Query (id=7f40dcb034de70b7:292a363c00000000): Summary: Session ID: e04567f29000ab88:f982c30f420379b6 Session Type: BEESWAX Start Time: 2017-03-02 08:13:24.558275000 End Time: 2017-03-02 08:34:31.659152000 Query Type: QUERY Query State: EXCEPTION Query Status: RPC client failed to connect: Couldn't open transport for vd1332.foo:22000 (Could not resolve host for client socket.) Impala Version: impalad version 2.7.0-cdh5.10.0 RELEASE (build 785a073cd07e2540d521ecebb8b38161ccbd2aa2) User: systest@foo Connected User: systest@foo Delegated User: Network Address: 10.17.187.36:34306 Default Db: tpcds_100000_parquet Sql Statement: select cd_gender, cd_marital_status, cd_education_status, count(*) cnt1, cd_purchase_estimate, count(*) cnt2, cd_credit_rating, count(*) cnt3, cd_dep_count, count(*) cnt4, cd_dep_employed_count, count(*) cnt5, cd_dep_college_count, count(*) cnt6 from customer c,customer_address ca,customer_demographics, (select ss_customer_sk from store_sales,date_dim where ss_sold_date_sk = d_date_sk and d_year = 2002 and d_moy between 2 and 2+3) ss, (select ws_bill_customer_sk from web_sales,date_dim where ws_sold_date_sk = d_date_sk and d_year = 2002 and d_moy between 2 ANd 2+3) ws, (select cs_ship_customer_sk from catalog_sales,date_dim where cs_sold_date_sk = d_date_sk and d_year = 2002 and d_moy between 2 and 2+3) cs where c.c_current_addr_sk = ca.ca_address_sk and ca_county in ('McKenzie County','Adams County','Grant County','Saguache County','Waseca County') and cd_demo_sk = c.c_current_cdemo_sk and c_customer_sk = ss_customer_sk and c_customer_sk = ws_bill_customer_sk and c_customer_sk = cs_ship_customer_sk group by cd_gender, cd_marital_status, cd_education_status, cd_purchase_estimate, cd_credit_rating, cd_dep_count, cd_dep_employed_count, cd_dep_college_count order by cd_gender, cd_marital_status, cd_education_status, cd_purchase_estimate, cd_credit_rating, cd_dep_count, cd_dep_employed_count, cd_dep_college_count limit 100 Coordinator: va1026.foo:22000 Query Options (non default): NUM_SCANNER_THREADS=12,SYNC_DDL=1,MAX_NUM_RUNTIME_FILTERS=50 Plan: ---------------- Estimated Per-Host Requirements: Memory=2.40GB VCores=6 PLAN-ROOT SINK | 31:MERGING-EXCHANGE [UNPARTITIONED] | order by: cd_gender ASC, cd_marital_status ASC, cd_education_status ASC, cd_purchase_estimate ASC, cd_credit_rating ASC, cd_dep_count ASC, cd_dep_employed_count ASC, cd_dep_college_count ASC | limit: 100 | hosts=134 per-host-mem=unavailable | tuple-ids=13 row-size=107B cardinality=100 | 18:TOP-N [LIMIT=100] | order by: cd_gender ASC, cd_marital_status ASC, cd_education_status ASC, cd_purchase_estimate ASC, cd_credit_rating ASC, cd_dep_count ASC, cd_dep_employed_count ASC, cd_dep_college_count ASC | hosts=134 per-host-mem=10.41KB | tuple-ids=13 row-size=107B cardinality=100 | 30:AGGREGATE [FINALIZE] | output: count:merge(*) | group by: cd_gender, cd_marital_status, cd_education_status, cd_purchase_estimate, cd_credit_rating, cd_dep_count, cd_dep_employed_count, cd_dep_college_count | hosts=134 per-host-mem=10.00MB | tuple-ids=12 row-size=107B cardinality=203712 | 29:EXCHANGE [HASH(cd_gender,cd_marital_status,cd_education_status,cd_purchase_estimate,cd_credit_rating,cd_dep_count,cd_dep_employed_count,cd_dep_college_count)] | hosts=134 per-host-mem=0B | tuple-ids=12 row-size=107B cardinality=203712 | 17:AGGREGATE [STREAMING] | output: count(*) | group by: cd_gender, cd_marital_status, cd_education_status, cd_purchase_estimate, cd_credit_rating, cd_dep_count, cd_dep_employed_count, cd_dep_college_count | hosts=134 per-host-mem=22.77MB | tuple-ids=12 row-size=107B cardinality=203712 | 16:HASH JOIN [INNER JOIN, PARTITIONED] | hash predicates: cd_demo_sk = c.c_current_cdemo_sk | runtime filters: RF000 <- c.c_current_cdemo_sk | hosts=134 per-host-mem=181.11KB | tuple-ids=2,6,7,3,4,9,10,0,1 row-size=212B cardinality=203712 | |--28:EXCHANGE [HASH(c.c_current_cdemo_sk)] | | hosts=134 per-host-mem=0B | | tuple-ids=6,7,3,4,9,10,0,1 row-size=110B cardinality=206237 | | | 15:HASH JOIN [INNER JOIN, BROADCAST] | | hash predicates: c.c_current_addr_sk = ca.ca_address_sk | | runtime filters: RF001 <- ca.ca_address_sk | | hosts=134 per-host-mem=4.82MB | | tuple-ids=6,7,3,4,9,10,0,1 row-size=110B cardinality=206237 | | | |--26:EXCHANGE [BROADCAST] | | | hosts=131 per-host-mem=0B | | | tuple-ids=1 row-size=34B cardinality=136986 | | | | | 01:SCAN HDFS [tpcds_100000_parquet.customer_address ca, RANDOM] | | partitions=1/1 files=133 size=946.04MB | | predicates: ca_county IN ('McKenzie County', 'Adams County', 'Grant County', 'Saguache County', 'Waseca County') | | table stats: 50000000 rows total | | column stats: all | | hosts=131 per-host-mem=32.00MB | | tuple-ids=1 row-size=34B cardinality=136986 | | | 14:HASH JOIN [INNER JOIN, PARTITIONED] | | hash predicates: ss_customer_sk = c_customer_sk | | runtime filters: RF002 <- c_customer_sk | | hosts=134 per-host-mem=9.39MB | | tuple-ids=6,7,3,4,9,10,0 row-size=76B cardinality=72517523 | | | |--25:EXCHANGE [HASH(c_customer_sk)] | | | hosts=132 per-host-mem=0B | | | tuple-ids=0 row-size=12B cardinality=100000000 | | | | | 00:SCAN HDFS [tpcds_100000_parquet.customer c, RANDOM] | | partitions=1/1 files=132 size=5.01GB | | runtime filters: RF001 -> c.c_current_addr_sk | | table stats: 100000000 rows total | | column stats: all | | hosts=132 per-host-mem=144.00MB | | tuple-ids=0 row-size=12B cardinality=100000000 | | | 13:HASH JOIN [INNER JOIN, PARTITIONED] | | hash predicates: ws_bill_customer_sk = ss_customer_sk | | runtime filters: RF003 <- ss_customer_sk | | hosts=134 per-host-mem=412.25MB | | tuple-ids=6,7,3,4,9,10 row-size=64B cardinality=77424064 | | | |--12:HASH JOIN [INNER JOIN, PARTITIONED] | | | hash predicates: ss_customer_sk = cs_ship_customer_sk | | | runtime filters: RF005 <- cs_ship_customer_sk | | | hosts=134 per-host-mem=1.70GB | | | tuple-ids=3,4,9,10 row-size=44B cardinality=1196792301 | | | | | |--23:EXCHANGE [HASH(cs_ship_customer_sk)] | | | | hosts=134 per-host-mem=0B | | | | tuple-ids=9,10 row-size=24B cardinality=9250396905 | | | | | | | 11:HASH JOIN [INNER JOIN, BROADCAST] | | | | hash predicates: cs_sold_date_sk = d_date_sk | | | | runtime filters: RF007 <- d_date_sk | | | | hosts=134 per-host-mem=1.52KB | | | | tuple-ids=9,10 row-size=24B cardinality=9250396905 | | | | | | | |--21:EXCHANGE [BROADCAST] | | | | | hosts=1 per-host-mem=0B | | | | | tuple-ids=10 row-size=12B cardinality=118 | | | | | | | | | 10:SCAN HDFS [tpcds_100000_parquet.date_dim, RANDOM] | | | | partitions=1/1 files=1 size=2.15MB | | | | predicates: d_year = 2002, d_moy <= 5, d_moy >= 2 | | | | table stats: 73049 rows total | | | | column stats: all | | | | hosts=1 per-host-mem=48.00MB | | | | tuple-ids=10 row-size=12B cardinality=118 | | | | | | | 09:SCAN HDFS [tpcds_100000_parquet.catalog_sales, RANDOM] | | | partitions=1837/1837 files=156142 size=9.72TB | | | runtime filters: RF002 -> tpcds_100000_parquet.catalog_sales.cs_ship_customer_sk, RF007 -> cs_sold_date_sk | | | table stats: 144008297565 rows total | | | column stats: all | | | hosts=134 per-host-mem=80.00MB | | | tuple-ids=9 row-size=12B cardinality=144008297565 | | | | | 22:EXCHANGE [HASH(ss_customer_sk)] | | | hosts=134 per-host-mem=0B | | | tuple-ids=3,4 row-size=20B cardinality=18631419110 | | | | | 05:HASH JOIN [INNER JOIN, BROADCAST] | | | hash predicates: ss_sold_date_sk = d_date_sk | | | runtime filters: RF006 <- d_date_sk | | | hosts=134 per-host-mem=1.52KB | | | tuple-ids=3,4 row-size=20B cardinality=18631419110 | | | | | |--20:EXCHANGE [BROADCAST] | | | | hosts=1 per-host-mem=0B | | | | tuple-ids=4 row-size=12B cardinality=118 | | | | | | | 04:SCAN HDFS [tpcds_100000_parquet.date_dim, RANDOM] | | | partitions=1/1 files=1 size=2.15MB | | | predicates: d_year = 2002, d_moy <= 5, d_moy >= 2 | | | table stats: 73049 rows total | | | column stats: all | | | hosts=1 per-host-mem=48.00MB | | | tuple-ids=4 row-size=12B cardinality=118 | | | | | 03:SCAN HDFS [tpcds_100000_parquet.store_sales, RANDOM] | | partitions=1824/1824 files=242616 size=13.73TB | | runtime filters: RF002 -> ss_customer_sk, RF005 -> ss_customer_sk, RF006 -> ss_sold_date_sk | | table stats: 287997529286 rows total | | column stats: all | | hosts=134 per-host-mem=72.00MB | | tuple-ids=3 row-size=8B cardinality=287997529286 | | | 24:EXCHANGE [HASH(ws_bill_customer_sk)] | | hosts=134 per-host-mem=0B | | tuple-ids=6,7 row-size=20B cardinality=4657445191 | | | 08:HASH JOIN [INNER JOIN, BROADCAST] | | hash predicates: ws_sold_date_sk = d_date_sk | | runtime filters: RF004 <- d_date_sk | | hosts=134 per-host-mem=1.52KB | | tuple-ids=6,7 row-size=20B cardinality=4657445191 | | | |--19:EXCHANGE [BROADCAST] | | | hosts=1 per-host-mem=0B | | | tuple-ids=7 row-size=12B cardinality=118 | | | | | 07:SCAN HDFS [tpcds_100000_parquet.date_dim, RANDOM] | | partitions=1/1 files=1 size=2.15MB | | predicates: d_year = 2002, d_moy <= 5, d_moy >= 2 | | table stats: 73049 rows total | | column stats: all | | hosts=1 per-host-mem=48.00MB | | tuple-ids=7 row-size=12B cardinality=118 | | | 06:SCAN HDFS [tpcds_100000_parquet.web_sales, RANDOM] | partitions=1824/1824 files=20737 size=4.70TB | runtime filters: RF002 -> tpcds_100000_parquet.web_sales.ws_bill_customer_sk, RF003 -> ws_bill_customer_sk, RF004 -> ws_sold_date_sk | table stats: 71993051084 rows total | column stats: all | hosts=134 per-host-mem=88.00MB | tuple-ids=6 row-size=8B cardinality=71993051084 | 27:EXCHANGE [HASH(cd_demo_sk)] | hosts=132 per-host-mem=0B | tuple-ids=2 row-size=103B cardinality=1920800 | 02:SCAN HDFS [tpcds_100000_parquet.customer_demographics, RANDOM] partitions=1/1 files=132 size=11.02MB runtime filters: RF000 -> cd_demo_sk table stats: 1920800 rows total column stats: all hosts=132 per-host-mem=144.00MB tuple-ids=2 row-size=103B cardinality=1920800 ---------------- Estimated Per-Host Mem: 2580027407 Estimated Per-Host VCores: 6 Request Pool: root.systest Admission result: Admitted immediately ExecSummary: Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail --------------------------------------------------------------------------------------------------------------------------------------- 31:MERGING-EXCHANGE 1 0.000ns 0.000ns 0 100 0 -1.00 B UNPARTITIONED 18:TOP-N 110 42.018us 84.905us 0 100 4.00 KB 10.41 KB 30:AGGREGATE 110 1.031ms 3.942ms 0 203.71K 2.34 MB 10.00 MB FINALIZE 29:EXCHANGE 110 0.000ns 0.000ns 0 203.71K 0 0 HASH(cd_gender,cd_marital_s... 17:AGGREGATE 110 735.091us 3.443ms 0 203.71K 1.34 MB 22.77 MB STREAMING 16:HASH JOIN 110 406.736us 1.141ms 0 203.71K 90.25 KB 181.11 KB INNER JOIN, PARTITIONED |--28:EXCHANGE 110 0.000ns 0.000ns 0 206.24K 0 0 HASH(c.c_current_cdemo_sk) | 15:HASH JOIN 134 997.429us 7.646ms 0 206.24K 153.09 MB 4.82 MB INNER JOIN, BROADCAST | |--26:EXCHANGE 134 27.025ms 146.830ms 451.92K 136.99K 0 0 BROADCAST | | 01:SCAN HDFS 113 173.467ms 600.617ms 451.92K 136.99K 18.43 MB 32.00 MB tpcds_100000_parquet.custom... | 14:HASH JOIN 134 963.410us 6.401ms 0 72.52M 25.08 MB 9.39 MB INNER JOIN, PARTITIONED | |--25:EXCHANGE 134 15.603ms 24.591ms 61.54M 100.00M 0 0 HASH(c_customer_sk) | | 00:SCAN HDFS 113 1s076ms 1s362ms 61.54M 100.00M 42.32 MB 144.00 MB tpcds_100000_parquet.custom... | 13:HASH JOIN 134 0.000ns 0.000ns 0 77.42M 160.56 GB 412.25 MB INNER JOIN, PARTITIONED | |--12:HASH JOIN 134 1m13s 1m22s 534.93B 1.20B 3.02 GB 1.70 GB INNER JOIN, PARTITIONED | | |--23:EXCHANGE 134 1s584ms 2s637ms 5.40B 9.25B 0 0 HASH(cs_ship_customer_sk) | | | 11:HASH JOIN 134 924.502ms 1s133ms 5.40B 9.25B 1.28 MB 1.52 KB INNER JOIN, BROADCAST | | | |--21:EXCHANGE 134 19.733us 38.004us 120 118 0 0 BROADCAST | | | | 10:SCAN HDFS 1 32.674ms 32.674ms 120 118 2.14 MB 48.00 MB tpcds_100000_parquet.date_dim | | | 09:SCAN HDFS 134 864.327ms 1s451ms 5.40B 144.01B 28.89 MB 80.00 MB tpcds_100000_parquet.catalo... | | 22:EXCHANGE 134 1s664ms 10s399ms 10.35B 18.63B 0 0 HASH(ss_customer_sk) | | 05:HASH JOIN 134 3s222ms 3s623ms 10.35B 18.63B 1.24 MB 1.52 KB INNER JOIN, BROADCAST | | |--20:EXCHANGE 134 21.297us 59.353us 120 118 0 0 BROADCAST | | | 04:SCAN HDFS 1 136.625ms 136.625ms 120 118 2.14 MB 48.00 MB tpcds_100000_parquet.date_dim | | 03:SCAN HDFS 134 841.490ms 2s563ms 10.35B 288.00B 30.09 MB 72.00 MB tpcds_100000_parquet.store_... | 24:EXCHANGE 134 4.290us 19.484us 0 4.66B 0 0 HASH(ws_bill_customer_sk) | 08:HASH JOIN 134 31.269ms 77.815ms 162.25M 4.66B 1.19 MB 1.52 KB INNER JOIN, BROADCAST | |--19:EXCHANGE 134 16.961us 43.317us 120 118 0 0 BROADCAST | | 07:SCAN HDFS 1 21.300ms 21.300ms 120 118 2.14 MB 48.00 MB tpcds_100000_parquet.date_dim | 06:SCAN HDFS 134 796.647ms 939.306ms 162.38M 71.99B 58.60 MB 88.00 MB tpcds_100000_parquet.web_sales 27:EXCHANGE 110 5.557us 21.377us 0 1.92M 0 0 HASH(cd_demo_sk) 02:SCAN HDFS 110 1s149ms 1s703ms 1.92M 1.92M 2.50 MB 144.00 MB tpcds_100000_parquet.custom... Planner Timeline: 188.872ms - Analysis finished: 4.706ms (4.706ms) - Equivalence classes computed: 6.540ms (1.834ms) - Single node plan created: 178.955ms (172.414ms) - Runtime filters computed: 179.320ms (365.179us) - Distributed plan created: 179.723ms (403.706us) - Lineage info computed: 179.908ms (184.401us) - Planning finished: 188.872ms (8.963ms) Query Timeline: 21m8s - Query submitted: 25.296us (25.296us) - Planning finished: 10m4s (10m4s) - Submit for admission: 10m5s (1s002ms) - Completed admission: 10m5s (1.056ms) - Ready to start 1096 fragment instances: 10m5s (177.325ms) - All 1096 fragment instances started: 10m7s (1s827ms) - First dynamic filter received: 10m8s (1s124ms) - Rows available: 21m7s (10m58s) - Unregister query: 21m7s (7.079ms) - ComputeScanRangeAssignmentTimer: 610.548ms ImpalaServer: - ClientFetchWaitTimer: 0.000ns - RowMaterializationTimer: 0.000ns Execution Profile 7f40dcb034de70b7:292a363c00000000:(Total: 11m1s, non-child: 0.000ns, % non-child: 0.00%) Number of filters: 8 Filter routing table: ID Src. Node Tgt. Node(s) Targets Target type Partition filter Pending (Expected) First arrived Completed Enabled ------------------------------------------------------------------------------------------------------------------------------------------------ 4 8 6 134 LOCAL true 0 (134) N/A N/A true 7 11 9 134 LOCAL true 0 (134) N/A N/A true 6 5 3 134 LOCAL true 0 (134) N/A N/A true 5 12 3 134 REMOTE false 134 (134) N/A N/A true 3 13 6 134 REMOTE false 134 (134) N/A N/A true 2 14 3, 9, 6 134, 134, 134 REMOTE, REMOTE, REMOTE false, false, false 134 (134) N/A N/A true 1 15 0 113 REMOTE false 1 (3) N/A N/A true 0 16 2 110 REMOTE false 110 (110) N/A N/A true Fragment instance start latencies: Count: 1096, 25th %-ile: 2ms, 50th %-ile: 3ms, 75th %-ile: 27ms, 90th %-ile: 32ms, 95th %-ile: 34ms, 99.9th %-ile: 217ms Per Node Peak Memory Usage: vd1122.foo:22000(169.55 GB) vd1109.foo:22000(169.55 GB) vd1140.foo:22000(169.56 GB) ve1131.foo:22000(169.57 GB) vd1336.foo:22000(169.57 GB) va1043.foo:22000(169.56 GB) vd1127.foo:22000(169.57 GB) ve1137.foo:22000(169.56 GB) vd1335.foo:22000(169.54 GB) vd1124.foo:22000(169.55 GB) vd1112.foo:22000(169.55 GB) vc1525.foo:22000(169.54 GB) vc1537.foo:22000(169.57 GB) vd1134.foo:22000(169.55 GB) vc1507.foo:22000(169.57 GB) vd1114.foo:22000(169.50 GB) vd1118.foo:22000(169.55 GB) vd1132.foo:22000(169.57 GB) va1036.foo:22000(169.56 GB) vd1329.foo:22000(169.58 GB) vc1521.foo:22000(169.57 GB) vc1539.foo:22000(169.57 GB) vd1123.foo:22000(169.57 GB) vc1513.foo:22000(169.55 GB) va1031.foo:22000(169.55 GB) vc1505.foo:22000(169.56 GB) vc1529.foo:22000(169.56 GB) vd1136.foo:22000(169.56 GB) ve1130.foo:22000(169.56 GB) vd1135.foo:22000(169.57 GB) vd1337.foo:22000(169.56 GB) ve1129.foo:22000(169.57 GB) vd1339.foo:22000(169.57 GB) vc1517.foo:22000(169.57 GB) ve1128.foo:22000(169.55 GB) vc1542.foo:22000(169.57 GB) va1045.foo:22000(169.56 GB) ve1127.foo:22000(169.56 GB) vc1527.foo:22000(169.57 GB) ve1140.foo:22000(169.57 GB) vc1532.foo:22000(169.55 GB) ve1142.foo:22000(169.58 GB) ve1138.foo:22000(169.54 GB) vd1113.foo:22000(169.56 GB) vd1108.foo:22000(169.56 GB) vd1110.foo:22000(169.55 GB) va1030.foo:22000(169.57 GB) vd1111.foo:22000(169.55 GB) vd1326.foo:22000(169.56 GB) vc1536.foo:22000(169.57 GB) vd1101.foo:22000(169.56 GB) vd1341.foo:22000(169.56 GB) vd1102.foo:22000(169.56 GB) ve1134.foo:22000(169.56 GB) va1042.foo:22000(169.58 GB) vc1535.foo:22000(169.57 GB) va1037.foo:22000(169.56 GB) vc1510.foo:22000(169.57 GB) vd1327.foo:22000(169.56 GB) ve1132.foo:22000(169.57 GB) vd1139.foo:22000(169.56 GB) vc1519.foo:22000(169.57 GB) vd1338.foo:22000(169.56 GB) vd1330.foo:22000(169.56 GB) vd1125.foo:22000(169.56 GB) va1041.foo:22000(169.56 GB) ve1135.foo:22000(169.56 GB) vd1138.foo:22000(169.55 GB) vd1121.foo:22000(169.57 GB) vc1526.foo:22000(169.56 GB) vc1501.foo:22000(169.58 GB) vd1120.foo:22000(169.56 GB) va1032.foo:22000(169.56 GB) vd1104.foo:22000(169.57 GB) va1035.foo:22000(169.56 GB) va1038.foo:22000(169.57 GB) vc1520.foo:22000(169.57 GB) vc1503.foo:22000(169.57 GB) vd1119.foo:22000(169.57 GB) va1027.foo:22000(169.54 GB) vd1105.foo:22000(169.57 GB) vd1115.foo:22000(169.57 GB) vc1541.foo:22000(169.55 GB) vd1129.foo:22000(169.56 GB) vc1531.foo:22000(169.56 GB) va1046.foo:22000(169.56 GB) va1039.foo:22000(169.56 GB) vd1103.foo:22000(169.56 GB) vc1515.foo:22000(169.57 GB) vd1328.foo:22000(169.56 GB) vc1506.foo:22000(169.56 GB) vc1528.foo:22000(169.58 GB) vd1130.foo:22000(169.56 GB) ve1136.foo:22000(169.56 GB) vd1333.foo:22000(169.57 GB) vc1514.foo:22000(169.56 GB) vc1530.foo:22000(169.56 GB) vd1133.foo:22000(169.56 GB) vd1334.foo:22000(169.57 GB) ve1139.foo:22000(169.57 GB) ve1126.foo:22000(169.56 GB) vd1126.foo:22000(169.56 GB) vc1523.foo:22000(169.56 GB) vc1524.foo:22000(169.57 GB) vd1116.foo:22000(169.56 GB) va1028.foo:22000(169.57 GB) vd1332.foo:22000(169.55 GB) vd1117.foo:22000(169.56 GB) ve1141.foo:22000(169.58 GB) vc1508.foo:22000(169.57 GB) vc1518.foo:22000(169.57 GB) vd1331.foo:22000(169.56 GB) vd1141.foo:22000(169.58 GB) vc1502.foo:22000(169.57 GB) vd1107.foo:22000(169.55 GB) vd1342.foo:22000(169.55 GB) va1029.foo:22000(169.56 GB) vc1522.foo:22000(169.56 GB) vc1509.foo:22000(169.56 GB) ve1125.foo:22000(169.57 GB) va1044.foo:22000(169.57 GB) vd1142.foo:22000(169.56 GB) vc1533.foo:22000(169.57 GB) vc1538.foo:22000(169.56 GB) vc1516.foo:22000(169.57 GB) vd1131.foo:22000(169.56 GB) vc1504.foo:22000(169.55 GB) vc1511.foo:22000(169.54 GB) va1033.foo:22000(169.57 GB) vd1340.foo:22000(169.56 GB) va1034.foo:22000(169.57 GB) vc1540.foo:22000(169.58 GB) vc1534.foo:22000(169.55 GB) va1026.foo:22000(169.57 GB) Final filter table: ID Src. Node Tgt. Node(s) Targets Target type Partition filter Pending (Expected) First arrived Completed Enabled ------------------------------------------------------------------------------------------------------------------------------------------------ 4 8 6 134 LOCAL true 0 (134) N/A N/A true 7 11 9 134 LOCAL true 0 (134) N/A N/A true 6 5 3 134 LOCAL true 0 (134) N/A N/A true 5 12 3 134 REMOTE false 0 (134) 10m19s 10m21s false 3 13 6 134 REMOTE false 0 (134) 19m30s 19m30s false 2 14 3, 9, 6 134, 134, 134 REMOTE, REMOTE, REMOTE false, false, false 0 (134) 10m10s 10m13s false 1 15 0 113 REMOTE false 0 (3) 10m8s 10m8s false 0 16 2 110 REMOTE false 110 (110) N/A N/A true - FiltersReceived: 270 (270) - FinalizationTimer: 0.000ns Coordinator Fragment F12: Instance 7f40dcb034de70b7:292a363c00000000 (host=va1026.foo:22000):(Total: 37.860ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 9.24 KB, 9.24 KB, 9.24 KB, 9.24 KB, 9.24 KB, 9.24 KB, 9.24 KB, 9.24 KB, 9.24 KB, 9.24 KB, 9.24 KB, 9.24 KB, 9.24 KB, 9.24 KB, 9.24 KB, 9.24 KB, 9.24 KB, 9.24 KB, 9.24 KB, 9.24 KB, 9.24 KB, 9.24 KB, 9.24 KB, 9.24 KB, 9.24 KB, 9.24 KB, 9.24 KB, 9.24 KB, 9.24 KB, 9.24 KB, 9.24 KB, 9.24 KB, 9.24 KB, 9.24 KB, 9.24 KB, 9.24 KB, 9.24 KB, 9.24 KB, 9.24 KB - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 489.00 KB (500736) - PerHostPeakMemUsage: 169.56 GB (182068681164) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 37.760ms - ExecTreePrepareTime: 289.520us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 23.93K (23925) - BlocksRecycled: 354 (354) - BufferedPins: 0 (0) - BytesWritten: 40.41 GB (43385880576) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 161.38 GB (173284007936) - ScratchFileUsedBytes: 40.41 GB (43385880576) - TotalBufferWaitTime: 5s108ms - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns PLAN_ROOT_SINK: - PeakMemoryUsage: 0 CodeGen:(Total: 142.859ms, non-child: 142.859ms, % non-child: 100.00%) - CodegenTime: 2.390ms - CompileTime: 34.343ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 35 (35) - NumInstructions: 962 (962) - OptimizationTime: 73.256ms - PeakMemoryUsage: 481.00 KB (492544) - PrepareTime: 34.630ms EXCHANGE_NODE (id=31): ExecOption: Codegen Enabled BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - MergeGetNext: 0.000ns - MergeGetNextBatch: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Averaged Fragment F11:(Total: 33.381ms, non-child: 0.000ns, % non-child: 0.00%) split sizes: min: 0, max: 0, avg: 0, stddev: 0 completion times: min:11m1s max:11m1s mean: 11m1s stddev:4.916ms execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec num instances: 110 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 4.01 MB (4206640) - PerHostPeakMemUsage: 169.56 GB (182067197194) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 33.318ms - ExecTreePrepareTime: 1.074ms BlockMgr: - BlockWritesOutstanding: 2 (2) - BlocksCreated: 24.24K (24242) - BlocksRecycled: 466 (466) - BufferedPins: 0 (0) - BytesWritten: 44.96 GB (48277978234) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 161.38 GB (173284007936) - ScratchFileUsedBytes: 44.96 GB (48277978234) - TotalBufferWaitTime: 7s833ms - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=31):(Total: 22.026us, non-child: 22.026us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.42 KB (1456) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 338.932ms, non-child: 338.932ms, % non-child: 100.00%) - CodegenTime: 6.751ms - CompileTime: 80.545ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 131 (131) - NumInstructions: 3.40K (3397) - OptimizationTime: 231.027ms - PeakMemoryUsage: 1.66 MB (1739264) - PrepareTime: 26.515ms SORT_NODE (id=18):(Total: 1.073ms, non-child: 42.019us, % non-child: 3.91%) - InsertBatchTime: 0.000ns - PeakMemoryUsage: 4.00 KB (4096) - RowsReturned: 0 (0) - RowsReturnedRate: 0 AGGREGATION_NODE (id=30):(Total: 1.031ms, non-child: 1.031ms, % non-child: 100.00%) - BuildTime: 0.000ns - GetNewBlockTime: 266.886us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.34 MB (2457728) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.736us EXCHANGE_NODE (id=29): - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Fragment F11: Instance 7f40dcb034de70b7:3f9 (host=vc1524.foo:22000):(Total: 336.376ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 2.42 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 4.01 MB (4206640) - PerHostPeakMemUsage: 169.57 GB (182077603970) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 336.281ms - ExecTreePrepareTime: 3.990ms BlockMgr: - BlockWritesOutstanding: 1 (1) - BlocksCreated: 25.19K (25186) - BlocksRecycled: 1.09K (1090) - BufferedPins: 0 (0) - BytesWritten: 58.24 GB (62537072640) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 161.38 GB (173284007936) - ScratchFileUsedBytes: 58.24 GB (62537072640) - TotalBufferWaitTime: 5s224ms - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=31):(Total: 29.770us, non-child: 29.770us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.42 KB (1456) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 859.731ms, non-child: 859.731ms, % non-child: 100.00%) - CodegenTime: 147.308ms - CompileTime: 92.856ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 131 (131) - NumInstructions: 3.40K (3397) - OptimizationTime: 515.063ms - PeakMemoryUsage: 1.66 MB (1739264) - PrepareTime: 232.819ms SORT_NODE (id=18):(Total: 3.989ms, non-child: 47.440us, % non-child: 1.19%) ExecOption: Codegen Enabled - InsertBatchTime: 0.000ns - PeakMemoryUsage: 4.00 KB (4096) - RowsReturned: 0 (0) - RowsReturnedRate: 0 AGGREGATION_NODE (id=30):(Total: 3.942ms, non-child: 3.942ms, % non-child: 100.00%) ExecOption: Codegen Enabled - BuildTime: 0.000ns - GetNewBlockTime: 1.150ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.34 MB (2457728) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.018us EXCHANGE_NODE (id=29): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:3fa (host=vd1331.foo:22000):(Total: 134.064ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 4.01 MB (4206640) - PerHostPeakMemUsage: 169.56 GB (182068619987) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 134.003ms - ExecTreePrepareTime: 1.914ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 24.04K (24040) - BlocksRecycled: 354 (354) - BufferedPins: 0 (0) - BytesWritten: 41.30 GB (44350570496) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 161.38 GB (173284007936) - ScratchFileUsedBytes: 41.30 GB (44350570496) - TotalBufferWaitTime: 3s584ms - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=31):(Total: 13.005us, non-child: 13.005us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.42 KB (1456) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 451.257ms, non-child: 451.257ms, % non-child: 100.00%) - CodegenTime: 37.625ms - CompileTime: 82.033ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 131 (131) - NumInstructions: 3.40K (3397) - OptimizationTime: 255.543ms - PeakMemoryUsage: 1.66 MB (1739264) - PrepareTime: 101.665ms SORT_NODE (id=18):(Total: 1.914ms, non-child: 38.222us, % non-child: 2.00%) ExecOption: Codegen Enabled - InsertBatchTime: 0.000ns - PeakMemoryUsage: 4.00 KB (4096) - RowsReturned: 0 (0) - RowsReturnedRate: 0 AGGREGATION_NODE (id=30):(Total: 1.875ms, non-child: 1.875ms, % non-child: 100.00%) ExecOption: Codegen Enabled - BuildTime: 0.000ns - GetNewBlockTime: 275.490us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.34 MB (2457728) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.096us EXCHANGE_NODE (id=29): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:40a (host=va1026.foo:22000):(Total: 40.547ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 2.42 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 4.01 MB (4206640) - PerHostPeakMemUsage: 169.57 GB (182069270988) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 40.481ms - ExecTreePrepareTime: 1.442ms DataStreamSender (dst_id=31):(Total: 19.973us, non-child: 19.973us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.42 KB (1456) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 424.277ms, non-child: 424.277ms, % non-child: 100.00%) - CodegenTime: 8.151ms - CompileTime: 85.051ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 131 (131) - NumInstructions: 3.40K (3397) - OptimizationTime: 305.878ms - PeakMemoryUsage: 1.66 MB (1739264) - PrepareTime: 32.788ms SORT_NODE (id=18):(Total: 1.441ms, non-child: 52.902us, % non-child: 3.67%) ExecOption: Codegen Enabled - InsertBatchTime: 0.000ns - PeakMemoryUsage: 4.00 KB (4096) - RowsReturned: 0 (0) - RowsReturnedRate: 0 AGGREGATION_NODE (id=30):(Total: 1.388ms, non-child: 1.388ms, % non-child: 100.00%) ExecOption: Codegen Enabled - BuildTime: 0.000ns - GetNewBlockTime: 295.966us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.34 MB (2457728) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.368us EXCHANGE_NODE (id=29): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:3dd (host=vc1502.foo:22000):(Total: 39.942ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 2.42 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 4.01 MB (4206640) - PerHostPeakMemUsage: 169.57 GB (182069848181) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 39.875ms - ExecTreePrepareTime: 1.319ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 23.72K (23719) - BlocksRecycled: 354 (354) - BufferedPins: 0 (0) - BytesWritten: 38.79 GB (41649438720) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 161.38 GB (173284007936) - ScratchFileUsedBytes: 38.79 GB (41649438720) - TotalBufferWaitTime: 6s485ms - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=31):(Total: 30.240us, non-child: 30.240us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.42 KB (1456) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 348.296ms, non-child: 348.296ms, % non-child: 100.00%) - CodegenTime: 6.711ms - CompileTime: 80.680ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 131 (131) - NumInstructions: 3.40K (3397) - OptimizationTime: 234.069ms - PeakMemoryUsage: 1.66 MB (1739264) - PrepareTime: 32.830ms SORT_NODE (id=18):(Total: 1.317ms, non-child: 41.963us, % non-child: 3.18%) ExecOption: Codegen Enabled - InsertBatchTime: 0.000ns - PeakMemoryUsage: 4.00 KB (4096) - RowsReturned: 0 (0) - RowsReturnedRate: 0 AGGREGATION_NODE (id=30):(Total: 1.275ms, non-child: 1.275ms, % non-child: 100.00%) ExecOption: Codegen Enabled - BuildTime: 0.000ns - GetNewBlockTime: 410.120us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.34 MB (2457728) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.843us EXCHANGE_NODE (id=29): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:3e4 (host=vd1131.foo:22000):(Total: 39.788ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 4.01 MB (4206640) - PerHostPeakMemUsage: 169.56 GB (182064558770) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 39.711ms - ExecTreePrepareTime: 1.349ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 24.90K (24901) - BlocksRecycled: 355 (355) - BufferedPins: 0 (0) - BytesWritten: 48.02 GB (51564773376) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 161.38 GB (173284007936) - ScratchFileUsedBytes: 48.02 GB (51564773376) - TotalBufferWaitTime: 21s709ms - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=31):(Total: 27.236us, non-child: 27.236us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.42 KB (1456) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 346.333ms, non-child: 346.333ms, % non-child: 100.00%) - CodegenTime: 7.139ms - CompileTime: 80.980ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 131 (131) - NumInstructions: 3.40K (3397) - OptimizationTime: 232.617ms - PeakMemoryUsage: 1.66 MB (1739264) - PrepareTime: 32.023ms SORT_NODE (id=18):(Total: 1.349ms, non-child: 37.189us, % non-child: 2.76%) ExecOption: Codegen Enabled - InsertBatchTime: 0.000ns - PeakMemoryUsage: 4.00 KB (4096) - RowsReturned: 0 (0) - RowsReturnedRate: 0 AGGREGATION_NODE (id=30):(Total: 1.311ms, non-child: 1.311ms, % non-child: 100.00%) ExecOption: Codegen Enabled - BuildTime: 0.000ns - GetNewBlockTime: 415.556us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.34 MB (2457728) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.905us EXCHANGE_NODE (id=29): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:42b (host=vd1136.foo:22000):(Total: 38.076ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 2.42 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 4.01 MB (4206640) - PerHostPeakMemUsage: 169.56 GB (182067830856) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 37.985ms - ExecTreePrepareTime: 1.411ms BlockMgr: - BlockWritesOutstanding: 4 (4) - BlocksCreated: 24.11K (24114) - BlocksRecycled: 354 (354) - BufferedPins: 0 (0) - BytesWritten: 41.91 GB (45004881920) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 161.38 GB (173284007936) - ScratchFileUsedBytes: 41.91 GB (45004881920) - TotalBufferWaitTime: 8s106ms - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=31):(Total: 23.484us, non-child: 23.484us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.42 KB (1456) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 352.807ms, non-child: 352.807ms, % non-child: 100.00%) - CodegenTime: 6.741ms - CompileTime: 77.614ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 131 (131) - NumInstructions: 3.40K (3397) - OptimizationTime: 243.931ms - PeakMemoryUsage: 1.66 MB (1739264) - PrepareTime: 30.400ms SORT_NODE (id=18):(Total: 1.410ms, non-child: 42.832us, % non-child: 3.04%) ExecOption: Codegen Enabled - InsertBatchTime: 0.000ns - PeakMemoryUsage: 4.00 KB (4096) - RowsReturned: 0 (0) - RowsReturnedRate: 0 AGGREGATION_NODE (id=30):(Total: 1.367ms, non-child: 1.367ms, % non-child: 100.00%) ExecOption: Codegen Enabled - BuildTime: 0.000ns - GetNewBlockTime: 409.828us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.34 MB (2457728) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.931us EXCHANGE_NODE (id=29): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:434 (host=vd1337.foo:22000):(Total: 37.433ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 2.42 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 4.01 MB (4206640) - PerHostPeakMemUsage: 169.56 GB (182064161916) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 37.366ms - ExecTreePrepareTime: 1.050ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 24.59K (24593) - BlocksRecycled: 888 (888) - BufferedPins: 0 (0) - BytesWritten: 45.62 GB (48981082112) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 161.38 GB (173284007936) - ScratchFileUsedBytes: 45.62 GB (48981082112) - TotalBufferWaitTime: 3s012ms - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=31):(Total: 33.945us, non-child: 33.945us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.42 KB (1456) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 376.709ms, non-child: 376.709ms, % non-child: 100.00%) - CodegenTime: 6.396ms - CompileTime: 90.499ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 131 (131) - NumInstructions: 3.40K (3397) - OptimizationTime: 254.755ms - PeakMemoryUsage: 1.66 MB (1739264) - PrepareTime: 30.675ms SORT_NODE (id=18):(Total: 1.049ms, non-child: 46.020us, % non-child: 4.39%) ExecOption: Codegen Enabled - InsertBatchTime: 0.000ns - PeakMemoryUsage: 4.00 KB (4096) - RowsReturned: 0 (0) - RowsReturnedRate: 0 AGGREGATION_NODE (id=30):(Total: 1.003ms, non-child: 1.003ms, % non-child: 100.00%) ExecOption: Codegen Enabled - BuildTime: 0.000ns - GetNewBlockTime: 216.823us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.34 MB (2457728) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.551us EXCHANGE_NODE (id=29): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:3db (host=vc1533.foo:22000):(Total: 37.170ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 2.42 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 4.01 MB (4206640) - PerHostPeakMemUsage: 169.57 GB (182078129765) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 37.119ms - ExecTreePrepareTime: 974.918us BlockMgr: - BlockWritesOutstanding: 15 (15) - BlocksCreated: 24.04K (24039) - BlocksRecycled: 372 (372) - BufferedPins: 0 (0) - BytesWritten: 43.72 GB (46942650368) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 161.38 GB (173284007936) - ScratchFileUsedBytes: 43.72 GB (46942650368) - TotalBufferWaitTime: 12s477ms - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=31):(Total: 20.076us, non-child: 20.076us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.42 KB (1456) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 335.511ms, non-child: 335.511ms, % non-child: 100.00%) - CodegenTime: 5.057ms - CompileTime: 79.309ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 131 (131) - NumInstructions: 3.40K (3397) - OptimizationTime: 225.663ms - PeakMemoryUsage: 1.66 MB (1739264) - PrepareTime: 29.901ms SORT_NODE (id=18):(Total: 973.685us, non-child: 39.561us, % non-child: 4.06%) ExecOption: Codegen Enabled - InsertBatchTime: 0.000ns - PeakMemoryUsage: 4.00 KB (4096) - RowsReturned: 0 (0) - RowsReturnedRate: 0 AGGREGATION_NODE (id=30):(Total: 934.124us, non-child: 934.124us, % non-child: 100.00%) ExecOption: Codegen Enabled - BuildTime: 0.000ns - GetNewBlockTime: 223.322us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.34 MB (2457728) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.522us EXCHANGE_NODE (id=29): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:3f5 (host=vc1523.foo:22000):(Total: 36.919ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 4.01 MB (4206640) - PerHostPeakMemUsage: 169.56 GB (182059761730) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 36.824ms - ExecTreePrepareTime: 1.468ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 24.29K (24288) - BlocksRecycled: 354 (354) - BufferedPins: 0 (0) - BytesWritten: 43.23 GB (46422556672) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 161.38 GB (173284007936) - ScratchFileUsedBytes: 43.23 GB (46422556672) - TotalBufferWaitTime: 4s173ms - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=31):(Total: 29.809us, non-child: 29.809us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.42 KB (1456) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 338.660ms, non-child: 338.660ms, % non-child: 100.00%) - CodegenTime: 6.093ms - CompileTime: 83.267ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 131 (131) - NumInstructions: 3.40K (3397) - OptimizationTime: 225.031ms - PeakMemoryUsage: 1.66 MB (1739264) - PrepareTime: 29.527ms SORT_NODE (id=18):(Total: 1.467ms, non-child: 44.092us, % non-child: 3.00%) ExecOption: Codegen Enabled - InsertBatchTime: 0.000ns - PeakMemoryUsage: 4.00 KB (4096) - RowsReturned: 0 (0) - RowsReturnedRate: 0 AGGREGATION_NODE (id=30):(Total: 1.423ms, non-child: 1.423ms, % non-child: 100.00%) ExecOption: Codegen Enabled - BuildTime: 0.000ns - GetNewBlockTime: 459.337us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.34 MB (2457728) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.888us EXCHANGE_NODE (id=29): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:42a (host=vd1135.foo:22000):(Total: 36.461ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 4.01 MB (4206640) - PerHostPeakMemUsage: 169.57 GB (182070255547) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 36.397ms - ExecTreePrepareTime: 1.361ms BlockMgr: - BlockWritesOutstanding: 15 (15) - BlocksCreated: 24.51K (24513) - BlocksRecycled: 354 (354) - BufferedPins: 0 (0) - BytesWritten: 48.37 GB (51933872128) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 161.38 GB (173284007936) - ScratchFileUsedBytes: 48.37 GB (51933872128) - TotalBufferWaitTime: 4s673ms - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=31):(Total: 33.100us, non-child: 33.100us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.42 KB (1456) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 338.066ms, non-child: 338.066ms, % non-child: 100.00%) - CodegenTime: 6.422ms - CompileTime: 77.989ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 131 (131) - NumInstructions: 3.40K (3397) - OptimizationTime: 230.501ms - PeakMemoryUsage: 1.66 MB (1739264) - PrepareTime: 28.785ms SORT_NODE (id=18):(Total: 1.360ms, non-child: 37.238us, % non-child: 2.74%) ExecOption: Codegen Enabled - InsertBatchTime: 0.000ns - PeakMemoryUsage: 4.00 KB (4096) - RowsReturned: 0 (0) - RowsReturnedRate: 0 AGGREGATION_NODE (id=30):(Total: 1.323ms, non-child: 1.323ms, % non-child: 100.00%) ExecOption: Codegen Enabled - BuildTime: 0.000ns - GetNewBlockTime: 385.638us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.34 MB (2457728) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.993us EXCHANGE_NODE (id=29): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:3fc (host=vc1515.foo:22000):(Total: 35.968ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 2.36 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 4.01 MB (4206640) - PerHostPeakMemUsage: 169.57 GB (182074877824) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 35.892ms - ExecTreePrepareTime: 1.282ms BlockMgr: - BlockWritesOutstanding: 1 (1) - BlocksCreated: 23.82K (23821) - BlocksRecycled: 354 (354) - BufferedPins: 0 (0) - BytesWritten: 39.59 GB (42513465344) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 161.38 GB (173284007936) - ScratchFileUsedBytes: 39.59 GB (42513465344) - TotalBufferWaitTime: 11s107ms - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=31):(Total: 28.198us, non-child: 28.198us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.42 KB (1456) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 328.515ms, non-child: 328.515ms, % non-child: 100.00%) - CodegenTime: 6.246ms - CompileTime: 76.941ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 131 (131) - NumInstructions: 3.40K (3397) - OptimizationTime: 221.695ms - PeakMemoryUsage: 1.66 MB (1739264) - PrepareTime: 29.109ms SORT_NODE (id=18):(Total: 1.281ms, non-child: 40.504us, % non-child: 3.16%) ExecOption: Codegen Enabled - InsertBatchTime: 0.000ns - PeakMemoryUsage: 4.00 KB (4096) - RowsReturned: 0 (0) - RowsReturnedRate: 0 AGGREGATION_NODE (id=30):(Total: 1.240ms, non-child: 1.240ms, % non-child: 100.00%) ExecOption: Codegen Enabled - BuildTime: 0.000ns - GetNewBlockTime: 353.152us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.34 MB (2457728) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.970us EXCHANGE_NODE (id=29): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:406 (host=ve1132.foo:22000):(Total: 35.558ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 2.36 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 4.01 MB (4206640) - PerHostPeakMemUsage: 169.57 GB (182073146432) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 35.487ms - ExecTreePrepareTime: 1.216ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 24.21K (24215) - BlocksRecycled: 354 (354) - BufferedPins: 0 (0) - BytesWritten: 42.67 GB (45818576896) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 161.38 GB (173284007936) - ScratchFileUsedBytes: 42.67 GB (45818576896) - TotalBufferWaitTime: 24s807ms - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=31):(Total: 30.898us, non-child: 30.898us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.42 KB (1456) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 350.670ms, non-child: 350.670ms, % non-child: 100.00%) - CodegenTime: 6.333ms - CompileTime: 95.914ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 131 (131) - NumInstructions: 3.40K (3397) - OptimizationTime: 225.595ms - PeakMemoryUsage: 1.66 MB (1739264) - PrepareTime: 28.302ms SORT_NODE (id=18):(Total: 1.215ms, non-child: 39.882us, % non-child: 3.28%) ExecOption: Codegen Enabled - InsertBatchTime: 0.000ns - PeakMemoryUsage: 4.00 KB (4096) - RowsReturned: 0 (0) - RowsReturnedRate: 0 AGGREGATION_NODE (id=30):(Total: 1.175ms, non-child: 1.175ms, % non-child: 100.00%) ExecOption: Codegen Enabled - BuildTime: 0.000ns - GetNewBlockTime: 388.025us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.34 MB (2457728) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.733us EXCHANGE_NODE (id=29): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:405 (host=vc1534.foo:22000):(Total: 35.394ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 2.42 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 4.01 MB (4206640) - PerHostPeakMemUsage: 169.55 GB (182056259688) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 35.334ms - ExecTreePrepareTime: 1.032ms BlockMgr: - BlockWritesOutstanding: 15 (15) - BlocksCreated: 24.00K (24004) - BlocksRecycled: 568 (568) - BufferedPins: 0 (0) - BytesWritten: 46.87 GB (50323259392) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 161.38 GB (173284007936) - ScratchFileUsedBytes: 46.87 GB (50323259392) - TotalBufferWaitTime: 6s455ms - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=31):(Total: 20.881us, non-child: 20.881us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.42 KB (1456) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 318.557ms, non-child: 318.557ms, % non-child: 100.00%) - CodegenTime: 4.833ms - CompileTime: 74.412ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 131 (131) - NumInstructions: 3.40K (3397) - OptimizationTime: 214.318ms - PeakMemoryUsage: 1.66 MB (1739264) - PrepareTime: 29.229ms SORT_NODE (id=18):(Total: 1.031ms, non-child: 40.961us, % non-child: 3.97%) ExecOption: Codegen Enabled - InsertBatchTime: 0.000ns - PeakMemoryUsage: 4.00 KB (4096) - RowsReturned: 0 (0) - RowsReturnedRate: 0 AGGREGATION_NODE (id=30):(Total: 990.439us, non-child: 990.439us, % non-child: 100.00%) ExecOption: Codegen Enabled - BuildTime: 0.000ns - GetNewBlockTime: 259.783us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.34 MB (2457728) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.789us EXCHANGE_NODE (id=29): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:439 (host=va1033.foo:22000):(Total: 34.901ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 2.42 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 4.01 MB (4206640) - PerHostPeakMemUsage: 169.57 GB (182072814812) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 34.851ms - ExecTreePrepareTime: 939.630us BlockMgr: - BlockWritesOutstanding: 1 (1) - BlocksCreated: 24.27K (24275) - BlocksRecycled: 354 (354) - BufferedPins: 0 (0) - BytesWritten: 43.14 GB (46321893376) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 161.38 GB (173284007936) - ScratchFileUsedBytes: 43.14 GB (46321893376) - TotalBufferWaitTime: 5s386ms - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=31):(Total: 18.987us, non-child: 18.987us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.42 KB (1456) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 331.862ms, non-child: 331.862ms, % non-child: 100.00%) - CodegenTime: 5.281ms - CompileTime: 82.824ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 131 (131) - NumInstructions: 3.40K (3397) - OptimizationTime: 219.086ms - PeakMemoryUsage: 1.66 MB (1739264) - PrepareTime: 29.242ms SORT_NODE (id=18):(Total: 938.511us, non-child: 42.665us, % non-child: 4.55%) ExecOption: Codegen Enabled - InsertBatchTime: 0.000ns - PeakMemoryUsage: 4.00 KB (4096) - RowsReturned: 0 (0) - RowsReturnedRate: 0 AGGREGATION_NODE (id=30):(Total: 895.846us, non-child: 895.846us, % non-child: 100.00%) ExecOption: Codegen Enabled - BuildTime: 0.000ns - GetNewBlockTime: 222.181us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.34 MB (2457728) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.816us EXCHANGE_NODE (id=29): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:3f6 (host=vc1516.foo:22000):(Total: 34.858ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 2.42 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 4.01 MB (4206640) - PerHostPeakMemUsage: 169.57 GB (182072988562) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 34.814ms - ExecTreePrepareTime: 1.290ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 23.44K (23441) - BlocksRecycled: 354 (354) - BufferedPins: 0 (0) - BytesWritten: 36.62 GB (39317405696) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 161.38 GB (173284007936) - ScratchFileUsedBytes: 36.62 GB (39317405696) - TotalBufferWaitTime: 3s428ms - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=31):(Total: 27.577us, non-child: 27.577us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.42 KB (1456) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 352.756ms, non-child: 352.756ms, % non-child: 100.00%) - CodegenTime: 6.687ms - CompileTime: 88.158ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 131 (131) - NumInstructions: 3.40K (3397) - OptimizationTime: 235.986ms - PeakMemoryUsage: 1.66 MB (1739264) - PrepareTime: 27.695ms SORT_NODE (id=18):(Total: 1.289ms, non-child: 44.529us, % non-child: 3.45%) ExecOption: Codegen Enabled - InsertBatchTime: 0.000ns - PeakMemoryUsage: 4.00 KB (4096) - RowsReturned: 0 (0) - RowsReturnedRate: 0 AGGREGATION_NODE (id=30):(Total: 1.244ms, non-child: 1.244ms, % non-child: 100.00%) ExecOption: Codegen Enabled - BuildTime: 0.000ns - GetNewBlockTime: 262.371us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.34 MB (2457728) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 2.159us EXCHANGE_NODE (id=29): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:407 (host=vd1104.foo:22000):(Total: 34.648ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 2.42 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 4.01 MB (4206640) - PerHostPeakMemUsage: 169.57 GB (182079364681) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 34.536ms - ExecTreePrepareTime: 1.357ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 23.74K (23736) - BlocksRecycled: 354 (354) - BufferedPins: 0 (0) - BytesWritten: 38.92 GB (41792045056) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 161.38 GB (173284007936) - ScratchFileUsedBytes: 38.92 GB (41792045056) - TotalBufferWaitTime: 2s289ms - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=31):(Total: 34.653us, non-child: 34.653us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.42 KB (1456) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 329.275ms, non-child: 329.275ms, % non-child: 100.00%) - CodegenTime: 7.100ms - CompileTime: 83.666ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 131 (131) - NumInstructions: 3.40K (3397) - OptimizationTime: 218.400ms - PeakMemoryUsage: 1.66 MB (1739264) - PrepareTime: 26.468ms SORT_NODE (id=18):(Total: 1.355ms, non-child: 59.851us, % non-child: 4.41%) ExecOption: Codegen Enabled - InsertBatchTime: 0.000ns - PeakMemoryUsage: 4.00 KB (4096) - RowsReturned: 0 (0) - RowsReturnedRate: 0 AGGREGATION_NODE (id=30):(Total: 1.296ms, non-child: 1.296ms, % non-child: 100.00%) ExecOption: Codegen Enabled - BuildTime: 0.000ns - GetNewBlockTime: 378.316us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.34 MB (2457728) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.923us EXCHANGE_NODE (id=29): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:3f1 (host=vd1334.foo:22000):(Total: 34.336ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 4.01 MB (4206640) - PerHostPeakMemUsage: 169.57 GB (182073588045) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 34.283ms - ExecTreePrepareTime: 934.044us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 24.61K (24606) - BlocksRecycled: 354 (354) - BufferedPins: 0 (0) - BytesWritten: 53.70 GB (57663291392) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 161.38 GB (173284007936) - ScratchFileUsedBytes: 53.70 GB (57663291392) - TotalBufferWaitTime: 7s376ms - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=31):(Total: 20.240us, non-child: 20.240us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.42 KB (1456) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 329.348ms, non-child: 329.348ms, % non-child: 100.00%) - CodegenTime: 5.148ms - CompileTime: 77.182ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 131 (131) - NumInstructions: 3.40K (3397) - OptimizationTime: 222.594ms - PeakMemoryUsage: 1.66 MB (1739264) - PrepareTime: 28.549ms SORT_NODE (id=18):(Total: 932.938us, non-child: 47.045us, % non-child: 5.04%) ExecOption: Codegen Enabled - InsertBatchTime: 0.000ns - PeakMemoryUsage: 4.00 KB (4096) - RowsReturned: 0 (0) - RowsReturnedRate: 0 AGGREGATION_NODE (id=30):(Total: 885.893us, non-child: 885.893us, % non-child: 100.00%) ExecOption: Codegen Enabled - BuildTime: 0.000ns - GetNewBlockTime: 182.366us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.34 MB (2457728) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.701us EXCHANGE_NODE (id=29): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:412 (host=vd1341.foo:22000):(Total: 34.183ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 2.36 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 4.01 MB (4206640) - PerHostPeakMemUsage: 169.56 GB (182068199748) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 34.136ms - ExecTreePrepareTime: 927.291us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 24.63K (24632) - BlocksRecycled: 909 (909) - BufferedPins: 0 (0) - BytesWritten: 45.92 GB (49308237824) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 161.38 GB (173284007936) - ScratchFileUsedBytes: 45.92 GB (49308237824) - TotalBufferWaitTime: 3s721ms - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=31):(Total: 19.128us, non-child: 19.128us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.42 KB (1456) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 335.346ms, non-child: 335.346ms, % non-child: 100.00%) - CodegenTime: 6.184ms - CompileTime: 78.852ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 131 (131) - NumInstructions: 3.40K (3397) - OptimizationTime: 227.945ms - PeakMemoryUsage: 1.66 MB (1739264) - PrepareTime: 27.794ms SORT_NODE (id=18):(Total: 926.284us, non-child: 38.381us, % non-child: 4.14%) ExecOption: Codegen Enabled - InsertBatchTime: 0.000ns - PeakMemoryUsage: 4.00 KB (4096) - RowsReturned: 0 (0) - RowsReturnedRate: 0 AGGREGATION_NODE (id=30):(Total: 887.903us, non-child: 887.903us, % non-child: 100.00%) ExecOption: Codegen Enabled - BuildTime: 0.000ns - GetNewBlockTime: 205.872us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.34 MB (2457728) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 2.035us EXCHANGE_NODE (id=29): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:417 (host=vd1111.foo:22000):(Total: 34.167ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 2.42 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 4.01 MB (4206640) - PerHostPeakMemUsage: 169.55 GB (182051211814) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 34.083ms - ExecTreePrepareTime: 1.654ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 24.71K (24710) - BlocksRecycled: 354 (354) - BufferedPins: 0 (0) - BytesWritten: 46.53 GB (49962549248) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 161.38 GB (173284007936) - ScratchFileUsedBytes: 46.53 GB (49962549248) - TotalBufferWaitTime: 2s275ms - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=31):(Total: 31.927us, non-child: 31.927us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.42 KB (1456) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 322.469ms, non-child: 322.469ms, % non-child: 100.00%) - CodegenTime: 6.510ms - CompileTime: 75.231ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 131 (131) - NumInstructions: 3.40K (3397) - OptimizationTime: 221.010ms - PeakMemoryUsage: 1.66 MB (1739264) - PrepareTime: 25.555ms SORT_NODE (id=18):(Total: 1.653ms, non-child: 73.079us, % non-child: 4.42%) ExecOption: Codegen Enabled - InsertBatchTime: 0.000ns - PeakMemoryUsage: 4.00 KB (4096) - RowsReturned: 0 (0) - RowsReturnedRate: 0 AGGREGATION_NODE (id=30):(Total: 1.580ms, non-child: 1.580ms, % non-child: 100.00%) ExecOption: Codegen Enabled - BuildTime: 0.000ns - GetNewBlockTime: 444.677us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.34 MB (2457728) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.781us EXCHANGE_NODE (id=29): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:403 (host=vc1519.foo:22000):(Total: 33.900ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 4.01 MB (4206640) - PerHostPeakMemUsage: 169.57 GB (182071139285) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 33.838ms - ExecTreePrepareTime: 1.423ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 23.48K (23477) - BlocksRecycled: 1.01K (1012) - BufferedPins: 0 (0) - BytesWritten: 36.90 GB (39619395584) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 161.38 GB (173284007936) - ScratchFileUsedBytes: 36.90 GB (39619395584) - TotalBufferWaitTime: 3s438ms - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=31):(Total: 27.747us, non-child: 27.747us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.42 KB (1456) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 350.292ms, non-child: 350.292ms, % non-child: 100.00%) - CodegenTime: 6.760ms - CompileTime: 89.573ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 131 (131) - NumInstructions: 3.40K (3397) - OptimizationTime: 233.951ms - PeakMemoryUsage: 1.66 MB (1739264) - PrepareTime: 26.108ms SORT_NODE (id=18):(Total: 1.423ms, non-child: 84.905us, % non-child: 5.97%) ExecOption: Codegen Enabled - InsertBatchTime: 0.000ns - PeakMemoryUsage: 4.00 KB (4096) - RowsReturned: 0 (0) - RowsReturnedRate: 0 AGGREGATION_NODE (id=30):(Total: 1.338ms, non-child: 1.338ms, % non-child: 100.00%) ExecOption: Codegen Enabled - BuildTime: 0.000ns - GetNewBlockTime: 410.801us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.34 MB (2457728) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.810us EXCHANGE_NODE (id=29): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:3fb (host=vc1528.foo:22000):(Total: 33.516ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 2.42 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 4.01 MB (4206640) - PerHostPeakMemUsage: 169.58 GB (182081766840) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 33.431ms - ExecTreePrepareTime: 1.308ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 23.42K (23416) - BlocksRecycled: 445 (445) - BufferedPins: 0 (0) - BytesWritten: 36.43 GB (39116079104) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 161.38 GB (173284007936) - ScratchFileUsedBytes: 36.43 GB (39116079104) - TotalBufferWaitTime: 15s994ms - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=31):(Total: 22.782us, non-child: 22.782us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.42 KB (1456) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 337.735ms, non-child: 337.735ms, % non-child: 100.00%) - CodegenTime: 6.261ms - CompileTime: 74.749ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 131 (131) - NumInstructions: 3.40K (3397) - OptimizationTime: 235.552ms - PeakMemoryUsage: 1.66 MB (1739264) - PrepareTime: 26.797ms SORT_NODE (id=18):(Total: 1.306ms, non-child: 53.139us, % non-child: 4.07%) ExecOption: Codegen Enabled - InsertBatchTime: 0.000ns - PeakMemoryUsage: 4.00 KB (4096) - RowsReturned: 0 (0) - RowsReturnedRate: 0 AGGREGATION_NODE (id=30):(Total: 1.253ms, non-child: 1.253ms, % non-child: 100.00%) ExecOption: Codegen Enabled - BuildTime: 0.000ns - GetNewBlockTime: 319.607us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.34 MB (2457728) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.586us EXCHANGE_NODE (id=29): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:419 (host=vd1142.foo:22000):(Total: 33.446ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 4.01 MB (4206640) - PerHostPeakMemUsage: 169.56 GB (182068790410) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 33.395ms - ExecTreePrepareTime: 858.318us BlockMgr: - BlockWritesOutstanding: 1 (1) - BlocksCreated: 23.83K (23830) - BlocksRecycled: 456 (456) - BufferedPins: 0 (0) - BytesWritten: 39.66 GB (42588962816) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 161.38 GB (173284007936) - ScratchFileUsedBytes: 39.66 GB (42588962816) - TotalBufferWaitTime: 9s520ms - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=31):(Total: 25.275us, non-child: 25.275us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.42 KB (1456) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 325.037ms, non-child: 325.037ms, % non-child: 100.00%) - CodegenTime: 5.567ms - CompileTime: 76.715ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 131 (131) - NumInstructions: 3.40K (3397) - OptimizationTime: 219.717ms - PeakMemoryUsage: 1.66 MB (1739264) - PrepareTime: 28.027ms SORT_NODE (id=18):(Total: 857.243us, non-child: 39.153us, % non-child: 4.57%) ExecOption: Codegen Enabled - InsertBatchTime: 0.000ns - PeakMemoryUsage: 4.00 KB (4096) - RowsReturned: 0 (0) - RowsReturnedRate: 0 AGGREGATION_NODE (id=30):(Total: 818.090us, non-child: 818.090us, % non-child: 100.00%) ExecOption: Codegen Enabled - BuildTime: 0.000ns - GetNewBlockTime: 182.407us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.34 MB (2457728) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.578us EXCHANGE_NODE (id=29): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:402 (host=vc1522.foo:22000):(Total: 33.001ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 2.42 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 4.01 MB (4206640) - PerHostPeakMemUsage: 169.56 GB (182064280165) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 32.957ms - ExecTreePrepareTime: 989.697us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 24.36K (24356) - BlocksRecycled: 713 (713) - BufferedPins: 0 (0) - BytesWritten: 43.77 GB (46992982016) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 161.38 GB (173284007936) - ScratchFileUsedBytes: 43.77 GB (46992982016) - TotalBufferWaitTime: 8s191ms - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=31):(Total: 22.829us, non-child: 22.829us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.42 KB (1456) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 329.683ms, non-child: 329.683ms, % non-child: 100.00%) - CodegenTime: 5.325ms - CompileTime: 77.970ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 131 (131) - NumInstructions: 3.40K (3397) - OptimizationTime: 223.854ms - PeakMemoryUsage: 1.66 MB (1739264) - PrepareTime: 27.215ms SORT_NODE (id=18):(Total: 988.882us, non-child: 36.106us, % non-child: 3.65%) ExecOption: Codegen Enabled - InsertBatchTime: 0.000ns - PeakMemoryUsage: 4.00 KB (4096) - RowsReturned: 0 (0) - RowsReturnedRate: 0 AGGREGATION_NODE (id=30):(Total: 952.776us, non-child: 952.776us, % non-child: 100.00%) ExecOption: Codegen Enabled - BuildTime: 0.000ns - GetNewBlockTime: 221.672us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.34 MB (2457728) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.759us EXCHANGE_NODE (id=29): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:42d (host=vc1508.foo:22000):(Total: 32.842ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 4.01 MB (4206640) - PerHostPeakMemUsage: 169.57 GB (182073476623) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 32.793ms - ExecTreePrepareTime: 926.455us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 24.65K (24647) - BlocksRecycled: 987 (987) - BufferedPins: 0 (0) - BytesWritten: 54.05 GB (58032390144) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 161.38 GB (173284007936) - ScratchFileUsedBytes: 54.05 GB (58032390144) - TotalBufferWaitTime: 10s383ms - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=31):(Total: 21.276us, non-child: 21.276us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.42 KB (1456) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 323.167ms, non-child: 323.167ms, % non-child: 100.00%) - CodegenTime: 6.107ms - CompileTime: 75.175ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 131 (131) - NumInstructions: 3.40K (3397) - OptimizationTime: 220.594ms - PeakMemoryUsage: 1.66 MB (1739264) - PrepareTime: 26.809ms SORT_NODE (id=18):(Total: 925.529us, non-child: 37.562us, % non-child: 4.06%) ExecOption: Codegen Enabled - InsertBatchTime: 0.000ns - PeakMemoryUsage: 4.00 KB (4096) - RowsReturned: 0 (0) - RowsReturnedRate: 0 AGGREGATION_NODE (id=30):(Total: 887.967us, non-child: 887.967us, % non-child: 100.00%) ExecOption: Codegen Enabled - BuildTime: 0.000ns - GetNewBlockTime: 199.303us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.34 MB (2457728) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.646us EXCHANGE_NODE (id=29): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:428 (host=ve1129.foo:22000):(Total: 32.823ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 2.42 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 4.01 MB (4206640) - PerHostPeakMemUsage: 169.57 GB (182072457823) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 32.770ms - ExecTreePrepareTime: 990.004us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 24.67K (24674) - BlocksRecycled: 377 (377) - BufferedPins: 0 (0) - BytesWritten: 46.25 GB (49660559360) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 161.38 GB (173284007936) - ScratchFileUsedBytes: 46.25 GB (49660559360) - TotalBufferWaitTime: 5s642ms - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=31):(Total: 19.865us, non-child: 19.865us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.42 KB (1456) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 352.668ms, non-child: 352.668ms, % non-child: 100.00%) - CodegenTime: 5.585ms - CompileTime: 82.057ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 131 (131) - NumInstructions: 3.40K (3397) - OptimizationTime: 242.312ms - PeakMemoryUsage: 1.66 MB (1739264) - PrepareTime: 27.687ms SORT_NODE (id=18):(Total: 989.166us, non-child: 35.676us, % non-child: 3.61%) ExecOption: Codegen Enabled - InsertBatchTime: 0.000ns - PeakMemoryUsage: 4.00 KB (4096) - RowsReturned: 0 (0) - RowsReturnedRate: 0 AGGREGATION_NODE (id=30):(Total: 953.490us, non-child: 953.490us, % non-child: 100.00%) ExecOption: Codegen Enabled - BuildTime: 0.000ns - GetNewBlockTime: 208.790us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.34 MB (2457728) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.701us EXCHANGE_NODE (id=29): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:425 (host=vc1542.foo:22000):(Total: 32.719ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 2.42 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 4.01 MB (4206640) - PerHostPeakMemUsage: 169.57 GB (182073432523) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 32.651ms - ExecTreePrepareTime: 955.569us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 24.30K (24305) - BlocksRecycled: 354 (354) - BufferedPins: 0 (0) - BytesWritten: 51.35 GB (55138320384) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 161.38 GB (173284007936) - ScratchFileUsedBytes: 51.35 GB (55138320384) - TotalBufferWaitTime: 9s909ms - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=31):(Total: 20.006us, non-child: 20.006us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.42 KB (1456) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 322.312ms, non-child: 322.312ms, % non-child: 100.00%) - CodegenTime: 6.155ms - CompileTime: 76.784ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 131 (131) - NumInstructions: 3.40K (3397) - OptimizationTime: 218.440ms - PeakMemoryUsage: 1.66 MB (1739264) - PrepareTime: 26.422ms SORT_NODE (id=18):(Total: 954.831us, non-child: 39.471us, % non-child: 4.13%) ExecOption: Codegen Enabled - InsertBatchTime: 0.000ns - PeakMemoryUsage: 4.00 KB (4096) - RowsReturned: 0 (0) - RowsReturnedRate: 0 AGGREGATION_NODE (id=30):(Total: 915.360us, non-child: 915.360us, % non-child: 100.00%) ExecOption: Codegen Enabled - BuildTime: 0.000ns - GetNewBlockTime: 228.940us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.34 MB (2457728) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.823us EXCHANGE_NODE (id=29): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:3e7 (host=vd1116.foo:22000):(Total: 32.653ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 4.01 MB (4206640) - PerHostPeakMemUsage: 169.56 GB (182059842389) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 32.583ms - ExecTreePrepareTime: 1.095ms BlockMgr: - BlockWritesOutstanding: 1 (1) - BlocksCreated: 24.37K (24369) - BlocksRecycled: 354 (354) - BufferedPins: 0 (0) - BytesWritten: 43.88 GB (47110422528) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 161.38 GB (173284007936) - ScratchFileUsedBytes: 43.88 GB (47110422528) - TotalBufferWaitTime: 13s098ms - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=31):(Total: 24.543us, non-child: 24.543us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.42 KB (1456) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 322.943ms, non-child: 322.943ms, % non-child: 100.00%) - CodegenTime: 5.492ms - CompileTime: 77.500ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 131 (131) - NumInstructions: 3.40K (3397) - OptimizationTime: 219.322ms - PeakMemoryUsage: 1.66 MB (1739264) - PrepareTime: 25.514ms SORT_NODE (id=18):(Total: 1.094ms, non-child: 42.037us, % non-child: 3.84%) ExecOption: Codegen Enabled - InsertBatchTime: 0.000ns - PeakMemoryUsage: 4.00 KB (4096) - RowsReturned: 0 (0) - RowsReturnedRate: 0 AGGREGATION_NODE (id=30):(Total: 1.052ms, non-child: 1.052ms, % non-child: 100.00%) ExecOption: Codegen Enabled - BuildTime: 0.000ns - GetNewBlockTime: 358.505us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.34 MB (2457728) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 2.053us EXCHANGE_NODE (id=29): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:442 (host=vd1107.foo:22000):(Total: 32.589ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 2.42 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 4.01 MB (4206640) - PerHostPeakMemUsage: 169.55 GB (182055448413) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 32.539ms - ExecTreePrepareTime: 1.015ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 24.65K (24654) - BlocksRecycled: 355 (355) - BufferedPins: 0 (0) - BytesWritten: 46.10 GB (49501175808) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 161.38 GB (173284007936) - ScratchFileUsedBytes: 46.10 GB (49501175808) - TotalBufferWaitTime: 2s191ms - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=31):(Total: 20.598us, non-child: 20.598us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.42 KB (1456) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 323.711ms, non-child: 323.711ms, % non-child: 100.00%) - CodegenTime: 5.315ms - CompileTime: 74.563ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 131 (131) - NumInstructions: 3.40K (3397) - OptimizationTime: 221.776ms - PeakMemoryUsage: 1.66 MB (1739264) - PrepareTime: 26.840ms SORT_NODE (id=18):(Total: 1.014ms, non-child: 38.726us, % non-child: 3.82%) ExecOption: Codegen Enabled - InsertBatchTime: 0.000ns - PeakMemoryUsage: 4.00 KB (4096) - RowsReturned: 0 (0) - RowsReturnedRate: 0 AGGREGATION_NODE (id=30):(Total: 975.956us, non-child: 975.956us, % non-child: 100.00%) ExecOption: Codegen Enabled - BuildTime: 0.000ns - GetNewBlockTime: 248.081us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.34 MB (2457728) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.745us EXCHANGE_NODE (id=29): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:3f8 (host=vc1503.foo:22000):(Total: 32.466ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 4.01 MB (4206640) - PerHostPeakMemUsage: 169.57 GB (182069369402) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 32.387ms - ExecTreePrepareTime: 1.359ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 24.23K (24227) - BlocksRecycled: 354 (354) - BufferedPins: 0 (0) - BytesWritten: 50.77 GB (54509174784) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 161.38 GB (173284007936) - ScratchFileUsedBytes: 50.77 GB (54509174784) - TotalBufferWaitTime: 15s910ms - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=31):(Total: 37.877us, non-child: 37.877us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.42 KB (1456) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 344.256ms, non-child: 344.256ms, % non-child: 100.00%) - CodegenTime: 6.853ms - CompileTime: 82.155ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 131 (131) - NumInstructions: 3.40K (3397) - OptimizationTime: 236.243ms - PeakMemoryUsage: 1.66 MB (1739264) - PrepareTime: 25.277ms SORT_NODE (id=18):(Total: 1.358ms, non-child: 53.393us, % non-child: 3.93%) ExecOption: Codegen Enabled - InsertBatchTime: 0.000ns - PeakMemoryUsage: 4.00 KB (4096) - RowsReturned: 0 (0) - RowsReturnedRate: 0 AGGREGATION_NODE (id=30):(Total: 1.304ms, non-child: 1.304ms, % non-child: 100.00%) ExecOption: Codegen Enabled - BuildTime: 0.000ns - GetNewBlockTime: 420.906us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.34 MB (2457728) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.706us EXCHANGE_NODE (id=29): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:3e1 (host=ve1136.foo:22000):(Total: 32.436ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 4.01 MB (4206640) - PerHostPeakMemUsage: 169.56 GB (182064805489) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 32.390ms - ExecTreePrepareTime: 876.541us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 24.56K (24562) - BlocksRecycled: 354 (354) - BufferedPins: 0 (0) - BytesWritten: 53.37 GB (57302581248) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 161.38 GB (173284007936) - ScratchFileUsedBytes: 53.37 GB (57302581248) - TotalBufferWaitTime: 6s998ms - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=31):(Total: 20.029us, non-child: 20.029us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.42 KB (1456) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 343.059ms, non-child: 343.059ms, % non-child: 100.00%) - CodegenTime: 5.825ms - CompileTime: 82.491ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 131 (131) - NumInstructions: 3.40K (3397) - OptimizationTime: 233.069ms - PeakMemoryUsage: 1.66 MB (1739264) - PrepareTime: 26.763ms SORT_NODE (id=18):(Total: 875.461us, non-child: 38.775us, % non-child: 4.43%) ExecOption: Codegen Enabled - InsertBatchTime: 0.000ns - PeakMemoryUsage: 4.00 KB (4096) - RowsReturned: 0 (0) - RowsReturnedRate: 0 AGGREGATION_NODE (id=30):(Total: 836.686us, non-child: 836.686us, % non-child: 100.00%) ExecOption: Codegen Enabled - BuildTime: 0.000ns - GetNewBlockTime: 188.426us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.34 MB (2457728) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.667us EXCHANGE_NODE (id=29): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:40e (host=vc1540.foo:22000):(Total: 32.306ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 2.36 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 4.01 MB (4206640) - PerHostPeakMemUsage: 169.58 GB (182081361196) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 32.254ms - ExecTreePrepareTime: 1.027ms BlockMgr: - BlockWritesOutstanding: 1 (1) - BlocksCreated: 24.07K (24067) - BlocksRecycled: 354 (354) - BufferedPins: 0 (0) - BytesWritten: 41.52 GB (44577062912) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 161.38 GB (173284007936) - ScratchFileUsedBytes: 41.52 GB (44577062912) - TotalBufferWaitTime: 2s410ms - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=31):(Total: 20.624us, non-child: 20.624us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.42 KB (1456) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 332.553ms, non-child: 332.553ms, % non-child: 100.00%) - CodegenTime: 5.316ms - CompileTime: 84.508ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 131 (131) - NumInstructions: 3.40K (3397) - OptimizationTime: 220.764ms - PeakMemoryUsage: 1.66 MB (1739264) - PrepareTime: 26.653ms SORT_NODE (id=18):(Total: 1.026ms, non-child: 38.982us, % non-child: 3.80%) ExecOption: Codegen Enabled - InsertBatchTime: 0.000ns - PeakMemoryUsage: 4.00 KB (4096) - RowsReturned: 0 (0) - RowsReturnedRate: 0 AGGREGATION_NODE (id=30):(Total: 987.833us, non-child: 987.833us, % non-child: 100.00%) ExecOption: Codegen Enabled - BuildTime: 0.000ns - GetNewBlockTime: 249.215us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.34 MB (2457728) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.564us EXCHANGE_NODE (id=29): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:41f (host=vd1101.foo:22000):(Total: 32.139ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 2.42 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 4.01 MB (4206640) - PerHostPeakMemUsage: 169.56 GB (182059540873) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 32.092ms - ExecTreePrepareTime: 907.491us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 24.34K (24339) - BlocksRecycled: 354 (354) - BufferedPins: 0 (0) - BytesWritten: 43.64 GB (46858764288) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 161.38 GB (173284007936) - ScratchFileUsedBytes: 43.64 GB (46858764288) - TotalBufferWaitTime: 5s944ms - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=31):(Total: 22.184us, non-child: 22.184us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.42 KB (1456) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 345.781ms, non-child: 345.781ms, % non-child: 100.00%) - CodegenTime: 5.329ms - CompileTime: 84.100ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 131 (131) - NumInstructions: 3.40K (3397) - OptimizationTime: 234.849ms - PeakMemoryUsage: 1.66 MB (1739264) - PrepareTime: 26.183ms SORT_NODE (id=18):(Total: 906.575us, non-child: 34.583us, % non-child: 3.81%) ExecOption: Codegen Enabled - InsertBatchTime: 0.000ns - PeakMemoryUsage: 4.00 KB (4096) - RowsReturned: 0 (0) - RowsReturnedRate: 0 AGGREGATION_NODE (id=30):(Total: 871.992us, non-child: 871.992us, % non-child: 100.00%) ExecOption: Codegen Enabled - BuildTime: 0.000ns - GetNewBlockTime: 204.836us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.34 MB (2457728) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 2.031us EXCHANGE_NODE (id=29): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:3ee (host=vc1520.foo:22000):(Total: 31.989ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 4.01 MB (4206640) - PerHostPeakMemUsage: 169.57 GB (182072367876) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 31.933ms - ExecTreePrepareTime: 924.688us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 24.77K (24774) - BlocksRecycled: 355 (355) - BufferedPins: 0 (0) - BytesWritten: 47.03 GB (50499420160) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 161.38 GB (173284007936) - ScratchFileUsedBytes: 47.03 GB (50499420160) - TotalBufferWaitTime: 2s943ms - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=31):(Total: 23.300us, non-child: 23.300us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.42 KB (1456) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 327.586ms, non-child: 327.586ms, % non-child: 100.00%) - CodegenTime: 5.217ms - CompileTime: 79.478ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 131 (131) - NumInstructions: 3.40K (3397) - OptimizationTime: 221.203ms - PeakMemoryUsage: 1.66 MB (1739264) - PrepareTime: 26.254ms SORT_NODE (id=18):(Total: 923.803us, non-child: 40.828us, % non-child: 4.42%) ExecOption: Codegen Enabled - InsertBatchTime: 0.000ns - PeakMemoryUsage: 4.00 KB (4096) - RowsReturned: 0 (0) - RowsReturnedRate: 0 AGGREGATION_NODE (id=30):(Total: 882.975us, non-child: 882.975us, % non-child: 100.00%) ExecOption: Codegen Enabled - BuildTime: 0.000ns - GetNewBlockTime: 192.194us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.34 MB (2457728) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.750us EXCHANGE_NODE (id=29): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:41c (host=vd1133.foo:22000):(Total: 31.986ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 4.01 MB (4206640) - PerHostPeakMemUsage: 169.56 GB (182063982385) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 31.907ms - ExecTreePrepareTime: 1.345ms BlockMgr: - BlockWritesOutstanding: 1 (1) - BlocksCreated: 24.09K (24085) - BlocksRecycled: 354 (354) - BufferedPins: 0 (0) - BytesWritten: 41.66 GB (44728057856) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 161.38 GB (173284007936) - ScratchFileUsedBytes: 41.66 GB (44728057856) - TotalBufferWaitTime: 3s649ms - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=31):(Total: 31.509us, non-child: 31.509us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.42 KB (1456) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 327.693ms, non-child: 327.693ms, % non-child: 100.00%) - CodegenTime: 6.446ms - CompileTime: 76.663ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 131 (131) - NumInstructions: 3.40K (3397) - OptimizationTime: 225.805ms - PeakMemoryUsage: 1.66 MB (1739264) - PrepareTime: 24.731ms SORT_NODE (id=18):(Total: 1.344ms, non-child: 67.398us, % non-child: 5.01%) ExecOption: Codegen Enabled - InsertBatchTime: 0.000ns - PeakMemoryUsage: 4.00 KB (4096) - RowsReturned: 0 (0) - RowsReturnedRate: 0 AGGREGATION_NODE (id=30):(Total: 1.277ms, non-child: 1.277ms, % non-child: 100.00%) ExecOption: Codegen Enabled - BuildTime: 0.000ns - GetNewBlockTime: 423.791us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.34 MB (2457728) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.627us EXCHANGE_NODE (id=29): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:416 (host=va1037.foo:22000):(Total: 31.885ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 4.01 MB (4206640) - PerHostPeakMemUsage: 169.56 GB (182068666281) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 31.824ms - ExecTreePrepareTime: 1.001ms BlockMgr: - BlockWritesOutstanding: 15 (15) - BlocksCreated: 23.65K (23649) - BlocksRecycled: 702 (702) - BufferedPins: 0 (0) - BytesWritten: 44.02 GB (47269806080) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 161.38 GB (173284007936) - ScratchFileUsedBytes: 44.02 GB (47269806080) - TotalBufferWaitTime: 17s581ms - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=31):(Total: 23.921us, non-child: 23.921us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.42 KB (1456) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 318.356ms, non-child: 318.356ms, % non-child: 100.00%) - CodegenTime: 5.166ms - CompileTime: 74.816ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 131 (131) - NumInstructions: 3.40K (3397) - OptimizationTime: 216.583ms - PeakMemoryUsage: 1.66 MB (1739264) - PrepareTime: 26.345ms SORT_NODE (id=18):(Total: 1.000ms, non-child: 36.644us, % non-child: 3.66%) ExecOption: Codegen Enabled - InsertBatchTime: 0.000ns - PeakMemoryUsage: 4.00 KB (4096) - RowsReturned: 0 (0) - RowsReturnedRate: 0 AGGREGATION_NODE (id=30):(Total: 963.940us, non-child: 963.940us, % non-child: 100.00%) ExecOption: Codegen Enabled - BuildTime: 0.000ns - GetNewBlockTime: 244.612us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.34 MB (2457728) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.718us EXCHANGE_NODE (id=29): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:43f (host=va1042.foo:22000):(Total: 31.820ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 2.42 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 4.01 MB (4206640) - PerHostPeakMemUsage: 169.58 GB (182088609238) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 31.737ms - ExecTreePrepareTime: 1.272ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 24.46K (24459) - BlocksRecycled: 614 (614) - BufferedPins: 0 (0) - BytesWritten: 44.57 GB (47857008640) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 161.38 GB (173284007936) - ScratchFileUsedBytes: 44.57 GB (47857008640) - TotalBufferWaitTime: 3s649ms - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=31):(Total: 28.412us, non-child: 28.412us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.42 KB (1456) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 335.329ms, non-child: 335.329ms, % non-child: 100.00%) - CodegenTime: 6.080ms - CompileTime: 79.415ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 131 (131) - NumInstructions: 3.40K (3397) - OptimizationTime: 230.394ms - PeakMemoryUsage: 1.66 MB (1739264) - PrepareTime: 25.012ms SORT_NODE (id=18):(Total: 1.271ms, non-child: 68.581us, % non-child: 5.39%) ExecOption: Codegen Enabled - InsertBatchTime: 0.000ns - PeakMemoryUsage: 4.00 KB (4096) - RowsReturned: 0 (0) - RowsReturnedRate: 0 AGGREGATION_NODE (id=30):(Total: 1.203ms, non-child: 1.203ms, % non-child: 100.00%) ExecOption: Codegen Enabled - BuildTime: 0.000ns - GetNewBlockTime: 380.358us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.34 MB (2457728) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.978us EXCHANGE_NODE (id=29): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:43a (host=vc1521.foo:22000):(Total: 31.818ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 4.01 MB (4206640) - PerHostPeakMemUsage: 169.57 GB (182069092083) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 31.764ms - ExecTreePrepareTime: 924.279us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 24.43K (24434) - BlocksRecycled: 354 (354) - BufferedPins: 0 (0) - BytesWritten: 52.37 GB (56228839424) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 161.38 GB (173284007936) - ScratchFileUsedBytes: 52.37 GB (56228839424) - TotalBufferWaitTime: 9s729ms - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=31):(Total: 21.553us, non-child: 21.553us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.42 KB (1456) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 359.647ms, non-child: 359.647ms, % non-child: 100.00%) - CodegenTime: 5.464ms - CompileTime: 81.173ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 131 (131) - NumInstructions: 3.40K (3397) - OptimizationTime: 251.624ms - PeakMemoryUsage: 1.66 MB (1739264) - PrepareTime: 26.182ms SORT_NODE (id=18):(Total: 923.046us, non-child: 40.671us, % non-child: 4.41%) ExecOption: Codegen Enabled - InsertBatchTime: 0.000ns - PeakMemoryUsage: 4.00 KB (4096) - RowsReturned: 0 (0) - RowsReturnedRate: 0 AGGREGATION_NODE (id=30):(Total: 882.375us, non-child: 882.375us, % non-child: 100.00%) ExecOption: Codegen Enabled - BuildTime: 0.000ns - GetNewBlockTime: 221.536us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.34 MB (2457728) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.718us EXCHANGE_NODE (id=29): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:3fd (host=ve1135.foo:22000):(Total: 31.769ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 4.01 MB (4206640) - PerHostPeakMemUsage: 169.56 GB (182064603624) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 31.675ms - ExecTreePrepareTime: 1.459ms BlockMgr: - BlockWritesOutstanding: 1 (1) - BlocksCreated: 23.86K (23855) - BlocksRecycled: 354 (354) - BufferedPins: 0 (0) - BytesWritten: 39.86 GB (42798678016) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 161.38 GB (173284007936) - ScratchFileUsedBytes: 39.86 GB (42798678016) - TotalBufferWaitTime: 4s880ms - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=31):(Total: 27.583us, non-child: 27.583us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.42 KB (1456) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 340.855ms, non-child: 340.855ms, % non-child: 100.00%) - CodegenTime: 6.326ms - CompileTime: 81.720ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 131 (131) - NumInstructions: 3.40K (3397) - OptimizationTime: 233.917ms - PeakMemoryUsage: 1.66 MB (1739264) - PrepareTime: 24.544ms SORT_NODE (id=18):(Total: 1.458ms, non-child: 82.323us, % non-child: 5.64%) ExecOption: Codegen Enabled - InsertBatchTime: 0.000ns - PeakMemoryUsage: 4.00 KB (4096) - RowsReturned: 0 (0) - RowsReturnedRate: 0 AGGREGATION_NODE (id=30):(Total: 1.376ms, non-child: 1.376ms, % non-child: 100.00%) ExecOption: Codegen Enabled - BuildTime: 0.000ns - GetNewBlockTime: 368.898us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.34 MB (2457728) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.754us EXCHANGE_NODE (id=29): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:447 (host=vd1108.foo:22000):(Total: 31.422ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 2.42 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 4.01 MB (4206640) - PerHostPeakMemUsage: 169.56 GB (182065411723) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 31.371ms - ExecTreePrepareTime: 970.500us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 24.31K (24309) - BlocksRecycled: 354 (354) - BufferedPins: 0 (0) - BytesWritten: 51.41 GB (55197040640) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 161.38 GB (173284007936) - ScratchFileUsedBytes: 51.41 GB (55197040640) - TotalBufferWaitTime: 9s255ms - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=31):(Total: 21.460us, non-child: 21.460us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.42 KB (1456) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 322.970ms, non-child: 322.970ms, % non-child: 100.00%) - CodegenTime: 5.362ms - CompileTime: 76.536ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 131 (131) - NumInstructions: 3.40K (3397) - OptimizationTime: 220.144ms - PeakMemoryUsage: 1.66 MB (1739264) - PrepareTime: 25.756ms SORT_NODE (id=18):(Total: 969.525us, non-child: 37.487us, % non-child: 3.87%) ExecOption: Codegen Enabled - InsertBatchTime: 0.000ns - PeakMemoryUsage: 4.00 KB (4096) - RowsReturned: 0 (0) - RowsReturnedRate: 0 AGGREGATION_NODE (id=30):(Total: 932.038us, non-child: 932.038us, % non-child: 100.00%) ExecOption: Codegen Enabled - BuildTime: 0.000ns - GetNewBlockTime: 221.767us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.34 MB (2457728) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.655us EXCHANGE_NODE (id=29): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:426 (host=vd1339.foo:22000):(Total: 31.357ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 4.01 MB (4206640) - PerHostPeakMemUsage: 169.57 GB (182074821441) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 31.288ms - ExecTreePrepareTime: 1.284ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 24.28K (24283) - BlocksRecycled: 354 (354) - BufferedPins: 0 (0) - BytesWritten: 51.20 GB (54978936832) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 161.38 GB (173284007936) - ScratchFileUsedBytes: 51.20 GB (54978936832) - TotalBufferWaitTime: 8s542ms - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=31):(Total: 27.336us, non-child: 27.336us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.42 KB (1456) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 333.033ms, non-child: 333.033ms, % non-child: 100.00%) - CodegenTime: 5.936ms - CompileTime: 79.550ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 131 (131) - NumInstructions: 3.40K (3397) - OptimizationTime: 228.274ms - PeakMemoryUsage: 1.66 MB (1739264) - PrepareTime: 24.695ms SORT_NODE (id=18):(Total: 1.283ms, non-child: 42.481us, % non-child: 3.31%) ExecOption: Codegen Enabled - InsertBatchTime: 0.000ns - PeakMemoryUsage: 4.00 KB (4096) - RowsReturned: 0 (0) - RowsReturnedRate: 0 AGGREGATION_NODE (id=30):(Total: 1.241ms, non-child: 1.241ms, % non-child: 100.00%) ExecOption: Codegen Enabled - BuildTime: 0.000ns - GetNewBlockTime: 330.177us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.34 MB (2457728) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.810us EXCHANGE_NODE (id=29): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:42f (host=ve1127.foo:22000):(Total: 31.336ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 2.42 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 4.01 MB (4206640) - PerHostPeakMemUsage: 169.56 GB (182064155503) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 31.265ms - ExecTreePrepareTime: 1.232ms BlockMgr: - BlockWritesOutstanding: 1 (1) - BlocksCreated: 24.27K (24266) - BlocksRecycled: 354 (354) - BufferedPins: 0 (0) - BytesWritten: 43.07 GB (46246395904) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 161.38 GB (173284007936) - ScratchFileUsedBytes: 43.07 GB (46246395904) - TotalBufferWaitTime: 2s903ms - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=31):(Total: 21.653us, non-child: 21.653us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.42 KB (1456) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 328.496ms, non-child: 328.496ms, % non-child: 100.00%) - CodegenTime: 5.958ms - CompileTime: 78.250ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 131 (131) - NumInstructions: 3.40K (3397) - OptimizationTime: 224.753ms - PeakMemoryUsage: 1.66 MB (1739264) - PrepareTime: 24.861ms SORT_NODE (id=18):(Total: 1.231ms, non-child: 50.343us, % non-child: 4.09%) ExecOption: Codegen Enabled - InsertBatchTime: 0.000ns - PeakMemoryUsage: 4.00 KB (4096) - RowsReturned: 0 (0) - RowsReturnedRate: 0 AGGREGATION_NODE (id=30):(Total: 1.181ms, non-child: 1.181ms, % non-child: 100.00%) ExecOption: Codegen Enabled - BuildTime: 0.000ns - GetNewBlockTime: 364.233us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.34 MB (2457728) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.776us EXCHANGE_NODE (id=29): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:420 (host=ve1140.foo:22000):(Total: 31.318ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 2.42 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 4.01 MB (4206640) - PerHostPeakMemUsage: 169.57 GB (182072110511) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 31.246ms - ExecTreePrepareTime: 1.472ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 23.85K (23848) - BlocksRecycled: 354 (354) - BufferedPins: 0 (0) - BytesWritten: 39.80 GB (42731569152) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 161.38 GB (173284007936) - ScratchFileUsedBytes: 39.80 GB (42731569152) - TotalBufferWaitTime: 3s442ms - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=31):(Total: 27.006us, non-child: 27.006us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.42 KB (1456) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 340.155ms, non-child: 340.155ms, % non-child: 100.00%) - CodegenTime: 5.794ms - CompileTime: 87.146ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 131 (131) - NumInstructions: 3.40K (3397) - OptimizationTime: 227.576ms - PeakMemoryUsage: 1.66 MB (1739264) - PrepareTime: 24.820ms SORT_NODE (id=18):(Total: 1.471ms, non-child: 48.836us, % non-child: 3.32%) ExecOption: Codegen Enabled - InsertBatchTime: 0.000ns - PeakMemoryUsage: 4.00 KB (4096) - RowsReturned: 0 (0) - RowsReturnedRate: 0 AGGREGATION_NODE (id=30):(Total: 1.422ms, non-child: 1.422ms, % non-child: 100.00%) ExecOption: Codegen Enabled - BuildTime: 0.000ns - GetNewBlockTime: 416.426us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.34 MB (2457728) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.998us EXCHANGE_NODE (id=29): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:414 (host=vd1326.foo:22000):(Total: 31.245ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 4.01 MB (4206640) - PerHostPeakMemUsage: 169.56 GB (182062806114) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 31.170ms - ExecTreePrepareTime: 848.298us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 24.37K (24371) - BlocksRecycled: 354 (354) - BufferedPins: 0 (0) - BytesWritten: 51.87 GB (55691968512) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 161.38 GB (173284007936) - ScratchFileUsedBytes: 51.87 GB (55691968512) - TotalBufferWaitTime: 8s427ms - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=31):(Total: 10.887us, non-child: 10.887us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.42 KB (1456) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 341.821ms, non-child: 341.821ms, % non-child: 100.00%) - CodegenTime: 5.985ms - CompileTime: 90.484ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 131 (131) - NumInstructions: 3.40K (3397) - OptimizationTime: 225.350ms - PeakMemoryUsage: 1.66 MB (1739264) - PrepareTime: 25.432ms SORT_NODE (id=18):(Total: 847.957us, non-child: 65.702us, % non-child: 7.75%) ExecOption: Codegen Enabled - InsertBatchTime: 0.000ns - PeakMemoryUsage: 4.00 KB (4096) - RowsReturned: 0 (0) - RowsReturnedRate: 0 AGGREGATION_NODE (id=30):(Total: 782.255us, non-child: 782.255us, % non-child: 100.00%) ExecOption: Codegen Enabled - BuildTime: 0.000ns - GetNewBlockTime: 190.443us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.34 MB (2457728) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 627.000ns EXCHANGE_NODE (id=29): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:430 (host=va1028.foo:22000):(Total: 31.227ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 4.01 MB (4206640) - PerHostPeakMemUsage: 169.57 GB (182070306136) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 31.178ms - ExecTreePrepareTime: 831.168us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 23.79K (23789) - BlocksRecycled: 641 (641) - BufferedPins: 0 (0) - BytesWritten: 47.32 GB (50809798656) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 161.38 GB (173284007936) - ScratchFileUsedBytes: 47.32 GB (50809798656) - TotalBufferWaitTime: 16s444ms - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=31):(Total: 16.776us, non-child: 16.776us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.42 KB (1456) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 319.699ms, non-child: 319.699ms, % non-child: 100.00%) - CodegenTime: 5.088ms - CompileTime: 75.062ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 131 (131) - NumInstructions: 3.40K (3397) - OptimizationTime: 218.278ms - PeakMemoryUsage: 1.66 MB (1739264) - PrepareTime: 25.831ms SORT_NODE (id=18):(Total: 830.442us, non-child: 32.668us, % non-child: 3.93%) ExecOption: Codegen Enabled - InsertBatchTime: 0.000ns - PeakMemoryUsage: 4.00 KB (4096) - RowsReturned: 0 (0) - RowsReturnedRate: 0 AGGREGATION_NODE (id=30):(Total: 797.774us, non-child: 797.774us, % non-child: 100.00%) ExecOption: Codegen Enabled - BuildTime: 0.000ns - GetNewBlockTime: 211.424us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.34 MB (2457728) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.177us EXCHANGE_NODE (id=29): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:3e5 (host=vd1126.foo:22000):(Total: 31.203ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 2.36 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 4.01 MB (4206640) - PerHostPeakMemUsage: 169.56 GB (182068494623) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 31.153ms - ExecTreePrepareTime: 973.357us BlockMgr: - BlockWritesOutstanding: 15 (15) - BlocksCreated: 24.05K (24046) - BlocksRecycled: 362 (362) - BufferedPins: 0 (0) - BytesWritten: 41.81 GB (44895830016) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 161.38 GB (173284007936) - ScratchFileUsedBytes: 41.81 GB (44895830016) - TotalBufferWaitTime: 8s492ms - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=31):(Total: 21.887us, non-child: 21.887us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.42 KB (1456) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 345.787ms, non-child: 345.787ms, % non-child: 100.00%) - CodegenTime: 5.280ms - CompileTime: 79.231ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 131 (131) - NumInstructions: 3.40K (3397) - OptimizationTime: 239.831ms - PeakMemoryUsage: 1.66 MB (1739264) - PrepareTime: 26.241ms SORT_NODE (id=18):(Total: 972.115us, non-child: 38.964us, % non-child: 4.01%) ExecOption: Codegen Enabled - InsertBatchTime: 0.000ns - PeakMemoryUsage: 4.00 KB (4096) - RowsReturned: 0 (0) - RowsReturnedRate: 0 AGGREGATION_NODE (id=30):(Total: 933.151us, non-child: 933.151us, % non-child: 100.00%) ExecOption: Codegen Enabled - BuildTime: 0.000ns - GetNewBlockTime: 208.824us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.34 MB (2457728) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.670us EXCHANGE_NODE (id=29): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:429 (host=ve1130.foo:22000):(Total: 31.124ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 4.01 MB (4206640) - PerHostPeakMemUsage: 169.56 GB (182064299158) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 31.069ms - ExecTreePrepareTime: 912.116us BlockMgr: - BlockWritesOutstanding: 1 (1) - BlocksCreated: 23.82K (23817) - BlocksRecycled: 354 (354) - BufferedPins: 0 (0) - BytesWritten: 39.56 GB (42479910912) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 161.38 GB (173284007936) - ScratchFileUsedBytes: 39.56 GB (42479910912) - TotalBufferWaitTime: 5s511ms - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=31):(Total: 21.238us, non-child: 21.238us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.42 KB (1456) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 338.348ms, non-child: 338.348ms, % non-child: 100.00%) - CodegenTime: 4.777ms - CompileTime: 76.792ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 131 (131) - NumInstructions: 3.40K (3397) - OptimizationTime: 234.142ms - PeakMemoryUsage: 1.66 MB (1739264) - PrepareTime: 26.917ms SORT_NODE (id=18):(Total: 911.171us, non-child: 42.031us, % non-child: 4.61%) ExecOption: Codegen Enabled - InsertBatchTime: 0.000ns - PeakMemoryUsage: 4.00 KB (4096) - RowsReturned: 0 (0) - RowsReturnedRate: 0 AGGREGATION_NODE (id=30):(Total: 869.140us, non-child: 869.140us, % non-child: 100.00%) ExecOption: Codegen Enabled - BuildTime: 0.000ns - GetNewBlockTime: 195.201us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.34 MB (2457728) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.632us EXCHANGE_NODE (id=29): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:3e8 (host=vc1506.foo:22000):(Total: 30.968ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 4.01 MB (4206640) - PerHostPeakMemUsage: 169.56 GB (182060057121) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 30.907ms - ExecTreePrepareTime: 1.004ms BlockMgr: - BlockWritesOutstanding: 1 (1) - BlocksCreated: 23.78K (23781) - BlocksRecycled: 452 (452) - BufferedPins: 0 (0) - BytesWritten: 39.28 GB (42177921024) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 161.38 GB (173284007936) - ScratchFileUsedBytes: 39.28 GB (42177921024) - TotalBufferWaitTime: 3s786ms - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=31):(Total: 19.103us, non-child: 19.103us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.42 KB (1456) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 323.346ms, non-child: 323.346ms, % non-child: 100.00%) - CodegenTime: 5.792ms - CompileTime: 76.622ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 131 (131) - NumInstructions: 3.40K (3397) - OptimizationTime: 221.027ms - PeakMemoryUsage: 1.66 MB (1739264) - PrepareTime: 25.150ms SORT_NODE (id=18):(Total: 1.003ms, non-child: 40.012us, % non-child: 3.99%) ExecOption: Codegen Enabled - InsertBatchTime: 0.000ns - PeakMemoryUsage: 4.00 KB (4096) - RowsReturned: 0 (0) - RowsReturnedRate: 0 AGGREGATION_NODE (id=30):(Total: 963.309us, non-child: 963.309us, % non-child: 100.00%) ExecOption: Codegen Enabled - BuildTime: 0.000ns - GetNewBlockTime: 220.648us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.34 MB (2457728) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.780us EXCHANGE_NODE (id=29): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:400 (host=vd1330.foo:22000):(Total: 30.950ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 4.01 MB (4206640) - PerHostPeakMemUsage: 169.56 GB (182060553646) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 30.868ms - ExecTreePrepareTime: 1.342ms BlockMgr: - BlockWritesOutstanding: 15 (15) - BlocksCreated: 24.39K (24393) - BlocksRecycled: 354 (354) - BufferedPins: 0 (0) - BytesWritten: 51.74 GB (55557750784) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 161.38 GB (173284007936) - ScratchFileUsedBytes: 51.74 GB (55557750784) - TotalBufferWaitTime: 8s632ms - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=31):(Total: 32.392us, non-child: 32.392us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.42 KB (1456) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 353.425ms, non-child: 353.425ms, % non-child: 100.00%) - CodegenTime: 5.875ms - CompileTime: 88.016ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 131 (131) - NumInstructions: 3.40K (3397) - OptimizationTime: 240.561ms - PeakMemoryUsage: 1.66 MB (1739264) - PrepareTime: 24.253ms SORT_NODE (id=18):(Total: 1.341ms, non-child: 38.468us, % non-child: 2.87%) ExecOption: Codegen Enabled - InsertBatchTime: 0.000ns - PeakMemoryUsage: 4.00 KB (4096) - RowsReturned: 0 (0) - RowsReturnedRate: 0 AGGREGATION_NODE (id=30):(Total: 1.303ms, non-child: 1.303ms, % non-child: 100.00%) ExecOption: Codegen Enabled - BuildTime: 0.000ns - GetNewBlockTime: 347.742us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.34 MB (2457728) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.930us EXCHANGE_NODE (id=29): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:3de (host=ve1141.foo:22000):(Total: 30.652ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 4.01 MB (4206640) - PerHostPeakMemUsage: 169.58 GB (182080120448) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 30.603ms - ExecTreePrepareTime: 952.876us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 24.26K (24263) - BlocksRecycled: 354 (354) - BufferedPins: 0 (0) - BytesWritten: 51.02 GB (54785998848) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 161.38 GB (173284007936) - ScratchFileUsedBytes: 51.02 GB (54785998848) - TotalBufferWaitTime: 30s857ms - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=31):(Total: 20.881us, non-child: 20.881us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.42 KB (1456) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 332.500ms, non-child: 332.500ms, % non-child: 100.00%) - CodegenTime: 5.833ms - CompileTime: 77.163ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 131 (131) - NumInstructions: 3.40K (3397) - OptimizationTime: 229.971ms - PeakMemoryUsage: 1.66 MB (1739264) - PrepareTime: 24.781ms SORT_NODE (id=18):(Total: 951.937us, non-child: 34.539us, % non-child: 3.63%) ExecOption: Codegen Enabled - InsertBatchTime: 0.000ns - PeakMemoryUsage: 4.00 KB (4096) - RowsReturned: 0 (0) - RowsReturnedRate: 0 AGGREGATION_NODE (id=30):(Total: 917.398us, non-child: 917.398us, % non-child: 100.00%) ExecOption: Codegen Enabled - BuildTime: 0.000ns - GetNewBlockTime: 229.376us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.34 MB (2457728) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.703us EXCHANGE_NODE (id=29): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:3ef (host=vd1105.foo:22000):(Total: 30.557ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 2.42 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 4.01 MB (4206640) - PerHostPeakMemUsage: 169.57 GB (182070840498) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 30.511ms - ExecTreePrepareTime: 996.212us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 24.52K (24517) - BlocksRecycled: 418 (418) - BufferedPins: 0 (0) - BytesWritten: 45.02 GB (48343547904) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 161.38 GB (173284007936) - ScratchFileUsedBytes: 45.02 GB (48343547904) - TotalBufferWaitTime: 7s710ms - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=31):(Total: 19.789us, non-child: 19.789us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.42 KB (1456) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 344.583ms, non-child: 344.583ms, % non-child: 100.00%) - CodegenTime: 5.350ms - CompileTime: 83.910ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 131 (131) - NumInstructions: 3.40K (3397) - OptimizationTime: 234.990ms - PeakMemoryUsage: 1.66 MB (1739264) - PrepareTime: 25.034ms SORT_NODE (id=18):(Total: 995.283us, non-child: 36.678us, % non-child: 3.69%) ExecOption: Codegen Enabled - InsertBatchTime: 0.000ns - PeakMemoryUsage: 4.00 KB (4096) - RowsReturned: 0 (0) - RowsReturnedRate: 0 AGGREGATION_NODE (id=30):(Total: 958.605us, non-child: 958.605us, % non-child: 100.00%) ExecOption: Codegen Enabled - BuildTime: 0.000ns - GetNewBlockTime: 250.534us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.34 MB (2457728) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.860us EXCHANGE_NODE (id=29): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:3e2 (host=ve1125.foo:22000):(Total: 30.156ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 2.42 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 4.01 MB (4206640) - PerHostPeakMemUsage: 169.57 GB (182077147455) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 30.072ms - ExecTreePrepareTime: 1.249ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 23.26K (23256) - BlocksRecycled: 627 (627) - BufferedPins: 0 (0) - BytesWritten: 35.17 GB (37765513216) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 161.38 GB (173284007936) - ScratchFileUsedBytes: 35.17 GB (37765513216) - TotalBufferWaitTime: 6s045ms - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=31):(Total: 28.355us, non-child: 28.355us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.42 KB (1456) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 337.631ms, non-child: 337.631ms, % non-child: 100.00%) - CodegenTime: 5.142ms - CompileTime: 81.128ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 131 (131) - NumInstructions: 3.40K (3397) - OptimizationTime: 232.033ms - PeakMemoryUsage: 1.66 MB (1739264) - PrepareTime: 23.956ms SORT_NODE (id=18):(Total: 1.248ms, non-child: 46.926us, % non-child: 3.76%) ExecOption: Codegen Enabled - InsertBatchTime: 0.000ns - PeakMemoryUsage: 4.00 KB (4096) - RowsReturned: 0 (0) - RowsReturnedRate: 0 AGGREGATION_NODE (id=30):(Total: 1.201ms, non-child: 1.201ms, % non-child: 100.00%) ExecOption: Codegen Enabled - BuildTime: 0.000ns - GetNewBlockTime: 386.737us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.34 MB (2457728) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.796us EXCHANGE_NODE (id=29): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:43e (host=vc1509.foo:22000):(Total: 30.016ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 4.01 MB (4206640) - PerHostPeakMemUsage: 169.56 GB (182064892776) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 29.957ms - ExecTreePrepareTime: 945.727us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 24.38K (24375) - BlocksRecycled: 354 (354) - BufferedPins: 0 (0) - BytesWritten: 51.90 GB (55725522944) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 161.38 GB (173284007936) - ScratchFileUsedBytes: 51.90 GB (55725522944) - TotalBufferWaitTime: 9s254ms - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=31):(Total: 21.052us, non-child: 21.052us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.42 KB (1456) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 329.615ms, non-child: 329.615ms, % non-child: 100.00%) - CodegenTime: 4.862ms - CompileTime: 74.925ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 131 (131) - NumInstructions: 3.40K (3397) - OptimizationTime: 229.403ms - PeakMemoryUsage: 1.66 MB (1739264) - PrepareTime: 24.801ms SORT_NODE (id=18):(Total: 944.665us, non-child: 40.544us, % non-child: 4.29%) ExecOption: Codegen Enabled - InsertBatchTime: 0.000ns - PeakMemoryUsage: 4.00 KB (4096) - RowsReturned: 0 (0) - RowsReturnedRate: 0 AGGREGATION_NODE (id=30):(Total: 904.121us, non-child: 904.121us, % non-child: 100.00%) ExecOption: Codegen Enabled - BuildTime: 0.000ns - GetNewBlockTime: 200.863us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.34 MB (2457728) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.755us EXCHANGE_NODE (id=29): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:441 (host=vd1132.foo:22000):(Total: 30.000ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 2.42 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 4.01 MB (4206640) - PerHostPeakMemUsage: 169.57 GB (182074885619) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 29.938ms - ExecTreePrepareTime: 1.337ms BlockMgr: - BlockWritesOutstanding: 15 (15) - BlocksCreated: 24.42K (24417) - BlocksRecycled: 354 (354) - BufferedPins: 0 (0) - BytesWritten: 47.48 GB (50985959424) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 161.38 GB (173284007936) - ScratchFileUsedBytes: 47.48 GB (50985959424) - TotalBufferWaitTime: 29s438ms - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=31):(Total: 26.855us, non-child: 26.855us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.42 KB (1456) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 330.826ms, non-child: 330.826ms, % non-child: 100.00%) - CodegenTime: 5.671ms - CompileTime: 78.435ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 131 (131) - NumInstructions: 3.40K (3397) - OptimizationTime: 228.556ms - PeakMemoryUsage: 1.66 MB (1739264) - PrepareTime: 23.352ms SORT_NODE (id=18):(Total: 1.336ms, non-child: 53.713us, % non-child: 4.02%) ExecOption: Codegen Enabled - InsertBatchTime: 0.000ns - PeakMemoryUsage: 4.00 KB (4096) - RowsReturned: 0 (0) - RowsReturnedRate: 0 AGGREGATION_NODE (id=30):(Total: 1.282ms, non-child: 1.282ms, % non-child: 100.00%) ExecOption: Codegen Enabled - BuildTime: 0.000ns - GetNewBlockTime: 392.603us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.34 MB (2457728) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 2.061us EXCHANGE_NODE (id=29): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:3f7 (host=vc1511.foo:22000):(Total: 29.742ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 2.42 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 4.01 MB (4206640) - PerHostPeakMemUsage: 169.54 GB (182042906319) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 29.690ms - ExecTreePrepareTime: 896.421us BlockMgr: - BlockWritesOutstanding: 1 (1) - BlocksCreated: 25.27K (25273) - BlocksRecycled: 871 (871) - BufferedPins: 0 (0) - BytesWritten: 58.92 GB (63266881536) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 161.38 GB (173284007936) - ScratchFileUsedBytes: 58.92 GB (63266881536) - TotalBufferWaitTime: 4s506ms - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=31):(Total: 19.342us, non-child: 19.342us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.42 KB (1456) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 329.763ms, non-child: 329.763ms, % non-child: 100.00%) - CodegenTime: 5.155ms - CompileTime: 80.029ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 131 (131) - NumInstructions: 3.40K (3397) - OptimizationTime: 224.790ms - PeakMemoryUsage: 1.66 MB (1739264) - PrepareTime: 24.470ms SORT_NODE (id=18):(Total: 895.645us, non-child: 38.519us, % non-child: 4.30%) ExecOption: Codegen Enabled - InsertBatchTime: 0.000ns - PeakMemoryUsage: 4.00 KB (4096) - RowsReturned: 0 (0) - RowsReturnedRate: 0 AGGREGATION_NODE (id=30):(Total: 857.126us, non-child: 857.126us, % non-child: 100.00%) ExecOption: Codegen Enabled - BuildTime: 0.000ns - GetNewBlockTime: 169.086us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.34 MB (2457728) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.911us EXCHANGE_NODE (id=29): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:42e (host=vc1527.foo:22000):(Total: 29.518ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 2.42 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 4.01 MB (4206640) - PerHostPeakMemUsage: 169.57 GB (182069173875) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 29.449ms - ExecTreePrepareTime: 1.241ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 24.42K (24422) - BlocksRecycled: 354 (354) - BufferedPins: 0 (0) - BytesWritten: 52.29 GB (56144953344) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 161.38 GB (173284007936) - ScratchFileUsedBytes: 52.29 GB (56144953344) - TotalBufferWaitTime: 7s062ms - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=31):(Total: 25.526us, non-child: 25.526us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.42 KB (1456) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 331.878ms, non-child: 331.878ms, % non-child: 100.00%) - CodegenTime: 5.890ms - CompileTime: 80.927ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 131 (131) - NumInstructions: 3.40K (3397) - OptimizationTime: 227.513ms - PeakMemoryUsage: 1.66 MB (1739264) - PrepareTime: 22.919ms SORT_NODE (id=18):(Total: 1.240ms, non-child: 51.809us, % non-child: 4.18%) ExecOption: Codegen Enabled - InsertBatchTime: 0.000ns - PeakMemoryUsage: 4.00 KB (4096) - RowsReturned: 0 (0) - RowsReturnedRate: 0 AGGREGATION_NODE (id=30):(Total: 1.188ms, non-child: 1.188ms, % non-child: 100.00%) ExecOption: Codegen Enabled - BuildTime: 0.000ns - GetNewBlockTime: 328.190us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.34 MB (2457728) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 2.172us EXCHANGE_NODE (id=29): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:41b (host=ve1138.foo:22000):(Total: 29.510ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 2.42 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 4.01 MB (4206640) - PerHostPeakMemUsage: 169.54 GB (182045058641) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 29.459ms - ExecTreePrepareTime: 978.102us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 24.30K (24305) - BlocksRecycled: 354 (354) - BufferedPins: 0 (0) - BytesWritten: 43.38 GB (46573551616) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 161.38 GB (173284007936) - ScratchFileUsedBytes: 43.38 GB (46573551616) - TotalBufferWaitTime: 3s088ms - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=31):(Total: 20.046us, non-child: 20.046us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.42 KB (1456) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 328.796ms, non-child: 328.796ms, % non-child: 100.00%) - CodegenTime: 4.846ms - CompileTime: 78.259ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 131 (131) - NumInstructions: 3.40K (3397) - OptimizationTime: 226.039ms - PeakMemoryUsage: 1.66 MB (1739264) - PrepareTime: 23.990ms SORT_NODE (id=18):(Total: 977.170us, non-child: 39.875us, % non-child: 4.08%) ExecOption: Codegen Enabled - InsertBatchTime: 0.000ns - PeakMemoryUsage: 4.00 KB (4096) - RowsReturned: 0 (0) - RowsReturnedRate: 0 AGGREGATION_NODE (id=30):(Total: 937.295us, non-child: 937.295us, % non-child: 100.00%) ExecOption: Codegen Enabled - BuildTime: 0.000ns - GetNewBlockTime: 224.255us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.34 MB (2457728) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.500us EXCHANGE_NODE (id=29): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:43c (host=vd1329.foo:22000):(Total: 29.364ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 2.42 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 4.01 MB (4206640) - PerHostPeakMemUsage: 169.58 GB (182081170998) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 29.310ms - ExecTreePrepareTime: 1.025ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 23.94K (23944) - BlocksRecycled: 525 (525) - BufferedPins: 0 (0) - BytesWritten: 40.55 GB (43536875520) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 161.38 GB (173284007936) - ScratchFileUsedBytes: 40.55 GB (43536875520) - TotalBufferWaitTime: 8s060ms - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=31):(Total: 20.814us, non-child: 20.814us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.42 KB (1456) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 319.148ms, non-child: 319.148ms, % non-child: 100.00%) - CodegenTime: 5.123ms - CompileTime: 75.757ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 131 (131) - NumInstructions: 3.40K (3397) - OptimizationTime: 219.137ms - PeakMemoryUsage: 1.66 MB (1739264) - PrepareTime: 23.791ms SORT_NODE (id=18):(Total: 1.024ms, non-child: 36.099us, % non-child: 3.52%) ExecOption: Codegen Enabled - InsertBatchTime: 0.000ns - PeakMemoryUsage: 4.00 KB (4096) - RowsReturned: 0 (0) - RowsReturnedRate: 0 AGGREGATION_NODE (id=30):(Total: 988.805us, non-child: 988.805us, % non-child: 100.00%) ExecOption: Codegen Enabled - BuildTime: 0.000ns - GetNewBlockTime: 249.571us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.34 MB (2457728) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.798us EXCHANGE_NODE (id=29): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:40b (host=va1039.foo:22000):(Total: 28.956ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 4.01 MB (4206640) - PerHostPeakMemUsage: 169.56 GB (182068550938) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 28.901ms - ExecTreePrepareTime: 992.250us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 24.35K (24354) - BlocksRecycled: 354 (354) - BufferedPins: 0 (0) - BytesWritten: 43.75 GB (46976204800) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 161.38 GB (173284007936) - ScratchFileUsedBytes: 43.75 GB (46976204800) - TotalBufferWaitTime: 2s843ms - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=31):(Total: 28.405us, non-child: 28.405us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.42 KB (1456) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 321.411ms, non-child: 321.411ms, % non-child: 100.00%) - CodegenTime: 4.653ms - CompileTime: 76.563ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 131 (131) - NumInstructions: 3.40K (3397) - OptimizationTime: 220.710ms - PeakMemoryUsage: 1.66 MB (1739264) - PrepareTime: 23.654ms SORT_NODE (id=18):(Total: 991.415us, non-child: 37.841us, % non-child: 3.82%) ExecOption: Codegen Enabled - InsertBatchTime: 0.000ns - PeakMemoryUsage: 4.00 KB (4096) - RowsReturned: 0 (0) - RowsReturnedRate: 0 AGGREGATION_NODE (id=30):(Total: 953.574us, non-child: 953.574us, % non-child: 100.00%) ExecOption: Codegen Enabled - BuildTime: 0.000ns - GetNewBlockTime: 245.518us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.34 MB (2457728) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.550us EXCHANGE_NODE (id=29): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:43b (host=vd1332.foo:22000):(Total: 28.646ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 4.01 MB (4206640) - PerHostPeakMemUsage: 169.55 GB (182049888199) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 28.596ms - ExecTreePrepareTime: 972.363us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 24.36K (24360) - BlocksRecycled: 354 (354) - BufferedPins: 0 (0) - BytesWritten: 43.80 GB (47026536448) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 161.38 GB (173284007936) - ScratchFileUsedBytes: 43.80 GB (47026536448) - TotalBufferWaitTime: 2s280ms - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=31):(Total: 21.884us, non-child: 21.884us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.42 KB (1456) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 315.940ms, non-child: 315.940ms, % non-child: 100.00%) - CodegenTime: 4.846ms - CompileTime: 75.932ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 131 (131) - NumInstructions: 3.40K (3397) - OptimizationTime: 216.298ms - PeakMemoryUsage: 1.66 MB (1739264) - PrepareTime: 23.240ms SORT_NODE (id=18):(Total: 971.458us, non-child: 38.372us, % non-child: 3.95%) ExecOption: Codegen Enabled - InsertBatchTime: 0.000ns - PeakMemoryUsage: 4.00 KB (4096) - RowsReturned: 0 (0) - RowsReturnedRate: 0 AGGREGATION_NODE (id=30):(Total: 933.086us, non-child: 933.086us, % non-child: 100.00%) ExecOption: Codegen Enabled - BuildTime: 0.000ns - GetNewBlockTime: 257.565us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.34 MB (2457728) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.874us EXCHANGE_NODE (id=29): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:433 (host=ve1128.foo:22000):(Total: 28.592ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 2.42 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 4.01 MB (4206640) - PerHostPeakMemUsage: 169.55 GB (182055458089) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 28.536ms - ExecTreePrepareTime: 917.704us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 23.54K (23541) - BlocksRecycled: 825 (825) - BufferedPins: 0 (0) - BytesWritten: 37.41 GB (40164655104) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 161.38 GB (173284007936) - ScratchFileUsedBytes: 37.41 GB (40164655104) - TotalBufferWaitTime: 19s119ms - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=31):(Total: 18.896us, non-child: 18.896us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.42 KB (1456) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 322.331ms, non-child: 322.331ms, % non-child: 100.00%) - CodegenTime: 4.743ms - CompileTime: 75.517ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 131 (131) - NumInstructions: 3.40K (3397) - OptimizationTime: 222.935ms - PeakMemoryUsage: 1.66 MB (1739264) - PrepareTime: 23.382ms SORT_NODE (id=18):(Total: 916.765us, non-child: 36.938us, % non-child: 4.03%) ExecOption: Codegen Enabled - InsertBatchTime: 0.000ns - PeakMemoryUsage: 4.00 KB (4096) - RowsReturned: 0 (0) - RowsReturnedRate: 0 AGGREGATION_NODE (id=30):(Total: 879.827us, non-child: 879.827us, % non-child: 100.00%) ExecOption: Codegen Enabled - BuildTime: 0.000ns - GetNewBlockTime: 206.167us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.34 MB (2457728) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.759us EXCHANGE_NODE (id=29): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:408 (host=vd1327.foo:22000):(Total: 28.516ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 4.01 MB (4206640) - PerHostPeakMemUsage: 169.56 GB (182065073254) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 28.466ms - ExecTreePrepareTime: 1.009ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 24.20K (24198) - BlocksRecycled: 528 (528) - BufferedPins: 0 (0) - BytesWritten: 50.52 GB (54249127936) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 161.38 GB (173284007936) - ScratchFileUsedBytes: 50.52 GB (54249127936) - TotalBufferWaitTime: 7s305ms - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=31):(Total: 19.773us, non-child: 19.773us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.42 KB (1456) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 319.425ms, non-child: 319.425ms, % non-child: 100.00%) - CodegenTime: 4.688ms - CompileTime: 74.643ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 131 (131) - NumInstructions: 3.40K (3397) - OptimizationTime: 221.071ms - PeakMemoryUsage: 1.66 MB (1739264) - PrepareTime: 23.173ms SORT_NODE (id=18):(Total: 1.008ms, non-child: 39.749us, % non-child: 3.94%) ExecOption: Codegen Enabled - InsertBatchTime: 0.000ns - PeakMemoryUsage: 4.00 KB (4096) - RowsReturned: 0 (0) - RowsReturnedRate: 0 AGGREGATION_NODE (id=30):(Total: 968.952us, non-child: 968.952us, % non-child: 100.00%) ExecOption: Codegen Enabled - BuildTime: 0.000ns - GetNewBlockTime: 272.468us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.34 MB (2457728) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.778us EXCHANGE_NODE (id=29): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:3e9 (host=vd1103.foo:22000):(Total: 28.500ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 2.42 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 4.01 MB (4206640) - PerHostPeakMemUsage: 169.56 GB (182068719943) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 28.423ms - ExecTreePrepareTime: 942.085us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 24.82K (24818) - BlocksRecycled: 433 (433) - BufferedPins: 0 (0) - BytesWritten: 47.38 GB (50868518912) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 161.38 GB (173284007936) - ScratchFileUsedBytes: 47.38 GB (50868518912) - TotalBufferWaitTime: 6s437ms - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=31):(Total: 12.073us, non-child: 12.073us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.42 KB (1456) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 329.885ms, non-child: 329.885ms, % non-child: 100.00%) - CodegenTime: 7.641ms - CompileTime: 78.643ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 131 (131) - NumInstructions: 3.40K (3397) - OptimizationTime: 229.946ms - PeakMemoryUsage: 1.66 MB (1739264) - PrepareTime: 20.545ms SORT_NODE (id=18):(Total: 941.091us, non-child: 37.234us, % non-child: 3.96%) ExecOption: Codegen Enabled - InsertBatchTime: 0.000ns - PeakMemoryUsage: 4.00 KB (4096) - RowsReturned: 0 (0) - RowsReturnedRate: 0 AGGREGATION_NODE (id=30):(Total: 903.857us, non-child: 903.857us, % non-child: 100.00%) ExecOption: Codegen Enabled - BuildTime: 0.000ns - GetNewBlockTime: 251.898us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.34 MB (2457728) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 615.000ns EXCHANGE_NODE (id=29): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:3ea (host=va1046.foo:22000):(Total: 28.405ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 2.42 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 4.01 MB (4206640) - PerHostPeakMemUsage: 169.56 GB (182060334243) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 28.350ms - ExecTreePrepareTime: 934.185us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 24.70K (24704) - BlocksRecycled: 355 (355) - BufferedPins: 0 (0) - BytesWritten: 54.49 GB (58510540800) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 161.38 GB (173284007936) - ScratchFileUsedBytes: 54.49 GB (58510540800) - TotalBufferWaitTime: 5s006ms - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=31):(Total: 20.738us, non-child: 20.738us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.42 KB (1456) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 314.149ms, non-child: 314.149ms, % non-child: 100.00%) - CodegenTime: 4.649ms - CompileTime: 76.159ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 131 (131) - NumInstructions: 3.40K (3397) - OptimizationTime: 214.735ms - PeakMemoryUsage: 1.66 MB (1739264) - PrepareTime: 22.771ms SORT_NODE (id=18):(Total: 933.337us, non-child: 38.527us, % non-child: 4.13%) ExecOption: Codegen Enabled - InsertBatchTime: 0.000ns - PeakMemoryUsage: 4.00 KB (4096) - RowsReturned: 0 (0) - RowsReturnedRate: 0 AGGREGATION_NODE (id=30):(Total: 894.810us, non-child: 894.810us, % non-child: 100.00%) ExecOption: Codegen Enabled - BuildTime: 0.000ns - GetNewBlockTime: 197.243us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.34 MB (2457728) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.449us EXCHANGE_NODE (id=29): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:409 (host=va1029.foo:22000):(Total: 28.354ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 2.36 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 4.01 MB (4206640) - PerHostPeakMemUsage: 169.56 GB (182062110817) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 28.242ms - ExecTreePrepareTime: 1.341ms BlockMgr: - BlockWritesOutstanding: 1 (1) - BlocksCreated: 24.38K (24382) - BlocksRecycled: 1.02K (1018) - BufferedPins: 0 (0) - BytesWritten: 43.98 GB (47219474432) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 161.38 GB (173284007936) - ScratchFileUsedBytes: 43.98 GB (47219474432) - TotalBufferWaitTime: 3s000ms - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=31):(Total: 25.088us, non-child: 25.088us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.42 KB (1456) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 364.197ms, non-child: 364.197ms, % non-child: 100.00%) - CodegenTime: 4.629ms - CompileTime: 92.398ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 131 (131) - NumInstructions: 3.40K (3397) - OptimizationTime: 248.664ms - PeakMemoryUsage: 1.66 MB (1739264) - PrepareTime: 22.596ms SORT_NODE (id=18):(Total: 1.340ms, non-child: 56.354us, % non-child: 4.20%) ExecOption: Codegen Enabled - InsertBatchTime: 0.000ns - PeakMemoryUsage: 4.00 KB (4096) - RowsReturned: 0 (0) - RowsReturnedRate: 0 AGGREGATION_NODE (id=30):(Total: 1.284ms, non-child: 1.284ms, % non-child: 100.00%) ExecOption: Codegen Enabled - BuildTime: 0.000ns - GetNewBlockTime: 299.095us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.34 MB (2457728) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.626us EXCHANGE_NODE (id=29): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:436 (host=vd1113.foo:22000):(Total: 28.209ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 2.42 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 4.01 MB (4206640) - PerHostPeakMemUsage: 169.56 GB (182064308550) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 28.176ms - ExecTreePrepareTime: 765.579us BlockMgr: - BlockWritesOutstanding: 1 (1) - BlocksCreated: 24.71K (24709) - BlocksRecycled: 766 (766) - BufferedPins: 0 (0) - BytesWritten: 46.52 GB (49954160640) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 161.38 GB (173284007936) - ScratchFileUsedBytes: 46.52 GB (49954160640) - TotalBufferWaitTime: 2s752ms - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=31):(Total: 14.416us, non-child: 14.416us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.42 KB (1456) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 324.972ms, non-child: 324.972ms, % non-child: 100.00%) - CodegenTime: 5.728ms - CompileTime: 78.140ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 131 (131) - NumInstructions: 3.40K (3397) - OptimizationTime: 223.854ms - PeakMemoryUsage: 1.66 MB (1739264) - PrepareTime: 22.461ms SORT_NODE (id=18):(Total: 765.181us, non-child: 32.067us, % non-child: 4.19%) ExecOption: Codegen Enabled - InsertBatchTime: 0.000ns - PeakMemoryUsage: 4.00 KB (4096) - RowsReturned: 0 (0) - RowsReturnedRate: 0 AGGREGATION_NODE (id=30):(Total: 733.114us, non-child: 733.114us, % non-child: 100.00%) ExecOption: Codegen Enabled - BuildTime: 0.000ns - GetNewBlockTime: 202.159us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.34 MB (2457728) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 790.000ns EXCHANGE_NODE (id=29): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:3e6 (host=vd1141.foo:22000):(Total: 28.181ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 4.01 MB (4206640) - PerHostPeakMemUsage: 169.58 GB (182081720861) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 28.122ms - ExecTreePrepareTime: 1.199ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 24.37K (24372) - BlocksRecycled: 354 (354) - BufferedPins: 0 (0) - BytesWritten: 51.88 GB (55700357120) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 161.38 GB (173284007936) - ScratchFileUsedBytes: 51.88 GB (55700357120) - TotalBufferWaitTime: 10s515ms - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=31):(Total: 27.600us, non-child: 27.600us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.42 KB (1456) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 340.313ms, non-child: 340.313ms, % non-child: 100.00%) - CodegenTime: 5.049ms - CompileTime: 79.008ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 131 (131) - NumInstructions: 3.40K (3397) - OptimizationTime: 238.381ms - PeakMemoryUsage: 1.66 MB (1739264) - PrepareTime: 22.415ms SORT_NODE (id=18):(Total: 1.198ms, non-child: 39.151us, % non-child: 3.27%) ExecOption: Codegen Enabled - InsertBatchTime: 0.000ns - PeakMemoryUsage: 4.00 KB (4096) - RowsReturned: 0 (0) - RowsReturnedRate: 0 AGGREGATION_NODE (id=30):(Total: 1.159ms, non-child: 1.159ms, % non-child: 100.00%) ExecOption: Codegen Enabled - BuildTime: 0.000ns - GetNewBlockTime: 364.553us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.34 MB (2457728) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 2.008us EXCHANGE_NODE (id=29): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:41d (host=vd1120.foo:22000):(Total: 28.111ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 4.01 MB (4206640) - PerHostPeakMemUsage: 169.56 GB (182061714716) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 28.027ms - ExecTreePrepareTime: 1.434ms BlockMgr: - BlockWritesOutstanding: 1 (1) - BlocksCreated: 24.43K (24431) - BlocksRecycled: 354 (354) - BufferedPins: 0 (0) - BytesWritten: 44.36 GB (47630516224) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 161.38 GB (173284007936) - ScratchFileUsedBytes: 44.36 GB (47630516224) - TotalBufferWaitTime: 7s240ms - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=31):(Total: 23.551us, non-child: 23.551us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.42 KB (1456) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 324.187ms, non-child: 324.187ms, % non-child: 100.00%) - CodegenTime: 4.963ms - CompileTime: 75.750ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 131 (131) - NumInstructions: 3.40K (3397) - OptimizationTime: 225.838ms - PeakMemoryUsage: 1.66 MB (1739264) - PrepareTime: 22.094ms SORT_NODE (id=18):(Total: 1.433ms, non-child: 43.229us, % non-child: 3.02%) ExecOption: Codegen Enabled - InsertBatchTime: 0.000ns - PeakMemoryUsage: 4.00 KB (4096) - RowsReturned: 0 (0) - RowsReturnedRate: 0 AGGREGATION_NODE (id=30):(Total: 1.390ms, non-child: 1.390ms, % non-child: 100.00%) ExecOption: Codegen Enabled - BuildTime: 0.000ns - GetNewBlockTime: 487.555us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.34 MB (2457728) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 2.285us EXCHANGE_NODE (id=29): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:438 (host=vc1514.foo:22000):(Total: 28.039ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 2.42 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 4.01 MB (4206640) - PerHostPeakMemUsage: 169.56 GB (182059706145) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 27.989ms - ExecTreePrepareTime: 912.327us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 24.66K (24664) - BlocksRecycled: 956 (956) - BufferedPins: 0 (0) - BytesWritten: 46.17 GB (49576673280) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 161.38 GB (173284007936) - ScratchFileUsedBytes: 46.17 GB (49576673280) - TotalBufferWaitTime: 4s779ms - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=31):(Total: 24.173us, non-child: 24.173us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.42 KB (1456) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 333.875ms, non-child: 333.875ms, % non-child: 100.00%) - CodegenTime: 4.531ms - CompileTime: 82.927ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 131 (131) - NumInstructions: 3.40K (3397) - OptimizationTime: 227.600ms - PeakMemoryUsage: 1.66 MB (1739264) - PrepareTime: 22.875ms SORT_NODE (id=18):(Total: 911.255us, non-child: 33.678us, % non-child: 3.70%) ExecOption: Codegen Enabled - InsertBatchTime: 0.000ns - PeakMemoryUsage: 4.00 KB (4096) - RowsReturned: 0 (0) - RowsReturnedRate: 0 AGGREGATION_NODE (id=30):(Total: 877.577us, non-child: 877.577us, % non-child: 100.00%) ExecOption: Codegen Enabled - BuildTime: 0.000ns - GetNewBlockTime: 204.534us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.34 MB (2457728) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.656us EXCHANGE_NODE (id=29): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:3ed (host=va1027.foo:22000):(Total: 27.737ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 2.42 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 4.01 MB (4206640) - PerHostPeakMemUsage: 169.54 GB (182043355220) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 27.667ms - ExecTreePrepareTime: 1.166ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 24.19K (24187) - BlocksRecycled: 379 (379) - BufferedPins: 0 (0) - BytesWritten: 50.43 GB (54148464640) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 161.38 GB (173284007936) - ScratchFileUsedBytes: 50.43 GB (54148464640) - TotalBufferWaitTime: 18s337ms - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=31):(Total: 10.424us, non-child: 10.424us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.42 KB (1456) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 333.115ms, non-child: 333.115ms, % non-child: 100.00%) - CodegenTime: 4.889ms - CompileTime: 77.332ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 131 (131) - NumInstructions: 3.40K (3397) - OptimizationTime: 233.276ms - PeakMemoryUsage: 1.66 MB (1739264) - PrepareTime: 21.914ms SORT_NODE (id=18):(Total: 1.165ms, non-child: 47.880us, % non-child: 4.11%) ExecOption: Codegen Enabled - InsertBatchTime: 0.000ns - PeakMemoryUsage: 4.00 KB (4096) - RowsReturned: 0 (0) - RowsReturnedRate: 0 AGGREGATION_NODE (id=30):(Total: 1.117ms, non-child: 1.117ms, % non-child: 100.00%) ExecOption: Codegen Enabled - BuildTime: 0.000ns - GetNewBlockTime: 275.246us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.34 MB (2457728) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.721us EXCHANGE_NODE (id=29): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:3e0 (host=ve1126.foo:22000):(Total: 27.674ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 4.01 MB (4206640) - PerHostPeakMemUsage: 169.56 GB (182065029600) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 27.617ms - ExecTreePrepareTime: 1.458ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 24.65K (24649) - BlocksRecycled: 543 (543) - BufferedPins: 0 (0) - BytesWritten: 46.05 GB (49450844160) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 161.38 GB (173284007936) - ScratchFileUsedBytes: 46.05 GB (49450844160) - TotalBufferWaitTime: 3s217ms - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=31):(Total: 34.924us, non-child: 34.924us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.42 KB (1456) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 332.106ms, non-child: 332.106ms, % non-child: 100.00%) - CodegenTime: 4.385ms - CompileTime: 79.347ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 131 (131) - NumInstructions: 3.40K (3397) - OptimizationTime: 230.315ms - PeakMemoryUsage: 1.66 MB (1739264) - PrepareTime: 21.935ms SORT_NODE (id=18):(Total: 1.457ms, non-child: 48.154us, % non-child: 3.30%) ExecOption: Codegen Enabled - InsertBatchTime: 0.000ns - PeakMemoryUsage: 4.00 KB (4096) - RowsReturned: 0 (0) - RowsReturnedRate: 0 AGGREGATION_NODE (id=30):(Total: 1.409ms, non-child: 1.409ms, % non-child: 100.00%) ExecOption: Codegen Enabled - BuildTime: 0.000ns - GetNewBlockTime: 521.022us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.34 MB (2457728) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.967us EXCHANGE_NODE (id=29): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:3da (host=vc1538.foo:22000):(Total: 27.594ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 4.01 MB (4206640) - PerHostPeakMemUsage: 169.56 GB (182066816132) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 27.536ms - ExecTreePrepareTime: 887.945us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 23.90K (23901) - BlocksRecycled: 354 (354) - BufferedPins: 0 (0) - BytesWritten: 40.21 GB (43176165376) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 161.38 GB (173284007936) - ScratchFileUsedBytes: 40.21 GB (43176165376) - TotalBufferWaitTime: 3s701ms - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=31):(Total: 21.971us, non-child: 21.971us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.42 KB (1456) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 323.551ms, non-child: 323.551ms, % non-child: 100.00%) - CodegenTime: 4.229ms - CompileTime: 78.077ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 131 (131) - NumInstructions: 3.40K (3397) - OptimizationTime: 222.298ms - PeakMemoryUsage: 1.66 MB (1739264) - PrepareTime: 22.693ms SORT_NODE (id=18):(Total: 886.973us, non-child: 41.500us, % non-child: 4.68%) ExecOption: Codegen Enabled - InsertBatchTime: 0.000ns - PeakMemoryUsage: 4.00 KB (4096) - RowsReturned: 0 (0) - RowsReturnedRate: 0 AGGREGATION_NODE (id=30):(Total: 845.473us, non-child: 845.473us, % non-child: 100.00%) ExecOption: Codegen Enabled - BuildTime: 0.000ns - GetNewBlockTime: 190.864us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.34 MB (2457728) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.579us EXCHANGE_NODE (id=29): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:40f (host=ve1134.foo:22000):(Total: 27.471ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 4.01 MB (4206640) - PerHostPeakMemUsage: 169.56 GB (182064974107) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 27.421ms - ExecTreePrepareTime: 1.018ms BlockMgr: - BlockWritesOutstanding: 15 (15) - BlocksCreated: 24.24K (24241) - BlocksRecycled: 354 (354) - BufferedPins: 0 (0) - BytesWritten: 43.08 GB (46254784512) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 161.38 GB (173284007936) - ScratchFileUsedBytes: 43.08 GB (46254784512) - TotalBufferWaitTime: 8s827ms - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=31):(Total: 18.436us, non-child: 18.436us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.42 KB (1456) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 336.946ms, non-child: 336.946ms, % non-child: 100.00%) - CodegenTime: 4.211ms - CompileTime: 83.188ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 131 (131) - NumInstructions: 3.40K (3397) - OptimizationTime: 230.720ms - PeakMemoryUsage: 1.66 MB (1739264) - PrepareTime: 22.536ms SORT_NODE (id=18):(Total: 1.017ms, non-child: 38.390us, % non-child: 3.77%) ExecOption: Codegen Enabled - InsertBatchTime: 0.000ns - PeakMemoryUsage: 4.00 KB (4096) - RowsReturned: 0 (0) - RowsReturnedRate: 0 AGGREGATION_NODE (id=30):(Total: 979.169us, non-child: 979.169us, % non-child: 100.00%) ExecOption: Codegen Enabled - BuildTime: 0.000ns - GetNewBlockTime: 266.879us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.34 MB (2457728) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.724us EXCHANGE_NODE (id=29): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:422 (host=va1045.foo:22000):(Total: 27.416ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 2.42 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 4.01 MB (4206640) - PerHostPeakMemUsage: 169.56 GB (182061058974) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 27.331ms - ExecTreePrepareTime: 1.252ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 24.64K (24637) - BlocksRecycled: 488 (488) - BufferedPins: 0 (0) - BytesWritten: 45.96 GB (49350180864) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 161.38 GB (173284007936) - ScratchFileUsedBytes: 45.96 GB (49350180864) - TotalBufferWaitTime: 2s435ms - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=31):(Total: 27.935us, non-child: 27.935us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.42 KB (1456) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 468.786ms, non-child: 468.786ms, % non-child: 100.00%) - CodegenTime: 4.945ms - CompileTime: 175.829ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 131 (131) - NumInstructions: 3.40K (3397) - OptimizationTime: 270.585ms - PeakMemoryUsage: 1.66 MB (1739264) - PrepareTime: 21.837ms SORT_NODE (id=18):(Total: 1.251ms, non-child: 38.536us, % non-child: 3.08%) ExecOption: Codegen Enabled - InsertBatchTime: 0.000ns - PeakMemoryUsage: 4.00 KB (4096) - RowsReturned: 0 (0) - RowsReturnedRate: 0 AGGREGATION_NODE (id=30):(Total: 1.213ms, non-child: 1.213ms, % non-child: 100.00%) ExecOption: Codegen Enabled - BuildTime: 0.000ns - GetNewBlockTime: 222.143us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.34 MB (2457728) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.642us EXCHANGE_NODE (id=29): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:40d (host=vc1535.foo:22000):(Total: 27.289ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 4.01 MB (4206640) - PerHostPeakMemUsage: 169.57 GB (182070261522) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 27.238ms - ExecTreePrepareTime: 957.726us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 24.37K (24370) - BlocksRecycled: 354 (354) - BufferedPins: 0 (0) - BytesWritten: 43.88 GB (47118811136) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 161.38 GB (173284007936) - ScratchFileUsedBytes: 43.88 GB (47118811136) - TotalBufferWaitTime: 4s180ms - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=31):(Total: 21.369us, non-child: 21.369us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.42 KB (1456) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 322.064ms, non-child: 322.064ms, % non-child: 100.00%) - CodegenTime: 4.376ms - CompileTime: 76.566ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 131 (131) - NumInstructions: 3.40K (3397) - OptimizationTime: 222.797ms - PeakMemoryUsage: 1.66 MB (1739264) - PrepareTime: 22.215ms SORT_NODE (id=18):(Total: 956.573us, non-child: 39.513us, % non-child: 4.13%) ExecOption: Codegen Enabled - InsertBatchTime: 0.000ns - PeakMemoryUsage: 4.00 KB (4096) - RowsReturned: 0 (0) - RowsReturnedRate: 0 AGGREGATION_NODE (id=30):(Total: 917.060us, non-child: 917.060us, % non-child: 100.00%) ExecOption: Codegen Enabled - BuildTime: 0.000ns - GetNewBlockTime: 224.852us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.34 MB (2457728) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.672us EXCHANGE_NODE (id=29): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:432 (host=vc1518.foo:22000):(Total: 26.829ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 2.42 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 4.01 MB (4206640) - PerHostPeakMemUsage: 169.57 GB (182075770335) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 26.782ms - ExecTreePrepareTime: 888.539us BlockMgr: - BlockWritesOutstanding: 15 (15) - BlocksCreated: 24.40K (24403) - BlocksRecycled: 354 (354) - BufferedPins: 0 (0) - BytesWritten: 46.23 GB (49643782144) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 161.38 GB (173284007936) - ScratchFileUsedBytes: 46.23 GB (49643782144) - TotalBufferWaitTime: 18s584ms - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=31):(Total: 19.585us, non-child: 19.585us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.42 KB (1456) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 342.971ms, non-child: 342.971ms, % non-child: 100.00%) - CodegenTime: 4.065ms - CompileTime: 83.988ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 131 (131) - NumInstructions: 3.40K (3397) - OptimizationTime: 236.288ms - PeakMemoryUsage: 1.66 MB (1739264) - PrepareTime: 22.196ms SORT_NODE (id=18):(Total: 887.472us, non-child: 36.183us, % non-child: 4.08%) ExecOption: Codegen Enabled - InsertBatchTime: 0.000ns - PeakMemoryUsage: 4.00 KB (4096) - RowsReturned: 0 (0) - RowsReturnedRate: 0 AGGREGATION_NODE (id=30):(Total: 851.289us, non-child: 851.289us, % non-child: 100.00%) ExecOption: Codegen Enabled - BuildTime: 0.000ns - GetNewBlockTime: 200.992us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.34 MB (2457728) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.654us EXCHANGE_NODE (id=29): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:423 (host=vd1342.foo:22000):(Total: 26.807ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 2.42 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 4.01 MB (4206640) - PerHostPeakMemUsage: 169.55 GB (182056923792) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 26.757ms - ExecTreePrepareTime: 919.006us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 24.05K (24054) - BlocksRecycled: 354 (354) - BufferedPins: 0 (0) - BytesWritten: 41.41 GB (44459622400) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 161.38 GB (173284007936) - ScratchFileUsedBytes: 41.41 GB (44459622400) - TotalBufferWaitTime: 2s807ms - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=31):(Total: 20.287us, non-child: 20.287us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.42 KB (1456) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 311.025ms, non-child: 311.025ms, % non-child: 100.00%) - CodegenTime: 4.329ms - CompileTime: 74.405ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 131 (131) - NumInstructions: 3.40K (3397) - OptimizationTime: 214.396ms - PeakMemoryUsage: 1.66 MB (1739264) - PrepareTime: 21.746ms SORT_NODE (id=18):(Total: 918.195us, non-child: 38.579us, % non-child: 4.20%) ExecOption: Codegen Enabled - InsertBatchTime: 0.000ns - PeakMemoryUsage: 4.00 KB (4096) - RowsReturned: 0 (0) - RowsReturnedRate: 0 AGGREGATION_NODE (id=30):(Total: 879.616us, non-child: 879.616us, % non-child: 100.00%) ExecOption: Codegen Enabled - BuildTime: 0.000ns - GetNewBlockTime: 188.110us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.34 MB (2457728) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.863us EXCHANGE_NODE (id=29): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:3f3 (host=vc1530.foo:22000):(Total: 26.639ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 2.36 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 4.01 MB (4206640) - PerHostPeakMemUsage: 169.56 GB (182062118557) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 26.585ms - ExecTreePrepareTime: 926.713us BlockMgr: - BlockWritesOutstanding: 1 (1) - BlocksCreated: 24.73K (24726) - BlocksRecycled: 970 (970) - BufferedPins: 0 (0) - BytesWritten: 46.66 GB (50105155584) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 161.38 GB (173284007936) - ScratchFileUsedBytes: 46.66 GB (50105155584) - TotalBufferWaitTime: 3s771ms - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=31):(Total: 20.744us, non-child: 20.744us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.42 KB (1456) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 322.861ms, non-child: 322.861ms, % non-child: 100.00%) - CodegenTime: 4.328ms - CompileTime: 75.578ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 131 (131) - NumInstructions: 3.40K (3397) - OptimizationTime: 224.931ms - PeakMemoryUsage: 1.66 MB (1739264) - PrepareTime: 21.893ms SORT_NODE (id=18):(Total: 925.805us, non-child: 40.778us, % non-child: 4.40%) ExecOption: Codegen Enabled - InsertBatchTime: 0.000ns - PeakMemoryUsage: 4.00 KB (4096) - RowsReturned: 0 (0) - RowsReturnedRate: 0 AGGREGATION_NODE (id=30):(Total: 885.027us, non-child: 885.027us, % non-child: 100.00%) ExecOption: Codegen Enabled - BuildTime: 0.000ns - GetNewBlockTime: 182.597us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.34 MB (2457728) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.625us EXCHANGE_NODE (id=29): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:3ec (host=vd1115.foo:22000):(Total: 26.571ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 2.42 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 4.01 MB (4206640) - PerHostPeakMemUsage: 169.57 GB (182077227576) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 26.500ms - ExecTreePrepareTime: 981.535us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 23.33K (23329) - BlocksRecycled: 465 (465) - BufferedPins: 0 (0) - BytesWritten: 35.74 GB (38377881600) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 161.38 GB (173284007936) - ScratchFileUsedBytes: 35.74 GB (38377881600) - TotalBufferWaitTime: 14s883ms - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=31):(Total: 22.458us, non-child: 22.458us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.42 KB (1456) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 315.771ms, non-child: 315.771ms, % non-child: 100.00%) - CodegenTime: 4.405ms - CompileTime: 75.136ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 131 (131) - NumInstructions: 3.40K (3397) - OptimizationTime: 218.724ms - PeakMemoryUsage: 1.66 MB (1739264) - PrepareTime: 21.437ms SORT_NODE (id=18):(Total: 980.709us, non-child: 39.180us, % non-child: 4.00%) ExecOption: Codegen Enabled - InsertBatchTime: 0.000ns - PeakMemoryUsage: 4.00 KB (4096) - RowsReturned: 0 (0) - RowsReturnedRate: 0 AGGREGATION_NODE (id=30):(Total: 941.529us, non-child: 941.529us, % non-child: 100.00%) ExecOption: Codegen Enabled - BuildTime: 0.000ns - GetNewBlockTime: 227.252us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.34 MB (2457728) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.729us EXCHANGE_NODE (id=29): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:3f0 (host=vd1129.foo:22000):(Total: 26.539ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 4.01 MB (4206640) - PerHostPeakMemUsage: 169.56 GB (182059979970) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 26.475ms - ExecTreePrepareTime: 1.234ms BlockMgr: - BlockWritesOutstanding: 1 (1) - BlocksCreated: 23.96K (23959) - BlocksRecycled: 354 (354) - BufferedPins: 0 (0) - BytesWritten: 40.67 GB (43671093248) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 161.38 GB (173284007936) - ScratchFileUsedBytes: 40.67 GB (43671093248) - TotalBufferWaitTime: 4s054ms - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=31):(Total: 14.225us, non-child: 14.225us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.42 KB (1456) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 323.713ms, non-child: 323.713ms, % non-child: 100.00%) - CodegenTime: 5.228ms - CompileTime: 76.708ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 131 (131) - NumInstructions: 3.40K (3397) - OptimizationTime: 226.101ms - PeakMemoryUsage: 1.66 MB (1739264) - PrepareTime: 20.418ms SORT_NODE (id=18):(Total: 1.233ms, non-child: 54.648us, % non-child: 4.43%) ExecOption: Codegen Enabled - InsertBatchTime: 0.000ns - PeakMemoryUsage: 4.00 KB (4096) - RowsReturned: 0 (0) - RowsReturnedRate: 0 AGGREGATION_NODE (id=30):(Total: 1.179ms, non-child: 1.179ms, % non-child: 100.00%) ExecOption: Codegen Enabled - BuildTime: 0.000ns - GetNewBlockTime: 385.838us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.34 MB (2457728) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.893us EXCHANGE_NODE (id=29): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:3df (host=vd1117.foo:22000):(Total: 26.504ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 2.42 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 4.01 MB (4206640) - PerHostPeakMemUsage: 169.56 GB (182068232415) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 26.451ms - ExecTreePrepareTime: 946.101us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 23.34K (23344) - BlocksRecycled: 468 (468) - BufferedPins: 0 (0) - BytesWritten: 35.86 GB (38503710720) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 161.38 GB (173284007936) - ScratchFileUsedBytes: 35.86 GB (38503710720) - TotalBufferWaitTime: 2s334ms - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=31):(Total: 18.843us, non-child: 18.843us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.42 KB (1456) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 320.556ms, non-child: 320.556ms, % non-child: 100.00%) - CodegenTime: 5.070ms - CompileTime: 76.825ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 131 (131) - NumInstructions: 3.40K (3397) - OptimizationTime: 222.141ms - PeakMemoryUsage: 1.66 MB (1739264) - PrepareTime: 21.093ms SORT_NODE (id=18):(Total: 945.162us, non-child: 43.570us, % non-child: 4.61%) ExecOption: Codegen Enabled - InsertBatchTime: 0.000ns - PeakMemoryUsage: 4.00 KB (4096) - RowsReturned: 0 (0) - RowsReturnedRate: 0 AGGREGATION_NODE (id=30):(Total: 901.592us, non-child: 901.592us, % non-child: 100.00%) ExecOption: Codegen Enabled - BuildTime: 0.000ns - GetNewBlockTime: 227.262us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.34 MB (2457728) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.621us EXCHANGE_NODE (id=29): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:411 (host=vd1102.foo:22000):(Total: 26.503ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 4.01 MB (4206640) - PerHostPeakMemUsage: 169.56 GB (182064217136) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 26.440ms - ExecTreePrepareTime: 961.225us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 24.39K (24390) - BlocksRecycled: 354 (354) - BufferedPins: 0 (0) - BytesWritten: 44.03 GB (47278194688) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 161.38 GB (173284007936) - ScratchFileUsedBytes: 44.03 GB (47278194688) - TotalBufferWaitTime: 3s527ms - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=31):(Total: 23.478us, non-child: 23.478us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.42 KB (1456) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 311.869ms, non-child: 311.869ms, % non-child: 100.00%) - CodegenTime: 4.710ms - CompileTime: 74.593ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 131 (131) - NumInstructions: 3.40K (3397) - OptimizationTime: 215.509ms - PeakMemoryUsage: 1.66 MB (1739264) - PrepareTime: 21.000ms SORT_NODE (id=18):(Total: 960.199us, non-child: 37.974us, % non-child: 3.95%) ExecOption: Codegen Enabled - InsertBatchTime: 0.000ns - PeakMemoryUsage: 4.00 KB (4096) - RowsReturned: 0 (0) - RowsReturnedRate: 0 AGGREGATION_NODE (id=30):(Total: 922.225us, non-child: 922.225us, % non-child: 100.00%) ExecOption: Codegen Enabled - BuildTime: 0.000ns - GetNewBlockTime: 259.034us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.34 MB (2457728) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.672us EXCHANGE_NODE (id=29): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:437 (host=vc1539.foo:22000):(Total: 26.404ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 2.42 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 4.01 MB (4206640) - PerHostPeakMemUsage: 169.57 GB (182073034609) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 26.350ms - ExecTreePrepareTime: 947.139us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 24.07K (24075) - BlocksRecycled: 354 (354) - BufferedPins: 0 (0) - BytesWritten: 41.57 GB (44635783168) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 161.38 GB (173284007936) - ScratchFileUsedBytes: 41.57 GB (44635783168) - TotalBufferWaitTime: 3s584ms - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=31):(Total: 20.016us, non-child: 20.016us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.42 KB (1456) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 330.591ms, non-child: 330.591ms, % non-child: 100.00%) - CodegenTime: 4.508ms - CompileTime: 80.778ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 131 (131) - NumInstructions: 3.40K (3397) - OptimizationTime: 228.075ms - PeakMemoryUsage: 1.66 MB (1739264) - PrepareTime: 21.261ms SORT_NODE (id=18):(Total: 946.247us, non-child: 79.339us, % non-child: 8.38%) ExecOption: Codegen Enabled - InsertBatchTime: 0.000ns - PeakMemoryUsage: 4.00 KB (4096) - RowsReturned: 0 (0) - RowsReturnedRate: 0 AGGREGATION_NODE (id=30):(Total: 866.908us, non-child: 866.908us, % non-child: 100.00%) ExecOption: Codegen Enabled - BuildTime: 0.000ns - GetNewBlockTime: 183.855us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.34 MB (2457728) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.679us EXCHANGE_NODE (id=29): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:443 (host=vd1118.foo:22000):(Total: 26.393ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 4.01 MB (4206640) - PerHostPeakMemUsage: 169.55 GB (182054034148) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 26.318ms - ExecTreePrepareTime: 1.050ms BlockMgr: - BlockWritesOutstanding: 15 (15) - BlocksCreated: 24.35K (24351) - BlocksRecycled: 354 (354) - BufferedPins: 0 (0) - BytesWritten: 48.12 GB (51665436672) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 161.38 GB (173284007936) - ScratchFileUsedBytes: 48.12 GB (51665436672) - TotalBufferWaitTime: 7s725ms - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=31):(Total: 15.692us, non-child: 15.692us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.42 KB (1456) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 322.759ms, non-child: 322.759ms, % non-child: 100.00%) - CodegenTime: 4.374ms - CompileTime: 76.534ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 131 (131) - NumInstructions: 3.40K (3397) - OptimizationTime: 224.666ms - PeakMemoryUsage: 1.66 MB (1739264) - PrepareTime: 21.043ms SORT_NODE (id=18):(Total: 1.049ms, non-child: 49.011us, % non-child: 4.67%) ExecOption: Codegen Enabled - InsertBatchTime: 0.000ns - PeakMemoryUsage: 4.00 KB (4096) - RowsReturned: 0 (0) - RowsReturnedRate: 0 AGGREGATION_NODE (id=30):(Total: 1.000ms, non-child: 1.000ms, % non-child: 100.00%) ExecOption: Codegen Enabled - BuildTime: 0.000ns - GetNewBlockTime: 225.189us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.34 MB (2457728) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 621.000ns EXCHANGE_NODE (id=29): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:404 (host=vd1139.foo:22000):(Total: 26.357ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 2.42 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 4.01 MB (4206640) - PerHostPeakMemUsage: 169.56 GB (182064187763) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 26.307ms - ExecTreePrepareTime: 970.883us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 24.34K (24341) - BlocksRecycled: 354 (354) - BufferedPins: 0 (0) - BytesWritten: 43.65 GB (46867152896) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 161.38 GB (173284007936) - ScratchFileUsedBytes: 43.65 GB (46867152896) - TotalBufferWaitTime: 2s381ms - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=31):(Total: 19.658us, non-child: 19.658us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.42 KB (1456) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 318.415ms, non-child: 318.415ms, % non-child: 100.00%) - CodegenTime: 4.148ms - CompileTime: 76.891ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 131 (131) - NumInstructions: 3.40K (3397) - OptimizationTime: 219.689ms - PeakMemoryUsage: 1.66 MB (1739264) - PrepareTime: 21.304ms SORT_NODE (id=18):(Total: 969.944us, non-child: 37.807us, % non-child: 3.90%) ExecOption: Codegen Enabled - InsertBatchTime: 0.000ns - PeakMemoryUsage: 4.00 KB (4096) - RowsReturned: 0 (0) - RowsReturnedRate: 0 AGGREGATION_NODE (id=30):(Total: 932.137us, non-child: 932.137us, % non-child: 100.00%) ExecOption: Codegen Enabled - BuildTime: 0.000ns - GetNewBlockTime: 227.462us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.34 MB (2457728) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.860us EXCHANGE_NODE (id=29): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:3fe (host=vd1125.foo:22000):(Total: 26.240ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 2.42 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 4.01 MB (4206640) - PerHostPeakMemUsage: 169.56 GB (182067071571) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 26.155ms - ExecTreePrepareTime: 859.803us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 23.89K (23895) - BlocksRecycled: 354 (354) - BufferedPins: 0 (0) - BytesWritten: 40.17 GB (43134222336) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 161.38 GB (173284007936) - ScratchFileUsedBytes: 40.17 GB (43134222336) - TotalBufferWaitTime: 8s322ms - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=31):(Total: 13.265us, non-child: 13.265us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.42 KB (1456) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 346.493ms, non-child: 346.493ms, % non-child: 100.00%) - CodegenTime: 4.870ms - CompileTime: 80.192ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 131 (131) - NumInstructions: 3.40K (3397) - OptimizationTime: 244.263ms - PeakMemoryUsage: 1.66 MB (1739264) - PrepareTime: 21.547ms SORT_NODE (id=18):(Total: 859.162us, non-child: 27.633us, % non-child: 3.22%) ExecOption: Codegen Enabled - InsertBatchTime: 0.000ns - PeakMemoryUsage: 4.00 KB (4096) - RowsReturned: 0 (0) - RowsReturnedRate: 0 AGGREGATION_NODE (id=30):(Total: 831.529us, non-child: 831.529us, % non-child: 100.00%) ExecOption: Codegen Enabled - BuildTime: 0.000ns - GetNewBlockTime: 236.095us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.34 MB (2457728) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 620.000ns EXCHANGE_NODE (id=29): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:401 (host=vd1338.foo:22000):(Total: 26.052ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 2.42 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 4.01 MB (4206640) - PerHostPeakMemUsage: 169.56 GB (182065416325) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 26.005ms - ExecTreePrepareTime: 1.018ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 24.61K (24609) - BlocksRecycled: 924 (924) - BufferedPins: 0 (0) - BytesWritten: 45.74 GB (49115299840) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 161.38 GB (173284007936) - ScratchFileUsedBytes: 45.74 GB (49115299840) - TotalBufferWaitTime: 3s697ms - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=31):(Total: 51.151us, non-child: 51.151us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.42 KB (1456) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 316.639ms, non-child: 316.639ms, % non-child: 100.00%) - CodegenTime: 4.545ms - CompileTime: 78.254ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 131 (131) - NumInstructions: 3.40K (3397) - OptimizationTime: 217.074ms - PeakMemoryUsage: 1.66 MB (1739264) - PrepareTime: 20.831ms SORT_NODE (id=18):(Total: 1.017ms, non-child: 56.156us, % non-child: 5.52%) ExecOption: Codegen Enabled - InsertBatchTime: 0.000ns - PeakMemoryUsage: 4.00 KB (4096) - RowsReturned: 0 (0) - RowsReturnedRate: 0 AGGREGATION_NODE (id=30):(Total: 961.039us, non-child: 961.039us, % non-child: 100.00%) ExecOption: Codegen Enabled - BuildTime: 0.000ns - GetNewBlockTime: 211.511us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.34 MB (2457728) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.635us EXCHANGE_NODE (id=29): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:3eb (host=vc1531.foo:22000):(Total: 25.999ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 4.01 MB (4206640) - PerHostPeakMemUsage: 169.56 GB (182064015224) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 25.948ms - ExecTreePrepareTime: 956.913us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 23.90K (23902) - BlocksRecycled: 354 (354) - BufferedPins: 0 (0) - BytesWritten: 40.22 GB (43184553984) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 161.38 GB (173284007936) - ScratchFileUsedBytes: 40.22 GB (43184553984) - TotalBufferWaitTime: 2s253ms - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=31):(Total: 18.750us, non-child: 18.750us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.42 KB (1456) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 315.128ms, non-child: 315.128ms, % non-child: 100.00%) - CodegenTime: 4.231ms - CompileTime: 75.651ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 131 (131) - NumInstructions: 3.40K (3397) - OptimizationTime: 217.935ms - PeakMemoryUsage: 1.66 MB (1739264) - PrepareTime: 21.044ms SORT_NODE (id=18):(Total: 955.807us, non-child: 38.632us, % non-child: 4.04%) ExecOption: Codegen Enabled - InsertBatchTime: 0.000ns - PeakMemoryUsage: 4.00 KB (4096) - RowsReturned: 0 (0) - RowsReturnedRate: 0 AGGREGATION_NODE (id=30):(Total: 917.175us, non-child: 917.175us, % non-child: 100.00%) ExecOption: Codegen Enabled - BuildTime: 0.000ns - GetNewBlockTime: 226.680us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.34 MB (2457728) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.671us EXCHANGE_NODE (id=29): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:446 (host=vd1119.foo:22000):(Total: 25.978ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 2.36 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 4.01 MB (4206640) - PerHostPeakMemUsage: 169.57 GB (182073242429) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 25.926ms - ExecTreePrepareTime: 884.238us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 24.38K (24380) - BlocksRecycled: 354 (354) - BufferedPins: 0 (0) - BytesWritten: 43.95 GB (47194308608) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 161.38 GB (173284007936) - ScratchFileUsedBytes: 43.95 GB (47194308608) - TotalBufferWaitTime: 6s013ms - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=31):(Total: 18.998us, non-child: 18.998us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.42 KB (1456) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 339.934ms, non-child: 339.934ms, % non-child: 100.00%) - CodegenTime: 4.228ms - CompileTime: 85.532ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 131 (131) - NumInstructions: 3.40K (3397) - OptimizationTime: 232.715ms - PeakMemoryUsage: 1.66 MB (1739264) - PrepareTime: 21.192ms SORT_NODE (id=18):(Total: 883.334us, non-child: 38.551us, % non-child: 4.36%) ExecOption: Codegen Enabled - InsertBatchTime: 0.000ns - PeakMemoryUsage: 4.00 KB (4096) - RowsReturned: 0 (0) - RowsReturnedRate: 0 AGGREGATION_NODE (id=30):(Total: 844.783us, non-child: 844.783us, % non-child: 100.00%) ExecOption: Codegen Enabled - BuildTime: 0.000ns - GetNewBlockTime: 193.660us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.34 MB (2457728) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.647us EXCHANGE_NODE (id=29): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:3f2 (host=vc1501.foo:22000):(Total: 25.696ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 4.01 MB (4206640) - PerHostPeakMemUsage: 169.58 GB (182084640221) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 25.647ms - ExecTreePrepareTime: 781.448us BlockMgr: - BlockWritesOutstanding: 15 (15) - BlocksCreated: 24.70K (24698) - BlocksRecycled: 1.03K (1035) - BufferedPins: 0 (0) - BytesWritten: 53.88 GB (57856229376) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 161.38 GB (173284007936) - ScratchFileUsedBytes: 53.88 GB (57856229376) - TotalBufferWaitTime: 14s697ms - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=31):(Total: 24.834us, non-child: 24.834us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.42 KB (1456) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 317.054ms, non-child: 317.054ms, % non-child: 100.00%) - CodegenTime: 4.545ms - CompileTime: 74.878ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 131 (131) - NumInstructions: 3.40K (3397) - OptimizationTime: 220.895ms - PeakMemoryUsage: 1.66 MB (1739264) - PrepareTime: 20.781ms SORT_NODE (id=18):(Total: 780.746us, non-child: 33.811us, % non-child: 4.33%) ExecOption: Codegen Enabled - InsertBatchTime: 0.000ns - PeakMemoryUsage: 4.00 KB (4096) - RowsReturned: 0 (0) - RowsReturnedRate: 0 AGGREGATION_NODE (id=30):(Total: 746.935us, non-child: 746.935us, % non-child: 100.00%) ExecOption: Codegen Enabled - BuildTime: 0.000ns - GetNewBlockTime: 139.969us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.34 MB (2457728) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 905.000ns EXCHANGE_NODE (id=29): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:418 (host=vd1110.foo:22000):(Total: 25.611ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 4.01 MB (4206640) - PerHostPeakMemUsage: 169.55 GB (182055427331) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 25.560ms - ExecTreePrepareTime: 898.453us BlockMgr: - BlockWritesOutstanding: 15 (15) - BlocksCreated: 24.40K (24396) - BlocksRecycled: 354 (354) - BufferedPins: 0 (0) - BytesWritten: 51.11 GB (54878273536) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 161.38 GB (173284007936) - ScratchFileUsedBytes: 51.11 GB (54878273536) - TotalBufferWaitTime: 7s324ms - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=31):(Total: 19.806us, non-child: 19.806us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.42 KB (1456) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 318.962ms, non-child: 318.962ms, % non-child: 100.00%) - CodegenTime: 4.124ms - CompileTime: 76.879ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 131 (131) - NumInstructions: 3.40K (3397) - OptimizationTime: 220.659ms - PeakMemoryUsage: 1.66 MB (1739264) - PrepareTime: 20.940ms SORT_NODE (id=18):(Total: 897.661us, non-child: 40.566us, % non-child: 4.52%) ExecOption: Codegen Enabled - InsertBatchTime: 0.000ns - PeakMemoryUsage: 4.00 KB (4096) - RowsReturned: 0 (0) - RowsReturnedRate: 0 AGGREGATION_NODE (id=30):(Total: 857.095us, non-child: 857.095us, % non-child: 100.00%) ExecOption: Codegen Enabled - BuildTime: 0.000ns - GetNewBlockTime: 173.231us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.34 MB (2457728) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.581us EXCHANGE_NODE (id=29): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:427 (host=vc1504.foo:22000):(Total: 25.606ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 4.01 MB (4206640) - PerHostPeakMemUsage: 169.55 GB (182051120599) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 25.556ms - ExecTreePrepareTime: 941.500us BlockMgr: - BlockWritesOutstanding: 1 (1) - BlocksCreated: 24.52K (24523) - BlocksRecycled: 354 (354) - BufferedPins: 0 (0) - BytesWritten: 45.08 GB (48402268160) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 161.38 GB (173284007936) - ScratchFileUsedBytes: 45.08 GB (48402268160) - TotalBufferWaitTime: 4s963ms - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=31):(Total: 20.461us, non-child: 20.461us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.42 KB (1456) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 316.986ms, non-child: 316.986ms, % non-child: 100.00%) - CodegenTime: 4.199ms - CompileTime: 76.352ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 131 (131) - NumInstructions: 3.40K (3397) - OptimizationTime: 219.540ms - PeakMemoryUsage: 1.66 MB (1739264) - PrepareTime: 20.599ms SORT_NODE (id=18):(Total: 940.595us, non-child: 32.585us, % non-child: 3.46%) ExecOption: Codegen Enabled - InsertBatchTime: 0.000ns - PeakMemoryUsage: 4.00 KB (4096) - RowsReturned: 0 (0) - RowsReturnedRate: 0 AGGREGATION_NODE (id=30):(Total: 908.010us, non-child: 908.010us, % non-child: 100.00%) ExecOption: Codegen Enabled - BuildTime: 0.000ns - GetNewBlockTime: 181.042us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.34 MB (2457728) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.958us EXCHANGE_NODE (id=29): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:3ff (host=vc1541.foo:22000):(Total: 25.326ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 4.01 MB (4206640) - PerHostPeakMemUsage: 169.55 GB (182053501934) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 25.274ms - ExecTreePrepareTime: 1.033ms BlockMgr: - BlockWritesOutstanding: 1 (1) - BlocksCreated: 24.10K (24104) - BlocksRecycled: 354 (354) - BufferedPins: 0 (0) - BytesWritten: 41.80 GB (44887441408) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 161.38 GB (173284007936) - ScratchFileUsedBytes: 41.80 GB (44887441408) - TotalBufferWaitTime: 5s209ms - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=31):(Total: 20.687us, non-child: 20.687us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.42 KB (1456) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 315.086ms, non-child: 315.086ms, % non-child: 100.00%) - CodegenTime: 3.982ms - CompileTime: 78.738ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 131 (131) - NumInstructions: 3.40K (3397) - OptimizationTime: 215.584ms - PeakMemoryUsage: 1.66 MB (1739264) - PrepareTime: 20.283ms SORT_NODE (id=18):(Total: 1.032ms, non-child: 48.405us, % non-child: 4.69%) ExecOption: Codegen Enabled - InsertBatchTime: 0.000ns - PeakMemoryUsage: 4.00 KB (4096) - RowsReturned: 0 (0) - RowsReturnedRate: 0 AGGREGATION_NODE (id=30):(Total: 984.527us, non-child: 984.527us, % non-child: 100.00%) ExecOption: Codegen Enabled - BuildTime: 0.000ns - GetNewBlockTime: 256.257us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.34 MB (2457728) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.798us EXCHANGE_NODE (id=29): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:410 (host=vd1340.foo:22000):(Total: 25.214ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 4.01 MB (4206640) - PerHostPeakMemUsage: 169.56 GB (182064352999) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 25.151ms - ExecTreePrepareTime: 1.248ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 24.52K (24522) - BlocksRecycled: 825 (825) - BufferedPins: 0 (0) - BytesWritten: 45.06 GB (48385490944) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 161.38 GB (173284007936) - ScratchFileUsedBytes: 45.06 GB (48385490944) - TotalBufferWaitTime: 2s951ms - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=31):(Total: 29.845us, non-child: 29.845us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.42 KB (1456) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 321.244ms, non-child: 321.244ms, % non-child: 100.00%) - CodegenTime: 4.424ms - CompileTime: 76.929ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 131 (131) - NumInstructions: 3.40K (3397) - OptimizationTime: 224.245ms - PeakMemoryUsage: 1.66 MB (1739264) - PrepareTime: 19.569ms SORT_NODE (id=18):(Total: 1.247ms, non-child: 37.249us, % non-child: 2.99%) ExecOption: Codegen Enabled - InsertBatchTime: 0.000ns - PeakMemoryUsage: 4.00 KB (4096) - RowsReturned: 0 (0) - RowsReturnedRate: 0 AGGREGATION_NODE (id=30):(Total: 1.209ms, non-child: 1.209ms, % non-child: 100.00%) ExecOption: Codegen Enabled - BuildTime: 0.000ns - GetNewBlockTime: 366.065us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.34 MB (2457728) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.807us EXCHANGE_NODE (id=29): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:440 (host=va1036.foo:22000):(Total: 25.118ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 2.42 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 4.01 MB (4206640) - PerHostPeakMemUsage: 169.56 GB (182059851881) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 25.042ms - ExecTreePrepareTime: 906.640us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 24.19K (24189) - BlocksRecycled: 354 (354) - BufferedPins: 0 (0) - BytesWritten: 42.46 GB (45592084480) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 161.38 GB (173284007936) - ScratchFileUsedBytes: 42.46 GB (45592084480) - TotalBufferWaitTime: 3s375ms - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=31):(Total: 25.111us, non-child: 25.111us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.42 KB (1456) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 321.129ms, non-child: 321.129ms, % non-child: 100.00%) - CodegenTime: 4.367ms - CompileTime: 77.714ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 131 (131) - NumInstructions: 3.40K (3397) - OptimizationTime: 222.647ms - PeakMemoryUsage: 1.66 MB (1739264) - PrepareTime: 20.293ms SORT_NODE (id=18):(Total: 905.761us, non-child: 37.670us, % non-child: 4.16%) ExecOption: Codegen Enabled - InsertBatchTime: 0.000ns - PeakMemoryUsage: 4.00 KB (4096) - RowsReturned: 0 (0) - RowsReturnedRate: 0 AGGREGATION_NODE (id=30):(Total: 868.091us, non-child: 868.091us, % non-child: 100.00%) ExecOption: Codegen Enabled - BuildTime: 0.000ns - GetNewBlockTime: 197.544us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.34 MB (2457728) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.842us EXCHANGE_NODE (id=29): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:431 (host=va1031.foo:22000):(Total: 24.919ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 2.42 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 4.01 MB (4206640) - PerHostPeakMemUsage: 169.55 GB (182054131090) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 24.869ms - ExecTreePrepareTime: 891.496us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 23.56K (23558) - BlocksRecycled: 576 (576) - BufferedPins: 0 (0) - BytesWritten: 37.53 GB (40298872832) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 161.38 GB (173284007936) - ScratchFileUsedBytes: 37.53 GB (40298872832) - TotalBufferWaitTime: 4s093ms - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=31):(Total: 23.825us, non-child: 23.825us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.42 KB (1456) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 339.373ms, non-child: 339.373ms, % non-child: 100.00%) - CodegenTime: 3.851ms - CompileTime: 84.328ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 131 (131) - NumInstructions: 3.40K (3397) - OptimizationTime: 233.366ms - PeakMemoryUsage: 1.66 MB (1739264) - PrepareTime: 21.208ms SORT_NODE (id=18):(Total: 890.430us, non-child: 34.970us, % non-child: 3.93%) ExecOption: Codegen Enabled - InsertBatchTime: 0.000ns - PeakMemoryUsage: 4.00 KB (4096) - RowsReturned: 0 (0) - RowsReturnedRate: 0 AGGREGATION_NODE (id=30):(Total: 855.460us, non-child: 855.460us, % non-child: 100.00%) ExecOption: Codegen Enabled - BuildTime: 0.000ns - GetNewBlockTime: 189.055us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.34 MB (2457728) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.601us EXCHANGE_NODE (id=29): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:413 (host=ve1139.foo:22000):(Total: 24.803ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 2.42 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 4.01 MB (4206640) - PerHostPeakMemUsage: 169.57 GB (182077340353) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 24.735ms - ExecTreePrepareTime: 727.357us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 23.98K (23982) - BlocksRecycled: 354 (354) - BufferedPins: 0 (0) - BytesWritten: 40.84 GB (43855642624) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 161.38 GB (173284007936) - ScratchFileUsedBytes: 40.84 GB (43855642624) - TotalBufferWaitTime: 3s681ms - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=31):(Total: 16.822us, non-child: 16.822us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.42 KB (1456) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 322.733ms, non-child: 322.733ms, % non-child: 100.00%) - CodegenTime: 3.691ms - CompileTime: 77.898ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 131 (131) - NumInstructions: 3.40K (3397) - OptimizationTime: 223.790ms - PeakMemoryUsage: 1.66 MB (1739264) - PrepareTime: 20.595ms SORT_NODE (id=18):(Total: 726.584us, non-child: 31.996us, % non-child: 4.40%) ExecOption: Codegen Enabled - InsertBatchTime: 0.000ns - PeakMemoryUsage: 4.00 KB (4096) - RowsReturned: 0 (0) - RowsReturnedRate: 0 AGGREGATION_NODE (id=30):(Total: 694.588us, non-child: 694.588us, % non-child: 100.00%) ExecOption: Codegen Enabled - BuildTime: 0.000ns - GetNewBlockTime: 163.246us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.34 MB (2457728) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.006us EXCHANGE_NODE (id=29): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:40c (host=vc1510.foo:22000):(Total: 24.759ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 2.42 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 4.01 MB (4206640) - PerHostPeakMemUsage: 169.57 GB (182075614100) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 24.671ms - ExecTreePrepareTime: 654.126us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 24.57K (24565) - BlocksRecycled: 354 (354) - BufferedPins: 0 (0) - BytesWritten: 53.41 GB (57344524288) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 161.38 GB (173284007936) - ScratchFileUsedBytes: 53.41 GB (57344524288) - TotalBufferWaitTime: 7s523ms - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=31):(Total: 13.249us, non-child: 13.249us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.42 KB (1456) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 334.956ms, non-child: 334.956ms, % non-child: 100.00%) - CodegenTime: 4.159ms - CompileTime: 79.599ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 131 (131) - NumInstructions: 3.40K (3397) - OptimizationTime: 233.543ms - PeakMemoryUsage: 1.66 MB (1739264) - PrepareTime: 21.189ms SORT_NODE (id=18):(Total: 653.307us, non-child: 29.073us, % non-child: 4.45%) ExecOption: Codegen Enabled - InsertBatchTime: 0.000ns - PeakMemoryUsage: 4.00 KB (4096) - RowsReturned: 0 (0) - RowsReturnedRate: 0 AGGREGATION_NODE (id=30):(Total: 624.234us, non-child: 624.234us, % non-child: 100.00%) ExecOption: Codegen Enabled - BuildTime: 0.000ns - GetNewBlockTime: 139.040us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.34 MB (2457728) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 615.000ns EXCHANGE_NODE (id=29): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:3f4 (host=vc1526.foo:22000):(Total: 24.731ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 2.42 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 4.01 MB (4206640) - PerHostPeakMemUsage: 169.56 GB (182060487844) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 24.591ms - ExecTreePrepareTime: 843.345us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 24.20K (24200) - BlocksRecycled: 354 (354) - BufferedPins: 0 (0) - BytesWritten: 42.55 GB (45684359168) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 161.38 GB (173284007936) - ScratchFileUsedBytes: 42.55 GB (45684359168) - TotalBufferWaitTime: 2s596ms - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=31):(Total: 12.864us, non-child: 12.864us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.42 KB (1456) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 339.130ms, non-child: 339.130ms, % non-child: 100.00%) - CodegenTime: 3.971ms - CompileTime: 83.991ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 131 (131) - NumInstructions: 3.40K (3397) - OptimizationTime: 234.723ms - PeakMemoryUsage: 1.66 MB (1739264) - PrepareTime: 19.844ms SORT_NODE (id=18):(Total: 843.001us, non-child: 30.144us, % non-child: 3.58%) ExecOption: Codegen Enabled - InsertBatchTime: 0.000ns - PeakMemoryUsage: 4.00 KB (4096) - RowsReturned: 0 (0) - RowsReturnedRate: 0 AGGREGATION_NODE (id=30):(Total: 812.857us, non-child: 812.857us, % non-child: 100.00%) ExecOption: Codegen Enabled - BuildTime: 0.000ns - GetNewBlockTime: 194.462us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.34 MB (2457728) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 607.000ns EXCHANGE_NODE (id=29): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:435 (host=vc1513.foo:22000):(Total: 24.715ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 4.01 MB (4206640) - PerHostPeakMemUsage: 169.55 GB (182057389143) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 24.659ms - ExecTreePrepareTime: 888.588us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 24.61K (24614) - BlocksRecycled: 355 (355) - BufferedPins: 0 (0) - BytesWritten: 45.78 GB (49157242880) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 161.38 GB (173284007936) - ScratchFileUsedBytes: 45.78 GB (49157242880) - TotalBufferWaitTime: 4s973ms - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=31):(Total: 18.339us, non-child: 18.339us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.42 KB (1456) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 316.505ms, non-child: 316.505ms, % non-child: 100.00%) - CodegenTime: 3.870ms - CompileTime: 76.137ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 131 (131) - NumInstructions: 3.40K (3397) - OptimizationTime: 219.922ms - PeakMemoryUsage: 1.66 MB (1739264) - PrepareTime: 19.955ms SORT_NODE (id=18):(Total: 887.746us, non-child: 36.448us, % non-child: 4.11%) ExecOption: Codegen Enabled - InsertBatchTime: 0.000ns - PeakMemoryUsage: 4.00 KB (4096) - RowsReturned: 0 (0) - RowsReturnedRate: 0 AGGREGATION_NODE (id=30):(Total: 851.298us, non-child: 851.298us, % non-child: 100.00%) ExecOption: Codegen Enabled - BuildTime: 0.000ns - GetNewBlockTime: 232.423us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.34 MB (2457728) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.666us EXCHANGE_NODE (id=29): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:43d (host=vc1517.foo:22000):(Total: 24.342ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 4.01 MB (4206640) - PerHostPeakMemUsage: 169.57 GB (182072460943) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 24.239ms - ExecTreePrepareTime: 810.233us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 23.77K (23768) - BlocksRecycled: 367 (367) - BufferedPins: 0 (0) - BytesWritten: 39.17 GB (42060480512) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 161.38 GB (173284007936) - ScratchFileUsedBytes: 39.17 GB (42060480512) - TotalBufferWaitTime: 11s636ms - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=31):(Total: 12.952us, non-child: 12.952us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.42 KB (1456) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 324.688ms, non-child: 324.688ms, % non-child: 100.00%) - CodegenTime: 4.200ms - CompileTime: 78.313ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 131 (131) - NumInstructions: 3.40K (3397) - OptimizationTime: 226.656ms - PeakMemoryUsage: 1.66 MB (1739264) - PrepareTime: 19.231ms SORT_NODE (id=18):(Total: 809.331us, non-child: 31.742us, % non-child: 3.92%) ExecOption: Codegen Enabled - InsertBatchTime: 0.000ns - PeakMemoryUsage: 4.00 KB (4096) - RowsReturned: 0 (0) - RowsReturnedRate: 0 AGGREGATION_NODE (id=30):(Total: 777.589us, non-child: 777.589us, % non-child: 100.00%) ExecOption: Codegen Enabled - BuildTime: 0.000ns - GetNewBlockTime: 201.544us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.34 MB (2457728) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 620.000ns EXCHANGE_NODE (id=29): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:41e (host=ve1142.foo:22000):(Total: 24.176ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 2.42 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 4.01 MB (4206640) - PerHostPeakMemUsage: 169.58 GB (182081261058) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 24.129ms - ExecTreePrepareTime: 966.219us BlockMgr: - BlockWritesOutstanding: 1 (1) - BlocksCreated: 24.52K (24525) - BlocksRecycled: 1.06K (1064) - BufferedPins: 0 (0) - BytesWritten: 45.09 GB (48419045376) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 161.38 GB (173284007936) - ScratchFileUsedBytes: 45.09 GB (48419045376) - TotalBufferWaitTime: 3s328ms - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=31):(Total: 20.217us, non-child: 20.217us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.42 KB (1456) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 361.376ms, non-child: 361.376ms, % non-child: 100.00%) - CodegenTime: 4.142ms - CompileTime: 84.471ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 131 (131) - NumInstructions: 3.40K (3397) - OptimizationTime: 256.839ms - PeakMemoryUsage: 1.66 MB (1739264) - PrepareTime: 19.539ms SORT_NODE (id=18):(Total: 965.368us, non-child: 35.997us, % non-child: 3.73%) ExecOption: Codegen Enabled - InsertBatchTime: 0.000ns - PeakMemoryUsage: 4.00 KB (4096) - RowsReturned: 0 (0) - RowsReturnedRate: 0 AGGREGATION_NODE (id=30):(Total: 929.371us, non-child: 929.371us, % non-child: 100.00%) ExecOption: Codegen Enabled - BuildTime: 0.000ns - GetNewBlockTime: 214.368us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.34 MB (2457728) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.956us EXCHANGE_NODE (id=29): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:421 (host=vd1121.foo:22000):(Total: 23.993ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 4.01 MB (4206640) - PerHostPeakMemUsage: 169.57 GB (182076301709) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 23.946ms - ExecTreePrepareTime: 999.768us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 24.30K (24301) - BlocksRecycled: 354 (354) - BufferedPins: 0 (0) - BytesWritten: 43.34 GB (46539997184) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 161.38 GB (173284007936) - ScratchFileUsedBytes: 43.34 GB (46539997184) - TotalBufferWaitTime: 42s067ms - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=31):(Total: 13.993us, non-child: 13.993us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.42 KB (1456) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 315.975ms, non-child: 315.975ms, % non-child: 100.00%) - CodegenTime: 4.228ms - CompileTime: 75.921ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 131 (131) - NumInstructions: 3.40K (3397) - OptimizationTime: 220.607ms - PeakMemoryUsage: 1.66 MB (1739264) - PrepareTime: 18.939ms SORT_NODE (id=18):(Total: 998.802us, non-child: 42.811us, % non-child: 4.29%) ExecOption: Codegen Enabled - InsertBatchTime: 0.000ns - PeakMemoryUsage: 4.00 KB (4096) - RowsReturned: 0 (0) - RowsReturnedRate: 0 AGGREGATION_NODE (id=30):(Total: 955.991us, non-child: 955.991us, % non-child: 100.00%) ExecOption: Codegen Enabled - BuildTime: 0.000ns - GetNewBlockTime: 204.115us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.34 MB (2457728) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.606us EXCHANGE_NODE (id=29): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:42c (host=vc1505.foo:22000):(Total: 23.896ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 2.42 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 4.01 MB (4206640) - PerHostPeakMemUsage: 169.56 GB (182066036121) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 23.852ms - ExecTreePrepareTime: 779.110us BlockMgr: - BlockWritesOutstanding: 15 (15) - BlocksCreated: 24.32K (24325) - BlocksRecycled: 354 (354) - BufferedPins: 0 (0) - BytesWritten: 44.54 GB (47823454208) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 161.38 GB (173284007936) - ScratchFileUsedBytes: 44.54 GB (47823454208) - TotalBufferWaitTime: 21s840ms - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=31):(Total: 11.791us, non-child: 11.791us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.42 KB (1456) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 342.925ms, non-child: 342.925ms, % non-child: 100.00%) - CodegenTime: 4.015ms - CompileTime: 83.800ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 131 (131) - NumInstructions: 3.40K (3397) - OptimizationTime: 239.247ms - PeakMemoryUsage: 1.66 MB (1739264) - PrepareTime: 19.355ms SORT_NODE (id=18):(Total: 778.402us, non-child: 32.537us, % non-child: 4.18%) ExecOption: Codegen Enabled - InsertBatchTime: 0.000ns - PeakMemoryUsage: 4.00 KB (4096) - RowsReturned: 0 (0) - RowsReturnedRate: 0 AGGREGATION_NODE (id=30):(Total: 745.864us, non-child: 745.864us, % non-child: 100.00%) ExecOption: Codegen Enabled - BuildTime: 0.000ns - GetNewBlockTime: 157.378us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.34 MB (2457728) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 17.065us EXCHANGE_NODE (id=29): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:444 (host=vc1529.foo:22000):(Total: 23.708ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 2.42 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 4.01 MB (4206640) - PerHostPeakMemUsage: 169.56 GB (182068133972) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 23.654ms - ExecTreePrepareTime: 697.207us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 23.81K (23812) - BlocksRecycled: 354 (354) - BufferedPins: 0 (0) - BytesWritten: 39.52 GB (42429579264) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 161.38 GB (173284007936) - ScratchFileUsedBytes: 39.52 GB (42429579264) - TotalBufferWaitTime: 2s260ms - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=31):(Total: 10.207us, non-child: 10.207us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.42 KB (1456) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 317.972ms, non-child: 317.972ms, % non-child: 100.00%) - CodegenTime: 4.300ms - CompileTime: 76.669ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 131 (131) - NumInstructions: 3.40K (3397) - OptimizationTime: 221.746ms - PeakMemoryUsage: 1.66 MB (1739264) - PrepareTime: 19.082ms SORT_NODE (id=18):(Total: 696.838us, non-child: 27.497us, % non-child: 3.95%) ExecOption: Codegen Enabled - InsertBatchTime: 0.000ns - PeakMemoryUsage: 4.00 KB (4096) - RowsReturned: 0 (0) - RowsReturnedRate: 0 AGGREGATION_NODE (id=30):(Total: 669.341us, non-child: 669.341us, % non-child: 100.00%) ExecOption: Codegen Enabled - BuildTime: 0.000ns - GetNewBlockTime: 190.201us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.34 MB (2457728) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 554.000ns EXCHANGE_NODE (id=29): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:415 (host=va1030.foo:22000):(Total: 23.635ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 2.42 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 4.01 MB (4206640) - PerHostPeakMemUsage: 169.57 GB (182077449644) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 23.582ms - ExecTreePrepareTime: 832.325us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 23.88K (23879) - BlocksRecycled: 354 (354) - BufferedPins: 0 (0) - BytesWritten: 40.04 GB (42991616000) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 161.38 GB (173284007936) - ScratchFileUsedBytes: 40.04 GB (42991616000) - TotalBufferWaitTime: 22s002ms - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=31):(Total: 13.394us, non-child: 13.394us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.42 KB (1456) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 340.792ms, non-child: 340.792ms, % non-child: 100.00%) - CodegenTime: 4.127ms - CompileTime: 82.791ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 131 (131) - NumInstructions: 3.40K (3397) - OptimizationTime: 238.308ms - PeakMemoryUsage: 1.66 MB (1739264) - PrepareTime: 19.109ms SORT_NODE (id=18):(Total: 831.454us, non-child: 31.183us, % non-child: 3.75%) ExecOption: Codegen Enabled - InsertBatchTime: 0.000ns - PeakMemoryUsage: 4.00 KB (4096) - RowsReturned: 0 (0) - RowsReturnedRate: 0 AGGREGATION_NODE (id=30):(Total: 800.271us, non-child: 800.271us, % non-child: 100.00%) ExecOption: Codegen Enabled - BuildTime: 0.000ns - GetNewBlockTime: 204.012us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.34 MB (2457728) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.409us EXCHANGE_NODE (id=29): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:445 (host=va1041.foo:22000):(Total: 23.630ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 4.01 MB (4206640) - PerHostPeakMemUsage: 169.56 GB (182068847826) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 23.580ms - ExecTreePrepareTime: 924.303us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 24.22K (24220) - BlocksRecycled: 354 (354) - BufferedPins: 0 (0) - BytesWritten: 42.70 GB (45852131328) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 161.38 GB (173284007936) - ScratchFileUsedBytes: 42.70 GB (45852131328) - TotalBufferWaitTime: 5s110ms - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=31):(Total: 21.015us, non-child: 21.015us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.42 KB (1456) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 322.816ms, non-child: 322.816ms, % non-child: 100.00%) - CodegenTime: 4.284ms - CompileTime: 81.428ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 131 (131) - NumInstructions: 3.40K (3397) - OptimizationTime: 222.180ms - PeakMemoryUsage: 1.66 MB (1739264) - PrepareTime: 18.728ms SORT_NODE (id=18):(Total: 923.501us, non-child: 43.728us, % non-child: 4.74%) ExecOption: Codegen Enabled - InsertBatchTime: 0.000ns - PeakMemoryUsage: 4.00 KB (4096) - RowsReturned: 0 (0) - RowsReturnedRate: 0 AGGREGATION_NODE (id=30):(Total: 879.773us, non-child: 879.773us, % non-child: 100.00%) ExecOption: Codegen Enabled - BuildTime: 0.000ns - GetNewBlockTime: 176.501us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.34 MB (2457728) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.653us EXCHANGE_NODE (id=29): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:424 (host=va1035.foo:22000):(Total: 23.213ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 4.01 MB (4206640) - PerHostPeakMemUsage: 169.56 GB (182068743403) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 23.178ms - ExecTreePrepareTime: 639.802us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 24.23K (24232) - BlocksRecycled: 354 (354) - BufferedPins: 0 (0) - BytesWritten: 50.78 GB (54525952000) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 161.38 GB (173284007936) - ScratchFileUsedBytes: 50.78 GB (54525952000) - TotalBufferWaitTime: 6s977ms - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=31):(Total: 10.803us, non-child: 10.803us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.42 KB (1456) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 319.354ms, non-child: 319.354ms, % non-child: 100.00%) - CodegenTime: 3.921ms - CompileTime: 77.980ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 131 (131) - NumInstructions: 3.40K (3397) - OptimizationTime: 221.871ms - PeakMemoryUsage: 1.66 MB (1739264) - PrepareTime: 19.026ms SORT_NODE (id=18):(Total: 639.413us, non-child: 28.711us, % non-child: 4.49%) ExecOption: Codegen Enabled - InsertBatchTime: 0.000ns - PeakMemoryUsage: 4.00 KB (4096) - RowsReturned: 0 (0) - RowsReturnedRate: 0 AGGREGATION_NODE (id=30):(Total: 610.702us, non-child: 610.702us, % non-child: 100.00%) ExecOption: Codegen Enabled - BuildTime: 0.000ns - GetNewBlockTime: 149.034us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.34 MB (2457728) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 749.000ns EXCHANGE_NODE (id=29): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:3dc (host=va1044.foo:22000):(Total: 23.084ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 4.01 MB (4206640) - PerHostPeakMemUsage: 169.57 GB (182072811520) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 23.054ms - ExecTreePrepareTime: 657.300us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 24.58K (24576) - BlocksRecycled: 354 (354) - BufferedPins: 0 (0) - BytesWritten: 45.48 GB (48838475776) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 161.38 GB (173284007936) - ScratchFileUsedBytes: 45.48 GB (48838475776) - TotalBufferWaitTime: 2s331ms - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=31):(Total: 13.053us, non-child: 13.053us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.42 KB (1456) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 317.881ms, non-child: 317.881ms, % non-child: 100.00%) - CodegenTime: 4.297ms - CompileTime: 81.601ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 131 (131) - NumInstructions: 3.40K (3397) - OptimizationTime: 216.898ms - PeakMemoryUsage: 1.66 MB (1739264) - PrepareTime: 18.889ms SORT_NODE (id=18):(Total: 656.820us, non-child: 26.851us, % non-child: 4.09%) ExecOption: Codegen Enabled - InsertBatchTime: 0.000ns - PeakMemoryUsage: 4.00 KB (4096) - RowsReturned: 0 (0) - RowsReturnedRate: 0 AGGREGATION_NODE (id=30):(Total: 629.969us, non-child: 629.969us, % non-child: 100.00%) ExecOption: Codegen Enabled - BuildTime: 0.000ns - GetNewBlockTime: 137.032us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.34 MB (2457728) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 569.000ns EXCHANGE_NODE (id=29): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:3e3 (host=vd1333.foo:22000):(Total: 22.374ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 2.36 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 4.01 MB (4206640) - PerHostPeakMemUsage: 169.57 GB (182072937354) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 22.333ms - ExecTreePrepareTime: 684.656us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 24.02K (24023) - BlocksRecycled: 354 (354) - BufferedPins: 0 (0) - BytesWritten: 41.16 GB (44199575552) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 161.38 GB (173284007936) - ScratchFileUsedBytes: 41.16 GB (44199575552) - TotalBufferWaitTime: 3s909ms - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=31):(Total: 12.515us, non-child: 12.515us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.42 KB (1456) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 317.991ms, non-child: 317.991ms, % non-child: 100.00%) - CodegenTime: 3.949ms - CompileTime: 78.044ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 131 (131) - NumInstructions: 3.40K (3397) - OptimizationTime: 221.179ms - PeakMemoryUsage: 1.66 MB (1739264) - PrepareTime: 18.292ms SORT_NODE (id=18):(Total: 683.943us, non-child: 23.959us, % non-child: 3.50%) ExecOption: Codegen Enabled - InsertBatchTime: 0.000ns - PeakMemoryUsage: 4.00 KB (4096) - RowsReturned: 0 (0) - RowsReturnedRate: 0 AGGREGATION_NODE (id=30):(Total: 659.984us, non-child: 659.984us, % non-child: 100.00%) ExecOption: Codegen Enabled - BuildTime: 0.000ns - GetNewBlockTime: 144.436us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.34 MB (2457728) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 557.000ns EXCHANGE_NODE (id=29): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:41a (host=va1034.foo:22000):(Total: 21.252ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 4.01 MB (4206640) - PerHostPeakMemUsage: 169.57 GB (182073558301) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 21.205ms - ExecTreePrepareTime: 571.832us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 24.45K (24452) - BlocksRecycled: 354 (354) - BufferedPins: 0 (0) - BytesWritten: 52.50 GB (56371445760) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 161.38 GB (173284007936) - ScratchFileUsedBytes: 52.50 GB (56371445760) - TotalBufferWaitTime: 5s295ms - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=31):(Total: 10.886us, non-child: 10.886us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.42 KB (1456) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 306.720ms, non-child: 306.720ms, % non-child: 100.00%) - CodegenTime: 3.471ms - CompileTime: 75.141ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 131 (131) - NumInstructions: 3.40K (3397) - OptimizationTime: 214.007ms - PeakMemoryUsage: 1.66 MB (1739264) - PrepareTime: 17.124ms SORT_NODE (id=18):(Total: 571.444us, non-child: 19.985us, % non-child: 3.50%) ExecOption: Codegen Enabled - InsertBatchTime: 0.000ns - PeakMemoryUsage: 4.00 KB (4096) - RowsReturned: 0 (0) - RowsReturnedRate: 0 AGGREGATION_NODE (id=30):(Total: 551.459us, non-child: 551.459us, % non-child: 100.00%) ExecOption: Codegen Enabled - BuildTime: 0.000ns - GetNewBlockTime: 130.704us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.34 MB (2457728) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 579.000ns EXCHANGE_NODE (id=29): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Averaged Fragment F10:(Total: 64.016ms, non-child: 0.000ns, % non-child: 0.00%) split sizes: min: 0, max: 0, avg: 0, stddev: 0 completion times: min:11m1s max:11m1s mean: 11m1s stddev:5.349ms execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec num instances: 110 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.49 MB (3655048) - PerHostPeakMemUsage: 169.56 GB (182067161454) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 872.832ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 63.955ms - ExecTreePrepareTime: 1.139ms DataStreamSender (dst_id=29):(Total: 908.828us, non-child: 908.828us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 158.12 KB (161920) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 340.706ms, non-child: 340.706ms, % non-child: 100.00%) - CodegenTime: 3.103ms - CompileTime: 99.157ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 96 (96) - NumInstructions: 3.85K (3850) - OptimizationTime: 206.744ms - PeakMemoryUsage: 1.88 MB (1971200) - PrepareTime: 34.042ms AGGREGATION_NODE (id=17):(Total: 1.138ms, non-child: 735.091us, % non-child: 64.57%) - GetNewBlockTime: 182.239us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.34 MB (1409152) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - StreamingTime: 0.000ns - UnpinTime: 0.000ns HASH_JOIN_NODE (id=16):(Total: 403.368us, non-child: 406.736us, % non-child: 100.00%) - BuildRows: 0 (0) - BuildTime: 0.000ns - PeakMemoryUsage: 90.25 KB (92416) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=16): - BuildRowsPartitionTime: 0.000ns - BuildRowsPartitioned: 0 (0) - HashBuckets: 0 (0) - HashCollisions: 0 (0) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 9.12 KB (9344) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=28): - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=27):(Total: 872.833ms, non-child: 872.833ms, % non-child: 100.00%) - BytesReceived: 819.14 KB (838799) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 11.536ms - FirstBatchArrivalWaitTime: 872.825ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Fragment F10: Instance 7f40dcb034de70b7:38b (host=vc1524.foo:22000):(Total: 562.043ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 3.37 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB ThreadUsage(16s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.49 MB (3662531) - PerHostPeakMemUsage: 169.57 GB (182077603970) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 268.963ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 561.970ms - ExecTreePrepareTime: 4.583ms DataStreamSender (dst_id=29):(Total: 42.933ms, non-child: 42.933ms, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 158.12 KB (161920) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 564.991ms, non-child: 564.991ms, % non-child: 100.00%) - CodegenTime: 7.425ms - CompileTime: 111.245ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 96 (96) - NumInstructions: 3.85K (3850) - OptimizationTime: 280.708ms - PeakMemoryUsage: 1.88 MB (1971200) - PrepareTime: 170.991ms AGGREGATION_NODE (id=17):(Total: 4.580ms, non-child: 3.443ms, % non-child: 75.17%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 243.086us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.34 MB (1409152) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - StreamingTime: 0.000ns - UnpinTime: 0.000ns HASH_JOIN_NODE (id=16):(Total: 1.137ms, non-child: 1.141ms, % non-child: 100.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 0 (0) - BuildTime: 0.000ns - PeakMemoryUsage: 90.25 KB (92416) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=16): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 0.000ns - BuildRowsPartitioned: 0 (0) - HashBuckets: 0 (0) - HashCollisions: 0 (0) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 9.12 KB (9344) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=28): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=27):(Total: 268.963ms, non-child: 14.725us, % non-child: 0.01%) BytesReceived(16s000ms): 744.67 KB, 822.15 KB, 822.15 KB, 822.15 KB, 822.15 KB, 822.15 KB, 822.15 KB, 822.15 KB, 822.15 KB, 822.15 KB, 822.15 KB, 822.15 KB, 822.15 KB, 822.15 KB, 822.15 KB, 822.15 KB, 822.15 KB, 822.15 KB, 822.15 KB, 822.15 KB, 822.15 KB, 822.15 KB, 822.15 KB, 822.15 KB, 822.15 KB, 822.15 KB, 822.15 KB, 822.15 KB, 822.15 KB, 822.15 KB, 822.15 KB, 822.15 KB, 822.15 KB, 822.15 KB, 822.15 KB, 822.15 KB, 822.15 KB, 822.15 KB, 822.15 KB, 822.15 KB - BytesReceived: 822.15 KB (841880) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 8.600ms - FirstBatchArrivalWaitTime: 268.946ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:38c (host=vd1331.foo:22000):(Total: 146.491ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 3.39 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB ThreadUsage(16s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.51 MB (3678873) - PerHostPeakMemUsage: 169.56 GB (182068619987) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 763.985ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 146.455ms - ExecTreePrepareTime: 1.860ms DataStreamSender (dst_id=29):(Total: 728.544us, non-child: 728.544us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 158.12 KB (161920) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 352.462ms, non-child: 352.462ms, % non-child: 100.00%) - CodegenTime: 2.269ms - CompileTime: 100.655ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 96 (96) - NumInstructions: 3.85K (3850) - OptimizationTime: 223.561ms - PeakMemoryUsage: 1.88 MB (1971200) - PrepareTime: 27.644ms AGGREGATION_NODE (id=17):(Total: 1.860ms, non-child: 1.517ms, % non-child: 81.57%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 207.932us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.34 MB (1409152) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - StreamingTime: 0.000ns - UnpinTime: 0.000ns HASH_JOIN_NODE (id=16):(Total: 342.790us, non-child: 344.124us, % non-child: 100.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 0 (0) - BuildTime: 0.000ns - PeakMemoryUsage: 90.25 KB (92416) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=16): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 0.000ns - BuildRowsPartitioned: 0 (0) - HashBuckets: 0 (0) - HashCollisions: 0 (0) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 9.12 KB (9344) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=28): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=27):(Total: 763.986ms, non-child: 5.736us, % non-child: 0.00%) BytesReceived(16s000ms): 776.58 KB, 829.71 KB, 829.71 KB, 829.71 KB, 829.71 KB, 829.71 KB, 829.71 KB, 829.71 KB, 829.71 KB, 829.71 KB, 829.71 KB, 829.71 KB, 829.71 KB, 829.71 KB, 829.71 KB, 829.71 KB, 829.71 KB, 829.71 KB, 829.71 KB, 829.71 KB, 829.71 KB, 829.71 KB, 829.71 KB, 829.71 KB, 829.71 KB, 829.71 KB, 829.71 KB, 829.71 KB, 829.71 KB, 829.71 KB, 829.71 KB, 829.71 KB, 829.71 KB, 829.71 KB, 829.71 KB, 829.71 KB, 829.71 KB, 829.71 KB, 829.71 KB, 829.71 KB - BytesReceived: 829.71 KB (849618) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 9.108ms - FirstBatchArrivalWaitTime: 763.977ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:39c (host=va1026.foo:22000):(Total: 90.593ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 3.37 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB ThreadUsage(16s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.50 MB (3664804) - PerHostPeakMemUsage: 169.57 GB (182069270988) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 805.402ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 90.538ms - ExecTreePrepareTime: 1.423ms DataStreamSender (dst_id=29):(Total: 743.556us, non-child: 743.556us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 158.12 KB (161920) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 401.187ms, non-child: 401.187ms, % non-child: 100.00%) - CodegenTime: 9.377ms - CompileTime: 102.867ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 96 (96) - NumInstructions: 3.85K (3850) - OptimizationTime: 256.521ms - PeakMemoryUsage: 1.88 MB (1971200) - PrepareTime: 41.193ms AGGREGATION_NODE (id=17):(Total: 1.422ms, non-child: 920.730us, % non-child: 64.72%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 164.694us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.34 MB (1409152) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - StreamingTime: 0.000ns - UnpinTime: 0.000ns HASH_JOIN_NODE (id=16):(Total: 501.922us, non-child: 504.958us, % non-child: 100.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 0 (0) - BuildTime: 0.000ns - PeakMemoryUsage: 90.25 KB (92416) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=16): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 0.000ns - BuildRowsPartitioned: 0 (0) - HashBuckets: 0 (0) - HashCollisions: 0 (0) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 9.12 KB (9344) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=28): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=27):(Total: 805.403ms, non-child: 4.850us, % non-child: 0.00%) BytesReceived(16s000ms): 745.99 KB, 824.01 KB, 824.01 KB, 824.01 KB, 824.01 KB, 824.01 KB, 824.01 KB, 824.01 KB, 824.01 KB, 824.01 KB, 824.01 KB, 824.01 KB, 824.01 KB, 824.01 KB, 824.01 KB, 824.01 KB, 824.01 KB, 824.01 KB, 824.01 KB, 824.01 KB, 824.01 KB, 824.01 KB, 824.01 KB, 824.01 KB, 824.01 KB, 824.01 KB, 824.01 KB, 824.01 KB, 824.01 KB, 824.01 KB, 824.01 KB, 824.01 KB, 824.01 KB, 824.01 KB, 824.01 KB, 824.01 KB, 824.01 KB, 824.01 KB, 824.01 KB, 824.01 KB - BytesReceived: 824.01 KB (843788) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 10.554ms - FirstBatchArrivalWaitTime: 805.395ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:378 (host=vd1141.foo:22000):(Total: 83.936ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 3.35 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB ThreadUsage(16s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.47 MB (3642880) - PerHostPeakMemUsage: 169.58 GB (182081720861) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 802.687ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 83.833ms - ExecTreePrepareTime: 1.439ms DataStreamSender (dst_id=29):(Total: 649.567us, non-child: 649.567us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 158.12 KB (161920) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 367.513ms, non-child: 367.513ms, % non-child: 100.00%) - CodegenTime: 5.801ms - CompileTime: 102.365ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 96 (96) - NumInstructions: 3.85K (3850) - OptimizationTime: 217.956ms - PeakMemoryUsage: 1.88 MB (1971200) - PrepareTime: 46.531ms AGGREGATION_NODE (id=17):(Total: 1.438ms, non-child: 823.727us, % non-child: 57.26%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 270.484us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.34 MB (1409152) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - StreamingTime: 0.000ns - UnpinTime: 0.000ns HASH_JOIN_NODE (id=16):(Total: 614.877us, non-child: 619.943us, % non-child: 100.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 0 (0) - BuildTime: 0.000ns - PeakMemoryUsage: 90.25 KB (92416) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=16): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 0.000ns - BuildRowsPartitioned: 0 (0) - HashBuckets: 0 (0) - HashCollisions: 0 (0) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 9.12 KB (9344) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=28): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=27):(Total: 802.688ms, non-child: 4.785us, % non-child: 0.00%) BytesReceived(16s000ms): 760.88 KB, 812.83 KB, 812.83 KB, 812.83 KB, 812.83 KB, 812.83 KB, 812.83 KB, 812.83 KB, 812.83 KB, 812.83 KB, 812.83 KB, 812.83 KB, 812.83 KB, 812.83 KB, 812.83 KB, 812.83 KB, 812.83 KB, 812.83 KB, 812.83 KB, 812.83 KB, 812.83 KB, 812.83 KB, 812.83 KB, 812.83 KB, 812.83 KB, 812.83 KB, 812.83 KB, 812.83 KB, 812.83 KB, 812.83 KB, 812.83 KB, 812.83 KB, 812.83 KB, 812.83 KB, 812.83 KB, 812.83 KB, 812.83 KB, 812.83 KB, 812.83 KB, 812.83 KB - BytesReceived: 812.83 KB (832343) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 9.741ms - FirstBatchArrivalWaitTime: 802.681ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:399 (host=vd1104.foo:22000):(Total: 83.811ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 3.28 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB ThreadUsage(16s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.47 MB (3642880) - PerHostPeakMemUsage: 169.57 GB (182079364681) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 856.224ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 83.717ms - ExecTreePrepareTime: 1.299ms DataStreamSender (dst_id=29):(Total: 666.845us, non-child: 666.845us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 158.12 KB (161920) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 370.547ms, non-child: 370.547ms, % non-child: 100.00%) - CodegenTime: 2.929ms - CompileTime: 102.357ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 96 (96) - NumInstructions: 3.85K (3850) - OptimizationTime: 214.867ms - PeakMemoryUsage: 1.88 MB (1971200) - PrepareTime: 51.931ms AGGREGATION_NODE (id=17):(Total: 1.298ms, non-child: 788.300us, % non-child: 60.72%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 240.317us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.34 MB (1409152) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - StreamingTime: 0.000ns - UnpinTime: 0.000ns HASH_JOIN_NODE (id=16):(Total: 509.848us, non-child: 513.874us, % non-child: 100.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 0 (0) - BuildTime: 0.000ns - PeakMemoryUsage: 90.25 KB (92416) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=16): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 0.000ns - BuildRowsPartitioned: 0 (0) - HashBuckets: 0 (0) - HashCollisions: 0 (0) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 9.12 KB (9344) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=28): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=27):(Total: 856.225ms, non-child: 6.349us, % non-child: 0.00%) BytesReceived(16s000ms): 732.56 KB, 809.16 KB, 809.16 KB, 809.16 KB, 809.16 KB, 809.16 KB, 809.16 KB, 809.16 KB, 809.16 KB, 809.16 KB, 809.16 KB, 809.16 KB, 809.16 KB, 809.16 KB, 809.16 KB, 809.16 KB, 809.16 KB, 809.16 KB, 809.16 KB, 809.16 KB, 809.16 KB, 809.16 KB, 809.16 KB, 809.16 KB, 809.16 KB, 809.16 KB, 809.16 KB, 809.16 KB, 809.16 KB, 809.16 KB, 809.16 KB, 809.16 KB, 809.16 KB, 809.16 KB, 809.16 KB, 809.16 KB, 809.16 KB, 809.16 KB, 809.16 KB, 809.16 KB - BytesReceived: 809.16 KB (828583) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 12.703ms - FirstBatchArrivalWaitTime: 856.214ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:37b (host=vd1103.foo:22000):(Total: 83.102ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 3.30 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB ThreadUsage(16s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.48 MB (3648794) - PerHostPeakMemUsage: 169.56 GB (182068719943) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 807.415ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 82.998ms - ExecTreePrepareTime: 1.345ms DataStreamSender (dst_id=29):(Total: 510.728us, non-child: 510.728us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 158.12 KB (161920) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 374.105ms, non-child: 374.105ms, % non-child: 100.00%) - CodegenTime: 3.304ms - CompileTime: 100.949ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 96 (96) - NumInstructions: 3.85K (3850) - OptimizationTime: 219.485ms - PeakMemoryUsage: 1.88 MB (1971200) - PrepareTime: 51.769ms AGGREGATION_NODE (id=17):(Total: 1.345ms, non-child: 811.734us, % non-child: 60.35%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 261.870us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.34 MB (1409152) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - StreamingTime: 0.000ns - UnpinTime: 0.000ns HASH_JOIN_NODE (id=16):(Total: 533.330us, non-child: 539.784us, % non-child: 100.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 0 (0) - BuildTime: 0.000ns - PeakMemoryUsage: 90.25 KB (92416) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=16): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 0.000ns - BuildRowsPartitioned: 0 (0) - HashBuckets: 0 (0) - HashCollisions: 0 (0) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 9.12 KB (9344) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=28): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=27):(Total: 807.416ms, non-child: 6.292us, % non-child: 0.00%) BytesReceived(16s000ms): 739.74 KB, 817.16 KB, 817.16 KB, 817.16 KB, 817.16 KB, 817.16 KB, 817.16 KB, 817.16 KB, 817.16 KB, 817.16 KB, 817.16 KB, 817.16 KB, 817.16 KB, 817.16 KB, 817.16 KB, 817.16 KB, 817.16 KB, 817.16 KB, 817.16 KB, 817.16 KB, 817.16 KB, 817.16 KB, 817.16 KB, 817.16 KB, 817.16 KB, 817.16 KB, 817.16 KB, 817.16 KB, 817.16 KB, 817.16 KB, 817.16 KB, 817.16 KB, 817.16 KB, 817.16 KB, 817.16 KB, 817.16 KB, 817.16 KB, 817.16 KB, 817.16 KB, 817.16 KB - BytesReceived: 817.16 KB (836772) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 10.373ms - FirstBatchArrivalWaitTime: 807.407ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:3b4 (host=va1045.foo:22000):(Total: 79.155ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 3.32 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB ThreadUsage(16s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.50 MB (3669042) - PerHostPeakMemUsage: 169.56 GB (182061058974) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 670.629ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 79.115ms - ExecTreePrepareTime: 1.617ms DataStreamSender (dst_id=29):(Total: 853.013us, non-child: 853.013us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 158.12 KB (161920) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 551.513ms, non-child: 551.513ms, % non-child: 100.00%) - CodegenTime: 2.918ms - CompileTime: 204.919ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 96 (96) - NumInstructions: 3.85K (3850) - OptimizationTime: 301.066ms - PeakMemoryUsage: 1.88 MB (1971200) - PrepareTime: 44.826ms AGGREGATION_NODE (id=17):(Total: 1.616ms, non-child: 1.137ms, % non-child: 70.38%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 407.866us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.34 MB (1409152) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - StreamingTime: 0.000ns - UnpinTime: 0.000ns HASH_JOIN_NODE (id=16):(Total: 478.729us, non-child: 484.797us, % non-child: 100.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 0 (0) - BuildTime: 0.000ns - PeakMemoryUsage: 90.25 KB (92416) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=16): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 0.000ns - BuildRowsPartitioned: 0 (0) - HashBuckets: 0 (0) - HashCollisions: 0 (0) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 9.12 KB (9344) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=28): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=27):(Total: 670.630ms, non-child: 7.658us, % non-child: 0.00%) BytesReceived(16s000ms): 746.85 KB, 825.04 KB, 825.04 KB, 825.04 KB, 825.04 KB, 825.04 KB, 825.04 KB, 825.04 KB, 825.04 KB, 825.04 KB, 825.04 KB, 825.04 KB, 825.04 KB, 825.04 KB, 825.04 KB, 825.04 KB, 825.04 KB, 825.04 KB, 825.04 KB, 825.04 KB, 825.04 KB, 825.04 KB, 825.04 KB, 825.04 KB, 825.04 KB, 825.04 KB, 825.04 KB, 825.04 KB, 825.04 KB, 825.04 KB, 825.04 KB, 825.04 KB, 825.04 KB, 825.04 KB, 825.04 KB, 825.04 KB, 825.04 KB, 825.04 KB, 825.04 KB, 825.04 KB - BytesReceived: 825.04 KB (844838) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 13.443ms - FirstBatchArrivalWaitTime: 670.619ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:3c6 (host=vd1337.foo:22000):(Total: 78.666ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 3.39 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB ThreadUsage(16s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.51 MB (3676748) - PerHostPeakMemUsage: 169.56 GB (182064161916) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 835.481ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 78.576ms - ExecTreePrepareTime: 1.709ms DataStreamSender (dst_id=29):(Total: 780.719us, non-child: 780.719us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 158.12 KB (161920) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 381.120ms, non-child: 381.120ms, % non-child: 100.00%) - CodegenTime: 2.734ms - CompileTime: 112.816ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 96 (96) - NumInstructions: 3.85K (3850) - OptimizationTime: 224.536ms - PeakMemoryUsage: 1.88 MB (1971200) - PrepareTime: 43.182ms AGGREGATION_NODE (id=17):(Total: 1.708ms, non-child: 1.101ms, % non-child: 64.47%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 244.140us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.34 MB (1409152) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - StreamingTime: 0.000ns - UnpinTime: 0.000ns HASH_JOIN_NODE (id=16):(Total: 606.907us, non-child: 611.407us, % non-child: 100.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 0 (0) - BuildTime: 0.000ns - PeakMemoryUsage: 90.25 KB (92416) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=16): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 0.000ns - BuildRowsPartitioned: 0 (0) - HashBuckets: 0 (0) - HashCollisions: 0 (0) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 9.12 KB (9344) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=28): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=27):(Total: 835.482ms, non-child: 4.900us, % non-child: 0.00%) BytesReceived(16s000ms): 750.59 KB, 828.60 KB, 828.60 KB, 828.60 KB, 828.60 KB, 828.60 KB, 828.60 KB, 828.60 KB, 828.60 KB, 828.60 KB, 828.60 KB, 828.60 KB, 828.60 KB, 828.60 KB, 828.60 KB, 828.60 KB, 828.60 KB, 828.60 KB, 828.60 KB, 828.60 KB, 828.60 KB, 828.60 KB, 828.60 KB, 828.60 KB, 828.60 KB, 828.60 KB, 828.60 KB, 828.60 KB, 828.60 KB, 828.60 KB, 828.60 KB, 828.60 KB, 828.60 KB, 828.60 KB, 828.60 KB, 828.60 KB, 828.60 KB, 828.60 KB, 828.60 KB, 828.60 KB - BytesReceived: 828.60 KB (848483) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 10.584ms - FirstBatchArrivalWaitTime: 835.474ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:3c4 (host=vc1518.foo:22000):(Total: 76.933ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 3.36 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB ThreadUsage(16s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.48 MB (3646257) - PerHostPeakMemUsage: 169.57 GB (182075770335) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 880.926ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 76.870ms - ExecTreePrepareTime: 1.216ms DataStreamSender (dst_id=29):(Total: 530.462us, non-child: 530.462us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 158.12 KB (161920) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 346.886ms, non-child: 346.886ms, % non-child: 100.00%) - CodegenTime: 3.363ms - CompileTime: 99.334ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 96 (96) - NumInstructions: 3.85K (3850) - OptimizationTime: 198.514ms - PeakMemoryUsage: 1.88 MB (1971200) - PrepareTime: 47.766ms AGGREGATION_NODE (id=17):(Total: 1.215ms, non-child: 850.919us, % non-child: 70.03%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 237.757us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.34 MB (1409152) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - StreamingTime: 0.000ns - UnpinTime: 0.000ns HASH_JOIN_NODE (id=16):(Total: 364.117us, non-child: 368.464us, % non-child: 100.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 0 (0) - BuildTime: 0.000ns - PeakMemoryUsage: 90.25 KB (92416) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=16): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 0.000ns - BuildRowsPartitioned: 0 (0) - HashBuckets: 0 (0) - HashCollisions: 0 (0) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 9.12 KB (9344) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=28): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=27):(Total: 880.927ms, non-child: 6.649us, % non-child: 0.00%) BytesReceived(16s000ms): 739.24 KB, 816.56 KB, 816.56 KB, 816.56 KB, 816.56 KB, 816.56 KB, 816.56 KB, 816.56 KB, 816.56 KB, 816.56 KB, 816.56 KB, 816.56 KB, 816.56 KB, 816.56 KB, 816.56 KB, 816.56 KB, 816.56 KB, 816.56 KB, 816.56 KB, 816.56 KB, 816.56 KB, 816.56 KB, 816.56 KB, 816.56 KB, 816.56 KB, 816.56 KB, 816.56 KB, 816.56 KB, 816.56 KB, 816.56 KB, 816.56 KB, 816.56 KB, 816.56 KB, 816.56 KB, 816.56 KB, 816.56 KB, 816.56 KB, 816.56 KB, 816.56 KB, 816.56 KB - BytesReceived: 816.56 KB (836158) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 10.811ms - FirstBatchArrivalWaitTime: 880.918ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:3b2 (host=ve1140.foo:22000):(Total: 75.868ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 3.31 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB ThreadUsage(16s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.50 MB (3666690) - PerHostPeakMemUsage: 169.57 GB (182072110511) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 872.517ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 75.797ms - ExecTreePrepareTime: 1.143ms DataStreamSender (dst_id=29):(Total: 448.796us, non-child: 448.796us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 158.12 KB (161920) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 355.378ms, non-child: 355.378ms, % non-child: 100.00%) - CodegenTime: 9.243ms - CompileTime: 101.036ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 96 (96) - NumInstructions: 3.85K (3850) - OptimizationTime: 210.300ms - PeakMemoryUsage: 1.88 MB (1971200) - PrepareTime: 42.629ms AGGREGATION_NODE (id=17):(Total: 1.140ms, non-child: 742.633us, % non-child: 65.09%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 189.892us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.34 MB (1409152) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - StreamingTime: 0.000ns - UnpinTime: 0.000ns HASH_JOIN_NODE (id=16):(Total: 398.365us, non-child: 401.692us, % non-child: 100.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 0 (0) - BuildTime: 0.000ns - PeakMemoryUsage: 90.25 KB (92416) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=16): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 0.000ns - BuildRowsPartitioned: 0 (0) - HashBuckets: 0 (0) - HashCollisions: 0 (0) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 9.12 KB (9344) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=28): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=27):(Total: 872.518ms, non-child: 4.268us, % non-child: 0.00%) BytesReceived(16s000ms): 746.85 KB, 825.00 KB, 825.00 KB, 825.00 KB, 825.00 KB, 825.00 KB, 825.00 KB, 825.00 KB, 825.00 KB, 825.00 KB, 825.00 KB, 825.00 KB, 825.00 KB, 825.00 KB, 825.00 KB, 825.00 KB, 825.00 KB, 825.00 KB, 825.00 KB, 825.00 KB, 825.00 KB, 825.00 KB, 825.00 KB, 825.00 KB, 825.00 KB, 825.00 KB, 825.00 KB, 825.00 KB, 825.00 KB, 825.00 KB, 825.00 KB, 825.00 KB, 825.00 KB, 825.00 KB, 825.00 KB, 825.00 KB, 825.00 KB, 825.00 KB, 825.00 KB, 825.00 KB - BytesReceived: 825.00 KB (844796) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 9.332ms - FirstBatchArrivalWaitTime: 872.511ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:3bd (host=vd1136.foo:22000):(Total: 74.052ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 3.35 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB ThreadUsage(16s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.47 MB (3642880) - PerHostPeakMemUsage: 169.56 GB (182067830856) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 884.114ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 73.948ms - ExecTreePrepareTime: 1.432ms DataStreamSender (dst_id=29):(Total: 601.876us, non-child: 601.876us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 158.12 KB (161920) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 340.812ms, non-child: 340.812ms, % non-child: 100.00%) - CodegenTime: 3.040ms - CompileTime: 95.737ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 96 (96) - NumInstructions: 3.85K (3850) - OptimizationTime: 202.227ms - PeakMemoryUsage: 1.88 MB (1971200) - PrepareTime: 42.259ms AGGREGATION_NODE (id=17):(Total: 1.431ms, non-child: 1.001ms, % non-child: 69.99%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 299.719us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.34 MB (1409152) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - StreamingTime: 0.000ns - UnpinTime: 0.000ns HASH_JOIN_NODE (id=16):(Total: 429.492us, non-child: 434.483us, % non-child: 100.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 0 (0) - BuildTime: 0.000ns - PeakMemoryUsage: 90.25 KB (92416) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=16): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 0.000ns - BuildRowsPartitioned: 0 (0) - HashBuckets: 0 (0) - HashCollisions: 0 (0) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 9.12 KB (9344) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=28): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=27):(Total: 884.115ms, non-child: 4.502us, % non-child: 0.00%) BytesReceived(16s000ms): 737.18 KB, 814.35 KB, 814.35 KB, 814.35 KB, 814.35 KB, 814.35 KB, 814.35 KB, 814.35 KB, 814.35 KB, 814.35 KB, 814.35 KB, 814.35 KB, 814.35 KB, 814.35 KB, 814.35 KB, 814.35 KB, 814.35 KB, 814.35 KB, 814.35 KB, 814.35 KB, 814.35 KB, 814.35 KB, 814.35 KB, 814.35 KB, 814.35 KB, 814.35 KB, 814.35 KB, 814.35 KB, 814.35 KB, 814.35 KB, 814.35 KB, 814.35 KB, 814.35 KB, 814.35 KB, 814.35 KB, 814.35 KB, 814.35 KB, 814.35 KB, 814.35 KB, 814.35 KB - BytesReceived: 814.35 KB (833895) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 10.339ms - FirstBatchArrivalWaitTime: 884.107ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:3a6 (host=vd1326.foo:22000):(Total: 72.609ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 3.34 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB ThreadUsage(16s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.49 MB (3659036) - PerHostPeakMemUsage: 169.56 GB (182062806114) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 891.283ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 72.519ms - ExecTreePrepareTime: 1.199ms DataStreamSender (dst_id=29):(Total: 524.565us, non-child: 524.565us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 158.12 KB (161920) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 349.939ms, non-child: 349.939ms, % non-child: 100.00%) - CodegenTime: 2.819ms - CompileTime: 97.628ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 96 (96) - NumInstructions: 3.85K (3850) - OptimizationTime: 205.240ms - PeakMemoryUsage: 1.88 MB (1971200) - PrepareTime: 46.007ms AGGREGATION_NODE (id=17):(Total: 1.199ms, non-child: 777.543us, % non-child: 64.84%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 237.015us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.34 MB (1409152) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - StreamingTime: 0.000ns - UnpinTime: 0.000ns HASH_JOIN_NODE (id=16):(Total: 421.544us, non-child: 425.276us, % non-child: 100.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 0 (0) - BuildTime: 0.000ns - PeakMemoryUsage: 90.25 KB (92416) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=16): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 0.000ns - BuildRowsPartitioned: 0 (0) - HashBuckets: 0 (0) - HashCollisions: 0 (0) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 9.12 KB (9344) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=28): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=27):(Total: 891.285ms, non-child: 5.630us, % non-child: 0.00%) BytesReceived(16s000ms): 755.57 KB, 821.87 KB, 821.87 KB, 821.87 KB, 821.87 KB, 821.87 KB, 821.87 KB, 821.87 KB, 821.87 KB, 821.87 KB, 821.87 KB, 821.87 KB, 821.87 KB, 821.87 KB, 821.87 KB, 821.87 KB, 821.87 KB, 821.87 KB, 821.87 KB, 821.87 KB, 821.87 KB, 821.87 KB, 821.87 KB, 821.87 KB, 821.87 KB, 821.87 KB, 821.87 KB, 821.87 KB, 821.87 KB, 821.87 KB, 821.87 KB, 821.87 KB, 821.87 KB, 821.87 KB, 821.87 KB, 821.87 KB, 821.87 KB, 821.87 KB, 821.87 KB, 821.87 KB - BytesReceived: 821.87 KB (841591) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 10.593ms - FirstBatchArrivalWaitTime: 891.276ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:37e (host=vd1115.foo:22000):(Total: 70.740ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 3.36 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB ThreadUsage(16s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.47 MB (3642880) - PerHostPeakMemUsage: 169.57 GB (182077227576) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 843.981ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 70.695ms - ExecTreePrepareTime: 1.081ms DataStreamSender (dst_id=29):(Total: 613.917us, non-child: 613.917us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 158.12 KB (161920) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 340.556ms, non-child: 340.556ms, % non-child: 100.00%) - CodegenTime: 3.112ms - CompileTime: 94.476ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 96 (96) - NumInstructions: 3.85K (3850) - OptimizationTime: 204.880ms - PeakMemoryUsage: 1.88 MB (1971200) - PrepareTime: 40.627ms AGGREGATION_NODE (id=17):(Total: 1.080ms, non-child: 722.475us, % non-child: 66.87%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 173.052us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.34 MB (1409152) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - StreamingTime: 0.000ns - UnpinTime: 0.000ns HASH_JOIN_NODE (id=16):(Total: 357.910us, non-child: 360.208us, % non-child: 100.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 0 (0) - BuildTime: 0.000ns - PeakMemoryUsage: 90.25 KB (92416) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=16): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 0.000ns - BuildRowsPartitioned: 0 (0) - HashBuckets: 0 (0) - HashCollisions: 0 (0) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 9.12 KB (9344) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=28): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=27):(Total: 843.982ms, non-child: 5.575us, % non-child: 0.00%) BytesReceived(16s000ms): 738.75 KB, 815.84 KB, 815.84 KB, 815.84 KB, 815.84 KB, 815.84 KB, 815.84 KB, 815.84 KB, 815.84 KB, 815.84 KB, 815.84 KB, 815.84 KB, 815.84 KB, 815.84 KB, 815.84 KB, 815.84 KB, 815.84 KB, 815.84 KB, 815.84 KB, 815.84 KB, 815.84 KB, 815.84 KB, 815.84 KB, 815.84 KB, 815.84 KB, 815.84 KB, 815.84 KB, 815.84 KB, 815.84 KB, 815.84 KB, 815.84 KB, 815.84 KB, 815.84 KB, 815.84 KB, 815.84 KB, 815.84 KB, 815.84 KB, 815.84 KB, 815.84 KB, 815.84 KB - BytesReceived: 815.84 KB (835418) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 10.173ms - FirstBatchArrivalWaitTime: 843.974ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:3ba (host=ve1129.foo:22000):(Total: 70.562ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 3.29 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB ThreadUsage(16s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.47 MB (3642880) - PerHostPeakMemUsage: 169.57 GB (182072457823) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 879.273ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 70.516ms - ExecTreePrepareTime: 1.210ms DataStreamSender (dst_id=29):(Total: 609.435us, non-child: 609.435us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 158.12 KB (161920) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 360.603ms, non-child: 360.603ms, % non-child: 100.00%) - CodegenTime: 3.041ms - CompileTime: 103.373ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 96 (96) - NumInstructions: 3.85K (3850) - OptimizationTime: 214.253ms - PeakMemoryUsage: 1.88 MB (1971200) - PrepareTime: 42.326ms AGGREGATION_NODE (id=17):(Total: 1.209ms, non-child: 779.585us, % non-child: 64.47%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 187.734us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.34 MB (1409152) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - StreamingTime: 0.000ns - UnpinTime: 0.000ns HASH_JOIN_NODE (id=16):(Total: 429.561us, non-child: 435.734us, % non-child: 100.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 0 (0) - BuildTime: 0.000ns - PeakMemoryUsage: 90.25 KB (92416) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=16): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 0.000ns - BuildRowsPartitioned: 0 (0) - HashBuckets: 0 (0) - HashCollisions: 0 (0) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 9.12 KB (9344) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=28): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=27):(Total: 879.274ms, non-child: 7.420us, % non-child: 0.00%) BytesReceived(16s000ms): 737.68 KB, 814.83 KB, 814.83 KB, 814.83 KB, 814.83 KB, 814.83 KB, 814.83 KB, 814.83 KB, 814.83 KB, 814.83 KB, 814.83 KB, 814.83 KB, 814.83 KB, 814.83 KB, 814.83 KB, 814.83 KB, 814.83 KB, 814.83 KB, 814.83 KB, 814.83 KB, 814.83 KB, 814.83 KB, 814.83 KB, 814.83 KB, 814.83 KB, 814.83 KB, 814.83 KB, 814.83 KB, 814.83 KB, 814.83 KB, 814.83 KB, 814.83 KB, 814.83 KB, 814.83 KB, 814.83 KB, 814.83 KB, 814.83 KB, 814.83 KB, 814.83 KB, 814.83 KB - BytesReceived: 814.83 KB (834388) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 88.043ms - FirstBatchArrivalWaitTime: 879.264ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:3cc (host=vc1521.foo:22000):(Total: 70.523ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 3.31 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB ThreadUsage(16s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.50 MB (3668363) - PerHostPeakMemUsage: 169.57 GB (182069092083) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 866.105ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 70.475ms - ExecTreePrepareTime: 1.160ms DataStreamSender (dst_id=29):(Total: 589.839us, non-child: 589.839us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 158.12 KB (161920) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 362.009ms, non-child: 362.009ms, % non-child: 100.00%) - CodegenTime: 2.823ms - CompileTime: 105.641ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 96 (96) - NumInstructions: 3.85K (3850) - OptimizationTime: 213.345ms - PeakMemoryUsage: 1.88 MB (1971200) - PrepareTime: 42.323ms AGGREGATION_NODE (id=17):(Total: 1.159ms, non-child: 740.753us, % non-child: 63.89%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 160.486us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.34 MB (1409152) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - StreamingTime: 0.000ns - UnpinTime: 0.000ns HASH_JOIN_NODE (id=16):(Total: 418.633us, non-child: 422.382us, % non-child: 100.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 0 (0) - BuildTime: 0.000ns - PeakMemoryUsage: 90.25 KB (92416) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=16): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 0.000ns - BuildRowsPartitioned: 0 (0) - HashBuckets: 0 (0) - HashCollisions: 0 (0) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 9.12 KB (9344) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=28): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=27):(Total: 866.106ms, non-child: 5.395us, % non-child: 0.00%) BytesReceived(16s000ms): 746.48 KB, 824.60 KB, 824.60 KB, 824.60 KB, 824.60 KB, 824.60 KB, 824.60 KB, 824.60 KB, 824.60 KB, 824.60 KB, 824.60 KB, 824.60 KB, 824.60 KB, 824.60 KB, 824.60 KB, 824.60 KB, 824.60 KB, 824.60 KB, 824.60 KB, 824.60 KB, 824.60 KB, 824.60 KB, 824.60 KB, 824.60 KB, 824.60 KB, 824.60 KB, 824.60 KB, 824.60 KB, 824.60 KB, 824.60 KB, 824.60 KB, 824.60 KB, 824.60 KB, 824.60 KB, 824.60 KB, 824.60 KB, 824.60 KB, 824.60 KB, 824.60 KB, 824.60 KB - BytesReceived: 824.60 KB (844391) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 10.159ms - FirstBatchArrivalWaitTime: 866.097ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:394 (host=vc1522.foo:22000):(Total: 69.723ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 3.37 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB ThreadUsage(16s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.49 MB (3656458) - PerHostPeakMemUsage: 169.56 GB (182064280165) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 887.350ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 69.593ms - ExecTreePrepareTime: 1.131ms DataStreamSender (dst_id=29):(Total: 571.806us, non-child: 571.806us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 158.12 KB (161920) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 335.496ms, non-child: 335.496ms, % non-child: 100.00%) - CodegenTime: 2.694ms - CompileTime: 93.019ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 96 (96) - NumInstructions: 3.85K (3850) - OptimizationTime: 200.438ms - PeakMemoryUsage: 1.88 MB (1971200) - PrepareTime: 41.516ms AGGREGATION_NODE (id=17):(Total: 1.130ms, non-child: 738.081us, % non-child: 65.30%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 152.072us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.34 MB (1409152) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - StreamingTime: 0.000ns - UnpinTime: 0.000ns HASH_JOIN_NODE (id=16):(Total: 392.153us, non-child: 395.320us, % non-child: 100.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 0 (0) - BuildTime: 0.000ns - PeakMemoryUsage: 90.25 KB (92416) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=16): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 0.000ns - BuildRowsPartitioned: 0 (0) - HashBuckets: 0 (0) - HashCollisions: 0 (0) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 9.12 KB (9344) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=28): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=27):(Total: 887.351ms, non-child: 5.192us, % non-child: 0.00%) BytesReceived(16s000ms): 742.11 KB, 819.75 KB, 819.75 KB, 819.75 KB, 819.75 KB, 819.75 KB, 819.75 KB, 819.75 KB, 819.75 KB, 819.75 KB, 819.75 KB, 819.75 KB, 819.75 KB, 819.75 KB, 819.75 KB, 819.75 KB, 819.75 KB, 819.75 KB, 819.75 KB, 819.75 KB, 819.75 KB, 819.75 KB, 819.75 KB, 819.75 KB, 819.75 KB, 819.75 KB, 819.75 KB, 819.75 KB, 819.75 KB, 819.75 KB, 819.75 KB, 819.75 KB, 819.75 KB, 819.75 KB, 819.75 KB, 819.75 KB, 819.75 KB, 819.75 KB, 819.75 KB, 819.75 KB - BytesReceived: 819.75 KB (839422) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 12.189ms - FirstBatchArrivalWaitTime: 887.343ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:3a1 (host=ve1134.foo:22000):(Total: 69.683ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 3.36 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB ThreadUsage(16s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.50 MB (3672389) - PerHostPeakMemUsage: 169.56 GB (182064974107) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 900.835ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 69.638ms - ExecTreePrepareTime: 1.043ms DataStreamSender (dst_id=29):(Total: 430.464us, non-child: 430.464us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 158.12 KB (161920) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 340.103ms, non-child: 340.103ms, % non-child: 100.00%) - CodegenTime: 2.440ms - CompileTime: 94.936ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 96 (96) - NumInstructions: 3.85K (3850) - OptimizationTime: 200.366ms - PeakMemoryUsage: 1.88 MB (1971200) - PrepareTime: 43.399ms AGGREGATION_NODE (id=17):(Total: 1.042ms, non-child: 630.341us, % non-child: 60.45%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 125.998us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.34 MB (1409152) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - StreamingTime: 0.000ns - UnpinTime: 0.000ns HASH_JOIN_NODE (id=16):(Total: 412.457us, non-child: 415.864us, % non-child: 100.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 0 (0) - BuildTime: 0.000ns - PeakMemoryUsage: 90.25 KB (92416) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=16): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 0.000ns - BuildRowsPartitioned: 0 (0) - HashBuckets: 0 (0) - HashCollisions: 0 (0) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 9.12 KB (9344) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=28): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=27):(Total: 900.835ms, non-child: 2.265us, % non-child: 0.00%) BytesReceived(16s000ms): 766.33 KB, 827.24 KB, 827.24 KB, 827.24 KB, 827.24 KB, 827.24 KB, 827.24 KB, 827.24 KB, 827.24 KB, 827.24 KB, 827.24 KB, 827.24 KB, 827.24 KB, 827.24 KB, 827.24 KB, 827.24 KB, 827.24 KB, 827.24 KB, 827.24 KB, 827.24 KB, 827.24 KB, 827.24 KB, 827.24 KB, 827.24 KB, 827.24 KB, 827.24 KB, 827.24 KB, 827.24 KB, 827.24 KB, 827.24 KB, 827.24 KB, 827.24 KB, 827.24 KB, 827.24 KB, 827.24 KB, 827.24 KB, 827.24 KB, 827.24 KB, 827.24 KB, 827.24 KB - BytesReceived: 827.24 KB (847094) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 9.625ms - FirstBatchArrivalWaitTime: 900.832ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:382 (host=vd1129.foo:22000):(Total: 68.799ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 3.37 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.49 MB (3663183) - PerHostPeakMemUsage: 169.56 GB (182059979970) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 867.089ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 68.719ms - ExecTreePrepareTime: 1.450ms DataStreamSender (dst_id=29):(Total: 530.348us, non-child: 530.348us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 158.12 KB (161920) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 325.262ms, non-child: 325.262ms, % non-child: 100.00%) - CodegenTime: 2.653ms - CompileTime: 92.213ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 96 (96) - NumInstructions: 3.85K (3850) - OptimizationTime: 191.507ms - PeakMemoryUsage: 1.88 MB (1971200) - PrepareTime: 41.030ms AGGREGATION_NODE (id=17):(Total: 1.448ms, non-child: 1.016ms, % non-child: 70.17%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 503.012us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.34 MB (1409152) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - StreamingTime: 0.000ns - UnpinTime: 0.000ns HASH_JOIN_NODE (id=16):(Total: 432.061us, non-child: 434.259us, % non-child: 100.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 0 (0) - BuildTime: 0.000ns - PeakMemoryUsage: 90.25 KB (92416) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=16): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 0.000ns - BuildRowsPartitioned: 0 (0) - HashBuckets: 0 (0) - HashCollisions: 0 (0) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 9.12 KB (9344) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=28): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=27):(Total: 867.091ms, non-child: 4.501us, % non-child: 0.00%) BytesReceived(16s000ms): 770.98 KB, 823.33 KB, 823.33 KB, 823.33 KB, 823.33 KB, 823.33 KB, 823.33 KB, 823.33 KB, 823.33 KB, 823.33 KB, 823.33 KB, 823.33 KB, 823.33 KB, 823.33 KB, 823.33 KB, 823.33 KB, 823.33 KB, 823.33 KB, 823.33 KB, 823.33 KB, 823.33 KB, 823.33 KB, 823.33 KB, 823.33 KB, 823.33 KB, 823.33 KB, 823.33 KB, 823.33 KB, 823.33 KB, 823.33 KB, 823.33 KB, 823.33 KB, 823.33 KB, 823.33 KB, 823.33 KB, 823.33 KB, 823.33 KB, 823.33 KB, 823.33 KB, 823.33 KB - BytesReceived: 823.33 KB (843087) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 10.878ms - FirstBatchArrivalWaitTime: 867.084ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:38f (host=ve1135.foo:22000):(Total: 67.931ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 3.35 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.47 MB (3642880) - PerHostPeakMemUsage: 169.56 GB (182064603624) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 860.487ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 67.829ms - ExecTreePrepareTime: 1.374ms DataStreamSender (dst_id=29):(Total: 619.896us, non-child: 619.896us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 158.12 KB (161920) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 352.699ms, non-child: 352.699ms, % non-child: 100.00%) - CodegenTime: 3.050ms - CompileTime: 101.334ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 96 (96) - NumInstructions: 3.85K (3850) - OptimizationTime: 212.712ms - PeakMemoryUsage: 1.88 MB (1971200) - PrepareTime: 37.747ms AGGREGATION_NODE (id=17):(Total: 1.371ms, non-child: 915.142us, % non-child: 66.71%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 276.351us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.34 MB (1409152) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - StreamingTime: 0.000ns - UnpinTime: 0.000ns HASH_JOIN_NODE (id=16):(Total: 456.731us, non-child: 461.731us, % non-child: 100.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 0 (0) - BuildTime: 0.000ns - PeakMemoryUsage: 90.25 KB (92416) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=16): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 0.000ns - BuildRowsPartitioned: 0 (0) - HashBuckets: 0 (0) - HashCollisions: 0 (0) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 9.12 KB (9344) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=28): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=27):(Total: 860.488ms, non-child: 4.544us, % non-child: 0.00%) BytesReceived(16s000ms): 760.83 KB, 812.40 KB, 812.40 KB, 812.40 KB, 812.40 KB, 812.40 KB, 812.40 KB, 812.40 KB, 812.40 KB, 812.40 KB, 812.40 KB, 812.40 KB, 812.40 KB, 812.40 KB, 812.40 KB, 812.40 KB, 812.40 KB, 812.40 KB, 812.40 KB, 812.40 KB, 812.40 KB, 812.40 KB, 812.40 KB, 812.40 KB, 812.40 KB, 812.40 KB, 812.40 KB, 812.40 KB, 812.40 KB, 812.40 KB, 812.40 KB, 812.40 KB, 812.40 KB, 812.40 KB, 812.40 KB, 812.40 KB, 812.40 KB, 812.40 KB, 812.40 KB, 812.40 KB - BytesReceived: 812.40 KB (831895) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 11.097ms - FirstBatchArrivalWaitTime: 860.481ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:384 (host=vc1501.foo:22000):(Total: 67.880ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 3.38 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB ThreadUsage(16s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.50 MB (3674484) - PerHostPeakMemUsage: 169.58 GB (182084640221) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 853.472ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 67.829ms - ExecTreePrepareTime: 1.102ms DataStreamSender (dst_id=29):(Total: 628.648us, non-child: 628.648us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 158.12 KB (161920) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 345.484ms, non-child: 345.484ms, % non-child: 100.00%) - CodegenTime: 2.481ms - CompileTime: 97.574ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 96 (96) - NumInstructions: 3.85K (3850) - OptimizationTime: 207.638ms - PeakMemoryUsage: 1.88 MB (1971200) - PrepareTime: 39.782ms AGGREGATION_NODE (id=17):(Total: 1.101ms, non-child: 697.772us, % non-child: 63.35%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 173.912us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.34 MB (1409152) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - StreamingTime: 0.000ns - UnpinTime: 0.000ns HASH_JOIN_NODE (id=16):(Total: 403.658us, non-child: 405.412us, % non-child: 100.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 0 (0) - BuildTime: 0.000ns - PeakMemoryUsage: 90.25 KB (92416) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=16): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 0.000ns - BuildRowsPartitioned: 0 (0) - HashBuckets: 0 (0) - HashCollisions: 0 (0) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 9.12 KB (9344) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=28): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=27):(Total: 853.473ms, non-child: 7.060us, % non-child: 0.00%) BytesReceived(16s000ms): 774.56 KB, 827.57 KB, 827.57 KB, 827.57 KB, 827.57 KB, 827.57 KB, 827.57 KB, 827.57 KB, 827.57 KB, 827.57 KB, 827.57 KB, 827.57 KB, 827.57 KB, 827.57 KB, 827.57 KB, 827.57 KB, 827.57 KB, 827.57 KB, 827.57 KB, 827.57 KB, 827.57 KB, 827.57 KB, 827.57 KB, 827.57 KB, 827.57 KB, 827.57 KB, 827.57 KB, 827.57 KB, 827.57 KB, 827.57 KB, 827.57 KB, 827.57 KB, 827.57 KB, 827.57 KB, 827.57 KB, 827.57 KB, 827.57 KB, 827.57 KB, 827.57 KB, 827.57 KB - BytesReceived: 827.57 KB (847428) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 9.569ms - FirstBatchArrivalWaitTime: 853.463ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:38a (host=vc1503.foo:22000):(Total: 67.219ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 3.40 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB ThreadUsage(16s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.51 MB (3681561) - PerHostPeakMemUsage: 169.57 GB (182069369402) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 862.748ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 67.141ms - ExecTreePrepareTime: 968.322us DataStreamSender (dst_id=29):(Total: 395.047us, non-child: 395.047us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 158.12 KB (161920) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 344.092ms, non-child: 344.092ms, % non-child: 100.00%) - CodegenTime: 3.739ms - CompileTime: 99.983ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 96 (96) - NumInstructions: 3.85K (3850) - OptimizationTime: 202.162ms - PeakMemoryUsage: 1.88 MB (1971200) - PrepareTime: 40.895ms AGGREGATION_NODE (id=17):(Total: 967.668us, non-child: 502.549us, % non-child: 51.93%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 151.790us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.34 MB (1409152) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - StreamingTime: 0.000ns - UnpinTime: 0.000ns HASH_JOIN_NODE (id=16):(Total: 465.119us, non-child: 468.407us, % non-child: 100.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 0 (0) - BuildTime: 0.000ns - PeakMemoryUsage: 90.25 KB (92416) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=16): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 0.000ns - BuildRowsPartitioned: 0 (0) - HashBuckets: 0 (0) - HashCollisions: 0 (0) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 9.12 KB (9344) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=28): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=27):(Total: 862.748ms, non-child: 6.387us, % non-child: 0.00%) BytesReceived(16s000ms): 756.72 KB, 829.23 KB, 829.23 KB, 829.23 KB, 829.23 KB, 829.23 KB, 829.23 KB, 829.23 KB, 829.23 KB, 829.23 KB, 829.23 KB, 829.23 KB, 829.23 KB, 829.23 KB, 829.23 KB, 829.23 KB, 829.23 KB, 829.23 KB, 829.23 KB, 829.23 KB, 829.23 KB, 829.23 KB, 829.23 KB, 829.23 KB, 829.23 KB, 829.23 KB, 829.23 KB, 829.23 KB, 829.23 KB, 829.23 KB, 829.23 KB, 829.23 KB, 829.23 KB, 829.23 KB, 829.23 KB, 829.23 KB, 829.23 KB, 829.23 KB, 829.23 KB, 829.23 KB - BytesReceived: 829.23 KB (849128) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 9.963ms - FirstBatchArrivalWaitTime: 862.737ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:386 (host=vc1526.foo:22000):(Total: 66.743ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 3.37 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB ThreadUsage(16s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.49 MB (3656130) - PerHostPeakMemUsage: 169.56 GB (182060487844) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 832.383ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 66.650ms - ExecTreePrepareTime: 1.038ms DataStreamSender (dst_id=29):(Total: 646.138us, non-child: 646.138us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 158.12 KB (161920) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 370.615ms, non-child: 370.615ms, % non-child: 100.00%) - CodegenTime: 2.659ms - CompileTime: 111.219ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 96 (96) - NumInstructions: 3.85K (3850) - OptimizationTime: 218.665ms - PeakMemoryUsage: 1.88 MB (1971200) - PrepareTime: 40.256ms AGGREGATION_NODE (id=17):(Total: 1.037ms, non-child: 645.483us, % non-child: 62.20%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 150.316us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.34 MB (1409152) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - StreamingTime: 0.000ns - UnpinTime: 0.000ns HASH_JOIN_NODE (id=16):(Total: 392.245us, non-child: 396.525us, % non-child: 100.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 0 (0) - BuildTime: 0.000ns - PeakMemoryUsage: 90.25 KB (92416) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=16): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 0.000ns - BuildRowsPartitioned: 0 (0) - HashBuckets: 0 (0) - HashCollisions: 0 (0) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 9.12 KB (9344) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=28): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=27):(Total: 832.384ms, non-child: 4.194us, % non-child: 0.00%) BytesReceived(16s000ms): 742.33 KB, 819.76 KB, 819.76 KB, 819.76 KB, 819.76 KB, 819.76 KB, 819.76 KB, 819.76 KB, 819.76 KB, 819.76 KB, 819.76 KB, 819.76 KB, 819.76 KB, 819.76 KB, 819.76 KB, 819.76 KB, 819.76 KB, 819.76 KB, 819.76 KB, 819.76 KB, 819.76 KB, 819.76 KB, 819.76 KB, 819.76 KB, 819.76 KB, 819.76 KB, 819.76 KB, 819.76 KB, 819.76 KB, 819.76 KB, 819.76 KB, 819.76 KB, 819.76 KB, 819.76 KB, 819.76 KB, 819.76 KB, 819.76 KB, 819.76 KB, 819.76 KB, 819.76 KB - BytesReceived: 819.76 KB (839435) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 9.531ms - FirstBatchArrivalWaitTime: 832.377ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:3a7 (host=va1030.foo:22000):(Total: 66.692ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 3.36 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB ThreadUsage(16s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.48 MB (3650643) - PerHostPeakMemUsage: 169.57 GB (182077449644) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 896.802ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 66.637ms - ExecTreePrepareTime: 1.039ms DataStreamSender (dst_id=29):(Total: 547.089us, non-child: 547.089us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 158.12 KB (161920) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 333.002ms, non-child: 333.002ms, % non-child: 100.00%) - CodegenTime: 2.915ms - CompileTime: 93.791ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 96 (96) - NumInstructions: 3.85K (3850) - OptimizationTime: 197.503ms - PeakMemoryUsage: 1.88 MB (1971200) - PrepareTime: 41.084ms AGGREGATION_NODE (id=17):(Total: 1.038ms, non-child: 655.034us, % non-child: 63.06%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 157.580us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.34 MB (1409152) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - StreamingTime: 0.000ns - UnpinTime: 0.000ns HASH_JOIN_NODE (id=16):(Total: 383.680us, non-child: 385.801us, % non-child: 100.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 0 (0) - BuildTime: 0.000ns - PeakMemoryUsage: 90.25 KB (92416) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=16): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 0.000ns - BuildRowsPartitioned: 0 (0) - HashBuckets: 0 (0) - HashCollisions: 0 (0) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 9.12 KB (9344) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=28): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=27):(Total: 896.803ms, non-child: 5.414us, % non-child: 0.00%) BytesReceived(16s000ms): 740.52 KB, 817.74 KB, 817.74 KB, 817.74 KB, 817.74 KB, 817.74 KB, 817.74 KB, 817.74 KB, 817.74 KB, 817.74 KB, 817.74 KB, 817.74 KB, 817.74 KB, 817.74 KB, 817.74 KB, 817.74 KB, 817.74 KB, 817.74 KB, 817.74 KB, 817.74 KB, 817.74 KB, 817.74 KB, 817.74 KB, 817.74 KB, 817.74 KB, 817.74 KB, 817.74 KB, 817.74 KB, 817.74 KB, 817.74 KB, 817.74 KB, 817.74 KB, 817.74 KB, 817.74 KB, 817.74 KB, 817.74 KB, 817.74 KB, 817.74 KB, 817.74 KB, 817.74 KB - BytesReceived: 817.74 KB (837366) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 10.147ms - FirstBatchArrivalWaitTime: 896.794ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:3b9 (host=vc1504.foo:22000):(Total: 66.110ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 3.36 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB ThreadUsage(16s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.48 MB (3649508) - PerHostPeakMemUsage: 169.55 GB (182051120599) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 872.177ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 66.065ms - ExecTreePrepareTime: 1.175ms DataStreamSender (dst_id=29):(Total: 556.966us, non-child: 556.966us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 158.12 KB (161920) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 354.724ms, non-child: 354.724ms, % non-child: 100.00%) - CodegenTime: 2.664ms - CompileTime: 101.328ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 96 (96) - NumInstructions: 3.85K (3850) - OptimizationTime: 216.648ms - PeakMemoryUsage: 1.88 MB (1971200) - PrepareTime: 36.172ms AGGREGATION_NODE (id=17):(Total: 1.174ms, non-child: 780.869us, % non-child: 66.50%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 197.329us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.34 MB (1409152) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - StreamingTime: 0.000ns - UnpinTime: 0.000ns HASH_JOIN_NODE (id=16):(Total: 393.383us, non-child: 398.229us, % non-child: 100.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 0 (0) - BuildTime: 0.000ns - PeakMemoryUsage: 90.25 KB (92416) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=16): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 0.000ns - BuildRowsPartitioned: 0 (0) - HashBuckets: 0 (0) - HashCollisions: 0 (0) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 9.12 KB (9344) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=28): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=27):(Total: 872.178ms, non-child: 3.913us, % non-child: 0.00%) BytesReceived(16s000ms): 742.46 KB, 819.08 KB, 819.08 KB, 819.08 KB, 819.08 KB, 819.08 KB, 819.08 KB, 819.08 KB, 819.08 KB, 819.08 KB, 819.08 KB, 819.08 KB, 819.08 KB, 819.08 KB, 819.08 KB, 819.08 KB, 819.08 KB, 819.08 KB, 819.08 KB, 819.08 KB, 819.08 KB, 819.08 KB, 819.08 KB, 819.08 KB, 819.08 KB, 819.08 KB, 819.08 KB, 819.08 KB, 819.08 KB, 819.08 KB, 819.08 KB, 819.08 KB, 819.08 KB, 819.08 KB, 819.08 KB, 819.08 KB, 819.08 KB, 819.08 KB, 819.08 KB, 819.08 KB - BytesReceived: 819.08 KB (838740) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 10.322ms - FirstBatchArrivalWaitTime: 872.170ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:37c (host=va1046.foo:22000):(Total: 65.795ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 3.36 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB ThreadUsage(16s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.47 MB (3643511) - PerHostPeakMemUsage: 169.56 GB (182060334243) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 824.154ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 65.745ms - ExecTreePrepareTime: 1.337ms DataStreamSender (dst_id=29):(Total: 530.731us, non-child: 530.731us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 158.12 KB (161920) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 364.016ms, non-child: 364.016ms, % non-child: 100.00%) - CodegenTime: 2.967ms - CompileTime: 104.571ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 96 (96) - NumInstructions: 3.85K (3850) - OptimizationTime: 216.533ms - PeakMemoryUsage: 1.88 MB (1971200) - PrepareTime: 42.241ms AGGREGATION_NODE (id=17):(Total: 1.336ms, non-child: 926.905us, % non-child: 69.37%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 115.890us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.34 MB (1409152) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - StreamingTime: 0.000ns - UnpinTime: 0.000ns HASH_JOIN_NODE (id=16):(Total: 409.254us, non-child: 411.229us, % non-child: 100.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 0 (0) - BuildTime: 0.000ns - PeakMemoryUsage: 90.25 KB (92416) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=16): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 0.000ns - BuildRowsPartitioned: 0 (0) - HashBuckets: 0 (0) - HashCollisions: 0 (0) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 9.12 KB (9344) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=28): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=27):(Total: 824.155ms, non-child: 5.653us, % non-child: 0.00%) BytesReceived(16s000ms): 738.32 KB, 815.59 KB, 815.59 KB, 815.59 KB, 815.59 KB, 815.59 KB, 815.59 KB, 815.59 KB, 815.59 KB, 815.59 KB, 815.59 KB, 815.59 KB, 815.59 KB, 815.59 KB, 815.59 KB, 815.59 KB, 815.59 KB, 815.59 KB, 815.59 KB, 815.59 KB, 815.59 KB, 815.59 KB, 815.59 KB, 815.59 KB, 815.59 KB, 815.59 KB, 815.59 KB, 815.59 KB, 815.59 KB, 815.59 KB, 815.59 KB, 815.59 KB, 815.59 KB, 815.59 KB, 815.59 KB, 815.59 KB, 815.59 KB, 815.59 KB, 815.59 KB, 815.59 KB - BytesReceived: 815.59 KB (835161) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 10.288ms - FirstBatchArrivalWaitTime: 824.146ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:377 (host=vd1126.foo:22000):(Total: 65.687ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 3.30 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB ThreadUsage(16s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.48 MB (3652458) - PerHostPeakMemUsage: 169.56 GB (182067882047) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 834.727ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 65.637ms - ExecTreePrepareTime: 1.138ms DataStreamSender (dst_id=29):(Total: 665.765us, non-child: 665.765us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 158.12 KB (161920) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 348.424ms, non-child: 348.424ms, % non-child: 100.00%) - CodegenTime: 3.149ms - CompileTime: 97.572ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 96 (96) - NumInstructions: 3.85K (3850) - OptimizationTime: 208.936ms - PeakMemoryUsage: 1.88 MB (1971200) - PrepareTime: 41.259ms AGGREGATION_NODE (id=17):(Total: 1.137ms, non-child: 774.699us, % non-child: 68.10%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 175.210us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.34 MB (1409152) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - StreamingTime: 0.000ns - UnpinTime: 0.000ns HASH_JOIN_NODE (id=16):(Total: 362.814us, non-child: 367.244us, % non-child: 100.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 0 (0) - BuildTime: 0.000ns - PeakMemoryUsage: 90.25 KB (92416) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=16): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 0.000ns - BuildRowsPartitioned: 0 (0) - HashBuckets: 0 (0) - HashCollisions: 0 (0) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 9.12 KB (9344) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=28): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=27):(Total: 834.728ms, non-child: 4.291us, % non-child: 0.00%) BytesReceived(16s000ms): 740.56 KB, 818.10 KB, 818.10 KB, 818.10 KB, 818.10 KB, 818.10 KB, 818.10 KB, 818.10 KB, 818.10 KB, 818.10 KB, 818.10 KB, 818.10 KB, 818.10 KB, 818.10 KB, 818.10 KB, 818.10 KB, 818.10 KB, 818.10 KB, 818.10 KB, 818.10 KB, 818.10 KB, 818.10 KB, 818.10 KB, 818.10 KB, 818.10 KB, 818.10 KB, 818.10 KB, 818.10 KB, 818.10 KB, 818.10 KB, 818.10 KB, 818.10 KB, 818.10 KB, 818.10 KB, 818.10 KB, 818.10 KB, 818.10 KB, 818.10 KB, 818.10 KB, 818.10 KB - BytesReceived: 818.10 KB (837738) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 9.478ms - FirstBatchArrivalWaitTime: 834.721ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:3cf (host=vc1517.foo:22000):(Total: 65.172ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 3.36 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB ThreadUsage(16s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.48 MB (3652081) - PerHostPeakMemUsage: 169.57 GB (182072460943) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 865.105ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 65.114ms - ExecTreePrepareTime: 1.193ms DataStreamSender (dst_id=29):(Total: 692.931us, non-child: 692.931us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 158.12 KB (161920) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 351.580ms, non-child: 351.580ms, % non-child: 100.00%) - CodegenTime: 3.574ms - CompileTime: 101.605ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 96 (96) - NumInstructions: 3.85K (3850) - OptimizationTime: 213.912ms - PeakMemoryUsage: 1.88 MB (1971200) - PrepareTime: 35.098ms AGGREGATION_NODE (id=17):(Total: 1.192ms, non-child: 805.457us, % non-child: 67.54%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 237.316us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.34 MB (1409152) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - StreamingTime: 0.000ns - UnpinTime: 0.000ns HASH_JOIN_NODE (id=16):(Total: 387.059us, non-child: 390.203us, % non-child: 100.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 0 (0) - BuildTime: 0.000ns - PeakMemoryUsage: 90.25 KB (92416) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=16): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 0.000ns - BuildRowsPartitioned: 0 (0) - HashBuckets: 0 (0) - HashCollisions: 0 (0) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 9.12 KB (9344) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=28): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=27):(Total: 865.106ms, non-child: 3.495us, % non-child: 0.00%) BytesReceived(16s000ms): 741.42 KB, 818.73 KB, 818.73 KB, 818.73 KB, 818.73 KB, 818.73 KB, 818.73 KB, 818.73 KB, 818.73 KB, 818.73 KB, 818.73 KB, 818.73 KB, 818.73 KB, 818.73 KB, 818.73 KB, 818.73 KB, 818.73 KB, 818.73 KB, 818.73 KB, 818.73 KB, 818.73 KB, 818.73 KB, 818.73 KB, 818.73 KB, 818.73 KB, 818.73 KB, 818.73 KB, 818.73 KB, 818.73 KB, 818.73 KB, 818.73 KB, 818.73 KB, 818.73 KB, 818.73 KB, 818.73 KB, 818.73 KB, 818.73 KB, 818.73 KB, 818.73 KB, 818.73 KB - BytesReceived: 818.73 KB (838376) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 9.868ms - FirstBatchArrivalWaitTime: 865.098ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:3bb (host=ve1130.foo:22000):(Total: 64.832ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 3.29 MB, 3.45 MB, 3.45 MB, 3.45 MB, 3.45 MB, 3.45 MB, 3.45 MB, 3.45 MB, 3.45 MB, 3.45 MB, 3.45 MB, 3.45 MB, 3.45 MB, 3.45 MB, 3.45 MB, 3.45 MB, 3.45 MB, 3.45 MB, 3.45 MB, 3.45 MB, 3.45 MB, 3.45 MB, 3.45 MB, 3.45 MB, 3.45 MB, 3.45 MB, 3.45 MB, 3.45 MB, 3.45 MB, 3.45 MB, 3.45 MB, 3.45 MB, 3.45 MB, 3.45 MB, 3.45 MB, 3.45 MB, 3.45 MB, 3.45 MB, 3.45 MB, 3.45 MB ThreadUsage(16s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.47 MB (3642880) - PerHostPeakMemUsage: 169.56 GB (182064299158) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 895.550ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 64.784ms - ExecTreePrepareTime: 910.353us DataStreamSender (dst_id=29):(Total: 517.744us, non-child: 517.744us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 158.12 KB (161920) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 330.328ms, non-child: 330.328ms, % non-child: 100.00%) - CodegenTime: 2.988ms - CompileTime: 96.171ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 96 (96) - NumInstructions: 3.85K (3850) - OptimizationTime: 192.104ms - PeakMemoryUsage: 1.88 MB (1971200) - PrepareTime: 40.382ms AGGREGATION_NODE (id=17):(Total: 909.403us, non-child: 594.111us, % non-child: 65.33%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 126.693us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.34 MB (1409152) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - StreamingTime: 0.000ns - UnpinTime: 0.000ns HASH_JOIN_NODE (id=16):(Total: 315.292us, non-child: 317.139us, % non-child: 100.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 0 (0) - BuildTime: 0.000ns - PeakMemoryUsage: 90.25 KB (92416) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=16): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 0.000ns - BuildRowsPartitioned: 0 (0) - HashBuckets: 0 (0) - HashCollisions: 0 (0) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 9.12 KB (9344) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=28): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=27):(Total: 895.551ms, non-child: 5.834us, % non-child: 0.00%) BytesReceived(16s000ms): 738.06 KB, 808.35 KB, 808.35 KB, 808.35 KB, 808.35 KB, 808.35 KB, 808.35 KB, 808.35 KB, 808.35 KB, 808.35 KB, 808.35 KB, 808.35 KB, 808.35 KB, 808.35 KB, 808.35 KB, 808.35 KB, 808.35 KB, 808.35 KB, 808.35 KB, 808.35 KB, 808.35 KB, 808.35 KB, 808.35 KB, 808.35 KB, 808.35 KB, 808.35 KB, 808.35 KB, 808.35 KB, 808.35 KB, 808.35 KB, 808.35 KB, 808.35 KB, 808.35 KB, 808.35 KB, 808.35 KB, 808.35 KB, 808.35 KB, 808.35 KB, 808.35 KB, 808.35 KB - BytesReceived: 808.35 KB (827748) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 10.011ms - FirstBatchArrivalWaitTime: 895.542ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:3d2 (host=va1036.foo:22000):(Total: 64.616ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 3.31 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB ThreadUsage(16s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.49 MB (3656406) - PerHostPeakMemUsage: 169.56 GB (182059851881) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 896.894ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 64.576ms - ExecTreePrepareTime: 813.462us DataStreamSender (dst_id=29):(Total: 424.809us, non-child: 424.809us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 158.12 KB (161920) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 325.666ms, non-child: 325.666ms, % non-child: 100.00%) - CodegenTime: 2.651ms - CompileTime: 91.664ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 96 (96) - NumInstructions: 3.85K (3850) - OptimizationTime: 193.130ms - PeakMemoryUsage: 1.88 MB (1971200) - PrepareTime: 39.795ms AGGREGATION_NODE (id=17):(Total: 812.342us, non-child: 564.975us, % non-child: 69.55%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 95.568us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.34 MB (1409152) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - StreamingTime: 0.000ns - UnpinTime: 0.000ns HASH_JOIN_NODE (id=16):(Total: 247.367us, non-child: 249.061us, % non-child: 100.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 0 (0) - BuildTime: 0.000ns - PeakMemoryUsage: 90.25 KB (92416) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=16): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 0.000ns - BuildRowsPartitioned: 0 (0) - HashBuckets: 0 (0) - HashCollisions: 0 (0) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 9.12 KB (9344) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=28): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=27):(Total: 896.895ms, non-child: 3.942us, % non-child: 0.00%) BytesReceived(16s000ms): 742.74 KB, 820.48 KB, 820.48 KB, 820.48 KB, 820.48 KB, 820.48 KB, 820.48 KB, 820.48 KB, 820.48 KB, 820.48 KB, 820.48 KB, 820.48 KB, 820.48 KB, 820.48 KB, 820.48 KB, 820.48 KB, 820.48 KB, 820.48 KB, 820.48 KB, 820.48 KB, 820.48 KB, 820.48 KB, 820.48 KB, 820.48 KB, 820.48 KB, 820.48 KB, 820.48 KB, 820.48 KB, 820.48 KB, 820.48 KB, 820.48 KB, 820.48 KB, 820.48 KB, 820.48 KB, 820.48 KB, 820.48 KB, 820.48 KB, 820.48 KB, 820.48 KB, 820.48 KB - BytesReceived: 820.48 KB (840167) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 9.913ms - FirstBatchArrivalWaitTime: 896.886ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:36f (host=vc1502.foo:22000):(Total: 64.199ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 3.32 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB ThreadUsage(16s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.50 MB (3668048) - PerHostPeakMemUsage: 169.57 GB (182069848181) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 819.230ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 64.046ms - ExecTreePrepareTime: 1.389ms DataStreamSender (dst_id=29):(Total: 681.484us, non-child: 681.484us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 158.12 KB (161920) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 349.243ms, non-child: 349.243ms, % non-child: 100.00%) - CodegenTime: 2.759ms - CompileTime: 101.772ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 96 (96) - NumInstructions: 3.85K (3850) - OptimizationTime: 212.097ms - PeakMemoryUsage: 1.88 MB (1971200) - PrepareTime: 34.688ms AGGREGATION_NODE (id=17):(Total: 1.388ms, non-child: 900.286us, % non-child: 64.82%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 242.166us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.34 MB (1409152) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - StreamingTime: 0.000ns - UnpinTime: 0.000ns HASH_JOIN_NODE (id=16):(Total: 488.708us, non-child: 492.033us, % non-child: 100.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 0 (0) - BuildTime: 0.000ns - PeakMemoryUsage: 90.25 KB (92416) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=16): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 0.000ns - BuildRowsPartitioned: 0 (0) - HashBuckets: 0 (0) - HashCollisions: 0 (0) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 9.12 KB (9344) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=28): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=27):(Total: 819.231ms, non-child: 4.941us, % non-child: 0.00%) BytesReceived(16s000ms): 747.44 KB, 825.70 KB, 825.70 KB, 825.70 KB, 825.70 KB, 825.70 KB, 825.70 KB, 825.70 KB, 825.70 KB, 825.70 KB, 825.70 KB, 825.70 KB, 825.70 KB, 825.70 KB, 825.70 KB, 825.70 KB, 825.70 KB, 825.70 KB, 825.70 KB, 825.70 KB, 825.70 KB, 825.70 KB, 825.70 KB, 825.70 KB, 825.70 KB, 825.70 KB, 825.70 KB, 825.70 KB, 825.70 KB, 825.70 KB, 825.70 KB, 825.70 KB, 825.70 KB, 825.70 KB, 825.70 KB, 825.70 KB, 825.70 KB, 825.70 KB, 825.70 KB, 825.70 KB - BytesReceived: 825.70 KB (845517) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 9.479ms - FirstBatchArrivalWaitTime: 819.224ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:3b3 (host=vd1121.foo:22000):(Total: 63.916ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 3.36 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.48 MB (3648753) - PerHostPeakMemUsage: 169.57 GB (182076301709) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 915.300ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 63.878ms - ExecTreePrepareTime: 971.659us DataStreamSender (dst_id=29):(Total: 505.385us, non-child: 505.385us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 158.12 KB (161920) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 322.838ms, non-child: 322.838ms, % non-child: 100.00%) - CodegenTime: 2.268ms - CompileTime: 91.784ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 96 (96) - NumInstructions: 3.85K (3850) - OptimizationTime: 190.860ms - PeakMemoryUsage: 1.88 MB (1971200) - PrepareTime: 39.746ms AGGREGATION_NODE (id=17):(Total: 970.657us, non-child: 707.084us, % non-child: 72.85%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 150.958us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.34 MB (1409152) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - StreamingTime: 0.000ns - UnpinTime: 0.000ns HASH_JOIN_NODE (id=16):(Total: 263.573us, non-child: 265.490us, % non-child: 100.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 0 (0) - BuildTime: 0.000ns - PeakMemoryUsage: 90.25 KB (92416) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=16): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 0.000ns - BuildRowsPartitioned: 0 (0) - HashBuckets: 0 (0) - HashCollisions: 0 (0) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 9.12 KB (9344) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=28): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=27):(Total: 915.300ms, non-child: 4.777us, % non-child: 0.00%) BytesReceived(16s000ms): 764.66 KB, 816.62 KB, 816.62 KB, 816.62 KB, 816.62 KB, 816.62 KB, 816.62 KB, 816.62 KB, 816.62 KB, 816.62 KB, 816.62 KB, 816.62 KB, 816.62 KB, 816.62 KB, 816.62 KB, 816.62 KB, 816.62 KB, 816.62 KB, 816.62 KB, 816.62 KB, 816.62 KB, 816.62 KB, 816.62 KB, 816.62 KB, 816.62 KB, 816.62 KB, 816.62 KB, 816.62 KB, 816.62 KB, 816.62 KB, 816.62 KB, 816.62 KB, 816.62 KB, 816.62 KB, 816.62 KB, 816.62 KB, 816.62 KB, 816.62 KB, 816.62 KB, 816.62 KB - BytesReceived: 816.62 KB (836221) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 9.443ms - FirstBatchArrivalWaitTime: 915.293ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:3a3 (host=vd1102.foo:22000):(Total: 63.752ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 3.37 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.49 MB (3662462) - PerHostPeakMemUsage: 169.56 GB (182064217136) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 902.650ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 63.707ms - ExecTreePrepareTime: 928.615us DataStreamSender (dst_id=29):(Total: 484.076us, non-child: 484.076us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 158.12 KB (161920) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 332.865ms, non-child: 332.865ms, % non-child: 100.00%) - CodegenTime: 2.367ms - CompileTime: 93.906ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 96 (96) - NumInstructions: 3.85K (3850) - OptimizationTime: 199.096ms - PeakMemoryUsage: 1.88 MB (1971200) - PrepareTime: 39.418ms AGGREGATION_NODE (id=17):(Total: 927.585us, non-child: 558.651us, % non-child: 60.23%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 119.994us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.34 MB (1409152) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - StreamingTime: 0.000ns - UnpinTime: 0.000ns HASH_JOIN_NODE (id=16):(Total: 368.934us, non-child: 371.233us, % non-child: 100.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 0 (0) - BuildTime: 0.000ns - PeakMemoryUsage: 90.25 KB (92416) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=16): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 0.000ns - BuildRowsPartitioned: 0 (0) - HashBuckets: 0 (0) - HashCollisions: 0 (0) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 9.12 KB (9344) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=28): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=27):(Total: 902.650ms, non-child: 5.343us, % non-child: 0.00%) BytesReceived(16s000ms): 770.41 KB, 822.70 KB, 822.70 KB, 822.70 KB, 822.70 KB, 822.70 KB, 822.70 KB, 822.70 KB, 822.70 KB, 822.70 KB, 822.70 KB, 822.70 KB, 822.70 KB, 822.70 KB, 822.70 KB, 822.70 KB, 822.70 KB, 822.70 KB, 822.70 KB, 822.70 KB, 822.70 KB, 822.70 KB, 822.70 KB, 822.70 KB, 822.70 KB, 822.70 KB, 822.70 KB, 822.70 KB, 822.70 KB, 822.70 KB, 822.70 KB, 822.70 KB, 822.70 KB, 822.70 KB, 822.70 KB, 822.70 KB, 822.70 KB, 822.70 KB, 822.70 KB, 822.70 KB - BytesReceived: 822.70 KB (842448) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 9.202ms - FirstBatchArrivalWaitTime: 902.641ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:3ae (host=vd1133.foo:22000):(Total: 63.378ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 3.34 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.47 MB (3643473) - PerHostPeakMemUsage: 169.56 GB (182063982385) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 917.124ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 63.293ms - ExecTreePrepareTime: 922.161us DataStreamSender (dst_id=29):(Total: 430.547us, non-child: 430.547us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 158.12 KB (161920) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 323.474ms, non-child: 323.474ms, % non-child: 100.00%) - CodegenTime: 3.565ms - CompileTime: 92.289ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 96 (96) - NumInstructions: 3.85K (3850) - OptimizationTime: 192.579ms - PeakMemoryUsage: 1.88 MB (1971200) - PrepareTime: 38.141ms AGGREGATION_NODE (id=17):(Total: 921.418us, non-child: 405.789us, % non-child: 44.04%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 134.858us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.34 MB (1409152) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - StreamingTime: 0.000ns - UnpinTime: 0.000ns HASH_JOIN_NODE (id=16):(Total: 515.629us, non-child: 518.094us, % non-child: 100.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 0 (0) - BuildTime: 0.000ns - PeakMemoryUsage: 90.25 KB (92416) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=16): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 0.000ns - BuildRowsPartitioned: 0 (0) - HashBuckets: 0 (0) - HashCollisions: 0 (0) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 9.12 KB (9344) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=28): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=27):(Total: 917.127ms, non-child: 9.921us, % non-child: 0.00%) BytesReceived(16s000ms): 756.66 KB, 815.58 KB, 815.58 KB, 815.58 KB, 815.58 KB, 815.58 KB, 815.58 KB, 815.58 KB, 815.58 KB, 815.58 KB, 815.58 KB, 815.58 KB, 815.58 KB, 815.58 KB, 815.58 KB, 815.58 KB, 815.58 KB, 815.58 KB, 815.58 KB, 815.58 KB, 815.58 KB, 815.58 KB, 815.58 KB, 815.58 KB, 815.58 KB, 815.58 KB, 815.58 KB, 815.58 KB, 815.58 KB, 815.58 KB, 815.58 KB, 815.58 KB, 815.58 KB, 815.58 KB, 815.58 KB, 815.58 KB, 815.58 KB, 815.58 KB, 815.58 KB, 815.58 KB - BytesReceived: 815.58 KB (835152) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 11.879ms - FirstBatchArrivalWaitTime: 917.114ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:391 (host=vc1541.foo:22000):(Total: 63.222ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 3.36 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.48 MB (3647387) - PerHostPeakMemUsage: 169.55 GB (182053501934) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 876.055ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 63.180ms - ExecTreePrepareTime: 1.072ms DataStreamSender (dst_id=29):(Total: 589.442us, non-child: 589.442us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 158.12 KB (161920) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 342.582ms, non-child: 342.582ms, % non-child: 100.00%) - CodegenTime: 3.787ms - CompileTime: 102.063ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 96 (96) - NumInstructions: 3.85K (3850) - OptimizationTime: 203.873ms - PeakMemoryUsage: 1.88 MB (1971200) - PrepareTime: 36.081ms AGGREGATION_NODE (id=17):(Total: 1.071ms, non-child: 666.043us, % non-child: 62.16%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 160.180us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.34 MB (1409152) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - StreamingTime: 0.000ns - UnpinTime: 0.000ns HASH_JOIN_NODE (id=16):(Total: 405.464us, non-child: 407.776us, % non-child: 100.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 0 (0) - BuildTime: 0.000ns - PeakMemoryUsage: 90.25 KB (92416) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=16): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 0.000ns - BuildRowsPartitioned: 0 (0) - HashBuckets: 0 (0) - HashCollisions: 0 (0) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 9.12 KB (9344) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=28): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=27):(Total: 876.056ms, non-child: 4.287us, % non-child: 0.00%) BytesReceived(16s000ms): 765.45 KB, 817.32 KB, 817.32 KB, 817.32 KB, 817.32 KB, 817.32 KB, 817.32 KB, 817.32 KB, 817.32 KB, 817.32 KB, 817.32 KB, 817.32 KB, 817.32 KB, 817.32 KB, 817.32 KB, 817.32 KB, 817.32 KB, 817.32 KB, 817.32 KB, 817.32 KB, 817.32 KB, 817.32 KB, 817.32 KB, 817.32 KB, 817.32 KB, 817.32 KB, 817.32 KB, 817.32 KB, 817.32 KB, 817.32 KB, 817.32 KB, 817.32 KB, 817.32 KB, 817.32 KB, 817.32 KB, 817.32 KB, 817.32 KB, 817.32 KB, 817.32 KB, 817.32 KB - BytesReceived: 817.32 KB (836935) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 14.474ms - FirstBatchArrivalWaitTime: 876.049ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:3b0 (host=ve1142.foo:22000):(Total: 63.025ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 3.36 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB ThreadUsage(16s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.48 MB (3649047) - PerHostPeakMemUsage: 169.58 GB (182081261058) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 898.099ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 62.970ms - ExecTreePrepareTime: 1.027ms DataStreamSender (dst_id=29):(Total: 466.318us, non-child: 466.318us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 158.12 KB (161920) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 343.965ms, non-child: 343.965ms, % non-child: 100.00%) - CodegenTime: 2.506ms - CompileTime: 98.598ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 96 (96) - NumInstructions: 3.85K (3850) - OptimizationTime: 203.581ms - PeakMemoryUsage: 1.88 MB (1971200) - PrepareTime: 40.690ms AGGREGATION_NODE (id=17):(Total: 1.026ms, non-child: 642.469us, % non-child: 62.58%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 142.975us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.34 MB (1409152) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - StreamingTime: 0.000ns - UnpinTime: 0.000ns HASH_JOIN_NODE (id=16):(Total: 384.112us, non-child: 387.728us, % non-child: 100.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 0 (0) - BuildTime: 0.000ns - PeakMemoryUsage: 90.25 KB (92416) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=16): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 0.000ns - BuildRowsPartitioned: 0 (0) - HashBuckets: 0 (0) - HashCollisions: 0 (0) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 9.12 KB (9344) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=28): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=27):(Total: 898.101ms, non-child: 7.373us, % non-child: 0.00%) BytesReceived(16s000ms): 739.38 KB, 816.85 KB, 816.85 KB, 816.85 KB, 816.85 KB, 816.85 KB, 816.85 KB, 816.85 KB, 816.85 KB, 816.85 KB, 816.85 KB, 816.85 KB, 816.85 KB, 816.85 KB, 816.85 KB, 816.85 KB, 816.85 KB, 816.85 KB, 816.85 KB, 816.85 KB, 816.85 KB, 816.85 KB, 816.85 KB, 816.85 KB, 816.85 KB, 816.85 KB, 816.85 KB, 816.85 KB, 816.85 KB, 816.85 KB, 816.85 KB, 816.85 KB, 816.85 KB, 816.85 KB, 816.85 KB, 816.85 KB, 816.85 KB, 816.85 KB, 816.85 KB, 816.85 KB - BytesReceived: 816.85 KB (836450) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 9.914ms - FirstBatchArrivalWaitTime: 898.090ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:389 (host=vc1511.foo:22000):(Total: 62.635ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 3.34 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB ThreadUsage(16s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.47 MB (3642880) - PerHostPeakMemUsage: 169.54 GB (182042906319) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 871.784ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 62.586ms - ExecTreePrepareTime: 1.059ms DataStreamSender (dst_id=29):(Total: 508.250us, non-child: 508.250us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 158.12 KB (161920) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 339.296ms, non-child: 339.296ms, % non-child: 100.00%) - CodegenTime: 2.202ms - CompileTime: 97.305ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 96 (96) - NumInstructions: 3.85K (3850) - OptimizationTime: 201.981ms - PeakMemoryUsage: 1.88 MB (1971200) - PrepareTime: 39.523ms AGGREGATION_NODE (id=17):(Total: 1.058ms, non-child: 706.475us, % non-child: 66.72%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 174.367us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.34 MB (1409152) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - StreamingTime: 0.000ns - UnpinTime: 0.000ns HASH_JOIN_NODE (id=16):(Total: 352.336us, non-child: 355.873us, % non-child: 100.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 0 (0) - BuildTime: 0.000ns - PeakMemoryUsage: 90.25 KB (92416) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=16): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 0.000ns - BuildRowsPartitioned: 0 (0) - HashBuckets: 0 (0) - HashCollisions: 0 (0) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 9.12 KB (9344) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=28): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=27):(Total: 871.785ms, non-child: 6.169us, % non-child: 0.00%) BytesReceived(16s000ms): 731.33 KB, 807.82 KB, 807.82 KB, 807.82 KB, 807.82 KB, 807.82 KB, 807.82 KB, 807.82 KB, 807.82 KB, 807.82 KB, 807.82 KB, 807.82 KB, 807.82 KB, 807.82 KB, 807.82 KB, 807.82 KB, 807.82 KB, 807.82 KB, 807.82 KB, 807.82 KB, 807.82 KB, 807.82 KB, 807.82 KB, 807.82 KB, 807.82 KB, 807.82 KB, 807.82 KB, 807.82 KB, 807.82 KB, 807.82 KB, 807.82 KB, 807.82 KB, 807.82 KB, 807.82 KB, 807.82 KB, 807.82 KB, 807.82 KB, 807.82 KB, 807.82 KB, 807.82 KB - BytesReceived: 807.82 KB (827208) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 8.784ms - FirstBatchArrivalWaitTime: 871.774ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:3ac (host=va1034.foo:22000):(Total: 62.556ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 3.32 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB ThreadUsage(16s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.48 MB (3651841) - PerHostPeakMemUsage: 169.57 GB (182073558301) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 915.290ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 62.525ms - ExecTreePrepareTime: 848.650us DataStreamSender (dst_id=29):(Total: 497.172us, non-child: 497.172us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 158.12 KB (161920) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 318.793ms, non-child: 318.793ms, % non-child: 100.00%) - CodegenTime: 2.052ms - CompileTime: 92.668ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 96 (96) - NumInstructions: 3.85K (3850) - OptimizationTime: 188.311ms - PeakMemoryUsage: 1.88 MB (1971200) - PrepareTime: 37.374ms AGGREGATION_NODE (id=17):(Total: 847.801us, non-child: 587.411us, % non-child: 69.29%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 102.874us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.34 MB (1409152) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - StreamingTime: 0.000ns - UnpinTime: 0.000ns HASH_JOIN_NODE (id=16):(Total: 260.390us, non-child: 264.035us, % non-child: 100.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 0 (0) - BuildTime: 0.000ns - PeakMemoryUsage: 90.25 KB (92416) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=16): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 0.000ns - BuildRowsPartitioned: 0 (0) - HashBuckets: 0 (0) - HashCollisions: 0 (0) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 9.12 KB (9344) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=28): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=27):(Total: 915.290ms, non-child: 5.754us, % non-child: 0.00%) BytesReceived(16s000ms): 749.49 KB, 819.02 KB, 819.02 KB, 819.02 KB, 819.02 KB, 819.02 KB, 819.02 KB, 819.02 KB, 819.02 KB, 819.02 KB, 819.02 KB, 819.02 KB, 819.02 KB, 819.02 KB, 819.02 KB, 819.02 KB, 819.02 KB, 819.02 KB, 819.02 KB, 819.02 KB, 819.02 KB, 819.02 KB, 819.02 KB, 819.02 KB, 819.02 KB, 819.02 KB, 819.02 KB, 819.02 KB, 819.02 KB, 819.02 KB, 819.02 KB, 819.02 KB, 819.02 KB, 819.02 KB, 819.02 KB, 819.02 KB, 819.02 KB, 819.02 KB, 819.02 KB, 819.02 KB - BytesReceived: 819.02 KB (838678) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 8.813ms - FirstBatchArrivalWaitTime: 915.281ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:3c9 (host=vc1539.foo:22000):(Total: 61.748ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 3.36 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB ThreadUsage(16s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.48 MB (3645346) - PerHostPeakMemUsage: 169.57 GB (182073034609) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 872.331ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 61.697ms - ExecTreePrepareTime: 1.088ms DataStreamSender (dst_id=29):(Total: 339.321us, non-child: 339.321us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 158.12 KB (161920) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 355.412ms, non-child: 355.412ms, % non-child: 100.00%) - CodegenTime: 3.139ms - CompileTime: 103.807ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 96 (96) - NumInstructions: 3.85K (3850) - OptimizationTime: 217.138ms - PeakMemoryUsage: 1.88 MB (1971200) - PrepareTime: 33.443ms AGGREGATION_NODE (id=17):(Total: 1.087ms, non-child: 700.851us, % non-child: 64.46%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 142.858us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.34 MB (1409152) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - StreamingTime: 0.000ns - UnpinTime: 0.000ns HASH_JOIN_NODE (id=16):(Total: 386.422us, non-child: 391.254us, % non-child: 100.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 0 (0) - BuildTime: 0.000ns - PeakMemoryUsage: 90.25 KB (92416) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=16): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 0.000ns - BuildRowsPartitioned: 0 (0) - HashBuckets: 0 (0) - HashCollisions: 0 (0) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 9.12 KB (9344) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=28): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=27):(Total: 872.332ms, non-child: 4.237us, % non-child: 0.00%) BytesReceived(16s000ms): 738.28 KB, 815.53 KB, 815.53 KB, 815.53 KB, 815.53 KB, 815.53 KB, 815.53 KB, 815.53 KB, 815.53 KB, 815.53 KB, 815.53 KB, 815.53 KB, 815.53 KB, 815.53 KB, 815.53 KB, 815.53 KB, 815.53 KB, 815.53 KB, 815.53 KB, 815.53 KB, 815.53 KB, 815.53 KB, 815.53 KB, 815.53 KB, 815.53 KB, 815.53 KB, 815.53 KB, 815.53 KB, 815.53 KB, 815.53 KB, 815.53 KB, 815.53 KB, 815.53 KB, 815.53 KB, 815.53 KB, 815.53 KB, 815.53 KB, 815.53 KB, 815.53 KB, 815.53 KB - BytesReceived: 815.53 KB (835099) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 9.290ms - FirstBatchArrivalWaitTime: 872.324ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:3be (host=vc1505.foo:22000):(Total: 61.412ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 3.34 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB ThreadUsage(16s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.47 MB (3642880) - PerHostPeakMemUsage: 169.56 GB (182066036121) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 903.640ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 61.330ms - ExecTreePrepareTime: 970.916us DataStreamSender (dst_id=29):(Total: 533.880us, non-child: 533.880us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 158.12 KB (161920) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 333.014ms, non-child: 333.014ms, % non-child: 100.00%) - CodegenTime: 3.165ms - CompileTime: 94.733ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 96 (96) - NumInstructions: 3.85K (3850) - OptimizationTime: 202.395ms - PeakMemoryUsage: 1.88 MB (1971200) - PrepareTime: 34.473ms AGGREGATION_NODE (id=17):(Total: 970.017us, non-child: 592.701us, % non-child: 61.10%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 117.027us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.34 MB (1409152) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - StreamingTime: 0.000ns - UnpinTime: 0.000ns HASH_JOIN_NODE (id=16):(Total: 377.316us, non-child: 379.362us, % non-child: 100.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 0 (0) - BuildTime: 0.000ns - PeakMemoryUsage: 90.25 KB (92416) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=16): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 0.000ns - BuildRowsPartitioned: 0 (0) - HashBuckets: 0 (0) - HashCollisions: 0 (0) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 9.12 KB (9344) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=28): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=27):(Total: 903.640ms, non-child: 2.846us, % non-child: 0.00%) BytesReceived(16s000ms): 732.85 KB, 809.50 KB, 809.50 KB, 809.50 KB, 809.50 KB, 809.50 KB, 809.50 KB, 809.50 KB, 809.50 KB, 809.50 KB, 809.50 KB, 809.50 KB, 809.50 KB, 809.50 KB, 809.50 KB, 809.50 KB, 809.50 KB, 809.50 KB, 809.50 KB, 809.50 KB, 809.50 KB, 809.50 KB, 809.50 KB, 809.50 KB, 809.50 KB, 809.50 KB, 809.50 KB, 809.50 KB, 809.50 KB, 809.50 KB, 809.50 KB, 809.50 KB, 809.50 KB, 809.50 KB, 809.50 KB, 809.50 KB, 809.50 KB, 809.50 KB, 809.50 KB, 809.50 KB - BytesReceived: 809.50 KB (828923) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 9.769ms - FirstBatchArrivalWaitTime: 903.636ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:3a4 (host=vd1341.foo:22000):(Total: 60.089ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 3.26 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB ThreadUsage(16s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.49 MB (3658536) - PerHostPeakMemUsage: 169.56 GB (182068199748) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 906.261ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 60.012ms - ExecTreePrepareTime: 1.184ms DataStreamSender (dst_id=29):(Total: 645.233us, non-child: 645.233us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 158.12 KB (161920) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 330.258ms, non-child: 330.258ms, % non-child: 100.00%) - CodegenTime: 2.937ms - CompileTime: 95.096ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 96 (96) - NumInstructions: 3.85K (3850) - OptimizationTime: 201.804ms - PeakMemoryUsage: 1.88 MB (1971200) - PrepareTime: 32.795ms AGGREGATION_NODE (id=17):(Total: 1.183ms, non-child: 732.259us, % non-child: 61.89%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 207.497us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.34 MB (1409152) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - StreamingTime: 0.000ns - UnpinTime: 0.000ns HASH_JOIN_NODE (id=16):(Total: 450.989us, non-child: 455.372us, % non-child: 100.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 0 (0) - BuildTime: 0.000ns - PeakMemoryUsage: 90.25 KB (92416) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=16): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 0.000ns - BuildRowsPartitioned: 0 (0) - HashBuckets: 0 (0) - HashCollisions: 0 (0) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 9.12 KB (9344) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=28): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=27):(Total: 906.262ms, non-child: 5.064us, % non-child: 0.00%) BytesReceived(16s000ms): 769.78 KB, 821.89 KB, 821.89 KB, 821.89 KB, 821.89 KB, 821.89 KB, 821.89 KB, 821.89 KB, 821.89 KB, 821.89 KB, 821.89 KB, 821.89 KB, 821.89 KB, 821.89 KB, 821.89 KB, 821.89 KB, 821.89 KB, 821.89 KB, 821.89 KB, 821.89 KB, 821.89 KB, 821.89 KB, 821.89 KB, 821.89 KB, 821.89 KB, 821.89 KB, 821.89 KB, 821.89 KB, 821.89 KB, 821.89 KB, 821.89 KB, 821.89 KB, 821.89 KB, 821.89 KB, 821.89 KB, 821.89 KB, 821.89 KB, 821.89 KB, 821.89 KB, 821.89 KB - BytesReceived: 821.89 KB (841612) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 9.438ms - FirstBatchArrivalWaitTime: 906.255ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:3d8 (host=vd1119.foo:22000):(Total: 59.880ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 3.38 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.50 MB (3669466) - PerHostPeakMemUsage: 169.57 GB (182073242429) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 869.709ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 59.825ms - ExecTreePrepareTime: 1.168ms DataStreamSender (dst_id=29):(Total: 617.024us, non-child: 617.024us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 158.12 KB (161920) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 348.736ms, non-child: 348.736ms, % non-child: 100.00%) - CodegenTime: 3.853ms - CompileTime: 98.328ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 96 (96) - NumInstructions: 3.85K (3850) - OptimizationTime: 216.862ms - PeakMemoryUsage: 1.88 MB (1971200) - PrepareTime: 32.531ms AGGREGATION_NODE (id=17):(Total: 1.167ms, non-child: 734.950us, % non-child: 62.97%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 153.329us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.34 MB (1409152) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - StreamingTime: 0.000ns - UnpinTime: 0.000ns HASH_JOIN_NODE (id=16):(Total: 432.196us, non-child: 436.141us, % non-child: 100.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 0 (0) - BuildTime: 0.000ns - PeakMemoryUsage: 90.25 KB (92416) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=16): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 0.000ns - BuildRowsPartitioned: 0 (0) - HashBuckets: 0 (0) - HashCollisions: 0 (0) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 9.12 KB (9344) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=28): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=27):(Total: 869.711ms, non-child: 5.290us, % non-child: 0.00%) BytesReceived(16s000ms): 772.56 KB, 824.84 KB, 824.84 KB, 824.84 KB, 824.84 KB, 824.84 KB, 824.84 KB, 824.84 KB, 824.84 KB, 824.84 KB, 824.84 KB, 824.84 KB, 824.84 KB, 824.84 KB, 824.84 KB, 824.84 KB, 824.84 KB, 824.84 KB, 824.84 KB, 824.84 KB, 824.84 KB, 824.84 KB, 824.84 KB, 824.84 KB, 824.84 KB, 824.84 KB, 824.84 KB, 824.84 KB, 824.84 KB, 824.84 KB, 824.84 KB, 824.84 KB, 824.84 KB, 824.84 KB, 824.84 KB, 824.84 KB, 824.84 KB, 824.84 KB, 824.84 KB, 824.84 KB - BytesReceived: 824.84 KB (844639) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 9.710ms - FirstBatchArrivalWaitTime: 869.702ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:3d7 (host=va1041.foo:22000):(Total: 58.826ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 3.35 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.48 MB (3644423) - PerHostPeakMemUsage: 169.56 GB (182068847826) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 890.875ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 58.776ms - ExecTreePrepareTime: 857.717us DataStreamSender (dst_id=29):(Total: 366.149us, non-child: 366.149us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 158.12 KB (161920) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 334.703ms, non-child: 334.703ms, % non-child: 100.00%) - CodegenTime: 2.826ms - CompileTime: 98.354ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 96 (96) - NumInstructions: 3.85K (3850) - OptimizationTime: 202.313ms - PeakMemoryUsage: 1.88 MB (1971200) - PrepareTime: 33.018ms AGGREGATION_NODE (id=17):(Total: 856.990us, non-child: 571.846us, % non-child: 66.73%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 99.998us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.34 MB (1409152) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - StreamingTime: 0.000ns - UnpinTime: 0.000ns HASH_JOIN_NODE (id=16):(Total: 285.144us, non-child: 288.863us, % non-child: 100.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 0 (0) - BuildTime: 0.000ns - PeakMemoryUsage: 90.25 KB (92416) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=16): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 0.000ns - BuildRowsPartitioned: 0 (0) - HashBuckets: 0 (0) - HashCollisions: 0 (0) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 9.12 KB (9344) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=28): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=27):(Total: 890.877ms, non-child: 5.084us, % non-child: 0.00%) BytesReceived(16s000ms): 762.52 KB, 815.55 KB, 815.55 KB, 815.55 KB, 815.55 KB, 815.55 KB, 815.55 KB, 815.55 KB, 815.55 KB, 815.55 KB, 815.55 KB, 815.55 KB, 815.55 KB, 815.55 KB, 815.55 KB, 815.55 KB, 815.55 KB, 815.55 KB, 815.55 KB, 815.55 KB, 815.55 KB, 815.55 KB, 815.55 KB, 815.55 KB, 815.55 KB, 815.55 KB, 815.55 KB, 815.55 KB, 815.55 KB, 815.55 KB, 815.55 KB, 815.55 KB, 815.55 KB, 815.55 KB, 815.55 KB, 815.55 KB, 815.55 KB, 815.55 KB, 815.55 KB, 815.55 KB - BytesReceived: 815.55 KB (835124) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 9.652ms - FirstBatchArrivalWaitTime: 890.869ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:37a (host=vc1506.foo:22000):(Total: 58.822ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 3.36 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.48 MB (3650242) - PerHostPeakMemUsage: 169.56 GB (182060057121) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 836.504ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 58.775ms - ExecTreePrepareTime: 1.229ms DataStreamSender (dst_id=29):(Total: 582.305us, non-child: 582.305us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 158.12 KB (161920) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 349.411ms, non-child: 349.411ms, % non-child: 100.00%) - CodegenTime: 3.136ms - CompileTime: 101.067ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 96 (96) - NumInstructions: 3.85K (3850) - OptimizationTime: 213.468ms - PeakMemoryUsage: 1.88 MB (1971200) - PrepareTime: 34.218ms AGGREGATION_NODE (id=17):(Total: 1.228ms, non-child: 798.525us, % non-child: 65.00%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 149.907us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.34 MB (1409152) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - StreamingTime: 0.000ns - UnpinTime: 0.000ns HASH_JOIN_NODE (id=16):(Total: 429.926us, non-child: 434.317us, % non-child: 100.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 0 (0) - BuildTime: 0.000ns - PeakMemoryUsage: 90.25 KB (92416) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=16): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 0.000ns - BuildRowsPartitioned: 0 (0) - HashBuckets: 0 (0) - HashCollisions: 0 (0) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 9.12 KB (9344) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=28): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=27):(Total: 836.505ms, non-child: 6.142us, % non-child: 0.00%) BytesReceived(16s000ms): 765.71 KB, 817.73 KB, 817.73 KB, 817.73 KB, 817.73 KB, 817.73 KB, 817.73 KB, 817.73 KB, 817.73 KB, 817.73 KB, 817.73 KB, 817.73 KB, 817.73 KB, 817.73 KB, 817.73 KB, 817.73 KB, 817.73 KB, 817.73 KB, 817.73 KB, 817.73 KB, 817.73 KB, 817.73 KB, 817.73 KB, 817.73 KB, 817.73 KB, 817.73 KB, 817.73 KB, 817.73 KB, 817.73 KB, 817.73 KB, 817.73 KB, 817.73 KB, 817.73 KB, 817.73 KB, 817.73 KB, 817.73 KB, 817.73 KB, 817.73 KB, 817.73 KB, 817.73 KB - BytesReceived: 817.73 KB (837352) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 9.064ms - FirstBatchArrivalWaitTime: 836.497ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:3aa (host=vd1110.foo:22000):(Total: 58.303ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 3.36 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB ThreadUsage(16s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.48 MB (3652494) - PerHostPeakMemUsage: 169.55 GB (182055427331) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 895.430ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 58.255ms - ExecTreePrepareTime: 1.055ms DataStreamSender (dst_id=29):(Total: 612.571us, non-child: 612.571us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 158.12 KB (161920) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 341.667ms, non-child: 341.667ms, % non-child: 100.00%) - CodegenTime: 3.111ms - CompileTime: 98.360ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 96 (96) - NumInstructions: 3.85K (3850) - OptimizationTime: 210.685ms - PeakMemoryUsage: 1.88 MB (1971200) - PrepareTime: 31.895ms AGGREGATION_NODE (id=17):(Total: 1.054ms, non-child: 656.403us, % non-child: 62.27%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 177.220us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.34 MB (1409152) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - StreamingTime: 0.000ns - UnpinTime: 0.000ns HASH_JOIN_NODE (id=16):(Total: 397.669us, non-child: 400.746us, % non-child: 100.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 0 (0) - BuildTime: 0.000ns - PeakMemoryUsage: 90.25 KB (92416) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=16): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 0.000ns - BuildRowsPartitioned: 0 (0) - HashBuckets: 0 (0) - HashCollisions: 0 (0) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 9.12 KB (9344) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=28): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=27):(Total: 895.431ms, non-child: 5.078us, % non-child: 0.00%) BytesReceived(16s000ms): 741.68 KB, 818.89 KB, 818.89 KB, 818.89 KB, 818.89 KB, 818.89 KB, 818.89 KB, 818.89 KB, 818.89 KB, 818.89 KB, 818.89 KB, 818.89 KB, 818.89 KB, 818.89 KB, 818.89 KB, 818.89 KB, 818.89 KB, 818.89 KB, 818.89 KB, 818.89 KB, 818.89 KB, 818.89 KB, 818.89 KB, 818.89 KB, 818.89 KB, 818.89 KB, 818.89 KB, 818.89 KB, 818.89 KB, 818.89 KB, 818.89 KB, 818.89 KB, 818.89 KB, 818.89 KB, 818.89 KB, 818.89 KB, 818.89 KB, 818.89 KB, 818.89 KB, 818.89 KB - BytesReceived: 818.89 KB (838545) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 9.905ms - FirstBatchArrivalWaitTime: 895.423ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:393 (host=vd1338.foo:22000):(Total: 57.911ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 3.32 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB ThreadUsage(16s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.50 MB (3672894) - PerHostPeakMemUsage: 169.56 GB (182065416325) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 883.461ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 57.858ms - ExecTreePrepareTime: 1.090ms DataStreamSender (dst_id=29):(Total: 405.687us, non-child: 405.687us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 158.12 KB (161920) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 340.596ms, non-child: 340.596ms, % non-child: 100.00%) - CodegenTime: 3.237ms - CompileTime: 96.589ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 96 (96) - NumInstructions: 3.85K (3850) - OptimizationTime: 211.117ms - PeakMemoryUsage: 1.88 MB (1971200) - PrepareTime: 32.197ms AGGREGATION_NODE (id=17):(Total: 1.089ms, non-child: 692.527us, % non-child: 63.58%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 127.704us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.34 MB (1409152) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - StreamingTime: 0.000ns - UnpinTime: 0.000ns HASH_JOIN_NODE (id=16):(Total: 396.723us, non-child: 398.773us, % non-child: 100.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 0 (0) - BuildTime: 0.000ns - PeakMemoryUsage: 90.25 KB (92416) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=16): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 0.000ns - BuildRowsPartitioned: 0 (0) - HashBuckets: 0 (0) - HashCollisions: 0 (0) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 9.12 KB (9344) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=28): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=27):(Total: 883.462ms, non-child: 6.973us, % non-child: 0.00%) BytesReceived(16s000ms): 748.58 KB, 826.89 KB, 826.89 KB, 826.89 KB, 826.89 KB, 826.89 KB, 826.89 KB, 826.89 KB, 826.89 KB, 826.89 KB, 826.89 KB, 826.89 KB, 826.89 KB, 826.89 KB, 826.89 KB, 826.89 KB, 826.89 KB, 826.89 KB, 826.89 KB, 826.89 KB, 826.89 KB, 826.89 KB, 826.89 KB, 826.89 KB, 826.89 KB, 826.89 KB, 826.89 KB, 826.89 KB, 826.89 KB, 826.89 KB, 826.89 KB, 826.89 KB, 826.89 KB, 826.89 KB, 826.89 KB, 826.89 KB, 826.89 KB, 826.89 KB, 826.89 KB, 826.89 KB - BytesReceived: 826.89 KB (846735) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 10.600ms - FirstBatchArrivalWaitTime: 883.452ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:388 (host=vc1516.foo:22000):(Total: 57.793ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 3.31 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB ThreadUsage(16s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.49 MB (3663195) - PerHostPeakMemUsage: 169.57 GB (182072988562) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 873.275ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 57.684ms - ExecTreePrepareTime: 1.277ms DataStreamSender (dst_id=29):(Total: 564.145us, non-child: 564.145us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 158.12 KB (161920) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 332.280ms, non-child: 332.280ms, % non-child: 100.00%) - CodegenTime: 2.641ms - CompileTime: 100.273ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 96 (96) - NumInstructions: 3.85K (3850) - OptimizationTime: 200.611ms - PeakMemoryUsage: 1.88 MB (1971200) - PrepareTime: 30.670ms AGGREGATION_NODE (id=17):(Total: 1.276ms, non-child: 889.890us, % non-child: 69.72%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 261.031us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.34 MB (1409152) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - StreamingTime: 0.000ns - UnpinTime: 0.000ns HASH_JOIN_NODE (id=16):(Total: 386.407us, non-child: 389.400us, % non-child: 100.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 0 (0) - BuildTime: 0.000ns - PeakMemoryUsage: 90.25 KB (92416) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=16): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 0.000ns - BuildRowsPartitioned: 0 (0) - HashBuckets: 0 (0) - HashCollisions: 0 (0) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 9.12 KB (9344) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=28): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=27):(Total: 873.276ms, non-child: 6.469us, % non-child: 0.00%) BytesReceived(16s000ms): 743.66 KB, 821.53 KB, 821.53 KB, 821.53 KB, 821.53 KB, 821.53 KB, 821.53 KB, 821.53 KB, 821.53 KB, 821.53 KB, 821.53 KB, 821.53 KB, 821.53 KB, 821.53 KB, 821.53 KB, 821.53 KB, 821.53 KB, 821.53 KB, 821.53 KB, 821.53 KB, 821.53 KB, 821.53 KB, 821.53 KB, 821.53 KB, 821.53 KB, 821.53 KB, 821.53 KB, 821.53 KB, 821.53 KB, 821.53 KB, 821.53 KB, 821.53 KB, 821.53 KB, 821.53 KB, 821.53 KB, 821.53 KB, 821.53 KB, 821.53 KB, 821.53 KB, 821.53 KB - BytesReceived: 821.53 KB (841244) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 10.156ms - FirstBatchArrivalWaitTime: 873.267ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:3c1 (host=ve1127.foo:22000):(Total: 57.584ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 3.34 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB ThreadUsage(16s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.47 MB (3642880) - PerHostPeakMemUsage: 169.56 GB (182064155503) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 903.253ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 57.480ms - ExecTreePrepareTime: 1.103ms DataStreamSender (dst_id=29):(Total: 483.310us, non-child: 483.310us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 158.12 KB (161920) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 322.713ms, non-child: 322.713ms, % non-child: 100.00%) - CodegenTime: 2.734ms - CompileTime: 92.630ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 96 (96) - NumInstructions: 3.85K (3850) - OptimizationTime: 198.134ms - PeakMemoryUsage: 1.88 MB (1971200) - PrepareTime: 31.232ms AGGREGATION_NODE (id=17):(Total: 1.102ms, non-child: 727.708us, % non-child: 66.03%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 164.281us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.34 MB (1409152) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - StreamingTime: 0.000ns - UnpinTime: 0.000ns HASH_JOIN_NODE (id=16):(Total: 374.451us, non-child: 378.233us, % non-child: 100.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 0 (0) - BuildTime: 0.000ns - PeakMemoryUsage: 90.25 KB (92416) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=16): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 0.000ns - BuildRowsPartitioned: 0 (0) - HashBuckets: 0 (0) - HashCollisions: 0 (0) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 9.12 KB (9344) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=28): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=27):(Total: 903.255ms, non-child: 6.624us, % non-child: 0.00%) BytesReceived(16s000ms): 732.44 KB, 808.86 KB, 808.86 KB, 808.86 KB, 808.86 KB, 808.86 KB, 808.86 KB, 808.86 KB, 808.86 KB, 808.86 KB, 808.86 KB, 808.86 KB, 808.86 KB, 808.86 KB, 808.86 KB, 808.86 KB, 808.86 KB, 808.86 KB, 808.86 KB, 808.86 KB, 808.86 KB, 808.86 KB, 808.86 KB, 808.86 KB, 808.86 KB, 808.86 KB, 808.86 KB, 808.86 KB, 808.86 KB, 808.86 KB, 808.86 KB, 808.86 KB, 808.86 KB, 808.86 KB, 808.86 KB, 808.86 KB, 808.86 KB, 808.86 KB, 808.86 KB, 808.86 KB - BytesReceived: 808.86 KB (828277) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 9.790ms - FirstBatchArrivalWaitTime: 903.246ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:398 (host=ve1132.foo:22000):(Total: 57.391ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 3.37 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.49 MB (3663190) - PerHostPeakMemUsage: 169.57 GB (182073146432) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 868.112ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 57.309ms - ExecTreePrepareTime: 1.418ms DataStreamSender (dst_id=29):(Total: 536.248us, non-child: 536.248us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 158.12 KB (161920) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 362.146ms, non-child: 362.146ms, % non-child: 100.00%) - CodegenTime: 3.890ms - CompileTime: 113.454ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 96 (96) - NumInstructions: 3.85K (3850) - OptimizationTime: 215.837ms - PeakMemoryUsage: 1.88 MB (1971200) - PrepareTime: 32.136ms AGGREGATION_NODE (id=17):(Total: 1.417ms, non-child: 893.971us, % non-child: 63.08%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 290.441us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.34 MB (1409152) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - StreamingTime: 0.000ns - UnpinTime: 0.000ns HASH_JOIN_NODE (id=16):(Total: 523.274us, non-child: 525.703us, % non-child: 100.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 0 (0) - BuildTime: 0.000ns - PeakMemoryUsage: 90.25 KB (92416) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=16): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 0.000ns - BuildRowsPartitioned: 0 (0) - HashBuckets: 0 (0) - HashCollisions: 0 (0) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 9.12 KB (9344) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=28): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=27):(Total: 868.113ms, non-child: 8.331us, % non-child: 0.00%) BytesReceived(16s000ms): 771.71 KB, 823.96 KB, 823.96 KB, 823.96 KB, 823.96 KB, 823.96 KB, 823.96 KB, 823.96 KB, 823.96 KB, 823.96 KB, 823.96 KB, 823.96 KB, 823.96 KB, 823.96 KB, 823.96 KB, 823.96 KB, 823.96 KB, 823.96 KB, 823.96 KB, 823.96 KB, 823.96 KB, 823.96 KB, 823.96 KB, 823.96 KB, 823.96 KB, 823.96 KB, 823.96 KB, 823.96 KB, 823.96 KB, 823.96 KB, 823.96 KB, 823.96 KB, 823.96 KB, 823.96 KB, 823.96 KB, 823.96 KB, 823.96 KB, 823.96 KB, 823.96 KB, 823.96 KB - BytesReceived: 823.96 KB (843740) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 75.208ms - FirstBatchArrivalWaitTime: 868.104ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:379 (host=vd1116.foo:22000):(Total: 57.201ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 3.38 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.51 MB (3675288) - PerHostPeakMemUsage: 169.56 GB (182059842389) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 853.395ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 57.153ms - ExecTreePrepareTime: 865.833us DataStreamSender (dst_id=29):(Total: 466.824us, non-child: 466.824us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 158.12 KB (161920) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 330.549ms, non-child: 330.549ms, % non-child: 100.00%) - CodegenTime: 3.087ms - CompileTime: 95.403ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 96 (96) - NumInstructions: 3.85K (3850) - OptimizationTime: 202.243ms - PeakMemoryUsage: 1.88 MB (1971200) - PrepareTime: 32.098ms AGGREGATION_NODE (id=17):(Total: 863.759us, non-child: 586.509us, % non-child: 67.90%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 102.261us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.34 MB (1409152) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - StreamingTime: 0.000ns - UnpinTime: 0.000ns HASH_JOIN_NODE (id=16):(Total: 277.250us, non-child: 279.322us, % non-child: 100.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 0 (0) - BuildTime: 0.000ns - PeakMemoryUsage: 90.25 KB (92416) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=16): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 0.000ns - BuildRowsPartitioned: 0 (0) - HashBuckets: 0 (0) - HashCollisions: 0 (0) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 9.12 KB (9344) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=28): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=27):(Total: 853.396ms, non-child: 7.122us, % non-child: 0.00%) BytesReceived(16s000ms): 774.83 KB, 827.34 KB, 827.34 KB, 827.34 KB, 827.34 KB, 827.34 KB, 827.34 KB, 827.34 KB, 827.34 KB, 827.34 KB, 827.34 KB, 827.34 KB, 827.34 KB, 827.34 KB, 827.34 KB, 827.34 KB, 827.34 KB, 827.34 KB, 827.34 KB, 827.34 KB, 827.34 KB, 827.34 KB, 827.34 KB, 827.34 KB, 827.34 KB, 827.34 KB, 827.34 KB, 827.34 KB, 827.34 KB, 827.34 KB, 827.34 KB, 827.34 KB, 827.34 KB, 827.34 KB, 827.34 KB, 827.34 KB, 827.34 KB, 827.34 KB, 827.34 KB, 827.34 KB - BytesReceived: 827.34 KB (847198) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 9.348ms - FirstBatchArrivalWaitTime: 853.387ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:39f (host=vc1535.foo:22000):(Total: 57.144ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 3.38 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.50 MB (3668076) - PerHostPeakMemUsage: 169.57 GB (182070261522) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 892.387ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 57.100ms - ExecTreePrepareTime: 1.355ms DataStreamSender (dst_id=29):(Total: 544.808us, non-child: 544.808us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 158.12 KB (161920) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 344.136ms, non-child: 344.136ms, % non-child: 100.00%) - CodegenTime: 2.615ms - CompileTime: 98.997ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 96 (96) - NumInstructions: 3.85K (3850) - OptimizationTime: 212.597ms - PeakMemoryUsage: 1.88 MB (1971200) - PrepareTime: 31.605ms AGGREGATION_NODE (id=17):(Total: 1.354ms, non-child: 976.492us, % non-child: 72.07%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 427.355us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.34 MB (1409152) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - StreamingTime: 0.000ns - UnpinTime: 0.000ns HASH_JOIN_NODE (id=16):(Total: 378.345us, non-child: 383.202us, % non-child: 100.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 0 (0) - BuildTime: 0.000ns - PeakMemoryUsage: 90.25 KB (92416) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=16): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 0.000ns - BuildRowsPartitioned: 0 (0) - HashBuckets: 0 (0) - HashCollisions: 0 (0) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 9.12 KB (9344) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=28): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=27):(Total: 892.388ms, non-child: 4.561us, % non-child: 0.00%) BytesReceived(16s000ms): 772.33 KB, 824.64 KB, 824.64 KB, 824.64 KB, 824.64 KB, 824.64 KB, 824.64 KB, 824.64 KB, 824.64 KB, 824.64 KB, 824.64 KB, 824.64 KB, 824.64 KB, 824.64 KB, 824.64 KB, 824.64 KB, 824.64 KB, 824.64 KB, 824.64 KB, 824.64 KB, 824.64 KB, 824.64 KB, 824.64 KB, 824.64 KB, 824.64 KB, 824.64 KB, 824.64 KB, 824.64 KB, 824.64 KB, 824.64 KB, 824.64 KB, 824.64 KB, 824.64 KB, 824.64 KB, 824.64 KB, 824.64 KB, 824.64 KB, 824.64 KB, 824.64 KB, 824.64 KB - BytesReceived: 824.64 KB (844436) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 9.266ms - FirstBatchArrivalWaitTime: 892.381ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:3ab (host=vd1142.foo:22000):(Total: 57.126ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 3.35 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB ThreadUsage(16s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.49 MB (3656978) - PerHostPeakMemUsage: 169.56 GB (182068790410) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 899.252ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 57.075ms - ExecTreePrepareTime: 1.173ms DataStreamSender (dst_id=29):(Total: 518.373us, non-child: 518.373us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 158.12 KB (161920) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 335.743ms, non-child: 335.743ms, % non-child: 100.00%) - CodegenTime: 2.778ms - CompileTime: 98.772ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 96 (96) - NumInstructions: 3.85K (3850) - OptimizationTime: 204.306ms - PeakMemoryUsage: 1.88 MB (1971200) - PrepareTime: 31.915ms AGGREGATION_NODE (id=17):(Total: 1.171ms, non-child: 762.187us, % non-child: 65.06%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 181.720us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.34 MB (1409152) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - StreamingTime: 0.000ns - UnpinTime: 0.000ns HASH_JOIN_NODE (id=16):(Total: 409.383us, non-child: 414.132us, % non-child: 100.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 0 (0) - BuildTime: 0.000ns - PeakMemoryUsage: 90.25 KB (92416) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=16): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 0.000ns - BuildRowsPartitioned: 0 (0) - HashBuckets: 0 (0) - HashCollisions: 0 (0) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 9.12 KB (9344) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=28): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=27):(Total: 899.253ms, non-child: 4.567us, % non-child: 0.00%) BytesReceived(16s000ms): 760.81 KB, 821.12 KB, 821.12 KB, 821.12 KB, 821.12 KB, 821.12 KB, 821.12 KB, 821.12 KB, 821.12 KB, 821.12 KB, 821.12 KB, 821.12 KB, 821.12 KB, 821.12 KB, 821.12 KB, 821.12 KB, 821.12 KB, 821.12 KB, 821.12 KB, 821.12 KB, 821.12 KB, 821.12 KB, 821.12 KB, 821.12 KB, 821.12 KB, 821.12 KB, 821.12 KB, 821.12 KB, 821.12 KB, 821.12 KB, 821.12 KB, 821.12 KB, 821.12 KB, 821.12 KB, 821.12 KB, 821.12 KB, 821.12 KB, 821.12 KB, 821.12 KB, 821.12 KB - BytesReceived: 821.12 KB (840825) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 8.971ms - FirstBatchArrivalWaitTime: 899.246ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:3cb (host=va1033.foo:22000):(Total: 57.100ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 3.32 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB ThreadUsage(16s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.50 MB (3672899) - PerHostPeakMemUsage: 169.57 GB (182072814812) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 880.497ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 57.050ms - ExecTreePrepareTime: 1.012ms DataStreamSender (dst_id=29):(Total: 692.238us, non-child: 692.238us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 158.12 KB (161920) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 343.952ms, non-child: 343.952ms, % non-child: 100.00%) - CodegenTime: 3.339ms - CompileTime: 104.364ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 96 (96) - NumInstructions: 3.85K (3850) - OptimizationTime: 207.122ms - PeakMemoryUsage: 1.88 MB (1971200) - PrepareTime: 31.644ms AGGREGATION_NODE (id=17):(Total: 1.011ms, non-child: 650.083us, % non-child: 64.24%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 123.190us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.34 MB (1409152) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - StreamingTime: 0.000ns - UnpinTime: 0.000ns HASH_JOIN_NODE (id=16):(Total: 361.870us, non-child: 366.835us, % non-child: 100.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 0 (0) - BuildTime: 0.000ns - PeakMemoryUsage: 90.25 KB (92416) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=16): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 0.000ns - BuildRowsPartitioned: 0 (0) - HashBuckets: 0 (0) - HashCollisions: 0 (0) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 9.12 KB (9344) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=28): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=27):(Total: 880.497ms, non-child: 4.727us, % non-child: 0.00%) BytesReceived(16s000ms): 748.73 KB, 827.06 KB, 827.06 KB, 827.06 KB, 827.06 KB, 827.06 KB, 827.06 KB, 827.06 KB, 827.06 KB, 827.06 KB, 827.06 KB, 827.06 KB, 827.06 KB, 827.06 KB, 827.06 KB, 827.06 KB, 827.06 KB, 827.06 KB, 827.06 KB, 827.06 KB, 827.06 KB, 827.06 KB, 827.06 KB, 827.06 KB, 827.06 KB, 827.06 KB, 827.06 KB, 827.06 KB, 827.06 KB, 827.06 KB, 827.06 KB, 827.06 KB, 827.06 KB, 827.06 KB, 827.06 KB, 827.06 KB, 827.06 KB, 827.06 KB, 827.06 KB, 827.06 KB - BytesReceived: 827.06 KB (846905) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 10.343ms - FirstBatchArrivalWaitTime: 880.490ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:390 (host=vd1125.foo:22000):(Total: 57.068ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 3.37 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB ThreadUsage(16s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.49 MB (3655002) - PerHostPeakMemUsage: 169.56 GB (182067071571) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 882.796ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 57.009ms - ExecTreePrepareTime: 1.224ms DataStreamSender (dst_id=29):(Total: 625.425us, non-child: 625.425us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 158.12 KB (161920) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 338.059ms, non-child: 338.059ms, % non-child: 100.00%) - CodegenTime: 2.988ms - CompileTime: 98.322ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 96 (96) - NumInstructions: 3.85K (3850) - OptimizationTime: 205.719ms - PeakMemoryUsage: 1.88 MB (1971200) - PrepareTime: 33.386ms AGGREGATION_NODE (id=17):(Total: 1.223ms, non-child: 812.208us, % non-child: 66.36%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 245.941us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.34 MB (1409152) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - StreamingTime: 0.000ns - UnpinTime: 0.000ns HASH_JOIN_NODE (id=16):(Total: 411.749us, non-child: 414.323us, % non-child: 100.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 0 (0) - BuildTime: 0.000ns - PeakMemoryUsage: 90.25 KB (92416) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=16): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 0.000ns - BuildRowsPartitioned: 0 (0) - HashBuckets: 0 (0) - HashCollisions: 0 (0) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 9.12 KB (9344) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=28): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=27):(Total: 882.797ms, non-child: 4.669us, % non-child: 0.00%) BytesReceived(16s000ms): 742.22 KB, 819.88 KB, 819.88 KB, 819.88 KB, 819.88 KB, 819.88 KB, 819.88 KB, 819.88 KB, 819.88 KB, 819.88 KB, 819.88 KB, 819.88 KB, 819.88 KB, 819.88 KB, 819.88 KB, 819.88 KB, 819.88 KB, 819.88 KB, 819.88 KB, 819.88 KB, 819.88 KB, 819.88 KB, 819.88 KB, 819.88 KB, 819.88 KB, 819.88 KB, 819.88 KB, 819.88 KB, 819.88 KB, 819.88 KB, 819.88 KB, 819.88 KB, 819.88 KB, 819.88 KB, 819.88 KB, 819.88 KB, 819.88 KB, 819.88 KB, 819.88 KB, 819.88 KB - BytesReceived: 819.88 KB (839558) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 9.838ms - FirstBatchArrivalWaitTime: 882.789ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:3d1 (host=va1042.foo:22000):(Total: 56.897ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 3.33 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB ThreadUsage(16s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.51 MB (3682439) - PerHostPeakMemUsage: 169.58 GB (182088609238) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 902.154ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 56.799ms - ExecTreePrepareTime: 1.364ms DataStreamSender (dst_id=29):(Total: 524.217us, non-child: 524.217us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 158.12 KB (161920) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 329.213ms, non-child: 329.213ms, % non-child: 100.00%) - CodegenTime: 4.171ms - CompileTime: 95.593ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 96 (96) - NumInstructions: 3.85K (3850) - OptimizationTime: 199.392ms - PeakMemoryUsage: 1.88 MB (1971200) - PrepareTime: 33.541ms AGGREGATION_NODE (id=17):(Total: 1.363ms, non-child: 914.245us, % non-child: 67.04%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 238.776us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.34 MB (1409152) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - StreamingTime: 0.000ns - UnpinTime: 0.000ns HASH_JOIN_NODE (id=16):(Total: 449.445us, non-child: 459.744us, % non-child: 100.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 0 (0) - BuildTime: 0.000ns - PeakMemoryUsage: 90.25 KB (92416) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=16): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 0.000ns - BuildRowsPartitioned: 0 (0) - HashBuckets: 0 (0) - HashCollisions: 0 (0) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 9.12 KB (9344) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=28): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=27):(Total: 902.155ms, non-child: 3.515us, % non-child: 0.00%) BytesReceived(16s000ms): 752.24 KB, 830.96 KB, 830.96 KB, 830.96 KB, 830.96 KB, 830.96 KB, 830.96 KB, 830.96 KB, 830.96 KB, 830.96 KB, 830.96 KB, 830.96 KB, 830.96 KB, 830.96 KB, 830.96 KB, 830.96 KB, 830.96 KB, 830.96 KB, 830.96 KB, 830.96 KB, 830.96 KB, 830.96 KB, 830.96 KB, 830.96 KB, 830.96 KB, 830.96 KB, 830.96 KB, 830.96 KB, 830.96 KB, 830.96 KB, 830.96 KB, 830.96 KB, 830.96 KB, 830.96 KB, 830.96 KB, 830.96 KB, 830.96 KB, 830.96 KB, 830.96 KB, 830.96 KB - BytesReceived: 830.96 KB (850907) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 10.273ms - FirstBatchArrivalWaitTime: 902.145ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:395 (host=vc1519.foo:22000):(Total: 56.633ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 3.32 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB ThreadUsage(16s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.48 MB (3651905) - PerHostPeakMemUsage: 169.57 GB (182071139285) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 866.259ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 56.550ms - ExecTreePrepareTime: 1.225ms DataStreamSender (dst_id=29):(Total: 590.809us, non-child: 590.809us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 158.12 KB (161920) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 361.062ms, non-child: 361.062ms, % non-child: 100.00%) - CodegenTime: 2.731ms - CompileTime: 111.413ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 96 (96) - NumInstructions: 3.85K (3850) - OptimizationTime: 217.413ms - PeakMemoryUsage: 1.88 MB (1971200) - PrepareTime: 31.545ms AGGREGATION_NODE (id=17):(Total: 1.224ms, non-child: 585.747us, % non-child: 47.84%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 250.962us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.34 MB (1409152) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - StreamingTime: 0.000ns - UnpinTime: 0.000ns HASH_JOIN_NODE (id=16):(Total: 638.646us, non-child: 642.312us, % non-child: 100.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 0 (0) - BuildTime: 0.000ns - PeakMemoryUsage: 90.25 KB (92416) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=16): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 0.000ns - BuildRowsPartitioned: 0 (0) - HashBuckets: 0 (0) - HashCollisions: 0 (0) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 9.12 KB (9344) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=28): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=27):(Total: 866.260ms, non-child: 5.183us, % non-child: 0.00%) BytesReceived(16s000ms): 746.84 KB, 818.69 KB, 818.69 KB, 818.69 KB, 818.69 KB, 818.69 KB, 818.69 KB, 818.69 KB, 818.69 KB, 818.69 KB, 818.69 KB, 818.69 KB, 818.69 KB, 818.69 KB, 818.69 KB, 818.69 KB, 818.69 KB, 818.69 KB, 818.69 KB, 818.69 KB, 818.69 KB, 818.69 KB, 818.69 KB, 818.69 KB, 818.69 KB, 818.69 KB, 818.69 KB, 818.69 KB, 818.69 KB, 818.69 KB, 818.69 KB, 818.69 KB, 818.69 KB, 818.69 KB, 818.69 KB, 818.69 KB, 818.69 KB, 818.69 KB, 818.69 KB, 818.69 KB - BytesReceived: 818.69 KB (838334) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 11.860ms - FirstBatchArrivalWaitTime: 866.252ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:3af (host=vd1120.foo:22000):(Total: 56.520ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 3.33 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB ThreadUsage(16s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.47 MB (3642880) - PerHostPeakMemUsage: 169.56 GB (182061714716) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 901.509ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 56.430ms - ExecTreePrepareTime: 1.519ms DataStreamSender (dst_id=29):(Total: 605.257us, non-child: 605.257us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 158.12 KB (161920) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 339.352ms, non-child: 339.352ms, % non-child: 100.00%) - CodegenTime: 3.136ms - CompileTime: 98.722ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 96 (96) - NumInstructions: 3.85K (3850) - OptimizationTime: 208.084ms - PeakMemoryUsage: 1.88 MB (1971200) - PrepareTime: 31.643ms AGGREGATION_NODE (id=17):(Total: 1.518ms, non-child: 996.463us, % non-child: 65.62%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 276.361us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.34 MB (1409152) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - StreamingTime: 0.000ns - UnpinTime: 0.000ns HASH_JOIN_NODE (id=16):(Total: 522.179us, non-child: 527.175us, % non-child: 100.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 0 (0) - BuildTime: 0.000ns - PeakMemoryUsage: 90.25 KB (92416) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=16): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 0.000ns - BuildRowsPartitioned: 0 (0) - HashBuckets: 0 (0) - HashCollisions: 0 (0) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 9.12 KB (9344) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=28): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=27):(Total: 901.510ms, non-child: 6.836us, % non-child: 0.00%) BytesReceived(16s000ms): 752.12 KB, 815.01 KB, 815.01 KB, 815.01 KB, 815.01 KB, 815.01 KB, 815.01 KB, 815.01 KB, 815.01 KB, 815.01 KB, 815.01 KB, 815.01 KB, 815.01 KB, 815.01 KB, 815.01 KB, 815.01 KB, 815.01 KB, 815.01 KB, 815.01 KB, 815.01 KB, 815.01 KB, 815.01 KB, 815.01 KB, 815.01 KB, 815.01 KB, 815.01 KB, 815.01 KB, 815.01 KB, 815.01 KB, 815.01 KB, 815.01 KB, 815.01 KB, 815.01 KB, 815.01 KB, 815.01 KB, 815.01 KB, 815.01 KB, 815.01 KB, 815.01 KB, 815.01 KB - BytesReceived: 815.01 KB (834567) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 10.925ms - FirstBatchArrivalWaitTime: 901.501ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:38d (host=vc1528.foo:22000):(Total: 56.459ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 3.33 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB, 3.51 MB ThreadUsage(16s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.51 MB (3676844) - PerHostPeakMemUsage: 169.58 GB (182081766840) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 874.175ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 56.416ms - ExecTreePrepareTime: 1.464ms DataStreamSender (dst_id=29):(Total: 717.142us, non-child: 717.142us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 158.12 KB (161920) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 336.904ms, non-child: 336.904ms, % non-child: 100.00%) - CodegenTime: 2.357ms - CompileTime: 95.177ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 96 (96) - NumInstructions: 3.85K (3850) - OptimizationTime: 212.973ms - PeakMemoryUsage: 1.88 MB (1971200) - PrepareTime: 28.131ms AGGREGATION_NODE (id=17):(Total: 1.463ms, non-child: 1.011ms, % non-child: 69.15%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 243.474us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.34 MB (1409152) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - StreamingTime: 0.000ns - UnpinTime: 0.000ns HASH_JOIN_NODE (id=16):(Total: 451.408us, non-child: 455.260us, % non-child: 100.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 0 (0) - BuildTime: 0.000ns - PeakMemoryUsage: 90.25 KB (92416) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=16): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 0.000ns - BuildRowsPartitioned: 0 (0) - HashBuckets: 0 (0) - HashCollisions: 0 (0) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 9.12 KB (9344) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=28): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=27):(Total: 874.176ms, non-child: 5.551us, % non-child: 0.00%) BytesReceived(16s000ms): 751.25 KB, 829.85 KB, 829.85 KB, 829.85 KB, 829.85 KB, 829.85 KB, 829.85 KB, 829.85 KB, 829.85 KB, 829.85 KB, 829.85 KB, 829.85 KB, 829.85 KB, 829.85 KB, 829.85 KB, 829.85 KB, 829.85 KB, 829.85 KB, 829.85 KB, 829.85 KB, 829.85 KB, 829.85 KB, 829.85 KB, 829.85 KB, 829.85 KB, 829.85 KB, 829.85 KB, 829.85 KB, 829.85 KB, 829.85 KB, 829.85 KB, 829.85 KB, 829.85 KB, 829.85 KB, 829.85 KB, 829.85 KB, 829.85 KB, 829.85 KB, 829.85 KB, 829.85 KB - BytesReceived: 829.85 KB (849767) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 9.986ms - FirstBatchArrivalWaitTime: 874.168ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:383 (host=vd1334.foo:22000):(Total: 56.186ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 3.38 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.50 MB (3669703) - PerHostPeakMemUsage: 169.57 GB (182073588045) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 856.089ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 56.142ms - ExecTreePrepareTime: 1.108ms DataStreamSender (dst_id=29):(Total: 580.380us, non-child: 580.380us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 158.12 KB (161920) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 341.532ms, non-child: 341.532ms, % non-child: 100.00%) - CodegenTime: 2.417ms - CompileTime: 99.605ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 96 (96) - NumInstructions: 3.85K (3850) - OptimizationTime: 209.712ms - PeakMemoryUsage: 1.88 MB (1971200) - PrepareTime: 31.500ms AGGREGATION_NODE (id=17):(Total: 1.107ms, non-child: 723.777us, % non-child: 65.36%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 134.967us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.34 MB (1409152) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - StreamingTime: 0.000ns - UnpinTime: 0.000ns HASH_JOIN_NODE (id=16):(Total: 383.529us, non-child: 383.509us, % non-child: 99.99%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 0 (0) - BuildTime: 0.000ns - PeakMemoryUsage: 90.25 KB (92416) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=16): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 0.000ns - BuildRowsPartitioned: 0 (0) - HashBuckets: 0 (0) - HashCollisions: 0 (0) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 9.12 KB (9344) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=28): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=27):(Total: 856.089ms, non-child: 5.854us, % non-child: 0.00%) BytesReceived(16s000ms): 772.41 KB, 825.16 KB, 825.16 KB, 825.16 KB, 825.16 KB, 825.16 KB, 825.16 KB, 825.16 KB, 825.16 KB, 825.16 KB, 825.16 KB, 825.16 KB, 825.16 KB, 825.16 KB, 825.16 KB, 825.16 KB, 825.16 KB, 825.16 KB, 825.16 KB, 825.16 KB, 825.16 KB, 825.16 KB, 825.16 KB, 825.16 KB, 825.16 KB, 825.16 KB, 825.16 KB, 825.16 KB, 825.16 KB, 825.16 KB, 825.16 KB, 825.16 KB, 825.16 KB, 825.16 KB, 825.16 KB, 825.16 KB, 825.16 KB, 825.16 KB, 825.16 KB, 825.16 KB - BytesReceived: 825.16 KB (844959) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 9.558ms - FirstBatchArrivalWaitTime: 856.081ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:372 (host=ve1126.foo:22000):(Total: 56.141ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 3.31 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB ThreadUsage(16s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.49 MB (3661143) - PerHostPeakMemUsage: 169.56 GB (182065029600) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 851.645ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 55.954ms - ExecTreePrepareTime: 1.375ms DataStreamSender (dst_id=29):(Total: 566.294us, non-child: 566.294us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 158.12 KB (161920) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 324.910ms, non-child: 324.910ms, % non-child: 100.00%) - CodegenTime: 2.817ms - CompileTime: 93.713ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 96 (96) - NumInstructions: 3.85K (3850) - OptimizationTime: 199.481ms - PeakMemoryUsage: 1.88 MB (1971200) - PrepareTime: 31.057ms AGGREGATION_NODE (id=17):(Total: 1.373ms, non-child: 774.651us, % non-child: 56.42%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 328.766us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.34 MB (1409152) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - StreamingTime: 0.000ns - UnpinTime: 0.000ns HASH_JOIN_NODE (id=16):(Total: 598.450us, non-child: 601.429us, % non-child: 100.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 0 (0) - BuildTime: 0.000ns - PeakMemoryUsage: 90.25 KB (92416) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=16): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 0.000ns - BuildRowsPartitioned: 0 (0) - HashBuckets: 0 (0) - HashCollisions: 0 (0) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 9.12 KB (9344) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=28): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=27):(Total: 851.646ms, non-child: 4.116us, % non-child: 0.00%) BytesReceived(16s000ms): 744.07 KB, 821.93 KB, 821.93 KB, 821.93 KB, 821.93 KB, 821.93 KB, 821.93 KB, 821.93 KB, 821.93 KB, 821.93 KB, 821.93 KB, 821.93 KB, 821.93 KB, 821.93 KB, 821.93 KB, 821.93 KB, 821.93 KB, 821.93 KB, 821.93 KB, 821.93 KB, 821.93 KB, 821.93 KB, 821.93 KB, 821.93 KB, 821.93 KB, 821.93 KB, 821.93 KB, 821.93 KB, 821.93 KB, 821.93 KB, 821.93 KB, 821.93 KB, 821.93 KB, 821.93 KB, 821.93 KB, 821.93 KB, 821.93 KB, 821.93 KB, 821.93 KB, 821.93 KB - BytesReceived: 821.93 KB (841656) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 9.838ms - FirstBatchArrivalWaitTime: 851.639ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:37f (host=va1027.foo:22000):(Total: 56.108ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 3.36 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB ThreadUsage(16s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.48 MB (3653014) - PerHostPeakMemUsage: 169.54 GB (182043355220) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 861.287ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 56.058ms - ExecTreePrepareTime: 1.338ms DataStreamSender (dst_id=29):(Total: 586.370us, non-child: 586.370us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 158.12 KB (161920) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 330.198ms, non-child: 330.198ms, % non-child: 100.00%) - CodegenTime: 2.203ms - CompileTime: 92.459ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 96 (96) - NumInstructions: 3.85K (3850) - OptimizationTime: 206.506ms - PeakMemoryUsage: 1.88 MB (1971200) - PrepareTime: 30.751ms AGGREGATION_NODE (id=17):(Total: 1.336ms, non-child: 888.926us, % non-child: 66.50%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 233.925us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.34 MB (1409152) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - StreamingTime: 0.000ns - UnpinTime: 0.000ns HASH_JOIN_NODE (id=16):(Total: 447.808us, non-child: 450.498us, % non-child: 100.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 0 (0) - BuildTime: 0.000ns - PeakMemoryUsage: 90.25 KB (92416) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=16): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 0.000ns - BuildRowsPartitioned: 0 (0) - HashBuckets: 0 (0) - HashCollisions: 0 (0) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 9.12 KB (9344) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=28): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=27):(Total: 861.288ms, non-child: 6.709us, % non-child: 0.00%) BytesReceived(16s000ms): 741.69 KB, 819.30 KB, 819.30 KB, 819.30 KB, 819.30 KB, 819.30 KB, 819.30 KB, 819.30 KB, 819.30 KB, 819.30 KB, 819.30 KB, 819.30 KB, 819.30 KB, 819.30 KB, 819.30 KB, 819.30 KB, 819.30 KB, 819.30 KB, 819.30 KB, 819.30 KB, 819.30 KB, 819.30 KB, 819.30 KB, 819.30 KB, 819.30 KB, 819.30 KB, 819.30 KB, 819.30 KB, 819.30 KB, 819.30 KB, 819.30 KB, 819.30 KB, 819.30 KB, 819.30 KB, 819.30 KB, 819.30 KB, 819.30 KB, 819.30 KB, 819.30 KB, 819.30 KB - BytesReceived: 819.30 KB (838963) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 10.314ms - FirstBatchArrivalWaitTime: 861.278ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:3d0 (host=vc1509.foo:22000):(Total: 56.090ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 3.35 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.49 MB (3654751) - PerHostPeakMemUsage: 169.56 GB (182064892776) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 897.106ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 56.048ms - ExecTreePrepareTime: 916.693us DataStreamSender (dst_id=29):(Total: 542.481us, non-child: 542.481us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 158.12 KB (161920) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 328.797ms, non-child: 328.797ms, % non-child: 100.00%) - CodegenTime: 3.355ms - CompileTime: 94.609ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 96 (96) - NumInstructions: 3.85K (3850) - OptimizationTime: 204.521ms - PeakMemoryUsage: 1.88 MB (1971200) - PrepareTime: 29.021ms AGGREGATION_NODE (id=17):(Total: 915.630us, non-child: 585.128us, % non-child: 63.90%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 105.352us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.34 MB (1409152) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - StreamingTime: 0.000ns - UnpinTime: 0.000ns HASH_JOIN_NODE (id=16):(Total: 330.502us, non-child: 334.412us, % non-child: 100.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 0 (0) - BuildTime: 0.000ns - PeakMemoryUsage: 90.25 KB (92416) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=16): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 0.000ns - BuildRowsPartitioned: 0 (0) - HashBuckets: 0 (0) - HashCollisions: 0 (0) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 9.12 KB (9344) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=28): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=27):(Total: 897.107ms, non-child: 5.877us, % non-child: 0.00%) BytesReceived(16s000ms): 761.44 KB, 819.25 KB, 819.25 KB, 819.25 KB, 819.25 KB, 819.25 KB, 819.25 KB, 819.25 KB, 819.25 KB, 819.25 KB, 819.25 KB, 819.25 KB, 819.25 KB, 819.25 KB, 819.25 KB, 819.25 KB, 819.25 KB, 819.25 KB, 819.25 KB, 819.25 KB, 819.25 KB, 819.25 KB, 819.25 KB, 819.25 KB, 819.25 KB, 819.25 KB, 819.25 KB, 819.25 KB, 819.25 KB, 819.25 KB, 819.25 KB, 819.25 KB, 819.25 KB, 819.25 KB, 819.25 KB, 819.25 KB, 819.25 KB, 819.25 KB, 819.25 KB, 819.25 KB - BytesReceived: 819.25 KB (838909) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 9.443ms - FirstBatchArrivalWaitTime: 897.098ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:3d5 (host=vd1118.foo:22000):(Total: 55.959ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 3.36 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.48 MB (3649901) - PerHostPeakMemUsage: 169.55 GB (182054034148) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 905.103ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 55.919ms - ExecTreePrepareTime: 989.782us DataStreamSender (dst_id=29):(Total: 569.445us, non-child: 569.445us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 158.12 KB (161920) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 315.647ms, non-child: 315.647ms, % non-child: 100.00%) - CodegenTime: 2.327ms - CompileTime: 92.592ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 96 (96) - NumInstructions: 3.85K (3850) - OptimizationTime: 192.369ms - PeakMemoryUsage: 1.88 MB (1971200) - PrepareTime: 29.710ms AGGREGATION_NODE (id=17):(Total: 989.010us, non-child: 607.293us, % non-child: 61.40%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 189.037us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.34 MB (1409152) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - StreamingTime: 0.000ns - UnpinTime: 0.000ns HASH_JOIN_NODE (id=16):(Total: 381.717us, non-child: 384.616us, % non-child: 100.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 0 (0) - BuildTime: 0.000ns - PeakMemoryUsage: 90.25 KB (92416) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=16): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 0.000ns - BuildRowsPartitioned: 0 (0) - HashBuckets: 0 (0) - HashCollisions: 0 (0) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 9.12 KB (9344) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=28): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=27):(Total: 905.104ms, non-child: 21.377us, % non-child: 0.00%) BytesReceived(16s000ms): 764.12 KB, 818.65 KB, 818.65 KB, 818.65 KB, 818.65 KB, 818.65 KB, 818.65 KB, 818.65 KB, 818.65 KB, 818.65 KB, 818.65 KB, 818.65 KB, 818.65 KB, 818.65 KB, 818.65 KB, 818.65 KB, 818.65 KB, 818.65 KB, 818.65 KB, 818.65 KB, 818.65 KB, 818.65 KB, 818.65 KB, 818.65 KB, 818.65 KB, 818.65 KB, 818.65 KB, 818.65 KB, 818.65 KB, 818.65 KB, 818.65 KB, 818.65 KB, 818.65 KB, 818.65 KB, 818.65 KB, 818.65 KB, 818.65 KB, 818.65 KB, 818.65 KB, 818.65 KB - BytesReceived: 818.65 KB (838300) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 15.202ms - FirstBatchArrivalWaitTime: 905.080ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:3a5 (host=ve1139.foo:22000):(Total: 55.751ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 3.38 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB ThreadUsage(16s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.50 MB (3673887) - PerHostPeakMemUsage: 169.57 GB (182077340353) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 922.506ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 55.705ms - ExecTreePrepareTime: 996.515us DataStreamSender (dst_id=29):(Total: 565.640us, non-child: 565.640us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 158.12 KB (161920) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 325.914ms, non-child: 325.914ms, % non-child: 100.00%) - CodegenTime: 2.426ms - CompileTime: 94.087ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 96 (96) - NumInstructions: 3.85K (3850) - OptimizationTime: 198.720ms - PeakMemoryUsage: 1.88 MB (1971200) - PrepareTime: 32.314ms AGGREGATION_NODE (id=17):(Total: 995.445us, non-child: 582.947us, % non-child: 58.56%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 133.546us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.34 MB (1409152) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - StreamingTime: 0.000ns - UnpinTime: 0.000ns HASH_JOIN_NODE (id=16):(Total: 412.498us, non-child: 415.347us, % non-child: 100.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 0 (0) - BuildTime: 0.000ns - PeakMemoryUsage: 90.25 KB (92416) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=16): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 0.000ns - BuildRowsPartitioned: 0 (0) - HashBuckets: 0 (0) - HashCollisions: 0 (0) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 9.12 KB (9344) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=28): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=27):(Total: 922.507ms, non-child: 4.595us, % non-child: 0.00%) BytesReceived(16s000ms): 748.94 KB, 827.28 KB, 827.28 KB, 827.28 KB, 827.28 KB, 827.28 KB, 827.28 KB, 827.28 KB, 827.28 KB, 827.28 KB, 827.28 KB, 827.28 KB, 827.28 KB, 827.28 KB, 827.28 KB, 827.28 KB, 827.28 KB, 827.28 KB, 827.28 KB, 827.28 KB, 827.28 KB, 827.28 KB, 827.28 KB, 827.28 KB, 827.28 KB, 827.28 KB, 827.28 KB, 827.28 KB, 827.28 KB, 827.28 KB, 827.28 KB, 827.28 KB, 827.28 KB, 827.28 KB, 827.28 KB, 827.28 KB, 827.28 KB, 827.28 KB, 827.28 KB, 827.28 KB - BytesReceived: 827.28 KB (847133) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 9.303ms - FirstBatchArrivalWaitTime: 922.500ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:3bc (host=vd1135.foo:22000):(Total: 55.600ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 3.35 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.47 MB (3642880) - PerHostPeakMemUsage: 169.57 GB (182069699515) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 902.845ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 55.554ms - ExecTreePrepareTime: 1.291ms DataStreamSender (dst_id=29):(Total: 293.020us, non-child: 293.020us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 158.12 KB (161920) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 321.358ms, non-child: 321.358ms, % non-child: 100.00%) - CodegenTime: 3.799ms - CompileTime: 95.397ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 96 (96) - NumInstructions: 3.85K (3850) - OptimizationTime: 198.041ms - PeakMemoryUsage: 1.88 MB (1971200) - PrepareTime: 27.169ms AGGREGATION_NODE (id=17):(Total: 1.290ms, non-child: 784.343us, % non-child: 60.79%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 249.829us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.34 MB (1409152) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - StreamingTime: 0.000ns - UnpinTime: 0.000ns HASH_JOIN_NODE (id=16):(Total: 505.814us, non-child: 511.181us, % non-child: 100.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 0 (0) - BuildTime: 0.000ns - PeakMemoryUsage: 90.25 KB (92416) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=16): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 0.000ns - BuildRowsPartitioned: 0 (0) - HashBuckets: 0 (0) - HashCollisions: 0 (0) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 9.12 KB (9344) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=28): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=27):(Total: 902.846ms, non-child: 4.168us, % non-child: 0.00%) BytesReceived(16s000ms): 758.46 KB, 810.02 KB, 810.02 KB, 810.02 KB, 810.02 KB, 810.02 KB, 810.02 KB, 810.02 KB, 810.02 KB, 810.02 KB, 810.02 KB, 810.02 KB, 810.02 KB, 810.02 KB, 810.02 KB, 810.02 KB, 810.02 KB, 810.02 KB, 810.02 KB, 810.02 KB, 810.02 KB, 810.02 KB, 810.02 KB, 810.02 KB, 810.02 KB, 810.02 KB, 810.02 KB, 810.02 KB, 810.02 KB, 810.02 KB, 810.02 KB, 810.02 KB, 810.02 KB, 810.02 KB, 810.02 KB, 810.02 KB, 810.02 KB, 810.02 KB, 810.02 KB, 810.02 KB - BytesReceived: 810.02 KB (829462) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 10.973ms - FirstBatchArrivalWaitTime: 902.838ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:3bf (host=vc1508.foo:22000):(Total: 55.530ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 3.36 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.48 MB (3645160) - PerHostPeakMemUsage: 169.57 GB (182072953359) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 898.992ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 55.481ms - ExecTreePrepareTime: 1.119ms DataStreamSender (dst_id=29):(Total: 534.483us, non-child: 534.483us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 158.12 KB (161920) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 331.863ms, non-child: 331.863ms, % non-child: 100.00%) - CodegenTime: 3.007ms - CompileTime: 97.977ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 96 (96) - NumInstructions: 3.85K (3850) - OptimizationTime: 203.126ms - PeakMemoryUsage: 1.88 MB (1971200) - PrepareTime: 30.185ms AGGREGATION_NODE (id=17):(Total: 1.118ms, non-child: 666.462us, % non-child: 59.57%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 147.326us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.34 MB (1409152) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - StreamingTime: 0.000ns - UnpinTime: 0.000ns HASH_JOIN_NODE (id=16):(Total: 452.374us, non-child: 454.464us, % non-child: 100.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 0 (0) - BuildTime: 0.000ns - PeakMemoryUsage: 90.25 KB (92416) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=16): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 0.000ns - BuildRowsPartitioned: 0 (0) - HashBuckets: 0 (0) - HashCollisions: 0 (0) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 9.12 KB (9344) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=28): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=27):(Total: 898.993ms, non-child: 4.075us, % non-child: 0.00%) BytesReceived(16s000ms): 764.94 KB, 816.70 KB, 816.70 KB, 816.70 KB, 816.70 KB, 816.70 KB, 816.70 KB, 816.70 KB, 816.70 KB, 816.70 KB, 816.70 KB, 816.70 KB, 816.70 KB, 816.70 KB, 816.70 KB, 816.70 KB, 816.70 KB, 816.70 KB, 816.70 KB, 816.70 KB, 816.70 KB, 816.70 KB, 816.70 KB, 816.70 KB, 816.70 KB, 816.70 KB, 816.70 KB, 816.70 KB, 816.70 KB, 816.70 KB, 816.70 KB, 816.70 KB, 816.70 KB, 816.70 KB, 816.70 KB, 816.70 KB, 816.70 KB, 816.70 KB, 816.70 KB, 816.70 KB - BytesReceived: 816.70 KB (836297) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 9.610ms - FirstBatchArrivalWaitTime: 898.986ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:381 (host=vd1105.foo:22000):(Total: 55.022ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 3.36 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB ThreadUsage(16s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.48 MB (3646344) - PerHostPeakMemUsage: 169.57 GB (182070840498) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 859.169ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 54.945ms - ExecTreePrepareTime: 1.132ms DataStreamSender (dst_id=29):(Total: 612.175us, non-child: 612.175us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 158.12 KB (161920) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 335.540ms, non-child: 335.540ms, % non-child: 100.00%) - CodegenTime: 2.681ms - CompileTime: 98.329ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 96 (96) - NumInstructions: 3.85K (3850) - OptimizationTime: 205.697ms - PeakMemoryUsage: 1.88 MB (1971200) - PrepareTime: 30.820ms AGGREGATION_NODE (id=17):(Total: 1.131ms, non-child: 718.163us, % non-child: 63.48%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 185.089us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.34 MB (1409152) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - StreamingTime: 0.000ns - UnpinTime: 0.000ns HASH_JOIN_NODE (id=16):(Total: 413.143us, non-child: 415.727us, % non-child: 100.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 0 (0) - BuildTime: 0.000ns - PeakMemoryUsage: 90.25 KB (92416) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=16): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 0.000ns - BuildRowsPartitioned: 0 (0) - HashBuckets: 0 (0) - HashCollisions: 0 (0) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 9.12 KB (9344) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=28): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=27):(Total: 859.170ms, non-child: 5.022us, % non-child: 0.00%) BytesReceived(16s000ms): 739.08 KB, 816.43 KB, 816.43 KB, 816.43 KB, 816.43 KB, 816.43 KB, 816.43 KB, 816.43 KB, 816.43 KB, 816.43 KB, 816.43 KB, 816.43 KB, 816.43 KB, 816.43 KB, 816.43 KB, 816.43 KB, 816.43 KB, 816.43 KB, 816.43 KB, 816.43 KB, 816.43 KB, 816.43 KB, 816.43 KB, 816.43 KB, 816.43 KB, 816.43 KB, 816.43 KB, 816.43 KB, 816.43 KB, 816.43 KB, 816.43 KB, 816.43 KB, 816.43 KB, 816.43 KB, 816.43 KB, 816.43 KB, 816.43 KB, 816.43 KB, 816.43 KB, 816.43 KB - BytesReceived: 816.43 KB (836021) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 10.252ms - FirstBatchArrivalWaitTime: 859.162ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:3ca (host=vc1514.foo:22000):(Total: 54.996ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 3.30 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB ThreadUsage(16s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.49 MB (3657880) - PerHostPeakMemUsage: 169.56 GB (182059706145) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 904.954ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 54.913ms - ExecTreePrepareTime: 1.133ms DataStreamSender (dst_id=29):(Total: 480.629us, non-child: 480.629us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 158.12 KB (161920) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 323.348ms, non-child: 323.348ms, % non-child: 100.00%) - CodegenTime: 4.042ms - CompileTime: 97.022ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 96 (96) - NumInstructions: 3.85K (3850) - OptimizationTime: 195.513ms - PeakMemoryUsage: 1.88 MB (1971200) - PrepareTime: 30.145ms AGGREGATION_NODE (id=17):(Total: 1.132ms, non-child: 769.459us, % non-child: 67.94%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 184.425us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.34 MB (1409152) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - StreamingTime: 0.000ns - UnpinTime: 0.000ns HASH_JOIN_NODE (id=16):(Total: 363.038us, non-child: 365.484us, % non-child: 100.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 0 (0) - BuildTime: 0.000ns - PeakMemoryUsage: 90.25 KB (92416) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=16): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 0.000ns - BuildRowsPartitioned: 0 (0) - HashBuckets: 0 (0) - HashCollisions: 0 (0) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 9.12 KB (9344) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=28): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=27):(Total: 904.955ms, non-child: 18.038us, % non-child: 0.00%) BytesReceived(16s000ms): 743.24 KB, 821.01 KB, 821.01 KB, 821.01 KB, 821.01 KB, 821.01 KB, 821.01 KB, 821.01 KB, 821.01 KB, 821.01 KB, 821.01 KB, 821.01 KB, 821.01 KB, 821.01 KB, 821.01 KB, 821.01 KB, 821.01 KB, 821.01 KB, 821.01 KB, 821.01 KB, 821.01 KB, 821.01 KB, 821.01 KB, 821.01 KB, 821.01 KB, 821.01 KB, 821.01 KB, 821.01 KB, 821.01 KB, 821.01 KB, 821.01 KB, 821.01 KB, 821.01 KB, 821.01 KB, 821.01 KB, 821.01 KB, 821.01 KB, 821.01 KB, 821.01 KB, 821.01 KB - BytesReceived: 821.01 KB (840712) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 10.735ms - FirstBatchArrivalWaitTime: 904.934ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:3c0 (host=vc1527.foo:22000):(Total: 54.996ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 3.34 MB, 3.45 MB, 3.45 MB, 3.45 MB, 3.45 MB, 3.45 MB, 3.45 MB, 3.45 MB, 3.45 MB, 3.45 MB, 3.45 MB, 3.45 MB, 3.45 MB, 3.45 MB, 3.45 MB, 3.45 MB, 3.45 MB, 3.45 MB, 3.45 MB, 3.45 MB, 3.45 MB, 3.45 MB, 3.45 MB, 3.45 MB, 3.45 MB, 3.45 MB, 3.45 MB, 3.45 MB, 3.45 MB, 3.45 MB, 3.45 MB, 3.45 MB, 3.45 MB, 3.45 MB, 3.45 MB, 3.45 MB, 3.45 MB, 3.45 MB, 3.45 MB, 3.45 MB ThreadUsage(16s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.47 MB (3642880) - PerHostPeakMemUsage: 169.56 GB (182068626035) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 909.991ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 54.828ms - ExecTreePrepareTime: 1.119ms DataStreamSender (dst_id=29):(Total: 398.370us, non-child: 398.370us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 158.12 KB (161920) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 329.131ms, non-child: 329.131ms, % non-child: 100.00%) - CodegenTime: 2.685ms - CompileTime: 95.167ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 96 (96) - NumInstructions: 3.85K (3850) - OptimizationTime: 202.903ms - PeakMemoryUsage: 1.88 MB (1971200) - PrepareTime: 30.155ms AGGREGATION_NODE (id=17):(Total: 1.118ms, non-child: 538.572us, % non-child: 48.14%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 157.780us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.34 MB (1409152) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - StreamingTime: 0.000ns - UnpinTime: 0.000ns HASH_JOIN_NODE (id=16):(Total: 580.194us, non-child: 581.773us, % non-child: 100.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 0 (0) - BuildTime: 0.000ns - PeakMemoryUsage: 90.25 KB (92416) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=16): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 0.000ns - BuildRowsPartitioned: 0 (0) - HashBuckets: 0 (0) - HashCollisions: 0 (0) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 9.12 KB (9344) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=28): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=27):(Total: 909.992ms, non-child: 6.334us, % non-child: 0.00%) BytesReceived(16s000ms): 730.91 KB, 807.42 KB, 807.42 KB, 807.42 KB, 807.42 KB, 807.42 KB, 807.42 KB, 807.42 KB, 807.42 KB, 807.42 KB, 807.42 KB, 807.42 KB, 807.42 KB, 807.42 KB, 807.42 KB, 807.42 KB, 807.42 KB, 807.42 KB, 807.42 KB, 807.42 KB, 807.42 KB, 807.42 KB, 807.42 KB, 807.42 KB, 807.42 KB, 807.42 KB, 807.42 KB, 807.42 KB, 807.42 KB, 807.42 KB, 807.42 KB, 807.42 KB, 807.42 KB, 807.42 KB, 807.42 KB, 807.42 KB, 807.42 KB, 807.42 KB, 807.42 KB, 807.42 KB - BytesReceived: 807.42 KB (826795) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 10.550ms - FirstBatchArrivalWaitTime: 909.983ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:3b5 (host=vd1342.foo:22000):(Total: 54.620ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 3.36 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB ThreadUsage(16s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.48 MB (3644018) - PerHostPeakMemUsage: 169.55 GB (182056923792) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 901.909ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 54.575ms - ExecTreePrepareTime: 1.168ms DataStreamSender (dst_id=29):(Total: 565.743us, non-child: 565.743us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 158.12 KB (161920) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 336.196ms, non-child: 336.196ms, % non-child: 100.00%) - CodegenTime: 2.810ms - CompileTime: 97.096ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 96 (96) - NumInstructions: 3.85K (3850) - OptimizationTime: 207.751ms - PeakMemoryUsage: 1.88 MB (1971200) - PrepareTime: 30.711ms AGGREGATION_NODE (id=17):(Total: 1.167ms, non-child: 781.775us, % non-child: 66.97%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 209.485us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.34 MB (1409152) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - StreamingTime: 0.000ns - UnpinTime: 0.000ns HASH_JOIN_NODE (id=16):(Total: 385.522us, non-child: 389.546us, % non-child: 100.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 0 (0) - BuildTime: 0.000ns - PeakMemoryUsage: 90.25 KB (92416) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=16): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 0.000ns - BuildRowsPartitioned: 0 (0) - HashBuckets: 0 (0) - HashCollisions: 0 (0) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 9.12 KB (9344) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=28): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=27):(Total: 901.910ms, non-child: 5.960us, % non-child: 0.00%) BytesReceived(16s000ms): 739.18 KB, 816.53 KB, 816.53 KB, 816.53 KB, 816.53 KB, 816.53 KB, 816.53 KB, 816.53 KB, 816.53 KB, 816.53 KB, 816.53 KB, 816.53 KB, 816.53 KB, 816.53 KB, 816.53 KB, 816.53 KB, 816.53 KB, 816.53 KB, 816.53 KB, 816.53 KB, 816.53 KB, 816.53 KB, 816.53 KB, 816.53 KB, 816.53 KB, 816.53 KB, 816.53 KB, 816.53 KB, 816.53 KB, 816.53 KB, 816.53 KB, 816.53 KB, 816.53 KB, 816.53 KB, 816.53 KB, 816.53 KB, 816.53 KB, 816.53 KB, 816.53 KB, 816.53 KB - BytesReceived: 816.53 KB (836122) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 10.121ms - FirstBatchArrivalWaitTime: 901.901ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:3d4 (host=vd1107.foo:22000):(Total: 54.479ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 3.31 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB ThreadUsage(16s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.49 MB (3659858) - PerHostPeakMemUsage: 169.55 GB (182055448413) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 884.562ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 54.433ms - ExecTreePrepareTime: 1.270ms DataStreamSender (dst_id=29):(Total: 598.886us, non-child: 598.886us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 158.12 KB (161920) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 336.085ms, non-child: 336.085ms, % non-child: 100.00%) - CodegenTime: 3.627ms - CompileTime: 97.252ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 96 (96) - NumInstructions: 3.85K (3850) - OptimizationTime: 209.430ms - PeakMemoryUsage: 1.88 MB (1971200) - PrepareTime: 28.667ms AGGREGATION_NODE (id=17):(Total: 1.269ms, non-child: 848.991us, % non-child: 66.88%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 231.435us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.34 MB (1409152) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - StreamingTime: 0.000ns - UnpinTime: 0.000ns HASH_JOIN_NODE (id=16):(Total: 420.464us, non-child: 422.720us, % non-child: 100.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 0 (0) - BuildTime: 0.000ns - PeakMemoryUsage: 90.25 KB (92416) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=16): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 0.000ns - BuildRowsPartitioned: 0 (0) - HashBuckets: 0 (0) - HashCollisions: 0 (0) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 9.12 KB (9344) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=28): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=27):(Total: 884.563ms, non-child: 8.622us, % non-child: 0.00%) BytesReceived(16s000ms): 743.72 KB, 821.55 KB, 821.55 KB, 821.55 KB, 821.55 KB, 821.55 KB, 821.55 KB, 821.55 KB, 821.55 KB, 821.55 KB, 821.55 KB, 821.55 KB, 821.55 KB, 821.55 KB, 821.55 KB, 821.55 KB, 821.55 KB, 821.55 KB, 821.55 KB, 821.55 KB, 821.55 KB, 821.55 KB, 821.55 KB, 821.55 KB, 821.55 KB, 821.55 KB, 821.55 KB, 821.55 KB, 821.55 KB, 821.55 KB, 821.55 KB, 821.55 KB, 821.55 KB, 821.55 KB, 821.55 KB, 821.55 KB, 821.55 KB, 821.55 KB, 821.55 KB, 821.55 KB - BytesReceived: 821.55 KB (841270) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 11.278ms - FirstBatchArrivalWaitTime: 884.552ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:396 (host=vd1139.foo:22000):(Total: 54.111ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 3.29 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB ThreadUsage(16s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.47 MB (3642880) - PerHostPeakMemUsage: 169.56 GB (182064187763) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 880.081ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 54.066ms - ExecTreePrepareTime: 1.030ms DataStreamSender (dst_id=29):(Total: 532.320us, non-child: 532.320us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 158.12 KB (161920) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 348.202ms, non-child: 348.202ms, % non-child: 100.00%) - CodegenTime: 2.716ms - CompileTime: 101.138ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 96 (96) - NumInstructions: 3.85K (3850) - OptimizationTime: 216.366ms - PeakMemoryUsage: 1.88 MB (1971200) - PrepareTime: 29.811ms AGGREGATION_NODE (id=17):(Total: 1.029ms, non-child: 633.264us, % non-child: 61.52%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 119.842us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.34 MB (1409152) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - StreamingTime: 0.000ns - UnpinTime: 0.000ns HASH_JOIN_NODE (id=16):(Total: 396.087us, non-child: 398.405us, % non-child: 100.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 0 (0) - BuildTime: 0.000ns - PeakMemoryUsage: 90.25 KB (92416) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=16): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 0.000ns - BuildRowsPartitioned: 0 (0) - HashBuckets: 0 (0) - HashCollisions: 0 (0) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 9.12 KB (9344) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=28): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=27):(Total: 880.082ms, non-child: 5.658us, % non-child: 0.00%) BytesReceived(16s000ms): 736.06 KB, 813.07 KB, 813.07 KB, 813.07 KB, 813.07 KB, 813.07 KB, 813.07 KB, 813.07 KB, 813.07 KB, 813.07 KB, 813.07 KB, 813.07 KB, 813.07 KB, 813.07 KB, 813.07 KB, 813.07 KB, 813.07 KB, 813.07 KB, 813.07 KB, 813.07 KB, 813.07 KB, 813.07 KB, 813.07 KB, 813.07 KB, 813.07 KB, 813.07 KB, 813.07 KB, 813.07 KB, 813.07 KB, 813.07 KB, 813.07 KB, 813.07 KB, 813.07 KB, 813.07 KB, 813.07 KB, 813.07 KB, 813.07 KB, 813.07 KB, 813.07 KB, 813.07 KB - BytesReceived: 813.07 KB (832583) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 9.022ms - FirstBatchArrivalWaitTime: 880.074ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:3c7 (host=vc1513.foo:22000):(Total: 54.102ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 3.31 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB ThreadUsage(16s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.48 MB (3647553) - PerHostPeakMemUsage: 169.55 GB (182057389143) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 894.895ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 54.054ms - ExecTreePrepareTime: 1.104ms DataStreamSender (dst_id=29):(Total: 576.862us, non-child: 576.862us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 158.12 KB (161920) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 334.874ms, non-child: 334.874ms, % non-child: 100.00%) - CodegenTime: 3.222ms - CompileTime: 94.004ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 96 (96) - NumInstructions: 3.85K (3850) - OptimizationTime: 209.294ms - PeakMemoryUsage: 1.88 MB (1971200) - PrepareTime: 30.970ms AGGREGATION_NODE (id=17):(Total: 1.103ms, non-child: 685.874us, % non-child: 62.13%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 175.600us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.34 MB (1409152) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - StreamingTime: 0.000ns - UnpinTime: 0.000ns HASH_JOIN_NODE (id=16):(Total: 418.004us, non-child: 421.681us, % non-child: 100.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 0 (0) - BuildTime: 0.000ns - PeakMemoryUsage: 90.25 KB (92416) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=16): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 0.000ns - BuildRowsPartitioned: 0 (0) - HashBuckets: 0 (0) - HashCollisions: 0 (0) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 9.12 KB (9344) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=28): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=27):(Total: 894.896ms, non-child: 4.310us, % non-child: 0.00%) BytesReceived(16s000ms): 745.58 KB, 817.05 KB, 817.05 KB, 817.05 KB, 817.05 KB, 817.05 KB, 817.05 KB, 817.05 KB, 817.05 KB, 817.05 KB, 817.05 KB, 817.05 KB, 817.05 KB, 817.05 KB, 817.05 KB, 817.05 KB, 817.05 KB, 817.05 KB, 817.05 KB, 817.05 KB, 817.05 KB, 817.05 KB, 817.05 KB, 817.05 KB, 817.05 KB, 817.05 KB, 817.05 KB, 817.05 KB, 817.05 KB, 817.05 KB, 817.05 KB, 817.05 KB, 817.05 KB, 817.05 KB, 817.05 KB, 817.05 KB, 817.05 KB, 817.05 KB, 817.05 KB, 817.05 KB - BytesReceived: 817.05 KB (836657) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 9.530ms - FirstBatchArrivalWaitTime: 894.890ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:3b7 (host=vc1542.foo:22000):(Total: 54.076ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 3.34 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB ThreadUsage(16s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.47 MB (3642880) - PerHostPeakMemUsage: 169.57 GB (182073432523) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 895.778ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 54.016ms - ExecTreePrepareTime: 1.127ms DataStreamSender (dst_id=29):(Total: 617.268us, non-child: 617.268us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 158.12 KB (161920) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 337.697ms, non-child: 337.697ms, % non-child: 100.00%) - CodegenTime: 2.977ms - CompileTime: 98.580ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 96 (96) - NumInstructions: 3.85K (3850) - OptimizationTime: 209.187ms - PeakMemoryUsage: 1.88 MB (1971200) - PrepareTime: 29.184ms AGGREGATION_NODE (id=17):(Total: 1.126ms, non-child: 731.449us, % non-child: 64.92%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 174.502us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.34 MB (1409152) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - StreamingTime: 0.000ns - UnpinTime: 0.000ns HASH_JOIN_NODE (id=16):(Total: 395.295us, non-child: 398.640us, % non-child: 100.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 0 (0) - BuildTime: 0.000ns - PeakMemoryUsage: 90.25 KB (92416) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=16): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 0.000ns - BuildRowsPartitioned: 0 (0) - HashBuckets: 0 (0) - HashCollisions: 0 (0) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 9.12 KB (9344) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=28): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=27):(Total: 895.778ms, non-child: 4.638us, % non-child: 0.00%) BytesReceived(16s000ms): 733.06 KB, 809.80 KB, 809.80 KB, 809.80 KB, 809.80 KB, 809.80 KB, 809.80 KB, 809.80 KB, 809.80 KB, 809.80 KB, 809.80 KB, 809.80 KB, 809.80 KB, 809.80 KB, 809.80 KB, 809.80 KB, 809.80 KB, 809.80 KB, 809.80 KB, 809.80 KB, 809.80 KB, 809.80 KB, 809.80 KB, 809.80 KB, 809.80 KB, 809.80 KB, 809.80 KB, 809.80 KB, 809.80 KB, 809.80 KB, 809.80 KB, 809.80 KB, 809.80 KB, 809.80 KB, 809.80 KB, 809.80 KB, 809.80 KB, 809.80 KB, 809.80 KB, 809.80 KB - BytesReceived: 809.80 KB (829237) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 9.184ms - FirstBatchArrivalWaitTime: 895.771ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:3ce (host=vd1329.foo:22000):(Total: 53.961ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 3.37 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB ThreadUsage(16s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.49 MB (3657704) - PerHostPeakMemUsage: 169.58 GB (182081170998) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 908.977ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 53.924ms - ExecTreePrepareTime: 966.112us DataStreamSender (dst_id=29):(Total: 475.779us, non-child: 475.779us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 158.12 KB (161920) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 313.519ms, non-child: 313.519ms, % non-child: 100.00%) - CodegenTime: 3.259ms - CompileTime: 91.993ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 96 (96) - NumInstructions: 3.85K (3850) - OptimizationTime: 191.996ms - PeakMemoryUsage: 1.88 MB (1971200) - PrepareTime: 28.889ms AGGREGATION_NODE (id=17):(Total: 965.186us, non-child: 622.514us, % non-child: 64.50%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 135.046us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.34 MB (1409152) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - StreamingTime: 0.000ns - UnpinTime: 0.000ns HASH_JOIN_NODE (id=16):(Total: 342.672us, non-child: 345.428us, % non-child: 100.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 0 (0) - BuildTime: 0.000ns - PeakMemoryUsage: 90.25 KB (92416) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=16): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 0.000ns - BuildRowsPartitioned: 0 (0) - HashBuckets: 0 (0) - HashCollisions: 0 (0) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 9.12 KB (9344) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=28): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=27):(Total: 908.978ms, non-child: 4.845us, % non-child: 0.00%) BytesReceived(16s000ms): 743.08 KB, 820.82 KB, 820.82 KB, 820.82 KB, 820.82 KB, 820.82 KB, 820.82 KB, 820.82 KB, 820.82 KB, 820.82 KB, 820.82 KB, 820.82 KB, 820.82 KB, 820.82 KB, 820.82 KB, 820.82 KB, 820.82 KB, 820.82 KB, 820.82 KB, 820.82 KB, 820.82 KB, 820.82 KB, 820.82 KB, 820.82 KB, 820.82 KB, 820.82 KB, 820.82 KB, 820.82 KB, 820.82 KB, 820.82 KB, 820.82 KB, 820.82 KB, 820.82 KB, 820.82 KB, 820.82 KB, 820.82 KB, 820.82 KB, 820.82 KB, 820.82 KB, 820.82 KB - BytesReceived: 820.82 KB (840516) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 10.081ms - FirstBatchArrivalWaitTime: 908.970ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:3cd (host=vd1332.foo:22000):(Total: 53.793ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 3.37 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.49 MB (3661660) - PerHostPeakMemUsage: 169.55 GB (182049888199) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 886.940ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 53.747ms - ExecTreePrepareTime: 1.295ms DataStreamSender (dst_id=29):(Total: 473.133us, non-child: 473.133us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 158.12 KB (161920) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 345.376ms, non-child: 345.376ms, % non-child: 100.00%) - CodegenTime: 2.516ms - CompileTime: 99.234ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 96 (96) - NumInstructions: 3.85K (3850) - OptimizationTime: 214.487ms - PeakMemoryUsage: 1.88 MB (1971200) - PrepareTime: 30.681ms AGGREGATION_NODE (id=17):(Total: 1.294ms, non-child: 959.818us, % non-child: 74.16%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 303.520us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.34 MB (1409152) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - StreamingTime: 0.000ns - UnpinTime: 0.000ns HASH_JOIN_NODE (id=16):(Total: 334.397us, non-child: 339.743us, % non-child: 100.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 0 (0) - BuildTime: 0.000ns - PeakMemoryUsage: 90.25 KB (92416) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=16): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 0.000ns - BuildRowsPartitioned: 0 (0) - HashBuckets: 0 (0) - HashCollisions: 0 (0) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 9.12 KB (9344) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=28): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=27):(Total: 886.941ms, non-child: 4.383us, % non-child: 0.00%) BytesReceived(16s000ms): 769.20 KB, 822.54 KB, 822.54 KB, 822.54 KB, 822.54 KB, 822.54 KB, 822.54 KB, 822.54 KB, 822.54 KB, 822.54 KB, 822.54 KB, 822.54 KB, 822.54 KB, 822.54 KB, 822.54 KB, 822.54 KB, 822.54 KB, 822.54 KB, 822.54 KB, 822.54 KB, 822.54 KB, 822.54 KB, 822.54 KB, 822.54 KB, 822.54 KB, 822.54 KB, 822.54 KB, 822.54 KB, 822.54 KB, 822.54 KB, 822.54 KB, 822.54 KB, 822.54 KB, 822.54 KB, 822.54 KB, 822.54 KB, 822.54 KB, 822.54 KB, 822.54 KB, 822.54 KB - BytesReceived: 822.54 KB (842278) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 9.991ms - FirstBatchArrivalWaitTime: 886.934ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:3a0 (host=vc1540.foo:22000):(Total: 53.718ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 3.37 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.49 MB (3662869) - PerHostPeakMemUsage: 169.58 GB (182081361196) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 885.561ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 53.669ms - ExecTreePrepareTime: 1.112ms DataStreamSender (dst_id=29):(Total: 637.829us, non-child: 637.829us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 158.12 KB (161920) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 351.084ms, non-child: 351.084ms, % non-child: 100.00%) - CodegenTime: 3.014ms - CompileTime: 102.315ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 96 (96) - NumInstructions: 3.85K (3850) - OptimizationTime: 217.858ms - PeakMemoryUsage: 1.88 MB (1971200) - PrepareTime: 30.267ms AGGREGATION_NODE (id=17):(Total: 1.111ms, non-child: 701.072us, % non-child: 63.09%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 177.892us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.34 MB (1409152) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - StreamingTime: 0.000ns - UnpinTime: 0.000ns HASH_JOIN_NODE (id=16):(Total: 410.164us, non-child: 414.411us, % non-child: 100.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 0 (0) - BuildTime: 0.000ns - PeakMemoryUsage: 90.25 KB (92416) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=16): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 0.000ns - BuildRowsPartitioned: 0 (0) - HashBuckets: 0 (0) - HashCollisions: 0 (0) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 9.12 KB (9344) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=28): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=27):(Total: 885.562ms, non-child: 3.315us, % non-child: 0.00%) BytesReceived(16s000ms): 770.07 KB, 822.31 KB, 822.31 KB, 822.31 KB, 822.31 KB, 822.31 KB, 822.31 KB, 822.31 KB, 822.31 KB, 822.31 KB, 822.31 KB, 822.31 KB, 822.31 KB, 822.31 KB, 822.31 KB, 822.31 KB, 822.31 KB, 822.31 KB, 822.31 KB, 822.31 KB, 822.31 KB, 822.31 KB, 822.31 KB, 822.31 KB, 822.31 KB, 822.31 KB, 822.31 KB, 822.31 KB, 822.31 KB, 822.31 KB, 822.31 KB, 822.31 KB, 822.31 KB, 822.31 KB, 822.31 KB, 822.31 KB, 822.31 KB, 822.31 KB, 822.31 KB, 822.31 KB - BytesReceived: 822.31 KB (842047) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 23.475ms - FirstBatchArrivalWaitTime: 885.557ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:39b (host=va1029.foo:22000):(Total: 53.524ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 3.35 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.47 MB (3642880) - PerHostPeakMemUsage: 169.56 GB (182062110817) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 865.641ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 53.396ms - ExecTreePrepareTime: 1.578ms DataStreamSender (dst_id=29):(Total: 479.146us, non-child: 479.146us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 158.12 KB (161920) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 369.782ms, non-child: 369.782ms, % non-child: 100.00%) - CodegenTime: 2.459ms - CompileTime: 116.381ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 96 (96) - NumInstructions: 3.85K (3850) - OptimizationTime: 223.963ms - PeakMemoryUsage: 1.88 MB (1971200) - PrepareTime: 28.671ms AGGREGATION_NODE (id=17):(Total: 1.577ms, non-child: 583.298us, % non-child: 36.98%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 131.827us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.34 MB (1409152) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - StreamingTime: 0.000ns - UnpinTime: 0.000ns HASH_JOIN_NODE (id=16):(Total: 994.130us, non-child: 995.064us, % non-child: 100.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 0 (0) - BuildTime: 0.000ns - PeakMemoryUsage: 90.25 KB (92416) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=16): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 0.000ns - BuildRowsPartitioned: 0 (0) - HashBuckets: 0 (0) - HashCollisions: 0 (0) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 9.12 KB (9344) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=28): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=27):(Total: 865.642ms, non-child: 4.066us, % non-child: 0.00%) BytesReceived(16s000ms): 759.54 KB, 810.98 KB, 810.98 KB, 810.98 KB, 810.98 KB, 810.98 KB, 810.98 KB, 810.98 KB, 810.98 KB, 810.98 KB, 810.98 KB, 810.98 KB, 810.98 KB, 810.98 KB, 810.98 KB, 810.98 KB, 810.98 KB, 810.98 KB, 810.98 KB, 810.98 KB, 810.98 KB, 810.98 KB, 810.98 KB, 810.98 KB, 810.98 KB, 810.98 KB, 810.98 KB, 810.98 KB, 810.98 KB, 810.98 KB, 810.98 KB, 810.98 KB, 810.98 KB, 810.98 KB, 810.98 KB, 810.98 KB, 810.98 KB, 810.98 KB, 810.98 KB, 810.98 KB - BytesReceived: 810.98 KB (830441) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 9.802ms - FirstBatchArrivalWaitTime: 865.636ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:3b8 (host=vd1339.foo:22000):(Total: 53.504ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 3.36 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.48 MB (3649536) - PerHostPeakMemUsage: 169.57 GB (182074821441) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 903.390ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 53.436ms - ExecTreePrepareTime: 1.104ms DataStreamSender (dst_id=29):(Total: 462.828us, non-child: 462.828us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 158.12 KB (161920) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 326.415ms, non-child: 326.415ms, % non-child: 100.00%) - CodegenTime: 2.433ms - CompileTime: 94.616ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 96 (96) - NumInstructions: 3.85K (3850) - OptimizationTime: 202.563ms - PeakMemoryUsage: 1.88 MB (1971200) - PrepareTime: 28.557ms AGGREGATION_NODE (id=17):(Total: 1.104ms, non-child: 737.476us, % non-child: 66.80%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 198.850us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.34 MB (1409152) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - StreamingTime: 0.000ns - UnpinTime: 0.000ns HASH_JOIN_NODE (id=16):(Total: 366.524us, non-child: 368.471us, % non-child: 100.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 0 (0) - BuildTime: 0.000ns - PeakMemoryUsage: 90.25 KB (92416) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=16): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 0.000ns - BuildRowsPartitioned: 0 (0) - HashBuckets: 0 (0) - HashCollisions: 0 (0) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 9.12 KB (9344) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=28): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=27):(Total: 903.390ms, non-child: 3.542us, % non-child: 0.00%) BytesReceived(16s000ms): 765.38 KB, 817.25 KB, 817.25 KB, 817.25 KB, 817.25 KB, 817.25 KB, 817.25 KB, 817.25 KB, 817.25 KB, 817.25 KB, 817.25 KB, 817.25 KB, 817.25 KB, 817.25 KB, 817.25 KB, 817.25 KB, 817.25 KB, 817.25 KB, 817.25 KB, 817.25 KB, 817.25 KB, 817.25 KB, 817.25 KB, 817.25 KB, 817.25 KB, 817.25 KB, 817.25 KB, 817.25 KB, 817.25 KB, 817.25 KB, 817.25 KB, 817.25 KB, 817.25 KB, 817.25 KB, 817.25 KB, 817.25 KB, 817.25 KB, 817.25 KB, 817.25 KB, 817.25 KB - BytesReceived: 817.25 KB (836861) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 11.231ms - FirstBatchArrivalWaitTime: 903.385ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:3b1 (host=vd1101.foo:22000):(Total: 53.461ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 3.31 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB ThreadUsage(16s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.49 MB (3663706) - PerHostPeakMemUsage: 169.56 GB (182059540873) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 899.685ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 53.343ms - ExecTreePrepareTime: 1.111ms DataStreamSender (dst_id=29):(Total: 552.427us, non-child: 552.427us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 158.12 KB (161920) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 333.070ms, non-child: 333.070ms, % non-child: 100.00%) - CodegenTime: 3.297ms - CompileTime: 101.638ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 96 (96) - NumInstructions: 3.85K (3850) - OptimizationTime: 201.962ms - PeakMemoryUsage: 1.88 MB (1971200) - PrepareTime: 28.668ms AGGREGATION_NODE (id=17):(Total: 1.109ms, non-child: 718.102us, % non-child: 64.73%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 125.981us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.34 MB (1409152) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - StreamingTime: 0.000ns - UnpinTime: 0.000ns HASH_JOIN_NODE (id=16):(Total: 391.194us, non-child: 395.155us, % non-child: 100.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 0 (0) - BuildTime: 0.000ns - PeakMemoryUsage: 90.25 KB (92416) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=16): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 0.000ns - BuildRowsPartitioned: 0 (0) - HashBuckets: 0 (0) - HashCollisions: 0 (0) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 9.12 KB (9344) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=28): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=27):(Total: 899.686ms, non-child: 6.857us, % non-child: 0.00%) BytesReceived(16s000ms): 745.66 KB, 823.67 KB, 823.67 KB, 823.67 KB, 823.67 KB, 823.67 KB, 823.67 KB, 823.67 KB, 823.67 KB, 823.67 KB, 823.67 KB, 823.67 KB, 823.67 KB, 823.67 KB, 823.67 KB, 823.67 KB, 823.67 KB, 823.67 KB, 823.67 KB, 823.67 KB, 823.67 KB, 823.67 KB, 823.67 KB, 823.67 KB, 823.67 KB, 823.67 KB, 823.67 KB, 823.67 KB, 823.67 KB, 823.67 KB, 823.67 KB, 823.67 KB, 823.67 KB, 823.67 KB, 823.67 KB, 823.67 KB, 823.67 KB, 823.67 KB, 823.67 KB, 823.67 KB - BytesReceived: 823.67 KB (843442) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 9.110ms - FirstBatchArrivalWaitTime: 899.677ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:3c2 (host=va1028.foo:22000):(Total: 53.129ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 3.37 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB ThreadUsage(16s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.49 MB (3654777) - PerHostPeakMemUsage: 169.57 GB (182070306136) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 906.806ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 53.092ms - ExecTreePrepareTime: 646.107us DataStreamSender (dst_id=29):(Total: 533.352us, non-child: 533.352us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 158.12 KB (161920) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 320.223ms, non-child: 320.223ms, % non-child: 100.00%) - CodegenTime: 3.216ms - CompileTime: 94.828ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 96 (96) - NumInstructions: 3.85K (3850) - OptimizationTime: 196.991ms - PeakMemoryUsage: 1.88 MB (1971200) - PrepareTime: 27.512ms AGGREGATION_NODE (id=17):(Total: 645.743us, non-child: 455.996us, % non-child: 70.62%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 102.896us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.34 MB (1409152) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - StreamingTime: 0.000ns - UnpinTime: 0.000ns HASH_JOIN_NODE (id=16):(Total: 189.747us, non-child: 193.570us, % non-child: 100.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 0 (0) - BuildTime: 0.000ns - PeakMemoryUsage: 90.25 KB (92416) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=16): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 0.000ns - BuildRowsPartitioned: 0 (0) - HashBuckets: 0 (0) - HashCollisions: 0 (0) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 9.12 KB (9344) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=28): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=27):(Total: 906.807ms, non-child: 4.387us, % non-child: 0.00%) BytesReceived(16s000ms): 743.45 KB, 821.00 KB, 821.00 KB, 821.00 KB, 821.00 KB, 821.00 KB, 821.00 KB, 821.00 KB, 821.00 KB, 821.00 KB, 821.00 KB, 821.00 KB, 821.00 KB, 821.00 KB, 821.00 KB, 821.00 KB, 821.00 KB, 821.00 KB, 821.00 KB, 821.00 KB, 821.00 KB, 821.00 KB, 821.00 KB, 821.00 KB, 821.00 KB, 821.00 KB, 821.00 KB, 821.00 KB, 821.00 KB, 821.00 KB, 821.00 KB, 821.00 KB, 821.00 KB, 821.00 KB, 821.00 KB, 821.00 KB, 821.00 KB, 821.00 KB, 821.00 KB, 821.00 KB - BytesReceived: 821.00 KB (840709) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 10.870ms - FirstBatchArrivalWaitTime: 906.800ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:3a8 (host=va1037.foo:22000):(Total: 52.808ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 3.36 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.50 MB (3665802) - PerHostPeakMemUsage: 169.56 GB (182068666281) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 931.543ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 52.763ms - ExecTreePrepareTime: 1.022ms DataStreamSender (dst_id=29):(Total: 483.483us, non-child: 483.483us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 158.12 KB (161920) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 310.037ms, non-child: 310.037ms, % non-child: 100.00%) - CodegenTime: 2.430ms - CompileTime: 91.884ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 96 (96) - NumInstructions: 3.85K (3850) - OptimizationTime: 191.012ms - PeakMemoryUsage: 1.88 MB (1971200) - PrepareTime: 26.624ms AGGREGATION_NODE (id=17):(Total: 1.021ms, non-child: 672.693us, % non-child: 65.85%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 167.932us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.34 MB (1409152) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - StreamingTime: 0.000ns - UnpinTime: 0.000ns HASH_JOIN_NODE (id=16):(Total: 348.860us, non-child: 352.101us, % non-child: 100.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 0 (0) - BuildTime: 0.000ns - PeakMemoryUsage: 90.25 KB (92416) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=16): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 0.000ns - BuildRowsPartitioned: 0 (0) - HashBuckets: 0 (0) - HashCollisions: 0 (0) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 9.12 KB (9344) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=28): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=27):(Total: 931.543ms, non-child: 3.823us, % non-child: 0.00%) BytesReceived(16s000ms): 766.72 KB, 824.20 KB, 824.20 KB, 824.20 KB, 824.20 KB, 824.20 KB, 824.20 KB, 824.20 KB, 824.20 KB, 824.20 KB, 824.20 KB, 824.20 KB, 824.20 KB, 824.20 KB, 824.20 KB, 824.20 KB, 824.20 KB, 824.20 KB, 824.20 KB, 824.20 KB, 824.20 KB, 824.20 KB, 824.20 KB, 824.20 KB, 824.20 KB, 824.20 KB, 824.20 KB, 824.20 KB, 824.20 KB, 824.20 KB, 824.20 KB, 824.20 KB, 824.20 KB, 824.20 KB, 824.20 KB, 824.20 KB, 824.20 KB, 824.20 KB, 824.20 KB, 824.20 KB - BytesReceived: 824.20 KB (843983) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 9.711ms - FirstBatchArrivalWaitTime: 931.536ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:3d9 (host=vd1108.foo:22000):(Total: 52.430ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 3.35 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB ThreadUsage(16s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.47 MB (3642880) - PerHostPeakMemUsage: 169.56 GB (182065411723) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 893.531ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 52.384ms - ExecTreePrepareTime: 1.094ms DataStreamSender (dst_id=29):(Total: 570.246us, non-child: 570.246us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 158.12 KB (161920) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 332.267ms, non-child: 332.267ms, % non-child: 100.00%) - CodegenTime: 3.677ms - CompileTime: 101.311ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 96 (96) - NumInstructions: 3.85K (3850) - OptimizationTime: 202.240ms - PeakMemoryUsage: 1.88 MB (1971200) - PrepareTime: 27.953ms AGGREGATION_NODE (id=17):(Total: 1.093ms, non-child: 685.075us, % non-child: 62.63%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 159.970us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.34 MB (1409152) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - StreamingTime: 0.000ns - UnpinTime: 0.000ns HASH_JOIN_NODE (id=16):(Total: 408.696us, non-child: 410.685us, % non-child: 100.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 0 (0) - BuildTime: 0.000ns - PeakMemoryUsage: 90.25 KB (92416) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=16): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 0.000ns - BuildRowsPartitioned: 0 (0) - HashBuckets: 0 (0) - HashCollisions: 0 (0) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 9.12 KB (9344) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=28): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=27):(Total: 893.532ms, non-child: 4.169us, % non-child: 0.00%) BytesReceived(16s000ms): 738.27 KB, 815.56 KB, 815.56 KB, 815.56 KB, 815.56 KB, 815.56 KB, 815.56 KB, 815.56 KB, 815.56 KB, 815.56 KB, 815.56 KB, 815.56 KB, 815.56 KB, 815.56 KB, 815.56 KB, 815.56 KB, 815.56 KB, 815.56 KB, 815.56 KB, 815.56 KB, 815.56 KB, 815.56 KB, 815.56 KB, 815.56 KB, 815.56 KB, 815.56 KB, 815.56 KB, 815.56 KB, 815.56 KB, 815.56 KB, 815.56 KB, 815.56 KB, 815.56 KB, 815.56 KB, 815.56 KB, 815.56 KB, 815.56 KB, 815.56 KB, 815.56 KB, 815.56 KB - BytesReceived: 815.56 KB (835131) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 9.759ms - FirstBatchArrivalWaitTime: 893.526ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:3b6 (host=va1035.foo:22000):(Total: 51.887ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 3.32 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.47 MB (3642880) - PerHostPeakMemUsage: 169.56 GB (182068743403) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 930.238ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 51.849ms - ExecTreePrepareTime: 847.466us DataStreamSender (dst_id=29):(Total: 497.825us, non-child: 497.825us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 158.12 KB (161920) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 312.863ms, non-child: 312.863ms, % non-child: 100.00%) - CodegenTime: 2.280ms - CompileTime: 92.648ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 96 (96) - NumInstructions: 3.85K (3850) - OptimizationTime: 190.859ms - PeakMemoryUsage: 1.88 MB (1971200) - PrepareTime: 28.889ms AGGREGATION_NODE (id=17):(Total: 846.615us, non-child: 585.946us, % non-child: 69.21%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 115.727us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.34 MB (1409152) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - StreamingTime: 0.000ns - UnpinTime: 0.000ns HASH_JOIN_NODE (id=16):(Total: 260.668us, non-child: 262.904us, % non-child: 100.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 0 (0) - BuildTime: 0.000ns - PeakMemoryUsage: 90.25 KB (92416) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=16): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 0.000ns - BuildRowsPartitioned: 0 (0) - HashBuckets: 0 (0) - HashCollisions: 0 (0) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 9.12 KB (9344) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=28): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=27):(Total: 930.239ms, non-child: 4.132us, % non-child: 0.00%) BytesReceived(16s000ms): 750.81 KB, 809.93 KB, 809.93 KB, 809.93 KB, 809.93 KB, 809.93 KB, 809.93 KB, 809.93 KB, 809.93 KB, 809.93 KB, 809.93 KB, 809.93 KB, 809.93 KB, 809.93 KB, 809.93 KB, 809.93 KB, 809.93 KB, 809.93 KB, 809.93 KB, 809.93 KB, 809.93 KB, 809.93 KB, 809.93 KB, 809.93 KB, 809.93 KB, 809.93 KB, 809.93 KB, 809.93 KB, 809.93 KB, 809.93 KB, 809.93 KB, 809.93 KB, 809.93 KB, 809.93 KB, 809.93 KB, 809.93 KB, 809.93 KB, 809.93 KB, 809.93 KB, 809.93 KB - BytesReceived: 809.93 KB (829368) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 9.966ms - FirstBatchArrivalWaitTime: 930.232ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:380 (host=vc1520.foo:22000):(Total: 51.861ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 3.36 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.48 MB (3650571) - PerHostPeakMemUsage: 169.57 GB (182072367876) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 865.574ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 51.836ms - ExecTreePrepareTime: 947.869us DataStreamSender (dst_id=29):(Total: 449.634us, non-child: 449.634us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 158.12 KB (161920) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 326.974ms, non-child: 326.974ms, % non-child: 100.00%) - CodegenTime: 2.191ms - CompileTime: 97.383ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 96 (96) - NumInstructions: 3.85K (3850) - OptimizationTime: 201.964ms - PeakMemoryUsage: 1.88 MB (1971200) - PrepareTime: 26.924ms AGGREGATION_NODE (id=17):(Total: 947.263us, non-child: 740.022us, % non-child: 78.12%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 128.494us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.34 MB (1409152) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - StreamingTime: 0.000ns - UnpinTime: 0.000ns HASH_JOIN_NODE (id=16):(Total: 207.241us, non-child: 212.452us, % non-child: 100.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 0 (0) - BuildTime: 0.000ns - PeakMemoryUsage: 90.25 KB (92416) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=16): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 0.000ns - BuildRowsPartitioned: 0 (0) - HashBuckets: 0 (0) - HashCollisions: 0 (0) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 9.12 KB (9344) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=28): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=27):(Total: 865.575ms, non-child: 6.807us, % non-child: 0.00%) BytesReceived(16s000ms): 766.31 KB, 818.20 KB, 818.20 KB, 818.20 KB, 818.20 KB, 818.20 KB, 818.20 KB, 818.20 KB, 818.20 KB, 818.20 KB, 818.20 KB, 818.20 KB, 818.20 KB, 818.20 KB, 818.20 KB, 818.20 KB, 818.20 KB, 818.20 KB, 818.20 KB, 818.20 KB, 818.20 KB, 818.20 KB, 818.20 KB, 818.20 KB, 818.20 KB, 818.20 KB, 818.20 KB, 818.20 KB, 818.20 KB, 818.20 KB, 818.20 KB, 818.20 KB, 818.20 KB, 818.20 KB, 818.20 KB, 818.20 KB, 818.20 KB, 818.20 KB, 818.20 KB, 818.20 KB - BytesReceived: 818.20 KB (837834) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 9.032ms - FirstBatchArrivalWaitTime: 865.566ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:376 (host=vd1131.foo:22000):(Total: 51.642ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 3.36 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.48 MB (3644649) - PerHostPeakMemUsage: 169.56 GB (182064558770) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 859.876ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 51.559ms - ExecTreePrepareTime: 1.209ms DataStreamSender (dst_id=29):(Total: 597.748us, non-child: 597.748us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 158.12 KB (161920) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 323.199ms, non-child: 323.199ms, % non-child: 100.00%) - CodegenTime: 2.595ms - CompileTime: 96.887ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 96 (96) - NumInstructions: 3.85K (3850) - OptimizationTime: 196.911ms - PeakMemoryUsage: 1.88 MB (1971200) - PrepareTime: 28.535ms AGGREGATION_NODE (id=17):(Total: 1.208ms, non-child: 691.581us, % non-child: 57.21%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 235.537us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.34 MB (1409152) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - StreamingTime: 0.000ns - UnpinTime: 0.000ns HASH_JOIN_NODE (id=16):(Total: 517.366us, non-child: 521.469us, % non-child: 100.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 0 (0) - BuildTime: 0.000ns - PeakMemoryUsage: 90.25 KB (92416) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=16): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 0.000ns - BuildRowsPartitioned: 0 (0) - HashBuckets: 0 (0) - HashCollisions: 0 (0) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 9.12 KB (9344) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=28): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=27):(Total: 859.877ms, non-child: 5.046us, % non-child: 0.00%) BytesReceived(16s000ms): 763.68 KB, 815.85 KB, 815.85 KB, 815.85 KB, 815.85 KB, 815.85 KB, 815.85 KB, 815.85 KB, 815.85 KB, 815.85 KB, 815.85 KB, 815.85 KB, 815.85 KB, 815.85 KB, 815.85 KB, 815.85 KB, 815.85 KB, 815.85 KB, 815.85 KB, 815.85 KB, 815.85 KB, 815.85 KB, 815.85 KB, 815.85 KB, 815.85 KB, 815.85 KB, 815.85 KB, 815.85 KB, 815.85 KB, 815.85 KB, 815.85 KB, 815.85 KB, 815.85 KB, 815.85 KB, 815.85 KB, 815.85 KB, 815.85 KB, 815.85 KB, 815.85 KB, 815.85 KB - BytesReceived: 815.85 KB (835431) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 10.229ms - FirstBatchArrivalWaitTime: 859.869ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:385 (host=vc1530.foo:22000):(Total: 51.361ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 3.37 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.49 MB (3662086) - PerHostPeakMemUsage: 169.56 GB (182062118557) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 878.420ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 51.311ms - ExecTreePrepareTime: 679.006us DataStreamSender (dst_id=29):(Total: 400.240us, non-child: 400.240us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 158.12 KB (161920) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 325.930ms, non-child: 325.930ms, % non-child: 100.00%) - CodegenTime: 3.842ms - CompileTime: 98.434ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 96 (96) - NumInstructions: 3.85K (3850) - OptimizationTime: 199.463ms - PeakMemoryUsage: 1.88 MB (1971200) - PrepareTime: 27.204ms AGGREGATION_NODE (id=17):(Total: 678.671us, non-child: 400.847us, % non-child: 59.06%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 76.119us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.34 MB (1409152) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - StreamingTime: 0.000ns - UnpinTime: 0.000ns HASH_JOIN_NODE (id=16):(Total: 277.824us, non-child: 280.173us, % non-child: 100.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 0 (0) - BuildTime: 0.000ns - PeakMemoryUsage: 90.25 KB (92416) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=16): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 0.000ns - BuildRowsPartitioned: 0 (0) - HashBuckets: 0 (0) - HashCollisions: 0 (0) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 9.12 KB (9344) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=28): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=27):(Total: 878.421ms, non-child: 6.392us, % non-child: 0.00%) BytesReceived(16s000ms): 769.99 KB, 822.19 KB, 822.19 KB, 822.19 KB, 822.19 KB, 822.19 KB, 822.19 KB, 822.19 KB, 822.19 KB, 822.19 KB, 822.19 KB, 822.19 KB, 822.19 KB, 822.19 KB, 822.19 KB, 822.19 KB, 822.19 KB, 822.19 KB, 822.19 KB, 822.19 KB, 822.19 KB, 822.19 KB, 822.19 KB, 822.19 KB, 822.19 KB, 822.19 KB, 822.19 KB, 822.19 KB, 822.19 KB, 822.19 KB, 822.19 KB, 822.19 KB, 822.19 KB, 822.19 KB, 822.19 KB, 822.19 KB, 822.19 KB, 822.19 KB, 822.19 KB, 822.19 KB - BytesReceived: 822.19 KB (841924) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 9.445ms - FirstBatchArrivalWaitTime: 878.411ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:3a2 (host=vd1340.foo:22000):(Total: 51.322ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 3.35 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB ThreadUsage(16s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.47 MB (3642880) - PerHostPeakMemUsage: 169.56 GB (182064352999) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 916.058ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 51.281ms - ExecTreePrepareTime: 985.289us DataStreamSender (dst_id=29):(Total: 523.583us, non-child: 523.583us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 158.12 KB (161920) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 317.627ms, non-child: 317.627ms, % non-child: 100.00%) - CodegenTime: 2.615ms - CompileTime: 92.180ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 96 (96) - NumInstructions: 3.85K (3850) - OptimizationTime: 197.235ms - PeakMemoryUsage: 1.88 MB (1971200) - PrepareTime: 27.379ms AGGREGATION_NODE (id=17):(Total: 984.420us, non-child: 642.356us, % non-child: 65.25%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 187.095us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.34 MB (1409152) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - StreamingTime: 0.000ns - UnpinTime: 0.000ns HASH_JOIN_NODE (id=16):(Total: 342.064us, non-child: 345.849us, % non-child: 100.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 0 (0) - BuildTime: 0.000ns - PeakMemoryUsage: 90.25 KB (92416) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=16): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 0.000ns - BuildRowsPartitioned: 0 (0) - HashBuckets: 0 (0) - HashCollisions: 0 (0) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 9.12 KB (9344) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=28): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=27):(Total: 916.058ms, non-child: 4.666us, % non-child: 0.00%) BytesReceived(16s000ms): 736.30 KB, 812.89 KB, 812.89 KB, 812.89 KB, 812.89 KB, 812.89 KB, 812.89 KB, 812.89 KB, 812.89 KB, 812.89 KB, 812.89 KB, 812.89 KB, 812.89 KB, 812.89 KB, 812.89 KB, 812.89 KB, 812.89 KB, 812.89 KB, 812.89 KB, 812.89 KB, 812.89 KB, 812.89 KB, 812.89 KB, 812.89 KB, 812.89 KB, 812.89 KB, 812.89 KB, 812.89 KB, 812.89 KB, 812.89 KB, 812.89 KB, 812.89 KB, 812.89 KB, 812.89 KB, 812.89 KB, 812.89 KB, 812.89 KB, 812.89 KB, 812.89 KB, 812.89 KB - BytesReceived: 812.89 KB (832397) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 9.837ms - FirstBatchArrivalWaitTime: 916.051ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:3a9 (host=vd1111.foo:22000):(Total: 51.034ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 3.30 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB ThreadUsage(16s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.47 MB (3643283) - PerHostPeakMemUsage: 169.55 GB (182051211814) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 929.081ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 50.989ms - ExecTreePrepareTime: 1.233ms DataStreamSender (dst_id=29):(Total: 530.117us, non-child: 530.117us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 158.12 KB (161920) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 312.350ms, non-child: 312.350ms, % non-child: 100.00%) - CodegenTime: 2.935ms - CompileTime: 92.648ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 96 (96) - NumInstructions: 3.85K (3850) - OptimizationTime: 193.550ms - PeakMemoryUsage: 1.88 MB (1971200) - PrepareTime: 25.478ms AGGREGATION_NODE (id=17):(Total: 1.232ms, non-child: 726.586us, % non-child: 58.96%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 209.428us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.34 MB (1409152) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - StreamingTime: 0.000ns - UnpinTime: 0.000ns HASH_JOIN_NODE (id=16):(Total: 505.688us, non-child: 507.946us, % non-child: 100.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 0 (0) - BuildTime: 0.000ns - PeakMemoryUsage: 90.25 KB (92416) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=16): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 0.000ns - BuildRowsPartitioned: 0 (0) - HashBuckets: 0 (0) - HashCollisions: 0 (0) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 9.12 KB (9344) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=28): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=27):(Total: 929.081ms, non-child: 4.327us, % non-child: 0.00%) BytesReceived(16s000ms): 737.89 KB, 815.10 KB, 815.10 KB, 815.10 KB, 815.10 KB, 815.10 KB, 815.10 KB, 815.10 KB, 815.10 KB, 815.10 KB, 815.10 KB, 815.10 KB, 815.10 KB, 815.10 KB, 815.10 KB, 815.10 KB, 815.10 KB, 815.10 KB, 815.10 KB, 815.10 KB, 815.10 KB, 815.10 KB, 815.10 KB, 815.10 KB, 815.10 KB, 815.10 KB, 815.10 KB, 815.10 KB, 815.10 KB, 815.10 KB, 815.10 KB, 815.10 KB, 815.10 KB, 815.10 KB, 815.10 KB, 815.10 KB, 815.10 KB, 815.10 KB, 815.10 KB, 815.10 KB - BytesReceived: 815.10 KB (834658) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 10.274ms - FirstBatchArrivalWaitTime: 929.074ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:397 (host=vc1534.foo:22000):(Total: 50.950ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 3.30 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB ThreadUsage(16s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.48 MB (3651237) - PerHostPeakMemUsage: 169.55 GB (182055654504) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 918.898ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 50.887ms - ExecTreePrepareTime: 925.367us DataStreamSender (dst_id=29):(Total: 513.893us, non-child: 513.893us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 158.12 KB (161920) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 308.372ms, non-child: 308.372ms, % non-child: 100.00%) - CodegenTime: 3.252ms - CompileTime: 91.719ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 96 (96) - NumInstructions: 3.85K (3850) - OptimizationTime: 192.691ms - PeakMemoryUsage: 1.88 MB (1971200) - PrepareTime: 23.402ms AGGREGATION_NODE (id=17):(Total: 924.621us, non-child: 609.827us, % non-child: 65.95%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 134.650us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.34 MB (1409152) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - StreamingTime: 0.000ns - UnpinTime: 0.000ns HASH_JOIN_NODE (id=16):(Total: 314.794us, non-child: 316.994us, % non-child: 100.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 0 (0) - BuildTime: 0.000ns - PeakMemoryUsage: 90.25 KB (92416) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=16): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 0.000ns - BuildRowsPartitioned: 0 (0) - HashBuckets: 0 (0) - HashCollisions: 0 (0) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 9.12 KB (9344) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=28): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=27):(Total: 918.899ms, non-child: 4.399us, % non-child: 0.00%) BytesReceived(16s000ms): 740.19 KB, 817.67 KB, 817.67 KB, 817.67 KB, 817.67 KB, 817.67 KB, 817.67 KB, 817.67 KB, 817.67 KB, 817.67 KB, 817.67 KB, 817.67 KB, 817.67 KB, 817.67 KB, 817.67 KB, 817.67 KB, 817.67 KB, 817.67 KB, 817.67 KB, 817.67 KB, 817.67 KB, 817.67 KB, 817.67 KB, 817.67 KB, 817.67 KB, 817.67 KB, 817.67 KB, 817.67 KB, 817.67 KB, 817.67 KB, 817.67 KB, 817.67 KB, 817.67 KB, 817.67 KB, 817.67 KB, 817.67 KB, 817.67 KB, 817.67 KB, 817.67 KB, 817.67 KB - BytesReceived: 817.67 KB (837296) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 10.962ms - FirstBatchArrivalWaitTime: 918.892ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:392 (host=vd1330.foo:22000):(Total: 50.861ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 3.35 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB ThreadUsage(16s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.47 MB (3642880) - PerHostPeakMemUsage: 169.56 GB (182059948462) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 892.315ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 50.792ms - ExecTreePrepareTime: 1.265ms DataStreamSender (dst_id=29):(Total: 442.107us, non-child: 442.107us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 158.12 KB (161920) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 330.932ms, non-child: 330.932ms, % non-child: 100.00%) - CodegenTime: 3.491ms - CompileTime: 105.084ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 96 (96) - NumInstructions: 3.85K (3850) - OptimizationTime: 198.075ms - PeakMemoryUsage: 1.88 MB (1971200) - PrepareTime: 27.150ms AGGREGATION_NODE (id=17):(Total: 1.264ms, non-child: 735.420us, % non-child: 58.14%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 232.499us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.34 MB (1409152) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - StreamingTime: 0.000ns - UnpinTime: 0.000ns HASH_JOIN_NODE (id=16):(Total: 529.429us, non-child: 535.228us, % non-child: 100.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 0 (0) - BuildTime: 0.000ns - PeakMemoryUsage: 90.25 KB (92416) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=16): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 0.000ns - BuildRowsPartitioned: 0 (0) - HashBuckets: 0 (0) - HashCollisions: 0 (0) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 9.12 KB (9344) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=28): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=27):(Total: 892.316ms, non-child: 4.943us, % non-child: 0.00%) BytesReceived(16s000ms): 761.82 KB, 814.11 KB, 814.11 KB, 814.11 KB, 814.11 KB, 814.11 KB, 814.11 KB, 814.11 KB, 814.11 KB, 814.11 KB, 814.11 KB, 814.11 KB, 814.11 KB, 814.11 KB, 814.11 KB, 814.11 KB, 814.11 KB, 814.11 KB, 814.11 KB, 814.11 KB, 814.11 KB, 814.11 KB, 814.11 KB, 814.11 KB, 814.11 KB, 814.11 KB, 814.11 KB, 814.11 KB, 814.11 KB, 814.11 KB, 814.11 KB, 814.11 KB, 814.11 KB, 814.11 KB, 814.11 KB, 814.11 KB, 814.11 KB, 814.11 KB, 814.11 KB, 814.11 KB - BytesReceived: 814.11 KB (833647) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 13.786ms - FirstBatchArrivalWaitTime: 892.308ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:373 (host=ve1136.foo:22000):(Total: 50.802ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 3.36 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB ThreadUsage(16s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.49 MB (3661272) - PerHostPeakMemUsage: 169.56 GB (182064805489) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 844.180ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 50.770ms - ExecTreePrepareTime: 1.259ms DataStreamSender (dst_id=29):(Total: 593.449us, non-child: 593.449us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 158.12 KB (161920) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 337.069ms, non-child: 337.069ms, % non-child: 100.00%) - CodegenTime: 2.727ms - CompileTime: 98.906ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 96 (96) - NumInstructions: 3.85K (3850) - OptimizationTime: 209.020ms - PeakMemoryUsage: 1.88 MB (1971200) - PrepareTime: 28.502ms AGGREGATION_NODE (id=17):(Total: 1.258ms, non-child: 709.991us, % non-child: 56.40%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 183.889us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.34 MB (1409152) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - StreamingTime: 0.000ns - UnpinTime: 0.000ns HASH_JOIN_NODE (id=16):(Total: 548.859us, non-child: 552.477us, % non-child: 100.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 0 (0) - BuildTime: 0.000ns - PeakMemoryUsage: 90.25 KB (92416) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=16): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 0.000ns - BuildRowsPartitioned: 0 (0) - HashBuckets: 0 (0) - HashCollisions: 0 (0) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 9.12 KB (9344) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=28): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=27):(Total: 844.181ms, non-child: 4.573us, % non-child: 0.00%) BytesReceived(16s000ms): 766.33 KB, 822.08 KB, 822.08 KB, 822.08 KB, 822.08 KB, 822.08 KB, 822.08 KB, 822.08 KB, 822.08 KB, 822.08 KB, 822.08 KB, 822.08 KB, 822.08 KB, 822.08 KB, 822.08 KB, 822.08 KB, 822.08 KB, 822.08 KB, 822.08 KB, 822.08 KB, 822.08 KB, 822.08 KB, 822.08 KB, 822.08 KB, 822.08 KB, 822.08 KB, 822.08 KB, 822.08 KB, 822.08 KB, 822.08 KB, 822.08 KB, 822.08 KB, 822.08 KB, 822.08 KB, 822.08 KB, 822.08 KB, 822.08 KB, 822.08 KB, 822.08 KB, 822.08 KB - BytesReceived: 822.08 KB (841806) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 9.874ms - FirstBatchArrivalWaitTime: 844.174ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:36e (host=va1044.foo:22000):(Total: 50.487ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 3.36 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.48 MB (3652870) - PerHostPeakMemUsage: 169.57 GB (182072811520) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 851.799ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 50.454ms - ExecTreePrepareTime: 867.299us DataStreamSender (dst_id=29):(Total: 541.862us, non-child: 541.862us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 158.12 KB (161920) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 317.308ms, non-child: 317.308ms, % non-child: 100.00%) - CodegenTime: 2.266ms - CompileTime: 99.760ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 96 (96) - NumInstructions: 3.85K (3850) - OptimizationTime: 191.151ms - PeakMemoryUsage: 1.88 MB (1971200) - PrepareTime: 25.740ms AGGREGATION_NODE (id=17):(Total: 866.229us, non-child: 563.166us, % non-child: 65.01%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 143.994us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.34 MB (1409152) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - StreamingTime: 0.000ns - UnpinTime: 0.000ns HASH_JOIN_NODE (id=16):(Total: 303.063us, non-child: 304.465us, % non-child: 100.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 0 (0) - BuildTime: 0.000ns - PeakMemoryUsage: 90.25 KB (92416) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=16): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 0.000ns - BuildRowsPartitioned: 0 (0) - HashBuckets: 0 (0) - HashCollisions: 0 (0) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 9.12 KB (9344) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=28): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=27):(Total: 851.800ms, non-child: 3.270us, % non-child: 0.00%) BytesReceived(16s000ms): 767.17 KB, 819.59 KB, 819.59 KB, 819.59 KB, 819.59 KB, 819.59 KB, 819.59 KB, 819.59 KB, 819.59 KB, 819.59 KB, 819.59 KB, 819.59 KB, 819.59 KB, 819.59 KB, 819.59 KB, 819.59 KB, 819.59 KB, 819.59 KB, 819.59 KB, 819.59 KB, 819.59 KB, 819.59 KB, 819.59 KB, 819.59 KB, 819.59 KB, 819.59 KB, 819.59 KB, 819.59 KB, 819.59 KB, 819.59 KB, 819.59 KB, 819.59 KB, 819.59 KB, 819.59 KB, 819.59 KB, 819.59 KB, 819.59 KB, 819.59 KB, 819.59 KB, 819.59 KB - BytesReceived: 819.59 KB (839262) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 9.219ms - FirstBatchArrivalWaitTime: 851.795ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:37d (host=vc1531.foo:22000):(Total: 49.659ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 3.34 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB ThreadUsage(16s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.48 MB (3653565) - PerHostPeakMemUsage: 169.56 GB (182064015224) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 880.119ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 49.618ms - ExecTreePrepareTime: 913.646us DataStreamSender (dst_id=29):(Total: 404.078us, non-child: 404.078us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 158.12 KB (161920) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 312.615ms, non-child: 312.615ms, % non-child: 100.00%) - CodegenTime: 2.324ms - CompileTime: 91.888ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 96 (96) - NumInstructions: 3.85K (3850) - OptimizationTime: 192.526ms - PeakMemoryUsage: 1.88 MB (1971200) - PrepareTime: 27.553ms AGGREGATION_NODE (id=17):(Total: 912.705us, non-child: 579.755us, % non-child: 63.52%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 129.033us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.34 MB (1409152) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - StreamingTime: 0.000ns - UnpinTime: 0.000ns HASH_JOIN_NODE (id=16):(Total: 332.950us, non-child: 334.828us, % non-child: 100.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 0 (0) - BuildTime: 0.000ns - PeakMemoryUsage: 90.25 KB (92416) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=16): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 0.000ns - BuildRowsPartitioned: 0 (0) - HashBuckets: 0 (0) - HashCollisions: 0 (0) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 9.12 KB (9344) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=28): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=27):(Total: 880.120ms, non-child: 4.343us, % non-child: 0.00%) BytesReceived(16s000ms): 757.58 KB, 819.95 KB, 819.95 KB, 819.95 KB, 819.95 KB, 819.95 KB, 819.95 KB, 819.95 KB, 819.95 KB, 819.95 KB, 819.95 KB, 819.95 KB, 819.95 KB, 819.95 KB, 819.95 KB, 819.95 KB, 819.95 KB, 819.95 KB, 819.95 KB, 819.95 KB, 819.95 KB, 819.95 KB, 819.95 KB, 819.95 KB, 819.95 KB, 819.95 KB, 819.95 KB, 819.95 KB, 819.95 KB, 819.95 KB, 819.95 KB, 819.95 KB, 819.95 KB, 819.95 KB, 819.95 KB, 819.95 KB, 819.95 KB, 819.95 KB, 819.95 KB, 819.95 KB - BytesReceived: 819.95 KB (839624) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 10.002ms - FirstBatchArrivalWaitTime: 880.112ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:375 (host=vd1333.foo:22000):(Total: 49.426ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 3.37 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.49 MB (3654567) - PerHostPeakMemUsage: 169.57 GB (182072937354) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 866.180ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 49.385ms - ExecTreePrepareTime: 888.786us DataStreamSender (dst_id=29):(Total: 507.427us, non-child: 507.427us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 158.12 KB (161920) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 315.710ms, non-child: 315.710ms, % non-child: 100.00%) - CodegenTime: 2.281ms - CompileTime: 97.786ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 96 (96) - NumInstructions: 3.85K (3850) - OptimizationTime: 191.175ms - PeakMemoryUsage: 1.88 MB (1971200) - PrepareTime: 26.148ms AGGREGATION_NODE (id=17):(Total: 887.754us, non-child: 574.944us, % non-child: 64.76%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 110.201us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.34 MB (1409152) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - StreamingTime: 0.000ns - UnpinTime: 0.000ns HASH_JOIN_NODE (id=16):(Total: 312.810us, non-child: 315.327us, % non-child: 100.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 0 (0) - BuildTime: 0.000ns - PeakMemoryUsage: 90.25 KB (92416) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=16): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 0.000ns - BuildRowsPartitioned: 0 (0) - HashBuckets: 0 (0) - HashCollisions: 0 (0) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 9.12 KB (9344) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=28): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=27):(Total: 866.181ms, non-child: 4.067us, % non-child: 0.00%) BytesReceived(16s000ms): 767.65 KB, 819.70 KB, 819.70 KB, 819.70 KB, 819.70 KB, 819.70 KB, 819.70 KB, 819.70 KB, 819.70 KB, 819.70 KB, 819.70 KB, 819.70 KB, 819.70 KB, 819.70 KB, 819.70 KB, 819.70 KB, 819.70 KB, 819.70 KB, 819.70 KB, 819.70 KB, 819.70 KB, 819.70 KB, 819.70 KB, 819.70 KB, 819.70 KB, 819.70 KB, 819.70 KB, 819.70 KB, 819.70 KB, 819.70 KB, 819.70 KB, 819.70 KB, 819.70 KB, 819.70 KB, 819.70 KB, 819.70 KB, 819.70 KB, 819.70 KB, 819.70 KB, 819.70 KB - BytesReceived: 819.70 KB (839373) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 9.578ms - FirstBatchArrivalWaitTime: 866.173ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:38e (host=vc1515.foo:22000):(Total: 49.152ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 3.36 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.47 MB (3642880) - PerHostPeakMemUsage: 169.57 GB (182074877824) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 899.125ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 49.108ms - ExecTreePrepareTime: 886.298us DataStreamSender (dst_id=29):(Total: 461.926us, non-child: 461.926us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 158.12 KB (161920) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 321.455ms, non-child: 321.455ms, % non-child: 100.00%) - CodegenTime: 2.719ms - CompileTime: 98.442ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 96 (96) - NumInstructions: 3.85K (3850) - OptimizationTime: 195.540ms - PeakMemoryUsage: 1.88 MB (1971200) - PrepareTime: 26.873ms AGGREGATION_NODE (id=17):(Total: 885.743us, non-child: 587.224us, % non-child: 66.30%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 183.157us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.34 MB (1409152) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - StreamingTime: 0.000ns - UnpinTime: 0.000ns HASH_JOIN_NODE (id=16):(Total: 298.519us, non-child: 300.324us, % non-child: 100.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 0 (0) - BuildTime: 0.000ns - PeakMemoryUsage: 90.25 KB (92416) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=16): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 0.000ns - BuildRowsPartitioned: 0 (0) - HashBuckets: 0 (0) - HashCollisions: 0 (0) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 9.12 KB (9344) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=28): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=27):(Total: 899.125ms, non-child: 4.974us, % non-child: 0.00%) BytesReceived(16s000ms): 764.07 KB, 815.85 KB, 815.85 KB, 815.85 KB, 815.85 KB, 815.85 KB, 815.85 KB, 815.85 KB, 815.85 KB, 815.85 KB, 815.85 KB, 815.85 KB, 815.85 KB, 815.85 KB, 815.85 KB, 815.85 KB, 815.85 KB, 815.85 KB, 815.85 KB, 815.85 KB, 815.85 KB, 815.85 KB, 815.85 KB, 815.85 KB, 815.85 KB, 815.85 KB, 815.85 KB, 815.85 KB, 815.85 KB, 815.85 KB, 815.85 KB, 815.85 KB, 815.85 KB, 815.85 KB, 815.85 KB, 815.85 KB, 815.85 KB, 815.85 KB, 815.85 KB, 815.85 KB - BytesReceived: 815.85 KB (835426) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 9.674ms - FirstBatchArrivalWaitTime: 899.116ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:3ad (host=ve1138.foo:22000):(Total: 48.628ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 3.35 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB ThreadUsage(16s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.47 MB (3642880) - PerHostPeakMemUsage: 169.54 GB (182045058641) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 908.386ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 48.588ms - ExecTreePrepareTime: 1.058ms DataStreamSender (dst_id=29):(Total: 399.902us, non-child: 399.902us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 158.12 KB (161920) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 332.702ms, non-child: 332.702ms, % non-child: 100.00%) - CodegenTime: 2.770ms - CompileTime: 97.388ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 96 (96) - NumInstructions: 3.85K (3850) - OptimizationTime: 207.388ms - PeakMemoryUsage: 1.88 MB (1971200) - PrepareTime: 27.356ms AGGREGATION_NODE (id=17):(Total: 1.057ms, non-child: 745.381us, % non-child: 70.47%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 316.820us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.34 MB (1409152) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - StreamingTime: 0.000ns - UnpinTime: 0.000ns HASH_JOIN_NODE (id=16):(Total: 312.313us, non-child: 317.293us, % non-child: 100.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 0 (0) - BuildTime: 0.000ns - PeakMemoryUsage: 90.25 KB (92416) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=16): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 0.000ns - BuildRowsPartitioned: 0 (0) - HashBuckets: 0 (0) - HashCollisions: 0 (0) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 9.12 KB (9344) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=28): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=27):(Total: 908.387ms, non-child: 5.854us, % non-child: 0.00%) BytesReceived(16s000ms): 735.14 KB, 812.09 KB, 812.09 KB, 812.09 KB, 812.09 KB, 812.09 KB, 812.09 KB, 812.09 KB, 812.09 KB, 812.09 KB, 812.09 KB, 812.09 KB, 812.09 KB, 812.09 KB, 812.09 KB, 812.09 KB, 812.09 KB, 812.09 KB, 812.09 KB, 812.09 KB, 812.09 KB, 812.09 KB, 812.09 KB, 812.09 KB, 812.09 KB, 812.09 KB, 812.09 KB, 812.09 KB, 812.09 KB, 812.09 KB, 812.09 KB, 812.09 KB, 812.09 KB, 812.09 KB, 812.09 KB, 812.09 KB, 812.09 KB, 812.09 KB, 812.09 KB, 812.09 KB - BytesReceived: 812.09 KB (831584) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 9.871ms - FirstBatchArrivalWaitTime: 908.377ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:371 (host=vd1117.foo:22000):(Total: 48.426ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 3.38 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB ThreadUsage(16s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.50 MB (3671625) - PerHostPeakMemUsage: 169.56 GB (182068232415) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 854.374ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 48.375ms - ExecTreePrepareTime: 951.860us DataStreamSender (dst_id=29):(Total: 452.656us, non-child: 452.656us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 158.12 KB (161920) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 323.957ms, non-child: 323.957ms, % non-child: 100.00%) - CodegenTime: 2.539ms - CompileTime: 96.080ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 96 (96) - NumInstructions: 3.85K (3850) - OptimizationTime: 200.683ms - PeakMemoryUsage: 1.88 MB (1971200) - PrepareTime: 26.619ms AGGREGATION_NODE (id=17):(Total: 951.303us, non-child: 613.338us, % non-child: 64.47%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 171.152us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.34 MB (1409152) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - StreamingTime: 0.000ns - UnpinTime: 0.000ns HASH_JOIN_NODE (id=16):(Total: 337.965us, non-child: 340.228us, % non-child: 100.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 0 (0) - BuildTime: 0.000ns - PeakMemoryUsage: 90.25 KB (92416) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=16): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 0.000ns - BuildRowsPartitioned: 0 (0) - HashBuckets: 0 (0) - HashCollisions: 0 (0) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 9.12 KB (9344) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=28): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=27):(Total: 854.375ms, non-child: 5.348us, % non-child: 0.00%) BytesReceived(16s000ms): 748.19 KB, 826.51 KB, 826.51 KB, 826.51 KB, 826.51 KB, 826.51 KB, 826.51 KB, 826.51 KB, 826.51 KB, 826.51 KB, 826.51 KB, 826.51 KB, 826.51 KB, 826.51 KB, 826.51 KB, 826.51 KB, 826.51 KB, 826.51 KB, 826.51 KB, 826.51 KB, 826.51 KB, 826.51 KB, 826.51 KB, 826.51 KB, 826.51 KB, 826.51 KB, 826.51 KB, 826.51 KB, 826.51 KB, 826.51 KB, 826.51 KB, 826.51 KB, 826.51 KB, 826.51 KB, 826.51 KB, 826.51 KB, 826.51 KB, 826.51 KB, 826.51 KB, 826.51 KB - BytesReceived: 826.51 KB (846344) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 8.894ms - FirstBatchArrivalWaitTime: 854.366ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:3c8 (host=vd1113.foo:22000):(Total: 48.369ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 3.31 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB ThreadUsage(16s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.49 MB (3655863) - PerHostPeakMemUsage: 169.56 GB (182064308550) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 912.333ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 48.304ms - ExecTreePrepareTime: 1.254ms DataStreamSender (dst_id=29):(Total: 407.619us, non-child: 407.619us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 158.12 KB (161920) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 320.400ms, non-child: 320.400ms, % non-child: 100.00%) - CodegenTime: 3.096ms - CompileTime: 95.459ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 96 (96) - NumInstructions: 3.85K (3850) - OptimizationTime: 198.308ms - PeakMemoryUsage: 1.88 MB (1971200) - PrepareTime: 25.962ms AGGREGATION_NODE (id=17):(Total: 1.245ms, non-child: 778.916us, % non-child: 62.52%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 229.060us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.34 MB (1409152) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - StreamingTime: 0.000ns - UnpinTime: 0.000ns HASH_JOIN_NODE (id=16):(Total: 467.000us, non-child: 470.969us, % non-child: 100.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 0 (0) - BuildTime: 0.000ns - PeakMemoryUsage: 90.25 KB (92416) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=16): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 0.000ns - BuildRowsPartitioned: 0 (0) - HashBuckets: 0 (0) - HashCollisions: 0 (0) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 9.12 KB (9344) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=28): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=27):(Total: 912.335ms, non-child: 6.570us, % non-child: 0.00%) BytesReceived(16s000ms): 742.68 KB, 820.34 KB, 820.34 KB, 820.34 KB, 820.34 KB, 820.34 KB, 820.34 KB, 820.34 KB, 820.34 KB, 820.34 KB, 820.34 KB, 820.34 KB, 820.34 KB, 820.34 KB, 820.34 KB, 820.34 KB, 820.34 KB, 820.34 KB, 820.34 KB, 820.34 KB, 820.34 KB, 820.34 KB, 820.34 KB, 820.34 KB, 820.34 KB, 820.34 KB, 820.34 KB, 820.34 KB, 820.34 KB, 820.34 KB, 820.34 KB, 820.34 KB, 820.34 KB, 820.34 KB, 820.34 KB, 820.34 KB, 820.34 KB, 820.34 KB, 820.34 KB, 820.34 KB - BytesReceived: 820.34 KB (840025) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 10.420ms - FirstBatchArrivalWaitTime: 912.324ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:36d (host=vc1533.foo:22000):(Total: 48.056ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 3.29 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB ThreadUsage(16s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.47 MB (3642880) - PerHostPeakMemUsage: 169.57 GB (182077648486) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 794.986ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 48.016ms - ExecTreePrepareTime: 897.937us DataStreamSender (dst_id=29):(Total: 518.928us, non-child: 518.928us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 158.12 KB (161920) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 376.450ms, non-child: 376.450ms, % non-child: 100.00%) - CodegenTime: 2.764ms - CompileTime: 95.047ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 96 (96) - NumInstructions: 3.85K (3850) - OptimizationTime: 256.963ms - PeakMemoryUsage: 1.88 MB (1971200) - PrepareTime: 23.890ms AGGREGATION_NODE (id=17):(Total: 896.852us, non-child: 526.514us, % non-child: 58.71%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 114.970us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.34 MB (1409152) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - StreamingTime: 0.000ns - UnpinTime: 0.000ns HASH_JOIN_NODE (id=16):(Total: 370.338us, non-child: 373.839us, % non-child: 100.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 0 (0) - BuildTime: 0.000ns - PeakMemoryUsage: 90.25 KB (92416) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=16): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 0.000ns - BuildRowsPartitioned: 0 (0) - HashBuckets: 0 (0) - HashCollisions: 0 (0) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 9.12 KB (9344) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=28): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=27):(Total: 794.987ms, non-child: 5.002us, % non-child: 0.00%) BytesReceived(16s000ms): 735.64 KB, 812.52 KB, 812.52 KB, 812.52 KB, 812.52 KB, 812.52 KB, 812.52 KB, 812.52 KB, 812.52 KB, 812.52 KB, 812.52 KB, 812.52 KB, 812.52 KB, 812.52 KB, 812.52 KB, 812.52 KB, 812.52 KB, 812.52 KB, 812.52 KB, 812.52 KB, 812.52 KB, 812.52 KB, 812.52 KB, 812.52 KB, 812.52 KB, 812.52 KB, 812.52 KB, 812.52 KB, 812.52 KB, 812.52 KB, 812.52 KB, 812.52 KB, 812.52 KB, 812.52 KB, 812.52 KB, 812.52 KB, 812.52 KB, 812.52 KB, 812.52 KB, 812.52 KB - BytesReceived: 812.52 KB (832023) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 9.101ms - FirstBatchArrivalWaitTime: 794.980ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:3d6 (host=vc1529.foo:22000):(Total: 47.715ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 3.34 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB, 3.46 MB ThreadUsage(16s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.47 MB (3642880) - PerHostPeakMemUsage: 169.56 GB (182068133972) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 899.778ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 47.682ms - ExecTreePrepareTime: 874.694us DataStreamSender (dst_id=29):(Total: 430.092us, non-child: 430.092us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 158.12 KB (161920) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 325.952ms, non-child: 325.952ms, % non-child: 100.00%) - CodegenTime: 2.737ms - CompileTime: 94.405ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 96 (96) - NumInstructions: 3.85K (3850) - OptimizationTime: 205.313ms - PeakMemoryUsage: 1.88 MB (1971200) - PrepareTime: 25.700ms AGGREGATION_NODE (id=17):(Total: 873.738us, non-child: 606.787us, % non-child: 69.45%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 122.744us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.34 MB (1409152) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - StreamingTime: 0.000ns - UnpinTime: 0.000ns HASH_JOIN_NODE (id=16):(Total: 266.951us, non-child: 271.237us, % non-child: 100.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 0 (0) - BuildTime: 0.000ns - PeakMemoryUsage: 90.25 KB (92416) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=16): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 0.000ns - BuildRowsPartitioned: 0 (0) - HashBuckets: 0 (0) - HashCollisions: 0 (0) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 9.12 KB (9344) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=28): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=27):(Total: 899.779ms, non-child: 4.904us, % non-child: 0.00%) BytesReceived(16s000ms): 731.43 KB, 807.98 KB, 807.98 KB, 807.98 KB, 807.98 KB, 807.98 KB, 807.98 KB, 807.98 KB, 807.98 KB, 807.98 KB, 807.98 KB, 807.98 KB, 807.98 KB, 807.98 KB, 807.98 KB, 807.98 KB, 807.98 KB, 807.98 KB, 807.98 KB, 807.98 KB, 807.98 KB, 807.98 KB, 807.98 KB, 807.98 KB, 807.98 KB, 807.98 KB, 807.98 KB, 807.98 KB, 807.98 KB, 807.98 KB, 807.98 KB, 807.98 KB, 807.98 KB, 807.98 KB, 807.98 KB, 807.98 KB, 807.98 KB, 807.98 KB, 807.98 KB, 807.98 KB - BytesReceived: 807.98 KB (827368) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 9.435ms - FirstBatchArrivalWaitTime: 899.771ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:370 (host=ve1141.foo:22000):(Total: 47.687ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 3.38 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB ThreadUsage(16s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.48 MB (3652880) - PerHostPeakMemUsage: 169.58 GB (182080120448) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 856.564ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 47.649ms - ExecTreePrepareTime: 841.889us DataStreamSender (dst_id=29):(Total: 400.699us, non-child: 400.699us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 158.12 KB (161920) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 320.215ms, non-child: 320.215ms, % non-child: 100.00%) - CodegenTime: 3.243ms - CompileTime: 95.242ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 96 (96) - NumInstructions: 3.85K (3850) - OptimizationTime: 198.576ms - PeakMemoryUsage: 1.88 MB (1971200) - PrepareTime: 25.499ms AGGREGATION_NODE (id=17):(Total: 841.318us, non-child: 488.599us, % non-child: 58.08%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 110.062us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.34 MB (1409152) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - StreamingTime: 0.000ns - UnpinTime: 0.000ns HASH_JOIN_NODE (id=16):(Total: 352.719us, non-child: 354.346us, % non-child: 100.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 0 (0) - BuildTime: 0.000ns - PeakMemoryUsage: 90.25 KB (92416) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=16): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 0.000ns - BuildRowsPartitioned: 0 (0) - HashBuckets: 0 (0) - HashCollisions: 0 (0) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 9.12 KB (9344) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=28): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=27):(Total: 856.565ms, non-child: 4.815us, % non-child: 0.00%) BytesReceived(16s000ms): 746.53 KB, 819.24 KB, 819.24 KB, 819.24 KB, 819.24 KB, 819.24 KB, 819.24 KB, 819.24 KB, 819.24 KB, 819.24 KB, 819.24 KB, 819.24 KB, 819.24 KB, 819.24 KB, 819.24 KB, 819.24 KB, 819.24 KB, 819.24 KB, 819.24 KB, 819.24 KB, 819.24 KB, 819.24 KB, 819.24 KB, 819.24 KB, 819.24 KB, 819.24 KB, 819.24 KB, 819.24 KB, 819.24 KB, 819.24 KB, 819.24 KB, 819.24 KB, 819.24 KB, 819.24 KB, 819.24 KB, 819.24 KB, 819.24 KB, 819.24 KB, 819.24 KB, 819.24 KB - BytesReceived: 819.24 KB (838906) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 9.022ms - FirstBatchArrivalWaitTime: 856.557ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:39d (host=va1039.foo:22000):(Total: 47.277ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 3.33 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB ThreadUsage(16s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.49 MB (3658939) - PerHostPeakMemUsage: 169.56 GB (182068550938) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 909.284ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 47.217ms - ExecTreePrepareTime: 821.901us DataStreamSender (dst_id=29):(Total: 396.303us, non-child: 396.303us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 158.12 KB (161920) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 331.315ms, non-child: 331.315ms, % non-child: 100.00%) - CodegenTime: 2.466ms - CompileTime: 99.374ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 96 (96) - NumInstructions: 3.85K (3850) - OptimizationTime: 204.926ms - PeakMemoryUsage: 1.88 MB (1971200) - PrepareTime: 26.302ms AGGREGATION_NODE (id=17):(Total: 821.155us, non-child: 477.057us, % non-child: 58.10%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 88.458us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.34 MB (1409152) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - StreamingTime: 0.000ns - UnpinTime: 0.000ns HASH_JOIN_NODE (id=16):(Total: 344.098us, non-child: 348.974us, % non-child: 100.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 0 (0) - BuildTime: 0.000ns - PeakMemoryUsage: 90.25 KB (92416) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=16): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 0.000ns - BuildRowsPartitioned: 0 (0) - HashBuckets: 0 (0) - HashCollisions: 0 (0) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 9.12 KB (9344) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=28): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=27):(Total: 909.285ms, non-child: 5.190us, % non-child: 0.00%) BytesReceived(16s000ms): 752.11 KB, 821.00 KB, 821.00 KB, 821.00 KB, 821.00 KB, 821.00 KB, 821.00 KB, 821.00 KB, 821.00 KB, 821.00 KB, 821.00 KB, 821.00 KB, 821.00 KB, 821.00 KB, 821.00 KB, 821.00 KB, 821.00 KB, 821.00 KB, 821.00 KB, 821.00 KB, 821.00 KB, 821.00 KB, 821.00 KB, 821.00 KB, 821.00 KB, 821.00 KB, 821.00 KB, 821.00 KB, 821.00 KB, 821.00 KB, 821.00 KB, 821.00 KB, 821.00 KB, 821.00 KB, 821.00 KB, 821.00 KB, 821.00 KB, 821.00 KB, 821.00 KB, 821.00 KB - BytesReceived: 821.00 KB (840699) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 9.470ms - FirstBatchArrivalWaitTime: 909.276ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:3c5 (host=ve1128.foo:22000):(Total: 46.646ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 3.37 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB ThreadUsage(16s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.49 MB (3664320) - PerHostPeakMemUsage: 169.55 GB (182055458089) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 919.628ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 46.606ms - ExecTreePrepareTime: 856.456us DataStreamSender (dst_id=29):(Total: 347.821us, non-child: 347.821us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 158.12 KB (161920) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 316.316ms, non-child: 316.316ms, % non-child: 100.00%) - CodegenTime: 2.752ms - CompileTime: 96.334ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 96 (96) - NumInstructions: 3.85K (3850) - OptimizationTime: 193.718ms - PeakMemoryUsage: 1.88 MB (1971200) - PrepareTime: 25.498ms AGGREGATION_NODE (id=17):(Total: 856.081us, non-child: 659.714us, % non-child: 77.06%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 121.634us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.34 MB (1409152) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - StreamingTime: 0.000ns - UnpinTime: 0.000ns HASH_JOIN_NODE (id=16):(Total: 196.367us, non-child: 198.830us, % non-child: 100.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 0 (0) - BuildTime: 0.000ns - PeakMemoryUsage: 90.25 KB (92416) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=16): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 0.000ns - BuildRowsPartitioned: 0 (0) - HashBuckets: 0 (0) - HashCollisions: 0 (0) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 9.12 KB (9344) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=28): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=27):(Total: 919.629ms, non-child: 4.249us, % non-child: 0.00%) BytesReceived(16s000ms): 745.45 KB, 823.41 KB, 823.41 KB, 823.41 KB, 823.41 KB, 823.41 KB, 823.41 KB, 823.41 KB, 823.41 KB, 823.41 KB, 823.41 KB, 823.41 KB, 823.41 KB, 823.41 KB, 823.41 KB, 823.41 KB, 823.41 KB, 823.41 KB, 823.41 KB, 823.41 KB, 823.41 KB, 823.41 KB, 823.41 KB, 823.41 KB, 823.41 KB, 823.41 KB, 823.41 KB, 823.41 KB, 823.41 KB, 823.41 KB, 823.41 KB, 823.41 KB, 823.41 KB, 823.41 KB, 823.41 KB, 823.41 KB, 823.41 KB, 823.41 KB, 823.41 KB, 823.41 KB - BytesReceived: 823.41 KB (843168) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 11.484ms - FirstBatchArrivalWaitTime: 919.622ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:39a (host=vd1327.foo:22000):(Total: 46.507ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 3.35 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.48 MB (3646426) - PerHostPeakMemUsage: 169.56 GB (182065073254) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 925.403ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 46.460ms - ExecTreePrepareTime: 987.942us DataStreamSender (dst_id=29):(Total: 354.773us, non-child: 354.773us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 158.12 KB (161920) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 311.672ms, non-child: 311.672ms, % non-child: 100.00%) - CodegenTime: 2.995ms - CompileTime: 93.779ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 96 (96) - NumInstructions: 3.85K (3850) - OptimizationTime: 193.178ms - PeakMemoryUsage: 1.88 MB (1971200) - PrepareTime: 24.118ms AGGREGATION_NODE (id=17):(Total: 986.951us, non-child: 547.760us, % non-child: 55.50%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 155.071us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.34 MB (1409152) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - StreamingTime: 0.000ns - UnpinTime: 0.000ns HASH_JOIN_NODE (id=16):(Total: 439.191us, non-child: 441.356us, % non-child: 100.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 0 (0) - BuildTime: 0.000ns - PeakMemoryUsage: 90.25 KB (92416) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=16): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 0.000ns - BuildRowsPartitioned: 0 (0) - HashBuckets: 0 (0) - HashCollisions: 0 (0) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 9.12 KB (9344) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=28): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=27):(Total: 925.404ms, non-child: 4.067us, % non-child: 0.00%) BytesReceived(16s000ms): 758.04 KB, 815.69 KB, 815.69 KB, 815.69 KB, 815.69 KB, 815.69 KB, 815.69 KB, 815.69 KB, 815.69 KB, 815.69 KB, 815.69 KB, 815.69 KB, 815.69 KB, 815.69 KB, 815.69 KB, 815.69 KB, 815.69 KB, 815.69 KB, 815.69 KB, 815.69 KB, 815.69 KB, 815.69 KB, 815.69 KB, 815.69 KB, 815.69 KB, 815.69 KB, 815.69 KB, 815.69 KB, 815.69 KB, 815.69 KB, 815.69 KB, 815.69 KB, 815.69 KB, 815.69 KB, 815.69 KB, 815.69 KB, 815.69 KB, 815.69 KB, 815.69 KB, 815.69 KB - BytesReceived: 815.69 KB (835270) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 9.515ms - FirstBatchArrivalWaitTime: 925.398ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:387 (host=vc1523.foo:22000):(Total: 46.048ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 3.38 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB, 3.50 MB ThreadUsage(16s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.50 MB (3672622) - PerHostPeakMemUsage: 169.56 GB (182059761730) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 882.988ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 46.005ms - ExecTreePrepareTime: 772.862us DataStreamSender (dst_id=29):(Total: 321.998us, non-child: 321.998us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 158.12 KB (161920) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 322.577ms, non-child: 322.577ms, % non-child: 100.00%) - CodegenTime: 3.565ms - CompileTime: 100.668ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 96 (96) - NumInstructions: 3.85K (3850) - OptimizationTime: 200.421ms - PeakMemoryUsage: 1.88 MB (1971200) - PrepareTime: 20.712ms AGGREGATION_NODE (id=17):(Total: 772.229us, non-child: 505.070us, % non-child: 65.40%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 139.119us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.34 MB (1409152) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - StreamingTime: 0.000ns - UnpinTime: 0.000ns HASH_JOIN_NODE (id=16):(Total: 267.159us, non-child: 270.595us, % non-child: 100.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 0 (0) - BuildTime: 0.000ns - PeakMemoryUsage: 90.25 KB (92416) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=16): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 0.000ns - BuildRowsPartitioned: 0 (0) - HashBuckets: 0 (0) - HashCollisions: 0 (0) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 9.12 KB (9344) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=28): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=27):(Total: 882.989ms, non-child: 3.818us, % non-child: 0.00%) BytesReceived(16s000ms): 773.04 KB, 825.96 KB, 825.96 KB, 825.96 KB, 825.96 KB, 825.96 KB, 825.96 KB, 825.96 KB, 825.96 KB, 825.96 KB, 825.96 KB, 825.96 KB, 825.96 KB, 825.96 KB, 825.96 KB, 825.96 KB, 825.96 KB, 825.96 KB, 825.96 KB, 825.96 KB, 825.96 KB, 825.96 KB, 825.96 KB, 825.96 KB, 825.96 KB, 825.96 KB, 825.96 KB, 825.96 KB, 825.96 KB, 825.96 KB, 825.96 KB, 825.96 KB, 825.96 KB, 825.96 KB, 825.96 KB, 825.96 KB, 825.96 KB, 825.96 KB, 825.96 KB, 825.96 KB - BytesReceived: 825.96 KB (845786) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 9.447ms - FirstBatchArrivalWaitTime: 882.981ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:36c (host=vc1538.foo:22000):(Total: 45.140ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 3.36 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB ThreadUsage(16s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.48 MB (3651807) - PerHostPeakMemUsage: 169.56 GB (182066816132) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 843.696ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 45.100ms - ExecTreePrepareTime: 815.956us DataStreamSender (dst_id=29):(Total: 320.583us, non-child: 320.583us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 158.12 KB (161920) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 328.532ms, non-child: 328.532ms, % non-child: 100.00%) - CodegenTime: 2.605ms - CompileTime: 98.901ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 96 (96) - NumInstructions: 3.85K (3850) - OptimizationTime: 204.320ms - PeakMemoryUsage: 1.88 MB (1971200) - PrepareTime: 24.611ms AGGREGATION_NODE (id=17):(Total: 815.399us, non-child: 509.424us, % non-child: 62.48%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 104.332us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.34 MB (1409152) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - StreamingTime: 0.000ns - UnpinTime: 0.000ns HASH_JOIN_NODE (id=16):(Total: 305.975us, non-child: 310.006us, % non-child: 100.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 0 (0) - BuildTime: 0.000ns - PeakMemoryUsage: 90.25 KB (92416) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=16): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 0.000ns - BuildRowsPartitioned: 0 (0) - HashBuckets: 0 (0) - HashCollisions: 0 (0) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 9.12 KB (9344) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=28): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=27):(Total: 843.697ms, non-child: 4.935us, % non-child: 0.00%) BytesReceived(16s000ms): 766.47 KB, 818.79 KB, 818.79 KB, 818.79 KB, 818.79 KB, 818.79 KB, 818.79 KB, 818.79 KB, 818.79 KB, 818.79 KB, 818.79 KB, 818.79 KB, 818.79 KB, 818.79 KB, 818.79 KB, 818.79 KB, 818.79 KB, 818.79 KB, 818.79 KB, 818.79 KB, 818.79 KB, 818.79 KB, 818.79 KB, 818.79 KB, 818.79 KB, 818.79 KB, 818.79 KB, 818.79 KB, 818.79 KB, 818.79 KB, 818.79 KB, 818.79 KB, 818.79 KB, 818.79 KB, 818.79 KB, 818.79 KB, 818.79 KB, 818.79 KB, 818.79 KB, 818.79 KB - BytesReceived: 818.79 KB (838446) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 10.115ms - FirstBatchArrivalWaitTime: 843.688ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:39e (host=vc1510.foo:22000):(Total: 43.776ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 3.37 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB ThreadUsage(16s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.49 MB (3664471) - PerHostPeakMemUsage: 169.57 GB (182075614100) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 927.789ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 43.750ms - ExecTreePrepareTime: 599.923us DataStreamSender (dst_id=29):(Total: 304.281us, non-child: 304.281us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 158.12 KB (161920) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 316.165ms, non-child: 316.165ms, % non-child: 100.00%) - CodegenTime: 3.406ms - CompileTime: 94.940ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 96 (96) - NumInstructions: 3.85K (3850) - OptimizationTime: 198.120ms - PeakMemoryUsage: 1.88 MB (1971200) - PrepareTime: 22.225ms AGGREGATION_NODE (id=17):(Total: 599.562us, non-child: 390.486us, % non-child: 65.13%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 66.875us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.34 MB (1409152) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - StreamingTime: 0.000ns - UnpinTime: 0.000ns HASH_JOIN_NODE (id=16):(Total: 209.076us, non-child: 211.115us, % non-child: 100.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 0 (0) - BuildTime: 0.000ns - PeakMemoryUsage: 90.25 KB (92416) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=16): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 0.000ns - BuildRowsPartitioned: 0 (0) - HashBuckets: 0 (0) - HashCollisions: 0 (0) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 9.12 KB (9344) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=28): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=27):(Total: 927.790ms, non-child: 6.330us, % non-child: 0.00%) BytesReceived(16s000ms): 745.78 KB, 823.84 KB, 823.84 KB, 823.84 KB, 823.84 KB, 823.84 KB, 823.84 KB, 823.84 KB, 823.84 KB, 823.84 KB, 823.84 KB, 823.84 KB, 823.84 KB, 823.84 KB, 823.84 KB, 823.84 KB, 823.84 KB, 823.84 KB, 823.84 KB, 823.84 KB, 823.84 KB, 823.84 KB, 823.84 KB, 823.84 KB, 823.84 KB, 823.84 KB, 823.84 KB, 823.84 KB, 823.84 KB, 823.84 KB, 823.84 KB, 823.84 KB, 823.84 KB, 823.84 KB, 823.84 KB, 823.84 KB, 823.84 KB, 823.84 KB, 823.84 KB, 823.84 KB - BytesReceived: 823.84 KB (843609) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 9.216ms - FirstBatchArrivalWaitTime: 927.779ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:374 (host=ve1125.foo:22000):(Total: 43.184ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 3.35 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB, 3.47 MB ThreadUsage(16s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.47 MB (3642880) - PerHostPeakMemUsage: 169.57 GB (182077147455) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 858.066ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 43.132ms - ExecTreePrepareTime: 718.258us DataStreamSender (dst_id=29):(Total: 359.730us, non-child: 359.730us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 158.12 KB (161920) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 323.326ms, non-child: 323.326ms, % non-child: 100.00%) - CodegenTime: 3.411ms - CompileTime: 100.223ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 96 (96) - NumInstructions: 3.85K (3850) - OptimizationTime: 201.565ms - PeakMemoryUsage: 1.88 MB (1971200) - PrepareTime: 20.898ms AGGREGATION_NODE (id=17):(Total: 717.857us, non-child: 441.321us, % non-child: 61.48%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 139.249us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.34 MB (1409152) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - StreamingTime: 0.000ns - UnpinTime: 0.000ns HASH_JOIN_NODE (id=16):(Total: 276.536us, non-child: 278.554us, % non-child: 100.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 0 (0) - BuildTime: 0.000ns - PeakMemoryUsage: 90.25 KB (92416) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=16): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 0.000ns - BuildRowsPartitioned: 0 (0) - HashBuckets: 0 (0) - HashCollisions: 0 (0) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 9.12 KB (9344) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=28): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=27):(Total: 858.067ms, non-child: 5.131us, % non-child: 0.00%) BytesReceived(16s000ms): 737.86 KB, 814.83 KB, 814.83 KB, 814.83 KB, 814.83 KB, 814.83 KB, 814.83 KB, 814.83 KB, 814.83 KB, 814.83 KB, 814.83 KB, 814.83 KB, 814.83 KB, 814.83 KB, 814.83 KB, 814.83 KB, 814.83 KB, 814.83 KB, 814.83 KB, 814.83 KB, 814.83 KB, 814.83 KB, 814.83 KB, 814.83 KB, 814.83 KB, 814.83 KB, 814.83 KB, 814.83 KB, 814.83 KB, 814.83 KB, 814.83 KB, 814.83 KB, 814.83 KB, 814.83 KB, 814.83 KB, 814.83 KB, 814.83 KB, 814.83 KB, 814.83 KB, 814.83 KB - BytesReceived: 814.83 KB (834384) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 9.637ms - FirstBatchArrivalWaitTime: 858.060ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:3c3 (host=va1031.foo:22000):(Total: 42.617ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 3.37 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB, 3.48 MB ThreadUsage(16s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.48 MB (3654109) - PerHostPeakMemUsage: 169.55 GB (182054131090) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 918.133ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 42.597ms - ExecTreePrepareTime: 556.617us DataStreamSender (dst_id=29):(Total: 211.436us, non-child: 211.436us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 158.12 KB (161920) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 322.621ms, non-child: 322.621ms, % non-child: 100.00%) - CodegenTime: 2.506ms - CompileTime: 96.889ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 96 (96) - NumInstructions: 3.85K (3850) - OptimizationTime: 201.809ms - PeakMemoryUsage: 1.88 MB (1971200) - PrepareTime: 23.385ms AGGREGATION_NODE (id=17):(Total: 556.161us, non-child: 400.460us, % non-child: 72.00%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 69.578us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.34 MB (1409152) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - StreamingTime: 0.000ns - UnpinTime: 0.000ns HASH_JOIN_NODE (id=16):(Total: 155.701us, non-child: 160.462us, % non-child: 100.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 0 (0) - BuildTime: 0.000ns - PeakMemoryUsage: 90.25 KB (92416) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=16): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 0.000ns - BuildRowsPartitioned: 0 (0) - HashBuckets: 0 (0) - HashCollisions: 0 (0) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 9.12 KB (9344) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=28): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=27):(Total: 918.134ms, non-child: 4.961us, % non-child: 0.00%) BytesReceived(16s000ms): 742.26 KB, 819.91 KB, 819.91 KB, 819.91 KB, 819.91 KB, 819.91 KB, 819.91 KB, 819.91 KB, 819.91 KB, 819.91 KB, 819.91 KB, 819.91 KB, 819.91 KB, 819.91 KB, 819.91 KB, 819.91 KB, 819.91 KB, 819.91 KB, 819.91 KB, 819.91 KB, 819.91 KB, 819.91 KB, 819.91 KB, 819.91 KB, 819.91 KB, 819.91 KB, 819.91 KB, 819.91 KB, 819.91 KB, 819.91 KB, 819.91 KB, 819.91 KB, 819.91 KB, 819.91 KB, 819.91 KB, 819.91 KB, 819.91 KB, 819.91 KB, 819.91 KB, 819.91 KB - BytesReceived: 819.91 KB (839591) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 8.494ms - FirstBatchArrivalWaitTime: 918.127ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:3d3 (host=vd1132.foo:22000):(Total: 42.551ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 3.37 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB, 3.49 MB ThreadUsage(16s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.49 MB (3656771) - PerHostPeakMemUsage: 169.57 GB (182074885619) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 909.725ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 42.524ms - ExecTreePrepareTime: 963.746us DataStreamSender (dst_id=29):(Total: 314.770us, non-child: 314.770us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 158.12 KB (161920) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 315.872ms, non-child: 315.872ms, % non-child: 100.00%) - CodegenTime: 3.304ms - CompileTime: 93.327ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 96 (96) - NumInstructions: 3.85K (3850) - OptimizationTime: 202.411ms - PeakMemoryUsage: 1.88 MB (1971200) - PrepareTime: 19.609ms AGGREGATION_NODE (id=17):(Total: 963.354us, non-child: 695.095us, % non-child: 72.15%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 187.777us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.34 MB (1409152) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - StreamingTime: 0.000ns - UnpinTime: 0.000ns HASH_JOIN_NODE (id=16):(Total: 268.259us, non-child: 271.345us, % non-child: 100.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 0 (0) - BuildTime: 0.000ns - PeakMemoryUsage: 90.25 KB (92416) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=16): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 0.000ns - BuildRowsPartitioned: 0 (0) - HashBuckets: 0 (0) - HashCollisions: 0 (0) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 9.12 KB (9344) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=28): BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=27):(Total: 909.725ms, non-child: 4.574us, % non-child: 0.00%) BytesReceived(16s000ms): 742.72 KB, 820.40 KB, 820.40 KB, 820.40 KB, 820.40 KB, 820.40 KB, 820.40 KB, 820.40 KB, 820.40 KB, 820.40 KB, 820.40 KB, 820.40 KB, 820.40 KB, 820.40 KB, 820.40 KB, 820.40 KB, 820.40 KB, 820.40 KB, 820.40 KB, 820.40 KB, 820.40 KB, 820.40 KB, 820.40 KB, 820.40 KB, 820.40 KB, 820.40 KB, 820.40 KB, 820.40 KB, 820.40 KB, 820.40 KB, 820.40 KB, 820.40 KB, 820.40 KB, 820.40 KB, 820.40 KB, 820.40 KB, 820.40 KB, 820.40 KB, 820.40 KB, 820.40 KB - BytesReceived: 820.40 KB (840092) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 11.198ms - FirstBatchArrivalWaitTime: 909.719ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Averaged Fragment F00:(Total: 1s400ms, non-child: 167.556ms, % non-child: 11.97%) split sizes: min: 8.06 KB, max: 175.90 KB, avg: 102.61 KB, stddev: 35.20 KB completion times: min:1s736ms max:1s910ms mean: 1s794ms stddev:25.923ms execution rates: min:4.58 KB/sec max:99.27 KB/sec mean:57.21 KB/sec stddev:19.74 KB/sec num instances: 110 - AverageThreadTokens: 1.19 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.77 MB (3954689) - PerHostPeakMemUsage: 16.42 MB (17218468) - RowsProduced: 17.46K (17461) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 90.354ms - TotalStorageWaitTime: 258.269ms - TotalThreadsInvoluntaryContextSwitches: 30 (30) - TotalThreadsTotalWallClockTime: 1s611ms - TotalThreadsSysTime: 18.705ms - TotalThreadsUserTime: 62.062ms - TotalThreadsVoluntaryContextSwitches: 418 (418) Fragment Instance Lifecycle Timings: - ExecTime: 1s321ms - ExecTreeExecTime: 1s148ms - OpenTime: 24.894ms - ExecTreeOpenTime: 50.006us - PrepareTime: 53.981ms - ExecTreePrepareTime: 151.175us DataStreamSender (dst_id=27):(Total: 31.293ms, non-child: 31.293ms, % non-child: 100.00%) - BytesSent: 819.14 KB (838799) - NetworkThroughput(*): 63.75 MB/sec - OverallThroughput: 25.35 MB/sec - PeakMemoryUsage: 3.14 MB (3296246) - RowsReturned: 17.46K (17461) - SerializeBatchTime: 17.385ms - TransmitDataRPCTime: 12.889ms - UncompressedRowBatchSize: 1.81 MB (1896382) CodeGen:(Total: 51.881ms, non-child: 51.881ms, % non-child: 100.00%) - CodegenTime: 1.264ms - CompileTime: 6.495ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 16.824ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 27.941ms HDFS_SCAN_NODE (id=2):(Total: 1s149ms, non-child: 1s149ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.21 - BytesRead: 203.72 KB (208605) - BytesReadDataNodeCache: 0 - BytesReadLocal: 203.72 KB (208605) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 203.72 KB (208605) - DecompressionTime: 101.166us - MaxCompressedTextFileLength: 0 - NumColumns: 9 (9) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 1.11 MB (1161838) - PerReadThreadRawHdfsThroughput: 514.10 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 215.915ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 17.46K (17461) - RowsReturned: 17.46K (17461) - RowsReturnedRate: 15.28 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 1 (1) - ScannerThreadsTotalWallClockTime: 265.812ms - MaterializeTupleTime(*): 5.831ms - ScannerThreadsSysTime: 908.518us - ScannerThreadsUserTime: 5.898ms - ScannerThreadsVoluntaryContextSwitches: 18 (18) - TotalRawHdfsReadTime(*): 403.745us - TotalReadThroughput: 12.57 KB/sec Filter 0 (1.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 17.46K (17461) Fragment F00: Instance 7f40dcb034de70b7:2d (host=ve1132.foo:22000):(Total: 1s908ms, non-child: 125.936ms, % non-child: 6.60%) Hdfs split stats (:<# splits>/): 1:1/88.00 KB MemoryUsage(500.000ms): 171.90 KB, 171.90 KB, 307.90 KB ThreadUsage(500.000ms): 1, 1, 2 - AverageThreadTokens: 1.33 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.58 MB (3751527) - PerHostPeakMemUsage: 78.36 MB (82169712) - RowsProduced: 14.98K (14983) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 63.144ms - TotalStorageWaitTime: 750.982ms - TotalThreadsInvoluntaryContextSwitches: 30 (30) - TotalThreadsTotalWallClockTime: 2s622ms - TotalThreadsSysTime: 27.995ms - TotalThreadsUserTime: 61.990ms - TotalThreadsVoluntaryContextSwitches: 481 (481) Fragment Instance Lifecycle Timings: - ExecTime: 1s839ms - ExecTreeExecTime: 1s702ms - OpenTime: 22.207ms - ExecTreeOpenTime: 28.736us - PrepareTime: 47.188ms - ExecTreePrepareTime: 161.174us DataStreamSender (dst_id=27):(Total: 31.328ms, non-child: 31.328ms, % non-child: 100.00%) - BytesSent: 701.15 KB (717975) - NetworkThroughput(*): 57.82 MB/sec - OverallThroughput: 21.86 MB/sec - PeakMemoryUsage: 3.17 MB (3321120) - RowsReturned: 14.98K (14983) - SerializeBatchTime: 18.839ms - TransmitDataRPCTime: 11.842ms - UncompressedRowBatchSize: 1.55 MB (1626801) CodeGen:(Total: 48.495ms, non-child: 48.495ms, % non-child: 100.00%) - CodegenTime: 1.235ms - CompileTime: 5.941ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 14.859ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 26.945ms HDFS_SCAN_NODE (id=2):(Total: 1s703ms, non-child: 1s703ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:1/88.00 KB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: Only following filters arrived: , waited 947ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:9 BytesRead(500.000ms): 0, 0, 0 - FooterProcessingTime: (Avg: 673.206ms ; Min: 673.206ms ; Max: 673.206ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.33 - BytesRead: 174.74 KB (178932) - BytesReadDataNodeCache: 0 - BytesReadLocal: 174.74 KB (178932) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 174.74 KB (178932) - DecompressionTime: 135.266us - MaxCompressedTextFileLength: 0 - NumColumns: 9 (9) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 959.70 KB (982731) - PerReadThreadRawHdfsThroughput: 342.86 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 753.247ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 14.98K (14983) - RowsReturned: 14.98K (14983) - RowsReturnedRate: 8.80 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 1 (1) - ScannerThreadsTotalWallClockTime: 760.737ms - MaterializeTupleTime(*): 7.358ms - ScannerThreadsSysTime: 999.000us - ScannerThreadsUserTime: 7.998ms - ScannerThreadsVoluntaryContextSwitches: 47 (47) - TotalRawHdfsReadTime(*): 497.699us - TotalReadThroughput: 0.00 /sec Filter 0 (1.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 14.98K (14983) Instance 7f40dcb034de70b7:35 (host=vc1540.foo:22000):(Total: 1s867ms, non-child: 125.292ms, % non-child: 6.71%) Hdfs split stats (:<# splits>/): 3:1/87.98 KB MemoryUsage(500.000ms): 171.90 KB, 171.90 KB, 307.90 KB ThreadUsage(500.000ms): 1, 1, 2 - AverageThreadTokens: 1.33 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.56 MB (3731047) - PerHostPeakMemUsage: 76.88 MB (80619385) - RowsProduced: 14.98K (14983) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 67.604ms - TotalStorageWaitTime: 713.130ms - TotalThreadsInvoluntaryContextSwitches: 33 (33) - TotalThreadsTotalWallClockTime: 2s532ms - TotalThreadsSysTime: 19.997ms - TotalThreadsUserTime: 51.991ms - TotalThreadsVoluntaryContextSwitches: 426 (426) Fragment Instance Lifecycle Timings: - ExecTime: 1s791ms - ExecTreeExecTime: 1s659ms - OpenTime: 20.757ms - ExecTreeOpenTime: 30.910us - PrepareTime: 55.713ms - ExecTreePrepareTime: 115.870us DataStreamSender (dst_id=27):(Total: 27.990ms, non-child: 27.990ms, % non-child: 100.00%) - BytesSent: 705.06 KB (721984) - NetworkThroughput(*): 68.16 MB/sec - OverallThroughput: 24.60 MB/sec - PeakMemoryUsage: 3.17 MB (3321120) - RowsReturned: 14.98K (14983) - SerializeBatchTime: 17.076ms - TransmitDataRPCTime: 10.101ms - UncompressedRowBatchSize: 1.55 MB (1628720) CodeGen:(Total: 54.682ms, non-child: 54.682ms, % non-child: 100.00%) - CodegenTime: 928.355us - CompileTime: 5.511ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 13.968ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 34.730ms HDFS_SCAN_NODE (id=2):(Total: 1s659ms, non-child: 1s659ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:1/87.98 KB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: Only following filters arrived: , waited 944ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:9 BytesRead(500.000ms): 0, 0, 0 - FooterProcessingTime: (Avg: 598.920ms ; Min: 598.920ms ; Max: 598.920ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.33 - BytesRead: 174.71 KB (178900) - BytesReadDataNodeCache: 0 - BytesReadLocal: 174.71 KB (178900) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 174.71 KB (178900) - DecompressionTime: 46.069us - MaxCompressedTextFileLength: 0 - NumColumns: 9 (9) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 763.70 KB (782027) - PerReadThreadRawHdfsThroughput: 490.48 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 714.409ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 14.98K (14983) - RowsReturned: 14.98K (14983) - RowsReturnedRate: 9.03 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 1 (1) - ScannerThreadsTotalWallClockTime: 720.449ms - MaterializeTupleTime(*): 5.814ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 6.998ms - ScannerThreadsVoluntaryContextSwitches: 13 (13) - TotalRawHdfsReadTime(*): 347.847us - TotalReadThroughput: 0.00 /sec Filter 0 (1.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 14.98K (14983) Instance 7f40dcb034de70b7:14 (host=va1027.foo:22000):(Total: 1s786ms, non-child: 132.805ms, % non-child: 7.43%) Hdfs split stats (:<# splits>/): 3:1/85.79 KB MemoryUsage(500.000ms): 171.90 KB, 171.90 KB, 307.90 KB, 312.29 KB ThreadUsage(500.000ms): 1, 1, 2, 2 - AverageThreadTokens: 1.50 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.54 MB (3716405) - PerHostPeakMemUsage: 30.92 MB (32424227) - RowsProduced: 14.60K (14599) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 72.893ms - TotalStorageWaitTime: 632.461ms - TotalThreadsInvoluntaryContextSwitches: 38 (38) - TotalThreadsTotalWallClockTime: 2s380ms - TotalThreadsSysTime: 17.996ms - TotalThreadsUserTime: 58.990ms - TotalThreadsVoluntaryContextSwitches: 417 (417) Fragment Instance Lifecycle Timings: - ExecTime: 1s717ms - ExecTreeExecTime: 1s578ms - OpenTime: 24.365ms - ExecTreeOpenTime: 47.156us - PrepareTime: 43.918ms - ExecTreePrepareTime: 163.369us DataStreamSender (dst_id=27):(Total: 26.099ms, non-child: 26.099ms, % non-child: 100.00%) - BytesSent: 687.59 KB (704092) - NetworkThroughput(*): 71.04 MB/sec - OverallThroughput: 25.73 MB/sec - PeakMemoryUsage: 3.17 MB (3321120) - RowsReturned: 14.60K (14599) - SerializeBatchTime: 15.885ms - TransmitDataRPCTime: 9.452ms - UncompressedRowBatchSize: 1.51 MB (1585630) CodeGen:(Total: 48.085ms, non-child: 48.085ms, % non-child: 100.00%) - CodegenTime: 928.258us - CompileTime: 6.475ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 16.609ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 24.471ms HDFS_SCAN_NODE (id=2):(Total: 1s579ms, non-child: 1s579ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:1/85.79 KB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: Only following filters arrived: , waited 944ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:9 BytesRead(500.000ms): 0, 0, 0, 87.60 KB - FooterProcessingTime: (Avg: 474.279ms ; Min: 474.279ms ; Max: 474.279ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.50 - BytesRead: 170.31 KB (174402) - BytesReadDataNodeCache: 0 - BytesReadLocal: 170.31 KB (174402) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 170.31 KB (174402) - DecompressionTime: 54.810us - MaxCompressedTextFileLength: 0 - NumColumns: 9 (9) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 1.12 MB (1172889) - PerReadThreadRawHdfsThroughput: 495.86 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 633.695ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 14.60K (14599) - RowsReturned: 14.60K (14599) - RowsReturnedRate: 9.24 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 1 (1) - ScannerThreadsTotalWallClockTime: 638.024ms - MaterializeTupleTime(*): 4.555ms - ScannerThreadsSysTime: 999.000us - ScannerThreadsUserTime: 3.999ms - ScannerThreadsVoluntaryContextSwitches: 14 (14) - TotalRawHdfsReadTime(*): 335.422us - TotalReadThroughput: 43.80 KB/sec Filter 0 (1.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 14.60K (14599) Instance 7f40dcb034de70b7:4f (host=ve1129.foo:22000):(Total: 1s709ms, non-child: 137.998ms, % non-child: 8.07%) Hdfs split stats (:<# splits>/): 2:1/85.78 KB MemoryUsage(500.000ms): 171.90 KB, 171.90 KB, 274.90 KB ThreadUsage(500.000ms): 1, 1, 2 - AverageThreadTokens: 1.33 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.56 MB (3732781) - PerHostPeakMemUsage: 28.28 MB (29648820) - RowsProduced: 14.60K (14597) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 72.368ms - TotalStorageWaitTime: 540.188ms - TotalThreadsInvoluntaryContextSwitches: 33 (33) - TotalThreadsTotalWallClockTime: 2s207ms - TotalThreadsSysTime: 23.995ms - TotalThreadsUserTime: 61.991ms - TotalThreadsVoluntaryContextSwitches: 428 (428) Fragment Instance Lifecycle Timings: - ExecTime: 1s634ms - ExecTreeExecTime: 1s490ms - OpenTime: 24.780ms - ExecTreeOpenTime: 32.454us - PrepareTime: 49.804ms - ExecTreePrepareTime: 124.308us DataStreamSender (dst_id=27):(Total: 31.502ms, non-child: 31.502ms, % non-child: 100.00%) - BytesSent: 693.97 KB (710622) - NetworkThroughput(*): 59.85 MB/sec - OverallThroughput: 21.51 MB/sec - PeakMemoryUsage: 3.17 MB (3321120) - RowsReturned: 14.60K (14597) - SerializeBatchTime: 19.714ms - TransmitDataRPCTime: 11.323ms - UncompressedRowBatchSize: 1.51 MB (1584077) CodeGen:(Total: 49.386ms, non-child: 49.386ms, % non-child: 100.00%) - CodegenTime: 1.235ms - CompileTime: 5.824ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 17.091ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 25.969ms HDFS_SCAN_NODE (id=2):(Total: 1s490ms, non-child: 1s490ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:1/85.78 KB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: Only following filters arrived: , waited 946ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:9 BytesRead(500.000ms): 0, 0, 85.78 KB - FooterProcessingTime: (Avg: 458.117ms ; Min: 458.117ms ; Max: 458.117ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.33 - BytesRead: 170.30 KB (174384) - BytesReadDataNodeCache: 0 - BytesReadLocal: 170.30 KB (174384) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 170.30 KB (174384) - DecompressionTime: 145.855us - MaxCompressedTextFileLength: 0 - NumColumns: 9 (9) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 1.02 MB (1068433) - PerReadThreadRawHdfsThroughput: 428.58 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 542.084ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 14.60K (14597) - RowsReturned: 14.60K (14597) - RowsReturnedRate: 9.79 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 548.036ms - MaterializeTupleTime(*): 6.258ms - ScannerThreadsSysTime: 999.000us - ScannerThreadsUserTime: 5.999ms - ScannerThreadsVoluntaryContextSwitches: 11 (11) - TotalRawHdfsReadTime(*): 388.035us - TotalReadThroughput: 57.18 KB/sec Filter 0 (1.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 14.60K (14597) Instance 7f40dcb034de70b7:49 (host=va1045.foo:22000):(Total: 1s439ms, non-child: 94.667ms, % non-child: 6.58%) Hdfs split stats (:<# splits>/): 0:1/85.78 KB 7:1/85.78 KB MemoryUsage(500.000ms): 0, 171.90 KB, 171.90 KB ThreadUsage(500.000ms): 1, 1, 3 - AverageThreadTokens: 1.67 - BloomFilterBytes: 0 - PeakMemoryUsage: 4.39 MB (4603193) - PerHostPeakMemUsage: 20.46 MB (21455757) - RowsProduced: 29.20K (29200) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 42.715ms - TotalStorageWaitTime: 593.598ms - TotalThreadsInvoluntaryContextSwitches: 21 (21) - TotalThreadsTotalWallClockTime: 1s996ms - TotalThreadsSysTime: 26.996ms - TotalThreadsUserTime: 64.989ms - TotalThreadsVoluntaryContextSwitches: 471 (471) Fragment Instance Lifecycle Timings: - ExecTime: 1s351ms - ExecTreeExecTime: 1s245ms - OpenTime: 24.537ms - ExecTreeOpenTime: 49.014us - PrepareTime: 62.777ms - ExecTreePrepareTime: 245.115us DataStreamSender (dst_id=27):(Total: 39.870ms, non-child: 39.870ms, % non-child: 100.00%) - BytesSent: 1.34 MB (1401722) - NetworkThroughput(*): 93.09 MB/sec - OverallThroughput: 33.53 MB/sec - PeakMemoryUsage: 3.17 MB (3321120) - RowsReturned: 29.20K (29200) - SerializeBatchTime: 24.429ms - TransmitDataRPCTime: 14.360ms - UncompressedRowBatchSize: 3.03 MB (3172208) CodeGen:(Total: 58.730ms, non-child: 58.730ms, % non-child: 100.00%) - CodegenTime: 1.260ms - CompileTime: 6.503ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 16.909ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 34.686ms HDFS_SCAN_NODE (id=2):(Total: 1s245ms, non-child: 1s245ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/85.78 KB 7:1/85.78 KB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 2 out of 2 Runtime filters: Only following filters arrived: , waited 924ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:18 BytesRead(500.000ms): 0, 0, 0 - FooterProcessingTime: (Avg: 259.863ms ; Min: 256.384ms ; Max: 263.343ms ; Number of samples: 2) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 340.62 KB (348792) - BytesReadDataNodeCache: 0 - BytesReadLocal: 340.62 KB (348792) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 340.62 KB (348792) - DecompressionTime: 203.894us - MaxCompressedTextFileLength: 0 - NumColumns: 9 (9) - NumDisksAccessed: 2 (2) - NumRowGroups: 2 (2) - NumScannerThreadsStarted: 2 (2) - PeakMemoryUsage: 1.29 MB (1357213) - PerReadThreadRawHdfsThroughput: 331.78 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 309.103ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 29.20K (29200) - RowsReturned: 29.20K (29200) - RowsReturnedRate: 23.44 K/sec - ScanRangesComplete: 2 (2) - ScannerThreadsInvoluntaryContextSwitches: 3 (3) - ScannerThreadsTotalWallClockTime: 620.292ms - MaterializeTupleTime(*): 9.517ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 11.997ms - ScannerThreadsVoluntaryContextSwitches: 52 (52) - TotalRawHdfsReadTime(*): 1.002ms - TotalReadThroughput: 0.00 /sec Filter 0 (1.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 29.20K (29200) Instance 7f40dcb034de70b7:19 (host=vc1501.foo:22000):(Total: 1s438ms, non-child: 191.741ms, % non-child: 13.33%) Hdfs split stats (:<# splits>/): 1:1/88.04 KB MemoryUsage(500.000ms): 171.90 KB, 171.90 KB, 2.14 MB ThreadUsage(500.000ms): 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.56 MB (3735143) - PerHostPeakMemUsage: 15.78 MB (16545783) - RowsProduced: 14.98K (14983) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 120.258ms - TotalStorageWaitTime: 226.142ms - TotalThreadsInvoluntaryContextSwitches: 38 (38) - TotalThreadsTotalWallClockTime: 1s620ms - TotalThreadsSysTime: 14.997ms - TotalThreadsUserTime: 60.990ms - TotalThreadsVoluntaryContextSwitches: 407 (407) Fragment Instance Lifecycle Timings: - ExecTime: 1s366ms - ExecTreeExecTime: 1s172ms - OpenTime: 24.106ms - ExecTreeOpenTime: 34.437us - PrepareTime: 47.421ms - ExecTreePrepareTime: 103.619us DataStreamSender (dst_id=27):(Total: 26.780ms, non-child: 26.780ms, % non-child: 100.00%) - BytesSent: 703.15 KB (720021) - NetworkThroughput(*): 67.74 MB/sec - OverallThroughput: 25.64 MB/sec - PeakMemoryUsage: 3.17 MB (3321120) - RowsReturned: 14.98K (14983) - SerializeBatchTime: 16.046ms - TransmitDataRPCTime: 10.137ms - UncompressedRowBatchSize: 1.55 MB (1625154) CodeGen:(Total: 47.465ms, non-child: 47.465ms, % non-child: 100.00%) - CodegenTime: 889.981us - CompileTime: 7.300ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 15.588ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 24.104ms HDFS_SCAN_NODE (id=2):(Total: 1s172ms, non-child: 1s172ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:1/88.04 KB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: Only following filters arrived: , waited 944ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:9 BytesRead(500.000ms): 0, 0 - FooterProcessingTime: (Avg: 118.805ms ; Min: 118.805ms ; Max: 118.805ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 174.82 KB (179014) - BytesReadDataNodeCache: 0 - BytesReadLocal: 174.82 KB (179014) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 174.82 KB (179014) - DecompressionTime: 56.134us - MaxCompressedTextFileLength: 0 - NumColumns: 9 (9) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 1.21 MB (1271499) - PerReadThreadRawHdfsThroughput: 453.31 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 227.025ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 14.98K (14983) - RowsReturned: 14.98K (14983) - RowsReturnedRate: 12.78 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 2 (2) - ScannerThreadsTotalWallClockTime: 230.131ms - MaterializeTupleTime(*): 3.159ms - ScannerThreadsSysTime: 999.000us - ScannerThreadsUserTime: 2.999ms - ScannerThreadsVoluntaryContextSwitches: 11 (11) - TotalRawHdfsReadTime(*): 376.606us - TotalReadThroughput: 0.00 /sec Filter 0 (1.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 14.98K (14983) Instance 7f40dcb034de70b7:2a (host=vc1519.foo:22000):(Total: 1s436ms, non-child: 188.745ms, % non-child: 13.14%) Hdfs split stats (:<# splits>/): 5:1/88.05 KB MemoryUsage(500.000ms): 171.90 KB, 171.90 KB, 2.32 MB ThreadUsage(500.000ms): 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.56 MB (3733120) - PerHostPeakMemUsage: 18.73 MB (19639756) - RowsProduced: 14.98K (14985) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 102.307ms - TotalStorageWaitTime: 235.753ms - TotalThreadsInvoluntaryContextSwitches: 38 (38) - TotalThreadsTotalWallClockTime: 1s627ms - TotalThreadsSysTime: 14.998ms - TotalThreadsUserTime: 67.990ms - TotalThreadsVoluntaryContextSwitches: 412 (412) Fragment Instance Lifecycle Timings: - ExecTime: 1s356ms - ExecTreeExecTime: 1s162ms - OpenTime: 27.807ms - ExecTreeOpenTime: 49.684us - PrepareTime: 52.336ms - ExecTreePrepareTime: 134.356us DataStreamSender (dst_id=27):(Total: 27.148ms, non-child: 27.148ms, % non-child: 100.00%) - BytesSent: 707.05 KB (724019) - NetworkThroughput(*): 65.28 MB/sec - OverallThroughput: 25.43 MB/sec - PeakMemoryUsage: 3.17 MB (3321120) - RowsReturned: 14.98K (14985) - SerializeBatchTime: 15.983ms - TransmitDataRPCTime: 10.577ms - UncompressedRowBatchSize: 1.56 MB (1630879) CodeGen:(Total: 57.635ms, non-child: 57.635ms, % non-child: 100.00%) - CodegenTime: 1.779ms - CompileTime: 7.469ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 18.624ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 30.879ms HDFS_SCAN_NODE (id=2):(Total: 1s163ms, non-child: 1s163ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:1/88.05 KB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: Only following filters arrived: , waited 925ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:9 BytesRead(500.000ms): 0, 0, 174.84 KB - FooterProcessingTime: (Avg: 133.278ms ; Min: 133.278ms ; Max: 133.278ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 174.84 KB (179038) - BytesReadDataNodeCache: 0 - BytesReadLocal: 174.84 KB (179038) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 174.84 KB (179038) - DecompressionTime: 445.261us - MaxCompressedTextFileLength: 0 - NumColumns: 9 (9) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 865.72 KB (886500) - PerReadThreadRawHdfsThroughput: 421.43 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 237.595ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 14.98K (14985) - RowsReturned: 14.98K (14985) - RowsReturnedRate: 12.88 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 2 (2) - ScannerThreadsTotalWallClockTime: 243.226ms - MaterializeTupleTime(*): 5.563ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 6.998ms - ScannerThreadsVoluntaryContextSwitches: 29 (29) - TotalRawHdfsReadTime(*): 405.154us - TotalReadThroughput: 116.56 KB/sec Filter 0 (1.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 14.98K (14985) Instance 7f40dcb034de70b7:e (host=vd1116.foo:22000):(Total: 1s433ms, non-child: 182.510ms, % non-child: 12.73%) Hdfs split stats (:<# splits>/): 7:1/88.03 KB MemoryUsage(500.000ms): 171.90 KB, 171.90 KB, 255.90 KB ThreadUsage(500.000ms): 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.55 MB (3718759) - PerHostPeakMemUsage: 17.56 MB (18412053) - RowsProduced: 14.98K (14983) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 110.654ms - TotalStorageWaitTime: 228.946ms - TotalThreadsInvoluntaryContextSwitches: 30 (30) - TotalThreadsTotalWallClockTime: 1s614ms - TotalThreadsSysTime: 16.997ms - TotalThreadsUserTime: 59.991ms - TotalThreadsVoluntaryContextSwitches: 428 (428) Fragment Instance Lifecycle Timings: - ExecTime: 1s355ms - ExecTreeExecTime: 1s175ms - OpenTime: 24.499ms - ExecTreeOpenTime: 39.397us - PrepareTime: 53.203ms - ExecTreePrepareTime: 163.731us DataStreamSender (dst_id=27):(Total: 26.538ms, non-child: 26.538ms, % non-child: 100.00%) - BytesSent: 700.79 KB (717613) - NetworkThroughput(*): 70.00 MB/sec - OverallThroughput: 25.79 MB/sec - PeakMemoryUsage: 3.17 MB (3321120) - RowsReturned: 14.98K (14983) - SerializeBatchTime: 16.048ms - TransmitDataRPCTime: 9.776ms - UncompressedRowBatchSize: 1.55 MB (1621052) CodeGen:(Total: 48.370ms, non-child: 48.370ms, % non-child: 100.00%) - CodegenTime: 1.164ms - CompileTime: 6.603ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 16.059ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 25.116ms HDFS_SCAN_NODE (id=2):(Total: 1s175ms, non-child: 1s175ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:1/88.03 KB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: Only following filters arrived: , waited 944ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:9 BytesRead(500.000ms): 0, 0 - FooterProcessingTime: (Avg: 138.641ms ; Min: 138.641ms ; Max: 138.641ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 174.80 KB (178994) - BytesReadDataNodeCache: 0 - BytesReadLocal: 174.80 KB (178994) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 174.80 KB (178994) - DecompressionTime: 94.230us - MaxCompressedTextFileLength: 0 - NumColumns: 9 (9) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 959.70 KB (982731) - PerReadThreadRawHdfsThroughput: 444.61 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 230.451ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 14.98K (14983) - RowsReturned: 14.98K (14983) - RowsReturnedRate: 12.74 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 235.110ms - MaterializeTupleTime(*): 4.808ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 5.999ms - ScannerThreadsVoluntaryContextSwitches: 13 (13) - TotalRawHdfsReadTime(*): 383.940us - TotalReadThroughput: 0.00 /sec Filter 0 (1.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 14.98K (14983) Instance 7f40dcb034de70b7:52 (host=vd1136.foo:22000):(Total: 1s432ms, non-child: 201.186ms, % non-child: 14.04%) Hdfs split stats (:<# splits>/): 1:1/85.83 KB MemoryUsage(500.000ms): 171.90 KB, 171.90 KB, 307.90 KB ThreadUsage(500.000ms): 1, 1, 2 - AverageThreadTokens: 1.33 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.58 MB (3749169) - PerHostPeakMemUsage: 16.39 MB (17186636) - RowsProduced: 14.60K (14598) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 117.990ms - TotalStorageWaitTime: 226.809ms - TotalThreadsInvoluntaryContextSwitches: 35 (35) - TotalThreadsTotalWallClockTime: 1s610ms - TotalThreadsSysTime: 16.998ms - TotalThreadsUserTime: 59.991ms - TotalThreadsVoluntaryContextSwitches: 423 (423) Fragment Instance Lifecycle Timings: - ExecTime: 1s354ms - ExecTreeExecTime: 1s154ms - OpenTime: 22.854ms - ExecTreeOpenTime: 41.716us - PrepareTime: 55.068ms - ExecTreePrepareTime: 133.825us DataStreamSender (dst_id=27):(Total: 29.145ms, non-child: 29.145ms, % non-child: 100.00%) - BytesSent: 678.52 KB (694801) - NetworkThroughput(*): 55.55 MB/sec - OverallThroughput: 22.73 MB/sec - PeakMemoryUsage: 3.17 MB (3321120) - RowsReturned: 14.60K (14598) - SerializeBatchTime: 16.494ms - TransmitDataRPCTime: 11.928ms - UncompressedRowBatchSize: 1.52 MB (1589650) CodeGen:(Total: 47.737ms, non-child: 47.737ms, % non-child: 100.00%) - CodegenTime: 908.808us - CompileTime: 6.272ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 15.399ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 25.583ms HDFS_SCAN_NODE (id=2):(Total: 1s154ms, non-child: 1s154ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:1/85.83 KB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: Only following filters arrived: , waited 924ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:9 BytesRead(500.000ms): 0, 0, 0 - FooterProcessingTime: (Avg: 131.741ms ; Min: 131.741ms ; Max: 131.741ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.33 - BytesRead: 170.41 KB (174504) - BytesReadDataNodeCache: 0 - BytesReadLocal: 170.41 KB (174504) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 170.41 KB (174504) - DecompressionTime: 72.797us - MaxCompressedTextFileLength: 0 - NumColumns: 9 (9) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 1.03 MB (1076629) - PerReadThreadRawHdfsThroughput: 503.76 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 228.352ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 14.60K (14598) - RowsReturned: 14.60K (14598) - RowsReturnedRate: 12.64 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 3 (3) - ScannerThreadsTotalWallClockTime: 233.002ms - MaterializeTupleTime(*): 4.903ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 5.999ms - ScannerThreadsVoluntaryContextSwitches: 20 (20) - TotalRawHdfsReadTime(*): 330.358us - TotalReadThroughput: 0.00 /sec Filter 0 (1.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 14.60K (14598) Instance 7f40dcb034de70b7:3a (host=ve1139.foo:22000):(Total: 1s430ms, non-child: 186.215ms, % non-child: 13.02%) Hdfs split stats (:<# splits>/): 3:1/85.76 KB MemoryUsage(500.000ms): 163.28 KB, 171.90 KB, 307.90 KB ThreadUsage(500.000ms): 1, 1, 2 - AverageThreadTokens: 1.33 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.56 MB (3732789) - PerHostPeakMemUsage: 15.80 MB (16566676) - RowsProduced: 14.60K (14599) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 101.088ms - TotalStorageWaitTime: 224.544ms - TotalThreadsInvoluntaryContextSwitches: 24 (24) - TotalThreadsTotalWallClockTime: 1s614ms - TotalThreadsSysTime: 13.997ms - TotalThreadsUserTime: 61.990ms - TotalThreadsVoluntaryContextSwitches: 413 (413) Fragment Instance Lifecycle Timings: - ExecTime: 1s359ms - ExecTreeExecTime: 1s171ms - OpenTime: 24.085ms - ExecTreeOpenTime: 29.868us - PrepareTime: 46.355ms - ExecTreePrepareTime: 113.064us DataStreamSender (dst_id=27):(Total: 25.806ms, non-child: 25.806ms, % non-child: 100.00%) - BytesSent: 686.28 KB (702752) - NetworkThroughput(*): 69.03 MB/sec - OverallThroughput: 25.97 MB/sec - PeakMemoryUsage: 3.17 MB (3321120) - RowsReturned: 14.60K (14599) - SerializeBatchTime: 15.540ms - TransmitDataRPCTime: 9.709ms - UncompressedRowBatchSize: 1.51 MB (1586353) CodeGen:(Total: 46.833ms, non-child: 46.833ms, % non-child: 100.00%) - CodegenTime: 1.203ms - CompileTime: 6.015ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 16.607ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 23.601ms HDFS_SCAN_NODE (id=2):(Total: 1s171ms, non-child: 1s171ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:1/85.76 KB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: Only following filters arrived: , waited 944ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:9 BytesRead(500.000ms): 0, 0, 0 - FooterProcessingTime: (Avg: 141.392ms ; Min: 141.392ms ; Max: 141.392ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.50 - BytesRead: 170.27 KB (174358) - BytesReadDataNodeCache: 0 - BytesReadLocal: 170.27 KB (174358) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 170.27 KB (174358) - DecompressionTime: 79.851us - MaxCompressedTextFileLength: 0 - NumColumns: 9 (9) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 957.40 KB (980377) - PerReadThreadRawHdfsThroughput: 494.87 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 225.972ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 14.60K (14599) - RowsReturned: 14.60K (14599) - RowsReturnedRate: 12.46 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 1 (1) - ScannerThreadsTotalWallClockTime: 230.604ms - MaterializeTupleTime(*): 4.867ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 5.999ms - ScannerThreadsVoluntaryContextSwitches: 17 (17) - TotalRawHdfsReadTime(*): 336.012us - TotalReadThroughput: 0.00 /sec Filter 0 (1.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 14.60K (14599) Instance 7f40dcb034de70b7:1 (host=vc1538.foo:22000):(Total: 1s426ms, non-child: 172.957ms, % non-child: 12.12%) Hdfs split stats (:<# splits>/): 3:1/85.78 KB MemoryUsage(500.000ms): 171.90 KB, 171.90 KB, 1.95 MB ThreadUsage(500.000ms): 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.53 MB (3700017) - PerHostPeakMemUsage: 18.42 MB (19312059) - RowsProduced: 14.60K (14598) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 88.001ms - TotalStorageWaitTime: 233.866ms - TotalThreadsInvoluntaryContextSwitches: 36 (36) - TotalThreadsTotalWallClockTime: 1s627ms - TotalThreadsSysTime: 17.997ms - TotalThreadsUserTime: 62.990ms - TotalThreadsVoluntaryContextSwitches: 423 (423) Fragment Instance Lifecycle Timings: - ExecTime: 1s360ms - ExecTreeExecTime: 1s180ms - OpenTime: 26.921ms - ExecTreeOpenTime: 34.895us - PrepareTime: 39.237ms - ExecTreePrepareTime: 78.792us DataStreamSender (dst_id=27):(Total: 27.118ms, non-child: 27.118ms, % non-child: 100.00%) - BytesSent: 687.77 KB (704279) - NetworkThroughput(*): 62.11 MB/sec - OverallThroughput: 24.77 MB/sec - PeakMemoryUsage: 3.17 MB (3321120) - RowsReturned: 14.60K (14598) - SerializeBatchTime: 15.895ms - TransmitDataRPCTime: 10.813ms - UncompressedRowBatchSize: 1.51 MB (1588029) CodeGen:(Total: 45.269ms, non-child: 45.269ms, % non-child: 100.00%) - CodegenTime: 1.198ms - CompileTime: 6.760ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 18.711ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 19.248ms HDFS_SCAN_NODE (id=2):(Total: 1s181ms, non-child: 1s181ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:1/85.78 KB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: Only following filters arrived: , waited 944ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:9 BytesRead(500.000ms): 0, 0 - FooterProcessingTime: (Avg: 122.762ms ; Min: 122.762ms ; Max: 122.762ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 170.31 KB (174398) - BytesReadDataNodeCache: 0 - BytesReadLocal: 170.31 KB (174398) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 170.31 KB (174398) - DecompressionTime: 91.795us - MaxCompressedTextFileLength: 0 - NumColumns: 9 (9) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 957.40 KB (980373) - PerReadThreadRawHdfsThroughput: 525.79 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 235.398ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 14.60K (14598) - RowsReturned: 14.60K (14598) - RowsReturnedRate: 12.36 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 4 (4) - ScannerThreadsTotalWallClockTime: 240.571ms - MaterializeTupleTime(*): 5.464ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 5.999ms - ScannerThreadsVoluntaryContextSwitches: 14 (14) - TotalRawHdfsReadTime(*): 316.324us - TotalReadThroughput: 0.00 /sec Filter 0 (1.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 14.60K (14598) Instance 7f40dcb034de70b7:5c (host=vc1513.foo:22000):(Total: 1s424ms, non-child: 192.454ms, % non-child: 13.51%) Hdfs split stats (:<# splits>/): 0:1/88.03 KB MemoryUsage(500.000ms): 171.90 KB, 171.90 KB, 2.55 MB ThreadUsage(500.000ms): 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.56 MB (3735172) - PerHostPeakMemUsage: 14.90 MB (15623994) - RowsProduced: 14.99K (14986) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 104.304ms - TotalStorageWaitTime: 213.172ms - TotalThreadsInvoluntaryContextSwitches: 41 (41) - TotalThreadsTotalWallClockTime: 1s594ms - TotalThreadsSysTime: 17.997ms - TotalThreadsUserTime: 57.991ms - TotalThreadsVoluntaryContextSwitches: 398 (398) Fragment Instance Lifecycle Timings: - ExecTime: 1s354ms - ExecTreeExecTime: 1s159ms - OpenTime: 21.182ms - ExecTreeOpenTime: 51.618us - PrepareTime: 48.459ms - ExecTreePrepareTime: 186.577us DataStreamSender (dst_id=27):(Total: 26.948ms, non-child: 26.948ms, % non-child: 100.00%) - BytesSent: 704.81 KB (721723) - NetworkThroughput(*): 67.14 MB/sec - OverallThroughput: 25.54 MB/sec - PeakMemoryUsage: 3.17 MB (3321120) - RowsReturned: 14.99K (14986) - SerializeBatchTime: 15.958ms - TransmitDataRPCTime: 10.250ms - UncompressedRowBatchSize: 1.56 MB (1630790) CodeGen:(Total: 44.790ms, non-child: 44.790ms, % non-child: 100.00%) - CodegenTime: 1.065ms - CompileTime: 5.646ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 14.235ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 24.442ms HDFS_SCAN_NODE (id=2):(Total: 1s160ms, non-child: 1s160ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/88.03 KB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: Only following filters arrived: , waited 944ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:9 BytesRead(500.000ms): 0, 0 - FooterProcessingTime: (Avg: 125.310ms ; Min: 125.310ms ; Max: 125.310ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 174.80 KB (178996) - BytesReadDataNodeCache: 0 - BytesReadLocal: 174.80 KB (178996) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 174.80 KB (178996) - DecompressionTime: 74.450us - MaxCompressedTextFileLength: 0 - NumColumns: 9 (9) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 959.73 KB (982760) - PerReadThreadRawHdfsThroughput: 596.36 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 214.581ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 14.99K (14986) - RowsReturned: 14.99K (14986) - RowsReturnedRate: 12.91 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 4 (4) - ScannerThreadsTotalWallClockTime: 219.208ms - MaterializeTupleTime(*): 4.740ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 5.999ms - ScannerThreadsVoluntaryContextSwitches: 11 (11) - TotalRawHdfsReadTime(*): 286.245us - TotalReadThroughput: 0.00 /sec Filter 0 (1.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 14.99K (14986) Instance 7f40dcb034de70b7:1d (host=vc1516.foo:22000):(Total: 1s424ms, non-child: 176.224ms, % non-child: 12.37%) Hdfs split stats (:<# splits>/): 2:1/87.94 KB MemoryUsage(500.000ms): 171.90 KB, 171.90 KB ThreadUsage(500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.53 MB (3702375) - PerHostPeakMemUsage: 15.70 MB (16464480) - RowsProduced: 14.98K (14983) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 107.031ms - TotalStorageWaitTime: 226.282ms - TotalThreadsInvoluntaryContextSwitches: 34 (34) - TotalThreadsTotalWallClockTime: 1s604ms - TotalThreadsSysTime: 20.996ms - TotalThreadsUserTime: 56.991ms - TotalThreadsVoluntaryContextSwitches: 402 (402) Fragment Instance Lifecycle Timings: - ExecTime: 1s349ms - ExecTreeExecTime: 1s172ms - OpenTime: 22.905ms - ExecTreeOpenTime: 39.988us - PrepareTime: 51.913ms - ExecTreePrepareTime: 121.540us DataStreamSender (dst_id=27):(Total: 26.692ms, non-child: 26.692ms, % non-child: 100.00%) - BytesSent: 706.48 KB (723439) - NetworkThroughput(*): 71.62 MB/sec - OverallThroughput: 25.85 MB/sec - PeakMemoryUsage: 3.17 MB (3321120) - RowsReturned: 14.98K (14983) - SerializeBatchTime: 16.426ms - TransmitDataRPCTime: 9.632ms - UncompressedRowBatchSize: 1.55 MB (1626642) CodeGen:(Total: 48.511ms, non-child: 48.511ms, % non-child: 100.00%) - CodegenTime: 1.118ms - CompileTime: 6.415ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 15.117ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 26.539ms HDFS_SCAN_NODE (id=2):(Total: 1s172ms, non-child: 1s172ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:1/87.94 KB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: Only following filters arrived: , waited 943ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:9 BytesRead(500.000ms): 0, 0 - FooterProcessingTime: (Avg: 130.624ms ; Min: 130.624ms ; Max: 130.624ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 174.62 KB (178812) - BytesReadDataNodeCache: 0 - BytesReadLocal: 174.62 KB (178812) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 174.62 KB (178812) - DecompressionTime: 84.764us - MaxCompressedTextFileLength: 0 - NumColumns: 9 (9) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 951.70 KB (974539) - PerReadThreadRawHdfsThroughput: 458.85 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 227.719ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 14.98K (14983) - RowsReturned: 14.98K (14983) - RowsReturnedRate: 12.78 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 232.928ms - MaterializeTupleTime(*): 5.242ms - ScannerThreadsSysTime: 999.000us - ScannerThreadsUserTime: 4.999ms - ScannerThreadsVoluntaryContextSwitches: 15 (15) - TotalRawHdfsReadTime(*): 371.646us - TotalReadThroughput: 0.00 /sec Filter 0 (1.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 14.98K (14983) Instance 7f40dcb034de70b7:67 (host=va1036.foo:22000):(Total: 1s420ms, non-child: 189.638ms, % non-child: 13.35%) Hdfs split stats (:<# splits>/): 1:1/83.58 KB MemoryUsage(500.000ms): 0, 171.90 KB, 307.90 KB ThreadUsage(500.000ms): 1, 1, 2 - AverageThreadTokens: 1.33 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.47 MB (3634177) - PerHostPeakMemUsage: 18.18 MB (19065492) - RowsProduced: 14.21K (14214) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 121.902ms - TotalStorageWaitTime: 218.958ms - TotalThreadsInvoluntaryContextSwitches: 28 (28) - TotalThreadsTotalWallClockTime: 1s589ms - TotalThreadsSysTime: 16.997ms - TotalThreadsUserTime: 59.991ms - TotalThreadsVoluntaryContextSwitches: 396 (396) Fragment Instance Lifecycle Timings: - ExecTime: 1s339ms - ExecTreeExecTime: 1s145ms - OpenTime: 25.231ms - ExecTreeOpenTime: 50.998us - PrepareTime: 55.653ms - ExecTreePrepareTime: 132.623us DataStreamSender (dst_id=27):(Total: 26.141ms, non-child: 26.141ms, % non-child: 100.00%) - BytesSent: 669.16 KB (685221) - NetworkThroughput(*): 64.52 MB/sec - OverallThroughput: 25.00 MB/sec - PeakMemoryUsage: 3.17 MB (3321120) - RowsReturned: 14.21K (14214) - SerializeBatchTime: 15.465ms - TransmitDataRPCTime: 10.128ms - UncompressedRowBatchSize: 1.47 MB (1543321) CodeGen:(Total: 59.136ms, non-child: 59.136ms, % non-child: 100.00%) - CodegenTime: 1.320ms - CompileTime: 6.527ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 17.026ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 35.011ms HDFS_SCAN_NODE (id=2):(Total: 1s145ms, non-child: 1s145ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:1/83.58 KB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: Only following filters arrived: , waited 924ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:9 BytesRead(500.000ms): 0, 0, 0 - FooterProcessingTime: (Avg: 127.083ms ; Min: 127.083ms ; Max: 127.083ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.50 - BytesRead: 165.90 KB (169880) - BytesReadDataNodeCache: 0 - BytesReadLocal: 165.90 KB (169880) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 165.90 KB (169880) - DecompressionTime: 59.961us - MaxCompressedTextFileLength: 0 - NumColumns: 9 (9) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 853.10 KB (873573) - PerReadThreadRawHdfsThroughput: 469.27 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 220.305ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 14.21K (14214) - RowsReturned: 14.21K (14214) - RowsReturnedRate: 12.40 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 224.583ms - MaterializeTupleTime(*): 4.408ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 4.999ms - ScannerThreadsVoluntaryContextSwitches: 12 (12) - TotalRawHdfsReadTime(*): 345.238us - TotalReadThroughput: 0.00 /sec Filter 0 (1.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 14.21K (14214) Instance 7f40dcb034de70b7:6b (host=vc1529.foo:22000):(Total: 1s417ms, non-child: 187.304ms, % non-child: 13.21%) Hdfs split stats (:<# splits>/): 1:1/83.61 KB MemoryUsage(500.000ms): 171.90 KB, 171.90 KB, 307.90 KB ThreadUsage(500.000ms): 1, 1, 2 - AverageThreadTokens: 1.33 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.45 MB (3617793) - PerHostPeakMemUsage: 15.15 MB (15881263) - RowsProduced: 14.21K (14214) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 105.664ms - TotalStorageWaitTime: 215.102ms - TotalThreadsInvoluntaryContextSwitches: 32 (32) - TotalThreadsTotalWallClockTime: 1s600ms - TotalThreadsSysTime: 16.997ms - TotalThreadsUserTime: 61.990ms - TotalThreadsVoluntaryContextSwitches: 409 (409) Fragment Instance Lifecycle Timings: - ExecTime: 1s354ms - ExecTreeExecTime: 1s161ms - OpenTime: 25.481ms - ExecTreeOpenTime: 35.429us - PrepareTime: 38.030ms - ExecTreePrepareTime: 74.038us DataStreamSender (dst_id=27):(Total: 26.194ms, non-child: 26.194ms, % non-child: 100.00%) - BytesSent: 660.16 KB (676007) - NetworkThroughput(*): 62.54 MB/sec - OverallThroughput: 24.61 MB/sec - PeakMemoryUsage: 3.17 MB (3321120) - RowsReturned: 14.21K (14214) - SerializeBatchTime: 15.415ms - TransmitDataRPCTime: 10.308ms - UncompressedRowBatchSize: 1.48 MB (1547683) CodeGen:(Total: 43.012ms, non-child: 43.012ms, % non-child: 100.00%) - CodegenTime: 1.889ms - CompileTime: 6.201ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 17.483ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 18.659ms HDFS_SCAN_NODE (id=2):(Total: 1s161ms, non-child: 1s161ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:1/83.61 KB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: Only following filters arrived: , waited 944ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:9 BytesRead(500.000ms): 0, 0, 0 - FooterProcessingTime: (Avg: 122.692ms ; Min: 122.692ms ; Max: 122.692ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.33 - BytesRead: 165.97 KB (169956) - BytesReadDataNodeCache: 0 - BytesReadLocal: 165.97 KB (169956) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 165.97 KB (169956) - DecompressionTime: 97.098us - MaxCompressedTextFileLength: 0 - NumColumns: 9 (9) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 861.10 KB (881765) - PerReadThreadRawHdfsThroughput: 630.21 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 216.473ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 14.21K (14214) - RowsReturned: 14.21K (14214) - RowsReturnedRate: 12.24 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 2 (2) - ScannerThreadsTotalWallClockTime: 221.034ms - MaterializeTupleTime(*): 4.603ms - ScannerThreadsSysTime: 1.999ms - ScannerThreadsUserTime: 3.999ms - ScannerThreadsVoluntaryContextSwitches: 11 (11) - TotalRawHdfsReadTime(*): 257.190us - TotalReadThroughput: 0.00 /sec Filter 0 (1.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 14.21K (14214) Instance 7f40dcb034de70b7:3d (host=va1037.foo:22000):(Total: 1s415ms, non-child: 171.961ms, % non-child: 12.15%) Hdfs split stats (:<# splits>/): 6:1/87.96 KB MemoryUsage(500.000ms): 171.90 KB, 171.90 KB, 1.89 MB ThreadUsage(500.000ms): 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.55 MB (3718759) - PerHostPeakMemUsage: 15.19 MB (15926014) - RowsProduced: 14.98K (14983) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 99.596ms - TotalStorageWaitTime: 220.405ms - TotalThreadsInvoluntaryContextSwitches: 24 (24) - TotalThreadsTotalWallClockTime: 1s595ms - TotalThreadsSysTime: 12.998ms - TotalThreadsUserTime: 65.989ms - TotalThreadsVoluntaryContextSwitches: 412 (412) Fragment Instance Lifecycle Timings: - ExecTime: 1s341ms - ExecTreeExecTime: 1s167ms - OpenTime: 27.878ms - ExecTreeOpenTime: 40.918us - PrepareTime: 46.360ms - ExecTreePrepareTime: 127.012us DataStreamSender (dst_id=27):(Total: 25.554ms, non-child: 25.554ms, % non-child: 100.00%) - BytesSent: 700.61 KB (717423) - NetworkThroughput(*): 71.41 MB/sec - OverallThroughput: 26.77 MB/sec - PeakMemoryUsage: 3.17 MB (3321120) - RowsReturned: 14.98K (14983) - SerializeBatchTime: 15.371ms - TransmitDataRPCTime: 9.581ms - UncompressedRowBatchSize: 1.55 MB (1622708) CodeGen:(Total: 50.156ms, non-child: 50.156ms, % non-child: 100.00%) - CodegenTime: 1.130ms - CompileTime: 6.852ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 19.215ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 23.545ms HDFS_SCAN_NODE (id=2):(Total: 1s167ms, non-child: 1s167ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 6:1/87.96 KB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: Only following filters arrived: , waited 945ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:9 BytesRead(500.000ms): 0, 0 - FooterProcessingTime: (Avg: 142.519ms ; Min: 142.519ms ; Max: 142.519ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 174.66 KB (178850) - BytesReadDataNodeCache: 0 - BytesReadLocal: 174.66 KB (178850) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 174.66 KB (178850) - DecompressionTime: 61.474us - MaxCompressedTextFileLength: 0 - NumColumns: 9 (9) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 951.70 KB (974539) - PerReadThreadRawHdfsThroughput: 556.52 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 222.031ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 14.98K (14983) - RowsReturned: 14.98K (14983) - RowsReturnedRate: 12.83 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 226.911ms - MaterializeTupleTime(*): 5.097ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 4.999ms - ScannerThreadsVoluntaryContextSwitches: 15 (15) - TotalRawHdfsReadTime(*): 306.486us - TotalReadThroughput: 0.00 /sec Filter 0 (1.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 14.98K (14983) Instance 7f40dcb034de70b7:58 (host=va1031.foo:22000):(Total: 1s414ms, non-child: 172.489ms, % non-child: 12.20%) Hdfs split stats (:<# splits>/): 5:1/85.81 KB MemoryUsage(500.000ms): 163.28 KB, 171.90 KB, 307.90 KB ThreadUsage(500.000ms): 1, 1, 2 - AverageThreadTokens: 1.33 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.57 MB (3747121) - PerHostPeakMemUsage: 15.38 MB (16131939) - RowsProduced: 14.60K (14598) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 90.758ms - TotalStorageWaitTime: 215.699ms - TotalThreadsInvoluntaryContextSwitches: 32 (32) - TotalThreadsTotalWallClockTime: 1s590ms - TotalThreadsSysTime: 15.998ms - TotalThreadsUserTime: 61.990ms - TotalThreadsVoluntaryContextSwitches: 412 (412) Fragment Instance Lifecycle Timings: - ExecTime: 1s341ms - ExecTreeExecTime: 1s163ms - OpenTime: 27.087ms - ExecTreeOpenTime: 46.690us - PrepareTime: 45.201ms - ExecTreePrepareTime: 115.339us DataStreamSender (dst_id=27):(Total: 24.894ms, non-child: 24.894ms, % non-child: 100.00%) - BytesSent: 682.46 KB (698838) - NetworkThroughput(*): 71.38 MB/sec - OverallThroughput: 26.77 MB/sec - PeakMemoryUsage: 3.17 MB (3321120) - RowsReturned: 14.60K (14598) - SerializeBatchTime: 15.048ms - TransmitDataRPCTime: 9.336ms - UncompressedRowBatchSize: 1.51 MB (1580670) CodeGen:(Total: 53.304ms, non-child: 53.304ms, % non-child: 100.00%) - CodegenTime: 1.450ms - CompileTime: 6.895ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 18.445ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 27.248ms HDFS_SCAN_NODE (id=2):(Total: 1s163ms, non-child: 1s163ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:1/85.81 KB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: Only following filters arrived: , waited 944ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:9 BytesRead(500.000ms): 0, 0, 0 - FooterProcessingTime: (Avg: 133.747ms ; Min: 133.747ms ; Max: 133.747ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.50 - BytesRead: 170.37 KB (174462) - BytesReadDataNodeCache: 0 - BytesReadLocal: 170.37 KB (174462) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 170.37 KB (174462) - DecompressionTime: 90.061us - MaxCompressedTextFileLength: 0 - NumColumns: 9 (9) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 863.40 KB (884117) - PerReadThreadRawHdfsThroughput: 644.23 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 217.008ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 14.60K (14598) - RowsReturned: 14.60K (14598) - RowsReturnedRate: 12.54 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 1 (1) - ScannerThreadsTotalWallClockTime: 221.743ms - MaterializeTupleTime(*): 4.953ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 5.999ms - ScannerThreadsVoluntaryContextSwitches: 11 (11) - TotalRawHdfsReadTime(*): 258.260us - TotalReadThroughput: 0.00 /sec Filter 0 (1.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 14.60K (14598) Instance 7f40dcb034de70b7:54 (host=vc1508.foo:22000):(Total: 1s414ms, non-child: 177.544ms, % non-child: 12.56%) Hdfs split stats (:<# splits>/): 7:1/88.01 KB MemoryUsage(500.000ms): 171.90 KB, 171.90 KB ThreadUsage(500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.58 MB (3751527) - PerHostPeakMemUsage: 16.18 MB (16968048) - RowsProduced: 14.98K (14983) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 92.472ms - TotalStorageWaitTime: 214.765ms - TotalThreadsInvoluntaryContextSwitches: 22 (22) - TotalThreadsTotalWallClockTime: 1s587ms - TotalThreadsSysTime: 14.997ms - TotalThreadsUserTime: 59.990ms - TotalThreadsVoluntaryContextSwitches: 403 (403) Fragment Instance Lifecycle Timings: - ExecTime: 1s344ms - ExecTreeExecTime: 1s161ms - OpenTime: 22.770ms - ExecTreeOpenTime: 38.743us - PrepareTime: 46.712ms - ExecTreePrepareTime: 115.713us DataStreamSender (dst_id=27):(Total: 27.555ms, non-child: 27.555ms, % non-child: 100.00%) - BytesSent: 707.92 KB (724906) - NetworkThroughput(*): 67.30 MB/sec - OverallThroughput: 25.09 MB/sec - PeakMemoryUsage: 3.17 MB (3321120) - RowsReturned: 14.98K (14983) - SerializeBatchTime: 16.790ms - TransmitDataRPCTime: 10.272ms - UncompressedRowBatchSize: 1.55 MB (1623598) CodeGen:(Total: 47.394ms, non-child: 47.394ms, % non-child: 100.00%) - CodegenTime: 949.626us - CompileTime: 5.846ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 15.524ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 25.353ms HDFS_SCAN_NODE (id=2):(Total: 1s161ms, non-child: 1s161ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:1/88.01 KB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: Only following filters arrived: , waited 944ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:9 BytesRead(500.000ms): 0, 0 - FooterProcessingTime: (Avg: 125.537ms ; Min: 125.537ms ; Max: 125.537ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 174.76 KB (178952) - BytesReadDataNodeCache: 0 - BytesReadLocal: 174.76 KB (178952) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 174.76 KB (178952) - DecompressionTime: 67.942us - MaxCompressedTextFileLength: 0 - NumColumns: 9 (9) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 951.70 KB (974539) - PerReadThreadRawHdfsThroughput: 507.56 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 216.166ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 14.98K (14983) - RowsReturned: 14.98K (14983) - RowsReturnedRate: 12.90 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 1 (1) - ScannerThreadsTotalWallClockTime: 220.971ms - MaterializeTupleTime(*): 4.927ms - ScannerThreadsSysTime: 999.000us - ScannerThreadsUserTime: 4.999ms - ScannerThreadsVoluntaryContextSwitches: 12 (12) - TotalRawHdfsReadTime(*): 336.242us - TotalReadThroughput: 0.00 /sec Filter 0 (1.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 14.98K (14983) Instance 7f40dcb034de70b7:13 (host=vd1115.foo:22000):(Total: 1s412ms, non-child: 146.561ms, % non-child: 10.37%) Hdfs split stats (:<# splits>/): 4:1/88.02 KB 2:1/83.60 KB MemoryUsage(500.000ms): 171.90 KB, 171.90 KB, 443.90 KB ThreadUsage(500.000ms): 1, 1, 3 - AverageThreadTokens: 1.67 - BloomFilterBytes: 0 - PeakMemoryUsage: 4.88 MB (5114568) - PerHostPeakMemUsage: 14.90 MB (15619733) - RowsProduced: 29.20K (29196) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 82.012ms - TotalStorageWaitTime: 452.392ms - TotalThreadsInvoluntaryContextSwitches: 27 (27) - TotalThreadsTotalWallClockTime: 1s830ms - TotalThreadsSysTime: 26.994ms - TotalThreadsUserTime: 64.989ms - TotalThreadsVoluntaryContextSwitches: 421 (421) Fragment Instance Lifecycle Timings: - ExecTime: 1s341ms - ExecTreeExecTime: 1s171ms - OpenTime: 22.719ms - ExecTreeOpenTime: 33.217us - PrepareTime: 48.543ms - ExecTreePrepareTime: 114.641us DataStreamSender (dst_id=27):(Total: 44.865ms, non-child: 44.865ms, % non-child: 100.00%) - BytesSent: 1.34 MB (1404682) - NetworkThroughput(*): 59.38 MB/sec - OverallThroughput: 29.86 MB/sec - PeakMemoryUsage: 3.17 MB (3321120) - RowsReturned: 29.20K (29196) - SerializeBatchTime: 21.820ms - TransmitDataRPCTime: 22.558ms - UncompressedRowBatchSize: 3.02 MB (3170734) CodeGen:(Total: 49.356ms, non-child: 49.356ms, % non-child: 100.00%) - CodegenTime: 1.226ms - CompileTime: 5.824ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 15.622ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 27.374ms HDFS_SCAN_NODE (id=2):(Total: 1s172ms, non-child: 1s172ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:1/88.02 KB 2:1/83.60 KB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 2 out of 2 Runtime filters: Only following filters arrived: , waited 944ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:18 BytesRead(500.000ms): 0, 0, 0 - FooterProcessingTime: (Avg: 121.202ms ; Min: 116.204ms ; Max: 126.199ms ; Number of samples: 2) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.67 - BytesRead: 340.74 KB (348922) - BytesReadDataNodeCache: 0 - BytesReadLocal: 340.74 KB (348922) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 340.74 KB (348922) - DecompressionTime: 181.148us - MaxCompressedTextFileLength: 0 - NumColumns: 9 (9) - NumDisksAccessed: 2 (2) - NumRowGroups: 2 (2) - NumScannerThreadsStarted: 2 (2) - PeakMemoryUsage: 1.62 MB (1696556) - PerReadThreadRawHdfsThroughput: 453.25 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 226.156ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 29.20K (29196) - RowsReturned: 29.20K (29196) - RowsReturnedRate: 24.91 K/sec - ScanRangesComplete: 2 (2) - ScannerThreadsInvoluntaryContextSwitches: 1 (1) - ScannerThreadsTotalWallClockTime: 466.552ms - MaterializeTupleTime(*): 11.034ms - ScannerThreadsSysTime: 2.998ms - ScannerThreadsUserTime: 10.998ms - ScannerThreadsVoluntaryContextSwitches: 30 (30) - TotalRawHdfsReadTime(*): 734.162us - TotalReadThroughput: 0.00 /sec Filter 0 (1.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 29.20K (29196) Instance 7f40dcb034de70b7:2e (host=vd1104.foo:22000):(Total: 1s412ms, non-child: 148.440ms, % non-child: 10.51%) Hdfs split stats (:<# splits>/): 3:1/83.60 KB 2:1/83.63 KB MemoryUsage(500.000ms): 0, 171.90 KB, 443.90 KB ThreadUsage(500.000ms): 1, 1, 3 - AverageThreadTokens: 1.67 - BloomFilterBytes: 0 - PeakMemoryUsage: 4.87 MB (5101670) - PerHostPeakMemUsage: 15.21 MB (15952796) - RowsProduced: 28.43K (28428) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 80.472ms - TotalStorageWaitTime: 457.453ms - TotalThreadsInvoluntaryContextSwitches: 24 (24) - TotalThreadsTotalWallClockTime: 1s821ms - TotalThreadsSysTime: 25.995ms - TotalThreadsUserTime: 74.988ms - TotalThreadsVoluntaryContextSwitches: 533 (533) Fragment Instance Lifecycle Timings: - ExecTime: 1s326ms - ExecTreeExecTime: 1s154ms - OpenTime: 20.889ms - ExecTreeOpenTime: 36.318us - PrepareTime: 65.163ms - ExecTreePrepareTime: 155.536us DataStreamSender (dst_id=27):(Total: 50.290ms, non-child: 50.290ms, % non-child: 100.00%) - BytesSent: 1.30 MB (1364605) - NetworkThroughput(*): 52.31 MB/sec - OverallThroughput: 25.88 MB/sec - PeakMemoryUsage: 3.17 MB (3321120) - RowsReturned: 28.43K (28428) - SerializeBatchTime: 24.733ms - TransmitDataRPCTime: 24.879ms - UncompressedRowBatchSize: 2.94 MB (3087056) CodeGen:(Total: 59.468ms, non-child: 59.468ms, % non-child: 100.00%) - CodegenTime: 1.059ms - CompileTime: 5.476ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 14.182ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 39.327ms HDFS_SCAN_NODE (id=2):(Total: 1s154ms, non-child: 1s154ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:1/83.60 KB 2:1/83.63 KB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 2 out of 2 Runtime filters: Only following filters arrived: , waited 923ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:18 BytesRead(500.000ms): 0, 0, 0 - FooterProcessingTime: (Avg: 126.142ms ; Min: 126.019ms ; Max: 126.266ms ; Number of samples: 2) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 331.95 KB (339916) - BytesReadDataNodeCache: 0 - BytesReadLocal: 331.95 KB (339916) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 331.95 KB (339916) - DecompressionTime: 324.689us - MaxCompressedTextFileLength: 0 - NumColumns: 9 (9) - NumDisksAccessed: 2 (2) - NumRowGroups: 2 (2) - NumScannerThreadsStarted: 2 (2) - PeakMemoryUsage: 2.16 MB (2261194) - PerReadThreadRawHdfsThroughput: 361.50 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 229.132ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 28.43K (28428) - RowsReturned: 28.43K (28428) - RowsReturnedRate: 24.62 K/sec - ScanRangesComplete: 2 (2) - ScannerThreadsInvoluntaryContextSwitches: 4 (4) - ScannerThreadsTotalWallClockTime: 474.315ms - MaterializeTupleTime(*): 12.955ms - ScannerThreadsSysTime: 6.998ms - ScannerThreadsUserTime: 7.998ms - ScannerThreadsVoluntaryContextSwitches: 88 (88) - TotalRawHdfsReadTime(*): 896.732us - TotalReadThroughput: 0.00 /sec Filter 0 (1.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 28.43K (28428) Instance 7f40dcb034de70b7:3e (host=vd1111.foo:22000):(Total: 1s411ms, non-child: 169.433ms, % non-child: 12.00%) Hdfs split stats (:<# splits>/): 4:1/87.96 KB MemoryUsage(500.000ms): 0, 171.90 KB, 171.90 KB ThreadUsage(500.000ms): 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.56 MB (3735143) - PerHostPeakMemUsage: 15.31 MB (16049569) - RowsProduced: 14.98K (14983) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 82.299ms - TotalStorageWaitTime: 217.697ms - TotalThreadsInvoluntaryContextSwitches: 35 (35) - TotalThreadsTotalWallClockTime: 1s590ms - TotalThreadsSysTime: 18.996ms - TotalThreadsUserTime: 62.990ms - TotalThreadsVoluntaryContextSwitches: 413 (413) Fragment Instance Lifecycle Timings: - ExecTime: 1s338ms - ExecTreeExecTime: 1s164ms - OpenTime: 29.109ms - ExecTreeOpenTime: 41.206us - PrepareTime: 44.083ms - ExecTreePrepareTime: 141.095us DataStreamSender (dst_id=27):(Total: 26.267ms, non-child: 26.267ms, % non-child: 100.00%) - BytesSent: 698.22 KB (714979) - NetworkThroughput(*): 71.62 MB/sec - OverallThroughput: 25.96 MB/sec - PeakMemoryUsage: 3.17 MB (3321120) - RowsReturned: 14.98K (14983) - SerializeBatchTime: 16.150ms - TransmitDataRPCTime: 9.521ms - UncompressedRowBatchSize: 1.55 MB (1628161) CodeGen:(Total: 51.744ms, non-child: 51.744ms, % non-child: 100.00%) - CodegenTime: 1.243ms - CompileTime: 7.101ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 19.635ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 24.380ms HDFS_SCAN_NODE (id=2):(Total: 1s164ms, non-child: 1s164ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:1/87.96 KB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: Only following filters arrived: , waited 944ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:9 BytesRead(500.000ms): 0, 0, 0 - FooterProcessingTime: (Avg: 118.706ms ; Min: 118.706ms ; Max: 118.706ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 174.67 KB (178860) - BytesReadDataNodeCache: 0 - BytesReadLocal: 174.67 KB (178860) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 174.67 KB (178860) - DecompressionTime: 58.397us - MaxCompressedTextFileLength: 0 - NumColumns: 9 (9) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 1.03 MB (1078987) - PerReadThreadRawHdfsThroughput: 647.09 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 218.956ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 14.98K (14983) - RowsReturned: 14.98K (14983) - RowsReturnedRate: 12.87 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 1 (1) - ScannerThreadsTotalWallClockTime: 223.893ms - MaterializeTupleTime(*): 5.036ms - ScannerThreadsSysTime: 1.999ms - ScannerThreadsUserTime: 2.999ms - ScannerThreadsVoluntaryContextSwitches: 11 (11) - TotalRawHdfsReadTime(*): 263.603us - TotalReadThroughput: 0.00 /sec Filter 0 (1.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 14.98K (14983) Instance 7f40dcb034de70b7:63 (host=vd1329.foo:22000):(Total: 1s411ms, non-child: 174.621ms, % non-child: 12.38%) Hdfs split stats (:<# splits>/): 6:1/87.95 KB MemoryUsage(500.000ms): 171.90 KB, 171.90 KB, 307.90 KB ThreadUsage(500.000ms): 1, 1, 2 - AverageThreadTokens: 1.33 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.56 MB (3735135) - PerHostPeakMemUsage: 15.18 MB (15919145) - RowsProduced: 14.98K (14981) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 96.706ms - TotalStorageWaitTime: 204.908ms - TotalThreadsInvoluntaryContextSwitches: 32 (32) - TotalThreadsTotalWallClockTime: 1s573ms - TotalThreadsSysTime: 16.997ms - TotalThreadsUserTime: 66.989ms - TotalThreadsVoluntaryContextSwitches: 411 (411) Fragment Instance Lifecycle Timings: - ExecTime: 1s335ms - ExecTreeExecTime: 1s152ms - OpenTime: 25.784ms - ExecTreeOpenTime: 50.532us - PrepareTime: 49.608ms - ExecTreePrepareTime: 141.288us DataStreamSender (dst_id=27):(Total: 31.189ms, non-child: 31.189ms, % non-child: 100.00%) - BytesSent: 700.90 KB (717725) - NetworkThroughput(*): 58.90 MB/sec - OverallThroughput: 21.95 MB/sec - PeakMemoryUsage: 3.17 MB (3321120) - RowsReturned: 14.98K (14981) - SerializeBatchTime: 18.831ms - TransmitDataRPCTime: 11.621ms - UncompressedRowBatchSize: 1.55 MB (1626120) CodeGen:(Total: 52.617ms, non-child: 52.617ms, % non-child: 100.00%) - CodegenTime: 1.257ms - CompileTime: 7.178ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 17.031ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 27.819ms HDFS_SCAN_NODE (id=2):(Total: 1s152ms, non-child: 1s152ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 6:1/87.95 KB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: Only following filters arrived: , waited 944ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:9 BytesRead(500.000ms): 0, 0, 0 - FooterProcessingTime: (Avg: 116.371ms ; Min: 116.371ms ; Max: 116.371ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.33 - BytesRead: 174.64 KB (178834) - BytesReadDataNodeCache: 0 - BytesReadLocal: 174.64 KB (178834) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 174.64 KB (178834) - DecompressionTime: 103.557us - MaxCompressedTextFileLength: 0 - NumColumns: 9 (9) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 1.02 MB (1070787) - PerReadThreadRawHdfsThroughput: 434.34 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 206.698ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 14.98K (14981) - RowsReturned: 14.98K (14981) - RowsReturnedRate: 13.00 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 1 (1) - ScannerThreadsTotalWallClockTime: 212.275ms - MaterializeTupleTime(*): 5.844ms - ScannerThreadsSysTime: 999.000us - ScannerThreadsUserTime: 4.999ms - ScannerThreadsVoluntaryContextSwitches: 22 (22) - TotalRawHdfsReadTime(*): 392.666us - TotalReadThroughput: 0.00 /sec Filter 0 (1.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 14.98K (14981) Instance 7f40dcb034de70b7:26 (host=vc1541.foo:22000):(Total: 1s403ms, non-child: 151.825ms, % non-child: 10.82%) Hdfs split stats (:<# splits>/): 7:1/88.01 KB MemoryUsage(500.000ms): 171.90 KB, 171.90 KB ThreadUsage(500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.56 MB (3735143) - PerHostPeakMemUsage: 17.93 MB (18805390) - RowsProduced: 14.98K (14983) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 84.862ms - TotalStorageWaitTime: 221.821ms - TotalThreadsInvoluntaryContextSwitches: 40 (40) - TotalThreadsTotalWallClockTime: 1s592ms - TotalThreadsSysTime: 29.994ms - TotalThreadsUserTime: 57.991ms - TotalThreadsVoluntaryContextSwitches: 443 (443) Fragment Instance Lifecycle Timings: - ExecTime: 1s340ms - ExecTreeExecTime: 1s168ms - OpenTime: 22.033ms - ExecTreeOpenTime: 33.136us - PrepareTime: 41.393ms - ExecTreePrepareTime: 62.139us DataStreamSender (dst_id=27):(Total: 38.270ms, non-child: 38.270ms, % non-child: 100.00%) - BytesSent: 696.58 KB (713300) - NetworkThroughput(*): 48.43 MB/sec - OverallThroughput: 17.78 MB/sec - PeakMemoryUsage: 3.17 MB (3321120) - RowsReturned: 14.98K (14983) - SerializeBatchTime: 23.700ms - TransmitDataRPCTime: 14.046ms - UncompressedRowBatchSize: 1.56 MB (1633305) CodeGen:(Total: 44.504ms, non-child: 44.504ms, % non-child: 100.00%) - CodegenTime: 1.020ms - CompileTime: 5.561ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 15.168ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 23.297ms HDFS_SCAN_NODE (id=2):(Total: 1s169ms, non-child: 1s169ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:1/88.01 KB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: Only following filters arrived: , waited 944ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:9 BytesRead(500.000ms): 0, 0 - FooterProcessingTime: (Avg: 106.841ms ; Min: 106.841ms ; Max: 106.841ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 174.77 KB (178966) - BytesReadDataNodeCache: 0 - BytesReadLocal: 174.77 KB (178966) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 174.77 KB (178966) - DecompressionTime: 76.330us - MaxCompressedTextFileLength: 0 - NumColumns: 9 (9) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 763.70 KB (782027) - PerReadThreadRawHdfsThroughput: 421.59 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 223.355ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 14.98K (14983) - RowsReturned: 14.98K (14983) - RowsReturnedRate: 12.82 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 1 (1) - ScannerThreadsTotalWallClockTime: 230.569ms - MaterializeTupleTime(*): 7.344ms - ScannerThreadsSysTime: 999.000us - ScannerThreadsUserTime: 4.999ms - ScannerThreadsVoluntaryContextSwitches: 13 (13) - TotalRawHdfsReadTime(*): 404.836us - TotalReadThroughput: 0.00 /sec Filter 0 (1.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 14.98K (14983) Instance 7f40dcb034de70b7:29 (host=vc1522.foo:22000):(Total: 1s402ms, non-child: 141.558ms, % non-child: 10.09%) Hdfs split stats (:<# splits>/): 5:1/85.82 KB 6:1/85.74 KB MemoryUsage(500.000ms): 171.90 KB, 171.90 KB, 443.90 KB ThreadUsage(500.000ms): 1, 1, 3 - AverageThreadTokens: 1.67 - BloomFilterBytes: 0 - PeakMemoryUsage: 4.65 MB (4871477) - PerHostPeakMemUsage: 17.80 MB (18665876) - RowsProduced: 29.20K (29196) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 74.866ms - TotalStorageWaitTime: 440.932ms - TotalThreadsInvoluntaryContextSwitches: 24 (24) - TotalThreadsTotalWallClockTime: 1s806ms - TotalThreadsSysTime: 22.996ms - TotalThreadsUserTime: 69.989ms - TotalThreadsVoluntaryContextSwitches: 429 (429) Fragment Instance Lifecycle Timings: - ExecTime: 1s328ms - ExecTreeExecTime: 1s164ms - OpenTime: 25.093ms - ExecTreeOpenTime: 36.928us - PrepareTime: 49.163ms - ExecTreePrepareTime: 127.032us DataStreamSender (dst_id=27):(Total: 45.487ms, non-child: 45.487ms, % non-child: 100.00%) - BytesSent: 1.34 MB (1405869) - NetworkThroughput(*): 57.02 MB/sec - OverallThroughput: 29.48 MB/sec - PeakMemoryUsage: 3.17 MB (3321120) - RowsReturned: 29.20K (29196) - SerializeBatchTime: 21.547ms - TransmitDataRPCTime: 23.514ms - UncompressedRowBatchSize: 3.03 MB (3172217) CodeGen:(Total: 50.891ms, non-child: 50.891ms, % non-child: 100.00%) - CodegenTime: 1.026ms - CompileTime: 6.034ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 17.758ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 26.472ms HDFS_SCAN_NODE (id=2):(Total: 1s164ms, non-child: 1s164ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:1/85.82 KB 6:1/85.74 KB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 2 out of 2 Runtime filters: Only following filters arrived: , waited 945ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:18 BytesRead(500.000ms): 0, 0, 0 - FooterProcessingTime: (Avg: 119.617ms ; Min: 111.799ms ; Max: 127.435ms ; Number of samples: 2) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.67 - BytesRead: 340.62 KB (348792) - BytesReadDataNodeCache: 0 - BytesReadLocal: 340.62 KB (348792) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 340.62 KB (348792) - DecompressionTime: 132.258us - MaxCompressedTextFileLength: 0 - NumColumns: 9 (9) - NumDisksAccessed: 2 (2) - NumRowGroups: 2 (2) - NumScannerThreadsStarted: 2 (2) - PeakMemoryUsage: 1.39 MB (1453465) - PerReadThreadRawHdfsThroughput: 495.95 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 219.030ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 29.20K (29196) - RowsReturned: 29.20K (29196) - RowsReturnedRate: 25.06 K/sec - ScanRangesComplete: 2 (2) - ScannerThreadsInvoluntaryContextSwitches: 3 (3) - ScannerThreadsTotalWallClockTime: 453.566ms - MaterializeTupleTime(*): 10.133ms - ScannerThreadsSysTime: 1.999ms - ScannerThreadsUserTime: 9.998ms - ScannerThreadsVoluntaryContextSwitches: 22 (22) - TotalRawHdfsReadTime(*): 670.705us - TotalReadThroughput: 0.00 /sec Filter 0 (1.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 29.20K (29196) Instance 7f40dcb034de70b7:57 (host=va1028.foo:22000):(Total: 1s399ms, non-child: 151.718ms, % non-child: 10.84%) Hdfs split stats (:<# splits>/): 1:1/87.94 KB 7:1/83.52 KB MemoryUsage(500.000ms): 171.90 KB, 171.90 KB, 472.67 KB ThreadUsage(500.000ms): 1, 1, 3 - AverageThreadTokens: 1.67 - BloomFilterBytes: 0 - PeakMemoryUsage: 5.06 MB (5302976) - PerHostPeakMemUsage: 17.48 MB (18332632) - RowsProduced: 29.19K (29194) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 93.833ms - TotalStorageWaitTime: 437.306ms - TotalThreadsInvoluntaryContextSwitches: 20 (20) - TotalThreadsTotalWallClockTime: 1s795ms - TotalThreadsSysTime: 13.998ms - TotalThreadsUserTime: 83.987ms - TotalThreadsVoluntaryContextSwitches: 395 (395) Fragment Instance Lifecycle Timings: - ExecTime: 1s320ms - ExecTreeExecTime: 1s144ms - OpenTime: 26.081ms - ExecTreeOpenTime: 39.919us - PrepareTime: 53.008ms - ExecTreePrepareTime: 136.471us DataStreamSender (dst_id=27):(Total: 49.599ms, non-child: 49.599ms, % non-child: 100.00%) - BytesSent: 1.33 MB (1396582) - NetworkThroughput(*): 58.62 MB/sec - OverallThroughput: 26.85 MB/sec - PeakMemoryUsage: 3.17 MB (3321120) - RowsReturned: 29.19K (29194) - SerializeBatchTime: 26.009ms - TransmitDataRPCTime: 22.719ms - UncompressedRowBatchSize: 3.02 MB (3165022) CodeGen:(Total: 54.022ms, non-child: 54.022ms, % non-child: 100.00%) - CodegenTime: 1.259ms - CompileTime: 6.676ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 17.837ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 28.964ms HDFS_SCAN_NODE (id=2):(Total: 1s144ms, non-child: 1s144ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:1/87.94 KB 7:1/83.52 KB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 2 out of 2 Runtime filters: Only following filters arrived: , waited 925ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:18 BytesRead(500.000ms): 0, 0, 175.72 KB - FooterProcessingTime: (Avg: 111.323ms ; Min: 110.329ms ; Max: 112.316ms ; Number of samples: 2) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.67 - BytesRead: 340.43 KB (348596) - BytesReadDataNodeCache: 0 - BytesReadLocal: 340.43 KB (348596) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 340.43 KB (348596) - DecompressionTime: 123.557us - MaxCompressedTextFileLength: 0 - NumColumns: 9 (9) - NumDisksAccessed: 2 (2) - NumRowGroups: 2 (2) - NumScannerThreadsStarted: 2 (2) - PeakMemoryUsage: 1.99 MB (2081572) - PerReadThreadRawHdfsThroughput: 468.80 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 218.651ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 29.19K (29194) - RowsReturned: 29.19K (29194) - RowsReturnedRate: 25.50 K/sec - ScanRangesComplete: 2 (2) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 449.021ms - MaterializeTupleTime(*): 9.039ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 10.998ms - ScannerThreadsVoluntaryContextSwitches: 24 (24) - TotalRawHdfsReadTime(*): 709.144us - TotalReadThroughput: 117.14 KB/sec Filter 0 (1.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 29.19K (29194) Instance 7f40dcb034de70b7:4e (host=vc1504.foo:22000):(Total: 1s399ms, non-child: 144.072ms, % non-child: 10.29%) Hdfs split stats (:<# splits>/): 7:1/85.82 KB 6:1/85.77 KB MemoryUsage(500.000ms): 171.90 KB, 171.90 KB, 3.34 MB ThreadUsage(500.000ms): 1, 1, 2 - AverageThreadTokens: 1.33 - BloomFilterBytes: 0 - PeakMemoryUsage: 4.21 MB (4410661) - PerHostPeakMemUsage: 14.16 MB (14848367) - RowsProduced: 29.19K (29193) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 81.318ms - TotalStorageWaitTime: 413.613ms - TotalThreadsInvoluntaryContextSwitches: 26 (26) - TotalThreadsTotalWallClockTime: 1s780ms - TotalThreadsSysTime: 19.996ms - TotalThreadsUserTime: 66.990ms - TotalThreadsVoluntaryContextSwitches: 421 (421) Fragment Instance Lifecycle Timings: - ExecTime: 1s331ms - ExecTreeExecTime: 1s162ms - OpenTime: 22.622ms - ExecTreeOpenTime: 30.629us - PrepareTime: 44.879ms - ExecTreePrepareTime: 115.512us DataStreamSender (dst_id=27):(Total: 45.694ms, non-child: 45.694ms, % non-child: 100.00%) - BytesSent: 1.34 MB (1410180) - NetworkThroughput(*): 56.19 MB/sec - OverallThroughput: 29.43 MB/sec - PeakMemoryUsage: 3.17 MB (3321120) - RowsReturned: 29.19K (29193) - SerializeBatchTime: 21.190ms - TransmitDataRPCTime: 23.935ms - UncompressedRowBatchSize: 3.03 MB (3172134) CodeGen:(Total: 46.728ms, non-child: 46.728ms, % non-child: 100.00%) - CodegenTime: 1.335ms - CompileTime: 5.825ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 15.480ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 24.896ms HDFS_SCAN_NODE (id=2):(Total: 1s162ms, non-child: 1s162ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:1/85.82 KB 6:1/85.77 KB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 2 out of 2 Runtime filters: Only following filters arrived: , waited 945ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:18 BytesRead(500.000ms): 0, 0, 258.47 KB - FooterProcessingTime: (Avg: 118.076ms ; Min: 115.356ms ; Max: 120.796ms ; Number of samples: 2) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.33 - BytesRead: 340.67 KB (348844) - BytesReadDataNodeCache: 0 - BytesReadLocal: 340.67 KB (348844) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 340.67 KB (348844) - DecompressionTime: 190.311us - MaxCompressedTextFileLength: 0 - NumColumns: 9 (9) - NumDisksAccessed: 2 (2) - NumRowGroups: 2 (2) - NumScannerThreadsStarted: 2 (2) - PeakMemoryUsage: 1.21 MB (1269129) - PerReadThreadRawHdfsThroughput: 454.00 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 217.019ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 29.19K (29193) - RowsReturned: 29.19K (29193) - RowsReturnedRate: 25.10 K/sec - ScanRangesComplete: 2 (2) - ScannerThreadsInvoluntaryContextSwitches: 2 (2) - ScannerThreadsTotalWallClockTime: 425.861ms - MaterializeTupleTime(*): 9.542ms - ScannerThreadsSysTime: 999.000us - ScannerThreadsUserTime: 9.998ms - ScannerThreadsVoluntaryContextSwitches: 17 (17) - TotalRawHdfsReadTime(*): 732.777us - TotalReadThroughput: 172.31 KB/sec Filter 0 (1.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 29.19K (29193) Instance 7f40dcb034de70b7:a (host=vd1333.foo:22000):(Total: 1s399ms, non-child: 150.923ms, % non-child: 10.78%) Hdfs split stats (:<# splits>/): 0:1/87.98 KB MemoryUsage(500.000ms): 171.90 KB, 171.90 KB ThreadUsage(500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.55 MB (3718759) - PerHostPeakMemUsage: 17.83 MB (18697528) - RowsProduced: 14.98K (14983) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 80.282ms - TotalStorageWaitTime: 221.634ms - TotalThreadsInvoluntaryContextSwitches: 35 (35) - TotalThreadsTotalWallClockTime: 1s575ms - TotalThreadsSysTime: 15.998ms - TotalThreadsUserTime: 60.990ms - TotalThreadsVoluntaryContextSwitches: 424 (424) Fragment Instance Lifecycle Timings: - ExecTime: 1s322ms - ExecTreeExecTime: 1s167ms - OpenTime: 28.095ms - ExecTreeOpenTime: 39.798us - PrepareTime: 48.464ms - ExecTreePrepareTime: 110.142us DataStreamSender (dst_id=27):(Total: 25.689ms, non-child: 25.689ms, % non-child: 100.00%) - BytesSent: 699.70 KB (716490) - NetworkThroughput(*): 73.17 MB/sec - OverallThroughput: 26.60 MB/sec - PeakMemoryUsage: 3.17 MB (3321120) - RowsReturned: 14.98K (14983) - SerializeBatchTime: 15.674ms - TransmitDataRPCTime: 9.338ms - UncompressedRowBatchSize: 1.55 MB (1629589) CodeGen:(Total: 54.773ms, non-child: 54.773ms, % non-child: 100.00%) - CodegenTime: 1.830ms - CompileTime: 7.203ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 18.690ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 28.007ms HDFS_SCAN_NODE (id=2):(Total: 1s168ms, non-child: 1s168ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/87.98 KB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: Only following filters arrived: , waited 944ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:9 BytesRead(500.000ms): 0, 0 - FooterProcessingTime: (Avg: 115.355ms ; Min: 115.355ms ; Max: 115.355ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 174.70 KB (178894) - BytesReadDataNodeCache: 0 - BytesReadLocal: 174.70 KB (178894) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 174.70 KB (178894) - DecompressionTime: 53.224us - MaxCompressedTextFileLength: 0 - NumColumns: 9 (9) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 1.30 MB (1367755) - PerReadThreadRawHdfsThroughput: 543.38 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 222.749ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 14.98K (14983) - RowsReturned: 14.98K (14983) - RowsReturnedRate: 12.83 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 225.215ms - MaterializeTupleTime(*): 2.600ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 2.999ms - ScannerThreadsVoluntaryContextSwitches: 20 (20) - TotalRawHdfsReadTime(*): 313.972us - TotalReadThroughput: 0.00 /sec Filter 0 (1.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 14.98K (14983) Instance 7f40dcb034de70b7:39 (host=vd1341.foo:22000):(Total: 1s399ms, non-child: 153.491ms, % non-child: 10.97%) Hdfs split stats (:<# splits>/): 4:1/85.88 KB MemoryUsage(500.000ms): 171.90 KB, 171.90 KB ThreadUsage(500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.54 MB (3716401) - PerHostPeakMemUsage: 15.11 MB (15841718) - RowsProduced: 14.60K (14598) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 80.156ms - TotalStorageWaitTime: 227.426ms - TotalThreadsInvoluntaryContextSwitches: 34 (34) - TotalThreadsTotalWallClockTime: 1s589ms - TotalThreadsSysTime: 19.997ms - TotalThreadsUserTime: 54.991ms - TotalThreadsVoluntaryContextSwitches: 401 (401) Fragment Instance Lifecycle Timings: - ExecTime: 1s333ms - ExecTreeExecTime: 1s173ms - OpenTime: 25.522ms - ExecTreeOpenTime: 29.725us - PrepareTime: 40.173ms - ExecTreePrepareTime: 73.690us DataStreamSender (dst_id=27):(Total: 25.830ms, non-child: 25.830ms, % non-child: 100.00%) - BytesSent: 685.82 KB (702281) - NetworkThroughput(*): 70.25 MB/sec - OverallThroughput: 25.93 MB/sec - PeakMemoryUsage: 3.17 MB (3321120) - RowsReturned: 14.60K (14598) - SerializeBatchTime: 15.796ms - TransmitDataRPCTime: 9.533ms - UncompressedRowBatchSize: 1.51 MB (1581525) CodeGen:(Total: 45.735ms, non-child: 45.735ms, % non-child: 100.00%) - CodegenTime: 1.010ms - CompileTime: 6.743ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 17.630ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 20.938ms HDFS_SCAN_NODE (id=2):(Total: 1s174ms, non-child: 1s174ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:1/85.88 KB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: Only following filters arrived: , waited 944ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:9 BytesRead(500.000ms): 0, 0 - FooterProcessingTime: (Avg: 130.578ms ; Min: 130.578ms ; Max: 130.578ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 170.49 KB (174586) - BytesReadDataNodeCache: 0 - BytesReadLocal: 170.49 KB (174586) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 170.49 KB (174586) - DecompressionTime: 58.773us - MaxCompressedTextFileLength: 0 - NumColumns: 9 (9) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 1.21 MB (1269141) - PerReadThreadRawHdfsThroughput: 477.39 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 228.688ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 14.60K (14598) - RowsReturned: 14.60K (14598) - RowsReturnedRate: 12.43 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 4 (4) - ScannerThreadsTotalWallClockTime: 231.307ms - MaterializeTupleTime(*): 2.954ms - ScannerThreadsSysTime: 999.000us - ScannerThreadsUserTime: 1.999ms - ScannerThreadsVoluntaryContextSwitches: 12 (12) - TotalRawHdfsReadTime(*): 348.770us - TotalReadThroughput: 0.00 /sec Filter 0 (1.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 14.60K (14598) Instance 7f40dcb034de70b7:c (host=vd1126.foo:22000):(Total: 1s398ms, non-child: 146.521ms, % non-child: 10.48%) Hdfs split stats (:<# splits>/): 2:1/88.07 KB MemoryUsage(500.000ms): 171.90 KB, 171.90 KB ThreadUsage(500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.56 MB (3735143) - PerHostPeakMemUsage: 14.76 MB (15481935) - RowsProduced: 14.98K (14983) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 75.730ms - TotalStorageWaitTime: 231.137ms - TotalThreadsInvoluntaryContextSwitches: 35 (35) - TotalThreadsTotalWallClockTime: 1s590ms - TotalThreadsSysTime: 14.997ms - TotalThreadsUserTime: 58.991ms - TotalThreadsVoluntaryContextSwitches: 413 (413) Fragment Instance Lifecycle Timings: - ExecTime: 1s330ms - ExecTreeExecTime: 1s177ms - OpenTime: 22.963ms - ExecTreeOpenTime: 187.173us - PrepareTime: 45.222ms - ExecTreePrepareTime: 113.569us DataStreamSender (dst_id=27):(Total: 25.867ms, non-child: 25.867ms, % non-child: 100.00%) - BytesSent: 704.50 KB (721404) - NetworkThroughput(*): 72.59 MB/sec - OverallThroughput: 26.60 MB/sec - PeakMemoryUsage: 3.17 MB (3321120) - RowsReturned: 14.98K (14983) - SerializeBatchTime: 15.932ms - TransmitDataRPCTime: 9.477ms - UncompressedRowBatchSize: 1.55 MB (1623963) CodeGen:(Total: 47.863ms, non-child: 47.863ms, % non-child: 100.00%) - CodegenTime: 1.047ms - CompileTime: 6.958ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 14.651ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 25.679ms HDFS_SCAN_NODE (id=2):(Total: 1s178ms, non-child: 1s178ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:1/88.07 KB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: Only following filters arrived: , waited 945ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:9 BytesRead(500.000ms): 0, 0 - FooterProcessingTime: (Avg: 123.863ms ; Min: 123.863ms ; Max: 123.863ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 174.89 KB (179084) - BytesReadDataNodeCache: 0 - BytesReadLocal: 174.89 KB (179084) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 174.89 KB (179084) - DecompressionTime: 89.044us - MaxCompressedTextFileLength: 0 - NumColumns: 9 (9) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 959.70 KB (982731) - PerReadThreadRawHdfsThroughput: 352.97 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 232.652ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 14.98K (14983) - RowsReturned: 14.98K (14983) - RowsReturnedRate: 12.71 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 2 (2) - ScannerThreadsTotalWallClockTime: 237.037ms - MaterializeTupleTime(*): 4.616ms - ScannerThreadsSysTime: 2.999ms - ScannerThreadsUserTime: 1.999ms - ScannerThreadsVoluntaryContextSwitches: 14 (14) - TotalRawHdfsReadTime(*): 483.861us - TotalReadThroughput: 0.00 /sec Filter 0 (1.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 14.98K (14983) Instance 7f40dcb034de70b7:64 (host=vc1517.foo:22000):(Total: 1s398ms, non-child: 169.837ms, % non-child: 12.14%) Hdfs split stats (:<# splits>/): 1:1/85.77 KB MemoryUsage(500.000ms): 171.90 KB, 171.90 KB, 317.29 KB ThreadUsage(500.000ms): 1, 1, 2 - AverageThreadTokens: 1.33 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.56 MB (3732781) - PerHostPeakMemUsage: 15.02 MB (15749975) - RowsProduced: 14.60K (14597) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 82.250ms - TotalStorageWaitTime: 206.026ms - TotalThreadsInvoluntaryContextSwitches: 35 (35) - TotalThreadsTotalWallClockTime: 1s557ms - TotalThreadsSysTime: 11.998ms - TotalThreadsUserTime: 61.990ms - TotalThreadsVoluntaryContextSwitches: 398 (398) Fragment Instance Lifecycle Timings: - ExecTime: 1s325ms - ExecTreeExecTime: 1s152ms - OpenTime: 20.087ms - ExecTreeOpenTime: 41.859us - PrepareTime: 52.777ms - ExecTreePrepareTime: 123.726us DataStreamSender (dst_id=27):(Total: 26.956ms, non-child: 26.956ms, % non-child: 100.00%) - BytesSent: 689.23 KB (705768) - NetworkThroughput(*): 65.01 MB/sec - OverallThroughput: 24.97 MB/sec - PeakMemoryUsage: 3.17 MB (3321120) - RowsReturned: 14.60K (14597) - SerializeBatchTime: 16.145ms - TransmitDataRPCTime: 10.354ms - UncompressedRowBatchSize: 1.51 MB (1581595) CodeGen:(Total: 48.443ms, non-child: 48.443ms, % non-child: 100.00%) - CodegenTime: 943.548us - CompileTime: 5.462ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 13.396ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 29.196ms HDFS_SCAN_NODE (id=2):(Total: 1s153ms, non-child: 1s153ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:1/85.77 KB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: Only following filters arrived: , waited 945ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:9 BytesRead(500.000ms): 0, 0, 87.77 KB - FooterProcessingTime: (Avg: 120.227ms ; Min: 120.227ms ; Max: 120.227ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.33 - BytesRead: 170.29 KB (174374) - BytesReadDataNodeCache: 0 - BytesReadLocal: 170.29 KB (174374) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 170.29 KB (174374) - DecompressionTime: 83.046us - MaxCompressedTextFileLength: 0 - NumColumns: 9 (9) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 957.39 KB (980369) - PerReadThreadRawHdfsThroughput: 492.20 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 207.533ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 14.60K (14597) - RowsReturned: 14.60K (14597) - RowsReturnedRate: 12.66 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 1 (1) - ScannerThreadsTotalWallClockTime: 212.397ms - MaterializeTupleTime(*): 5.021ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 5.999ms - ScannerThreadsVoluntaryContextSwitches: 13 (13) - TotalRawHdfsReadTime(*): 337.865us - TotalReadThroughput: 58.51 KB/sec Filter 0 (1.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 14.60K (14597) Instance 7f40dcb034de70b7:61 (host=vc1521.foo:22000):(Total: 1s397ms, non-child: 150.147ms, % non-child: 10.75%) Hdfs split stats (:<# splits>/): 0:1/83.55 KB 1:1/85.74 KB MemoryUsage(500.000ms): 171.90 KB, 171.90 KB ThreadUsage(500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 4.84 MB (5079438) - PerHostPeakMemUsage: 18.41 MB (19307244) - RowsProduced: 28.81K (28810) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 96.008ms - TotalStorageWaitTime: 415.814ms - TotalThreadsInvoluntaryContextSwitches: 18 (18) - TotalThreadsTotalWallClockTime: 1s775ms - TotalThreadsSysTime: 22.995ms - TotalThreadsUserTime: 61.991ms - TotalThreadsVoluntaryContextSwitches: 414 (414) Fragment Instance Lifecycle Timings: - ExecTime: 1s324ms - ExecTreeExecTime: 1s154ms - OpenTime: 23.208ms - ExecTreeOpenTime: 33.930us - PrepareTime: 49.644ms - ExecTreePrepareTime: 131.119us DataStreamSender (dst_id=27):(Total: 45.018ms, non-child: 45.018ms, % non-child: 100.00%) - BytesSent: 1.32 MB (1385957) - NetworkThroughput(*): 55.68 MB/sec - OverallThroughput: 29.36 MB/sec - PeakMemoryUsage: 3.17 MB (3321120) - RowsReturned: 28.81K (28810) - SerializeBatchTime: 20.357ms - TransmitDataRPCTime: 23.737ms - UncompressedRowBatchSize: 2.98 MB (3128785) CodeGen:(Total: 47.120ms, non-child: 47.120ms, % non-child: 100.00%) - CodegenTime: 1.196ms - CompileTime: 6.242ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 15.642ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 24.712ms HDFS_SCAN_NODE (id=2):(Total: 1s154ms, non-child: 1s154ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/83.55 KB 1:1/85.74 KB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 2 out of 2 Runtime filters: Only following filters arrived: , waited 944ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:18 BytesRead(500.000ms): 0, 0 - FooterProcessingTime: (Avg: 115.040ms ; Min: 114.347ms ; Max: 115.733ms ; Number of samples: 2) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 336.07 KB (344132) - BytesReadDataNodeCache: 0 - BytesReadLocal: 336.07 KB (344132) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 336.07 KB (344132) - DecompressionTime: 120.271us - MaxCompressedTextFileLength: 0 - NumColumns: 9 (9) - NumDisksAccessed: 2 (2) - NumRowGroups: 2 (2) - NumScannerThreadsStarted: 2 (2) - PeakMemoryUsage: 1.58 MB (1661426) - PerReadThreadRawHdfsThroughput: 546.66 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 208.708ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 28.81K (28810) - RowsReturned: 28.81K (28810) - RowsReturnedRate: 24.95 K/sec - ScanRangesComplete: 2 (2) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 428.356ms - MaterializeTupleTime(*): 9.698ms - ScannerThreadsSysTime: 999.000us - ScannerThreadsUserTime: 10.998ms - ScannerThreadsVoluntaryContextSwitches: 25 (25) - TotalRawHdfsReadTime(*): 600.356us - TotalReadThroughput: 0.00 /sec Filter 0 (1.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 28.81K (28810) Instance 7f40dcb034de70b7:4d (host=vd1339.foo:22000):(Total: 1s396ms, non-child: 141.901ms, % non-child: 10.16%) Hdfs split stats (:<# splits>/): 1:1/85.81 KB 0:1/85.76 KB MemoryUsage(500.000ms): 171.90 KB, 171.90 KB ThreadUsage(500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 5.14 MB (5386946) - PerHostPeakMemUsage: 17.51 MB (18364039) - RowsProduced: 29.20K (29195) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 86.308ms - TotalStorageWaitTime: 445.681ms - TotalThreadsInvoluntaryContextSwitches: 21 (21) - TotalThreadsTotalWallClockTime: 1s802ms - TotalThreadsSysTime: 22.995ms - TotalThreadsUserTime: 72.989ms - TotalThreadsVoluntaryContextSwitches: 399 (399) Fragment Instance Lifecycle Timings: - ExecTime: 1s317ms - ExecTreeExecTime: 1s148ms - OpenTime: 26.654ms - ExecTreeOpenTime: 40.013us - PrepareTime: 52.015ms - ExecTreePrepareTime: 161.509us DataStreamSender (dst_id=27):(Total: 48.769ms, non-child: 48.769ms, % non-child: 100.00%) - BytesSent: 1.34 MB (1402673) - NetworkThroughput(*): 55.21 MB/sec - OverallThroughput: 27.43 MB/sec - PeakMemoryUsage: 3.17 MB (3321120) - RowsReturned: 29.20K (29195) - SerializeBatchTime: 23.814ms - TransmitDataRPCTime: 24.230ms - UncompressedRowBatchSize: 3.03 MB (3180676) CodeGen:(Total: 57.157ms, non-child: 57.157ms, % non-child: 100.00%) - CodegenTime: 1.358ms - CompileTime: 6.966ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 17.702ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 31.593ms HDFS_SCAN_NODE (id=2):(Total: 1s148ms, non-child: 1s148ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:1/85.81 KB 0:1/85.76 KB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 2 out of 2 Runtime filters: Only following filters arrived: , waited 924ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:18 BytesRead(500.000ms): 0, 0 - FooterProcessingTime: (Avg: 119.739ms ; Min: 115.786ms ; Max: 123.691ms ; Number of samples: 2) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 340.64 KB (348818) - BytesReadDataNodeCache: 0 - BytesReadLocal: 340.64 KB (348818) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 340.64 KB (348818) - DecompressionTime: 180.344us - MaxCompressedTextFileLength: 0 - NumColumns: 9 (9) - NumDisksAccessed: 2 (2) - NumRowGroups: 2 (2) - NumScannerThreadsStarted: 2 (2) - PeakMemoryUsage: 1.89 MB (1985318) - PerReadThreadRawHdfsThroughput: 501.62 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 222.550ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 29.20K (29195) - RowsReturned: 29.20K (29195) - RowsReturnedRate: 25.42 K/sec - ScanRangesComplete: 2 (2) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 458.171ms - MaterializeTupleTime(*): 9.791ms - ScannerThreadsSysTime: 1.998ms - ScannerThreadsUserTime: 9.998ms - ScannerThreadsVoluntaryContextSwitches: 25 (25) - TotalRawHdfsReadTime(*): 663.166us - TotalReadThroughput: 0.00 /sec Filter 0 (1.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 29.20K (29195) Instance 7f40dcb034de70b7:6c (host=va1041.foo:22000):(Total: 1s393ms, non-child: 142.022ms, % non-child: 10.19%) Hdfs split stats (:<# splits>/): 1:1/85.79 KB 2:1/83.55 KB MemoryUsage(500.000ms): 171.90 KB, 171.90 KB ThreadUsage(500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 4.87 MB (5104018) - PerHostPeakMemUsage: 16.73 MB (17542164) - RowsProduced: 28.81K (28811) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 83.265ms - TotalStorageWaitTime: 403.006ms - TotalThreadsInvoluntaryContextSwitches: 28 (28) - TotalThreadsTotalWallClockTime: 1s759ms - TotalThreadsSysTime: 21.995ms - TotalThreadsUserTime: 74.988ms - TotalThreadsVoluntaryContextSwitches: 722 (722) Fragment Instance Lifecycle Timings: - ExecTime: 1s318ms - ExecTreeExecTime: 1s145ms - OpenTime: 25.288ms - ExecTreeOpenTime: 59.321us - PrepareTime: 49.654ms - ExecTreePrepareTime: 143.654us DataStreamSender (dst_id=27):(Total: 55.919ms, non-child: 55.919ms, % non-child: 100.00%) - BytesSent: 1.32 MB (1385815) - NetworkThroughput(*): 50.18 MB/sec - OverallThroughput: 23.63 MB/sec - PeakMemoryUsage: 3.17 MB (3321120) - RowsReturned: 28.81K (28811) - SerializeBatchTime: 28.885ms - TransmitDataRPCTime: 26.339ms - UncompressedRowBatchSize: 2.98 MB (3128450) CodeGen:(Total: 49.405ms, non-child: 49.405ms, % non-child: 100.00%) - CodegenTime: 1.213ms - CompileTime: 6.490ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 17.154ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 25.239ms HDFS_SCAN_NODE (id=2):(Total: 1s146ms, non-child: 1s146ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:1/85.79 KB 2:1/83.55 KB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 2 out of 2 Runtime filters: Only following filters arrived: , waited 944ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:18 BytesRead(500.000ms): 0, 0 - FooterProcessingTime: (Avg: 107.571ms ; Min: 96.140ms ; Max: 119.002ms ; Number of samples: 2) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 336.16 KB (344226) - BytesReadDataNodeCache: 0 - BytesReadLocal: 336.16 KB (344226) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 336.16 KB (344226) - DecompressionTime: 168.211us - MaxCompressedTextFileLength: 0 - NumColumns: 9 (9) - NumDisksAccessed: 2 (2) - NumRowGroups: 2 (2) - NumScannerThreadsStarted: 2 (2) - PeakMemoryUsage: 1.61 MB (1686006) - PerReadThreadRawHdfsThroughput: 434.27 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 200.015ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 28.81K (28811) - RowsReturned: 28.81K (28811) - RowsReturnedRate: 25.14 K/sec - ScanRangesComplete: 2 (2) - ScannerThreadsInvoluntaryContextSwitches: 1 (1) - ScannerThreadsTotalWallClockTime: 416.078ms - MaterializeTupleTime(*): 9.722ms - ScannerThreadsSysTime: 2.998ms - ScannerThreadsUserTime: 8.998ms - ScannerThreadsVoluntaryContextSwitches: 71 (71) - TotalRawHdfsReadTime(*): 755.930us - TotalReadThroughput: 0.00 /sec Filter 0 (1.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 28.81K (28811) Instance 7f40dcb034de70b7:4 (host=vc1502.foo:22000):(Total: 1s392ms, non-child: 147.226ms, % non-child: 10.57%) Hdfs split stats (:<# splits>/): 4:1/85.78 KB MemoryUsage(500.000ms): 0, 171.90 KB, 171.90 KB ThreadUsage(500.000ms): 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.57 MB (3747117) - PerHostPeakMemUsage: 14.62 MB (15325802) - RowsProduced: 14.60K (14597) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 74.668ms - TotalStorageWaitTime: 225.784ms - TotalThreadsInvoluntaryContextSwitches: 20 (20) - TotalThreadsTotalWallClockTime: 1s573ms - TotalThreadsSysTime: 17.997ms - TotalThreadsUserTime: 56.991ms - TotalThreadsVoluntaryContextSwitches: 419 (419) Fragment Instance Lifecycle Timings: - ExecTime: 1s319ms - ExecTreeExecTime: 1s172ms - OpenTime: 22.351ms - ExecTreeOpenTime: 52.932us - PrepareTime: 50.931ms - ExecTreePrepareTime: 109.870us DataStreamSender (dst_id=27):(Total: 25.663ms, non-child: 25.663ms, % non-child: 100.00%) - BytesSent: 677.26 KB (693519) - NetworkThroughput(*): 68.48 MB/sec - OverallThroughput: 25.77 MB/sec - PeakMemoryUsage: 3.17 MB (3321120) - RowsReturned: 14.60K (14597) - SerializeBatchTime: 15.410ms - TransmitDataRPCTime: 9.658ms - UncompressedRowBatchSize: 1.50 MB (1577866) CodeGen:(Total: 47.029ms, non-child: 47.029ms, % non-child: 100.00%) - CodegenTime: 1.754ms - CompileTime: 5.708ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 15.177ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 25.242ms HDFS_SCAN_NODE (id=2):(Total: 1s172ms, non-child: 1s172ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:1/85.78 KB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: Only following filters arrived: , waited 944ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:9 BytesRead(500.000ms): 0, 0, 0 - FooterProcessingTime: (Avg: 119.950ms ; Min: 119.950ms ; Max: 119.950ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 170.30 KB (174390) - BytesReadDataNodeCache: 0 - BytesReadLocal: 170.30 KB (174390) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 170.30 KB (174390) - DecompressionTime: 64.866us - MaxCompressedTextFileLength: 0 - NumColumns: 9 (9) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 957.39 KB (980369) - PerReadThreadRawHdfsThroughput: 560.95 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 227.219ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 14.60K (14597) - RowsReturned: 14.60K (14597) - RowsReturnedRate: 12.45 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 1 (1) - ScannerThreadsTotalWallClockTime: 232.120ms - MaterializeTupleTime(*): 5.066ms - ScannerThreadsSysTime: 1.999ms - ScannerThreadsUserTime: 3.999ms - ScannerThreadsVoluntaryContextSwitches: 13 (13) - TotalRawHdfsReadTime(*): 296.483us - TotalReadThroughput: 0.00 /sec Filter 0 (1.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 14.60K (14597) Instance 7f40dcb034de70b7:62 (host=vd1332.foo:22000):(Total: 1s391ms, non-child: 144.349ms, % non-child: 10.38%) Hdfs split stats (:<# splits>/): 2:1/85.70 KB 1:1/85.67 KB MemoryUsage(500.000ms): 171.90 KB, 171.90 KB ThreadUsage(500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 5.08 MB (5329598) - PerHostPeakMemUsage: 13.84 MB (14513356) - RowsProduced: 29.19K (29194) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 91.254ms - TotalStorageWaitTime: 408.995ms - TotalThreadsInvoluntaryContextSwitches: 23 (23) - TotalThreadsTotalWallClockTime: 1s773ms - TotalThreadsSysTime: 20.996ms - TotalThreadsUserTime: 75.987ms - TotalThreadsVoluntaryContextSwitches: 488 (488) Fragment Instance Lifecycle Timings: - ExecTime: 1s329ms - ExecTreeExecTime: 1s150ms - OpenTime: 21.298ms - ExecTreeOpenTime: 35.160us - PrepareTime: 39.821ms - ExecTreePrepareTime: 82.831us DataStreamSender (dst_id=27):(Total: 51.826ms, non-child: 51.826ms, % non-child: 100.00%) - BytesSent: 1.34 MB (1399860) - NetworkThroughput(*): 54.24 MB/sec - OverallThroughput: 25.76 MB/sec - PeakMemoryUsage: 3.17 MB (3321120) - RowsReturned: 29.19K (29194) - SerializeBatchTime: 26.837ms - TransmitDataRPCTime: 24.612ms - UncompressedRowBatchSize: 3.03 MB (3179930) CodeGen:(Total: 44.514ms, non-child: 44.514ms, % non-child: 100.00%) - CodegenTime: 1.069ms - CompileTime: 5.607ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 14.317ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 24.070ms HDFS_SCAN_NODE (id=2):(Total: 1s150ms, non-child: 1s150ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:1/85.70 KB 1:1/85.67 KB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 2 out of 2 Runtime filters: Only following filters arrived: , waited 944ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:18 BytesRead(500.000ms): 0, 0 - FooterProcessingTime: (Avg: 83.154ms ; Min: 79.303ms ; Max: 87.005ms ; Number of samples: 2) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 340.23 KB (348394) - BytesReadDataNodeCache: 0 - BytesReadLocal: 340.23 KB (348394) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 340.23 KB (348394) - DecompressionTime: 191.100us - MaxCompressedTextFileLength: 0 - NumColumns: 9 (9) - NumDisksAccessed: 2 (2) - NumRowGroups: 2 (2) - NumScannerThreadsStarted: 2 (2) - PeakMemoryUsage: 2.26 MB (2370338) - PerReadThreadRawHdfsThroughput: 456.46 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 204.307ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 29.19K (29194) - RowsReturned: 29.19K (29194) - RowsReturnedRate: 25.38 K/sec - ScanRangesComplete: 2 (2) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 422.490ms - MaterializeTupleTime(*): 10.306ms - ScannerThreadsSysTime: 1.999ms - ScannerThreadsUserTime: 9.997ms - ScannerThreadsVoluntaryContextSwitches: 59 (59) - TotalRawHdfsReadTime(*): 727.901us - TotalReadThroughput: 0.00 /sec Filter 0 (1.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 29.19K (29194) Instance 7f40dcb034de70b7:4a (host=vd1342.foo:22000):(Total: 1s390ms, non-child: 126.190ms, % non-child: 9.08%) Hdfs split stats (:<# splits>/): 3:1/83.60 KB 0:1/85.76 KB MemoryUsage(500.000ms): 171.90 KB, 171.90 KB, 443.90 KB ThreadUsage(500.000ms): 1, 1, 3 - AverageThreadTokens: 1.67 - BloomFilterBytes: 0 - PeakMemoryUsage: 4.96 MB (5200278) - PerHostPeakMemUsage: 14.87 MB (15587535) - RowsProduced: 28.81K (28812) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 66.914ms - TotalStorageWaitTime: 442.361ms - TotalThreadsInvoluntaryContextSwitches: 31 (31) - TotalThreadsTotalWallClockTime: 1s797ms - TotalThreadsSysTime: 19.997ms - TotalThreadsUserTime: 68.989ms - TotalThreadsVoluntaryContextSwitches: 413 (413) Fragment Instance Lifecycle Timings: - ExecTime: 1s322ms - ExecTreeExecTime: 1s168ms - OpenTime: 23.141ms - ExecTreeOpenTime: 36.021us - PrepareTime: 44.862ms - ExecTreePrepareTime: 155.571us DataStreamSender (dst_id=27):(Total: 46.657ms, non-child: 46.657ms, % non-child: 100.00%) - BytesSent: 1.32 MB (1379349) - NetworkThroughput(*): 54.46 MB/sec - OverallThroughput: 28.19 MB/sec - PeakMemoryUsage: 3.17 MB (3321120) - RowsReturned: 28.81K (28812) - SerializeBatchTime: 22.019ms - TransmitDataRPCTime: 24.154ms - UncompressedRowBatchSize: 2.99 MB (3135752) CodeGen:(Total: 48.786ms, non-child: 48.786ms, % non-child: 100.00%) - CodegenTime: 1.257ms - CompileTime: 6.126ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 15.723ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 26.487ms HDFS_SCAN_NODE (id=2):(Total: 1s168ms, non-child: 1s168ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:1/83.60 KB 0:1/85.76 KB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 2 out of 2 Runtime filters: Only following filters arrived: , waited 945ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:18 BytesRead(500.000ms): 0, 0, 0 - FooterProcessingTime: (Avg: 142.008ms ; Min: 136.561ms ; Max: 147.455ms ; Number of samples: 2) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.67 - BytesRead: 336.21 KB (344278) - BytesReadDataNodeCache: 0 - BytesReadLocal: 336.21 KB (344278) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 336.21 KB (344278) - DecompressionTime: 174.517us - MaxCompressedTextFileLength: 0 - NumColumns: 9 (9) - NumDisksAccessed: 2 (2) - NumRowGroups: 2 (2) - NumScannerThreadsStarted: 2 (2) - PeakMemoryUsage: 2.43 MB (2552314) - PerReadThreadRawHdfsThroughput: 464.23 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 222.195ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 28.81K (28812) - RowsReturned: 28.81K (28812) - RowsReturnedRate: 24.66 K/sec - ScanRangesComplete: 2 (2) - ScannerThreadsInvoluntaryContextSwitches: 1 (1) - ScannerThreadsTotalWallClockTime: 452.837ms - MaterializeTupleTime(*): 7.613ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 9.998ms - ScannerThreadsVoluntaryContextSwitches: 28 (28) - TotalRawHdfsReadTime(*): 707.252us - TotalReadThroughput: 0.00 /sec Filter 0 (1.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 28.81K (28812) Instance 7f40dcb034de70b7:5b (host=vd1337.foo:22000):(Total: 1s390ms, non-child: 141.169ms, % non-child: 10.16%) Hdfs split stats (:<# splits>/): 2:1/85.78 KB 1:1/85.74 KB MemoryUsage(500.000ms): 171.90 KB, 171.90 KB, 778.67 KB ThreadUsage(500.000ms): 1, 1, 3 - AverageThreadTokens: 1.67 - BloomFilterBytes: 0 - PeakMemoryUsage: 5.02 MB (5266122) - PerHostPeakMemUsage: 13.97 MB (14645849) - RowsProduced: 29.20K (29197) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 78.735ms - TotalStorageWaitTime: 420.791ms - TotalThreadsInvoluntaryContextSwitches: 27 (27) - TotalThreadsTotalWallClockTime: 1s761ms - TotalThreadsSysTime: 20.996ms - TotalThreadsUserTime: 76.988ms - TotalThreadsVoluntaryContextSwitches: 457 (457) Fragment Instance Lifecycle Timings: - ExecTime: 1s300ms - ExecTreeExecTime: 1s137ms - OpenTime: 27.101ms - ExecTreeOpenTime: 69.231us - PrepareTime: 62.151ms - ExecTreePrepareTime: 237.778us DataStreamSender (dst_id=27):(Total: 50.841ms, non-child: 50.841ms, % non-child: 100.00%) - BytesSent: 1.34 MB (1403528) - NetworkThroughput(*): 51.44 MB/sec - OverallThroughput: 26.33 MB/sec - PeakMemoryUsage: 3.17 MB (3321120) - RowsReturned: 29.20K (29197) - SerializeBatchTime: 24.105ms - TransmitDataRPCTime: 26.020ms - UncompressedRowBatchSize: 3.02 MB (3167717) CodeGen:(Total: 60.436ms, non-child: 60.436ms, % non-child: 100.00%) - CodegenTime: 1.217ms - CompileTime: 7.724ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 18.143ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 33.971ms HDFS_SCAN_NODE (id=2):(Total: 1s137ms, non-child: 1s137ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:1/85.78 KB 1:1/85.74 KB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 2 out of 2 Runtime filters: Only following filters arrived: , waited 924ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:18 BytesRead(500.000ms): 0, 0, 176.39 KB - FooterProcessingTime: (Avg: 111.390ms ; Min: 108.424ms ; Max: 114.356ms ; Number of samples: 2) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.67 - BytesRead: 340.52 KB (348696) - BytesReadDataNodeCache: 0 - BytesReadLocal: 340.52 KB (348696) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 340.52 KB (348696) - DecompressionTime: 175.385us - MaxCompressedTextFileLength: 0 - NumColumns: 9 (9) - NumDisksAccessed: 2 (2) - NumRowGroups: 2 (2) - NumScannerThreadsStarted: 2 (2) - PeakMemoryUsage: 2.17 MB (2274094) - PerReadThreadRawHdfsThroughput: 407.86 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 211.092ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 29.20K (29197) - RowsReturned: 29.20K (29197) - RowsReturnedRate: 25.66 K/sec - ScanRangesComplete: 2 (2) - ScannerThreadsInvoluntaryContextSwitches: 3 (3) - ScannerThreadsTotalWallClockTime: 433.798ms - MaterializeTupleTime(*): 10.007ms - ScannerThreadsSysTime: 999.000us - ScannerThreadsUserTime: 9.998ms - ScannerThreadsVoluntaryContextSwitches: 62 (62) - TotalRawHdfsReadTime(*): 815.330us - TotalReadThroughput: 117.59 KB/sec Filter 0 (1.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 29.20K (29197) Instance 7f40dcb034de70b7:68 (host=vd1132.foo:22000):(Total: 1s389ms, non-child: 145.278ms, % non-child: 10.46%) Hdfs split stats (:<# splits>/): 7:1/90.20 KB 0:1/85.70 KB MemoryUsage(500.000ms): 171.90 KB, 171.90 KB, 443.90 KB ThreadUsage(500.000ms): 1, 1, 3 - AverageThreadTokens: 1.67 - BloomFilterBytes: 0 - PeakMemoryUsage: 5.18 MB (5432618) - PerHostPeakMemUsage: 14.36 MB (15056775) - RowsProduced: 29.96K (29964) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 79.204ms - TotalStorageWaitTime: 419.272ms - TotalThreadsInvoluntaryContextSwitches: 23 (23) - TotalThreadsTotalWallClockTime: 1s763ms - TotalThreadsSysTime: 19.995ms - TotalThreadsUserTime: 75.988ms - TotalThreadsVoluntaryContextSwitches: 407 (407) Fragment Instance Lifecycle Timings: - ExecTime: 1s304ms - ExecTreeExecTime: 1s135ms - OpenTime: 25.934ms - ExecTreeOpenTime: 48.050us - PrepareTime: 58.587ms - ExecTreePrepareTime: 163.650us DataStreamSender (dst_id=27):(Total: 50.507ms, non-child: 50.507ms, % non-child: 100.00%) - BytesSent: 1.38 MB (1443964) - NetworkThroughput(*): 53.29 MB/sec - OverallThroughput: 27.26 MB/sec - PeakMemoryUsage: 3.17 MB (3321120) - RowsReturned: 29.96K (29964) - SerializeBatchTime: 23.492ms - TransmitDataRPCTime: 25.841ms - UncompressedRowBatchSize: 3.10 MB (3250558) CodeGen:(Total: 57.426ms, non-child: 57.426ms, % non-child: 100.00%) - CodegenTime: 1.478ms - CompileTime: 6.556ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 17.648ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 32.675ms HDFS_SCAN_NODE (id=2):(Total: 1s136ms, non-child: 1s136ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:1/90.20 KB 0:1/85.70 KB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 2 out of 2 Runtime filters: Only following filters arrived: , waited 924ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:18 BytesRead(500.000ms): 0, 0, 0 - FooterProcessingTime: (Avg: 110.394ms ; Min: 107.403ms ; Max: 113.385ms ; Number of samples: 2) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.67 - BytesRead: 349.29 KB (357670) - BytesReadDataNodeCache: 0 - BytesReadLocal: 349.29 KB (357670) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 349.29 KB (357670) - DecompressionTime: 164.056us - MaxCompressedTextFileLength: 0 - NumColumns: 9 (9) - NumDisksAccessed: 2 (2) - NumRowGroups: 2 (2) - NumScannerThreadsStarted: 2 (2) - PeakMemoryUsage: 2.36 MB (2471310) - PerReadThreadRawHdfsThroughput: 432.16 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 210.117ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 29.96K (29964) - RowsReturned: 29.96K (29964) - RowsReturnedRate: 26.37 K/sec - ScanRangesComplete: 2 (2) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 432.905ms - MaterializeTupleTime(*): 10.739ms - ScannerThreadsSysTime: 1.998ms - ScannerThreadsUserTime: 9.998ms - ScannerThreadsVoluntaryContextSwitches: 24 (24) - TotalRawHdfsReadTime(*): 789.290us - TotalReadThroughput: 0.00 /sec Filter 0 (1.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 29.96K (29964) Instance 7f40dcb034de70b7:53 (host=vc1505.foo:22000):(Total: 1s389ms, non-child: 163.215ms, % non-child: 11.75%) Hdfs split stats (:<# splits>/): 2:1/83.57 KB MemoryUsage(500.000ms): 171.90 KB, 171.90 KB, 287.90 KB ThreadUsage(500.000ms): 1, 1, 2 - AverageThreadTokens: 1.33 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.48 MB (3648509) - PerHostPeakMemUsage: 14.96 MB (15689036) - RowsProduced: 14.21K (14213) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 83.694ms - TotalStorageWaitTime: 207.044ms - TotalThreadsInvoluntaryContextSwitches: 33 (33) - TotalThreadsTotalWallClockTime: 1s549ms - TotalThreadsSysTime: 21.995ms - TotalThreadsUserTime: 50.992ms - TotalThreadsVoluntaryContextSwitches: 396 (396) Fragment Instance Lifecycle Timings: - ExecTime: 1s314ms - ExecTreeExecTime: 1s153ms - OpenTime: 22.005ms - ExecTreeOpenTime: 32.625us - PrepareTime: 52.174ms - ExecTreePrepareTime: 111.583us DataStreamSender (dst_id=27):(Total: 26.832ms, non-child: 26.832ms, % non-child: 100.00%) - BytesSent: 672.21 KB (688346) - NetworkThroughput(*): 62.06 MB/sec - OverallThroughput: 24.46 MB/sec - PeakMemoryUsage: 3.17 MB (3321120) - RowsReturned: 14.21K (14213) - SerializeBatchTime: 15.641ms - TransmitDataRPCTime: 10.578ms - UncompressedRowBatchSize: 1.47 MB (1543057) CodeGen:(Total: 45.072ms, non-child: 45.072ms, % non-child: 100.00%) - CodegenTime: 1.206ms - CompileTime: 5.928ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 14.641ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 23.948ms HDFS_SCAN_NODE (id=2):(Total: 1s153ms, non-child: 1s153ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:1/83.57 KB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: Only following filters arrived: , waited 945ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:9 BytesRead(500.000ms): 0, 0, 83.76 KB - FooterProcessingTime: (Avg: 114.129ms ; Min: 114.129ms ; Max: 114.129ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.33 - BytesRead: 165.88 KB (169856) - BytesReadDataNodeCache: 0 - BytesReadLocal: 165.88 KB (169856) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 165.88 KB (169856) - DecompressionTime: 84.176us - MaxCompressedTextFileLength: 0 - NumColumns: 9 (9) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 853.09 KB (873569) - PerReadThreadRawHdfsThroughput: 574.11 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 208.507ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 14.21K (14213) - RowsReturned: 14.21K (14213) - RowsReturnedRate: 12.32 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 1 (1) - ScannerThreadsTotalWallClockTime: 212.881ms - MaterializeTupleTime(*): 4.485ms - ScannerThreadsSysTime: 1.999ms - ScannerThreadsUserTime: 2.999ms - ScannerThreadsVoluntaryContextSwitches: 12 (12) - TotalRawHdfsReadTime(*): 282.153us - TotalReadThroughput: 55.84 KB/sec Filter 0 (1.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 14.21K (14213) Instance 7f40dcb034de70b7:15 (host=vc1520.foo:22000):(Total: 1s388ms, non-child: 139.816ms, % non-child: 10.07%) Hdfs split stats (:<# splits>/): 3:1/83.55 KB MemoryUsage(500.000ms): 171.90 KB, 171.90 KB ThreadUsage(500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.47 MB (3634181) - PerHostPeakMemUsage: 14.55 MB (15261247) - RowsProduced: 14.21K (14215) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 71.955ms - TotalStorageWaitTime: 225.831ms - TotalThreadsInvoluntaryContextSwitches: 34 (34) - TotalThreadsTotalWallClockTime: 1s574ms - TotalThreadsSysTime: 18.997ms - TotalThreadsUserTime: 58.991ms - TotalThreadsVoluntaryContextSwitches: 404 (404) Fragment Instance Lifecycle Timings: - ExecTime: 1s316ms - ExecTreeExecTime: 1s172ms - OpenTime: 26.008ms - ExecTreeOpenTime: 33.428us - PrepareTime: 46.361ms - ExecTreePrepareTime: 68.696us DataStreamSender (dst_id=27):(Total: 24.306ms, non-child: 24.306ms, % non-child: 100.00%) - BytesSent: 663.03 KB (678942) - NetworkThroughput(*): 69.37 MB/sec - OverallThroughput: 26.64 MB/sec - PeakMemoryUsage: 3.17 MB (3321120) - RowsReturned: 14.21K (14215) - SerializeBatchTime: 14.385ms - TransmitDataRPCTime: 9.334ms - UncompressedRowBatchSize: 1.48 MB (1552652) CodeGen:(Total: 51.627ms, non-child: 51.627ms, % non-child: 100.00%) - CodegenTime: 1.507ms - CompileTime: 6.501ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 17.660ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 26.814ms HDFS_SCAN_NODE (id=2):(Total: 1s173ms, non-child: 1s173ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:1/83.55 KB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: Only following filters arrived: , waited 945ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:9 BytesRead(500.000ms): 0, 0 - FooterProcessingTime: (Avg: 123.133ms ; Min: 123.133ms ; Max: 123.133ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 165.85 KB (169832) - BytesReadDataNodeCache: 0 - BytesReadLocal: 165.85 KB (169832) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 165.85 KB (169832) - DecompressionTime: 61.546us - MaxCompressedTextFileLength: 0 - NumColumns: 9 (9) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 861.10 KB (881769) - PerReadThreadRawHdfsThroughput: 543.10 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 227.162ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 14.21K (14215) - RowsReturned: 14.21K (14215) - RowsReturnedRate: 12.12 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 232.183ms - MaterializeTupleTime(*): 5.076ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 5.999ms - ScannerThreadsVoluntaryContextSwitches: 12 (12) - TotalRawHdfsReadTime(*): 298.224us - TotalReadThroughput: 0.00 /sec Filter 0 (1.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 14.21K (14215) Instance 7f40dcb034de70b7:7 (host=ve1126.foo:22000):(Total: 1s387ms, non-child: 152.927ms, % non-child: 11.02%) Hdfs split stats (:<# splits>/): 5:1/85.76 KB MemoryUsage(500.000ms): 171.90 KB, 171.90 KB ThreadUsage(500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.57 MB (3747125) - PerHostPeakMemUsage: 14.48 MB (15181294) - RowsProduced: 14.60K (14599) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 91.139ms - TotalStorageWaitTime: 217.688ms - TotalThreadsInvoluntaryContextSwitches: 33 (33) - TotalThreadsTotalWallClockTime: 1s571ms - TotalThreadsSysTime: 12.998ms - TotalThreadsUserTime: 64.989ms - TotalThreadsVoluntaryContextSwitches: 412 (412) Fragment Instance Lifecycle Timings: - ExecTime: 1s323ms - ExecTreeExecTime: 1s164ms - OpenTime: 23.335ms - ExecTreeOpenTime: 44.027us - PrepareTime: 40.611ms - ExecTreePrepareTime: 129.257us DataStreamSender (dst_id=27):(Total: 26.225ms, non-child: 26.225ms, % non-child: 100.00%) - BytesSent: 689.75 KB (706302) - NetworkThroughput(*): 68.38 MB/sec - OverallThroughput: 25.68 MB/sec - PeakMemoryUsage: 3.17 MB (3321120) - RowsReturned: 14.60K (14599) - SerializeBatchTime: 15.754ms - TransmitDataRPCTime: 9.850ms - UncompressedRowBatchSize: 1.52 MB (1591349) CodeGen:(Total: 43.956ms, non-child: 43.956ms, % non-child: 100.00%) - CodegenTime: 1.012ms - CompileTime: 6.994ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 15.022ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 21.521ms HDFS_SCAN_NODE (id=2):(Total: 1s164ms, non-child: 1s164ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:1/85.76 KB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: Only following filters arrived: , waited 945ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:9 BytesRead(500.000ms): 0, 0 - FooterProcessingTime: (Avg: 98.196ms ; Min: 98.196ms ; Max: 98.196ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 170.27 KB (174360) - BytesReadDataNodeCache: 0 - BytesReadLocal: 170.27 KB (174360) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 170.27 KB (174360) - DecompressionTime: 100.698us - MaxCompressedTextFileLength: 0 - NumColumns: 9 (9) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 957.40 KB (980377) - PerReadThreadRawHdfsThroughput: 450.55 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 219.406ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 14.60K (14599) - RowsReturned: 14.60K (14599) - RowsReturnedRate: 12.54 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 224.821ms - MaterializeTupleTime(*): 5.701ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 6.998ms - ScannerThreadsVoluntaryContextSwitches: 17 (17) - TotalRawHdfsReadTime(*): 369.065us - TotalReadThroughput: 0.00 /sec Filter 0 (1.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 14.60K (14599) Instance 7f40dcb034de70b7:8 (host=ve1136.foo:22000):(Total: 1s387ms, non-child: 190.653ms, % non-child: 13.74%) Hdfs split stats (:<# splits>/): 5:1/85.82 KB MemoryUsage(500.000ms): 171.90 KB, 171.90 KB, 1.52 MB ThreadUsage(500.000ms): 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.54 MB (3716401) - PerHostPeakMemUsage: 17.38 MB (18220000) - RowsProduced: 14.60K (14598) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 112.417ms - TotalStorageWaitTime: 166.994ms - TotalThreadsInvoluntaryContextSwitches: 35 (35) - TotalThreadsTotalWallClockTime: 1s507ms - TotalThreadsSysTime: 17.997ms - TotalThreadsUserTime: 57.991ms - TotalThreadsVoluntaryContextSwitches: 408 (408) Fragment Instance Lifecycle Timings: - ExecTime: 1s312ms - ExecTreeExecTime: 1s113ms - OpenTime: 22.911ms - ExecTreeOpenTime: 35.250us - PrepareTime: 52.319ms - ExecTreePrepareTime: 108.794us DataStreamSender (dst_id=27):(Total: 28.246ms, non-child: 28.246ms, % non-child: 100.00%) - BytesSent: 686.35 KB (702821) - NetworkThroughput(*): 59.10 MB/sec - OverallThroughput: 23.73 MB/sec - PeakMemoryUsage: 3.15 MB (3304736) - RowsReturned: 14.60K (14598) - SerializeBatchTime: 16.335ms - TransmitDataRPCTime: 11.341ms - UncompressedRowBatchSize: 1.51 MB (1585543) CodeGen:(Total: 54.777ms, non-child: 54.777ms, % non-child: 100.00%) - CodegenTime: 935.609us - CompileTime: 6.907ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 14.668ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 32.776ms HDFS_SCAN_NODE (id=2):(Total: 1s113ms, non-child: 1s113ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:1/85.82 KB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: Only following filters arrived: , waited 944ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:9 BytesRead(500.000ms): 0, 0 - FooterProcessingTime: (Avg: 92.425ms ; Min: 92.425ms ; Max: 92.425ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 170.39 KB (174482) - BytesReadDataNodeCache: 0 - BytesReadLocal: 170.39 KB (174482) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 170.39 KB (174482) - DecompressionTime: 59.037us - MaxCompressedTextFileLength: 0 - NumColumns: 9 (9) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 957.40 KB (980373) - PerReadThreadRawHdfsThroughput: 526.60 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 168.189ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 14.60K (14598) - RowsReturned: 14.60K (14598) - RowsReturnedRate: 13.10 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 2 (2) - ScannerThreadsTotalWallClockTime: 172.646ms - MaterializeTupleTime(*): 4.676ms - ScannerThreadsSysTime: 999.000us - ScannerThreadsUserTime: 3.999ms - ScannerThreadsVoluntaryContextSwitches: 12 (12) - TotalRawHdfsReadTime(*): 315.985us - TotalReadThroughput: 0.00 /sec Filter 0 (1.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 14.60K (14598) Instance 7f40dcb034de70b7:f (host=vc1506.foo:22000):(Total: 1s387ms, non-child: 158.771ms, % non-child: 11.44%) Hdfs split stats (:<# splits>/): 1:1/85.77 KB MemoryUsage(500.000ms): 171.90 KB, 171.90 KB, 395.90 KB ThreadUsage(500.000ms): 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.54 MB (3716405) - PerHostPeakMemUsage: 14.96 MB (15689036) - RowsProduced: 14.60K (14599) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 94.680ms - TotalStorageWaitTime: 218.179ms - TotalThreadsInvoluntaryContextSwitches: 33 (33) - TotalThreadsTotalWallClockTime: 1s553ms - TotalThreadsSysTime: 19.996ms - TotalThreadsUserTime: 51.991ms - TotalThreadsVoluntaryContextSwitches: 398 (398) Fragment Instance Lifecycle Timings: - ExecTime: 1s309ms - ExecTreeExecTime: 1s143ms - OpenTime: 20.941ms - ExecTreeOpenTime: 31.124us - PrepareTime: 57.305ms - ExecTreePrepareTime: 117.390us DataStreamSender (dst_id=27):(Total: 26.782ms, non-child: 26.782ms, % non-child: 100.00%) - BytesSent: 678.07 KB (694348) - NetworkThroughput(*): 63.32 MB/sec - OverallThroughput: 24.72 MB/sec - PeakMemoryUsage: 3.17 MB (3321120) - RowsReturned: 14.60K (14599) - SerializeBatchTime: 15.758ms - TransmitDataRPCTime: 10.458ms - UncompressedRowBatchSize: 1.51 MB (1583964) CodeGen:(Total: 58.001ms, non-child: 58.001ms, % non-child: 100.00%) - CodegenTime: 968.192us - CompileTime: 5.468ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 14.196ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 37.955ms HDFS_SCAN_NODE (id=2):(Total: 1s143ms, non-child: 1s143ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:1/85.77 KB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: Only following filters arrived: , waited 924ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:9 BytesRead(500.000ms): 0, 0 - FooterProcessingTime: (Avg: 66.691ms ; Min: 66.691ms ; Max: 66.691ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 170.28 KB (174370) - BytesReadDataNodeCache: 0 - BytesReadLocal: 170.28 KB (174370) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 170.28 KB (174370) - DecompressionTime: 81.757us - MaxCompressedTextFileLength: 0 - NumColumns: 9 (9) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 1.03 MB (1076633) - PerReadThreadRawHdfsThroughput: 402.81 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 219.565ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 14.60K (14599) - RowsReturned: 14.60K (14599) - RowsReturnedRate: 12.76 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 2 (2) - ScannerThreadsTotalWallClockTime: 223.486ms - MaterializeTupleTime(*): 4.266ms - ScannerThreadsSysTime: 999.000us - ScannerThreadsUserTime: 2.999ms - ScannerThreadsVoluntaryContextSwitches: 12 (12) - TotalRawHdfsReadTime(*): 412.835us - TotalReadThroughput: 0.00 /sec Filter 0 (1.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 14.60K (14599) Instance 7f40dcb034de70b7:1f (host=vc1503.foo:22000):(Total: 1s387ms, non-child: 145.737ms, % non-child: 10.51%) Hdfs split stats (:<# splits>/): 6:1/85.76 KB MemoryUsage(500.000ms): 171.90 KB, 171.90 KB, 2.05 MB ThreadUsage(500.000ms): 1, 1, 2 - AverageThreadTokens: 1.33 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.57 MB (3747129) - PerHostPeakMemUsage: 14.61 MB (15314700) - RowsProduced: 14.60K (14600) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 73.059ms - TotalStorageWaitTime: 231.303ms - TotalThreadsInvoluntaryContextSwitches: 38 (38) - TotalThreadsTotalWallClockTime: 1s574ms - TotalThreadsSysTime: 17.997ms - TotalThreadsUserTime: 66.989ms - TotalThreadsVoluntaryContextSwitches: 408 (408) Fragment Instance Lifecycle Timings: - ExecTime: 1s304ms - ExecTreeExecTime: 1s158ms - OpenTime: 31.828ms - ExecTreeOpenTime: 39.914us - PrepareTime: 50.324ms - ExecTreePrepareTime: 168.906us DataStreamSender (dst_id=27):(Total: 26.448ms, non-child: 26.448ms, % non-child: 100.00%) - BytesSent: 680.34 KB (696671) - NetworkThroughput(*): 68.32 MB/sec - OverallThroughput: 25.12 MB/sec - PeakMemoryUsage: 3.17 MB (3321120) - RowsReturned: 14.60K (14600) - SerializeBatchTime: 16.005ms - TransmitDataRPCTime: 9.724ms - UncompressedRowBatchSize: 1.52 MB (1595612) CodeGen:(Total: 56.344ms, non-child: 56.344ms, % non-child: 100.00%) - CodegenTime: 1.088ms - CompileTime: 6.934ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 23.537ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 25.354ms HDFS_SCAN_NODE (id=2):(Total: 1s158ms, non-child: 1s158ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 6:1/85.76 KB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: Only following filters arrived: , waited 924ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:9 BytesRead(500.000ms): 0, 0, 170.26 KB - FooterProcessingTime: (Avg: 121.546ms ; Min: 121.546ms ; Max: 121.546ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.33 - BytesRead: 170.26 KB (174348) - BytesReadDataNodeCache: 0 - BytesReadLocal: 170.26 KB (174348) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 170.26 KB (174348) - DecompressionTime: 86.148us - MaxCompressedTextFileLength: 0 - NumColumns: 9 (9) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 949.40 KB (972189) - PerReadThreadRawHdfsThroughput: 645.32 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 232.696ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 14.60K (14600) - RowsReturned: 14.60K (14600) - RowsReturnedRate: 12.60 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 238.084ms - MaterializeTupleTime(*): 5.502ms - ScannerThreadsSysTime: 1.999ms - ScannerThreadsUserTime: 4.999ms - ScannerThreadsVoluntaryContextSwitches: 12 (12) - TotalRawHdfsReadTime(*): 257.656us - TotalReadThroughput: 113.51 KB/sec Filter 0 (1.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 14.60K (14600) Instance 7f40dcb034de70b7:11 (host=va1046.foo:22000):(Total: 1s387ms, non-child: 133.794ms, % non-child: 9.65%) Hdfs split stats (:<# splits>/): 0:1/87.93 KB 1:1/85.79 KB MemoryUsage(500.000ms): 171.90 KB, 171.90 KB, 443.90 KB ThreadUsage(500.000ms): 1, 1, 3 - AverageThreadTokens: 1.67 - BloomFilterBytes: 0 - PeakMemoryUsage: 4.61 MB (4830509) - PerHostPeakMemUsage: 15.03 MB (15759182) - RowsProduced: 29.58K (29580) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 76.809ms - TotalStorageWaitTime: 435.859ms - TotalThreadsInvoluntaryContextSwitches: 25 (25) - TotalThreadsTotalWallClockTime: 1s788ms - TotalThreadsSysTime: 16.997ms - TotalThreadsUserTime: 73.987ms - TotalThreadsVoluntaryContextSwitches: 436 (436) Fragment Instance Lifecycle Timings: - ExecTime: 1s316ms - ExecTreeExecTime: 1s161ms - OpenTime: 22.092ms - ExecTreeOpenTime: 49.540us - PrepareTime: 47.995ms - ExecTreePrepareTime: 121.687us DataStreamSender (dst_id=27):(Total: 44.135ms, non-child: 44.135ms, % non-child: 100.00%) - BytesSent: 1.36 MB (1431141) - NetworkThroughput(*): 62.36 MB/sec - OverallThroughput: 30.92 MB/sec - PeakMemoryUsage: 3.17 MB (3321120) - RowsReturned: 29.58K (29580) - SerializeBatchTime: 21.654ms - TransmitDataRPCTime: 21.887ms - UncompressedRowBatchSize: 3.06 MB (3205462) CodeGen:(Total: 47.206ms, non-child: 47.206ms, % non-child: 100.00%) - CodegenTime: 1.152ms - CompileTime: 5.399ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 15.254ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 25.869ms HDFS_SCAN_NODE (id=2):(Total: 1s161ms, non-child: 1s161ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/87.93 KB 1:1/85.79 KB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 2 out of 2 Runtime filters: Only following filters arrived: , waited 944ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:18 BytesRead(500.000ms): 0, 0, 0 - FooterProcessingTime: (Avg: 106.220ms ; Min: 98.643ms ; Max: 113.797ms ; Number of samples: 2) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.67 - BytesRead: 344.93 KB (353208) - BytesReadDataNodeCache: 0 - BytesReadLocal: 344.93 KB (353208) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 344.93 KB (353208) - DecompressionTime: 158.866us - MaxCompressedTextFileLength: 0 - NumColumns: 9 (9) - NumDisksAccessed: 2 (2) - NumRowGroups: 2 (2) - NumScannerThreadsStarted: 2 (2) - PeakMemoryUsage: 1.39 MB (1461649) - PerReadThreadRawHdfsThroughput: 440.34 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 215.839ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 29.58K (29580) - RowsReturned: 29.58K (29580) - RowsReturnedRate: 25.46 K/sec - ScanRangesComplete: 2 (2) - ScannerThreadsInvoluntaryContextSwitches: 7 (7) - ScannerThreadsTotalWallClockTime: 449.639ms - MaterializeTupleTime(*): 10.874ms - ScannerThreadsSysTime: 1.999ms - ScannerThreadsUserTime: 10.997ms - ScannerThreadsVoluntaryContextSwitches: 28 (28) - TotalRawHdfsReadTime(*): 764.974us - TotalReadThroughput: 0.00 /sec Filter 0 (1.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 29.58K (29580) Instance 7f40dcb034de70b7:60 (host=va1033.foo:22000):(Total: 1s386ms, non-child: 131.814ms, % non-child: 9.50%) Hdfs split stats (:<# splits>/): 6:1/87.94 KB 5:1/85.74 KB MemoryUsage(500.000ms): 163.28 KB, 171.90 KB, 443.90 KB ThreadUsage(500.000ms): 1, 1, 3 - AverageThreadTokens: 1.67 - BloomFilterBytes: 0 - PeakMemoryUsage: 5.04 MB (5284852) - PerHostPeakMemUsage: 17.32 MB (18162639) - RowsProduced: 29.58K (29579) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 70.648ms - TotalStorageWaitTime: 435.874ms - TotalThreadsInvoluntaryContextSwitches: 26 (26) - TotalThreadsTotalWallClockTime: 1s790ms - TotalThreadsSysTime: 18.997ms - TotalThreadsUserTime: 67.989ms - TotalThreadsVoluntaryContextSwitches: 415 (415) Fragment Instance Lifecycle Timings: - ExecTime: 1s322ms - ExecTreeExecTime: 1s163ms - OpenTime: 21.324ms - ExecTreeOpenTime: 35.090us - PrepareTime: 42.923ms - ExecTreePrepareTime: 86.971us DataStreamSender (dst_id=27):(Total: 45.943ms, non-child: 45.943ms, % non-child: 100.00%) - BytesSent: 1.36 MB (1423191) - NetworkThroughput(*): 58.24 MB/sec - OverallThroughput: 29.54 MB/sec - PeakMemoryUsage: 3.17 MB (3321120) - RowsReturned: 29.58K (29579) - SerializeBatchTime: 21.835ms - TransmitDataRPCTime: 23.306ms - UncompressedRowBatchSize: 3.06 MB (3210924) CodeGen:(Total: 45.109ms, non-child: 45.109ms, % non-child: 100.00%) - CodegenTime: 1.039ms - CompileTime: 5.563ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 14.269ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 24.813ms HDFS_SCAN_NODE (id=2):(Total: 1s164ms, non-child: 1s164ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 6:1/87.94 KB 5:1/85.74 KB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 2 out of 2 Runtime filters: Only following filters arrived: , waited 945ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:18 BytesRead(500.000ms): 0, 0, 0 - FooterProcessingTime: (Avg: 127.478ms ; Min: 126.976ms ; Max: 127.980ms ; Number of samples: 2) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 344.86 KB (353132) - BytesReadDataNodeCache: 0 - BytesReadLocal: 344.86 KB (353132) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 344.86 KB (353132) - DecompressionTime: 145.548us - MaxCompressedTextFileLength: 0 - NumColumns: 9 (9) - NumDisksAccessed: 2 (2) - NumRowGroups: 2 (2) - NumScannerThreadsStarted: 2 (2) - PeakMemoryUsage: 2.17 MB (2276440) - PerReadThreadRawHdfsThroughput: 463.02 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 218.502ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 29.58K (29579) - RowsReturned: 29.58K (29579) - RowsReturnedRate: 25.41 K/sec - ScanRangesComplete: 2 (2) - ScannerThreadsInvoluntaryContextSwitches: 6 (6) - ScannerThreadsTotalWallClockTime: 447.293ms - MaterializeTupleTime(*): 8.877ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 10.998ms - ScannerThreadsVoluntaryContextSwitches: 26 (26) - TotalRawHdfsReadTime(*): 727.346us - TotalReadThroughput: 0.00 /sec Filter 0 (1.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 29.58K (29579) Instance 7f40dcb034de70b7:1b (host=vc1526.foo:22000):(Total: 1s386ms, non-child: 164.157ms, % non-child: 11.84%) Hdfs split stats (:<# splits>/): 6:1/85.86 KB MemoryUsage(500.000ms): 171.90 KB, 171.90 KB, 294.29 KB ThreadUsage(500.000ms): 1, 1, 2 - AverageThreadTokens: 1.33 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.58 MB (3749177) - PerHostPeakMemUsage: 14.53 MB (15232873) - RowsProduced: 14.60K (14600) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 94.318ms - TotalStorageWaitTime: 196.414ms - TotalThreadsInvoluntaryContextSwitches: 30 (30) - TotalThreadsTotalWallClockTime: 1s538ms - TotalThreadsSysTime: 18.997ms - TotalThreadsUserTime: 58.991ms - TotalThreadsVoluntaryContextSwitches: 392 (392) Fragment Instance Lifecycle Timings: - ExecTime: 1s312ms - ExecTreeExecTime: 1s143ms - OpenTime: 24.186ms - ExecTreeOpenTime: 40.788us - PrepareTime: 49.444ms - ExecTreePrepareTime: 111.994us DataStreamSender (dst_id=27):(Total: 26.238ms, non-child: 26.238ms, % non-child: 100.00%) - BytesSent: 691.56 KB (708157) - NetworkThroughput(*): 68.68 MB/sec - OverallThroughput: 25.74 MB/sec - PeakMemoryUsage: 3.17 MB (3321120) - RowsReturned: 14.60K (14600) - SerializeBatchTime: 15.710ms - TransmitDataRPCTime: 9.832ms - UncompressedRowBatchSize: 1.51 MB (1587103) CodeGen:(Total: 52.422ms, non-child: 52.422ms, % non-child: 100.00%) - CodegenTime: 1.188ms - CompileTime: 7.295ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 15.799ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 28.760ms HDFS_SCAN_NODE (id=2):(Total: 1s143ms, non-child: 1s143ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 6:1/85.86 KB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: Only following filters arrived: , waited 945ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:9 BytesRead(500.000ms): 0, 0, 86.63 KB - FooterProcessingTime: (Avg: 118.205ms ; Min: 118.205ms ; Max: 118.205ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.33 - BytesRead: 170.46 KB (174550) - BytesReadDataNodeCache: 0 - BytesReadLocal: 170.46 KB (174550) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 170.46 KB (174550) - DecompressionTime: 74.272us - MaxCompressedTextFileLength: 0 - NumColumns: 9 (9) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 1.02 MB (1068445) - PerReadThreadRawHdfsThroughput: 506.26 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 197.666ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 14.60K (14600) - RowsReturned: 14.60K (14600) - RowsReturnedRate: 12.77 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 1 (1) - ScannerThreadsTotalWallClockTime: 202.369ms - MaterializeTupleTime(*): 4.897ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 5.999ms - ScannerThreadsVoluntaryContextSwitches: 11 (11) - TotalRawHdfsReadTime(*): 328.812us - TotalReadThroughput: 57.76 KB/sec Filter 0 (1.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 14.60K (14600) Instance 7f40dcb034de70b7:12 (host=vc1531.foo:22000):(Total: 1s384ms, non-child: 126.668ms, % non-child: 9.15%) Hdfs split stats (:<# splits>/): 1:1/87.97 KB 6:1/85.72 KB MemoryUsage(500.000ms): 171.90 KB, 171.90 KB, 1.60 MB ThreadUsage(500.000ms): 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 4.00 MB (4189795) - PerHostPeakMemUsage: 14.37 MB (15071473) - RowsProduced: 29.58K (29581) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 79.772ms - TotalStorageWaitTime: 437.338ms - TotalThreadsInvoluntaryContextSwitches: 36 (36) - TotalThreadsTotalWallClockTime: 1s794ms - TotalThreadsSysTime: 13.997ms - TotalThreadsUserTime: 79.987ms - TotalThreadsVoluntaryContextSwitches: 417 (417) Fragment Instance Lifecycle Timings: - ExecTime: 1s317ms - ExecTreeExecTime: 1s164ms - OpenTime: 27.018ms - ExecTreeOpenTime: 34.687us - PrepareTime: 39.625ms - ExecTreePrepareTime: 131.892us DataStreamSender (dst_id=27):(Total: 43.900ms, non-child: 43.900ms, % non-child: 100.00%) - BytesSent: 1.35 MB (1418478) - NetworkThroughput(*): 64.81 MB/sec - OverallThroughput: 30.81 MB/sec - PeakMemoryUsage: 3.17 MB (3321120) - RowsReturned: 29.58K (29581) - SerializeBatchTime: 22.560ms - TransmitDataRPCTime: 20.872ms - UncompressedRowBatchSize: 3.07 MB (3215700) CodeGen:(Total: 49.098ms, non-child: 49.098ms, % non-child: 100.00%) - CodegenTime: 1.020ms - CompileTime: 6.432ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 18.891ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 23.294ms HDFS_SCAN_NODE (id=2):(Total: 1s164ms, non-child: 1s164ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:1/87.97 KB 6:1/85.72 KB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 2 out of 2 Runtime filters: Only following filters arrived: , waited 945ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:18 BytesRead(500.000ms): 0, 0 - FooterProcessingTime: (Avg: 112.749ms ; Min: 101.861ms ; Max: 123.636ms ; Number of samples: 2) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 344.87 KB (353146) - BytesReadDataNodeCache: 0 - BytesReadLocal: 344.87 KB (353146) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 344.87 KB (353146) - DecompressionTime: 152.120us - MaxCompressedTextFileLength: 0 - NumColumns: 9 (9) - NumDisksAccessed: 2 (2) - NumRowGroups: 2 (2) - NumScannerThreadsStarted: 2 (2) - PeakMemoryUsage: 1.21 MB (1271495) - PerReadThreadRawHdfsThroughput: 639.08 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 218.205ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 29.58K (29581) - RowsReturned: 29.58K (29581) - RowsReturnedRate: 25.40 K/sec - ScanRangesComplete: 2 (2) - ScannerThreadsInvoluntaryContextSwitches: 7 (7) - ScannerThreadsTotalWallClockTime: 450.528ms - MaterializeTupleTime(*): 10.390ms - ScannerThreadsSysTime: 999.000us - ScannerThreadsUserTime: 10.998ms - ScannerThreadsVoluntaryContextSwitches: 25 (25) - TotalRawHdfsReadTime(*): 526.986us - TotalReadThroughput: 0.00 /sec Filter 0 (1.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 29.58K (29581) Instance 7f40dcb034de70b7:10 (host=vd1103.foo:22000):(Total: 1s383ms, non-child: 172.009ms, % non-child: 12.43%) Hdfs split stats (:<# splits>/): 4:1/85.75 KB MemoryUsage(500.000ms): 163.28 KB, 171.90 KB, 307.90 KB ThreadUsage(500.000ms): 1, 1, 2 - AverageThreadTokens: 1.33 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.58 MB (3749169) - PerHostPeakMemUsage: 14.96 MB (15689036) - RowsProduced: 14.60K (14598) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 94.532ms - TotalStorageWaitTime: 198.749ms - TotalThreadsInvoluntaryContextSwitches: 32 (32) - TotalThreadsTotalWallClockTime: 1s526ms - TotalThreadsSysTime: 18.998ms - TotalThreadsUserTime: 54.992ms - TotalThreadsVoluntaryContextSwitches: 396 (396) Fragment Instance Lifecycle Timings: - ExecTime: 1s300ms - ExecTreeExecTime: 1s125ms - OpenTime: 20.537ms - ExecTreeOpenTime: 37.124us - PrepareTime: 62.400ms - ExecTreePrepareTime: 104.938us DataStreamSender (dst_id=27):(Total: 26.802ms, non-child: 26.802ms, % non-child: 100.00%) - BytesSent: 679.00 KB (695292) - NetworkThroughput(*): 62.55 MB/sec - OverallThroughput: 24.74 MB/sec - PeakMemoryUsage: 3.17 MB (3321120) - RowsReturned: 14.60K (14598) - SerializeBatchTime: 15.583ms - TransmitDataRPCTime: 10.600ms - UncompressedRowBatchSize: 1.51 MB (1588515) CodeGen:(Total: 59.726ms, non-child: 59.726ms, % non-child: 100.00%) - CodegenTime: 885.639us - CompileTime: 5.631ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 13.758ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 39.919ms HDFS_SCAN_NODE (id=2):(Total: 1s125ms, non-child: 1s125ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:1/85.75 KB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: Only following filters arrived: , waited 924ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:9 BytesRead(500.000ms): 0, 0, 0 - FooterProcessingTime: (Avg: 108.248ms ; Min: 108.248ms ; Max: 108.248ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.50 - BytesRead: 170.24 KB (174326) - BytesReadDataNodeCache: 0 - BytesReadLocal: 170.24 KB (174326) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 170.24 KB (174326) - DecompressionTime: 67.200us - MaxCompressedTextFileLength: 0 - NumColumns: 9 (9) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 949.40 KB (972181) - PerReadThreadRawHdfsThroughput: 388.06 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 200.266ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 14.60K (14598) - RowsReturned: 14.60K (14598) - RowsReturnedRate: 12.97 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 2 (2) - ScannerThreadsTotalWallClockTime: 205.049ms - MaterializeTupleTime(*): 4.993ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 4.999ms - ScannerThreadsVoluntaryContextSwitches: 11 (11) - TotalRawHdfsReadTime(*): 428.417us - TotalReadThroughput: 0.00 /sec Filter 0 (1.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 14.60K (14598) Instance 7f40dcb034de70b7:27 (host=vd1330.foo:22000):(Total: 1s382ms, non-child: 158.531ms, % non-child: 11.47%) Hdfs split stats (:<# splits>/): 5:1/85.75 KB MemoryUsage(500.000ms): 171.90 KB, 171.90 KB, 1.07 MB ThreadUsage(500.000ms): 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.56 MB (3732785) - PerHostPeakMemUsage: 17.49 MB (18341078) - RowsProduced: 14.60K (14598) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 88.374ms - TotalStorageWaitTime: 197.284ms - TotalThreadsInvoluntaryContextSwitches: 29 (29) - TotalThreadsTotalWallClockTime: 1s533ms - TotalThreadsSysTime: 16.997ms - TotalThreadsUserTime: 59.990ms - TotalThreadsVoluntaryContextSwitches: 420 (420) Fragment Instance Lifecycle Timings: - ExecTime: 1s307ms - ExecTreeExecTime: 1s143ms - OpenTime: 21.953ms - ExecTreeOpenTime: 41.212us - PrepareTime: 52.725ms - ExecTreePrepareTime: 201.414us DataStreamSender (dst_id=27):(Total: 29.159ms, non-child: 29.159ms, % non-child: 100.00%) - BytesSent: 681.73 KB (698090) - NetworkThroughput(*): 57.46 MB/sec - OverallThroughput: 22.83 MB/sec - PeakMemoryUsage: 3.17 MB (3321120) - RowsReturned: 14.60K (14598) - SerializeBatchTime: 16.936ms - TransmitDataRPCTime: 11.585ms - UncompressedRowBatchSize: 1.51 MB (1585214) CodeGen:(Total: 51.154ms, non-child: 51.154ms, % non-child: 100.00%) - CodegenTime: 1.658ms - CompileTime: 6.181ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 14.368ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 29.762ms HDFS_SCAN_NODE (id=2):(Total: 1s143ms, non-child: 1s143ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:1/85.75 KB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: Only following filters arrived: , waited 944ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:9 BytesRead(500.000ms): 0, 0 - FooterProcessingTime: (Avg: 122.588ms ; Min: 122.588ms ; Max: 122.588ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 170.24 KB (174326) - BytesReadDataNodeCache: 0 - BytesReadLocal: 170.24 KB (174326) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 170.24 KB (174326) - DecompressionTime: 69.554us - MaxCompressedTextFileLength: 0 - NumColumns: 9 (9) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 1.02 MB (1068437) - PerReadThreadRawHdfsThroughput: 594.40 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 198.723ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 14.60K (14598) - RowsReturned: 14.60K (14598) - RowsReturnedRate: 12.76 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 1 (1) - ScannerThreadsTotalWallClockTime: 203.806ms - MaterializeTupleTime(*): 5.175ms - ScannerThreadsSysTime: 1.999ms - ScannerThreadsUserTime: 4.999ms - ScannerThreadsVoluntaryContextSwitches: 11 (11) - TotalRawHdfsReadTime(*): 279.696us - TotalReadThroughput: 0.00 /sec Filter 0 (1.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 14.60K (14598) Instance 7f40dcb034de70b7:22 (host=vc1528.foo:22000):(Total: 1s382ms, non-child: 167.838ms, % non-child: 12.14%) Hdfs split stats (:<# splits>/): 0:1/87.96 KB MemoryUsage(500.000ms): 171.90 KB, 171.90 KB ThreadUsage(500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.58 MB (3749475) - PerHostPeakMemUsage: 14.46 MB (15164984) - RowsProduced: 14.98K (14982) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 94.666ms - TotalStorageWaitTime: 192.804ms - TotalThreadsInvoluntaryContextSwitches: 38 (38) - TotalThreadsTotalWallClockTime: 1s535ms - TotalThreadsSysTime: 15.998ms - TotalThreadsUserTime: 60.991ms - TotalThreadsVoluntaryContextSwitches: 413 (413) Fragment Instance Lifecycle Timings: - ExecTime: 1s312ms - ExecTreeExecTime: 1s139ms - OpenTime: 23.997ms - ExecTreeOpenTime: 36.924us - PrepareTime: 45.725ms - ExecTreePrepareTime: 121.673us DataStreamSender (dst_id=27):(Total: 26.776ms, non-child: 26.776ms, % non-child: 100.00%) - BytesSent: 702.83 KB (719700) - NetworkThroughput(*): 67.99 MB/sec - OverallThroughput: 25.63 MB/sec - PeakMemoryUsage: 3.17 MB (3321120) - RowsReturned: 14.98K (14982) - SerializeBatchTime: 16.052ms - TransmitDataRPCTime: 10.094ms - UncompressedRowBatchSize: 1.55 MB (1628445) CodeGen:(Total: 47.845ms, non-child: 47.845ms, % non-child: 100.00%) - CodegenTime: 838.255us - CompileTime: 6.343ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 15.731ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 25.374ms HDFS_SCAN_NODE (id=2):(Total: 1s139ms, non-child: 1s139ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/87.96 KB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: Only following filters arrived: , waited 945ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:9 BytesRead(500.000ms): 0, 0 - FooterProcessingTime: (Avg: 108.603ms ; Min: 108.603ms ; Max: 108.603ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 174.67 KB (178864) - BytesReadDataNodeCache: 0 - BytesReadLocal: 174.67 KB (178864) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 174.67 KB (178864) - DecompressionTime: 85.645us - MaxCompressedTextFileLength: 0 - NumColumns: 9 (9) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 771.69 KB (790215) - PerReadThreadRawHdfsThroughput: 622.80 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 194.225ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 14.98K (14982) - RowsReturned: 14.98K (14982) - RowsReturnedRate: 13.14 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 4 (4) - ScannerThreadsTotalWallClockTime: 199.310ms - MaterializeTupleTime(*): 5.242ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 5.999ms - ScannerThreadsVoluntaryContextSwitches: 11 (11) - TotalRawHdfsReadTime(*): 273.888us - TotalReadThroughput: 0.00 /sec Filter 0 (1.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 14.98K (14982) Instance 7f40dcb034de70b7:23 (host=vc1515.foo:22000):(Total: 1s382ms, non-child: 213.164ms, % non-child: 15.42%) Hdfs split stats (:<# splits>/): 6:1/88.02 KB MemoryUsage(500.000ms): 171.90 KB, 171.90 KB ThreadUsage(500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.53 MB (3702379) - PerHostPeakMemUsage: 14.40 MB (15104153) - RowsProduced: 14.98K (14984) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 125.856ms - TotalStorageWaitTime: 156.715ms - TotalThreadsInvoluntaryContextSwitches: 38 (38) - TotalThreadsTotalWallClockTime: 1s496ms - TotalThreadsSysTime: 17.997ms - TotalThreadsUserTime: 63.990ms - TotalThreadsVoluntaryContextSwitches: 418 (418) Fragment Instance Lifecycle Timings: - ExecTime: 1s303ms - ExecTreeExecTime: 1s083ms - OpenTime: 30.385ms - ExecTreeOpenTime: 42.018us - PrepareTime: 48.078ms - ExecTreePrepareTime: 146.973us DataStreamSender (dst_id=27):(Total: 26.699ms, non-child: 26.699ms, % non-child: 100.00%) - BytesSent: 706.02 KB (722965) - NetworkThroughput(*): 69.22 MB/sec - OverallThroughput: 25.82 MB/sec - PeakMemoryUsage: 3.17 MB (3321120) - RowsReturned: 14.98K (14984) - SerializeBatchTime: 16.080ms - TransmitDataRPCTime: 9.960ms - UncompressedRowBatchSize: 1.55 MB (1629182) CodeGen:(Total: 58.369ms, non-child: 58.369ms, % non-child: 100.00%) - CodegenTime: 1.566ms - CompileTime: 7.368ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 21.077ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 29.202ms HDFS_SCAN_NODE (id=2):(Total: 1s083ms, non-child: 1s083ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 6:1/88.02 KB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: Only following filters arrived: , waited 924ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:9 BytesRead(500.000ms): 0, 0 - FooterProcessingTime: (Avg: 68.066ms ; Min: 68.066ms ; Max: 68.066ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 174.78 KB (178978) - BytesReadDataNodeCache: 0 - BytesReadLocal: 174.78 KB (178978) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 174.78 KB (178978) - DecompressionTime: 85.349us - MaxCompressedTextFileLength: 0 - NumColumns: 9 (9) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 1.03 MB (1078991) - PerReadThreadRawHdfsThroughput: 666.37 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 158.133ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 14.98K (14984) - RowsReturned: 14.98K (14984) - RowsReturnedRate: 13.82 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 3 (3) - ScannerThreadsTotalWallClockTime: 162.535ms - MaterializeTupleTime(*): 4.682ms - ScannerThreadsSysTime: 999.000us - ScannerThreadsUserTime: 3.999ms - ScannerThreadsVoluntaryContextSwitches: 12 (12) - TotalRawHdfsReadTime(*): 256.144us - TotalReadThroughput: 0.00 /sec Filter 0 (1.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 14.98K (14984) Instance 7f40dcb034de70b7:5 (host=ve1141.foo:22000):(Total: 1s381ms, non-child: 198.694ms, % non-child: 14.38%) Hdfs split stats (:<# splits>/): 6:1/85.80 KB MemoryUsage(500.000ms): 171.90 KB, 171.90 KB, 2.55 MB ThreadUsage(500.000ms): 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.56 MB (3732785) - PerHostPeakMemUsage: 13.41 MB (14058828) - RowsProduced: 14.60K (14598) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 113.795ms - TotalStorageWaitTime: 163.417ms - TotalThreadsInvoluntaryContextSwitches: 36 (36) - TotalThreadsTotalWallClockTime: 1s505ms - TotalThreadsSysTime: 17.996ms - TotalThreadsUserTime: 58.990ms - TotalThreadsVoluntaryContextSwitches: 403 (403) Fragment Instance Lifecycle Timings: - ExecTime: 1s313ms - ExecTreeExecTime: 1s110ms - OpenTime: 22.634ms - ExecTreeOpenTime: 224.166us - PrepareTime: 45.390ms - ExecTreePrepareTime: 103.305us DataStreamSender (dst_id=27):(Total: 26.750ms, non-child: 26.750ms, % non-child: 100.00%) - BytesSent: 682.60 KB (698986) - NetworkThroughput(*): 64.25 MB/sec - OverallThroughput: 24.92 MB/sec - PeakMemoryUsage: 3.17 MB (3321120) - RowsReturned: 14.60K (14598) - SerializeBatchTime: 15.785ms - TransmitDataRPCTime: 10.375ms - UncompressedRowBatchSize: 1.52 MB (1591435) CodeGen:(Total: 45.274ms, non-child: 45.274ms, % non-child: 100.00%) - CodegenTime: 1.114ms - CompileTime: 6.931ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 14.177ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 23.713ms HDFS_SCAN_NODE (id=2):(Total: 1s110ms, non-child: 1s110ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 6:1/85.80 KB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: Only following filters arrived: , waited 944ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:9 BytesRead(500.000ms): 0, 0 - FooterProcessingTime: (Avg: 80.702ms ; Min: 80.702ms ; Max: 80.702ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 170.34 KB (174430) - BytesReadDataNodeCache: 0 - BytesReadLocal: 170.34 KB (174430) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 170.34 KB (174430) - DecompressionTime: 61.508us - MaxCompressedTextFileLength: 0 - NumColumns: 9 (9) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 1.03 MB (1076629) - PerReadThreadRawHdfsThroughput: 577.80 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 164.825ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 14.60K (14598) - RowsReturned: 14.60K (14598) - RowsReturnedRate: 13.14 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 2 (2) - ScannerThreadsTotalWallClockTime: 169.819ms - MaterializeTupleTime(*): 5.203ms - ScannerThreadsSysTime: 999.000us - ScannerThreadsUserTime: 4.999ms - ScannerThreadsVoluntaryContextSwitches: 14 (14) - TotalRawHdfsReadTime(*): 287.901us - TotalReadThroughput: 0.00 /sec Filter 0 (1.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 14.60K (14598) Instance 7f40dcb034de70b7:17 (host=vd1129.foo:22000):(Total: 1s381ms, non-child: 126.110ms, % non-child: 9.13%) Hdfs split stats (:<# splits>/): 2:1/88.05 KB 7:1/83.52 KB MemoryUsage(500.000ms): 171.90 KB, 171.90 KB ThreadUsage(500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 5.13 MB (5376712) - PerHostPeakMemUsage: 15.41 MB (16162728) - RowsProduced: 29.20K (29196) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 70.394ms - TotalStorageWaitTime: 451.879ms - TotalThreadsInvoluntaryContextSwitches: 26 (26) - TotalThreadsTotalWallClockTime: 1s794ms - TotalThreadsSysTime: 23.995ms - TotalThreadsUserTime: 73.987ms - TotalThreadsVoluntaryContextSwitches: 427 (427) Fragment Instance Lifecycle Timings: - ExecTime: 1s301ms - ExecTreeExecTime: 1s151ms - OpenTime: 27.887ms - ExecTreeOpenTime: 43.813us - PrepareTime: 52.421ms - ExecTreePrepareTime: 144.981us DataStreamSender (dst_id=27):(Total: 47.793ms, non-child: 47.793ms, % non-child: 100.00%) - BytesSent: 1.33 MB (1397629) - NetworkThroughput(*): 53.88 MB/sec - OverallThroughput: 27.89 MB/sec - PeakMemoryUsage: 3.17 MB (3321120) - RowsReturned: 29.20K (29196) - SerializeBatchTime: 22.583ms - TransmitDataRPCTime: 24.737ms - UncompressedRowBatchSize: 3.02 MB (3169523) CodeGen:(Total: 55.481ms, non-child: 55.481ms, % non-child: 100.00%) - CodegenTime: 1.645ms - CompileTime: 6.749ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 19.630ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 28.236ms HDFS_SCAN_NODE (id=2):(Total: 1s151ms, non-child: 1s151ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:1/88.05 KB 7:1/83.52 KB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 2 out of 2 Runtime filters: Only following filters arrived: , waited 924ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:18 BytesRead(500.000ms): 0, 0 - FooterProcessingTime: (Avg: 115.182ms ; Min: 110.359ms ; Max: 120.005ms ; Number of samples: 2) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 340.62 KB (348800) - BytesReadDataNodeCache: 0 - BytesReadLocal: 340.62 KB (348800) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 340.62 KB (348800) - DecompressionTime: 164.721us - MaxCompressedTextFileLength: 0 - NumColumns: 9 (9) - NumDisksAccessed: 2 (2) - NumRowGroups: 2 (2) - NumScannerThreadsStarted: 2 (2) - PeakMemoryUsage: 1.98 MB (2073388) - PerReadThreadRawHdfsThroughput: 421.42 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 225.876ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 29.20K (29196) - RowsReturned: 29.20K (29196) - RowsReturnedRate: 25.34 K/sec - ScanRangesComplete: 2 (2) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 465.860ms - MaterializeTupleTime(*): 10.636ms - ScannerThreadsSysTime: 2.999ms - ScannerThreadsUserTime: 9.997ms - ScannerThreadsVoluntaryContextSwitches: 25 (25) - TotalRawHdfsReadTime(*): 789.335us - TotalReadThroughput: 0.00 /sec Filter 0 (1.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 29.20K (29196) Instance 7f40dcb034de70b7:5d (host=vd1113.foo:22000):(Total: 1s380ms, non-child: 152.979ms, % non-child: 11.08%) Hdfs split stats (:<# splits>/): 5:1/81.39 KB MemoryUsage(500.000ms): 0, 171.90 KB, 307.90 KB ThreadUsage(500.000ms): 1, 1, 2 - AverageThreadTokens: 1.33 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.45 MB (3615435) - PerHostPeakMemUsage: 14.15 MB (14833361) - RowsProduced: 13.83K (13829) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 82.038ms - TotalStorageWaitTime: 210.508ms - TotalThreadsInvoluntaryContextSwitches: 37 (37) - TotalThreadsTotalWallClockTime: 1s559ms - TotalThreadsSysTime: 17.997ms - TotalThreadsUserTime: 63.990ms - TotalThreadsVoluntaryContextSwitches: 410 (410) Fragment Instance Lifecycle Timings: - ExecTime: 1s316ms - ExecTreeExecTime: 1s157ms - OpenTime: 25.957ms - ExecTreeOpenTime: 44.505us - PrepareTime: 37.961ms - ExecTreePrepareTime: 188.842us DataStreamSender (dst_id=27):(Total: 26.429ms, non-child: 26.429ms, % non-child: 100.00%) - BytesSent: 641.96 KB (657368) - NetworkThroughput(*): 58.02 MB/sec - OverallThroughput: 23.72 MB/sec - PeakMemoryUsage: 3.17 MB (3321120) - RowsReturned: 13.83K (13829) - SerializeBatchTime: 15.156ms - TransmitDataRPCTime: 10.804ms - UncompressedRowBatchSize: 1.44 MB (1505027) CodeGen:(Total: 43.769ms, non-child: 43.769ms, % non-child: 100.00%) - CodegenTime: 1.471ms - CompileTime: 6.196ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 18.092ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 18.844ms HDFS_SCAN_NODE (id=2):(Total: 1s157ms, non-child: 1s157ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:1/81.39 KB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: Only following filters arrived: , waited 945ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:9 BytesRead(500.000ms): 0, 0, 0 - FooterProcessingTime: (Avg: 116.800ms ; Min: 116.800ms ; Max: 116.800ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.50 - BytesRead: 161.52 KB (165396) - BytesReadDataNodeCache: 0 - BytesReadLocal: 161.52 KB (165396) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 161.52 KB (165396) - DecompressionTime: 108.046us - MaxCompressedTextFileLength: 0 - NumColumns: 9 (9) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 1.02 MB (1071919) - PerReadThreadRawHdfsThroughput: 553.57 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 211.944ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 13.83K (13829) - RowsReturned: 13.83K (13829) - RowsReturnedRate: 11.95 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 216.664ms - MaterializeTupleTime(*): 4.805ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 5.999ms - ScannerThreadsVoluntaryContextSwitches: 15 (15) - TotalRawHdfsReadTime(*): 284.940us - TotalReadThroughput: 0.00 /sec Filter 0 (1.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 13.83K (13829) Instance 7f40dcb034de70b7:33 (host=vc1510.foo:22000):(Total: 1s380ms, non-child: 159.407ms, % non-child: 11.55%) Hdfs split stats (:<# splits>/): 2:1/87.95 KB MemoryUsage(500.000ms): 171.90 KB, 171.90 KB, 287.90 KB ThreadUsage(500.000ms): 1, 1, 2 - AverageThreadTokens: 1.33 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.55 MB (3718755) - PerHostPeakMemUsage: 14.57 MB (15275314) - RowsProduced: 14.98K (14982) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 90.166ms - TotalStorageWaitTime: 217.955ms - TotalThreadsInvoluntaryContextSwitches: 31 (31) - TotalThreadsTotalWallClockTime: 1s554ms - TotalThreadsSysTime: 16.997ms - TotalThreadsUserTime: 59.991ms - TotalThreadsVoluntaryContextSwitches: 410 (410) Fragment Instance Lifecycle Timings: - ExecTime: 1s303ms - ExecTreeExecTime: 1s143ms - OpenTime: 27.615ms - ExecTreeOpenTime: 44.888us - PrepareTime: 49.276ms - ExecTreePrepareTime: 118.206us DataStreamSender (dst_id=27):(Total: 25.413ms, non-child: 25.413ms, % non-child: 100.00%) - BytesSent: 707.02 KB (723987) - NetworkThroughput(*): 76.83 MB/sec - OverallThroughput: 27.17 MB/sec - PeakMemoryUsage: 3.17 MB (3321120) - RowsReturned: 14.98K (14982) - SerializeBatchTime: 15.759ms - TransmitDataRPCTime: 8.986ms - UncompressedRowBatchSize: 1.55 MB (1622550) CodeGen:(Total: 51.640ms, non-child: 51.640ms, % non-child: 100.00%) - CodegenTime: 1.247ms - CompileTime: 6.676ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 18.731ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 25.609ms HDFS_SCAN_NODE (id=2):(Total: 1s144ms, non-child: 1s144ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:1/87.95 KB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: Only following filters arrived: , waited 924ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:9 BytesRead(500.000ms): 0, 0, 88.15 KB - FooterProcessingTime: (Avg: 92.955ms ; Min: 92.955ms ; Max: 92.955ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.33 - BytesRead: 174.65 KB (178844) - BytesReadDataNodeCache: 0 - BytesReadLocal: 174.65 KB (178844) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 174.65 KB (178844) - DecompressionTime: 61.100us - MaxCompressedTextFileLength: 0 - NumColumns: 9 (9) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 865.69 KB (886471) - PerReadThreadRawHdfsThroughput: 498.37 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 219.273ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 14.98K (14982) - RowsReturned: 14.98K (14982) - RowsReturnedRate: 13.09 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 2 (2) - ScannerThreadsTotalWallClockTime: 224.141ms - MaterializeTupleTime(*): 4.976ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 4.999ms - ScannerThreadsVoluntaryContextSwitches: 11 (11) - TotalRawHdfsReadTime(*): 342.233us - TotalReadThroughput: 58.77 KB/sec Filter 0 (1.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 14.98K (14982) Instance 7f40dcb034de70b7:51 (host=vd1135.foo:22000):(Total: 1s380ms, non-child: 155.433ms, % non-child: 11.26%) Hdfs split stats (:<# splits>/): 3:1/88.04 KB MemoryUsage(500.000ms): 171.90 KB, 171.90 KB ThreadUsage(500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.54 MB (3716715) - PerHostPeakMemUsage: 14.50 MB (15207319) - RowsProduced: 14.98K (14984) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 77.307ms - TotalStorageWaitTime: 213.648ms - TotalThreadsInvoluntaryContextSwitches: 35 (35) - TotalThreadsTotalWallClockTime: 1s540ms - TotalThreadsSysTime: 16.997ms - TotalThreadsUserTime: 62.990ms - TotalThreadsVoluntaryContextSwitches: 398 (398) Fragment Instance Lifecycle Timings: - ExecTime: 1s296ms - ExecTreeExecTime: 1s140ms - OpenTime: 25.698ms - ExecTreeOpenTime: 38.938us - PrepareTime: 57.851ms - ExecTreePrepareTime: 211.066us DataStreamSender (dst_id=27):(Total: 26.328ms, non-child: 26.328ms, % non-child: 100.00%) - BytesSent: 703.93 KB (720825) - NetworkThroughput(*): 70.51 MB/sec - OverallThroughput: 26.11 MB/sec - PeakMemoryUsage: 3.17 MB (3321120) - RowsReturned: 14.98K (14984) - SerializeBatchTime: 15.905ms - TransmitDataRPCTime: 9.749ms - UncompressedRowBatchSize: 1.55 MB (1624570) CodeGen:(Total: 57.971ms, non-child: 57.971ms, % non-child: 100.00%) - CodegenTime: 1.400ms - CompileTime: 6.536ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 17.380ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 33.501ms HDFS_SCAN_NODE (id=2):(Total: 1s140ms, non-child: 1s140ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:1/88.04 KB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: Only following filters arrived: , waited 925ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:9 BytesRead(500.000ms): 0, 0 - FooterProcessingTime: (Avg: 107.041ms ; Min: 107.041ms ; Max: 107.041ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 174.82 KB (179018) - BytesReadDataNodeCache: 0 - BytesReadLocal: 174.82 KB (179018) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 174.82 KB (179018) - DecompressionTime: 64.968us - MaxCompressedTextFileLength: 0 - NumColumns: 9 (9) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 1.21 MB (1271503) - PerReadThreadRawHdfsThroughput: 648.84 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 215.053ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 14.98K (14984) - RowsReturned: 14.98K (14984) - RowsReturnedRate: 13.13 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 5 (5) - ScannerThreadsTotalWallClockTime: 218.380ms - MaterializeTupleTime(*): 3.485ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 4.999ms - ScannerThreadsVoluntaryContextSwitches: 12 (12) - TotalRawHdfsReadTime(*): 263.124us - TotalReadThroughput: 0.00 /sec Filter 0 (1.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 14.98K (14984) Instance 7f40dcb034de70b7:32 (host=va1039.foo:22000):(Total: 1s379ms, non-child: 166.764ms, % non-child: 12.09%) Hdfs split stats (:<# splits>/): 0:1/85.80 KB MemoryUsage(500.000ms): 171.90 KB, 171.90 KB, 2.25 MB ThreadUsage(500.000ms): 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.56 MB (3732789) - PerHostPeakMemUsage: 14.50 MB (15201153) - RowsProduced: 14.60K (14599) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 94.941ms - TotalStorageWaitTime: 197.099ms - TotalThreadsInvoluntaryContextSwitches: 31 (31) - TotalThreadsTotalWallClockTime: 1s543ms - TotalThreadsSysTime: 17.998ms - TotalThreadsUserTime: 58.991ms - TotalThreadsVoluntaryContextSwitches: 415 (415) Fragment Instance Lifecycle Timings: - ExecTime: 1s316ms - ExecTreeExecTime: 1s143ms - OpenTime: 24.241ms - ExecTreeOpenTime: 37.676us - PrepareTime: 39.211ms - ExecTreePrepareTime: 119.946us DataStreamSender (dst_id=27):(Total: 26.065ms, non-child: 26.065ms, % non-child: 100.00%) - BytesSent: 687.93 KB (704445) - NetworkThroughput(*): 69.61 MB/sec - OverallThroughput: 25.77 MB/sec - PeakMemoryUsage: 3.17 MB (3321120) - RowsReturned: 14.60K (14599) - SerializeBatchTime: 15.860ms - TransmitDataRPCTime: 9.650ms - UncompressedRowBatchSize: 1.51 MB (1584571) CodeGen:(Total: 43.083ms, non-child: 43.083ms, % non-child: 100.00%) - CodegenTime: 843.538us - CompileTime: 6.911ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 16.043ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 19.735ms HDFS_SCAN_NODE (id=2):(Total: 1s143ms, non-child: 1s143ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/85.80 KB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: Only following filters arrived: , waited 944ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:9 BytesRead(500.000ms): 0, 0 - FooterProcessingTime: (Avg: 101.228ms ; Min: 101.228ms ; Max: 101.228ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 170.34 KB (174430) - BytesReadDataNodeCache: 0 - BytesReadLocal: 170.34 KB (174430) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 170.34 KB (174430) - DecompressionTime: 86.940us - MaxCompressedTextFileLength: 0 - NumColumns: 9 (9) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 957.40 KB (980377) - PerReadThreadRawHdfsThroughput: 570.97 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 198.482ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 14.60K (14599) - RowsReturned: 14.60K (14599) - RowsReturnedRate: 12.76 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 1 (1) - ScannerThreadsTotalWallClockTime: 202.928ms - MaterializeTupleTime(*): 4.707ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 5.999ms - ScannerThreadsVoluntaryContextSwitches: 11 (11) - TotalRawHdfsReadTime(*): 291.344us - TotalReadThroughput: 0.00 /sec Filter 0 (1.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 14.60K (14599) Instance 7f40dcb034de70b7:34 (host=vc1535.foo:22000):(Total: 1s379ms, non-child: 143.116ms, % non-child: 10.38%) Hdfs split stats (:<# splits>/): 4:1/85.77 KB MemoryUsage(500.000ms): 171.90 KB, 171.90 KB ThreadUsage(500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.54 MB (3716401) - PerHostPeakMemUsage: 14.46 MB (15158775) - RowsProduced: 14.60K (14598) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 76.819ms - TotalStorageWaitTime: 220.129ms - TotalThreadsInvoluntaryContextSwitches: 29 (29) - TotalThreadsTotalWallClockTime: 1s559ms - TotalThreadsSysTime: 14.997ms - TotalThreadsUserTime: 57.991ms - TotalThreadsVoluntaryContextSwitches: 416 (416) Fragment Instance Lifecycle Timings: - ExecTime: 1s310ms - ExecTreeExecTime: 1s166ms - OpenTime: 23.118ms - ExecTreeOpenTime: 38.468us - PrepareTime: 45.457ms - ExecTreePrepareTime: 114.821us DataStreamSender (dst_id=27):(Total: 25.047ms, non-child: 25.047ms, % non-child: 100.00%) - BytesSent: 681.77 KB (698132) - NetworkThroughput(*): 70.91 MB/sec - OverallThroughput: 26.58 MB/sec - PeakMemoryUsage: 3.17 MB (3321120) - RowsReturned: 14.60K (14598) - SerializeBatchTime: 15.093ms - TransmitDataRPCTime: 9.389ms - UncompressedRowBatchSize: 1.52 MB (1589561) CodeGen:(Total: 44.760ms, non-child: 44.760ms, % non-child: 100.00%) - CodegenTime: 899.802us - CompileTime: 6.721ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 15.118ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 22.513ms HDFS_SCAN_NODE (id=2):(Total: 1s166ms, non-child: 1s166ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:1/85.77 KB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: Only following filters arrived: , waited 944ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:9 BytesRead(500.000ms): 0, 0 - FooterProcessingTime: (Avg: 117.160ms ; Min: 117.160ms ; Max: 117.160ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 170.29 KB (174380) - BytesReadDataNodeCache: 0 - BytesReadLocal: 170.29 KB (174380) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 170.29 KB (174380) - DecompressionTime: 54.204us - MaxCompressedTextFileLength: 0 - NumColumns: 9 (9) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 1.03 MB (1076629) - PerReadThreadRawHdfsThroughput: 552.79 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 221.331ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 14.60K (14598) - RowsReturned: 14.60K (14598) - RowsReturnedRate: 12.52 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 3 (3) - ScannerThreadsTotalWallClockTime: 225.644ms - MaterializeTupleTime(*): 4.516ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 4.999ms - ScannerThreadsVoluntaryContextSwitches: 13 (13) - TotalRawHdfsReadTime(*): 300.840us - TotalReadThroughput: 0.00 /sec Filter 0 (1.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 14.60K (14598) Instance 7f40dcb034de70b7:28 (host=vd1338.foo:22000):(Total: 1s379ms, non-child: 169.623ms, % non-child: 12.30%) Hdfs split stats (:<# splits>/): 4:1/85.78 KB MemoryUsage(500.000ms): 171.90 KB, 171.90 KB ThreadUsage(500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.54 MB (3714345) - PerHostPeakMemUsage: 15.95 MB (16727993) - RowsProduced: 14.60K (14596) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 96.775ms - TotalStorageWaitTime: 191.054ms - TotalThreadsInvoluntaryContextSwitches: 34 (34) - TotalThreadsTotalWallClockTime: 1s533ms - TotalThreadsSysTime: 22.997ms - TotalThreadsUserTime: 50.992ms - TotalThreadsVoluntaryContextSwitches: 412 (412) Fragment Instance Lifecycle Timings: - ExecTime: 1s314ms - ExecTreeExecTime: 1s137ms - OpenTime: 22.511ms - ExecTreeOpenTime: 40.951us - PrepareTime: 42.038ms - ExecTreePrepareTime: 128.252us DataStreamSender (dst_id=27):(Total: 27.585ms, non-child: 27.585ms, % non-child: 100.00%) - BytesSent: 687.16 KB (703653) - NetworkThroughput(*): 62.97 MB/sec - OverallThroughput: 24.33 MB/sec - PeakMemoryUsage: 3.17 MB (3321120) - RowsReturned: 14.60K (14596) - SerializeBatchTime: 16.395ms - TransmitDataRPCTime: 10.656ms - UncompressedRowBatchSize: 1.52 MB (1590402) CodeGen:(Total: 44.069ms, non-child: 44.069ms, % non-child: 100.00%) - CodegenTime: 975.837us - CompileTime: 5.748ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 15.366ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 22.553ms HDFS_SCAN_NODE (id=2):(Total: 1s137ms, non-child: 1s137ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:1/85.78 KB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: Only following filters arrived: , waited 945ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:9 BytesRead(500.000ms): 0, 0 - FooterProcessingTime: (Avg: 98.064ms ; Min: 98.064ms ; Max: 98.064ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 170.30 KB (174388) - BytesReadDataNodeCache: 0 - BytesReadLocal: 170.30 KB (174388) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 170.30 KB (174388) - DecompressionTime: 83.939us - MaxCompressedTextFileLength: 0 - NumColumns: 9 (9) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 761.39 KB (779661) - PerReadThreadRawHdfsThroughput: 554.90 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 192.463ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 14.60K (14596) - RowsReturned: 14.60K (14596) - RowsReturnedRate: 12.83 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 2 (2) - ScannerThreadsTotalWallClockTime: 197.204ms - MaterializeTupleTime(*): 5.004ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 4.999ms - ScannerThreadsVoluntaryContextSwitches: 11 (11) - TotalRawHdfsReadTime(*): 299.713us - TotalReadThroughput: 0.00 /sec Filter 0 (1.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 14.60K (14596) Instance 7f40dcb034de70b7:6d (host=vd1119.foo:22000):(Total: 1s378ms, non-child: 158.623ms, % non-child: 11.51%) Hdfs split stats (:<# splits>/): 1:1/87.92 KB MemoryUsage(500.000ms): 171.90 KB, 171.90 KB ThreadUsage(500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.58 MB (3751523) - PerHostPeakMemUsage: 14.33 MB (15026142) - RowsProduced: 14.98K (14982) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 82.482ms - TotalStorageWaitTime: 206.215ms - TotalThreadsInvoluntaryContextSwitches: 39 (39) - TotalThreadsTotalWallClockTime: 1s539ms - TotalThreadsSysTime: 14.998ms - TotalThreadsUserTime: 54.991ms - TotalThreadsVoluntaryContextSwitches: 399 (399) Fragment Instance Lifecycle Timings: - ExecTime: 1s307ms - ExecTreeExecTime: 1s151ms - OpenTime: 22.436ms - ExecTreeOpenTime: 148.578us - PrepareTime: 48.686ms - ExecTreePrepareTime: 151.439us DataStreamSender (dst_id=27):(Total: 28.093ms, non-child: 28.093ms, % non-child: 100.00%) - BytesSent: 702.98 KB (719851) - NetworkThroughput(*): 60.45 MB/sec - OverallThroughput: 24.44 MB/sec - PeakMemoryUsage: 3.17 MB (3321120) - RowsReturned: 14.98K (14982) - SerializeBatchTime: 16.162ms - TransmitDataRPCTime: 11.357ms - UncompressedRowBatchSize: 1.54 MB (1615586) CodeGen:(Total: 39.111ms, non-child: 39.111ms, % non-child: 100.00%) - CodegenTime: 1.054ms - CompileTime: 6.042ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 14.854ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 17.680ms HDFS_SCAN_NODE (id=2):(Total: 1s152ms, non-child: 1s152ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:1/87.92 KB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: Only following filters arrived: , waited 944ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:9 BytesRead(500.000ms): 0, 0 - FooterProcessingTime: (Avg: 110.790ms ; Min: 110.790ms ; Max: 110.790ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 174.58 KB (178768) - BytesReadDataNodeCache: 0 - BytesReadLocal: 174.58 KB (178768) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 174.58 KB (178768) - DecompressionTime: 58.780us - MaxCompressedTextFileLength: 0 - NumColumns: 9 (9) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 1.11 MB (1167047) - PerReadThreadRawHdfsThroughput: 631.50 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 207.487ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 14.98K (14982) - RowsReturned: 14.98K (14982) - RowsReturnedRate: 13.00 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 4 (4) - ScannerThreadsTotalWallClockTime: 210.409ms - MaterializeTupleTime(*): 3.235ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 3.999ms - ScannerThreadsVoluntaryContextSwitches: 11 (11) - TotalRawHdfsReadTime(*): 269.969us - TotalReadThroughput: 0.00 /sec Filter 0 (1.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 14.98K (14982) Instance 7f40dcb034de70b7:43 (host=vd1133.foo:22000):(Total: 1s377ms, non-child: 166.762ms, % non-child: 12.11%) Hdfs split stats (:<# splits>/): 5:1/87.95 KB MemoryUsage(500.000ms): 171.90 KB, 171.90 KB, 983.90 KB ThreadUsage(500.000ms): 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.56 MB (3735139) - PerHostPeakMemUsage: 14.07 MB (14748554) - RowsProduced: 14.98K (14982) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 91.286ms - TotalStorageWaitTime: 194.894ms - TotalThreadsInvoluntaryContextSwitches: 45 (45) - TotalThreadsTotalWallClockTime: 1s526ms - TotalThreadsSysTime: 24.995ms - TotalThreadsUserTime: 69.988ms - TotalThreadsVoluntaryContextSwitches: 426 (426) Fragment Instance Lifecycle Timings: - ExecTime: 1s297ms - ExecTreeExecTime: 1s122ms - OpenTime: 27.491ms - ExecTreeOpenTime: 45.711us - PrepareTime: 52.261ms - ExecTreePrepareTime: 150.927us DataStreamSender (dst_id=27):(Total: 32.202ms, non-child: 32.202ms, % non-child: 100.00%) - BytesSent: 703.37 KB (720248) - NetworkThroughput(*): 68.59 MB/sec - OverallThroughput: 21.33 MB/sec - PeakMemoryUsage: 3.17 MB (3321120) - RowsReturned: 14.98K (14982) - SerializeBatchTime: 21.575ms - TransmitDataRPCTime: 10.013ms - UncompressedRowBatchSize: 1.55 MB (1628803) CodeGen:(Total: 56.029ms, non-child: 56.029ms, % non-child: 100.00%) - CodegenTime: 1.839ms - CompileTime: 6.943ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 19.035ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 29.252ms HDFS_SCAN_NODE (id=2):(Total: 1s122ms, non-child: 1s122ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:1/87.95 KB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: Only following filters arrived: , waited 925ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:9 BytesRead(500.000ms): 0, 0 - FooterProcessingTime: (Avg: 108.742ms ; Min: 108.742ms ; Max: 108.742ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 174.65 KB (178844) - BytesReadDataNodeCache: 0 - BytesReadLocal: 174.65 KB (178844) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 174.65 KB (178844) - DecompressionTime: 81.135us - MaxCompressedTextFileLength: 0 - NumColumns: 9 (9) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 1.21 MB (1271495) - PerReadThreadRawHdfsThroughput: 273.48 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 196.800ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 14.98K (14982) - RowsReturned: 14.98K (14982) - RowsReturnedRate: 13.35 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 201.485ms - MaterializeTupleTime(*): 4.802ms - ScannerThreadsSysTime: 2.999ms - ScannerThreadsUserTime: 2.999ms - ScannerThreadsVoluntaryContextSwitches: 38 (38) - TotalRawHdfsReadTime(*): 623.664us - TotalReadThroughput: 0.00 /sec Filter 0 (1.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 14.98K (14982) Instance 7f40dcb034de70b7:16 (host=vd1105.foo:22000):(Total: 1s377ms, non-child: 204.816ms, % non-child: 14.87%) Hdfs split stats (:<# splits>/): 2:1/88.00 KB MemoryUsage(500.000ms): 171.90 KB, 171.90 KB, 307.90 KB ThreadUsage(500.000ms): 1, 1, 2 - AverageThreadTokens: 1.33 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.56 MB (3735139) - PerHostPeakMemUsage: 15.88 MB (16651605) - RowsProduced: 14.98K (14982) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 116.702ms - TotalStorageWaitTime: 153.456ms - TotalThreadsInvoluntaryContextSwitches: 30 (30) - TotalThreadsTotalWallClockTime: 1s496ms - TotalThreadsSysTime: 20.997ms - TotalThreadsUserTime: 57.991ms - TotalThreadsVoluntaryContextSwitches: 414 (414) Fragment Instance Lifecycle Timings: - ExecTime: 1s312ms - ExecTreeExecTime: 1s100ms - OpenTime: 24.561ms - ExecTreeOpenTime: 41.565us - PrepareTime: 40.059ms - ExecTreePrepareTime: 115.285us DataStreamSender (dst_id=27):(Total: 28.222ms, non-child: 28.222ms, % non-child: 100.00%) - BytesSent: 701.26 KB (718090) - NetworkThroughput(*): 61.96 MB/sec - OverallThroughput: 24.26 MB/sec - PeakMemoryUsage: 3.17 MB (3321120) - RowsReturned: 14.98K (14982) - SerializeBatchTime: 16.562ms - TransmitDataRPCTime: 11.053ms - UncompressedRowBatchSize: 1.54 MB (1617966) CodeGen:(Total: 43.583ms, non-child: 43.583ms, % non-child: 100.00%) - CodegenTime: 917.626us - CompileTime: 6.821ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 16.468ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 19.841ms HDFS_SCAN_NODE (id=2):(Total: 1s100ms, non-child: 1s100ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:1/88.00 KB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: Only following filters arrived: , waited 944ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:9 BytesRead(500.000ms): 0, 0, 0 - FooterProcessingTime: (Avg: 62.372ms ; Min: 62.372ms ; Max: 62.372ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.33 - BytesRead: 174.74 KB (178932) - BytesReadDataNodeCache: 0 - BytesReadLocal: 174.74 KB (178932) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 174.74 KB (178932) - DecompressionTime: 89.527us - MaxCompressedTextFileLength: 0 - NumColumns: 9 (9) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 959.69 KB (982727) - PerReadThreadRawHdfsThroughput: 586.00 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 154.919ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 14.98K (14982) - RowsReturned: 14.98K (14982) - RowsReturnedRate: 13.61 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 159.634ms - MaterializeTupleTime(*): 4.888ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 4.999ms - ScannerThreadsVoluntaryContextSwitches: 13 (13) - TotalRawHdfsReadTime(*): 291.201us - TotalReadThroughput: 0.00 /sec Filter 0 (1.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 14.98K (14982) Instance 7f40dcb034de70b7:3 (host=va1044.foo:22000):(Total: 1s375ms, non-child: 182.513ms, % non-child: 13.26%) Hdfs split stats (:<# splits>/): 4:1/88.09 KB MemoryUsage(500.000ms): 171.90 KB, 171.90 KB, 927.90 KB ThreadUsage(500.000ms): 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.56 MB (3733095) - PerHostPeakMemUsage: 13.41 MB (14058828) - RowsProduced: 14.98K (14983) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 99.614ms - TotalStorageWaitTime: 167.966ms - TotalThreadsInvoluntaryContextSwitches: 35 (35) - TotalThreadsTotalWallClockTime: 1s503ms - TotalThreadsSysTime: 18.997ms - TotalThreadsUserTime: 60.990ms - TotalThreadsVoluntaryContextSwitches: 409 (409) Fragment Instance Lifecycle Timings: - ExecTime: 1s303ms - ExecTreeExecTime: 1s114ms - OpenTime: 26.459ms - ExecTreeOpenTime: 57.559us - PrepareTime: 46.414ms - ExecTreePrepareTime: 118.623us DataStreamSender (dst_id=27):(Total: 27.044ms, non-child: 27.044ms, % non-child: 100.00%) - BytesSent: 701.31 KB (718141) - NetworkThroughput(*): 66.02 MB/sec - OverallThroughput: 25.32 MB/sec - PeakMemoryUsage: 3.17 MB (3321120) - RowsReturned: 14.98K (14983) - SerializeBatchTime: 16.118ms - TransmitDataRPCTime: 10.373ms - UncompressedRowBatchSize: 1.55 MB (1621915) CodeGen:(Total: 51.395ms, non-child: 51.395ms, % non-child: 100.00%) - CodegenTime: 1.388ms - CompileTime: 6.613ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 18.130ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 26.036ms HDFS_SCAN_NODE (id=2):(Total: 1s115ms, non-child: 1s115ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:1/88.09 KB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: Only following filters arrived: , waited 945ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:9 BytesRead(500.000ms): 0, 0 - FooterProcessingTime: (Avg: 94.006ms ; Min: 94.006ms ; Max: 94.006ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 174.93 KB (179126) - BytesReadDataNodeCache: 0 - BytesReadLocal: 174.93 KB (179126) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 174.93 KB (179126) - DecompressionTime: 86.983us - MaxCompressedTextFileLength: 0 - NumColumns: 9 (9) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 1.03 MB (1078987) - PerReadThreadRawHdfsThroughput: 611.35 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 169.261ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 14.98K (14983) - RowsReturned: 14.98K (14983) - RowsReturnedRate: 13.44 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 2 (2) - ScannerThreadsTotalWallClockTime: 174.471ms - MaterializeTupleTime(*): 5.245ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 5.999ms - ScannerThreadsVoluntaryContextSwitches: 11 (11) - TotalRawHdfsReadTime(*): 279.428us - TotalReadThroughput: 0.00 /sec Filter 0 (1.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 14.98K (14983) Instance 7f40dcb034de70b7:2 (host=vc1533.foo:22000):(Total: 1s375ms, non-child: 187.264ms, % non-child: 13.62%) Hdfs split stats (:<# splits>/): 1:1/85.74 KB MemoryUsage(500.000ms): 171.90 KB, 171.90 KB ThreadUsage(500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.51 MB (3681581) - PerHostPeakMemUsage: 14.96 MB (15689036) - RowsProduced: 14.60K (14597) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 104.931ms - TotalStorageWaitTime: 162.884ms - TotalThreadsInvoluntaryContextSwitches: 32 (32) - TotalThreadsTotalWallClockTime: 1s498ms - TotalThreadsSysTime: 24.995ms - TotalThreadsUserTime: 54.992ms - TotalThreadsVoluntaryContextSwitches: 407 (407) Fragment Instance Lifecycle Timings: - ExecTime: 1s303ms - ExecTreeExecTime: 1s109ms - OpenTime: 26.047ms - ExecTreeOpenTime: 40.464us - PrepareTime: 45.244ms - ExecTreePrepareTime: 151.482us DataStreamSender (dst_id=27):(Total: 26.621ms, non-child: 26.621ms, % non-child: 100.00%) - BytesSent: 683.15 KB (699544) - NetworkThroughput(*): 64.05 MB/sec - OverallThroughput: 25.06 MB/sec - PeakMemoryUsage: 3.17 MB (3321120) - RowsReturned: 14.60K (14597) - SerializeBatchTime: 15.640ms - TransmitDataRPCTime: 10.415ms - UncompressedRowBatchSize: 1.51 MB (1582508) CodeGen:(Total: 51.282ms, non-child: 51.282ms, % non-child: 100.00%) - CodegenTime: 1.371ms - CompileTime: 6.605ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 17.568ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 26.448ms HDFS_SCAN_NODE (id=2):(Total: 1s110ms, non-child: 1s110ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:1/85.74 KB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: Only following filters arrived: , waited 945ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:9 BytesRead(500.000ms): 0, 0 - FooterProcessingTime: (Avg: 85.427ms ; Min: 85.427ms ; Max: 85.427ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 170.22 KB (174308) - BytesReadDataNodeCache: 0 - BytesReadLocal: 170.22 KB (174308) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 170.22 KB (174308) - DecompressionTime: 82.631us - MaxCompressedTextFileLength: 0 - NumColumns: 9 (9) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 1.03 MB (1076625) - PerReadThreadRawHdfsThroughput: 532.91 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 164.245ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 14.60K (14597) - RowsReturned: 14.60K (14597) - RowsReturnedRate: 13.15 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 168.790ms - MaterializeTupleTime(*): 4.840ms - ScannerThreadsSysTime: 999.000us - ScannerThreadsUserTime: 4.999ms - ScannerThreadsVoluntaryContextSwitches: 11 (11) - TotalRawHdfsReadTime(*): 311.932us - TotalReadThroughput: 0.00 /sec Filter 0 (1.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 14.60K (14597) Instance 7f40dcb034de70b7:38 (host=vd1102.foo:22000):(Total: 1s374ms, non-child: 194.817ms, % non-child: 14.17%) Hdfs split stats (:<# splits>/): 5:1/85.79 KB MemoryUsage(500.000ms): 171.90 KB, 171.90 KB ThreadUsage(500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.54 MB (3716401) - PerHostPeakMemUsage: 14.40 MB (15096944) - RowsProduced: 14.60K (14598) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 109.580ms - TotalStorageWaitTime: 169.711ms - TotalThreadsInvoluntaryContextSwitches: 28 (28) - TotalThreadsTotalWallClockTime: 1s498ms - TotalThreadsSysTime: 15.998ms - TotalThreadsUserTime: 66.990ms - TotalThreadsVoluntaryContextSwitches: 427 (427) Fragment Instance Lifecycle Timings: - ExecTime: 1s294ms - ExecTreeExecTime: 1s096ms - OpenTime: 29.032ms - ExecTreeOpenTime: 36.424us - PrepareTime: 50.768ms - ExecTreePrepareTime: 114.391us DataStreamSender (dst_id=27):(Total: 26.447ms, non-child: 26.447ms, % non-child: 100.00%) - BytesSent: 679.86 KB (696179) - NetworkThroughput(*): 63.84 MB/sec - OverallThroughput: 25.10 MB/sec - PeakMemoryUsage: 3.17 MB (3321120) - RowsReturned: 14.60K (14598) - SerializeBatchTime: 15.448ms - TransmitDataRPCTime: 10.400ms - UncompressedRowBatchSize: 1.51 MB (1584634) CodeGen:(Total: 56.446ms, non-child: 56.446ms, % non-child: 100.00%) - CodegenTime: 1.828ms - CompileTime: 7.114ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 19.957ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 28.371ms HDFS_SCAN_NODE (id=2):(Total: 1s096ms, non-child: 1s096ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:1/85.79 KB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: Only following filters arrived: , waited 925ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:9 BytesRead(500.000ms): 0, 0 - FooterProcessingTime: (Avg: 95.535ms ; Min: 95.535ms ; Max: 95.535ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 170.33 KB (174420) - BytesReadDataNodeCache: 0 - BytesReadLocal: 170.33 KB (174420) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 170.33 KB (174420) - DecompressionTime: 85.504us - MaxCompressedTextFileLength: 0 - NumColumns: 9 (9) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 1.03 MB (1076629) - PerReadThreadRawHdfsThroughput: 525.16 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 171.019ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 14.60K (14598) - RowsReturned: 14.60K (14598) - RowsReturnedRate: 13.31 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 175.531ms - MaterializeTupleTime(*): 4.704ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 5.999ms - ScannerThreadsVoluntaryContextSwitches: 11 (11) - TotalRawHdfsReadTime(*): 316.741us - TotalReadThroughput: 0.00 /sec Filter 0 (1.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 14.60K (14598) Instance 7f40dcb034de70b7:3c (host=va1030.foo:22000):(Total: 1s374ms, non-child: 178.351ms, % non-child: 12.98%) Hdfs split stats (:<# splits>/): 6:1/88.00 KB MemoryUsage(500.000ms): 171.90 KB, 171.90 KB, 3.15 MB ThreadUsage(500.000ms): 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.53 MB (3700323) - PerHostPeakMemUsage: 14.03 MB (14712587) - RowsProduced: 14.98K (14982) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 102.253ms - TotalStorageWaitTime: 170.862ms - TotalThreadsInvoluntaryContextSwitches: 33 (33) - TotalThreadsTotalWallClockTime: 1s503ms - TotalThreadsSysTime: 13.997ms - TotalThreadsUserTime: 63.989ms - TotalThreadsVoluntaryContextSwitches: 456 (456) Fragment Instance Lifecycle Timings: - ExecTime: 1s300ms - ExecTreeExecTime: 1s117ms - OpenTime: 25.776ms - ExecTreeOpenTime: 34.829us - PrepareTime: 47.902ms - ExecTreePrepareTime: 137.346us DataStreamSender (dst_id=27):(Total: 28.745ms, non-child: 28.745ms, % non-child: 100.00%) - BytesSent: 699.96 KB (716757) - NetworkThroughput(*): 60.87 MB/sec - OverallThroughput: 23.78 MB/sec - PeakMemoryUsage: 3.17 MB (3321120) - RowsReturned: 14.98K (14982) - SerializeBatchTime: 16.743ms - TransmitDataRPCTime: 11.230ms - UncompressedRowBatchSize: 1.55 MB (1627077) CodeGen:(Total: 49.302ms, non-child: 49.302ms, % non-child: 100.00%) - CodegenTime: 937.800us - CompileTime: 6.434ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 17.900ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 24.524ms HDFS_SCAN_NODE (id=2):(Total: 1s117ms, non-child: 1s117ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 6:1/88.00 KB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: Only following filters arrived: , waited 944ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:9 BytesRead(500.000ms): 0, 0 - FooterProcessingTime: (Avg: 95.004ms ; Min: 95.004ms ; Max: 95.004ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 174.74 KB (178938) - BytesReadDataNodeCache: 0 - BytesReadLocal: 174.74 KB (178938) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 174.74 KB (178938) - DecompressionTime: 122.183us - MaxCompressedTextFileLength: 0 - NumColumns: 9 (9) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 865.69 KB (886471) - PerReadThreadRawHdfsThroughput: 368.23 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 172.370ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 14.98K (14982) - RowsReturned: 14.98K (14982) - RowsReturnedRate: 13.40 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 2 (2) - ScannerThreadsTotalWallClockTime: 177.431ms - MaterializeTupleTime(*): 5.189ms - ScannerThreadsSysTime: 1.999ms - ScannerThreadsUserTime: 3.999ms - ScannerThreadsVoluntaryContextSwitches: 28 (28) - TotalRawHdfsReadTime(*): 463.430us - TotalReadThroughput: 0.00 /sec Filter 0 (1.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 14.98K (14982) Instance 7f40dcb034de70b7:41 (host=va1034.foo:22000):(Total: 1s373ms, non-child: 169.409ms, % non-child: 12.33%) Hdfs split stats (:<# splits>/): 4:1/87.95 KB MemoryUsage(500.000ms): 171.90 KB, 171.90 KB, 1.75 MB ThreadUsage(500.000ms): 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.56 MB (3735143) - PerHostPeakMemUsage: 14.26 MB (14953685) - RowsProduced: 14.98K (14983) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 92.095ms - TotalStorageWaitTime: 186.695ms - TotalThreadsInvoluntaryContextSwitches: 33 (33) - TotalThreadsTotalWallClockTime: 1s521ms - TotalThreadsSysTime: 14.997ms - TotalThreadsUserTime: 57.990ms - TotalThreadsVoluntaryContextSwitches: 422 (422) Fragment Instance Lifecycle Timings: - ExecTime: 1s307ms - ExecTreeExecTime: 1s134ms - OpenTime: 21.815ms - ExecTreeOpenTime: 38.012us - PrepareTime: 44.026ms - ExecTreePrepareTime: 107.986us DataStreamSender (dst_id=27):(Total: 25.288ms, non-child: 25.288ms, % non-child: 100.00%) - BytesSent: 701.50 KB (718335) - NetworkThroughput(*): 75.56 MB/sec - OverallThroughput: 27.09 MB/sec - PeakMemoryUsage: 3.17 MB (3321120) - RowsReturned: 14.98K (14983) - SerializeBatchTime: 15.759ms - TransmitDataRPCTime: 9.066ms - UncompressedRowBatchSize: 1.55 MB (1625522) CodeGen:(Total: 44.662ms, non-child: 44.662ms, % non-child: 100.00%) - CodegenTime: 848.761us - CompileTime: 5.837ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 14.879ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 23.450ms HDFS_SCAN_NODE (id=2):(Total: 1s134ms, non-child: 1s134ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:1/87.95 KB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: Only following filters arrived: , waited 944ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:9 BytesRead(500.000ms): 0, 0 - FooterProcessingTime: (Avg: 112.766ms ; Min: 112.766ms ; Max: 112.766ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 174.65 KB (178838) - BytesReadDataNodeCache: 0 - BytesReadLocal: 174.65 KB (178838) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 174.65 KB (178838) - DecompressionTime: 87.050us - MaxCompressedTextFileLength: 0 - NumColumns: 9 (9) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 1.03 MB (1078987) - PerReadThreadRawHdfsThroughput: 557.04 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 188.038ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 14.98K (14983) - RowsReturned: 14.98K (14983) - RowsReturnedRate: 13.21 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 5 (5) - ScannerThreadsTotalWallClockTime: 192.273ms - MaterializeTupleTime(*): 4.529ms - ScannerThreadsSysTime: 999.000us - ScannerThreadsUserTime: 3.999ms - ScannerThreadsVoluntaryContextSwitches: 12 (12) - TotalRawHdfsReadTime(*): 306.178us - TotalReadThroughput: 0.00 /sec Filter 0 (1.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 14.98K (14983) Instance 7f40dcb034de70b7:48 (host=vd1121.foo:22000):(Total: 1s373ms, non-child: 184.216ms, % non-child: 13.41%) Hdfs split stats (:<# splits>/): 3:1/85.79 KB MemoryUsage(500.000ms): 171.90 KB, 171.90 KB ThreadUsage(500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.54 MB (3716397) - PerHostPeakMemUsage: 14.26 MB (14957555) - RowsProduced: 14.60K (14597) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 110.450ms - TotalStorageWaitTime: 179.844ms - TotalThreadsInvoluntaryContextSwitches: 29 (29) - TotalThreadsTotalWallClockTime: 1s506ms - TotalThreadsSysTime: 11.997ms - TotalThreadsUserTime: 67.990ms - TotalThreadsVoluntaryContextSwitches: 403 (403) Fragment Instance Lifecycle Timings: - ExecTime: 1s293ms - ExecTreeExecTime: 1s106ms - OpenTime: 27.012ms - ExecTreeOpenTime: 39.474us - PrepareTime: 52.661ms - ExecTreePrepareTime: 131.332us DataStreamSender (dst_id=27):(Total: 27.473ms, non-child: 27.473ms, % non-child: 100.00%) - BytesSent: 683.35 KB (699747) - NetworkThroughput(*): 64.50 MB/sec - OverallThroughput: 24.29 MB/sec - PeakMemoryUsage: 3.17 MB (3321120) - RowsReturned: 14.60K (14597) - SerializeBatchTime: 16.488ms - TransmitDataRPCTime: 10.345ms - UncompressedRowBatchSize: 1.51 MB (1587034) CodeGen:(Total: 55.276ms, non-child: 55.276ms, % non-child: 100.00%) - CodegenTime: 1.410ms - CompileTime: 6.746ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 18.313ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 29.572ms HDFS_SCAN_NODE (id=2):(Total: 1s106ms, non-child: 1s106ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:1/85.79 KB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: Only following filters arrived: , waited 924ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:9 BytesRead(500.000ms): 0, 0 - FooterProcessingTime: (Avg: 109.903ms ; Min: 109.903ms ; Max: 109.903ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 170.32 KB (174404) - BytesReadDataNodeCache: 0 - BytesReadLocal: 170.32 KB (174404) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 170.32 KB (174404) - DecompressionTime: 76.902us - MaxCompressedTextFileLength: 0 - NumColumns: 9 (9) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 957.39 KB (980369) - PerReadThreadRawHdfsThroughput: 517.78 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 181.290ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 14.60K (14597) - RowsReturned: 14.60K (14597) - RowsReturnedRate: 13.19 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 185.766ms - MaterializeTupleTime(*): 4.690ms - ScannerThreadsSysTime: 999.000us - ScannerThreadsUserTime: 4.999ms - ScannerThreadsVoluntaryContextSwitches: 11 (11) - TotalRawHdfsReadTime(*): 321.229us - TotalReadThroughput: 0.00 /sec Filter 0 (1.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 14.60K (14597) Instance 7f40dcb034de70b7:69 (host=vd1107.foo:22000):(Total: 1s373ms, non-child: 117.915ms, % non-child: 8.59%) Hdfs split stats (:<# splits>/): 2:1/87.99 KB 1:1/83.65 KB MemoryUsage(500.000ms): 171.90 KB, 443.90 KB ThreadUsage(500.000ms): 1, 3 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 4.98 MB (5219020) - PerHostPeakMemUsage: 14.15 MB (14841553) - RowsProduced: 29.20K (29197) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 62.475ms - TotalStorageWaitTime: 434.861ms - TotalThreadsInvoluntaryContextSwitches: 25 (25) - TotalThreadsTotalWallClockTime: 1s780ms - TotalThreadsSysTime: 21.996ms - TotalThreadsUserTime: 74.987ms - TotalThreadsVoluntaryContextSwitches: 414 (414) Fragment Instance Lifecycle Timings: - ExecTime: 1s307ms - ExecTreeExecTime: 1s163ms - OpenTime: 22.935ms - ExecTreeOpenTime: 32.773us - PrepareTime: 42.290ms - ExecTreePrepareTime: 151.221us DataStreamSender (dst_id=27):(Total: 45.920ms, non-child: 45.920ms, % non-child: 100.00%) - BytesSent: 1.34 MB (1400845) - NetworkThroughput(*): 56.35 MB/sec - OverallThroughput: 29.09 MB/sec - PeakMemoryUsage: 3.17 MB (3321120) - RowsReturned: 29.20K (29197) - SerializeBatchTime: 21.589ms - TransmitDataRPCTime: 23.707ms - UncompressedRowBatchSize: 3.02 MB (3168585) CodeGen:(Total: 45.368ms, non-child: 45.368ms, % non-child: 100.00%) - CodegenTime: 1.068ms - CompileTime: 6.111ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 15.427ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 23.329ms HDFS_SCAN_NODE (id=2):(Total: 1s163ms, non-child: 1s163ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:1/87.99 KB 1:1/83.65 KB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 2 out of 2 Runtime filters: Only following filters arrived: , waited 944ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:18 BytesRead(500.000ms): 0, 0 - FooterProcessingTime: (Avg: 138.399ms ; Min: 136.865ms ; Max: 139.933ms ; Number of samples: 2) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 340.76 KB (348942) - BytesReadDataNodeCache: 0 - BytesReadLocal: 340.76 KB (348942) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 340.76 KB (348942) - DecompressionTime: 176.090us - MaxCompressedTextFileLength: 0 - NumColumns: 9 (9) - NumDisksAccessed: 2 (2) - NumRowGroups: 2 (2) - NumScannerThreadsStarted: 2 (2) - PeakMemoryUsage: 2.50 MB (2626352) - PerReadThreadRawHdfsThroughput: 504.97 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 218.200ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 29.20K (29197) - RowsReturned: 29.20K (29197) - RowsReturnedRate: 25.08 K/sec - ScanRangesComplete: 2 (2) - ScannerThreadsInvoluntaryContextSwitches: 1 (1) - ScannerThreadsTotalWallClockTime: 450.472ms - MaterializeTupleTime(*): 12.493ms - ScannerThreadsSysTime: 999.000us - ScannerThreadsUserTime: 13.996ms - ScannerThreadsVoluntaryContextSwitches: 31 (31) - TotalRawHdfsReadTime(*): 659.002us - TotalReadThroughput: 0.00 /sec Filter 0 (1.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 29.20K (29197) Instance 7f40dcb034de70b7:24 (host=ve1135.foo:22000):(Total: 1s372ms, non-child: 198.791ms, % non-child: 14.48%) Hdfs split stats (:<# splits>/): 6:1/88.04 KB MemoryUsage(500.000ms): 171.90 KB, 171.90 KB ThreadUsage(500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.56 MB (3735143) - PerHostPeakMemUsage: 15.87 MB (16642868) - RowsProduced: 14.98K (14983) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 107.227ms - TotalStorageWaitTime: 167.889ms - TotalThreadsInvoluntaryContextSwitches: 32 (32) - TotalThreadsTotalWallClockTime: 1s488ms - TotalThreadsSysTime: 26.995ms - TotalThreadsUserTime: 49.992ms - TotalThreadsVoluntaryContextSwitches: 403 (403) Fragment Instance Lifecycle Timings: - ExecTime: 1s292ms - ExecTreeExecTime: 1s093ms - OpenTime: 21.977ms - ExecTreeOpenTime: 32.420us - PrepareTime: 57.919ms - ExecTreePrepareTime: 123.598us DataStreamSender (dst_id=27):(Total: 28.126ms, non-child: 28.126ms, % non-child: 100.00%) - BytesSent: 707.78 KB (724769) - NetworkThroughput(*): 63.96 MB/sec - OverallThroughput: 24.57 MB/sec - PeakMemoryUsage: 3.17 MB (3321120) - RowsReturned: 14.98K (14983) - SerializeBatchTime: 16.417ms - TransmitDataRPCTime: 10.806ms - UncompressedRowBatchSize: 1.55 MB (1630023) CodeGen:(Total: 51.772ms, non-child: 51.772ms, % non-child: 100.00%) - CodegenTime: 1.248ms - CompileTime: 5.981ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 14.661ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 30.727ms HDFS_SCAN_NODE (id=2):(Total: 1s094ms, non-child: 1s094ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 6:1/88.04 KB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: Only following filters arrived: , waited 924ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:9 BytesRead(500.000ms): 0, 0 - FooterProcessingTime: (Avg: 89.632ms ; Min: 89.632ms ; Max: 89.632ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 174.82 KB (179016) - BytesReadDataNodeCache: 0 - BytesReadLocal: 174.82 KB (179016) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 174.82 KB (179016) - DecompressionTime: 88.146us - MaxCompressedTextFileLength: 0 - NumColumns: 9 (9) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 951.70 KB (974539) - PerReadThreadRawHdfsThroughput: 534.40 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 169.288ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 14.98K (14983) - RowsReturned: 14.98K (14983) - RowsReturnedRate: 13.69 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 1 (1) - ScannerThreadsTotalWallClockTime: 174.194ms - MaterializeTupleTime(*): 4.968ms - ScannerThreadsSysTime: 1.999ms - ScannerThreadsUserTime: 3.999ms - ScannerThreadsVoluntaryContextSwitches: 11 (11) - TotalRawHdfsReadTime(*): 319.464us - TotalReadThroughput: 0.00 /sec Filter 0 (1.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 14.98K (14983) Instance 7f40dcb034de70b7:47 (host=ve1140.foo:22000):(Total: 1s372ms, non-child: 173.038ms, % non-child: 12.61%) Hdfs split stats (:<# splits>/): 0:1/85.74 KB MemoryUsage(500.000ms): 171.90 KB, 171.90 KB ThreadUsage(500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.56 MB (3730729) - PerHostPeakMemUsage: 14.21 MB (14903280) - RowsProduced: 14.60K (14596) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 94.815ms - TotalStorageWaitTime: 176.269ms - TotalThreadsInvoluntaryContextSwitches: 38 (38) - TotalThreadsTotalWallClockTime: 1s484ms - TotalThreadsSysTime: 14.997ms - TotalThreadsUserTime: 62.990ms - TotalThreadsVoluntaryContextSwitches: 392 (392) Fragment Instance Lifecycle Timings: - ExecTime: 1s276ms - ExecTreeExecTime: 1s102ms - OpenTime: 26.109ms - ExecTreeOpenTime: 37.098us - PrepareTime: 69.494ms - ExecTreePrepareTime: 143.711us DataStreamSender (dst_id=27):(Total: 27.256ms, non-child: 27.256ms, % non-child: 100.00%) - BytesSent: 686.17 KB (702638) - NetworkThroughput(*): 66.14 MB/sec - OverallThroughput: 24.58 MB/sec - PeakMemoryUsage: 3.17 MB (3321120) - RowsReturned: 14.60K (14596) - SerializeBatchTime: 15.893ms - TransmitDataRPCTime: 10.131ms - UncompressedRowBatchSize: 1.51 MB (1588324) CodeGen:(Total: 69.111ms, non-child: 69.111ms, % non-child: 100.00%) - CodegenTime: 1.584ms - CompileTime: 6.709ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 17.985ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 43.692ms HDFS_SCAN_NODE (id=2):(Total: 1s102ms, non-child: 1s102ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/85.74 KB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: Only following filters arrived: , waited 925ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:9 BytesRead(500.000ms): 0, 0 - FooterProcessingTime: (Avg: 108.880ms ; Min: 108.880ms ; Max: 108.880ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 170.22 KB (174302) - BytesReadDataNodeCache: 0 - BytesReadLocal: 170.22 KB (174302) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 170.22 KB (174302) - DecompressionTime: 51.556us - MaxCompressedTextFileLength: 0 - NumColumns: 9 (9) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 863.39 KB (884109) - PerReadThreadRawHdfsThroughput: 600.07 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 177.444ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 14.60K (14596) - RowsReturned: 14.60K (14596) - RowsReturnedRate: 13.23 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 182.296ms - MaterializeTupleTime(*): 4.999ms - ScannerThreadsSysTime: 1.999ms - ScannerThreadsUserTime: 2.999ms - ScannerThreadsVoluntaryContextSwitches: 11 (11) - TotalRawHdfsReadTime(*): 277.012us - TotalReadThroughput: 0.00 /sec Filter 0 (1.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 14.60K (14596) Instance 7f40dcb034de70b7:4b (host=va1035.foo:22000):(Total: 1s372ms, non-child: 114.430ms, % non-child: 8.34%) Hdfs split stats (:<# splits>/): 1:1/88.00 KB 2:1/81.32 KB MemoryUsage(500.000ms): 171.90 KB, 171.90 KB, 795.90 KB ThreadUsage(500.000ms): 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 5.05 MB (5296534) - PerHostPeakMemUsage: 14.83 MB (15555505) - RowsProduced: 28.81K (28812) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 68.966ms - TotalStorageWaitTime: 418.141ms - TotalThreadsInvoluntaryContextSwitches: 30 (30) - TotalThreadsTotalWallClockTime: 1s756ms - TotalThreadsSysTime: 20.997ms - TotalThreadsUserTime: 72.988ms - TotalThreadsVoluntaryContextSwitches: 417 (417) Fragment Instance Lifecycle Timings: - ExecTime: 1s297ms - ExecTreeExecTime: 1s155ms - OpenTime: 31.439ms - ExecTreeOpenTime: 33.791us - PrepareTime: 43.460ms - ExecTreePrepareTime: 133.518us DataStreamSender (dst_id=27):(Total: 46.940ms, non-child: 46.940ms, % non-child: 100.00%) - BytesSent: 1.31 MB (1378721) - NetworkThroughput(*): 53.45 MB/sec - OverallThroughput: 28.01 MB/sec - PeakMemoryUsage: 3.17 MB (3321120) - RowsReturned: 28.81K (28812) - SerializeBatchTime: 21.762ms - TransmitDataRPCTime: 24.601ms - UncompressedRowBatchSize: 2.99 MB (3130582) CodeGen:(Total: 55.572ms, non-child: 55.572ms, % non-child: 100.00%) - CodegenTime: 1.482ms - CompileTime: 6.564ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 23.193ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 24.980ms HDFS_SCAN_NODE (id=2):(Total: 1s155ms, non-child: 1s155ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:1/88.00 KB 2:1/81.32 KB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 2 out of 2 Runtime filters: Only following filters arrived: , waited 945ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:18 BytesRead(500.000ms): 0, 0 - FooterProcessingTime: (Avg: 109.943ms ; Min: 107.155ms ; Max: 112.732ms ; Number of samples: 2) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 336.13 KB (344196) - BytesReadDataNodeCache: 0 - BytesReadLocal: 336.13 KB (344196) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 336.13 KB (344196) - DecompressionTime: 195.087us - MaxCompressedTextFileLength: 0 - NumColumns: 9 (9) - NumDisksAccessed: 2 (2) - NumRowGroups: 2 (2) - NumScannerThreadsStarted: 2 (2) - PeakMemoryUsage: 1.88 MB (1974778) - PerReadThreadRawHdfsThroughput: 455.42 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 209.151ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 28.81K (28812) - RowsReturned: 28.81K (28812) - RowsReturnedRate: 24.94 K/sec - ScanRangesComplete: 2 (2) - ScannerThreadsInvoluntaryContextSwitches: 1 (1) - ScannerThreadsTotalWallClockTime: 428.448ms - MaterializeTupleTime(*): 7.523ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 8.998ms - ScannerThreadsVoluntaryContextSwitches: 28 (28) - TotalRawHdfsReadTime(*): 720.759us - TotalReadThroughput: 0.00 /sec Filter 0 (1.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 28.81K (28812) Instance 7f40dcb034de70b7:45 (host=ve1142.foo:22000):(Total: 1s371ms, non-child: 174.580ms, % non-child: 12.73%) Hdfs split stats (:<# splits>/): 2:1/85.85 KB MemoryUsage(500.000ms): 171.90 KB, 171.90 KB, 307.90 KB ThreadUsage(500.000ms): 1, 1, 2 - AverageThreadTokens: 1.33 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.57 MB (3747121) - PerHostPeakMemUsage: 14.19 MB (14882004) - RowsProduced: 14.60K (14598) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 96.239ms - TotalStorageWaitTime: 174.339ms - TotalThreadsInvoluntaryContextSwitches: 22 (22) - TotalThreadsTotalWallClockTime: 1s503ms - TotalThreadsSysTime: 18.997ms - TotalThreadsUserTime: 56.991ms - TotalThreadsVoluntaryContextSwitches: 416 (416) Fragment Instance Lifecycle Timings: - ExecTime: 1s300ms - ExecTreeExecTime: 1s121ms - OpenTime: 23.076ms - ExecTreeOpenTime: 34.156us - PrepareTime: 48.594ms - ExecTreePrepareTime: 154.898us DataStreamSender (dst_id=27):(Total: 26.913ms, non-child: 26.913ms, % non-child: 100.00%) - BytesSent: 693.70 KB (710351) - NetworkThroughput(*): 66.11 MB/sec - OverallThroughput: 25.17 MB/sec - PeakMemoryUsage: 3.17 MB (3321120) - RowsReturned: 14.60K (14598) - SerializeBatchTime: 16.044ms - TransmitDataRPCTime: 10.247ms - UncompressedRowBatchSize: 1.51 MB (1585602) CodeGen:(Total: 48.723ms, non-child: 48.723ms, % non-child: 100.00%) - CodegenTime: 1.255ms - CompileTime: 5.810ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 15.731ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 26.711ms HDFS_SCAN_NODE (id=2):(Total: 1s121ms, non-child: 1s121ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:1/85.85 KB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: Only following filters arrived: , waited 944ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:9 BytesRead(500.000ms): 0, 0, 0 - FooterProcessingTime: (Avg: 104.693ms ; Min: 104.693ms ; Max: 104.693ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.33 - BytesRead: 170.45 KB (174538) - BytesReadDataNodeCache: 0 - BytesReadLocal: 170.45 KB (174538) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 170.45 KB (174538) - DecompressionTime: 72.023us - MaxCompressedTextFileLength: 0 - NumColumns: 9 (9) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 1.02 MB (1068437) - PerReadThreadRawHdfsThroughput: 476.93 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 175.809ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 14.60K (14598) - RowsReturned: 14.60K (14598) - RowsReturnedRate: 13.02 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 1 (1) - ScannerThreadsTotalWallClockTime: 180.393ms - MaterializeTupleTime(*): 4.805ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 4.999ms - ScannerThreadsVoluntaryContextSwitches: 15 (15) - TotalRawHdfsReadTime(*): 349.010us - TotalReadThroughput: 0.00 /sec Filter 0 (1.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 14.60K (14598) Instance 7f40dcb034de70b7:3f (host=vd1110.foo:22000):(Total: 1s371ms, non-child: 167.491ms, % non-child: 12.21%) Hdfs split stats (:<# splits>/): 4:1/85.74 KB MemoryUsage(500.000ms): 171.90 KB, 171.90 KB, 2.68 MB ThreadUsage(500.000ms): 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.53 MB (3700013) - PerHostPeakMemUsage: 14.27 MB (14962153) - RowsProduced: 14.60K (14597) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 93.322ms - TotalStorageWaitTime: 186.574ms - TotalThreadsInvoluntaryContextSwitches: 29 (29) - TotalThreadsTotalWallClockTime: 1s519ms - TotalThreadsSysTime: 18.997ms - TotalThreadsUserTime: 55.991ms - TotalThreadsVoluntaryContextSwitches: 411 (411) Fragment Instance Lifecycle Timings: - ExecTime: 1s303ms - ExecTreeExecTime: 1s133ms - OpenTime: 23.724ms - ExecTreeOpenTime: 38.300us - PrepareTime: 44.641ms - ExecTreePrepareTime: 123.953us DataStreamSender (dst_id=27):(Total: 27.038ms, non-child: 27.038ms, % non-child: 100.00%) - BytesSent: 687.40 KB (703894) - NetworkThroughput(*): 64.40 MB/sec - OverallThroughput: 24.83 MB/sec - PeakMemoryUsage: 3.17 MB (3321120) - RowsReturned: 14.60K (14597) - SerializeBatchTime: 15.899ms - TransmitDataRPCTime: 10.423ms - UncompressedRowBatchSize: 1.51 MB (1587013) CodeGen:(Total: 43.881ms, non-child: 43.881ms, % non-child: 100.00%) - CodegenTime: 1.039ms - CompileTime: 5.575ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 16.632ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 21.275ms HDFS_SCAN_NODE (id=2):(Total: 1s133ms, non-child: 1s133ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:1/85.74 KB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: Only following filters arrived: , waited 944ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:9 BytesRead(500.000ms): 0, 0 - FooterProcessingTime: (Avg: 115.436ms ; Min: 115.436ms ; Max: 115.436ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 170.23 KB (174314) - BytesReadDataNodeCache: 0 - BytesReadLocal: 170.23 KB (174314) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 170.23 KB (174314) - DecompressionTime: 72.730us - MaxCompressedTextFileLength: 0 - NumColumns: 9 (9) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 957.39 KB (980369) - PerReadThreadRawHdfsThroughput: 615.78 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 187.966ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 14.60K (14597) - RowsReturned: 14.60K (14597) - RowsReturnedRate: 12.88 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 2 (2) - ScannerThreadsTotalWallClockTime: 192.443ms - MaterializeTupleTime(*): 4.731ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 4.999ms - ScannerThreadsVoluntaryContextSwitches: 10 (10) - TotalRawHdfsReadTime(*): 269.966us - TotalReadThroughput: 0.00 /sec Filter 0 (1.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 14.60K (14597) Instance 7f40dcb034de70b7:50 (host=ve1130.foo:22000):(Total: 1s371ms, non-child: 175.507ms, % non-child: 12.80%) Hdfs split stats (:<# splits>/): 6:1/85.75 KB MemoryUsage(500.000ms): 171.90 KB, 171.90 KB, 1.02 MB ThreadUsage(500.000ms): 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.58 MB (3749169) - PerHostPeakMemUsage: 14.07 MB (14751157) - RowsProduced: 14.60K (14598) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 98.783ms - TotalStorageWaitTime: 181.911ms - TotalThreadsInvoluntaryContextSwitches: 24 (24) - TotalThreadsTotalWallClockTime: 1s498ms - TotalThreadsSysTime: 16.997ms - TotalThreadsUserTime: 56.991ms - TotalThreadsVoluntaryContextSwitches: 400 (400) Fragment Instance Lifecycle Timings: - ExecTime: 1s289ms - ExecTreeExecTime: 1s108ms - OpenTime: 21.937ms - ExecTreeOpenTime: 41.842us - PrepareTime: 60.123ms - ExecTreePrepareTime: 104.680us DataStreamSender (dst_id=27):(Total: 26.089ms, non-child: 26.089ms, % non-child: 100.00%) - BytesSent: 689.74 KB (706296) - NetworkThroughput(*): 70.08 MB/sec - OverallThroughput: 25.82 MB/sec - PeakMemoryUsage: 3.17 MB (3321120) - RowsReturned: 14.60K (14598) - SerializeBatchTime: 15.939ms - TransmitDataRPCTime: 9.610ms - UncompressedRowBatchSize: 1.51 MB (1588404) CodeGen:(Total: 61.324ms, non-child: 61.324ms, % non-child: 100.00%) - CodegenTime: 1.355ms - CompileTime: 6.033ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 14.330ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 39.995ms HDFS_SCAN_NODE (id=2):(Total: 1s108ms, non-child: 1s108ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 6:1/85.75 KB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: Only following filters arrived: , waited 925ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:9 BytesRead(500.000ms): 0, 0 - FooterProcessingTime: (Avg: 109.585ms ; Min: 109.585ms ; Max: 109.585ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 170.24 KB (174330) - BytesReadDataNodeCache: 0 - BytesReadLocal: 170.24 KB (174330) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 170.24 KB (174330) - DecompressionTime: 101.992us - MaxCompressedTextFileLength: 0 - NumColumns: 9 (9) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 769.40 KB (787861) - PerReadThreadRawHdfsThroughput: 697.04 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 183.330ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 14.60K (14598) - RowsReturned: 14.60K (14598) - RowsReturnedRate: 13.17 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 187.947ms - MaterializeTupleTime(*): 4.867ms - ScannerThreadsSysTime: 1.999ms - ScannerThreadsUserTime: 3.999ms - ScannerThreadsVoluntaryContextSwitches: 11 (11) - TotalRawHdfsReadTime(*): 238.514us - TotalReadThroughput: 0.00 /sec Filter 0 (1.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 14.60K (14598) Instance 7f40dcb034de70b7:40 (host=vd1142.foo:22000):(Total: 1s371ms, non-child: 175.045ms, % non-child: 12.77%) Hdfs split stats (:<# splits>/): 6:1/87.96 KB MemoryUsage(500.000ms): 171.90 KB, 171.90 KB, 1.02 MB ThreadUsage(500.000ms): 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.55 MB (3718759) - PerHostPeakMemUsage: 14.27 MB (14962836) - RowsProduced: 14.98K (14983) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 96.757ms - TotalStorageWaitTime: 179.570ms - TotalThreadsInvoluntaryContextSwitches: 27 (27) - TotalThreadsTotalWallClockTime: 1s511ms - TotalThreadsSysTime: 14.997ms - TotalThreadsUserTime: 60.991ms - TotalThreadsVoluntaryContextSwitches: 413 (413) Fragment Instance Lifecycle Timings: - ExecTime: 1s303ms - ExecTreeExecTime: 1s125ms - OpenTime: 22.664ms - ExecTreeOpenTime: 33.005us - PrepareTime: 44.495ms - ExecTreePrepareTime: 100.131us DataStreamSender (dst_id=27):(Total: 26.097ms, non-child: 26.097ms, % non-child: 100.00%) - BytesSent: 701.22 KB (718051) - NetworkThroughput(*): 70.82 MB/sec - OverallThroughput: 26.24 MB/sec - PeakMemoryUsage: 3.17 MB (3321120) - RowsReturned: 14.98K (14983) - SerializeBatchTime: 15.901ms - TransmitDataRPCTime: 9.669ms - UncompressedRowBatchSize: 1.55 MB (1620130) CodeGen:(Total: 43.831ms, non-child: 43.831ms, % non-child: 100.00%) - CodegenTime: 1.377ms - CompileTime: 5.684ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 15.340ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 22.284ms HDFS_SCAN_NODE (id=2):(Total: 1s126ms, non-child: 1s126ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 6:1/87.96 KB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: Only following filters arrived: , waited 944ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:9 BytesRead(500.000ms): 0, 0 - FooterProcessingTime: (Avg: 110.165ms ; Min: 110.165ms ; Max: 110.165ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 174.67 KB (178866) - BytesReadDataNodeCache: 0 - BytesReadLocal: 174.67 KB (178866) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 174.67 KB (178866) - DecompressionTime: 63.347us - MaxCompressedTextFileLength: 0 - NumColumns: 9 (9) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 865.70 KB (886475) - PerReadThreadRawHdfsThroughput: 661.96 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 180.920ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 14.98K (14983) - RowsReturned: 14.98K (14983) - RowsReturnedRate: 13.30 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 2 (2) - ScannerThreadsTotalWallClockTime: 185.710ms - MaterializeTupleTime(*): 4.918ms - ScannerThreadsSysTime: 999.000us - ScannerThreadsUserTime: 4.999ms - ScannerThreadsVoluntaryContextSwitches: 12 (12) - TotalRawHdfsReadTime(*): 257.690us - TotalReadThroughput: 0.00 /sec Filter 0 (1.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 14.98K (14983) Instance 7f40dcb034de70b7:1a (host=vc1530.foo:22000):(Total: 1s371ms, non-child: 158.448ms, % non-child: 11.56%) Hdfs split stats (:<# splits>/): 3:1/85.84 KB MemoryUsage(500.000ms): 171.90 KB, 171.90 KB ThreadUsage(500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.57 MB (3747121) - PerHostPeakMemUsage: 13.41 MB (14058828) - RowsProduced: 14.60K (14598) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 78.215ms - TotalStorageWaitTime: 190.229ms - TotalThreadsInvoluntaryContextSwitches: 33 (33) - TotalThreadsTotalWallClockTime: 1s514ms - TotalThreadsSysTime: 13.998ms - TotalThreadsUserTime: 60.990ms - TotalThreadsVoluntaryContextSwitches: 413 (413) Fragment Instance Lifecycle Timings: - ExecTime: 1s297ms - ExecTreeExecTime: 1s136ms - OpenTime: 22.356ms - ExecTreeOpenTime: 36.628us - PrepareTime: 51.546ms - ExecTreePrepareTime: 113.559us DataStreamSender (dst_id=27):(Total: 27.147ms, non-child: 27.147ms, % non-child: 100.00%) - BytesSent: 686.96 KB (703451) - NetworkThroughput(*): 64.69 MB/sec - OverallThroughput: 24.71 MB/sec - PeakMemoryUsage: 3.17 MB (3321120) - RowsReturned: 14.60K (14598) - SerializeBatchTime: 16.164ms - TransmitDataRPCTime: 10.370ms - UncompressedRowBatchSize: 1.51 MB (1587055) CodeGen:(Total: 48.638ms, non-child: 48.638ms, % non-child: 100.00%) - CodegenTime: 1.150ms - CompileTime: 6.077ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 14.930ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 27.158ms HDFS_SCAN_NODE (id=2):(Total: 1s136ms, non-child: 1s136ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:1/85.84 KB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: Only following filters arrived: , waited 945ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:9 BytesRead(500.000ms): 0, 0 - FooterProcessingTime: (Avg: 119.445ms ; Min: 119.445ms ; Max: 119.445ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 170.42 KB (174508) - BytesReadDataNodeCache: 0 - BytesReadLocal: 170.42 KB (174508) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 170.42 KB (174508) - DecompressionTime: 61.227us - MaxCompressedTextFileLength: 0 - NumColumns: 9 (9) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 957.40 KB (980373) - PerReadThreadRawHdfsThroughput: 552.60 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 191.186ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 14.60K (14598) - RowsReturned: 14.60K (14598) - RowsReturnedRate: 12.84 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 2 (2) - ScannerThreadsTotalWallClockTime: 195.504ms - MaterializeTupleTime(*): 4.404ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 4.999ms - ScannerThreadsVoluntaryContextSwitches: 12 (12) - TotalRawHdfsReadTime(*): 301.167us - TotalReadThroughput: 0.00 /sec Filter 0 (1.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 14.60K (14598) Instance 7f40dcb034de70b7:2f (host=vd1327.foo:22000):(Total: 1s370ms, non-child: 182.368ms, % non-child: 13.30%) Hdfs split stats (:<# splits>/): 1:1/83.62 KB MemoryUsage(500.000ms): 171.90 KB, 171.90 KB, 983.90 KB ThreadUsage(500.000ms): 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.48 MB (3650557) - PerHostPeakMemUsage: 14.09 MB (14778318) - RowsProduced: 14.21K (14213) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 100.529ms - TotalStorageWaitTime: 181.465ms - TotalThreadsInvoluntaryContextSwitches: 27 (27) - TotalThreadsTotalWallClockTime: 1s506ms - TotalThreadsSysTime: 14.998ms - TotalThreadsUserTime: 61.990ms - TotalThreadsVoluntaryContextSwitches: 413 (413) Fragment Instance Lifecycle Timings: - ExecTime: 1s292ms - ExecTreeExecTime: 1s108ms - OpenTime: 27.050ms - ExecTreeOpenTime: 36.041us - PrepareTime: 51.246ms - ExecTreePrepareTime: 112.964us DataStreamSender (dst_id=27):(Total: 26.414ms, non-child: 26.414ms, % non-child: 100.00%) - BytesSent: 668.52 KB (684564) - NetworkThroughput(*): 63.58 MB/sec - OverallThroughput: 24.72 MB/sec - PeakMemoryUsage: 3.17 MB (3321120) - RowsReturned: 14.21K (14213) - SerializeBatchTime: 15.682ms - TransmitDataRPCTime: 10.268ms - UncompressedRowBatchSize: 1.47 MB (1536614) CodeGen:(Total: 53.685ms, non-child: 53.685ms, % non-child: 100.00%) - CodegenTime: 1.572ms - CompileTime: 6.727ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 18.535ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 27.851ms HDFS_SCAN_NODE (id=2):(Total: 1s108ms, non-child: 1s108ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:1/83.62 KB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: Only following filters arrived: , waited 925ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:9 BytesRead(500.000ms): 0, 0 - FooterProcessingTime: (Avg: 107.179ms ; Min: 107.179ms ; Max: 107.179ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 165.99 KB (169970) - BytesReadDataNodeCache: 0 - BytesReadLocal: 165.99 KB (169970) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 165.99 KB (169970) - DecompressionTime: 60.492us - MaxCompressedTextFileLength: 0 - NumColumns: 9 (9) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 853.09 KB (873569) - PerReadThreadRawHdfsThroughput: 515.31 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 182.841ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 14.21K (14213) - RowsReturned: 14.21K (14213) - RowsReturnedRate: 12.82 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 1 (1) - ScannerThreadsTotalWallClockTime: 187.054ms - MaterializeTupleTime(*): 4.298ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 4.999ms - ScannerThreadsVoluntaryContextSwitches: 11 (11) - TotalRawHdfsReadTime(*): 314.560us - TotalReadThroughput: 0.00 /sec Filter 0 (1.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 14.21K (14213) Instance 7f40dcb034de70b7:4c (host=vc1542.foo:22000):(Total: 1s370ms, non-child: 168.740ms, % non-child: 12.31%) Hdfs split stats (:<# splits>/): 1:1/87.95 KB MemoryUsage(500.000ms): 171.90 KB, 171.90 KB, 307.90 KB ThreadUsage(500.000ms): 1, 1, 2 - AverageThreadTokens: 1.33 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.58 MB (3751527) - PerHostPeakMemUsage: 15.68 MB (16437451) - RowsProduced: 14.98K (14983) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 91.584ms - TotalStorageWaitTime: 180.518ms - TotalThreadsInvoluntaryContextSwitches: 34 (34) - TotalThreadsTotalWallClockTime: 1s508ms - TotalThreadsSysTime: 18.996ms - TotalThreadsUserTime: 52.992ms - TotalThreadsVoluntaryContextSwitches: 408 (408) Fragment Instance Lifecycle Timings: - ExecTime: 1s300ms - ExecTreeExecTime: 1s127ms - OpenTime: 21.430ms - ExecTreeOpenTime: 41.241us - PrepareTime: 47.907ms - ExecTreePrepareTime: 162.800us DataStreamSender (dst_id=27):(Total: 26.428ms, non-child: 26.428ms, % non-child: 100.00%) - BytesSent: 703.80 KB (720692) - NetworkThroughput(*): 70.23 MB/sec - OverallThroughput: 26.01 MB/sec - PeakMemoryUsage: 3.17 MB (3321120) - RowsReturned: 14.98K (14983) - SerializeBatchTime: 16.177ms - TransmitDataRPCTime: 9.786ms - UncompressedRowBatchSize: 1.55 MB (1621563) CodeGen:(Total: 46.997ms, non-child: 46.997ms, % non-child: 100.00%) - CodegenTime: 1.416ms - CompileTime: 5.913ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 14.073ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 26.145ms HDFS_SCAN_NODE (id=2):(Total: 1s128ms, non-child: 1s128ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:1/87.95 KB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: Only following filters arrived: , waited 945ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:9 BytesRead(500.000ms): 0, 0, 0 - FooterProcessingTime: (Avg: 103.140ms ; Min: 103.140ms ; Max: 103.140ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.33 - BytesRead: 174.65 KB (178838) - BytesReadDataNodeCache: 0 - BytesReadLocal: 174.65 KB (178838) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 174.65 KB (178838) - DecompressionTime: 59.846us - MaxCompressedTextFileLength: 0 - NumColumns: 9 (9) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 959.70 KB (982731) - PerReadThreadRawHdfsThroughput: 471.10 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 181.894ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 14.98K (14983) - RowsReturned: 14.98K (14983) - RowsReturnedRate: 13.28 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 1 (1) - ScannerThreadsTotalWallClockTime: 186.314ms - MaterializeTupleTime(*): 4.583ms - ScannerThreadsSysTime: 999.000us - ScannerThreadsUserTime: 3.999ms - ScannerThreadsVoluntaryContextSwitches: 12 (12) - TotalRawHdfsReadTime(*): 362.034us - TotalReadThroughput: 0.00 /sec Filter 0 (1.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 14.98K (14983) Instance 7f40dcb034de70b7:42 (host=ve1138.foo:22000):(Total: 1s370ms, non-child: 177.886ms, % non-child: 12.98%) Hdfs split stats (:<# splits>/): 7:1/87.88 KB MemoryUsage(500.000ms): 171.90 KB, 171.90 KB, 312.43 KB ThreadUsage(500.000ms): 1, 1, 2 - AverageThreadTokens: 1.33 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.59 MB (3765859) - PerHostPeakMemUsage: 13.95 MB (14626917) - RowsProduced: 14.98K (14982) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 93.118ms - TotalStorageWaitTime: 185.969ms - TotalThreadsInvoluntaryContextSwitches: 30 (30) - TotalThreadsTotalWallClockTime: 1s507ms - TotalThreadsSysTime: 24.995ms - TotalThreadsUserTime: 53.991ms - TotalThreadsVoluntaryContextSwitches: 473 (473) Fragment Instance Lifecycle Timings: - ExecTime: 1s292ms - ExecTreeExecTime: 1s112ms - OpenTime: 24.337ms - ExecTreeOpenTime: 41.197us - PrepareTime: 52.875ms - ExecTreePrepareTime: 140.700us DataStreamSender (dst_id=27):(Total: 27.424ms, non-child: 27.424ms, % non-child: 100.00%) - BytesSent: 699.82 KB (716616) - NetworkThroughput(*): 63.02 MB/sec - OverallThroughput: 24.92 MB/sec - PeakMemoryUsage: 3.17 MB (3321120) - RowsReturned: 14.98K (14982) - SerializeBatchTime: 15.887ms - TransmitDataRPCTime: 10.845ms - UncompressedRowBatchSize: 1.55 MB (1621391) CodeGen:(Total: 51.856ms, non-child: 51.856ms, % non-child: 100.00%) - CodegenTime: 1.498ms - CompileTime: 6.389ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 16.235ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 28.366ms HDFS_SCAN_NODE (id=2):(Total: 1s112ms, non-child: 1s112ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:1/87.88 KB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: Only following filters arrived: , waited 924ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:9 BytesRead(500.000ms): 0, 0, 89.65 KB - FooterProcessingTime: (Avg: 104.562ms ; Min: 104.562ms ; Max: 104.562ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.33 - BytesRead: 174.50 KB (178684) - BytesReadDataNodeCache: 0 - BytesReadLocal: 174.50 KB (178684) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 174.50 KB (178684) - DecompressionTime: 54.818us - MaxCompressedTextFileLength: 0 - NumColumns: 9 (9) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 1.30 MB (1367751) - PerReadThreadRawHdfsThroughput: 457.17 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 187.222ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 14.98K (14982) - RowsReturned: 14.98K (14982) - RowsReturnedRate: 13.46 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 190.285ms - MaterializeTupleTime(*): 3.224ms - ScannerThreadsSysTime: 1.999ms - ScannerThreadsUserTime: 1.999ms - ScannerThreadsVoluntaryContextSwitches: 36 (36) - TotalRawHdfsReadTime(*): 372.740us - TotalReadThroughput: 59.77 KB/sec Filter 0 (1.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 14.98K (14982) Instance 7f40dcb034de70b7:36 (host=ve1134.foo:22000):(Total: 1s368ms, non-child: 174.323ms, % non-child: 12.74%) Hdfs split stats (:<# splits>/): 3:1/81.37 KB MemoryUsage(500.000ms): 171.90 KB, 171.90 KB, 1.02 MB ThreadUsage(500.000ms): 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.46 MB (3631815) - PerHostPeakMemUsage: 13.41 MB (14058828) - RowsProduced: 13.83K (13828) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 95.603ms - TotalStorageWaitTime: 184.632ms - TotalThreadsInvoluntaryContextSwitches: 28 (28) - TotalThreadsTotalWallClockTime: 1s504ms - TotalThreadsSysTime: 15.996ms - TotalThreadsUserTime: 61.990ms - TotalThreadsVoluntaryContextSwitches: 401 (401) Fragment Instance Lifecycle Timings: - ExecTime: 1s286ms - ExecTreeExecTime: 1s110ms - OpenTime: 26.807ms - ExecTreeOpenTime: 53.673us - PrepareTime: 54.992ms - ExecTreePrepareTime: 122.505us DataStreamSender (dst_id=27):(Total: 26.276ms, non-child: 26.276ms, % non-child: 100.00%) - BytesSent: 647.36 KB (662901) - NetworkThroughput(*): 59.24 MB/sec - OverallThroughput: 24.06 MB/sec - PeakMemoryUsage: 3.17 MB (3321120) - RowsReturned: 13.83K (13828) - SerializeBatchTime: 14.899ms - TransmitDataRPCTime: 10.670ms - UncompressedRowBatchSize: 1.43 MB (1502695) CodeGen:(Total: 57.081ms, non-child: 57.081ms, % non-child: 100.00%) - CodegenTime: 1.350ms - CompileTime: 7.288ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 18.061ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 31.159ms HDFS_SCAN_NODE (id=2):(Total: 1s111ms, non-child: 1s111ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:1/81.37 KB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: Only following filters arrived: , waited 924ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:9 BytesRead(500.000ms): 0, 0 - FooterProcessingTime: (Avg: 95.738ms ; Min: 95.738ms ; Max: 95.738ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 161.48 KB (165352) - BytesReadDataNodeCache: 0 - BytesReadLocal: 161.48 KB (165352) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 161.48 KB (165352) - DecompressionTime: 81.920us - MaxCompressedTextFileLength: 0 - NumColumns: 9 (9) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 952.79 KB (975659) - PerReadThreadRawHdfsThroughput: 434.30 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 186.354ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 13.83K (13828) - RowsReturned: 13.83K (13828) - RowsReturnedRate: 12.44 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 2 (2) - ScannerThreadsTotalWallClockTime: 190.798ms - MaterializeTupleTime(*): 4.792ms - ScannerThreadsSysTime: 999.000us - ScannerThreadsUserTime: 3.999ms - ScannerThreadsVoluntaryContextSwitches: 15 (15) - TotalRawHdfsReadTime(*): 363.094us - TotalReadThroughput: 0.00 /sec Filter 0 (1.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 13.83K (13828) Instance 7f40dcb034de70b7:55 (host=vc1527.foo:22000):(Total: 1s368ms, non-child: 161.105ms, % non-child: 11.77%) Hdfs split stats (:<# splits>/): 5:1/85.91 KB MemoryUsage(500.000ms): 401.28 KB, 171.90 KB, 307.90 KB ThreadUsage(500.000ms): 1, 1, 2 - AverageThreadTokens: 1.33 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.56 MB (3732785) - PerHostPeakMemUsage: 14.07 MB (14752996) - RowsProduced: 14.60K (14598) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 93.381ms - TotalStorageWaitTime: 186.838ms - TotalThreadsInvoluntaryContextSwitches: 28 (28) - TotalThreadsTotalWallClockTime: 1s519ms - TotalThreadsSysTime: 24.995ms - TotalThreadsUserTime: 52.991ms - TotalThreadsVoluntaryContextSwitches: 412 (412) Fragment Instance Lifecycle Timings: - ExecTime: 1s302ms - ExecTreeExecTime: 1s133ms - OpenTime: 23.696ms - ExecTreeOpenTime: 42.232us - PrepareTime: 42.170ms - ExecTreePrepareTime: 135.921us DataStreamSender (dst_id=27):(Total: 27.786ms, non-child: 27.786ms, % non-child: 100.00%) - BytesSent: 685.37 KB (701820) - NetworkThroughput(*): 60.79 MB/sec - OverallThroughput: 24.09 MB/sec - PeakMemoryUsage: 3.17 MB (3321120) - RowsReturned: 14.60K (14598) - SerializeBatchTime: 16.225ms - TransmitDataRPCTime: 11.010ms - UncompressedRowBatchSize: 1.51 MB (1581118) CodeGen:(Total: 45.613ms, non-child: 45.613ms, % non-child: 100.00%) - CodegenTime: 1.078ms - CompileTime: 5.917ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 16.341ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 22.919ms HDFS_SCAN_NODE (id=2):(Total: 1s134ms, non-child: 1s134ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:1/85.91 KB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: Only following filters arrived: , waited 945ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:9 BytesRead(500.000ms): 0, 0, 0 - FooterProcessingTime: (Avg: 116.257ms ; Min: 116.257ms ; Max: 116.257ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.50 - BytesRead: 170.56 KB (174654) - BytesReadDataNodeCache: 0 - BytesReadLocal: 170.56 KB (174654) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 170.56 KB (174654) - DecompressionTime: 134.318us - MaxCompressedTextFileLength: 0 - NumColumns: 9 (9) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 957.40 KB (980373) - PerReadThreadRawHdfsThroughput: 627.53 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 188.364ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 14.60K (14598) - RowsReturned: 14.60K (14598) - RowsReturnedRate: 12.87 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 193.192ms - MaterializeTupleTime(*): 5.032ms - ScannerThreadsSysTime: 1.999ms - ScannerThreadsUserTime: 3.999ms - ScannerThreadsVoluntaryContextSwitches: 11 (11) - TotalRawHdfsReadTime(*): 265.427us - TotalReadThroughput: 0.00 /sec Filter 0 (1.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 14.60K (14598) Instance 7f40dcb034de70b7:65 (host=vc1509.foo:22000):(Total: 1s368ms, non-child: 119.025ms, % non-child: 8.70%) Hdfs split stats (:<# splits>/): 4:1/85.72 KB 6:1/85.81 KB MemoryUsage(500.000ms): 171.90 KB, 171.90 KB, 171.90 KB ThreadUsage(500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 4.96 MB (5202626) - PerHostPeakMemUsage: 14.12 MB (14801765) - RowsProduced: 29.20K (29195) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 63.245ms - TotalStorageWaitTime: 420.753ms - TotalThreadsInvoluntaryContextSwitches: 32 (32) - TotalThreadsTotalWallClockTime: 1s751ms - TotalThreadsSysTime: 24.996ms - TotalThreadsUserTime: 64.989ms - TotalThreadsVoluntaryContextSwitches: 396 (396) Fragment Instance Lifecycle Timings: - ExecTime: 1s292ms - ExecTreeExecTime: 1s155ms - OpenTime: 25.707ms - ExecTreeOpenTime: 56.007us - PrepareTime: 50.420ms - ExecTreePrepareTime: 127.497us DataStreamSender (dst_id=27):(Total: 42.217ms, non-child: 42.217ms, % non-child: 100.00%) - BytesSent: 1.33 MB (1396793) - NetworkThroughput(*): 61.68 MB/sec - OverallThroughput: 31.55 MB/sec - PeakMemoryUsage: 3.17 MB (3321120) - RowsReturned: 29.20K (29195) - SerializeBatchTime: 19.978ms - TransmitDataRPCTime: 21.595ms - UncompressedRowBatchSize: 3.03 MB (3178044) CodeGen:(Total: 51.755ms, non-child: 51.755ms, % non-child: 100.00%) - CodegenTime: 987.253us - CompileTime: 5.851ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 18.548ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 26.908ms HDFS_SCAN_NODE (id=2):(Total: 1s155ms, non-child: 1s155ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:1/85.72 KB 6:1/85.81 KB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 2 out of 2 Runtime filters: Only following filters arrived: , waited 944ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:18 BytesRead(500.000ms): 0, 0 - FooterProcessingTime: (Avg: 143.698ms ; Min: 130.429ms ; Max: 156.966ms ; Number of samples: 2) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 340.53 KB (348704) - BytesReadDataNodeCache: 0 - BytesReadLocal: 340.53 KB (348704) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 340.53 KB (348704) - DecompressionTime: 153.706us - MaxCompressedTextFileLength: 0 - NumColumns: 9 (9) - NumDisksAccessed: 2 (2) - NumRowGroups: 2 (2) - NumScannerThreadsStarted: 2 (2) - PeakMemoryUsage: 1.70 MB (1784614) - PerReadThreadRawHdfsThroughput: 543.05 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 209.466ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 29.20K (29195) - RowsReturned: 29.20K (29195) - RowsReturnedRate: 25.27 K/sec - ScanRangesComplete: 2 (2) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 433.486ms - MaterializeTupleTime(*): 10.098ms - ScannerThreadsSysTime: 999.000us - ScannerThreadsUserTime: 10.998ms - ScannerThreadsVoluntaryContextSwitches: 25 (25) - TotalRawHdfsReadTime(*): 612.378us - TotalReadThroughput: 0.00 /sec Filter 0 (1.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 29.20K (29195) Instance 7f40dcb034de70b7:2c (host=vc1534.foo:22000):(Total: 1s368ms, non-child: 172.546ms, % non-child: 12.61%) Hdfs split stats (:<# splits>/): 2:1/85.76 KB MemoryUsage(500.000ms): 0, 171.90 KB, 307.90 KB ThreadUsage(500.000ms): 1, 1, 2 - AverageThreadTokens: 1.33 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.56 MB (3730733) - PerHostPeakMemUsage: 15.81 MB (16573289) - RowsProduced: 14.60K (14597) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 93.042ms - TotalStorageWaitTime: 187.074ms - TotalThreadsInvoluntaryContextSwitches: 34 (34) - TotalThreadsTotalWallClockTime: 1s508ms - TotalThreadsSysTime: 16.996ms - TotalThreadsUserTime: 63.990ms - TotalThreadsVoluntaryContextSwitches: 420 (420) Fragment Instance Lifecycle Timings: - ExecTime: 1s289ms - ExecTreeExecTime: 1s113ms - OpenTime: 26.905ms - ExecTreeOpenTime: 46.779us - PrepareTime: 51.906ms - ExecTreePrepareTime: 146.051us DataStreamSender (dst_id=27):(Total: 27.433ms, non-child: 27.433ms, % non-child: 100.00%) - BytesSent: 682.52 KB (698901) - NetworkThroughput(*): 63.06 MB/sec - OverallThroughput: 24.30 MB/sec - PeakMemoryUsage: 3.17 MB (3321120) - RowsReturned: 14.60K (14597) - SerializeBatchTime: 16.048ms - TransmitDataRPCTime: 10.569ms - UncompressedRowBatchSize: 1.51 MB (1586545) CodeGen:(Total: 54.425ms, non-child: 54.425ms, % non-child: 100.00%) - CodegenTime: 1.634ms - CompileTime: 6.355ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 18.378ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 28.998ms HDFS_SCAN_NODE (id=2):(Total: 1s114ms, non-child: 1s114ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:1/85.76 KB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: Only following filters arrived: , waited 924ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:9 BytesRead(500.000ms): 0, 0, 0 - FooterProcessingTime: (Avg: 116.011ms ; Min: 116.011ms ; Max: 116.011ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.50 - BytesRead: 170.27 KB (174352) - BytesReadDataNodeCache: 0 - BytesReadLocal: 170.27 KB (174352) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 170.27 KB (174352) - DecompressionTime: 87.258us - MaxCompressedTextFileLength: 0 - NumColumns: 9 (9) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 1.02 MB (1068433) - PerReadThreadRawHdfsThroughput: 592.78 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 188.349ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 14.60K (14597) - RowsReturned: 14.60K (14597) - RowsReturnedRate: 13.10 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 2 (2) - ScannerThreadsTotalWallClockTime: 192.977ms - MaterializeTupleTime(*): 4.869ms - ScannerThreadsSysTime: 999.000us - ScannerThreadsUserTime: 4.999ms - ScannerThreadsVoluntaryContextSwitches: 10 (10) - TotalRawHdfsReadTime(*): 280.499us - TotalReadThroughput: 0.00 /sec Filter 0 (1.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 14.60K (14597) Instance 7f40dcb034de70b7:3b (host=vd1326.foo:22000):(Total: 1s367ms, non-child: 188.895ms, % non-child: 13.81%) Hdfs split stats (:<# splits>/): 6:1/88.03 KB MemoryUsage(500.000ms): 171.90 KB, 171.90 KB, 1.40 MB ThreadUsage(500.000ms): 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.56 MB (3733095) - PerHostPeakMemUsage: 14.00 MB (14681845) - RowsProduced: 14.98K (14983) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 106.612ms - TotalStorageWaitTime: 169.858ms - TotalThreadsInvoluntaryContextSwitches: 40 (40) - TotalThreadsTotalWallClockTime: 1s491ms - TotalThreadsSysTime: 21.996ms - TotalThreadsUserTime: 61.990ms - TotalThreadsVoluntaryContextSwitches: 429 (429) Fragment Instance Lifecycle Timings: - ExecTime: 1s288ms - ExecTreeExecTime: 1s096ms - OpenTime: 26.942ms - ExecTreeOpenTime: 44.239us - PrepareTime: 52.159ms - ExecTreePrepareTime: 127.005us DataStreamSender (dst_id=27):(Total: 29.401ms, non-child: 29.401ms, % non-child: 100.00%) - BytesSent: 706.20 KB (723147) - NetworkThroughput(*): 59.30 MB/sec - OverallThroughput: 23.46 MB/sec - PeakMemoryUsage: 3.17 MB (3321120) - RowsReturned: 14.98K (14983) - SerializeBatchTime: 17.075ms - TransmitDataRPCTime: 11.629ms - UncompressedRowBatchSize: 1.55 MB (1624803) CodeGen:(Total: 52.241ms, non-child: 52.241ms, % non-child: 100.00%) - CodegenTime: 1.547ms - CompileTime: 6.778ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 18.542ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 26.172ms HDFS_SCAN_NODE (id=2):(Total: 1s097ms, non-child: 1s097ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 6:1/88.03 KB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: Only following filters arrived: , waited 925ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:9 BytesRead(500.000ms): 0, 0 - FooterProcessingTime: (Avg: 96.853ms ; Min: 96.853ms ; Max: 96.853ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 174.80 KB (178996) - BytesReadDataNodeCache: 0 - BytesReadLocal: 174.80 KB (178996) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 174.80 KB (178996) - DecompressionTime: 115.465us - MaxCompressedTextFileLength: 0 - NumColumns: 9 (9) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 1.02 MB (1070795) - PerReadThreadRawHdfsThroughput: 495.98 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 171.161ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 14.98K (14983) - RowsReturned: 14.98K (14983) - RowsReturnedRate: 13.65 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 176.525ms - MaterializeTupleTime(*): 5.250ms - ScannerThreadsSysTime: 1.999ms - ScannerThreadsUserTime: 3.999ms - ScannerThreadsVoluntaryContextSwitches: 11 (11) - TotalRawHdfsReadTime(*): 344.175us - TotalReadThroughput: 0.00 /sec Filter 0 (1.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 14.98K (14983) Instance 7f40dcb034de70b7:30 (host=va1029.foo:22000):(Total: 1s367ms, non-child: 178.250ms, % non-child: 13.03%) Hdfs split stats (:<# splits>/): 2:1/85.74 KB MemoryUsage(500.000ms): 171.90 KB, 171.90 KB ThreadUsage(500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.65 MB (3824945) - PerHostPeakMemUsage: 13.96 MB (14635694) - RowsProduced: 14.60K (14598) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 96.103ms - TotalStorageWaitTime: 167.786ms - TotalThreadsInvoluntaryContextSwitches: 25 (25) - TotalThreadsTotalWallClockTime: 1s494ms - TotalThreadsSysTime: 16.997ms - TotalThreadsUserTime: 55.991ms - TotalThreadsVoluntaryContextSwitches: 414 (414) Fragment Instance Lifecycle Timings: - ExecTime: 1s296ms - ExecTreeExecTime: 1s113ms - OpenTime: 24.417ms - ExecTreeOpenTime: 38.521us - PrepareTime: 46.294ms - ExecTreePrepareTime: 127.199us DataStreamSender (dst_id=27):(Total: 27.154ms, non-child: 27.154ms, % non-child: 100.00%) - BytesSent: 686.31 KB (702778) - NetworkThroughput(*): 65.03 MB/sec - OverallThroughput: 24.68 MB/sec - PeakMemoryUsage: 3.17 MB (3321120) - RowsReturned: 14.60K (14598) - SerializeBatchTime: 16.284ms - TransmitDataRPCTime: 10.306ms - UncompressedRowBatchSize: 1.51 MB (1581564) CodeGen:(Total: 48.215ms, non-child: 48.215ms, % non-child: 100.00%) - CodegenTime: 1.033ms - CompileTime: 5.945ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 17.013ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 24.633ms HDFS_SCAN_NODE (id=2):(Total: 1s114ms, non-child: 1s114ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:1/85.74 KB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: Only following filters arrived: , waited 944ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:9 BytesRead(500.000ms): 0, 0 - FooterProcessingTime: (Avg: 99.843ms ; Min: 99.843ms ; Max: 99.843ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 170.22 KB (174304) - BytesReadDataNodeCache: 0 - BytesReadLocal: 170.22 KB (174304) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 170.22 KB (174304) - DecompressionTime: 76.230us - MaxCompressedTextFileLength: 0 - NumColumns: 9 (9) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 581.40 KB (595349) - PerReadThreadRawHdfsThroughput: 627.94 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 169.216ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 14.60K (14598) - RowsReturned: 14.60K (14598) - RowsReturnedRate: 13.10 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 3 (3) - ScannerThreadsTotalWallClockTime: 173.042ms - MaterializeTupleTime(*): 4.183ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 3.999ms - ScannerThreadsVoluntaryContextSwitches: 11 (11) - TotalRawHdfsReadTime(*): 264.720us - TotalReadThroughput: 0.00 /sec Filter 0 (1.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 14.60K (14598) Instance 7f40dcb034de70b7:31 (host=va1026.foo:22000):(Total: 1s367ms, non-child: 145.340ms, % non-child: 10.63%) Hdfs split stats (:<# splits>/): 4:1/79.09 KB MemoryUsage(500.000ms): 163.28 KB, 171.90 KB, 307.90 KB ThreadUsage(500.000ms): 1, 1, 2 - AverageThreadTokens: 1.33 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.49 MB (3660177) - PerHostPeakMemUsage: 15.69 MB (16450105) - RowsProduced: 13.44K (13443) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 73.784ms - TotalStorageWaitTime: 225.840ms - TotalThreadsInvoluntaryContextSwitches: 20 (20) - TotalThreadsTotalWallClockTime: 1s488ms - TotalThreadsSysTime: 8.999ms - TotalThreadsUserTime: 61.990ms - TotalThreadsVoluntaryContextSwitches: 465 (465) Fragment Instance Lifecycle Timings: - ExecTime: 1s222ms - ExecTreeExecTime: 1s092ms - OpenTime: 34.194ms - ExecTreeOpenTime: 49.941us - PrepareTime: 110.407ms - ExecTreePrepareTime: 255.512us DataStreamSender (dst_id=27):(Total: 20.355ms, non-child: 20.355ms, % non-child: 100.00%) - BytesSent: 632.00 KB (647163) - NetworkThroughput(*): 107.37 MB/sec - OverallThroughput: 30.32 MB/sec - PeakMemoryUsage: 3.15 MB (3304736) - RowsReturned: 13.44K (13443) - SerializeBatchTime: 14.205ms - TransmitDataRPCTime: 5.748ms - UncompressedRowBatchSize: 1.39 MB (1461244) CodeGen:(Total: 108.999ms, non-child: 108.999ms, % non-child: 100.00%) - CodegenTime: 3.878ms - CompileTime: 6.271ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 25.288ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 72.096ms HDFS_SCAN_NODE (id=2):(Total: 1s092ms, non-child: 1s092ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:1/79.09 KB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: Only following filters arrived: , waited 863ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:9 BytesRead(500.000ms): 0, 0, 0 - FooterProcessingTime: (Avg: 120.402ms ; Min: 120.402ms ; Max: 120.402ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.50 - BytesRead: 156.92 KB (160688) - BytesReadDataNodeCache: 0 - BytesReadLocal: 156.92 KB (160688) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 156.92 KB (160688) - DecompressionTime: 94.792us - MaxCompressedTextFileLength: 0 - NumColumns: 9 (9) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 574.49 KB (588277) - PerReadThreadRawHdfsThroughput: 362.80 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 227.623ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 13.44K (13443) - RowsReturned: 13.44K (13443) - RowsReturnedRate: 12.30 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 1 (1) - ScannerThreadsTotalWallClockTime: 232.663ms - MaterializeTupleTime(*): 5.456ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 5.999ms - ScannerThreadsVoluntaryContextSwitches: 20 (20) - TotalRawHdfsReadTime(*): 422.396us - TotalReadThroughput: 0.00 /sec Filter 0 (1.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 13.44K (13443) Instance 7f40dcb034de70b7:6 (host=vd1117.foo:22000):(Total: 1s366ms, non-child: 182.290ms, % non-child: 13.34%) Hdfs split stats (:<# splits>/): 5:1/85.77 KB MemoryUsage(500.000ms): 171.90 KB, 171.90 KB, 307.90 KB ThreadUsage(500.000ms): 1, 1, 2 - AverageThreadTokens: 1.33 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.57 MB (3747117) - PerHostPeakMemUsage: 13.41 MB (14058828) - RowsProduced: 14.60K (14597) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 98.318ms - TotalStorageWaitTime: 163.990ms - TotalThreadsInvoluntaryContextSwitches: 30 (30) - TotalThreadsTotalWallClockTime: 1s494ms - TotalThreadsSysTime: 17.997ms - TotalThreadsUserTime: 58.991ms - TotalThreadsVoluntaryContextSwitches: 408 (408) Fragment Instance Lifecycle Timings: - ExecTime: 1s300ms - ExecTreeExecTime: 1s110ms - OpenTime: 23.363ms - ExecTreeOpenTime: 49.227us - PrepareTime: 42.596ms - ExecTreePrepareTime: 117.160us DataStreamSender (dst_id=27):(Total: 26.300ms, non-child: 26.300ms, % non-child: 100.00%) - BytesSent: 680.52 KB (696850) - NetworkThroughput(*): 65.20 MB/sec - OverallThroughput: 25.27 MB/sec - PeakMemoryUsage: 3.17 MB (3321120) - RowsReturned: 14.60K (14597) - SerializeBatchTime: 15.553ms - TransmitDataRPCTime: 10.193ms - UncompressedRowBatchSize: 1.52 MB (1592508) CodeGen:(Total: 47.169ms, non-child: 47.169ms, % non-child: 100.00%) - CodegenTime: 1.031ms - CompileTime: 6.118ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 15.842ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 24.807ms HDFS_SCAN_NODE (id=2):(Total: 1s111ms, non-child: 1s111ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:1/85.77 KB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: Only following filters arrived: , waited 945ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:9 BytesRead(500.000ms): 0, 0, 0 - FooterProcessingTime: (Avg: 80.122ms ; Min: 80.122ms ; Max: 80.122ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.33 - BytesRead: 170.29 KB (174374) - BytesReadDataNodeCache: 0 - BytesReadLocal: 170.29 KB (174374) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 170.29 KB (174374) - DecompressionTime: 97.423us - MaxCompressedTextFileLength: 0 - NumColumns: 9 (9) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 769.39 KB (787857) - PerReadThreadRawHdfsThroughput: 563.83 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 165.447ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 14.60K (14597) - RowsReturned: 14.60K (14597) - RowsReturnedRate: 13.13 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 170.374ms - MaterializeTupleTime(*): 5.117ms - ScannerThreadsSysTime: 2.999ms - ScannerThreadsUserTime: 3.999ms - ScannerThreadsVoluntaryContextSwitches: 12 (12) - TotalRawHdfsReadTime(*): 294.939us - TotalReadThroughput: 0.00 /sec Filter 0 (1.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 14.60K (14597) Instance 7f40dcb034de70b7:9 (host=ve1125.foo:22000):(Total: 1s366ms, non-child: 197.690ms, % non-child: 14.46%) Hdfs split stats (:<# splits>/): 5:1/87.97 KB MemoryUsage(500.000ms): 171.90 KB, 171.90 KB, 307.43 KB ThreadUsage(500.000ms): 1, 1, 2 - AverageThreadTokens: 1.33 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.58 MB (3751523) - PerHostPeakMemUsage: 14.96 MB (15689036) - RowsProduced: 14.98K (14982) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 106.942ms - TotalStorageWaitTime: 160.775ms - TotalThreadsInvoluntaryContextSwitches: 28 (28) - TotalThreadsTotalWallClockTime: 1s480ms - TotalThreadsSysTime: 16.997ms - TotalThreadsUserTime: 62.990ms - TotalThreadsVoluntaryContextSwitches: 393 (393) Fragment Instance Lifecycle Timings: - ExecTime: 1s288ms - ExecTreeExecTime: 1s086ms - OpenTime: 25.473ms - ExecTreeOpenTime: 36.083us - PrepareTime: 52.445ms - ExecTreePrepareTime: 166.486us DataStreamSender (dst_id=27):(Total: 26.743ms, non-child: 26.743ms, % non-child: 100.00%) - BytesSent: 708.41 KB (725409) - NetworkThroughput(*): 66.03 MB/sec - OverallThroughput: 25.87 MB/sec - PeakMemoryUsage: 3.17 MB (3321120) - RowsReturned: 14.98K (14982) - SerializeBatchTime: 15.709ms - TransmitDataRPCTime: 10.476ms - UncompressedRowBatchSize: 1.54 MB (1619893) CodeGen:(Total: 55.175ms, non-child: 55.175ms, % non-child: 100.00%) - CodegenTime: 1.331ms - CompileTime: 7.069ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 16.737ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 30.746ms HDFS_SCAN_NODE (id=2):(Total: 1s087ms, non-child: 1s087ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:1/87.97 KB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: Only following filters arrived: , waited 924ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:9 BytesRead(500.000ms): 0, 0, 89.30 KB - FooterProcessingTime: (Avg: 63.660ms ; Min: 63.660ms ; Max: 63.660ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.33 - BytesRead: 174.69 KB (178886) - BytesReadDataNodeCache: 0 - BytesReadLocal: 174.69 KB (178886) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 174.69 KB (178886) - DecompressionTime: 96.896us - MaxCompressedTextFileLength: 0 - NumColumns: 9 (9) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 959.69 KB (982727) - PerReadThreadRawHdfsThroughput: 569.18 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 162.242ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 14.98K (14982) - RowsReturned: 14.98K (14982) - RowsReturnedRate: 13.78 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 166.910ms - MaterializeTupleTime(*): 4.785ms - ScannerThreadsSysTime: 2.999ms - ScannerThreadsUserTime: 2.999ms - ScannerThreadsVoluntaryContextSwitches: 11 (11) - TotalRawHdfsReadTime(*): 299.728us - TotalReadThroughput: 59.53 KB/sec Filter 0 (1.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 14.98K (14982) Instance 7f40dcb034de70b7:59 (host=vc1518.foo:22000):(Total: 1s366ms, non-child: 171.852ms, % non-child: 12.58%) Hdfs split stats (:<# splits>/): 2:1/88.07 KB MemoryUsage(500.000ms): 171.90 KB, 171.90 KB, 274.90 KB ThreadUsage(500.000ms): 1, 1, 2 - AverageThreadTokens: 1.33 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.59 MB (3765888) - PerHostPeakMemUsage: 15.59 MB (16345918) - RowsProduced: 14.98K (14985) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 93.311ms - TotalStorageWaitTime: 188.375ms - TotalThreadsInvoluntaryContextSwitches: 29 (29) - TotalThreadsTotalWallClockTime: 1s507ms - TotalThreadsSysTime: 16.997ms - TotalThreadsUserTime: 61.990ms - TotalThreadsVoluntaryContextSwitches: 412 (412) Fragment Instance Lifecycle Timings: - ExecTime: 1s288ms - ExecTreeExecTime: 1s114ms - OpenTime: 24.427ms - ExecTreeOpenTime: 36.641us - PrepareTime: 53.580ms - ExecTreePrepareTime: 112.500us DataStreamSender (dst_id=27):(Total: 28.235ms, non-child: 28.235ms, % non-child: 100.00%) - BytesSent: 700.95 KB (717772) - NetworkThroughput(*): 62.63 MB/sec - OverallThroughput: 24.24 MB/sec - PeakMemoryUsage: 3.17 MB (3321120) - RowsReturned: 14.98K (14985) - SerializeBatchTime: 16.385ms - TransmitDataRPCTime: 10.929ms - UncompressedRowBatchSize: 1.55 MB (1629754) CodeGen:(Total: 51.469ms, non-child: 51.469ms, % non-child: 100.00%) - CodegenTime: 1.002ms - CompileTime: 6.779ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 16.458ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 27.783ms HDFS_SCAN_NODE (id=2):(Total: 1s114ms, non-child: 1s114ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:1/88.07 KB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: Only following filters arrived: , waited 924ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:9 BytesRead(500.000ms): 0, 0, 88.07 KB - FooterProcessingTime: (Avg: 118.433ms ; Min: 118.433ms ; Max: 118.433ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.33 - BytesRead: 174.88 KB (179080) - BytesReadDataNodeCache: 0 - BytesReadLocal: 174.88 KB (179080) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 174.88 KB (179080) - DecompressionTime: 63.162us - MaxCompressedTextFileLength: 0 - NumColumns: 9 (9) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 1.02 MB (1070820) - PerReadThreadRawHdfsThroughput: 674.82 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 189.788ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 14.98K (14985) - RowsReturned: 14.98K (14985) - RowsReturnedRate: 13.44 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 194.582ms - MaterializeTupleTime(*): 4.953ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 5.999ms - ScannerThreadsVoluntaryContextSwitches: 13 (13) - TotalRawHdfsReadTime(*): 253.080us - TotalReadThroughput: 58.71 KB/sec Filter 0 (1.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 14.98K (14985) Instance 7f40dcb034de70b7:5f (host=vc1514.foo:22000):(Total: 1s364ms, non-child: 159.170ms, % non-child: 11.66%) Hdfs split stats (:<# splits>/): 1:1/85.79 KB MemoryUsage(500.000ms): 171.90 KB, 171.90 KB ThreadUsage(500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.58 MB (3749169) - PerHostPeakMemUsage: 14.04 MB (14718507) - RowsProduced: 14.60K (14598) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 95.520ms - TotalStorageWaitTime: 192.755ms - TotalThreadsInvoluntaryContextSwitches: 32 (32) - TotalThreadsTotalWallClockTime: 1s525ms - TotalThreadsSysTime: 20.996ms - TotalThreadsUserTime: 54.991ms - TotalThreadsVoluntaryContextSwitches: 406 (406) Fragment Instance Lifecycle Timings: - ExecTime: 1s303ms - ExecTreeExecTime: 1s139ms - OpenTime: 23.872ms - ExecTreeOpenTime: 40.319us - PrepareTime: 37.505ms - ExecTreePrepareTime: 127.243us DataStreamSender (dst_id=27):(Total: 26.330ms, non-child: 26.330ms, % non-child: 100.00%) - BytesSent: 683.73 KB (700138) - NetworkThroughput(*): 63.62 MB/sec - OverallThroughput: 25.36 MB/sec - PeakMemoryUsage: 3.17 MB (3321120) - RowsReturned: 14.60K (14598) - SerializeBatchTime: 15.452ms - TransmitDataRPCTime: 10.495ms - UncompressedRowBatchSize: 1.51 MB (1583226) CodeGen:(Total: 40.059ms, non-child: 40.059ms, % non-child: 100.00%) - CodegenTime: 1.205ms - CompileTime: 5.650ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 16.681ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 17.164ms HDFS_SCAN_NODE (id=2):(Total: 1s139ms, non-child: 1s139ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:1/85.79 KB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: Only following filters arrived: , waited 944ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:9 BytesRead(500.000ms): 0, 0 - FooterProcessingTime: (Avg: 131.874ms ; Min: 131.874ms ; Max: 131.874ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 170.33 KB (174418) - BytesReadDataNodeCache: 0 - BytesReadLocal: 170.33 KB (174418) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 170.33 KB (174418) - DecompressionTime: 58.652us - MaxCompressedTextFileLength: 0 - NumColumns: 9 (9) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 1.03 MB (1076629) - PerReadThreadRawHdfsThroughput: 564.20 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 194.196ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 14.60K (14598) - RowsReturned: 14.60K (14598) - RowsReturnedRate: 12.81 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 1 (1) - ScannerThreadsTotalWallClockTime: 198.909ms - MaterializeTupleTime(*): 4.900ms - ScannerThreadsSysTime: 999.000us - ScannerThreadsUserTime: 3.999ms - ScannerThreadsVoluntaryContextSwitches: 12 (12) - TotalRawHdfsReadTime(*): 294.820us - TotalReadThroughput: 0.00 /sec Filter 0 (1.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 14.60K (14598) Instance 7f40dcb034de70b7:6e (host=vd1108.foo:22000):(Total: 1s364ms, non-child: 165.765ms, % non-child: 12.15%) Hdfs split stats (:<# splits>/): 0:1/85.75 KB MemoryUsage(500.000ms): 171.90 KB, 171.90 KB, 307.90 KB ThreadUsage(500.000ms): 1, 1, 2 - AverageThreadTokens: 1.33 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.54 MB (3716401) - PerHostPeakMemUsage: 13.90 MB (14571829) - RowsProduced: 14.60K (14598) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 93.737ms - TotalStorageWaitTime: 178.849ms - TotalThreadsInvoluntaryContextSwitches: 41 (41) - TotalThreadsTotalWallClockTime: 1s502ms - TotalThreadsSysTime: 19.997ms - TotalThreadsUserTime: 53.992ms - TotalThreadsVoluntaryContextSwitches: 391 (391) Fragment Instance Lifecycle Timings: - ExecTime: 1s297ms - ExecTreeExecTime: 1s125ms - OpenTime: 21.227ms - ExecTreeOpenTime: 39.187us - PrepareTime: 45.589ms - ExecTreePrepareTime: 121.784us DataStreamSender (dst_id=27):(Total: 27.302ms, non-child: 27.302ms, % non-child: 100.00%) - BytesSent: 682.39 KB (698772) - NetworkThroughput(*): 63.61 MB/sec - OverallThroughput: 24.41 MB/sec - PeakMemoryUsage: 3.17 MB (3321120) - RowsReturned: 14.60K (14598) - SerializeBatchTime: 15.991ms - TransmitDataRPCTime: 10.476ms - UncompressedRowBatchSize: 1.52 MB (1590412) CodeGen:(Total: 45.693ms, non-child: 45.693ms, % non-child: 100.00%) - CodegenTime: 1.182ms - CompileTime: 5.704ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 14.133ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 25.399ms HDFS_SCAN_NODE (id=2):(Total: 1s125ms, non-child: 1s125ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/85.75 KB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: Only following filters arrived: , waited 944ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:9 BytesRead(500.000ms): 0, 0, 0 - FooterProcessingTime: (Avg: 113.358ms ; Min: 113.358ms ; Max: 113.358ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.33 - BytesRead: 170.23 KB (174320) - BytesReadDataNodeCache: 0 - BytesReadLocal: 170.23 KB (174320) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 170.23 KB (174320) - DecompressionTime: 87.787us - MaxCompressedTextFileLength: 0 - NumColumns: 9 (9) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 1.12 MB (1172885) - PerReadThreadRawHdfsThroughput: 586.99 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 180.307ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 14.60K (14598) - RowsReturned: 14.60K (14598) - RowsReturnedRate: 12.97 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 3 (3) - ScannerThreadsTotalWallClockTime: 183.730ms - MaterializeTupleTime(*): 3.780ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 3.999ms - ScannerThreadsVoluntaryContextSwitches: 10 (10) - TotalRawHdfsReadTime(*): 283.214us - TotalReadThroughput: 0.00 /sec Filter 0 (1.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 14.60K (14598) Instance 7f40dcb034de70b7:5e (host=vc1539.foo:22000):(Total: 1s364ms, non-child: 170.168ms, % non-child: 12.47%) Hdfs split stats (:<# splits>/): 5:1/83.62 KB MemoryUsage(500.000ms): 171.90 KB, 171.90 KB, 287.90 KB ThreadUsage(500.000ms): 1, 1, 2 - AverageThreadTokens: 1.33 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.48 MB (3650561) - PerHostPeakMemUsage: 14.73 MB (15447372) - RowsProduced: 14.21K (14214) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 95.734ms - TotalStorageWaitTime: 179.867ms - TotalThreadsInvoluntaryContextSwitches: 34 (34) - TotalThreadsTotalWallClockTime: 1s503ms - TotalThreadsSysTime: 19.996ms - TotalThreadsUserTime: 52.991ms - TotalThreadsVoluntaryContextSwitches: 392 (392) Fragment Instance Lifecycle Timings: - ExecTime: 1s295ms - ExecTreeExecTime: 1s126ms - OpenTime: 22.640ms - ExecTreeOpenTime: 34.453us - PrepareTime: 45.891ms - ExecTreePrepareTime: 109.779us DataStreamSender (dst_id=27):(Total: 27.332ms, non-child: 27.332ms, % non-child: 100.00%) - BytesSent: 666.54 KB (682535) - NetworkThroughput(*): 58.63 MB/sec - OverallThroughput: 23.81 MB/sec - PeakMemoryUsage: 3.17 MB (3321120) - RowsReturned: 14.21K (14214) - SerializeBatchTime: 15.395ms - TransmitDataRPCTime: 11.101ms - UncompressedRowBatchSize: 1.47 MB (1545233) CodeGen:(Total: 40.044ms, non-child: 40.044ms, % non-child: 100.00%) - CodegenTime: 1.108ms - CompileTime: 6.021ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 15.268ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 18.318ms HDFS_SCAN_NODE (id=2):(Total: 1s126ms, non-child: 1s126ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:1/83.62 KB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: Only following filters arrived: , waited 945ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:9 BytesRead(500.000ms): 0, 0, 83.82 KB - FooterProcessingTime: (Avg: 109.075ms ; Min: 109.075ms ; Max: 109.075ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.33 - BytesRead: 165.99 KB (169970) - BytesReadDataNodeCache: 0 - BytesReadLocal: 165.99 KB (169970) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 165.99 KB (169970) - DecompressionTime: 108.412us - MaxCompressedTextFileLength: 0 - NumColumns: 9 (9) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 853.10 KB (873573) - PerReadThreadRawHdfsThroughput: 631.19 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 181.185ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 14.21K (14214) - RowsReturned: 14.21K (14214) - RowsReturnedRate: 12.62 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 185.326ms - MaterializeTupleTime(*): 4.282ms - ScannerThreadsSysTime: 1.999ms - ScannerThreadsUserTime: 2.999ms - ScannerThreadsVoluntaryContextSwitches: 10 (10) - TotalRawHdfsReadTime(*): 256.810us - TotalReadThroughput: 55.88 KB/sec Filter 0 (1.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 14.21K (14214) Instance 7f40dcb034de70b7:44 (host=vd1120.foo:22000):(Total: 1s364ms, non-child: 117.535ms, % non-child: 8.62%) Hdfs split stats (:<# splits>/): 4:1/88.06 KB 7:1/83.61 KB MemoryUsage(500.000ms): 171.90 KB, 171.90 KB, 1015.90 KB ThreadUsage(500.000ms): 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.86 MB (4044395) - PerHostPeakMemUsage: 13.64 MB (14303366) - RowsProduced: 29.20K (29197) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 74.767ms - TotalStorageWaitTime: 415.375ms - TotalThreadsInvoluntaryContextSwitches: 29 (29) - TotalThreadsTotalWallClockTime: 1s747ms - TotalThreadsSysTime: 17.996ms - TotalThreadsUserTime: 71.989ms - TotalThreadsVoluntaryContextSwitches: 427 (427) Fragment Instance Lifecycle Timings: - ExecTime: 1s293ms - ExecTreeExecTime: 1s151ms - OpenTime: 26.009ms - ExecTreeOpenTime: 34.933us - PrepareTime: 44.770ms - ExecTreePrepareTime: 175.197us DataStreamSender (dst_id=27):(Total: 46.283ms, non-child: 46.283ms, % non-child: 100.00%) - BytesSent: 1.34 MB (1407668) - NetworkThroughput(*): 54.40 MB/sec - OverallThroughput: 29.01 MB/sec - PeakMemoryUsage: 3.17 MB (3321120) - RowsReturned: 29.20K (29197) - SerializeBatchTime: 20.864ms - TransmitDataRPCTime: 24.677ms - UncompressedRowBatchSize: 3.03 MB (3174380) CodeGen:(Total: 48.685ms, non-child: 48.685ms, % non-child: 100.00%) - CodegenTime: 1.089ms - CompileTime: 5.721ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 17.917ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 24.534ms HDFS_SCAN_NODE (id=2):(Total: 1s151ms, non-child: 1s151ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:1/88.06 KB 7:1/83.61 KB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 2 out of 2 Runtime filters: Only following filters arrived: , waited 943ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:18 BytesRead(500.000ms): 0, 0 - FooterProcessingTime: (Avg: 103.520ms ; Min: 97.056ms ; Max: 109.984ms ; Number of samples: 2) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 340.82 KB (349004) - BytesReadDataNodeCache: 0 - BytesReadLocal: 340.82 KB (349004) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 340.82 KB (349004) - DecompressionTime: 252.662us - MaxCompressedTextFileLength: 0 - NumColumns: 9 (9) - NumDisksAccessed: 2 (2) - NumRowGroups: 2 (2) - NumScannerThreadsStarted: 2 (2) - PeakMemoryUsage: 1.12 MB (1175247) - PerReadThreadRawHdfsThroughput: 409.02 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 206.328ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 29.20K (29197) - RowsReturned: 29.20K (29197) - RowsReturnedRate: 25.35 K/sec - ScanRangesComplete: 2 (2) - ScannerThreadsInvoluntaryContextSwitches: 4 (4) - ScannerThreadsTotalWallClockTime: 428.913ms - MaterializeTupleTime(*): 10.316ms - ScannerThreadsSysTime: 999.000us - ScannerThreadsUserTime: 10.998ms - ScannerThreadsVoluntaryContextSwitches: 29 (29) - TotalRawHdfsReadTime(*): 813.738us - TotalReadThroughput: 0.00 /sec Filter 0 (1.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 29.20K (29197) Instance 7f40dcb034de70b7:6a (host=vd1118.foo:22000):(Total: 1s363ms, non-child: 159.810ms, % non-child: 11.72%) Hdfs split stats (:<# splits>/): 0:1/85.82 KB MemoryUsage(500.000ms): 171.90 KB, 171.90 KB ThreadUsage(500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.56 MB (3732781) - PerHostPeakMemUsage: 13.97 MB (14644259) - RowsProduced: 14.60K (14597) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 93.146ms - TotalStorageWaitTime: 189.107ms - TotalThreadsInvoluntaryContextSwitches: 28 (28) - TotalThreadsTotalWallClockTime: 1s505ms - TotalThreadsSysTime: 13.998ms - TotalThreadsUserTime: 62.990ms - TotalThreadsVoluntaryContextSwitches: 402 (402) Fragment Instance Lifecycle Timings: - ExecTime: 1s286ms - ExecTreeExecTime: 1s115ms - OpenTime: 23.876ms - ExecTreeOpenTime: 36.430us - PrepareTime: 53.502ms - ExecTreePrepareTime: 157.981us DataStreamSender (dst_id=27):(Total: 30.621ms, non-child: 30.621ms, % non-child: 100.00%) - BytesSent: 688.41 KB (704935) - NetworkThroughput(*): 63.90 MB/sec - OverallThroughput: 21.95 MB/sec - PeakMemoryUsage: 3.17 MB (3321120) - RowsReturned: 14.60K (14597) - SerializeBatchTime: 19.538ms - TransmitDataRPCTime: 10.520ms - UncompressedRowBatchSize: 1.51 MB (1581835) CodeGen:(Total: 57.093ms, non-child: 57.093ms, % non-child: 100.00%) - CodegenTime: 1.104ms - CompileTime: 6.282ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 16.056ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 34.213ms HDFS_SCAN_NODE (id=2):(Total: 1s116ms, non-child: 1s116ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/85.82 KB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: Only following filters arrived: , waited 924ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:9 BytesRead(500.000ms): 0, 0 - FooterProcessingTime: (Avg: 121.587ms ; Min: 121.587ms ; Max: 121.587ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 170.38 KB (174470) - BytesReadDataNodeCache: 0 - BytesReadLocal: 170.38 KB (174470) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 170.38 KB (174470) - DecompressionTime: 94.218us - MaxCompressedTextFileLength: 0 - NumColumns: 9 (9) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 1.02 MB (1068433) - PerReadThreadRawHdfsThroughput: 501.86 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 190.574ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 14.60K (14597) - RowsReturned: 14.60K (14597) - RowsReturnedRate: 13.07 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 195.504ms - MaterializeTupleTime(*): 5.131ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 5.999ms - ScannerThreadsVoluntaryContextSwitches: 11 (11) - TotalRawHdfsReadTime(*): 331.540us - TotalReadThroughput: 0.00 /sec Filter 0 (1.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 14.60K (14597) Instance 7f40dcb034de70b7:d (host=vd1141.foo:22000):(Total: 1s363ms, non-child: 197.898ms, % non-child: 14.51%) Hdfs split stats (:<# splits>/): 2:1/88.04 KB MemoryUsage(500.000ms): 171.90 KB, 171.90 KB, 1.02 MB ThreadUsage(500.000ms): 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.59 MB (3765867) - PerHostPeakMemUsage: 15.63 MB (16390931) - RowsProduced: 14.98K (14984) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 107.743ms - TotalStorageWaitTime: 158.614ms - TotalThreadsInvoluntaryContextSwitches: 25 (25) - TotalThreadsTotalWallClockTime: 1s474ms - TotalThreadsSysTime: 18.997ms - TotalThreadsUserTime: 57.991ms - TotalThreadsVoluntaryContextSwitches: 404 (404) Fragment Instance Lifecycle Timings: - ExecTime: 1s285ms - ExecTreeExecTime: 1s084ms - OpenTime: 24.076ms - ExecTreeOpenTime: 36.482us - PrepareTime: 53.599ms - ExecTreePrepareTime: 143.343us DataStreamSender (dst_id=27):(Total: 27.924ms, non-child: 27.924ms, % non-child: 100.00%) - BytesSent: 701.12 KB (717952) - NetworkThroughput(*): 61.74 MB/sec - OverallThroughput: 24.52 MB/sec - PeakMemoryUsage: 3.17 MB (3321120) - RowsReturned: 14.98K (14984) - SerializeBatchTime: 16.124ms - TransmitDataRPCTime: 11.089ms - UncompressedRowBatchSize: 1.55 MB (1627844) CodeGen:(Total: 53.475ms, non-child: 53.475ms, % non-child: 100.00%) - CodegenTime: 1.223ms - CompileTime: 7.553ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 15.102ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 30.322ms HDFS_SCAN_NODE (id=2):(Total: 1s084ms, non-child: 1s084ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:1/88.04 KB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: Only following filters arrived: , waited 923ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:9 BytesRead(500.000ms): 0, 0 - FooterProcessingTime: (Avg: 57.337ms ; Min: 57.337ms ; Max: 57.337ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 174.83 KB (179026) - BytesReadDataNodeCache: 0 - BytesReadLocal: 174.83 KB (179026) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 174.83 KB (179026) - DecompressionTime: 60.326us - MaxCompressedTextFileLength: 0 - NumColumns: 9 (9) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 951.70 KB (974543) - PerReadThreadRawHdfsThroughput: 591.57 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 159.994ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 14.98K (14984) - RowsReturned: 14.98K (14984) - RowsReturnedRate: 13.82 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 2 (2) - ScannerThreadsTotalWallClockTime: 164.580ms - MaterializeTupleTime(*): 4.765ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 5.999ms - ScannerThreadsVoluntaryContextSwitches: 11 (11) - TotalRawHdfsReadTime(*): 288.608us - TotalReadThroughput: 0.00 /sec Filter 0 (1.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 14.98K (14984) Instance 7f40dcb034de70b7:b (host=vd1131.foo:22000):(Total: 1s363ms, non-child: 193.667ms, % non-child: 14.20%) Hdfs split stats (:<# splits>/): 7:1/83.51 KB MemoryUsage(500.000ms): 171.90 KB, 171.90 KB, 171.90 KB ThreadUsage(500.000ms): 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.46 MB (3632125) - PerHostPeakMemUsage: 13.41 MB (14058828) - RowsProduced: 14.21K (14213) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 106.364ms - TotalStorageWaitTime: 154.604ms - TotalThreadsInvoluntaryContextSwitches: 35 (35) - TotalThreadsTotalWallClockTime: 1s486ms - TotalThreadsSysTime: 15.996ms - TotalThreadsUserTime: 61.990ms - TotalThreadsVoluntaryContextSwitches: 404 (404) Fragment Instance Lifecycle Timings: - ExecTime: 1s303ms - ExecTreeExecTime: 1s101ms - OpenTime: 22.085ms - ExecTreeOpenTime: 74.735us - PrepareTime: 37.703ms - ExecTreePrepareTime: 106.060us DataStreamSender (dst_id=27):(Total: 26.675ms, non-child: 26.675ms, % non-child: 100.00%) - BytesSent: 667.88 KB (683908) - NetworkThroughput(*): 61.17 MB/sec - OverallThroughput: 24.45 MB/sec - PeakMemoryUsage: 3.17 MB (3321120) - RowsReturned: 14.21K (14213) - SerializeBatchTime: 15.555ms - TransmitDataRPCTime: 10.662ms - UncompressedRowBatchSize: 1.47 MB (1543777) CodeGen:(Total: 41.563ms, non-child: 41.563ms, % non-child: 100.00%) - CodegenTime: 1.073ms - CompileTime: 6.778ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 13.958ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 20.368ms HDFS_SCAN_NODE (id=2):(Total: 1s101ms, non-child: 1s101ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:1/83.51 KB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: Only following filters arrived: , waited 944ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:9 BytesRead(500.000ms): 0, 0 - FooterProcessingTime: (Avg: 51.251ms ; Min: 51.251ms ; Max: 51.251ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 165.76 KB (169736) - BytesReadDataNodeCache: 0 - BytesReadLocal: 165.76 KB (169736) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 165.76 KB (169736) - DecompressionTime: 60.704us - MaxCompressedTextFileLength: 0 - NumColumns: 9 (9) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 955.09 KB (978017) - PerReadThreadRawHdfsThroughput: 528.08 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 155.991ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 14.21K (14213) - RowsReturned: 14.21K (14213) - RowsReturnedRate: 12.90 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 161.158ms - MaterializeTupleTime(*): 5.203ms - ScannerThreadsSysTime: 999.000us - ScannerThreadsUserTime: 4.999ms - ScannerThreadsVoluntaryContextSwitches: 18 (18) - TotalRawHdfsReadTime(*): 306.531us - TotalReadThroughput: 0.00 /sec Filter 0 (1.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 14.21K (14213) Instance 7f40dcb034de70b7:18 (host=vd1334.foo:22000):(Total: 1s362ms, non-child: 165.032ms, % non-child: 12.11%) Hdfs split stats (:<# splits>/): 3:1/85.73 KB MemoryUsage(500.000ms): 171.90 KB, 171.90 KB, 171.90 KB ThreadUsage(500.000ms): 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.56 MB (3732777) - PerHostPeakMemUsage: 13.41 MB (14058828) - RowsProduced: 14.60K (14596) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 85.707ms - TotalStorageWaitTime: 177.379ms - TotalThreadsInvoluntaryContextSwitches: 35 (35) - TotalThreadsTotalWallClockTime: 1s500ms - TotalThreadsSysTime: 19.996ms - TotalThreadsUserTime: 54.991ms - TotalThreadsVoluntaryContextSwitches: 411 (411) Fragment Instance Lifecycle Timings: - ExecTime: 1s294ms - ExecTreeExecTime: 1s124ms - OpenTime: 23.111ms - ExecTreeOpenTime: 34.234us - PrepareTime: 44.870ms - ExecTreePrepareTime: 120.795us DataStreamSender (dst_id=27):(Total: 27.418ms, non-child: 27.418ms, % non-child: 100.00%) - BytesSent: 688.80 KB (705328) - NetworkThroughput(*): 62.67 MB/sec - OverallThroughput: 24.53 MB/sec - PeakMemoryUsage: 3.17 MB (3321120) - RowsReturned: 14.60K (14596) - SerializeBatchTime: 16.155ms - TransmitDataRPCTime: 10.733ms - UncompressedRowBatchSize: 1.50 MB (1572804) CodeGen:(Total: 45.299ms, non-child: 45.299ms, % non-child: 100.00%) - CodegenTime: 854.929us - CompileTime: 7.019ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 14.674ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 23.187ms HDFS_SCAN_NODE (id=2):(Total: 1s124ms, non-child: 1s124ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:1/85.73 KB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: Only following filters arrived: , waited 945ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:9 BytesRead(500.000ms): 0, 0 - FooterProcessingTime: (Avg: 98.836ms ; Min: 98.836ms ; Max: 98.836ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 170.20 KB (174286) - BytesReadDataNodeCache: 0 - BytesReadLocal: 170.20 KB (174286) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 170.20 KB (174286) - DecompressionTime: 84.019us - MaxCompressedTextFileLength: 0 - NumColumns: 9 (9) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 957.39 KB (980365) - PerReadThreadRawHdfsThroughput: 458.25 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 178.871ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 14.60K (14596) - RowsReturned: 14.60K (14596) - RowsReturnedRate: 12.98 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 1 (1) - ScannerThreadsTotalWallClockTime: 183.357ms - MaterializeTupleTime(*): 4.810ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 4.999ms - ScannerThreadsVoluntaryContextSwitches: 12 (12) - TotalRawHdfsReadTime(*): 362.713us - TotalReadThroughput: 0.00 /sec Filter 0 (1.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 14.60K (14596) Instance 7f40dcb034de70b7:1e (host=vc1511.foo:22000):(Total: 1s360ms, non-child: 212.068ms, % non-child: 15.58%) Hdfs split stats (:<# splits>/): 4:1/8.06 KB MemoryUsage(500.000ms): 171.90 KB, 171.90 KB, 305.90 KB ThreadUsage(500.000ms): 1, 1, 2 - AverageThreadTokens: 1.33 - BloomFilterBytes: 0 - PeakMemoryUsage: 855.90 KB (876444) - PerHostPeakMemUsage: 13.41 MB (14058828) - RowsProduced: 1.15K (1153) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 64.317ms - TotalStorageWaitTime: 156.303ms - TotalThreadsInvoluntaryContextSwitches: 19 (19) - TotalThreadsTotalWallClockTime: 1s469ms - TotalThreadsSysTime: 13.998ms - TotalThreadsUserTime: 42.992ms - TotalThreadsVoluntaryContextSwitches: 417 (417) Fragment Instance Lifecycle Timings: - ExecTime: 1s283ms - ExecTreeExecTime: 1s082ms - OpenTime: 28.315ms - ExecTreeOpenTime: 62.561us - PrepareTime: 48.848ms - ExecTreePrepareTime: 135.101us DataStreamSender (dst_id=27):(Total: 9.268ms, non-child: 9.268ms, % non-child: 100.00%) - BytesSent: 62.36 KB (63853) - NetworkThroughput(*): 9.80 MB/sec - OverallThroughput: 6.57 MB/sec - PeakMemoryUsage: 603.28 KB (617760) - RowsReturned: 1.15K (1153) - SerializeBatchTime: 2.364ms - TransmitDataRPCTime: 6.212ms - UncompressedRowBatchSize: 122.53 KB (125471) CodeGen:(Total: 56.559ms, non-child: 56.559ms, % non-child: 100.00%) - CodegenTime: 1.524ms - CompileTime: 6.754ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 19.900ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 29.295ms HDFS_SCAN_NODE (id=2):(Total: 1s082ms, non-child: 1s082ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:1/8.06 KB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: Only following filters arrived: , waited 925ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:9 BytesRead(500.000ms): 0, 0, 8.42 KB - FooterProcessingTime: (Avg: 58.697ms ; Min: 58.697ms ; Max: 58.697ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.33 - BytesRead: 14.94 KB (15303) - BytesReadDataNodeCache: 0 - BytesReadLocal: 14.94 KB (15303) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 14.94 KB (15303) - DecompressionTime: 30.908us - MaxCompressedTextFileLength: 0 - NumColumns: 9 (9) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 288.00 KB (294912) - PerReadThreadRawHdfsThroughput: 115.71 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 157.250ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 1.15K (1153) - RowsReturned: 1.15K (1153) - RowsReturnedRate: 1.06 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 157.531ms - MaterializeTupleTime(*): 517.568us - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 999.000us - ScannerThreadsVoluntaryContextSwitches: 12 (12) - TotalRawHdfsReadTime(*): 126.125us - TotalReadThroughput: 5.62 KB/sec Filter 0 (1.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 1.15K (1153) Instance 7f40dcb034de70b7:1c (host=vc1523.foo:22000):(Total: 1s360ms, non-child: 181.458ms, % non-child: 13.34%) Hdfs split stats (:<# splits>/): 2:1/85.77 KB MemoryUsage(500.000ms): 171.90 KB, 171.90 KB, 1.02 MB ThreadUsage(500.000ms): 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.58 MB (3749165) - PerHostPeakMemUsage: 13.41 MB (14058828) - RowsProduced: 14.60K (14597) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 86.005ms - TotalStorageWaitTime: 166.602ms - TotalThreadsInvoluntaryContextSwitches: 24 (24) - TotalThreadsTotalWallClockTime: 1s473ms - TotalThreadsSysTime: 14.998ms - TotalThreadsUserTime: 62.991ms - TotalThreadsVoluntaryContextSwitches: 395 (395) Fragment Instance Lifecycle Timings: - ExecTime: 1s274ms - ExecTreeExecTime: 1s093ms - OpenTime: 26.642ms - ExecTreeOpenTime: 41.769us - PrepareTime: 59.729ms - ExecTreePrepareTime: 131.355us DataStreamSender (dst_id=27):(Total: 25.143ms, non-child: 25.143ms, % non-child: 100.00%) - BytesSent: 685.16 KB (701606) - NetworkThroughput(*): 73.74 MB/sec - OverallThroughput: 26.61 MB/sec - PeakMemoryUsage: 3.17 MB (3321120) - RowsReturned: 14.60K (14597) - SerializeBatchTime: 15.451ms - TransmitDataRPCTime: 9.073ms - UncompressedRowBatchSize: 1.51 MB (1578527) CodeGen:(Total: 60.251ms, non-child: 60.251ms, % non-child: 100.00%) - CodegenTime: 1.453ms - CompileTime: 7.181ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 17.776ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 34.653ms HDFS_SCAN_NODE (id=2):(Total: 1s093ms, non-child: 1s093ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:1/85.77 KB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: Only following filters arrived: , waited 924ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:9 BytesRead(500.000ms): 0, 0 - FooterProcessingTime: (Avg: 89.485ms ; Min: 89.485ms ; Max: 89.485ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 170.29 KB (174372) - BytesReadDataNodeCache: 0 - BytesReadLocal: 170.29 KB (174372) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 170.29 KB (174372) - DecompressionTime: 64.840us - MaxCompressedTextFileLength: 0 - NumColumns: 9 (9) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 863.39 KB (884113) - PerReadThreadRawHdfsThroughput: 488.11 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 167.879ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 14.60K (14597) - RowsReturned: 14.60K (14597) - RowsReturnedRate: 13.34 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 172.520ms - MaterializeTupleTime(*): 4.770ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 5.999ms - ScannerThreadsVoluntaryContextSwitches: 11 (11) - TotalRawHdfsReadTime(*): 340.692us - TotalReadThroughput: 0.00 /sec Filter 0 (1.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 14.60K (14597) Instance 7f40dcb034de70b7:25 (host=vd1125.foo:22000):(Total: 1s359ms, non-child: 175.470ms, % non-child: 12.90%) Hdfs split stats (:<# splits>/): 5:1/85.81 KB MemoryUsage(500.000ms): 171.90 KB, 171.90 KB, 307.90 KB ThreadUsage(500.000ms): 1, 1, 2 - AverageThreadTokens: 1.33 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.54 MB (3716409) - PerHostPeakMemUsage: 13.41 MB (14058828) - RowsProduced: 14.60K (14600) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 96.394ms - TotalStorageWaitTime: 159.995ms - TotalThreadsInvoluntaryContextSwitches: 40 (40) - TotalThreadsTotalWallClockTime: 1s479ms - TotalThreadsSysTime: 21.997ms - TotalThreadsUserTime: 55.991ms - TotalThreadsVoluntaryContextSwitches: 418 (418) Fragment Instance Lifecycle Timings: - ExecTime: 1s287ms - ExecTreeExecTime: 1s106ms - OpenTime: 25.886ms - ExecTreeOpenTime: 42.376us - PrepareTime: 46.149ms - ExecTreePrepareTime: 158.385us DataStreamSender (dst_id=27):(Total: 26.691ms, non-child: 26.691ms, % non-child: 100.00%) - BytesSent: 680.02 KB (696338) - NetworkThroughput(*): 65.02 MB/sec - OverallThroughput: 24.88 MB/sec - PeakMemoryUsage: 3.17 MB (3321120) - RowsReturned: 14.60K (14600) - SerializeBatchTime: 15.858ms - TransmitDataRPCTime: 10.212ms - UncompressedRowBatchSize: 1.51 MB (1585937) CodeGen:(Total: 50.448ms, non-child: 50.448ms, % non-child: 100.00%) - CodegenTime: 1.025ms - CompileTime: 6.628ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 17.658ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 25.710ms HDFS_SCAN_NODE (id=2):(Total: 1s107ms, non-child: 1s107ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:1/85.81 KB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: Only following filters arrived: , waited 944ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:9 BytesRead(500.000ms): 0, 0, 0 - FooterProcessingTime: (Avg: 90.813ms ; Min: 90.813ms ; Max: 90.813ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.33 - BytesRead: 170.37 KB (174462) - BytesReadDataNodeCache: 0 - BytesReadLocal: 170.37 KB (174462) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 170.37 KB (174462) - DecompressionTime: 67.950us - MaxCompressedTextFileLength: 0 - NumColumns: 9 (9) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 1.03 MB (1076637) - PerReadThreadRawHdfsThroughput: 651.63 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 161.480ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 14.60K (14600) - RowsReturned: 14.60K (14600) - RowsReturnedRate: 13.19 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 2 (2) - ScannerThreadsTotalWallClockTime: 166.014ms - MaterializeTupleTime(*): 4.777ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 5.999ms - ScannerThreadsVoluntaryContextSwitches: 11 (11) - TotalRawHdfsReadTime(*): 255.327us - TotalReadThroughput: 0.00 /sec Filter 0 (1.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 14.60K (14600) Instance 7f40dcb034de70b7:66 (host=va1042.foo:22000):(Total: 1s359ms, non-child: 123.539ms, % non-child: 9.09%) Hdfs split stats (:<# splits>/): 7:1/85.82 KB 0:1/83.53 KB MemoryUsage(500.000ms): 163.28 KB, 171.90 KB, 443.90 KB ThreadUsage(500.000ms): 1, 1, 3 - AverageThreadTokens: 1.67 - BloomFilterBytes: 0 - PeakMemoryUsage: 4.34 MB (4553721) - PerHostPeakMemUsage: 13.91 MB (14590058) - RowsProduced: 28.81K (28810) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 70.507ms - TotalStorageWaitTime: 397.273ms - TotalThreadsInvoluntaryContextSwitches: 23 (23) - TotalThreadsTotalWallClockTime: 1s719ms - TotalThreadsSysTime: 18.997ms - TotalThreadsUserTime: 69.989ms - TotalThreadsVoluntaryContextSwitches: 421 (421) Fragment Instance Lifecycle Timings: - ExecTime: 1s289ms - ExecTreeExecTime: 1s140ms - OpenTime: 22.084ms - ExecTreeOpenTime: 49.000us - PrepareTime: 47.909ms - ExecTreePrepareTime: 86.588us DataStreamSender (dst_id=27):(Total: 43.155ms, non-child: 43.155ms, % non-child: 100.00%) - BytesSent: 1.32 MB (1381928) - NetworkThroughput(*): 57.75 MB/sec - OverallThroughput: 30.54 MB/sec - PeakMemoryUsage: 3.17 MB (3321120) - RowsReturned: 28.81K (28810) - SerializeBatchTime: 19.708ms - TransmitDataRPCTime: 22.822ms - UncompressedRowBatchSize: 3.00 MB (3144629) CodeGen:(Total: 51.719ms, non-child: 51.719ms, % non-child: 100.00%) - CodegenTime: 1.052ms - CompileTime: 5.815ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 14.932ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 30.476ms HDFS_SCAN_NODE (id=2):(Total: 1s141ms, non-child: 1s141ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:1/85.82 KB 0:1/83.53 KB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 2 out of 2 Runtime filters: Only following filters arrived: , waited 945ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:18 BytesRead(500.000ms): 0, 0, 0 - FooterProcessingTime: (Avg: 106.248ms ; Min: 97.283ms ; Max: 115.214ms ; Number of samples: 2) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 336.18 KB (344248) - BytesReadDataNodeCache: 0 - BytesReadLocal: 336.18 KB (344248) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 336.18 KB (344248) - DecompressionTime: 173.168us - MaxCompressedTextFileLength: 0 - NumColumns: 9 (9) - NumDisksAccessed: 2 (2) - NumRowGroups: 2 (2) - NumScannerThreadsStarted: 2 (2) - PeakMemoryUsage: 1.21 MB (1266781) - PerReadThreadRawHdfsThroughput: 511.18 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 195.090ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 28.81K (28810) - RowsReturned: 28.81K (28810) - RowsReturnedRate: 25.25 K/sec - ScanRangesComplete: 2 (2) - ScannerThreadsInvoluntaryContextSwitches: 3 (3) - ScannerThreadsTotalWallClockTime: 408.617ms - MaterializeTupleTime(*): 8.626ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 9.998ms - ScannerThreadsVoluntaryContextSwitches: 24 (24) - TotalRawHdfsReadTime(*): 642.236us - TotalReadThroughput: 0.00 /sec Filter 0 (1.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 28.81K (28810) Instance 7f40dcb034de70b7:2b (host=vd1139.foo:22000):(Total: 1s358ms, non-child: 188.675ms, % non-child: 13.89%) Hdfs split stats (:<# splits>/): 1:1/85.83 KB MemoryUsage(500.000ms): 163.28 KB, 171.90 KB, 307.90 KB ThreadUsage(500.000ms): 1, 1, 2 - AverageThreadTokens: 1.33 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.58 MB (3749165) - PerHostPeakMemUsage: 13.41 MB (14058828) - RowsProduced: 14.60K (14597) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 106.537ms - TotalStorageWaitTime: 150.945ms - TotalThreadsInvoluntaryContextSwitches: 31 (31) - TotalThreadsTotalWallClockTime: 1s475ms - TotalThreadsSysTime: 15.997ms - TotalThreadsUserTime: 59.991ms - TotalThreadsVoluntaryContextSwitches: 407 (407) Fragment Instance Lifecycle Timings: - ExecTime: 1s295ms - ExecTreeExecTime: 1s097ms - OpenTime: 23.070ms - ExecTreeOpenTime: 34.876us - PrepareTime: 39.189ms - ExecTreePrepareTime: 104.414us DataStreamSender (dst_id=27):(Total: 26.547ms, non-child: 26.547ms, % non-child: 100.00%) - BytesSent: 684.04 KB (700462) - NetworkThroughput(*): 64.76 MB/sec - OverallThroughput: 25.16 MB/sec - PeakMemoryUsage: 3.17 MB (3321120) - RowsReturned: 14.60K (14597) - SerializeBatchTime: 15.824ms - TransmitDataRPCTime: 10.315ms - UncompressedRowBatchSize: 1.51 MB (1584883) CodeGen:(Total: 45.084ms, non-child: 45.084ms, % non-child: 100.00%) - CodegenTime: 922.119us - CompileTime: 6.371ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 15.569ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 22.703ms HDFS_SCAN_NODE (id=2):(Total: 1s097ms, non-child: 1s097ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:1/85.83 KB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: Only following filters arrived: , waited 944ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:9 BytesRead(500.000ms): 0, 0, 0 - FooterProcessingTime: (Avg: 70.796ms ; Min: 70.796ms ; Max: 70.796ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.50 - BytesRead: 170.41 KB (174500) - BytesReadDataNodeCache: 0 - BytesReadLocal: 170.41 KB (174500) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 170.41 KB (174500) - DecompressionTime: 87.043us - MaxCompressedTextFileLength: 0 - NumColumns: 9 (9) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 957.39 KB (980369) - PerReadThreadRawHdfsThroughput: 621.43 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 152.399ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 14.60K (14597) - RowsReturned: 14.60K (14597) - RowsReturnedRate: 13.30 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 156.907ms - MaterializeTupleTime(*): 4.795ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 4.999ms - ScannerThreadsVoluntaryContextSwitches: 12 (12) - TotalRawHdfsReadTime(*): 267.796us - TotalReadThroughput: 0.00 /sec Filter 0 (1.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 14.60K (14597) Instance 7f40dcb034de70b7:46 (host=vd1101.foo:22000):(Total: 1s357ms, non-child: 179.689ms, % non-child: 13.23%) Hdfs split stats (:<# splits>/): 2:1/85.81 KB MemoryUsage(500.000ms): 0, 171.90 KB, 307.90 KB ThreadUsage(500.000ms): 1, 1, 2 - AverageThreadTokens: 1.33 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.57 MB (3747121) - PerHostPeakMemUsage: 13.41 MB (14058828) - RowsProduced: 14.60K (14598) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 96.856ms - TotalStorageWaitTime: 168.333ms - TotalThreadsInvoluntaryContextSwitches: 30 (30) - TotalThreadsTotalWallClockTime: 1s477ms - TotalThreadsSysTime: 18.996ms - TotalThreadsUserTime: 59.990ms - TotalThreadsVoluntaryContextSwitches: 395 (395) Fragment Instance Lifecycle Timings: - ExecTime: 1s281ms - ExecTreeExecTime: 1s095ms - OpenTime: 22.645ms - ExecTreeOpenTime: 32.523us - PrepareTime: 54.191ms - ExecTreePrepareTime: 127.307us DataStreamSender (dst_id=27):(Total: 27.351ms, non-child: 27.351ms, % non-child: 100.00%) - BytesSent: 685.75 KB (702211) - NetworkThroughput(*): 61.86 MB/sec - OverallThroughput: 24.48 MB/sec - PeakMemoryUsage: 3.17 MB (3321120) - RowsReturned: 14.60K (14598) - SerializeBatchTime: 15.759ms - TransmitDataRPCTime: 10.825ms - UncompressedRowBatchSize: 1.52 MB (1590600) CodeGen:(Total: 55.064ms, non-child: 55.064ms, % non-child: 100.00%) - CodegenTime: 1.061ms - CompileTime: 6.106ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 15.111ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 33.373ms HDFS_SCAN_NODE (id=2):(Total: 1s095ms, non-child: 1s095ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:1/85.81 KB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: Only following filters arrived: , waited 925ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% File Formats: PARQUET/SNAPPY:9 BytesRead(500.000ms): 0, 0, 0 - FooterProcessingTime: (Avg: 93.568ms ; Min: 93.568ms ; Max: 93.568ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.50 - BytesRead: 170.37 KB (174462) - BytesReadDataNodeCache: 0 - BytesReadLocal: 170.37 KB (174462) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 170.37 KB (174462) - DecompressionTime: 90.330us - MaxCompressedTextFileLength: 0 - NumColumns: 9 (9) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 1.03 MB (1076629) - PerReadThreadRawHdfsThroughput: 448.11 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 169.859ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 14.60K (14598) - RowsReturned: 14.60K (14598) - RowsReturnedRate: 13.32 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 174.645ms - MaterializeTupleTime(*): 5.074ms - ScannerThreadsSysTime: 2.999ms - ScannerThreadsUserTime: 2.999ms - ScannerThreadsVoluntaryContextSwitches: 13 (13) - TotalRawHdfsReadTime(*): 371.289us - TotalReadThroughput: 0.00 /sec Filter 0 (1.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 14.60K (14598) Instance 7f40dcb034de70b7:5a (host=ve1128.foo:22000):(Total: 1s357ms, non-child: 178.598ms, % non-child: 13.16%) Hdfs split stats (:<# splits>/): 2:1/87.95 KB MemoryUsage(500.000ms): 171.90 KB, 171.90 KB, 322.43 KB ThreadUsage(500.000ms): 1, 1, 2 - AverageThreadTokens: 1.33 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.54 MB (3716707) - PerHostPeakMemUsage: 13.63 MB (14287598) - RowsProduced: 14.98K (14982) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 96.214ms - TotalStorageWaitTime: 167.211ms - TotalThreadsInvoluntaryContextSwitches: 40 (40) - TotalThreadsTotalWallClockTime: 1s475ms - TotalThreadsSysTime: 19.997ms - TotalThreadsUserTime: 54.991ms - TotalThreadsVoluntaryContextSwitches: 413 (413) Fragment Instance Lifecycle Timings: - ExecTime: 1s280ms - ExecTreeExecTime: 1s093ms - OpenTime: 22.326ms - ExecTreeOpenTime: 30.072us - PrepareTime: 54.589ms - ExecTreePrepareTime: 109.395us DataStreamSender (dst_id=27):(Total: 28.317ms, non-child: 28.317ms, % non-child: 100.00%) - BytesSent: 699.77 KB (716560) - NetworkThroughput(*): 67.88 MB/sec - OverallThroughput: 24.13 MB/sec - PeakMemoryUsage: 3.17 MB (3321120) - RowsReturned: 14.98K (14982) - SerializeBatchTime: 17.626ms - TransmitDataRPCTime: 10.066ms - UncompressedRowBatchSize: 1.55 MB (1626182) CodeGen:(Total: 56.240ms, non-child: 56.240ms, % non-child: 100.00%) - CodegenTime: 1.204ms - CompileTime: 5.869ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 14.884ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 35.022ms HDFS_SCAN_NODE (id=2):(Total: 1s094ms, non-child: 1s094ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:1/87.95 KB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: Only following filters arrived: , waited 925ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:9 BytesRead(500.000ms): 0, 0, 90.12 KB - FooterProcessingTime: (Avg: 99.775ms ; Min: 99.775ms ; Max: 99.775ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.33 - BytesRead: 174.64 KB (178828) - BytesReadDataNodeCache: 0 - BytesReadLocal: 174.64 KB (178828) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 174.64 KB (178828) - DecompressionTime: 65.095us - MaxCompressedTextFileLength: 0 - NumColumns: 9 (9) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 951.69 KB (974535) - PerReadThreadRawHdfsThroughput: 621.32 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 168.648ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 14.98K (14982) - RowsReturned: 14.98K (14982) - RowsReturnedRate: 13.69 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 173.234ms - MaterializeTupleTime(*): 4.808ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 4.999ms - ScannerThreadsVoluntaryContextSwitches: 11 (11) - TotalRawHdfsReadTime(*): 274.484us - TotalReadThroughput: 60.08 KB/sec Filter 0 (1.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 14.98K (14982) Instance 7f40dcb034de70b7:37 (host=vd1340.foo:22000):(Total: 1s354ms, non-child: 174.128ms, % non-child: 12.85%) Hdfs split stats (:<# splits>/): 3:1/87.93 KB MemoryUsage(500.000ms): 171.90 KB, 171.90 KB, 2.27 MB ThreadUsage(500.000ms): 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.58 MB (3751527) - PerHostPeakMemUsage: 13.41 MB (14058828) - RowsProduced: 14.98K (14983) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 89.171ms - TotalStorageWaitTime: 173.519ms - TotalThreadsInvoluntaryContextSwitches: 21 (21) - TotalThreadsTotalWallClockTime: 1s483ms - TotalThreadsSysTime: 19.997ms - TotalThreadsUserTime: 59.991ms - TotalThreadsVoluntaryContextSwitches: 416 (416) Fragment Instance Lifecycle Timings: - ExecTime: 1s277ms - ExecTreeExecTime: 1s099ms - OpenTime: 27.048ms - ExecTreeOpenTime: 39.550us - PrepareTime: 50.333ms - ExecTreePrepareTime: 183.989us DataStreamSender (dst_id=27):(Total: 25.758ms, non-child: 25.758ms, % non-child: 100.00%) - BytesSent: 693.37 KB (710007) - NetworkThroughput(*): 69.16 MB/sec - OverallThroughput: 26.29 MB/sec - PeakMemoryUsage: 3.17 MB (3321120) - RowsReturned: 14.98K (14983) - SerializeBatchTime: 15.303ms - TransmitDataRPCTime: 9.790ms - UncompressedRowBatchSize: 1.55 MB (1623367) CodeGen:(Total: 54.590ms, non-child: 54.590ms, % non-child: 100.00%) - CodegenTime: 1.604ms - CompileTime: 6.772ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 18.591ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 28.587ms HDFS_SCAN_NODE (id=2):(Total: 1s100ms, non-child: 1s100ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:1/87.93 KB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: Only following filters arrived: , waited 924ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:9 BytesRead(500.000ms): 0, 0 - FooterProcessingTime: (Avg: 101.078ms ; Min: 101.078ms ; Max: 101.078ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 174.60 KB (178790) - BytesReadDataNodeCache: 0 - BytesReadLocal: 174.60 KB (178790) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 174.60 KB (178790) - DecompressionTime: 62.756us - MaxCompressedTextFileLength: 0 - NumColumns: 9 (9) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 865.70 KB (886475) - PerReadThreadRawHdfsThroughput: 505.52 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 174.890ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 14.98K (14983) - RowsReturned: 14.98K (14983) - RowsReturnedRate: 13.62 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 179.669ms - MaterializeTupleTime(*): 4.881ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 5.999ms - ScannerThreadsVoluntaryContextSwitches: 13 (13) - TotalRawHdfsReadTime(*): 337.293us - TotalReadThroughput: 0.00 /sec Filter 0 (1.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 14.98K (14983) Instance 7f40dcb034de70b7:56 (host=ve1127.foo:22000):(Total: 1s354ms, non-child: 173.042ms, % non-child: 12.77%) Hdfs split stats (:<# splits>/): 5:1/85.86 KB MemoryUsage(500.000ms): 171.90 KB, 171.90 KB, 2.56 MB ThreadUsage(500.000ms): 1, 1, 2 - AverageThreadTokens: 1.33 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.59 MB (3763505) - PerHostPeakMemUsage: 13.41 MB (14058828) - RowsProduced: 14.60K (14598) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 90.343ms - TotalStorageWaitTime: 176.372ms - TotalThreadsInvoluntaryContextSwitches: 39 (39) - TotalThreadsTotalWallClockTime: 1s484ms - TotalThreadsSysTime: 10.998ms - TotalThreadsUserTime: 64.989ms - TotalThreadsVoluntaryContextSwitches: 408 (408) Fragment Instance Lifecycle Timings: - ExecTime: 1s277ms - ExecTreeExecTime: 1s102ms - OpenTime: 25.969ms - ExecTreeOpenTime: 35.747us - PrepareTime: 51.562ms - ExecTreePrepareTime: 131.165us DataStreamSender (dst_id=27):(Total: 25.796ms, non-child: 25.796ms, % non-child: 100.00%) - BytesSent: 684.41 KB (700836) - NetworkThroughput(*): 68.90 MB/sec - OverallThroughput: 25.91 MB/sec - PeakMemoryUsage: 3.17 MB (3321120) - RowsReturned: 14.60K (14598) - SerializeBatchTime: 15.498ms - TransmitDataRPCTime: 9.700ms - UncompressedRowBatchSize: 1.51 MB (1584759) CodeGen:(Total: 52.693ms, non-child: 52.693ms, % non-child: 100.00%) - CodegenTime: 1.375ms - CompileTime: 6.532ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 17.430ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 28.054ms HDFS_SCAN_NODE (id=2):(Total: 1s103ms, non-child: 1s103ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:1/85.86 KB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: Only following filters arrived: , waited 925ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:9 BytesRead(500.000ms): 0, 0, 170.46 KB - FooterProcessingTime: (Avg: 107.445ms ; Min: 107.445ms ; Max: 107.445ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.33 - BytesRead: 170.46 KB (174550) - BytesReadDataNodeCache: 0 - BytesReadLocal: 170.46 KB (174550) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 170.46 KB (174550) - DecompressionTime: 64.997us - MaxCompressedTextFileLength: 0 - NumColumns: 9 (9) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 1.03 MB (1076629) - PerReadThreadRawHdfsThroughput: 561.22 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 177.791ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 14.60K (14598) - RowsReturned: 14.60K (14598) - RowsReturnedRate: 13.23 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 4 (4) - ScannerThreadsTotalWallClockTime: 182.047ms - MaterializeTupleTime(*): 4.522ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 4.999ms - ScannerThreadsVoluntaryContextSwitches: 12 (12) - TotalRawHdfsReadTime(*): 296.612us - TotalReadThroughput: 113.64 KB/sec Filter 0 (1.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 14.60K (14598) Instance 7f40dcb034de70b7:20 (host=vc1524.foo:22000):(Total: 1s343ms, non-child: 539.483ms, % non-child: 40.15%) Hdfs split stats (:<# splits>/): 5:1/87.91 KB MemoryUsage(500.000ms): 0, 171.90 KB, 2.87 MB ThreadUsage(500.000ms): 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.58 MB (3749479) - PerHostPeakMemUsage: 16.39 MB (17186636) - RowsProduced: 14.98K (14983) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 94.002ms - TotalStorageWaitTime: 153.972ms - TotalThreadsInvoluntaryContextSwitches: 41 (41) - TotalThreadsTotalWallClockTime: 991.240ms - TotalThreadsSysTime: 24.997ms - TotalThreadsUserTime: 69.990ms - TotalThreadsVoluntaryContextSwitches: 414 (414) Fragment Instance Lifecycle Timings: - ExecTime: 775.372ms - ExecTreeExecTime: 597.717ms - OpenTime: 57.754ms - ExecTreeOpenTime: 636.075us - PrepareTime: 510.466ms - ExecTreePrepareTime: 896.543us DataStreamSender (dst_id=27):(Total: 68.308ms, non-child: 68.308ms, % non-child: 100.00%) - BytesSent: 705.48 KB (722410) - NetworkThroughput(*): 66.25 MB/sec - OverallThroughput: 10.09 MB/sec - PeakMemoryUsage: 3.17 MB (3321120) - RowsReturned: 14.98K (14983) - SerializeBatchTime: 14.332ms - TransmitDataRPCTime: 10.399ms - UncompressedRowBatchSize: 1.55 MB (1627884) CodeGen:(Total: 135.167ms, non-child: 135.167ms, % non-child: 100.00%) - CodegenTime: 3.417ms - CompileTime: 17.736ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 33.798ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 82.086ms HDFS_SCAN_NODE (id=2):(Total: 600.801ms, non-child: 600.801ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:1/87.91 KB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: Only following filters arrived: , waited 442ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:9 BytesRead(500.000ms): 0, 0 - FooterProcessingTime: (Avg: 83.565ms ; Min: 83.565ms ; Max: 83.565ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 174.56 KB (178748) - BytesReadDataNodeCache: 0 - BytesReadLocal: 174.56 KB (178748) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 174.56 KB (178748) - DecompressionTime: 50.538us - MaxCompressedTextFileLength: 0 - NumColumns: 9 (9) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 857.70 KB (878283) - PerReadThreadRawHdfsThroughput: 519.99 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 155.304ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 14.98K (14983) - RowsReturned: 14.98K (14983) - RowsReturnedRate: 24.94 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 159.954ms - MaterializeTupleTime(*): 4.712ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 4.999ms - ScannerThreadsVoluntaryContextSwitches: 11 (11) - TotalRawHdfsReadTime(*): 327.829us - TotalReadThroughput: 0.00 /sec Filter 0 (1.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 14.98K (14983) Instance 7f40dcb034de70b7:21 (host=vd1331.foo:22000):(Total: 1s336ms, non-child: 187.439ms, % non-child: 14.02%) Hdfs split stats (:<# splits>/): 3:1/85.75 KB MemoryUsage(500.000ms): 171.90 KB, 171.90 KB, 843.90 KB ThreadUsage(500.000ms): 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.56 MB (3732785) - PerHostPeakMemUsage: 14.46 MB (15159719) - RowsProduced: 14.60K (14598) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 98.024ms - TotalStorageWaitTime: 157.735ms - TotalThreadsInvoluntaryContextSwitches: 29 (29) - TotalThreadsTotalWallClockTime: 1s421ms - TotalThreadsSysTime: 19.996ms - TotalThreadsUserTime: 56.991ms - TotalThreadsVoluntaryContextSwitches: 394 (394) Fragment Instance Lifecycle Timings: - ExecTime: 1s233ms - ExecTreeExecTime: 1s064ms - OpenTime: 24.519ms - ExecTreeOpenTime: 45.996us - PrepareTime: 78.873ms - ExecTreePrepareTime: 1.448ms DataStreamSender (dst_id=27):(Total: 27.753ms, non-child: 27.753ms, % non-child: 100.00%) - BytesSent: 677.49 KB (693751) - NetworkThroughput(*): 58.12 MB/sec - OverallThroughput: 23.84 MB/sec - PeakMemoryUsage: 3.17 MB (3321120) - RowsReturned: 14.60K (14598) - SerializeBatchTime: 15.698ms - TransmitDataRPCTime: 11.382ms - UncompressedRowBatchSize: 1.51 MB (1580350) CodeGen:(Total: 53.409ms, non-child: 53.409ms, % non-child: 100.00%) - CodegenTime: 974.583us - CompileTime: 6.923ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 16.327ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 29.601ms HDFS_SCAN_NODE (id=2):(Total: 1s068ms, non-child: 1s068ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:1/85.75 KB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: Only following filters arrived: , waited 904ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:9 BytesRead(500.000ms): 0, 0 - FooterProcessingTime: (Avg: 90.452ms ; Min: 90.452ms ; Max: 90.452ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 170.24 KB (174330) - BytesReadDataNodeCache: 0 - BytesReadLocal: 170.24 KB (174330) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 170.24 KB (174330) - DecompressionTime: 62.551us - MaxCompressedTextFileLength: 0 - NumColumns: 9 (9) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 863.40 KB (884117) - PerReadThreadRawHdfsThroughput: 553.14 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 159.149ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 14.60K (14598) - RowsReturned: 14.60K (14598) - RowsReturnedRate: 13.66 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 163.705ms - MaterializeTupleTime(*): 4.793ms - ScannerThreadsSysTime: 1.999ms - ScannerThreadsUserTime: 3.999ms - ScannerThreadsVoluntaryContextSwitches: 11 (11) - TotalRawHdfsReadTime(*): 300.562us - TotalReadThroughput: 0.00 /sec Filter 0 (1.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 14.60K (14598) Averaged Fragment F07:(Total: 62.118ms, non-child: 0.000ns, % non-child: 0.00%) split sizes: min: 0, max: 0, avg: 0, stddev: 0 completion times: min:11m max:11m1s mean: 11m1s stddev:4.731ms execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec num instances: 134 - AverageThreadTokens: 2.03 - BloomFilterBytes: 49.00 MB (51380224) - PeakMemoryUsage: 160.67 GB (172521939428) - PerHostPeakMemUsage: 169.56 GB (182065862095) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 2m12s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 1.59K (1589) - TotalThreadsTotalWallClockTime: 21s900ms - TotalThreadsSysTime: 2s194ms - TotalThreadsUserTime: 8s038ms - TotalThreadsVoluntaryContextSwitches: 22.30K (22299) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 62.037ms - ExecTreePrepareTime: 830.781us DataStreamSender (dst_id=28):(Total: 994.548us, non-child: 994.548us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.05 MB (1105280) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 644.415ms, non-child: 644.415ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 208.320ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 122 (122) - NumInstructions: 8.95K (8951) - OptimizationTime: 410.671ms - PeakMemoryUsage: 4.37 MB (4582912) - PrepareTime: 24.948ms HASH_JOIN_NODE (id=15):(Total: 1.570ms, non-child: 997.429us, % non-child: 63.52%) - BuildRows: 451.92K (451915) - BuildTime: 137.144ms - PeakMemoryUsage: 153.09 MB (160524544) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=15): - BuildRowsPartitionTime: 100.982ms - BuildRowsPartitioned: 451.92K (451915) - GetNewBlockTime: 504.048us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 32.158ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160449664) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=26):(Total: 2s035ms, non-child: 2s035ms, % non-child: 100.00%) - BytesReceived: 6.21 MB (6513198) - ConvertRowBatchTime: 12.191ms - DeserializeRowBatchTimer: 54.165ms - FirstBatchArrivalWaitTime: 1s176ms - PeakMemoryUsage: 0 - RowsReturned: 451.92K (451915) - RowsReturnedRate: 222.56 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=14):(Total: 1.211ms, non-child: 963.410us, % non-child: 79.52%) - BuildRows: 459.26K (459259) - BuildTime: 156.192ms - PeakMemoryUsage: 25.08 MB (26298624) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): - BuildRowsPartitionTime: 94.137ms - BuildRowsPartitioned: 459.26K (459259) - GetNewBlockTime: 212.321us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 24.887ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 25.02 MB (26231936) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 4s111ms, non-child: 4s111ms, % non-child: 100.00%) - BytesReceived: 7.34 MB (7692696) - ConvertRowBatchTime: 11.578ms - DeserializeRowBatchTimer: 16.853ms - FirstBatchArrivalWaitTime: 2s086ms - PeakMemoryUsage: 0 - RowsReturned: 459.26K (459259) - RowsReturnedRate: 111.77 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=13):(Total: 833.268us, non-child: 0.000ns, % non-child: 0.00%) - BuildRows: 3.99B (3991987410) - BuildTime: 6m6s - PeakMemoryUsage: 158.80 GB (170513314681) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): - BuildRowsPartitionTime: 6m5s - BuildRowsPartitioned: 3.99B (3991987410) - GetNewBlockTime: 41s324ms - HashBuckets: 633.03M (633026896) - HashCollisions: 0 (0) - HashTablesBuildTime: 50s342ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 158.80 GB (170513247512) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 4 (4) - UnpinTime: 270.628ms HASH_JOIN_NODE (id=12):(Total: 3m19s, non-child: 1m13s, % non-child: 36.99%) - BuildRows: 40.28M (40277267) - BuildTime: 8s449ms - PeakMemoryUsage: 3.02 GB (3240189834) - ProbeRows: 77.21M (77213598) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1m4s - RowsReturned: 3.99B (3991987410) - RowsReturnedRate: 20.24 M/sec Hash Join Builder (join_node_id=12): - BuildRowsPartitionTime: 5s582ms - BuildRowsPartitioned: 40.28M (40277267) - GetNewBlockTime: 3.564ms - HashBuckets: 67.11M (67108864) - HashCollisions: 0 (0) - HashTablesBuildTime: 2s817ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 3.02 GB (3240125568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 6s912ms, non-child: 6s912ms, % non-child: 100.00%) - BytesReceived: 381.75 MB (400294250) - ConvertRowBatchTime: 957.503ms - DeserializeRowBatchTimer: 1s580ms - FirstBatchArrivalWaitTime: 1s100ms - PeakMemoryUsage: 0 - RowsReturned: 40.28M (40277267) - RowsReturnedRate: 5.84 M/sec - SendersBlockedTimer: 35.822ms - SendersBlockedTotalTimer(*): 3s234ms EXCHANGE_NODE (id=22):(Total: 1m59s, non-child: 1m59s, % non-child: 100.00%) - BytesReceived: 714.78 MB (749497970) - ConvertRowBatchTime: 875.867ms - DeserializeRowBatchTimer: 7s060ms - FirstBatchArrivalWaitTime: 764.879ms - PeakMemoryUsage: 0 - RowsReturned: 77.21M (77213598) - RowsReturnedRate: 669.41 K/sec - SendersBlockedTimer: 3s438ms - SendersBlockedTotalTimer(*): 6m46s EXCHANGE_NODE (id=24):(Total: 1s703ms, non-child: 1s703ms, % non-child: 100.00%) - BytesReceived: 10.55 MB (11060307) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 72.026ms - FirstBatchArrivalWaitTime: 1s703ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 23.99K (23986) - BlocksRecycled: 451 (451) - BufferedPins: 0 (0) - BytesWritten: 42.37 GB (45493518336) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 161.38 GB (173283483306) - ScratchFileUsedBytes: 42.37 GB (45493518336) - TotalBufferWaitTime: 5s767ms - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns Fragment F07: Instance 7f40dcb034de70b7:311 (host=vc1524.foo:22000):(Total: 501.722ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 1000.03 MB, 7.14 GB, 14.25 GB, 20.91 GB, 27.83 GB, 34.75 GB, 41.72 GB, 48.70 GB, 55.31 GB, 61.90 GB, 68.32 GB, 74.81 GB, 81.82 GB, 88.35 GB, 94.74 GB, 101.58 GB, 108.21 GB, 115.02 GB, 121.35 GB, 127.56 GB, 133.96 GB, 138.31 GB, 143.09 GB, 149.03 GB, 154.62 GB, 157.93 GB, 151.43 GB, 154.91 GB, 157.05 GB, 158.36 GB, 150.12 GB, 151.92 GB, 154.25 GB, 155.88 GB, 158.25 GB, 152.05 GB, 153.88 GB, 154.24 GB, 157.29 GB, 145.05 GB ThreadUsage(16s000ms): 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.03 - BloomFilterBytes: 49.00 MB (51380224) - PeakMemoryUsage: 160.60 GB (172446200527) - PerHostPeakMemUsage: 169.57 GB (182077603970) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 1m47s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 1.75K (1751) - TotalThreadsTotalWallClockTime: 19s947ms - TotalThreadsSysTime: 2s172ms - TotalThreadsUserTime: 8s216ms - TotalThreadsVoluntaryContextSwitches: 20.29K (20289) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 501.148ms - ExecTreePrepareTime: 11.681ms DataStreamSender (dst_id=28):(Total: 8.316ms, non-child: 8.316ms, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.05 MB (1105280) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 776.361ms, non-child: 776.361ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 224.988ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 122 (122) - NumInstructions: 8.95K (8951) - OptimizationTime: 488.970ms - PeakMemoryUsage: 4.37 MB (4582912) - PrepareTime: 61.369ms HASH_JOIN_NODE (id=15):(Total: 21.244ms, non-child: 7.646ms, % non-child: 35.99%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 451.92K (451915) - BuildTime: 122.056ms - PeakMemoryUsage: 153.09 MB (160524544) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=15): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 92.296ms - BuildRowsPartitioned: 451.92K (451915) - GetNewBlockTime: 452.081us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 27.466ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160449664) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=26):(Total: 1s482ms, non-child: 29.500ms, % non-child: 1.99%) BytesReceived(16s000ms): 5.38 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB - BytesReceived: 6.21 MB (6513198) - ConvertRowBatchTime: 11.612ms - DeserializeRowBatchTimer: 59.977ms - FirstBatchArrivalWaitTime: 611.138ms - PeakMemoryUsage: 0 - RowsReturned: 451.92K (451915) - RowsReturnedRate: 304.83 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=14):(Total: 14.191ms, non-child: 6.401ms, % non-child: 45.11%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 458.23K (458234) - BuildTime: 144.640ms - PeakMemoryUsage: 25.08 MB (26298624) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 85.186ms - BuildRowsPartitioned: 458.23K (458234) - GetNewBlockTime: 237.160us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 21.189ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 25.02 MB (26231936) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 3s534ms, non-child: 15.610ms, % non-child: 0.44%) BytesReceived(16s000ms): 5.82 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB - BytesReceived: 7.32 MB (7675014) - ConvertRowBatchTime: 11.410ms - DeserializeRowBatchTimer: 16.739ms - FirstBatchArrivalWaitTime: 1s515ms - PeakMemoryUsage: 0 - RowsReturned: 458.23K (458234) - RowsReturnedRate: 129.64 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=13):(Total: 8.347ms, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 4.06B (4057800199) - BuildTime: 6m23s - PeakMemoryUsage: 160.16 GB (171968792832) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled, Spilled Runtime filters: 0 of 1 Runtime Filter Published, 1 Disabled - BuildRowsPartitionTime: 6m23s - BuildRowsPartitioned: 4.06B (4057800199) - GetNewBlockTime: 41s294ms - HashBuckets: 1.07B (1073741824) - HashCollisions: 0 (0) - HashTablesBuildTime: 1m15s - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 160.16 GB (171968734336) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 5 (5) - UnpinTime: 119.547ms HASH_JOIN_NODE (id=12):(Total: 2m58s, non-child: 1m15s, % non-child: 42.27%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 40.13M (40127990) - BuildTime: 8s664ms - PeakMemoryUsage: 3.02 GB (3240191296) - ProbeRows: 76.71M (76711902) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1m5s - RowsReturned: 4.06B (4057800199) - RowsReturnedRate: 22.73 M/sec Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 5s874ms - BuildRowsPartitioned: 40.13M (40127990) - GetNewBlockTime: 3.072ms - HashBuckets: 67.11M (67108864) - HashCollisions: 0 (0) - HashTablesBuildTime: 2s740ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 3.02 GB (3240125568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 5s898ms, non-child: 1s533ms, % non-child: 25.99%) BytesReceived(16s000ms): 210.24 MB, 380.03 MB, 380.03 MB, 380.03 MB, 380.03 MB, 380.03 MB, 380.03 MB, 380.03 MB, 380.03 MB, 380.03 MB, 380.03 MB, 380.03 MB, 380.03 MB, 380.03 MB, 380.03 MB, 380.03 MB, 380.03 MB, 380.03 MB, 380.03 MB, 380.03 MB, 380.03 MB, 380.03 MB, 380.03 MB, 380.03 MB, 380.03 MB, 380.03 MB, 380.03 MB, 380.03 MB, 380.03 MB, 380.03 MB, 380.03 MB, 380.03 MB, 380.03 MB, 380.03 MB, 380.03 MB, 380.03 MB, 380.03 MB, 380.03 MB, 380.03 MB, 380.03 MB - BytesReceived: 380.03 MB (398492932) - ConvertRowBatchTime: 937.645ms - DeserializeRowBatchTimer: 1s539ms - FirstBatchArrivalWaitTime: 538.003ms - PeakMemoryUsage: 0 - RowsReturned: 40.13M (40127990) - RowsReturnedRate: 6.80 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=22):(Total: 1m37s, non-child: 1s411ms, % non-child: 1.45%) BytesReceived(16s000ms): 2.20 MB, 15.66 MB, 42.69 MB, 68.83 MB, 95.92 MB, 123.05 MB, 150.58 MB, 178.11 MB, 204.04 MB, 229.91 MB, 255.35 MB, 281.58 MB, 308.66 MB, 335.09 MB, 359.50 MB, 386.73 MB, 412.69 MB, 440.30 MB, 463.79 MB, 489.04 MB, 512.91 MB, 530.12 MB, 549.27 MB, 573.08 MB, 593.71 MB, 606.61 MB, 627.24 MB, 643.30 MB, 655.54 MB, 660.41 MB, 669.85 MB, 682.92 MB, 687.89 MB, 697.77 MB, 706.46 MB, 710.54 MB, 710.54 MB, 710.54 MB, 710.54 MB, 710.54 MB - BytesReceived: 710.54 MB (745057638) - ConvertRowBatchTime: 895.322ms - DeserializeRowBatchTimer: 6s134ms - FirstBatchArrivalWaitTime: 198.661ms - PeakMemoryUsage: 0 - RowsReturned: 76.71M (76711902) - RowsReturnedRate: 787.98 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=24):(Total: 1s145ms, non-child: 4.299us, % non-child: 0.00%) BytesReceived(16s000ms): 8.35 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.13 MB, 10.19 MB, 10.19 MB - BytesReceived: 10.20 MB (10697007) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 67.354ms - FirstBatchArrivalWaitTime: 1s145ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:34c (host=va1026.foo:22000):(Total: 109.056ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 891.99 MB, 6.36 GB, 13.82 GB, 20.39 GB, 27.10 GB, 33.83 GB, 40.66 GB, 47.43 GB, 53.77 GB, 60.15 GB, 66.34 GB, 72.75 GB, 79.51 GB, 85.90 GB, 92.07 GB, 98.33 GB, 105.61 GB, 112.59 GB, 118.52 GB, 124.50 GB, 130.68 GB, 135.00 GB, 139.55 GB, 145.16 GB, 149.84 GB, 153.09 GB, 157.71 GB, 151.87 GB, 154.47 GB, 155.54 GB, 157.62 GB, 154.18 GB, 150.61 GB, 152.59 GB, 154.05 GB, 151.16 GB, 150.91 GB, 152.10 GB, 152.36 GB, 154.25 GB ThreadUsage(16s000ms): 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.03 - BloomFilterBytes: 49.00 MB (51380224) - PeakMemoryUsage: 160.60 GB (172439443519) - PerHostPeakMemUsage: 169.57 GB (182069270988) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 2m30s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 3.02K (3016) - TotalThreadsTotalWallClockTime: 23s016ms - TotalThreadsSysTime: 2s311ms - TotalThreadsUserTime: 8s556ms - TotalThreadsVoluntaryContextSwitches: 19.72K (19719) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 109.015ms - ExecTreePrepareTime: 709.303us DataStreamSender (dst_id=28):(Total: 858.126us, non-child: 858.126us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.05 MB (1105280) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 681.925ms, non-child: 681.925ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 234.369ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 122 (122) - NumInstructions: 8.95K (8951) - OptimizationTime: 423.852ms - PeakMemoryUsage: 4.37 MB (4582912) - PrepareTime: 23.272ms HASH_JOIN_NODE (id=15):(Total: 1.347ms, non-child: 868.081us, % non-child: 64.44%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 451.92K (451915) - BuildTime: 125.058ms - PeakMemoryUsage: 153.09 MB (160524544) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=15): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 85.842ms - BuildRowsPartitioned: 451.92K (451915) - GetNewBlockTime: 391.069us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 36.278ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160449664) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=26):(Total: 1s958ms, non-child: 26.970ms, % non-child: 1.38%) BytesReceived(16s000ms): 5.35 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB - BytesReceived: 6.21 MB (6513198) - ConvertRowBatchTime: 11.884ms - DeserializeRowBatchTimer: 55.823ms - FirstBatchArrivalWaitTime: 1s083ms - PeakMemoryUsage: 0 - RowsReturned: 451.92K (451915) - RowsReturnedRate: 230.71 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=14):(Total: 1.048ms, non-child: 906.518us, % non-child: 86.45%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 458.29K (458285) - BuildTime: 183.590ms - PeakMemoryUsage: 25.08 MB (26298624) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 89.010ms - BuildRowsPartitioned: 458.29K (458285) - GetNewBlockTime: 303.594us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 50.145ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 25.02 MB (26231936) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 4s057ms, non-child: 24.591ms, % non-child: 0.61%) BytesReceived(16s000ms): 5.78 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB - BytesReceived: 7.32 MB (7677041) - ConvertRowBatchTime: 11.644ms - DeserializeRowBatchTimer: 76.804ms - FirstBatchArrivalWaitTime: 1s984ms - PeakMemoryUsage: 0 - RowsReturned: 458.29K (458285) - RowsReturnedRate: 112.94 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=13):(Total: 714.484us, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 3.94B (3936905114) - BuildTime: 5m42s - PeakMemoryUsage: 157.60 GB (169217329408) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled, Spilled Runtime filters: 0 of 1 Runtime Filter Published, 1 Disabled - BuildRowsPartitionTime: 5m42s - BuildRowsPartitioned: 3.94B (3936905114) - GetNewBlockTime: 30s355ms - HashBuckets: 1.07B (1073741824) - HashCollisions: 0 (0) - HashTablesBuildTime: 1m19s - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 157.60 GB (169217270912) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 5 (5) - UnpinTime: 253.465ms HASH_JOIN_NODE (id=12):(Total: 3m37s, non-child: 1m13s, % non-child: 33.75%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 40.11M (40112293) - BuildTime: 9s608ms - PeakMemoryUsage: 3.02 GB (3240189272) - ProbeRows: 74.61M (74611028) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1m3s - RowsReturned: 3.94B (3936905114) - RowsReturnedRate: 18.07 M/sec Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 5s656ms - BuildRowsPartitioned: 40.11M (40112293) - GetNewBlockTime: 5.567ms - HashBuckets: 67.11M (67108864) - HashCollisions: 0 (0) - HashTablesBuildTime: 3s907ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 3.02 GB (3240125568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 6s965ms, non-child: 2s637ms, % non-child: 37.86%) BytesReceived(16s000ms): 207.65 MB, 379.89 MB, 379.89 MB, 379.89 MB, 379.89 MB, 379.89 MB, 379.89 MB, 379.89 MB, 379.89 MB, 379.89 MB, 379.89 MB, 379.89 MB, 379.89 MB, 379.89 MB, 379.89 MB, 379.89 MB, 379.89 MB, 379.89 MB, 379.89 MB, 379.89 MB, 379.89 MB, 379.89 MB, 379.89 MB, 379.89 MB, 379.89 MB, 379.89 MB, 379.89 MB, 379.89 MB, 379.89 MB, 379.89 MB, 379.89 MB, 379.89 MB, 379.89 MB, 379.89 MB, 379.89 MB, 379.89 MB, 379.89 MB, 379.89 MB, 379.89 MB, 379.89 MB - BytesReceived: 379.89 MB (398339720) - ConvertRowBatchTime: 987.389ms - DeserializeRowBatchTimer: 2s557ms - FirstBatchArrivalWaitTime: 1s007ms - PeakMemoryUsage: 0 - RowsReturned: 40.11M (40112293) - RowsReturnedRate: 5.76 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=22):(Total: 2m18s, non-child: 1s550ms, % non-child: 1.12%) BytesReceived(16s000ms): 2.04 MB, 15.00 MB, 41.26 MB, 66.85 MB, 93.24 MB, 119.73 MB, 146.50 MB, 173.18 MB, 198.38 MB, 223.41 MB, 247.90 MB, 273.22 MB, 299.48 MB, 325.48 MB, 349.38 MB, 377.90 MB, 403.48 MB, 430.34 MB, 452.98 MB, 478.27 MB, 500.57 MB, 517.55 MB, 536.18 MB, 558.20 MB, 575.97 MB, 588.29 MB, 607.92 MB, 623.98 MB, 637.06 MB, 641.64 MB, 650.35 MB, 663.17 MB, 668.34 MB, 677.23 MB, 685.71 MB, 690.67 MB, 690.67 MB, 690.67 MB, 690.67 MB, 690.67 MB - BytesReceived: 690.67 MB (724221073) - ConvertRowBatchTime: 859.103ms - DeserializeRowBatchTimer: 13s060ms - FirstBatchArrivalWaitTime: 664.200ms - PeakMemoryUsage: 0 - RowsReturned: 74.61M (74611028) - RowsReturnedRate: 540.60 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=24):(Total: 1s624ms, non-child: 3.624us, % non-child: 0.00%) BytesReceived(16s000ms): 8.58 MB, 10.49 MB, 10.49 MB, 10.49 MB, 10.49 MB, 10.49 MB, 10.49 MB, 10.49 MB, 10.49 MB, 10.49 MB, 10.49 MB, 10.49 MB, 10.49 MB, 10.49 MB, 10.49 MB, 10.49 MB, 10.49 MB, 10.49 MB, 10.49 MB, 10.49 MB, 10.49 MB, 10.49 MB, 10.49 MB, 10.49 MB, 10.49 MB, 10.49 MB, 10.49 MB, 10.49 MB, 10.49 MB, 10.49 MB, 10.49 MB, 10.49 MB, 10.49 MB, 10.49 MB, 10.49 MB, 10.49 MB, 10.49 MB, 10.54 MB, 10.80 MB, 10.81 MB - BytesReceived: 10.98 MB (11513571) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 72.182ms - FirstBatchArrivalWaitTime: 1s624ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:312 (host=vd1331.foo:22000):(Total: 91.897ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 1017.46 MB, 6.98 GB, 14.32 GB, 21.01 GB, 27.90 GB, 34.78 GB, 41.69 GB, 48.54 GB, 55.01 GB, 61.85 GB, 68.31 GB, 74.89 GB, 81.72 GB, 88.37 GB, 94.56 GB, 101.57 GB, 108.16 GB, 115.15 GB, 121.09 GB, 127.55 GB, 133.70 GB, 137.99 GB, 142.85 GB, 148.59 GB, 153.32 GB, 156.61 GB, 153.65 GB, 154.56 GB, 157.88 GB, 158.12 GB, 158.69 GB, 152.62 GB, 153.91 GB, 154.70 GB, 157.99 GB, 159.00 GB, 153.20 GB, 153.77 GB, 153.96 GB, 155.16 GB ThreadUsage(16s000ms): 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.03 - BloomFilterBytes: 49.00 MB (51380224) - PeakMemoryUsage: 160.64 GB (172486261847) - PerHostPeakMemUsage: 169.56 GB (182068619987) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 1m40s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 1.40K (1397) - TotalThreadsTotalWallClockTime: 21s801ms - TotalThreadsSysTime: 2s194ms - TotalThreadsUserTime: 8s186ms - TotalThreadsVoluntaryContextSwitches: 23.73K (23728) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 90.078ms - ExecTreePrepareTime: 8.864ms DataStreamSender (dst_id=28):(Total: 928.066us, non-child: 928.066us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.05 MB (1105280) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 662.645ms, non-child: 662.645ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 201.032ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 122 (122) - NumInstructions: 8.95K (8951) - OptimizationTime: 431.592ms - PeakMemoryUsage: 4.37 MB (4582912) - PrepareTime: 29.434ms HASH_JOIN_NODE (id=15):(Total: 17.632ms, non-child: 2.080ms, % non-child: 11.80%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 451.92K (451915) - BuildTime: 157.041ms - PeakMemoryUsage: 153.09 MB (160524544) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=15): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 110.074ms - BuildRowsPartitioned: 451.92K (451915) - GetNewBlockTime: 378.879us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 44.052ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160449664) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=26):(Total: 1s980ms, non-child: 28.400ms, % non-child: 1.43%) BytesReceived(16s000ms): 5.43 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB - BytesReceived: 6.21 MB (6513198) - ConvertRowBatchTime: 12.757ms - DeserializeRowBatchTimer: 55.004ms - FirstBatchArrivalWaitTime: 1s125ms - PeakMemoryUsage: 0 - RowsReturned: 451.92K (451915) - RowsReturnedRate: 228.23 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=14):(Total: 16.195ms, non-child: 5.450ms, % non-child: 33.65%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 458.69K (458692) - BuildTime: 175.321ms - PeakMemoryUsage: 25.08 MB (26298624) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 100.228ms - BuildRowsPartitioned: 458.69K (458692) - GetNewBlockTime: 242.715us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 27.042ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 25.02 MB (26231936) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 4s030ms, non-child: 16.264ms, % non-child: 0.40%) BytesReceived(16s000ms): 5.85 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB - BytesReceived: 7.33 MB (7682942) - ConvertRowBatchTime: 12.091ms - DeserializeRowBatchTimer: 16.278ms - FirstBatchArrivalWaitTime: 2s039ms - PeakMemoryUsage: 0 - RowsReturned: 458.69K (458692) - RowsReturnedRate: 113.80 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=13):(Total: 11.400ms, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 4.04B (4035858373) - BuildTime: 6m52s - PeakMemoryUsage: 157.86 GB (169501952256) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled, Spilled Runtime filters: 0 of 1 Runtime Filter Published, 1 Disabled - BuildRowsPartitionTime: 6m52s - BuildRowsPartitioned: 4.04B (4035858373) - GetNewBlockTime: 1m24s - HashBuckets: 536.87M (536870912) - HashCollisions: 0 (0) - HashTablesBuildTime: 34s837ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 157.86 GB (169501893760) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 4 (4) - UnpinTime: 106.654ms HASH_JOIN_NODE (id=12):(Total: 2m49s, non-child: 1m15s, % non-child: 44.50%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 40.09M (40091012) - BuildTime: 8s500ms - PeakMemoryUsage: 3.02 GB (3240192224) - ProbeRows: 76.82M (76815956) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1m6s - RowsReturned: 4.04B (4035858373) - RowsReturnedRate: 23.85 M/sec Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 5s437ms - BuildRowsPartitioned: 40.09M (40091012) - GetNewBlockTime: 2.666ms - HashBuckets: 67.11M (67108864) - HashCollisions: 0 (0) - HashTablesBuildTime: 3s014ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 3.02 GB (3240125568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 6s873ms, non-child: 1s686ms, % non-child: 24.54%) BytesReceived(16s000ms): 213.50 MB, 379.68 MB, 379.68 MB, 379.68 MB, 379.68 MB, 379.68 MB, 379.68 MB, 379.68 MB, 379.68 MB, 379.68 MB, 379.68 MB, 379.68 MB, 379.68 MB, 379.68 MB, 379.68 MB, 379.68 MB, 379.68 MB, 379.68 MB, 379.68 MB, 379.68 MB, 379.68 MB, 379.68 MB, 379.68 MB, 379.68 MB, 379.68 MB, 379.68 MB, 379.68 MB, 379.68 MB, 379.68 MB, 379.68 MB, 379.68 MB, 379.68 MB, 379.68 MB, 379.68 MB, 379.68 MB, 379.68 MB, 379.68 MB, 379.68 MB, 379.68 MB, 379.68 MB - BytesReceived: 379.68 MB (398125801) - ConvertRowBatchTime: 986.167ms - DeserializeRowBatchTimer: 1s741ms - FirstBatchArrivalWaitTime: 1s046ms - PeakMemoryUsage: 0 - RowsReturned: 40.09M (40091012) - RowsReturnedRate: 5.83 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=22):(Total: 1m27s, non-child: 1s408ms, % non-child: 1.61%) BytesReceived(16s000ms): 2.21 MB, 15.97 MB, 43.19 MB, 69.56 MB, 96.74 MB, 123.87 MB, 151.23 MB, 178.58 MB, 205.41 MB, 231.67 MB, 256.78 MB, 282.79 MB, 309.86 MB, 336.62 MB, 361.32 MB, 389.00 MB, 415.03 MB, 442.87 MB, 466.15 MB, 492.06 MB, 515.15 MB, 532.63 MB, 551.90 MB, 574.45 MB, 592.74 MB, 605.46 MB, 625.68 MB, 642.06 MB, 655.91 MB, 660.54 MB, 669.20 MB, 682.75 MB, 688.25 MB, 697.96 MB, 707.96 MB, 711.43 MB, 711.43 MB, 711.43 MB, 711.43 MB, 711.43 MB - BytesReceived: 711.43 MB (745987098) - ConvertRowBatchTime: 884.695ms - DeserializeRowBatchTimer: 6s358ms - FirstBatchArrivalWaitTime: 702.977ms - PeakMemoryUsage: 0 - RowsReturned: 76.82M (76815956) - RowsReturnedRate: 875.27 K/sec - SendersBlockedTimer: 24s685ms - SendersBlockedTotalTimer(*): 44m14s EXCHANGE_NODE (id=24):(Total: 1s656ms, non-child: 4.619us, % non-child: 0.00%) BytesReceived(16s000ms): 8.94 MB, 10.60 MB, 10.60 MB, 10.60 MB, 10.60 MB, 10.60 MB, 10.60 MB, 10.60 MB, 10.60 MB, 10.60 MB, 10.60 MB, 10.60 MB, 10.60 MB, 10.60 MB, 10.60 MB, 10.60 MB, 10.60 MB, 10.60 MB, 10.60 MB, 10.60 MB, 10.60 MB, 10.60 MB, 10.60 MB, 10.60 MB, 10.60 MB, 10.60 MB, 10.60 MB, 10.60 MB, 10.60 MB, 10.60 MB, 10.60 MB, 10.60 MB, 10.60 MB, 10.60 MB, 10.60 MB, 10.60 MB, 10.60 MB, 10.66 MB, 10.76 MB, 10.77 MB - BytesReceived: 11.19 MB (11728354) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 73.862ms - FirstBatchArrivalWaitTime: 1s656ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:33f (host=vd1336.foo:22000):(Total: 73.774ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 971.24 MB, 7.17 GB, 14.22 GB, 20.91 GB, 27.78 GB, 34.64 GB, 41.58 GB, 48.53 GB, 55.08 GB, 61.60 GB, 67.89 GB, 74.43 GB, 81.25 GB, 87.88 GB, 94.47 GB, 101.44 GB, 107.86 GB, 114.84 GB, 120.86 GB, 127.43 GB, 133.27 GB, 137.51 GB, 142.33 GB, 148.06 GB, 152.80 GB, 156.01 GB, 156.27 GB, 154.30 GB, 157.64 GB, 158.15 GB, 156.59 GB, 152.11 GB, 152.86 GB, 156.00 GB, 157.38 GB, 156.00 GB, 152.52 GB, 153.16 GB, 154.16 GB, 154.17 GB ThreadUsage(16s000ms): 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.03 - BloomFilterBytes: 49.00 MB (51380224) - PeakMemoryUsage: 160.99 GB (172856539247) - PerHostPeakMemUsage: 169.57 GB (182074005218) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 2m6s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 1.35K (1352) - TotalThreadsTotalWallClockTime: 21s698ms - TotalThreadsSysTime: 2s231ms - TotalThreadsUserTime: 7s795ms - TotalThreadsVoluntaryContextSwitches: 24.02K (24020) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 73.705ms - ExecTreePrepareTime: 1.019ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 23.86K (23864) - BlocksRecycled: 354 (354) - BufferedPins: 0 (0) - BytesWritten: 40.30 GB (43268440064) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 161.38 GB (173283483648) - ScratchFileUsedBytes: 40.30 GB (43268440064) - TotalBufferWaitTime: 3s637ms - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=28):(Total: 1.338ms, non-child: 1.338ms, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.05 MB (1105280) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 660.229ms, non-child: 660.229ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 205.528ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 122 (122) - NumInstructions: 8.95K (8951) - OptimizationTime: 420.537ms - PeakMemoryUsage: 4.37 MB (4582912) - PrepareTime: 33.509ms HASH_JOIN_NODE (id=15):(Total: 1.906ms, non-child: 1.021ms, % non-child: 53.60%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 451.92K (451915) - BuildTime: 130.661ms - PeakMemoryUsage: 153.09 MB (160524544) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=15): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 93.657ms - BuildRowsPartitioned: 451.92K (451915) - GetNewBlockTime: 366.480us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 33.906ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160449664) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=26):(Total: 2s013ms, non-child: 27.581ms, % non-child: 1.37%) BytesReceived(16s000ms): 5.37 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB - BytesReceived: 6.21 MB (6513198) - ConvertRowBatchTime: 12.276ms - DeserializeRowBatchTimer: 56.010ms - FirstBatchArrivalWaitTime: 1s149ms - PeakMemoryUsage: 0 - RowsReturned: 451.92K (451915) - RowsReturnedRate: 224.42 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=14):(Total: 1.470ms, non-child: 1.013ms, % non-child: 68.92%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 458.95K (458947) - BuildTime: 157.111ms - PeakMemoryUsage: 25.08 MB (26298624) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 97.082ms - BuildRowsPartitioned: 458.95K (458947) - GetNewBlockTime: 80.960us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 27.221ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 25.02 MB (26231936) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 4s099ms, non-child: 14.997ms, % non-child: 0.37%) BytesReceived(16s000ms): 5.80 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB - BytesReceived: 7.33 MB (7687351) - ConvertRowBatchTime: 10.655ms - DeserializeRowBatchTimer: 17.994ms - FirstBatchArrivalWaitTime: 2s059ms - PeakMemoryUsage: 0 - RowsReturned: 458.95K (458947) - RowsReturnedRate: 111.95 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=13):(Total: 1.010ms, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 4.02B (4018490477) - BuildTime: 6m27s - PeakMemoryUsage: 157.70 GB (169333590240) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled, Spilled Runtime filters: 0 of 1 Runtime Filter Published, 1 Disabled - BuildRowsPartitionTime: 6m27s - BuildRowsPartitioned: 4.02B (4018490477) - GetNewBlockTime: 1m5s - HashBuckets: 536.87M (536870912) - HashCollisions: 0 (0) - HashTablesBuildTime: 30s889ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 157.70 GB (169333499008) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 4 (4) - UnpinTime: 164.672ms HASH_JOIN_NODE (id=12):(Total: 3m8s, non-child: 1m8s, % non-child: 36.27%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 40.13M (40132258) - BuildTime: 8s173ms - PeakMemoryUsage: 3.02 GB (3240188128) - ProbeRows: 75.71M (75713841) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 59s285ms - RowsReturned: 4.02B (4018490477) - RowsReturnedRate: 21.37 M/sec Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 5s398ms - BuildRowsPartitioned: 40.13M (40132258) - GetNewBlockTime: 2.952ms - HashBuckets: 67.11M (67108864) - HashCollisions: 0 (0) - HashTablesBuildTime: 2s726ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 3.02 GB (3240125568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 7s032ms, non-child: 1s725ms, % non-child: 24.54%) BytesReceived(16s000ms): 208.31 MB, 380.06 MB, 380.06 MB, 380.06 MB, 380.06 MB, 380.06 MB, 380.06 MB, 380.06 MB, 380.06 MB, 380.06 MB, 380.06 MB, 380.06 MB, 380.06 MB, 380.06 MB, 380.06 MB, 380.06 MB, 380.06 MB, 380.06 MB, 380.06 MB, 380.06 MB, 380.06 MB, 380.06 MB, 380.06 MB, 380.06 MB, 380.06 MB, 380.06 MB, 380.06 MB, 380.06 MB, 380.06 MB, 380.06 MB, 380.06 MB, 380.06 MB, 380.06 MB, 380.06 MB, 380.06 MB, 380.06 MB, 380.06 MB, 380.06 MB, 380.06 MB, 380.06 MB - BytesReceived: 380.06 MB (398522832) - ConvertRowBatchTime: 989.967ms - DeserializeRowBatchTimer: 1s782ms - FirstBatchArrivalWaitTime: 1s071ms - PeakMemoryUsage: 0 - RowsReturned: 40.13M (40132258) - RowsReturnedRate: 5.71 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=22):(Total: 1m53s, non-child: 1s401ms, % non-child: 1.23%) BytesReceived(16s000ms): 2.11 MB, 15.45 MB, 42.39 MB, 68.52 MB, 95.37 MB, 122.18 MB, 149.25 MB, 176.41 MB, 202.04 MB, 227.48 MB, 252.30 MB, 277.88 MB, 304.43 MB, 332.04 MB, 356.72 MB, 383.74 MB, 409.13 MB, 436.33 MB, 459.35 MB, 484.92 MB, 507.49 MB, 524.60 MB, 543.58 MB, 565.93 MB, 584.15 MB, 596.77 MB, 616.95 MB, 633.21 MB, 646.92 MB, 651.49 MB, 660.18 MB, 673.21 MB, 679.26 MB, 689.39 MB, 697.60 MB, 701.03 MB, 701.03 MB, 701.03 MB, 701.03 MB, 701.03 MB - BytesReceived: 701.03 MB (735079773) - ConvertRowBatchTime: 876.540ms - DeserializeRowBatchTimer: 7s626ms - FirstBatchArrivalWaitTime: 732.879ms - PeakMemoryUsage: 0 - RowsReturned: 75.71M (75713841) - RowsReturnedRate: 666.91 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=24):(Total: 1s663ms, non-child: 3.587us, % non-child: 0.00%) BytesReceived(16s000ms): 8.35 MB, 10.19 MB, 10.19 MB, 10.19 MB, 10.19 MB, 10.19 MB, 10.19 MB, 10.19 MB, 10.19 MB, 10.19 MB, 10.19 MB, 10.19 MB, 10.19 MB, 10.19 MB, 10.19 MB, 10.19 MB, 10.19 MB, 10.19 MB, 10.19 MB, 10.19 MB, 10.19 MB, 10.19 MB, 10.19 MB, 10.19 MB, 10.19 MB, 10.19 MB, 10.19 MB, 10.19 MB, 10.19 MB, 10.19 MB, 10.19 MB, 10.19 MB, 10.19 MB, 10.19 MB, 10.19 MB, 10.19 MB, 10.19 MB, 10.25 MB, 10.31 MB, 10.32 MB - BytesReceived: 10.37 MB (10877051) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 75.755ms - FirstBatchArrivalWaitTime: 1s663ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:300 (host=ve1140.foo:22000):(Total: 68.953ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 1.03 GB, 7.08 GB, 14.21 GB, 20.81 GB, 27.62 GB, 34.47 GB, 41.38 GB, 48.30 GB, 54.74 GB, 61.22 GB, 67.51 GB, 73.97 GB, 80.85 GB, 87.34 GB, 94.11 GB, 101.05 GB, 107.47 GB, 114.37 GB, 120.18 GB, 126.81 GB, 132.72 GB, 137.06 GB, 141.76 GB, 147.50 GB, 152.13 GB, 155.24 GB, 156.12 GB, 153.23 GB, 156.46 GB, 156.80 GB, 157.75 GB, 150.87 GB, 151.75 GB, 153.63 GB, 155.24 GB, 156.80 GB, 149.77 GB, 150.38 GB, 153.04 GB, 152.43 GB ThreadUsage(16s000ms): 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.03 - BloomFilterBytes: 49.00 MB (51380224) - PeakMemoryUsage: 160.60 GB (172445251183) - PerHostPeakMemUsage: 169.57 GB (182072110511) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 1m51s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 1.79K (1794) - TotalThreadsTotalWallClockTime: 21s843ms - TotalThreadsSysTime: 2s277ms - TotalThreadsUserTime: 8s199ms - TotalThreadsVoluntaryContextSwitches: 20.91K (20907) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 68.891ms - ExecTreePrepareTime: 960.004us DataStreamSender (dst_id=28):(Total: 1.146ms, non-child: 1.146ms, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.05 MB (1105280) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 621.340ms, non-child: 621.340ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 195.612ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 122 (122) - NumInstructions: 8.95K (8951) - OptimizationTime: 400.211ms - PeakMemoryUsage: 4.37 MB (4582912) - PrepareTime: 25.062ms HASH_JOIN_NODE (id=15):(Total: 1.813ms, non-child: 1.072ms, % non-child: 59.16%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 451.92K (451915) - BuildTime: 136.964ms - PeakMemoryUsage: 153.09 MB (160524544) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=15): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 102.696ms - BuildRowsPartitioned: 451.92K (451915) - GetNewBlockTime: 595.107us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 31.920ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160449664) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=26):(Total: 2s069ms, non-child: 28.365ms, % non-child: 1.37%) BytesReceived(16s000ms): 5.49 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB - BytesReceived: 6.21 MB (6513198) - ConvertRowBatchTime: 12.704ms - DeserializeRowBatchTimer: 54.818ms - FirstBatchArrivalWaitTime: 1s203ms - PeakMemoryUsage: 0 - RowsReturned: 451.92K (451915) - RowsReturnedRate: 218.37 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=14):(Total: 1.409ms, non-child: 1.082ms, % non-child: 76.77%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 458.96K (458965) - BuildTime: 159.197ms - PeakMemoryUsage: 25.08 MB (26298624) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 97.465ms - BuildRowsPartitioned: 458.96K (458965) - GetNewBlockTime: 217.995us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 24.978ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 25.02 MB (26231936) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 4s098ms, non-child: 14.964ms, % non-child: 0.37%) BytesReceived(16s000ms): 5.99 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB - BytesReceived: 7.33 MB (7687770) - ConvertRowBatchTime: 11.260ms - DeserializeRowBatchTimer: 16.044ms - FirstBatchArrivalWaitTime: 2s107ms - PeakMemoryUsage: 0 - RowsReturned: 458.96K (458965) - RowsReturnedRate: 111.97 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=13):(Total: 877.761us, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 4.00B (3997194018) - BuildTime: 6m41s - PeakMemoryUsage: 157.31 GB (168914159840) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled, Spilled Runtime filters: 0 of 1 Runtime Filter Published, 1 Disabled - BuildRowsPartitionTime: 6m40s - BuildRowsPartitioned: 4.00B (3997194018) - GetNewBlockTime: 1m9s - HashBuckets: 536.87M (536870912) - HashCollisions: 0 (0) - HashTablesBuildTime: 48s650ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 157.31 GB (168914068608) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 4 (4) - UnpinTime: 176.914ms HASH_JOIN_NODE (id=12):(Total: 2m54s, non-child: 1m10s, % non-child: 40.22%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 40.18M (40183969) - BuildTime: 8s691ms - PeakMemoryUsage: 3.02 GB (3240188696) - ProbeRows: 75.65M (75654312) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1m - RowsReturned: 4.00B (3997194018) - RowsReturnedRate: 22.86 M/sec Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 5s765ms - BuildRowsPartitioned: 40.18M (40183969) - GetNewBlockTime: 3.777ms - HashBuckets: 67.11M (67108864) - HashCollisions: 0 (0) - HashTablesBuildTime: 2s877ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 3.02 GB (3240125568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 6s575ms, non-child: 1s555ms, % non-child: 23.66%) BytesReceived(16s000ms): 217.46 MB, 380.56 MB, 380.56 MB, 380.56 MB, 380.56 MB, 380.56 MB, 380.56 MB, 380.56 MB, 380.56 MB, 380.56 MB, 380.56 MB, 380.56 MB, 380.56 MB, 380.56 MB, 380.56 MB, 380.56 MB, 380.56 MB, 380.56 MB, 380.56 MB, 380.56 MB, 380.56 MB, 380.56 MB, 380.56 MB, 380.56 MB, 380.56 MB, 380.56 MB, 380.56 MB, 380.56 MB, 380.56 MB, 380.56 MB, 380.56 MB, 380.56 MB, 380.56 MB, 380.56 MB, 380.56 MB, 380.56 MB, 380.56 MB, 380.56 MB, 380.56 MB, 380.56 MB - BytesReceived: 380.56 MB (399048289) - ConvertRowBatchTime: 951.679ms - DeserializeRowBatchTimer: 1s564ms - FirstBatchArrivalWaitTime: 1s124ms - PeakMemoryUsage: 0 - RowsReturned: 40.18M (40183969) - RowsReturnedRate: 6.11 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=22):(Total: 1m38s, non-child: 2s870ms, % non-child: 2.91%) BytesReceived(16s000ms): 2.07 MB, 15.80 MB, 42.43 MB, 68.24 MB, 95.00 MB, 121.88 MB, 149.13 MB, 176.29 MB, 201.93 MB, 227.35 MB, 252.33 MB, 278.04 MB, 304.68 MB, 332.60 MB, 357.21 MB, 384.42 MB, 409.72 MB, 436.78 MB, 459.58 MB, 485.57 MB, 507.75 MB, 525.16 MB, 544.07 MB, 566.47 MB, 584.16 MB, 596.56 MB, 616.79 MB, 632.72 MB, 645.79 MB, 650.47 MB, 659.46 MB, 672.52 MB, 677.71 MB, 686.86 MB, 695.48 MB, 700.27 MB, 700.28 MB, 700.28 MB, 700.28 MB, 700.28 MB - BytesReceived: 700.28 MB (734292662) - ConvertRowBatchTime: 821.823ms - DeserializeRowBatchTimer: 8s694ms - FirstBatchArrivalWaitTime: 795.452ms - PeakMemoryUsage: 0 - RowsReturned: 75.65M (75654312) - RowsReturnedRate: 766.01 K/sec - SendersBlockedTimer: 2s218ms - SendersBlockedTotalTimer(*): 4s347ms EXCHANGE_NODE (id=24):(Total: 1s742ms, non-child: 3.868us, % non-child: 0.00%) BytesReceived(16s000ms): 8.66 MB, 10.25 MB, 10.25 MB, 10.25 MB, 10.25 MB, 10.25 MB, 10.25 MB, 10.25 MB, 10.25 MB, 10.25 MB, 10.25 MB, 10.25 MB, 10.25 MB, 10.25 MB, 10.25 MB, 10.25 MB, 10.25 MB, 10.25 MB, 10.25 MB, 10.25 MB, 10.25 MB, 10.25 MB, 10.25 MB, 10.25 MB, 10.25 MB, 10.25 MB, 10.25 MB, 10.25 MB, 10.25 MB, 10.25 MB, 10.25 MB, 10.25 MB, 10.25 MB, 10.25 MB, 10.25 MB, 10.25 MB, 10.25 MB, 10.27 MB, 10.34 MB, 10.36 MB - BytesReceived: 10.50 MB (11009900) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 71.218ms - FirstBatchArrivalWaitTime: 1s742ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:2e7 (host=vd1136.foo:22000):(Total: 67.771ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 984.07 MB, 6.73 GB, 13.72 GB, 20.36 GB, 27.05 GB, 33.78 GB, 40.54 GB, 47.31 GB, 53.63 GB, 60.00 GB, 66.20 GB, 72.46 GB, 79.19 GB, 85.64 GB, 91.85 GB, 98.38 GB, 104.86 GB, 111.58 GB, 117.46 GB, 123.75 GB, 129.98 GB, 134.17 GB, 138.91 GB, 144.57 GB, 149.31 GB, 152.56 GB, 157.24 GB, 152.89 GB, 154.32 GB, 155.37 GB, 157.49 GB, 154.84 GB, 150.52 GB, 152.81 GB, 154.22 GB, 150.75 GB, 152.33 GB, 147.80 GB, 151.87 GB, 152.74 GB ThreadUsage(16s000ms): 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.03 - BloomFilterBytes: 49.00 MB (51380224) - PeakMemoryUsage: 160.59 GB (172437210031) - PerHostPeakMemUsage: 169.56 GB (182067266632) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 2m3s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 1.35K (1346) - TotalThreadsTotalWallClockTime: 21s550ms - TotalThreadsSysTime: 2s351ms - TotalThreadsUserTime: 7s934ms - TotalThreadsVoluntaryContextSwitches: 22.72K (22723) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 67.517ms - ExecTreePrepareTime: 1.306ms DataStreamSender (dst_id=28):(Total: 1.340ms, non-child: 1.340ms, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.05 MB (1105280) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 658.161ms, non-child: 658.161ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 199.889ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 122 (122) - NumInstructions: 8.95K (8951) - OptimizationTime: 430.540ms - PeakMemoryUsage: 4.37 MB (4582912) - PrepareTime: 27.187ms HASH_JOIN_NODE (id=15):(Total: 2.499ms, non-child: 1.156ms, % non-child: 46.29%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 451.92K (451915) - BuildTime: 151.500ms - PeakMemoryUsage: 153.09 MB (160524544) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=15): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 113.051ms - BuildRowsPartitioned: 451.92K (451915) - GetNewBlockTime: 464.621us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 34.981ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160449664) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=26):(Total: 2s021ms, non-child: 27.411ms, % non-child: 1.36%) BytesReceived(16s000ms): 5.35 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB - BytesReceived: 6.21 MB (6513198) - ConvertRowBatchTime: 13.274ms - DeserializeRowBatchTimer: 54.502ms - FirstBatchArrivalWaitTime: 1s171ms - PeakMemoryUsage: 0 - RowsReturned: 451.92K (451915) - RowsReturnedRate: 223.57 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=14):(Total: 1.956ms, non-child: 1.030ms, % non-child: 52.68%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 459.32K (459324) - BuildTime: 157.465ms - PeakMemoryUsage: 25.08 MB (26298624) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 100.177ms - BuildRowsPartitioned: 459.32K (459324) - GetNewBlockTime: 284.753us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 22.999ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 25.02 MB (26231936) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 4s052ms, non-child: 16.231ms, % non-child: 0.40%) BytesReceived(16s000ms): 5.82 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB - BytesReceived: 7.34 MB (7694031) - ConvertRowBatchTime: 11.503ms - DeserializeRowBatchTimer: 20.113ms - FirstBatchArrivalWaitTime: 2s085ms - PeakMemoryUsage: 0 - RowsReturned: 459.32K (459324) - RowsReturnedRate: 113.34 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=13):(Total: 1.494ms, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 3.94B (3937650306) - BuildTime: 6m11s - PeakMemoryUsage: 157.31 GB (168914159840) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled, Spilled Runtime filters: 0 of 1 Runtime Filter Published, 1 Disabled - BuildRowsPartitionTime: 6m10s - BuildRowsPartitioned: 3.94B (3937650306) - GetNewBlockTime: 31s686ms - HashBuckets: 536.87M (536870912) - HashCollisions: 0 (0) - HashTablesBuildTime: 27s268ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 157.31 GB (168914068608) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 4 (4) - UnpinTime: 305.522ms HASH_JOIN_NODE (id=12):(Total: 3m16s, non-child: 1m18s, % non-child: 40.12%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 40.15M (40146868) - BuildTime: 8s315ms - PeakMemoryUsage: 3.02 GB (3240188916) - ProbeRows: 74.18M (74178098) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1m9s - RowsReturned: 3.94B (3937650306) - RowsReturnedRate: 20.08 M/sec Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 5s543ms - BuildRowsPartitioned: 40.15M (40146868) - GetNewBlockTime: 2.340ms - HashBuckets: 67.11M (67108864) - HashCollisions: 0 (0) - HashTablesBuildTime: 2s724ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 3.02 GB (3240125568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 6s737ms, non-child: 1s887ms, % non-child: 28.01%) BytesReceived(16s000ms): 207.81 MB, 380.21 MB, 380.21 MB, 380.21 MB, 380.21 MB, 380.21 MB, 380.21 MB, 380.21 MB, 380.21 MB, 380.21 MB, 380.21 MB, 380.21 MB, 380.21 MB, 380.21 MB, 380.21 MB, 380.21 MB, 380.21 MB, 380.21 MB, 380.21 MB, 380.21 MB, 380.21 MB, 380.21 MB, 380.21 MB, 380.21 MB, 380.21 MB, 380.21 MB, 380.21 MB, 380.21 MB, 380.21 MB, 380.21 MB, 380.21 MB, 380.21 MB, 380.21 MB, 380.21 MB, 380.21 MB, 380.21 MB, 380.21 MB, 380.21 MB, 380.21 MB, 380.21 MB - BytesReceived: 380.21 MB (398676253) - ConvertRowBatchTime: 996.325ms - DeserializeRowBatchTimer: 1s901ms - FirstBatchArrivalWaitTime: 1s098ms - PeakMemoryUsage: 0 - RowsReturned: 40.15M (40146868) - RowsReturnedRate: 5.96 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=22):(Total: 1m51s, non-child: 1s260ms, % non-child: 1.13%) BytesReceived(16s000ms): 2.05 MB, 14.88 MB, 41.00 MB, 66.34 MB, 92.56 MB, 118.83 MB, 145.40 MB, 171.95 MB, 196.99 MB, 221.83 MB, 246.16 MB, 271.15 MB, 297.28 MB, 323.06 MB, 346.81 MB, 373.12 MB, 398.07 MB, 424.67 MB, 447.50 MB, 471.95 MB, 495.22 MB, 511.85 MB, 530.49 MB, 552.70 MB, 570.74 MB, 583.06 MB, 602.13 MB, 618.37 MB, 632.53 MB, 636.94 MB, 645.34 MB, 658.15 MB, 664.71 MB, 674.20 MB, 682.63 MB, 686.66 MB, 686.66 MB, 686.66 MB, 686.66 MB, 686.66 MB - BytesReceived: 686.66 MB (720013289) - ConvertRowBatchTime: 834.589ms - DeserializeRowBatchTimer: 6s519ms - FirstBatchArrivalWaitTime: 759.348ms - PeakMemoryUsage: 0 - RowsReturned: 74.18M (74178098) - RowsReturnedRate: 665.51 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=24):(Total: 1s701ms, non-child: 5.585us, % non-child: 0.00%) BytesReceived(16s000ms): 7.93 MB, 9.70 MB, 9.70 MB, 9.70 MB, 9.70 MB, 9.70 MB, 9.70 MB, 9.70 MB, 9.70 MB, 9.70 MB, 9.70 MB, 9.70 MB, 9.70 MB, 9.70 MB, 9.70 MB, 9.70 MB, 9.70 MB, 9.70 MB, 9.70 MB, 9.70 MB, 9.70 MB, 9.70 MB, 9.70 MB, 9.70 MB, 9.70 MB, 9.70 MB, 9.70 MB, 9.70 MB, 9.70 MB, 9.70 MB, 9.70 MB, 9.70 MB, 9.70 MB, 9.70 MB, 9.70 MB, 9.70 MB, 9.70 MB, 9.70 MB, 9.70 MB, 9.70 MB - BytesReceived: 9.70 MB (10167056) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 88.313ms - FirstBatchArrivalWaitTime: 1s701ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:314 (host=vd1337.foo:22000):(Total: 67.363ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 999.65 MB, 7.14 GB, 14.44 GB, 21.24 GB, 28.28 GB, 35.32 GB, 42.40 GB, 49.48 GB, 56.14 GB, 62.80 GB, 69.28 GB, 75.95 GB, 83.02 GB, 89.76 GB, 96.07 GB, 103.05 GB, 109.79 GB, 116.84 GB, 123.02 GB, 129.52 GB, 136.00 GB, 140.34 GB, 145.23 GB, 151.09 GB, 155.99 GB, 158.05 GB, 153.84 GB, 157.95 GB, 159.47 GB, 151.40 GB, 153.55 GB, 155.12 GB, 158.05 GB, 158.69 GB, 153.71 GB, 154.66 GB, 157.30 GB, 159.35 GB, 148.95 GB, 154.84 GB ThreadUsage(16s000ms): 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.03 - BloomFilterBytes: 49.00 MB (51380224) - PeakMemoryUsage: 160.62 GB (172465307913) - PerHostPeakMemUsage: 169.56 GB (182064161916) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 1m57s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 2.02K (2017) - TotalThreadsTotalWallClockTime: 21s659ms - TotalThreadsSysTime: 2s062ms - TotalThreadsUserTime: 7s921ms - TotalThreadsVoluntaryContextSwitches: 22.77K (22774) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 67.245ms - ExecTreePrepareTime: 1.188ms DataStreamSender (dst_id=28):(Total: 666.202us, non-child: 666.202us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.05 MB (1105280) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 693.311ms, non-child: 693.311ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 199.093ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 122 (122) - NumInstructions: 8.95K (8951) - OptimizationTime: 466.456ms - PeakMemoryUsage: 4.37 MB (4582912) - PrepareTime: 27.253ms HASH_JOIN_NODE (id=15):(Total: 2.173ms, non-child: 1.217ms, % non-child: 56.04%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 451.92K (451915) - BuildTime: 122.068ms - PeakMemoryUsage: 153.09 MB (160524544) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=15): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 93.528ms - BuildRowsPartitioned: 451.92K (451915) - GetNewBlockTime: 333.693us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 25.953ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160449664) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=26):(Total: 2s003ms, non-child: 25.747ms, % non-child: 1.29%) BytesReceived(16s000ms): 5.38 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB - BytesReceived: 6.21 MB (6513198) - ConvertRowBatchTime: 12.128ms - DeserializeRowBatchTimer: 51.294ms - FirstBatchArrivalWaitTime: 1s128ms - PeakMemoryUsage: 0 - RowsReturned: 451.92K (451915) - RowsReturnedRate: 225.54 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=14):(Total: 1.525ms, non-child: 1.102ms, % non-child: 72.28%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 457.58K (457581) - BuildTime: 156.463ms - PeakMemoryUsage: 25.08 MB (26298624) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 105.038ms - BuildRowsPartitioned: 457.58K (457581) - GetNewBlockTime: 160.279us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 23.836ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 25.02 MB (26231936) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 4s040ms, non-child: 15.285ms, % non-child: 0.38%) BytesReceived(16s000ms): 5.80 MB, 7.31 MB, 7.31 MB, 7.31 MB, 7.31 MB, 7.31 MB, 7.31 MB, 7.31 MB, 7.31 MB, 7.31 MB, 7.31 MB, 7.31 MB, 7.31 MB, 7.31 MB, 7.31 MB, 7.31 MB, 7.31 MB, 7.31 MB, 7.31 MB, 7.31 MB, 7.31 MB, 7.31 MB, 7.31 MB, 7.31 MB, 7.31 MB, 7.31 MB, 7.31 MB, 7.31 MB, 7.31 MB, 7.31 MB, 7.31 MB, 7.31 MB, 7.31 MB, 7.31 MB, 7.31 MB, 7.31 MB, 7.31 MB, 7.31 MB, 7.31 MB, 7.31 MB - BytesReceived: 7.31 MB (7664361) - ConvertRowBatchTime: 11.715ms - DeserializeRowBatchTimer: 14.526ms - FirstBatchArrivalWaitTime: 2s040ms - PeakMemoryUsage: 0 - RowsReturned: 457.58K (457581) - RowsReturnedRate: 113.26 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=13):(Total: 958.742us, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 4.11B (4114964292) - BuildTime: 6m16s - PeakMemoryUsage: 160.16 GB (171968203008) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled, Spilled Runtime filters: 0 of 1 Runtime Filter Published, 1 Disabled - BuildRowsPartitionTime: 6m16s - BuildRowsPartitioned: 4.11B (4114964292) - GetNewBlockTime: 48s556ms - HashBuckets: 536.87M (536870912) - HashCollisions: 0 (0) - HashTablesBuildTime: 1m5s - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 160.16 GB (171968144512) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 4 (4) - UnpinTime: 279.620ms HASH_JOIN_NODE (id=12):(Total: 3m4s, non-child: 1m13s, % non-child: 40.03%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 40.12M (40115945) - BuildTime: 8s343ms - PeakMemoryUsage: 3.02 GB (3240189488) - ProbeRows: 77.59M (77587258) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1m4s - RowsReturned: 4.11B (4114964292) - RowsReturnedRate: 22.27 M/sec Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 5s406ms - BuildRowsPartitioned: 40.12M (40115945) - GetNewBlockTime: 2.937ms - HashBuckets: 67.11M (67108864) - HashCollisions: 0 (0) - HashTablesBuildTime: 2s899ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 3.02 GB (3240125568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 6s911ms, non-child: 1s381ms, % non-child: 19.99%) BytesReceived(16s000ms): 211.02 MB, 379.93 MB, 379.93 MB, 379.93 MB, 379.93 MB, 379.93 MB, 379.93 MB, 379.93 MB, 379.93 MB, 379.93 MB, 379.93 MB, 379.93 MB, 379.93 MB, 379.93 MB, 379.93 MB, 379.93 MB, 379.93 MB, 379.93 MB, 379.93 MB, 379.93 MB, 379.93 MB, 379.93 MB, 379.93 MB, 379.93 MB, 379.93 MB, 379.93 MB, 379.93 MB, 379.93 MB, 379.93 MB, 379.93 MB, 379.93 MB, 379.93 MB, 379.93 MB, 379.93 MB, 379.93 MB, 379.93 MB, 379.93 MB, 379.93 MB, 379.93 MB, 379.93 MB - BytesReceived: 379.93 MB (398381844) - ConvertRowBatchTime: 914.481ms - DeserializeRowBatchTimer: 1s328ms - FirstBatchArrivalWaitTime: 1s051ms - PeakMemoryUsage: 0 - RowsReturned: 40.12M (40115945) - RowsReturnedRate: 5.80 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=22):(Total: 1m44s, non-child: 1s632ms, % non-child: 1.56%) BytesReceived(16s000ms): 2.15 MB, 15.83 MB, 43.16 MB, 69.65 MB, 97.16 MB, 124.62 MB, 152.37 MB, 180.15 MB, 206.44 MB, 232.55 MB, 258.07 MB, 284.46 MB, 311.81 MB, 338.63 MB, 363.35 MB, 390.98 MB, 417.13 MB, 445.02 MB, 468.97 MB, 494.77 MB, 519.04 MB, 536.40 MB, 555.64 MB, 578.69 MB, 597.39 MB, 610.28 MB, 630.38 MB, 647.31 MB, 661.93 MB, 666.70 MB, 677.51 MB, 690.73 MB, 695.83 MB, 705.83 MB, 714.53 MB, 718.57 MB, 718.57 MB, 718.57 MB, 718.57 MB, 718.57 MB - BytesReceived: 718.57 MB (753476171) - ConvertRowBatchTime: 862.728ms - DeserializeRowBatchTimer: 6s809ms - FirstBatchArrivalWaitTime: 711.916ms - PeakMemoryUsage: 0 - RowsReturned: 77.59M (77587258) - RowsReturnedRate: 741.62 K/sec - SendersBlockedTimer: 19s972ms - SendersBlockedTotalTimer(*): 36m58s EXCHANGE_NODE (id=24):(Total: 1s653ms, non-child: 3.993us, % non-child: 0.00%) BytesReceived(16s000ms): 8.69 MB, 10.48 MB, 10.48 MB, 10.48 MB, 10.48 MB, 10.48 MB, 10.48 MB, 10.48 MB, 10.48 MB, 10.48 MB, 10.48 MB, 10.48 MB, 10.48 MB, 10.48 MB, 10.48 MB, 10.48 MB, 10.48 MB, 10.48 MB, 10.48 MB, 10.48 MB, 10.48 MB, 10.48 MB, 10.48 MB, 10.48 MB, 10.48 MB, 10.48 MB, 10.48 MB, 10.48 MB, 10.48 MB, 10.48 MB, 10.48 MB, 10.48 MB, 10.48 MB, 10.48 MB, 10.48 MB, 10.48 MB, 10.48 MB, 10.50 MB, 10.54 MB, 10.54 MB - BytesReceived: 10.89 MB (11419953) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 68.360ms - FirstBatchArrivalWaitTime: 1s653ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:2f9 (host=vc1523.foo:22000):(Total: 67.080ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 1.00 GB, 7.32 GB, 14.27 GB, 20.97 GB, 27.88 GB, 34.78 GB, 41.77 GB, 48.75 GB, 55.28 GB, 61.87 GB, 68.20 GB, 74.76 GB, 81.66 GB, 88.18 GB, 94.49 GB, 101.36 GB, 107.96 GB, 114.92 GB, 121.07 GB, 127.38 GB, 133.60 GB, 137.79 GB, 142.58 GB, 148.59 GB, 153.77 GB, 157.09 GB, 152.94 GB, 155.08 GB, 158.19 GB, 158.63 GB, 150.03 GB, 152.38 GB, 153.98 GB, 155.92 GB, 157.42 GB, 152.44 GB, 153.58 GB, 156.37 GB, 154.43 GB, 158.10 GB ThreadUsage(16s000ms): 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.03 - BloomFilterBytes: 49.00 MB (51380224) - PeakMemoryUsage: 160.60 GB (172443526591) - PerHostPeakMemUsage: 169.56 GB (182059761730) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 2m24s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 1.59K (1589) - TotalThreadsTotalWallClockTime: 21s482ms - TotalThreadsSysTime: 2s148ms - TotalThreadsUserTime: 8s094ms - TotalThreadsVoluntaryContextSwitches: 20.88K (20883) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 67.003ms - ExecTreePrepareTime: 692.767us DataStreamSender (dst_id=28):(Total: 1.284ms, non-child: 1.284ms, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.05 MB (1105280) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 661.703ms, non-child: 661.703ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 199.955ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 122 (122) - NumInstructions: 8.95K (8951) - OptimizationTime: 431.539ms - PeakMemoryUsage: 4.37 MB (4582912) - PrepareTime: 29.622ms HASH_JOIN_NODE (id=15):(Total: 1.298ms, non-child: 935.968us, % non-child: 72.11%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 451.92K (451915) - BuildTime: 132.762ms - PeakMemoryUsage: 153.09 MB (160524544) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=15): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 101.433ms - BuildRowsPartitioned: 451.92K (451915) - GetNewBlockTime: 417.460us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 28.579ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160449664) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=26):(Total: 2s022ms, non-child: 24.545ms, % non-child: 1.21%) BytesReceived(16s000ms): 5.39 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB - BytesReceived: 6.21 MB (6513198) - ConvertRowBatchTime: 12.155ms - DeserializeRowBatchTimer: 51.698ms - FirstBatchArrivalWaitTime: 1s172ms - PeakMemoryUsage: 0 - RowsReturned: 451.92K (451915) - RowsReturnedRate: 223.46 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=14):(Total: 1.019ms, non-child: 903.381us, % non-child: 88.63%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 459.96K (459960) - BuildTime: 135.315ms - PeakMemoryUsage: 25.08 MB (26298624) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 84.005ms - BuildRowsPartitioned: 459.96K (459960) - GetNewBlockTime: 227.423us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 21.129ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 25.02 MB (26231936) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 4s082ms, non-child: 15.646ms, % non-child: 0.38%) BytesReceived(16s000ms): 5.84 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB - BytesReceived: 7.35 MB (7703635) - ConvertRowBatchTime: 11.695ms - DeserializeRowBatchTimer: 16.286ms - FirstBatchArrivalWaitTime: 2s080ms - PeakMemoryUsage: 0 - RowsReturned: 459.96K (459960) - RowsReturnedRate: 112.67 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=13):(Total: 741.717us, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 4.04B (4035316643) - BuildTime: 5m52s - PeakMemoryUsage: 157.99 GB (169636169984) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled, Spilled Runtime filters: 0 of 1 Runtime Filter Published, 1 Disabled - BuildRowsPartitionTime: 5m52s - BuildRowsPartitioned: 4.04B (4035316643) - GetNewBlockTime: 36s609ms - HashBuckets: 536.87M (536870912) - HashCollisions: 0 (0) - HashTablesBuildTime: 49s778ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 157.99 GB (169636111488) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 4 (4) - UnpinTime: 285.153ms HASH_JOIN_NODE (id=12):(Total: 3m30s, non-child: 1m12s, % non-child: 34.25%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 40.28M (40276769) - BuildTime: 8s466ms - PeakMemoryUsage: 3.02 GB (3240188128) - ProbeRows: 75.80M (75797107) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1m2s - RowsReturned: 4.04B (4035316643) - RowsReturnedRate: 19.17 M/sec Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 5s768ms - BuildRowsPartitioned: 40.28M (40276769) - GetNewBlockTime: 5.263ms - HashBuckets: 67.11M (67108864) - HashCollisions: 0 (0) - HashTablesBuildTime: 2s650ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 3.02 GB (3240125568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 6s538ms, non-child: 1s564ms, % non-child: 23.94%) BytesReceived(16s000ms): 213.44 MB, 381.45 MB, 381.45 MB, 381.45 MB, 381.45 MB, 381.45 MB, 381.45 MB, 381.45 MB, 381.45 MB, 381.45 MB, 381.45 MB, 381.45 MB, 381.45 MB, 381.45 MB, 381.45 MB, 381.45 MB, 381.45 MB, 381.45 MB, 381.45 MB, 381.45 MB, 381.45 MB, 381.45 MB, 381.45 MB, 381.45 MB, 381.45 MB, 381.45 MB, 381.45 MB, 381.45 MB, 381.45 MB, 381.45 MB, 381.45 MB, 381.45 MB, 381.45 MB, 381.45 MB, 381.45 MB, 381.45 MB, 381.45 MB, 381.45 MB, 381.45 MB, 381.45 MB - BytesReceived: 381.45 MB (399974180) - ConvertRowBatchTime: 958.634ms - DeserializeRowBatchTimer: 1s557ms - FirstBatchArrivalWaitTime: 1s103ms - PeakMemoryUsage: 0 - RowsReturned: 40.28M (40276769) - RowsReturnedRate: 6.16 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=22):(Total: 2m12s, non-child: 1s268ms, % non-child: 0.96%) BytesReceived(16s000ms): 2.18 MB, 15.69 MB, 42.54 MB, 68.65 MB, 95.54 MB, 122.41 MB, 149.64 MB, 176.93 MB, 202.51 MB, 228.16 MB, 253.01 MB, 278.71 MB, 305.44 MB, 331.58 MB, 355.92 MB, 382.90 MB, 408.58 MB, 436.00 MB, 459.26 MB, 484.27 MB, 507.72 MB, 524.57 MB, 543.23 MB, 568.34 MB, 586.59 MB, 599.18 MB, 619.79 MB, 635.86 MB, 648.17 MB, 652.93 MB, 662.20 MB, 674.97 MB, 679.84 MB, 689.34 MB, 697.80 MB, 701.99 MB, 701.99 MB, 701.99 MB, 701.99 MB, 701.99 MB - BytesReceived: 701.99 MB (736092548) - ConvertRowBatchTime: 826.447ms - DeserializeRowBatchTimer: 9s057ms - FirstBatchArrivalWaitTime: 762.187ms - PeakMemoryUsage: 0 - RowsReturned: 75.80M (75797107) - RowsReturnedRate: 571.52 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=24):(Total: 1s687ms, non-child: 4.798us, % non-child: 0.00%) BytesReceived(16s000ms): 8.91 MB, 10.64 MB, 10.64 MB, 10.64 MB, 10.64 MB, 10.64 MB, 10.64 MB, 10.64 MB, 10.64 MB, 10.64 MB, 10.64 MB, 10.64 MB, 10.64 MB, 10.64 MB, 10.64 MB, 10.64 MB, 10.64 MB, 10.64 MB, 10.64 MB, 10.64 MB, 10.64 MB, 10.64 MB, 10.64 MB, 10.64 MB, 10.64 MB, 10.64 MB, 10.64 MB, 10.64 MB, 10.64 MB, 10.64 MB, 10.64 MB, 10.64 MB, 10.64 MB, 10.64 MB, 10.64 MB, 10.64 MB, 10.64 MB, 10.65 MB, 10.66 MB, 10.69 MB - BytesReceived: 11.07 MB (11608360) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 69.710ms - FirstBatchArrivalWaitTime: 1s687ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:2f2 (host=va1041.foo:22000):(Total: 66.821ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 1.02 GB, 7.23 GB, 14.12 GB, 20.69 GB, 27.45 GB, 34.21 GB, 41.05 GB, 47.92 GB, 54.40 GB, 60.88 GB, 67.15 GB, 73.61 GB, 80.48 GB, 86.81 GB, 93.18 GB, 99.93 GB, 106.48 GB, 113.09 GB, 119.45 GB, 125.59 GB, 131.80 GB, 136.12 GB, 140.76 GB, 146.79 GB, 151.79 GB, 155.05 GB, 155.95 GB, 152.97 GB, 156.11 GB, 156.96 GB, 158.79 GB, 150.87 GB, 151.86 GB, 154.03 GB, 155.51 GB, 151.47 GB, 152.96 GB, 151.50 GB, 153.51 GB, 153.87 GB ThreadUsage(16s000ms): 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.03 - BloomFilterBytes: 49.00 MB (51380224) - PeakMemoryUsage: 160.60 GB (172446588289) - PerHostPeakMemUsage: 169.56 GB (182068847826) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 2m2s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 1.70K (1704) - TotalThreadsTotalWallClockTime: 21s760ms - TotalThreadsSysTime: 2s209ms - TotalThreadsUserTime: 8s010ms - TotalThreadsVoluntaryContextSwitches: 22.22K (22216) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 66.780ms - ExecTreePrepareTime: 1.107ms DataStreamSender (dst_id=28):(Total: 1.010ms, non-child: 1.010ms, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.05 MB (1105280) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 647.994ms, non-child: 647.994ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 199.090ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 122 (122) - NumInstructions: 8.95K (8951) - OptimizationTime: 420.954ms - PeakMemoryUsage: 4.37 MB (4582912) - PrepareTime: 27.459ms HASH_JOIN_NODE (id=15):(Total: 2.145ms, non-child: 1.378ms, % non-child: 64.26%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 451.92K (451915) - BuildTime: 137.728ms - PeakMemoryUsage: 153.09 MB (160524544) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=15): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 103.403ms - BuildRowsPartitioned: 451.92K (451915) - GetNewBlockTime: 442.368us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 31.364ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160449664) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=26):(Total: 2s034ms, non-child: 25.504ms, % non-child: 1.25%) BytesReceived(16s000ms): 5.45 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB - BytesReceived: 6.21 MB (6513198) - ConvertRowBatchTime: 12.073ms - DeserializeRowBatchTimer: 48.807ms - FirstBatchArrivalWaitTime: 1s184ms - PeakMemoryUsage: 0 - RowsReturned: 451.92K (451915) - RowsReturnedRate: 222.11 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=14):(Total: 1.531ms, non-child: 1.181ms, % non-child: 77.15%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 460.56K (460559) - BuildTime: 152.444ms - PeakMemoryUsage: 25.08 MB (26298624) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 89.728ms - BuildRowsPartitioned: 460.56K (460559) - GetNewBlockTime: 179.300us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 25.247ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 25.02 MB (26231936) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 4s083ms, non-child: 15.720ms, % non-child: 0.38%) BytesReceived(16s000ms): 5.98 MB, 7.36 MB, 7.36 MB, 7.36 MB, 7.36 MB, 7.36 MB, 7.36 MB, 7.36 MB, 7.36 MB, 7.36 MB, 7.36 MB, 7.36 MB, 7.36 MB, 7.36 MB, 7.36 MB, 7.36 MB, 7.36 MB, 7.36 MB, 7.36 MB, 7.36 MB, 7.36 MB, 7.36 MB, 7.36 MB, 7.36 MB, 7.36 MB, 7.36 MB, 7.36 MB, 7.36 MB, 7.36 MB, 7.36 MB, 7.36 MB, 7.36 MB, 7.36 MB, 7.36 MB, 7.36 MB, 7.36 MB, 7.36 MB, 7.36 MB, 7.36 MB, 7.36 MB - BytesReceived: 7.36 MB (7714748) - ConvertRowBatchTime: 11.444ms - DeserializeRowBatchTimer: 14.991ms - FirstBatchArrivalWaitTime: 2s097ms - PeakMemoryUsage: 0 - RowsReturned: 460.56K (460559) - RowsReturnedRate: 112.79 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=13):(Total: 1.007ms, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 3.98B (3984881048) - BuildTime: 6m12s - PeakMemoryUsage: 157.31 GB (168914159840) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled, Spilled Runtime filters: 0 of 1 Runtime Filter Published, 1 Disabled - BuildRowsPartitionTime: 6m12s - BuildRowsPartitioned: 3.98B (3984881048) - GetNewBlockTime: 35s965ms - HashBuckets: 536.87M (536870912) - HashCollisions: 0 (0) - HashTablesBuildTime: 25s913ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 157.31 GB (168914068608) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 4 (4) - UnpinTime: 96.028ms HASH_JOIN_NODE (id=12):(Total: 3m12s, non-child: 1m16s, % non-child: 39.57%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 40.25M (40254455) - BuildTime: 8s481ms - PeakMemoryUsage: 3.02 GB (3240189158) - ProbeRows: 75.40M (75395861) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1m6s - RowsReturned: 3.98B (3984881048) - RowsReturnedRate: 20.72 M/sec Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 5s547ms - BuildRowsPartitioned: 40.25M (40254455) - GetNewBlockTime: 6.367ms - HashBuckets: 67.11M (67108864) - HashCollisions: 0 (0) - HashTablesBuildTime: 2s886ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 3.02 GB (3240125568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 6s786ms, non-child: 1s464ms, % non-child: 21.58%) BytesReceived(16s000ms): 216.40 MB, 381.22 MB, 381.22 MB, 381.22 MB, 381.22 MB, 381.22 MB, 381.22 MB, 381.22 MB, 381.22 MB, 381.22 MB, 381.22 MB, 381.22 MB, 381.22 MB, 381.22 MB, 381.22 MB, 381.22 MB, 381.22 MB, 381.22 MB, 381.22 MB, 381.22 MB, 381.22 MB, 381.22 MB, 381.22 MB, 381.22 MB, 381.22 MB, 381.22 MB, 381.22 MB, 381.22 MB, 381.22 MB, 381.22 MB, 381.22 MB, 381.22 MB, 381.22 MB, 381.22 MB, 381.22 MB, 381.22 MB, 381.22 MB, 381.22 MB, 381.22 MB, 381.22 MB - BytesReceived: 381.22 MB (399740611) - ConvertRowBatchTime: 965.456ms - DeserializeRowBatchTimer: 1s412ms - FirstBatchArrivalWaitTime: 1s108ms - PeakMemoryUsage: 0 - RowsReturned: 40.25M (40254455) - RowsReturnedRate: 5.93 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=22):(Total: 1m50s, non-child: 1s399ms, % non-child: 1.27%) BytesReceived(16s000ms): 2.20 MB, 15.73 MB, 42.20 MB, 67.90 MB, 94.41 MB, 120.99 MB, 147.93 MB, 174.94 MB, 200.50 MB, 225.80 MB, 250.69 MB, 276.27 MB, 302.88 MB, 328.93 MB, 353.12 MB, 380.00 MB, 405.63 MB, 432.90 MB, 455.99 MB, 480.88 MB, 504.15 MB, 521.12 MB, 539.74 MB, 565.34 MB, 582.68 MB, 595.26 MB, 615.48 MB, 631.38 MB, 643.78 MB, 648.56 MB, 657.67 MB, 670.52 MB, 675.49 MB, 684.98 MB, 693.68 MB, 698.04 MB, 698.04 MB, 698.04 MB, 698.04 MB, 698.04 MB - BytesReceived: 698.04 MB (731950435) - ConvertRowBatchTime: 891.518ms - DeserializeRowBatchTimer: 5s224ms - FirstBatchArrivalWaitTime: 778.959ms - PeakMemoryUsage: 0 - RowsReturned: 75.40M (75395861) - RowsReturnedRate: 684.12 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=24):(Total: 1s706ms, non-child: 2.937us, % non-child: 0.00%) BytesReceived(16s000ms): 8.49 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.08 MB, 10.12 MB, 10.12 MB - BytesReceived: 10.12 MB (10613383) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 69.677ms - FirstBatchArrivalWaitTime: 1s706ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:2f4 (host=vd1119.foo:22000):(Total: 66.500ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 1.02 GB, 7.17 GB, 14.20 GB, 20.75 GB, 27.53 GB, 34.32 GB, 41.18 GB, 48.24 GB, 54.94 GB, 61.48 GB, 67.80 GB, 74.29 GB, 81.07 GB, 87.71 GB, 93.86 GB, 100.74 GB, 107.20 GB, 113.93 GB, 119.98 GB, 126.34 GB, 132.43 GB, 136.68 GB, 141.56 GB, 147.25 GB, 151.95 GB, 155.28 GB, 156.58 GB, 153.85 GB, 157.19 GB, 158.12 GB, 156.30 GB, 152.23 GB, 153.21 GB, 155.42 GB, 157.12 GB, 153.66 GB, 154.67 GB, 154.24 GB, 155.52 GB, 156.20 GB ThreadUsage(16s000ms): 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.03 - BloomFilterBytes: 49.00 MB (51380224) - PeakMemoryUsage: 160.60 GB (172445335999) - PerHostPeakMemUsage: 169.57 GB (182073242429) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 2m13s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 1.60K (1604) - TotalThreadsTotalWallClockTime: 21s890ms - TotalThreadsSysTime: 2s363ms - TotalThreadsUserTime: 8s216ms - TotalThreadsVoluntaryContextSwitches: 21.25K (21248) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 66.450ms - ExecTreePrepareTime: 965.621us DataStreamSender (dst_id=28):(Total: 904.537us, non-child: 904.537us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.05 MB (1105280) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 632.416ms, non-child: 632.416ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 197.088ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 122 (122) - NumInstructions: 8.95K (8951) - OptimizationTime: 410.073ms - PeakMemoryUsage: 4.37 MB (4582912) - PrepareTime: 24.830ms HASH_JOIN_NODE (id=15):(Total: 1.863ms, non-child: 987.966us, % non-child: 53.02%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 451.92K (451915) - BuildTime: 126.284ms - PeakMemoryUsage: 153.09 MB (160524544) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=15): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 95.618ms - BuildRowsPartitioned: 451.92K (451915) - GetNewBlockTime: 403.162us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 28.426ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160449664) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=26):(Total: 2s058ms, non-child: 25.639ms, % non-child: 1.25%) BytesReceived(16s000ms): 5.47 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB - BytesReceived: 6.21 MB (6513198) - ConvertRowBatchTime: 12.298ms - DeserializeRowBatchTimer: 53.093ms - FirstBatchArrivalWaitTime: 1s198ms - PeakMemoryUsage: 0 - RowsReturned: 451.92K (451915) - RowsReturnedRate: 219.56 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=14):(Total: 1.398ms, non-child: 1.087ms, % non-child: 77.75%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 458.44K (458445) - BuildTime: 155.162ms - PeakMemoryUsage: 25.08 MB (26298624) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 93.679ms - BuildRowsPartitioned: 458.44K (458445) - GetNewBlockTime: 178.089us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 25.897ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 25.02 MB (26231936) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 4s095ms, non-child: 16.031ms, % non-child: 0.39%) BytesReceived(16s000ms): 5.96 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB - BytesReceived: 7.32 MB (7680797) - ConvertRowBatchTime: 11.939ms - DeserializeRowBatchTimer: 17.080ms - FirstBatchArrivalWaitTime: 2s115ms - PeakMemoryUsage: 0 - RowsReturned: 458.44K (458445) - RowsReturnedRate: 111.95 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=13):(Total: 895.233us, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 4.00B (3997880949) - BuildTime: 6m - PeakMemoryUsage: 159.03 GB (170752444672) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled, Spilled Runtime filters: 0 of 1 Runtime Filter Published, 1 Disabled - BuildRowsPartitionTime: 6m - BuildRowsPartitioned: 4.00B (3997880949) - GetNewBlockTime: 43s047ms - HashBuckets: 536.87M (536870912) - HashCollisions: 0 (0) - HashTablesBuildTime: 22s994ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 159.03 GB (170752386176) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 4 (4) - UnpinTime: 165.786ms HASH_JOIN_NODE (id=12):(Total: 3m23s, non-child: 1m16s, % non-child: 37.78%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 40.12M (40122309) - BuildTime: 8s759ms - PeakMemoryUsage: 3.02 GB (3240192224) - ProbeRows: 75.44M (75441856) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1m7s - RowsReturned: 4.00B (3997880949) - RowsReturnedRate: 19.66 M/sec Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 5s730ms - BuildRowsPartitioned: 40.12M (40122309) - GetNewBlockTime: 3.191ms - HashBuckets: 67.11M (67108864) - HashCollisions: 0 (0) - HashTablesBuildTime: 2s974ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 3.02 GB (3240125568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 6s593ms, non-child: 1s627ms, % non-child: 24.69%) BytesReceived(16s000ms): 216.58 MB, 379.97 MB, 379.97 MB, 379.97 MB, 379.97 MB, 379.97 MB, 379.97 MB, 379.97 MB, 379.97 MB, 379.97 MB, 379.97 MB, 379.97 MB, 379.97 MB, 379.97 MB, 379.97 MB, 379.97 MB, 379.97 MB, 379.97 MB, 379.97 MB, 379.97 MB, 379.97 MB, 379.97 MB, 379.97 MB, 379.97 MB, 379.97 MB, 379.97 MB, 379.97 MB, 379.97 MB, 379.97 MB, 379.97 MB, 379.97 MB, 379.97 MB, 379.97 MB, 379.97 MB, 379.97 MB, 379.97 MB, 379.97 MB, 379.97 MB, 379.97 MB, 379.97 MB - BytesReceived: 379.97 MB (398430122) - ConvertRowBatchTime: 980.602ms - DeserializeRowBatchTimer: 1s603ms - FirstBatchArrivalWaitTime: 1s124ms - PeakMemoryUsage: 0 - RowsReturned: 40.12M (40122309) - RowsReturnedRate: 6.08 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=22):(Total: 2m, non-child: 2s439ms, % non-child: 2.02%) BytesReceived(16s000ms): 2.16 MB, 15.77 MB, 42.34 MB, 67.98 MB, 94.50 MB, 121.09 MB, 148.51 MB, 176.68 MB, 202.24 MB, 227.75 MB, 252.70 MB, 278.46 MB, 305.10 MB, 331.16 MB, 355.15 MB, 382.16 MB, 407.59 MB, 434.76 MB, 457.53 MB, 482.93 MB, 505.44 MB, 522.61 MB, 541.58 MB, 563.93 MB, 582.16 MB, 594.74 MB, 614.76 MB, 630.90 MB, 644.57 MB, 649.14 MB, 657.82 MB, 670.80 MB, 676.07 MB, 684.92 MB, 693.62 MB, 698.72 MB, 698.72 MB, 698.72 MB, 698.72 MB, 698.72 MB - BytesReceived: 698.72 MB (732661880) - ConvertRowBatchTime: 921.569ms - DeserializeRowBatchTimer: 7s514ms - FirstBatchArrivalWaitTime: 791.671ms - PeakMemoryUsage: 0 - RowsReturned: 75.44M (75441856) - RowsReturnedRate: 624.95 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=24):(Total: 1s739ms, non-child: 4.301us, % non-child: 0.00%) BytesReceived(16s000ms): 8.74 MB, 10.36 MB, 10.36 MB, 10.36 MB, 10.36 MB, 10.36 MB, 10.36 MB, 10.36 MB, 10.36 MB, 10.36 MB, 10.36 MB, 10.36 MB, 10.36 MB, 10.36 MB, 10.36 MB, 10.36 MB, 10.36 MB, 10.36 MB, 10.36 MB, 10.36 MB, 10.36 MB, 10.36 MB, 10.36 MB, 10.36 MB, 10.36 MB, 10.36 MB, 10.36 MB, 10.36 MB, 10.36 MB, 10.36 MB, 10.36 MB, 10.36 MB, 10.36 MB, 10.36 MB, 10.36 MB, 10.36 MB, 10.36 MB, 10.39 MB, 10.47 MB, 10.48 MB - BytesReceived: 10.71 MB (11228912) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 71.300ms - FirstBatchArrivalWaitTime: 1s739ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:2f7 (host=vc1537.foo:22000):(Total: 66.457ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 1.02 GB, 7.25 GB, 14.30 GB, 20.93 GB, 27.84 GB, 34.78 GB, 41.76 GB, 48.72 GB, 55.25 GB, 61.83 GB, 68.19 GB, 74.77 GB, 81.71 GB, 88.21 GB, 94.57 GB, 101.50 GB, 108.13 GB, 115.11 GB, 121.32 GB, 127.62 GB, 133.94 GB, 138.87 GB, 143.78 GB, 149.51 GB, 154.11 GB, 157.45 GB, 153.46 GB, 155.61 GB, 158.82 GB, 158.95 GB, 150.89 GB, 152.77 GB, 154.97 GB, 157.03 GB, 158.88 GB, 155.16 GB, 154.93 GB, 155.72 GB, 156.76 GB, 156.79 GB ThreadUsage(16s000ms): 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.03 - BloomFilterBytes: 49.00 MB (51380224) - PeakMemoryUsage: 160.99 GB (172862589455) - PerHostPeakMemUsage: 169.57 GB (182071107149) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 2m28s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 1.48K (1484) - TotalThreadsTotalWallClockTime: 21s762ms - TotalThreadsSysTime: 2s087ms - TotalThreadsUserTime: 7s903ms - TotalThreadsVoluntaryContextSwitches: 24.55K (24549) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 66.370ms - ExecTreePrepareTime: 1.052ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 24.17K (24172) - BlocksRecycled: 354 (354) - BufferedPins: 0 (0) - BytesWritten: 42.71 GB (45860519936) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 161.38 GB (173283483648) - ScratchFileUsedBytes: 42.71 GB (45860519936) - TotalBufferWaitTime: 8s041ms - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=28):(Total: 1.104ms, non-child: 1.104ms, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.05 MB (1105280) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 630.641ms, non-child: 630.641ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 196.598ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 122 (122) - NumInstructions: 8.95K (8951) - OptimizationTime: 404.273ms - PeakMemoryUsage: 4.37 MB (4582912) - PrepareTime: 29.237ms HASH_JOIN_NODE (id=15):(Total: 1.987ms, non-child: 1.132ms, % non-child: 56.99%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 451.92K (451915) - BuildTime: 140.476ms - PeakMemoryUsage: 153.09 MB (160524544) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=15): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 104.603ms - BuildRowsPartitioned: 451.92K (451915) - GetNewBlockTime: 407.771us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 33.019ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160449664) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=26):(Total: 2s051ms, non-child: 27.560ms, % non-child: 1.34%) BytesReceived(16s000ms): 5.44 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB - BytesReceived: 6.21 MB (6513198) - ConvertRowBatchTime: 12.984ms - DeserializeRowBatchTimer: 53.510ms - FirstBatchArrivalWaitTime: 1s203ms - PeakMemoryUsage: 0 - RowsReturned: 451.92K (451915) - RowsReturnedRate: 220.32 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=14):(Total: 1.589ms, non-child: 1.119ms, % non-child: 70.43%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 459.33K (459327) - BuildTime: 172.678ms - PeakMemoryUsage: 25.08 MB (26298624) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 105.890ms - BuildRowsPartitioned: 459.33K (459327) - GetNewBlockTime: 282.913us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 26.377ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 25.02 MB (26231936) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 4s088ms, non-child: 16.546ms, % non-child: 0.40%) BytesReceived(16s000ms): 5.95 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB - BytesReceived: 7.34 MB (7693368) - ConvertRowBatchTime: 11.713ms - DeserializeRowBatchTimer: 17.394ms - FirstBatchArrivalWaitTime: 2s108ms - PeakMemoryUsage: 0 - RowsReturned: 459.33K (459327) - RowsReturnedRate: 112.36 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=13):(Total: 1.216ms, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 4.05B (4048210428) - BuildTime: 5m52s - PeakMemoryUsage: 160.10 GB (171909482752) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled, Spilled Runtime filters: 0 of 1 Runtime Filter Published, 1 Disabled - BuildRowsPartitionTime: 5m51s - BuildRowsPartitioned: 4.05B (4048210428) - GetNewBlockTime: 28s721ms - HashBuckets: 536.87M (536870912) - HashCollisions: 0 (0) - HashTablesBuildTime: 23s599ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 160.10 GB (171909424256) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 4 (4) - UnpinTime: 203.234ms HASH_JOIN_NODE (id=12):(Total: 3m30s, non-child: 1m9s, % non-child: 33.01%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 40.17M (40165462) - BuildTime: 8s177ms - PeakMemoryUsage: 3.02 GB (3240189686) - ProbeRows: 75.83M (75826075) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1m - RowsReturned: 4.05B (4048210428) - RowsReturnedRate: 19.20 M/sec Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 5s312ms - BuildRowsPartitioned: 40.17M (40165462) - GetNewBlockTime: 2.681ms - HashBuckets: 67.11M (67108864) - HashCollisions: 0 (0) - HashTablesBuildTime: 2s822ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 3.02 GB (3240125568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 7s042ms, non-child: 1s595ms, % non-child: 22.65%) BytesReceived(16s000ms): 215.70 MB, 380.40 MB, 380.40 MB, 380.40 MB, 380.40 MB, 380.40 MB, 380.40 MB, 380.40 MB, 380.40 MB, 380.40 MB, 380.40 MB, 380.40 MB, 380.40 MB, 380.40 MB, 380.40 MB, 380.40 MB, 380.40 MB, 380.40 MB, 380.40 MB, 380.40 MB, 380.40 MB, 380.40 MB, 380.40 MB, 380.40 MB, 380.40 MB, 380.40 MB, 380.40 MB, 380.40 MB, 380.40 MB, 380.40 MB, 380.40 MB, 380.40 MB, 380.40 MB, 380.40 MB, 380.40 MB, 380.40 MB, 380.40 MB, 380.40 MB, 380.40 MB, 380.40 MB - BytesReceived: 380.40 MB (398882755) - ConvertRowBatchTime: 935.636ms - DeserializeRowBatchTimer: 1s645ms - FirstBatchArrivalWaitTime: 1s119ms - PeakMemoryUsage: 0 - RowsReturned: 40.17M (40165462) - RowsReturnedRate: 5.70 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=22):(Total: 2m15s, non-child: 1s223ms, % non-child: 0.91%) BytesReceived(16s000ms): 2.16 MB, 15.76 MB, 42.41 MB, 68.13 MB, 94.94 MB, 121.86 MB, 149.05 MB, 176.13 MB, 201.75 MB, 227.16 MB, 252.14 MB, 277.81 MB, 304.55 MB, 330.80 MB, 355.15 MB, 382.13 MB, 407.90 MB, 435.42 MB, 458.65 MB, 483.79 MB, 507.43 MB, 527.39 MB, 546.12 MB, 568.65 MB, 586.04 MB, 598.67 MB, 619.09 MB, 635.11 MB, 647.62 MB, 652.38 MB, 661.68 MB, 674.59 MB, 679.51 MB, 689.12 MB, 697.66 MB, 701.97 MB, 701.98 MB, 701.98 MB, 701.98 MB, 701.98 MB - BytesReceived: 701.98 MB (736075008) - ConvertRowBatchTime: 793.660ms - DeserializeRowBatchTimer: 6s809ms - FirstBatchArrivalWaitTime: 791.493ms - PeakMemoryUsage: 0 - RowsReturned: 75.83M (75826075) - RowsReturnedRate: 561.53 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=24):(Total: 1s733ms, non-child: 5.082us, % non-child: 0.00%) BytesReceived(16s000ms): 8.46 MB, 10.03 MB, 10.03 MB, 10.03 MB, 10.03 MB, 10.03 MB, 10.03 MB, 10.03 MB, 10.03 MB, 10.03 MB, 10.03 MB, 10.03 MB, 10.03 MB, 10.03 MB, 10.03 MB, 10.03 MB, 10.03 MB, 10.03 MB, 10.03 MB, 10.03 MB, 10.03 MB, 10.03 MB, 10.03 MB, 10.03 MB, 10.03 MB, 10.03 MB, 10.03 MB, 10.03 MB, 10.03 MB, 10.03 MB, 10.03 MB, 10.03 MB, 10.03 MB, 10.03 MB, 10.03 MB, 10.03 MB, 10.03 MB, 10.04 MB, 10.06 MB, 10.06 MB - BytesReceived: 10.06 MB (10544989) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 70.741ms - FirstBatchArrivalWaitTime: 1s733ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:2f0 (host=vd1103.foo:22000):(Total: 66.389ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 1.05 GB, 7.30 GB, 14.38 GB, 21.05 GB, 27.96 GB, 34.87 GB, 41.86 GB, 48.81 GB, 55.32 GB, 61.89 GB, 68.28 GB, 74.82 GB, 81.76 GB, 88.51 GB, 94.82 GB, 102.06 GB, 109.14 GB, 115.95 GB, 122.19 GB, 128.74 GB, 134.67 GB, 138.94 GB, 143.93 GB, 149.66 GB, 154.38 GB, 157.68 GB, 152.70 GB, 155.55 GB, 158.20 GB, 157.88 GB, 150.49 GB, 152.90 GB, 154.39 GB, 156.49 GB, 157.99 GB, 154.26 GB, 154.71 GB, 154.04 GB, 158.80 GB, 159.28 GB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.03 - BloomFilterBytes: 49.00 MB (51380224) - PeakMemoryUsage: 160.60 GB (172446721327) - PerHostPeakMemUsage: 169.56 GB (182068719943) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 1m58s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 1.56K (1563) - TotalThreadsTotalWallClockTime: 21s548ms - TotalThreadsSysTime: 2s289ms - TotalThreadsUserTime: 7s949ms - TotalThreadsVoluntaryContextSwitches: 21.03K (21031) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 66.319ms - ExecTreePrepareTime: 764.546us DataStreamSender (dst_id=28):(Total: 1.339ms, non-child: 1.339ms, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.05 MB (1105280) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 657.124ms, non-child: 657.124ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 203.881ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 122 (122) - NumInstructions: 8.95K (8951) - OptimizationTime: 424.700ms - PeakMemoryUsage: 4.37 MB (4582912) - PrepareTime: 28.037ms HASH_JOIN_NODE (id=15):(Total: 1.441ms, non-child: 896.697us, % non-child: 62.20%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 451.92K (451915) - BuildTime: 123.566ms - PeakMemoryUsage: 153.09 MB (160524544) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=15): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 94.311ms - BuildRowsPartitioned: 451.92K (451915) - GetNewBlockTime: 983.335us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 26.451ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160449664) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=26):(Total: 2s054ms, non-child: 23.017ms, % non-child: 1.12%) BytesReceived(16s000ms): 5.50 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB - BytesReceived: 6.21 MB (6513198) - ConvertRowBatchTime: 11.749ms - DeserializeRowBatchTimer: 48.903ms - FirstBatchArrivalWaitTime: 1s178ms - PeakMemoryUsage: 0 - RowsReturned: 451.92K (451915) - RowsReturnedRate: 219.92 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=14):(Total: 1.051ms, non-child: 821.941us, % non-child: 78.17%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 457.93K (457934) - BuildTime: 142.799ms - PeakMemoryUsage: 25.08 MB (26298624) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 85.235ms - BuildRowsPartitioned: 457.93K (457934) - GetNewBlockTime: 235.349us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 26.250ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 25.02 MB (26231936) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 4s081ms, non-child: 15.387ms, % non-child: 0.38%) BytesReceived(16s000ms): 6.00 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB - BytesReceived: 7.32 MB (7670888) - ConvertRowBatchTime: 11.929ms - DeserializeRowBatchTimer: 15.466ms - FirstBatchArrivalWaitTime: 2s094ms - PeakMemoryUsage: 0 - RowsReturned: 457.93K (457934) - RowsReturnedRate: 112.20 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=13):(Total: 721.906us, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 4.05B (4054661287) - BuildTime: 6m13s - PeakMemoryUsage: 159.78 GB (171566139648) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled, Spilled Runtime filters: 0 of 1 Runtime Filter Published, 1 Disabled - BuildRowsPartitionTime: 6m13s - BuildRowsPartitioned: 4.05B (4054661287) - GetNewBlockTime: 43s521ms - HashBuckets: 536.87M (536870912) - HashCollisions: 0 (0) - HashTablesBuildTime: 25s331ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 159.78 GB (171566081152) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 4 (4) - UnpinTime: 223.329ms HASH_JOIN_NODE (id=12):(Total: 3m9s, non-child: 1m16s, % non-child: 40.66%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 40.12M (40117042) - BuildTime: 8s462ms - PeakMemoryUsage: 3.02 GB (3240190354) - ProbeRows: 76.23M (76234699) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1m7s - RowsReturned: 4.05B (4054661287) - RowsReturnedRate: 21.41 M/sec Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 5s721ms - BuildRowsPartitioned: 40.12M (40117042) - GetNewBlockTime: 3.569ms - HashBuckets: 67.11M (67108864) - HashCollisions: 0 (0) - HashTablesBuildTime: 2s691ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 3.02 GB (3240125568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 6s574ms, non-child: 1s554ms, % non-child: 23.65%) BytesReceived(16s000ms): 217.79 MB, 379.95 MB, 379.95 MB, 379.95 MB, 379.95 MB, 379.95 MB, 379.95 MB, 379.95 MB, 379.95 MB, 379.95 MB, 379.95 MB, 379.95 MB, 379.95 MB, 379.95 MB, 379.95 MB, 379.95 MB, 379.95 MB, 379.95 MB, 379.95 MB, 379.95 MB, 379.95 MB, 379.95 MB, 379.95 MB, 379.95 MB, 379.95 MB, 379.95 MB, 379.95 MB, 379.95 MB, 379.95 MB, 379.95 MB, 379.95 MB, 379.95 MB, 379.95 MB, 379.95 MB, 379.95 MB, 379.95 MB, 379.95 MB, 379.95 MB, 379.95 MB, 379.95 MB - BytesReceived: 379.95 MB (398407412) - ConvertRowBatchTime: 949.912ms - DeserializeRowBatchTimer: 1s527ms - FirstBatchArrivalWaitTime: 1s101ms - PeakMemoryUsage: 0 - RowsReturned: 40.12M (40117042) - RowsReturnedRate: 6.10 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=22):(Total: 1m46s, non-child: 1s469ms, % non-child: 1.38%) BytesReceived(16s000ms): 2.16 MB, 16.07 MB, 42.88 MB, 68.90 MB, 95.83 MB, 122.77 MB, 149.98 MB, 177.12 MB, 202.71 MB, 228.25 MB, 253.37 MB, 279.33 MB, 306.40 MB, 332.90 MB, 358.91 MB, 388.54 MB, 414.18 MB, 441.36 MB, 464.35 MB, 490.51 MB, 512.18 MB, 529.85 MB, 548.83 MB, 571.47 MB, 589.11 MB, 601.76 MB, 622.28 MB, 638.53 MB, 651.15 MB, 655.90 MB, 665.13 MB, 678.12 MB, 683.07 MB, 692.61 MB, 701.29 MB, 705.77 MB, 705.77 MB, 705.77 MB, 705.77 MB, 705.77 MB - BytesReceived: 705.77 MB (740056444) - ConvertRowBatchTime: 921.251ms - DeserializeRowBatchTimer: 8s153ms - FirstBatchArrivalWaitTime: 767.035ms - PeakMemoryUsage: 0 - RowsReturned: 76.23M (76234699) - RowsReturnedRate: 715.44 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=24):(Total: 1s687ms, non-child: 4.225us, % non-child: 0.00%) BytesReceived(16s000ms): 8.67 MB, 10.25 MB, 10.25 MB, 10.25 MB, 10.25 MB, 10.25 MB, 10.25 MB, 10.25 MB, 10.25 MB, 10.25 MB, 10.25 MB, 10.25 MB, 10.25 MB, 10.25 MB, 10.25 MB, 10.25 MB, 10.25 MB, 10.25 MB, 10.25 MB, 10.25 MB, 10.25 MB, 10.25 MB, 10.25 MB, 10.25 MB, 10.25 MB, 10.25 MB, 10.25 MB, 10.25 MB, 10.25 MB, 10.25 MB, 10.25 MB, 10.25 MB, 10.25 MB, 10.25 MB, 10.25 MB, 10.25 MB, 10.25 MB, 10.28 MB, 10.36 MB, 10.36 MB - BytesReceived: 10.50 MB (11013837) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 68.805ms - FirstBatchArrivalWaitTime: 1s687ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:2e8 (host=vc1505.foo:22000):(Total: 65.948ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 996.36 MB, 7.19 GB, 14.08 GB, 20.65 GB, 27.45 GB, 34.24 GB, 41.11 GB, 47.97 GB, 54.40 GB, 60.85 GB, 67.09 GB, 73.53 GB, 80.33 GB, 86.66 GB, 93.03 GB, 100.10 GB, 106.98 GB, 113.78 GB, 119.75 GB, 125.98 GB, 132.00 GB, 136.36 GB, 141.03 GB, 146.68 GB, 151.36 GB, 154.71 GB, 156.07 GB, 152.28 GB, 155.47 GB, 156.43 GB, 158.69 GB, 151.25 GB, 151.24 GB, 153.47 GB, 154.68 GB, 150.63 GB, 150.71 GB, 151.34 GB, 153.17 GB ThreadUsage(16s000ms): 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.03 - BloomFilterBytes: 49.00 MB (51380224) - PeakMemoryUsage: 160.61 GB (172449173535) - PerHostPeakMemUsage: 169.56 GB (182065446297) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 2m22s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 1.35K (1350) - TotalThreadsTotalWallClockTime: 21s626ms - TotalThreadsSysTime: 2s107ms - TotalThreadsUserTime: 7s823ms - TotalThreadsVoluntaryContextSwitches: 24.09K (24085) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 65.905ms - ExecTreePrepareTime: 695.882us DataStreamSender (dst_id=28):(Total: 947.565us, non-child: 947.565us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.05 MB (1105280) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 632.329ms, non-child: 632.329ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 198.802ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 122 (122) - NumInstructions: 8.95K (8951) - OptimizationTime: 407.004ms - PeakMemoryUsage: 4.37 MB (4582912) - PrepareTime: 26.083ms HASH_JOIN_NODE (id=15):(Total: 1.337ms, non-child: 941.889us, % non-child: 70.40%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 451.92K (451915) - BuildTime: 126.783ms - PeakMemoryUsage: 153.09 MB (160524544) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=15): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 98.496ms - BuildRowsPartitioned: 451.92K (451915) - GetNewBlockTime: 338.091us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 25.344ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160449664) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=26):(Total: 2s060ms, non-child: 25.573ms, % non-child: 1.24%) BytesReceived(16s000ms): 5.38 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB - BytesReceived: 6.21 MB (6513198) - ConvertRowBatchTime: 12.116ms - DeserializeRowBatchTimer: 51.672ms - FirstBatchArrivalWaitTime: 1s203ms - PeakMemoryUsage: 0 - RowsReturned: 451.92K (451915) - RowsReturnedRate: 219.34 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=14):(Total: 1.037ms, non-child: 915.377us, % non-child: 88.26%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 458.68K (458675) - BuildTime: 151.323ms - PeakMemoryUsage: 25.08 MB (26298624) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 93.369ms - BuildRowsPartitioned: 458.68K (458675) - GetNewBlockTime: 203.790us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 22.413ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 25.02 MB (26231936) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 4s092ms, non-child: 16.210ms, % non-child: 0.40%) BytesReceived(16s000ms): 5.81 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB - BytesReceived: 7.33 MB (7682039) - ConvertRowBatchTime: 12.297ms - DeserializeRowBatchTimer: 16.123ms - FirstBatchArrivalWaitTime: 2s110ms - PeakMemoryUsage: 0 - RowsReturned: 458.68K (458675) - RowsReturnedRate: 112.08 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=13):(Total: 739.984us, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 3.98B (3976322070) - BuildTime: 5m55s - PeakMemoryUsage: 157.31 GB (168914159840) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled, Spilled Runtime filters: 0 of 1 Runtime Filter Published, 1 Disabled - BuildRowsPartitionTime: 5m54s - BuildRowsPartitioned: 3.98B (3976322070) - GetNewBlockTime: 36s103ms - HashBuckets: 536.87M (536870912) - HashCollisions: 0 (0) - HashTablesBuildTime: 23s471ms - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 157.31 GB (168914068608) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 4 (4) - UnpinTime: 105.578ms HASH_JOIN_NODE (id=12):(Total: 3m27s, non-child: 1m11s, % non-child: 34.50%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 40.12M (40119941) - BuildTime: 8s162ms - PeakMemoryUsage: 3.02 GB (3240188128) - ProbeRows: 74.74M (74736369) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1m2s - RowsReturned: 3.98B (3976322070) - RowsReturnedRate: 19.18 M/sec Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 5s387ms - BuildRowsPartitioned: 40.12M (40119941) - GetNewBlockTime: 3.195ms - HashBuckets: 67.11M (67108864) - HashCollisions: 0 (0) - HashTablesBuildTime: 2s721ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 3.02 GB (3240125568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 6s952ms, non-child: 1s596ms, % non-child: 22.96%) BytesReceived(16s000ms): 209.38 MB, 379.96 MB, 379.96 MB, 379.96 MB, 379.96 MB, 379.96 MB, 379.96 MB, 379.96 MB, 379.96 MB, 379.96 MB, 379.96 MB, 379.96 MB, 379.96 MB, 379.96 MB, 379.96 MB, 379.96 MB, 379.96 MB, 379.96 MB, 379.96 MB, 379.96 MB, 379.96 MB, 379.96 MB, 379.96 MB, 379.96 MB, 379.96 MB, 379.96 MB, 379.96 MB, 379.96 MB, 379.96 MB, 379.96 MB, 379.96 MB, 379.96 MB, 379.96 MB, 379.96 MB, 379.96 MB, 379.96 MB, 379.96 MB, 379.96 MB, 379.96 MB - BytesReceived: 379.96 MB (398420204) - ConvertRowBatchTime: 958.344ms - DeserializeRowBatchTimer: 1s652ms - FirstBatchArrivalWaitTime: 1s123ms - PeakMemoryUsage: 0 - RowsReturned: 40.12M (40119941) - RowsReturnedRate: 5.77 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=22):(Total: 2m9s, non-child: 3s043ms, % non-child: 2.35%) BytesReceived(16s000ms): 2.13 MB, 15.24 MB, 41.69 MB, 67.25 MB, 93.74 MB, 120.21 MB, 146.96 MB, 173.72 MB, 199.03 MB, 224.11 MB, 248.63 MB, 273.81 MB, 300.19 MB, 326.04 MB, 350.01 MB, 379.00 MB, 404.84 MB, 431.75 MB, 454.42 MB, 479.86 MB, 501.80 MB, 518.85 MB, 537.49 MB, 559.60 MB, 577.29 MB, 589.92 MB, 609.83 MB, 625.61 MB, 638.23 MB, 642.82 MB, 651.59 MB, 664.43 MB, 669.44 MB, 678.56 MB, 687.11 MB, 691.67 MB, 691.67 MB, 691.67 MB, 691.67 MB - BytesReceived: 691.67 MB (725272953) - ConvertRowBatchTime: 911.033ms - DeserializeRowBatchTimer: 7s204ms - FirstBatchArrivalWaitTime: 790.248ms - PeakMemoryUsage: 0 - RowsReturned: 74.74M (74736369) - RowsReturnedRate: 576.60 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=24):(Total: 1s734ms, non-child: 4.718us, % non-child: 0.00%) BytesReceived(16s000ms): 8.29 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.10 MB, 10.14 MB - BytesReceived: 10.15 MB (10641041) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 69.266ms - FirstBatchArrivalWaitTime: 1s734ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:2ed (host=vc1533.foo:22000):(Total: 65.339ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 1.05 GB, 7.27 GB, 14.08 GB, 20.58 GB, 27.32 GB, 34.25 GB, 41.03 GB, 47.82 GB, 54.14 GB, 60.54 GB, 66.69 GB, 73.15 GB, 79.85 GB, 86.30 GB, 92.35 GB, 99.13 GB, 105.46 GB, 112.30 GB, 118.20 GB, 124.52 GB, 130.40 GB, 134.63 GB, 139.25 GB, 144.86 GB, 149.39 GB, 152.66 GB, 157.43 GB, 152.31 GB, 154.02 GB, 155.04 GB, 157.37 GB, 156.18 GB, 150.26 GB, 152.58 GB, 154.43 GB, 155.74 GB, 150.96 GB, 150.64 GB, 152.36 GB, 152.42 GB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.03 - BloomFilterBytes: 49.00 MB (51380224) - PeakMemoryUsage: 160.60 GB (172439895871) - PerHostPeakMemUsage: 169.57 GB (182077648486) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 2m40s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 1.72K (1720) - TotalThreadsTotalWallClockTime: 21s548ms - TotalThreadsSysTime: 2s122ms - TotalThreadsUserTime: 8s127ms - TotalThreadsVoluntaryContextSwitches: 20.25K (20254) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 65.272ms - ExecTreePrepareTime: 704.559us DataStreamSender (dst_id=28):(Total: 644.618us, non-child: 644.618us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.05 MB (1105280) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 639.553ms, non-child: 639.553ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 192.097ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 122 (122) - NumInstructions: 8.95K (8951) - OptimizationTime: 421.229ms - PeakMemoryUsage: 4.37 MB (4582912) - PrepareTime: 25.649ms HASH_JOIN_NODE (id=15):(Total: 1.323ms, non-child: 800.359us, % non-child: 60.49%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 451.92K (451915) - BuildTime: 123.954ms - PeakMemoryUsage: 153.09 MB (160524544) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=15): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 86.734ms - BuildRowsPartitioned: 451.92K (451915) - GetNewBlockTime: 306.127us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 34.648ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160449664) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=26):(Total: 2s069ms, non-child: 20.566ms, % non-child: 0.99%) BytesReceived(16s000ms): 5.48 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB - BytesReceived: 6.21 MB (6513198) - ConvertRowBatchTime: 11.040ms - DeserializeRowBatchTimer: 45.994ms - FirstBatchArrivalWaitTime: 1s194ms - PeakMemoryUsage: 0 - RowsReturned: 451.92K (451915) - RowsReturnedRate: 218.32 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=14):(Total: 974.561us, non-child: 623.097us, % non-child: 63.94%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 459.10K (459101) - BuildTime: 122.565ms - PeakMemoryUsage: 25.08 MB (26298624) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 70.919ms - BuildRowsPartitioned: 459.10K (459101) - GetNewBlockTime: 145.936us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 23.548ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 25.02 MB (26231936) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 4s112ms, non-child: 10.428ms, % non-child: 0.25%) BytesReceived(16s000ms): 5.99 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB - BytesReceived: 7.33 MB (7690083) - ConvertRowBatchTime: 7.640ms - DeserializeRowBatchTimer: 15.921ms - FirstBatchArrivalWaitTime: 2s098ms - PeakMemoryUsage: 0 - RowsReturned: 459.10K (459101) - RowsReturnedRate: 111.63 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=13):(Total: 645.339us, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 3.93B (3930981382) - BuildTime: 5m40s - PeakMemoryUsage: 160.16 GB (171968203008) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled, Spilled Runtime filters: 0 of 1 Runtime Filter Published, 1 Disabled - BuildRowsPartitionTime: 5m40s - BuildRowsPartitioned: 3.93B (3930981382) - GetNewBlockTime: 23s201ms - HashBuckets: 536.87M (536870912) - HashCollisions: 0 (0) - HashTablesBuildTime: 38s555ms - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 160.16 GB (171968144512) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 4 (4) - UnpinTime: 269.526ms HASH_JOIN_NODE (id=12):(Total: 3m42s, non-child: 1m9s, % non-child: 31.07%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 40.16M (40160393) - BuildTime: 8s506ms - PeakMemoryUsage: 3.02 GB (3240189928) - ProbeRows: 74.11M (74114693) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 59s773ms - RowsReturned: 3.93B (3930981382) - RowsReturnedRate: 17.68 M/sec Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 5s808ms - BuildRowsPartitioned: 40.16M (40160393) - GetNewBlockTime: 5.007ms - HashBuckets: 67.11M (67108864) - HashCollisions: 0 (0) - HashTablesBuildTime: 2s647ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 3.02 GB (3240125568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 6s499ms, non-child: 1s560ms, % non-child: 24.01%) BytesReceived(16s000ms): 217.09 MB, 380.33 MB, 380.33 MB, 380.33 MB, 380.33 MB, 380.33 MB, 380.33 MB, 380.33 MB, 380.33 MB, 380.33 MB, 380.33 MB, 380.33 MB, 380.33 MB, 380.33 MB, 380.33 MB, 380.33 MB, 380.33 MB, 380.33 MB, 380.33 MB, 380.33 MB, 380.33 MB, 380.33 MB, 380.33 MB, 380.33 MB, 380.33 MB, 380.33 MB, 380.33 MB, 380.33 MB, 380.33 MB, 380.33 MB, 380.33 MB, 380.33 MB, 380.33 MB, 380.33 MB, 380.33 MB, 380.33 MB, 380.33 MB, 380.33 MB, 380.33 MB, 380.33 MB - BytesReceived: 380.33 MB (398809590) - ConvertRowBatchTime: 948.479ms - DeserializeRowBatchTimer: 1s542ms - FirstBatchArrivalWaitTime: 1s116ms - PeakMemoryUsage: 0 - RowsReturned: 40.16M (40160393) - RowsReturnedRate: 6.18 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=22):(Total: 2m27s, non-child: 1s214ms, % non-child: 0.82%) BytesReceived(16s000ms): 2.13 MB, 15.62 MB, 41.88 MB, 67.33 MB, 93.80 MB, 120.74 MB, 147.31 MB, 173.84 MB, 198.88 MB, 223.73 MB, 248.12 MB, 273.32 MB, 299.37 MB, 325.01 MB, 348.59 MB, 375.05 MB, 399.97 MB, 426.61 MB, 449.08 MB, 473.98 MB, 496.43 MB, 513.12 MB, 531.58 MB, 553.33 MB, 571.05 MB, 583.32 MB, 602.66 MB, 620.02 MB, 633.14 MB, 637.96 MB, 647.28 MB, 659.48 MB, 664.12 MB, 673.88 MB, 682.09 MB, 685.64 MB, 685.64 MB, 685.64 MB, 685.64 MB, 685.64 MB - BytesReceived: 685.64 MB (718946081) - ConvertRowBatchTime: 802.437ms - DeserializeRowBatchTimer: 5s987ms - FirstBatchArrivalWaitTime: 784.596ms - PeakMemoryUsage: 0 - RowsReturned: 74.11M (74114693) - RowsReturnedRate: 502.18 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=24):(Total: 1s727ms, non-child: 4.668us, % non-child: 0.00%) BytesReceived(16s000ms): 8.59 MB, 10.17 MB, 10.17 MB, 10.17 MB, 10.17 MB, 10.17 MB, 10.17 MB, 10.17 MB, 10.17 MB, 10.17 MB, 10.17 MB, 10.17 MB, 10.17 MB, 10.17 MB, 10.17 MB, 10.17 MB, 10.17 MB, 10.17 MB, 10.17 MB, 10.17 MB, 10.17 MB, 10.17 MB, 10.17 MB, 10.17 MB, 10.17 MB, 10.17 MB, 10.17 MB, 10.17 MB, 10.17 MB, 10.17 MB, 10.17 MB, 10.17 MB, 10.17 MB, 10.17 MB, 10.17 MB, 10.17 MB, 10.17 MB, 10.22 MB, 10.27 MB, 10.27 MB - BytesReceived: 10.34 MB (10846491) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 69.818ms - FirstBatchArrivalWaitTime: 1s727ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:326 (host=vd1132.foo:22000):(Total: 65.229ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 966.65 MB, 6.95 GB, 14.04 GB, 20.60 GB, 27.39 GB, 34.17 GB, 41.03 GB, 47.85 GB, 54.31 GB, 60.75 GB, 67.04 GB, 73.50 GB, 80.33 GB, 86.84 GB, 93.38 GB, 100.50 GB, 107.00 GB, 113.74 GB, 119.71 GB, 126.14 GB, 132.18 GB, 136.46 GB, 141.28 GB, 146.97 GB, 151.69 GB, 154.96 GB, 156.54 GB, 153.47 GB, 156.78 GB, 157.64 GB, 156.88 GB, 151.56 GB, 152.58 GB, 154.91 GB, 156.52 GB, 152.29 GB, 156.03 GB, 154.56 GB, 155.72 GB, 153.97 GB ThreadUsage(16s000ms): 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.03 - BloomFilterBytes: 49.00 MB (51380224) - PeakMemoryUsage: 160.60 GB (172444855375) - PerHostPeakMemUsage: 169.57 GB (182074885619) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 2m6s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 1.57K (1566) - TotalThreadsTotalWallClockTime: 22s015ms - TotalThreadsSysTime: 2s276ms - TotalThreadsUserTime: 8s326ms - TotalThreadsVoluntaryContextSwitches: 21.47K (21467) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 64.995ms - ExecTreePrepareTime: 925.451us DataStreamSender (dst_id=28):(Total: 1.171ms, non-child: 1.171ms, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.05 MB (1105280) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 644.772ms, non-child: 644.772ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 204.280ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 122 (122) - NumInstructions: 8.95K (8951) - OptimizationTime: 412.815ms - PeakMemoryUsage: 4.37 MB (4582912) - PrepareTime: 27.212ms HASH_JOIN_NODE (id=15):(Total: 1.629ms, non-child: 1.093ms, % non-child: 67.09%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 451.92K (451915) - BuildTime: 143.786ms - PeakMemoryUsage: 153.09 MB (160524544) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=15): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 103.879ms - BuildRowsPartitioned: 451.92K (451915) - GetNewBlockTime: 415.956us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 36.701ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160449664) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=26):(Total: 2s038ms, non-child: 29.851ms, % non-child: 1.46%) BytesReceived(16s000ms): 5.37 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB - BytesReceived: 6.21 MB (6513198) - ConvertRowBatchTime: 12.273ms - DeserializeRowBatchTimer: 52.750ms - FirstBatchArrivalWaitTime: 1s175ms - PeakMemoryUsage: 0 - RowsReturned: 451.92K (451915) - RowsReturnedRate: 221.69 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=14):(Total: 1.216ms, non-child: 741.164us, % non-child: 60.91%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 458.40K (458397) - BuildTime: 140.549ms - PeakMemoryUsage: 25.08 MB (26298624) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 83.446ms - BuildRowsPartitioned: 458.40K (458397) - GetNewBlockTime: 165.651us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 23.761ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 25.02 MB (26231936) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 4s121ms, non-child: 14.123ms, % non-child: 0.34%) BytesReceived(16s000ms): 5.80 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB - BytesReceived: 7.32 MB (7679107) - ConvertRowBatchTime: 10.280ms - DeserializeRowBatchTimer: 17.806ms - FirstBatchArrivalWaitTime: 2s082ms - PeakMemoryUsage: 0 - RowsReturned: 458.40K (458397) - RowsReturnedRate: 111.21 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=13):(Total: 920.106us, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 3.99B (3987800219) - BuildTime: 6m6s - PeakMemoryUsage: 159.92 GB (171708745984) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled, Spilled Runtime filters: 0 of 1 Runtime Filter Published, 1 Disabled - BuildRowsPartitionTime: 6m6s - BuildRowsPartitioned: 3.99B (3987800219) - GetNewBlockTime: 37s726ms - HashBuckets: 1.07B (1073741824) - HashCollisions: 0 (0) - HashTablesBuildTime: 1m8s - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 159.92 GB (171708687488) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 5 (5) - UnpinTime: 112.811ms HASH_JOIN_NODE (id=12):(Total: 3m14s, non-child: 1m14s, % non-child: 38.55%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 40.18M (40176130) - BuildTime: 8s805ms - PeakMemoryUsage: 3.02 GB (3240189914) - ProbeRows: 75.83M (75825781) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1m5s - RowsReturned: 3.99B (3987800219) - RowsReturnedRate: 20.51 M/sec Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 5s707ms - BuildRowsPartitioned: 40.18M (40176130) - GetNewBlockTime: 3.886ms - HashBuckets: 67.11M (67108864) - HashCollisions: 0 (0) - HashTablesBuildTime: 3s053ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 3.02 GB (3240125568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 6s663ms, non-child: 1s596ms, % non-child: 23.96%) BytesReceived(16s000ms): 208.52 MB, 380.49 MB, 380.49 MB, 380.49 MB, 380.49 MB, 380.49 MB, 380.49 MB, 380.49 MB, 380.49 MB, 380.49 MB, 380.49 MB, 380.49 MB, 380.49 MB, 380.49 MB, 380.49 MB, 380.49 MB, 380.49 MB, 380.49 MB, 380.49 MB, 380.49 MB, 380.49 MB, 380.49 MB, 380.49 MB, 380.49 MB, 380.49 MB, 380.49 MB, 380.49 MB, 380.49 MB, 380.49 MB, 380.49 MB, 380.49 MB, 380.49 MB, 380.49 MB, 380.49 MB, 380.49 MB, 380.49 MB, 380.49 MB, 380.49 MB, 380.49 MB, 380.49 MB - BytesReceived: 380.49 MB (398967904) - ConvertRowBatchTime: 950.663ms - DeserializeRowBatchTimer: 1s605ms - FirstBatchArrivalWaitTime: 1s106ms - PeakMemoryUsage: 0 - RowsReturned: 40.18M (40176130) - RowsReturnedRate: 6.03 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=22):(Total: 1m53s, non-child: 1s822ms, % non-child: 1.60%) BytesReceived(16s000ms): 2.14 MB, 15.36 MB, 42.01 MB, 67.85 MB, 94.61 MB, 121.36 MB, 148.46 MB, 175.53 MB, 201.08 MB, 226.51 MB, 251.46 MB, 277.14 MB, 303.85 MB, 330.82 MB, 356.80 MB, 384.08 MB, 409.70 MB, 436.95 MB, 459.81 MB, 485.55 MB, 508.18 MB, 525.64 MB, 544.78 MB, 567.30 MB, 585.34 MB, 597.88 MB, 617.91 MB, 634.02 MB, 647.54 MB, 652.16 MB, 660.97 MB, 674.05 MB, 679.29 MB, 688.24 MB, 696.86 MB, 701.92 MB, 701.92 MB, 701.92 MB, 701.92 MB, 701.92 MB - BytesReceived: 701.92 MB (736019938) - ConvertRowBatchTime: 875.889ms - DeserializeRowBatchTimer: 8s502ms - FirstBatchArrivalWaitTime: 766.009ms - PeakMemoryUsage: 0 - RowsReturned: 75.83M (75825781) - RowsReturnedRate: 667.62 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=24):(Total: 1s701ms, non-child: 3.830us, % non-child: 0.00%) BytesReceived(16s000ms): 8.59 MB, 10.49 MB, 10.49 MB, 10.49 MB, 10.49 MB, 10.49 MB, 10.49 MB, 10.49 MB, 10.49 MB, 10.49 MB, 10.49 MB, 10.49 MB, 10.49 MB, 10.49 MB, 10.49 MB, 10.49 MB, 10.49 MB, 10.49 MB, 10.49 MB, 10.49 MB, 10.49 MB, 10.49 MB, 10.49 MB, 10.49 MB, 10.49 MB, 10.49 MB, 10.49 MB, 10.49 MB, 10.49 MB, 10.49 MB, 10.49 MB, 10.49 MB, 10.49 MB, 10.49 MB, 10.49 MB, 10.49 MB, 10.49 MB, 10.49 MB, 10.52 MB, 10.52 MB - BytesReceived: 10.65 MB (11169084) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 77.040ms - FirstBatchArrivalWaitTime: 1s701ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:342 (host=vd1121.foo:22000):(Total: 64.455ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 1016.55 MB, 7.03 GB, 14.27 GB, 20.94 GB, 27.75 GB, 34.61 GB, 41.52 GB, 48.40 GB, 54.82 GB, 61.36 GB, 67.88 GB, 74.64 GB, 81.44 GB, 87.98 GB, 94.18 GB, 101.08 GB, 107.59 GB, 114.24 GB, 120.36 GB, 126.78 GB, 132.86 GB, 137.07 GB, 141.92 GB, 147.64 GB, 152.37 GB, 155.68 GB, 156.26 GB, 154.03 GB, 157.36 GB, 158.10 GB, 156.10 GB, 152.38 GB, 153.19 GB, 155.61 GB, 157.31 GB, 155.91 GB, 155.49 GB, 152.66 GB, 147.85 GB, 149.35 GB ThreadUsage(16s000ms): 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.03 - BloomFilterBytes: 49.00 MB (51380224) - PeakMemoryUsage: 160.60 GB (172446693055) - PerHostPeakMemUsage: 169.57 GB (182076301709) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 2m9s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 1.67K (1669) - TotalThreadsTotalWallClockTime: 21s984ms - TotalThreadsSysTime: 2s328ms - TotalThreadsUserTime: 8s236ms - TotalThreadsVoluntaryContextSwitches: 21.08K (21080) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 64.360ms - ExecTreePrepareTime: 709.221us DataStreamSender (dst_id=28):(Total: 1.035ms, non-child: 1.035ms, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.05 MB (1105280) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 651.112ms, non-child: 651.112ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 212.481ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 122 (122) - NumInstructions: 8.95K (8951) - OptimizationTime: 410.546ms - PeakMemoryUsage: 4.37 MB (4582912) - PrepareTime: 27.654ms HASH_JOIN_NODE (id=15):(Total: 1.363ms, non-child: 909.998us, % non-child: 66.76%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 451.92K (451915) - BuildTime: 153.020ms - PeakMemoryUsage: 153.09 MB (160524544) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=15): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 116.062ms - BuildRowsPartitioned: 451.92K (451915) - GetNewBlockTime: 356.243us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 33.941ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160449664) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=26):(Total: 2s010ms, non-child: 28.487ms, % non-child: 1.42%) BytesReceived(16s000ms): 5.44 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB - BytesReceived: 6.21 MB (6513198) - ConvertRowBatchTime: 12.961ms - DeserializeRowBatchTimer: 57.690ms - FirstBatchArrivalWaitTime: 1s165ms - PeakMemoryUsage: 0 - RowsReturned: 451.92K (451915) - RowsReturnedRate: 224.76 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=14):(Total: 1.074ms, non-child: 937.414us, % non-child: 87.26%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 459.06K (459057) - BuildTime: 168.990ms - PeakMemoryUsage: 25.08 MB (26298624) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 105.341ms - BuildRowsPartitioned: 459.06K (459057) - GetNewBlockTime: 237.355us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 23.265ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 25.02 MB (26231936) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 4s098ms, non-child: 15.979ms, % non-child: 0.39%) BytesReceived(16s000ms): 5.94 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB - BytesReceived: 7.33 MB (7688660) - ConvertRowBatchTime: 11.695ms - DeserializeRowBatchTimer: 16.279ms - FirstBatchArrivalWaitTime: 2s079ms - PeakMemoryUsage: 0 - RowsReturned: 459.06K (459057) - RowsReturnedRate: 112.00 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=13):(Total: 768.541us, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 4.01B (4011278627) - BuildTime: 6m14s - PeakMemoryUsage: 158.81 GB (170516973824) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled, Spilled Runtime filters: 0 of 1 Runtime Filter Published, 1 Disabled - BuildRowsPartitionTime: 6m14s - BuildRowsPartitioned: 4.01B (4011278627) - GetNewBlockTime: 49s041ms - HashBuckets: 536.87M (536870912) - HashCollisions: 0 (0) - HashTablesBuildTime: 27s252ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 158.81 GB (170516915328) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 4 (4) - UnpinTime: 146.259ms HASH_JOIN_NODE (id=12):(Total: 3m16s, non-child: 1m13s, % non-child: 37.42%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 40.10M (40101147) - BuildTime: 8s727ms - PeakMemoryUsage: 3.02 GB (3240188128) - ProbeRows: 75.79M (75794590) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1m4s - RowsReturned: 4.01B (4011278627) - RowsReturnedRate: 20.41 M/sec Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 5s724ms - BuildRowsPartitioned: 40.10M (40101147) - GetNewBlockTime: 3.742ms - HashBuckets: 67.11M (67108864) - HashCollisions: 0 (0) - HashTablesBuildTime: 2s953ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 3.02 GB (3240125568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 6s713ms, non-child: 1s578ms, % non-child: 23.51%) BytesReceived(16s000ms): 215.13 MB, 379.79 MB, 379.79 MB, 379.79 MB, 379.79 MB, 379.79 MB, 379.79 MB, 379.79 MB, 379.79 MB, 379.79 MB, 379.79 MB, 379.79 MB, 379.79 MB, 379.79 MB, 379.79 MB, 379.79 MB, 379.79 MB, 379.79 MB, 379.79 MB, 379.79 MB, 379.79 MB, 379.79 MB, 379.79 MB, 379.79 MB, 379.79 MB, 379.79 MB, 379.79 MB, 379.79 MB, 379.79 MB, 379.79 MB, 379.79 MB, 379.79 MB, 379.79 MB, 379.79 MB, 379.79 MB, 379.79 MB, 379.79 MB, 379.79 MB, 379.79 MB, 379.79 MB - BytesReceived: 379.79 MB (398239144) - ConvertRowBatchTime: 951.704ms - DeserializeRowBatchTimer: 1s565ms - FirstBatchArrivalWaitTime: 1s085ms - PeakMemoryUsage: 0 - RowsReturned: 40.10M (40101147) - RowsReturnedRate: 5.97 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=22):(Total: 1m57s, non-child: 1s995ms, % non-child: 1.70%) BytesReceived(16s000ms): 2.11 MB, 15.83 MB, 42.74 MB, 68.83 MB, 95.54 MB, 122.42 MB, 149.53 MB, 176.56 MB, 202.01 MB, 227.51 MB, 254.05 MB, 280.00 MB, 306.66 MB, 332.82 MB, 356.88 MB, 384.00 MB, 409.54 MB, 436.75 MB, 459.78 MB, 485.29 MB, 507.92 MB, 525.00 MB, 543.92 MB, 566.31 MB, 584.47 MB, 596.97 MB, 616.92 MB, 633.02 MB, 646.60 MB, 651.23 MB, 660.05 MB, 673.30 MB, 678.71 MB, 687.71 MB, 696.57 MB, 701.77 MB, 701.77 MB, 701.77 MB, 701.77 MB, 701.77 MB - BytesReceived: 701.77 MB (735858927) - ConvertRowBatchTime: 868.074ms - DeserializeRowBatchTimer: 8s539ms - FirstBatchArrivalWaitTime: 745.329ms - PeakMemoryUsage: 0 - RowsReturned: 75.79M (75794590) - RowsReturnedRate: 647.52 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=24):(Total: 1s679ms, non-child: 3.836us, % non-child: 0.00%) BytesReceived(16s000ms): 8.34 MB, 9.88 MB, 9.88 MB, 9.88 MB, 9.88 MB, 9.88 MB, 9.88 MB, 9.88 MB, 9.88 MB, 9.88 MB, 9.88 MB, 9.88 MB, 9.88 MB, 9.88 MB, 9.88 MB, 9.88 MB, 9.88 MB, 9.88 MB, 9.88 MB, 9.88 MB, 9.88 MB, 9.88 MB, 9.88 MB, 9.88 MB, 9.88 MB, 9.88 MB, 9.88 MB, 9.88 MB, 9.88 MB, 9.88 MB, 9.88 MB, 9.88 MB, 9.88 MB, 9.88 MB, 9.88 MB, 9.88 MB, 9.88 MB, 9.88 MB, 9.88 MB, 9.88 MB - BytesReceived: 9.88 MB (10358488) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 70.843ms - FirstBatchArrivalWaitTime: 1s679ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:310 (host=vc1518.foo:22000):(Total: 64.330ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 990.12 MB, 7.19 GB, 14.13 GB, 20.75 GB, 27.57 GB, 34.36 GB, 41.23 GB, 48.29 GB, 54.88 GB, 61.37 GB, 67.62 GB, 74.09 GB, 80.84 GB, 87.29 GB, 93.49 GB, 100.33 GB, 106.74 GB, 113.63 GB, 119.65 GB, 126.14 GB, 132.06 GB, 136.17 GB, 141.02 GB, 146.68 GB, 151.32 GB, 154.54 GB, 156.84 GB, 152.95 GB, 156.36 GB, 156.99 GB, 159.55 GB, 151.12 GB, 151.74 GB, 154.22 GB, 156.25 GB, 154.31 GB, 146.07 GB, 152.36 GB, 153.72 GB, 153.73 GB ThreadUsage(16s000ms): 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.03 - BloomFilterBytes: 49.00 MB (51380224) - PeakMemoryUsage: 160.60 GB (172442932879) - PerHostPeakMemUsage: 169.57 GB (182075238879) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 2m31s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 1.62K (1622) - TotalThreadsTotalWallClockTime: 21s651ms - TotalThreadsSysTime: 2s157ms - TotalThreadsUserTime: 8s012ms - TotalThreadsVoluntaryContextSwitches: 21.38K (21380) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 64.287ms - ExecTreePrepareTime: 788.313us DataStreamSender (dst_id=28):(Total: 1.223ms, non-child: 1.223ms, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.05 MB (1105280) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 612.736ms, non-child: 612.736ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 195.697ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 122 (122) - NumInstructions: 8.95K (8951) - OptimizationTime: 391.246ms - PeakMemoryUsage: 4.37 MB (4582912) - PrepareTime: 25.305ms HASH_JOIN_NODE (id=15):(Total: 1.494ms, non-child: 1.076ms, % non-child: 72.06%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 451.92K (451915) - BuildTime: 133.497ms - PeakMemoryUsage: 153.09 MB (160524544) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=15): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 100.789ms - BuildRowsPartitioned: 451.92K (451915) - GetNewBlockTime: 615.004us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 29.084ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160449664) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=26):(Total: 2s074ms, non-child: 24.021ms, % non-child: 1.16%) BytesReceived(16s000ms): 5.37 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB - BytesReceived: 6.21 MB (6513198) - ConvertRowBatchTime: 12.773ms - DeserializeRowBatchTimer: 51.870ms - FirstBatchArrivalWaitTime: 1s210ms - PeakMemoryUsage: 0 - RowsReturned: 451.92K (451915) - RowsReturnedRate: 217.85 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=14):(Total: 1.110ms, non-child: 966.494us, % non-child: 87.01%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 459.96K (459960) - BuildTime: 161.172ms - PeakMemoryUsage: 25.08 MB (26298624) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 102.467ms - BuildRowsPartitioned: 459.96K (459960) - GetNewBlockTime: 265.754us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 20.860ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 25.02 MB (26231936) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 4s110ms, non-child: 15.416ms, % non-child: 0.38%) BytesReceived(16s000ms): 5.83 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB - BytesReceived: 7.35 MB (7704056) - ConvertRowBatchTime: 11.849ms - DeserializeRowBatchTimer: 15.493ms - FirstBatchArrivalWaitTime: 2s119ms - PeakMemoryUsage: 0 - RowsReturned: 459.96K (459960) - RowsReturnedRate: 111.89 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=13):(Total: 709.348us, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 3.99B (3985414242) - BuildTime: 5m56s - PeakMemoryUsage: 157.31 GB (168914159840) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled, Spilled Runtime filters: 0 of 1 Runtime Filter Published, 1 Disabled - BuildRowsPartitionTime: 5m56s - BuildRowsPartitioned: 3.99B (3985414242) - GetNewBlockTime: 50s986ms - HashBuckets: 536.87M (536870912) - HashCollisions: 0 (0) - HashTablesBuildTime: 33s861ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 157.31 GB (168914068608) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 4 (4) - UnpinTime: 324.106ms HASH_JOIN_NODE (id=12):(Total: 3m34s, non-child: 1m9s, % non-child: 32.53%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 40.24M (40244472) - BuildTime: 8s393ms - PeakMemoryUsage: 3.02 GB (3240188128) - ProbeRows: 75.30M (75296106) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1m - RowsReturned: 3.99B (3985414242) - RowsReturnedRate: 18.56 M/sec Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 5s700ms - BuildRowsPartitioned: 40.24M (40244472) - GetNewBlockTime: 2.931ms - HashBuckets: 67.11M (67108864) - HashCollisions: 0 (0) - HashTablesBuildTime: 2s645ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 3.02 GB (3240125568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 6s683ms, non-child: 1s516ms, % non-child: 22.69%) BytesReceived(16s000ms): 209.35 MB, 381.12 MB, 381.12 MB, 381.12 MB, 381.12 MB, 381.12 MB, 381.12 MB, 381.12 MB, 381.12 MB, 381.12 MB, 381.12 MB, 381.12 MB, 381.12 MB, 381.12 MB, 381.12 MB, 381.12 MB, 381.12 MB, 381.12 MB, 381.12 MB, 381.12 MB, 381.12 MB, 381.12 MB, 381.12 MB, 381.12 MB, 381.12 MB, 381.12 MB, 381.12 MB, 381.12 MB, 381.12 MB, 381.12 MB, 381.12 MB, 381.12 MB, 381.12 MB, 381.12 MB, 381.12 MB, 381.12 MB, 381.12 MB, 381.12 MB, 381.12 MB, 381.12 MB - BytesReceived: 381.12 MB (399633709) - ConvertRowBatchTime: 946.002ms - DeserializeRowBatchTimer: 1s496ms - FirstBatchArrivalWaitTime: 1s132ms - PeakMemoryUsage: 0 - RowsReturned: 40.24M (40244472) - RowsReturnedRate: 6.02 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=22):(Total: 2m18s, non-child: 1s240ms, % non-child: 0.89%) BytesReceived(16s000ms): 2.11 MB, 15.31 MB, 42.06 MB, 68.01 MB, 94.83 MB, 121.54 MB, 148.54 MB, 176.83 MB, 202.45 MB, 227.77 MB, 252.54 MB, 277.93 MB, 304.31 MB, 330.22 MB, 354.09 MB, 381.00 MB, 406.30 MB, 433.37 MB, 456.34 MB, 481.86 MB, 504.75 MB, 521.65 MB, 540.50 MB, 562.59 MB, 580.67 MB, 593.19 MB, 612.93 MB, 629.07 MB, 642.97 MB, 647.52 MB, 656.15 MB, 669.25 MB, 674.72 MB, 683.51 MB, 692.25 MB, 697.59 MB, 697.60 MB, 697.60 MB, 697.60 MB, 697.60 MB - BytesReceived: 697.60 MB (731481479) - ConvertRowBatchTime: 798.468ms - DeserializeRowBatchTimer: 6s517ms - FirstBatchArrivalWaitTime: 796.223ms - PeakMemoryUsage: 0 - RowsReturned: 75.30M (75296106) - RowsReturnedRate: 541.73 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=24):(Total: 1s754ms, non-child: 3.901us, % non-child: 0.00%) BytesReceived(16s000ms): 8.33 MB, 10.15 MB, 10.15 MB, 10.15 MB, 10.15 MB, 10.15 MB, 10.15 MB, 10.15 MB, 10.15 MB, 10.15 MB, 10.15 MB, 10.15 MB, 10.15 MB, 10.15 MB, 10.15 MB, 10.15 MB, 10.15 MB, 10.15 MB, 10.15 MB, 10.15 MB, 10.15 MB, 10.15 MB, 10.15 MB, 10.15 MB, 10.15 MB, 10.15 MB, 10.15 MB, 10.15 MB, 10.15 MB, 10.15 MB, 10.15 MB, 10.15 MB, 10.15 MB, 10.15 MB, 10.15 MB, 10.15 MB, 10.15 MB, 10.17 MB, 10.21 MB, 10.22 MB - BytesReceived: 10.30 MB (10805087) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 67.474ms - FirstBatchArrivalWaitTime: 1s754ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:32b (host=vc1517.foo:22000):(Total: 64.184ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 997.77 MB, 7.11 GB, 13.93 GB, 20.38 GB, 27.08 GB, 33.81 GB, 40.62 GB, 47.40 GB, 53.80 GB, 60.19 GB, 66.40 GB, 72.78 GB, 79.47 GB, 85.89 GB, 91.97 GB, 98.70 GB, 105.49 GB, 112.65 GB, 118.59 GB, 124.99 GB, 130.70 GB, 134.77 GB, 139.56 GB, 145.18 GB, 149.78 GB, 152.96 GB, 157.84 GB, 151.58 GB, 154.13 GB, 154.99 GB, 157.20 GB, 154.60 GB, 149.98 GB, 152.29 GB, 154.21 GB, 154.45 GB, 153.64 GB, 151.86 GB, 150.91 GB, 154.98 GB ThreadUsage(16s000ms): 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.03 - BloomFilterBytes: 49.00 MB (51380224) - PeakMemoryUsage: 160.59 GB (172437278479) - PerHostPeakMemUsage: 169.57 GB (182072460943) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 2m26s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 1.52K (1518) - TotalThreadsTotalWallClockTime: 21s726ms - TotalThreadsSysTime: 2s165ms - TotalThreadsUserTime: 8s182ms - TotalThreadsVoluntaryContextSwitches: 21.41K (21405) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 64.065ms - ExecTreePrepareTime: 918.291us DataStreamSender (dst_id=28):(Total: 993.307us, non-child: 993.307us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.05 MB (1105280) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 661.861ms, non-child: 661.861ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 203.663ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 122 (122) - NumInstructions: 8.95K (8951) - OptimizationTime: 428.654ms - PeakMemoryUsage: 4.37 MB (4582912) - PrepareTime: 29.083ms HASH_JOIN_NODE (id=15):(Total: 1.729ms, non-child: 939.622us, % non-child: 54.33%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 451.92K (451915) - BuildTime: 138.942ms - PeakMemoryUsage: 153.09 MB (160524544) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=15): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 105.894ms - BuildRowsPartitioned: 451.92K (451915) - GetNewBlockTime: 1.391ms - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 30.239ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160449664) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=26):(Total: 2s021ms, non-child: 27.264ms, % non-child: 1.35%) BytesReceived(16s000ms): 5.38 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB - BytesReceived: 6.21 MB (6513198) - ConvertRowBatchTime: 12.480ms - DeserializeRowBatchTimer: 52.105ms - FirstBatchArrivalWaitTime: 1s158ms - PeakMemoryUsage: 0 - RowsReturned: 451.92K (451915) - RowsReturnedRate: 223.61 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=14):(Total: 1.333ms, non-child: 954.827us, % non-child: 71.58%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 460.23K (460226) - BuildTime: 142.361ms - PeakMemoryUsage: 25.08 MB (26298624) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 79.126ms - BuildRowsPartitioned: 460.23K (460226) - GetNewBlockTime: 240.431us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 25.180ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 25.02 MB (26231936) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 4s106ms, non-child: 13.927ms, % non-child: 0.34%) BytesReceived(16s000ms): 5.84 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB - BytesReceived: 7.35 MB (7708916) - ConvertRowBatchTime: 10.304ms - DeserializeRowBatchTimer: 15.616ms - FirstBatchArrivalWaitTime: 2s071ms - PeakMemoryUsage: 0 - RowsReturned: 460.23K (460226) - RowsReturnedRate: 112.08 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=13):(Total: 931.627us, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 3.93B (3932583378) - BuildTime: 5m46s - PeakMemoryUsage: 160.16 GB (171968203008) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled, Spilled Runtime filters: 0 of 1 Runtime Filter Published, 1 Disabled - BuildRowsPartitionTime: 5m45s - BuildRowsPartitioned: 3.93B (3932583378) - GetNewBlockTime: 31s861ms - HashBuckets: 536.87M (536870912) - HashCollisions: 0 (0) - HashTablesBuildTime: 49s790ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 160.16 GB (171968144512) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 4 (4) - UnpinTime: 131.425ms HASH_JOIN_NODE (id=12):(Total: 3m36s, non-child: 1m16s, % non-child: 35.27%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 40.21M (40214370) - BuildTime: 8s592ms - PeakMemoryUsage: 3.02 GB (3240188850) - ProbeRows: 74.81M (74807626) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1m7s - RowsReturned: 3.93B (3932583378) - RowsReturnedRate: 18.13 M/sec Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 5s738ms - BuildRowsPartitioned: 40.21M (40214370) - GetNewBlockTime: 5.269ms - HashBuckets: 67.11M (67108864) - HashCollisions: 0 (0) - HashTablesBuildTime: 2s802ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 3.02 GB (3240125568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 6s630ms, non-child: 1s496ms, % non-child: 22.57%) BytesReceived(16s000ms): 211.14 MB, 380.86 MB, 380.86 MB, 380.86 MB, 380.86 MB, 380.86 MB, 380.86 MB, 380.86 MB, 380.86 MB, 380.86 MB, 380.86 MB, 380.86 MB, 380.86 MB, 380.86 MB, 380.86 MB, 380.86 MB, 380.86 MB, 380.86 MB, 380.86 MB, 380.86 MB, 380.86 MB, 380.86 MB, 380.86 MB, 380.86 MB, 380.86 MB, 380.86 MB, 380.86 MB, 380.86 MB, 380.86 MB, 380.86 MB, 380.86 MB, 380.86 MB, 380.86 MB, 380.86 MB, 380.86 MB, 380.86 MB, 380.86 MB, 380.86 MB, 380.86 MB, 380.86 MB - BytesReceived: 380.86 MB (399358696) - ConvertRowBatchTime: 935.867ms - DeserializeRowBatchTimer: 1s444ms - FirstBatchArrivalWaitTime: 1s082ms - PeakMemoryUsage: 0 - RowsReturned: 40.21M (40214370) - RowsReturnedRate: 6.06 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=22):(Total: 2m14s, non-child: 1s442ms, % non-child: 1.07%) BytesReceived(16s000ms): 2.16 MB, 15.25 MB, 41.45 MB, 66.83 MB, 93.23 MB, 119.79 MB, 146.62 MB, 173.54 MB, 198.97 MB, 224.20 MB, 248.81 MB, 274.06 MB, 300.35 MB, 326.18 MB, 350.19 MB, 376.97 MB, 404.92 MB, 432.36 MB, 454.94 MB, 480.51 MB, 502.32 MB, 519.41 MB, 538.09 MB, 560.22 MB, 577.78 MB, 590.16 MB, 610.11 MB, 625.83 MB, 638.78 MB, 643.34 MB, 652.23 MB, 665.06 MB, 670.17 MB, 679.18 MB, 687.67 MB, 692.37 MB, 692.37 MB, 692.37 MB, 692.37 MB, 692.37 MB - BytesReceived: 692.37 MB (726004194) - ConvertRowBatchTime: 898.034ms - DeserializeRowBatchTimer: 7s785ms - FirstBatchArrivalWaitTime: 754.690ms - PeakMemoryUsage: 0 - RowsReturned: 74.81M (74807626) - RowsReturnedRate: 555.98 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=24):(Total: 1s679ms, non-child: 3.631us, % non-child: 0.00%) BytesReceived(16s000ms): 8.88 MB, 10.73 MB, 10.73 MB, 10.73 MB, 10.73 MB, 10.73 MB, 10.73 MB, 10.73 MB, 10.73 MB, 10.73 MB, 10.73 MB, 10.73 MB, 10.73 MB, 10.73 MB, 10.73 MB, 10.73 MB, 10.73 MB, 10.73 MB, 10.73 MB, 10.73 MB, 10.73 MB, 10.73 MB, 10.73 MB, 10.73 MB, 10.73 MB, 10.73 MB, 10.73 MB, 10.73 MB, 10.73 MB, 10.73 MB, 10.73 MB, 10.73 MB, 10.73 MB, 10.73 MB, 10.73 MB, 10.73 MB, 10.73 MB, 10.82 MB, 10.94 MB, 10.99 MB - BytesReceived: 11.33 MB (11883325) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 70.145ms - FirstBatchArrivalWaitTime: 1s679ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:2ee (host=vc1521.foo:22000):(Total: 63.964ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 1.07 GB, 7.32 GB, 14.01 GB, 20.52 GB, 27.23 GB, 33.96 GB, 40.76 GB, 47.53 GB, 53.94 GB, 60.65 GB, 66.86 GB, 73.35 GB, 80.03 GB, 86.39 GB, 92.45 GB, 99.32 GB, 105.65 GB, 112.51 GB, 118.39 GB, 124.75 GB, 130.55 GB, 134.82 GB, 139.50 GB, 145.15 GB, 149.73 GB, 153.00 GB, 157.85 GB, 152.11 GB, 154.41 GB, 155.53 GB, 157.58 GB, 154.48 GB, 150.51 GB, 152.55 GB, 154.20 GB, 151.02 GB, 152.03 GB, 154.98 GB, 152.55 GB, 156.51 GB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.03 - BloomFilterBytes: 49.00 MB (51380224) - PeakMemoryUsage: 160.60 GB (172439059615) - PerHostPeakMemUsage: 169.57 GB (182069092083) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 3m12s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 1.33K (1327) - TotalThreadsTotalWallClockTime: 21s261ms - TotalThreadsSysTime: 2s032ms - TotalThreadsUserTime: 7s678ms - TotalThreadsVoluntaryContextSwitches: 24.21K (24212) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 63.908ms - ExecTreePrepareTime: 1.059ms DataStreamSender (dst_id=28):(Total: 1.065ms, non-child: 1.065ms, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.05 MB (1105280) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 650.371ms, non-child: 650.371ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 199.885ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 122 (122) - NumInstructions: 8.95K (8951) - OptimizationTime: 423.133ms - PeakMemoryUsage: 4.37 MB (4582912) - PrepareTime: 26.845ms HASH_JOIN_NODE (id=15):(Total: 1.879ms, non-child: 1.217ms, % non-child: 64.80%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 451.92K (451915) - BuildTime: 128.785ms - PeakMemoryUsage: 153.09 MB (160524544) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=15): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 103.580ms - BuildRowsPartitioned: 451.92K (451915) - GetNewBlockTime: 647.471us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 22.831ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160449664) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=26):(Total: 2s039ms, non-child: 30.730ms, % non-child: 1.51%) BytesReceived(16s000ms): 5.49 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB - BytesReceived: 6.21 MB (6513198) - ConvertRowBatchTime: 12.098ms - DeserializeRowBatchTimer: 58.807ms - FirstBatchArrivalWaitTime: 1s182ms - PeakMemoryUsage: 0 - RowsReturned: 451.92K (451915) - RowsReturnedRate: 221.61 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=14):(Total: 1.338ms, non-child: 1.129ms, % non-child: 84.38%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 459.37K (459366) - BuildTime: 154.268ms - PeakMemoryUsage: 25.08 MB (26298624) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 92.074ms - BuildRowsPartitioned: 459.37K (459366) - GetNewBlockTime: 259.589us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 28.206ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 25.02 MB (26231936) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 4s079ms, non-child: 15.323ms, % non-child: 0.38%) BytesReceived(16s000ms): 6.00 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB - BytesReceived: 7.34 MB (7694740) - ConvertRowBatchTime: 11.130ms - DeserializeRowBatchTimer: 15.542ms - FirstBatchArrivalWaitTime: 2s093ms - PeakMemoryUsage: 0 - RowsReturned: 459.37K (459366) - RowsReturnedRate: 112.61 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=13):(Total: 816.640us, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 3.94B (3936573253) - BuildTime: 5m5s - PeakMemoryUsage: 158.28 GB (169955526912) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled, Spilled Runtime filters: 0 of 1 Runtime Filter Published, 1 Disabled - BuildRowsPartitionTime: 5m5s - BuildRowsPartitioned: 3.94B (3936573253) - GetNewBlockTime: 18s253ms - HashBuckets: 1.07B (1073741824) - HashCollisions: 0 (0) - HashTablesBuildTime: 42s203ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 158.28 GB (169955468416) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 5 (5) - UnpinTime: 259.486ms HASH_JOIN_NODE (id=12):(Total: 4m15s, non-child: 1m10s, % non-child: 27.43%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 40.14M (40135399) - BuildTime: 7s816ms - PeakMemoryUsage: 3.02 GB (3240204072) - ProbeRows: 74.27M (74272097) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1m1s - RowsReturned: 3.94B (3936573253) - RowsReturnedRate: 15.38 M/sec Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 5s368ms - BuildRowsPartitioned: 40.14M (40135399) - GetNewBlockTime: 3.376ms - HashBuckets: 67.11M (67108864) - HashCollisions: 0 (0) - HashTablesBuildTime: 2s397ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 3.02 GB (3240125568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 6s897ms, non-child: 1s659ms, % non-child: 24.06%) BytesReceived(16s000ms): 217.17 MB, 380.12 MB, 380.12 MB, 380.12 MB, 380.12 MB, 380.12 MB, 380.12 MB, 380.12 MB, 380.12 MB, 380.12 MB, 380.12 MB, 380.12 MB, 380.12 MB, 380.12 MB, 380.12 MB, 380.12 MB, 380.12 MB, 380.12 MB, 380.12 MB, 380.12 MB, 380.12 MB, 380.12 MB, 380.12 MB, 380.12 MB, 380.12 MB, 380.12 MB, 380.12 MB, 380.12 MB, 380.12 MB, 380.12 MB, 380.12 MB, 380.12 MB, 380.12 MB, 380.12 MB, 380.12 MB, 380.12 MB, 380.12 MB, 380.12 MB, 380.12 MB, 380.12 MB - BytesReceived: 380.12 MB (398585712) - ConvertRowBatchTime: 927.871ms - DeserializeRowBatchTimer: 1s656ms - FirstBatchArrivalWaitTime: 1s111ms - PeakMemoryUsage: 0 - RowsReturned: 40.14M (40135399) - RowsReturnedRate: 5.82 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=22):(Total: 2m59s, non-child: 1s765ms, % non-child: 0.98%) BytesReceived(16s000ms): 2.06 MB, 15.48 MB, 41.55 MB, 66.93 MB, 93.17 MB, 119.52 MB, 146.12 MB, 172.67 MB, 198.31 MB, 224.03 MB, 248.59 MB, 273.97 MB, 300.07 MB, 325.61 MB, 349.15 MB, 375.81 MB, 400.92 MB, 427.70 MB, 450.17 MB, 475.29 MB, 497.54 MB, 514.44 MB, 533.11 MB, 555.04 MB, 572.83 MB, 585.15 MB, 604.71 MB, 620.59 MB, 633.90 MB, 638.39 MB, 646.95 MB, 659.71 MB, 664.97 MB, 673.66 MB, 682.29 MB, 687.34 MB, 687.34 MB, 687.34 MB, 687.34 MB, 687.34 MB - BytesReceived: 687.34 MB (720729279) - ConvertRowBatchTime: 847.800ms - DeserializeRowBatchTimer: 7s221ms - FirstBatchArrivalWaitTime: 777.436ms - PeakMemoryUsage: 0 - RowsReturned: 74.27M (74272097) - RowsReturnedRate: 413.48 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=24):(Total: 1s712ms, non-child: 7.392us, % non-child: 0.00%) BytesReceived(16s000ms): 8.53 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.11 MB - BytesReceived: 10.20 MB (10696501) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 71.546ms - FirstBatchArrivalWaitTime: 1s712ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:368 (host=vd1122.foo:22000):(Total: 63.914ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 893.83 MB, 6.46 GB, 13.65 GB, 20.57 GB, 27.30 GB, 34.01 GB, 40.85 GB, 47.68 GB, 54.27 GB, 60.72 GB, 67.02 GB, 73.42 GB, 80.28 GB, 86.87 GB, 93.07 GB, 99.80 GB, 106.32 GB, 112.99 GB, 119.06 GB, 125.16 GB, 131.45 GB, 135.57 GB, 140.41 GB, 146.03 GB, 150.80 GB, 154.43 GB, 156.47 GB, 152.60 GB, 155.67 GB, 156.52 GB, 159.02 GB, 151.61 GB, 151.06 GB, 153.69 GB, 154.93 GB, 152.48 GB, 153.37 GB, 154.07 GB, 153.81 GB, 156.03 GB ThreadUsage(16s000ms): 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.03 - BloomFilterBytes: 49.00 MB (51380224) - PeakMemoryUsage: 160.99 GB (172865348207) - PerHostPeakMemUsage: 169.55 GB (182053628868) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 1m39s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 1.44K (1442) - TotalThreadsTotalWallClockTime: 22s532ms - TotalThreadsSysTime: 2s291ms - TotalThreadsUserTime: 7s917ms - TotalThreadsVoluntaryContextSwitches: 23.19K (23187) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 63.836ms - ExecTreePrepareTime: 1.010ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 24.15K (24150) - BlocksRecycled: 354 (354) - BufferedPins: 0 (0) - BytesWritten: 42.53 GB (45667581952) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 161.38 GB (173283483648) - ScratchFileUsedBytes: 42.53 GB (45667581952) - TotalBufferWaitTime: 2s598ms - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=28):(Total: 1.058ms, non-child: 1.058ms, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.05 MB (1105280) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 630.535ms, non-child: 630.535ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 216.230ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 122 (122) - NumInstructions: 8.95K (8951) - OptimizationTime: 385.821ms - PeakMemoryUsage: 4.37 MB (4582912) - PrepareTime: 27.928ms HASH_JOIN_NODE (id=15):(Total: 1.917ms, non-child: 1.210ms, % non-child: 63.16%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 451.92K (451915) - BuildTime: 141.772ms - PeakMemoryUsage: 153.09 MB (160524544) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=15): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 107.685ms - BuildRowsPartitioned: 451.92K (451915) - GetNewBlockTime: 371.195us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 31.119ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160449664) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=26):(Total: 2s027ms, non-child: 29.790ms, % non-child: 1.47%) BytesReceived(16s000ms): 5.33 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB - BytesReceived: 6.21 MB (6513198) - ConvertRowBatchTime: 13.364ms - DeserializeRowBatchTimer: 58.194ms - FirstBatchArrivalWaitTime: 1s174ms - PeakMemoryUsage: 0 - RowsReturned: 451.92K (451915) - RowsReturnedRate: 222.91 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=14):(Total: 1.457ms, non-child: 1.102ms, % non-child: 75.64%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 459.51K (459511) - BuildTime: 165.663ms - PeakMemoryUsage: 25.08 MB (26298624) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 104.445ms - BuildRowsPartitioned: 459.51K (459511) - GetNewBlockTime: 151.210us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 23.842ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 25.02 MB (26231936) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 4s152ms, non-child: 16.125ms, % non-child: 0.39%) BytesReceived(16s000ms): 5.79 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB - BytesReceived: 7.34 MB (7696608) - ConvertRowBatchTime: 12.484ms - DeserializeRowBatchTimer: 16.663ms - FirstBatchArrivalWaitTime: 2s080ms - PeakMemoryUsage: 0 - RowsReturned: 459.51K (459511) - RowsReturnedRate: 110.66 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=13):(Total: 1.022ms, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 3.97B (3973954132) - BuildTime: 6m38s - PeakMemoryUsage: 158.71 GB (170416900352) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled, Spilled Runtime filters: 0 of 1 Runtime Filter Published, 1 Disabled - BuildRowsPartitionTime: 6m38s - BuildRowsPartitioned: 3.97B (3973954132) - GetNewBlockTime: 50s862ms - HashBuckets: 536.87M (536870912) - HashCollisions: 0 (0) - HashTablesBuildTime: 52s605ms - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 158.71 GB (170416841856) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 4 (4) - UnpinTime: 310.021ms HASH_JOIN_NODE (id=12):(Total: 2m49s, non-child: 1m16s, % non-child: 45.20%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 40.22M (40215191) - BuildTime: 8s369ms - PeakMemoryUsage: 3.02 GB (3240188718) - ProbeRows: 74.50M (74504709) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1m7s - RowsReturned: 3.97B (3973954132) - RowsReturnedRate: 23.41 M/sec Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 5s481ms - BuildRowsPartitioned: 40.22M (40215191) - GetNewBlockTime: 2.794ms - HashBuckets: 67.11M (67108864) - HashCollisions: 0 (0) - HashTablesBuildTime: 2s839ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 3.02 GB (3240125568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 7s588ms, non-child: 1s659ms, % non-child: 21.87%) BytesReceived(16s000ms): 207.19 MB, 380.85 MB, 380.85 MB, 380.85 MB, 380.85 MB, 380.85 MB, 380.85 MB, 380.85 MB, 380.85 MB, 380.85 MB, 380.85 MB, 380.85 MB, 380.85 MB, 380.85 MB, 380.85 MB, 380.85 MB, 380.85 MB, 380.85 MB, 380.85 MB, 380.85 MB, 380.85 MB, 380.85 MB, 380.85 MB, 380.85 MB, 380.85 MB, 380.85 MB, 380.85 MB, 380.85 MB, 380.85 MB, 380.85 MB, 380.85 MB, 380.85 MB, 380.85 MB, 380.85 MB, 380.85 MB, 380.85 MB, 380.85 MB, 380.85 MB, 380.85 MB, 380.85 MB - BytesReceived: 380.85 MB (399346368) - ConvertRowBatchTime: 983.800ms - DeserializeRowBatchTimer: 1s716ms - FirstBatchArrivalWaitTime: 1s104ms - PeakMemoryUsage: 0 - RowsReturned: 40.22M (40215191) - RowsReturnedRate: 5.30 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=22):(Total: 1m26s, non-child: 1s290ms, % non-child: 1.50%) BytesReceived(16s000ms): 2.09 MB, 15.00 MB, 41.40 MB, 66.89 MB, 93.17 MB, 119.47 MB, 146.16 MB, 172.99 MB, 198.33 MB, 223.43 MB, 248.01 MB, 273.32 MB, 299.64 MB, 325.45 MB, 349.39 MB, 375.88 MB, 401.06 MB, 427.88 MB, 450.69 MB, 475.10 MB, 498.42 MB, 514.93 MB, 533.34 MB, 555.45 MB, 573.53 MB, 587.75 MB, 609.15 MB, 624.72 MB, 636.62 MB, 641.38 MB, 650.58 MB, 663.05 MB, 667.75 MB, 677.32 MB, 685.64 MB, 689.61 MB, 689.61 MB, 689.61 MB, 689.61 MB, 689.61 MB - BytesReceived: 689.61 MB (723104596) - ConvertRowBatchTime: 844.898ms - DeserializeRowBatchTimer: 7s794ms - FirstBatchArrivalWaitTime: 755.567ms - PeakMemoryUsage: 0 - RowsReturned: 74.50M (74504709) - RowsReturnedRate: 864.43 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=24):(Total: 1s713ms, non-child: 4.537us, % non-child: 0.00%) BytesReceived(16s000ms): 8.51 MB, 10.43 MB, 10.43 MB, 10.43 MB, 10.43 MB, 10.43 MB, 10.43 MB, 10.43 MB, 10.43 MB, 10.43 MB, 10.43 MB, 10.43 MB, 10.43 MB, 10.43 MB, 10.43 MB, 10.43 MB, 10.43 MB, 10.43 MB, 10.43 MB, 10.43 MB, 10.43 MB, 10.43 MB, 10.43 MB, 10.43 MB, 10.43 MB, 10.43 MB, 10.43 MB, 10.43 MB, 10.43 MB, 10.43 MB, 10.43 MB, 10.43 MB, 10.43 MB, 10.43 MB, 10.43 MB, 10.43 MB, 10.43 MB, 10.47 MB, 10.55 MB, 10.55 MB - BytesReceived: 10.86 MB (11390498) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 74.966ms - FirstBatchArrivalWaitTime: 1s713ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:322 (host=va1038.foo:22000):(Total: 63.859ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 995.64 MB, 7.00 GB, 13.85 GB, 20.33 GB, 27.04 GB, 33.74 GB, 40.51 GB, 47.25 GB, 53.57 GB, 59.95 GB, 66.11 GB, 72.43 GB, 79.13 GB, 85.37 GB, 91.64 GB, 98.25 GB, 104.73 GB, 110.94 GB, 117.42 GB, 123.57 GB, 129.66 GB, 133.76 GB, 138.37 GB, 143.96 GB, 148.63 GB, 151.89 GB, 156.55 GB, 156.45 GB, 153.37 GB, 154.47 GB, 156.51 GB, 159.63 GB, 155.92 GB, 151.32 GB, 152.87 GB, 156.70 GB, 152.06 GB, 153.30 GB, 150.98 GB, 152.29 GB ThreadUsage(16s000ms): 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.03 - BloomFilterBytes: 49.00 MB (51380224) - PeakMemoryUsage: 160.99 GB (172866903167) - PerHostPeakMemUsage: 169.57 GB (182069396571) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 2m33s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 1.35K (1346) - TotalThreadsTotalWallClockTime: 21s616ms - TotalThreadsSysTime: 2s146ms - TotalThreadsUserTime: 7s937ms - TotalThreadsVoluntaryContextSwitches: 23.22K (23223) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 63.790ms - ExecTreePrepareTime: 975.776us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 23.45K (23455) - BlocksRecycled: 563 (563) - BufferedPins: 0 (0) - BytesWritten: 37.10 GB (39837499392) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 161.38 GB (173283483648) - ScratchFileUsedBytes: 37.10 GB (39837499392) - TotalBufferWaitTime: 3s142ms - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=28):(Total: 1.127ms, non-child: 1.127ms, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.05 MB (1105280) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 625.123ms, non-child: 625.123ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 204.505ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 122 (122) - NumInstructions: 8.95K (8951) - OptimizationTime: 392.646ms - PeakMemoryUsage: 4.37 MB (4582912) - PrepareTime: 27.436ms HASH_JOIN_NODE (id=15):(Total: 1.849ms, non-child: 965.940us, % non-child: 52.24%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 451.92K (451915) - BuildTime: 128.774ms - PeakMemoryUsage: 153.09 MB (160524544) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=15): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 95.817ms - BuildRowsPartitioned: 451.92K (451915) - GetNewBlockTime: 367.867us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 30.279ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160449664) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=26):(Total: 2s068ms, non-child: 32.452ms, % non-child: 1.57%) BytesReceived(16s000ms): 5.38 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB - BytesReceived: 6.21 MB (6513198) - ConvertRowBatchTime: 12.005ms - DeserializeRowBatchTimer: 62.586ms - FirstBatchArrivalWaitTime: 1s199ms - PeakMemoryUsage: 0 - RowsReturned: 451.92K (451915) - RowsReturnedRate: 218.52 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=14):(Total: 1.421ms, non-child: 1.015ms, % non-child: 71.42%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 459.41K (459408) - BuildTime: 167.000ms - PeakMemoryUsage: 25.08 MB (26298624) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 102.158ms - BuildRowsPartitioned: 459.41K (459408) - GetNewBlockTime: 253.326us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 29.484ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 25.02 MB (26231936) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 4s115ms, non-child: 15.312ms, % non-child: 0.37%) BytesReceived(16s000ms): 5.81 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB - BytesReceived: 7.34 MB (7694796) - ConvertRowBatchTime: 11.348ms - DeserializeRowBatchTimer: 16.430ms - FirstBatchArrivalWaitTime: 2s105ms - PeakMemoryUsage: 0 - RowsReturned: 459.41K (459408) - RowsReturnedRate: 111.63 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=13):(Total: 1.019ms, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 3.92B (3917904194) - BuildTime: 5m46s - PeakMemoryUsage: 160.55 GB (172387633408) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled, Spilled Runtime filters: 0 of 1 Runtime Filter Published, 1 Disabled - BuildRowsPartitionTime: 5m46s - BuildRowsPartitioned: 3.92B (3917904194) - GetNewBlockTime: 23s059ms - HashBuckets: 536.87M (536870912) - HashCollisions: 0 (0) - HashTablesBuildTime: 52s375ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 160.55 GB (172387574912) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 4 (4) - UnpinTime: 298.768ms HASH_JOIN_NODE (id=12):(Total: 3m38s, non-child: 1m12s, % non-child: 33.01%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 40.18M (40179592) - BuildTime: 8s241ms - PeakMemoryUsage: 3.02 GB (3240188982) - ProbeRows: 73.86M (73858856) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1m3s - RowsReturned: 3.92B (3917904194) - RowsReturnedRate: 17.90 M/sec Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 5s588ms - BuildRowsPartitioned: 40.18M (40179592) - GetNewBlockTime: 3.412ms - HashBuckets: 67.11M (67108864) - HashCollisions: 0 (0) - HashTablesBuildTime: 2s603ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 3.02 GB (3240125568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 6s805ms, non-child: 1s741ms, % non-child: 25.59%) BytesReceived(16s000ms): 209.87 MB, 380.51 MB, 380.51 MB, 380.51 MB, 380.51 MB, 380.51 MB, 380.51 MB, 380.51 MB, 380.51 MB, 380.51 MB, 380.51 MB, 380.51 MB, 380.51 MB, 380.51 MB, 380.51 MB, 380.51 MB, 380.51 MB, 380.51 MB, 380.51 MB, 380.51 MB, 380.51 MB, 380.51 MB, 380.51 MB, 380.51 MB, 380.51 MB, 380.51 MB, 380.51 MB, 380.51 MB, 380.51 MB, 380.51 MB, 380.51 MB, 380.51 MB, 380.51 MB, 380.51 MB, 380.51 MB, 380.51 MB, 380.51 MB, 380.51 MB, 380.51 MB, 380.51 MB - BytesReceived: 380.51 MB (398991191) - ConvertRowBatchTime: 975.789ms - DeserializeRowBatchTimer: 1s832ms - FirstBatchArrivalWaitTime: 1s125ms - PeakMemoryUsage: 0 - RowsReturned: 40.18M (40179592) - RowsReturnedRate: 5.90 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=22):(Total: 2m20s, non-child: 1s294ms, % non-child: 0.92%) BytesReceived(16s000ms): 2.09 MB, 14.91 MB, 40.92 MB, 66.19 MB, 92.40 MB, 118.60 MB, 145.14 MB, 171.56 MB, 196.54 MB, 221.43 MB, 245.68 MB, 270.76 MB, 296.91 MB, 322.59 MB, 346.29 MB, 372.63 MB, 397.66 MB, 424.24 MB, 446.87 MB, 471.13 MB, 494.09 MB, 510.49 MB, 528.86 MB, 550.69 MB, 568.65 MB, 581.02 MB, 600.20 MB, 616.48 MB, 630.53 MB, 634.99 MB, 643.34 MB, 656.75 MB, 662.48 MB, 671.78 MB, 680.06 MB, 684.19 MB, 684.20 MB, 684.20 MB, 684.20 MB, 684.20 MB - BytesReceived: 684.20 MB (717431247) - ConvertRowBatchTime: 844.614ms - DeserializeRowBatchTimer: 5s712ms - FirstBatchArrivalWaitTime: 783.562ms - PeakMemoryUsage: 0 - RowsReturned: 73.86M (73858856) - RowsReturnedRate: 525.35 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=24):(Total: 1s724ms, non-child: 3.395us, % non-child: 0.00%) BytesReceived(16s000ms): 8.33 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.15 MB, 10.20 MB, 10.21 MB - BytesReceived: 10.24 MB (10733722) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 73.137ms - FirstBatchArrivalWaitTime: 1s724ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:315 (host=ve1130.foo:22000):(Total: 63.505ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 1000.96 MB, 7.17 GB, 14.16 GB, 20.74 GB, 27.51 GB, 34.26 GB, 41.05 GB, 47.83 GB, 54.22 GB, 60.65 GB, 66.92 GB, 73.31 GB, 80.09 GB, 87.14 GB, 93.09 GB, 100.06 GB, 106.57 GB, 113.44 GB, 119.28 GB, 125.47 GB, 131.61 GB, 136.00 GB, 140.69 GB, 146.36 GB, 150.99 GB, 154.25 GB, 156.69 GB, 152.05 GB, 155.34 GB, 156.22 GB, 158.51 GB, 152.52 GB, 151.19 GB, 153.34 GB, 154.94 GB, 150.61 GB, 151.47 GB, 154.20 GB, 154.21 GB, 154.23 GB ThreadUsage(16s000ms): 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.03 - BloomFilterBytes: 49.00 MB (51380224) - PeakMemoryUsage: 160.61 GB (172448858095) - PerHostPeakMemUsage: 169.56 GB (182064299158) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 2m18s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 1.59K (1587) - TotalThreadsTotalWallClockTime: 21s929ms - TotalThreadsSysTime: 2s224ms - TotalThreadsUserTime: 8s100ms - TotalThreadsVoluntaryContextSwitches: 22.80K (22805) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 63.460ms - ExecTreePrepareTime: 626.437us DataStreamSender (dst_id=28):(Total: 1.103ms, non-child: 1.103ms, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.05 MB (1105280) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 642.451ms, non-child: 642.451ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 203.222ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 122 (122) - NumInstructions: 8.95K (8951) - OptimizationTime: 411.528ms - PeakMemoryUsage: 4.37 MB (4582912) - PrepareTime: 27.158ms HASH_JOIN_NODE (id=15):(Total: 1.179ms, non-child: 865.345us, % non-child: 73.37%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 451.92K (451915) - BuildTime: 129.842ms - PeakMemoryUsage: 153.09 MB (160524544) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=15): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 92.395ms - BuildRowsPartitioned: 451.92K (451915) - GetNewBlockTime: 375.799us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 34.600ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160449664) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=26):(Total: 2s048ms, non-child: 23.408ms, % non-child: 1.14%) BytesReceived(16s000ms): 5.40 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB - BytesReceived: 6.21 MB (6513198) - ConvertRowBatchTime: 11.562ms - DeserializeRowBatchTimer: 48.896ms - FirstBatchArrivalWaitTime: 1s185ms - PeakMemoryUsage: 0 - RowsReturned: 451.92K (451915) - RowsReturnedRate: 220.59 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=14):(Total: 926.329us, non-child: 869.036us, % non-child: 93.82%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 458.60K (458604) - BuildTime: 156.092ms - PeakMemoryUsage: 25.08 MB (26298624) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 92.128ms - BuildRowsPartitioned: 458.60K (458604) - GetNewBlockTime: 286.708us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 24.393ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 25.02 MB (26231936) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 4s103ms, non-child: 15.311ms, % non-child: 0.37%) BytesReceived(16s000ms): 5.83 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB - BytesReceived: 7.33 MB (7682665) - ConvertRowBatchTime: 11.561ms - DeserializeRowBatchTimer: 15.933ms - FirstBatchArrivalWaitTime: 2s097ms - PeakMemoryUsage: 0 - RowsReturned: 458.60K (458604) - RowsReturnedRate: 111.77 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=13):(Total: 651.759us, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 3.97B (3972224615) - BuildTime: 5m53s - PeakMemoryUsage: 157.31 GB (168914159840) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled, Spilled Runtime filters: 0 of 1 Runtime Filter Published, 1 Disabled - BuildRowsPartitionTime: 5m53s - BuildRowsPartitioned: 3.97B (3972224615) - GetNewBlockTime: 31s278ms - HashBuckets: 536.87M (536870912) - HashCollisions: 0 (0) - HashTablesBuildTime: 22s827ms - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 157.31 GB (168914068608) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 4 (4) - UnpinTime: 258.594ms HASH_JOIN_NODE (id=12):(Total: 3m28s, non-child: 1m16s, % non-child: 36.88%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 40.15M (40148745) - BuildTime: 8s549ms - PeakMemoryUsage: 3.02 GB (3240188608) - ProbeRows: 74.75M (74753390) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1m7s - RowsReturned: 3.97B (3972224615) - RowsReturnedRate: 19.06 M/sec Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 5s512ms - BuildRowsPartitioned: 40.15M (40148745) - GetNewBlockTime: 4.253ms - HashBuckets: 67.11M (67108864) - HashCollisions: 0 (0) - HashTablesBuildTime: 2s986ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 3.02 GB (3240125568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 6s855ms, non-child: 1s541ms, % non-child: 22.49%) BytesReceived(16s000ms): 213.16 MB, 380.23 MB, 380.23 MB, 380.23 MB, 380.23 MB, 380.23 MB, 380.23 MB, 380.23 MB, 380.23 MB, 380.23 MB, 380.23 MB, 380.23 MB, 380.23 MB, 380.23 MB, 380.23 MB, 380.23 MB, 380.23 MB, 380.23 MB, 380.23 MB, 380.23 MB, 380.23 MB, 380.23 MB, 380.23 MB, 380.23 MB, 380.23 MB, 380.23 MB, 380.23 MB, 380.23 MB, 380.23 MB, 380.23 MB, 380.23 MB, 380.23 MB, 380.23 MB, 380.23 MB, 380.23 MB, 380.23 MB, 380.23 MB, 380.23 MB, 380.23 MB, 380.23 MB - BytesReceived: 380.23 MB (398701386) - ConvertRowBatchTime: 948.452ms - DeserializeRowBatchTimer: 1s544ms - FirstBatchArrivalWaitTime: 1s109ms - PeakMemoryUsage: 0 - RowsReturned: 40.15M (40148745) - RowsReturnedRate: 5.86 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=22):(Total: 2m5s, non-child: 2s126ms, % non-child: 1.70%) BytesReceived(16s000ms): 2.17 MB, 15.53 MB, 42.07 MB, 67.77 MB, 94.22 MB, 120.60 MB, 147.14 MB, 173.78 MB, 198.91 MB, 224.10 MB, 248.71 MB, 274.07 MB, 300.79 MB, 328.37 MB, 352.07 MB, 379.05 MB, 404.19 MB, 431.12 MB, 453.73 MB, 479.28 MB, 501.53 MB, 518.47 MB, 537.19 MB, 559.20 MB, 576.95 MB, 589.33 MB, 609.12 MB, 625.06 MB, 638.33 MB, 642.87 MB, 651.61 MB, 664.57 MB, 669.84 MB, 678.76 MB, 687.43 MB, 692.45 MB, 692.46 MB, 692.46 MB, 692.46 MB, 692.46 MB - BytesReceived: 692.46 MB (726093631) - ConvertRowBatchTime: 860.438ms - DeserializeRowBatchTimer: 7s913ms - FirstBatchArrivalWaitTime: 771.424ms - PeakMemoryUsage: 0 - RowsReturned: 74.75M (74753390) - RowsReturnedRate: 596.00 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=24):(Total: 1s708ms, non-child: 4.879us, % non-child: 0.00%) BytesReceived(16s000ms): 8.60 MB, 10.24 MB, 10.24 MB, 10.24 MB, 10.24 MB, 10.24 MB, 10.24 MB, 10.24 MB, 10.24 MB, 10.24 MB, 10.24 MB, 10.24 MB, 10.24 MB, 10.24 MB, 10.24 MB, 10.24 MB, 10.24 MB, 10.24 MB, 10.24 MB, 10.24 MB, 10.24 MB, 10.24 MB, 10.24 MB, 10.24 MB, 10.24 MB, 10.24 MB, 10.24 MB, 10.24 MB, 10.24 MB, 10.24 MB, 10.24 MB, 10.24 MB, 10.24 MB, 10.24 MB, 10.24 MB, 10.24 MB, 10.24 MB, 10.26 MB, 10.35 MB, 10.37 MB - BytesReceived: 10.48 MB (10985731) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 73.456ms - FirstBatchArrivalWaitTime: 1s708ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:2e9 (host=vd1141.foo:22000):(Total: 63.417ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 1.00 GB, 7.26 GB, 14.09 GB, 20.66 GB, 27.42 GB, 34.20 GB, 41.07 GB, 47.94 GB, 54.39 GB, 60.85 GB, 67.10 GB, 73.61 GB, 80.43 GB, 86.96 GB, 93.04 GB, 99.94 GB, 106.44 GB, 113.36 GB, 119.32 GB, 125.63 GB, 131.65 GB, 135.76 GB, 140.97 GB, 146.91 GB, 151.47 GB, 154.62 GB, 156.17 GB, 153.19 GB, 156.31 GB, 157.22 GB, 158.60 GB, 151.52 GB, 152.29 GB, 154.69 GB, 156.27 GB, 152.09 GB, 151.96 GB, 151.90 GB, 155.94 GB, 152.81 GB ThreadUsage(16s000ms): 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.03 - BloomFilterBytes: 49.00 MB (51380224) - PeakMemoryUsage: 160.60 GB (172446593333) - PerHostPeakMemUsage: 169.58 GB (182081720861) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 2m27s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 1.73K (1726) - TotalThreadsTotalWallClockTime: 21s583ms - TotalThreadsSysTime: 2s176ms - TotalThreadsUserTime: 7s907ms - TotalThreadsVoluntaryContextSwitches: 22.23K (22226) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 63.307ms - ExecTreePrepareTime: 945.450us DataStreamSender (dst_id=28):(Total: 1.063ms, non-child: 1.063ms, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.05 MB (1105280) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 657.249ms, non-child: 657.249ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 204.340ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 122 (122) - NumInstructions: 8.95K (8951) - OptimizationTime: 424.461ms - PeakMemoryUsage: 4.37 MB (4582912) - PrepareTime: 27.618ms HASH_JOIN_NODE (id=15):(Total: 1.783ms, non-child: 1.199ms, % non-child: 67.27%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 451.92K (451915) - BuildTime: 153.280ms - PeakMemoryUsage: 153.09 MB (160524544) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=15): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 104.498ms - BuildRowsPartitioned: 451.92K (451915) - GetNewBlockTime: 548.073us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 46.743ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160449664) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=26):(Total: 2s044ms, non-child: 25.003ms, % non-child: 1.22%) BytesReceived(16s000ms): 5.40 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB - BytesReceived: 6.21 MB (6513198) - ConvertRowBatchTime: 12.177ms - DeserializeRowBatchTimer: 55.292ms - FirstBatchArrivalWaitTime: 1s181ms - PeakMemoryUsage: 0 - RowsReturned: 451.92K (451915) - RowsReturnedRate: 221.06 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=14):(Total: 1.228ms, non-child: 1.089ms, % non-child: 88.73%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 457.93K (457925) - BuildTime: 157.972ms - PeakMemoryUsage: 25.08 MB (26298624) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 94.916ms - BuildRowsPartitioned: 457.93K (457925) - GetNewBlockTime: 419.894us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 24.222ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 25.02 MB (26231936) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 4s069ms, non-child: 14.828ms, % non-child: 0.36%) BytesReceived(16s000ms): 5.82 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB - BytesReceived: 7.32 MB (7670943) - ConvertRowBatchTime: 10.792ms - DeserializeRowBatchTimer: 16.023ms - FirstBatchArrivalWaitTime: 2s088ms - PeakMemoryUsage: 0 - RowsReturned: 457.93K (457925) - RowsReturnedRate: 112.53 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=13):(Total: 752.192us, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 3.97B (3974730837) - BuildTime: 5m50s - PeakMemoryUsage: 158.74 GB (170450454784) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled, Spilled Runtime filters: 0 of 1 Runtime Filter Published, 1 Disabled - BuildRowsPartitionTime: 5m50s - BuildRowsPartitioned: 3.97B (3974730837) - GetNewBlockTime: 42s959ms - HashBuckets: 1.07B (1073741824) - HashCollisions: 0 (0) - HashTablesBuildTime: 58s928ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 158.74 GB (170450396288) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 5 (5) - UnpinTime: 280.762ms HASH_JOIN_NODE (id=12):(Total: 3m34s, non-child: 1m13s, % non-child: 34.17%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 40.16M (40155928) - BuildTime: 8s337ms - PeakMemoryUsage: 3.02 GB (3240189078) - ProbeRows: 74.78M (74781834) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1m4s - RowsReturned: 3.97B (3974730837) - RowsReturnedRate: 18.56 M/sec Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 5s582ms - BuildRowsPartitioned: 40.16M (40155928) - GetNewBlockTime: 2.902ms - HashBuckets: 67.11M (67108864) - HashCollisions: 0 (0) - HashTablesBuildTime: 2s701ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 3.02 GB (3240125568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 6s731ms, non-child: 1s480ms, % non-child: 21.99%) BytesReceived(16s000ms): 213.03 MB, 380.29 MB, 380.29 MB, 380.29 MB, 380.29 MB, 380.29 MB, 380.29 MB, 380.29 MB, 380.29 MB, 380.29 MB, 380.29 MB, 380.29 MB, 380.29 MB, 380.29 MB, 380.29 MB, 380.29 MB, 380.29 MB, 380.29 MB, 380.29 MB, 380.29 MB, 380.29 MB, 380.29 MB, 380.29 MB, 380.29 MB, 380.29 MB, 380.29 MB, 380.29 MB, 380.29 MB, 380.29 MB, 380.29 MB, 380.29 MB, 380.29 MB, 380.29 MB, 380.29 MB, 380.29 MB, 380.29 MB, 380.29 MB, 380.29 MB, 380.29 MB, 380.29 MB - BytesReceived: 380.29 MB (398768071) - ConvertRowBatchTime: 951.125ms - DeserializeRowBatchTimer: 1s440ms - FirstBatchArrivalWaitTime: 1s108ms - PeakMemoryUsage: 0 - RowsReturned: 40.16M (40155928) - RowsReturnedRate: 5.97 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=22):(Total: 2m14s, non-child: 1s267ms, % non-child: 0.94%) BytesReceived(16s000ms): 2.14 MB, 15.44 MB, 41.78 MB, 67.36 MB, 93.78 MB, 120.26 MB, 147.10 MB, 173.99 MB, 199.21 MB, 224.41 MB, 249.04 MB, 274.54 MB, 300.98 MB, 326.83 MB, 350.85 MB, 377.64 MB, 402.99 MB, 430.01 MB, 452.81 MB, 477.38 MB, 500.46 MB, 517.02 MB, 537.99 MB, 560.94 MB, 578.14 MB, 590.65 MB, 610.85 MB, 626.67 MB, 638.97 MB, 643.66 MB, 652.74 MB, 665.46 MB, 670.30 MB, 679.76 MB, 688.16 MB, 692.41 MB, 692.41 MB, 692.41 MB, 692.41 MB, 692.41 MB - BytesReceived: 692.41 MB (726043034) - ConvertRowBatchTime: 818.405ms - DeserializeRowBatchTimer: 10s385ms - FirstBatchArrivalWaitTime: 768.387ms - PeakMemoryUsage: 0 - RowsReturned: 74.78M (74781834) - RowsReturnedRate: 554.02 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=24):(Total: 1s703ms, non-child: 4.045us, % non-child: 0.00%) BytesReceived(16s000ms): 8.74 MB, 10.42 MB, 10.42 MB, 10.42 MB, 10.42 MB, 10.42 MB, 10.42 MB, 10.42 MB, 10.42 MB, 10.42 MB, 10.42 MB, 10.42 MB, 10.42 MB, 10.42 MB, 10.42 MB, 10.42 MB, 10.42 MB, 10.42 MB, 10.42 MB, 10.42 MB, 10.42 MB, 10.42 MB, 10.42 MB, 10.42 MB, 10.42 MB, 10.42 MB, 10.42 MB, 10.42 MB, 10.42 MB, 10.42 MB, 10.42 MB, 10.42 MB, 10.42 MB, 10.42 MB, 10.42 MB, 10.42 MB, 10.42 MB, 10.46 MB, 10.57 MB, 10.57 MB - BytesReceived: 10.83 MB (11357405) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 84.473ms - FirstBatchArrivalWaitTime: 1s703ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:2f5 (host=vc1540.foo:22000):(Total: 63.244ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 1.04 GB, 7.15 GB, 14.13 GB, 20.71 GB, 27.52 GB, 34.31 GB, 41.13 GB, 47.96 GB, 54.56 GB, 61.32 GB, 67.59 GB, 74.09 GB, 80.88 GB, 87.26 GB, 93.54 GB, 100.36 GB, 106.84 GB, 113.57 GB, 119.74 GB, 125.96 GB, 132.09 GB, 136.43 GB, 141.15 GB, 146.83 GB, 151.50 GB, 154.81 GB, 156.59 GB, 153.01 GB, 156.36 GB, 157.23 GB, 159.57 GB, 150.97 GB, 152.06 GB, 154.51 GB, 156.02 GB, 152.52 GB, 152.90 GB, 153.07 GB, 153.78 GB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.03 - BloomFilterBytes: 49.00 MB (51380224) - PeakMemoryUsage: 160.60 GB (172445138095) - PerHostPeakMemUsage: 169.58 GB (182081361196) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 2m5s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 1.56K (1564) - TotalThreadsTotalWallClockTime: 21s644ms - TotalThreadsSysTime: 2s284ms - TotalThreadsUserTime: 7s973ms - TotalThreadsVoluntaryContextSwitches: 21.32K (21321) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 63.197ms - ExecTreePrepareTime: 633.810us DataStreamSender (dst_id=28):(Total: 1.002ms, non-child: 1.002ms, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.05 MB (1105280) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 653.173ms, non-child: 653.173ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 199.613ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 122 (122) - NumInstructions: 8.95K (8951) - OptimizationTime: 425.772ms - PeakMemoryUsage: 4.37 MB (4582912) - PrepareTime: 27.273ms HASH_JOIN_NODE (id=15):(Total: 1.201ms, non-child: 932.842us, % non-child: 77.66%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 451.92K (451915) - BuildTime: 131.730ms - PeakMemoryUsage: 153.09 MB (160524544) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=15): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 97.808ms - BuildRowsPartitioned: 451.92K (451915) - GetNewBlockTime: 307.218us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 31.856ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160449664) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=26):(Total: 2s050ms, non-child: 25.831ms, % non-child: 1.26%) BytesReceived(16s000ms): 5.46 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB - BytesReceived: 6.21 MB (6513198) - ConvertRowBatchTime: 11.975ms - DeserializeRowBatchTimer: 48.462ms - FirstBatchArrivalWaitTime: 1s184ms - PeakMemoryUsage: 0 - RowsReturned: 451.92K (451915) - RowsReturnedRate: 220.40 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=14):(Total: 913.965us, non-child: 743.944us, % non-child: 81.40%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 458.67K (458672) - BuildTime: 146.952ms - PeakMemoryUsage: 25.08 MB (26298624) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 72.525ms - BuildRowsPartitioned: 458.67K (458672) - GetNewBlockTime: 211.133us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 31.292ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 25.02 MB (26231936) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 4s098ms, non-child: 11.278ms, % non-child: 0.28%) BytesReceived(16s000ms): 5.96 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB - BytesReceived: 7.33 MB (7682912) - ConvertRowBatchTime: 8.438ms - DeserializeRowBatchTimer: 16.156ms - FirstBatchArrivalWaitTime: 2s087ms - PeakMemoryUsage: 0 - RowsReturned: 458.67K (458672) - RowsReturnedRate: 111.90 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=13):(Total: 592.819us, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 3.99B (3985106144) - BuildTime: 6m12s - PeakMemoryUsage: 157.31 GB (168914159840) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled, Spilled Runtime filters: 0 of 1 Runtime Filter Published, 1 Disabled - BuildRowsPartitionTime: 6m11s - BuildRowsPartitioned: 3.99B (3985106144) - GetNewBlockTime: 43s501ms - HashBuckets: 536.87M (536870912) - HashCollisions: 0 (0) - HashTablesBuildTime: 55s940ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 157.31 GB (168914068608) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 4 (4) - UnpinTime: 287.795ms HASH_JOIN_NODE (id=12):(Total: 3m10s, non-child: 1m11s, % non-child: 37.53%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 40.18M (40175972) - BuildTime: 8s487ms - PeakMemoryUsage: 3.02 GB (3240195748) - ProbeRows: 74.93M (74932777) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1m2s - RowsReturned: 3.99B (3985106144) - RowsReturnedRate: 20.95 M/sec Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 5s684ms - BuildRowsPartitioned: 40.18M (40175972) - GetNewBlockTime: 3.640ms - HashBuckets: 67.11M (67108864) - HashCollisions: 0 (0) - HashTablesBuildTime: 2s751ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 3.02 GB (3240125568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 6s622ms, non-child: 1s533ms, % non-child: 23.15%) BytesReceived(16s000ms): 216.56 MB, 380.49 MB, 380.49 MB, 380.49 MB, 380.49 MB, 380.49 MB, 380.49 MB, 380.49 MB, 380.49 MB, 380.49 MB, 380.49 MB, 380.49 MB, 380.49 MB, 380.49 MB, 380.49 MB, 380.49 MB, 380.49 MB, 380.49 MB, 380.49 MB, 380.49 MB, 380.49 MB, 380.49 MB, 380.49 MB, 380.49 MB, 380.49 MB, 380.49 MB, 380.49 MB, 380.49 MB, 380.49 MB, 380.49 MB, 380.49 MB, 380.49 MB, 380.49 MB, 380.49 MB, 380.49 MB, 380.49 MB, 380.49 MB, 380.49 MB, 380.49 MB - BytesReceived: 380.49 MB (398969293) - ConvertRowBatchTime: 924.163ms - DeserializeRowBatchTimer: 1s518ms - FirstBatchArrivalWaitTime: 1s106ms - PeakMemoryUsage: 0 - RowsReturned: 40.18M (40175972) - RowsReturnedRate: 6.07 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=22):(Total: 1m52s, non-child: 2s458ms, % non-child: 2.18%) BytesReceived(16s000ms): 2.11 MB, 15.66 MB, 42.18 MB, 67.87 MB, 94.44 MB, 120.95 MB, 147.73 MB, 174.55 MB, 200.68 MB, 226.50 MB, 251.26 MB, 276.78 MB, 303.27 MB, 329.16 MB, 352.98 MB, 379.79 MB, 404.92 MB, 431.77 MB, 454.57 MB, 480.15 MB, 502.69 MB, 519.64 MB, 538.35 MB, 560.34 MB, 578.36 MB, 590.76 MB, 610.56 MB, 626.53 MB, 640.06 MB, 644.64 MB, 653.27 MB, 666.26 MB, 671.55 MB, 680.25 MB, 688.88 MB, 693.97 MB, 693.97 MB, 693.97 MB, 693.97 MB - BytesReceived: 693.97 MB (727682958) - ConvertRowBatchTime: 844.302ms - DeserializeRowBatchTimer: 5s830ms - FirstBatchArrivalWaitTime: 784.115ms - PeakMemoryUsage: 0 - RowsReturned: 74.93M (74932777) - RowsReturnedRate: 663.23 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=24):(Total: 1s720ms, non-child: 3.299us, % non-child: 0.00%) BytesReceived(16s000ms): 8.60 MB, 10.19 MB, 10.19 MB, 10.19 MB, 10.19 MB, 10.19 MB, 10.19 MB, 10.19 MB, 10.19 MB, 10.19 MB, 10.19 MB, 10.19 MB, 10.19 MB, 10.19 MB, 10.19 MB, 10.19 MB, 10.19 MB, 10.19 MB, 10.19 MB, 10.19 MB, 10.19 MB, 10.19 MB, 10.19 MB, 10.19 MB, 10.19 MB, 10.19 MB, 10.19 MB, 10.19 MB, 10.19 MB, 10.19 MB, 10.19 MB, 10.19 MB, 10.19 MB, 10.19 MB, 10.19 MB, 10.19 MB, 10.19 MB, 10.19 MB, 10.19 MB - BytesReceived: 10.37 MB (10874358) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 70.655ms - FirstBatchArrivalWaitTime: 1s720ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:31f (host=va1028.foo:22000):(Total: 63.121ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 997.43 MB, 7.08 GB, 13.83 GB, 20.25 GB, 26.88 GB, 33.52 GB, 40.25 GB, 47.00 GB, 53.34 GB, 59.66 GB, 65.80 GB, 72.14 GB, 78.83 GB, 85.09 GB, 91.40 GB, 98.48 GB, 104.81 GB, 111.46 GB, 117.40 GB, 123.72 GB, 129.41 GB, 133.62 GB, 138.16 GB, 143.67 GB, 148.23 GB, 151.52 GB, 156.35 GB, 155.54 GB, 152.55 GB, 153.53 GB, 155.53 GB, 158.58 GB, 159.79 GB, 150.25 GB, 152.00 GB, 150.91 GB, 156.04 GB, 148.75 GB, 148.97 GB, 151.41 GB ThreadUsage(16s000ms): 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.03 - BloomFilterBytes: 49.00 MB (51380224) - PeakMemoryUsage: 160.60 GB (172444790655) - PerHostPeakMemUsage: 169.57 GB (182070306136) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 2m36s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 1.55K (1552) - TotalThreadsTotalWallClockTime: 21s798ms - TotalThreadsSysTime: 2s243ms - TotalThreadsUserTime: 8s087ms - TotalThreadsVoluntaryContextSwitches: 21.35K (21353) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 63.077ms - ExecTreePrepareTime: 629.099us DataStreamSender (dst_id=28):(Total: 1.024ms, non-child: 1.024ms, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.05 MB (1105280) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 636.637ms, non-child: 636.637ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 203.807ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 122 (122) - NumInstructions: 8.95K (8951) - OptimizationTime: 405.068ms - PeakMemoryUsage: 4.37 MB (4582912) - PrepareTime: 27.290ms HASH_JOIN_NODE (id=15):(Total: 1.206ms, non-child: 871.338us, % non-child: 72.22%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 451.92K (451915) - BuildTime: 123.727ms - PeakMemoryUsage: 153.09 MB (160524544) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=15): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 95.623ms - BuildRowsPartitioned: 451.92K (451915) - GetNewBlockTime: 677.933us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 25.152ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160449664) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=26):(Total: 2s054ms, non-child: 25.949ms, % non-child: 1.26%) BytesReceived(16s000ms): 5.38 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB - BytesReceived: 6.21 MB (6513198) - ConvertRowBatchTime: 12.606ms - DeserializeRowBatchTimer: 53.713ms - FirstBatchArrivalWaitTime: 1s189ms - PeakMemoryUsage: 0 - RowsReturned: 451.92K (451915) - RowsReturnedRate: 219.97 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=14):(Total: 978.156us, non-child: 747.888us, % non-child: 76.46%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 459.85K (459853) - BuildTime: 132.370ms - PeakMemoryUsage: 25.08 MB (26298624) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 78.807ms - BuildRowsPartitioned: 459.85K (459853) - GetNewBlockTime: 185.056us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 22.007ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 25.02 MB (26231936) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 4s134ms, non-child: 12.951ms, % non-child: 0.31%) BytesReceived(16s000ms): 5.83 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB - BytesReceived: 7.35 MB (7702657) - ConvertRowBatchTime: 9.286ms - DeserializeRowBatchTimer: 16.966ms - FirstBatchArrivalWaitTime: 2s095ms - PeakMemoryUsage: 0 - RowsReturned: 459.85K (459853) - RowsReturnedRate: 111.22 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=13):(Total: 676.649us, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 3.90B (3896499158) - BuildTime: 5m45s - PeakMemoryUsage: 160.16 GB (171968203008) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled, Spilled Runtime filters: 0 of 1 Runtime Filter Published, 1 Disabled - BuildRowsPartitionTime: 5m45s - BuildRowsPartitioned: 3.90B (3896499158) - GetNewBlockTime: 25s079ms - HashBuckets: 1.07B (1073741824) - HashCollisions: 0 (0) - HashTablesBuildTime: 1m15s - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 160.16 GB (171968144512) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 5 (5) - UnpinTime: 264.408ms HASH_JOIN_NODE (id=12):(Total: 3m38s, non-child: 1m8s, % non-child: 31.52%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 40.23M (40233224) - BuildTime: 8s565ms - PeakMemoryUsage: 3.02 GB (3240188128) - ProbeRows: 73.86M (73857536) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 59s399ms - RowsReturned: 3.90B (3896499158) - RowsReturnedRate: 17.86 M/sec Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 5s683ms - BuildRowsPartitioned: 40.23M (40233224) - GetNewBlockTime: 3.339ms - HashBuckets: 67.11M (67108864) - HashCollisions: 0 (0) - HashTablesBuildTime: 2s838ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 3.02 GB (3240125568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 6s683ms, non-child: 1s581ms, % non-child: 23.66%) BytesReceived(16s000ms): 211.16 MB, 381.03 MB, 381.03 MB, 381.03 MB, 381.03 MB, 381.03 MB, 381.03 MB, 381.03 MB, 381.03 MB, 381.03 MB, 381.03 MB, 381.03 MB, 381.03 MB, 381.03 MB, 381.03 MB, 381.03 MB, 381.03 MB, 381.03 MB, 381.03 MB, 381.03 MB, 381.03 MB, 381.03 MB, 381.03 MB, 381.03 MB, 381.03 MB, 381.03 MB, 381.03 MB, 381.03 MB, 381.03 MB, 381.03 MB, 381.03 MB, 381.03 MB, 381.03 MB, 381.03 MB, 381.03 MB, 381.03 MB, 381.03 MB, 381.03 MB, 381.03 MB, 381.03 MB - BytesReceived: 381.03 MB (399541821) - ConvertRowBatchTime: 946.933ms - DeserializeRowBatchTimer: 1s584ms - FirstBatchArrivalWaitTime: 1s110ms - PeakMemoryUsage: 0 - RowsReturned: 40.23M (40233224) - RowsReturnedRate: 6.02 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=22):(Total: 2m23s, non-child: 1s287ms, % non-child: 0.90%) BytesReceived(16s000ms): 2.13 MB, 15.18 MB, 41.22 MB, 66.43 MB, 92.52 MB, 118.66 MB, 145.09 MB, 171.62 MB, 196.70 MB, 221.61 MB, 245.88 MB, 270.94 MB, 297.07 MB, 322.61 MB, 347.31 MB, 374.81 MB, 399.67 MB, 426.19 MB, 448.56 MB, 473.69 MB, 495.59 MB, 512.31 MB, 530.66 MB, 552.32 MB, 569.95 MB, 582.41 MB, 602.18 MB, 617.87 MB, 630.73 MB, 635.28 MB, 644.03 MB, 656.68 MB, 661.73 MB, 670.65 MB, 679.06 MB, 683.80 MB, 683.81 MB, 683.81 MB, 683.81 MB, 683.81 MB - BytesReceived: 683.81 MB (717022539) - ConvertRowBatchTime: 810.591ms - DeserializeRowBatchTimer: 5s263ms - FirstBatchArrivalWaitTime: 776.171ms - PeakMemoryUsage: 0 - RowsReturned: 73.86M (73857536) - RowsReturnedRate: 514.84 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=24):(Total: 1s726ms, non-child: 3.875us, % non-child: 0.00%) BytesReceived(16s000ms): 8.05 MB, 9.74 MB, 9.74 MB, 9.74 MB, 9.74 MB, 9.74 MB, 9.74 MB, 9.74 MB, 9.74 MB, 9.74 MB, 9.74 MB, 9.74 MB, 9.74 MB, 9.74 MB, 9.74 MB, 9.74 MB, 9.74 MB, 9.74 MB, 9.74 MB, 9.74 MB, 9.74 MB, 9.74 MB, 9.74 MB, 9.74 MB, 9.74 MB, 9.74 MB, 9.74 MB, 9.74 MB, 9.74 MB, 9.74 MB, 9.74 MB, 9.74 MB, 9.74 MB, 9.74 MB, 9.74 MB, 9.74 MB, 9.74 MB, 9.74 MB, 9.74 MB, 9.74 MB - BytesReceived: 9.74 MB (10209837) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 69.394ms - FirstBatchArrivalWaitTime: 1s726ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:31c (host=ve1137.foo:22000):(Total: 62.881ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 991.04 MB, 7.14 GB, 14.15 GB, 20.79 GB, 27.63 GB, 34.49 GB, 41.43 GB, 48.41 GB, 54.89 GB, 61.40 GB, 67.72 GB, 74.23 GB, 81.06 GB, 87.59 GB, 93.77 GB, 100.62 GB, 107.78 GB, 114.97 GB, 120.80 GB, 127.32 GB, 133.28 GB, 137.70 GB, 142.39 GB, 148.11 GB, 152.79 GB, 155.89 GB, 156.08 GB, 153.87 GB, 157.03 GB, 157.96 GB, 157.33 GB, 151.94 GB, 153.22 GB, 155.43 GB, 157.06 GB, 153.67 GB, 154.48 GB, 154.58 GB, 154.21 GB, 154.52 GB ThreadUsage(16s000ms): 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.03 - BloomFilterBytes: 49.00 MB (51380224) - PeakMemoryUsage: 160.99 GB (172866365999) - PerHostPeakMemUsage: 169.56 GB (182058400847) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 2m6s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 1.86K (1864) - TotalThreadsTotalWallClockTime: 21s673ms - TotalThreadsSysTime: 2s199ms - TotalThreadsUserTime: 7s888ms - TotalThreadsVoluntaryContextSwitches: 21.84K (21845) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 62.837ms - ExecTreePrepareTime: 512.284us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 23.82K (23822) - BlocksRecycled: 354 (354) - BufferedPins: 0 (0) - BytesWritten: 39.97 GB (42916118528) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 161.38 GB (173283483648) - ScratchFileUsedBytes: 39.97 GB (42916118528) - TotalBufferWaitTime: 3s141ms - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=28):(Total: 766.487us, non-child: 766.487us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.05 MB (1105280) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 643.202ms, non-child: 643.202ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 209.025ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 122 (122) - NumInstructions: 8.95K (8951) - OptimizationTime: 407.026ms - PeakMemoryUsage: 4.37 MB (4582912) - PrepareTime: 26.548ms HASH_JOIN_NODE (id=15):(Total: 964.776us, non-child: 859.326us, % non-child: 89.07%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 451.92K (451915) - BuildTime: 138.213ms - PeakMemoryUsage: 153.09 MB (160524544) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=15): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 100.409ms - BuildRowsPartitioned: 451.92K (451915) - GetNewBlockTime: 327.234us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 34.978ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160449664) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=26):(Total: 2s040ms, non-child: 29.540ms, % non-child: 1.45%) BytesReceived(16s000ms): 5.38 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB - BytesReceived: 6.21 MB (6513198) - ConvertRowBatchTime: 12.629ms - DeserializeRowBatchTimer: 57.372ms - FirstBatchArrivalWaitTime: 1s180ms - PeakMemoryUsage: 0 - RowsReturned: 451.92K (451915) - RowsReturnedRate: 221.53 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=14):(Total: 752.577us, non-child: 853.244us, % non-child: 100.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 459.18K (459179) - BuildTime: 172.196ms - PeakMemoryUsage: 25.08 MB (26298624) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 101.622ms - BuildRowsPartitioned: 459.18K (459179) - GetNewBlockTime: 225.330us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 23.273ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 25.02 MB (26231936) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 4s087ms, non-child: 15.920ms, % non-child: 0.39%) BytesReceived(16s000ms): 5.82 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB - BytesReceived: 7.33 MB (7690460) - ConvertRowBatchTime: 12.042ms - DeserializeRowBatchTimer: 16.177ms - FirstBatchArrivalWaitTime: 2s083ms - PeakMemoryUsage: 0 - RowsReturned: 459.18K (459179) - RowsReturnedRate: 112.34 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=13):(Total: 531.199us, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 4.02B (4015284670) - BuildTime: 6m9s - PeakMemoryUsage: 157.74 GB (169367734528) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled, Spilled Runtime filters: 0 of 1 Runtime Filter Published, 1 Disabled - BuildRowsPartitionTime: 6m8s - BuildRowsPartitioned: 4.02B (4015284670) - GetNewBlockTime: 47s982ms - HashBuckets: 536.87M (536870912) - HashCollisions: 0 (0) - HashTablesBuildTime: 59s381ms - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 157.74 GB (169367676032) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 4 (4) - UnpinTime: 130.714ms HASH_JOIN_NODE (id=12):(Total: 3m15s, non-child: 1m15s, % non-child: 38.55%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 40.11M (40110159) - BuildTime: 8s330ms - PeakMemoryUsage: 3.02 GB (3240192224) - ProbeRows: 75.89M (75893924) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1m6s - RowsReturned: 4.02B (4015284670) - RowsReturnedRate: 20.56 M/sec Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 5s554ms - BuildRowsPartitioned: 40.11M (40110159) - GetNewBlockTime: 3.419ms - HashBuckets: 67.11M (67108864) - HashCollisions: 0 (0) - HashTablesBuildTime: 2s731ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 3.02 GB (3240125568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 6s811ms, non-child: 1s509ms, % non-child: 22.16%) BytesReceived(16s000ms): 209.57 MB, 379.87 MB, 379.87 MB, 379.87 MB, 379.87 MB, 379.87 MB, 379.87 MB, 379.87 MB, 379.87 MB, 379.87 MB, 379.87 MB, 379.87 MB, 379.87 MB, 379.87 MB, 379.87 MB, 379.87 MB, 379.87 MB, 379.87 MB, 379.87 MB, 379.87 MB, 379.87 MB, 379.87 MB, 379.87 MB, 379.87 MB, 379.87 MB, 379.87 MB, 379.87 MB, 379.87 MB, 379.87 MB, 379.87 MB, 379.87 MB, 379.87 MB, 379.87 MB, 379.87 MB, 379.87 MB, 379.87 MB, 379.87 MB, 379.87 MB, 379.87 MB, 379.87 MB - BytesReceived: 379.87 MB (398318366) - ConvertRowBatchTime: 935.812ms - DeserializeRowBatchTimer: 1s469ms - FirstBatchArrivalWaitTime: 1s100ms - PeakMemoryUsage: 0 - RowsReturned: 40.11M (40110159) - RowsReturnedRate: 5.89 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=22):(Total: 1m53s, non-child: 1s560ms, % non-child: 1.37%) BytesReceived(16s000ms): 2.20 MB, 15.43 MB, 42.14 MB, 68.02 MB, 94.88 MB, 121.78 MB, 149.02 MB, 176.39 MB, 202.19 MB, 227.75 MB, 252.59 MB, 278.24 MB, 304.87 MB, 331.11 MB, 355.36 MB, 382.37 MB, 410.87 MB, 438.40 MB, 461.26 MB, 487.30 MB, 509.46 MB, 526.92 MB, 545.97 MB, 568.36 MB, 586.26 MB, 598.64 MB, 619.02 MB, 635.18 MB, 648.15 MB, 652.84 MB, 661.88 MB, 674.92 MB, 680.06 MB, 689.25 MB, 697.88 MB, 702.67 MB, 702.67 MB, 702.67 MB, 702.67 MB, 702.67 MB - BytesReceived: 702.67 MB (736806202) - ConvertRowBatchTime: 888.796ms - DeserializeRowBatchTimer: 8s457ms - FirstBatchArrivalWaitTime: 769.462ms - PeakMemoryUsage: 0 - RowsReturned: 75.89M (75893924) - RowsReturnedRate: 665.84 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=24):(Total: 1s698ms, non-child: 4.373us, % non-child: 0.00%) BytesReceived(16s000ms): 8.72 MB, 10.60 MB, 10.60 MB, 10.60 MB, 10.60 MB, 10.60 MB, 10.60 MB, 10.60 MB, 10.60 MB, 10.60 MB, 10.60 MB, 10.60 MB, 10.60 MB, 10.60 MB, 10.60 MB, 10.60 MB, 10.60 MB, 10.60 MB, 10.60 MB, 10.60 MB, 10.60 MB, 10.60 MB, 10.60 MB, 10.60 MB, 10.60 MB, 10.60 MB, 10.60 MB, 10.60 MB, 10.60 MB, 10.60 MB, 10.60 MB, 10.60 MB, 10.60 MB, 10.60 MB, 10.60 MB, 10.60 MB, 10.60 MB, 10.62 MB, 10.72 MB, 10.73 MB - BytesReceived: 10.93 MB (11457349) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 81.878ms - FirstBatchArrivalWaitTime: 1s698ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:343 (host=va1045.foo:22000):(Total: 62.588ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 1.02 GB, 7.38 GB, 14.28 GB, 20.93 GB, 27.82 GB, 34.73 GB, 41.72 GB, 48.65 GB, 55.16 GB, 61.70 GB, 68.06 GB, 74.60 GB, 81.53 GB, 87.88 GB, 94.35 GB, 101.22 GB, 107.81 GB, 114.57 GB, 120.98 GB, 127.14 GB, 133.49 GB, 137.89 GB, 142.62 GB, 148.42 GB, 153.19 GB, 156.53 GB, 154.07 GB, 155.39 GB, 158.17 GB, 157.91 GB, 150.60 GB, 152.91 GB, 154.34 GB, 156.58 GB, 158.06 GB, 153.20 GB, 154.63 GB, 155.27 GB, 155.27 GB, 156.51 GB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.03 - BloomFilterBytes: 49.00 MB (51380224) - PeakMemoryUsage: 160.60 GB (172444786927) - PerHostPeakMemUsage: 169.56 GB (182061058974) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 2m1s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 1.31K (1308) - TotalThreadsTotalWallClockTime: 19s610ms - TotalThreadsSysTime: 2s086ms - TotalThreadsUserTime: 7s748ms - TotalThreadsVoluntaryContextSwitches: 23.54K (23537) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 62.550ms - ExecTreePrepareTime: 852.309us DataStreamSender (dst_id=28):(Total: 1.312ms, non-child: 1.312ms, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.05 MB (1105280) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 1s355ms, non-child: 1s355ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 639.619ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 122 (122) - NumInstructions: 8.95K (8951) - OptimizationTime: 692.308ms - PeakMemoryUsage: 4.37 MB (4582912) - PrepareTime: 23.266ms HASH_JOIN_NODE (id=15):(Total: 1.626ms, non-child: 824.403us, % non-child: 50.70%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 451.92K (451915) - BuildTime: 129.573ms - PeakMemoryUsage: 153.09 MB (160524544) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=15): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 91.583ms - BuildRowsPartitioned: 451.92K (451915) - GetNewBlockTime: 385.654us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 35.477ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160449664) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=26):(Total: 1s326ms, non-child: 24.855ms, % non-child: 1.87%) BytesReceived(16s000ms): 5.51 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB - BytesReceived: 6.21 MB (6513198) - ConvertRowBatchTime: 11.576ms - DeserializeRowBatchTimer: 48.472ms - FirstBatchArrivalWaitTime: 457.104ms - PeakMemoryUsage: 0 - RowsReturned: 451.92K (451915) - RowsReturnedRate: 340.60 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=14):(Total: 1.326ms, non-child: 1.091ms, % non-child: 82.27%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 459.26K (459260) - BuildTime: 161.757ms - PeakMemoryUsage: 25.08 MB (26298624) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 101.821ms - BuildRowsPartitioned: 459.26K (459260) - GetNewBlockTime: 177.928us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 22.347ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 25.02 MB (26231936) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 3s398ms, non-child: 16.465ms, % non-child: 0.48%) BytesReceived(16s000ms): 6.00 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB - BytesReceived: 7.34 MB (7693271) - ConvertRowBatchTime: 11.979ms - DeserializeRowBatchTimer: 16.099ms - FirstBatchArrivalWaitTime: 1s361ms - PeakMemoryUsage: 0 - RowsReturned: 459.26K (459260) - RowsReturnedRate: 135.14 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=13):(Total: 918.992us, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 4.04B (4036301894) - BuildTime: 6m3s - PeakMemoryUsage: 159.46 GB (171222206720) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled, Spilled Runtime filters: 0 of 1 Runtime Filter Published, 1 Disabled - BuildRowsPartitionTime: 6m2s - BuildRowsPartitioned: 4.04B (4036301894) - GetNewBlockTime: 42s809ms - HashBuckets: 536.87M (536870912) - HashCollisions: 0 (0) - HashTablesBuildTime: 23s396ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 159.46 GB (171222148224) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 4 (4) - UnpinTime: 183.973ms HASH_JOIN_NODE (id=12):(Total: 3m19s, non-child: 1m22s, % non-child: 41.17%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 40.20M (40200881) - BuildTime: 8s019ms - PeakMemoryUsage: 3.02 GB (3240193636) - ProbeRows: 75.87M (75867656) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1m9s - RowsReturned: 4.04B (4036301894) - RowsReturnedRate: 20.25 M/sec Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 5s507ms - BuildRowsPartitioned: 40.20M (40200881) - GetNewBlockTime: 2.981ms - HashBuckets: 67.11M (67108864) - HashCollisions: 0 (0) - HashTablesBuildTime: 2s462ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 3.02 GB (3240125568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 6s492ms, non-child: 1s610ms, % non-child: 24.81%) BytesReceived(16s000ms): 218.34 MB, 380.72 MB, 380.72 MB, 380.72 MB, 380.72 MB, 380.72 MB, 380.72 MB, 380.72 MB, 380.72 MB, 380.72 MB, 380.72 MB, 380.72 MB, 380.72 MB, 380.72 MB, 380.72 MB, 380.72 MB, 380.72 MB, 380.72 MB, 380.72 MB, 380.72 MB, 380.72 MB, 380.72 MB, 380.72 MB, 380.72 MB, 380.72 MB, 380.72 MB, 380.72 MB, 380.72 MB, 380.72 MB, 380.72 MB, 380.72 MB, 380.72 MB, 380.72 MB, 380.72 MB, 380.72 MB, 380.72 MB, 380.72 MB, 380.72 MB, 380.72 MB, 380.72 MB - BytesReceived: 380.72 MB (399214993) - ConvertRowBatchTime: 944.283ms - DeserializeRowBatchTimer: 1s651ms - FirstBatchArrivalWaitTime: 374.540ms - PeakMemoryUsage: 0 - RowsReturned: 40.20M (40200881) - RowsReturnedRate: 6.19 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=22):(Total: 1m50s, non-child: 1s260ms, % non-child: 1.14%) BytesReceived(16s000ms): 2.18 MB, 15.95 MB, 42.66 MB, 68.60 MB, 95.43 MB, 122.34 MB, 149.50 MB, 176.61 MB, 202.27 MB, 227.69 MB, 252.61 MB, 278.34 MB, 305.07 MB, 331.31 MB, 355.63 MB, 382.79 MB, 408.48 MB, 435.85 MB, 459.09 MB, 484.32 MB, 507.82 MB, 524.94 MB, 543.78 MB, 566.32 MB, 584.63 MB, 597.21 MB, 616.97 MB, 636.22 MB, 648.75 MB, 653.58 MB, 662.95 MB, 675.66 MB, 680.48 MB, 690.30 MB, 698.75 MB, 702.74 MB, 702.74 MB, 702.74 MB, 702.74 MB, 702.74 MB - BytesReceived: 702.74 MB (736874191) - ConvertRowBatchTime: 814.984ms - DeserializeRowBatchTimer: 6s139ms - FirstBatchArrivalWaitTime: 40.761ms - PeakMemoryUsage: 0 - RowsReturned: 75.87M (75867656) - RowsReturnedRate: 684.77 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=24):(Total: 978.737ms, non-child: 4.667us, % non-child: 0.00%) BytesReceived(16s000ms): 8.66 MB, 10.24 MB, 10.24 MB, 10.24 MB, 10.24 MB, 10.24 MB, 10.24 MB, 10.24 MB, 10.24 MB, 10.24 MB, 10.24 MB, 10.24 MB, 10.24 MB, 10.24 MB, 10.24 MB, 10.24 MB, 10.24 MB, 10.24 MB, 10.24 MB, 10.24 MB, 10.24 MB, 10.24 MB, 10.24 MB, 10.24 MB, 10.24 MB, 10.24 MB, 10.24 MB, 10.24 MB, 10.24 MB, 10.24 MB, 10.24 MB, 10.24 MB, 10.24 MB, 10.24 MB, 10.24 MB, 10.24 MB, 10.24 MB, 10.29 MB, 10.36 MB, 10.37 MB - BytesReceived: 10.50 MB (11011689) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 70.050ms - FirstBatchArrivalWaitTime: 978.729ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:30f (host=ve1128.foo:22000):(Total: 62.449ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 989.79 MB, 7.04 GB, 13.78 GB, 20.19 GB, 26.83 GB, 33.47 GB, 40.18 GB, 46.86 GB, 53.16 GB, 59.46 GB, 65.54 GB, 71.81 GB, 78.87 GB, 85.52 GB, 91.32 GB, 98.13 GB, 104.42 GB, 111.27 GB, 116.84 GB, 123.19 GB, 128.99 GB, 133.23 GB, 137.83 GB, 143.35 GB, 147.91 GB, 151.08 GB, 155.85 GB, 156.79 GB, 152.13 GB, 153.21 GB, 155.10 GB, 158.19 GB, 159.35 GB, 154.27 GB, 151.91 GB, 150.65 GB, 157.69 GB, 148.85 GB, 156.23 GB, 158.33 GB ThreadUsage(16s000ms): 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.03 - BloomFilterBytes: 49.00 MB (51380224) - PeakMemoryUsage: 160.61 GB (172456101061) - PerHostPeakMemUsage: 169.55 GB (182055458089) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 2m56s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 1.35K (1350) - TotalThreadsTotalWallClockTime: 21s688ms - TotalThreadsSysTime: 2s071ms - TotalThreadsUserTime: 7s687ms - TotalThreadsVoluntaryContextSwitches: 25.05K (25051) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 62.404ms - ExecTreePrepareTime: 724.235us DataStreamSender (dst_id=28):(Total: 1.033ms, non-child: 1.033ms, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.05 MB (1105280) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 639.694ms, non-child: 639.694ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 198.862ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 122 (122) - NumInstructions: 8.95K (8951) - OptimizationTime: 413.966ms - PeakMemoryUsage: 4.37 MB (4582912) - PrepareTime: 26.297ms HASH_JOIN_NODE (id=15):(Total: 1.373ms, non-child: 987.941us, % non-child: 71.91%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 451.92K (451915) - BuildTime: 146.028ms - PeakMemoryUsage: 153.09 MB (160524544) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=15): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 110.920ms - BuildRowsPartitioned: 451.92K (451915) - GetNewBlockTime: 478.103us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 31.429ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160449664) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=26):(Total: 2s045ms, non-child: 24.531ms, % non-child: 1.20%) BytesReceived(16s000ms): 5.38 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB - BytesReceived: 6.21 MB (6513198) - ConvertRowBatchTime: 12.539ms - DeserializeRowBatchTimer: 51.757ms - FirstBatchArrivalWaitTime: 1s189ms - PeakMemoryUsage: 0 - RowsReturned: 451.92K (451915) - RowsReturnedRate: 220.89 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=14):(Total: 1.093ms, non-child: 861.062us, % non-child: 78.76%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 458.91K (458913) - BuildTime: 146.491ms - PeakMemoryUsage: 25.08 MB (26298624) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 93.429ms - BuildRowsPartitioned: 458.91K (458913) - GetNewBlockTime: 219.081us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 25.462ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 25.02 MB (26231936) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 4s107ms, non-child: 14.605ms, % non-child: 0.36%) BytesReceived(16s000ms): 5.81 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB - BytesReceived: 7.33 MB (7687058) - ConvertRowBatchTime: 11.259ms - DeserializeRowBatchTimer: 15.446ms - FirstBatchArrivalWaitTime: 2s097ms - PeakMemoryUsage: 0 - RowsReturned: 458.91K (458913) - RowsReturnedRate: 111.72 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=13):(Total: 783.656us, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 3.88B (3883642989) - BuildTime: 5m24s - PeakMemoryUsage: 160.16 GB (171968792832) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled, Spilled Runtime filters: 0 of 1 Runtime Filter Published, 1 Disabled - BuildRowsPartitionTime: 5m23s - BuildRowsPartitioned: 3.88B (3883642989) - GetNewBlockTime: 20s225ms - HashBuckets: 536.87M (536870912) - HashCollisions: 0 (0) - HashTablesBuildTime: 1m14s - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 160.16 GB (171968734336) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 4 (4) - UnpinTime: 264.649ms HASH_JOIN_NODE (id=12):(Total: 3m58s, non-child: 1m8s, % non-child: 28.88%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 40.13M (40129774) - BuildTime: 8s008ms - PeakMemoryUsage: 3.02 GB (3240188872) - ProbeRows: 73.51M (73509638) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1m - RowsReturned: 3.88B (3883642989) - RowsReturnedRate: 16.28 M/sec Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 5s218ms - BuildRowsPartitioned: 40.13M (40129774) - GetNewBlockTime: 3.244ms - HashBuckets: 67.11M (67108864) - HashCollisions: 0 (0) - HashTablesBuildTime: 2s744ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 3.02 GB (3240125568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 7s154ms, non-child: 1s533ms, % non-child: 21.43%) BytesReceived(16s000ms): 209.16 MB, 380.06 MB, 380.06 MB, 380.06 MB, 380.06 MB, 380.06 MB, 380.06 MB, 380.06 MB, 380.06 MB, 380.06 MB, 380.06 MB, 380.06 MB, 380.06 MB, 380.06 MB, 380.06 MB, 380.06 MB, 380.06 MB, 380.06 MB, 380.06 MB, 380.06 MB, 380.06 MB, 380.06 MB, 380.06 MB, 380.06 MB, 380.06 MB, 380.06 MB, 380.06 MB, 380.06 MB, 380.06 MB, 380.06 MB, 380.06 MB, 380.06 MB, 380.06 MB, 380.06 MB, 380.06 MB, 380.06 MB, 380.06 MB, 380.06 MB, 380.06 MB, 380.06 MB - BytesReceived: 380.06 MB (398518836) - ConvertRowBatchTime: 937.989ms - DeserializeRowBatchTimer: 1s582ms - FirstBatchArrivalWaitTime: 1s116ms - PeakMemoryUsage: 0 - RowsReturned: 40.13M (40129774) - RowsReturnedRate: 5.61 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=22):(Total: 2m43s, non-child: 1s377ms, % non-child: 0.84%) BytesReceived(16s000ms): 2.07 MB, 14.87 MB, 40.78 MB, 65.91 MB, 91.93 MB, 118.00 MB, 144.36 MB, 170.65 MB, 195.52 MB, 220.18 MB, 244.24 MB, 269.02 MB, 297.14 MB, 322.77 MB, 346.12 MB, 372.54 MB, 397.24 MB, 423.66 MB, 445.90 MB, 471.12 MB, 492.96 MB, 509.74 MB, 528.27 MB, 549.90 MB, 567.46 MB, 579.53 MB, 598.92 MB, 614.63 MB, 627.55 MB, 632.03 MB, 640.62 MB, 653.34 MB, 658.42 MB, 667.17 MB, 675.58 MB, 680.43 MB, 680.43 MB, 680.43 MB, 680.43 MB, 680.43 MB - BytesReceived: 680.43 MB (713487344) - ConvertRowBatchTime: 906.629ms - DeserializeRowBatchTimer: 5s371ms - FirstBatchArrivalWaitTime: 787.121ms - PeakMemoryUsage: 0 - RowsReturned: 73.51M (73509638) - RowsReturnedRate: 450.07 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=24):(Total: 1s725ms, non-child: 4.415us, % non-child: 0.00%) BytesReceived(16s000ms): 8.35 MB, 10.17 MB, 10.17 MB, 10.17 MB, 10.17 MB, 10.17 MB, 10.17 MB, 10.17 MB, 10.17 MB, 10.17 MB, 10.17 MB, 10.17 MB, 10.17 MB, 10.17 MB, 10.17 MB, 10.17 MB, 10.17 MB, 10.17 MB, 10.17 MB, 10.17 MB, 10.17 MB, 10.17 MB, 10.17 MB, 10.17 MB, 10.17 MB, 10.17 MB, 10.17 MB, 10.17 MB, 10.17 MB, 10.17 MB, 10.17 MB, 10.17 MB, 10.17 MB, 10.17 MB, 10.17 MB, 10.17 MB, 10.17 MB, 10.20 MB, 10.28 MB, 10.29 MB - BytesReceived: 10.33 MB (10833122) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 68.233ms - FirstBatchArrivalWaitTime: 1s725ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:31a (host=vd1108.foo:22000):(Total: 62.350ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 965.33 MB, 6.89 GB, 14.01 GB, 20.58 GB, 27.35 GB, 34.19 GB, 41.07 GB, 47.90 GB, 54.35 GB, 61.16 GB, 67.45 GB, 73.94 GB, 80.68 GB, 87.16 GB, 93.27 GB, 100.07 GB, 106.51 GB, 113.17 GB, 119.28 GB, 125.52 GB, 131.56 GB, 135.85 GB, 140.59 GB, 146.23 GB, 150.87 GB, 154.14 GB, 156.88 GB, 152.01 GB, 155.27 GB, 156.57 GB, 158.97 GB, 150.01 GB, 151.04 GB, 153.33 GB, 154.97 GB, 150.07 GB, 153.32 GB, 154.05 GB, 151.67 GB, 155.06 GB ThreadUsage(16s000ms): 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.03 - BloomFilterBytes: 49.00 MB (51380224) - PeakMemoryUsage: 160.61 GB (172448389375) - PerHostPeakMemUsage: 169.56 GB (182064821899) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 2m8s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 1.58K (1578) - TotalThreadsTotalWallClockTime: 21s840ms - TotalThreadsSysTime: 2s268ms - TotalThreadsUserTime: 8s076ms - TotalThreadsVoluntaryContextSwitches: 21.78K (21778) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 62.284ms - ExecTreePrepareTime: 924.314us DataStreamSender (dst_id=28):(Total: 1.190ms, non-child: 1.190ms, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.05 MB (1105280) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 646.851ms, non-child: 646.851ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 203.936ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 122 (122) - NumInstructions: 8.95K (8951) - OptimizationTime: 414.858ms - PeakMemoryUsage: 4.37 MB (4582912) - PrepareTime: 27.617ms HASH_JOIN_NODE (id=15):(Total: 1.742ms, non-child: 844.671us, % non-child: 48.47%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 451.92K (451915) - BuildTime: 121.580ms - PeakMemoryUsage: 153.09 MB (160524544) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=15): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 93.682ms - BuildRowsPartitioned: 451.92K (451915) - GetNewBlockTime: 377.528us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 25.830ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160449664) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=26):(Total: 2s055ms, non-child: 26.353ms, % non-child: 1.28%) BytesReceived(16s000ms): 5.34 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB - BytesReceived: 6.21 MB (6513198) - ConvertRowBatchTime: 12.615ms - DeserializeRowBatchTimer: 51.438ms - FirstBatchArrivalWaitTime: 1s178ms - PeakMemoryUsage: 0 - RowsReturned: 451.92K (451915) - RowsReturnedRate: 219.87 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=14):(Total: 1.432ms, non-child: 1.012ms, % non-child: 70.67%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 459.70K (459698) - BuildTime: 148.058ms - PeakMemoryUsage: 25.08 MB (26298624) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 91.439ms - BuildRowsPartitioned: 459.70K (459698) - GetNewBlockTime: 107.068us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 24.809ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 25.02 MB (26231936) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 4s109ms, non-child: 15.572ms, % non-child: 0.38%) BytesReceived(16s000ms): 5.81 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB - BytesReceived: 7.34 MB (7700759) - ConvertRowBatchTime: 11.920ms - DeserializeRowBatchTimer: 15.650ms - FirstBatchArrivalWaitTime: 2s094ms - PeakMemoryUsage: 0 - RowsReturned: 459.70K (459698) - RowsReturnedRate: 111.86 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=13):(Total: 989.267us, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 3.97B (3968015197) - BuildTime: 6m7s - PeakMemoryUsage: 157.31 GB (168914159840) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled, Spilled Runtime filters: 0 of 1 Runtime Filter Published, 1 Disabled - BuildRowsPartitionTime: 6m7s - BuildRowsPartitioned: 3.97B (3968015197) - GetNewBlockTime: 36s171ms - HashBuckets: 536.87M (536870912) - HashCollisions: 0 (0) - HashTablesBuildTime: 51s493ms - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 157.31 GB (168914068608) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 4 (4) - UnpinTime: 175.227ms HASH_JOIN_NODE (id=12):(Total: 3m17s, non-child: 1m15s, % non-child: 38.25%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 40.21M (40212359) - BuildTime: 8s583ms - PeakMemoryUsage: 3.02 GB (3240192352) - ProbeRows: 74.79M (74789330) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1m6s - RowsReturned: 3.97B (3968015197) - RowsReturnedRate: 20.10 M/sec Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 5s635ms - BuildRowsPartitioned: 40.21M (40212359) - GetNewBlockTime: 3.581ms - HashBuckets: 67.11M (67108864) - HashCollisions: 0 (0) - HashTablesBuildTime: 2s901ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 3.02 GB (3240125568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 6s722ms, non-child: 1s522ms, % non-child: 22.64%) BytesReceived(16s000ms): 208.01 MB, 380.83 MB, 380.83 MB, 380.83 MB, 380.83 MB, 380.83 MB, 380.83 MB, 380.83 MB, 380.83 MB, 380.83 MB, 380.83 MB, 380.83 MB, 380.83 MB, 380.83 MB, 380.83 MB, 380.83 MB, 380.83 MB, 380.83 MB, 380.83 MB, 380.83 MB, 380.83 MB, 380.83 MB, 380.83 MB, 380.83 MB, 380.83 MB, 380.83 MB, 380.83 MB, 380.83 MB, 380.83 MB, 380.83 MB, 380.83 MB, 380.83 MB, 380.83 MB, 380.83 MB, 380.83 MB, 380.83 MB, 380.83 MB, 380.83 MB, 380.83 MB, 380.83 MB - BytesReceived: 380.83 MB (399328897) - ConvertRowBatchTime: 946.682ms - DeserializeRowBatchTimer: 1s484ms - FirstBatchArrivalWaitTime: 1s096ms - PeakMemoryUsage: 0 - RowsReturned: 40.21M (40212359) - RowsReturnedRate: 5.98 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=22):(Total: 1m55s, non-child: 1s357ms, % non-child: 1.17%) BytesReceived(16s000ms): 2.06 MB, 15.11 MB, 41.56 MB, 67.19 MB, 93.70 MB, 120.39 MB, 147.32 MB, 174.01 MB, 200.09 MB, 226.24 MB, 250.87 MB, 276.21 MB, 302.47 MB, 328.31 MB, 352.10 MB, 378.94 MB, 404.06 MB, 430.81 MB, 453.44 MB, 478.73 MB, 501.01 MB, 518.08 MB, 536.75 MB, 558.88 MB, 576.71 MB, 589.05 MB, 608.78 MB, 624.76 MB, 638.46 MB, 644.25 MB, 653.98 MB, 665.95 MB, 670.52 MB, 680.71 MB, 689.01 MB, 692.16 MB, 692.16 MB, 692.16 MB, 692.16 MB, 692.16 MB - BytesReceived: 692.16 MB (725784784) - ConvertRowBatchTime: 862.540ms - DeserializeRowBatchTimer: 7s139ms - FirstBatchArrivalWaitTime: 772.018ms - PeakMemoryUsage: 0 - RowsReturned: 74.79M (74789330) - RowsReturnedRate: 644.99 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=24):(Total: 1s710ms, non-child: 4.840us, % non-child: 0.00%) BytesReceived(16s000ms): 8.69 MB, 10.63 MB, 10.63 MB, 10.63 MB, 10.63 MB, 10.63 MB, 10.63 MB, 10.63 MB, 10.63 MB, 10.63 MB, 10.63 MB, 10.63 MB, 10.63 MB, 10.63 MB, 10.63 MB, 10.63 MB, 10.63 MB, 10.63 MB, 10.63 MB, 10.63 MB, 10.63 MB, 10.63 MB, 10.63 MB, 10.63 MB, 10.63 MB, 10.63 MB, 10.63 MB, 10.63 MB, 10.63 MB, 10.63 MB, 10.63 MB, 10.63 MB, 10.63 MB, 10.63 MB, 10.63 MB, 10.63 MB, 10.63 MB, 10.63 MB, 10.63 MB, 10.64 MB - BytesReceived: 10.95 MB (11486251) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 70.060ms - FirstBatchArrivalWaitTime: 1s710ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:304 (host=vd1333.foo:22000):(Total: 62.079ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 1.02 GB, 7.16 GB, 14.12 GB, 20.68 GB, 27.47 GB, 34.29 GB, 41.22 GB, 48.10 GB, 54.54 GB, 61.01 GB, 67.27 GB, 73.70 GB, 80.50 GB, 87.05 GB, 93.17 GB, 100.00 GB, 106.50 GB, 113.38 GB, 119.31 GB, 125.54 GB, 131.78 GB, 136.07 GB, 140.80 GB, 146.49 GB, 151.21 GB, 154.47 GB, 156.96 GB, 153.42 GB, 156.59 GB, 157.51 GB, 156.55 GB, 151.33 GB, 152.42 GB, 154.97 GB, 156.01 GB, 153.16 GB, 154.07 GB, 155.02 GB, 155.16 GB, 152.83 GB ThreadUsage(16s000ms): 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.03 - BloomFilterBytes: 49.00 MB (51380224) - PeakMemoryUsage: 160.60 GB (172444051855) - PerHostPeakMemUsage: 169.57 GB (182072937354) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 1m55s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 1.74K (1737) - TotalThreadsTotalWallClockTime: 21s805ms - TotalThreadsSysTime: 2s378ms - TotalThreadsUserTime: 7s995ms - TotalThreadsVoluntaryContextSwitches: 21.54K (21541) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 61.998ms - ExecTreePrepareTime: 770.986us DataStreamSender (dst_id=28):(Total: 1.104ms, non-child: 1.104ms, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.05 MB (1105280) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 651.147ms, non-child: 651.147ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 201.166ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 122 (122) - NumInstructions: 8.95K (8951) - OptimizationTime: 422.847ms - PeakMemoryUsage: 4.37 MB (4582912) - PrepareTime: 26.693ms HASH_JOIN_NODE (id=15):(Total: 1.441ms, non-child: 987.178us, % non-child: 68.51%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 451.92K (451915) - BuildTime: 136.228ms - PeakMemoryUsage: 153.09 MB (160524544) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=15): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 102.987ms - BuildRowsPartitioned: 451.92K (451915) - GetNewBlockTime: 374.323us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 30.342ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160449664) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=26):(Total: 2s035ms, non-child: 25.583ms, % non-child: 1.26%) BytesReceived(16s000ms): 5.45 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB - BytesReceived: 6.21 MB (6513198) - ConvertRowBatchTime: 12.194ms - DeserializeRowBatchTimer: 49.195ms - FirstBatchArrivalWaitTime: 1s180ms - PeakMemoryUsage: 0 - RowsReturned: 451.92K (451915) - RowsReturnedRate: 221.99 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=14):(Total: 1.079ms, non-child: 988.319us, % non-child: 91.56%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 459.46K (459458) - BuildTime: 144.843ms - PeakMemoryUsage: 25.08 MB (26298624) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 86.248ms - BuildRowsPartitioned: 459.46K (459458) - GetNewBlockTime: 197.429us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 25.307ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 25.02 MB (26231936) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 4s097ms, non-child: 15.672ms, % non-child: 0.38%) BytesReceived(16s000ms): 5.96 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB - BytesReceived: 7.34 MB (7695480) - ConvertRowBatchTime: 11.887ms - DeserializeRowBatchTimer: 16.505ms - FirstBatchArrivalWaitTime: 2s099ms - PeakMemoryUsage: 0 - RowsReturned: 459.46K (459458) - RowsReturnedRate: 112.12 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=13):(Total: 666.341us, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 3.99B (3985088764) - BuildTime: 6m25s - PeakMemoryUsage: 157.31 GB (168914159840) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled, Spilled Runtime filters: 0 of 1 Runtime Filter Published, 1 Disabled - BuildRowsPartitionTime: 6m25s - BuildRowsPartitioned: 3.99B (3985088764) - GetNewBlockTime: 51s366ms - HashBuckets: 536.87M (536870912) - HashCollisions: 0 (0) - HashTablesBuildTime: 55s888ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 157.31 GB (168914068608) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 4 (4) - UnpinTime: 296.523ms HASH_JOIN_NODE (id=12):(Total: 3m2s, non-child: 1m13s, % non-child: 40.38%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 40.14M (40140293) - BuildTime: 8s583ms - PeakMemoryUsage: 3.02 GB (3240192246) - ProbeRows: 75.04M (75035398) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1m4s - RowsReturned: 3.99B (3985088764) - RowsReturnedRate: 21.80 M/sec Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 5s624ms - BuildRowsPartitioned: 40.14M (40140293) - GetNewBlockTime: 3.913ms - HashBuckets: 67.11M (67108864) - HashCollisions: 0 (0) - HashTablesBuildTime: 2s914ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 3.02 GB (3240125568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 6s709ms, non-child: 1s534ms, % non-child: 22.87%) BytesReceived(16s000ms): 216.11 MB, 380.15 MB, 380.15 MB, 380.15 MB, 380.15 MB, 380.15 MB, 380.15 MB, 380.15 MB, 380.15 MB, 380.15 MB, 380.15 MB, 380.15 MB, 380.15 MB, 380.15 MB, 380.15 MB, 380.15 MB, 380.15 MB, 380.15 MB, 380.15 MB, 380.15 MB, 380.15 MB, 380.15 MB, 380.15 MB, 380.15 MB, 380.15 MB, 380.15 MB, 380.15 MB, 380.15 MB, 380.15 MB, 380.15 MB, 380.15 MB, 380.15 MB, 380.15 MB, 380.15 MB, 380.15 MB, 380.15 MB, 380.15 MB, 380.15 MB, 380.15 MB, 380.15 MB - BytesReceived: 380.15 MB (398613156) - ConvertRowBatchTime: 963.159ms - DeserializeRowBatchTimer: 1s487ms - FirstBatchArrivalWaitTime: 1s106ms - PeakMemoryUsage: 0 - RowsReturned: 40.14M (40140293) - RowsReturnedRate: 5.98 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=22):(Total: 1m43s, non-child: 1s329ms, % non-child: 1.29%) BytesReceived(16s000ms): 2.10 MB, 15.63 MB, 42.03 MB, 67.64 MB, 94.13 MB, 120.75 MB, 147.78 MB, 174.75 MB, 200.26 MB, 225.36 MB, 250.00 MB, 275.27 MB, 301.70 MB, 327.74 MB, 351.73 MB, 378.42 MB, 403.71 MB, 430.78 MB, 453.81 MB, 478.64 MB, 501.89 MB, 518.80 MB, 537.36 MB, 559.67 MB, 577.90 MB, 590.31 MB, 609.81 MB, 629.19 MB, 641.22 MB, 646.01 MB, 655.19 MB, 667.87 MB, 672.61 MB, 682.25 MB, 690.68 MB, 694.64 MB, 694.64 MB, 694.64 MB, 694.64 MB, 694.64 MB - BytesReceived: 694.64 MB (728381280) - ConvertRowBatchTime: 870.320ms - DeserializeRowBatchTimer: 6s423ms - FirstBatchArrivalWaitTime: 769.463ms - PeakMemoryUsage: 0 - RowsReturned: 75.04M (75035398) - RowsReturnedRate: 728.38 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=24):(Total: 1s690ms, non-child: 3.347us, % non-child: 0.00%) BytesReceived(16s000ms): 8.55 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.16 MB, 10.21 MB, 10.22 MB - BytesReceived: 10.27 MB (10764432) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 70.798ms - FirstBatchArrivalWaitTime: 1s690ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:2f8 (host=vc1539.foo:22000):(Total: 61.983ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 983.34 MB, 6.97 GB, 14.28 GB, 20.92 GB, 27.76 GB, 34.58 GB, 41.49 GB, 48.33 GB, 54.92 GB, 61.45 GB, 67.75 GB, 74.29 GB, 81.22 GB, 87.78 GB, 94.14 GB, 101.09 GB, 107.71 GB, 114.61 GB, 120.81 GB, 126.87 GB, 133.19 GB, 137.53 GB, 142.37 GB, 148.17 GB, 152.94 GB, 156.19 GB, 154.37 GB, 154.48 GB, 157.93 GB, 158.73 GB, 151.41 GB, 152.83 GB, 153.91 GB, 156.38 GB, 157.72 GB, 155.38 GB, 155.33 GB, 157.70 GB, 154.31 GB, 154.71 GB ThreadUsage(16s000ms): 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.03 - BloomFilterBytes: 49.00 MB (51380224) - PeakMemoryUsage: 160.60 GB (172442807887) - PerHostPeakMemUsage: 169.57 GB (182073034609) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 2m7s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 1.45K (1450) - TotalThreadsTotalWallClockTime: 21s856ms - TotalThreadsSysTime: 2s219ms - TotalThreadsUserTime: 8s264ms - TotalThreadsVoluntaryContextSwitches: 22.41K (22415) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 61.922ms - ExecTreePrepareTime: 971.192us DataStreamSender (dst_id=28):(Total: 916.471us, non-child: 916.471us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.05 MB (1105280) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 643.126ms, non-child: 643.126ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 200.139ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 122 (122) - NumInstructions: 8.95K (8951) - OptimizationTime: 418.012ms - PeakMemoryUsage: 4.37 MB (4582912) - PrepareTime: 24.525ms HASH_JOIN_NODE (id=15):(Total: 1.727ms, non-child: 1.083ms, % non-child: 62.72%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 451.92K (451915) - BuildTime: 131.594ms - PeakMemoryUsage: 153.09 MB (160524544) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=15): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 91.538ms - BuildRowsPartitioned: 451.92K (451915) - GetNewBlockTime: 574.612us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 37.292ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160449664) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=26):(Total: 2s066ms, non-child: 24.927ms, % non-child: 1.21%) BytesReceived(16s000ms): 5.38 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB - BytesReceived: 6.21 MB (6513198) - ConvertRowBatchTime: 11.301ms - DeserializeRowBatchTimer: 49.971ms - FirstBatchArrivalWaitTime: 1s189ms - PeakMemoryUsage: 0 - RowsReturned: 451.92K (451915) - RowsReturnedRate: 218.65 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=14):(Total: 1.179ms, non-child: 920.674us, % non-child: 78.03%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 460.01K (460014) - BuildTime: 170.428ms - PeakMemoryUsage: 25.08 MB (26298624) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 105.022ms - BuildRowsPartitioned: 460.01K (460014) - GetNewBlockTime: 168.428us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 25.992ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 25.02 MB (26231936) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 4s075ms, non-child: 17.335ms, % non-child: 0.43%) BytesReceived(16s000ms): 5.82 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB - BytesReceived: 7.35 MB (7705379) - ConvertRowBatchTime: 13.396ms - DeserializeRowBatchTimer: 16.899ms - FirstBatchArrivalWaitTime: 2s092ms - PeakMemoryUsage: 0 - RowsReturned: 460.01K (460014) - RowsReturnedRate: 112.86 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=13):(Total: 844.652us, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 4.03B (4029718177) - BuildTime: 6m14s - PeakMemoryUsage: 157.86 GB (169501952256) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled, Spilled Runtime filters: 0 of 1 Runtime Filter Published, 1 Disabled - BuildRowsPartitionTime: 6m13s - BuildRowsPartitioned: 4.03B (4029718177) - GetNewBlockTime: 47s972ms - HashBuckets: 536.87M (536870912) - HashCollisions: 0 (0) - HashTablesBuildTime: 47s475ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 157.86 GB (169501893760) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 4 (4) - UnpinTime: 253.344ms HASH_JOIN_NODE (id=12):(Total: 3m15s, non-child: 1m14s, % non-child: 38.05%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 40.25M (40246704) - BuildTime: 8s665ms - PeakMemoryUsage: 3.02 GB (3240190948) - ProbeRows: 75.85M (75852500) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1m1s - RowsReturned: 4.03B (4029718177) - RowsReturnedRate: 20.59 M/sec Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 5s683ms - BuildRowsPartitioned: 40.25M (40246704) - GetNewBlockTime: 4.117ms - HashBuckets: 67.11M (67108864) - HashCollisions: 0 (0) - HashTablesBuildTime: 2s936ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 3.02 GB (3240125568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 6s653ms, non-child: 1s663ms, % non-child: 25.00%) BytesReceived(16s000ms): 209.74 MB, 381.15 MB, 381.15 MB, 381.15 MB, 381.15 MB, 381.15 MB, 381.15 MB, 381.15 MB, 381.15 MB, 381.15 MB, 381.15 MB, 381.15 MB, 381.15 MB, 381.15 MB, 381.15 MB, 381.15 MB, 381.15 MB, 381.15 MB, 381.15 MB, 381.15 MB, 381.15 MB, 381.15 MB, 381.15 MB, 381.15 MB, 381.15 MB, 381.15 MB, 381.15 MB, 381.15 MB, 381.15 MB, 381.15 MB, 381.15 MB, 381.15 MB, 381.15 MB, 381.15 MB, 381.15 MB, 381.15 MB, 381.15 MB, 381.15 MB, 381.15 MB, 381.15 MB - BytesReceived: 381.15 MB (399667383) - ConvertRowBatchTime: 966.735ms - DeserializeRowBatchTimer: 1s722ms - FirstBatchArrivalWaitTime: 1s120ms - PeakMemoryUsage: 0 - RowsReturned: 40.25M (40246704) - RowsReturnedRate: 6.05 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=22):(Total: 1m55s, non-child: 1s290ms, % non-child: 1.12%) BytesReceived(16s000ms): 2.19 MB, 15.65 MB, 42.53 MB, 68.38 MB, 95.07 MB, 121.74 MB, 148.76 MB, 175.81 MB, 201.33 MB, 226.75 MB, 251.64 MB, 277.44 MB, 304.29 MB, 330.74 MB, 355.35 MB, 382.62 MB, 408.39 MB, 435.84 MB, 459.02 MB, 484.03 MB, 507.60 MB, 524.58 MB, 543.44 MB, 566.05 MB, 584.34 MB, 596.92 MB, 616.56 MB, 633.00 MB, 647.30 MB, 651.81 MB, 660.47 MB, 673.45 MB, 679.70 MB, 689.73 MB, 698.28 MB, 702.54 MB, 702.55 MB, 702.55 MB, 702.55 MB, 702.55 MB - BytesReceived: 702.55 MB (736672026) - ConvertRowBatchTime: 834.795ms - DeserializeRowBatchTimer: 5s369ms - FirstBatchArrivalWaitTime: 776.505ms - PeakMemoryUsage: 0 - RowsReturned: 75.85M (75852500) - RowsReturnedRate: 657.66 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=24):(Total: 1s713ms, non-child: 3.600us, % non-child: 0.00%) BytesReceived(16s000ms): 8.62 MB, 10.49 MB, 10.49 MB, 10.49 MB, 10.49 MB, 10.49 MB, 10.49 MB, 10.49 MB, 10.49 MB, 10.49 MB, 10.49 MB, 10.49 MB, 10.49 MB, 10.49 MB, 10.49 MB, 10.49 MB, 10.49 MB, 10.49 MB, 10.49 MB, 10.49 MB, 10.49 MB, 10.49 MB, 10.49 MB, 10.49 MB, 10.49 MB, 10.49 MB, 10.49 MB, 10.49 MB, 10.49 MB, 10.49 MB, 10.49 MB, 10.49 MB, 10.49 MB, 10.49 MB, 10.49 MB, 10.49 MB, 10.49 MB, 10.53 MB, 10.62 MB, 10.63 MB - BytesReceived: 10.97 MB (11505830) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 70.234ms - FirstBatchArrivalWaitTime: 1s713ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:349 (host=va1034.foo:22000):(Total: 61.943ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 974.25 MB, 7.17 GB, 14.13 GB, 20.72 GB, 27.50 GB, 34.27 GB, 41.13 GB, 48.01 GB, 54.50 GB, 61.00 GB, 67.27 GB, 73.75 GB, 80.54 GB, 86.91 GB, 93.29 GB, 100.12 GB, 106.63 GB, 113.41 GB, 119.65 GB, 125.91 GB, 132.09 GB, 136.93 GB, 141.84 GB, 147.55 GB, 152.17 GB, 155.40 GB, 155.76 GB, 153.61 GB, 156.76 GB, 157.72 GB, 156.65 GB, 151.50 GB, 152.82 GB, 155.08 GB, 156.55 GB, 152.87 GB, 153.58 GB, 154.87 GB, 155.72 GB, 159.46 GB ThreadUsage(16s000ms): 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.03 - BloomFilterBytes: 49.00 MB (51380224) - PeakMemoryUsage: 160.60 GB (172443356959) - PerHostPeakMemUsage: 169.57 GB (182073558301) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 2m28s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 1.65K (1654) - TotalThreadsTotalWallClockTime: 21s959ms - TotalThreadsSysTime: 2s075ms - TotalThreadsUserTime: 7s836ms - TotalThreadsVoluntaryContextSwitches: 22.48K (22479) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 61.890ms - ExecTreePrepareTime: 570.829us DataStreamSender (dst_id=28):(Total: 996.066us, non-child: 996.066us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.05 MB (1105280) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 647.778ms, non-child: 647.778ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 210.768ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 122 (122) - NumInstructions: 8.95K (8951) - OptimizationTime: 408.878ms - PeakMemoryUsage: 4.37 MB (4582912) - PrepareTime: 27.637ms HASH_JOIN_NODE (id=15):(Total: 1.052ms, non-child: 939.977us, % non-child: 89.30%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 451.92K (451915) - BuildTime: 147.151ms - PeakMemoryUsage: 153.09 MB (160524544) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=15): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 103.886ms - BuildRowsPartitioned: 451.92K (451915) - GetNewBlockTime: 411.586us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 40.586ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160449664) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=26):(Total: 2s029ms, non-child: 22.727ms, % non-child: 1.12%) BytesReceived(16s000ms): 5.38 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB - BytesReceived: 6.21 MB (6513198) - ConvertRowBatchTime: 12.301ms - DeserializeRowBatchTimer: 48.609ms - FirstBatchArrivalWaitTime: 1s168ms - PeakMemoryUsage: 0 - RowsReturned: 451.92K (451915) - RowsReturnedRate: 222.67 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=14):(Total: 772.360us, non-child: 748.975us, % non-child: 96.97%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 459.97K (459967) - BuildTime: 149.419ms - PeakMemoryUsage: 25.08 MB (26298624) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 90.456ms - BuildRowsPartitioned: 459.97K (459967) - GetNewBlockTime: 161.015us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 24.473ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 25.02 MB (26231936) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 4s133ms, non-child: 13.308ms, % non-child: 0.32%) BytesReceived(16s000ms): 5.84 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB - BytesReceived: 7.35 MB (7703812) - ConvertRowBatchTime: 10.074ms - DeserializeRowBatchTimer: 15.715ms - FirstBatchArrivalWaitTime: 2s074ms - PeakMemoryUsage: 0 - RowsReturned: 459.97K (459967) - RowsReturnedRate: 111.28 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=13):(Total: 526.300us, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 3.99B (3994045497) - BuildTime: 5m50s - PeakMemoryUsage: 160.06 GB (171868129536) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled, Spilled Runtime filters: 0 of 1 Runtime Filter Published, 1 Disabled - BuildRowsPartitionTime: 5m50s - BuildRowsPartitioned: 3.99B (3994045497) - GetNewBlockTime: 40s155ms - HashBuckets: 1.07B (1073741824) - HashCollisions: 0 (0) - HashTablesBuildTime: 1m16s - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 160.06 GB (171868071040) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 5 (5) - UnpinTime: 106.728ms HASH_JOIN_NODE (id=12):(Total: 3m31s, non-child: 1m9s, % non-child: 32.85%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 40.24M (40239951) - BuildTime: 8s162ms - PeakMemoryUsage: 3.02 GB (3240188128) - ProbeRows: 75.26M (75260851) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1m - RowsReturned: 3.99B (3994045497) - RowsReturnedRate: 18.86 M/sec Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 5s477ms - BuildRowsPartitioned: 40.24M (40239951) - GetNewBlockTime: 2.977ms - HashBuckets: 67.11M (67108864) - HashCollisions: 0 (0) - HashTablesBuildTime: 2s638ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 3.02 GB (3240125568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 7s255ms, non-child: 1s472ms, % non-child: 20.30%) BytesReceived(16s000ms): 212.54 MB, 381.09 MB, 381.09 MB, 381.09 MB, 381.09 MB, 381.09 MB, 381.09 MB, 381.09 MB, 381.09 MB, 381.09 MB, 381.09 MB, 381.09 MB, 381.09 MB, 381.09 MB, 381.09 MB, 381.09 MB, 381.09 MB, 381.09 MB, 381.09 MB, 381.09 MB, 381.09 MB, 381.09 MB, 381.09 MB, 381.09 MB, 381.09 MB, 381.09 MB, 381.09 MB, 381.09 MB, 381.09 MB, 381.09 MB, 381.09 MB, 381.09 MB, 381.09 MB, 381.09 MB, 381.09 MB, 381.09 MB, 381.09 MB, 381.09 MB, 381.09 MB, 381.09 MB - BytesReceived: 381.09 MB (399605563) - ConvertRowBatchTime: 978.430ms - DeserializeRowBatchTimer: 1s411ms - FirstBatchArrivalWaitTime: 1s097ms - PeakMemoryUsage: 0 - RowsReturned: 40.24M (40239951) - RowsReturnedRate: 5.55 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=22):(Total: 2m15s, non-child: 1s310ms, % non-child: 0.97%) BytesReceived(16s000ms): 2.09 MB, 15.44 MB, 41.99 MB, 67.69 MB, 94.17 MB, 120.67 MB, 147.44 MB, 174.40 MB, 199.86 MB, 225.17 MB, 249.86 MB, 275.32 MB, 301.70 MB, 327.64 MB, 351.79 MB, 378.63 MB, 404.10 MB, 431.33 MB, 454.47 MB, 479.39 MB, 502.89 MB, 522.58 MB, 541.69 MB, 564.17 MB, 581.70 MB, 594.05 MB, 614.22 MB, 630.13 MB, 642.65 MB, 647.30 MB, 656.34 MB, 669.21 MB, 674.19 MB, 683.56 MB, 692.10 MB, 696.55 MB, 696.55 MB, 696.55 MB, 696.55 MB, 696.55 MB - BytesReceived: 696.55 MB (730386266) - ConvertRowBatchTime: 800.809ms - DeserializeRowBatchTimer: 5s103ms - FirstBatchArrivalWaitTime: 753.303ms - PeakMemoryUsage: 0 - RowsReturned: 75.26M (75260851) - RowsReturnedRate: 554.68 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=24):(Total: 1s694ms, non-child: 5.394us, % non-child: 0.00%) BytesReceived(16s000ms): 8.66 MB, 10.39 MB, 10.39 MB, 10.39 MB, 10.39 MB, 10.39 MB, 10.39 MB, 10.39 MB, 10.39 MB, 10.39 MB, 10.39 MB, 10.39 MB, 10.39 MB, 10.39 MB, 10.39 MB, 10.39 MB, 10.39 MB, 10.39 MB, 10.39 MB, 10.39 MB, 10.39 MB, 10.39 MB, 10.39 MB, 10.39 MB, 10.39 MB, 10.39 MB, 10.39 MB, 10.39 MB, 10.39 MB, 10.39 MB, 10.39 MB, 10.39 MB, 10.39 MB, 10.39 MB, 10.39 MB, 10.39 MB, 10.39 MB, 10.40 MB, 10.41 MB, 10.44 MB - BytesReceived: 10.78 MB (11307071) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 69.609ms - FirstBatchArrivalWaitTime: 1s694ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:313 (host=va1046.foo:22000):(Total: 61.914ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 974.11 MB, 6.94 GB, 14.18 GB, 20.88 GB, 27.79 GB, 34.75 GB, 41.80 GB, 48.81 GB, 55.37 GB, 61.92 GB, 68.32 GB, 74.87 GB, 81.86 GB, 88.29 GB, 94.74 GB, 101.56 GB, 108.22 GB, 114.93 GB, 121.36 GB, 127.59 GB, 133.98 GB, 138.37 GB, 143.11 GB, 148.94 GB, 153.78 GB, 157.17 GB, 154.16 GB, 156.03 GB, 159.22 GB, 156.81 GB, 151.46 GB, 153.60 GB, 155.16 GB, 157.24 GB, 159.46 GB, 152.91 GB, 155.87 GB, 154.58 GB, 155.06 GB, 155.48 GB ThreadUsage(16s000ms): 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.03 - BloomFilterBytes: 49.00 MB (51380224) - PeakMemoryUsage: 160.60 GB (172445917807) - PerHostPeakMemUsage: 169.56 GB (182059778211) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 1m53s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 1.60K (1602) - TotalThreadsTotalWallClockTime: 21s682ms - TotalThreadsSysTime: 2s071ms - TotalThreadsUserTime: 7s883ms - TotalThreadsVoluntaryContextSwitches: 22.60K (22597) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 61.871ms - ExecTreePrepareTime: 577.526us DataStreamSender (dst_id=28):(Total: 822.612us, non-child: 822.612us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.05 MB (1105280) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 642.333ms, non-child: 642.333ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 200.761ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 122 (122) - NumInstructions: 8.95K (8951) - OptimizationTime: 414.869ms - PeakMemoryUsage: 4.37 MB (4582912) - PrepareTime: 26.304ms HASH_JOIN_NODE (id=15):(Total: 1.070ms, non-child: 865.804us, % non-child: 80.91%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 451.92K (451915) - BuildTime: 125.910ms - PeakMemoryUsage: 153.09 MB (160524544) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=15): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 95.470ms - BuildRowsPartitioned: 451.92K (451915) - GetNewBlockTime: 405.257us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 28.074ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160449664) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=26):(Total: 2s046ms, non-child: 25.140ms, % non-child: 1.23%) BytesReceived(16s000ms): 5.34 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB - BytesReceived: 6.21 MB (6513198) - ConvertRowBatchTime: 12.067ms - DeserializeRowBatchTimer: 49.240ms - FirstBatchArrivalWaitTime: 1s184ms - PeakMemoryUsage: 0 - RowsReturned: 451.92K (451915) - RowsReturnedRate: 220.85 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=14):(Total: 761.754us, non-child: 680.363us, % non-child: 89.32%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 459.52K (459523) - BuildTime: 132.600ms - PeakMemoryUsage: 25.08 MB (26298624) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 79.109ms - BuildRowsPartitioned: 459.52K (459523) - GetNewBlockTime: 189.214us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 25.345ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 25.02 MB (26231936) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 4s122ms, non-child: 14.626ms, % non-child: 0.35%) BytesReceived(16s000ms): 5.81 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB - BytesReceived: 7.34 MB (7697070) - ConvertRowBatchTime: 10.715ms - DeserializeRowBatchTimer: 16.318ms - FirstBatchArrivalWaitTime: 2s098ms - PeakMemoryUsage: 0 - RowsReturned: 459.52K (459523) - RowsReturnedRate: 111.47 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=13):(Total: 560.288us, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 4.05B (4053418462) - BuildTime: 6m22s - PeakMemoryUsage: 158.58 GB (170274294016) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled, Spilled Runtime filters: 0 of 1 Runtime Filter Published, 1 Disabled - BuildRowsPartitionTime: 6m22s - BuildRowsPartitioned: 4.05B (4053418462) - GetNewBlockTime: 37s872ms - HashBuckets: 536.87M (536870912) - HashCollisions: 0 (0) - HashTablesBuildTime: 35s582ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 158.58 GB (170274235520) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 4 (4) - UnpinTime: 340.775ms HASH_JOIN_NODE (id=12):(Total: 2m59s, non-child: 1m12s, % non-child: 40.54%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 40.18M (40175048) - BuildTime: 8s233ms - PeakMemoryUsage: 3.02 GB (3240188784) - ProbeRows: 76.23M (76231718) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1m3s - RowsReturned: 4.05B (4053418462) - RowsReturnedRate: 22.53 M/sec Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 5s431ms - BuildRowsPartitioned: 40.18M (40175048) - GetNewBlockTime: 3.270ms - HashBuckets: 67.11M (67108864) - HashCollisions: 0 (0) - HashTablesBuildTime: 2s757ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 3.02 GB (3240125568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 6s923ms, non-child: 1s469ms, % non-child: 21.23%) BytesReceived(16s000ms): 207.81 MB, 380.48 MB, 380.48 MB, 380.48 MB, 380.48 MB, 380.48 MB, 380.48 MB, 380.48 MB, 380.48 MB, 380.48 MB, 380.48 MB, 380.48 MB, 380.48 MB, 380.48 MB, 380.48 MB, 380.48 MB, 380.48 MB, 380.48 MB, 380.48 MB, 380.48 MB, 380.48 MB, 380.48 MB, 380.48 MB, 380.48 MB, 380.48 MB, 380.48 MB, 380.48 MB, 380.48 MB, 380.48 MB, 380.48 MB, 380.48 MB, 380.48 MB, 380.48 MB, 380.48 MB, 380.48 MB, 380.48 MB, 380.48 MB, 380.48 MB, 380.48 MB, 380.48 MB - BytesReceived: 380.48 MB (398966520) - ConvertRowBatchTime: 944.037ms - DeserializeRowBatchTimer: 1s419ms - FirstBatchArrivalWaitTime: 1s112ms - PeakMemoryUsage: 0 - RowsReturned: 40.18M (40175048) - RowsReturnedRate: 5.80 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=22):(Total: 1m40s, non-child: 1s311ms, % non-child: 1.30%) BytesReceived(16s000ms): 2.16 MB, 15.38 MB, 42.34 MB, 68.38 MB, 95.39 MB, 122.53 MB, 150.01 MB, 177.38 MB, 203.12 MB, 228.62 MB, 253.83 MB, 279.70 MB, 306.53 MB, 332.85 MB, 357.17 MB, 384.22 MB, 409.94 MB, 437.28 MB, 460.68 MB, 485.82 MB, 509.69 MB, 526.74 MB, 545.71 MB, 568.42 MB, 587.00 MB, 599.74 MB, 621.18 MB, 638.80 MB, 651.45 MB, 656.19 MB, 665.29 MB, 678.26 MB, 683.25 MB, 692.65 MB, 701.22 MB, 705.68 MB, 705.68 MB, 705.68 MB, 705.68 MB, 705.68 MB - BytesReceived: 705.68 MB (739958898) - ConvertRowBatchTime: 860.349ms - DeserializeRowBatchTimer: 5s210ms - FirstBatchArrivalWaitTime: 766.668ms - PeakMemoryUsage: 0 - RowsReturned: 76.23M (76231718) - RowsReturnedRate: 756.18 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=24):(Total: 1s715ms, non-child: 3.803us, % non-child: 0.00%) BytesReceived(16s000ms): 8.18 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB - BytesReceived: 10.01 MB (10500692) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 66.094ms - FirstBatchArrivalWaitTime: 1s715ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:308 (host=vd1330.foo:22000):(Total: 61.862ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 1021.10 MB, 7.26 GB, 14.18 GB, 20.81 GB, 27.66 GB, 34.49 GB, 41.39 GB, 48.27 GB, 54.73 GB, 61.23 GB, 67.45 GB, 73.90 GB, 80.70 GB, 87.25 GB, 93.37 GB, 100.21 GB, 106.70 GB, 113.59 GB, 119.55 GB, 125.94 GB, 132.06 GB, 136.97 GB, 141.72 GB, 147.37 GB, 151.93 GB, 155.09 GB, 156.16 GB, 153.38 GB, 156.52 GB, 157.33 GB, 158.39 GB, 151.21 GB, 152.00 GB, 154.41 GB, 155.91 GB, 153.05 GB, 151.88 GB, 151.18 GB, 153.69 GB, 154.02 GB ThreadUsage(16s000ms): 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.03 - BloomFilterBytes: 49.00 MB (51380224) - PeakMemoryUsage: 160.60 GB (172443922399) - PerHostPeakMemUsage: 169.56 GB (182059948462) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 2m26s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 2.40K (2399) - TotalThreadsTotalWallClockTime: 21s666ms - TotalThreadsSysTime: 2s087ms - TotalThreadsUserTime: 8s158ms - TotalThreadsVoluntaryContextSwitches: 21.06K (21056) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 61.772ms - ExecTreePrepareTime: 628.427us DataStreamSender (dst_id=28):(Total: 943.561us, non-child: 943.561us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.05 MB (1105280) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 647.496ms, non-child: 647.496ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 203.385ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 122 (122) - NumInstructions: 8.95K (8951) - OptimizationTime: 418.997ms - PeakMemoryUsage: 4.37 MB (4582912) - PrepareTime: 24.657ms HASH_JOIN_NODE (id=15):(Total: 1.175ms, non-child: 980.076us, % non-child: 83.36%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 451.92K (451915) - BuildTime: 135.086ms - PeakMemoryUsage: 153.09 MB (160524544) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=15): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 101.671ms - BuildRowsPartitioned: 451.92K (451915) - GetNewBlockTime: 392.257us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 30.452ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160449664) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=26):(Total: 2s036ms, non-child: 26.389ms, % non-child: 1.30%) BytesReceived(16s000ms): 5.40 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB - BytesReceived: 6.21 MB (6513198) - ConvertRowBatchTime: 12.667ms - DeserializeRowBatchTimer: 50.786ms - FirstBatchArrivalWaitTime: 1s183ms - PeakMemoryUsage: 0 - RowsReturned: 451.92K (451915) - RowsReturnedRate: 221.93 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=14):(Total: 884.591us, non-child: 877.306us, % non-child: 99.18%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 458.68K (458678) - BuildTime: 154.724ms - PeakMemoryUsage: 25.08 MB (26298624) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 92.477ms - BuildRowsPartitioned: 458.68K (458678) - GetNewBlockTime: 209.038us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 23.338ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 25.02 MB (26231936) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 4s088ms, non-child: 16.372ms, % non-child: 0.40%) BytesReceived(16s000ms): 5.83 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB - BytesReceived: 7.33 MB (7684203) - ConvertRowBatchTime: 11.774ms - DeserializeRowBatchTimer: 15.364ms - FirstBatchArrivalWaitTime: 2s087ms - PeakMemoryUsage: 0 - RowsReturned: 458.68K (458678) - RowsReturnedRate: 112.20 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=13):(Total: 606.926us, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 3.99B (3987167268) - BuildTime: 5m57s - PeakMemoryUsage: 157.31 GB (168914159840) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled, Spilled Runtime filters: 0 of 1 Runtime Filter Published, 1 Disabled - BuildRowsPartitionTime: 5m56s - BuildRowsPartitioned: 3.99B (3987167268) - GetNewBlockTime: 46s797ms - HashBuckets: 536.87M (536870912) - HashCollisions: 0 (0) - HashTablesBuildTime: 28s827ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 157.31 GB (168914068608) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 4 (4) - UnpinTime: 274.864ms HASH_JOIN_NODE (id=12):(Total: 3m32s, non-child: 1m12s, % non-child: 33.97%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 40.13M (40125141) - BuildTime: 8s457ms - PeakMemoryUsage: 3.02 GB (3240189114) - ProbeRows: 75.62M (75620732) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1m2s - RowsReturned: 3.99B (3987167268) - RowsReturnedRate: 18.79 M/sec Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 5s640ms - BuildRowsPartitioned: 40.13M (40125141) - GetNewBlockTime: 3.201ms - HashBuckets: 67.11M (67108864) - HashCollisions: 0 (0) - HashTablesBuildTime: 2s768ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 3.02 GB (3240125568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 6s686ms, non-child: 1s519ms, % non-child: 22.73%) BytesReceived(16s000ms): 212.88 MB, 380.00 MB, 380.00 MB, 380.00 MB, 380.00 MB, 380.00 MB, 380.00 MB, 380.00 MB, 380.00 MB, 380.00 MB, 380.00 MB, 380.00 MB, 380.00 MB, 380.00 MB, 380.00 MB, 380.00 MB, 380.00 MB, 380.00 MB, 380.00 MB, 380.00 MB, 380.00 MB, 380.00 MB, 380.00 MB, 380.00 MB, 380.00 MB, 380.00 MB, 380.00 MB, 380.00 MB, 380.00 MB, 380.00 MB, 380.00 MB, 380.00 MB, 380.00 MB, 380.00 MB, 380.00 MB, 380.00 MB, 380.00 MB, 380.00 MB, 380.00 MB, 380.00 MB - BytesReceived: 380.00 MB (398455630) - ConvertRowBatchTime: 993.556ms - DeserializeRowBatchTimer: 1s418ms - FirstBatchArrivalWaitTime: 1s105ms - PeakMemoryUsage: 0 - RowsReturned: 40.13M (40125141) - RowsReturnedRate: 6.00 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=22):(Total: 2m14s, non-child: 1s287ms, % non-child: 0.96%) BytesReceived(16s000ms): 2.13 MB, 15.67 MB, 42.46 MB, 68.48 MB, 95.42 MB, 122.30 MB, 149.47 MB, 176.51 MB, 202.04 MB, 227.49 MB, 252.20 MB, 277.76 MB, 304.31 MB, 330.46 MB, 354.65 MB, 381.59 MB, 407.11 MB, 434.32 MB, 457.44 MB, 482.45 MB, 506.02 MB, 525.95 MB, 544.60 MB, 567.07 MB, 584.43 MB, 596.95 MB, 617.47 MB, 633.50 MB, 645.94 MB, 650.71 MB, 659.79 MB, 672.62 MB, 677.57 MB, 687.09 MB, 695.69 MB, 699.98 MB, 699.98 MB, 699.98 MB, 699.98 MB, 699.98 MB - BytesReceived: 699.98 MB (733982660) - ConvertRowBatchTime: 808.674ms - DeserializeRowBatchTimer: 6s385ms - FirstBatchArrivalWaitTime: 778.763ms - PeakMemoryUsage: 0 - RowsReturned: 75.62M (75620732) - RowsReturnedRate: 563.60 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=24):(Total: 1s706ms, non-child: 2.766us, % non-child: 0.00%) BytesReceived(16s000ms): 8.63 MB, 10.29 MB, 10.29 MB, 10.29 MB, 10.29 MB, 10.29 MB, 10.29 MB, 10.29 MB, 10.29 MB, 10.29 MB, 10.29 MB, 10.29 MB, 10.29 MB, 10.29 MB, 10.29 MB, 10.29 MB, 10.29 MB, 10.29 MB, 10.29 MB, 10.29 MB, 10.29 MB, 10.29 MB, 10.29 MB, 10.29 MB, 10.29 MB, 10.29 MB, 10.29 MB, 10.29 MB, 10.29 MB, 10.29 MB, 10.29 MB, 10.29 MB, 10.29 MB, 10.29 MB, 10.29 MB, 10.29 MB, 10.29 MB, 10.32 MB, 10.40 MB, 10.42 MB - BytesReceived: 10.49 MB (10999758) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 71.113ms - FirstBatchArrivalWaitTime: 1s706ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:30d (host=vd1327.foo:22000):(Total: 61.696ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 1.00 GB, 7.20 GB, 13.98 GB, 20.48 GB, 27.26 GB, 34.04 GB, 40.89 GB, 47.67 GB, 54.07 GB, 60.47 GB, 66.65 GB, 73.08 GB, 80.21 GB, 86.68 GB, 92.64 GB, 99.42 GB, 105.70 GB, 112.55 GB, 118.36 GB, 124.47 GB, 130.60 GB, 134.87 GB, 139.36 GB, 145.10 GB, 149.68 GB, 152.90 GB, 157.69 GB, 151.81 GB, 153.69 GB, 154.76 GB, 156.82 GB, 159.73 GB, 154.13 GB, 151.00 GB, 152.53 GB, 155.74 GB, 148.75 GB, 150.58 GB, 151.09 GB, 152.48 GB ThreadUsage(16s000ms): 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.03 - BloomFilterBytes: 49.00 MB (51380224) - PeakMemoryUsage: 160.60 GB (172444259617) - PerHostPeakMemUsage: 169.56 GB (182065073254) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 2m52s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 1.54K (1537) - TotalThreadsTotalWallClockTime: 21s587ms - TotalThreadsSysTime: 2s172ms - TotalThreadsUserTime: 7s959ms - TotalThreadsVoluntaryContextSwitches: 21.84K (21839) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 61.652ms - ExecTreePrepareTime: 636.866us DataStreamSender (dst_id=28):(Total: 1.019ms, non-child: 1.019ms, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.05 MB (1105280) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 647.495ms, non-child: 647.495ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 202.261ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 122 (122) - NumInstructions: 8.95K (8951) - OptimizationTime: 418.341ms - PeakMemoryUsage: 4.37 MB (4582912) - PrepareTime: 26.398ms HASH_JOIN_NODE (id=15):(Total: 1.204ms, non-child: 975.469us, % non-child: 80.97%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 451.92K (451915) - BuildTime: 144.826ms - PeakMemoryUsage: 153.09 MB (160524544) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=15): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 109.138ms - BuildRowsPartitioned: 451.92K (451915) - GetNewBlockTime: 690.765us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 32.393ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160449664) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=26):(Total: 2s029ms, non-child: 25.612ms, % non-child: 1.26%) BytesReceived(16s000ms): 5.41 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB - BytesReceived: 6.21 MB (6513198) - ConvertRowBatchTime: 12.645ms - DeserializeRowBatchTimer: 51.682ms - FirstBatchArrivalWaitTime: 1s184ms - PeakMemoryUsage: 0 - RowsReturned: 451.92K (451915) - RowsReturnedRate: 222.62 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=14):(Total: 918.085us, non-child: 979.085us, % non-child: 100.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 459.45K (459448) - BuildTime: 139.860ms - PeakMemoryUsage: 25.08 MB (26298624) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 85.491ms - BuildRowsPartitioned: 459.45K (459448) - GetNewBlockTime: 268.491us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 20.907ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 25.02 MB (26231936) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 4s101ms, non-child: 15.061ms, % non-child: 0.37%) BytesReceived(16s000ms): 5.85 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB - BytesReceived: 7.34 MB (7696317) - ConvertRowBatchTime: 11.248ms - DeserializeRowBatchTimer: 16.045ms - FirstBatchArrivalWaitTime: 2s092ms - PeakMemoryUsage: 0 - RowsReturned: 459.45K (459448) - RowsReturnedRate: 112.02 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=13):(Total: 606.473us, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 3.93B (3931989927) - BuildTime: 5m26s - PeakMemoryUsage: 160.16 GB (171968203008) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled, Spilled Runtime filters: 0 of 1 Runtime Filter Published, 1 Disabled - BuildRowsPartitionTime: 5m25s - BuildRowsPartitioned: 3.93B (3931989927) - GetNewBlockTime: 24s564ms - HashBuckets: 1.07B (1073741824) - HashCollisions: 0 (0) - HashTablesBuildTime: 1m16s - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 160.16 GB (171968144512) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 5 (5) - UnpinTime: 94.683ms HASH_JOIN_NODE (id=12):(Total: 3m56s, non-child: 1m10s, % non-child: 29.97%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 40.19M (40186461) - BuildTime: 8s338ms - PeakMemoryUsage: 3.02 GB (3240188128) - ProbeRows: 74.56M (74560381) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1m1s - RowsReturned: 3.93B (3931989927) - RowsReturnedRate: 16.61 M/sec Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 5s616ms - BuildRowsPartitioned: 40.19M (40186461) - GetNewBlockTime: 3.483ms - HashBuckets: 67.11M (67108864) - HashCollisions: 0 (0) - HashTablesBuildTime: 2s680ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 3.02 GB (3240125568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 6s717ms, non-child: 1s556ms, % non-child: 23.17%) BytesReceived(16s000ms): 213.55 MB, 380.58 MB, 380.58 MB, 380.58 MB, 380.58 MB, 380.58 MB, 380.58 MB, 380.58 MB, 380.58 MB, 380.58 MB, 380.58 MB, 380.58 MB, 380.58 MB, 380.58 MB, 380.58 MB, 380.58 MB, 380.58 MB, 380.58 MB, 380.58 MB, 380.58 MB, 380.58 MB, 380.58 MB, 380.58 MB, 380.58 MB, 380.58 MB, 380.58 MB, 380.58 MB, 380.58 MB, 380.58 MB, 380.58 MB, 380.58 MB, 380.58 MB, 380.58 MB, 380.58 MB, 380.58 MB, 380.58 MB, 380.58 MB, 380.58 MB, 380.58 MB, 380.58 MB - BytesReceived: 380.58 MB (399068250) - ConvertRowBatchTime: 950.475ms - DeserializeRowBatchTimer: 1s548ms - FirstBatchArrivalWaitTime: 1s101ms - PeakMemoryUsage: 0 - RowsReturned: 40.19M (40186461) - RowsReturnedRate: 5.98 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=22):(Total: 2m39s, non-child: 1s248ms, % non-child: 0.78%) BytesReceived(16s000ms): 2.09 MB, 15.32 MB, 41.68 MB, 67.23 MB, 93.86 MB, 120.57 MB, 147.52 MB, 174.42 MB, 199.65 MB, 224.75 MB, 249.22 MB, 275.91 MB, 302.49 MB, 328.05 MB, 351.59 MB, 378.20 MB, 403.30 MB, 430.10 MB, 452.71 MB, 478.06 MB, 500.39 MB, 517.34 MB, 535.96 MB, 558.05 MB, 575.78 MB, 588.01 MB, 607.57 MB, 623.33 MB, 636.66 MB, 641.18 MB, 649.80 MB, 662.61 MB, 667.87 MB, 676.68 MB, 685.27 MB, 690.32 MB, 690.32 MB, 690.32 MB, 690.32 MB, 690.32 MB - BytesReceived: 690.32 MB (723852549) - ConvertRowBatchTime: 806.091ms - DeserializeRowBatchTimer: 5s350ms - FirstBatchArrivalWaitTime: 765.065ms - PeakMemoryUsage: 0 - RowsReturned: 74.56M (74560381) - RowsReturnedRate: 466.48 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=24):(Total: 1s712ms, non-child: 3.613us, % non-child: 0.00%) BytesReceived(16s000ms): 8.79 MB, 10.45 MB, 10.45 MB, 10.45 MB, 10.45 MB, 10.45 MB, 10.45 MB, 10.45 MB, 10.45 MB, 10.45 MB, 10.45 MB, 10.45 MB, 10.45 MB, 10.45 MB, 10.45 MB, 10.45 MB, 10.45 MB, 10.45 MB, 10.45 MB, 10.45 MB, 10.45 MB, 10.45 MB, 10.45 MB, 10.45 MB, 10.45 MB, 10.45 MB, 10.45 MB, 10.45 MB, 10.45 MB, 10.45 MB, 10.45 MB, 10.45 MB, 10.45 MB, 10.45 MB, 10.45 MB, 10.45 MB, 10.45 MB, 10.46 MB, 10.50 MB, 10.51 MB - BytesReceived: 10.90 MB (11427696) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 69.725ms - FirstBatchArrivalWaitTime: 1s712ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:2ff (host=vd1104.foo:22000):(Total: 61.609ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 1.05 GB, 7.29 GB, 14.21 GB, 20.80 GB, 27.59 GB, 34.39 GB, 41.24 GB, 48.06 GB, 54.47 GB, 60.88 GB, 67.12 GB, 73.53 GB, 80.35 GB, 86.90 GB, 93.00 GB, 99.83 GB, 106.27 GB, 112.92 GB, 119.10 GB, 125.38 GB, 131.57 GB, 135.64 GB, 140.48 GB, 146.12 GB, 150.80 GB, 154.08 GB, 155.60 GB, 152.75 GB, 155.84 GB, 156.80 GB, 159.19 GB, 150.40 GB, 151.76 GB, 153.85 GB, 155.22 GB, 151.83 GB, 153.71 GB, 154.25 GB, 152.59 GB, 153.11 GB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.03 - BloomFilterBytes: 49.00 MB (51380224) - PeakMemoryUsage: 160.61 GB (172449508351) - PerHostPeakMemUsage: 169.57 GB (182079364681) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 2m10s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 1.82K (1822) - TotalThreadsTotalWallClockTime: 21s648ms - TotalThreadsSysTime: 2s104ms - TotalThreadsUserTime: 8s075ms - TotalThreadsVoluntaryContextSwitches: 21.86K (21858) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 61.535ms - ExecTreePrepareTime: 971.503us DataStreamSender (dst_id=28):(Total: 1.052ms, non-child: 1.052ms, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.05 MB (1105280) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 658.389ms, non-child: 658.389ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 203.906ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 122 (122) - NumInstructions: 8.95K (8951) - OptimizationTime: 427.597ms - PeakMemoryUsage: 4.37 MB (4582912) - PrepareTime: 26.384ms HASH_JOIN_NODE (id=15):(Total: 1.833ms, non-child: 1.157ms, % non-child: 63.11%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 451.92K (451915) - BuildTime: 132.069ms - PeakMemoryUsage: 153.09 MB (160524544) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=15): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 96.250ms - BuildRowsPartitioned: 451.92K (451915) - GetNewBlockTime: 403.260us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 32.962ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160449664) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=26):(Total: 2s029ms, non-child: 27.597ms, % non-child: 1.36%) BytesReceived(16s000ms): 5.50 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB - BytesReceived: 6.21 MB (6513198) - ConvertRowBatchTime: 12.156ms - DeserializeRowBatchTimer: 54.227ms - FirstBatchArrivalWaitTime: 1s174ms - PeakMemoryUsage: 0 - RowsReturned: 451.92K (451915) - RowsReturnedRate: 222.64 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=14):(Total: 1.417ms, non-child: 807.567us, % non-child: 56.95%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 459.77K (459768) - BuildTime: 144.566ms - PeakMemoryUsage: 25.08 MB (26298624) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 84.104ms - BuildRowsPartitioned: 459.77K (459768) - GetNewBlockTime: 147.623us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 26.837ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 25.02 MB (26231936) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 4s091ms, non-child: 14.939ms, % non-child: 0.37%) BytesReceived(16s000ms): 6.03 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB - BytesReceived: 7.34 MB (7700544) - ConvertRowBatchTime: 11.381ms - DeserializeRowBatchTimer: 15.320ms - FirstBatchArrivalWaitTime: 2s078ms - PeakMemoryUsage: 0 - RowsReturned: 459.77K (459768) - RowsReturnedRate: 112.36 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=13):(Total: 1.058ms, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 3.97B (3972087453) - BuildTime: 6m2s - PeakMemoryUsage: 157.31 GB (168914159840) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled, Spilled Runtime filters: 0 of 1 Runtime Filter Published, 1 Disabled - BuildRowsPartitionTime: 6m2s - BuildRowsPartitioned: 3.97B (3972087453) - GetNewBlockTime: 38s660ms - HashBuckets: 536.87M (536870912) - HashCollisions: 0 (0) - HashTablesBuildTime: 50s584ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 157.31 GB (168914068608) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 4 (4) - UnpinTime: 127.142ms HASH_JOIN_NODE (id=12):(Total: 3m20s, non-child: 1m15s, % non-child: 37.80%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 40.19M (40186096) - BuildTime: 8s441ms - PeakMemoryUsage: 3.02 GB (3240188128) - ProbeRows: 75.33M (75325733) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1m6s - RowsReturned: 3.97B (3972087453) - RowsReturnedRate: 19.86 M/sec Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 5s606ms - BuildRowsPartitioned: 40.19M (40186096) - GetNewBlockTime: 3.010ms - HashBuckets: 67.11M (67108864) - HashCollisions: 0 (0) - HashTablesBuildTime: 2s784ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 3.02 GB (3240125568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 6s721ms, non-child: 1s482ms, % non-child: 22.06%) BytesReceived(16s000ms): 218.09 MB, 380.58 MB, 380.58 MB, 380.58 MB, 380.58 MB, 380.58 MB, 380.58 MB, 380.58 MB, 380.58 MB, 380.58 MB, 380.58 MB, 380.58 MB, 380.58 MB, 380.58 MB, 380.58 MB, 380.58 MB, 380.58 MB, 380.58 MB, 380.58 MB, 380.58 MB, 380.58 MB, 380.58 MB, 380.58 MB, 380.58 MB, 380.58 MB, 380.58 MB, 380.58 MB, 380.58 MB, 380.58 MB, 380.58 MB, 380.58 MB, 380.58 MB, 380.58 MB, 380.58 MB, 380.58 MB, 380.58 MB, 380.58 MB, 380.58 MB, 380.58 MB, 380.58 MB - BytesReceived: 380.58 MB (399069804) - ConvertRowBatchTime: 979.794ms - DeserializeRowBatchTimer: 1s403ms - FirstBatchArrivalWaitTime: 1s105ms - PeakMemoryUsage: 0 - RowsReturned: 40.19M (40186096) - RowsReturnedRate: 5.98 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=22):(Total: 1m58s, non-child: 1s382ms, % non-child: 1.17%) BytesReceived(16s000ms): 2.12 MB, 15.98 MB, 42.64 MB, 68.55 MB, 95.27 MB, 121.99 MB, 148.91 MB, 175.77 MB, 201.15 MB, 226.35 MB, 251.05 MB, 276.52 MB, 303.11 MB, 329.24 MB, 353.42 MB, 380.34 MB, 405.74 MB, 432.84 MB, 456.04 MB, 481.17 MB, 504.53 MB, 521.41 MB, 540.02 MB, 562.30 MB, 580.39 MB, 592.87 MB, 614.39 MB, 631.68 MB, 643.81 MB, 648.65 MB, 657.85 MB, 670.68 MB, 675.53 MB, 685.09 MB, 693.55 MB, 697.63 MB, 697.63 MB, 697.63 MB, 697.63 MB, 697.63 MB - BytesReceived: 697.63 MB (731516624) - ConvertRowBatchTime: 905.058ms - DeserializeRowBatchTimer: 7s487ms - FirstBatchArrivalWaitTime: 757.429ms - PeakMemoryUsage: 0 - RowsReturned: 75.33M (75325733) - RowsReturnedRate: 635.85 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=24):(Total: 1s699ms, non-child: 2.585us, % non-child: 0.00%) BytesReceived(16s000ms): 8.75 MB, 10.35 MB, 10.35 MB, 10.35 MB, 10.35 MB, 10.35 MB, 10.35 MB, 10.35 MB, 10.35 MB, 10.35 MB, 10.35 MB, 10.35 MB, 10.35 MB, 10.35 MB, 10.35 MB, 10.35 MB, 10.35 MB, 10.35 MB, 10.35 MB, 10.35 MB, 10.35 MB, 10.35 MB, 10.35 MB, 10.35 MB, 10.35 MB, 10.35 MB, 10.35 MB, 10.35 MB, 10.35 MB, 10.35 MB, 10.35 MB, 10.35 MB, 10.35 MB, 10.35 MB, 10.35 MB, 10.35 MB, 10.35 MB, 10.39 MB, 10.45 MB, 10.45 MB - BytesReceived: 10.69 MB (11209677) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 68.950ms - FirstBatchArrivalWaitTime: 1s699ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:2f6 (host=ve1134.foo:22000):(Total: 61.554ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 1012.26 MB, 7.04 GB, 14.10 GB, 20.64 GB, 27.40 GB, 34.10 GB, 40.89 GB, 47.82 GB, 54.23 GB, 60.66 GB, 66.91 GB, 73.32 GB, 80.18 GB, 86.75 GB, 92.84 GB, 99.62 GB, 106.08 GB, 112.87 GB, 118.80 GB, 124.95 GB, 131.21 GB, 135.59 GB, 140.17 GB, 145.96 GB, 150.84 GB, 154.49 GB, 156.26 GB, 152.63 GB, 155.70 GB, 156.60 GB, 159.08 GB, 150.83 GB, 151.40 GB, 153.72 GB, 155.12 GB, 152.03 GB, 152.61 GB, 148.26 GB, 152.09 GB, 153.24 GB ThreadUsage(16s000ms): 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.03 - BloomFilterBytes: 49.00 MB (51380224) - PeakMemoryUsage: 160.61 GB (172451229419) - PerHostPeakMemUsage: 169.56 GB (182064409883) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 1m57s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 1.79K (1792) - TotalThreadsTotalWallClockTime: 21s786ms - TotalThreadsSysTime: 2s245ms - TotalThreadsUserTime: 8s195ms - TotalThreadsVoluntaryContextSwitches: 21.20K (21204) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 61.501ms - ExecTreePrepareTime: 730.902us DataStreamSender (dst_id=28):(Total: 1.130ms, non-child: 1.130ms, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.05 MB (1105280) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 662.696ms, non-child: 662.696ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 203.383ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 122 (122) - NumInstructions: 8.95K (8951) - OptimizationTime: 433.171ms - PeakMemoryUsage: 4.37 MB (4582912) - PrepareTime: 25.673ms HASH_JOIN_NODE (id=15):(Total: 1.371ms, non-child: 922.213us, % non-child: 67.25%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 451.92K (451915) - BuildTime: 122.851ms - PeakMemoryUsage: 153.09 MB (160524544) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=15): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 92.751ms - BuildRowsPartitioned: 451.92K (451915) - GetNewBlockTime: 406.472us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 27.470ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160449664) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=26):(Total: 2s050ms, non-child: 27.569ms, % non-child: 1.34%) BytesReceived(16s000ms): 5.39 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB - BytesReceived: 6.21 MB (6513198) - ConvertRowBatchTime: 11.626ms - DeserializeRowBatchTimer: 58.101ms - FirstBatchArrivalWaitTime: 1s171ms - PeakMemoryUsage: 0 - RowsReturned: 451.92K (451915) - RowsReturnedRate: 220.38 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=14):(Total: 1.063ms, non-child: 791.141us, % non-child: 74.40%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 460.19K (460188) - BuildTime: 133.017ms - PeakMemoryUsage: 25.08 MB (26298624) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 77.298ms - BuildRowsPartitioned: 460.19K (460188) - GetNewBlockTime: 184.155us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 22.621ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 25.02 MB (26231936) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 4s087ms, non-child: 13.522ms, % non-child: 0.33%) BytesReceived(16s000ms): 5.86 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB - BytesReceived: 7.35 MB (7709182) - ConvertRowBatchTime: 9.611ms - DeserializeRowBatchTimer: 17.087ms - FirstBatchArrivalWaitTime: 2s077ms - PeakMemoryUsage: 0 - RowsReturned: 460.19K (460188) - RowsReturnedRate: 112.59 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=13):(Total: 733.792us, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 3.97B (3969911204) - BuildTime: 6m25s - PeakMemoryUsage: 157.31 GB (168914143472) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled, Spilled Runtime filters: 0 of 1 Runtime Filter Published, 1 Disabled - BuildRowsPartitionTime: 6m25s - BuildRowsPartitioned: 3.97B (3969911204) - GetNewBlockTime: 44s215ms - HashBuckets: 536.87M (536870912) - HashCollisions: 0 (0) - HashTablesBuildTime: 26s308ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 157.31 GB (168914068608) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 4 (4) - UnpinTime: 106.288ms HASH_JOIN_NODE (id=12):(Total: 3m3s, non-child: 1m12s, % non-child: 39.70%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 40.22M (40222547) - BuildTime: 8s706ms - PeakMemoryUsage: 3.02 GB (3240188128) - ProbeRows: 74.77M (74767223) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1m3s - RowsReturned: 3.97B (3969911204) - RowsReturnedRate: 21.67 M/sec Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 5s731ms - BuildRowsPartitioned: 40.22M (40222547) - GetNewBlockTime: 3.258ms - HashBuckets: 67.11M (67108864) - HashCollisions: 0 (0) - HashTablesBuildTime: 2s932ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 3.02 GB (3240125568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 6s590ms, non-child: 1s519ms, % non-child: 23.05%) BytesReceived(16s000ms): 213.27 MB, 380.92 MB, 380.92 MB, 380.92 MB, 380.92 MB, 380.92 MB, 380.92 MB, 380.92 MB, 380.92 MB, 380.92 MB, 380.92 MB, 380.92 MB, 380.92 MB, 380.92 MB, 380.92 MB, 380.92 MB, 380.92 MB, 380.92 MB, 380.92 MB, 380.92 MB, 380.92 MB, 380.92 MB, 380.92 MB, 380.92 MB, 380.92 MB, 380.92 MB, 380.92 MB, 380.92 MB, 380.92 MB, 380.92 MB, 380.92 MB, 380.92 MB, 380.92 MB, 380.92 MB, 380.92 MB, 380.92 MB, 380.92 MB, 380.92 MB, 380.92 MB, 380.92 MB - BytesReceived: 380.92 MB (399419185) - ConvertRowBatchTime: 966.258ms - DeserializeRowBatchTimer: 1s484ms - FirstBatchArrivalWaitTime: 1s096ms - PeakMemoryUsage: 0 - RowsReturned: 40.22M (40222547) - RowsReturnedRate: 6.10 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=22):(Total: 1m44s, non-child: 1s309ms, % non-child: 1.25%) BytesReceived(16s000ms): 2.12 MB, 15.43 MB, 41.78 MB, 67.27 MB, 93.74 MB, 120.31 MB, 147.16 MB, 173.80 MB, 198.88 MB, 224.00 MB, 248.48 MB, 273.91 MB, 300.42 MB, 326.35 MB, 350.37 MB, 376.98 MB, 402.16 MB, 429.11 MB, 452.00 MB, 476.69 MB, 499.86 MB, 516.69 MB, 535.33 MB, 557.69 MB, 576.58 MB, 591.16 MB, 611.37 MB, 627.07 MB, 639.05 MB, 643.84 MB, 653.06 MB, 665.68 MB, 670.49 MB, 680.06 MB, 688.49 MB, 692.44 MB, 692.44 MB, 692.44 MB, 692.44 MB, 692.44 MB - BytesReceived: 692.44 MB (726075228) - ConvertRowBatchTime: 838.469ms - DeserializeRowBatchTimer: 7s034ms - FirstBatchArrivalWaitTime: 759.747ms - PeakMemoryUsage: 0 - RowsReturned: 74.77M (74767223) - RowsReturnedRate: 714.42 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=24):(Total: 1s698ms, non-child: 4.110us, % non-child: 0.00%) BytesReceived(16s000ms): 8.43 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.09 MB, 10.12 MB, 10.12 MB - BytesReceived: 10.12 MB (10613479) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 70.443ms - FirstBatchArrivalWaitTime: 1s698ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:338 (host=vd1124.foo:22000):(Total: 61.425ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 974.23 MB, 7.04 GB, 14.25 GB, 20.95 GB, 27.87 GB, 34.80 GB, 41.78 GB, 48.79 GB, 55.33 GB, 61.87 GB, 68.24 GB, 74.79 GB, 81.71 GB, 88.28 GB, 94.51 GB, 101.41 GB, 108.07 GB, 114.86 GB, 121.10 GB, 127.54 GB, 133.90 GB, 138.12 GB, 142.97 GB, 148.74 GB, 153.71 GB, 157.58 GB, 153.36 GB, 155.64 GB, 158.77 GB, 158.37 GB, 150.93 GB, 152.99 GB, 154.94 GB, 156.96 GB, 158.83 GB, 153.44 GB, 156.28 GB, 156.68 GB, 157.64 GB, 157.69 GB ThreadUsage(16s000ms): 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.03 - BloomFilterBytes: 49.00 MB (51380224) - PeakMemoryUsage: 160.99 GB (172864964303) - PerHostPeakMemUsage: 169.55 GB (182056460523) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 1m59s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 1.56K (1564) - TotalThreadsTotalWallClockTime: 21s923ms - TotalThreadsSysTime: 2s387ms - TotalThreadsUserTime: 7s914ms - TotalThreadsVoluntaryContextSwitches: 20.93K (20929) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 61.373ms - ExecTreePrepareTime: 600.273us BlockMgr: - BlockWritesOutstanding: 1 (1) - BlocksCreated: 24.16K (24157) - BlocksRecycled: 354 (354) - BufferedPins: 0 (0) - BytesWritten: 42.59 GB (45734690816) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 161.38 GB (173283483648) - ScratchFileUsedBytes: 42.59 GB (45734690816) - TotalBufferWaitTime: 5s796ms - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=28):(Total: 886.325us, non-child: 886.325us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.05 MB (1105280) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 616.295ms, non-child: 616.295ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 204.348ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 122 (122) - NumInstructions: 8.95K (8951) - OptimizationTime: 384.320ms - PeakMemoryUsage: 4.37 MB (4582912) - PrepareTime: 27.082ms HASH_JOIN_NODE (id=15):(Total: 1.135ms, non-child: 889.331us, % non-child: 78.30%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 451.92K (451915) - BuildTime: 126.133ms - PeakMemoryUsage: 153.09 MB (160524544) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=15): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 101.858ms - BuildRowsPartitioned: 451.92K (451915) - GetNewBlockTime: 377.807us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 22.174ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160449664) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=26):(Total: 2s060ms, non-child: 26.105ms, % non-child: 1.27%) BytesReceived(16s000ms): 5.37 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB - BytesReceived: 6.21 MB (6513198) - ConvertRowBatchTime: 12.923ms - DeserializeRowBatchTimer: 52.977ms - FirstBatchArrivalWaitTime: 1s203ms - PeakMemoryUsage: 0 - RowsReturned: 451.92K (451915) - RowsReturnedRate: 219.30 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=14):(Total: 891.016us, non-child: 897.733us, % non-child: 100.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 458.58K (458581) - BuildTime: 162.595ms - PeakMemoryUsage: 25.08 MB (26298624) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 97.690ms - BuildRowsPartitioned: 458.58K (458581) - GetNewBlockTime: 179.085us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 24.325ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 25.02 MB (26231936) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 4s139ms, non-child: 15.510ms, % non-child: 0.37%) BytesReceived(16s000ms): 5.81 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB - BytesReceived: 7.33 MB (7682563) - ConvertRowBatchTime: 11.545ms - DeserializeRowBatchTimer: 15.757ms - FirstBatchArrivalWaitTime: 2s106ms - PeakMemoryUsage: 0 - RowsReturned: 458.58K (458581) - RowsReturnedRate: 110.77 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=13):(Total: 620.843us, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 4.05B (4049535773) - BuildTime: 6m18s - PeakMemoryUsage: 160.06 GB (171867539712) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled, Spilled Runtime filters: 0 of 1 Runtime Filter Published, 1 Disabled - BuildRowsPartitionTime: 6m18s - BuildRowsPartitioned: 4.05B (4049535773) - GetNewBlockTime: 33s743ms - HashBuckets: 536.87M (536870912) - HashCollisions: 0 (0) - HashTablesBuildTime: 41s400ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 160.06 GB (171867481216) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 4 (4) - UnpinTime: 279.763ms HASH_JOIN_NODE (id=12):(Total: 3m4s, non-child: 1m11s, % non-child: 38.84%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 40.11M (40112758) - BuildTime: 8s483ms - PeakMemoryUsage: 3.02 GB (3240190222) - ProbeRows: 75.91M (75907932) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1m2s - RowsReturned: 4.05B (4049535773) - RowsReturnedRate: 21.98 M/sec Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 5s602ms - BuildRowsPartitioned: 40.11M (40112758) - GetNewBlockTime: 4.333ms - HashBuckets: 67.11M (67108864) - HashCollisions: 0 (0) - HashTablesBuildTime: 2s835ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 3.02 GB (3240125568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 6s612ms, non-child: 1s704ms, % non-child: 25.77%) BytesReceived(16s000ms): 208.83 MB, 379.89 MB, 379.89 MB, 379.89 MB, 379.89 MB, 379.89 MB, 379.89 MB, 379.89 MB, 379.89 MB, 379.89 MB, 379.89 MB, 379.89 MB, 379.89 MB, 379.89 MB, 379.89 MB, 379.89 MB, 379.89 MB, 379.89 MB, 379.89 MB, 379.89 MB, 379.89 MB, 379.89 MB, 379.89 MB, 379.89 MB, 379.89 MB, 379.89 MB, 379.89 MB, 379.89 MB, 379.89 MB, 379.89 MB, 379.89 MB, 379.89 MB, 379.89 MB, 379.89 MB, 379.89 MB, 379.89 MB, 379.89 MB, 379.89 MB, 379.89 MB, 379.89 MB - BytesReceived: 379.89 MB (398339009) - ConvertRowBatchTime: 939.125ms - DeserializeRowBatchTimer: 1s889ms - FirstBatchArrivalWaitTime: 1s123ms - PeakMemoryUsage: 0 - RowsReturned: 40.11M (40112758) - RowsReturnedRate: 6.07 M/sec - SendersBlockedTimer: 158.077ms - SendersBlockedTotalTimer(*): 13s136ms EXCHANGE_NODE (id=22):(Total: 1m46s, non-child: 1s295ms, % non-child: 1.21%) BytesReceived(16s000ms): 2.11 MB, 15.37 MB, 42.24 MB, 68.26 MB, 95.17 MB, 122.13 MB, 149.41 MB, 176.62 MB, 202.28 MB, 227.75 MB, 252.66 MB, 278.37 MB, 304.96 MB, 331.02 MB, 355.23 MB, 382.35 MB, 408.02 MB, 435.39 MB, 458.69 MB, 483.76 MB, 507.53 MB, 524.36 MB, 543.20 MB, 565.60 MB, 584.73 MB, 599.36 MB, 619.80 MB, 635.82 MB, 648.35 MB, 653.13 MB, 662.39 MB, 675.30 MB, 680.20 MB, 689.84 MB, 698.35 MB, 702.61 MB, 702.61 MB, 702.61 MB, 702.61 MB, 702.61 MB - BytesReceived: 702.61 MB (736738782) - ConvertRowBatchTime: 833.348ms - DeserializeRowBatchTimer: 7s083ms - FirstBatchArrivalWaitTime: 803.110ms - PeakMemoryUsage: 0 - RowsReturned: 75.91M (75907932) - RowsReturnedRate: 710.34 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=24):(Total: 1s725ms, non-child: 3.386us, % non-child: 0.00%) BytesReceived(16s000ms): 8.74 MB, 10.66 MB, 10.66 MB, 10.66 MB, 10.66 MB, 10.66 MB, 10.66 MB, 10.66 MB, 10.66 MB, 10.66 MB, 10.66 MB, 10.66 MB, 10.66 MB, 10.66 MB, 10.66 MB, 10.66 MB, 10.66 MB, 10.66 MB, 10.66 MB, 10.66 MB, 10.66 MB, 10.66 MB, 10.66 MB, 10.66 MB, 10.66 MB, 10.66 MB, 10.66 MB, 10.66 MB, 10.66 MB, 10.66 MB, 10.66 MB, 10.66 MB, 10.66 MB, 10.66 MB, 10.66 MB, 10.66 MB, 10.66 MB, 10.67 MB, 10.69 MB, 10.71 MB - BytesReceived: 11.16 MB (11703689) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 77.330ms - FirstBatchArrivalWaitTime: 1s725ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:306 (host=vc1519.foo:22000):(Total: 61.364ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 1002.66 MB, 6.76 GB, 13.52 GB, 20.09 GB, 26.67 GB, 33.24 GB, 39.88 GB, 46.53 GB, 52.74 GB, 58.96 GB, 65.17 GB, 71.46 GB, 78.03 GB, 84.38 GB, 90.43 GB, 97.37 GB, 103.76 GB, 110.49 GB, 116.16 GB, 122.14 GB, 127.98 GB, 132.25 GB, 136.80 GB, 142.03 GB, 146.76 GB, 149.92 GB, 154.58 GB, 158.63 GB, 150.18 GB, 151.27 GB, 153.24 GB, 156.19 GB, 157.45 GB, 157.11 GB, 149.78 GB, 153.28 GB, 156.81 GB, 150.67 GB, 150.21 GB, 154.94 GB ThreadUsage(16s000ms): 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.03 - BloomFilterBytes: 49.00 MB (51380224) - PeakMemoryUsage: 160.61 GB (172448829823) - PerHostPeakMemUsage: 169.57 GB (182071139285) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 2m41s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 1.38K (1376) - TotalThreadsTotalWallClockTime: 21s828ms - TotalThreadsSysTime: 2s322ms - TotalThreadsUserTime: 8s011ms - TotalThreadsVoluntaryContextSwitches: 23.16K (23155) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 61.313ms - ExecTreePrepareTime: 587.387us DataStreamSender (dst_id=28):(Total: 1.159ms, non-child: 1.159ms, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.05 MB (1105280) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 637.441ms, non-child: 637.441ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 199.065ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 122 (122) - NumInstructions: 8.95K (8951) - OptimizationTime: 412.493ms - PeakMemoryUsage: 4.37 MB (4582912) - PrepareTime: 25.450ms HASH_JOIN_NODE (id=15):(Total: 1.104ms, non-child: 982.104us, % non-child: 88.89%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 451.92K (451915) - BuildTime: 142.157ms - PeakMemoryUsage: 153.09 MB (160524544) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=15): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 104.350ms - BuildRowsPartitioned: 451.92K (451915) - GetNewBlockTime: 360.510us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 34.279ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160449664) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=26):(Total: 2s043ms, non-child: 24.400ms, % non-child: 1.19%) BytesReceived(16s000ms): 5.38 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB - BytesReceived: 6.21 MB (6513198) - ConvertRowBatchTime: 13.007ms - DeserializeRowBatchTimer: 50.541ms - FirstBatchArrivalWaitTime: 1s192ms - PeakMemoryUsage: 0 - RowsReturned: 451.92K (451915) - RowsReturnedRate: 221.13 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=14):(Total: 836.105us, non-child: 936.957us, % non-child: 100.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 458.87K (458867) - BuildTime: 181.246ms - PeakMemoryUsage: 25.08 MB (26298624) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 106.660ms - BuildRowsPartitioned: 458.87K (458867) - GetNewBlockTime: 203.637us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 30.924ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 25.02 MB (26231936) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 4s084ms, non-child: 15.594ms, % non-child: 0.38%) BytesReceived(16s000ms): 5.82 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB - BytesReceived: 7.33 MB (7686474) - ConvertRowBatchTime: 11.379ms - DeserializeRowBatchTimer: 17.483ms - FirstBatchArrivalWaitTime: 2s105ms - PeakMemoryUsage: 0 - RowsReturned: 458.87K (458867) - RowsReturnedRate: 112.34 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=13):(Total: 568.046us, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 3.85B (3851313611) - BuildTime: 5m32s - PeakMemoryUsage: 160.16 GB (171968792832) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled, Spilled Runtime filters: 0 of 1 Runtime Filter Published, 1 Disabled - BuildRowsPartitionTime: 5m32s - BuildRowsPartitioned: 3.85B (3851313611) - GetNewBlockTime: 11s017ms - HashBuckets: 536.87M (536870912) - HashCollisions: 0 (0) - HashTablesBuildTime: 1m13s - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 160.16 GB (171968734336) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 4 (4) - UnpinTime: 333.558ms HASH_JOIN_NODE (id=12):(Total: 3m50s, non-child: 1m15s, % non-child: 32.61%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 40.08M (40081790) - BuildTime: 8s443ms - PeakMemoryUsage: 3.02 GB (3240188128) - ProbeRows: 73.36M (73356152) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1m5s - RowsReturned: 3.85B (3851313611) - RowsReturnedRate: 16.74 M/sec Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 5s513ms - BuildRowsPartitioned: 40.08M (40081790) - GetNewBlockTime: 4.027ms - HashBuckets: 67.11M (67108864) - HashCollisions: 0 (0) - HashTablesBuildTime: 2s881ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 3.02 GB (3240125568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 6s843ms, non-child: 1s740ms, % non-child: 25.44%) BytesReceived(16s000ms): 211.04 MB, 379.61 MB, 379.61 MB, 379.61 MB, 379.61 MB, 379.61 MB, 379.61 MB, 379.61 MB, 379.61 MB, 379.61 MB, 379.61 MB, 379.61 MB, 379.61 MB, 379.61 MB, 379.61 MB, 379.61 MB, 379.61 MB, 379.61 MB, 379.61 MB, 379.61 MB, 379.61 MB, 379.61 MB, 379.61 MB, 379.61 MB, 379.61 MB, 379.61 MB, 379.61 MB, 379.61 MB, 379.61 MB, 379.61 MB, 379.61 MB, 379.61 MB, 379.61 MB, 379.61 MB, 379.61 MB, 379.61 MB, 379.61 MB, 379.61 MB, 379.61 MB, 379.61 MB - BytesReceived: 379.61 MB (398051093) - ConvertRowBatchTime: 1s004ms - DeserializeRowBatchTimer: 1s796ms - FirstBatchArrivalWaitTime: 1s112ms - PeakMemoryUsage: 0 - RowsReturned: 40.08M (40081790) - RowsReturnedRate: 5.86 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=22):(Total: 2m29s, non-child: 3s268ms, % non-child: 2.19%) BytesReceived(16s000ms): 2.06 MB, 14.99 MB, 40.84 MB, 65.81 MB, 91.78 MB, 117.73 MB, 143.94 MB, 170.33 MB, 195.15 MB, 219.98 MB, 244.08 MB, 269.08 MB, 294.96 MB, 320.37 MB, 345.17 MB, 372.65 MB, 397.34 MB, 423.64 MB, 445.78 MB, 470.88 MB, 492.64 MB, 509.47 MB, 527.84 MB, 549.39 MB, 566.73 MB, 578.69 MB, 598.09 MB, 613.67 MB, 626.42 MB, 630.92 MB, 639.48 MB, 652.14 MB, 657.21 MB, 665.96 MB, 674.37 MB, 679.16 MB, 679.16 MB, 679.16 MB, 679.16 MB, 679.16 MB - BytesReceived: 679.16 MB (712155423) - ConvertRowBatchTime: 839.437ms - DeserializeRowBatchTimer: 7s604ms - FirstBatchArrivalWaitTime: 783.151ms - PeakMemoryUsage: 0 - RowsReturned: 73.36M (73356152) - RowsReturnedRate: 492.28 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=24):(Total: 1s709ms, non-child: 3.395us, % non-child: 0.00%) BytesReceived(16s000ms): 8.48 MB, 10.21 MB, 10.21 MB, 10.21 MB, 10.21 MB, 10.21 MB, 10.21 MB, 10.21 MB, 10.21 MB, 10.21 MB, 10.21 MB, 10.21 MB, 10.21 MB, 10.21 MB, 10.21 MB, 10.21 MB, 10.21 MB, 10.21 MB, 10.21 MB, 10.21 MB, 10.21 MB, 10.21 MB, 10.21 MB, 10.21 MB, 10.21 MB, 10.21 MB, 10.21 MB, 10.21 MB, 10.21 MB, 10.21 MB, 10.21 MB, 10.21 MB, 10.21 MB, 10.21 MB, 10.21 MB, 10.21 MB, 10.21 MB, 10.23 MB, 10.24 MB, 10.27 MB - BytesReceived: 10.41 MB (10918326) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 79.794ms - FirstBatchArrivalWaitTime: 1s709ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:324 (host=vd1127.foo:22000):(Total: 61.277ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 992.95 MB, 7.16 GB, 14.19 GB, 20.85 GB, 27.70 GB, 34.55 GB, 41.50 GB, 48.41 GB, 54.92 GB, 61.57 GB, 67.92 GB, 74.45 GB, 81.32 GB, 87.91 GB, 94.12 GB, 101.01 GB, 107.71 GB, 114.55 GB, 120.78 GB, 127.24 GB, 133.89 GB, 138.58 GB, 143.48 GB, 149.21 GB, 153.86 GB, 157.10 GB, 153.44 GB, 154.75 GB, 157.89 GB, 158.86 GB, 155.19 GB, 152.17 GB, 153.20 GB, 155.73 GB, 157.47 GB, 153.52 GB, 153.44 GB, 154.21 GB, 154.75 GB, 153.09 GB ThreadUsage(16s000ms): 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.03 - BloomFilterBytes: 49.00 MB (51380224) - PeakMemoryUsage: 160.99 GB (172860626783) - PerHostPeakMemUsage: 169.57 GB (182069272751) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 2m - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 1.66K (1656) - TotalThreadsTotalWallClockTime: 21s756ms - TotalThreadsSysTime: 2s192ms - TotalThreadsUserTime: 8s058ms - TotalThreadsVoluntaryContextSwitches: 20.92K (20921) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 61.218ms - ExecTreePrepareTime: 789.107us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 24.02K (24018) - BlocksRecycled: 354 (354) - BufferedPins: 0 (0) - BytesWritten: 41.50 GB (44560285696) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 161.38 GB (173283483648) - ScratchFileUsedBytes: 41.50 GB (44560285696) - TotalBufferWaitTime: 3s350ms - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=28):(Total: 1.086ms, non-child: 1.086ms, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.05 MB (1105280) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 626.096ms, non-child: 626.096ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 205.434ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 122 (122) - NumInstructions: 8.95K (8951) - OptimizationTime: 395.880ms - PeakMemoryUsage: 4.37 MB (4582912) - PrepareTime: 24.224ms HASH_JOIN_NODE (id=15):(Total: 1.499ms, non-child: 887.798us, % non-child: 59.21%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 451.92K (451915) - BuildTime: 127.704ms - PeakMemoryUsage: 153.09 MB (160524544) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=15): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 95.395ms - BuildRowsPartitioned: 451.92K (451915) - GetNewBlockTime: 588.747us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 30.068ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160449664) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=26):(Total: 2s064ms, non-child: 27.238ms, % non-child: 1.32%) BytesReceived(16s000ms): 5.38 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB - BytesReceived: 6.21 MB (6513198) - ConvertRowBatchTime: 11.421ms - DeserializeRowBatchTimer: 53.653ms - FirstBatchArrivalWaitTime: 1s195ms - PeakMemoryUsage: 0 - RowsReturned: 451.92K (451915) - RowsReturnedRate: 218.92 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=14):(Total: 1.186ms, non-child: 978.734us, % non-child: 82.47%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 458.78K (458782) - BuildTime: 168.973ms - PeakMemoryUsage: 25.08 MB (26298624) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 100.869ms - BuildRowsPartitioned: 458.78K (458782) - GetNewBlockTime: 151.562us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 25.886ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 25.02 MB (26231936) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 4s116ms, non-child: 15.352ms, % non-child: 0.37%) BytesReceived(16s000ms): 5.81 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB - BytesReceived: 7.33 MB (7685580) - ConvertRowBatchTime: 10.917ms - DeserializeRowBatchTimer: 17.005ms - FirstBatchArrivalWaitTime: 2s110ms - PeakMemoryUsage: 0 - RowsReturned: 458.78K (458782) - RowsReturnedRate: 111.46 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=13):(Total: 766.575us, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 4.04B (4038963243) - BuildTime: 6m18s - PeakMemoryUsage: 157.70 GB (169333590240) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled, Spilled Runtime filters: 0 of 1 Runtime Filter Published, 1 Disabled - BuildRowsPartitionTime: 6m18s - BuildRowsPartitioned: 4.04B (4038963243) - GetNewBlockTime: 51s409ms - HashBuckets: 536.87M (536870912) - HashCollisions: 0 (0) - HashTablesBuildTime: 56s056ms - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 157.70 GB (169333499008) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 4 (4) - UnpinTime: 104.246ms HASH_JOIN_NODE (id=12):(Total: 3m8s, non-child: 1m14s, % non-child: 39.49%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 40.19M (40188898) - BuildTime: 8s502ms - PeakMemoryUsage: 3.02 GB (3240188128) - ProbeRows: 76.24M (76239296) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1m5s - RowsReturned: 4.04B (4038963243) - RowsReturnedRate: 21.39 M/sec Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 5s714ms - BuildRowsPartitioned: 40.19M (40188898) - GetNewBlockTime: 3.033ms - HashBuckets: 67.11M (67108864) - HashCollisions: 0 (0) - HashTablesBuildTime: 2s753ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 3.02 GB (3240125568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 6s677ms, non-child: 1s502ms, % non-child: 22.51%) BytesReceived(16s000ms): 210.21 MB, 380.58 MB, 380.58 MB, 380.58 MB, 380.58 MB, 380.58 MB, 380.58 MB, 380.58 MB, 380.58 MB, 380.58 MB, 380.58 MB, 380.58 MB, 380.58 MB, 380.58 MB, 380.58 MB, 380.58 MB, 380.58 MB, 380.58 MB, 380.58 MB, 380.58 MB, 380.58 MB, 380.58 MB, 380.58 MB, 380.58 MB, 380.58 MB, 380.58 MB, 380.58 MB, 380.58 MB, 380.58 MB, 380.58 MB, 380.58 MB, 380.58 MB, 380.58 MB, 380.58 MB, 380.58 MB, 380.58 MB, 380.58 MB, 380.58 MB, 380.58 MB, 380.58 MB - BytesReceived: 380.58 MB (399069321) - ConvertRowBatchTime: 916.807ms - DeserializeRowBatchTimer: 1s494ms - FirstBatchArrivalWaitTime: 1s118ms - PeakMemoryUsage: 0 - RowsReturned: 40.19M (40188898) - RowsReturnedRate: 6.02 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=22):(Total: 1m48s, non-child: 1s384ms, % non-child: 1.28%) BytesReceived(16s000ms): 2.15 MB, 15.44 MB, 42.24 MB, 68.26 MB, 95.07 MB, 121.94 MB, 149.07 MB, 176.19 MB, 201.94 MB, 227.59 MB, 252.68 MB, 278.49 MB, 305.25 MB, 331.48 MB, 355.83 MB, 383.10 MB, 408.97 MB, 436.55 MB, 460.01 MB, 485.26 MB, 510.73 MB, 529.69 MB, 548.64 MB, 571.29 MB, 588.70 MB, 601.35 MB, 621.92 MB, 638.03 MB, 650.58 MB, 655.44 MB, 664.76 MB, 677.71 MB, 682.65 MB, 692.31 MB, 700.98 MB, 705.35 MB, 705.35 MB, 705.35 MB, 705.35 MB, 705.35 MB - BytesReceived: 705.35 MB (739612358) - ConvertRowBatchTime: 860.762ms - DeserializeRowBatchTimer: 7s407ms - FirstBatchArrivalWaitTime: 788.289ms - PeakMemoryUsage: 0 - RowsReturned: 76.24M (76239296) - RowsReturnedRate: 703.65 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=24):(Total: 1s716ms, non-child: 3.641us, % non-child: 0.00%) BytesReceived(16s000ms): 8.41 MB, 10.19 MB, 10.19 MB, 10.19 MB, 10.19 MB, 10.19 MB, 10.19 MB, 10.19 MB, 10.19 MB, 10.19 MB, 10.19 MB, 10.19 MB, 10.19 MB, 10.19 MB, 10.19 MB, 10.19 MB, 10.19 MB, 10.19 MB, 10.19 MB, 10.19 MB, 10.19 MB, 10.19 MB, 10.19 MB, 10.19 MB, 10.19 MB, 10.19 MB, 10.19 MB, 10.19 MB, 10.19 MB, 10.19 MB, 10.19 MB, 10.19 MB, 10.19 MB, 10.19 MB, 10.19 MB, 10.19 MB, 10.19 MB, 10.23 MB, 10.31 MB, 10.32 MB - BytesReceived: 10.39 MB (10889688) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 72.844ms - FirstBatchArrivalWaitTime: 1s716ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:2eb (host=vc1506.foo:22000):(Total: 61.113ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 1.01 GB, 7.03 GB, 14.05 GB, 20.54 GB, 27.32 GB, 34.13 GB, 40.91 GB, 47.66 GB, 54.04 GB, 60.42 GB, 66.57 GB, 72.95 GB, 79.62 GB, 85.85 GB, 92.04 GB, 98.67 GB, 105.06 GB, 111.55 GB, 117.69 GB, 123.84 GB, 129.83 GB, 134.07 GB, 138.66 GB, 144.25 GB, 148.85 GB, 152.08 GB, 156.79 GB, 155.90 GB, 153.62 GB, 154.62 GB, 156.74 GB, 159.69 GB, 150.37 GB, 151.53 GB, 153.38 GB, 155.02 GB, 160.12 GB, 150.37 GB, 151.19 GB, 152.63 GB ThreadUsage(16s000ms): 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.03 - BloomFilterBytes: 49.00 MB (51380224) - PeakMemoryUsage: 160.60 GB (172447020415) - PerHostPeakMemUsage: 169.56 GB (182060057121) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 2m34s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 1.67K (1665) - TotalThreadsTotalWallClockTime: 21s727ms - TotalThreadsSysTime: 2s213ms - TotalThreadsUserTime: 7s998ms - TotalThreadsVoluntaryContextSwitches: 21.84K (21836) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 61.057ms - ExecTreePrepareTime: 622.689us DataStreamSender (dst_id=28):(Total: 991.771us, non-child: 991.771us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.05 MB (1105280) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 641.862ms, non-child: 641.862ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 197.075ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 122 (122) - NumInstructions: 8.95K (8951) - OptimizationTime: 417.304ms - PeakMemoryUsage: 4.37 MB (4582912) - PrepareTime: 27.044ms HASH_JOIN_NODE (id=15):(Total: 1.182ms, non-child: 991.190us, % non-child: 83.84%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 451.92K (451915) - BuildTime: 140.305ms - PeakMemoryUsage: 153.09 MB (160524544) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=15): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 102.997ms - BuildRowsPartitioned: 451.92K (451915) - GetNewBlockTime: 330.920us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 34.441ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160449664) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=26):(Total: 2s050ms, non-child: 24.254ms, % non-child: 1.18%) BytesReceived(16s000ms): 5.43 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB - BytesReceived: 6.21 MB (6513198) - ConvertRowBatchTime: 12.017ms - DeserializeRowBatchTimer: 52.800ms - FirstBatchArrivalWaitTime: 1s200ms - PeakMemoryUsage: 0 - RowsReturned: 451.92K (451915) - RowsReturnedRate: 220.37 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=14):(Total: 851.983us, non-child: 925.514us, % non-child: 100.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 459.38K (459377) - BuildTime: 139.902ms - PeakMemoryUsage: 25.08 MB (26298624) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 79.740ms - BuildRowsPartitioned: 459.38K (459377) - GetNewBlockTime: 214.423us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 21.755ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 25.02 MB (26231936) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 4s100ms, non-child: 14.863ms, % non-child: 0.36%) BytesReceived(16s000ms): 5.88 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB - BytesReceived: 7.34 MB (7695486) - ConvertRowBatchTime: 10.956ms - DeserializeRowBatchTimer: 16.124ms - FirstBatchArrivalWaitTime: 2s114ms - PeakMemoryUsage: 0 - RowsReturned: 459.38K (459377) - RowsReturnedRate: 112.02 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=13):(Total: 562.871us, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 3.91B (3909431172) - BuildTime: 5m49s - PeakMemoryUsage: 160.16 GB (171968203008) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled, Spilled Runtime filters: 0 of 1 Runtime Filter Published, 1 Disabled - BuildRowsPartitionTime: 5m49s - BuildRowsPartitioned: 3.91B (3909431172) - GetNewBlockTime: 29s314ms - HashBuckets: 536.87M (536870912) - HashCollisions: 0 (0) - HashTablesBuildTime: 42s805ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 160.16 GB (171968144512) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 4 (4) - UnpinTime: 257.606ms HASH_JOIN_NODE (id=12):(Total: 3m39s, non-child: 1m11s, % non-child: 32.63%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 40.19M (40193060) - BuildTime: 8s413ms - PeakMemoryUsage: 3.02 GB (3240188128) - ProbeRows: 73.92M (73920031) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1m2s - RowsReturned: 3.91B (3909431172) - RowsReturnedRate: 17.80 M/sec Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 5s540ms - BuildRowsPartitioned: 40.19M (40193060) - GetNewBlockTime: 4.545ms - HashBuckets: 67.11M (67108864) - HashCollisions: 0 (0) - HashTablesBuildTime: 2s823ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 3.02 GB (3240125568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 6s780ms, non-child: 1s538ms, % non-child: 22.69%) BytesReceived(16s000ms): 214.48 MB, 380.63 MB, 380.63 MB, 380.63 MB, 380.63 MB, 380.63 MB, 380.63 MB, 380.63 MB, 380.63 MB, 380.63 MB, 380.63 MB, 380.63 MB, 380.63 MB, 380.63 MB, 380.63 MB, 380.63 MB, 380.63 MB, 380.63 MB, 380.63 MB, 380.63 MB, 380.63 MB, 380.63 MB, 380.63 MB, 380.63 MB, 380.63 MB, 380.63 MB, 380.63 MB, 380.63 MB, 380.63 MB, 380.63 MB, 380.63 MB, 380.63 MB, 380.63 MB, 380.63 MB, 380.63 MB, 380.63 MB, 380.63 MB, 380.63 MB, 380.63 MB, 380.63 MB - BytesReceived: 380.63 MB (399114367) - ConvertRowBatchTime: 964.879ms - DeserializeRowBatchTimer: 1s456ms - FirstBatchArrivalWaitTime: 1s122ms - PeakMemoryUsage: 0 - RowsReturned: 40.19M (40193060) - RowsReturnedRate: 5.93 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=22):(Total: 2m21s, non-child: 1s271ms, % non-child: 0.90%) BytesReceived(16s000ms): 2.15 MB, 15.51 MB, 41.75 MB, 67.09 MB, 93.95 MB, 120.43 MB, 147.00 MB, 173.54 MB, 198.67 MB, 223.51 MB, 247.90 MB, 273.11 MB, 299.10 MB, 324.75 MB, 348.30 MB, 374.74 MB, 399.64 MB, 426.11 MB, 448.59 MB, 473.37 MB, 495.88 MB, 512.66 MB, 531.10 MB, 552.95 MB, 570.75 MB, 582.94 MB, 602.15 MB, 617.85 MB, 631.33 MB, 635.71 MB, 644.11 MB, 656.74 MB, 661.97 MB, 670.42 MB, 678.92 MB, 684.16 MB, 684.17 MB, 684.17 MB, 684.17 MB, 684.17 MB - BytesReceived: 684.17 MB (717401698) - ConvertRowBatchTime: 841.561ms - DeserializeRowBatchTimer: 4s987ms - FirstBatchArrivalWaitTime: 795.301ms - PeakMemoryUsage: 0 - RowsReturned: 73.92M (73920031) - RowsReturnedRate: 520.61 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=24):(Total: 1s717ms, non-child: 3.186us, % non-child: 0.00%) BytesReceived(16s000ms): 8.72 MB, 10.33 MB, 10.33 MB, 10.33 MB, 10.33 MB, 10.33 MB, 10.33 MB, 10.33 MB, 10.33 MB, 10.33 MB, 10.33 MB, 10.33 MB, 10.33 MB, 10.33 MB, 10.33 MB, 10.33 MB, 10.33 MB, 10.33 MB, 10.33 MB, 10.33 MB, 10.33 MB, 10.33 MB, 10.33 MB, 10.33 MB, 10.33 MB, 10.33 MB, 10.33 MB, 10.33 MB, 10.33 MB, 10.33 MB, 10.33 MB, 10.33 MB, 10.33 MB, 10.33 MB, 10.33 MB, 10.33 MB, 10.33 MB, 10.37 MB, 10.51 MB, 10.52 MB - BytesReceived: 10.66 MB (11180476) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 65.398ms - FirstBatchArrivalWaitTime: 1s717ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:316 (host=vd1135.foo:22000):(Total: 60.923ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 1.02 GB, 7.15 GB, 14.21 GB, 20.82 GB, 27.63 GB, 34.45 GB, 41.34 GB, 48.27 GB, 54.79 GB, 61.31 GB, 67.61 GB, 74.13 GB, 81.03 GB, 87.65 GB, 93.80 GB, 100.51 GB, 107.10 GB, 113.91 GB, 119.98 GB, 126.34 GB, 132.54 GB, 136.74 GB, 141.60 GB, 147.35 GB, 152.14 GB, 155.47 GB, 156.16 GB, 153.50 GB, 156.96 GB, 157.55 GB, 156.94 GB, 151.16 GB, 151.70 GB, 154.76 GB, 156.13 GB, 152.53 GB, 153.42 GB, 153.27 GB, 154.40 GB, 154.62 GB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.03 - BloomFilterBytes: 49.00 MB (51380224) - PeakMemoryUsage: 160.60 GB (172440133951) - PerHostPeakMemUsage: 169.57 GB (182069699515) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 1m56s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 1.73K (1734) - TotalThreadsTotalWallClockTime: 21s697ms - TotalThreadsSysTime: 2s183ms - TotalThreadsUserTime: 8s027ms - TotalThreadsVoluntaryContextSwitches: 21.20K (21201) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 60.860ms - ExecTreePrepareTime: 937.691us DataStreamSender (dst_id=28):(Total: 843.365us, non-child: 843.365us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.05 MB (1105280) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 622.452ms, non-child: 622.452ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 195.752ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 122 (122) - NumInstructions: 8.95K (8951) - OptimizationTime: 401.206ms - PeakMemoryUsage: 4.37 MB (4582912) - PrepareTime: 25.042ms HASH_JOIN_NODE (id=15):(Total: 1.787ms, non-child: 961.778us, % non-child: 53.80%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 451.92K (451915) - BuildTime: 126.367ms - PeakMemoryUsage: 153.09 MB (160524544) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=15): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 93.577ms - BuildRowsPartitioned: 451.92K (451915) - GetNewBlockTime: 407.194us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 29.730ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160449664) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=26):(Total: 2s075ms, non-child: 22.584ms, % non-child: 1.09%) BytesReceived(16s000ms): 5.44 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB - BytesReceived: 6.21 MB (6513198) - ConvertRowBatchTime: 11.714ms - DeserializeRowBatchTimer: 46.598ms - FirstBatchArrivalWaitTime: 1s206ms - PeakMemoryUsage: 0 - RowsReturned: 451.92K (451915) - RowsReturnedRate: 217.74 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=14):(Total: 1.424ms, non-child: 969.572us, % non-child: 68.06%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 459.39K (459395) - BuildTime: 164.510ms - PeakMemoryUsage: 25.08 MB (26298624) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 101.223ms - BuildRowsPartitioned: 459.39K (459395) - GetNewBlockTime: 225.138us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 22.094ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 25.02 MB (26231936) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 4s112ms, non-child: 15.366ms, % non-child: 0.37%) BytesReceived(16s000ms): 5.94 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB - BytesReceived: 7.34 MB (7694186) - ConvertRowBatchTime: 11.841ms - DeserializeRowBatchTimer: 15.746ms - FirstBatchArrivalWaitTime: 2s118ms - PeakMemoryUsage: 0 - RowsReturned: 459.39K (459395) - RowsReturnedRate: 111.70 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=13):(Total: 1.089ms, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 4.01B (4011177991) - BuildTime: 6m15s - PeakMemoryUsage: 157.31 GB (168914143472) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled, Spilled Runtime filters: 0 of 1 Runtime Filter Published, 1 Disabled - BuildRowsPartitionTime: 6m14s - BuildRowsPartitioned: 4.01B (4011177991) - GetNewBlockTime: 54s964ms - HashBuckets: 536.87M (536870912) - HashCollisions: 0 (0) - HashTablesBuildTime: 38s877ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 157.31 GB (168914068608) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 4 (4) - UnpinTime: 211.699ms HASH_JOIN_NODE (id=12):(Total: 3m8s, non-child: 1m18s, % non-child: 41.79%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 40.23M (40226228) - BuildTime: 8s444ms - PeakMemoryUsage: 3.02 GB (3240188128) - ProbeRows: 76.21M (76208145) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1m9s - RowsReturned: 4.01B (4011177991) - RowsReturnedRate: 21.27 M/sec Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 5s697ms - BuildRowsPartitioned: 40.23M (40226228) - GetNewBlockTime: 4.286ms - HashBuckets: 67.11M (67108864) - HashCollisions: 0 (0) - HashTablesBuildTime: 2s698ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 3.02 GB (3240125568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 6s662ms, non-child: 1s523ms, % non-child: 22.86%) BytesReceived(16s000ms): 215.73 MB, 380.96 MB, 380.96 MB, 380.96 MB, 380.96 MB, 380.96 MB, 380.96 MB, 380.96 MB, 380.96 MB, 380.96 MB, 380.96 MB, 380.96 MB, 380.96 MB, 380.96 MB, 380.96 MB, 380.96 MB, 380.96 MB, 380.96 MB, 380.96 MB, 380.96 MB, 380.96 MB, 380.96 MB, 380.96 MB, 380.96 MB, 380.96 MB, 380.96 MB, 380.96 MB, 380.96 MB, 380.96 MB, 380.96 MB, 380.96 MB, 380.96 MB, 380.96 MB, 380.96 MB, 380.96 MB, 380.96 MB, 380.96 MB, 380.96 MB, 380.96 MB, 380.96 MB - BytesReceived: 380.96 MB (399462377) - ConvertRowBatchTime: 917.576ms - DeserializeRowBatchTimer: 1s494ms - FirstBatchArrivalWaitTime: 1s127ms - PeakMemoryUsage: 0 - RowsReturned: 40.23M (40226228) - RowsReturnedRate: 6.04 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=22):(Total: 1m43s, non-child: 2s810ms, % non-child: 2.71%) BytesReceived(16s000ms): 2.22 MB, 15.94 MB, 42.70 MB, 68.72 MB, 95.55 MB, 122.44 MB, 149.66 MB, 177.04 MB, 202.87 MB, 228.49 MB, 253.58 MB, 279.31 MB, 306.28 MB, 332.84 MB, 357.22 MB, 384.24 MB, 410.00 MB, 437.38 MB, 460.74 MB, 485.92 MB, 509.50 MB, 526.64 MB, 545.60 MB, 568.40 MB, 586.89 MB, 599.57 MB, 619.41 MB, 636.01 MB, 650.38 MB, 655.01 MB, 663.72 MB, 676.86 MB, 682.68 MB, 693.22 MB, 701.92 MB, 705.82 MB, 705.82 MB, 705.82 MB, 705.82 MB, 705.82 MB - BytesReceived: 705.82 MB (740103934) - ConvertRowBatchTime: 887.974ms - DeserializeRowBatchTimer: 7s390ms - FirstBatchArrivalWaitTime: 792.486ms - PeakMemoryUsage: 0 - RowsReturned: 76.21M (76208145) - RowsReturnedRate: 733.54 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=24):(Total: 1s741ms, non-child: 3.906us, % non-child: 0.00%) BytesReceived(16s000ms): 8.61 MB, 10.21 MB, 10.21 MB, 10.21 MB, 10.21 MB, 10.21 MB, 10.21 MB, 10.21 MB, 10.21 MB, 10.21 MB, 10.21 MB, 10.21 MB, 10.21 MB, 10.21 MB, 10.21 MB, 10.21 MB, 10.21 MB, 10.21 MB, 10.21 MB, 10.21 MB, 10.21 MB, 10.21 MB, 10.21 MB, 10.21 MB, 10.21 MB, 10.21 MB, 10.21 MB, 10.21 MB, 10.21 MB, 10.21 MB, 10.21 MB, 10.21 MB, 10.21 MB, 10.21 MB, 10.21 MB, 10.21 MB, 10.21 MB, 10.23 MB, 10.30 MB, 10.30 MB - BytesReceived: 10.42 MB (10922084) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 71.187ms - FirstBatchArrivalWaitTime: 1s741ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:2ea (host=ve1125.foo:22000):(Total: 60.910ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 984.23 MB, 7.03 GB, 13.73 GB, 20.08 GB, 26.66 GB, 33.30 GB, 39.95 GB, 46.51 GB, 52.86 GB, 59.13 GB, 65.34 GB, 71.61 GB, 78.31 GB, 84.71 GB, 90.56 GB, 97.22 GB, 103.62 GB, 110.23 GB, 116.09 GB, 122.08 GB, 128.24 GB, 133.24 GB, 137.84 GB, 143.34 GB, 147.86 GB, 151.00 GB, 155.79 GB, 157.39 GB, 152.08 GB, 153.14 GB, 155.04 GB, 158.15 GB, 159.28 GB, 154.85 GB, 152.29 GB, 154.82 GB, 158.79 GB, 149.23 GB, 149.45 GB, 151.21 GB ThreadUsage(16s000ms): 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.03 - BloomFilterBytes: 49.00 MB (51380224) - PeakMemoryUsage: 160.61 GB (172458223283) - PerHostPeakMemUsage: 169.57 GB (182077147455) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 2m9s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 1.43K (1426) - TotalThreadsTotalWallClockTime: 21s657ms - TotalThreadsSysTime: 2s110ms - TotalThreadsUserTime: 7s800ms - TotalThreadsVoluntaryContextSwitches: 24.54K (24544) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 60.818ms - ExecTreePrepareTime: 753.040us DataStreamSender (dst_id=28):(Total: 1.029ms, non-child: 1.029ms, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.05 MB (1105280) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 650.672ms, non-child: 650.672ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 202.874ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 122 (122) - NumInstructions: 8.95K (8951) - OptimizationTime: 422.341ms - PeakMemoryUsage: 4.37 MB (4582912) - PrepareTime: 24.971ms HASH_JOIN_NODE (id=15):(Total: 1.408ms, non-child: 1.013ms, % non-child: 71.99%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 451.92K (451915) - BuildTime: 132.101ms - PeakMemoryUsage: 153.09 MB (160524544) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=15): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 97.504ms - BuildRowsPartitioned: 451.92K (451915) - GetNewBlockTime: 2.950ms - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 32.387ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160449664) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=26):(Total: 2s048ms, non-child: 25.764ms, % non-child: 1.26%) BytesReceived(16s000ms): 5.36 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB - BytesReceived: 6.21 MB (6513198) - ConvertRowBatchTime: 11.845ms - DeserializeRowBatchTimer: 51.008ms - FirstBatchArrivalWaitTime: 1s189ms - PeakMemoryUsage: 0 - RowsReturned: 451.92K (451915) - RowsReturnedRate: 220.64 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=14):(Total: 1.039ms, non-child: 963.141us, % non-child: 92.63%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 457.58K (457576) - BuildTime: 159.958ms - PeakMemoryUsage: 25.08 MB (26298624) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 95.593ms - BuildRowsPartitioned: 457.58K (457576) - GetNewBlockTime: 203.850us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 33.766ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 25.02 MB (26231936) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 4s079ms, non-child: 17.823ms, % non-child: 0.44%) BytesReceived(16s000ms): 5.79 MB, 7.31 MB, 7.31 MB, 7.31 MB, 7.31 MB, 7.31 MB, 7.31 MB, 7.31 MB, 7.31 MB, 7.31 MB, 7.31 MB, 7.31 MB, 7.31 MB, 7.31 MB, 7.31 MB, 7.31 MB, 7.31 MB, 7.31 MB, 7.31 MB, 7.31 MB, 7.31 MB, 7.31 MB, 7.31 MB, 7.31 MB, 7.31 MB, 7.31 MB, 7.31 MB, 7.31 MB, 7.31 MB, 7.31 MB, 7.31 MB, 7.31 MB, 7.31 MB, 7.31 MB, 7.31 MB, 7.31 MB, 7.31 MB, 7.31 MB, 7.31 MB, 7.31 MB - BytesReceived: 7.31 MB (7665289) - ConvertRowBatchTime: 13.119ms - DeserializeRowBatchTimer: 17.365ms - FirstBatchArrivalWaitTime: 2s098ms - PeakMemoryUsage: 0 - RowsReturned: 457.58K (457576) - RowsReturnedRate: 112.16 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=13):(Total: 700.236us, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 3.88B (3877194012) - BuildTime: 6m3s - PeakMemoryUsage: 160.16 GB (171968203008) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled, Spilled Runtime filters: 0 of 1 Runtime Filter Published, 1 Disabled - BuildRowsPartitionTime: 6m3s - BuildRowsPartitioned: 3.88B (3877194012) - GetNewBlockTime: 27s247ms - HashBuckets: 536.87M (536870912) - HashCollisions: 0 (0) - HashTablesBuildTime: 56s410ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 160.16 GB (171968144512) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 4 (4) - UnpinTime: 119.835ms HASH_JOIN_NODE (id=12):(Total: 3m19s, non-child: 1m16s, % non-child: 38.42%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 40.06M (40060275) - BuildTime: 8s147ms - PeakMemoryUsage: 3.02 GB (3240188894) - ProbeRows: 73.39M (73394289) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1m7s - RowsReturned: 3.88B (3877194012) - RowsReturnedRate: 19.45 M/sec Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 5s325ms - BuildRowsPartitioned: 40.06M (40060275) - GetNewBlockTime: 3.274ms - HashBuckets: 67.11M (67108864) - HashCollisions: 0 (0) - HashTablesBuildTime: 2s774ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 3.02 GB (3240125568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 7s000ms, non-child: 1s600ms, % non-child: 22.86%) BytesReceived(16s000ms): 207.64 MB, 379.40 MB, 379.40 MB, 379.40 MB, 379.40 MB, 379.40 MB, 379.40 MB, 379.40 MB, 379.40 MB, 379.40 MB, 379.40 MB, 379.40 MB, 379.40 MB, 379.40 MB, 379.40 MB, 379.40 MB, 379.40 MB, 379.40 MB, 379.40 MB, 379.40 MB, 379.40 MB, 379.40 MB, 379.40 MB, 379.40 MB, 379.40 MB, 379.40 MB, 379.40 MB, 379.40 MB, 379.40 MB, 379.40 MB, 379.40 MB, 379.40 MB, 379.40 MB, 379.40 MB, 379.40 MB, 379.40 MB, 379.40 MB, 379.40 MB, 379.40 MB, 379.40 MB - BytesReceived: 379.40 MB (397833406) - ConvertRowBatchTime: 931.162ms - DeserializeRowBatchTimer: 1s713ms - FirstBatchArrivalWaitTime: 1s115ms - PeakMemoryUsage: 0 - RowsReturned: 40.06M (40060275) - RowsReturnedRate: 5.72 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=22):(Total: 1m56s, non-child: 1s331ms, % non-child: 1.14%) BytesReceived(16s000ms): 2.04 MB, 14.79 MB, 40.65 MB, 65.58 MB, 91.46 MB, 117.50 MB, 143.71 MB, 169.95 MB, 194.82 MB, 219.60 MB, 243.85 MB, 268.84 MB, 294.73 MB, 320.18 MB, 343.61 MB, 369.75 MB, 394.63 MB, 421.00 MB, 443.52 MB, 467.76 MB, 491.30 MB, 510.20 MB, 528.44 MB, 550.37 MB, 567.34 MB, 579.44 MB, 598.99 MB, 614.37 MB, 626.62 MB, 631.20 MB, 639.98 MB, 652.48 MB, 657.40 MB, 666.53 MB, 674.86 MB, 679.23 MB, 679.23 MB, 679.23 MB, 679.23 MB, 679.23 MB - BytesReceived: 679.23 MB (712224432) - ConvertRowBatchTime: 842.014ms - DeserializeRowBatchTimer: 10s156ms - FirstBatchArrivalWaitTime: 777.578ms - PeakMemoryUsage: 0 - RowsReturned: 73.39M (73394289) - RowsReturnedRate: 629.71 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=24):(Total: 1s703ms, non-child: 4.704us, % non-child: 0.00%) BytesReceived(16s000ms): 8.78 MB, 10.73 MB, 10.73 MB, 10.73 MB, 10.73 MB, 10.73 MB, 10.73 MB, 10.73 MB, 10.73 MB, 10.73 MB, 10.73 MB, 10.73 MB, 10.73 MB, 10.73 MB, 10.73 MB, 10.73 MB, 10.73 MB, 10.73 MB, 10.73 MB, 10.73 MB, 10.73 MB, 10.73 MB, 10.73 MB, 10.73 MB, 10.73 MB, 10.73 MB, 10.73 MB, 10.73 MB, 10.73 MB, 10.73 MB, 10.73 MB, 10.73 MB, 10.73 MB, 10.73 MB, 10.73 MB, 10.73 MB, 10.73 MB, 10.74 MB, 10.74 MB, 10.75 MB - BytesReceived: 10.99 MB (11520212) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 70.412ms - FirstBatchArrivalWaitTime: 1s703ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:2ef (host=ve1135.foo:22000):(Total: 60.896ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 1.02 GB, 7.31 GB, 14.21 GB, 20.80 GB, 27.59 GB, 34.38 GB, 41.25 GB, 48.14 GB, 54.61 GB, 61.14 GB, 67.40 GB, 73.88 GB, 80.71 GB, 87.26 GB, 93.35 GB, 100.23 GB, 106.70 GB, 113.60 GB, 119.46 GB, 125.97 GB, 132.07 GB, 136.34 GB, 140.91 GB, 146.74 GB, 151.47 GB, 154.65 GB, 156.82 GB, 153.07 GB, 156.55 GB, 157.03 GB, 157.77 GB, 151.36 GB, 152.49 GB, 155.00 GB, 156.34 GB, 152.93 GB, 154.43 GB, 156.65 GB, 152.54 GB, 154.82 GB ThreadUsage(16s000ms): 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.03 - BloomFilterBytes: 49.00 MB (51380224) - PeakMemoryUsage: 160.60 GB (172443639679) - PerHostPeakMemUsage: 169.56 GB (182064603624) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 2m29s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 1.67K (1670) - TotalThreadsTotalWallClockTime: 21s656ms - TotalThreadsSysTime: 2s283ms - TotalThreadsUserTime: 8s117ms - TotalThreadsVoluntaryContextSwitches: 20.73K (20726) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 60.753ms - ExecTreePrepareTime: 993.341us DataStreamSender (dst_id=28):(Total: 1.274ms, non-child: 1.274ms, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.05 MB (1105280) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 651.637ms, non-child: 651.637ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 197.630ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 122 (122) - NumInstructions: 8.95K (8951) - OptimizationTime: 430.170ms - PeakMemoryUsage: 4.37 MB (4582912) - PrepareTime: 23.383ms HASH_JOIN_NODE (id=15):(Total: 1.890ms, non-child: 1.120ms, % non-child: 59.28%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 451.92K (451915) - BuildTime: 140.897ms - PeakMemoryUsage: 153.09 MB (160524544) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=15): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 104.491ms - BuildRowsPartitioned: 451.92K (451915) - GetNewBlockTime: 444.389us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 33.446ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160449664) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=26):(Total: 2s050ms, non-child: 27.549ms, % non-child: 1.34%) BytesReceived(16s000ms): 5.43 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB - BytesReceived: 6.21 MB (6513198) - ConvertRowBatchTime: 13.012ms - DeserializeRowBatchTimer: 56.670ms - FirstBatchArrivalWaitTime: 1s185ms - PeakMemoryUsage: 0 - RowsReturned: 451.92K (451915) - RowsReturnedRate: 220.44 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=14):(Total: 1.435ms, non-child: 1.057ms, % non-child: 73.69%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 458.88K (458878) - BuildTime: 142.233ms - PeakMemoryUsage: 25.08 MB (26298624) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 88.858ms - BuildRowsPartitioned: 458.88K (458878) - GetNewBlockTime: 206.356us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 21.013ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 25.02 MB (26231936) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 4s083ms, non-child: 16.185ms, % non-child: 0.40%) BytesReceived(16s000ms): 5.93 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB - BytesReceived: 7.33 MB (7685207) - ConvertRowBatchTime: 11.654ms - DeserializeRowBatchTimer: 16.780ms - FirstBatchArrivalWaitTime: 2s093ms - PeakMemoryUsage: 0 - RowsReturned: 458.88K (458878) - RowsReturnedRate: 112.39 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=13):(Total: 945.212us, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 3.99B (3994340182) - BuildTime: 5m51s - PeakMemoryUsage: 157.46 GB (169074133248) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled, Spilled Runtime filters: 0 of 1 Runtime Filter Published, 1 Disabled - BuildRowsPartitionTime: 5m50s - BuildRowsPartitioned: 3.99B (3994340182) - GetNewBlockTime: 50s530ms - HashBuckets: 536.87M (536870912) - HashCollisions: 0 (0) - HashTablesBuildTime: 43s538ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 157.46 GB (169074074752) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 4 (4) - UnpinTime: 266.374ms HASH_JOIN_NODE (id=12):(Total: 3m36s, non-child: 1m13s, % non-child: 33.84%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 40.13M (40130259) - BuildTime: 8s579ms - PeakMemoryUsage: 3.02 GB (3240192580) - ProbeRows: 75.42M (75423528) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1m3s - RowsReturned: 3.99B (3994340182) - RowsReturnedRate: 18.48 M/sec Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 5s752ms - BuildRowsPartitioned: 40.13M (40130259) - GetNewBlockTime: 4.206ms - HashBuckets: 67.11M (67108864) - HashCollisions: 0 (0) - HashTablesBuildTime: 2s776ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 3.02 GB (3240125568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 6s543ms, non-child: 1s595ms, % non-child: 24.38%) BytesReceived(16s000ms): 215.08 MB, 380.07 MB, 380.07 MB, 380.07 MB, 380.07 MB, 380.07 MB, 380.07 MB, 380.07 MB, 380.07 MB, 380.07 MB, 380.07 MB, 380.07 MB, 380.07 MB, 380.07 MB, 380.07 MB, 380.07 MB, 380.07 MB, 380.07 MB, 380.07 MB, 380.07 MB, 380.07 MB, 380.07 MB, 380.07 MB, 380.07 MB, 380.07 MB, 380.07 MB, 380.07 MB, 380.07 MB, 380.07 MB, 380.07 MB, 380.07 MB, 380.07 MB, 380.07 MB, 380.07 MB, 380.07 MB, 380.07 MB, 380.07 MB, 380.07 MB, 380.07 MB, 380.07 MB - BytesReceived: 380.07 MB (398527864) - ConvertRowBatchTime: 957.735ms - DeserializeRowBatchTimer: 1s587ms - FirstBatchArrivalWaitTime: 1s112ms - PeakMemoryUsage: 0 - RowsReturned: 40.13M (40130259) - RowsReturnedRate: 6.13 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=22):(Total: 2m17s, non-child: 1s290ms, % non-child: 0.94%) BytesReceived(16s000ms): 2.16 MB, 15.75 MB, 42.41 MB, 68.20 MB, 94.78 MB, 121.42 MB, 148.31 MB, 175.32 MB, 200.79 MB, 226.20 MB, 251.01 MB, 276.47 MB, 303.03 MB, 329.06 MB, 353.22 MB, 380.13 MB, 405.60 MB, 432.63 MB, 455.71 MB, 480.74 MB, 504.10 MB, 521.09 MB, 539.81 MB, 562.33 MB, 580.66 MB, 593.05 MB, 612.73 MB, 629.15 MB, 643.41 MB, 647.95 MB, 656.58 MB, 669.58 MB, 676.05 MB, 686.03 MB, 694.50 MB, 698.32 MB, 698.32 MB, 698.32 MB, 698.32 MB, 698.32 MB - BytesReceived: 698.32 MB (732237958) - ConvertRowBatchTime: 825.239ms - DeserializeRowBatchTimer: 7s586ms - FirstBatchArrivalWaitTime: 768.619ms - PeakMemoryUsage: 0 - RowsReturned: 75.42M (75423528) - RowsReturnedRate: 549.47 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=24):(Total: 1s714ms, non-child: 4.354us, % non-child: 0.00%) BytesReceived(16s000ms): 8.62 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.25 MB, 10.29 MB, 10.30 MB - BytesReceived: 10.44 MB (10944657) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 70.330ms - FirstBatchArrivalWaitTime: 1s714ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:345 (host=vd1118.foo:22000):(Total: 60.747ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 1006.16 MB, 7.22 GB, 14.08 GB, 20.62 GB, 27.39 GB, 34.15 GB, 41.03 GB, 47.87 GB, 54.27 GB, 60.74 GB, 67.00 GB, 73.51 GB, 80.33 GB, 86.85 GB, 93.00 GB, 99.83 GB, 106.27 GB, 113.37 GB, 119.83 GB, 126.38 GB, 132.00 GB, 136.27 GB, 141.05 GB, 146.71 GB, 151.31 GB, 154.55 GB, 156.45 GB, 152.66 GB, 155.85 GB, 156.72 GB, 159.11 GB, 150.93 GB, 151.69 GB, 153.99 GB, 155.23 GB, 151.23 GB, 154.29 GB, 151.29 GB, 153.72 GB, 154.05 GB ThreadUsage(16s000ms): 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.03 - BloomFilterBytes: 49.00 MB (51380224) - PeakMemoryUsage: 160.60 GB (172445644141) - PerHostPeakMemUsage: 169.55 GB (182053478116) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 2m29s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 1.56K (1565) - TotalThreadsTotalWallClockTime: 21s875ms - TotalThreadsSysTime: 2s269ms - TotalThreadsUserTime: 7s870ms - TotalThreadsVoluntaryContextSwitches: 20.59K (20585) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 60.697ms - ExecTreePrepareTime: 825.861us DataStreamSender (dst_id=28):(Total: 1.165ms, non-child: 1.165ms, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.05 MB (1105280) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 654.086ms, non-child: 654.086ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 223.898ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 122 (122) - NumInstructions: 8.95K (8951) - OptimizationTime: 405.222ms - PeakMemoryUsage: 4.37 MB (4582912) - PrepareTime: 24.403ms HASH_JOIN_NODE (id=15):(Total: 1.566ms, non-child: 740.571us, % non-child: 47.28%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 451.92K (451915) - BuildTime: 278.700ms - PeakMemoryUsage: 153.09 MB (160524544) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=15): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 84.095ms - BuildRowsPartitioned: 451.92K (451915) - GetNewBlockTime: 8.192ms - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 30.649ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160449664) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=26):(Total: 1s848ms, non-child: 146.830ms, % non-child: 7.94%) BytesReceived(16s000ms): 5.44 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB - BytesReceived: 6.21 MB (6513198) - ConvertRowBatchTime: 10.876ms - DeserializeRowBatchTimer: 295.073ms - FirstBatchArrivalWaitTime: 1s161ms - PeakMemoryUsage: 0 - RowsReturned: 451.92K (451915) - RowsReturnedRate: 244.43 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=14):(Total: 1.237ms, non-child: 935.174us, % non-child: 75.56%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 459.97K (459974) - BuildTime: 140.151ms - PeakMemoryUsage: 25.08 MB (26298624) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 82.307ms - BuildRowsPartitioned: 459.97K (459974) - GetNewBlockTime: 621.424us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 24.690ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 25.02 MB (26231936) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 4s124ms, non-child: 14.057ms, % non-child: 0.34%) BytesReceived(16s000ms): 5.94 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB - BytesReceived: 7.35 MB (7704056) - ConvertRowBatchTime: 10.201ms - DeserializeRowBatchTimer: 16.278ms - FirstBatchArrivalWaitTime: 2s077ms - PeakMemoryUsage: 0 - RowsReturned: 459.97K (459974) - RowsReturnedRate: 111.53 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=13):(Total: 849.946us, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 3.97B (3972240098) - BuildTime: 5m50s - PeakMemoryUsage: 157.31 GB (168914159840) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled, Spilled Runtime filters: 0 of 1 Runtime Filter Published, 1 Disabled - BuildRowsPartitionTime: 5m49s - BuildRowsPartitioned: 3.97B (3972240098) - GetNewBlockTime: 42s846ms - HashBuckets: 536.87M (536870912) - HashCollisions: 0 (0) - HashTablesBuildTime: 34s826ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 157.31 GB (168914068608) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 4 (4) - UnpinTime: 275.958ms HASH_JOIN_NODE (id=12):(Total: 3m34s, non-child: 1m11s, % non-child: 33.20%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 40.24M (40239278) - BuildTime: 8s621ms - PeakMemoryUsage: 3.02 GB (3240188128) - ProbeRows: 75.29M (75287660) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1m1s - RowsReturned: 3.97B (3972240098) - RowsReturnedRate: 18.51 M/sec Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 5s738ms - BuildRowsPartitioned: 40.24M (40239278) - GetNewBlockTime: 8.755ms - HashBuckets: 67.11M (67108864) - HashCollisions: 0 (0) - HashTablesBuildTime: 2s618ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 3.02 GB (3240125568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 6s722ms, non-child: 1s703ms, % non-child: 25.34%) BytesReceived(16s000ms): 215.88 MB, 381.08 MB, 381.08 MB, 381.08 MB, 381.08 MB, 381.08 MB, 381.08 MB, 381.08 MB, 381.08 MB, 381.08 MB, 381.08 MB, 381.08 MB, 381.08 MB, 381.08 MB, 381.08 MB, 381.08 MB, 381.08 MB, 381.08 MB, 381.08 MB, 381.08 MB, 381.08 MB, 381.08 MB, 381.08 MB, 381.08 MB, 381.08 MB, 381.08 MB, 381.08 MB, 381.08 MB, 381.08 MB, 381.08 MB, 381.08 MB, 381.08 MB, 381.08 MB, 381.08 MB, 381.08 MB, 381.08 MB, 381.08 MB, 381.08 MB, 381.08 MB, 381.08 MB - BytesReceived: 381.08 MB (399587233) - ConvertRowBatchTime: 908.121ms - DeserializeRowBatchTimer: 1s907ms - FirstBatchArrivalWaitTime: 1s082ms - PeakMemoryUsage: 0 - RowsReturned: 40.24M (40239278) - RowsReturnedRate: 5.99 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=22):(Total: 2m17s, non-child: 2s020ms, % non-child: 1.47%) BytesReceived(16s000ms): 2.12 MB, 15.63 MB, 42.13 MB, 67.80 MB, 94.43 MB, 121.02 MB, 148.04 MB, 174.95 MB, 200.34 MB, 225.60 MB, 250.43 MB, 275.96 MB, 302.63 MB, 328.75 MB, 353.01 MB, 379.83 MB, 406.40 MB, 435.34 MB, 458.04 MB, 483.81 MB, 505.55 MB, 522.85 MB, 541.78 MB, 564.12 MB, 581.78 MB, 594.17 MB, 614.21 MB, 630.15 MB, 642.96 MB, 647.65 MB, 656.60 MB, 669.55 MB, 674.58 MB, 683.78 MB, 692.37 MB, 697.02 MB, 697.03 MB, 697.03 MB, 697.03 MB, 697.03 MB - BytesReceived: 697.03 MB (730884078) - ConvertRowBatchTime: 812.252ms - DeserializeRowBatchTimer: 9s976ms - FirstBatchArrivalWaitTime: 738.216ms - PeakMemoryUsage: 0 - RowsReturned: 75.29M (75287660) - RowsReturnedRate: 548.10 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=24):(Total: 1s688ms, non-child: 4.236us, % non-child: 0.00%) BytesReceived(16s000ms): 8.92 MB, 10.58 MB, 10.58 MB, 10.58 MB, 10.58 MB, 10.58 MB, 10.58 MB, 10.58 MB, 10.58 MB, 10.58 MB, 10.58 MB, 10.58 MB, 10.58 MB, 10.58 MB, 10.58 MB, 10.58 MB, 10.58 MB, 10.58 MB, 10.58 MB, 10.58 MB, 10.58 MB, 10.58 MB, 10.58 MB, 10.58 MB, 10.58 MB, 10.58 MB, 10.58 MB, 10.58 MB, 10.58 MB, 10.58 MB, 10.58 MB, 10.58 MB, 10.58 MB, 10.58 MB, 10.58 MB, 10.58 MB, 10.58 MB, 10.61 MB, 10.73 MB, 10.74 MB - BytesReceived: 10.77 MB (11295578) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 69.174ms - FirstBatchArrivalWaitTime: 1s688ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:344 (host=vc1513.foo:22000):(Total: 60.559ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 965.05 MB, 6.91 GB, 14.22 GB, 20.93 GB, 27.87 GB, 34.82 GB, 41.83 GB, 48.89 GB, 55.81 GB, 62.41 GB, 68.80 GB, 75.44 GB, 82.30 GB, 88.74 GB, 95.13 GB, 102.10 GB, 108.69 GB, 115.66 GB, 121.86 GB, 128.36 GB, 134.55 GB, 138.90 GB, 143.72 GB, 149.53 GB, 154.31 GB, 157.65 GB, 153.68 GB, 156.08 GB, 159.00 GB, 156.91 GB, 151.52 GB, 154.03 GB, 155.59 GB, 158.06 GB, 159.06 GB, 153.77 GB, 155.78 GB, 155.31 GB, 157.08 GB, 157.22 GB ThreadUsage(16s000ms): 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.04 - BloomFilterBytes: 49.00 MB (51380224) - PeakMemoryUsage: 160.61 GB (172451555043) - PerHostPeakMemUsage: 169.55 GB (182057389143) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 2m1s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 1.68K (1684) - TotalThreadsTotalWallClockTime: 22s059ms - TotalThreadsSysTime: 2s200ms - TotalThreadsUserTime: 8s085ms - TotalThreadsVoluntaryContextSwitches: 21.50K (21495) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 60.516ms - ExecTreePrepareTime: 503.479us DataStreamSender (dst_id=28):(Total: 1.063ms, non-child: 1.063ms, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.05 MB (1105280) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 647.262ms, non-child: 647.262ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 215.636ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 122 (122) - NumInstructions: 8.95K (8951) - OptimizationTime: 404.919ms - PeakMemoryUsage: 4.37 MB (4582912) - PrepareTime: 26.231ms HASH_JOIN_NODE (id=15):(Total: 959.386us, non-child: 903.008us, % non-child: 94.12%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 451.92K (451915) - BuildTime: 139.003ms - PeakMemoryUsage: 153.09 MB (160524544) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=15): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 102.695ms - BuildRowsPartitioned: 451.92K (451915) - GetNewBlockTime: 806.158us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 33.259ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160449664) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=26):(Total: 2s029ms, non-child: 25.648ms, % non-child: 1.26%) BytesReceived(16s000ms): 5.38 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB - BytesReceived: 6.21 MB (6513198) - ConvertRowBatchTime: 12.134ms - DeserializeRowBatchTimer: 50.492ms - FirstBatchArrivalWaitTime: 1s171ms - PeakMemoryUsage: 0 - RowsReturned: 451.92K (451915) - RowsReturnedRate: 222.70 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=14):(Total: 758.240us, non-child: 812.343us, % non-child: 100.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 459.07K (459068) - BuildTime: 169.736ms - PeakMemoryUsage: 25.08 MB (26298624) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 98.121ms - BuildRowsPartitioned: 459.07K (459068) - GetNewBlockTime: 176.416us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 27.287ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 25.02 MB (26231936) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 4s115ms, non-child: 14.792ms, % non-child: 0.36%) BytesReceived(16s000ms): 5.83 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB - BytesReceived: 7.33 MB (7689622) - ConvertRowBatchTime: 11.051ms - DeserializeRowBatchTimer: 16.056ms - FirstBatchArrivalWaitTime: 2s084ms - PeakMemoryUsage: 0 - RowsReturned: 459.07K (459068) - RowsReturnedRate: 111.54 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=13):(Total: 519.323us, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 4.06B (4064125973) - BuildTime: 6m17s - PeakMemoryUsage: 159.47 GB (171230005504) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled, Spilled Runtime filters: 0 of 1 Runtime Filter Published, 1 Disabled - BuildRowsPartitionTime: 6m17s - BuildRowsPartitioned: 4.06B (4064125973) - GetNewBlockTime: 49s178ms - HashBuckets: 536.87M (536870912) - HashCollisions: 0 (0) - HashTablesBuildTime: 37s927ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 159.47 GB (171229947008) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 4 (4) - UnpinTime: 252.695ms HASH_JOIN_NODE (id=12):(Total: 3m7s, non-child: 1m12s, % non-child: 38.70%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 40.18M (40176110) - BuildTime: 8s491ms - PeakMemoryUsage: 3.02 GB (3240188128) - ProbeRows: 76.36M (76358585) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1m3s - RowsReturned: 4.06B (4064125973) - RowsReturnedRate: 21.68 M/sec Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 5s683ms - BuildRowsPartitioned: 40.18M (40176110) - GetNewBlockTime: 4.335ms - HashBuckets: 67.11M (67108864) - HashCollisions: 0 (0) - HashTablesBuildTime: 2s754ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 3.02 GB (3240125568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 7s015ms, non-child: 1s535ms, % non-child: 21.89%) BytesReceived(16s000ms): 212.33 MB, 380.50 MB, 380.50 MB, 380.50 MB, 380.50 MB, 380.50 MB, 380.50 MB, 380.50 MB, 380.50 MB, 380.50 MB, 380.50 MB, 380.50 MB, 380.50 MB, 380.50 MB, 380.50 MB, 380.50 MB, 380.50 MB, 380.50 MB, 380.50 MB, 380.50 MB, 380.50 MB, 380.50 MB, 380.50 MB, 380.50 MB, 380.50 MB, 380.50 MB, 380.50 MB, 380.50 MB, 380.50 MB, 380.50 MB, 380.50 MB, 380.50 MB, 380.50 MB, 380.50 MB, 380.50 MB, 380.50 MB, 380.50 MB, 380.50 MB, 380.50 MB, 380.50 MB - BytesReceived: 380.50 MB (398982846) - ConvertRowBatchTime: 950.788ms - DeserializeRowBatchTimer: 1s489ms - FirstBatchArrivalWaitTime: 1s097ms - PeakMemoryUsage: 0 - RowsReturned: 40.18M (40176110) - RowsReturnedRate: 5.73 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=22):(Total: 1m48s, non-child: 1s325ms, % non-child: 1.22%) BytesReceived(16s000ms): 2.21 MB, 15.66 MB, 42.46 MB, 68.43 MB, 95.46 MB, 122.59 MB, 149.95 MB, 177.91 MB, 204.78 MB, 230.44 MB, 255.50 MB, 281.42 MB, 308.11 MB, 334.36 MB, 358.64 MB, 386.10 MB, 411.79 MB, 439.21 MB, 462.53 MB, 488.44 MB, 511.57 MB, 528.84 MB, 548.02 MB, 570.56 MB, 588.93 MB, 601.58 MB, 621.67 MB, 638.08 MB, 651.91 MB, 656.59 MB, 665.44 MB, 678.80 MB, 685.03 MB, 695.15 MB, 703.75 MB, 707.33 MB, 707.33 MB, 707.33 MB, 707.33 MB, 707.33 MB - BytesReceived: 707.33 MB (741688107) - ConvertRowBatchTime: 856.282ms - DeserializeRowBatchTimer: 10s245ms - FirstBatchArrivalWaitTime: 754.998ms - PeakMemoryUsage: 0 - RowsReturned: 76.36M (76358585) - RowsReturnedRate: 702.83 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=24):(Total: 1s698ms, non-child: 3.843us, % non-child: 0.00%) BytesReceived(16s000ms): 8.94 MB, 10.71 MB, 10.71 MB, 10.71 MB, 10.71 MB, 10.71 MB, 10.71 MB, 10.71 MB, 10.71 MB, 10.71 MB, 10.71 MB, 10.71 MB, 10.71 MB, 10.71 MB, 10.71 MB, 10.71 MB, 10.71 MB, 10.71 MB, 10.71 MB, 10.71 MB, 10.71 MB, 10.71 MB, 10.71 MB, 10.71 MB, 10.71 MB, 10.71 MB, 10.71 MB, 10.71 MB, 10.71 MB, 10.71 MB, 10.71 MB, 10.71 MB, 10.71 MB, 10.71 MB, 10.71 MB, 10.71 MB, 10.71 MB, 10.78 MB, 10.89 MB, 10.90 MB - BytesReceived: 11.17 MB (11708202) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 65.995ms - FirstBatchArrivalWaitTime: 1s698ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:331 (host=vc1534.foo:22000):(Total: 60.503ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 1.04 GB, 7.16 GB, 14.01 GB, 20.55 GB, 27.22 GB, 33.90 GB, 40.68 GB, 47.41 GB, 53.73 GB, 60.09 GB, 66.21 GB, 72.57 GB, 79.29 GB, 85.58 GB, 91.77 GB, 98.48 GB, 104.84 GB, 111.51 GB, 117.52 GB, 123.65 GB, 129.69 GB, 133.81 GB, 138.48 GB, 144.03 GB, 148.61 GB, 151.87 GB, 156.61 GB, 155.36 GB, 152.66 GB, 153.47 GB, 155.80 GB, 158.98 GB, 158.15 GB, 151.03 GB, 152.89 GB, 154.53 GB, 153.24 GB, 150.19 GB, 152.00 GB, 155.55 GB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.03 - BloomFilterBytes: 49.00 MB (51380224) - PeakMemoryUsage: 160.60 GB (172447020415) - PerHostPeakMemUsage: 169.55 GB (182055654504) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 2m19s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 1.74K (1736) - TotalThreadsTotalWallClockTime: 21s687ms - TotalThreadsSysTime: 2s125ms - TotalThreadsUserTime: 8s036ms - TotalThreadsVoluntaryContextSwitches: 21.68K (21678) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 60.439ms - ExecTreePrepareTime: 675.584us DataStreamSender (dst_id=28):(Total: 923.309us, non-child: 923.309us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.05 MB (1105280) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 651.223ms, non-child: 651.223ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 212.814ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 122 (122) - NumInstructions: 8.95K (8951) - OptimizationTime: 411.927ms - PeakMemoryUsage: 4.37 MB (4582912) - PrepareTime: 26.073ms HASH_JOIN_NODE (id=15):(Total: 1.260ms, non-child: 929.262us, % non-child: 73.74%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 451.92K (451915) - BuildTime: 124.005ms - PeakMemoryUsage: 153.09 MB (160524544) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=15): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 92.487ms - BuildRowsPartitioned: 451.92K (451915) - GetNewBlockTime: 396.411us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 28.629ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160449664) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=26):(Total: 2s037ms, non-child: 26.635ms, % non-child: 1.31%) BytesReceived(16s000ms): 5.50 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB - BytesReceived: 6.21 MB (6513198) - ConvertRowBatchTime: 11.531ms - DeserializeRowBatchTimer: 53.679ms - FirstBatchArrivalWaitTime: 1s170ms - PeakMemoryUsage: 0 - RowsReturned: 451.92K (451915) - RowsReturnedRate: 221.76 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=14):(Total: 932.320us, non-child: 975.705us, % non-child: 100.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 459.14K (459144) - BuildTime: 148.879ms - PeakMemoryUsage: 25.08 MB (26298624) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 89.974ms - BuildRowsPartitioned: 459.14K (459144) - GetNewBlockTime: 144.573us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 24.341ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 25.02 MB (26231936) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 4s117ms, non-child: 16.160ms, % non-child: 0.39%) BytesReceived(16s000ms): 6.01 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB - BytesReceived: 7.33 MB (7690257) - ConvertRowBatchTime: 12.114ms - DeserializeRowBatchTimer: 16.534ms - FirstBatchArrivalWaitTime: 2s080ms - PeakMemoryUsage: 0 - RowsReturned: 459.14K (459144) - RowsReturnedRate: 111.52 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=13):(Total: 632.809us, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 3.92B (3915141182) - BuildTime: 6m2s - PeakMemoryUsage: 160.16 GB (171968203008) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled, Spilled Runtime filters: 0 of 1 Runtime Filter Published, 1 Disabled - BuildRowsPartitionTime: 6m2s - BuildRowsPartitioned: 3.92B (3915141182) - GetNewBlockTime: 33s834ms - HashBuckets: 536.87M (536870912) - HashCollisions: 0 (0) - HashTablesBuildTime: 36s384ms - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 160.16 GB (171968144512) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 4 (4) - UnpinTime: 105.369ms HASH_JOIN_NODE (id=12):(Total: 3m26s, non-child: 1m13s, % non-child: 35.74%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 40.17M (40168905) - BuildTime: 8s407ms - PeakMemoryUsage: 3.02 GB (3240188652) - ProbeRows: 73.93M (73926194) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1m4s - RowsReturned: 3.92B (3915141182) - RowsReturnedRate: 18.93 M/sec Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 5s643ms - BuildRowsPartitioned: 40.17M (40168905) - GetNewBlockTime: 2.935ms - HashBuckets: 67.11M (67108864) - HashCollisions: 0 (0) - HashTablesBuildTime: 2s707ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 3.02 GB (3240125568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 6s750ms, non-child: 1s507ms, % non-child: 22.33%) BytesReceived(16s000ms): 217.84 MB, 380.43 MB, 380.43 MB, 380.43 MB, 380.43 MB, 380.43 MB, 380.43 MB, 380.43 MB, 380.43 MB, 380.43 MB, 380.43 MB, 380.43 MB, 380.43 MB, 380.43 MB, 380.43 MB, 380.43 MB, 380.43 MB, 380.43 MB, 380.43 MB, 380.43 MB, 380.43 MB, 380.43 MB, 380.43 MB, 380.43 MB, 380.43 MB, 380.43 MB, 380.43 MB, 380.43 MB, 380.43 MB, 380.43 MB, 380.43 MB, 380.43 MB, 380.43 MB, 380.43 MB, 380.43 MB, 380.43 MB, 380.43 MB, 380.43 MB, 380.43 MB, 380.43 MB - BytesReceived: 380.43 MB (398906847) - ConvertRowBatchTime: 945.743ms - DeserializeRowBatchTimer: 1s464ms - FirstBatchArrivalWaitTime: 1s090ms - PeakMemoryUsage: 0 - RowsReturned: 40.17M (40168905) - RowsReturnedRate: 5.95 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=22):(Total: 2m6s, non-child: 1s380ms, % non-child: 1.09%) BytesReceived(16s000ms): 2.12 MB, 15.62 MB, 41.94 MB, 67.46 MB, 93.61 MB, 119.79 MB, 146.33 MB, 172.72 MB, 197.65 MB, 222.47 MB, 246.80 MB, 271.86 MB, 297.92 MB, 323.55 MB, 347.10 MB, 373.53 MB, 398.43 MB, 425.04 MB, 447.64 MB, 472.27 MB, 495.08 MB, 511.66 MB, 530.04 MB, 551.74 MB, 569.57 MB, 581.80 MB, 600.99 MB, 618.90 MB, 631.94 MB, 636.72 MB, 646.08 MB, 658.25 MB, 662.87 MB, 672.58 MB, 680.79 MB, 684.41 MB, 684.41 MB, 684.41 MB, 684.41 MB, 684.41 MB - BytesReceived: 684.41 MB (717651109) - ConvertRowBatchTime: 883.008ms - DeserializeRowBatchTimer: 7s014ms - FirstBatchArrivalWaitTime: 760.393ms - PeakMemoryUsage: 0 - RowsReturned: 73.93M (73926194) - RowsReturnedRate: 582.48 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=24):(Total: 1s689ms, non-child: 3.075us, % non-child: 0.00%) BytesReceived(16s000ms): 8.70 MB, 10.29 MB, 10.29 MB, 10.29 MB, 10.29 MB, 10.29 MB, 10.29 MB, 10.29 MB, 10.29 MB, 10.29 MB, 10.29 MB, 10.29 MB, 10.29 MB, 10.29 MB, 10.29 MB, 10.29 MB, 10.29 MB, 10.29 MB, 10.29 MB, 10.29 MB, 10.29 MB, 10.29 MB, 10.29 MB, 10.29 MB, 10.29 MB, 10.29 MB, 10.29 MB, 10.29 MB, 10.29 MB, 10.29 MB, 10.29 MB, 10.29 MB, 10.29 MB, 10.29 MB, 10.29 MB, 10.29 MB, 10.29 MB, 10.34 MB, 10.42 MB, 10.45 MB - BytesReceived: 10.58 MB (11096531) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 65.992ms - FirstBatchArrivalWaitTime: 1s689ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:329 (host=vd1133.foo:22000):(Total: 60.468ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 1.00 GB, 7.28 GB, 14.24 GB, 20.88 GB, 27.77 GB, 34.69 GB, 41.66 GB, 48.63 GB, 55.17 GB, 61.74 GB, 68.06 GB, 74.63 GB, 81.53 GB, 88.09 GB, 94.64 GB, 101.97 GB, 108.47 GB, 115.32 GB, 121.43 GB, 127.97 GB, 133.92 GB, 138.25 GB, 143.10 GB, 148.84 GB, 153.53 GB, 156.82 GB, 153.59 GB, 154.76 GB, 157.96 GB, 158.88 GB, 150.10 GB, 152.20 GB, 153.21 GB, 155.75 GB, 157.52 GB, 155.36 GB, 153.59 GB, 155.01 GB, 154.54 GB, 155.35 GB ThreadUsage(16s000ms): 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.03 - BloomFilterBytes: 49.00 MB (51380224) - PeakMemoryUsage: 160.60 GB (172443667951) - PerHostPeakMemUsage: 169.56 GB (182063982385) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 2m13s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 1.34K (1336) - TotalThreadsTotalWallClockTime: 21s556ms - TotalThreadsSysTime: 2s107ms - TotalThreadsUserTime: 7s805ms - TotalThreadsVoluntaryContextSwitches: 24.48K (24475) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 60.391ms - ExecTreePrepareTime: 864.413us DataStreamSender (dst_id=28):(Total: 1.128ms, non-child: 1.128ms, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.05 MB (1105280) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 674.653ms, non-child: 674.653ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 219.105ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 122 (122) - NumInstructions: 8.95K (8951) - OptimizationTime: 430.601ms - PeakMemoryUsage: 4.37 MB (4582912) - PrepareTime: 24.437ms HASH_JOIN_NODE (id=15):(Total: 1.633ms, non-child: 1.027ms, % non-child: 62.88%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 451.92K (451915) - BuildTime: 121.039ms - PeakMemoryUsage: 153.09 MB (160524544) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=15): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 96.176ms - BuildRowsPartitioned: 451.92K (451915) - GetNewBlockTime: 329.025us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 22.773ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160449664) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=26):(Total: 2s006ms, non-child: 27.550ms, % non-child: 1.37%) BytesReceived(16s000ms): 5.43 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB - BytesReceived: 6.21 MB (6513198) - ConvertRowBatchTime: 12.341ms - DeserializeRowBatchTimer: 50.581ms - FirstBatchArrivalWaitTime: 1s145ms - PeakMemoryUsage: 0 - RowsReturned: 451.92K (451915) - RowsReturnedRate: 225.27 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=14):(Total: 1.205ms, non-child: 960.532us, % non-child: 79.67%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 459.37K (459368) - BuildTime: 148.189ms - PeakMemoryUsage: 25.08 MB (26298624) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 87.285ms - BuildRowsPartitioned: 459.37K (459368) - GetNewBlockTime: 190.292us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 22.565ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 25.02 MB (26231936) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 4s082ms, non-child: 14.853ms, % non-child: 0.36%) BytesReceived(16s000ms): 5.85 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB - BytesReceived: 7.34 MB (7694458) - ConvertRowBatchTime: 10.656ms - DeserializeRowBatchTimer: 17.145ms - FirstBatchArrivalWaitTime: 2s055ms - PeakMemoryUsage: 0 - RowsReturned: 459.37K (459368) - RowsReturnedRate: 112.53 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=13):(Total: 804.584us, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 4.04B (4036211622) - BuildTime: 6m13s - PeakMemoryUsage: 159.12 GB (170852518144) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled, Spilled Runtime filters: 0 of 1 Runtime Filter Published, 1 Disabled - BuildRowsPartitionTime: 6m12s - BuildRowsPartitioned: 4.04B (4036211622) - GetNewBlockTime: 53s546ms - HashBuckets: 536.87M (536870912) - HashCollisions: 0 (0) - HashTablesBuildTime: 43s674ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 159.12 GB (170852459648) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 4 (4) - UnpinTime: 220.736ms HASH_JOIN_NODE (id=12):(Total: 3m15s, non-child: 1m8s, % non-child: 35.20%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 40.17M (40168824) - BuildTime: 8s116ms - PeakMemoryUsage: 3.02 GB (3240188828) - ProbeRows: 76.50M (76498864) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 59s914ms - RowsReturned: 4.04B (4036211622) - RowsReturnedRate: 20.66 M/sec Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 5s360ms - BuildRowsPartitioned: 40.17M (40168824) - GetNewBlockTime: 2.720ms - HashBuckets: 67.11M (67108864) - HashCollisions: 0 (0) - HashTablesBuildTime: 2s703ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 3.02 GB (3240125568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 7s000ms, non-child: 1s630ms, % non-child: 23.30%) BytesReceived(16s000ms): 213.70 MB, 380.42 MB, 380.42 MB, 380.42 MB, 380.42 MB, 380.42 MB, 380.42 MB, 380.42 MB, 380.42 MB, 380.42 MB, 380.42 MB, 380.42 MB, 380.42 MB, 380.42 MB, 380.42 MB, 380.42 MB, 380.42 MB, 380.42 MB, 380.42 MB, 380.42 MB, 380.42 MB, 380.42 MB, 380.42 MB, 380.42 MB, 380.42 MB, 380.42 MB, 380.42 MB, 380.42 MB, 380.42 MB, 380.42 MB, 380.42 MB, 380.42 MB, 380.42 MB, 380.42 MB, 380.42 MB, 380.42 MB, 380.42 MB, 380.42 MB, 380.42 MB, 380.42 MB - BytesReceived: 380.42 MB (398895856) - ConvertRowBatchTime: 970.863ms - DeserializeRowBatchTimer: 1s667ms - FirstBatchArrivalWaitTime: 1s064ms - PeakMemoryUsage: 0 - RowsReturned: 40.17M (40168824) - RowsReturnedRate: 5.74 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=22):(Total: 2m, non-child: 2s355ms, % non-child: 1.96%) BytesReceived(16s000ms): 2.15 MB, 15.79 MB, 42.82 MB, 68.94 MB, 96.06 MB, 123.27 MB, 150.75 MB, 178.22 MB, 204.11 MB, 229.87 MB, 254.97 MB, 280.93 MB, 307.74 MB, 334.03 MB, 360.75 MB, 388.56 MB, 414.44 MB, 441.87 MB, 465.06 MB, 491.12 MB, 513.47 MB, 531.14 MB, 550.24 MB, 572.89 MB, 590.82 MB, 603.47 MB, 623.87 MB, 640.10 MB, 653.48 MB, 658.17 MB, 667.23 MB, 680.41 MB, 685.59 MB, 694.91 MB, 703.63 MB, 708.49 MB, 708.49 MB, 708.49 MB, 708.49 MB, 708.49 MB - BytesReceived: 708.49 MB (742904393) - ConvertRowBatchTime: 911.088ms - DeserializeRowBatchTimer: 6s780ms - FirstBatchArrivalWaitTime: 728.148ms - PeakMemoryUsage: 0 - RowsReturned: 76.50M (76498864) - RowsReturnedRate: 635.67 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=24):(Total: 1s677ms, non-child: 7.454us, % non-child: 0.00%) BytesReceived(16s000ms): 8.31 MB, 9.87 MB, 9.87 MB, 9.87 MB, 9.87 MB, 9.87 MB, 9.87 MB, 9.87 MB, 9.87 MB, 9.87 MB, 9.87 MB, 9.87 MB, 9.87 MB, 9.87 MB, 9.87 MB, 9.87 MB, 9.87 MB, 9.87 MB, 9.87 MB, 9.87 MB, 9.87 MB, 9.87 MB, 9.87 MB, 9.87 MB, 9.87 MB, 9.87 MB, 9.87 MB, 9.87 MB, 9.87 MB, 9.87 MB, 9.87 MB, 9.87 MB, 9.87 MB, 9.87 MB, 9.87 MB, 9.87 MB, 9.87 MB, 9.87 MB, 9.87 MB, 9.87 MB - BytesReceived: 9.87 MB (10347339) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 72.181ms - FirstBatchArrivalWaitTime: 1s677ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:364 (host=vc1510.foo:22000):(Total: 60.429ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 911.00 MB, 6.96 GB, 14.08 GB, 20.70 GB, 27.53 GB, 34.39 GB, 41.32 GB, 48.28 GB, 55.16 GB, 61.78 GB, 68.08 GB, 74.62 GB, 81.44 GB, 87.76 GB, 94.17 GB, 101.04 GB, 107.49 GB, 114.23 GB, 120.41 GB, 126.86 GB, 132.79 GB, 137.13 GB, 141.80 GB, 147.50 GB, 152.15 GB, 155.49 GB, 156.27 GB, 153.52 GB, 156.89 GB, 157.18 GB, 156.34 GB, 151.66 GB, 152.33 GB, 154.79 GB, 156.53 GB, 153.63 GB, 153.61 GB, 154.32 GB, 154.59 GB, 155.04 GB ThreadUsage(16s000ms): 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.03 - BloomFilterBytes: 49.00 MB (51380224) - PeakMemoryUsage: 160.60 GB (172447133503) - PerHostPeakMemUsage: 169.57 GB (182075614100) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 2m16s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 1.66K (1663) - TotalThreadsTotalWallClockTime: 22s382ms - TotalThreadsSysTime: 2s084ms - TotalThreadsUserTime: 7s868ms - TotalThreadsVoluntaryContextSwitches: 22.81K (22808) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 60.389ms - ExecTreePrepareTime: 642.044us DataStreamSender (dst_id=28):(Total: 960.218us, non-child: 960.218us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.05 MB (1105280) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 641.257ms, non-child: 641.257ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 210.525ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 122 (122) - NumInstructions: 8.95K (8951) - OptimizationTime: 402.026ms - PeakMemoryUsage: 4.37 MB (4582912) - PrepareTime: 28.231ms HASH_JOIN_NODE (id=15):(Total: 1.196ms, non-child: 1.042ms, % non-child: 87.12%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 451.92K (451915) - BuildTime: 127.205ms - PeakMemoryUsage: 153.09 MB (160524544) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=15): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 100.833ms - BuildRowsPartitioned: 451.92K (451915) - GetNewBlockTime: 349.658us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 23.968ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160449664) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=26):(Total: 2s037ms, non-child: 23.978ms, % non-child: 1.18%) BytesReceived(16s000ms): 5.37 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB - BytesReceived: 6.21 MB (6513198) - ConvertRowBatchTime: 12.659ms - DeserializeRowBatchTimer: 50.673ms - FirstBatchArrivalWaitTime: 1s170ms - PeakMemoryUsage: 0 - RowsReturned: 451.92K (451915) - RowsReturnedRate: 221.77 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=14):(Total: 885.342us, non-child: 874.175us, % non-child: 98.74%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 461.54K (461539) - BuildTime: 158.428ms - PeakMemoryUsage: 25.08 MB (26298624) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 97.172ms - BuildRowsPartitioned: 461.54K (461539) - GetNewBlockTime: 155.673us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 22.131ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 25.02 MB (26231936) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 4s149ms, non-child: 15.793ms, % non-child: 0.38%) BytesReceived(16s000ms): 5.84 MB, 7.37 MB, 7.37 MB, 7.37 MB, 7.37 MB, 7.37 MB, 7.37 MB, 7.37 MB, 7.37 MB, 7.37 MB, 7.37 MB, 7.37 MB, 7.37 MB, 7.37 MB, 7.37 MB, 7.37 MB, 7.37 MB, 7.37 MB, 7.37 MB, 7.37 MB, 7.37 MB, 7.37 MB, 7.37 MB, 7.37 MB, 7.37 MB, 7.37 MB, 7.37 MB, 7.37 MB, 7.37 MB, 7.37 MB, 7.37 MB, 7.37 MB, 7.37 MB, 7.37 MB, 7.37 MB, 7.37 MB, 7.37 MB, 7.37 MB, 7.37 MB, 7.37 MB - BytesReceived: 7.37 MB (7729543) - ConvertRowBatchTime: 12.139ms - DeserializeRowBatchTimer: 15.303ms - FirstBatchArrivalWaitTime: 2s082ms - PeakMemoryUsage: 0 - RowsReturned: 461.54K (461539) - RowsReturnedRate: 111.24 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=13):(Total: 602.329us, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 4.01B (4007960812) - BuildTime: 6m6s - PeakMemoryUsage: 159.60 GB (171364813056) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled, Spilled Runtime filters: 0 of 1 Runtime Filter Published, 1 Disabled - BuildRowsPartitionTime: 6m6s - BuildRowsPartitioned: 4.01B (4007960812) - GetNewBlockTime: 59s471ms - HashBuckets: 1.07B (1073741824) - HashCollisions: 0 (0) - HashTablesBuildTime: 1m19s - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 159.60 GB (171364754560) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 5 (5) - UnpinTime: 241.438ms HASH_JOIN_NODE (id=12):(Total: 3m20s, non-child: 1m10s, % non-child: 35.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 40.30M (40302278) - BuildTime: 8s181ms - PeakMemoryUsage: 3.02 GB (3240188128) - ProbeRows: 75.98M (75978376) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1m1s - RowsReturned: 4.01B (4007960812) - RowsReturnedRate: 20.03 M/sec Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 5s400ms - BuildRowsPartitioned: 40.30M (40302278) - GetNewBlockTime: 2.914ms - HashBuckets: 67.11M (67108864) - HashCollisions: 0 (0) - HashTablesBuildTime: 2s727ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 3.02 GB (3240125568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 7s638ms, non-child: 1s489ms, % non-child: 19.50%) BytesReceived(16s000ms): 208.98 MB, 381.69 MB, 381.69 MB, 381.69 MB, 381.69 MB, 381.69 MB, 381.69 MB, 381.69 MB, 381.69 MB, 381.69 MB, 381.69 MB, 381.69 MB, 381.69 MB, 381.69 MB, 381.69 MB, 381.69 MB, 381.69 MB, 381.69 MB, 381.69 MB, 381.69 MB, 381.69 MB, 381.69 MB, 381.69 MB, 381.69 MB, 381.69 MB, 381.69 MB, 381.69 MB, 381.69 MB, 381.69 MB, 381.69 MB, 381.69 MB, 381.69 MB, 381.69 MB, 381.69 MB, 381.69 MB, 381.69 MB, 381.69 MB, 381.69 MB, 381.69 MB, 381.69 MB - BytesReceived: 381.69 MB (400229087) - ConvertRowBatchTime: 974.296ms - DeserializeRowBatchTimer: 1s373ms - FirstBatchArrivalWaitTime: 1s100ms - PeakMemoryUsage: 0 - RowsReturned: 40.30M (40302278) - RowsReturnedRate: 5.28 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=22):(Total: 2m3s, non-child: 1s284ms, % non-child: 1.04%) BytesReceived(16s000ms): 2.15 MB, 15.31 MB, 42.07 MB, 68.06 MB, 94.90 MB, 121.88 MB, 149.13 MB, 176.81 MB, 203.96 MB, 229.60 MB, 254.63 MB, 280.36 MB, 307.05 MB, 333.28 MB, 357.51 MB, 384.72 MB, 410.28 MB, 437.55 MB, 460.51 MB, 486.11 MB, 509.07 MB, 526.18 MB, 545.22 MB, 567.44 MB, 585.75 MB, 598.32 MB, 618.22 MB, 634.63 MB, 648.42 MB, 653.00 MB, 661.85 MB, 675.12 MB, 680.58 MB, 689.45 MB, 698.25 MB, 703.64 MB, 703.65 MB, 703.65 MB, 703.65 MB, 703.65 MB - BytesReceived: 703.65 MB (737825652) - ConvertRowBatchTime: 823.274ms - DeserializeRowBatchTimer: 5s696ms - FirstBatchArrivalWaitTime: 763.079ms - PeakMemoryUsage: 0 - RowsReturned: 75.98M (75978376) - RowsReturnedRate: 616.85 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=24):(Total: 1s684ms, non-child: 3.206us, % non-child: 0.00%) BytesReceived(16s000ms): 8.45 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.36 MB, 10.46 MB, 10.47 MB - BytesReceived: 10.64 MB (11155989) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 65.732ms - FirstBatchArrivalWaitTime: 1s684ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:35c (host=vd1113.foo:22000):(Total: 60.365ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 1021.04 MB, 7.37 GB, 14.49 GB, 21.22 GB, 28.20 GB, 35.17 GB, 42.22 GB, 49.27 GB, 55.89 GB, 62.54 GB, 68.97 GB, 75.67 GB, 82.58 GB, 89.29 GB, 95.69 GB, 102.60 GB, 109.33 GB, 115.94 GB, 123.17 GB, 130.14 GB, 135.82 GB, 140.15 GB, 145.12 GB, 150.93 GB, 155.67 GB, 157.33 GB, 153.34 GB, 157.15 GB, 159.86 GB, 150.24 GB, 152.25 GB, 154.12 GB, 156.38 GB, 157.35 GB, 155.87 GB, 153.56 GB, 158.73 GB, 158.90 GB, 156.93 GB, 148.59 GB ThreadUsage(16s000ms): 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.03 - BloomFilterBytes: 49.00 MB (51380224) - PeakMemoryUsage: 160.61 GB (172448898271) - PerHostPeakMemUsage: 169.56 GB (182064308550) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 2m22s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 1.49K (1492) - TotalThreadsTotalWallClockTime: 22s006ms - TotalThreadsSysTime: 1s959ms - TotalThreadsUserTime: 7s956ms - TotalThreadsVoluntaryContextSwitches: 22.55K (22550) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 60.302ms - ExecTreePrepareTime: 985.373us DataStreamSender (dst_id=28):(Total: 967.098us, non-child: 967.098us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.05 MB (1105280) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 619.943ms, non-child: 619.943ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 206.996ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 122 (122) - NumInstructions: 8.95K (8951) - OptimizationTime: 386.412ms - PeakMemoryUsage: 4.37 MB (4582912) - PrepareTime: 26.126ms HASH_JOIN_NODE (id=15):(Total: 1.883ms, non-child: 867.140us, % non-child: 46.05%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 451.92K (451915) - BuildTime: 121.673ms - PeakMemoryUsage: 153.09 MB (160524544) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=15): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 89.857ms - BuildRowsPartitioned: 451.92K (451915) - GetNewBlockTime: 422.984us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 28.585ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160449664) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=26):(Total: 2s066ms, non-child: 21.049ms, % non-child: 1.02%) BytesReceived(16s000ms): 5.51 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB - BytesReceived: 6.21 MB (6513198) - ConvertRowBatchTime: 11.122ms - DeserializeRowBatchTimer: 46.027ms - FirstBatchArrivalWaitTime: 1s192ms - PeakMemoryUsage: 0 - RowsReturned: 451.92K (451915) - RowsReturnedRate: 218.64 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=14):(Total: 1.504ms, non-child: 1.021ms, % non-child: 67.95%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 458.59K (458587) - BuildTime: 158.788ms - PeakMemoryUsage: 25.08 MB (26298624) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 97.653ms - BuildRowsPartitioned: 458.59K (458587) - GetNewBlockTime: 245.666us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 22.337ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 25.02 MB (26231936) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 4s166ms, non-child: 14.984ms, % non-child: 0.36%) BytesReceived(16s000ms): 6.00 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB - BytesReceived: 7.33 MB (7681799) - ConvertRowBatchTime: 11.526ms - DeserializeRowBatchTimer: 14.276ms - FirstBatchArrivalWaitTime: 2s101ms - PeakMemoryUsage: 0 - RowsReturned: 458.59K (458587) - RowsReturnedRate: 110.08 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=13):(Total: 1.027ms, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 4.09B (4087163979) - BuildTime: 5m58s - PeakMemoryUsage: 160.16 GB (171968792832) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled, Spilled Runtime filters: 0 of 1 Runtime Filter Published, 1 Disabled - BuildRowsPartitionTime: 5m57s - BuildRowsPartitioned: 4.09B (4087163979) - GetNewBlockTime: 43s510ms - HashBuckets: 536.87M (536870912) - HashCollisions: 0 (0) - HashTablesBuildTime: 1m1s - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 160.16 GB (171968734336) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 5 (5) - UnpinTime: 290.336ms HASH_JOIN_NODE (id=12):(Total: 3m25s, non-child: 1m9s, % non-child: 34.03%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 40.15M (40148897) - BuildTime: 8s166ms - PeakMemoryUsage: 3.02 GB (3240188128) - ProbeRows: 76.54M (76539166) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1m - RowsReturned: 4.09B (4087163979) - RowsReturnedRate: 19.93 M/sec Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 5s566ms - BuildRowsPartitioned: 40.15M (40148897) - GetNewBlockTime: 2.797ms - HashBuckets: 67.11M (67108864) - HashCollisions: 0 (0) - HashTablesBuildTime: 2s553ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 3.02 GB (3240125568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 7s240ms, non-child: 1s532ms, % non-child: 21.17%) BytesReceived(16s000ms): 217.94 MB, 380.25 MB, 380.25 MB, 380.25 MB, 380.25 MB, 380.25 MB, 380.25 MB, 380.25 MB, 380.25 MB, 380.25 MB, 380.25 MB, 380.25 MB, 380.25 MB, 380.25 MB, 380.25 MB, 380.25 MB, 380.25 MB, 380.25 MB, 380.25 MB, 380.25 MB, 380.25 MB, 380.25 MB, 380.25 MB, 380.25 MB, 380.25 MB, 380.25 MB, 380.25 MB, 380.25 MB, 380.25 MB, 380.25 MB, 380.25 MB, 380.25 MB, 380.25 MB, 380.25 MB, 380.25 MB, 380.25 MB, 380.25 MB, 380.25 MB, 380.25 MB, 380.25 MB - BytesReceived: 380.25 MB (398719763) - ConvertRowBatchTime: 960.595ms - DeserializeRowBatchTimer: 1s524ms - FirstBatchArrivalWaitTime: 1s112ms - PeakMemoryUsage: 0 - RowsReturned: 40.15M (40148897) - RowsReturnedRate: 5.55 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=22):(Total: 2m8s, non-child: 1s254ms, % non-child: 0.97%) BytesReceived(16s000ms): 2.16 MB, 16.14 MB, 43.17 MB, 69.29 MB, 96.35 MB, 123.45 MB, 150.86 MB, 178.23 MB, 204.18 MB, 229.92 MB, 255.20 MB, 281.27 MB, 308.24 MB, 334.84 MB, 359.39 MB, 386.73 MB, 412.59 MB, 442.06 MB, 466.49 MB, 492.73 MB, 514.66 MB, 532.27 MB, 551.34 MB, 574.21 MB, 591.98 MB, 604.74 MB, 625.35 MB, 641.55 MB, 654.53 MB, 659.22 MB, 668.43 MB, 681.51 MB, 686.59 MB, 695.99 MB, 704.61 MB, 709.19 MB, 709.19 MB, 709.19 MB, 709.19 MB, 709.19 MB - BytesReceived: 709.19 MB (743638544) - ConvertRowBatchTime: 788.262ms - DeserializeRowBatchTimer: 10s814ms - FirstBatchArrivalWaitTime: 780.225ms - PeakMemoryUsage: 0 - RowsReturned: 76.54M (76539166) - RowsReturnedRate: 594.27 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=24):(Total: 1s729ms, non-child: 4.070us, % non-child: 0.00%) BytesReceived(16s000ms): 8.69 MB, 10.28 MB, 10.28 MB, 10.28 MB, 10.28 MB, 10.28 MB, 10.28 MB, 10.28 MB, 10.28 MB, 10.28 MB, 10.28 MB, 10.28 MB, 10.28 MB, 10.28 MB, 10.28 MB, 10.28 MB, 10.28 MB, 10.28 MB, 10.28 MB, 10.28 MB, 10.28 MB, 10.28 MB, 10.28 MB, 10.28 MB, 10.28 MB, 10.28 MB, 10.28 MB, 10.28 MB, 10.28 MB, 10.28 MB, 10.28 MB, 10.28 MB, 10.28 MB, 10.28 MB, 10.28 MB, 10.28 MB, 10.28 MB, 10.32 MB, 10.40 MB, 10.40 MB - BytesReceived: 10.55 MB (11066114) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 75.989ms - FirstBatchArrivalWaitTime: 1s729ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:334 (host=vd1339.foo:22000):(Total: 60.321ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 1006.53 MB, 7.10 GB, 14.02 GB, 20.53 GB, 27.31 GB, 34.10 GB, 40.96 GB, 47.79 GB, 54.15 GB, 60.57 GB, 66.81 GB, 73.24 GB, 80.04 GB, 86.51 GB, 92.56 GB, 99.33 GB, 105.79 GB, 112.57 GB, 118.78 GB, 125.73 GB, 131.49 GB, 135.81 GB, 140.56 GB, 146.18 GB, 150.78 GB, 153.93 GB, 156.65 GB, 152.20 GB, 155.35 GB, 156.43 GB, 158.63 GB, 151.64 GB, 151.26 GB, 153.48 GB, 154.88 GB, 151.43 GB, 153.53 GB, 151.08 GB, 153.39 GB, 153.75 GB ThreadUsage(16s000ms): 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.03 - BloomFilterBytes: 49.00 MB (51380224) - PeakMemoryUsage: 160.60 GB (172448151295) - PerHostPeakMemUsage: 169.57 GB (182074265409) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 2m9s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 1.76K (1757) - TotalThreadsTotalWallClockTime: 22s116ms - TotalThreadsSysTime: 2s246ms - TotalThreadsUserTime: 8s321ms - TotalThreadsVoluntaryContextSwitches: 22.08K (22077) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 60.260ms - ExecTreePrepareTime: 920.993us DataStreamSender (dst_id=28):(Total: 1.201ms, non-child: 1.201ms, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.05 MB (1105280) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 637.938ms, non-child: 637.938ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 207.108ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 122 (122) - NumInstructions: 8.95K (8951) - OptimizationTime: 407.885ms - PeakMemoryUsage: 4.37 MB (4582912) - PrepareTime: 22.477ms HASH_JOIN_NODE (id=15):(Total: 1.697ms, non-child: 1.263ms, % non-child: 74.46%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 451.92K (451915) - BuildTime: 137.004ms - PeakMemoryUsage: 153.09 MB (160524544) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=15): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 106.874ms - BuildRowsPartitioned: 451.92K (451915) - GetNewBlockTime: 360.049us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 27.913ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160449664) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=26):(Total: 2s037ms, non-child: 29.570ms, % non-child: 1.45%) BytesReceived(16s000ms): 5.44 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB - BytesReceived: 6.21 MB (6513198) - ConvertRowBatchTime: 12.919ms - DeserializeRowBatchTimer: 54.225ms - FirstBatchArrivalWaitTime: 1s179ms - PeakMemoryUsage: 0 - RowsReturned: 451.92K (451915) - RowsReturnedRate: 221.82 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=14):(Total: 1.146ms, non-child: 876.110us, % non-child: 76.42%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 460.23K (460226) - BuildTime: 152.183ms - PeakMemoryUsage: 25.08 MB (26298624) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 85.768ms - BuildRowsPartitioned: 460.23K (460226) - GetNewBlockTime: 197.254us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 27.161ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 25.02 MB (26231936) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 4s129ms, non-child: 15.461ms, % non-child: 0.37%) BytesReceived(16s000ms): 5.97 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB - BytesReceived: 7.35 MB (7707564) - ConvertRowBatchTime: 11.524ms - DeserializeRowBatchTimer: 16.389ms - FirstBatchArrivalWaitTime: 2s090ms - PeakMemoryUsage: 0 - RowsReturned: 460.23K (460226) - RowsReturnedRate: 111.44 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=13):(Total: 791.327us, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 3.96B (3960558335) - BuildTime: 6m10s - PeakMemoryUsage: 157.31 GB (168914159840) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled, Spilled Runtime filters: 0 of 1 Runtime Filter Published, 1 Disabled - BuildRowsPartitionTime: 6m10s - BuildRowsPartitioned: 3.96B (3960558335) - GetNewBlockTime: 38s546ms - HashBuckets: 536.87M (536870912) - HashCollisions: 0 (0) - HashTablesBuildTime: 32s954ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 157.31 GB (168914068608) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 4 (4) - UnpinTime: 253.640ms HASH_JOIN_NODE (id=12):(Total: 3m15s, non-child: 1m12s, % non-child: 36.97%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 40.28M (40276444) - BuildTime: 8s750ms - PeakMemoryUsage: 3.02 GB (3240192224) - ProbeRows: 75.78M (75778318) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1m2s - RowsReturned: 3.96B (3960558335) - RowsReturnedRate: 20.31 M/sec Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 5s599ms - BuildRowsPartitioned: 40.28M (40276444) - GetNewBlockTime: 3.020ms - HashBuckets: 67.11M (67108864) - HashCollisions: 0 (0) - HashTablesBuildTime: 3s097ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 3.02 GB (3240125568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 6s807ms, non-child: 1s571ms, % non-child: 23.08%) BytesReceived(16s000ms): 216.45 MB, 381.44 MB, 381.44 MB, 381.44 MB, 381.44 MB, 381.44 MB, 381.44 MB, 381.44 MB, 381.44 MB, 381.44 MB, 381.44 MB, 381.44 MB, 381.44 MB, 381.44 MB, 381.44 MB, 381.44 MB, 381.44 MB, 381.44 MB, 381.44 MB, 381.44 MB, 381.44 MB, 381.44 MB, 381.44 MB, 381.44 MB, 381.44 MB, 381.44 MB, 381.44 MB, 381.44 MB, 381.44 MB, 381.44 MB, 381.44 MB, 381.44 MB, 381.44 MB, 381.44 MB, 381.44 MB, 381.44 MB, 381.44 MB, 381.44 MB, 381.44 MB, 381.44 MB - BytesReceived: 381.44 MB (399972522) - ConvertRowBatchTime: 967.722ms - DeserializeRowBatchTimer: 1s522ms - FirstBatchArrivalWaitTime: 1s104ms - PeakMemoryUsage: 0 - RowsReturned: 40.28M (40276444) - RowsReturnedRate: 5.92 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=22):(Total: 1m56s, non-child: 1s738ms, % non-child: 1.49%) BytesReceived(16s000ms): 2.12 MB, 15.64 MB, 42.18 MB, 67.95 MB, 94.81 MB, 121.66 MB, 148.88 MB, 175.96 MB, 201.53 MB, 226.94 MB, 251.95 MB, 277.71 MB, 304.46 MB, 330.72 MB, 355.03 MB, 382.06 MB, 407.68 MB, 434.95 MB, 459.68 MB, 487.21 MB, 508.82 MB, 526.41 MB, 545.36 MB, 567.86 MB, 585.47 MB, 598.05 MB, 618.51 MB, 634.73 MB, 647.42 MB, 652.21 MB, 661.37 MB, 674.36 MB, 679.36 MB, 688.80 MB, 697.33 MB, 701.79 MB, 701.80 MB, 701.80 MB, 701.80 MB, 701.80 MB - BytesReceived: 701.80 MB (735887014) - ConvertRowBatchTime: 848.704ms - DeserializeRowBatchTimer: 8s264ms - FirstBatchArrivalWaitTime: 766.636ms - PeakMemoryUsage: 0 - RowsReturned: 75.78M (75778318) - RowsReturnedRate: 648.25 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=24):(Total: 1s706ms, non-child: 3.975us, % non-child: 0.00%) BytesReceived(16s000ms): 8.69 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.34 MB, 10.42 MB, 10.44 MB - BytesReceived: 10.59 MB (11109014) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 67.758ms - FirstBatchArrivalWaitTime: 1s706ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:303 (host=va1033.foo:22000):(Total: 60.268ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 960.15 MB, 6.78 GB, 14.03 GB, 20.87 GB, 27.77 GB, 34.66 GB, 41.60 GB, 48.39 GB, 55.00 GB, 61.55 GB, 67.95 GB, 74.47 GB, 81.98 GB, 88.36 GB, 94.80 GB, 101.69 GB, 108.22 GB, 114.93 GB, 121.30 GB, 127.63 GB, 133.76 GB, 138.21 GB, 142.96 GB, 148.69 GB, 153.47 GB, 156.85 GB, 153.89 GB, 155.31 GB, 158.53 GB, 158.67 GB, 150.81 GB, 153.49 GB, 154.76 GB, 157.25 GB, 158.68 GB, 152.64 GB, 157.40 GB, 158.35 GB, 155.34 GB, 156.77 GB ThreadUsage(16s000ms): 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.03 - BloomFilterBytes: 49.00 MB (51380224) - PeakMemoryUsage: 160.60 GB (172445053279) - PerHostPeakMemUsage: 169.57 GB (182072814812) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 1m44s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 1.58K (1582) - TotalThreadsTotalWallClockTime: 21s904ms - TotalThreadsSysTime: 2s264ms - TotalThreadsUserTime: 8s293ms - TotalThreadsVoluntaryContextSwitches: 21.52K (21523) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 60.175ms - ExecTreePrepareTime: 881.089us DataStreamSender (dst_id=28):(Total: 940.833us, non-child: 940.833us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.05 MB (1105280) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 633.691ms, non-child: 633.691ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 197.755ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 122 (122) - NumInstructions: 8.95K (8951) - OptimizationTime: 409.055ms - PeakMemoryUsage: 4.37 MB (4582912) - PrepareTime: 26.478ms HASH_JOIN_NODE (id=15):(Total: 1.612ms, non-child: 1.040ms, % non-child: 64.50%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 451.92K (451915) - BuildTime: 140.295ms - PeakMemoryUsage: 153.09 MB (160524544) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=15): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 105.185ms - BuildRowsPartitioned: 451.92K (451915) - GetNewBlockTime: 340.252us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 32.046ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160449664) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=26):(Total: 2s054ms, non-child: 25.640ms, % non-child: 1.25%) BytesReceived(16s000ms): 5.32 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB - BytesReceived: 6.21 MB (6513198) - ConvertRowBatchTime: 12.255ms - DeserializeRowBatchTimer: 49.862ms - FirstBatchArrivalWaitTime: 1s200ms - PeakMemoryUsage: 0 - RowsReturned: 451.92K (451915) - RowsReturnedRate: 219.95 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=14):(Total: 1.280ms, non-child: 863.585us, % non-child: 67.43%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 458.63K (458630) - BuildTime: 182.401ms - PeakMemoryUsage: 25.08 MB (26298624) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 107.398ms - BuildRowsPartitioned: 458.63K (458630) - GetNewBlockTime: 189.541us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 28.242ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 25.02 MB (26231936) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 4s087ms, non-child: 15.619ms, % non-child: 0.38%) BytesReceived(16s000ms): 5.77 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB - BytesReceived: 7.33 MB (7681783) - ConvertRowBatchTime: 11.938ms - DeserializeRowBatchTimer: 15.595ms - FirstBatchArrivalWaitTime: 2s106ms - PeakMemoryUsage: 0 - RowsReturned: 458.63K (458630) - RowsReturnedRate: 112.19 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=13):(Total: 992.054us, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 4.04B (4039241767) - BuildTime: 6m30s - PeakMemoryUsage: 159.45 GB (171213228288) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled, Spilled Runtime filters: 0 of 1 Runtime Filter Published, 1 Disabled - BuildRowsPartitionTime: 6m29s - BuildRowsPartitioned: 4.04B (4039241767) - GetNewBlockTime: 45s303ms - HashBuckets: 536.87M (536870912) - HashCollisions: 0 (0) - HashTablesBuildTime: 49s366ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 159.45 GB (171213169792) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 4 (4) - UnpinTime: 289.014ms HASH_JOIN_NODE (id=12):(Total: 2m52s, non-child: 1m14s, % non-child: 43.21%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 40.17M (40170277) - BuildTime: 8s713ms - PeakMemoryUsage: 3.02 GB (3240189694) - ProbeRows: 76.31M (76309149) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1m1s - RowsReturned: 4.04B (4039241767) - RowsReturnedRate: 23.42 M/sec Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 5s724ms - BuildRowsPartitioned: 40.17M (40170277) - GetNewBlockTime: 3.431ms - HashBuckets: 67.11M (67108864) - HashCollisions: 0 (0) - HashTablesBuildTime: 2s943ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 3.02 GB (3240125568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 6s627ms, non-child: 1s636ms, % non-child: 24.69%) BytesReceived(16s000ms): 206.57 MB, 380.43 MB, 380.43 MB, 380.43 MB, 380.43 MB, 380.43 MB, 380.43 MB, 380.43 MB, 380.43 MB, 380.43 MB, 380.43 MB, 380.43 MB, 380.43 MB, 380.43 MB, 380.43 MB, 380.43 MB, 380.43 MB, 380.43 MB, 380.43 MB, 380.43 MB, 380.43 MB, 380.43 MB, 380.43 MB, 380.43 MB, 380.43 MB, 380.43 MB, 380.43 MB, 380.43 MB, 380.43 MB, 380.43 MB, 380.43 MB, 380.43 MB, 380.43 MB, 380.43 MB, 380.43 MB, 380.43 MB, 380.43 MB, 380.43 MB, 380.43 MB, 380.43 MB - BytesReceived: 380.43 MB (398909725) - ConvertRowBatchTime: 963.226ms - DeserializeRowBatchTimer: 1s679ms - FirstBatchArrivalWaitTime: 1s125ms - PeakMemoryUsage: 0 - RowsReturned: 40.17M (40170277) - RowsReturnedRate: 6.06 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=22):(Total: 1m32s, non-child: 1s342ms, % non-child: 1.46%) BytesReceived(16s000ms): 2.13 MB, 15.28 MB, 42.19 MB, 68.37 MB, 95.38 MB, 122.36 MB, 149.64 MB, 176.92 MB, 202.84 MB, 228.47 MB, 253.63 MB, 281.62 MB, 308.59 MB, 334.99 MB, 359.30 MB, 386.62 MB, 412.25 MB, 439.76 MB, 463.01 MB, 488.86 MB, 511.72 MB, 529.17 MB, 548.24 MB, 570.82 MB, 589.11 MB, 601.76 MB, 622.01 MB, 638.37 MB, 652.03 MB, 656.63 MB, 666.59 MB, 680.26 MB, 684.93 MB, 695.09 MB, 703.48 MB, 706.90 MB, 706.90 MB, 706.90 MB, 706.90 MB, 706.90 MB - BytesReceived: 706.90 MB (741243114) - ConvertRowBatchTime: 847.458ms - DeserializeRowBatchTimer: 5s677ms - FirstBatchArrivalWaitTime: 786.410ms - PeakMemoryUsage: 0 - RowsReturned: 76.31M (76309149) - RowsReturnedRate: 828.44 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=24):(Total: 1s731ms, non-child: 4.213us, % non-child: 0.00%) BytesReceived(16s000ms): 8.82 MB, 10.83 MB, 10.83 MB, 10.83 MB, 10.83 MB, 10.83 MB, 10.83 MB, 10.83 MB, 10.83 MB, 10.83 MB, 10.83 MB, 10.83 MB, 10.83 MB, 10.83 MB, 10.83 MB, 10.83 MB, 10.83 MB, 10.83 MB, 10.83 MB, 10.83 MB, 10.83 MB, 10.83 MB, 10.83 MB, 10.83 MB, 10.83 MB, 10.83 MB, 10.83 MB, 10.83 MB, 10.83 MB, 10.83 MB, 10.83 MB, 10.83 MB, 10.83 MB, 10.83 MB, 10.83 MB, 10.83 MB, 10.83 MB, 10.88 MB, 10.97 MB, 10.97 MB - BytesReceived: 11.31 MB (11856268) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 70.661ms - FirstBatchArrivalWaitTime: 1s731ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:33c (host=vd1332.foo:22000):(Total: 60.254ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 1015.61 MB, 6.80 GB, 13.93 GB, 20.92 GB, 27.75 GB, 34.58 GB, 41.49 GB, 48.38 GB, 54.83 GB, 61.31 GB, 67.57 GB, 74.05 GB, 80.84 GB, 87.39 GB, 93.58 GB, 100.41 GB, 106.93 GB, 113.83 GB, 119.83 GB, 126.22 GB, 132.39 GB, 136.65 GB, 141.48 GB, 147.32 GB, 152.64 GB, 155.82 GB, 155.43 GB, 153.72 GB, 156.77 GB, 157.22 GB, 155.87 GB, 151.51 GB, 152.03 GB, 154.98 GB, 156.07 GB, 152.88 GB, 154.76 GB, 155.98 GB, 154.30 GB, 157.03 GB ThreadUsage(16s000ms): 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.03 - BloomFilterBytes: 49.00 MB (51380224) - PeakMemoryUsage: 160.60 GB (172445675263) - PerHostPeakMemUsage: 169.55 GB (182049888199) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 1m44s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 1.54K (1545) - TotalThreadsTotalWallClockTime: 22s064ms - TotalThreadsSysTime: 2s262ms - TotalThreadsUserTime: 8s202ms - TotalThreadsVoluntaryContextSwitches: 22.60K (22600) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 60.186ms - ExecTreePrepareTime: 614.508us DataStreamSender (dst_id=28):(Total: 805.047us, non-child: 805.047us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.05 MB (1105280) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 644.993ms, non-child: 644.993ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 206.223ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 122 (122) - NumInstructions: 8.95K (8951) - OptimizationTime: 412.636ms - PeakMemoryUsage: 4.37 MB (4582912) - PrepareTime: 25.677ms HASH_JOIN_NODE (id=15):(Total: 1.172ms, non-child: 861.993us, % non-child: 73.54%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 451.92K (451915) - BuildTime: 135.237ms - PeakMemoryUsage: 153.09 MB (160524544) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=15): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 99.524ms - BuildRowsPartitioned: 451.92K (451915) - GetNewBlockTime: 369.450us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 33.094ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160449664) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=26):(Total: 2s033ms, non-child: 23.968ms, % non-child: 1.18%) BytesReceived(16s000ms): 5.44 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB - BytesReceived: 6.21 MB (6513198) - ConvertRowBatchTime: 11.692ms - DeserializeRowBatchTimer: 47.363ms - FirstBatchArrivalWaitTime: 1s172ms - PeakMemoryUsage: 0 - RowsReturned: 451.92K (451915) - RowsReturnedRate: 222.20 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=14):(Total: 923.668us, non-child: 916.472us, % non-child: 99.22%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 459.13K (459129) - BuildTime: 159.448ms - PeakMemoryUsage: 25.08 MB (26298624) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 102.011ms - BuildRowsPartitioned: 459.13K (459129) - GetNewBlockTime: 323.212us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 22.968ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 25.02 MB (26231936) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 4s109ms, non-child: 15.580ms, % non-child: 0.38%) BytesReceived(16s000ms): 5.95 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB - BytesReceived: 7.34 MB (7691651) - ConvertRowBatchTime: 11.645ms - DeserializeRowBatchTimer: 15.740ms - FirstBatchArrivalWaitTime: 2s086ms - PeakMemoryUsage: 0 - RowsReturned: 459.13K (459129) - RowsReturnedRate: 111.71 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=13):(Total: 693.005us, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 4.00B (4002300847) - BuildTime: 6m36s - PeakMemoryUsage: 158.43 GB (170114910464) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled, Spilled Runtime filters: 0 of 1 Runtime Filter Published, 1 Disabled - BuildRowsPartitionTime: 6m35s - BuildRowsPartitioned: 4.00B (4002300847) - GetNewBlockTime: 1m - HashBuckets: 536.87M (536870912) - HashCollisions: 0 (0) - HashTablesBuildTime: 49s137ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 158.43 GB (170114851968) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 4 (4) - UnpinTime: 396.680ms HASH_JOIN_NODE (id=12):(Total: 2m51s, non-child: 1m13s, % non-child: 42.97%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 40.12M (40118631) - BuildTime: 8s657ms - PeakMemoryUsage: 3.02 GB (3240188894) - ProbeRows: 75.38M (75378420) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1m4s - RowsReturned: 4.00B (4002300847) - RowsReturnedRate: 23.36 M/sec Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 5s565ms - BuildRowsPartitioned: 40.12M (40118631) - GetNewBlockTime: 4.133ms - HashBuckets: 67.11M (67108864) - HashCollisions: 0 (0) - HashTablesBuildTime: 3s044ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 3.02 GB (3240125568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 6s872ms, non-child: 1s634ms, % non-child: 23.79%) BytesReceived(16s000ms): 215.39 MB, 379.94 MB, 379.94 MB, 379.94 MB, 379.94 MB, 379.94 MB, 379.94 MB, 379.94 MB, 379.94 MB, 379.94 MB, 379.94 MB, 379.94 MB, 379.94 MB, 379.94 MB, 379.94 MB, 379.94 MB, 379.94 MB, 379.94 MB, 379.94 MB, 379.94 MB, 379.94 MB, 379.94 MB, 379.94 MB, 379.94 MB, 379.94 MB, 379.94 MB, 379.94 MB, 379.94 MB, 379.94 MB, 379.94 MB, 379.94 MB, 379.94 MB, 379.94 MB, 379.94 MB, 379.94 MB, 379.94 MB, 379.94 MB, 379.94 MB, 379.94 MB, 379.94 MB - BytesReceived: 379.94 MB (398398463) - ConvertRowBatchTime: 972.117ms - DeserializeRowBatchTimer: 1s688ms - FirstBatchArrivalWaitTime: 1s103ms - PeakMemoryUsage: 0 - RowsReturned: 40.12M (40118631) - RowsReturnedRate: 5.84 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=22):(Total: 1m31s, non-child: 1s256ms, % non-child: 1.37%) BytesReceived(16s000ms): 2.18 MB, 15.95 MB, 42.73 MB, 68.52 MB, 95.18 MB, 121.82 MB, 148.80 MB, 175.79 MB, 201.31 MB, 226.54 MB, 251.26 MB, 276.66 MB, 303.06 MB, 329.03 MB, 353.04 MB, 379.94 MB, 405.33 MB, 432.51 MB, 455.60 MB, 480.80 MB, 504.15 MB, 521.19 MB, 540.11 MB, 563.17 MB, 583.12 MB, 595.67 MB, 615.89 MB, 631.70 MB, 643.77 MB, 648.57 MB, 657.81 MB, 670.67 MB, 675.52 MB, 685.15 MB, 693.69 MB, 697.70 MB, 697.70 MB, 697.70 MB, 697.70 MB, 697.70 MB - BytesReceived: 697.70 MB (731589268) - ConvertRowBatchTime: 849.854ms - DeserializeRowBatchTimer: 6s280ms - FirstBatchArrivalWaitTime: 770.255ms - PeakMemoryUsage: 0 - RowsReturned: 75.38M (75378420) - RowsReturnedRate: 822.96 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=24):(Total: 1s703ms, non-child: 3.418us, % non-child: 0.00%) BytesReceived(16s000ms): 8.98 MB, 10.65 MB, 10.65 MB, 10.65 MB, 10.65 MB, 10.65 MB, 10.65 MB, 10.65 MB, 10.65 MB, 10.65 MB, 10.65 MB, 10.65 MB, 10.65 MB, 10.65 MB, 10.65 MB, 10.65 MB, 10.65 MB, 10.65 MB, 10.65 MB, 10.65 MB, 10.65 MB, 10.65 MB, 10.65 MB, 10.65 MB, 10.65 MB, 10.65 MB, 10.65 MB, 10.65 MB, 10.65 MB, 10.65 MB, 10.65 MB, 10.65 MB, 10.65 MB, 10.65 MB, 10.65 MB, 10.65 MB, 10.65 MB, 10.70 MB, 10.83 MB, 10.85 MB - BytesReceived: 11.27 MB (11820306) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 74.668ms - FirstBatchArrivalWaitTime: 1s703ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:34d (host=va1036.foo:22000):(Total: 60.231ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 1022.22 MB, 6.96 GB, 14.22 GB, 20.89 GB, 27.67 GB, 34.43 GB, 41.25 GB, 48.19 GB, 54.66 GB, 61.16 GB, 67.44 GB, 73.94 GB, 80.77 GB, 87.21 GB, 93.49 GB, 100.29 GB, 106.77 GB, 113.42 GB, 119.65 GB, 125.96 GB, 132.12 GB, 136.37 GB, 141.02 GB, 146.75 GB, 151.44 GB, 154.71 GB, 156.73 GB, 152.77 GB, 156.20 GB, 157.02 GB, 159.37 GB, 151.83 GB, 152.27 GB, 154.77 GB, 156.63 GB, 151.32 GB, 152.35 GB, 154.22 GB, 153.69 GB, 154.90 GB ThreadUsage(16s000ms): 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.03 - BloomFilterBytes: 49.00 MB (51380224) - PeakMemoryUsage: 160.60 GB (172446443071) - PerHostPeakMemUsage: 169.56 GB (182059851881) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 2m20s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 1.61K (1608) - TotalThreadsTotalWallClockTime: 22s102ms - TotalThreadsSysTime: 2s253ms - TotalThreadsUserTime: 7s911ms - TotalThreadsVoluntaryContextSwitches: 21.48K (21478) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 60.188ms - ExecTreePrepareTime: 582.211us DataStreamSender (dst_id=28):(Total: 917.471us, non-child: 917.471us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.05 MB (1105280) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 646.691ms, non-child: 646.691ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 221.844ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 122 (122) - NumInstructions: 8.95K (8951) - OptimizationTime: 397.348ms - PeakMemoryUsage: 4.37 MB (4582912) - PrepareTime: 27.076ms HASH_JOIN_NODE (id=15):(Total: 1.107ms, non-child: 869.328us, % non-child: 78.50%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 451.92K (451915) - BuildTime: 385.299ms - PeakMemoryUsage: 153.09 MB (160524544) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=15): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 334.253ms - BuildRowsPartitioned: 451.92K (451915) - GetNewBlockTime: 944.213us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 47.879ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160449664) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=26):(Total: 1s783ms, non-child: 69.051ms, % non-child: 3.87%) BytesReceived(16s000ms): 5.51 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB - BytesReceived: 6.21 MB (6513198) - ConvertRowBatchTime: 12.328ms - DeserializeRowBatchTimer: 92.545ms - FirstBatchArrivalWaitTime: 1s169ms - PeakMemoryUsage: 0 - RowsReturned: 451.92K (451915) - RowsReturnedRate: 253.39 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=14):(Total: 857.603us, non-child: 847.517us, % non-child: 98.82%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 459.33K (459329) - BuildTime: 144.166ms - PeakMemoryUsage: 25.08 MB (26298624) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 83.034ms - BuildRowsPartitioned: 459.33K (459329) - GetNewBlockTime: 178.768us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 21.615ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 25.02 MB (26231936) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 4s145ms, non-child: 15.143ms, % non-child: 0.37%) BytesReceived(16s000ms): 6.01 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB - BytesReceived: 7.34 MB (7694057) - ConvertRowBatchTime: 11.049ms - DeserializeRowBatchTimer: 15.548ms - FirstBatchArrivalWaitTime: 2s077ms - PeakMemoryUsage: 0 - RowsReturned: 459.33K (459329) - RowsReturnedRate: 110.81 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=13):(Total: 622.508us, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 3.99B (3986288393) - BuildTime: 5m52s - PeakMemoryUsage: 157.66 GB (169284438272) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled, Spilled Runtime filters: 0 of 1 Runtime Filter Published, 1 Disabled - BuildRowsPartitionTime: 5m51s - BuildRowsPartitioned: 3.99B (3986288393) - GetNewBlockTime: 32s946ms - HashBuckets: 536.87M (536870912) - HashCollisions: 0 (0) - HashTablesBuildTime: 57s912ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 157.66 GB (169284379776) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 4 (4) - UnpinTime: 196.771ms HASH_JOIN_NODE (id=12):(Total: 3m30s, non-child: 1m16s, % non-child: 36.15%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 40.18M (40180995) - BuildTime: 8s388ms - PeakMemoryUsage: 3.02 GB (3240188858) - ProbeRows: 75.59M (75588074) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1m7s - RowsReturned: 3.99B (3986288393) - RowsReturnedRate: 18.92 M/sec Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 5s572ms - BuildRowsPartitioned: 40.18M (40180995) - GetNewBlockTime: 3.266ms - HashBuckets: 67.11M (67108864) - HashCollisions: 0 (0) - HashTablesBuildTime: 2s771ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 3.02 GB (3240125568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 7s158ms, non-child: 1s518ms, % non-child: 21.22%) BytesReceived(16s000ms): 218.34 MB, 380.53 MB, 380.53 MB, 380.53 MB, 380.53 MB, 380.53 MB, 380.53 MB, 380.53 MB, 380.53 MB, 380.53 MB, 380.53 MB, 380.53 MB, 380.53 MB, 380.53 MB, 380.53 MB, 380.53 MB, 380.53 MB, 380.53 MB, 380.53 MB, 380.53 MB, 380.53 MB, 380.53 MB, 380.53 MB, 380.53 MB, 380.53 MB, 380.53 MB, 380.53 MB, 380.53 MB, 380.53 MB, 380.53 MB, 380.53 MB, 380.53 MB, 380.53 MB, 380.53 MB, 380.53 MB, 380.53 MB, 380.53 MB, 380.53 MB, 380.53 MB, 380.53 MB - BytesReceived: 380.53 MB (399012508) - ConvertRowBatchTime: 936.754ms - DeserializeRowBatchTimer: 1s490ms - FirstBatchArrivalWaitTime: 1s088ms - PeakMemoryUsage: 0 - RowsReturned: 40.18M (40180995) - RowsReturnedRate: 5.61 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=22):(Total: 2m8s, non-child: 1s446ms, % non-child: 1.13%) BytesReceived(16s000ms): 2.21 MB, 16.14 MB, 42.89 MB, 68.77 MB, 95.40 MB, 121.94 MB, 148.92 MB, 176.00 MB, 201.64 MB, 227.02 MB, 251.96 MB, 277.72 MB, 304.45 MB, 330.63 MB, 354.87 MB, 381.75 MB, 407.26 MB, 434.46 MB, 457.57 MB, 482.71 MB, 506.14 MB, 523.13 MB, 541.77 MB, 564.20 MB, 582.31 MB, 594.83 MB, 614.27 MB, 630.41 MB, 644.63 MB, 649.10 MB, 657.68 MB, 670.60 MB, 677.06 MB, 687.26 MB, 695.73 MB, 699.51 MB, 699.51 MB, 699.51 MB, 699.51 MB, 699.51 MB - BytesReceived: 699.51 MB (733490241) - ConvertRowBatchTime: 897.572ms - DeserializeRowBatchTimer: 5s187ms - FirstBatchArrivalWaitTime: 762.270ms - PeakMemoryUsage: 0 - RowsReturned: 75.59M (75588074) - RowsReturnedRate: 589.90 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=24):(Total: 1s697ms, non-child: 19.484us, % non-child: 0.00%) BytesReceived(16s000ms): 8.87 MB, 10.49 MB, 10.49 MB, 10.49 MB, 10.49 MB, 10.49 MB, 10.49 MB, 10.49 MB, 10.49 MB, 10.49 MB, 10.49 MB, 10.49 MB, 10.49 MB, 10.49 MB, 10.49 MB, 10.49 MB, 10.49 MB, 10.49 MB, 10.49 MB, 10.49 MB, 10.49 MB, 10.49 MB, 10.49 MB, 10.49 MB, 10.49 MB, 10.49 MB, 10.49 MB, 10.49 MB, 10.49 MB, 10.49 MB, 10.49 MB, 10.49 MB, 10.49 MB, 10.49 MB, 10.49 MB, 10.49 MB, 10.49 MB, 10.49 MB, 10.49 MB, 10.50 MB - BytesReceived: 10.98 MB (11508806) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 67.780ms - FirstBatchArrivalWaitTime: 1s697ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:2f1 (host=vc1507.foo:22000):(Total: 60.141ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 1.00 GB, 7.16 GB, 14.02 GB, 20.56 GB, 27.32 GB, 34.10 GB, 40.95 GB, 47.79 GB, 54.40 GB, 60.90 GB, 67.16 GB, 73.60 GB, 80.22 GB, 86.44 GB, 92.81 GB, 99.77 GB, 106.14 GB, 112.89 GB, 118.92 GB, 124.98 GB, 131.11 GB, 135.47 GB, 140.10 GB, 145.77 GB, 150.45 GB, 153.77 GB, 157.84 GB, 152.09 GB, 155.46 GB, 156.20 GB, 158.52 GB, 153.34 GB, 150.98 GB, 153.30 GB, 155.10 GB, 151.52 GB, 153.17 GB, 153.41 GB, 154.93 GB, 156.13 GB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.03 - BloomFilterBytes: 49.00 MB (51380224) - PeakMemoryUsage: 160.99 GB (172864789743) - PerHostPeakMemUsage: 169.57 GB (182076389417) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 2m12s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 1.33K (1328) - TotalThreadsTotalWallClockTime: 21s470ms - TotalThreadsSysTime: 2s045ms - TotalThreadsUserTime: 7s644ms - TotalThreadsVoluntaryContextSwitches: 24.60K (24601) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 60.090ms - ExecTreePrepareTime: 592.053us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 24.18K (24179) - BlocksRecycled: 354 (354) - BufferedPins: 0 (0) - BytesWritten: 50.77 GB (54509174784) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 161.38 GB (173283483648) - ScratchFileUsedBytes: 50.77 GB (54509174784) - TotalBufferWaitTime: 7s182ms - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=28):(Total: 802.647us, non-child: 802.647us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.05 MB (1105280) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 621.145ms, non-child: 621.145ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 196.375ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 122 (122) - NumInstructions: 8.95K (8951) - OptimizationTime: 397.152ms - PeakMemoryUsage: 4.37 MB (4582912) - PrepareTime: 27.077ms HASH_JOIN_NODE (id=15):(Total: 1.111ms, non-child: 906.161us, % non-child: 81.50%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 451.92K (451915) - BuildTime: 139.184ms - PeakMemoryUsage: 153.09 MB (160524544) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=15): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 103.330ms - BuildRowsPartitioned: 451.92K (451915) - GetNewBlockTime: 395.938us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 32.811ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160449664) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=26):(Total: 2s078ms, non-child: 26.691ms, % non-child: 1.28%) BytesReceived(16s000ms): 5.38 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB - BytesReceived: 6.21 MB (6513198) - ConvertRowBatchTime: 11.868ms - DeserializeRowBatchTimer: 54.537ms - FirstBatchArrivalWaitTime: 1s218ms - PeakMemoryUsage: 0 - RowsReturned: 451.92K (451915) - RowsReturnedRate: 217.38 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=14):(Total: 866.735us, non-child: 809.741us, % non-child: 93.42%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 459.45K (459448) - BuildTime: 148.917ms - PeakMemoryUsage: 25.08 MB (26298624) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 91.577ms - BuildRowsPartitioned: 459.45K (459448) - GetNewBlockTime: 179.941us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 21.926ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 25.02 MB (26231936) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 4s114ms, non-child: 15.057ms, % non-child: 0.37%) BytesReceived(16s000ms): 5.83 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB - BytesReceived: 7.34 MB (7695380) - ConvertRowBatchTime: 11.478ms - DeserializeRowBatchTimer: 16.184ms - FirstBatchArrivalWaitTime: 2s123ms - PeakMemoryUsage: 0 - RowsReturned: 459.45K (459448) - RowsReturnedRate: 111.67 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=13):(Total: 629.162us, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 3.96B (3961368570) - BuildTime: 6m1s - PeakMemoryUsage: 159.57 GB (171339647232) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled, Spilled Runtime filters: 0 of 1 Runtime Filter Published, 1 Disabled - BuildRowsPartitionTime: 6m1s - BuildRowsPartitioned: 3.96B (3961368570) - GetNewBlockTime: 49s783ms - HashBuckets: 1.07B (1073741824) - HashCollisions: 0 (0) - HashTablesBuildTime: 1m13s - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 159.57 GB (171339588736) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 5 (5) - UnpinTime: 304.815ms HASH_JOIN_NODE (id=12):(Total: 3m20s, non-child: 1m14s, % non-child: 37.32%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 40.23M (40229494) - BuildTime: 7s883ms - PeakMemoryUsage: 3.02 GB (3240189092) - ProbeRows: 74.22M (74222497) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1m6s - RowsReturned: 3.96B (3961368570) - RowsReturnedRate: 19.77 M/sec Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 5s348ms - BuildRowsPartitioned: 40.23M (40229494) - GetNewBlockTime: 3.334ms - HashBuckets: 67.11M (67108864) - HashCollisions: 0 (0) - HashTablesBuildTime: 2s490ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 3.02 GB (3240125568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 7s023ms, non-child: 1s591ms, % non-child: 22.66%) BytesReceived(16s000ms): 210.87 MB, 380.99 MB, 380.99 MB, 380.99 MB, 380.99 MB, 380.99 MB, 380.99 MB, 380.99 MB, 380.99 MB, 380.99 MB, 380.99 MB, 380.99 MB, 380.99 MB, 380.99 MB, 380.99 MB, 380.99 MB, 380.99 MB, 380.99 MB, 380.99 MB, 380.99 MB, 380.99 MB, 380.99 MB, 380.99 MB, 380.99 MB, 380.99 MB, 380.99 MB, 380.99 MB, 380.99 MB, 380.99 MB, 380.99 MB, 380.99 MB, 380.99 MB, 380.99 MB, 380.99 MB, 380.99 MB, 380.99 MB, 380.99 MB, 380.99 MB, 380.99 MB, 380.99 MB - BytesReceived: 380.99 MB (399494782) - ConvertRowBatchTime: 928.167ms - DeserializeRowBatchTimer: 1s656ms - FirstBatchArrivalWaitTime: 1s142ms - PeakMemoryUsage: 0 - RowsReturned: 40.23M (40229494) - RowsReturnedRate: 5.73 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=22):(Total: 1m59s, non-child: 1s214ms, % non-child: 1.02%) BytesReceived(16s000ms): 2.10 MB, 15.14 MB, 41.37 MB, 66.77 MB, 93.00 MB, 119.34 MB, 145.99 MB, 172.76 MB, 198.67 MB, 223.64 MB, 247.86 MB, 272.97 MB, 299.08 MB, 324.69 MB, 348.38 MB, 375.06 MB, 400.06 MB, 426.86 MB, 449.40 MB, 474.21 MB, 497.04 MB, 513.77 MB, 532.31 MB, 554.32 MB, 572.28 MB, 584.62 MB, 603.97 MB, 619.97 MB, 633.59 MB, 638.03 MB, 646.57 MB, 659.26 MB, 664.73 MB, 673.19 MB, 681.91 MB, 687.26 MB, 687.27 MB, 687.27 MB, 687.27 MB, 687.27 MB - BytesReceived: 687.27 MB (720653867) - ConvertRowBatchTime: 777.927ms - DeserializeRowBatchTimer: 5s518ms - FirstBatchArrivalWaitTime: 802.069ms - PeakMemoryUsage: 0 - RowsReturned: 74.22M (74222497) - RowsReturnedRate: 621.86 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=24):(Total: 1s734ms, non-child: 3.203us, % non-child: 0.00%) BytesReceived(16s000ms): 8.26 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB - BytesReceived: 10.01 MB (10491544) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 66.729ms - FirstBatchArrivalWaitTime: 1s734ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:2fb (host=vd1138.foo:22000):(Total: 59.992ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 972.31 MB, 7.01 GB, 13.83 GB, 20.27 GB, 26.93 GB, 33.60 GB, 40.34 GB, 47.06 GB, 53.64 GB, 60.09 GB, 66.24 GB, 72.63 GB, 79.33 GB, 85.73 GB, 91.68 GB, 98.42 GB, 104.76 GB, 111.58 GB, 117.41 GB, 123.65 GB, 129.52 GB, 133.67 GB, 138.28 GB, 143.88 GB, 148.45 GB, 151.68 GB, 156.47 GB, 156.47 GB, 152.98 GB, 154.05 GB, 156.06 GB, 159.02 GB, 160.03 GB, 152.17 GB, 152.59 GB, 156.23 GB, 153.63 GB, 153.47 GB, 144.33 GB, 151.76 GB ThreadUsage(16s000ms): 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.03 - BloomFilterBytes: 49.00 MB (51380224) - PeakMemoryUsage: 160.99 GB (172862181743) - PerHostPeakMemUsage: 169.55 GB (182058147394) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 2m45s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 1.51K (1509) - TotalThreadsTotalWallClockTime: 21s876ms - TotalThreadsSysTime: 2s096ms - TotalThreadsUserTime: 8s174ms - TotalThreadsVoluntaryContextSwitches: 23.48K (23479) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 59.938ms - ExecTreePrepareTime: 627.179us BlockMgr: - BlockWritesOutstanding: 1 (1) - BlocksCreated: 23.28K (23279) - BlocksRecycled: 604 (604) - BufferedPins: 0 (0) - BytesWritten: 35.73 GB (38369492992) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 161.38 GB (173283483648) - ScratchFileUsedBytes: 35.73 GB (38369492992) - TotalBufferWaitTime: 15s323ms - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=28):(Total: 825.256us, non-child: 825.256us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.05 MB (1105280) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 617.612ms, non-child: 617.612ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 195.682ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 122 (122) - NumInstructions: 8.95K (8951) - OptimizationTime: 396.410ms - PeakMemoryUsage: 4.37 MB (4582912) - PrepareTime: 24.949ms HASH_JOIN_NODE (id=15):(Total: 1.182ms, non-child: 1.003ms, % non-child: 84.82%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 451.92K (451915) - BuildTime: 141.812ms - PeakMemoryUsage: 153.09 MB (160524544) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=15): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 104.048ms - BuildRowsPartitioned: 451.92K (451915) - GetNewBlockTime: 479.011us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 35.040ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160449664) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=26):(Total: 2s083ms, non-child: 27.409ms, % non-child: 1.32%) BytesReceived(16s000ms): 5.35 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB - BytesReceived: 6.21 MB (6513198) - ConvertRowBatchTime: 12.653ms - DeserializeRowBatchTimer: 55.261ms - FirstBatchArrivalWaitTime: 1s216ms - PeakMemoryUsage: 0 - RowsReturned: 451.92K (451915) - RowsReturnedRate: 216.95 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=14):(Total: 920.440us, non-child: 985.799us, % non-child: 100.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 459.20K (459199) - BuildTime: 171.371ms - PeakMemoryUsage: 25.08 MB (26298624) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 113.952ms - BuildRowsPartitioned: 459.20K (459199) - GetNewBlockTime: 255.845us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 23.123ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 25.02 MB (26231936) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 4s095ms, non-child: 16.057ms, % non-child: 0.39%) BytesReceived(16s000ms): 5.81 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB - BytesReceived: 7.33 MB (7691244) - ConvertRowBatchTime: 11.444ms - DeserializeRowBatchTimer: 17.692ms - FirstBatchArrivalWaitTime: 2s127ms - PeakMemoryUsage: 0 - RowsReturned: 459.20K (459199) - RowsReturnedRate: 112.12 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=13):(Total: 576.032us, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 3.90B (3904703986) - BuildTime: 5m36s - PeakMemoryUsage: 160.55 GB (172387633408) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled, Spilled Runtime filters: 0 of 1 Runtime Filter Published, 1 Disabled - BuildRowsPartitionTime: 5m35s - BuildRowsPartitioned: 3.90B (3904703986) - GetNewBlockTime: 26s498ms - HashBuckets: 536.87M (536870912) - HashCollisions: 0 (0) - HashTablesBuildTime: 44s032ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 160.55 GB (172387574912) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 4 (4) - UnpinTime: 293.021ms HASH_JOIN_NODE (id=12):(Total: 3m47s, non-child: 1m8s, % non-child: 30.29%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 40.15M (40148341) - BuildTime: 8s385ms - PeakMemoryUsage: 3.02 GB (3240188862) - ProbeRows: 73.94M (73939130) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 59s642ms - RowsReturned: 3.90B (3904703986) - RowsReturnedRate: 17.20 M/sec Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 5s462ms - BuildRowsPartitioned: 40.15M (40148341) - GetNewBlockTime: 3.569ms - HashBuckets: 67.11M (67108864) - HashCollisions: 0 (0) - HashTablesBuildTime: 2s874ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 3.02 GB (3240125568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 6s911ms, non-child: 1s730ms, % non-child: 25.03%) BytesReceived(16s000ms): 207.77 MB, 380.24 MB, 380.24 MB, 380.24 MB, 380.24 MB, 380.24 MB, 380.24 MB, 380.24 MB, 380.24 MB, 380.24 MB, 380.24 MB, 380.24 MB, 380.24 MB, 380.24 MB, 380.24 MB, 380.24 MB, 380.24 MB, 380.24 MB, 380.24 MB, 380.24 MB, 380.24 MB, 380.24 MB, 380.24 MB, 380.24 MB, 380.24 MB, 380.24 MB, 380.24 MB, 380.24 MB, 380.24 MB, 380.24 MB, 380.24 MB, 380.24 MB, 380.24 MB, 380.24 MB, 380.24 MB, 380.24 MB, 380.24 MB, 380.24 MB, 380.24 MB, 380.24 MB - BytesReceived: 380.24 MB (398713172) - ConvertRowBatchTime: 1s002ms - DeserializeRowBatchTimer: 1s761ms - FirstBatchArrivalWaitTime: 1s144ms - PeakMemoryUsage: 0 - RowsReturned: 40.15M (40148341) - RowsReturnedRate: 5.81 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=22):(Total: 2m32s, non-child: 1s214ms, % non-child: 0.80%) BytesReceived(16s000ms): 2.03 MB, 14.88 MB, 41.05 MB, 66.30 MB, 92.44 MB, 118.64 MB, 145.08 MB, 171.69 MB, 198.06 MB, 222.90 MB, 247.34 MB, 272.47 MB, 298.49 MB, 323.98 MB, 347.41 MB, 373.94 MB, 398.98 MB, 425.62 MB, 448.10 MB, 472.77 MB, 495.25 MB, 512.06 MB, 530.49 MB, 552.47 MB, 570.33 MB, 582.55 MB, 601.93 MB, 617.80 MB, 631.38 MB, 635.77 MB, 644.22 MB, 656.99 MB, 662.28 MB, 670.81 MB, 679.33 MB, 684.59 MB, 684.59 MB, 684.59 MB, 684.59 MB, 684.59 MB - BytesReceived: 684.59 MB (717845649) - ConvertRowBatchTime: 782.814ms - DeserializeRowBatchTimer: 6s061ms - FirstBatchArrivalWaitTime: 803.319ms - PeakMemoryUsage: 0 - RowsReturned: 73.94M (73939130) - RowsReturnedRate: 485.89 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=24):(Total: 1s750ms, non-child: 2.872us, % non-child: 0.00%) BytesReceived(16s000ms): 8.73 MB, 10.68 MB, 10.68 MB, 10.68 MB, 10.68 MB, 10.68 MB, 10.68 MB, 10.68 MB, 10.68 MB, 10.68 MB, 10.68 MB, 10.68 MB, 10.68 MB, 10.68 MB, 10.68 MB, 10.68 MB, 10.68 MB, 10.68 MB, 10.68 MB, 10.68 MB, 10.68 MB, 10.68 MB, 10.68 MB, 10.68 MB, 10.68 MB, 10.68 MB, 10.68 MB, 10.68 MB, 10.68 MB, 10.68 MB, 10.68 MB, 10.68 MB, 10.68 MB, 10.68 MB, 10.68 MB, 10.68 MB, 10.68 MB, 10.69 MB, 10.72 MB, 10.72 MB - BytesReceived: 10.92 MB (11453537) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 76.942ms - FirstBatchArrivalWaitTime: 1s750ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:305 (host=vd1112.foo:22000):(Total: 59.614ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 985.58 MB, 6.98 GB, 13.78 GB, 20.13 GB, 26.70 GB, 33.32 GB, 39.98 GB, 46.56 GB, 52.72 GB, 58.92 GB, 65.05 GB, 71.33 GB, 77.97 GB, 84.33 GB, 90.34 GB, 96.84 GB, 103.66 GB, 110.36 GB, 116.33 GB, 122.43 GB, 128.22 GB, 132.40 GB, 137.05 GB, 142.56 GB, 147.05 GB, 150.20 GB, 154.96 GB, 158.93 GB, 151.60 GB, 152.72 GB, 154.67 GB, 157.70 GB, 158.86 GB, 154.89 GB, 151.57 GB, 154.62 GB, 158.29 GB, 154.27 GB, 153.51 GB, 158.41 GB ThreadUsage(16s000ms): 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.03 - BloomFilterBytes: 49.00 MB (51380224) - PeakMemoryUsage: 161.00 GB (172868147135) - PerHostPeakMemUsage: 169.55 GB (182055132687) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 2m20s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 1.49K (1488) - TotalThreadsTotalWallClockTime: 21s998ms - TotalThreadsSysTime: 2s282ms - TotalThreadsUserTime: 8s339ms - TotalThreadsVoluntaryContextSwitches: 22.32K (22316) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 59.513ms - ExecTreePrepareTime: 805.442us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 23.00K (23004) - BlocksRecycled: 839 (839) - BufferedPins: 0 (0) - BytesWritten: 33.58 GB (36054237184) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 161.38 GB (173283483648) - ScratchFileUsedBytes: 33.58 GB (36054237184) - TotalBufferWaitTime: 5s208ms - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=28):(Total: 1.132ms, non-child: 1.132ms, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.05 MB (1105280) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 640.134ms, non-child: 640.134ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 201.537ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 122 (122) - NumInstructions: 8.95K (8951) - OptimizationTime: 412.210ms - PeakMemoryUsage: 4.37 MB (4582912) - PrepareTime: 25.824ms HASH_JOIN_NODE (id=15):(Total: 1.500ms, non-child: 1.089ms, % non-child: 72.57%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 451.92K (451915) - BuildTime: 133.061ms - PeakMemoryUsage: 153.09 MB (160524544) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=15): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 100.433ms - BuildRowsPartitioned: 451.92K (451915) - GetNewBlockTime: 710.741us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 29.931ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160449664) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=26):(Total: 2s054ms, non-child: 26.757ms, % non-child: 1.30%) BytesReceived(16s000ms): 5.40 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB - BytesReceived: 6.21 MB (6513198) - ConvertRowBatchTime: 12.289ms - DeserializeRowBatchTimer: 52.719ms - FirstBatchArrivalWaitTime: 1s192ms - PeakMemoryUsage: 0 - RowsReturned: 451.92K (451915) - RowsReturnedRate: 219.99 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=14):(Total: 1.148ms, non-child: 949.863us, % non-child: 82.74%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 459.59K (459591) - BuildTime: 148.996ms - PeakMemoryUsage: 25.08 MB (26298624) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 88.694ms - BuildRowsPartitioned: 459.59K (459591) - GetNewBlockTime: 225.621us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 22.027ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 25.02 MB (26231936) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 4s100ms, non-child: 16.130ms, % non-child: 0.39%) BytesReceived(16s000ms): 5.84 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB - BytesReceived: 7.34 MB (7697703) - ConvertRowBatchTime: 11.751ms - DeserializeRowBatchTimer: 16.959ms - FirstBatchArrivalWaitTime: 2s102ms - PeakMemoryUsage: 0 - RowsReturned: 459.59K (459591) - RowsReturnedRate: 112.07 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=13):(Total: 787.571us, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 3.86B (3859722366) - BuildTime: 5m53s - PeakMemoryUsage: 160.55 GB (172388223232) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled, Spilled Runtime filters: 0 of 1 Runtime Filter Published, 1 Disabled - BuildRowsPartitionTime: 5m52s - BuildRowsPartitioned: 3.86B (3859722366) - GetNewBlockTime: 27s346ms - HashBuckets: 536.87M (536870912) - HashCollisions: 0 (0) - HashTablesBuildTime: 1m14s - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 160.55 GB (172388164736) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 4 (4) - UnpinTime: 95.345ms HASH_JOIN_NODE (id=12):(Total: 3m29s, non-child: 1m16s, % non-child: 36.30%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 40.15M (40149357) - BuildTime: 8s847ms - PeakMemoryUsage: 3.02 GB (3240188344) - ProbeRows: 73.22M (73222500) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1m6s - RowsReturned: 3.86B (3859722366) - RowsReturnedRate: 18.39 M/sec Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 5s732ms - BuildRowsPartitioned: 40.15M (40149357) - GetNewBlockTime: 3.030ms - HashBuckets: 67.11M (67108864) - HashCollisions: 0 (0) - HashTablesBuildTime: 3s066ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 3.02 GB (3240125568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 6s622ms, non-child: 1s635ms, % non-child: 24.70%) BytesReceived(16s000ms): 213.05 MB, 380.25 MB, 380.25 MB, 380.25 MB, 380.25 MB, 380.25 MB, 380.25 MB, 380.25 MB, 380.25 MB, 380.25 MB, 380.25 MB, 380.25 MB, 380.25 MB, 380.25 MB, 380.25 MB, 380.25 MB, 380.25 MB, 380.25 MB, 380.25 MB, 380.25 MB, 380.25 MB, 380.25 MB, 380.25 MB, 380.25 MB, 380.25 MB, 380.25 MB, 380.25 MB, 380.25 MB, 380.25 MB, 380.25 MB, 380.25 MB, 380.25 MB, 380.25 MB, 380.25 MB, 380.25 MB, 380.25 MB, 380.25 MB, 380.25 MB, 380.25 MB, 380.25 MB - BytesReceived: 380.25 MB (398725294) - ConvertRowBatchTime: 937.173ms - DeserializeRowBatchTimer: 1s721ms - FirstBatchArrivalWaitTime: 1s117ms - PeakMemoryUsage: 0 - RowsReturned: 40.15M (40149357) - RowsReturnedRate: 6.06 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=22):(Total: 2m7s, non-child: 2s471ms, % non-child: 1.93%) BytesReceived(16s000ms): 2.09 MB, 15.16 MB, 40.98 MB, 65.89 MB, 91.68 MB, 117.63 MB, 143.79 MB, 169.86 MB, 194.28 MB, 218.89 MB, 243.02 MB, 267.94 MB, 293.84 MB, 319.31 MB, 342.90 MB, 370.45 MB, 396.63 MB, 422.98 MB, 445.04 MB, 470.02 MB, 491.37 MB, 508.28 MB, 526.58 MB, 548.27 MB, 565.49 MB, 577.65 MB, 597.13 MB, 612.56 MB, 625.22 MB, 629.75 MB, 638.47 MB, 651.08 MB, 656.06 MB, 664.99 MB, 673.34 MB, 677.95 MB, 677.96 MB, 677.96 MB, 677.96 MB, 677.96 MB - BytesReceived: 677.96 MB (710888169) - ConvertRowBatchTime: 837.298ms - DeserializeRowBatchTimer: 5s800ms - FirstBatchArrivalWaitTime: 788.909ms - PeakMemoryUsage: 0 - RowsReturned: 73.22M (73222500) - RowsReturnedRate: 572.72 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=24):(Total: 1s719ms, non-child: 4.042us, % non-child: 0.00%) BytesReceived(16s000ms): 8.45 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.10 MB, 10.14 MB, 10.14 MB - BytesReceived: 10.14 MB (10637268) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 74.059ms - FirstBatchArrivalWaitTime: 1s719ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:32a (host=vc1532.foo:22000):(Total: 59.500ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 1.00 GB, 6.91 GB, 14.01 GB, 20.69 GB, 27.44 GB, 34.17 GB, 40.89 GB, 47.45 GB, 54.04 GB, 60.58 GB, 66.83 GB, 73.26 GB, 80.13 GB, 86.41 GB, 92.66 GB, 99.42 GB, 105.91 GB, 112.54 GB, 118.79 GB, 124.85 GB, 131.17 GB, 135.46 GB, 140.13 GB, 145.79 GB, 150.48 GB, 154.22 GB, 157.07 GB, 152.51 GB, 155.61 GB, 155.99 GB, 158.63 GB, 152.48 GB, 151.42 GB, 154.03 GB, 155.62 GB, 153.06 GB, 152.87 GB, 154.25 GB, 153.45 GB, 152.70 GB ThreadUsage(16s000ms): 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.03 - BloomFilterBytes: 49.00 MB (51380224) - PeakMemoryUsage: 160.99 GB (172865122031) - PerHostPeakMemUsage: 169.55 GB (182053739234) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 1m37s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 1.39K (1388) - TotalThreadsTotalWallClockTime: 21s913ms - TotalThreadsSysTime: 2s161ms - TotalThreadsUserTime: 7s959ms - TotalThreadsVoluntaryContextSwitches: 23.96K (23963) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 59.435ms - ExecTreePrepareTime: 865.606us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 23.70K (23699) - BlocksRecycled: 354 (354) - BufferedPins: 0 (0) - BytesWritten: 39.01 GB (41884319744) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 161.38 GB (173283483648) - ScratchFileUsedBytes: 39.01 GB (41884319744) - TotalBufferWaitTime: 2s568ms - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=28):(Total: 1.045ms, non-child: 1.045ms, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.05 MB (1105280) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 626.314ms, non-child: 626.314ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 203.639ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 122 (122) - NumInstructions: 8.95K (8951) - OptimizationTime: 396.457ms - PeakMemoryUsage: 4.37 MB (4582912) - PrepareTime: 25.654ms HASH_JOIN_NODE (id=15):(Total: 1.630ms, non-child: 997.935us, % non-child: 61.22%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 451.92K (451915) - BuildTime: 137.003ms - PeakMemoryUsage: 153.09 MB (160524544) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=15): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 105.769ms - BuildRowsPartitioned: 451.92K (451915) - GetNewBlockTime: 504.245us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 28.333ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160449664) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=26):(Total: 2s048ms, non-child: 28.029ms, % non-child: 1.37%) BytesReceived(16s000ms): 5.43 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB - BytesReceived: 6.21 MB (6513198) - ConvertRowBatchTime: 14.326ms - DeserializeRowBatchTimer: 53.510ms - FirstBatchArrivalWaitTime: 1s196ms - PeakMemoryUsage: 0 - RowsReturned: 451.92K (451915) - RowsReturnedRate: 220.64 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=14):(Total: 1.272ms, non-child: 961.166us, % non-child: 75.55%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 458.16K (458157) - BuildTime: 161.930ms - PeakMemoryUsage: 25.08 MB (26298624) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 97.980ms - BuildRowsPartitioned: 458.16K (458157) - GetNewBlockTime: 196.856us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 24.017ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 25.02 MB (26231936) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 4s124ms, non-child: 15.874ms, % non-child: 0.38%) BytesReceived(16s000ms): 5.91 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB - BytesReceived: 7.32 MB (7674769) - ConvertRowBatchTime: 11.886ms - DeserializeRowBatchTimer: 18.864ms - FirstBatchArrivalWaitTime: 2s109ms - PeakMemoryUsage: 0 - RowsReturned: 458.16K (458157) - RowsReturnedRate: 111.08 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=13):(Total: 873.289us, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 3.97B (3965144141) - BuildTime: 6m42s - PeakMemoryUsage: 157.70 GB (169333590240) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled, Spilled Runtime filters: 0 of 1 Runtime Filter Published, 1 Disabled - BuildRowsPartitionTime: 6m42s - BuildRowsPartitioned: 3.97B (3965144141) - GetNewBlockTime: 54s774ms - HashBuckets: 536.87M (536870912) - HashCollisions: 0 (0) - HashTablesBuildTime: 52s154ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 157.70 GB (169333499008) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 4 (4) - UnpinTime: 263.198ms HASH_JOIN_NODE (id=12):(Total: 2m47s, non-child: 1m16s, % non-child: 45.85%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 40.08M (40083375) - BuildTime: 8s298ms - PeakMemoryUsage: 3.02 GB (3240192360) - ProbeRows: 74.76M (74764999) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1m7s - RowsReturned: 3.97B (3965144141) - RowsReturnedRate: 23.65 M/sec Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 5s358ms - BuildRowsPartitioned: 40.08M (40083375) - GetNewBlockTime: 2.859ms - HashBuckets: 67.11M (67108864) - HashCollisions: 0 (0) - HashTablesBuildTime: 2s888ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 3.02 GB (3240125568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 7s056ms, non-child: 1s623ms, % non-child: 23.00%) BytesReceived(16s000ms): 214.75 MB, 379.59 MB, 379.59 MB, 379.59 MB, 379.59 MB, 379.59 MB, 379.59 MB, 379.59 MB, 379.59 MB, 379.59 MB, 379.59 MB, 379.59 MB, 379.59 MB, 379.59 MB, 379.59 MB, 379.59 MB, 379.59 MB, 379.59 MB, 379.59 MB, 379.59 MB, 379.59 MB, 379.59 MB, 379.59 MB, 379.59 MB, 379.59 MB, 379.59 MB, 379.59 MB, 379.59 MB, 379.59 MB, 379.59 MB, 379.59 MB, 379.59 MB, 379.59 MB, 379.59 MB, 379.59 MB, 379.59 MB, 379.59 MB, 379.59 MB, 379.59 MB, 379.59 MB - BytesReceived: 379.59 MB (398032611) - ConvertRowBatchTime: 978.696ms - DeserializeRowBatchTimer: 1s644ms - FirstBatchArrivalWaitTime: 1s116ms - PeakMemoryUsage: 0 - RowsReturned: 40.08M (40083375) - RowsReturnedRate: 5.68 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=22):(Total: 1m24s, non-child: 1s432ms, % non-child: 1.69%) BytesReceived(16s000ms): 2.13 MB, 15.58 MB, 41.98 MB, 67.50 MB, 93.87 MB, 120.20 MB, 146.91 MB, 173.77 MB, 198.98 MB, 224.08 MB, 248.73 MB, 274.14 MB, 300.65 MB, 326.48 MB, 350.52 MB, 377.00 MB, 402.17 MB, 429.06 MB, 452.16 MB, 477.11 MB, 500.34 MB, 517.08 MB, 535.67 MB, 557.88 MB, 576.00 MB, 590.53 MB, 611.22 MB, 627.05 MB, 639.15 MB, 643.85 MB, 653.01 MB, 665.67 MB, 670.46 MB, 679.89 MB, 688.24 MB, 692.41 MB, 692.41 MB, 692.41 MB, 692.41 MB, 692.41 MB - BytesReceived: 692.41 MB (726042974) - ConvertRowBatchTime: 831.482ms - DeserializeRowBatchTimer: 7s969ms - FirstBatchArrivalWaitTime: 787.698ms - PeakMemoryUsage: 0 - RowsReturned: 74.76M (74764999) - RowsReturnedRate: 884.60 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=24):(Total: 1s717ms, non-child: 3.566us, % non-child: 0.00%) BytesReceived(16s000ms): 8.52 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.12 MB, 10.16 MB, 10.17 MB - BytesReceived: 10.20 MB (10694420) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 70.852ms - FirstBatchArrivalWaitTime: 1s717ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:327 (host=vd1107.foo:22000):(Total: 59.384ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 1.03 GB, 7.12 GB, 14.43 GB, 21.29 GB, 28.24 GB, 35.21 GB, 42.19 GB, 49.15 GB, 55.95 GB, 62.60 GB, 69.08 GB, 75.76 GB, 82.76 GB, 89.41 GB, 95.70 GB, 102.50 GB, 109.31 GB, 116.14 GB, 122.48 GB, 128.92 GB, 135.33 GB, 139.56 GB, 144.56 GB, 150.34 GB, 155.21 GB, 156.89 GB, 152.95 GB, 156.79 GB, 157.98 GB, 154.58 GB, 151.80 GB, 153.38 GB, 155.89 GB, 157.58 GB, 157.16 GB, 152.85 GB, 157.02 GB, 157.15 GB, 156.25 GB, 157.58 GB ThreadUsage(16s000ms): 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.03 - BloomFilterBytes: 49.00 MB (51380224) - PeakMemoryUsage: 160.61 GB (172451471341) - PerHostPeakMemUsage: 169.55 GB (182055448413) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 1m26s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 1.46K (1456) - TotalThreadsTotalWallClockTime: 21s354ms - TotalThreadsSysTime: 2s135ms - TotalThreadsUserTime: 7s997ms - TotalThreadsVoluntaryContextSwitches: 23.96K (23961) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 59.336ms - ExecTreePrepareTime: 632.220us DataStreamSender (dst_id=28):(Total: 945.024us, non-child: 945.024us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.05 MB (1105280) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 818.193ms, non-child: 818.193ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 199.634ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 122 (122) - NumInstructions: 8.95K (8951) - OptimizationTime: 593.181ms - PeakMemoryUsage: 4.37 MB (4582912) - PrepareTime: 24.912ms HASH_JOIN_NODE (id=15):(Total: 1.205ms, non-child: 971.926us, % non-child: 80.61%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 451.92K (451915) - BuildTime: 128.583ms - PeakMemoryUsage: 153.09 MB (160524544) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=15): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 98.884ms - BuildRowsPartitioned: 451.92K (451915) - GetNewBlockTime: 501.861us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 27.255ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160449664) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=26):(Total: 1s862ms, non-child: 24.167ms, % non-child: 1.30%) BytesReceived(16s000ms): 5.51 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB - BytesReceived: 6.21 MB (6513198) - ConvertRowBatchTime: 12.092ms - DeserializeRowBatchTimer: 47.796ms - FirstBatchArrivalWaitTime: 1s005ms - PeakMemoryUsage: 0 - RowsReturned: 451.92K (451915) - RowsReturnedRate: 242.59 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=14):(Total: 918.500us, non-child: 789.694us, % non-child: 85.98%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 459.17K (459169) - BuildTime: 167.599ms - PeakMemoryUsage: 25.08 MB (26298624) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 94.359ms - BuildRowsPartitioned: 459.17K (459169) - GetNewBlockTime: 252.467us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 32.315ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 25.02 MB (26231936) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 3s930ms, non-child: 14.846ms, % non-child: 0.38%) BytesReceived(16s000ms): 6.01 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB - BytesReceived: 7.33 MB (7690851) - ConvertRowBatchTime: 10.760ms - DeserializeRowBatchTimer: 16.600ms - FirstBatchArrivalWaitTime: 1s922ms - PeakMemoryUsage: 0 - RowsReturned: 459.17K (459169) - RowsReturnedRate: 116.81 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=13):(Total: 693.713us, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 4.09B (4090624909) - BuildTime: 6m48s - PeakMemoryUsage: 159.25 GB (170995124480) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled, Spilled Runtime filters: 0 of 1 Runtime Filter Published, 1 Disabled - BuildRowsPartitionTime: 6m48s - BuildRowsPartitioned: 4.09B (4090624909) - GetNewBlockTime: 46s211ms - HashBuckets: 536.87M (536870912) - HashCollisions: 0 (0) - HashTablesBuildTime: 54s599ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 159.25 GB (170995065984) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 4 (4) - UnpinTime: 321.448ms HASH_JOIN_NODE (id=12):(Total: 2m33s, non-child: 1m13s, % non-child: 47.52%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 40.15M (40152455) - BuildTime: 8s330ms - PeakMemoryUsage: 3.02 GB (3240188784) - ProbeRows: 77.65M (77650020) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1m3s - RowsReturned: 4.09B (4090624909) - RowsReturnedRate: 26.60 M/sec Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 5s359ms - BuildRowsPartitioned: 40.15M (40152455) - GetNewBlockTime: 3.970ms - HashBuckets: 67.11M (67108864) - HashCollisions: 0 (0) - HashTablesBuildTime: 2s922ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 3.02 GB (3240125568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 6s851ms, non-child: 1s594ms, % non-child: 23.27%) BytesReceived(16s000ms): 218.41 MB, 380.27 MB, 380.27 MB, 380.27 MB, 380.27 MB, 380.27 MB, 380.27 MB, 380.27 MB, 380.27 MB, 380.27 MB, 380.27 MB, 380.27 MB, 380.27 MB, 380.27 MB, 380.27 MB, 380.27 MB, 380.27 MB, 380.27 MB, 380.27 MB, 380.27 MB, 380.27 MB, 380.27 MB, 380.27 MB, 380.27 MB, 380.27 MB, 380.27 MB, 380.27 MB, 380.27 MB, 380.27 MB, 380.27 MB, 380.27 MB, 380.27 MB, 380.27 MB, 380.27 MB, 380.27 MB, 380.27 MB, 380.27 MB, 380.27 MB, 380.27 MB, 380.27 MB - BytesReceived: 380.27 MB (398742323) - ConvertRowBatchTime: 963.778ms - DeserializeRowBatchTimer: 1s592ms - FirstBatchArrivalWaitTime: 926.879ms - PeakMemoryUsage: 0 - RowsReturned: 40.15M (40152455) - RowsReturnedRate: 5.86 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=22):(Total: 1m14s, non-child: 1s336ms, % non-child: 1.80%) BytesReceived(16s000ms): 2.23 MB, 16.51 MB, 44.00 MB, 70.63 MB, 98.08 MB, 125.52 MB, 153.30 MB, 181.24 MB, 207.60 MB, 233.73 MB, 259.45 MB, 285.96 MB, 313.32 MB, 339.99 MB, 364.70 MB, 392.32 MB, 418.57 MB, 446.57 MB, 470.39 MB, 496.23 MB, 520.22 MB, 537.59 MB, 556.86 MB, 579.85 MB, 598.44 MB, 613.91 MB, 635.16 MB, 651.46 MB, 663.83 MB, 668.87 MB, 678.39 MB, 691.41 MB, 696.34 MB, 706.31 MB, 715.00 MB, 719.10 MB, 719.10 MB, 719.10 MB, 719.10 MB, 719.10 MB - BytesReceived: 719.10 MB (754035779) - ConvertRowBatchTime: 871.320ms - DeserializeRowBatchTimer: 8s273ms - FirstBatchArrivalWaitTime: 591.157ms - PeakMemoryUsage: 0 - RowsReturned: 77.65M (77650020) - RowsReturnedRate: 1.04 M/sec - SendersBlockedTimer: 9s535ms - SendersBlockedTotalTimer(*): 15m8s EXCHANGE_NODE (id=24):(Total: 1s536ms, non-child: 6.752us, % non-child: 0.00%) BytesReceived(16s000ms): 8.56 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.15 MB, 10.19 MB, 10.20 MB - BytesReceived: 10.24 MB (10737100) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 78.215ms - FirstBatchArrivalWaitTime: 1s536ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:332 (host=vd1139.foo:22000):(Total: 59.095ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 1.05 GB, 7.35 GB, 14.19 GB, 20.76 GB, 27.52 GB, 34.29 GB, 41.18 GB, 48.10 GB, 54.56 GB, 61.02 GB, 67.60 GB, 74.13 GB, 80.87 GB, 87.42 GB, 93.44 GB, 100.37 GB, 106.81 GB, 113.76 GB, 119.66 GB, 126.11 GB, 131.94 GB, 136.17 GB, 140.90 GB, 146.50 GB, 151.10 GB, 154.29 GB, 156.56 GB, 152.55 GB, 155.88 GB, 156.71 GB, 159.10 GB, 151.62 GB, 151.95 GB, 154.14 GB, 155.73 GB, 153.07 GB, 153.02 GB, 153.82 GB, 153.99 GB, 157.87 GB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.03 - BloomFilterBytes: 49.00 MB (51380224) - PeakMemoryUsage: 160.60 GB (172445031519) - PerHostPeakMemUsage: 169.56 GB (182064187763) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 2m42s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 1.61K (1607) - TotalThreadsTotalWallClockTime: 21s647ms - TotalThreadsSysTime: 2s210ms - TotalThreadsUserTime: 7s970ms - TotalThreadsVoluntaryContextSwitches: 21.37K (21369) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 59.015ms - ExecTreePrepareTime: 636.093us DataStreamSender (dst_id=28):(Total: 998.874us, non-child: 998.874us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.05 MB (1105280) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 654.466ms, non-child: 654.466ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 211.696ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 122 (122) - NumInstructions: 8.95K (8951) - OptimizationTime: 418.617ms - PeakMemoryUsage: 4.37 MB (4582912) - PrepareTime: 23.716ms HASH_JOIN_NODE (id=15):(Total: 1.194ms, non-child: 782.147us, % non-child: 65.50%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 451.92K (451915) - BuildTime: 136.728ms - PeakMemoryUsage: 153.09 MB (160524544) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=15): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 99.444ms - BuildRowsPartitioned: 451.92K (451915) - GetNewBlockTime: 369.965us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 33.936ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160449664) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=26):(Total: 2s023ms, non-child: 25.150ms, % non-child: 1.24%) BytesReceived(16s000ms): 5.50 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB - BytesReceived: 6.21 MB (6513198) - ConvertRowBatchTime: 12.600ms - DeserializeRowBatchTimer: 52.987ms - FirstBatchArrivalWaitTime: 1s165ms - PeakMemoryUsage: 0 - RowsReturned: 451.92K (451915) - RowsReturnedRate: 223.33 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=14):(Total: 947.632us, non-child: 929.514us, % non-child: 98.09%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 459.83K (459834) - BuildTime: 146.745ms - PeakMemoryUsage: 25.08 MB (26298624) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 91.508ms - BuildRowsPartitioned: 459.83K (459834) - GetNewBlockTime: 186.448us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 20.988ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 25.02 MB (26231936) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 4s108ms, non-child: 16.346ms, % non-child: 0.40%) BytesReceived(16s000ms): 6.01 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB - BytesReceived: 7.35 MB (7702307) - ConvertRowBatchTime: 12.123ms - DeserializeRowBatchTimer: 15.761ms - FirstBatchArrivalWaitTime: 2s082ms - PeakMemoryUsage: 0 - RowsReturned: 459.83K (459834) - RowsReturnedRate: 111.93 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=13):(Total: 678.627us, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 3.97B (3973341169) - BuildTime: 5m37s - PeakMemoryUsage: 159.31 GB (171062823168) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled, Spilled Runtime filters: 0 of 1 Runtime Filter Published, 1 Disabled - BuildRowsPartitionTime: 5m36s - BuildRowsPartitioned: 3.97B (3973341169) - GetNewBlockTime: 38s415ms - HashBuckets: 536.87M (536870912) - HashCollisions: 0 (0) - HashTablesBuildTime: 16s803ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 159.31 GB (171062764672) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 4 (4) - UnpinTime: 317.267ms HASH_JOIN_NODE (id=12):(Total: 3m47s, non-child: 1m11s, % non-child: 31.47%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 40.21M (40213044) - BuildTime: 8s392ms - PeakMemoryUsage: 3.02 GB (3240191624) - ProbeRows: 75.10M (75095773) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1m2s - RowsReturned: 3.97B (3973341169) - RowsReturnedRate: 17.44 M/sec Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 5s654ms - BuildRowsPartitioned: 40.21M (40213044) - GetNewBlockTime: 3.939ms - HashBuckets: 67.11M (67108864) - HashCollisions: 0 (0) - HashTablesBuildTime: 2s687ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 3.02 GB (3240125568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 6s740ms, non-child: 1s550ms, % non-child: 23.00%) BytesReceived(16s000ms): 218.25 MB, 380.83 MB, 380.83 MB, 380.83 MB, 380.83 MB, 380.83 MB, 380.83 MB, 380.83 MB, 380.83 MB, 380.83 MB, 380.83 MB, 380.83 MB, 380.83 MB, 380.83 MB, 380.83 MB, 380.83 MB, 380.83 MB, 380.83 MB, 380.83 MB, 380.83 MB, 380.83 MB, 380.83 MB, 380.83 MB, 380.83 MB, 380.83 MB, 380.83 MB, 380.83 MB, 380.83 MB, 380.83 MB, 380.83 MB, 380.83 MB, 380.83 MB, 380.83 MB, 380.83 MB, 380.83 MB, 380.83 MB, 380.83 MB, 380.83 MB, 380.83 MB, 380.83 MB - BytesReceived: 380.83 MB (399325341) - ConvertRowBatchTime: 958.530ms - DeserializeRowBatchTimer: 1s519ms - FirstBatchArrivalWaitTime: 1s095ms - PeakMemoryUsage: 0 - RowsReturned: 40.21M (40213044) - RowsReturnedRate: 5.97 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=22):(Total: 2m30s, non-child: 1s671ms, % non-child: 1.11%) BytesReceived(16s000ms): 2.16 MB, 15.87 MB, 42.38 MB, 68.11 MB, 94.63 MB, 121.13 MB, 148.13 MB, 175.23 MB, 200.85 MB, 226.33 MB, 252.05 MB, 277.46 MB, 303.92 MB, 329.88 MB, 353.75 MB, 380.76 MB, 406.26 MB, 433.39 MB, 456.09 MB, 481.43 MB, 503.91 MB, 520.85 MB, 539.59 MB, 561.56 MB, 579.42 MB, 591.75 MB, 611.56 MB, 627.51 MB, 641.00 MB, 645.56 MB, 654.32 MB, 667.37 MB, 672.63 MB, 681.52 MB, 690.21 MB, 695.30 MB, 695.31 MB, 695.31 MB, 695.31 MB, 695.31 MB - BytesReceived: 695.31 MB (729080162) - ConvertRowBatchTime: 809.361ms - DeserializeRowBatchTimer: 6s472ms - FirstBatchArrivalWaitTime: 753.654ms - PeakMemoryUsage: 0 - RowsReturned: 75.10M (75095773) - RowsReturnedRate: 500.14 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=24):(Total: 1s695ms, non-child: 3.679us, % non-child: 0.00%) BytesReceived(16s000ms): 8.87 MB, 10.50 MB, 10.50 MB, 10.50 MB, 10.50 MB, 10.50 MB, 10.50 MB, 10.50 MB, 10.50 MB, 10.50 MB, 10.50 MB, 10.50 MB, 10.50 MB, 10.50 MB, 10.50 MB, 10.50 MB, 10.50 MB, 10.50 MB, 10.50 MB, 10.50 MB, 10.50 MB, 10.50 MB, 10.50 MB, 10.50 MB, 10.50 MB, 10.50 MB, 10.50 MB, 10.50 MB, 10.50 MB, 10.50 MB, 10.50 MB, 10.50 MB, 10.50 MB, 10.50 MB, 10.50 MB, 10.50 MB, 10.50 MB, 10.51 MB, 10.55 MB, 10.55 MB - BytesReceived: 10.91 MB (11437038) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 74.109ms - FirstBatchArrivalWaitTime: 1s695ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:2fd (host=va1044.foo:22000):(Total: 59.042ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 1.00 GB, 7.17 GB, 14.22 GB, 20.88 GB, 27.77 GB, 34.68 GB, 41.64 GB, 48.58 GB, 55.03 GB, 61.57 GB, 67.95 GB, 74.39 GB, 81.10 GB, 88.04 GB, 94.54 GB, 101.35 GB, 107.99 GB, 114.48 GB, 120.90 GB, 127.10 GB, 133.26 GB, 137.69 GB, 142.40 GB, 148.13 GB, 152.81 GB, 156.12 GB, 154.02 GB, 154.40 GB, 157.68 GB, 158.23 GB, 155.26 GB, 152.16 GB, 153.74 GB, 155.51 GB, 157.32 GB, 153.02 GB, 152.67 GB, 155.83 GB, 156.75 GB, 154.82 GB ThreadUsage(16s000ms): 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.03 - BloomFilterBytes: 49.00 MB (51380224) - PeakMemoryUsage: 160.59 GB (172436797855) - PerHostPeakMemUsage: 169.57 GB (182072811520) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 1m48s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 1.69K (1690) - TotalThreadsTotalWallClockTime: 21s693ms - TotalThreadsSysTime: 2s189ms - TotalThreadsUserTime: 7s995ms - TotalThreadsVoluntaryContextSwitches: 21.87K (21869) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 58.964ms - ExecTreePrepareTime: 550.725us DataStreamSender (dst_id=28):(Total: 1.022ms, non-child: 1.022ms, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.05 MB (1105280) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 641.032ms, non-child: 641.032ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 196.103ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 122 (122) - NumInstructions: 8.95K (8951) - OptimizationTime: 419.466ms - PeakMemoryUsage: 4.37 MB (4582912) - PrepareTime: 25.022ms HASH_JOIN_NODE (id=15):(Total: 1.047ms, non-child: 782.028us, % non-child: 74.64%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 451.92K (451915) - BuildTime: 133.453ms - PeakMemoryUsage: 153.09 MB (160524544) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=15): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 89.290ms - BuildRowsPartitioned: 451.92K (451915) - GetNewBlockTime: 197.280us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 41.033ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160449664) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=26):(Total: 2s060ms, non-child: 23.326ms, % non-child: 1.13%) BytesReceived(16s000ms): 5.42 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB - BytesReceived: 6.21 MB (6513198) - ConvertRowBatchTime: 11.318ms - DeserializeRowBatchTimer: 54.257ms - FirstBatchArrivalWaitTime: 1s194ms - PeakMemoryUsage: 0 - RowsReturned: 451.92K (451915) - RowsReturnedRate: 219.30 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=14):(Total: 777.718us, non-child: 856.674us, % non-child: 100.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 458.87K (458871) - BuildTime: 145.552ms - PeakMemoryUsage: 25.08 MB (26298624) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 93.292ms - BuildRowsPartitioned: 458.87K (458871) - GetNewBlockTime: 191.618us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 21.590ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 25.02 MB (26231936) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 4s099ms, non-child: 16.310ms, % non-child: 0.40%) BytesReceived(16s000ms): 5.83 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB - BytesReceived: 7.33 MB (7685701) - ConvertRowBatchTime: 11.918ms - DeserializeRowBatchTimer: 18.601ms - FirstBatchArrivalWaitTime: 2s102ms - PeakMemoryUsage: 0 - RowsReturned: 458.87K (458871) - RowsReturnedRate: 111.93 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=13):(Total: 542.287us, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 4.02B (4018921169) - BuildTime: 6m28s - PeakMemoryUsage: 157.63 GB (169259272448) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled, Spilled Runtime filters: 0 of 1 Runtime Filter Published, 1 Disabled - BuildRowsPartitionTime: 6m27s - BuildRowsPartitioned: 4.02B (4018921169) - GetNewBlockTime: 45s183ms - HashBuckets: 536.87M (536870912) - HashCollisions: 0 (0) - HashTablesBuildTime: 1m5s - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 157.63 GB (169259213952) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 4 (4) - UnpinTime: 261.138ms HASH_JOIN_NODE (id=12):(Total: 2m53s, non-child: 1m11s, % non-child: 41.38%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 40.20M (40201736) - BuildTime: 8s404ms - PeakMemoryUsage: 3.02 GB (3240188128) - ProbeRows: 75.79M (75786011) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1m2s - RowsReturned: 4.02B (4018921169) - RowsReturnedRate: 23.18 M/sec Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 5s581ms - BuildRowsPartitioned: 40.20M (40201736) - GetNewBlockTime: 3.225ms - HashBuckets: 67.11M (67108864) - HashCollisions: 0 (0) - HashTablesBuildTime: 2s768ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 3.02 GB (3240125568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 6s745ms, non-child: 1s550ms, % non-child: 22.99%) BytesReceived(16s000ms): 213.69 MB, 380.72 MB, 380.72 MB, 380.72 MB, 380.72 MB, 380.72 MB, 380.72 MB, 380.72 MB, 380.72 MB, 380.72 MB, 380.72 MB, 380.72 MB, 380.72 MB, 380.72 MB, 380.72 MB, 380.72 MB, 380.72 MB, 380.72 MB, 380.72 MB, 380.72 MB, 380.72 MB, 380.72 MB, 380.72 MB, 380.72 MB, 380.72 MB, 380.72 MB, 380.72 MB, 380.72 MB, 380.72 MB, 380.72 MB, 380.72 MB, 380.72 MB, 380.72 MB, 380.72 MB, 380.72 MB, 380.72 MB, 380.72 MB, 380.72 MB, 380.72 MB, 380.72 MB - BytesReceived: 380.72 MB (399214006) - ConvertRowBatchTime: 946.143ms - DeserializeRowBatchTimer: 1s513ms - FirstBatchArrivalWaitTime: 1s113ms - PeakMemoryUsage: 0 - RowsReturned: 40.20M (40201736) - RowsReturnedRate: 5.96 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=22):(Total: 1m35s, non-child: 1s569ms, % non-child: 1.64%) BytesReceived(16s000ms): 2.14 MB, 15.64 MB, 42.36 MB, 68.38 MB, 95.37 MB, 122.39 MB, 149.66 MB, 176.93 MB, 202.59 MB, 228.17 MB, 253.08 MB, 278.77 MB, 306.79 MB, 333.35 MB, 357.50 MB, 384.74 MB, 410.31 MB, 437.47 MB, 460.34 MB, 485.85 MB, 508.36 MB, 525.67 MB, 544.52 MB, 566.85 MB, 584.79 MB, 597.30 MB, 617.42 MB, 633.62 MB, 647.19 MB, 651.73 MB, 660.59 MB, 673.67 MB, 678.94 MB, 687.92 MB, 696.57 MB, 701.70 MB, 701.70 MB, 701.70 MB, 701.70 MB, 701.70 MB - BytesReceived: 701.70 MB (735784645) - ConvertRowBatchTime: 848.978ms - DeserializeRowBatchTimer: 5s506ms - FirstBatchArrivalWaitTime: 781.076ms - PeakMemoryUsage: 0 - RowsReturned: 75.79M (75786011) - RowsReturnedRate: 792.14 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=24):(Total: 1s729ms, non-child: 4.216us, % non-child: 0.00%) BytesReceived(16s000ms): 8.72 MB, 10.37 MB, 10.37 MB, 10.37 MB, 10.37 MB, 10.37 MB, 10.37 MB, 10.37 MB, 10.37 MB, 10.37 MB, 10.37 MB, 10.37 MB, 10.37 MB, 10.37 MB, 10.37 MB, 10.37 MB, 10.37 MB, 10.37 MB, 10.37 MB, 10.37 MB, 10.37 MB, 10.37 MB, 10.37 MB, 10.37 MB, 10.37 MB, 10.37 MB, 10.37 MB, 10.37 MB, 10.37 MB, 10.37 MB, 10.37 MB, 10.37 MB, 10.37 MB, 10.37 MB, 10.37 MB, 10.37 MB, 10.37 MB, 10.37 MB, 10.37 MB, 10.38 MB - BytesReceived: 10.71 MB (11235254) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 73.181ms - FirstBatchArrivalWaitTime: 1s729ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:317 (host=vc1511.foo:22000):(Total: 58.795ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 994.97 MB, 7.27 GB, 14.31 GB, 21.05 GB, 28.02 GB, 34.97 GB, 42.02 GB, 49.06 GB, 55.64 GB, 62.28 GB, 68.78 GB, 75.41 GB, 82.47 GB, 89.00 GB, 95.59 GB, 102.49 GB, 109.17 GB, 115.91 GB, 122.51 GB, 128.83 GB, 135.32 GB, 139.79 GB, 144.61 GB, 150.47 GB, 155.38 GB, 158.46 GB, 152.65 GB, 156.82 GB, 159.73 GB, 150.79 GB, 152.08 GB, 154.86 GB, 156.35 GB, 157.51 GB, 156.86 GB, 152.51 GB, 155.96 GB, 156.27 GB, 148.60 GB, 148.68 GB ThreadUsage(16s000ms): 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.03 - BloomFilterBytes: 49.00 MB (51380224) - PeakMemoryUsage: 160.62 GB (172462702791) - PerHostPeakMemUsage: 169.54 GB (182042906319) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 2m18s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 1.30K (1303) - TotalThreadsTotalWallClockTime: 21s490ms - TotalThreadsSysTime: 2s131ms - TotalThreadsUserTime: 7s716ms - TotalThreadsVoluntaryContextSwitches: 23.82K (23825) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 58.757ms - ExecTreePrepareTime: 695.612us DataStreamSender (dst_id=28):(Total: 875.048us, non-child: 875.048us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.05 MB (1105280) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 628.348ms, non-child: 628.348ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 202.837ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 122 (122) - NumInstructions: 8.95K (8951) - OptimizationTime: 400.055ms - PeakMemoryUsage: 4.37 MB (4582912) - PrepareTime: 25.067ms HASH_JOIN_NODE (id=15):(Total: 1.341ms, non-child: 823.186us, % non-child: 61.36%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 451.92K (451915) - BuildTime: 118.700ms - PeakMemoryUsage: 153.09 MB (160524544) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=15): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 88.166ms - BuildRowsPartitioned: 451.92K (451915) - GetNewBlockTime: 376.359us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 27.789ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160449664) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=26):(Total: 2s071ms, non-child: 23.072ms, % non-child: 1.11%) BytesReceived(16s000ms): 5.36 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB - BytesReceived: 6.21 MB (6513198) - ConvertRowBatchTime: 11.736ms - DeserializeRowBatchTimer: 48.079ms - FirstBatchArrivalWaitTime: 1s203ms - PeakMemoryUsage: 0 - RowsReturned: 451.92K (451915) - RowsReturnedRate: 218.19 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=14):(Total: 1.065ms, non-child: 940.970us, % non-child: 88.31%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 459.14K (459140) - BuildTime: 154.772ms - PeakMemoryUsage: 25.08 MB (26298624) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 91.566ms - BuildRowsPartitioned: 459.14K (459140) - GetNewBlockTime: 205.887us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 24.891ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 25.02 MB (26231936) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 4s123ms, non-child: 15.640ms, % non-child: 0.38%) BytesReceived(16s000ms): 5.81 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB - BytesReceived: 7.33 MB (7690140) - ConvertRowBatchTime: 11.548ms - DeserializeRowBatchTimer: 15.842ms - FirstBatchArrivalWaitTime: 2s107ms - PeakMemoryUsage: 0 - RowsReturned: 459.14K (459140) - RowsReturnedRate: 111.36 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=13):(Total: 749.568us, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 4.10B (4100765184) - BuildTime: 5m51s - PeakMemoryUsage: 160.16 GB (171968792832) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled, Spilled Runtime filters: 0 of 1 Runtime Filter Published, 1 Disabled - BuildRowsPartitionTime: 5m50s - BuildRowsPartitioned: 4.10B (4100765184) - GetNewBlockTime: 28s459ms - HashBuckets: 1.07B (1073741824) - HashCollisions: 0 (0) - HashTablesBuildTime: 1m17s - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 160.16 GB (171968734336) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 5 (5) - UnpinTime: 145.725ms HASH_JOIN_NODE (id=12):(Total: 3m31s, non-child: 1m19s, % non-child: 37.81%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 40.17M (40168268) - BuildTime: 8s019ms - PeakMemoryUsage: 3.02 GB (3240188128) - ProbeRows: 76.88M (76884374) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1m11s - RowsReturned: 4.10B (4100765184) - RowsReturnedRate: 19.41 M/sec Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 5s476ms - BuildRowsPartitioned: 40.17M (40168268) - GetNewBlockTime: 3.359ms - HashBuckets: 67.11M (67108864) - HashCollisions: 0 (0) - HashTablesBuildTime: 2s500ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 3.02 GB (3240125568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 6s924ms, non-child: 1s696ms, % non-child: 24.50%) BytesReceived(16s000ms): 208.19 MB, 380.43 MB, 380.43 MB, 380.43 MB, 380.43 MB, 380.43 MB, 380.43 MB, 380.43 MB, 380.43 MB, 380.43 MB, 380.43 MB, 380.43 MB, 380.43 MB, 380.43 MB, 380.43 MB, 380.43 MB, 380.43 MB, 380.43 MB, 380.43 MB, 380.43 MB, 380.43 MB, 380.43 MB, 380.43 MB, 380.43 MB, 380.43 MB, 380.43 MB, 380.43 MB, 380.43 MB, 380.43 MB, 380.43 MB, 380.43 MB, 380.43 MB, 380.43 MB, 380.43 MB, 380.43 MB, 380.43 MB, 380.43 MB, 380.43 MB, 380.43 MB, 380.43 MB - BytesReceived: 380.43 MB (398912075) - ConvertRowBatchTime: 976.051ms - DeserializeRowBatchTimer: 1s773ms - FirstBatchArrivalWaitTime: 1s128ms - PeakMemoryUsage: 0 - RowsReturned: 40.17M (40168268) - RowsReturnedRate: 5.80 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=22):(Total: 2m5s, non-child: 1s191ms, % non-child: 0.95%) BytesReceived(16s000ms): 2.13 MB, 15.45 MB, 42.49 MB, 68.60 MB, 95.70 MB, 122.72 MB, 150.13 MB, 177.65 MB, 203.59 MB, 229.44 MB, 254.85 MB, 281.05 MB, 308.25 MB, 334.95 MB, 359.61 MB, 386.91 MB, 412.78 MB, 440.36 MB, 464.13 MB, 489.61 MB, 513.76 MB, 530.94 MB, 550.12 MB, 572.91 MB, 591.63 MB, 604.40 MB, 624.28 MB, 641.18 MB, 655.83 MB, 660.46 MB, 669.14 MB, 682.32 MB, 688.35 MB, 696.82 MB, 706.58 MB, 711.92 MB, 711.92 MB, 711.92 MB, 711.92 MB, 711.92 MB - BytesReceived: 711.92 MB (746498141) - ConvertRowBatchTime: 805.905ms - DeserializeRowBatchTimer: 5s010ms - FirstBatchArrivalWaitTime: 800.765ms - PeakMemoryUsage: 0 - RowsReturned: 76.88M (76884374) - RowsReturnedRate: 613.79 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=24):(Total: 1s714ms, non-child: 3.552us, % non-child: 0.00%) BytesReceived(16s000ms): 8.19 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.02 MB - BytesReceived: 10.02 MB (10503846) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 78.213ms - FirstBatchArrivalWaitTime: 1s714ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:35f (host=ve1129.foo:22000):(Total: 58.783ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 1003.51 MB, 7.13 GB, 14.44 GB, 21.31 GB, 28.25 GB, 35.20 GB, 42.24 GB, 49.28 GB, 55.83 GB, 62.44 GB, 68.82 GB, 75.39 GB, 82.33 GB, 88.95 GB, 95.01 GB, 102.08 GB, 108.69 GB, 115.76 GB, 121.69 GB, 128.13 GB, 134.39 GB, 138.73 GB, 143.50 GB, 149.26 GB, 154.03 GB, 157.40 GB, 153.52 GB, 155.56 GB, 158.08 GB, 155.87 GB, 151.03 GB, 153.04 GB, 155.09 GB, 156.24 GB, 159.00 GB, 153.74 GB, 154.21 GB, 155.49 GB, 153.61 GB, 156.65 GB ThreadUsage(16s000ms): 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.03 - BloomFilterBytes: 49.00 MB (51380224) - PeakMemoryUsage: 160.60 GB (172445562175) - PerHostPeakMemUsage: 169.57 GB (182072457823) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 2m11s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 1.65K (1646) - TotalThreadsTotalWallClockTime: 22s023ms - TotalThreadsSysTime: 2s154ms - TotalThreadsUserTime: 7s890ms - TotalThreadsVoluntaryContextSwitches: 22.27K (22269) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 58.707ms - ExecTreePrepareTime: 565.120us DataStreamSender (dst_id=28):(Total: 1.005ms, non-child: 1.005ms, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.05 MB (1105280) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 678.181ms, non-child: 678.181ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 229.025ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 122 (122) - NumInstructions: 8.95K (8951) - OptimizationTime: 422.862ms - PeakMemoryUsage: 4.37 MB (4582912) - PrepareTime: 25.821ms HASH_JOIN_NODE (id=15):(Total: 1.064ms, non-child: 814.236us, % non-child: 76.51%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 451.92K (451915) - BuildTime: 117.889ms - PeakMemoryUsage: 153.09 MB (160524544) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=15): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 82.622ms - BuildRowsPartitioned: 451.92K (451915) - GetNewBlockTime: 547.113us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 32.977ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160449664) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=26):(Total: 2s004ms, non-child: 23.683ms, % non-child: 1.18%) BytesReceived(16s000ms): 5.49 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB - BytesReceived: 6.21 MB (6513198) - ConvertRowBatchTime: 11.024ms - DeserializeRowBatchTimer: 50.546ms - FirstBatchArrivalWaitTime: 1s132ms - PeakMemoryUsage: 0 - RowsReturned: 451.92K (451915) - RowsReturnedRate: 225.42 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=14):(Total: 802.195us, non-child: 773.559us, % non-child: 96.43%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 458.53K (458533) - BuildTime: 150.391ms - PeakMemoryUsage: 25.08 MB (26298624) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 90.493ms - BuildRowsPartitioned: 458.53K (458533) - GetNewBlockTime: 180.355us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 24.201ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 25.02 MB (26231936) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 4s120ms, non-child: 16.540ms, % non-child: 0.40%) BytesReceived(16s000ms): 5.98 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB - BytesReceived: 7.32 MB (7679866) - ConvertRowBatchTime: 12.590ms - DeserializeRowBatchTimer: 15.682ms - FirstBatchArrivalWaitTime: 2s048ms - PeakMemoryUsage: 0 - RowsReturned: 458.53K (458533) - RowsReturnedRate: 111.27 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=13):(Total: 535.838us, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 4.06B (4057833373) - BuildTime: 5m59s - PeakMemoryUsage: 160.16 GB (171968792832) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled, Spilled Runtime filters: 0 of 1 Runtime Filter Published, 1 Disabled - BuildRowsPartitionTime: 5m58s - BuildRowsPartitioned: 4.06B (4057833373) - GetNewBlockTime: 35s974ms - HashBuckets: 536.87M (536870912) - HashCollisions: 0 (0) - HashTablesBuildTime: 1m26s - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 160.16 GB (171968734336) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 5 (5) - UnpinTime: 107.594ms HASH_JOIN_NODE (id=12):(Total: 3m23s, non-child: 1m18s, % non-child: 38.58%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 40.13M (40134909) - BuildTime: 8s283ms - PeakMemoryUsage: 3.02 GB (3240188982) - ProbeRows: 76.58M (76582404) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1m5s - RowsReturned: 4.06B (4057833373) - RowsReturnedRate: 19.91 M/sec Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 5s497ms - BuildRowsPartitioned: 40.13M (40134909) - GetNewBlockTime: 3.112ms - HashBuckets: 67.11M (67108864) - HashCollisions: 0 (0) - HashTablesBuildTime: 2s738ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 3.02 GB (3240125568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 7s249ms, non-child: 1s518ms, % non-child: 20.94%) BytesReceived(16s000ms): 217.29 MB, 380.09 MB, 380.09 MB, 380.09 MB, 380.09 MB, 380.09 MB, 380.09 MB, 380.09 MB, 380.09 MB, 380.09 MB, 380.09 MB, 380.09 MB, 380.09 MB, 380.09 MB, 380.09 MB, 380.09 MB, 380.09 MB, 380.09 MB, 380.09 MB, 380.09 MB, 380.09 MB, 380.09 MB, 380.09 MB, 380.09 MB, 380.09 MB, 380.09 MB, 380.09 MB, 380.09 MB, 380.09 MB, 380.09 MB, 380.09 MB, 380.09 MB, 380.09 MB, 380.09 MB, 380.09 MB, 380.09 MB, 380.09 MB, 380.09 MB, 380.09 MB, 380.09 MB - BytesReceived: 380.09 MB (398555631) - ConvertRowBatchTime: 975.189ms - DeserializeRowBatchTimer: 1s434ms - FirstBatchArrivalWaitTime: 1s050ms - PeakMemoryUsage: 0 - RowsReturned: 40.13M (40134909) - RowsReturnedRate: 5.54 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=22):(Total: 1m58s, non-child: 1s419ms, % non-child: 1.20%) BytesReceived(16s000ms): 2.21 MB, 16.09 MB, 43.49 MB, 70.10 MB, 97.25 MB, 124.50 MB, 152.09 MB, 179.74 MB, 205.84 MB, 231.54 MB, 256.75 MB, 282.67 MB, 309.50 MB, 335.86 MB, 360.09 MB, 387.37 MB, 413.21 MB, 440.82 MB, 464.16 MB, 489.92 MB, 513.21 MB, 530.48 MB, 549.49 MB, 572.09 MB, 590.55 MB, 603.25 MB, 623.37 MB, 639.88 MB, 655.23 MB, 660.36 MB, 670.11 MB, 682.59 MB, 687.32 MB, 697.54 MB, 705.99 MB, 709.53 MB, 709.53 MB, 709.53 MB, 709.53 MB, 709.53 MB - BytesReceived: 709.53 MB (743998136) - ConvertRowBatchTime: 870.047ms - DeserializeRowBatchTimer: 11s012ms - FirstBatchArrivalWaitTime: 720.793ms - PeakMemoryUsage: 0 - RowsReturned: 76.58M (76582404) - RowsReturnedRate: 645.49 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=24):(Total: 1s647ms, non-child: 3.749us, % non-child: 0.00%) BytesReceived(16s000ms): 8.78 MB, 10.40 MB, 10.40 MB, 10.40 MB, 10.40 MB, 10.40 MB, 10.40 MB, 10.40 MB, 10.40 MB, 10.40 MB, 10.40 MB, 10.40 MB, 10.40 MB, 10.40 MB, 10.40 MB, 10.40 MB, 10.40 MB, 10.40 MB, 10.40 MB, 10.40 MB, 10.40 MB, 10.40 MB, 10.40 MB, 10.40 MB, 10.40 MB, 10.40 MB, 10.40 MB, 10.40 MB, 10.40 MB, 10.40 MB, 10.40 MB, 10.40 MB, 10.40 MB, 10.40 MB, 10.40 MB, 10.40 MB, 10.40 MB, 10.46 MB, 10.53 MB, 10.53 MB - BytesReceived: 10.80 MB (11322195) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 67.642ms - FirstBatchArrivalWaitTime: 1s647ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:32c (host=vd1329.foo:22000):(Total: 58.468ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 960.31 MB, 6.98 GB, 13.80 GB, 20.24 GB, 26.89 GB, 33.56 GB, 40.31 GB, 47.07 GB, 53.40 GB, 59.76 GB, 65.94 GB, 72.58 GB, 79.62 GB, 86.16 GB, 92.11 GB, 98.59 GB, 105.16 GB, 111.90 GB, 117.68 GB, 123.32 GB, 129.59 GB, 134.06 GB, 138.59 GB, 144.25 GB, 148.83 GB, 152.06 GB, 156.88 GB, 155.11 GB, 153.24 GB, 154.17 GB, 156.16 GB, 159.25 GB, 158.40 GB, 151.57 GB, 153.37 GB, 155.74 GB, 150.01 GB, 152.81 GB, 150.47 GB, 152.22 GB ThreadUsage(16s000ms): 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.03 - BloomFilterBytes: 49.00 MB (51380224) - PeakMemoryUsage: 160.61 GB (172450154807) - PerHostPeakMemUsage: 169.58 GB (182081170998) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 2m26s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 1.73K (1731) - TotalThreadsTotalWallClockTime: 21s885ms - TotalThreadsSysTime: 2s305ms - TotalThreadsUserTime: 8s217ms - TotalThreadsVoluntaryContextSwitches: 20.77K (20770) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 58.415ms - ExecTreePrepareTime: 664.675us DataStreamSender (dst_id=28):(Total: 1.008ms, non-child: 1.008ms, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.05 MB (1105280) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 669.204ms, non-child: 669.204ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 221.749ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 122 (122) - NumInstructions: 8.95K (8951) - OptimizationTime: 423.937ms - PeakMemoryUsage: 4.37 MB (4582912) - PrepareTime: 23.033ms HASH_JOIN_NODE (id=15):(Total: 1.270ms, non-child: 894.223us, % non-child: 70.40%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 451.92K (451915) - BuildTime: 137.777ms - PeakMemoryUsage: 153.09 MB (160524544) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=15): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 100.798ms - BuildRowsPartitioned: 451.92K (451915) - GetNewBlockTime: 596.208us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 34.300ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160449664) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=26):(Total: 2s009ms, non-child: 25.367ms, % non-child: 1.26%) BytesReceived(16s000ms): 5.36 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB - BytesReceived: 6.21 MB (6513198) - ConvertRowBatchTime: 12.486ms - DeserializeRowBatchTimer: 50.567ms - FirstBatchArrivalWaitTime: 1s152ms - PeakMemoryUsage: 0 - RowsReturned: 451.92K (451915) - RowsReturnedRate: 224.93 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=14):(Total: 1.025ms, non-child: 855.016us, % non-child: 83.36%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 458.84K (458843) - BuildTime: 166.818ms - PeakMemoryUsage: 25.08 MB (26298624) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 102.913ms - BuildRowsPartitioned: 458.84K (458843) - GetNewBlockTime: 162.120us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 25.060ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 25.02 MB (26231936) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 4s076ms, non-child: 15.621ms, % non-child: 0.38%) BytesReceived(16s000ms): 5.79 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB - BytesReceived: 7.33 MB (7685544) - ConvertRowBatchTime: 11.884ms - DeserializeRowBatchTimer: 15.531ms - FirstBatchArrivalWaitTime: 2s064ms - PeakMemoryUsage: 0 - RowsReturned: 458.84K (458843) - RowsReturnedRate: 112.55 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=13):(Total: 737.847us, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 3.91B (3909297602) - BuildTime: 5m48s - PeakMemoryUsage: 160.16 GB (171968203008) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled, Spilled Runtime filters: 0 of 1 Runtime Filter Published, 1 Disabled - BuildRowsPartitionTime: 5m47s - BuildRowsPartitioned: 3.91B (3909297602) - GetNewBlockTime: 24s168ms - HashBuckets: 536.87M (536870912) - HashCollisions: 0 (0) - HashTablesBuildTime: 57s015ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 160.16 GB (171968144512) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 4 (4) - UnpinTime: 145.505ms HASH_JOIN_NODE (id=12):(Total: 3m34s, non-child: 1m14s, % non-child: 34.72%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 40.11M (40105076) - BuildTime: 8s769ms - PeakMemoryUsage: 3.02 GB (3240189738) - ProbeRows: 74.54M (74539058) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1m4s - RowsReturned: 3.91B (3909297602) - RowsReturnedRate: 18.23 M/sec Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 5s741ms - BuildRowsPartitioned: 40.11M (40105076) - GetNewBlockTime: 3.772ms - HashBuckets: 67.11M (67108864) - HashCollisions: 0 (0) - HashTablesBuildTime: 2s988ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 3.02 GB (3240125568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 6s625ms, non-child: 1s512ms, % non-child: 22.83%) BytesReceived(16s000ms): 207.79 MB, 379.82 MB, 379.82 MB, 379.82 MB, 379.82 MB, 379.82 MB, 379.82 MB, 379.82 MB, 379.82 MB, 379.82 MB, 379.82 MB, 379.82 MB, 379.82 MB, 379.82 MB, 379.82 MB, 379.82 MB, 379.82 MB, 379.82 MB, 379.82 MB, 379.82 MB, 379.82 MB, 379.82 MB, 379.82 MB, 379.82 MB, 379.82 MB, 379.82 MB, 379.82 MB, 379.82 MB, 379.82 MB, 379.82 MB, 379.82 MB, 379.82 MB, 379.82 MB, 379.82 MB, 379.82 MB, 379.82 MB, 379.82 MB, 379.82 MB, 379.82 MB, 379.82 MB - BytesReceived: 379.82 MB (398271921) - ConvertRowBatchTime: 951.901ms - DeserializeRowBatchTimer: 1s483ms - FirstBatchArrivalWaitTime: 1s083ms - PeakMemoryUsage: 0 - RowsReturned: 40.11M (40105076) - RowsReturnedRate: 6.05 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=22):(Total: 2m14s, non-child: 2s321ms, % non-child: 1.73%) BytesReceived(16s000ms): 2.04 MB, 14.94 MB, 41.15 MB, 66.50 MB, 92.84 MB, 119.23 MB, 145.94 MB, 172.72 MB, 198.08 MB, 223.20 MB, 248.29 MB, 275.69 MB, 302.00 MB, 327.88 MB, 351.64 MB, 378.60 MB, 403.66 MB, 430.41 MB, 452.87 MB, 478.24 MB, 500.23 MB, 517.18 MB, 535.88 MB, 557.97 MB, 575.75 MB, 588.06 MB, 607.99 MB, 623.88 MB, 636.88 MB, 641.51 MB, 650.17 MB, 662.96 MB, 668.48 MB, 679.38 MB, 687.46 MB, 690.29 MB, 690.29 MB, 690.29 MB, 690.29 MB, 690.29 MB - BytesReceived: 690.29 MB (723816594) - ConvertRowBatchTime: 879.774ms - DeserializeRowBatchTimer: 6s765ms - FirstBatchArrivalWaitTime: 745.165ms - PeakMemoryUsage: 0 - RowsReturned: 74.54M (74539058) - RowsReturnedRate: 555.84 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=24):(Total: 1s688ms, non-child: 4.332us, % non-child: 0.00%) BytesReceived(16s000ms): 8.36 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.27 MB, 10.34 MB, 10.37 MB - BytesReceived: 10.44 MB (10942313) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 69.890ms - FirstBatchArrivalWaitTime: 1s688ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:340 (host=ve1142.foo:22000):(Total: 58.274ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 957.13 MB, 7.09 GB, 14.27 GB, 21.04 GB, 28.02 GB, 35.00 GB, 42.03 GB, 48.98 GB, 55.54 GB, 62.10 GB, 68.49 GB, 75.05 GB, 81.99 GB, 88.67 GB, 94.91 GB, 101.81 GB, 108.45 GB, 115.48 GB, 121.50 GB, 127.87 GB, 134.34 GB, 138.76 GB, 143.44 GB, 149.29 GB, 154.78 GB, 158.02 GB, 152.29 GB, 155.99 GB, 158.41 GB, 159.78 GB, 152.83 GB, 153.08 GB, 154.77 GB, 157.17 GB, 158.31 GB, 155.80 GB, 157.50 GB, 158.47 GB, 150.97 GB, 150.21 GB ThreadUsage(16s000ms): 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.03 - BloomFilterBytes: 49.00 MB (51380224) - PeakMemoryUsage: 160.62 GB (172461863215) - PerHostPeakMemUsage: 169.58 GB (182081261058) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 1m41s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 1.71K (1714) - TotalThreadsTotalWallClockTime: 21s861ms - TotalThreadsSysTime: 2s294ms - TotalThreadsUserTime: 8s100ms - TotalThreadsVoluntaryContextSwitches: 21.06K (21060) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 58.204ms - ExecTreePrepareTime: 794.594us DataStreamSender (dst_id=28):(Total: 724.726us, non-child: 724.726us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.05 MB (1105280) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 649.557ms, non-child: 649.557ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 210.267ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 122 (122) - NumInstructions: 8.95K (8951) - OptimizationTime: 415.063ms - PeakMemoryUsage: 4.37 MB (4582912) - PrepareTime: 23.704ms HASH_JOIN_NODE (id=15):(Total: 1.518ms, non-child: 955.387us, % non-child: 62.93%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 451.92K (451915) - BuildTime: 135.599ms - PeakMemoryUsage: 153.09 MB (160524544) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=15): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 98.693ms - BuildRowsPartitioned: 451.92K (451915) - GetNewBlockTime: 407.122us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 34.091ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160449664) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=26):(Total: 2s040ms, non-child: 21.807ms, % non-child: 1.07%) BytesReceived(16s000ms): 5.33 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB - BytesReceived: 6.21 MB (6513198) - ConvertRowBatchTime: 11.917ms - DeserializeRowBatchTimer: 44.865ms - FirstBatchArrivalWaitTime: 1s169ms - PeakMemoryUsage: 0 - RowsReturned: 451.92K (451915) - RowsReturnedRate: 221.51 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=14):(Total: 1.171ms, non-child: 1.056ms, % non-child: 90.20%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 461.11K (461109) - BuildTime: 171.797ms - PeakMemoryUsage: 25.08 MB (26298624) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 106.194ms - BuildRowsPartitioned: 461.11K (461109) - GetNewBlockTime: 199.793us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 23.714ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 25.02 MB (26231936) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 4s101ms, non-child: 16.329ms, % non-child: 0.40%) BytesReceived(16s000ms): 5.83 MB, 7.37 MB, 7.37 MB, 7.37 MB, 7.37 MB, 7.37 MB, 7.37 MB, 7.37 MB, 7.37 MB, 7.37 MB, 7.37 MB, 7.37 MB, 7.37 MB, 7.37 MB, 7.37 MB, 7.37 MB, 7.37 MB, 7.37 MB, 7.37 MB, 7.37 MB, 7.37 MB, 7.37 MB, 7.37 MB, 7.37 MB, 7.37 MB, 7.37 MB, 7.37 MB, 7.37 MB, 7.37 MB, 7.37 MB, 7.37 MB, 7.37 MB, 7.37 MB, 7.37 MB, 7.37 MB, 7.37 MB, 7.37 MB, 7.37 MB, 7.37 MB, 7.37 MB - BytesReceived: 7.37 MB (7723070) - ConvertRowBatchTime: 12.176ms - DeserializeRowBatchTimer: 16.092ms - FirstBatchArrivalWaitTime: 2s070ms - PeakMemoryUsage: 0 - RowsReturned: 461.11K (461109) - RowsReturnedRate: 112.43 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=13):(Total: 747.453us, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 4.07B (4067346666) - BuildTime: 6m39s - PeakMemoryUsage: 160.16 GB (171968203008) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled, Spilled Runtime filters: 0 of 1 Runtime Filter Published, 1 Disabled - BuildRowsPartitionTime: 6m39s - BuildRowsPartitioned: 4.07B (4067346666) - GetNewBlockTime: 58s424ms - HashBuckets: 536.87M (536870912) - HashCollisions: 0 (0) - HashTablesBuildTime: 1m4s - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 160.16 GB (171968144512) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 4 (4) - UnpinTime: 386.849ms HASH_JOIN_NODE (id=12):(Total: 2m47s, non-child: 1m12s, % non-child: 43.15%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 40.31M (40311934) - BuildTime: 8s571ms - PeakMemoryUsage: 3.02 GB (3240188128) - ProbeRows: 76.88M (76878944) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1m2s - RowsReturned: 4.07B (4067346666) - RowsReturnedRate: 24.29 M/sec Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 5s704ms - BuildRowsPartitioned: 40.31M (40311934) - GetNewBlockTime: 3.193ms - HashBuckets: 67.11M (67108864) - HashCollisions: 0 (0) - HashTablesBuildTime: 2s817ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 3.02 GB (3240125568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 6s734ms, non-child: 1s557ms, % non-child: 23.13%) BytesReceived(16s000ms): 208.22 MB, 381.77 MB, 381.77 MB, 381.77 MB, 381.77 MB, 381.77 MB, 381.77 MB, 381.77 MB, 381.77 MB, 381.77 MB, 381.77 MB, 381.77 MB, 381.77 MB, 381.77 MB, 381.77 MB, 381.77 MB, 381.77 MB, 381.77 MB, 381.77 MB, 381.77 MB, 381.77 MB, 381.77 MB, 381.77 MB, 381.77 MB, 381.77 MB, 381.77 MB, 381.77 MB, 381.77 MB, 381.77 MB, 381.77 MB, 381.77 MB, 381.77 MB, 381.77 MB, 381.77 MB, 381.77 MB, 381.77 MB, 381.77 MB, 381.77 MB, 381.77 MB, 381.77 MB - BytesReceived: 381.77 MB (400314002) - ConvertRowBatchTime: 964.167ms - DeserializeRowBatchTimer: 1s508ms - FirstBatchArrivalWaitTime: 1s086ms - PeakMemoryUsage: 0 - RowsReturned: 40.31M (40311934) - RowsReturnedRate: 5.99 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=22):(Total: 1m29s, non-child: 1s357ms, % non-child: 1.52%) BytesReceived(16s000ms): 2.13 MB, 15.49 MB, 42.74 MB, 69.15 MB, 96.50 MB, 123.88 MB, 151.41 MB, 178.77 MB, 204.71 MB, 230.46 MB, 255.73 MB, 281.64 MB, 308.59 MB, 335.27 MB, 359.87 MB, 387.09 MB, 413.02 MB, 440.68 MB, 464.24 MB, 489.61 MB, 513.75 MB, 530.95 MB, 549.93 MB, 573.12 MB, 594.02 MB, 606.84 MB, 627.70 MB, 644.09 MB, 656.81 MB, 661.68 MB, 670.91 MB, 683.99 MB, 689.01 MB, 698.53 MB, 707.23 MB, 711.62 MB, 711.62 MB, 711.62 MB, 711.62 MB, 711.62 MB - BytesReceived: 711.62 MB (746192463) - ConvertRowBatchTime: 858.240ms - DeserializeRowBatchTimer: 7s448ms - FirstBatchArrivalWaitTime: 754.023ms - PeakMemoryUsage: 0 - RowsReturned: 76.88M (76878944) - RowsReturnedRate: 861.74 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=24):(Total: 1s690ms, non-child: 2.926us, % non-child: 0.00%) BytesReceived(16s000ms): 8.50 MB, 10.41 MB, 10.41 MB, 10.41 MB, 10.41 MB, 10.41 MB, 10.41 MB, 10.41 MB, 10.41 MB, 10.41 MB, 10.41 MB, 10.41 MB, 10.41 MB, 10.41 MB, 10.41 MB, 10.41 MB, 10.41 MB, 10.41 MB, 10.41 MB, 10.41 MB, 10.41 MB, 10.41 MB, 10.41 MB, 10.41 MB, 10.41 MB, 10.41 MB, 10.41 MB, 10.41 MB, 10.41 MB, 10.41 MB, 10.41 MB, 10.41 MB, 10.41 MB, 10.41 MB, 10.41 MB, 10.41 MB, 10.41 MB, 10.44 MB, 10.57 MB, 10.57 MB - BytesReceived: 10.70 MB (11220904) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 73.347ms - FirstBatchArrivalWaitTime: 1s690ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:32d (host=vc1509.foo:22000):(Total: 58.087ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 1.01 GB, 7.09 GB, 14.11 GB, 20.69 GB, 27.49 GB, 34.29 GB, 41.14 GB, 48.01 GB, 54.42 GB, 60.88 GB, 67.42 GB, 74.05 GB, 80.82 GB, 87.09 GB, 93.45 GB, 100.28 GB, 106.77 GB, 113.36 GB, 119.71 GB, 126.11 GB, 132.12 GB, 136.45 GB, 141.15 GB, 146.79 GB, 151.47 GB, 154.78 GB, 156.08 GB, 152.24 GB, 155.56 GB, 156.42 GB, 158.73 GB, 152.02 GB, 151.41 GB, 153.47 GB, 155.22 GB, 150.08 GB, 150.63 GB, 152.90 GB, 153.67 GB, 155.97 GB ThreadUsage(16s000ms): 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.03 - BloomFilterBytes: 49.00 MB (51380224) - PeakMemoryUsage: 160.61 GB (172449802975) - PerHostPeakMemUsage: 169.56 GB (182064892776) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 2m24s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 1.56K (1562) - TotalThreadsTotalWallClockTime: 21s711ms - TotalThreadsSysTime: 2s134ms - TotalThreadsUserTime: 7s891ms - TotalThreadsVoluntaryContextSwitches: 22.59K (22594) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 58.044ms - ExecTreePrepareTime: 679.365us DataStreamSender (dst_id=28):(Total: 1.072ms, non-child: 1.072ms, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.05 MB (1105280) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 648.305ms, non-child: 648.305ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 209.497ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 122 (122) - NumInstructions: 8.95K (8951) - OptimizationTime: 414.356ms - PeakMemoryUsage: 4.37 MB (4582912) - PrepareTime: 23.933ms HASH_JOIN_NODE (id=15):(Total: 1.286ms, non-child: 941.941us, % non-child: 73.22%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 451.92K (451915) - BuildTime: 123.980ms - PeakMemoryUsage: 153.09 MB (160524544) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=15): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 93.090ms - BuildRowsPartitioned: 451.92K (451915) - GetNewBlockTime: 579.825us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 28.703ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160449664) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=26):(Total: 2s035ms, non-child: 26.900ms, % non-child: 1.32%) BytesReceived(16s000ms): 5.43 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB - BytesReceived: 6.21 MB (6513198) - ConvertRowBatchTime: 11.085ms - DeserializeRowBatchTimer: 53.578ms - FirstBatchArrivalWaitTime: 1s173ms - PeakMemoryUsage: 0 - RowsReturned: 451.92K (451915) - RowsReturnedRate: 222.06 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=14):(Total: 971.839us, non-child: 865.359us, % non-child: 89.04%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 459.44K (459439) - BuildTime: 133.948ms - PeakMemoryUsage: 25.08 MB (26298624) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 82.984ms - BuildRowsPartitioned: 459.44K (459439) - GetNewBlockTime: 166.678us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 21.367ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 25.02 MB (26231936) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 4s122ms, non-child: 15.695ms, % non-child: 0.38%) BytesReceived(16s000ms): 5.91 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB - BytesReceived: 7.34 MB (7695119) - ConvertRowBatchTime: 11.629ms - DeserializeRowBatchTimer: 16.157ms - FirstBatchArrivalWaitTime: 2s083ms - PeakMemoryUsage: 0 - RowsReturned: 459.44K (459439) - RowsReturnedRate: 111.45 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=13):(Total: 707.961us, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 3.98B (3982440901) - BuildTime: 5m53s - PeakMemoryUsage: 158.76 GB (170467232000) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled, Spilled Runtime filters: 0 of 1 Runtime Filter Published, 1 Disabled - BuildRowsPartitionTime: 5m53s - BuildRowsPartitioned: 3.98B (3982440901) - GetNewBlockTime: 29s172ms - HashBuckets: 1.07B (1073741824) - HashCollisions: 0 (0) - HashTablesBuildTime: 1m18s - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 158.76 GB (170467173504) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 5 (5) - UnpinTime: 310.299ms HASH_JOIN_NODE (id=12):(Total: 3m29s, non-child: 1m11s, % non-child: 34.09%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 40.12M (40118132) - BuildTime: 8s275ms - PeakMemoryUsage: 3.02 GB (3240188410) - ProbeRows: 75.52M (75516019) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1m2s - RowsReturned: 3.98B (3982440901) - RowsReturnedRate: 19.02 M/sec Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 5s468ms - BuildRowsPartitioned: 40.12M (40118132) - GetNewBlockTime: 3.423ms - HashBuckets: 67.11M (67108864) - HashCollisions: 0 (0) - HashTablesBuildTime: 2s763ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 3.02 GB (3240125568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 6s927ms, non-child: 1s520ms, % non-child: 21.95%) BytesReceived(16s000ms): 214.48 MB, 379.93 MB, 379.93 MB, 379.93 MB, 379.93 MB, 379.93 MB, 379.93 MB, 379.93 MB, 379.93 MB, 379.93 MB, 379.93 MB, 379.93 MB, 379.93 MB, 379.93 MB, 379.93 MB, 379.93 MB, 379.93 MB, 379.93 MB, 379.93 MB, 379.93 MB, 379.93 MB, 379.93 MB, 379.93 MB, 379.93 MB, 379.93 MB, 379.93 MB, 379.93 MB, 379.93 MB, 379.93 MB, 379.93 MB, 379.93 MB, 379.93 MB, 379.93 MB, 379.93 MB, 379.93 MB, 379.93 MB, 379.93 MB, 379.93 MB, 379.93 MB, 379.93 MB - BytesReceived: 379.93 MB (398383157) - ConvertRowBatchTime: 955.733ms - DeserializeRowBatchTimer: 1s476ms - FirstBatchArrivalWaitTime: 1s091ms - PeakMemoryUsage: 0 - RowsReturned: 40.12M (40118132) - RowsReturnedRate: 5.79 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=22):(Total: 2m11s, non-child: 1s308ms, % non-child: 0.99%) BytesReceived(16s000ms): 2.18 MB, 15.62 MB, 42.24 MB, 68.05 MB, 94.79 MB, 121.53 MB, 148.51 MB, 175.57 MB, 200.99 MB, 226.45 MB, 252.79 MB, 278.30 MB, 304.77 MB, 330.86 MB, 354.96 MB, 382.16 MB, 407.64 MB, 434.86 MB, 457.79 MB, 483.61 MB, 506.21 MB, 523.42 MB, 542.28 MB, 564.49 MB, 582.45 MB, 595.00 MB, 614.97 MB, 631.05 MB, 644.60 MB, 649.13 MB, 657.90 MB, 670.88 MB, 676.12 MB, 685.12 MB, 695.36 MB, 698.82 MB, 698.82 MB, 698.82 MB, 698.82 MB, 698.82 MB - BytesReceived: 698.82 MB (732769151) - ConvertRowBatchTime: 847.753ms - DeserializeRowBatchTimer: 6s940ms - FirstBatchArrivalWaitTime: 763.450ms - PeakMemoryUsage: 0 - RowsReturned: 75.52M (75516019) - RowsReturnedRate: 572.74 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=24):(Total: 1s711ms, non-child: 3.352us, % non-child: 0.00%) BytesReceived(16s000ms): 8.65 MB, 10.25 MB, 10.25 MB, 10.25 MB, 10.25 MB, 10.25 MB, 10.25 MB, 10.25 MB, 10.25 MB, 10.25 MB, 10.25 MB, 10.25 MB, 10.25 MB, 10.25 MB, 10.25 MB, 10.25 MB, 10.25 MB, 10.25 MB, 10.25 MB, 10.25 MB, 10.25 MB, 10.25 MB, 10.25 MB, 10.25 MB, 10.25 MB, 10.25 MB, 10.25 MB, 10.25 MB, 10.25 MB, 10.25 MB, 10.25 MB, 10.25 MB, 10.25 MB, 10.25 MB, 10.25 MB, 10.25 MB, 10.25 MB, 10.25 MB, 10.25 MB, 10.25 MB - BytesReceived: 10.49 MB (10999231) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 73.073ms - FirstBatchArrivalWaitTime: 1s711ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:320 (host=vc1538.foo:22000):(Total: 57.957ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 1022.00 MB, 7.22 GB, 14.20 GB, 20.84 GB, 27.65 GB, 34.67 GB, 41.76 GB, 48.66 GB, 55.13 GB, 61.66 GB, 67.97 GB, 74.53 GB, 81.32 GB, 87.82 GB, 93.99 GB, 100.83 GB, 107.36 GB, 114.33 GB, 120.36 GB, 126.65 GB, 132.77 GB, 136.90 GB, 141.85 GB, 147.60 GB, 152.34 GB, 155.59 GB, 155.90 GB, 153.20 GB, 156.60 GB, 157.72 GB, 155.81 GB, 151.24 GB, 152.13 GB, 154.46 GB, 156.20 GB, 153.24 GB, 154.33 GB, 156.28 GB, 152.77 GB, 154.65 GB ThreadUsage(16s000ms): 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.03 - BloomFilterBytes: 49.00 MB (51380224) - PeakMemoryUsage: 160.60 GB (172447456399) - PerHostPeakMemUsage: 169.56 GB (182066816132) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 2m5s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 1.64K (1636) - TotalThreadsTotalWallClockTime: 21s683ms - TotalThreadsSysTime: 2s051ms - TotalThreadsUserTime: 8s057ms - TotalThreadsVoluntaryContextSwitches: 21.26K (21260) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 57.919ms - ExecTreePrepareTime: 542.257us DataStreamSender (dst_id=28):(Total: 847.076us, non-child: 847.076us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.05 MB (1105280) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 638.010ms, non-child: 638.010ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 203.321ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 122 (122) - NumInstructions: 8.95K (8951) - OptimizationTime: 407.030ms - PeakMemoryUsage: 4.37 MB (4582912) - PrepareTime: 27.192ms HASH_JOIN_NODE (id=15):(Total: 1.022ms, non-child: 771.389us, % non-child: 75.46%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 451.92K (451915) - BuildTime: 120.337ms - PeakMemoryUsage: 153.09 MB (160524544) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=15): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 90.128ms - BuildRowsPartitioned: 451.92K (451915) - GetNewBlockTime: 337.519us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 27.537ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160449664) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=26):(Total: 2s072ms, non-child: 23.482ms, % non-child: 1.13%) BytesReceived(16s000ms): 5.40 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB - BytesReceived: 6.21 MB (6513198) - ConvertRowBatchTime: 12.186ms - DeserializeRowBatchTimer: 48.784ms - FirstBatchArrivalWaitTime: 1s190ms - PeakMemoryUsage: 0 - RowsReturned: 451.92K (451915) - RowsReturnedRate: 218.04 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=14):(Total: 778.420us, non-child: 906.880us, % non-child: 100.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 458.31K (458307) - BuildTime: 138.751ms - PeakMemoryUsage: 25.08 MB (26298624) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 85.543ms - BuildRowsPartitioned: 458.31K (458307) - GetNewBlockTime: 204.741us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 23.383ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 25.02 MB (26231936) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 4s127ms, non-child: 16.320ms, % non-child: 0.40%) BytesReceived(16s000ms): 5.83 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB - BytesReceived: 7.32 MB (7677911) - ConvertRowBatchTime: 11.989ms - DeserializeRowBatchTimer: 15.418ms - FirstBatchArrivalWaitTime: 2s103ms - PeakMemoryUsage: 0 - RowsReturned: 458.31K (458307) - RowsReturnedRate: 111.03 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=13):(Total: 522.303us, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 4.01B (4010709879) - BuildTime: 6m15s - PeakMemoryUsage: 157.31 GB (168914159840) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled, Spilled Runtime filters: 0 of 1 Runtime Filter Published, 1 Disabled - BuildRowsPartitionTime: 6m15s - BuildRowsPartitioned: 4.01B (4010709879) - GetNewBlockTime: 45s720ms - HashBuckets: 536.87M (536870912) - HashCollisions: 0 (0) - HashTablesBuildTime: 41s863ms - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 157.31 GB (168914068608) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 4 (4) - UnpinTime: 316.824ms HASH_JOIN_NODE (id=12):(Total: 3m13s, non-child: 1m14s, % non-child: 38.58%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 40.12M (40124457) - BuildTime: 8s393ms - PeakMemoryUsage: 3.02 GB (3240190082) - ProbeRows: 75.61M (75610469) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1m2s - RowsReturned: 4.01B (4010709879) - RowsReturnedRate: 20.76 M/sec Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 5s642ms - BuildRowsPartitioned: 40.12M (40124457) - GetNewBlockTime: 2.598ms - HashBuckets: 67.11M (67108864) - HashCollisions: 0 (0) - HashTablesBuildTime: 2s708ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 3.02 GB (3240125568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 6s740ms, non-child: 1s461ms, % non-child: 21.68%) BytesReceived(16s000ms): 212.83 MB, 380.00 MB, 380.00 MB, 380.00 MB, 380.00 MB, 380.00 MB, 380.00 MB, 380.00 MB, 380.00 MB, 380.00 MB, 380.00 MB, 380.00 MB, 380.00 MB, 380.00 MB, 380.00 MB, 380.00 MB, 380.00 MB, 380.00 MB, 380.00 MB, 380.00 MB, 380.00 MB, 380.00 MB, 380.00 MB, 380.00 MB, 380.00 MB, 380.00 MB, 380.00 MB, 380.00 MB, 380.00 MB, 380.00 MB, 380.00 MB, 380.00 MB, 380.00 MB, 380.00 MB, 380.00 MB, 380.00 MB, 380.00 MB, 380.00 MB, 380.00 MB, 380.00 MB - BytesReceived: 380.00 MB (398454196) - ConvertRowBatchTime: 959.512ms - DeserializeRowBatchTimer: 1s402ms - FirstBatchArrivalWaitTime: 1s117ms - PeakMemoryUsage: 0 - RowsReturned: 40.12M (40124457) - RowsReturnedRate: 5.95 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=22):(Total: 1m52s, non-child: 1s350ms, % non-child: 1.20%) BytesReceived(16s000ms): 2.15 MB, 15.60 MB, 42.32 MB, 68.22 MB, 94.86 MB, 122.82 MB, 150.10 MB, 177.13 MB, 202.71 MB, 228.16 MB, 253.05 MB, 278.78 MB, 305.31 MB, 331.31 MB, 355.25 MB, 382.36 MB, 407.92 MB, 435.25 MB, 458.15 MB, 483.62 MB, 506.48 MB, 523.57 MB, 542.65 MB, 564.99 MB, 583.36 MB, 595.83 MB, 615.71 MB, 633.62 MB, 646.79 MB, 651.70 MB, 661.15 MB, 673.69 MB, 678.40 MB, 688.31 MB, 696.67 MB, 700.44 MB, 700.44 MB, 700.44 MB, 700.44 MB, 700.44 MB - BytesReceived: 700.44 MB (734465532) - ConvertRowBatchTime: 865.213ms - DeserializeRowBatchTimer: 6s664ms - FirstBatchArrivalWaitTime: 778.419ms - PeakMemoryUsage: 0 - RowsReturned: 75.61M (75610469) - RowsReturnedRate: 671.03 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=24):(Total: 1s721ms, non-child: 3.392us, % non-child: 0.00%) BytesReceived(16s000ms): 8.62 MB, 10.28 MB, 10.28 MB, 10.28 MB, 10.28 MB, 10.28 MB, 10.28 MB, 10.28 MB, 10.28 MB, 10.28 MB, 10.28 MB, 10.28 MB, 10.28 MB, 10.28 MB, 10.28 MB, 10.28 MB, 10.28 MB, 10.28 MB, 10.28 MB, 10.28 MB, 10.28 MB, 10.28 MB, 10.28 MB, 10.28 MB, 10.28 MB, 10.28 MB, 10.28 MB, 10.28 MB, 10.28 MB, 10.28 MB, 10.28 MB, 10.28 MB, 10.28 MB, 10.28 MB, 10.28 MB, 10.28 MB, 10.28 MB, 10.32 MB, 10.39 MB, 10.40 MB - BytesReceived: 10.55 MB (11061797) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 68.397ms - FirstBatchArrivalWaitTime: 1s721ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:336 (host=va1035.foo:22000):(Total: 57.894ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 1006.78 MB, 7.08 GB, 14.04 GB, 20.60 GB, 27.33 GB, 34.03 GB, 41.11 GB, 47.92 GB, 54.31 GB, 60.73 GB, 66.95 GB, 73.41 GB, 80.17 GB, 86.43 GB, 92.74 GB, 99.49 GB, 105.97 GB, 112.56 GB, 118.86 GB, 125.03 GB, 131.14 GB, 135.39 GB, 140.03 GB, 145.66 GB, 150.33 GB, 153.62 GB, 157.33 GB, 151.43 GB, 154.81 GB, 155.63 GB, 157.98 GB, 152.66 GB, 150.55 GB, 152.63 GB, 154.41 GB, 150.33 GB, 150.22 GB, 152.87 GB, 154.37 GB, 154.56 GB ThreadUsage(16s000ms): 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.03 - BloomFilterBytes: 49.00 MB (51380224) - PeakMemoryUsage: 160.60 GB (172443514687) - PerHostPeakMemUsage: 169.56 GB (182068743403) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 2m18s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 1.50K (1501) - TotalThreadsTotalWallClockTime: 21s889ms - TotalThreadsSysTime: 2s173ms - TotalThreadsUserTime: 8s107ms - TotalThreadsVoluntaryContextSwitches: 21.89K (21894) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 57.843ms - ExecTreePrepareTime: 606.724us DataStreamSender (dst_id=28):(Total: 963.107us, non-child: 963.107us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.05 MB (1105280) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 635.251ms, non-child: 635.251ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 206.180ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 122 (122) - NumInstructions: 8.95K (8951) - OptimizationTime: 403.935ms - PeakMemoryUsage: 4.37 MB (4582912) - PrepareTime: 24.742ms HASH_JOIN_NODE (id=15):(Total: 1.167ms, non-child: 712.701us, % non-child: 61.05%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 451.92K (451915) - BuildTime: 107.548ms - PeakMemoryUsage: 153.09 MB (160524544) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=15): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 78.953ms - BuildRowsPartitioned: 451.92K (451915) - GetNewBlockTime: 244.280us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 26.817ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160449664) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=26):(Total: 2s078ms, non-child: 24.049ms, % non-child: 1.16%) BytesReceived(16s000ms): 5.42 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB - BytesReceived: 6.21 MB (6513198) - ConvertRowBatchTime: 10.753ms - DeserializeRowBatchTimer: 49.508ms - FirstBatchArrivalWaitTime: 1s184ms - PeakMemoryUsage: 0 - RowsReturned: 451.92K (451915) - RowsReturnedRate: 217.38 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=14):(Total: 946.263us, non-child: 899.655us, % non-child: 95.07%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 458.85K (458846) - BuildTime: 152.538ms - PeakMemoryUsage: 25.08 MB (26298624) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 96.310ms - BuildRowsPartitioned: 458.85K (458846) - GetNewBlockTime: 128.905us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 23.490ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 25.02 MB (26231936) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 4s128ms, non-child: 15.757ms, % non-child: 0.38%) BytesReceived(16s000ms): 5.83 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB - BytesReceived: 7.33 MB (7685068) - ConvertRowBatchTime: 11.867ms - DeserializeRowBatchTimer: 15.429ms - FirstBatchArrivalWaitTime: 2s091ms - PeakMemoryUsage: 0 - RowsReturned: 458.85K (458846) - RowsReturnedRate: 111.14 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=13):(Total: 622.115us, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 3.96B (3958364038) - BuildTime: 6m1s - PeakMemoryUsage: 157.31 GB (168914159840) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled, Spilled Runtime filters: 0 of 1 Runtime Filter Published, 1 Disabled - BuildRowsPartitionTime: 6m1s - BuildRowsPartitioned: 3.96B (3958364038) - GetNewBlockTime: 38s046ms - HashBuckets: 1.07B (1073741824) - HashCollisions: 0 (0) - HashTablesBuildTime: 1m18s - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 157.31 GB (168914068608) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 5 (5) - UnpinTime: 94.378ms HASH_JOIN_NODE (id=12):(Total: 3m21s, non-child: 1m9s, % non-child: 34.51%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 40.24M (40239291) - BuildTime: 8s526ms - PeakMemoryUsage: 3.02 GB (3240188128) - ProbeRows: 74.60M (74601404) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1m - RowsReturned: 3.96B (3958364038) - RowsReturnedRate: 19.69 M/sec Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 5s638ms - BuildRowsPartitioned: 40.24M (40239291) - GetNewBlockTime: 5.930ms - HashBuckets: 67.11M (67108864) - HashCollisions: 0 (0) - HashTablesBuildTime: 2s840ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 3.02 GB (3240125568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 6s800ms, non-child: 1s582ms, % non-child: 23.27%) BytesReceived(16s000ms): 214.04 MB, 381.10 MB, 381.10 MB, 381.10 MB, 381.10 MB, 381.10 MB, 381.10 MB, 381.10 MB, 381.10 MB, 381.10 MB, 381.10 MB, 381.10 MB, 381.10 MB, 381.10 MB, 381.10 MB, 381.10 MB, 381.10 MB, 381.10 MB, 381.10 MB, 381.10 MB, 381.10 MB, 381.10 MB, 381.10 MB, 381.10 MB, 381.10 MB, 381.10 MB, 381.10 MB, 381.10 MB, 381.10 MB, 381.10 MB, 381.10 MB, 381.10 MB, 381.10 MB, 381.10 MB, 381.10 MB, 381.10 MB, 381.10 MB, 381.10 MB, 381.10 MB, 381.10 MB - BytesReceived: 381.10 MB (399611543) - ConvertRowBatchTime: 969.095ms - DeserializeRowBatchTimer: 1s598ms - FirstBatchArrivalWaitTime: 1s113ms - PeakMemoryUsage: 0 - RowsReturned: 40.24M (40239291) - RowsReturnedRate: 5.92 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=22):(Total: 2m5s, non-child: 1s377ms, % non-child: 1.10%) BytesReceived(16s000ms): 2.07 MB, 15.41 MB, 41.71 MB, 67.28 MB, 93.61 MB, 120.84 MB, 147.60 MB, 174.26 MB, 199.38 MB, 224.52 MB, 249.06 MB, 274.42 MB, 300.71 MB, 326.44 MB, 350.23 MB, 376.95 MB, 402.24 MB, 429.18 MB, 452.00 MB, 476.99 MB, 499.79 MB, 516.60 MB, 535.12 MB, 557.13 MB, 575.02 MB, 587.39 MB, 606.84 MB, 622.87 MB, 636.58 MB, 641.10 MB, 649.64 MB, 662.46 MB, 667.96 MB, 676.48 MB, 685.27 MB, 690.63 MB, 690.63 MB, 690.63 MB, 690.63 MB, 690.63 MB - BytesReceived: 690.63 MB (724178547) - ConvertRowBatchTime: 908.536ms - DeserializeRowBatchTimer: 5s424ms - FirstBatchArrivalWaitTime: 783.870ms - PeakMemoryUsage: 0 - RowsReturned: 74.60M (74601404) - RowsReturnedRate: 593.62 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=24):(Total: 1s700ms, non-child: 3.679us, % non-child: 0.00%) BytesReceived(16s000ms): 9.12 MB, 10.83 MB, 10.83 MB, 10.83 MB, 10.83 MB, 10.83 MB, 10.83 MB, 10.83 MB, 10.83 MB, 10.83 MB, 10.83 MB, 10.83 MB, 10.83 MB, 10.83 MB, 10.83 MB, 10.83 MB, 10.83 MB, 10.83 MB, 10.83 MB, 10.83 MB, 10.83 MB, 10.83 MB, 10.83 MB, 10.83 MB, 10.83 MB, 10.83 MB, 10.83 MB, 10.83 MB, 10.83 MB, 10.83 MB, 10.83 MB, 10.83 MB, 10.83 MB, 10.83 MB, 10.83 MB, 10.83 MB, 10.83 MB, 10.83 MB, 10.84 MB, 10.84 MB - BytesReceived: 11.22 MB (11768120) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 70.632ms - FirstBatchArrivalWaitTime: 1s700ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:347 (host=vc1515.foo:22000):(Total: 57.842ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 987.42 MB, 7.05 GB, 14.10 GB, 20.62 GB, 27.33 GB, 34.02 GB, 40.77 GB, 47.56 GB, 53.93 GB, 60.35 GB, 66.55 GB, 72.98 GB, 79.76 GB, 86.09 GB, 92.27 GB, 99.00 GB, 105.47 GB, 112.24 GB, 118.30 GB, 124.60 GB, 130.98 GB, 135.45 GB, 140.09 GB, 145.71 GB, 150.26 GB, 153.46 GB, 158.12 GB, 151.81 GB, 154.93 GB, 155.95 GB, 158.18 GB, 152.57 GB, 150.31 GB, 152.67 GB, 154.91 GB, 146.33 GB, 150.20 GB, 152.36 GB, 150.32 GB, 152.34 GB ThreadUsage(16s000ms): 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.03 - BloomFilterBytes: 49.00 MB (51380224) - PeakMemoryUsage: 160.60 GB (172441168111) - PerHostPeakMemUsage: 169.57 GB (182074877824) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 2m19s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 1.64K (1642) - TotalThreadsTotalWallClockTime: 22s223ms - TotalThreadsSysTime: 2s343ms - TotalThreadsUserTime: 8s152ms - TotalThreadsVoluntaryContextSwitches: 21.53K (21527) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 57.783ms - ExecTreePrepareTime: 685.529us DataStreamSender (dst_id=28):(Total: 1.073ms, non-child: 1.073ms, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.05 MB (1105280) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 658.518ms, non-child: 658.518ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 215.542ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 122 (122) - NumInstructions: 8.95K (8951) - OptimizationTime: 421.510ms - PeakMemoryUsage: 4.37 MB (4582912) - PrepareTime: 20.984ms HASH_JOIN_NODE (id=15):(Total: 1.274ms, non-child: 957.345us, % non-child: 75.14%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 451.92K (451915) - BuildTime: 148.327ms - PeakMemoryUsage: 153.09 MB (160524544) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=15): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 108.781ms - BuildRowsPartitioned: 451.92K (451915) - GetNewBlockTime: 317.032us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 36.515ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160449664) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=26):(Total: 2s009ms, non-child: 23.816ms, % non-child: 1.19%) BytesReceived(16s000ms): 5.46 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB - BytesReceived: 6.21 MB (6513198) - ConvertRowBatchTime: 12.680ms - DeserializeRowBatchTimer: 50.568ms - FirstBatchArrivalWaitTime: 1s155ms - PeakMemoryUsage: 0 - RowsReturned: 451.92K (451915) - RowsReturnedRate: 224.93 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=14):(Total: 977.002us, non-child: 919.873us, % non-child: 94.15%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 460.08K (460077) - BuildTime: 173.084ms - PeakMemoryUsage: 25.08 MB (26298624) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 111.852ms - BuildRowsPartitioned: 460.08K (460077) - GetNewBlockTime: 188.745us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 21.833ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 25.02 MB (26231936) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 4s090ms, non-child: 16.418ms, % non-child: 0.40%) BytesReceived(16s000ms): 5.98 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB - BytesReceived: 7.35 MB (7707356) - ConvertRowBatchTime: 11.989ms - DeserializeRowBatchTimer: 17.617ms - FirstBatchArrivalWaitTime: 2s058ms - PeakMemoryUsage: 0 - RowsReturned: 460.08K (460077) - RowsReturnedRate: 112.48 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=13):(Total: 710.620us, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 3.94B (3944940321) - BuildTime: 6m - PeakMemoryUsage: 157.31 GB (168914159840) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled, Spilled Runtime filters: 0 of 1 Runtime Filter Published, 1 Disabled - BuildRowsPartitionTime: 5m59s - BuildRowsPartitioned: 3.94B (3944940321) - GetNewBlockTime: 29s696ms - HashBuckets: 536.87M (536870912) - HashCollisions: 0 (0) - HashTablesBuildTime: 47s580ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 157.31 GB (168914068608) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 4 (4) - UnpinTime: 268.529ms HASH_JOIN_NODE (id=12):(Total: 3m22s, non-child: 1m9s, % non-child: 34.42%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 40.22M (40215407) - BuildTime: 8s663ms - PeakMemoryUsage: 3.02 GB (3240188128) - ProbeRows: 74.23M (74234498) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1m - RowsReturned: 3.94B (3944940321) - RowsReturnedRate: 19.45 M/sec Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 5s654ms - BuildRowsPartitioned: 40.22M (40215407) - GetNewBlockTime: 4.014ms - HashBuckets: 67.11M (67108864) - HashCollisions: 0 (0) - HashTablesBuildTime: 2s965ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 3.02 GB (3240125568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 7s036ms, non-child: 1s563ms, % non-child: 22.22%) BytesReceived(16s000ms): 216.79 MB, 380.84 MB, 380.84 MB, 380.84 MB, 380.84 MB, 380.84 MB, 380.84 MB, 380.84 MB, 380.84 MB, 380.84 MB, 380.84 MB, 380.84 MB, 380.84 MB, 380.84 MB, 380.84 MB, 380.84 MB, 380.84 MB, 380.84 MB, 380.84 MB, 380.84 MB, 380.84 MB, 380.84 MB, 380.84 MB, 380.84 MB, 380.84 MB, 380.84 MB, 380.84 MB, 380.84 MB, 380.84 MB, 380.84 MB, 380.84 MB, 380.84 MB, 380.84 MB, 380.84 MB, 380.84 MB, 380.84 MB, 380.84 MB, 380.84 MB, 380.84 MB, 380.84 MB - BytesReceived: 380.84 MB (399341514) - ConvertRowBatchTime: 956.463ms - DeserializeRowBatchTimer: 1s517ms - FirstBatchArrivalWaitTime: 1s073ms - PeakMemoryUsage: 0 - RowsReturned: 40.22M (40215407) - RowsReturnedRate: 5.72 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=22):(Total: 2m6s, non-child: 1s265ms, % non-child: 1.00%) BytesReceived(16s000ms): 2.17 MB, 15.68 MB, 41.91 MB, 67.33 MB, 93.49 MB, 119.63 MB, 146.12 MB, 172.69 MB, 197.79 MB, 222.68 MB, 247.17 MB, 272.38 MB, 298.36 MB, 323.91 MB, 347.57 MB, 374.03 MB, 399.29 MB, 426.23 MB, 449.21 MB, 477.47 MB, 498.47 MB, 515.72 MB, 534.23 MB, 556.39 MB, 573.51 MB, 585.78 MB, 605.69 MB, 621.42 MB, 633.71 MB, 638.42 MB, 647.42 MB, 660.13 MB, 665.02 MB, 674.33 MB, 682.76 MB, 687.04 MB, 687.05 MB, 687.05 MB, 687.05 MB, 687.05 MB - BytesReceived: 687.05 MB (720418900) - ConvertRowBatchTime: 817.462ms - DeserializeRowBatchTimer: 5s413ms - FirstBatchArrivalWaitTime: 741.126ms - PeakMemoryUsage: 0 - RowsReturned: 74.23M (74234498) - RowsReturnedRate: 585.91 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=24):(Total: 1s678ms, non-child: 4.005us, % non-child: 0.00%) BytesReceived(16s000ms): 8.74 MB, 10.36 MB, 10.36 MB, 10.36 MB, 10.36 MB, 10.36 MB, 10.36 MB, 10.36 MB, 10.36 MB, 10.36 MB, 10.36 MB, 10.36 MB, 10.36 MB, 10.36 MB, 10.36 MB, 10.36 MB, 10.36 MB, 10.36 MB, 10.36 MB, 10.36 MB, 10.36 MB, 10.36 MB, 10.36 MB, 10.36 MB, 10.36 MB, 10.36 MB, 10.36 MB, 10.36 MB, 10.36 MB, 10.36 MB, 10.36 MB, 10.36 MB, 10.36 MB, 10.36 MB, 10.36 MB, 10.36 MB, 10.36 MB, 10.40 MB, 10.52 MB, 10.53 MB - BytesReceived: 10.72 MB (11235873) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 73.087ms - FirstBatchArrivalWaitTime: 1s678ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:35b (host=vd1110.foo:22000):(Total: 57.557ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 949.61 MB, 6.77 GB, 13.98 GB, 20.89 GB, 27.73 GB, 34.53 GB, 41.39 GB, 48.26 GB, 54.69 GB, 61.10 GB, 67.34 GB, 73.80 GB, 80.56 GB, 87.10 GB, 93.26 GB, 100.02 GB, 106.54 GB, 113.24 GB, 119.33 GB, 125.67 GB, 131.90 GB, 136.21 GB, 140.97 GB, 146.64 GB, 151.36 GB, 154.64 GB, 156.77 GB, 153.07 GB, 156.52 GB, 157.30 GB, 156.51 GB, 151.77 GB, 152.56 GB, 155.04 GB, 156.49 GB, 154.23 GB, 152.73 GB, 152.20 GB, 153.51 GB, 154.42 GB ThreadUsage(16s000ms): 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.03 - BloomFilterBytes: 49.00 MB (51380224) - PeakMemoryUsage: 160.60 GB (172444459567) - PerHostPeakMemUsage: 169.55 GB (182054859411) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 1m56s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 1.51K (1512) - TotalThreadsTotalWallClockTime: 22s293ms - TotalThreadsSysTime: 2s087ms - TotalThreadsUserTime: 8s040ms - TotalThreadsVoluntaryContextSwitches: 23.52K (23518) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 57.513ms - ExecTreePrepareTime: 629.437us DataStreamSender (dst_id=28):(Total: 787.243us, non-child: 787.243us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.05 MB (1105280) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 633.994ms, non-child: 633.994ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 207.882ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 122 (122) - NumInstructions: 8.95K (8951) - OptimizationTime: 399.396ms - PeakMemoryUsage: 4.37 MB (4582912) - PrepareTime: 26.291ms HASH_JOIN_NODE (id=15):(Total: 1.187ms, non-child: 965.672us, % non-child: 81.29%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 451.92K (451915) - BuildTime: 141.075ms - PeakMemoryUsage: 153.09 MB (160524544) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=15): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 100.115ms - BuildRowsPartitioned: 451.92K (451915) - GetNewBlockTime: 374.560us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 37.520ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160449664) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=26):(Total: 2s038ms, non-child: 23.729ms, % non-child: 1.16%) BytesReceived(16s000ms): 5.38 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB - BytesReceived: 6.21 MB (6513198) - ConvertRowBatchTime: 12.413ms - DeserializeRowBatchTimer: 47.356ms - FirstBatchArrivalWaitTime: 1s179ms - PeakMemoryUsage: 0 - RowsReturned: 451.92K (451915) - RowsReturnedRate: 221.65 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=14):(Total: 902.673us, non-child: 841.175us, % non-child: 93.19%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 458.95K (458955) - BuildTime: 161.402ms - PeakMemoryUsage: 25.08 MB (26298624) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 99.840ms - BuildRowsPartitioned: 458.95K (458955) - GetNewBlockTime: 320.105us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 22.572ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 25.02 MB (26231936) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 4s151ms, non-child: 16.309ms, % non-child: 0.39%) BytesReceived(16s000ms): 5.81 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB - BytesReceived: 7.33 MB (7688250) - ConvertRowBatchTime: 11.758ms - DeserializeRowBatchTimer: 18.830ms - FirstBatchArrivalWaitTime: 2s089ms - PeakMemoryUsage: 0 - RowsReturned: 458.95K (458955) - RowsReturnedRate: 110.54 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=13):(Total: 659.055us, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 3.99B (3988455664) - BuildTime: 6m28s - PeakMemoryUsage: 158.39 GB (170072967424) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled, Spilled Runtime filters: 0 of 1 Runtime Filter Published, 1 Disabled - BuildRowsPartitionTime: 6m27s - BuildRowsPartitioned: 3.99B (3988455664) - GetNewBlockTime: 47s275ms - HashBuckets: 536.87M (536870912) - HashCollisions: 0 (0) - HashTablesBuildTime: 32s435ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 158.39 GB (170072908928) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 4 (4) - UnpinTime: 382.985ms HASH_JOIN_NODE (id=12):(Total: 3m2s, non-child: 1m12s, % non-child: 39.65%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 40.16M (40162784) - BuildTime: 8s327ms - PeakMemoryUsage: 3.02 GB (3240188128) - ProbeRows: 75.20M (75204494) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1m3s - RowsReturned: 3.99B (3988455664) - RowsReturnedRate: 21.84 M/sec Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 5s407ms - BuildRowsPartitioned: 40.16M (40162784) - GetNewBlockTime: 2.333ms - HashBuckets: 67.11M (67108864) - HashCollisions: 0 (0) - HashTablesBuildTime: 2s878ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 3.02 GB (3240125568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 7s384ms, non-child: 1s544ms, % non-child: 20.92%) BytesReceived(16s000ms): 211.23 MB, 380.36 MB, 380.36 MB, 380.36 MB, 380.36 MB, 380.36 MB, 380.36 MB, 380.36 MB, 380.36 MB, 380.36 MB, 380.36 MB, 380.36 MB, 380.36 MB, 380.36 MB, 380.36 MB, 380.36 MB, 380.36 MB, 380.36 MB, 380.36 MB, 380.36 MB, 380.36 MB, 380.36 MB, 380.36 MB, 380.36 MB, 380.36 MB, 380.36 MB, 380.36 MB, 380.36 MB, 380.36 MB, 380.36 MB, 380.36 MB, 380.36 MB, 380.36 MB, 380.36 MB, 380.36 MB, 380.36 MB, 380.36 MB, 380.36 MB, 380.36 MB, 380.36 MB - BytesReceived: 380.36 MB (398835110) - ConvertRowBatchTime: 967.488ms - DeserializeRowBatchTimer: 1s506ms - FirstBatchArrivalWaitTime: 1s099ms - PeakMemoryUsage: 0 - RowsReturned: 40.16M (40162784) - RowsReturnedRate: 5.44 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=22):(Total: 1m43s, non-child: 1s289ms, % non-child: 1.24%) BytesReceived(16s000ms): 2.18 MB, 15.45 MB, 42.06 MB, 68.70 MB, 95.28 MB, 121.87 MB, 148.77 MB, 175.76 MB, 201.09 MB, 226.21 MB, 250.81 MB, 276.37 MB, 302.81 MB, 328.68 MB, 352.67 MB, 379.50 MB, 404.80 MB, 431.97 MB, 454.91 MB, 480.07 MB, 503.21 MB, 520.22 MB, 539.03 MB, 561.21 MB, 579.33 MB, 591.79 MB, 611.51 MB, 627.78 MB, 641.77 MB, 646.28 MB, 656.66 MB, 669.56 MB, 674.25 MB, 684.01 MB, 692.38 MB, 696.21 MB, 696.21 MB, 696.21 MB, 696.21 MB, 696.21 MB - BytesReceived: 696.21 MB (730028123) - ConvertRowBatchTime: 854.233ms - DeserializeRowBatchTimer: 5s469ms - FirstBatchArrivalWaitTime: 765.574ms - PeakMemoryUsage: 0 - RowsReturned: 75.20M (75204494) - RowsReturnedRate: 725.93 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=24):(Total: 1s698ms, non-child: 3.458us, % non-child: 0.00%) BytesReceived(16s000ms): 8.23 MB, 9.93 MB, 9.93 MB, 9.93 MB, 9.93 MB, 9.93 MB, 9.93 MB, 9.93 MB, 9.93 MB, 9.93 MB, 9.93 MB, 9.93 MB, 9.93 MB, 9.93 MB, 9.93 MB, 9.93 MB, 9.93 MB, 9.93 MB, 9.93 MB, 9.93 MB, 9.93 MB, 9.93 MB, 9.93 MB, 9.93 MB, 9.93 MB, 9.93 MB, 9.93 MB, 9.93 MB, 9.93 MB, 9.93 MB, 9.93 MB, 9.93 MB, 9.93 MB, 9.93 MB, 9.93 MB, 9.93 MB, 9.93 MB, 9.93 MB, 9.93 MB, 9.93 MB - BytesReceived: 9.93 MB (10416351) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 71.244ms - FirstBatchArrivalWaitTime: 1s698ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:339 (host=va1043.foo:22000):(Total: 57.390ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 1014.00 MB, 7.23 GB, 14.09 GB, 20.82 GB, 27.70 GB, 34.57 GB, 41.49 GB, 48.34 GB, 54.77 GB, 61.27 GB, 67.56 GB, 74.10 GB, 80.95 GB, 87.36 GB, 93.70 GB, 100.54 GB, 107.03 GB, 113.74 GB, 119.95 GB, 126.33 GB, 132.34 GB, 136.64 GB, 141.33 GB, 147.04 GB, 151.74 GB, 155.09 GB, 157.27 GB, 153.52 GB, 156.96 GB, 157.80 GB, 158.09 GB, 151.59 GB, 152.61 GB, 155.07 GB, 156.92 GB, 154.32 GB, 152.27 GB, 154.58 GB, 154.62 GB, 155.50 GB ThreadUsage(16s000ms): 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.03 - BloomFilterBytes: 49.00 MB (51380224) - PeakMemoryUsage: 160.99 GB (172861769567) - PerHostPeakMemUsage: 169.56 GB (182068554781) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 2m33s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 1.66K (1656) - TotalThreadsTotalWallClockTime: 21s930ms - TotalThreadsSysTime: 2s124ms - TotalThreadsUserTime: 8s170ms - TotalThreadsVoluntaryContextSwitches: 21.12K (21121) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 57.337ms - ExecTreePrepareTime: 638.764us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 24.35K (24350) - BlocksRecycled: 354 (354) - BufferedPins: 0 (0) - BytesWritten: 44.10 GB (47353692160) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 161.38 GB (173283483648) - ScratchFileUsedBytes: 44.10 GB (47353692160) - TotalBufferWaitTime: 4s593ms - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=28):(Total: 753.567us, non-child: 753.567us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.05 MB (1105280) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 622.235ms, non-child: 622.235ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 208.128ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 122 (122) - NumInstructions: 8.95K (8951) - OptimizationTime: 388.090ms - PeakMemoryUsage: 4.37 MB (4582912) - PrepareTime: 25.500ms HASH_JOIN_NODE (id=15):(Total: 1.204ms, non-child: 939.479us, % non-child: 78.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 451.92K (451915) - BuildTime: 144.829ms - PeakMemoryUsage: 153.09 MB (160524544) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=15): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 106.972ms - BuildRowsPartitioned: 451.92K (451915) - GetNewBlockTime: 326.443us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 34.867ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160449664) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=26):(Total: 2s059ms, non-child: 28.932ms, % non-child: 1.40%) BytesReceived(16s000ms): 5.43 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB - BytesReceived: 6.21 MB (6513198) - ConvertRowBatchTime: 13.107ms - DeserializeRowBatchTimer: 56.922ms - FirstBatchArrivalWaitTime: 1s199ms - PeakMemoryUsage: 0 - RowsReturned: 451.92K (451915) - RowsReturnedRate: 219.40 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=14):(Total: 953.656us, non-child: 976.836us, % non-child: 100.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 458.54K (458536) - BuildTime: 143.475ms - PeakMemoryUsage: 25.08 MB (26298624) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 84.768ms - BuildRowsPartitioned: 458.54K (458536) - GetNewBlockTime: 177.862us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 22.238ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 25.02 MB (26231936) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 4s151ms, non-child: 15.208ms, % non-child: 0.37%) BytesReceived(16s000ms): 5.85 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB - BytesReceived: 7.32 MB (7679710) - ConvertRowBatchTime: 11.039ms - DeserializeRowBatchTimer: 14.826ms - FirstBatchArrivalWaitTime: 2s115ms - PeakMemoryUsage: 0 - RowsReturned: 458.54K (458536) - RowsReturnedRate: 110.44 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=13):(Total: 664.192us, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 4.00B (3997638519) - BuildTime: 5m44s - PeakMemoryUsage: 159.00 GB (170727278848) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled, Spilled Runtime filters: 0 of 1 Runtime Filter Published, 1 Disabled - BuildRowsPartitionTime: 5m44s - BuildRowsPartitioned: 4.00B (3997638519) - GetNewBlockTime: 49s356ms - HashBuckets: 536.87M (536870912) - HashCollisions: 0 (0) - HashTablesBuildTime: 16s258ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 159.00 GB (170727220352) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 4 (4) - UnpinTime: 305.993ms HASH_JOIN_NODE (id=12):(Total: 3m43s, non-child: 1m16s, % non-child: 34.26%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 40.13M (40134046) - BuildTime: 8s564ms - PeakMemoryUsage: 3.02 GB (3240190148) - ProbeRows: 75.56M (75563570) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1m7s - RowsReturned: 4.00B (3997638519) - RowsReturnedRate: 17.87 M/sec Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 5s686ms - BuildRowsPartitioned: 40.13M (40134046) - GetNewBlockTime: 4.546ms - HashBuckets: 67.11M (67108864) - HashCollisions: 0 (0) - HashTablesBuildTime: 2s826ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 3.02 GB (3240125568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 6s786ms, non-child: 1s453ms, % non-child: 21.41%) BytesReceived(16s000ms): 214.15 MB, 380.09 MB, 380.09 MB, 380.09 MB, 380.09 MB, 380.09 MB, 380.09 MB, 380.09 MB, 380.09 MB, 380.09 MB, 380.09 MB, 380.09 MB, 380.09 MB, 380.09 MB, 380.09 MB, 380.09 MB, 380.09 MB, 380.09 MB, 380.09 MB, 380.09 MB, 380.09 MB, 380.09 MB, 380.09 MB, 380.09 MB, 380.09 MB, 380.09 MB, 380.09 MB, 380.09 MB, 380.09 MB, 380.09 MB, 380.09 MB, 380.09 MB, 380.09 MB, 380.09 MB, 380.09 MB, 380.09 MB, 380.09 MB, 380.09 MB, 380.09 MB, 380.09 MB - BytesReceived: 380.09 MB (398556701) - ConvertRowBatchTime: 966.196ms - DeserializeRowBatchTimer: 1s398ms - FirstBatchArrivalWaitTime: 1s124ms - PeakMemoryUsage: 0 - RowsReturned: 40.13M (40134046) - RowsReturnedRate: 5.91 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=22):(Total: 2m21s, non-child: 1s285ms, % non-child: 0.91%) BytesReceived(16s000ms): 2.10 MB, 15.55 MB, 42.04 MB, 68.51 MB, 95.42 MB, 122.30 MB, 149.35 MB, 176.27 MB, 201.63 MB, 227.03 MB, 251.91 MB, 277.65 MB, 304.42 MB, 330.63 MB, 354.84 MB, 381.83 MB, 407.33 MB, 434.56 MB, 457.54 MB, 482.74 MB, 505.84 MB, 522.86 MB, 541.71 MB, 564.03 MB, 582.30 MB, 594.87 MB, 614.65 MB, 631.01 MB, 645.03 MB, 649.63 MB, 658.31 MB, 671.39 MB, 676.97 MB, 685.60 MB, 694.52 MB, 699.99 MB, 700.00 MB, 700.00 MB, 700.00 MB, 700.00 MB - BytesReceived: 700.00 MB (733999101) - ConvertRowBatchTime: 826.972ms - DeserializeRowBatchTimer: 5s630ms - FirstBatchArrivalWaitTime: 787.724ms - PeakMemoryUsage: 0 - RowsReturned: 75.56M (75563570) - RowsReturnedRate: 535.68 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=24):(Total: 1s732ms, non-child: 3.807us, % non-child: 0.00%) BytesReceived(16s000ms): 8.28 MB, 9.82 MB, 9.82 MB, 9.82 MB, 9.82 MB, 9.82 MB, 9.82 MB, 9.82 MB, 9.82 MB, 9.82 MB, 9.82 MB, 9.82 MB, 9.82 MB, 9.82 MB, 9.82 MB, 9.82 MB, 9.82 MB, 9.82 MB, 9.82 MB, 9.82 MB, 9.82 MB, 9.82 MB, 9.82 MB, 9.82 MB, 9.82 MB, 9.82 MB, 9.82 MB, 9.82 MB, 9.82 MB, 9.82 MB, 9.82 MB, 9.82 MB, 9.82 MB, 9.82 MB, 9.82 MB, 9.82 MB, 9.82 MB, 9.82 MB, 9.82 MB, 9.82 MB - BytesReceived: 9.82 MB (10297126) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 65.107ms - FirstBatchArrivalWaitTime: 1s732ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:33a (host=va1039.foo:22000):(Total: 57.390ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 982.30 MB, 7.01 GB, 14.23 GB, 20.89 GB, 27.86 GB, 34.75 GB, 41.68 GB, 48.65 GB, 55.18 GB, 61.71 GB, 68.08 GB, 74.64 GB, 81.58 GB, 88.09 GB, 94.48 GB, 101.32 GB, 107.90 GB, 114.62 GB, 120.92 GB, 127.22 GB, 133.44 GB, 137.75 GB, 142.45 GB, 148.20 GB, 152.92 GB, 156.29 GB, 153.87 GB, 154.19 GB, 157.20 GB, 158.24 GB, 155.72 GB, 151.18 GB, 152.75 GB, 155.49 GB, 156.61 GB, 153.41 GB, 156.11 GB, 158.14 GB, 155.26 GB, 155.96 GB ThreadUsage(16s000ms): 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.03 - BloomFilterBytes: 49.00 MB (51380224) - PeakMemoryUsage: 160.60 GB (172442904607) - PerHostPeakMemUsage: 169.56 GB (182068550938) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 2m3s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 1.67K (1666) - TotalThreadsTotalWallClockTime: 22s067ms - TotalThreadsSysTime: 2s319ms - TotalThreadsUserTime: 8s116ms - TotalThreadsVoluntaryContextSwitches: 21.82K (21815) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 57.350ms - ExecTreePrepareTime: 539.209us DataStreamSender (dst_id=28):(Total: 844.399us, non-child: 844.399us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.05 MB (1105280) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 648.115ms, non-child: 648.115ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 210.415ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 122 (122) - NumInstructions: 8.95K (8951) - OptimizationTime: 412.084ms - PeakMemoryUsage: 4.37 MB (4582912) - PrepareTime: 25.200ms HASH_JOIN_NODE (id=15):(Total: 1.020ms, non-child: 939.887us, % non-child: 92.11%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 451.92K (451915) - BuildTime: 126.943ms - PeakMemoryUsage: 153.09 MB (160524544) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=15): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 93.864ms - BuildRowsPartitioned: 451.92K (451915) - GetNewBlockTime: 699.435us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 30.416ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160449664) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=26):(Total: 2s048ms, non-child: 23.661ms, % non-child: 1.16%) BytesReceived(16s000ms): 5.38 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB - BytesReceived: 6.21 MB (6513198) - ConvertRowBatchTime: 11.037ms - DeserializeRowBatchTimer: 51.216ms - FirstBatchArrivalWaitTime: 1s175ms - PeakMemoryUsage: 0 - RowsReturned: 451.92K (451915) - RowsReturnedRate: 220.60 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=14):(Total: 802.126us, non-child: 800.754us, % non-child: 99.83%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 459.09K (459086) - BuildTime: 171.705ms - PeakMemoryUsage: 25.08 MB (26298624) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 104.974ms - BuildRowsPartitioned: 459.09K (459086) - GetNewBlockTime: 216.152us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 26.392ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 25.02 MB (26231936) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 4s108ms, non-child: 15.267ms, % non-child: 0.37%) BytesReceived(16s000ms): 5.83 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB - BytesReceived: 7.33 MB (7689362) - ConvertRowBatchTime: 11.548ms - DeserializeRowBatchTimer: 15.776ms - FirstBatchArrivalWaitTime: 2s080ms - PeakMemoryUsage: 0 - RowsReturned: 459.09K (459086) - RowsReturnedRate: 111.74 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=13):(Total: 536.086us, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 4.03B (4031481444) - BuildTime: 6m16s - PeakMemoryUsage: 158.17 GB (169837496576) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled, Spilled Runtime filters: 0 of 1 Runtime Filter Published, 1 Disabled - BuildRowsPartitionTime: 6m15s - BuildRowsPartitioned: 4.03B (4031481444) - GetNewBlockTime: 48s213ms - HashBuckets: 536.87M (536870912) - HashCollisions: 0 (0) - HashTablesBuildTime: 51s173ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 158.17 GB (169837438080) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 4 (4) - UnpinTime: 329.533ms HASH_JOIN_NODE (id=12):(Total: 3m7s, non-child: 1m11s, % non-child: 37.91%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 40.13M (40126345) - BuildTime: 8s633ms - PeakMemoryUsage: 3.02 GB (3240188696) - ProbeRows: 75.50M (75499282) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1m1s - RowsReturned: 4.03B (4031481444) - RowsReturnedRate: 21.48 M/sec Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 5s556ms - BuildRowsPartitioned: 40.13M (40126345) - GetNewBlockTime: 4.606ms - HashBuckets: 67.11M (67108864) - HashCollisions: 0 (0) - HashTablesBuildTime: 3s032ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 3.02 GB (3240125568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 6s875ms, non-child: 1s532ms, % non-child: 22.30%) BytesReceived(16s000ms): 211.56 MB, 380.03 MB, 380.03 MB, 380.03 MB, 380.03 MB, 380.03 MB, 380.03 MB, 380.03 MB, 380.03 MB, 380.03 MB, 380.03 MB, 380.03 MB, 380.03 MB, 380.03 MB, 380.03 MB, 380.03 MB, 380.03 MB, 380.03 MB, 380.03 MB, 380.03 MB, 380.03 MB, 380.03 MB, 380.03 MB, 380.03 MB, 380.03 MB, 380.03 MB, 380.03 MB, 380.03 MB, 380.03 MB, 380.03 MB, 380.03 MB, 380.03 MB, 380.03 MB, 380.03 MB, 380.03 MB, 380.03 MB, 380.03 MB, 380.03 MB, 380.03 MB, 380.03 MB - BytesReceived: 380.03 MB (398487380) - ConvertRowBatchTime: 945.813ms - DeserializeRowBatchTimer: 1s488ms - FirstBatchArrivalWaitTime: 1s092ms - PeakMemoryUsage: 0 - RowsReturned: 40.13M (40126345) - RowsReturnedRate: 5.84 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=22):(Total: 1m50s, non-child: 1s334ms, % non-child: 1.21%) BytesReceived(16s000ms): 2.17 MB, 15.50 MB, 42.20 MB, 68.16 MB, 95.09 MB, 121.76 MB, 148.74 MB, 175.91 MB, 201.50 MB, 226.93 MB, 251.82 MB, 277.41 MB, 304.14 MB, 330.34 MB, 354.52 MB, 381.36 MB, 406.81 MB, 433.96 MB, 457.02 MB, 482.00 MB, 505.30 MB, 522.27 MB, 540.92 MB, 563.27 MB, 581.48 MB, 594.00 MB, 613.54 MB, 629.91 MB, 643.98 MB, 648.44 MB, 657.10 MB, 670.06 MB, 676.58 MB, 686.35 MB, 694.79 MB, 698.83 MB, 698.83 MB, 698.83 MB, 698.83 MB, 698.83 MB - BytesReceived: 698.83 MB (732773804) - ConvertRowBatchTime: 873.680ms - DeserializeRowBatchTimer: 5s277ms - FirstBatchArrivalWaitTime: 763.389ms - PeakMemoryUsage: 0 - RowsReturned: 75.50M (75499282) - RowsReturnedRate: 683.76 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=24):(Total: 1s691ms, non-child: 4.541us, % non-child: 0.00%) BytesReceived(16s000ms): 8.61 MB, 10.36 MB, 10.36 MB, 10.36 MB, 10.36 MB, 10.36 MB, 10.36 MB, 10.36 MB, 10.36 MB, 10.36 MB, 10.36 MB, 10.36 MB, 10.36 MB, 10.36 MB, 10.36 MB, 10.36 MB, 10.36 MB, 10.36 MB, 10.36 MB, 10.36 MB, 10.36 MB, 10.36 MB, 10.36 MB, 10.36 MB, 10.36 MB, 10.36 MB, 10.36 MB, 10.36 MB, 10.36 MB, 10.36 MB, 10.36 MB, 10.36 MB, 10.36 MB, 10.36 MB, 10.36 MB, 10.36 MB, 10.36 MB, 10.39 MB, 10.42 MB, 10.46 MB - BytesReceived: 10.72 MB (11239801) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 71.505ms - FirstBatchArrivalWaitTime: 1s691ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:356 (host=ve1131.foo:22000):(Total: 57.282ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 989.93 MB, 7.16 GB, 14.12 GB, 20.69 GB, 27.43 GB, 34.19 GB, 41.03 GB, 47.82 GB, 54.23 GB, 60.72 GB, 67.29 GB, 73.72 GB, 80.48 GB, 87.06 GB, 92.98 GB, 99.99 GB, 106.30 GB, 113.20 GB, 119.00 GB, 125.56 GB, 131.37 GB, 135.66 GB, 140.34 GB, 145.98 GB, 150.60 GB, 153.85 GB, 157.39 GB, 152.20 GB, 155.49 GB, 156.34 GB, 158.67 GB, 152.75 GB, 151.49 GB, 153.52 GB, 155.07 GB, 151.54 GB, 151.35 GB, 153.50 GB, 153.62 GB, 153.62 GB ThreadUsage(16s000ms): 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.03 - BloomFilterBytes: 49.00 MB (51380224) - PeakMemoryUsage: 160.99 GB (172864047695) - PerHostPeakMemUsage: 169.57 GB (182069508250) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 2m50s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 1.63K (1630) - TotalThreadsTotalWallClockTime: 22s046ms - TotalThreadsSysTime: 2s039ms - TotalThreadsUserTime: 8s104ms - TotalThreadsVoluntaryContextSwitches: 20.92K (20921) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 57.205ms - ExecTreePrepareTime: 585.458us BlockMgr: - BlockWritesOutstanding: 1 (1) - BlocksCreated: 24.07K (24065) - BlocksRecycled: 354 (354) - BufferedPins: 0 (0) - BytesWritten: 41.88 GB (44962938880) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 161.38 GB (173283483648) - ScratchFileUsedBytes: 41.88 GB (44962938880) - TotalBufferWaitTime: 2s649ms - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=28):(Total: 756.665us, non-child: 756.665us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.05 MB (1105280) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 619.089ms, non-child: 619.089ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 207.512ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 122 (122) - NumInstructions: 8.95K (8951) - OptimizationTime: 386.083ms - PeakMemoryUsage: 4.37 MB (4582912) - PrepareTime: 24.946ms HASH_JOIN_NODE (id=15):(Total: 1.103ms, non-child: 828.464us, % non-child: 75.05%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 451.92K (451915) - BuildTime: 142.509ms - PeakMemoryUsage: 153.09 MB (160524544) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=15): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 102.496ms - BuildRowsPartitioned: 451.92K (451915) - GetNewBlockTime: 316.570us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 37.720ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160449664) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=26):(Total: 2s047ms, non-child: 25.377ms, % non-child: 1.24%) BytesReceived(16s000ms): 5.43 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB - BytesReceived: 6.21 MB (6513198) - ConvertRowBatchTime: 12.126ms - DeserializeRowBatchTimer: 51.189ms - FirstBatchArrivalWaitTime: 1s196ms - PeakMemoryUsage: 0 - RowsReturned: 451.92K (451915) - RowsReturnedRate: 220.71 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=14):(Total: 870.364us, non-child: 675.922us, % non-child: 77.66%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 460.21K (460209) - BuildTime: 128.744ms - PeakMemoryUsage: 25.08 MB (26298624) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 77.639ms - BuildRowsPartitioned: 460.21K (460209) - GetNewBlockTime: 186.266us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 22.868ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 25.02 MB (26231936) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 4s192ms, non-child: 13.948ms, % non-child: 0.33%) BytesReceived(16s000ms): 5.90 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB - BytesReceived: 7.35 MB (7708967) - ConvertRowBatchTime: 10.398ms - DeserializeRowBatchTimer: 15.175ms - FirstBatchArrivalWaitTime: 2s104ms - PeakMemoryUsage: 0 - RowsReturned: 460.21K (460209) - RowsReturnedRate: 109.76 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=13):(Total: 599.934us, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 3.96B (3956404470) - BuildTime: 5m28s - PeakMemoryUsage: 157.70 GB (169333590240) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled, Spilled Runtime filters: 0 of 1 Runtime Filter Published, 1 Disabled - BuildRowsPartitionTime: 5m28s - BuildRowsPartitioned: 3.96B (3956404470) - GetNewBlockTime: 32s344ms - HashBuckets: 536.87M (536870912) - HashCollisions: 0 (0) - HashTablesBuildTime: 16s779ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 157.70 GB (169333499008) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 4 (4) - UnpinTime: 86.432ms HASH_JOIN_NODE (id=12):(Total: 3m54s, non-child: 1m10s, % non-child: 30.25%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 40.26M (40263867) - BuildTime: 8s402ms - PeakMemoryUsage: 3.02 GB (3240188128) - ProbeRows: 74.69M (74693216) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1m1s - RowsReturned: 3.96B (3956404470) - RowsReturnedRate: 16.89 M/sec Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 5s746ms - BuildRowsPartitioned: 40.26M (40263867) - GetNewBlockTime: 2.947ms - HashBuckets: 67.11M (67108864) - HashCollisions: 0 (0) - HashTablesBuildTime: 2s610ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 3.02 GB (3240125568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 7s036ms, non-child: 1s473ms, % non-child: 20.94%) BytesReceived(16s000ms): 214.99 MB, 381.30 MB, 381.30 MB, 381.30 MB, 381.30 MB, 381.30 MB, 381.30 MB, 381.30 MB, 381.30 MB, 381.30 MB, 381.30 MB, 381.30 MB, 381.30 MB, 381.30 MB, 381.30 MB, 381.30 MB, 381.30 MB, 381.30 MB, 381.30 MB, 381.30 MB, 381.30 MB, 381.30 MB, 381.30 MB, 381.30 MB, 381.30 MB, 381.30 MB, 381.30 MB, 381.30 MB, 381.30 MB, 381.30 MB, 381.30 MB, 381.30 MB, 381.30 MB, 381.30 MB, 381.30 MB, 381.30 MB, 381.30 MB, 381.30 MB, 381.30 MB, 381.30 MB - BytesReceived: 381.30 MB (399822090) - ConvertRowBatchTime: 957.289ms - DeserializeRowBatchTimer: 1s393ms - FirstBatchArrivalWaitTime: 1s112ms - PeakMemoryUsage: 0 - RowsReturned: 40.26M (40263867) - RowsReturnedRate: 5.72 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=22):(Total: 2m37s, non-child: 1s331ms, % non-child: 0.85%) BytesReceived(16s000ms): 2.14 MB, 15.56 MB, 41.97 MB, 67.60 MB, 94.02 MB, 120.54 MB, 147.30 MB, 173.89 MB, 199.03 MB, 224.61 MB, 250.44 MB, 275.72 MB, 301.99 MB, 327.92 MB, 351.74 MB, 378.46 MB, 403.63 MB, 430.47 MB, 453.06 MB, 478.48 MB, 500.86 MB, 517.90 MB, 536.55 MB, 558.66 MB, 576.44 MB, 588.72 MB, 608.33 MB, 624.14 MB, 637.43 MB, 641.95 MB, 650.61 MB, 663.48 MB, 668.68 MB, 677.47 MB, 686.03 MB, 691.06 MB, 691.06 MB, 691.06 MB, 691.06 MB, 691.06 MB - BytesReceived: 691.06 MB (724633788) - ConvertRowBatchTime: 840.373ms - DeserializeRowBatchTimer: 8s019ms - FirstBatchArrivalWaitTime: 782.909ms - PeakMemoryUsage: 0 - RowsReturned: 74.69M (74693216) - RowsReturnedRate: 475.24 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=24):(Total: 1s728ms, non-child: 4.650us, % non-child: 0.00%) BytesReceived(16s000ms): 8.62 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.23 MB, 10.23 MB - BytesReceived: 10.43 MB (10938285) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 69.400ms - FirstBatchArrivalWaitTime: 1s728ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:362 (host=vc1508.foo:22000):(Total: 57.270ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 957.55 MB, 6.87 GB, 14.21 GB, 20.80 GB, 27.64 GB, 34.58 GB, 41.51 GB, 48.43 GB, 54.92 GB, 61.41 GB, 67.74 GB, 74.25 GB, 81.14 GB, 87.67 GB, 94.16 GB, 101.03 GB, 107.59 GB, 114.25 GB, 120.64 GB, 126.92 GB, 133.13 GB, 137.46 GB, 142.15 GB, 147.85 GB, 152.52 GB, 155.86 GB, 155.40 GB, 154.20 GB, 157.61 GB, 158.64 GB, 155.96 GB, 152.23 GB, 153.86 GB, 155.73 GB, 157.63 GB, 153.97 GB, 151.72 GB, 155.51 GB, 156.46 GB, 149.88 GB ThreadUsage(16s000ms): 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.03 - BloomFilterBytes: 49.00 MB (51380224) - PeakMemoryUsage: 160.60 GB (172439415247) - PerHostPeakMemUsage: 169.57 GB (182072953359) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 2m29s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 1.81K (1808) - TotalThreadsTotalWallClockTime: 22s754ms - TotalThreadsSysTime: 2s354ms - TotalThreadsUserTime: 8s426ms - TotalThreadsVoluntaryContextSwitches: 21.66K (21662) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 57.228ms - ExecTreePrepareTime: 561.677us DataStreamSender (dst_id=28):(Total: 722.428us, non-child: 722.428us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.05 MB (1105280) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 634.379ms, non-child: 634.379ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 210.636ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 122 (122) - NumInstructions: 8.95K (8951) - OptimizationTime: 397.217ms - PeakMemoryUsage: 4.37 MB (4582912) - PrepareTime: 26.103ms HASH_JOIN_NODE (id=15):(Total: 1.076ms, non-child: 932.764us, % non-child: 86.66%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 451.92K (451915) - BuildTime: 135.971ms - PeakMemoryUsage: 153.09 MB (160524544) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=15): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 101.198ms - BuildRowsPartitioned: 451.92K (451915) - GetNewBlockTime: 363.293us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 32.556ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160449664) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=26):(Total: 2s046ms, non-child: 32.273ms, % non-child: 1.58%) BytesReceived(16s000ms): 5.45 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB - BytesReceived: 6.21 MB (6513198) - ConvertRowBatchTime: 12.466ms - DeserializeRowBatchTimer: 60.232ms - FirstBatchArrivalWaitTime: 1s180ms - PeakMemoryUsage: 0 - RowsReturned: 451.92K (451915) - RowsReturnedRate: 220.85 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=14):(Total: 809.264us, non-child: 852.372us, % non-child: 100.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 458.81K (458812) - BuildTime: 154.078ms - PeakMemoryUsage: 25.08 MB (26298624) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 88.567ms - BuildRowsPartitioned: 458.81K (458812) - GetNewBlockTime: 199.546us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 26.492ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 25.02 MB (26231936) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 4s166ms, non-child: 16.298ms, % non-child: 0.39%) BytesReceived(16s000ms): 5.94 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB - BytesReceived: 7.33 MB (7685154) - ConvertRowBatchTime: 12.298ms - DeserializeRowBatchTimer: 17.001ms - FirstBatchArrivalWaitTime: 2s096ms - PeakMemoryUsage: 0 - RowsReturned: 458.81K (458812) - RowsReturnedRate: 110.12 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=13):(Total: 580.587us, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 4.02B (4018012426) - BuildTime: 5m47s - PeakMemoryUsage: 160.16 GB (171968792832) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled, Spilled Runtime filters: 0 of 1 Runtime Filter Published, 1 Disabled - BuildRowsPartitionTime: 5m46s - BuildRowsPartitioned: 4.02B (4018012426) - GetNewBlockTime: 27s514ms - HashBuckets: 536.87M (536870912) - HashCollisions: 0 (0) - HashTablesBuildTime: 1m7s - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 160.16 GB (171968734336) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 5 (5) - UnpinTime: 172.833ms HASH_JOIN_NODE (id=12):(Total: 3m35s, non-child: 1m13s, % non-child: 33.89%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 40.22M (40224969) - BuildTime: 8s998ms - PeakMemoryUsage: 3.02 GB (3240191326) - ProbeRows: 76.11M (76110875) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1m3s - RowsReturned: 4.02B (4018012426) - RowsReturnedRate: 18.64 M/sec Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 5s644ms - BuildRowsPartitioned: 40.22M (40224969) - GetNewBlockTime: 2.933ms - HashBuckets: 67.11M (67108864) - HashCollisions: 0 (0) - HashTablesBuildTime: 3s304ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 3.02 GB (3240125568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 7s149ms, non-child: 1s547ms, % non-child: 21.65%) BytesReceived(16s000ms): 216.46 MB, 380.94 MB, 380.94 MB, 380.94 MB, 380.94 MB, 380.94 MB, 380.94 MB, 380.94 MB, 380.94 MB, 380.94 MB, 380.94 MB, 380.94 MB, 380.94 MB, 380.94 MB, 380.94 MB, 380.94 MB, 380.94 MB, 380.94 MB, 380.94 MB, 380.94 MB, 380.94 MB, 380.94 MB, 380.94 MB, 380.94 MB, 380.94 MB, 380.94 MB, 380.94 MB, 380.94 MB, 380.94 MB, 380.94 MB, 380.94 MB, 380.94 MB, 380.94 MB, 380.94 MB, 380.94 MB, 380.94 MB, 380.94 MB, 380.94 MB, 380.94 MB, 380.94 MB - BytesReceived: 380.94 MB (399441273) - ConvertRowBatchTime: 953.010ms - DeserializeRowBatchTimer: 1s517ms - FirstBatchArrivalWaitTime: 1s110ms - PeakMemoryUsage: 0 - RowsReturned: 40.22M (40224969) - RowsReturnedRate: 5.63 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=22):(Total: 2m16s, non-child: 1s852ms, % non-child: 1.36%) BytesReceived(16s000ms): 2.12 MB, 15.85 MB, 42.59 MB, 68.45 MB, 95.60 MB, 122.61 MB, 149.86 MB, 177.19 MB, 202.99 MB, 228.59 MB, 253.59 MB, 279.40 MB, 306.40 MB, 333.11 MB, 357.76 MB, 385.02 MB, 410.81 MB, 438.37 MB, 461.70 MB, 487.16 MB, 510.40 MB, 527.42 MB, 546.36 MB, 568.71 MB, 586.97 MB, 599.56 MB, 619.44 MB, 635.73 MB, 649.74 MB, 654.34 MB, 663.10 MB, 676.30 MB, 681.88 MB, 690.59 MB, 699.47 MB, 704.90 MB, 704.91 MB, 704.91 MB, 704.91 MB, 704.91 MB - BytesReceived: 704.91 MB (739153839) - ConvertRowBatchTime: 849.425ms - DeserializeRowBatchTimer: 5s770ms - FirstBatchArrivalWaitTime: 762.581ms - PeakMemoryUsage: 0 - RowsReturned: 76.11M (76110875) - RowsReturnedRate: 558.99 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=24):(Total: 1s715ms, non-child: 3.653us, % non-child: 0.00%) BytesReceived(16s000ms): 8.63 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.24 MB, 10.29 MB, 10.36 MB - BytesReceived: 10.45 MB (10955461) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 73.990ms - FirstBatchArrivalWaitTime: 1s715ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:31b (host=vc1502.foo:22000):(Total: 57.169ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 1.03 GB, 7.20 GB, 14.07 GB, 20.59 GB, 27.33 GB, 34.11 GB, 40.96 GB, 47.83 GB, 54.25 GB, 60.72 GB, 66.96 GB, 73.42 GB, 80.22 GB, 86.62 GB, 92.96 GB, 99.70 GB, 106.21 GB, 112.84 GB, 119.09 GB, 125.34 GB, 131.47 GB, 135.76 GB, 140.42 GB, 146.14 GB, 150.82 GB, 154.13 GB, 156.88 GB, 152.24 GB, 155.65 GB, 156.46 GB, 159.18 GB, 150.81 GB, 151.87 GB, 154.03 GB, 155.70 GB, 149.30 GB, 154.01 GB, 154.98 GB, 152.23 GB, 153.77 GB ThreadUsage(16s000ms): 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.03 - BloomFilterBytes: 49.00 MB (51380224) - PeakMemoryUsage: 160.61 GB (172448837699) - PerHostPeakMemUsage: 169.57 GB (182069848181) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 2m20s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 1.63K (1629) - TotalThreadsTotalWallClockTime: 21s902ms - TotalThreadsSysTime: 2s414ms - TotalThreadsUserTime: 8s086ms - TotalThreadsVoluntaryContextSwitches: 21.02K (21017) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 57.062ms - ExecTreePrepareTime: 766.320us DataStreamSender (dst_id=28):(Total: 1.051ms, non-child: 1.051ms, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.05 MB (1105280) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 641.748ms, non-child: 641.748ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 200.109ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 122 (122) - NumInstructions: 8.95K (8951) - OptimizationTime: 417.479ms - PeakMemoryUsage: 4.37 MB (4582912) - PrepareTime: 23.749ms HASH_JOIN_NODE (id=15):(Total: 1.430ms, non-child: 1.019ms, % non-child: 71.32%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 451.92K (451915) - BuildTime: 133.051ms - PeakMemoryUsage: 153.09 MB (160524544) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=15): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 97.919ms - BuildRowsPartitioned: 451.92K (451915) - GetNewBlockTime: 347.919us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 32.796ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160449664) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=26):(Total: 2s053ms, non-child: 24.419ms, % non-child: 1.19%) BytesReceived(16s000ms): 5.50 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB - BytesReceived: 6.21 MB (6513198) - ConvertRowBatchTime: 11.785ms - DeserializeRowBatchTimer: 50.464ms - FirstBatchArrivalWaitTime: 1s185ms - PeakMemoryUsage: 0 - RowsReturned: 451.92K (451915) - RowsReturnedRate: 220.04 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=14):(Total: 1.083ms, non-child: 996.738us, % non-child: 92.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 460.14K (460145) - BuildTime: 155.485ms - PeakMemoryUsage: 25.08 MB (26298624) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 85.751ms - BuildRowsPartitioned: 460.14K (460145) - GetNewBlockTime: 238.070us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 29.960ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 25.02 MB (26231936) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 4s115ms, non-child: 16.998ms, % non-child: 0.41%) BytesReceived(16s000ms): 6.02 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB - BytesReceived: 7.35 MB (7706630) - ConvertRowBatchTime: 12.249ms - DeserializeRowBatchTimer: 17.647ms - FirstBatchArrivalWaitTime: 2s096ms - PeakMemoryUsage: 0 - RowsReturned: 460.14K (460145) - RowsReturnedRate: 111.81 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=13):(Total: 776.503us, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 3.97B (3974294766) - BuildTime: 5m58s - PeakMemoryUsage: 157.31 GB (168914159840) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled, Spilled Runtime filters: 0 of 1 Runtime Filter Published, 1 Disabled - BuildRowsPartitionTime: 5m57s - BuildRowsPartitioned: 3.97B (3974294766) - GetNewBlockTime: 32s020ms - HashBuckets: 536.87M (536870912) - HashCollisions: 0 (0) - HashTablesBuildTime: 45s932ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 157.31 GB (168914068608) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 4 (4) - UnpinTime: 300.581ms HASH_JOIN_NODE (id=12):(Total: 3m24s, non-child: 1m11s, % non-child: 34.72%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 40.26M (40255361) - BuildTime: 8s682ms - PeakMemoryUsage: 3.02 GB (3240188520) - ProbeRows: 75.10M (75095273) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1m1s - RowsReturned: 3.97B (3974294766) - RowsReturnedRate: 19.41 M/sec Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 5s697ms - BuildRowsPartitioned: 40.26M (40255361) - GetNewBlockTime: 3.362ms - HashBuckets: 67.11M (67108864) - HashCollisions: 0 (0) - HashTablesBuildTime: 2s931ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 3.02 GB (3240125568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 6s636ms, non-child: 1s595ms, % non-child: 24.05%) BytesReceived(16s000ms): 218.15 MB, 381.24 MB, 381.24 MB, 381.24 MB, 381.24 MB, 381.24 MB, 381.24 MB, 381.24 MB, 381.24 MB, 381.24 MB, 381.24 MB, 381.24 MB, 381.24 MB, 381.24 MB, 381.24 MB, 381.24 MB, 381.24 MB, 381.24 MB, 381.24 MB, 381.24 MB, 381.24 MB, 381.24 MB, 381.24 MB, 381.24 MB, 381.24 MB, 381.24 MB, 381.24 MB, 381.24 MB, 381.24 MB, 381.24 MB, 381.24 MB, 381.24 MB, 381.24 MB, 381.24 MB, 381.24 MB, 381.24 MB, 381.24 MB, 381.24 MB, 381.24 MB, 381.24 MB - BytesReceived: 381.24 MB (399755421) - ConvertRowBatchTime: 952.096ms - DeserializeRowBatchTimer: 1s566ms - FirstBatchArrivalWaitTime: 1s117ms - PeakMemoryUsage: 0 - RowsReturned: 40.26M (40255361) - RowsReturnedRate: 6.07 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=22):(Total: 2m7s, non-child: 1s343ms, % non-child: 1.05%) BytesReceived(16s000ms): 2.13 MB, 15.67 MB, 41.97 MB, 67.56 MB, 93.99 MB, 120.53 MB, 147.37 MB, 174.33 MB, 199.88 MB, 225.09 MB, 249.74 MB, 275.22 MB, 301.75 MB, 327.81 MB, 351.94 MB, 378.67 MB, 404.02 MB, 431.09 MB, 454.04 MB, 478.99 MB, 502.26 MB, 519.24 MB, 537.91 MB, 560.34 MB, 578.50 MB, 590.97 MB, 610.49 MB, 626.66 MB, 640.82 MB, 646.52 MB, 655.95 MB, 668.63 MB, 673.37 MB, 683.17 MB, 691.58 MB, 695.59 MB, 695.59 MB, 695.59 MB, 695.59 MB, 695.59 MB - BytesReceived: 695.59 MB (729375541) - ConvertRowBatchTime: 813.965ms - DeserializeRowBatchTimer: 5s187ms - FirstBatchArrivalWaitTime: 767.492ms - PeakMemoryUsage: 0 - RowsReturned: 75.10M (75095273) - RowsReturnedRate: 587.72 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=24):(Total: 1s710ms, non-child: 3.558us, % non-child: 0.00%) BytesReceived(16s000ms): 8.72 MB, 10.33 MB, 10.33 MB, 10.33 MB, 10.33 MB, 10.33 MB, 10.33 MB, 10.33 MB, 10.33 MB, 10.33 MB, 10.33 MB, 10.33 MB, 10.33 MB, 10.33 MB, 10.33 MB, 10.33 MB, 10.33 MB, 10.33 MB, 10.33 MB, 10.33 MB, 10.33 MB, 10.33 MB, 10.33 MB, 10.33 MB, 10.33 MB, 10.33 MB, 10.33 MB, 10.33 MB, 10.33 MB, 10.33 MB, 10.33 MB, 10.33 MB, 10.33 MB, 10.33 MB, 10.33 MB, 10.33 MB, 10.33 MB, 10.38 MB, 10.48 MB, 10.50 MB - BytesReceived: 10.65 MB (11165621) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 71.732ms - FirstBatchArrivalWaitTime: 1s710ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:35a (host=vd1111.foo:22000):(Total: 57.088ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 1003.49 MB, 7.18 GB, 14.39 GB, 21.10 GB, 28.05 GB, 35.07 GB, 42.13 GB, 49.13 GB, 55.70 GB, 62.31 GB, 68.75 GB, 75.39 GB, 82.38 GB, 89.05 GB, 95.30 GB, 102.21 GB, 109.20 GB, 116.39 GB, 122.86 GB, 129.55 GB, 135.54 GB, 139.96 GB, 144.86 GB, 150.64 GB, 155.37 GB, 157.65 GB, 152.55 GB, 156.32 GB, 158.86 GB, 156.36 GB, 151.34 GB, 153.20 GB, 155.45 GB, 156.69 GB, 159.25 GB, 154.54 GB, 154.72 GB, 156.48 GB, 156.66 GB, 158.09 GB ThreadUsage(16s000ms): 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.03 - BloomFilterBytes: 49.00 MB (51380224) - PeakMemoryUsage: 160.60 GB (172437589471) - PerHostPeakMemUsage: 169.55 GB (182051211814) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 2m2s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 1.57K (1571) - TotalThreadsTotalWallClockTime: 22s239ms - TotalThreadsSysTime: 2s172ms - TotalThreadsUserTime: 8s034ms - TotalThreadsVoluntaryContextSwitches: 22.22K (22223) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 56.985ms - ExecTreePrepareTime: 638.098us DataStreamSender (dst_id=28):(Total: 791.423us, non-child: 791.423us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.05 MB (1105280) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 639.173ms, non-child: 639.173ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 212.111ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 122 (122) - NumInstructions: 8.95K (8951) - OptimizationTime: 401.452ms - PeakMemoryUsage: 4.37 MB (4582912) - PrepareTime: 25.103ms HASH_JOIN_NODE (id=15):(Total: 1.195ms, non-child: 872.009us, % non-child: 72.93%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 451.92K (451915) - BuildTime: 129.880ms - PeakMemoryUsage: 153.09 MB (160524544) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=15): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 96.809ms - BuildRowsPartitioned: 451.92K (451915) - GetNewBlockTime: 445.966us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 29.802ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160449664) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=26):(Total: 2s033ms, non-child: 27.688ms, % non-child: 1.36%) BytesReceived(16s000ms): 5.50 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB - BytesReceived: 6.21 MB (6513198) - ConvertRowBatchTime: 12.596ms - DeserializeRowBatchTimer: 52.306ms - FirstBatchArrivalWaitTime: 1s175ms - PeakMemoryUsage: 0 - RowsReturned: 451.92K (451915) - RowsReturnedRate: 222.28 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=14):(Total: 943.999us, non-child: 830.677us, % non-child: 88.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 459.75K (459752) - BuildTime: 170.866ms - PeakMemoryUsage: 25.08 MB (26298624) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 100.344ms - BuildRowsPartitioned: 459.75K (459752) - GetNewBlockTime: 216.979us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 25.083ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 25.02 MB (26231936) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 4s143ms, non-child: 16.066ms, % non-child: 0.39%) BytesReceived(16s000ms): 6.01 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB - BytesReceived: 7.34 MB (7700644) - ConvertRowBatchTime: 12.402ms - DeserializeRowBatchTimer: 15.332ms - FirstBatchArrivalWaitTime: 2s083ms - PeakMemoryUsage: 0 - RowsReturned: 459.75K (459752) - RowsReturnedRate: 110.96 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=13):(Total: 720.848us, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 4.08B (4081561814) - BuildTime: 6m14s - PeakMemoryUsage: 159.36 GB (171113154816) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled, Spilled Runtime filters: 0 of 1 Runtime Filter Published, 1 Disabled - BuildRowsPartitionTime: 6m14s - BuildRowsPartitioned: 4.08B (4081561814) - GetNewBlockTime: 36s615ms - HashBuckets: 536.87M (536870912) - HashCollisions: 0 (0) - HashTablesBuildTime: 44s220ms - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 159.36 GB (171113096320) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 4 (4) - UnpinTime: 268.387ms HASH_JOIN_NODE (id=12):(Total: 3m8s, non-child: 1m12s, % non-child: 38.55%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 40.23M (40229089) - BuildTime: 8s413ms - PeakMemoryUsage: 3.02 GB (3240188128) - ProbeRows: 76.93M (76928541) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1m3s - RowsReturned: 4.08B (4081561814) - RowsReturnedRate: 21.67 M/sec Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 5s522ms - BuildRowsPartitioned: 40.23M (40229089) - GetNewBlockTime: 3.181ms - HashBuckets: 67.11M (67108864) - HashCollisions: 0 (0) - HashTablesBuildTime: 2s845ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 3.02 GB (3240125568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 7s255ms, non-child: 1s514ms, % non-child: 20.87%) BytesReceived(16s000ms): 218.07 MB, 380.99 MB, 380.99 MB, 380.99 MB, 380.99 MB, 380.99 MB, 380.99 MB, 380.99 MB, 380.99 MB, 380.99 MB, 380.99 MB, 380.99 MB, 380.99 MB, 380.99 MB, 380.99 MB, 380.99 MB, 380.99 MB, 380.99 MB, 380.99 MB, 380.99 MB, 380.99 MB, 380.99 MB, 380.99 MB, 380.99 MB, 380.99 MB, 380.99 MB, 380.99 MB, 380.99 MB, 380.99 MB, 380.99 MB, 380.99 MB, 380.99 MB, 380.99 MB, 380.99 MB, 380.99 MB, 380.99 MB, 380.99 MB, 380.99 MB, 380.99 MB, 380.99 MB - BytesReceived: 380.99 MB (399491774) - ConvertRowBatchTime: 961.114ms - DeserializeRowBatchTimer: 1s436ms - FirstBatchArrivalWaitTime: 1s104ms - PeakMemoryUsage: 0 - RowsReturned: 40.23M (40229089) - RowsReturnedRate: 5.54 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=22):(Total: 1m49s, non-child: 1s340ms, % non-child: 1.23%) BytesReceived(16s000ms): 2.11 MB, 16.14 MB, 43.18 MB, 69.40 MB, 96.64 MB, 124.04 MB, 151.65 MB, 179.02 MB, 204.88 MB, 230.65 MB, 255.94 MB, 282.11 MB, 309.18 MB, 335.70 MB, 360.22 MB, 387.62 MB, 416.62 MB, 444.67 MB, 468.07 MB, 494.69 MB, 516.82 MB, 534.58 MB, 553.70 MB, 576.51 MB, 594.29 MB, 607.11 MB, 627.91 MB, 644.09 MB, 657.01 MB, 661.79 MB, 671.05 MB, 684.15 MB, 689.26 MB, 698.81 MB, 707.49 MB, 712.10 MB, 712.10 MB, 712.10 MB, 712.10 MB, 712.10 MB - BytesReceived: 712.10 MB (746692453) - ConvertRowBatchTime: 848.150ms - DeserializeRowBatchTimer: 7s330ms - FirstBatchArrivalWaitTime: 759.520ms - PeakMemoryUsage: 0 - RowsReturned: 76.93M (76928541) - RowsReturnedRate: 704.16 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=24):(Total: 1s700ms, non-child: 5.991us, % non-child: 0.00%) BytesReceived(16s000ms): 8.63 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.26 MB, 10.33 MB, 10.33 MB - BytesReceived: 10.44 MB (10949152) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 77.568ms - FirstBatchArrivalWaitTime: 1s700ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:319 (host=vc1536.foo:22000):(Total: 56.841ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 1001.34 MB, 7.13 GB, 13.86 GB, 20.35 GB, 27.02 GB, 33.69 GB, 40.42 GB, 47.12 GB, 53.42 GB, 59.75 GB, 65.85 GB, 72.11 GB, 79.15 GB, 85.46 GB, 91.52 GB, 98.29 GB, 104.51 GB, 111.20 GB, 117.10 GB, 123.30 GB, 129.16 GB, 133.35 GB, 137.90 GB, 143.43 GB, 147.97 GB, 151.19 GB, 155.99 GB, 157.67 GB, 152.66 GB, 153.72 GB, 155.64 GB, 158.76 GB, 159.97 GB, 152.82 GB, 152.59 GB, 153.81 GB, 153.93 GB, 147.92 GB, 150.03 GB, 150.91 GB ThreadUsage(16s000ms): 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.03 - BloomFilterBytes: 49.00 MB (51380224) - PeakMemoryUsage: 160.99 GB (172857613583) - PerHostPeakMemUsage: 169.57 GB (182077243467) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 2m59s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 1.30K (1303) - TotalThreadsTotalWallClockTime: 21s443ms - TotalThreadsSysTime: 2s045ms - TotalThreadsUserTime: 7s672ms - TotalThreadsVoluntaryContextSwitches: 24.30K (24304) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 56.790ms - ExecTreePrepareTime: 444.774us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 23.71K (23714) - BlocksRecycled: 614 (614) - BufferedPins: 0 (0) - BytesWritten: 47.13 GB (50608472064) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 161.38 GB (173283483648) - ScratchFileUsedBytes: 47.13 GB (50608472064) - TotalBufferWaitTime: 12s605ms - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=28):(Total: 808.674us, non-child: 808.674us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.05 MB (1105280) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 638.922ms, non-child: 638.922ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 204.788ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 122 (122) - NumInstructions: 8.95K (8951) - OptimizationTime: 406.093ms - PeakMemoryUsage: 4.37 MB (4582912) - PrepareTime: 27.450ms HASH_JOIN_NODE (id=15):(Total: 844.982us, non-child: 807.929us, % non-child: 95.61%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 451.92K (451915) - BuildTime: 132.387ms - PeakMemoryUsage: 153.09 MB (160524544) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=15): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 99.432ms - BuildRowsPartitioned: 451.92K (451915) - GetNewBlockTime: 313.339us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 30.208ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160449664) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=26):(Total: 2s052ms, non-child: 26.917ms, % non-child: 1.31%) BytesReceived(16s000ms): 5.37 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB - BytesReceived: 6.21 MB (6513198) - ConvertRowBatchTime: 12.546ms - DeserializeRowBatchTimer: 50.559ms - FirstBatchArrivalWaitTime: 1s195ms - PeakMemoryUsage: 0 - RowsReturned: 451.92K (451915) - RowsReturnedRate: 220.14 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=14):(Total: 681.156us, non-child: 700.557us, % non-child: 100.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 460.14K (460138) - BuildTime: 146.227ms - PeakMemoryUsage: 25.08 MB (26298624) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 85.322ms - BuildRowsPartitioned: 460.14K (460138) - GetNewBlockTime: 163.233us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 20.049ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 25.02 MB (26231936) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 4s123ms, non-child: 14.894ms, % non-child: 0.36%) BytesReceived(16s000ms): 5.83 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB - BytesReceived: 7.35 MB (7707815) - ConvertRowBatchTime: 11.200ms - DeserializeRowBatchTimer: 16.822ms - FirstBatchArrivalWaitTime: 2s113ms - PeakMemoryUsage: 0 - RowsReturned: 460.14K (460138) - RowsReturnedRate: 111.59 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=13):(Total: 503.446us, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 3.89B (3889370354) - BuildTime: 5m16s - PeakMemoryUsage: 160.55 GB (172387633408) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled, Spilled Runtime filters: 0 of 1 Runtime Filter Published, 1 Disabled - BuildRowsPartitionTime: 5m16s - BuildRowsPartitioned: 3.89B (3889370354) - GetNewBlockTime: 19s409ms - HashBuckets: 1.07B (1073741824) - HashCollisions: 0 (0) - HashTablesBuildTime: 1m19s - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 160.55 GB (172387574912) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 5 (5) - UnpinTime: 273.026ms HASH_JOIN_NODE (id=12):(Total: 4m6s, non-child: 1m14s, % non-child: 30.06%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 40.20M (40196149) - BuildTime: 7s888ms - PeakMemoryUsage: 3.02 GB (3240189466) - ProbeRows: 73.62M (73617147) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1m5s - RowsReturned: 3.89B (3889370354) - RowsReturnedRate: 15.78 M/sec Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 5s365ms - BuildRowsPartitioned: 40.20M (40196149) - GetNewBlockTime: 2.705ms - HashBuckets: 67.11M (67108864) - HashCollisions: 0 (0) - HashTablesBuildTime: 2s470ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 3.02 GB (3240125568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 7s020ms, non-child: 1s686ms, % non-child: 24.03%) BytesReceived(16s000ms): 208.57 MB, 380.69 MB, 380.69 MB, 380.69 MB, 380.69 MB, 380.69 MB, 380.69 MB, 380.69 MB, 380.69 MB, 380.69 MB, 380.69 MB, 380.69 MB, 380.69 MB, 380.69 MB, 380.69 MB, 380.69 MB, 380.69 MB, 380.69 MB, 380.69 MB, 380.69 MB, 380.69 MB, 380.69 MB, 380.69 MB, 380.69 MB, 380.69 MB, 380.69 MB, 380.69 MB, 380.69 MB, 380.69 MB, 380.69 MB, 380.69 MB, 380.69 MB, 380.69 MB, 380.69 MB, 380.69 MB, 380.69 MB, 380.69 MB, 380.69 MB, 380.69 MB, 380.69 MB - BytesReceived: 380.69 MB (399186938) - ConvertRowBatchTime: 986.096ms - DeserializeRowBatchTimer: 1s754ms - FirstBatchArrivalWaitTime: 1s117ms - PeakMemoryUsage: 0 - RowsReturned: 40.20M (40196149) - RowsReturnedRate: 5.73 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=22):(Total: 2m46s, non-child: 1s467ms, % non-child: 0.88%) BytesReceived(16s000ms): 2.07 MB, 14.88 MB, 41.09 MB, 66.49 MB, 92.68 MB, 118.89 MB, 145.26 MB, 171.55 MB, 196.43 MB, 221.18 MB, 245.36 MB, 270.93 MB, 297.70 MB, 323.09 MB, 346.52 MB, 372.99 MB, 397.87 MB, 424.40 MB, 446.66 MB, 471.46 MB, 493.66 MB, 510.29 MB, 528.68 MB, 550.26 MB, 567.99 MB, 580.12 MB, 599.36 MB, 615.22 MB, 628.52 MB, 632.99 MB, 641.46 MB, 654.27 MB, 659.56 MB, 668.10 MB, 676.58 MB, 681.75 MB, 681.76 MB, 681.76 MB, 681.76 MB, 681.76 MB - BytesReceived: 681.76 MB (714872491) - ConvertRowBatchTime: 833.153ms - DeserializeRowBatchTimer: 4s952ms - FirstBatchArrivalWaitTime: 781.073ms - PeakMemoryUsage: 0 - RowsReturned: 73.62M (73617147) - RowsReturnedRate: 443.03 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=24):(Total: 1s728ms, non-child: 3.945us, % non-child: 0.00%) BytesReceived(16s000ms): 8.48 MB, 10.35 MB, 10.35 MB, 10.35 MB, 10.35 MB, 10.35 MB, 10.35 MB, 10.35 MB, 10.35 MB, 10.35 MB, 10.35 MB, 10.35 MB, 10.35 MB, 10.35 MB, 10.35 MB, 10.35 MB, 10.35 MB, 10.35 MB, 10.35 MB, 10.35 MB, 10.35 MB, 10.35 MB, 10.35 MB, 10.35 MB, 10.35 MB, 10.35 MB, 10.35 MB, 10.35 MB, 10.35 MB, 10.35 MB, 10.35 MB, 10.35 MB, 10.35 MB, 10.35 MB, 10.35 MB, 10.35 MB, 10.35 MB, 10.37 MB, 10.49 MB, 10.53 MB - BytesReceived: 10.70 MB (11219092) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 71.958ms - FirstBatchArrivalWaitTime: 1s728ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:2fa (host=vc1516.foo:22000):(Total: 56.821ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 1.04 GB, 7.22 GB, 14.02 GB, 20.51 GB, 27.28 GB, 34.07 GB, 40.89 GB, 47.69 GB, 54.08 GB, 60.46 GB, 66.66 GB, 73.00 GB, 79.74 GB, 86.10 GB, 92.57 GB, 99.69 GB, 106.06 GB, 112.55 GB, 118.71 GB, 124.94 GB, 130.91 GB, 135.07 GB, 139.98 GB, 145.63 GB, 150.16 GB, 153.38 GB, 157.32 GB, 151.84 GB, 155.01 GB, 155.89 GB, 158.24 GB, 153.03 GB, 150.96 GB, 153.13 GB, 154.62 GB, 151.23 GB, 151.70 GB, 154.19 GB, 152.52 GB, 152.32 GB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.03 - BloomFilterBytes: 49.00 MB (51380224) - PeakMemoryUsage: 160.60 GB (172441960839) - PerHostPeakMemUsage: 169.57 GB (182072988562) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 2m1s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 1.44K (1441) - TotalThreadsTotalWallClockTime: 21s693ms - TotalThreadsSysTime: 2s077ms - TotalThreadsUserTime: 8s238ms - TotalThreadsVoluntaryContextSwitches: 22.47K (22469) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 56.772ms - ExecTreePrepareTime: 598.762us DataStreamSender (dst_id=28):(Total: 884.480us, non-child: 884.480us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.05 MB (1105280) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 646.712ms, non-child: 646.712ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 206.007ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 122 (122) - NumInstructions: 8.95K (8951) - OptimizationTime: 415.244ms - PeakMemoryUsage: 4.37 MB (4582912) - PrepareTime: 25.035ms HASH_JOIN_NODE (id=15):(Total: 1.150ms, non-child: 866.665us, % non-child: 75.36%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 451.92K (451915) - BuildTime: 116.856ms - PeakMemoryUsage: 153.09 MB (160524544) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=15): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 88.314ms - BuildRowsPartitioned: 451.92K (451915) - GetNewBlockTime: 291.919us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 26.384ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160449664) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=26):(Total: 2s065ms, non-child: 28.124ms, % non-child: 1.36%) BytesReceived(16s000ms): 5.49 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB - BytesReceived: 6.21 MB (6513198) - ConvertRowBatchTime: 11.005ms - DeserializeRowBatchTimer: 58.563ms - FirstBatchArrivalWaitTime: 1s193ms - PeakMemoryUsage: 0 - RowsReturned: 451.92K (451915) - RowsReturnedRate: 218.75 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=14):(Total: 911.383us, non-child: 839.040us, % non-child: 92.06%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 460.00K (459998) - BuildTime: 142.809ms - PeakMemoryUsage: 25.08 MB (26298624) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 87.200ms - BuildRowsPartitioned: 460.00K (459998) - GetNewBlockTime: 146.238us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 26.110ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 25.02 MB (26231936) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 4s101ms, non-child: 15.133ms, % non-child: 0.37%) BytesReceived(16s000ms): 6.01 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB - BytesReceived: 7.35 MB (7703422) - ConvertRowBatchTime: 11.184ms - DeserializeRowBatchTimer: 17.785ms - FirstBatchArrivalWaitTime: 2s099ms - PeakMemoryUsage: 0 - RowsReturned: 460.00K (459998) - RowsReturnedRate: 112.14 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=13):(Total: 641.233us, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 3.94B (3942658765) - BuildTime: 6m15s - PeakMemoryUsage: 157.31 GB (168914159840) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled, Spilled Runtime filters: 0 of 1 Runtime Filter Published, 1 Disabled - BuildRowsPartitionTime: 6m14s - BuildRowsPartitioned: 3.94B (3942658765) - GetNewBlockTime: 39s798ms - HashBuckets: 536.87M (536870912) - HashCollisions: 0 (0) - HashTablesBuildTime: 57s337ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 157.31 GB (168914068608) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 4 (4) - UnpinTime: 373.713ms HASH_JOIN_NODE (id=12):(Total: 3m9s, non-child: 1m14s, % non-child: 39.36%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 40.24M (40235203) - BuildTime: 8s524ms - PeakMemoryUsage: 3.02 GB (3240191502) - ProbeRows: 74.49M (74487267) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1m5s - RowsReturned: 3.94B (3942658765) - RowsReturnedRate: 20.79 M/sec Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 5s694ms - BuildRowsPartitioned: 40.24M (40235203) - GetNewBlockTime: 3.408ms - HashBuckets: 67.11M (67108864) - HashCollisions: 0 (0) - HashTablesBuildTime: 2s786ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 3.02 GB (3240125568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 6s649ms, non-child: 1s678ms, % non-child: 25.24%) BytesReceived(16s000ms): 217.75 MB, 381.03 MB, 381.03 MB, 381.03 MB, 381.03 MB, 381.03 MB, 381.03 MB, 381.03 MB, 381.03 MB, 381.03 MB, 381.03 MB, 381.03 MB, 381.03 MB, 381.03 MB, 381.03 MB, 381.03 MB, 381.03 MB, 381.03 MB, 381.03 MB, 381.03 MB, 381.03 MB, 381.03 MB, 381.03 MB, 381.03 MB, 381.03 MB, 381.03 MB, 381.03 MB, 381.03 MB, 381.03 MB, 381.03 MB, 381.03 MB, 381.03 MB, 381.03 MB, 381.03 MB, 381.03 MB, 381.03 MB, 381.03 MB, 381.03 MB, 381.03 MB, 381.03 MB - BytesReceived: 381.03 MB (399534023) - ConvertRowBatchTime: 963.126ms - DeserializeRowBatchTimer: 1s736ms - FirstBatchArrivalWaitTime: 1s117ms - PeakMemoryUsage: 0 - RowsReturned: 40.24M (40235203) - RowsReturnedRate: 6.05 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=22):(Total: 1m49s, non-child: 1s399ms, % non-child: 1.28%) BytesReceived(16s000ms): 2.10 MB, 15.59 MB, 41.77 MB, 67.17 MB, 93.68 MB, 120.23 MB, 146.96 MB, 173.69 MB, 198.88 MB, 223.78 MB, 248.34 MB, 273.61 MB, 299.84 MB, 325.66 MB, 352.28 MB, 378.99 MB, 403.90 MB, 430.63 MB, 453.22 MB, 478.97 MB, 500.68 MB, 517.93 MB, 536.50 MB, 558.62 MB, 576.03 MB, 588.45 MB, 608.45 MB, 624.21 MB, 636.76 MB, 641.40 MB, 650.26 MB, 663.00 MB, 667.94 MB, 676.97 MB, 685.45 MB, 689.97 MB, 689.97 MB, 689.97 MB, 689.97 MB, 689.97 MB - BytesReceived: 689.97 MB (723487793) - ConvertRowBatchTime: 867.760ms - DeserializeRowBatchTimer: 6s548ms - FirstBatchArrivalWaitTime: 781.638ms - PeakMemoryUsage: 0 - RowsReturned: 74.49M (74487267) - RowsReturnedRate: 682.69 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=24):(Total: 1s722ms, non-child: 3.953us, % non-child: 0.00%) BytesReceived(16s000ms): 8.60 MB, 10.19 MB, 10.19 MB, 10.19 MB, 10.19 MB, 10.19 MB, 10.19 MB, 10.19 MB, 10.19 MB, 10.19 MB, 10.19 MB, 10.19 MB, 10.19 MB, 10.19 MB, 10.19 MB, 10.19 MB, 10.19 MB, 10.19 MB, 10.19 MB, 10.19 MB, 10.19 MB, 10.19 MB, 10.19 MB, 10.19 MB, 10.19 MB, 10.19 MB, 10.19 MB, 10.19 MB, 10.19 MB, 10.19 MB, 10.19 MB, 10.19 MB, 10.19 MB, 10.19 MB, 10.19 MB, 10.19 MB, 10.19 MB, 10.26 MB, 10.32 MB, 10.33 MB - BytesReceived: 10.37 MB (10874171) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 71.413ms - FirstBatchArrivalWaitTime: 1s722ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:363 (host=vc1535.foo:22000):(Total: 56.714ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 990.93 MB, 7.17 GB, 14.13 GB, 20.71 GB, 27.54 GB, 34.41 GB, 41.34 GB, 48.20 GB, 54.67 GB, 61.16 GB, 67.66 GB, 74.54 GB, 81.37 GB, 87.95 GB, 94.15 GB, 101.07 GB, 107.63 GB, 114.61 GB, 120.59 GB, 127.08 GB, 133.01 GB, 137.34 GB, 142.13 GB, 147.81 GB, 152.51 GB, 155.81 GB, 155.79 GB, 154.19 GB, 157.53 GB, 158.35 GB, 155.87 GB, 152.45 GB, 153.38 GB, 155.66 GB, 157.42 GB, 155.81 GB, 155.63 GB, 156.01 GB, 154.39 GB, 155.31 GB ThreadUsage(16s000ms): 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.03 - BloomFilterBytes: 49.00 MB (51380224) - PeakMemoryUsage: 160.59 GB (172437532927) - PerHostPeakMemUsage: 169.57 GB (182070261522) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 2m23s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 1.72K (1715) - TotalThreadsTotalWallClockTime: 22s100ms - TotalThreadsSysTime: 2s119ms - TotalThreadsUserTime: 7s951ms - TotalThreadsVoluntaryContextSwitches: 21.95K (21948) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 56.662ms - ExecTreePrepareTime: 582.278us DataStreamSender (dst_id=28):(Total: 741.728us, non-child: 741.728us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.05 MB (1105280) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 651.032ms, non-child: 651.032ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 212.928ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 122 (122) - NumInstructions: 8.95K (8951) - OptimizationTime: 412.966ms - PeakMemoryUsage: 4.37 MB (4582912) - PrepareTime: 24.746ms HASH_JOIN_NODE (id=15):(Total: 1.105ms, non-child: 862.823us, % non-child: 78.04%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 451.92K (451915) - BuildTime: 131.401ms - PeakMemoryUsage: 153.09 MB (160524544) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=15): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 96.867ms - BuildRowsPartitioned: 451.92K (451915) - GetNewBlockTime: 523.842us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 31.615ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160449664) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=26):(Total: 2s024ms, non-child: 26.125ms, % non-child: 1.29%) BytesReceived(16s000ms): 5.44 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB - BytesReceived: 6.21 MB (6513198) - ConvertRowBatchTime: 12.000ms - DeserializeRowBatchTimer: 52.780ms - FirstBatchArrivalWaitTime: 1s161ms - PeakMemoryUsage: 0 - RowsReturned: 451.92K (451915) - RowsReturnedRate: 223.22 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=14):(Total: 861.554us, non-child: 869.560us, % non-child: 100.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 460.03K (460027) - BuildTime: 153.317ms - PeakMemoryUsage: 25.08 MB (26298624) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 99.857ms - BuildRowsPartitioned: 460.03K (460027) - GetNewBlockTime: 176.253us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 19.407ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 25.02 MB (26231936) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 4s140ms, non-child: 15.739ms, % non-child: 0.38%) BytesReceived(16s000ms): 5.97 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB - BytesReceived: 7.35 MB (7705276) - ConvertRowBatchTime: 11.515ms - DeserializeRowBatchTimer: 16.223ms - FirstBatchArrivalWaitTime: 2s074ms - PeakMemoryUsage: 0 - RowsReturned: 460.03K (460027) - RowsReturnedRate: 111.10 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=13):(Total: 594.465us, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 4.01B (4013580202) - BuildTime: 6m1s - PeakMemoryUsage: 158.56 GB (170248538368) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled, Spilled Runtime filters: 0 of 1 Runtime Filter Published, 1 Disabled - BuildRowsPartitionTime: 6m1s - BuildRowsPartitioned: 4.01B (4013580202) - GetNewBlockTime: 45s612ms - HashBuckets: 536.87M (536870912) - HashCollisions: 0 (0) - HashTablesBuildTime: 35s796ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 158.56 GB (170248479872) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 4 (4) - UnpinTime: 250.480ms HASH_JOIN_NODE (id=12):(Total: 3m27s, non-child: 1m11s, % non-child: 34.18%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 40.19M (40192405) - BuildTime: 8s311ms - PeakMemoryUsage: 3.02 GB (3240188128) - ProbeRows: 75.82M (75820284) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1m1s - RowsReturned: 4.01B (4013580202) - RowsReturnedRate: 19.30 M/sec Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 5s543ms - BuildRowsPartitioned: 40.19M (40192405) - GetNewBlockTime: 2.621ms - HashBuckets: 67.11M (67108864) - HashCollisions: 0 (0) - HashTablesBuildTime: 2s712ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 3.02 GB (3240125568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 7s246ms, non-child: 1s482ms, % non-child: 20.46%) BytesReceived(16s000ms): 215.93 MB, 380.64 MB, 380.64 MB, 380.64 MB, 380.64 MB, 380.64 MB, 380.64 MB, 380.64 MB, 380.64 MB, 380.64 MB, 380.64 MB, 380.64 MB, 380.64 MB, 380.64 MB, 380.64 MB, 380.64 MB, 380.64 MB, 380.64 MB, 380.64 MB, 380.64 MB, 380.64 MB, 380.64 MB, 380.64 MB, 380.64 MB, 380.64 MB, 380.64 MB, 380.64 MB, 380.64 MB, 380.64 MB, 380.64 MB, 380.64 MB, 380.64 MB, 380.64 MB, 380.64 MB, 380.64 MB, 380.64 MB, 380.64 MB, 380.64 MB, 380.64 MB, 380.64 MB - BytesReceived: 380.64 MB (399126067) - ConvertRowBatchTime: 970.899ms - DeserializeRowBatchTimer: 1s398ms - FirstBatchArrivalWaitTime: 1s084ms - PeakMemoryUsage: 0 - RowsReturned: 40.19M (40192405) - RowsReturnedRate: 5.55 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=22):(Total: 2m10s, non-child: 1s255ms, % non-child: 0.96%) BytesReceived(16s000ms): 2.12 MB, 15.68 MB, 42.21 MB, 67.96 MB, 94.75 MB, 121.59 MB, 148.76 MB, 175.84 MB, 201.41 MB, 226.78 MB, 253.01 MB, 279.47 MB, 306.20 MB, 332.49 MB, 356.69 MB, 384.13 MB, 409.86 MB, 437.20 MB, 460.00 MB, 485.70 MB, 508.31 MB, 525.59 MB, 544.64 MB, 567.08 MB, 585.16 MB, 597.71 MB, 617.64 MB, 633.69 MB, 647.24 MB, 651.86 MB, 660.72 MB, 673.89 MB, 679.21 MB, 688.27 MB, 697.04 MB, 702.20 MB, 702.21 MB, 702.21 MB, 702.21 MB, 702.21 MB - BytesReceived: 702.21 MB (736317136) - ConvertRowBatchTime: 820.585ms - DeserializeRowBatchTimer: 6s370ms - FirstBatchArrivalWaitTime: 748.886ms - PeakMemoryUsage: 0 - RowsReturned: 75.82M (75820284) - RowsReturnedRate: 581.42 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=24):(Total: 1s670ms, non-child: 3.043us, % non-child: 0.00%) BytesReceived(16s000ms): 8.90 MB, 10.55 MB, 10.55 MB, 10.55 MB, 10.55 MB, 10.55 MB, 10.55 MB, 10.55 MB, 10.55 MB, 10.55 MB, 10.55 MB, 10.55 MB, 10.55 MB, 10.55 MB, 10.55 MB, 10.55 MB, 10.55 MB, 10.55 MB, 10.55 MB, 10.55 MB, 10.55 MB, 10.55 MB, 10.55 MB, 10.55 MB, 10.55 MB, 10.55 MB, 10.55 MB, 10.55 MB, 10.55 MB, 10.55 MB, 10.55 MB, 10.55 MB, 10.55 MB, 10.55 MB, 10.55 MB, 10.55 MB, 10.55 MB, 10.58 MB, 10.74 MB, 10.74 MB - BytesReceived: 11.09 MB (11632145) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 66.680ms - FirstBatchArrivalWaitTime: 1s670ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:30c (host=vd1335.foo:22000):(Total: 56.415ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 980.10 MB, 7.08 GB, 13.95 GB, 20.46 GB, 27.22 GB, 34.00 GB, 40.82 GB, 47.41 GB, 54.04 GB, 60.55 GB, 66.88 GB, 73.75 GB, 80.48 GB, 87.09 GB, 93.11 GB, 99.98 GB, 106.51 GB, 113.44 GB, 119.37 GB, 125.74 GB, 131.61 GB, 135.81 GB, 140.51 GB, 146.09 GB, 150.72 GB, 153.95 GB, 157.46 GB, 151.94 GB, 155.25 GB, 156.18 GB, 158.45 GB, 153.63 GB, 151.05 GB, 152.88 GB, 154.78 GB, 150.74 GB, 152.09 GB, 152.82 GB, 151.59 GB, 153.08 GB ThreadUsage(16s000ms): 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.03 - BloomFilterBytes: 49.00 MB (51380224) - PeakMemoryUsage: 160.99 GB (172861192223) - PerHostPeakMemUsage: 169.54 GB (182040960593) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 2m28s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 1.69K (1693) - TotalThreadsTotalWallClockTime: 21s636ms - TotalThreadsSysTime: 2s197ms - TotalThreadsUserTime: 8s085ms - TotalThreadsVoluntaryContextSwitches: 21.26K (21260) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 56.348ms - ExecTreePrepareTime: 529.099us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 23.95K (23945) - BlocksRecycled: 354 (354) - BufferedPins: 0 (0) - BytesWritten: 40.94 GB (43956305920) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 161.38 GB (173283483648) - ScratchFileUsedBytes: 40.94 GB (43956305920) - TotalBufferWaitTime: 2s702ms - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=28):(Total: 759.699us, non-child: 759.699us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.05 MB (1105280) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 664.682ms, non-child: 664.682ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 206.032ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 122 (122) - NumInstructions: 8.95K (8951) - OptimizationTime: 432.397ms - PeakMemoryUsage: 4.37 MB (4582912) - PrepareTime: 25.719ms HASH_JOIN_NODE (id=15):(Total: 1.006ms, non-child: 993.153us, % non-child: 98.66%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 451.92K (451915) - BuildTime: 152.457ms - PeakMemoryUsage: 153.09 MB (160524544) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=15): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 115.763ms - BuildRowsPartitioned: 451.92K (451915) - GetNewBlockTime: 425.634us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 33.776ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160449664) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=26):(Total: 2s008ms, non-child: 28.528ms, % non-child: 1.42%) BytesReceived(16s000ms): 5.36 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB - BytesReceived: 6.21 MB (6513198) - ConvertRowBatchTime: 13.230ms - DeserializeRowBatchTimer: 57.461ms - FirstBatchArrivalWaitTime: 1s168ms - PeakMemoryUsage: 0 - RowsReturned: 451.92K (451915) - RowsReturnedRate: 225.03 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=14):(Total: 813.721us, non-child: 1.036ms, % non-child: 100.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 459.16K (459161) - BuildTime: 177.321ms - PeakMemoryUsage: 25.08 MB (26298624) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 113.013ms - BuildRowsPartitioned: 459.16K (459161) - GetNewBlockTime: 214.419us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 22.801ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 25.02 MB (26231936) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 4s059ms, non-child: 17.100ms, % non-child: 0.42%) BytesReceived(16s000ms): 5.81 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB - BytesReceived: 7.33 MB (7690929) - ConvertRowBatchTime: 12.757ms - DeserializeRowBatchTimer: 16.741ms - FirstBatchArrivalWaitTime: 2s076ms - PeakMemoryUsage: 0 - RowsReturned: 459.16K (459161) - RowsReturnedRate: 113.10 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=13):(Total: 468.245us, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 3.96B (3962222783) - BuildTime: 5m48s - PeakMemoryUsage: 157.70 GB (169333590240) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled, Spilled Runtime filters: 0 of 1 Runtime Filter Published, 1 Disabled - BuildRowsPartitionTime: 5m48s - BuildRowsPartitioned: 3.96B (3962222783) - GetNewBlockTime: 27s522ms - HashBuckets: 536.87M (536870912) - HashCollisions: 0 (0) - HashTablesBuildTime: 42s832ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 157.70 GB (169333499008) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 4 (4) - UnpinTime: 242.205ms HASH_JOIN_NODE (id=12):(Total: 3m33s, non-child: 1m11s, % non-child: 33.35%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 40.22M (40224656) - BuildTime: 8s503ms - PeakMemoryUsage: 3.02 GB (3240190010) - ProbeRows: 74.32M (74319873) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1m1s - RowsReturned: 3.96B (3962222783) - RowsReturnedRate: 18.55 M/sec Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 5s696ms - BuildRowsPartitioned: 40.22M (40224656) - GetNewBlockTime: 3.833ms - HashBuckets: 67.11M (67108864) - HashCollisions: 0 (0) - HashTablesBuildTime: 2s763ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 3.02 GB (3240125568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 6s631ms, non-child: 1s521ms, % non-child: 22.94%) BytesReceived(16s000ms): 208.56 MB, 380.94 MB, 380.94 MB, 380.94 MB, 380.94 MB, 380.94 MB, 380.94 MB, 380.94 MB, 380.94 MB, 380.94 MB, 380.94 MB, 380.94 MB, 380.94 MB, 380.94 MB, 380.94 MB, 380.94 MB, 380.94 MB, 380.94 MB, 380.94 MB, 380.94 MB, 380.94 MB, 380.94 MB, 380.94 MB, 380.94 MB, 380.94 MB, 380.94 MB, 380.94 MB, 380.94 MB, 380.94 MB, 380.94 MB, 380.94 MB, 380.94 MB, 380.94 MB, 380.94 MB, 380.94 MB, 380.94 MB, 380.94 MB, 380.94 MB, 380.94 MB, 380.94 MB - BytesReceived: 380.94 MB (399439860) - ConvertRowBatchTime: 929.638ms - DeserializeRowBatchTimer: 1s499ms - FirstBatchArrivalWaitTime: 1s094ms - PeakMemoryUsage: 0 - RowsReturned: 40.22M (40224656) - RowsReturnedRate: 6.07 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=22):(Total: 2m16s, non-child: 1s613ms, % non-child: 1.18%) BytesReceived(16s000ms): 2.10 MB, 15.02 MB, 41.20 MB, 66.55 MB, 92.90 MB, 119.24 MB, 145.92 MB, 172.53 MB, 197.75 MB, 222.73 MB, 248.38 MB, 274.47 MB, 300.69 MB, 326.43 MB, 350.14 MB, 376.95 MB, 402.20 MB, 429.14 MB, 451.62 MB, 476.73 MB, 498.91 MB, 515.84 MB, 534.31 MB, 556.18 MB, 573.85 MB, 586.11 MB, 605.71 MB, 621.50 MB, 634.76 MB, 639.31 MB, 647.93 MB, 660.70 MB, 665.89 MB, 674.66 MB, 683.17 MB, 688.24 MB, 688.24 MB, 688.24 MB, 688.24 MB, 688.24 MB - BytesReceived: 688.24 MB (721677096) - ConvertRowBatchTime: 845.626ms - DeserializeRowBatchTimer: 5s819ms - FirstBatchArrivalWaitTime: 760.356ms - PeakMemoryUsage: 0 - RowsReturned: 74.32M (74319873) - RowsReturnedRate: 544.58 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=24):(Total: 1s694ms, non-child: 4.511us, % non-child: 0.00%) BytesReceived(16s000ms): 8.55 MB, 10.45 MB, 10.45 MB, 10.45 MB, 10.45 MB, 10.45 MB, 10.45 MB, 10.45 MB, 10.45 MB, 10.45 MB, 10.45 MB, 10.45 MB, 10.45 MB, 10.45 MB, 10.45 MB, 10.45 MB, 10.45 MB, 10.45 MB, 10.45 MB, 10.45 MB, 10.45 MB, 10.45 MB, 10.45 MB, 10.45 MB, 10.45 MB, 10.45 MB, 10.45 MB, 10.45 MB, 10.45 MB, 10.45 MB, 10.45 MB, 10.45 MB, 10.45 MB, 10.45 MB, 10.45 MB, 10.45 MB, 10.45 MB, 10.47 MB, 10.52 MB, 10.53 MB - BytesReceived: 10.83 MB (11361029) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 71.207ms - FirstBatchArrivalWaitTime: 1s694ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:328 (host=ve1138.foo:22000):(Total: 56.350ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 966.76 MB, 6.64 GB, 13.86 GB, 20.76 GB, 27.63 GB, 34.40 GB, 41.27 GB, 48.17 GB, 54.67 GB, 61.20 GB, 67.60 GB, 74.09 GB, 80.99 GB, 87.56 GB, 93.75 GB, 100.57 GB, 107.13 GB, 113.89 GB, 119.99 GB, 126.13 GB, 132.46 GB, 136.90 GB, 141.57 GB, 147.26 GB, 152.04 GB, 155.32 GB, 156.25 GB, 153.39 GB, 156.68 GB, 157.46 GB, 155.86 GB, 151.20 GB, 152.67 GB, 154.74 GB, 155.97 GB, 152.87 GB, 155.87 GB, 157.19 GB, 153.69 GB, 155.11 GB ThreadUsage(16s000ms): 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.03 - BloomFilterBytes: 49.00 MB (51380224) - PeakMemoryUsage: 160.60 GB (172446879055) - PerHostPeakMemUsage: 169.54 GB (182045058641) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 1m51s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 1.47K (1468) - TotalThreadsTotalWallClockTime: 22s125ms - TotalThreadsSysTime: 2s213ms - TotalThreadsUserTime: 8s233ms - TotalThreadsVoluntaryContextSwitches: 23.42K (23424) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 56.313ms - ExecTreePrepareTime: 320.946us DataStreamSender (dst_id=28):(Total: 1.017ms, non-child: 1.017ms, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.05 MB (1105280) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 618.349ms, non-child: 618.349ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 199.039ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 122 (122) - NumInstructions: 8.95K (8951) - OptimizationTime: 394.905ms - PeakMemoryUsage: 4.37 MB (4582912) - PrepareTime: 23.966ms HASH_JOIN_NODE (id=15):(Total: 615.683us, non-child: 807.587us, % non-child: 100.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 451.92K (451915) - BuildTime: 131.469ms - PeakMemoryUsage: 153.09 MB (160524544) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=15): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 97.519ms - BuildRowsPartitioned: 451.92K (451915) - GetNewBlockTime: 354.944us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 31.230ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160449664) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=26):(Total: 2s064ms, non-child: 25.797ms, % non-child: 1.25%) BytesReceived(16s000ms): 5.37 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB - BytesReceived: 6.21 MB (6513198) - ConvertRowBatchTime: 11.563ms - DeserializeRowBatchTimer: 53.704ms - FirstBatchArrivalWaitTime: 1s209ms - PeakMemoryUsage: 0 - RowsReturned: 451.92K (451915) - RowsReturnedRate: 218.85 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=14):(Total: 499.397us, non-child: 746.663us, % non-child: 100.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 458.88K (458879) - BuildTime: 168.970ms - PeakMemoryUsage: 25.08 MB (26298624) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 99.627ms - BuildRowsPartitioned: 458.88K (458879) - GetNewBlockTime: 231.231us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 24.600ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 25.02 MB (26231936) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 4s129ms, non-child: 16.052ms, % non-child: 0.39%) BytesReceived(16s000ms): 5.82 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB - BytesReceived: 7.33 MB (7686254) - ConvertRowBatchTime: 12.028ms - DeserializeRowBatchTimer: 16.642ms - FirstBatchArrivalWaitTime: 2s113ms - PeakMemoryUsage: 0 - RowsReturned: 458.88K (458879) - RowsReturnedRate: 111.11 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=13):(Total: 376.506us, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 4.01B (4009006066) - BuildTime: 6m26s - PeakMemoryUsage: 158.08 GB (169736833280) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled, Spilled Runtime filters: 0 of 1 Runtime Filter Published, 1 Disabled - BuildRowsPartitionTime: 6m26s - BuildRowsPartitioned: 4.01B (4009006066) - GetNewBlockTime: 43s233ms - HashBuckets: 536.87M (536870912) - HashCollisions: 0 (0) - HashTablesBuildTime: 45s445ms - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 158.08 GB (169736774784) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 4 (4) - UnpinTime: 271.898ms HASH_JOIN_NODE (id=12):(Total: 2m59s, non-child: 1m14s, % non-child: 41.70%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 40.18M (40175750) - BuildTime: 8s600ms - PeakMemoryUsage: 3.02 GB (3240188128) - ProbeRows: 76.24M (76235602) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1m5s - RowsReturned: 4.01B (4009006066) - RowsReturnedRate: 22.33 M/sec Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 5s478ms - BuildRowsPartitioned: 40.18M (40175750) - GetNewBlockTime: 3.997ms - HashBuckets: 67.11M (67108864) - HashCollisions: 0 (0) - HashTablesBuildTime: 3s079ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 3.02 GB (3240125568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 6s934ms, non-child: 1s648ms, % non-child: 23.78%) BytesReceived(16s000ms): 209.33 MB, 380.50 MB, 380.50 MB, 380.50 MB, 380.50 MB, 380.50 MB, 380.50 MB, 380.50 MB, 380.50 MB, 380.50 MB, 380.50 MB, 380.50 MB, 380.50 MB, 380.50 MB, 380.50 MB, 380.50 MB, 380.50 MB, 380.50 MB, 380.50 MB, 380.50 MB, 380.50 MB, 380.50 MB, 380.50 MB, 380.50 MB, 380.50 MB, 380.50 MB, 380.50 MB, 380.50 MB, 380.50 MB, 380.50 MB, 380.50 MB, 380.50 MB, 380.50 MB, 380.50 MB, 380.50 MB, 380.50 MB, 380.50 MB, 380.50 MB, 380.50 MB, 380.50 MB - BytesReceived: 380.50 MB (398981675) - ConvertRowBatchTime: 973.078ms - DeserializeRowBatchTimer: 1s663ms - FirstBatchArrivalWaitTime: 1s133ms - PeakMemoryUsage: 0 - RowsReturned: 40.18M (40175750) - RowsReturnedRate: 5.79 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=22):(Total: 1m38s, non-child: 1s382ms, % non-child: 1.40%) BytesReceived(16s000ms): 2.19 MB, 15.52 MB, 42.60 MB, 68.78 MB, 95.68 MB, 122.44 MB, 149.54 MB, 176.95 MB, 202.81 MB, 228.57 MB, 253.74 MB, 279.73 MB, 306.67 MB, 333.05 MB, 357.53 MB, 384.71 MB, 410.41 MB, 437.90 MB, 461.25 MB, 486.34 MB, 510.03 MB, 526.99 MB, 545.90 MB, 568.42 MB, 586.82 MB, 599.46 MB, 619.13 MB, 638.55 MB, 651.39 MB, 656.32 MB, 665.76 MB, 678.59 MB, 683.49 MB, 693.34 MB, 701.87 MB, 705.86 MB, 705.86 MB, 705.86 MB, 705.86 MB, 705.86 MB - BytesReceived: 705.86 MB (740150216) - ConvertRowBatchTime: 878.034ms - DeserializeRowBatchTimer: 7s038ms - FirstBatchArrivalWaitTime: 791.598ms - PeakMemoryUsage: 0 - RowsReturned: 76.24M (76235602) - RowsReturnedRate: 773.95 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=24):(Total: 1s730ms, non-child: 3.153us, % non-child: 0.00%) BytesReceived(16s000ms): 8.67 MB, 10.56 MB, 10.56 MB, 10.56 MB, 10.56 MB, 10.56 MB, 10.56 MB, 10.56 MB, 10.56 MB, 10.56 MB, 10.56 MB, 10.56 MB, 10.56 MB, 10.56 MB, 10.56 MB, 10.56 MB, 10.56 MB, 10.56 MB, 10.56 MB, 10.56 MB, 10.56 MB, 10.56 MB, 10.56 MB, 10.56 MB, 10.56 MB, 10.56 MB, 10.56 MB, 10.56 MB, 10.56 MB, 10.56 MB, 10.56 MB, 10.56 MB, 10.56 MB, 10.56 MB, 10.56 MB, 10.56 MB, 10.56 MB, 10.59 MB, 10.66 MB, 10.66 MB - BytesReceived: 10.97 MB (11505631) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 74.924ms - FirstBatchArrivalWaitTime: 1s730ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:348 (host=vd1125.foo:22000):(Total: 56.349ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 931.17 MB, 6.76 GB, 13.94 GB, 20.48 GB, 27.16 GB, 33.74 GB, 40.27 GB, 46.87 GB, 53.53 GB, 60.21 GB, 66.45 GB, 72.82 GB, 79.57 GB, 86.01 GB, 92.09 GB, 98.69 GB, 105.15 GB, 111.69 GB, 117.84 GB, 124.02 GB, 130.27 GB, 134.25 GB, 139.80 GB, 145.47 GB, 150.12 GB, 153.35 GB, 158.22 GB, 151.34 GB, 154.53 GB, 155.69 GB, 157.83 GB, 153.74 GB, 150.65 GB, 152.79 GB, 154.28 GB, 151.10 GB, 151.57 GB, 149.19 GB, 152.21 GB, 152.42 GB ThreadUsage(16s000ms): 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.03 - BloomFilterBytes: 49.00 MB (51380224) - PeakMemoryUsage: 160.60 GB (172441236559) - PerHostPeakMemUsage: 169.56 GB (182067071571) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 2m3s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 1.33K (1332) - TotalThreadsTotalWallClockTime: 22s066ms - TotalThreadsSysTime: 2s144ms - TotalThreadsUserTime: 7s746ms - TotalThreadsVoluntaryContextSwitches: 24.83K (24826) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 56.268ms - ExecTreePrepareTime: 649.879us DataStreamSender (dst_id=28):(Total: 913.025us, non-child: 913.025us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.05 MB (1105280) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 645.903ms, non-child: 645.903ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 215.729ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 122 (122) - NumInstructions: 8.95K (8951) - OptimizationTime: 406.825ms - PeakMemoryUsage: 4.37 MB (4582912) - PrepareTime: 22.851ms HASH_JOIN_NODE (id=15):(Total: 1.205ms, non-child: 886.570us, % non-child: 73.55%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 451.92K (451915) - BuildTime: 137.331ms - PeakMemoryUsage: 153.09 MB (160524544) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=15): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 102.969ms - BuildRowsPartitioned: 451.92K (451915) - GetNewBlockTime: 359.700us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 30.781ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160449664) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=26):(Total: 2s037ms, non-child: 25.109ms, % non-child: 1.23%) BytesReceived(16s000ms): 5.34 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB - BytesReceived: 6.21 MB (6513198) - ConvertRowBatchTime: 13.076ms - DeserializeRowBatchTimer: 50.610ms - FirstBatchArrivalWaitTime: 1s171ms - PeakMemoryUsage: 0 - RowsReturned: 451.92K (451915) - RowsReturnedRate: 221.85 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=14):(Total: 906.935us, non-child: 1.063ms, % non-child: 100.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 460.80K (460796) - BuildTime: 158.864ms - PeakMemoryUsage: 25.08 MB (26298624) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 99.685ms - BuildRowsPartitioned: 460.80K (460796) - GetNewBlockTime: 180.276us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 24.036ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 25.02 MB (26231936) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 4s122ms, non-child: 15.796ms, % non-child: 0.38%) BytesReceived(16s000ms): 5.82 MB, 7.36 MB, 7.36 MB, 7.36 MB, 7.36 MB, 7.36 MB, 7.36 MB, 7.36 MB, 7.36 MB, 7.36 MB, 7.36 MB, 7.36 MB, 7.36 MB, 7.36 MB, 7.36 MB, 7.36 MB, 7.36 MB, 7.36 MB, 7.36 MB, 7.36 MB, 7.36 MB, 7.36 MB, 7.36 MB, 7.36 MB, 7.36 MB, 7.36 MB, 7.36 MB, 7.36 MB, 7.36 MB, 7.36 MB, 7.36 MB, 7.36 MB, 7.36 MB, 7.36 MB, 7.36 MB, 7.36 MB, 7.36 MB, 7.36 MB, 7.36 MB, 7.36 MB - BytesReceived: 7.36 MB (7718119) - ConvertRowBatchTime: 12.168ms - DeserializeRowBatchTimer: 16.521ms - FirstBatchArrivalWaitTime: 2s079ms - PeakMemoryUsage: 0 - RowsReturned: 460.80K (460796) - RowsReturnedRate: 111.77 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=13):(Total: 603.120us, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 3.94B (3943894834) - BuildTime: 6m10s - PeakMemoryUsage: 157.31 GB (168914159840) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled, Spilled Runtime filters: 0 of 1 Runtime Filter Published, 1 Disabled - BuildRowsPartitionTime: 6m10s - BuildRowsPartitioned: 3.94B (3943894834) - GetNewBlockTime: 26s068ms - HashBuckets: 536.87M (536870912) - HashCollisions: 0 (0) - HashTablesBuildTime: 23s869ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 157.31 GB (168914068608) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 4 (4) - UnpinTime: 168.352ms HASH_JOIN_NODE (id=12):(Total: 3m15s, non-child: 1m18s, % non-child: 39.98%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 40.27M (40272007) - BuildTime: 8s141ms - PeakMemoryUsage: 3.02 GB (3240196320) - ProbeRows: 74.05M (74051973) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1m9s - RowsReturned: 3.94B (3943894834) - RowsReturnedRate: 20.21 M/sec Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 5s343ms - BuildRowsPartitioned: 40.27M (40272007) - GetNewBlockTime: 2.955ms - HashBuckets: 67.11M (67108864) - HashCollisions: 0 (0) - HashTablesBuildTime: 2s747ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 3.02 GB (3240125568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 7s387ms, non-child: 1s582ms, % non-child: 21.42%) BytesReceived(16s000ms): 208.43 MB, 381.39 MB, 381.39 MB, 381.39 MB, 381.39 MB, 381.39 MB, 381.39 MB, 381.39 MB, 381.39 MB, 381.39 MB, 381.39 MB, 381.39 MB, 381.39 MB, 381.39 MB, 381.39 MB, 381.39 MB, 381.39 MB, 381.39 MB, 381.39 MB, 381.39 MB, 381.39 MB, 381.39 MB, 381.39 MB, 381.39 MB, 381.39 MB, 381.39 MB, 381.39 MB, 381.39 MB, 381.39 MB, 381.39 MB, 381.39 MB, 381.39 MB, 381.39 MB, 381.39 MB, 381.39 MB, 381.39 MB, 381.39 MB, 381.39 MB, 381.39 MB, 381.39 MB - BytesReceived: 381.39 MB (399920970) - ConvertRowBatchTime: 896.083ms - DeserializeRowBatchTimer: 1s728ms - FirstBatchArrivalWaitTime: 1s100ms - PeakMemoryUsage: 0 - RowsReturned: 40.27M (40272007) - RowsReturnedRate: 5.45 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=22):(Total: 1m50s, non-child: 5s294ms, % non-child: 4.79%) BytesReceived(16s000ms): 2.09 MB, 14.98 MB, 41.23 MB, 66.57 MB, 92.78 MB, 118.95 MB, 145.47 MB, 172.07 MB, 197.16 MB, 222.06 MB, 246.40 MB, 271.41 MB, 297.38 MB, 322.98 MB, 346.66 MB, 372.87 MB, 397.83 MB, 424.42 MB, 447.23 MB, 471.53 MB, 494.67 MB, 512.18 MB, 532.22 MB, 554.27 MB, 571.73 MB, 583.98 MB, 603.80 MB, 619.57 MB, 632.26 MB, 636.90 MB, 645.76 MB, 658.57 MB, 663.52 MB, 672.59 MB, 681.03 MB, 685.55 MB, 685.56 MB, 685.56 MB, 685.56 MB, 685.56 MB - BytesReceived: 685.56 MB (718858530) - ConvertRowBatchTime: 821.355ms - DeserializeRowBatchTimer: 11s026ms - FirstBatchArrivalWaitTime: 758.858ms - PeakMemoryUsage: 0 - RowsReturned: 74.05M (74051973) - RowsReturnedRate: 669.98 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=24):(Total: 1s704ms, non-child: 3.209us, % non-child: 0.00%) BytesReceived(16s000ms): 8.30 MB, 10.15 MB, 10.15 MB, 10.15 MB, 10.15 MB, 10.15 MB, 10.15 MB, 10.15 MB, 10.15 MB, 10.15 MB, 10.15 MB, 10.15 MB, 10.15 MB, 10.15 MB, 10.15 MB, 10.15 MB, 10.15 MB, 10.15 MB, 10.15 MB, 10.15 MB, 10.15 MB, 10.15 MB, 10.15 MB, 10.15 MB, 10.15 MB, 10.15 MB, 10.15 MB, 10.15 MB, 10.15 MB, 10.15 MB, 10.15 MB, 10.15 MB, 10.15 MB, 10.15 MB, 10.15 MB, 10.15 MB, 10.15 MB, 10.17 MB, 10.23 MB, 10.24 MB - BytesReceived: 10.29 MB (10792861) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 73.494ms - FirstBatchArrivalWaitTime: 1s704ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:31e (host=vc1531.foo:22000):(Total: 56.073ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 1010.70 MB, 7.06 GB, 14.08 GB, 20.67 GB, 27.47 GB, 34.24 GB, 41.10 GB, 48.08 GB, 54.59 GB, 61.07 GB, 67.37 GB, 73.85 GB, 80.70 GB, 87.04 GB, 93.31 GB, 100.09 GB, 106.58 GB, 113.43 GB, 119.53 GB, 125.73 GB, 131.87 GB, 136.15 GB, 140.83 GB, 146.52 GB, 151.21 GB, 154.48 GB, 156.84 GB, 152.44 GB, 155.83 GB, 156.59 GB, 159.02 GB, 151.83 GB, 151.27 GB, 153.80 GB, 155.74 GB, 151.80 GB, 151.30 GB, 154.39 GB, 154.60 GB, 153.01 GB ThreadUsage(16s000ms): 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.03 - BloomFilterBytes: 49.00 MB (51380224) - PeakMemoryUsage: 160.60 GB (172446980143) - PerHostPeakMemUsage: 169.56 GB (182064015224) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 2m15s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 1.63K (1632) - TotalThreadsTotalWallClockTime: 21s885ms - TotalThreadsSysTime: 2s292ms - TotalThreadsUserTime: 8s111ms - TotalThreadsVoluntaryContextSwitches: 21.51K (21514) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 56.028ms - ExecTreePrepareTime: 496.594us DataStreamSender (dst_id=28):(Total: 879.701us, non-child: 879.701us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.05 MB (1105280) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 640.776ms, non-child: 640.776ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 205.022ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 122 (122) - NumInstructions: 8.95K (8951) - OptimizationTime: 411.757ms - PeakMemoryUsage: 4.37 MB (4582912) - PrepareTime: 23.582ms HASH_JOIN_NODE (id=15):(Total: 950.206us, non-child: 804.993us, % non-child: 84.72%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 451.92K (451915) - BuildTime: 124.030ms - PeakMemoryUsage: 153.09 MB (160524544) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=15): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 97.105ms - BuildRowsPartitioned: 451.92K (451915) - GetNewBlockTime: 324.006us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 24.728ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160449664) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=26):(Total: 2s056ms, non-child: 26.923ms, % non-child: 1.31%) BytesReceived(16s000ms): 5.38 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB - BytesReceived: 6.21 MB (6513198) - ConvertRowBatchTime: 12.245ms - DeserializeRowBatchTimer: 52.866ms - FirstBatchArrivalWaitTime: 1s189ms - PeakMemoryUsage: 0 - RowsReturned: 451.92K (451915) - RowsReturnedRate: 219.74 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=14):(Total: 737.485us, non-child: 549.192us, % non-child: 74.47%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 459.40K (459399) - BuildTime: 136.736ms - PeakMemoryUsage: 25.08 MB (26298624) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 82.318ms - BuildRowsPartitioned: 459.40K (459399) - GetNewBlockTime: 187.375us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 23.156ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 25.02 MB (26231936) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 4s129ms, non-child: 13.923ms, % non-child: 0.34%) BytesReceived(16s000ms): 5.83 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB - BytesReceived: 7.34 MB (7695351) - ConvertRowBatchTime: 10.200ms - DeserializeRowBatchTimer: 17.144ms - FirstBatchArrivalWaitTime: 2s098ms - PeakMemoryUsage: 0 - RowsReturned: 459.40K (459399) - RowsReturnedRate: 111.24 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=13):(Total: 537.804us, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 3.98B (3980231638) - BuildTime: 6m7s - PeakMemoryUsage: 157.31 GB (168914127104) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled, Spilled Runtime filters: 0 of 1 Runtime Filter Published, 1 Disabled - BuildRowsPartitionTime: 6m7s - BuildRowsPartitioned: 3.98B (3980231638) - GetNewBlockTime: 44s430ms - HashBuckets: 536.87M (536870912) - HashCollisions: 0 (0) - HashTablesBuildTime: 57s105ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 157.31 GB (168914068608) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 4 (4) - UnpinTime: 103.094ms HASH_JOIN_NODE (id=12):(Total: 3m19s, non-child: 1m10s, % non-child: 35.23%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 40.20M (40195898) - BuildTime: 8s643ms - PeakMemoryUsage: 3.02 GB (3240191444) - ProbeRows: 74.91M (74913758) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1m - RowsReturned: 3.98B (3980231638) - RowsReturnedRate: 19.94 M/sec Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 5s668ms - BuildRowsPartitioned: 40.20M (40195898) - GetNewBlockTime: 4.163ms - HashBuckets: 67.11M (67108864) - HashCollisions: 0 (0) - HashTablesBuildTime: 2s930ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 3.02 GB (3240125568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 6s699ms, non-child: 1s537ms, % non-child: 22.95%) BytesReceived(16s000ms): 212.02 MB, 380.66 MB, 380.66 MB, 380.66 MB, 380.66 MB, 380.66 MB, 380.66 MB, 380.66 MB, 380.66 MB, 380.66 MB, 380.66 MB, 380.66 MB, 380.66 MB, 380.66 MB, 380.66 MB, 380.66 MB, 380.66 MB, 380.66 MB, 380.66 MB, 380.66 MB, 380.66 MB, 380.66 MB, 380.66 MB, 380.66 MB, 380.66 MB, 380.66 MB, 380.66 MB, 380.66 MB, 380.66 MB, 380.66 MB, 380.66 MB, 380.66 MB, 380.66 MB, 380.66 MB, 380.66 MB, 380.66 MB, 380.66 MB, 380.66 MB, 380.66 MB, 380.66 MB - BytesReceived: 380.66 MB (399147537) - ConvertRowBatchTime: 956.528ms - DeserializeRowBatchTimer: 1s476ms - FirstBatchArrivalWaitTime: 1s115ms - PeakMemoryUsage: 0 - RowsReturned: 40.20M (40195898) - RowsReturnedRate: 6.00 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=22):(Total: 2m3s, non-child: 1s800ms, % non-child: 1.46%) BytesReceived(16s000ms): 2.11 MB, 15.36 MB, 41.81 MB, 67.51 MB, 94.04 MB, 120.46 MB, 147.24 MB, 174.85 MB, 200.26 MB, 225.57 MB, 250.27 MB, 275.79 MB, 302.18 MB, 327.94 MB, 351.79 MB, 378.53 MB, 403.83 MB, 430.92 MB, 453.73 MB, 478.72 MB, 501.74 MB, 518.62 MB, 537.32 MB, 559.47 MB, 577.53 MB, 589.88 MB, 609.43 MB, 625.57 MB, 639.35 MB, 643.89 MB, 652.47 MB, 665.33 MB, 670.87 MB, 681.20 MB, 689.88 MB, 693.65 MB, 693.65 MB, 693.65 MB, 693.65 MB, 693.65 MB - BytesReceived: 693.65 MB (727341074) - ConvertRowBatchTime: 825.123ms - DeserializeRowBatchTimer: 5s631ms - FirstBatchArrivalWaitTime: 779.140ms - PeakMemoryUsage: 0 - RowsReturned: 74.91M (74913758) - RowsReturnedRate: 607.23 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=24):(Total: 1s719ms, non-child: 4.388us, % non-child: 0.00%) BytesReceived(16s000ms): 8.92 MB, 10.72 MB, 10.72 MB, 10.72 MB, 10.72 MB, 10.72 MB, 10.72 MB, 10.72 MB, 10.72 MB, 10.72 MB, 10.72 MB, 10.72 MB, 10.72 MB, 10.72 MB, 10.72 MB, 10.72 MB, 10.72 MB, 10.72 MB, 10.72 MB, 10.72 MB, 10.72 MB, 10.72 MB, 10.72 MB, 10.72 MB, 10.72 MB, 10.72 MB, 10.72 MB, 10.72 MB, 10.72 MB, 10.72 MB, 10.72 MB, 10.72 MB, 10.72 MB, 10.72 MB, 10.72 MB, 10.72 MB, 10.72 MB, 10.75 MB, 10.79 MB, 10.79 MB - BytesReceived: 11.18 MB (11726877) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 68.936ms - FirstBatchArrivalWaitTime: 1s719ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:2fc (host=vd1101.foo:22000):(Total: 56.068ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 1.04 GB, 7.25 GB, 14.31 GB, 20.97 GB, 27.77 GB, 34.60 GB, 41.47 GB, 48.36 GB, 54.84 GB, 61.35 GB, 67.62 GB, 74.13 GB, 81.05 GB, 87.82 GB, 94.30 GB, 101.18 GB, 107.60 GB, 114.50 GB, 120.45 GB, 126.89 GB, 132.69 GB, 136.76 GB, 141.64 GB, 147.32 GB, 151.96 GB, 155.18 GB, 156.24 GB, 153.75 GB, 157.00 GB, 157.82 GB, 156.55 GB, 152.32 GB, 153.25 GB, 155.53 GB, 157.05 GB, 153.07 GB, 153.63 GB, 154.21 GB, 154.92 GB, 155.72 GB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.03 - BloomFilterBytes: 49.00 MB (51380224) - PeakMemoryUsage: 160.60 GB (172444532479) - PerHostPeakMemUsage: 169.56 GB (182059540873) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 2m16s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 1.68K (1683) - TotalThreadsTotalWallClockTime: 21s733ms - TotalThreadsSysTime: 2s275ms - TotalThreadsUserTime: 7s929ms - TotalThreadsVoluntaryContextSwitches: 21.74K (21740) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 56.000ms - ExecTreePrepareTime: 727.496us DataStreamSender (dst_id=28):(Total: 999.246us, non-child: 999.246us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.05 MB (1105280) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 646.207ms, non-child: 646.207ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 200.434ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 122 (122) - NumInstructions: 8.95K (8951) - OptimizationTime: 422.959ms - PeakMemoryUsage: 4.37 MB (4582912) - PrepareTime: 22.387ms HASH_JOIN_NODE (id=15):(Total: 1.390ms, non-child: 936.668us, % non-child: 67.38%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 451.92K (451915) - BuildTime: 135.092ms - PeakMemoryUsage: 153.09 MB (160524544) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=15): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 99.252ms - BuildRowsPartitioned: 451.92K (451915) - GetNewBlockTime: 313.283us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 33.135ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160449664) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=26):(Total: 2s059ms, non-child: 22.514ms, % non-child: 1.09%) BytesReceived(16s000ms): 5.50 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB - BytesReceived: 6.21 MB (6513198) - ConvertRowBatchTime: 11.946ms - DeserializeRowBatchTimer: 51.502ms - FirstBatchArrivalWaitTime: 1s190ms - PeakMemoryUsage: 0 - RowsReturned: 451.92K (451915) - RowsReturnedRate: 219.41 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=14):(Total: 1.095ms, non-child: 804.015us, % non-child: 73.38%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 459.31K (459307) - BuildTime: 147.581ms - PeakMemoryUsage: 25.08 MB (26298624) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 84.915ms - BuildRowsPartitioned: 459.31K (459307) - GetNewBlockTime: 157.183us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 24.847ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 25.02 MB (26231936) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 4s104ms, non-child: 13.110ms, % non-child: 0.32%) BytesReceived(16s000ms): 6.01 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB - BytesReceived: 7.34 MB (7692914) - ConvertRowBatchTime: 9.583ms - DeserializeRowBatchTimer: 15.845ms - FirstBatchArrivalWaitTime: 2s095ms - PeakMemoryUsage: 0 - RowsReturned: 459.31K (459307) - RowsReturnedRate: 111.89 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=13):(Total: 773.625us, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 4.00B (3996521908) - BuildTime: 6m1s - PeakMemoryUsage: 158.06 GB (169711667456) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled, Spilled Runtime filters: 0 of 1 Runtime Filter Published, 1 Disabled - BuildRowsPartitionTime: 6m1s - BuildRowsPartitioned: 4.00B (3996521908) - GetNewBlockTime: 41s463ms - HashBuckets: 536.87M (536870912) - HashCollisions: 0 (0) - HashTablesBuildTime: 39s223ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 158.06 GB (169711608960) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 4 (4) - UnpinTime: 234.255ms HASH_JOIN_NODE (id=12):(Total: 3m22s, non-child: 1m11s, % non-child: 35.60%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 40.18M (40184353) - BuildTime: 8s424ms - PeakMemoryUsage: 3.02 GB (3240188128) - ProbeRows: 76.17M (76174146) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1m2s - RowsReturned: 4.00B (3996521908) - RowsReturnedRate: 19.78 M/sec Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 5s567ms - BuildRowsPartitioned: 40.18M (40184353) - GetNewBlockTime: 3.504ms - HashBuckets: 67.11M (67108864) - HashCollisions: 0 (0) - HashTablesBuildTime: 2s810ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 3.02 GB (3240125568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 6s766ms, non-child: 1s531ms, % non-child: 22.64%) BytesReceived(16s000ms): 217.98 MB, 380.57 MB, 380.57 MB, 380.57 MB, 380.57 MB, 380.57 MB, 380.57 MB, 380.57 MB, 380.57 MB, 380.57 MB, 380.57 MB, 380.57 MB, 380.57 MB, 380.57 MB, 380.57 MB, 380.57 MB, 380.57 MB, 380.57 MB, 380.57 MB, 380.57 MB, 380.57 MB, 380.57 MB, 380.57 MB, 380.57 MB, 380.57 MB, 380.57 MB, 380.57 MB, 380.57 MB, 380.57 MB, 380.57 MB, 380.57 MB, 380.57 MB, 380.57 MB, 380.57 MB, 380.57 MB, 380.57 MB, 380.57 MB, 380.57 MB, 380.57 MB, 380.57 MB - BytesReceived: 380.57 MB (399059415) - ConvertRowBatchTime: 964.004ms - DeserializeRowBatchTimer: 1s470ms - FirstBatchArrivalWaitTime: 1s114ms - PeakMemoryUsage: 0 - RowsReturned: 40.18M (40184353) - RowsReturnedRate: 5.94 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=22):(Total: 2m4s, non-child: 1s370ms, % non-child: 1.10%) BytesReceived(16s000ms): 2.18 MB, 16.14 MB, 43.17 MB, 69.40 MB, 96.31 MB, 123.32 MB, 150.52 MB, 177.79 MB, 203.57 MB, 229.15 MB, 254.24 MB, 280.20 MB, 307.21 MB, 335.79 MB, 360.13 MB, 387.53 MB, 413.01 MB, 440.28 MB, 463.26 MB, 489.20 MB, 511.49 MB, 528.63 MB, 547.62 MB, 569.95 MB, 587.99 MB, 600.57 MB, 620.91 MB, 637.16 MB, 650.50 MB, 655.20 MB, 664.17 MB, 677.41 MB, 682.66 MB, 691.75 MB, 700.52 MB, 705.49 MB, 705.50 MB, 705.50 MB, 705.50 MB, 705.50 MB - BytesReceived: 705.50 MB (739766120) - ConvertRowBatchTime: 882.785ms - DeserializeRowBatchTimer: 6s328ms - FirstBatchArrivalWaitTime: 783.498ms - PeakMemoryUsage: 0 - RowsReturned: 76.17M (76174146) - RowsReturnedRate: 613.59 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=24):(Total: 1s711ms, non-child: 3.990us, % non-child: 0.00%) BytesReceived(16s000ms): 8.75 MB, 10.35 MB, 10.35 MB, 10.35 MB, 10.35 MB, 10.35 MB, 10.35 MB, 10.35 MB, 10.35 MB, 10.35 MB, 10.35 MB, 10.35 MB, 10.35 MB, 10.35 MB, 10.35 MB, 10.35 MB, 10.35 MB, 10.35 MB, 10.35 MB, 10.35 MB, 10.35 MB, 10.35 MB, 10.35 MB, 10.35 MB, 10.35 MB, 10.35 MB, 10.35 MB, 10.35 MB, 10.35 MB, 10.35 MB, 10.35 MB, 10.35 MB, 10.35 MB, 10.35 MB, 10.35 MB, 10.35 MB, 10.35 MB, 10.36 MB, 10.38 MB, 10.38 MB - BytesReceived: 10.69 MB (11214331) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 72.499ms - FirstBatchArrivalWaitTime: 1s711ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:335 (host=va1032.foo:22000):(Total: 56.031ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 973.93 MB, 7.04 GB, 14.17 GB, 20.81 GB, 27.67 GB, 34.78 GB, 41.73 GB, 48.68 GB, 55.18 GB, 61.72 GB, 68.07 GB, 74.66 GB, 81.60 GB, 88.01 GB, 94.48 GB, 101.33 GB, 107.91 GB, 114.64 GB, 120.99 GB, 127.19 GB, 133.47 GB, 137.88 GB, 142.61 GB, 148.35 GB, 153.09 GB, 156.47 GB, 154.49 GB, 154.48 GB, 157.91 GB, 158.29 GB, 156.19 GB, 152.26 GB, 153.28 GB, 155.27 GB, 156.85 GB, 154.82 GB, 153.40 GB, 154.04 GB, 155.07 GB, 155.09 GB ThreadUsage(16s000ms): 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.03 - BloomFilterBytes: 49.00 MB (51380224) - PeakMemoryUsage: 160.99 GB (172858179023) - PerHostPeakMemUsage: 169.56 GB (182062903226) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 1m56s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 1.73K (1725) - TotalThreadsTotalWallClockTime: 22s012ms - TotalThreadsSysTime: 2s244ms - TotalThreadsUserTime: 8s200ms - TotalThreadsVoluntaryContextSwitches: 20.86K (20862) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 55.974ms - ExecTreePrepareTime: 596.203us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 24.01K (24007) - BlocksRecycled: 354 (354) - BufferedPins: 0 (0) - BytesWritten: 41.42 GB (44476399616) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 161.38 GB (173283483648) - ScratchFileUsedBytes: 41.42 GB (44476399616) - TotalBufferWaitTime: 7s521ms - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=28):(Total: 804.615us, non-child: 804.615us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.05 MB (1105280) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 618.048ms, non-child: 618.048ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 205.589ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 122 (122) - NumInstructions: 8.95K (8951) - OptimizationTime: 387.798ms - PeakMemoryUsage: 4.37 MB (4582912) - PrepareTime: 24.115ms HASH_JOIN_NODE (id=15):(Total: 1.130ms, non-child: 955.748us, % non-child: 84.54%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 451.92K (451915) - BuildTime: 153.459ms - PeakMemoryUsage: 153.09 MB (160524544) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=15): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 108.848ms - BuildRowsPartitioned: 451.92K (451915) - GetNewBlockTime: 402.502us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 40.945ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160449664) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=26):(Total: 2s064ms, non-child: 28.751ms, % non-child: 1.39%) BytesReceived(16s000ms): 5.38 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB - BytesReceived: 6.21 MB (6513198) - ConvertRowBatchTime: 13.591ms - DeserializeRowBatchTimer: 59.352ms - FirstBatchArrivalWaitTime: 1s203ms - PeakMemoryUsage: 0 - RowsReturned: 451.92K (451915) - RowsReturnedRate: 218.88 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=14):(Total: 884.523us, non-child: 911.780us, % non-child: 100.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 459.04K (459044) - BuildTime: 196.233ms - PeakMemoryUsage: 25.08 MB (26298624) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 115.720ms - BuildRowsPartitioned: 459.04K (459044) - GetNewBlockTime: 199.090us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 29.422ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 25.02 MB (26231936) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 4s115ms, non-child: 18.764ms, % non-child: 0.46%) BytesReceived(16s000ms): 5.82 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB - BytesReceived: 7.33 MB (7690407) - ConvertRowBatchTime: 13.990ms - DeserializeRowBatchTimer: 17.236ms - FirstBatchArrivalWaitTime: 2s114ms - PeakMemoryUsage: 0 - RowsReturned: 459.04K (459044) - RowsReturnedRate: 111.54 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=13):(Total: 611.620us, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 4.03B (4034829999) - BuildTime: 6m23s - PeakMemoryUsage: 158.32 GB (169996880128) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled, Spilled Runtime filters: 0 of 1 Runtime Filter Published, 1 Disabled - BuildRowsPartitionTime: 6m23s - BuildRowsPartitioned: 4.03B (4034829999) - GetNewBlockTime: 1m1s - HashBuckets: 536.87M (536870912) - HashCollisions: 0 (0) - HashTablesBuildTime: 31s687ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 158.32 GB (169996821632) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 4 (4) - UnpinTime: 118.222ms HASH_JOIN_NODE (id=12):(Total: 3m5s, non-child: 1m16s, % non-child: 40.98%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 40.22M (40216075) - BuildTime: 8s625ms - PeakMemoryUsage: 3.02 GB (3240188128) - ProbeRows: 75.70M (75699082) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1m6s - RowsReturned: 4.03B (4034829999) - RowsReturnedRate: 21.72 M/sec Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 5s692ms - BuildRowsPartitioned: 40.22M (40216075) - GetNewBlockTime: 3.276ms - HashBuckets: 67.11M (67108864) - HashCollisions: 0 (0) - HashTablesBuildTime: 2s881ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 3.02 GB (3240125568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 6s761ms, non-child: 1s493ms, % non-child: 22.08%) BytesReceived(16s000ms): 210.00 MB, 380.86 MB, 380.86 MB, 380.86 MB, 380.86 MB, 380.86 MB, 380.86 MB, 380.86 MB, 380.86 MB, 380.86 MB, 380.86 MB, 380.86 MB, 380.86 MB, 380.86 MB, 380.86 MB, 380.86 MB, 380.86 MB, 380.86 MB, 380.86 MB, 380.86 MB, 380.86 MB, 380.86 MB, 380.86 MB, 380.86 MB, 380.86 MB, 380.86 MB, 380.86 MB, 380.86 MB, 380.86 MB, 380.86 MB, 380.86 MB, 380.86 MB, 380.86 MB, 380.86 MB, 380.86 MB, 380.86 MB, 380.86 MB, 380.86 MB, 380.86 MB, 380.86 MB - BytesReceived: 380.86 MB (399355960) - ConvertRowBatchTime: 962.794ms - DeserializeRowBatchTimer: 1s451ms - FirstBatchArrivalWaitTime: 1s133ms - PeakMemoryUsage: 0 - RowsReturned: 40.22M (40216075) - RowsReturnedRate: 5.95 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=22):(Total: 1m43s, non-child: 1s710ms, % non-child: 1.65%) BytesReceived(16s000ms): 2.12 MB, 15.36 MB, 41.98 MB, 67.78 MB, 94.83 MB, 122.39 MB, 149.52 MB, 176.58 MB, 202.01 MB, 227.48 MB, 252.28 MB, 278.08 MB, 304.88 MB, 331.15 MB, 355.44 MB, 382.57 MB, 408.10 MB, 435.35 MB, 458.45 MB, 483.84 MB, 507.09 MB, 524.18 MB, 543.09 MB, 565.48 MB, 583.62 MB, 596.21 MB, 616.09 MB, 632.42 MB, 646.42 MB, 650.95 MB, 659.61 MB, 672.61 MB, 678.18 MB, 686.80 MB, 695.71 MB, 701.20 MB, 701.20 MB, 701.20 MB, 701.20 MB, 701.20 MB - BytesReceived: 701.20 MB (735264512) - ConvertRowBatchTime: 895.341ms - DeserializeRowBatchTimer: 5s796ms - FirstBatchArrivalWaitTime: 798.368ms - PeakMemoryUsage: 0 - RowsReturned: 75.70M (75699082) - RowsReturnedRate: 730.10 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=24):(Total: 1s737ms, non-child: 3.561us, % non-child: 0.00%) BytesReceived(16s000ms): 8.65 MB, 10.51 MB, 10.51 MB, 10.51 MB, 10.51 MB, 10.51 MB, 10.51 MB, 10.51 MB, 10.51 MB, 10.51 MB, 10.51 MB, 10.51 MB, 10.51 MB, 10.51 MB, 10.51 MB, 10.51 MB, 10.51 MB, 10.51 MB, 10.51 MB, 10.51 MB, 10.51 MB, 10.51 MB, 10.51 MB, 10.51 MB, 10.51 MB, 10.51 MB, 10.51 MB, 10.51 MB, 10.51 MB, 10.51 MB, 10.51 MB, 10.51 MB, 10.51 MB, 10.51 MB, 10.51 MB, 10.51 MB, 10.51 MB, 10.55 MB, 10.68 MB, 10.69 MB - BytesReceived: 11.01 MB (11541544) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 78.784ms - FirstBatchArrivalWaitTime: 1s737ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:301 (host=vc1525.foo:22000):(Total: 55.986ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 1013.44 MB, 6.96 GB, 14.11 GB, 20.95 GB, 27.83 GB, 34.75 GB, 41.74 GB, 48.68 GB, 55.34 GB, 61.91 GB, 68.30 GB, 74.80 GB, 81.62 GB, 88.31 GB, 94.58 GB, 101.37 GB, 108.06 GB, 114.96 GB, 121.30 GB, 127.53 GB, 133.90 GB, 138.09 GB, 143.11 GB, 149.02 GB, 154.54 GB, 157.97 GB, 153.00 GB, 155.84 GB, 158.92 GB, 158.40 GB, 150.91 GB, 152.55 GB, 154.78 GB, 156.69 GB, 158.59 GB, 154.21 GB, 157.04 GB, 156.22 GB, 156.78 GB, 150.03 GB ThreadUsage(16s000ms): 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.03 - BloomFilterBytes: 49.00 MB (51380224) - PeakMemoryUsage: 160.99 GB (172863651887) - PerHostPeakMemUsage: 169.54 GB (182040518846) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 1m46s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 1.35K (1350) - TotalThreadsTotalWallClockTime: 21s895ms - TotalThreadsSysTime: 2s066ms - TotalThreadsUserTime: 8s016ms - TotalThreadsVoluntaryContextSwitches: 23.76K (23760) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 55.934ms - ExecTreePrepareTime: 646.622us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 24.73K (24726) - BlocksRecycled: 781 (781) - BufferedPins: 0 (0) - BytesWritten: 47.03 GB (50499420160) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 161.38 GB (173283483648) - ScratchFileUsedBytes: 47.03 GB (50499420160) - TotalBufferWaitTime: 2s379ms - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=28):(Total: 863.261us, non-child: 863.261us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.05 MB (1105280) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 618.790ms, non-child: 618.790ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 197.641ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 122 (122) - NumInstructions: 8.95K (8951) - OptimizationTime: 396.092ms - PeakMemoryUsage: 4.37 MB (4582912) - PrepareTime: 24.533ms HASH_JOIN_NODE (id=15):(Total: 1.209ms, non-child: 905.401us, % non-child: 74.84%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 451.92K (451915) - BuildTime: 121.833ms - PeakMemoryUsage: 153.09 MB (160524544) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=15): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 95.075ms - BuildRowsPartitioned: 451.92K (451915) - GetNewBlockTime: 366.427us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 24.135ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160449664) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=26):(Total: 2s077ms, non-child: 22.760ms, % non-child: 1.10%) BytesReceived(16s000ms): 5.40 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB - BytesReceived: 6.21 MB (6513198) - ConvertRowBatchTime: 12.186ms - DeserializeRowBatchTimer: 48.148ms - FirstBatchArrivalWaitTime: 1s217ms - PeakMemoryUsage: 0 - RowsReturned: 451.92K (451915) - RowsReturnedRate: 217.51 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=14):(Total: 940.000us, non-child: 911.790us, % non-child: 97.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 459.83K (459827) - BuildTime: 148.831ms - PeakMemoryUsage: 25.08 MB (26298624) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 93.058ms - BuildRowsPartitioned: 459.83K (459827) - GetNewBlockTime: 143.975us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 21.969ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 25.02 MB (26231936) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 4s120ms, non-child: 15.202ms, % non-child: 0.37%) BytesReceived(16s000ms): 5.85 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB - BytesReceived: 7.35 MB (7703266) - ConvertRowBatchTime: 11.502ms - DeserializeRowBatchTimer: 15.143ms - FirstBatchArrivalWaitTime: 2s124ms - PeakMemoryUsage: 0 - RowsReturned: 459.83K (459827) - RowsReturnedRate: 111.59 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=13):(Total: 650.523us, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 4.05B (4053834361) - BuildTime: 6m24s - PeakMemoryUsage: 160.55 GB (172388223232) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled, Spilled Runtime filters: 0 of 1 Runtime Filter Published, 1 Disabled - BuildRowsPartitionTime: 6m24s - BuildRowsPartitioned: 4.05B (4053834361) - GetNewBlockTime: 39s417ms - HashBuckets: 536.87M (536870912) - HashCollisions: 0 (0) - HashTablesBuildTime: 1m7s - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 160.55 GB (172388164736) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 5 (5) - UnpinTime: 322.689ms HASH_JOIN_NODE (id=12):(Total: 2m57s, non-child: 1m18s, % non-child: 43.89%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 40.19M (40186702) - BuildTime: 8s365ms - PeakMemoryUsage: 3.02 GB (3240188128) - ProbeRows: 76.04M (76035709) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1m8s - RowsReturned: 4.05B (4053834361) - RowsReturnedRate: 22.79 M/sec Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 5s409ms - BuildRowsPartitioned: 40.19M (40186702) - GetNewBlockTime: 3.196ms - HashBuckets: 67.11M (67108864) - HashCollisions: 0 (0) - HashTablesBuildTime: 2s919ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 3.02 GB (3240125568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 6s984ms, non-child: 1s506ms, % non-child: 21.57%) BytesReceived(16s000ms): 213.24 MB, 380.58 MB, 380.58 MB, 380.58 MB, 380.58 MB, 380.58 MB, 380.58 MB, 380.58 MB, 380.58 MB, 380.58 MB, 380.58 MB, 380.58 MB, 380.58 MB, 380.58 MB, 380.58 MB, 380.58 MB, 380.58 MB, 380.58 MB, 380.58 MB, 380.58 MB, 380.58 MB, 380.58 MB, 380.58 MB, 380.58 MB, 380.58 MB, 380.58 MB, 380.58 MB, 380.58 MB, 380.58 MB, 380.58 MB, 380.58 MB, 380.58 MB, 380.58 MB, 380.58 MB, 380.58 MB, 380.58 MB, 380.58 MB, 380.58 MB, 380.58 MB, 380.58 MB - BytesReceived: 380.58 MB (399063707) - ConvertRowBatchTime: 948.034ms - DeserializeRowBatchTimer: 1s529ms - FirstBatchArrivalWaitTime: 1s144ms - PeakMemoryUsage: 0 - RowsReturned: 40.19M (40186702) - RowsReturnedRate: 5.75 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=22):(Total: 1m33s, non-child: 1s343ms, % non-child: 1.44%) BytesReceived(16s000ms): 2.24 MB, 15.71 MB, 42.46 MB, 68.36 MB, 95.17 MB, 122.03 MB, 149.21 MB, 176.55 MB, 202.27 MB, 227.86 MB, 252.79 MB, 278.67 MB, 305.36 MB, 331.42 MB, 355.71 MB, 382.71 MB, 408.48 MB, 436.04 MB, 459.38 MB, 484.54 MB, 508.21 MB, 525.34 MB, 544.44 MB, 567.95 MB, 588.54 MB, 601.55 MB, 622.00 MB, 637.81 MB, 649.99 MB, 654.85 MB, 664.29 MB, 677.10 MB, 681.90 MB, 691.76 MB, 700.26 MB, 704.27 MB, 704.27 MB, 704.27 MB, 704.27 MB, 704.27 MB - BytesReceived: 704.27 MB (738484756) - ConvertRowBatchTime: 907.110ms - DeserializeRowBatchTimer: 6s087ms - FirstBatchArrivalWaitTime: 796.818ms - PeakMemoryUsage: 0 - RowsReturned: 76.04M (76035709) - RowsReturnedRate: 812.35 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=24):(Total: 1s755ms, non-child: 5.930us, % non-child: 0.00%) BytesReceived(16s000ms): 8.48 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.14 MB, 10.19 MB, 10.21 MB - BytesReceived: 10.22 MB (10720053) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 70.318ms - FirstBatchArrivalWaitTime: 1s755ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:346 (host=vc1528.foo:22000):(Total: 55.833ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 1005.58 MB, 6.92 GB, 14.01 GB, 20.50 GB, 27.19 GB, 33.89 GB, 40.65 GB, 47.39 GB, 53.77 GB, 60.55 GB, 66.74 GB, 73.17 GB, 79.86 GB, 86.26 GB, 92.25 GB, 99.02 GB, 105.33 GB, 112.14 GB, 117.98 GB, 124.36 GB, 130.03 GB, 134.10 GB, 138.87 GB, 144.47 GB, 149.03 GB, 152.19 GB, 157.06 GB, 155.44 GB, 153.74 GB, 154.72 GB, 156.57 GB, 159.83 GB, 149.61 GB, 151.51 GB, 153.57 GB, 152.39 GB, 154.20 GB, 149.24 GB, 150.57 GB, 150.84 GB ThreadUsage(16s000ms): 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.03 - BloomFilterBytes: 49.00 MB (51380224) - PeakMemoryUsage: 160.60 GB (172446963871) - PerHostPeakMemUsage: 169.58 GB (182081766840) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 2m43s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 1.67K (1674) - TotalThreadsTotalWallClockTime: 22s185ms - TotalThreadsSysTime: 2s238ms - TotalThreadsUserTime: 8s161ms - TotalThreadsVoluntaryContextSwitches: 21.74K (21737) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 55.790ms - ExecTreePrepareTime: 656.976us DataStreamSender (dst_id=28):(Total: 897.062us, non-child: 897.062us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.05 MB (1105280) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 653.761ms, non-child: 653.761ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 214.687ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 122 (122) - NumInstructions: 8.95K (8951) - OptimizationTime: 414.914ms - PeakMemoryUsage: 4.37 MB (4582912) - PrepareTime: 23.676ms HASH_JOIN_NODE (id=15):(Total: 1.253ms, non-child: 855.379us, % non-child: 68.24%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 451.92K (451915) - BuildTime: 141.726ms - PeakMemoryUsage: 153.09 MB (160524544) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=15): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 97.434ms - BuildRowsPartitioned: 451.92K (451915) - GetNewBlockTime: 358.195us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 41.593ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160449664) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=26):(Total: 2s031ms, non-child: 24.548ms, % non-child: 1.21%) BytesReceived(16s000ms): 5.49 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB - BytesReceived: 6.21 MB (6513198) - ConvertRowBatchTime: 12.097ms - DeserializeRowBatchTimer: 51.888ms - FirstBatchArrivalWaitTime: 1s163ms - PeakMemoryUsage: 0 - RowsReturned: 451.92K (451915) - RowsReturnedRate: 222.50 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=14):(Total: 974.861us, non-child: 927.186us, % non-child: 95.11%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 458.41K (458410) - BuildTime: 175.599ms - PeakMemoryUsage: 25.08 MB (26298624) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 101.816ms - BuildRowsPartitioned: 458.41K (458410) - GetNewBlockTime: 191.901us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 33.564ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 25.02 MB (26231936) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 4s108ms, non-child: 15.908ms, % non-child: 0.39%) BytesReceived(16s000ms): 5.98 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB - BytesReceived: 7.32 MB (7677922) - ConvertRowBatchTime: 11.765ms - DeserializeRowBatchTimer: 16.257ms - FirstBatchArrivalWaitTime: 2s082ms - PeakMemoryUsage: 0 - RowsReturned: 458.41K (458410) - RowsReturnedRate: 111.57 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=13):(Total: 693.088us, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 3.92B (3915414781) - BuildTime: 5m36s - PeakMemoryUsage: 160.16 GB (171968203008) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled, Spilled Runtime filters: 0 of 1 Runtime Filter Published, 1 Disabled - BuildRowsPartitionTime: 5m35s - BuildRowsPartitioned: 3.92B (3915414781) - GetNewBlockTime: 22s925ms - HashBuckets: 536.87M (536870912) - HashCollisions: 0 (0) - HashTablesBuildTime: 40s739ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 160.16 GB (171968144512) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 4 (4) - UnpinTime: 142.539ms HASH_JOIN_NODE (id=12):(Total: 3m46s, non-child: 1m9s, % non-child: 30.71%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 40.14M (40142727) - BuildTime: 8s584ms - PeakMemoryUsage: 3.02 GB (3240188128) - ProbeRows: 74.26M (74256962) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1m - RowsReturned: 3.92B (3915414781) - RowsReturnedRate: 17.25 M/sec Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 5s653ms - BuildRowsPartitioned: 40.14M (40142727) - GetNewBlockTime: 4.012ms - HashBuckets: 67.11M (67108864) - HashCollisions: 0 (0) - HashTablesBuildTime: 2s881ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 3.02 GB (3240125568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 7s039ms, non-child: 1s558ms, % non-child: 22.15%) BytesReceived(16s000ms): 217.27 MB, 380.18 MB, 380.18 MB, 380.18 MB, 380.18 MB, 380.18 MB, 380.18 MB, 380.18 MB, 380.18 MB, 380.18 MB, 380.18 MB, 380.18 MB, 380.18 MB, 380.18 MB, 380.18 MB, 380.18 MB, 380.18 MB, 380.18 MB, 380.18 MB, 380.18 MB, 380.18 MB, 380.18 MB, 380.18 MB, 380.18 MB, 380.18 MB, 380.18 MB, 380.18 MB, 380.18 MB, 380.18 MB, 380.18 MB, 380.18 MB, 380.18 MB, 380.18 MB, 380.18 MB, 380.18 MB, 380.18 MB, 380.18 MB, 380.18 MB, 380.18 MB, 380.18 MB - BytesReceived: 380.18 MB (398652010) - ConvertRowBatchTime: 948.294ms - DeserializeRowBatchTimer: 1s540ms - FirstBatchArrivalWaitTime: 1s091ms - PeakMemoryUsage: 0 - RowsReturned: 40.14M (40142727) - RowsReturnedRate: 5.70 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=22):(Total: 2m30s, non-child: 1s290ms, % non-child: 0.85%) BytesReceived(16s000ms): 2.12 MB, 15.59 MB, 41.84 MB, 67.27 MB, 93.59 MB, 119.96 MB, 146.64 MB, 173.22 MB, 198.76 MB, 225.02 MB, 249.57 MB, 274.85 MB, 301.03 MB, 326.76 MB, 350.29 MB, 377.05 MB, 402.04 MB, 428.79 MB, 451.09 MB, 476.30 MB, 498.26 MB, 515.07 MB, 533.77 MB, 555.66 MB, 573.35 MB, 585.52 MB, 605.05 MB, 620.85 MB, 633.91 MB, 638.50 MB, 647.15 MB, 659.91 MB, 665.07 MB, 673.89 MB, 682.41 MB, 687.38 MB, 687.39 MB, 687.39 MB, 687.39 MB, 687.39 MB - BytesReceived: 687.39 MB (720775963) - ConvertRowBatchTime: 813.490ms - DeserializeRowBatchTimer: 6s367ms - FirstBatchArrivalWaitTime: 755.747ms - PeakMemoryUsage: 0 - RowsReturned: 74.26M (74256962) - RowsReturnedRate: 491.86 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=24):(Total: 1s699ms, non-child: 4.452us, % non-child: 0.00%) BytesReceived(16s000ms): 8.46 MB, 10.02 MB, 10.02 MB, 10.02 MB, 10.02 MB, 10.02 MB, 10.02 MB, 10.02 MB, 10.02 MB, 10.02 MB, 10.02 MB, 10.02 MB, 10.02 MB, 10.02 MB, 10.02 MB, 10.02 MB, 10.02 MB, 10.02 MB, 10.02 MB, 10.02 MB, 10.02 MB, 10.02 MB, 10.02 MB, 10.02 MB, 10.02 MB, 10.02 MB, 10.02 MB, 10.02 MB, 10.02 MB, 10.02 MB, 10.02 MB, 10.02 MB, 10.02 MB, 10.02 MB, 10.02 MB, 10.02 MB, 10.02 MB, 10.03 MB, 10.04 MB, 10.04 MB - BytesReceived: 10.04 MB (10527447) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 75.517ms - FirstBatchArrivalWaitTime: 1s699ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:357 (host=vd1140.foo:22000):(Total: 55.812ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 1018.03 MB, 7.32 GB, 14.35 GB, 20.99 GB, 27.86 GB, 34.73 GB, 41.68 GB, 48.62 GB, 55.17 GB, 61.99 GB, 68.32 GB, 74.89 GB, 81.73 GB, 88.39 GB, 94.45 GB, 101.42 GB, 108.01 GB, 114.86 GB, 120.81 GB, 127.19 GB, 133.25 GB, 137.56 GB, 142.36 GB, 148.07 GB, 152.82 GB, 156.10 GB, 156.41 GB, 154.53 GB, 157.89 GB, 158.63 GB, 156.60 GB, 152.84 GB, 153.42 GB, 155.80 GB, 157.84 GB, 153.42 GB, 153.56 GB, 156.03 GB, 155.07 GB, 156.37 GB ThreadUsage(16s000ms): 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.03 - BloomFilterBytes: 49.00 MB (51380224) - PeakMemoryUsage: 160.99 GB (172857104687) - PerHostPeakMemUsage: 169.56 GB (182066533803) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 2m6s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 1.35K (1346) - TotalThreadsTotalWallClockTime: 22s293ms - TotalThreadsSysTime: 2s225ms - TotalThreadsUserTime: 7s989ms - TotalThreadsVoluntaryContextSwitches: 23.56K (23563) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 55.757ms - ExecTreePrepareTime: 604.843us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 23.92K (23918) - BlocksRecycled: 354 (354) - BufferedPins: 0 (0) - BytesWritten: 40.73 GB (43729813504) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 161.38 GB (173283483648) - ScratchFileUsedBytes: 40.73 GB (43729813504) - TotalBufferWaitTime: 5s201ms - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=28):(Total: 814.180us, non-child: 814.180us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.05 MB (1105280) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 614.947ms, non-child: 614.947ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 205.586ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 122 (122) - NumInstructions: 8.95K (8951) - OptimizationTime: 384.968ms - PeakMemoryUsage: 4.37 MB (4582912) - PrepareTime: 23.868ms HASH_JOIN_NODE (id=15):(Total: 1.142ms, non-child: 849.529us, % non-child: 74.34%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 451.92K (451915) - BuildTime: 127.823ms - PeakMemoryUsage: 153.09 MB (160524544) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=15): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 94.284ms - BuildRowsPartitioned: 451.92K (451915) - GetNewBlockTime: 386.809us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 30.999ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160449664) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=26):(Total: 2s072ms, non-child: 26.456ms, % non-child: 1.28%) BytesReceived(16s000ms): 5.51 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB - BytesReceived: 6.21 MB (6513198) - ConvertRowBatchTime: 11.862ms - DeserializeRowBatchTimer: 53.929ms - FirstBatchArrivalWaitTime: 1s198ms - PeakMemoryUsage: 0 - RowsReturned: 451.92K (451915) - RowsReturnedRate: 218.02 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=14):(Total: 906.932us, non-child: 962.798us, % non-child: 100.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 458.53K (458529) - BuildTime: 150.808ms - PeakMemoryUsage: 25.08 MB (26298624) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 92.008ms - BuildRowsPartitioned: 458.53K (458529) - GetNewBlockTime: 149.902us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 29.041ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 25.02 MB (26231936) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 4s184ms, non-child: 16.404ms, % non-child: 0.39%) BytesReceived(16s000ms): 6.00 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB - BytesReceived: 7.33 MB (7681588) - ConvertRowBatchTime: 12.221ms - DeserializeRowBatchTimer: 16.247ms - FirstBatchArrivalWaitTime: 2s107ms - PeakMemoryUsage: 0 - RowsReturned: 458.53K (458529) - RowsReturnedRate: 109.59 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=13):(Total: 626.934us, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 4.02B (4021069559) - BuildTime: 6m6s - PeakMemoryUsage: 159.10 GB (170827352320) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled, Spilled Runtime filters: 0 of 1 Runtime Filter Published, 1 Disabled - BuildRowsPartitionTime: 6m6s - BuildRowsPartitioned: 4.02B (4021069559) - GetNewBlockTime: 44s662ms - HashBuckets: 536.87M (536870912) - HashCollisions: 0 (0) - HashTablesBuildTime: 42s534ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 159.10 GB (170827293824) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 4 (4) - UnpinTime: 311.510ms HASH_JOIN_NODE (id=12):(Total: 3m16s, non-child: 1m16s, % non-child: 38.89%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 40.13M (40131187) - BuildTime: 8s394ms - PeakMemoryUsage: 3.02 GB (3240188128) - ProbeRows: 75.65M (75654773) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1m7s - RowsReturned: 4.02B (4021069559) - RowsReturnedRate: 20.46 M/sec Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 5s524ms - BuildRowsPartitioned: 40.13M (40131187) - GetNewBlockTime: 2.441ms - HashBuckets: 67.11M (67108864) - HashCollisions: 0 (0) - HashTablesBuildTime: 2s821ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 3.02 GB (3240125568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 7s274ms, non-child: 1s694ms, % non-child: 23.29%) BytesReceived(16s000ms): 218.29 MB, 380.08 MB, 380.08 MB, 380.08 MB, 380.08 MB, 380.08 MB, 380.08 MB, 380.08 MB, 380.08 MB, 380.08 MB, 380.08 MB, 380.08 MB, 380.08 MB, 380.08 MB, 380.08 MB, 380.08 MB, 380.08 MB, 380.08 MB, 380.08 MB, 380.08 MB, 380.08 MB, 380.08 MB, 380.08 MB, 380.08 MB, 380.08 MB, 380.08 MB, 380.08 MB, 380.08 MB, 380.08 MB, 380.08 MB, 380.08 MB, 380.08 MB, 380.08 MB, 380.08 MB, 380.08 MB, 380.08 MB, 380.08 MB, 380.08 MB, 380.08 MB, 380.08 MB - BytesReceived: 380.08 MB (398541169) - ConvertRowBatchTime: 972.421ms - DeserializeRowBatchTimer: 1s753ms - FirstBatchArrivalWaitTime: 1s130ms - PeakMemoryUsage: 0 - RowsReturned: 40.13M (40131187) - RowsReturnedRate: 5.52 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=22):(Total: 1m53s, non-child: 1s269ms, % non-child: 1.12%) BytesReceived(16s000ms): 2.18 MB, 16.02 MB, 42.69 MB, 68.56 MB, 95.40 MB, 122.29 MB, 149.42 MB, 176.60 MB, 202.95 MB, 228.95 MB, 253.94 MB, 279.67 MB, 306.40 MB, 332.56 MB, 356.65 MB, 383.85 MB, 409.46 MB, 436.67 MB, 459.36 MB, 484.67 MB, 507.18 MB, 524.36 MB, 543.37 MB, 565.75 MB, 583.87 MB, 596.39 MB, 616.49 MB, 632.66 MB, 646.27 MB, 650.86 MB, 659.69 MB, 672.72 MB, 678.03 MB, 686.86 MB, 695.52 MB, 700.60 MB, 700.60 MB, 700.60 MB, 700.60 MB, 700.60 MB - BytesReceived: 700.60 MB (734634833) - ConvertRowBatchTime: 844.420ms - DeserializeRowBatchTimer: 6s353ms - FirstBatchArrivalWaitTime: 793.218ms - PeakMemoryUsage: 0 - RowsReturned: 75.65M (75654773) - RowsReturnedRate: 665.79 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=24):(Total: 1s725ms, non-child: 3.887us, % non-child: 0.00%) BytesReceived(16s000ms): 9.08 MB, 10.74 MB, 10.74 MB, 10.74 MB, 10.74 MB, 10.74 MB, 10.74 MB, 10.74 MB, 10.74 MB, 10.74 MB, 10.74 MB, 10.74 MB, 10.74 MB, 10.74 MB, 10.74 MB, 10.74 MB, 10.74 MB, 10.74 MB, 10.74 MB, 10.74 MB, 10.74 MB, 10.74 MB, 10.74 MB, 10.74 MB, 10.74 MB, 10.74 MB, 10.74 MB, 10.74 MB, 10.74 MB, 10.74 MB, 10.74 MB, 10.74 MB, 10.74 MB, 10.74 MB, 10.74 MB, 10.74 MB, 10.74 MB, 10.74 MB, 10.75 MB, 10.76 MB - BytesReceived: 11.06 MB (11599641) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 73.597ms - FirstBatchArrivalWaitTime: 1s725ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:35e (host=vd1109.foo:22000):(Total: 55.744ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 934.20 MB, 7.01 GB, 14.28 GB, 20.90 GB, 28.01 GB, 34.98 GB, 42.02 GB, 48.90 GB, 55.60 GB, 62.27 GB, 68.78 GB, 75.40 GB, 82.51 GB, 89.17 GB, 95.51 GB, 102.48 GB, 109.15 GB, 115.90 GB, 122.20 GB, 128.66 GB, 135.11 GB, 139.47 GB, 144.38 GB, 150.16 GB, 155.00 GB, 158.36 GB, 153.30 GB, 156.04 GB, 159.04 GB, 158.43 GB, 150.92 GB, 153.41 GB, 154.83 GB, 156.78 GB, 158.45 GB, 154.52 GB, 156.80 GB, 157.77 GB, 156.80 GB, 157.88 GB ThreadUsage(16s000ms): 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.03 - BloomFilterBytes: 49.00 MB (51380224) - PeakMemoryUsage: 160.99 GB (172866632351) - PerHostPeakMemUsage: 169.55 GB (182058052627) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 1m48s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 1.37K (1371) - TotalThreadsTotalWallClockTime: 22s316ms - TotalThreadsSysTime: 2s184ms - TotalThreadsUserTime: 8s055ms - TotalThreadsVoluntaryContextSwitches: 23.26K (23260) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 55.689ms - ExecTreePrepareTime: 603.152us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 24.48K (24484) - BlocksRecycled: 354 (354) - BufferedPins: 0 (0) - BytesWritten: 45.14 GB (48469377024) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 161.38 GB (173283483648) - ScratchFileUsedBytes: 45.14 GB (48469377024) - TotalBufferWaitTime: 2s159ms - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=28):(Total: 773.616us, non-child: 773.616us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.05 MB (1105280) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 621.079ms, non-child: 621.079ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 207.987ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 122 (122) - NumInstructions: 8.95K (8951) - OptimizationTime: 387.764ms - PeakMemoryUsage: 4.37 MB (4582912) - PrepareTime: 24.822ms HASH_JOIN_NODE (id=15):(Total: 1.143ms, non-child: 778.476us, % non-child: 68.09%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 451.92K (451915) - BuildTime: 128.773ms - PeakMemoryUsage: 153.09 MB (160524544) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=15): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 98.781ms - BuildRowsPartitioned: 451.92K (451915) - GetNewBlockTime: 455.235us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 27.632ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160449664) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=26):(Total: 2s065ms, non-child: 32.765ms, % non-child: 1.59%) BytesReceived(16s000ms): 5.38 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB - BytesReceived: 6.21 MB (6513198) - ConvertRowBatchTime: 12.031ms - DeserializeRowBatchTimer: 55.396ms - FirstBatchArrivalWaitTime: 1s193ms - PeakMemoryUsage: 0 - RowsReturned: 451.92K (451915) - RowsReturnedRate: 218.83 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=14):(Total: 919.101us, non-child: 826.778us, % non-child: 89.96%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 459.61K (459605) - BuildTime: 173.250ms - PeakMemoryUsage: 25.08 MB (26298624) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 114.024ms - BuildRowsPartitioned: 459.61K (459605) - GetNewBlockTime: 164.433us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 23.924ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 25.02 MB (26231936) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 4s153ms, non-child: 19.740ms, % non-child: 0.48%) BytesReceived(16s000ms): 5.82 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB - BytesReceived: 7.34 MB (7700035) - ConvertRowBatchTime: 15.624ms - DeserializeRowBatchTimer: 19.298ms - FirstBatchArrivalWaitTime: 2s100ms - PeakMemoryUsage: 0 - RowsReturned: 459.61K (459605) - RowsReturnedRate: 110.65 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=13):(Total: 650.350us, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 4.08B (4081513466) - BuildTime: 6m18s - PeakMemoryUsage: 160.09 GB (171892705536) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled, Spilled Runtime filters: 0 of 1 Runtime Filter Published, 1 Disabled - BuildRowsPartitionTime: 6m18s - BuildRowsPartitioned: 4.08B (4081513466) - GetNewBlockTime: 46s543ms - HashBuckets: 536.87M (536870912) - HashCollisions: 0 (0) - HashTablesBuildTime: 56s316ms - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 160.09 GB (171892647040) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 4 (4) - UnpinTime: 280.495ms HASH_JOIN_NODE (id=12):(Total: 3m4s, non-child: 1m22s, % non-child: 44.66%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 40.16M (40162575) - BuildTime: 8s378ms - PeakMemoryUsage: 3.02 GB (3240188128) - ProbeRows: 76.86M (76858493) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1m9s - RowsReturned: 4.08B (4081513466) - RowsReturnedRate: 22.10 M/sec Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 5s487ms - BuildRowsPartitioned: 40.16M (40162575) - GetNewBlockTime: 3.215ms - HashBuckets: 67.11M (67108864) - HashCollisions: 0 (0) - HashTablesBuildTime: 2s847ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 3.02 GB (3240125568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 7s329ms, non-child: 1s744ms, % non-child: 23.80%) BytesReceived(16s000ms): 209.27 MB, 380.34 MB, 380.34 MB, 380.34 MB, 380.34 MB, 380.34 MB, 380.34 MB, 380.34 MB, 380.34 MB, 380.34 MB, 380.34 MB, 380.34 MB, 380.34 MB, 380.34 MB, 380.34 MB, 380.34 MB, 380.34 MB, 380.34 MB, 380.34 MB, 380.34 MB, 380.34 MB, 380.34 MB, 380.34 MB, 380.34 MB, 380.34 MB, 380.34 MB, 380.34 MB, 380.34 MB, 380.34 MB, 380.34 MB, 380.34 MB, 380.34 MB, 380.34 MB, 380.34 MB, 380.34 MB, 380.34 MB, 380.34 MB, 380.34 MB, 380.34 MB, 380.34 MB - BytesReceived: 380.34 MB (398815475) - ConvertRowBatchTime: 989.276ms - DeserializeRowBatchTimer: 1s804ms - FirstBatchArrivalWaitTime: 1s120ms - PeakMemoryUsage: 0 - RowsReturned: 40.16M (40162575) - RowsReturnedRate: 5.48 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=22):(Total: 1m35s, non-child: 2s252ms, % non-child: 2.35%) BytesReceived(16s000ms): 2.16 MB, 15.58 MB, 42.62 MB, 69.04 MB, 96.32 MB, 123.58 MB, 151.15 MB, 178.86 MB, 204.86 MB, 230.85 MB, 256.26 MB, 282.57 MB, 309.78 MB, 336.38 MB, 361.03 MB, 388.42 MB, 414.42 MB, 442.21 MB, 465.98 MB, 491.56 MB, 515.58 MB, 532.70 MB, 551.67 MB, 574.43 MB, 592.91 MB, 605.61 MB, 625.36 MB, 641.94 MB, 656.33 MB, 660.90 MB, 669.61 MB, 682.69 MB, 688.58 MB, 697.02 MB, 707.55 MB, 711.88 MB, 711.89 MB, 711.89 MB, 711.89 MB, 711.89 MB - BytesReceived: 711.89 MB (746466224) - ConvertRowBatchTime: 854.646ms - DeserializeRowBatchTimer: 7s253ms - FirstBatchArrivalWaitTime: 789.314ms - PeakMemoryUsage: 0 - RowsReturned: 76.86M (76858493) - RowsReturnedRate: 803.42 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=24):(Total: 1s725ms, non-child: 2.665us, % non-child: 0.00%) BytesReceived(16s000ms): 8.49 MB, 10.34 MB, 10.34 MB, 10.34 MB, 10.34 MB, 10.34 MB, 10.34 MB, 10.34 MB, 10.34 MB, 10.34 MB, 10.34 MB, 10.34 MB, 10.34 MB, 10.34 MB, 10.34 MB, 10.34 MB, 10.34 MB, 10.34 MB, 10.34 MB, 10.34 MB, 10.34 MB, 10.34 MB, 10.34 MB, 10.34 MB, 10.34 MB, 10.34 MB, 10.34 MB, 10.34 MB, 10.34 MB, 10.34 MB, 10.34 MB, 10.34 MB, 10.34 MB, 10.34 MB, 10.34 MB, 10.34 MB, 10.34 MB, 10.38 MB, 10.49 MB, 10.49 MB - BytesReceived: 10.69 MB (11212383) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 84.336ms - FirstBatchArrivalWaitTime: 1s725ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:350 (host=vd1341.foo:22000):(Total: 55.623ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 993.67 MB, 6.97 GB, 14.38 GB, 21.16 GB, 28.07 GB, 35.00 GB, 41.92 GB, 48.76 GB, 55.38 GB, 61.88 GB, 68.28 GB, 74.86 GB, 81.78 GB, 88.37 GB, 94.54 GB, 101.42 GB, 108.06 GB, 114.97 GB, 120.97 GB, 127.40 GB, 134.05 GB, 138.72 GB, 143.46 GB, 149.22 GB, 153.89 GB, 157.12 GB, 153.31 GB, 155.46 GB, 158.27 GB, 158.01 GB, 150.87 GB, 152.73 GB, 154.90 GB, 156.58 GB, 158.54 GB, 153.74 GB, 156.17 GB, 156.32 GB, 154.92 GB, 156.93 GB ThreadUsage(16s000ms): 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.03 - BloomFilterBytes: 49.00 MB (51380224) - PeakMemoryUsage: 160.60 GB (172445493727) - PerHostPeakMemUsage: 169.56 GB (182068199748) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 1m49s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 1.68K (1684) - TotalThreadsTotalWallClockTime: 22s414ms - TotalThreadsSysTime: 2s213ms - TotalThreadsUserTime: 8s256ms - TotalThreadsVoluntaryContextSwitches: 21.54K (21535) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 55.587ms - ExecTreePrepareTime: 587.630us DataStreamSender (dst_id=28):(Total: 895.214us, non-child: 895.214us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.05 MB (1105280) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 600.492ms, non-child: 600.492ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 199.652ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 122 (122) - NumInstructions: 8.95K (8951) - OptimizationTime: 375.701ms - PeakMemoryUsage: 4.37 MB (4582912) - PrepareTime: 24.754ms HASH_JOIN_NODE (id=15):(Total: 1.129ms, non-child: 853.266us, % non-child: 75.56%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 451.92K (451915) - BuildTime: 141.467ms - PeakMemoryUsage: 153.09 MB (160524544) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=15): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 105.947ms - BuildRowsPartitioned: 451.92K (451915) - GetNewBlockTime: 425.310us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 32.716ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160449664) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=26):(Total: 2s073ms, non-child: 24.863ms, % non-child: 1.20%) BytesReceived(16s000ms): 5.47 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB - BytesReceived: 6.21 MB (6513198) - ConvertRowBatchTime: 11.882ms - DeserializeRowBatchTimer: 55.272ms - FirstBatchArrivalWaitTime: 1s216ms - PeakMemoryUsage: 0 - RowsReturned: 451.92K (451915) - RowsReturnedRate: 217.97 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=14):(Total: 880.270us, non-child: 868.610us, % non-child: 98.68%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 460.19K (460185) - BuildTime: 152.288ms - PeakMemoryUsage: 25.08 MB (26298624) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 88.370ms - BuildRowsPartitioned: 460.19K (460185) - GetNewBlockTime: 213.349us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 26.937ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 25.02 MB (26231936) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 4s194ms, non-child: 15.844ms, % non-child: 0.38%) BytesReceived(16s000ms): 5.99 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB - BytesReceived: 7.35 MB (7707307) - ConvertRowBatchTime: 11.685ms - DeserializeRowBatchTimer: 15.791ms - FirstBatchArrivalWaitTime: 2s128ms - PeakMemoryUsage: 0 - RowsReturned: 460.19K (460185) - RowsReturnedRate: 109.72 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=13):(Total: 625.420us, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 4.04B (4040501430) - BuildTime: 6m22s - PeakMemoryUsage: 160.16 GB (171968792832) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled, Spilled Runtime filters: 0 of 1 Runtime Filter Published, 1 Disabled - BuildRowsPartitionTime: 6m21s - BuildRowsPartitioned: 4.04B (4040501430) - GetNewBlockTime: 38s134ms - HashBuckets: 536.87M (536870912) - HashCollisions: 0 (0) - HashTablesBuildTime: 1m21s - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 160.16 GB (171968734336) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 5 (5) - UnpinTime: 344.715ms HASH_JOIN_NODE (id=12):(Total: 3m, non-child: 1m17s, % non-child: 42.95%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 40.19M (40190496) - BuildTime: 8s703ms - PeakMemoryUsage: 3.02 GB (3240192224) - ProbeRows: 75.44M (75439148) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1m8s - RowsReturned: 4.04B (4040501430) - RowsReturnedRate: 22.36 M/sec Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 5s725ms - BuildRowsPartitioned: 40.19M (40190496) - GetNewBlockTime: 2.902ms - HashBuckets: 67.11M (67108864) - HashCollisions: 0 (0) - HashTablesBuildTime: 2s923ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 3.02 GB (3240125568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 7s055ms, non-child: 1s535ms, % non-child: 21.77%) BytesReceived(16s000ms): 216.98 MB, 380.63 MB, 380.63 MB, 380.63 MB, 380.63 MB, 380.63 MB, 380.63 MB, 380.63 MB, 380.63 MB, 380.63 MB, 380.63 MB, 380.63 MB, 380.63 MB, 380.63 MB, 380.63 MB, 380.63 MB, 380.63 MB, 380.63 MB, 380.63 MB, 380.63 MB, 380.63 MB, 380.63 MB, 380.63 MB, 380.63 MB, 380.63 MB, 380.63 MB, 380.63 MB, 380.63 MB, 380.63 MB, 380.63 MB, 380.63 MB, 380.63 MB, 380.63 MB, 380.63 MB, 380.63 MB, 380.63 MB, 380.63 MB, 380.63 MB, 380.63 MB, 380.63 MB - BytesReceived: 380.63 MB (399117725) - ConvertRowBatchTime: 941.664ms - DeserializeRowBatchTimer: 1s538ms - FirstBatchArrivalWaitTime: 1s142ms - PeakMemoryUsage: 0 - RowsReturned: 40.19M (40190496) - RowsReturnedRate: 5.70 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=22):(Total: 1m36s, non-child: 1s284ms, % non-child: 1.33%) BytesReceived(16s000ms): 2.11 MB, 15.87 MB, 42.75 MB, 68.79 MB, 95.56 MB, 122.41 MB, 149.34 MB, 176.18 MB, 201.50 MB, 226.74 MB, 251.69 MB, 277.26 MB, 303.79 MB, 329.87 MB, 353.91 MB, 380.78 MB, 406.30 MB, 433.42 MB, 456.62 MB, 481.70 MB, 506.56 MB, 524.73 MB, 543.37 MB, 565.87 MB, 583.25 MB, 595.81 MB, 616.19 MB, 632.12 MB, 644.50 MB, 649.20 MB, 658.32 MB, 671.15 MB, 676.09 MB, 685.55 MB, 694.14 MB, 698.50 MB, 698.50 MB, 698.50 MB, 698.50 MB, 698.50 MB - BytesReceived: 698.50 MB (732434984) - ConvertRowBatchTime: 829.384ms - DeserializeRowBatchTimer: 8s088ms - FirstBatchArrivalWaitTime: 800.387ms - PeakMemoryUsage: 0 - RowsReturned: 75.44M (75439148) - RowsReturnedRate: 778.98 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=24):(Total: 1s756ms, non-child: 4.515us, % non-child: 0.00%) BytesReceived(16s000ms): 8.42 MB, 9.98 MB, 9.98 MB, 9.98 MB, 9.98 MB, 9.98 MB, 9.98 MB, 9.98 MB, 9.98 MB, 9.98 MB, 9.98 MB, 9.98 MB, 9.98 MB, 9.98 MB, 9.98 MB, 9.98 MB, 9.98 MB, 9.98 MB, 9.98 MB, 9.98 MB, 9.98 MB, 9.98 MB, 9.98 MB, 9.98 MB, 9.98 MB, 9.98 MB, 9.98 MB, 9.98 MB, 9.98 MB, 9.98 MB, 9.98 MB, 9.98 MB, 9.98 MB, 9.98 MB, 9.98 MB, 9.98 MB, 9.98 MB, 9.98 MB, 9.98 MB, 9.98 MB - BytesReceived: 9.98 MB (10461652) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 69.281ms - FirstBatchArrivalWaitTime: 1s756ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:30e (host=va1029.foo:22000):(Total: 55.487ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 1.04 GB, 7.44 GB, 14.49 GB, 21.26 GB, 28.27 GB, 35.29 GB, 42.40 GB, 49.49 GB, 56.13 GB, 62.79 GB, 69.23 GB, 75.88 GB, 82.89 GB, 89.38 GB, 95.98 GB, 102.99 GB, 109.71 GB, 116.64 GB, 123.66 GB, 130.84 GB, 136.47 GB, 141.04 GB, 145.86 GB, 151.67 GB, 156.36 GB, 157.35 GB, 154.04 GB, 157.71 GB, 158.70 GB, 152.21 GB, 153.04 GB, 154.76 GB, 156.81 GB, 158.79 GB, 158.25 GB, 153.87 GB, 156.67 GB, 157.62 GB, 146.77 GB, 156.09 GB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.03 - BloomFilterBytes: 49.00 MB (51380224) - PeakMemoryUsage: 160.63 GB (172474887739) - PerHostPeakMemUsage: 169.56 GB (182062110817) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 2m14s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 1.50K (1500) - TotalThreadsTotalWallClockTime: 21s415ms - TotalThreadsSysTime: 2s206ms - TotalThreadsUserTime: 7s981ms - TotalThreadsVoluntaryContextSwitches: 21.64K (21640) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 55.446ms - ExecTreePrepareTime: 616.836us DataStreamSender (dst_id=28):(Total: 950.224us, non-child: 950.224us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.05 MB (1105280) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 705.230ms, non-child: 705.230ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 215.053ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 122 (122) - NumInstructions: 8.95K (8951) - OptimizationTime: 464.082ms - PeakMemoryUsage: 4.37 MB (4582912) - PrepareTime: 25.625ms HASH_JOIN_NODE (id=15):(Total: 1.192ms, non-child: 824.464us, % non-child: 69.14%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 451.92K (451915) - BuildTime: 147.920ms - PeakMemoryUsage: 153.09 MB (160524544) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=15): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 103.396ms - BuildRowsPartitioned: 451.92K (451915) - GetNewBlockTime: 495.475us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 41.276ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160449664) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=26):(Total: 1s992ms, non-child: 23.144ms, % non-child: 1.16%) BytesReceived(16s000ms): 5.46 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB - BytesReceived: 6.21 MB (6513198) - ConvertRowBatchTime: 12.268ms - DeserializeRowBatchTimer: 49.056ms - FirstBatchArrivalWaitTime: 1s130ms - PeakMemoryUsage: 0 - RowsReturned: 451.92K (451915) - RowsReturnedRate: 226.84 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=14):(Total: 1.012ms, non-child: 818.404us, % non-child: 80.85%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 461.06K (461061) - BuildTime: 162.606ms - PeakMemoryUsage: 25.08 MB (26298624) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 91.019ms - BuildRowsPartitioned: 461.06K (461061) - GetNewBlockTime: 159.204us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 27.641ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 25.02 MB (26231936) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 4s044ms, non-child: 15.876ms, % non-child: 0.39%) BytesReceived(16s000ms): 6.00 MB, 7.36 MB, 7.36 MB, 7.36 MB, 7.36 MB, 7.36 MB, 7.36 MB, 7.36 MB, 7.36 MB, 7.36 MB, 7.36 MB, 7.36 MB, 7.36 MB, 7.36 MB, 7.36 MB, 7.36 MB, 7.36 MB, 7.36 MB, 7.36 MB, 7.36 MB, 7.36 MB, 7.36 MB, 7.36 MB, 7.36 MB, 7.36 MB, 7.36 MB, 7.36 MB, 7.36 MB, 7.36 MB, 7.36 MB, 7.36 MB, 7.36 MB, 7.36 MB, 7.36 MB, 7.36 MB, 7.36 MB, 7.36 MB, 7.36 MB, 7.36 MB, 7.36 MB - BytesReceived: 7.36 MB (7722042) - ConvertRowBatchTime: 11.753ms - DeserializeRowBatchTimer: 16.602ms - FirstBatchArrivalWaitTime: 2s043ms - PeakMemoryUsage: 0 - RowsReturned: 461.06K (461061) - RowsReturnedRate: 114.00 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=13):(Total: 783.368us, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 4.10B (4102116427) - BuildTime: 6m1s - PeakMemoryUsage: 160.16 GB (171968203008) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled, Spilled Runtime filters: 0 of 1 Runtime Filter Published, 1 Disabled - BuildRowsPartitionTime: 6m1s - BuildRowsPartitioned: 4.10B (4102116427) - GetNewBlockTime: 49s232ms - HashBuckets: 536.87M (536870912) - HashCollisions: 0 (0) - HashTablesBuildTime: 1m - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 160.16 GB (171968144512) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 4 (4) - UnpinTime: 344.472ms HASH_JOIN_NODE (id=12):(Total: 3m21s, non-child: 1m12s, % non-child: 36.24%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 40.28M (40280381) - BuildTime: 8s363ms - PeakMemoryUsage: 3.02 GB (3240188128) - ProbeRows: 77.17M (77166202) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1m3s - RowsReturned: 4.10B (4102116427) - RowsReturnedRate: 20.39 M/sec Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 5s683ms - BuildRowsPartitioned: 40.28M (40280381) - GetNewBlockTime: 3.498ms - HashBuckets: 67.11M (67108864) - HashCollisions: 0 (0) - HashTablesBuildTime: 2s628ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 3.02 GB (3240125568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 6s602ms, non-child: 1s547ms, % non-child: 23.45%) BytesReceived(16s000ms): 217.07 MB, 381.48 MB, 381.48 MB, 381.48 MB, 381.48 MB, 381.48 MB, 381.48 MB, 381.48 MB, 381.48 MB, 381.48 MB, 381.48 MB, 381.48 MB, 381.48 MB, 381.48 MB, 381.48 MB, 381.48 MB, 381.48 MB, 381.48 MB, 381.48 MB, 381.48 MB, 381.48 MB, 381.48 MB, 381.48 MB, 381.48 MB, 381.48 MB, 381.48 MB, 381.48 MB, 381.48 MB, 381.48 MB, 381.48 MB, 381.48 MB, 381.48 MB, 381.48 MB, 381.48 MB, 381.48 MB, 381.48 MB, 381.48 MB, 381.48 MB, 381.48 MB, 381.48 MB - BytesReceived: 381.48 MB (400012938) - ConvertRowBatchTime: 955.735ms - DeserializeRowBatchTimer: 1s532ms - FirstBatchArrivalWaitTime: 1s054ms - PeakMemoryUsage: 0 - RowsReturned: 40.28M (40280381) - RowsReturnedRate: 6.10 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=22):(Total: 2m2s, non-child: 1s273ms, % non-child: 1.04%) BytesReceived(16s000ms): 2.20 MB, 16.15 MB, 43.37 MB, 69.75 MB, 97.01 MB, 124.34 MB, 152.02 MB, 179.75 MB, 205.92 MB, 231.77 MB, 257.20 MB, 283.29 MB, 310.44 MB, 337.10 MB, 361.85 MB, 389.44 MB, 415.67 MB, 443.57 MB, 470.59 MB, 497.26 MB, 519.20 MB, 537.18 MB, 556.36 MB, 579.35 MB, 597.09 MB, 609.89 MB, 630.54 MB, 646.72 MB, 659.22 MB, 664.22 MB, 673.49 MB, 686.65 MB, 691.69 MB, 701.25 MB, 709.96 MB, 714.37 MB, 714.38 MB, 714.38 MB, 714.38 MB, 714.38 MB - BytesReceived: 714.38 MB (749076510) - ConvertRowBatchTime: 822.877ms - DeserializeRowBatchTimer: 6s295ms - FirstBatchArrivalWaitTime: 717.341ms - PeakMemoryUsage: 0 - RowsReturned: 77.17M (77166202) - RowsReturnedRate: 630.54 K/sec - SendersBlockedTimer: 13s091ms - SendersBlockedTotalTimer(*): 25m3s EXCHANGE_NODE (id=24):(Total: 1s662ms, non-child: 5.406us, % non-child: 0.00%) BytesReceived(16s000ms): 8.90 MB, 10.55 MB, 10.55 MB, 10.55 MB, 10.55 MB, 10.55 MB, 10.55 MB, 10.55 MB, 10.55 MB, 10.55 MB, 10.55 MB, 10.55 MB, 10.55 MB, 10.55 MB, 10.55 MB, 10.55 MB, 10.55 MB, 10.55 MB, 10.55 MB, 10.55 MB, 10.55 MB, 10.55 MB, 10.55 MB, 10.55 MB, 10.55 MB, 10.55 MB, 10.55 MB, 10.55 MB, 10.55 MB, 10.55 MB, 10.55 MB, 10.55 MB, 10.55 MB, 10.55 MB, 10.55 MB, 10.55 MB, 10.55 MB, 10.57 MB, 10.65 MB, 10.66 MB - BytesReceived: 11.09 MB (11625669) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 68.433ms - FirstBatchArrivalWaitTime: 1s662ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:321 (host=vd1115.foo:22000):(Total: 55.443ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 981.00 MB, 7.00 GB, 13.78 GB, 20.25 GB, 26.95 GB, 33.65 GB, 40.44 GB, 47.21 GB, 53.60 GB, 59.99 GB, 66.08 GB, 72.50 GB, 79.23 GB, 85.55 GB, 91.77 GB, 98.69 GB, 104.99 GB, 111.51 GB, 117.57 GB, 123.76 GB, 129.77 GB, 133.93 GB, 138.66 GB, 144.24 GB, 148.83 GB, 152.07 GB, 156.84 GB, 155.63 GB, 153.65 GB, 154.56 GB, 156.46 GB, 159.66 GB, 160.43 GB, 151.41 GB, 153.11 GB, 153.30 GB, 154.53 GB, 150.30 GB, 150.73 GB, 150.85 GB ThreadUsage(16s000ms): 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.03 - BloomFilterBytes: 49.00 MB (51380224) - PeakMemoryUsage: 160.61 GB (172456411425) - PerHostPeakMemUsage: 169.57 GB (182077227576) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 2m8s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 1.35K (1348) - TotalThreadsTotalWallClockTime: 21s867ms - TotalThreadsSysTime: 2s169ms - TotalThreadsUserTime: 7s968ms - TotalThreadsVoluntaryContextSwitches: 23.74K (23742) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 55.408ms - ExecTreePrepareTime: 556.121us DataStreamSender (dst_id=28):(Total: 683.083us, non-child: 683.083us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.05 MB (1105280) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 605.052ms, non-child: 605.052ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 195.633ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 122 (122) - NumInstructions: 8.95K (8951) - OptimizationTime: 383.276ms - PeakMemoryUsage: 4.37 MB (4582912) - PrepareTime: 25.747ms HASH_JOIN_NODE (id=15):(Total: 1.046ms, non-child: 929.021us, % non-child: 88.79%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 451.92K (451915) - BuildTime: 142.686ms - PeakMemoryUsage: 153.09 MB (160524544) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=15): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 103.577ms - BuildRowsPartitioned: 451.92K (451915) - GetNewBlockTime: 478.882us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 36.081ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160449664) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=26):(Total: 2s084ms, non-child: 26.015ms, % non-child: 1.25%) BytesReceived(16s000ms): 5.37 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB - BytesReceived: 6.21 MB (6513198) - ConvertRowBatchTime: 12.856ms - DeserializeRowBatchTimer: 51.637ms - FirstBatchArrivalWaitTime: 1s226ms - PeakMemoryUsage: 0 - RowsReturned: 451.92K (451915) - RowsReturnedRate: 216.80 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=14):(Total: 790.812us, non-child: 829.187us, % non-child: 100.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 458.11K (458110) - BuildTime: 179.870ms - PeakMemoryUsage: 25.08 MB (26298624) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 105.290ms - BuildRowsPartitioned: 458.11K (458110) - GetNewBlockTime: 269.038us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 25.705ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 25.02 MB (26231936) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 4s135ms, non-child: 16.712ms, % non-child: 0.40%) BytesReceived(16s000ms): 5.79 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB - BytesReceived: 7.32 MB (7674534) - ConvertRowBatchTime: 12.682ms - DeserializeRowBatchTimer: 16.639ms - FirstBatchArrivalWaitTime: 2s133ms - PeakMemoryUsage: 0 - RowsReturned: 458.11K (458110) - RowsReturnedRate: 110.78 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=13):(Total: 569.966us, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 3.91B (3913532660) - BuildTime: 6m5s - PeakMemoryUsage: 160.16 GB (171968203008) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled, Spilled Runtime filters: 0 of 1 Runtime Filter Published, 1 Disabled - BuildRowsPartitionTime: 6m5s - BuildRowsPartitioned: 3.91B (3913532660) - GetNewBlockTime: 35s328ms - HashBuckets: 536.87M (536870912) - HashCollisions: 0 (0) - HashTablesBuildTime: 1m8s - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 160.16 GB (171968144512) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 4 (4) - UnpinTime: 555.687ms HASH_JOIN_NODE (id=12):(Total: 3m17s, non-child: 1m15s, % non-child: 38.50%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 40.12M (40123265) - BuildTime: 8s263ms - PeakMemoryUsage: 3.02 GB (3240188916) - ProbeRows: 74.97M (74970325) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1m6s - RowsReturned: 3.91B (3913532660) - RowsReturnedRate: 19.84 M/sec Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 5s441ms - BuildRowsPartitioned: 40.12M (40123265) - GetNewBlockTime: 3.020ms - HashBuckets: 67.11M (67108864) - HashCollisions: 0 (0) - HashTablesBuildTime: 2s771ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 3.02 GB (3240125568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 6s972ms, non-child: 1s721ms, % non-child: 24.69%) BytesReceived(16s000ms): 208.36 MB, 379.99 MB, 379.99 MB, 379.99 MB, 379.99 MB, 379.99 MB, 379.99 MB, 379.99 MB, 379.99 MB, 379.99 MB, 379.99 MB, 379.99 MB, 379.99 MB, 379.99 MB, 379.99 MB, 379.99 MB, 379.99 MB, 379.99 MB, 379.99 MB, 379.99 MB, 379.99 MB, 379.99 MB, 379.99 MB, 379.99 MB, 379.99 MB, 379.99 MB, 379.99 MB, 379.99 MB, 379.99 MB, 379.99 MB, 379.99 MB, 379.99 MB, 379.99 MB, 379.99 MB, 379.99 MB, 379.99 MB, 379.99 MB, 379.99 MB, 379.99 MB, 379.99 MB - BytesReceived: 379.99 MB (398449983) - ConvertRowBatchTime: 975.714ms - DeserializeRowBatchTimer: 1s786ms - FirstBatchArrivalWaitTime: 1s139ms - PeakMemoryUsage: 0 - RowsReturned: 40.12M (40123265) - RowsReturnedRate: 5.75 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=22):(Total: 1m55s, non-child: 1s923ms, % non-child: 1.67%) BytesReceived(16s000ms): 2.08 MB, 15.05 MB, 41.44 MB, 67.04 MB, 93.65 MB, 120.19 MB, 147.19 MB, 174.31 MB, 199.83 MB, 225.25 MB, 249.97 MB, 275.51 MB, 301.81 MB, 327.60 MB, 353.02 MB, 380.09 MB, 405.28 MB, 432.15 MB, 454.81 MB, 480.12 MB, 502.67 MB, 519.57 MB, 538.27 MB, 560.29 MB, 578.26 MB, 590.71 MB, 610.60 MB, 626.68 MB, 640.22 MB, 644.78 MB, 653.44 MB, 666.31 MB, 671.56 MB, 680.24 MB, 688.81 MB, 693.81 MB, 693.81 MB, 693.81 MB, 693.81 MB, 693.81 MB - BytesReceived: 693.81 MB (727517455) - ConvertRowBatchTime: 823.455ms - DeserializeRowBatchTimer: 6s693ms - FirstBatchArrivalWaitTime: 816.294ms - PeakMemoryUsage: 0 - RowsReturned: 74.97M (74970325) - RowsReturnedRate: 651.07 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=24):(Total: 1s747ms, non-child: 4.681us, % non-child: 0.00%) BytesReceived(16s000ms): 8.61 MB, 10.51 MB, 10.51 MB, 10.51 MB, 10.51 MB, 10.51 MB, 10.51 MB, 10.51 MB, 10.51 MB, 10.51 MB, 10.51 MB, 10.51 MB, 10.51 MB, 10.51 MB, 10.51 MB, 10.51 MB, 10.51 MB, 10.51 MB, 10.51 MB, 10.51 MB, 10.51 MB, 10.51 MB, 10.51 MB, 10.51 MB, 10.51 MB, 10.51 MB, 10.51 MB, 10.51 MB, 10.51 MB, 10.51 MB, 10.51 MB, 10.51 MB, 10.51 MB, 10.51 MB, 10.51 MB, 10.51 MB, 10.51 MB, 10.55 MB, 10.60 MB, 10.66 MB - BytesReceived: 11.00 MB (11536330) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 73.043ms - FirstBatchArrivalWaitTime: 1s747ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:325 (host=vd1116.foo:22000):(Total: 55.396ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 1.01 GB, 7.30 GB, 14.18 GB, 20.80 GB, 27.58 GB, 34.37 GB, 41.24 GB, 48.08 GB, 54.52 GB, 61.00 GB, 67.28 GB, 73.79 GB, 80.63 GB, 87.20 GB, 93.32 GB, 100.19 GB, 106.65 GB, 113.42 GB, 119.52 GB, 125.92 GB, 131.93 GB, 136.12 GB, 140.77 GB, 146.44 GB, 151.10 GB, 154.39 GB, 156.89 GB, 152.81 GB, 156.31 GB, 157.53 GB, 158.12 GB, 151.54 GB, 151.89 GB, 154.66 GB, 156.76 GB, 146.54 GB, 152.51 GB, 152.99 GB, 154.03 GB, 154.18 GB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.03 - BloomFilterBytes: 49.00 MB (51380224) - PeakMemoryUsage: 160.60 GB (172442056447) - PerHostPeakMemUsage: 169.56 GB (182059842389) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 2m30s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 1.30K (1303) - TotalThreadsTotalWallClockTime: 21s745ms - TotalThreadsSysTime: 2s003ms - TotalThreadsUserTime: 7s708ms - TotalThreadsVoluntaryContextSwitches: 25.21K (25212) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 55.342ms - ExecTreePrepareTime: 482.930us DataStreamSender (dst_id=28):(Total: 908.551us, non-child: 908.551us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.05 MB (1105280) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 614.431ms, non-child: 614.431ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 198.938ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 122 (122) - NumInstructions: 8.95K (8951) - OptimizationTime: 389.243ms - PeakMemoryUsage: 4.37 MB (4582912) - PrepareTime: 25.848ms HASH_JOIN_NODE (id=15):(Total: 920.646us, non-child: 906.569us, % non-child: 98.47%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 451.92K (451915) - BuildTime: 134.598ms - PeakMemoryUsage: 153.09 MB (160524544) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=15): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 102.470ms - BuildRowsPartitioned: 451.92K (451915) - GetNewBlockTime: 393.054us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 28.763ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160449664) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=26):(Total: 2s079ms, non-child: 24.568ms, % non-child: 1.18%) BytesReceived(16s000ms): 5.44 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB - BytesReceived: 6.21 MB (6513198) - ConvertRowBatchTime: 12.450ms - DeserializeRowBatchTimer: 50.522ms - FirstBatchArrivalWaitTime: 1s215ms - PeakMemoryUsage: 0 - RowsReturned: 451.92K (451915) - RowsReturnedRate: 217.33 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=14):(Total: 711.795us, non-child: 808.238us, % non-child: 100.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 460.12K (460118) - BuildTime: 151.684ms - PeakMemoryUsage: 25.08 MB (26298624) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 92.817ms - BuildRowsPartitioned: 460.12K (460118) - GetNewBlockTime: 321.043us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 21.497ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 25.02 MB (26231936) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 4s148ms, non-child: 15.669ms, % non-child: 0.38%) BytesReceived(16s000ms): 5.97 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB - BytesReceived: 7.35 MB (7706916) - ConvertRowBatchTime: 11.977ms - DeserializeRowBatchTimer: 15.461ms - FirstBatchArrivalWaitTime: 2s124ms - PeakMemoryUsage: 0 - RowsReturned: 460.12K (460118) - RowsReturnedRate: 110.92 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=13):(Total: 490.297us, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 3.98B (3982345283) - BuildTime: 5m44s - PeakMemoryUsage: 157.31 GB (168914159840) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled, Spilled Runtime filters: 0 of 1 Runtime Filter Published, 1 Disabled - BuildRowsPartitionTime: 5m43s - BuildRowsPartitioned: 3.98B (3982345283) - GetNewBlockTime: 38s946ms - HashBuckets: 536.87M (536870912) - HashCollisions: 0 (0) - HashTablesBuildTime: 43s000ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 157.31 GB (168914068608) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 4 (4) - UnpinTime: 251.284ms HASH_JOIN_NODE (id=12):(Total: 3m38s, non-child: 1m14s, % non-child: 34.01%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 40.21M (40213755) - BuildTime: 7s941ms - PeakMemoryUsage: 3.02 GB (3240190750) - ProbeRows: 75.12M (75120534) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1m2s - RowsReturned: 3.98B (3982345283) - RowsReturnedRate: 18.23 M/sec Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 5s223ms - BuildRowsPartitioned: 40.21M (40213755) - GetNewBlockTime: 2.242ms - HashBuckets: 67.11M (67108864) - HashCollisions: 0 (0) - HashTablesBuildTime: 2s672ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 3.02 GB (3240125568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 7s212ms, non-child: 1s545ms, % non-child: 21.43%) BytesReceived(16s000ms): 215.87 MB, 380.83 MB, 380.83 MB, 380.83 MB, 380.83 MB, 380.83 MB, 380.83 MB, 380.83 MB, 380.83 MB, 380.83 MB, 380.83 MB, 380.83 MB, 380.83 MB, 380.83 MB, 380.83 MB, 380.83 MB, 380.83 MB, 380.83 MB, 380.83 MB, 380.83 MB, 380.83 MB, 380.83 MB, 380.83 MB, 380.83 MB, 380.83 MB, 380.83 MB, 380.83 MB, 380.83 MB, 380.83 MB, 380.83 MB, 380.83 MB, 380.83 MB, 380.83 MB, 380.83 MB, 380.83 MB, 380.83 MB, 380.83 MB, 380.83 MB, 380.83 MB, 380.83 MB - BytesReceived: 380.83 MB (399331558) - ConvertRowBatchTime: 955.441ms - DeserializeRowBatchTimer: 1s601ms - FirstBatchArrivalWaitTime: 1s142ms - PeakMemoryUsage: 0 - RowsReturned: 40.21M (40213755) - RowsReturnedRate: 5.58 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=22):(Total: 2m17s, non-child: 1s230ms, % non-child: 0.89%) BytesReceived(16s000ms): 2.14 MB, 15.73 MB, 42.28 MB, 68.09 MB, 94.62 MB, 121.23 MB, 148.08 MB, 174.86 MB, 200.20 MB, 225.41 MB, 250.28 MB, 275.83 MB, 302.34 MB, 328.37 MB, 352.48 MB, 379.31 MB, 404.84 MB, 431.97 MB, 454.97 MB, 479.82 MB, 503.01 MB, 519.82 MB, 538.30 MB, 560.53 MB, 578.57 MB, 591.04 MB, 610.50 MB, 626.78 MB, 641.75 MB, 646.71 MB, 655.96 MB, 668.72 MB, 673.59 MB, 683.17 MB, 691.68 MB, 695.78 MB, 695.78 MB, 695.78 MB, 695.78 MB, 695.78 MB - BytesReceived: 695.78 MB (729576100) - ConvertRowBatchTime: 784.366ms - DeserializeRowBatchTimer: 5s475ms - FirstBatchArrivalWaitTime: 805.688ms - PeakMemoryUsage: 0 - RowsReturned: 75.12M (75120534) - RowsReturnedRate: 545.33 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=24):(Total: 1s740ms, non-child: 4.378us, % non-child: 0.00%) BytesReceived(16s000ms): 8.48 MB, 10.05 MB, 10.05 MB, 10.05 MB, 10.05 MB, 10.05 MB, 10.05 MB, 10.05 MB, 10.05 MB, 10.05 MB, 10.05 MB, 10.05 MB, 10.05 MB, 10.05 MB, 10.05 MB, 10.05 MB, 10.05 MB, 10.05 MB, 10.05 MB, 10.05 MB, 10.05 MB, 10.05 MB, 10.05 MB, 10.05 MB, 10.05 MB, 10.05 MB, 10.05 MB, 10.05 MB, 10.05 MB, 10.05 MB, 10.05 MB, 10.05 MB, 10.05 MB, 10.05 MB, 10.05 MB, 10.05 MB, 10.05 MB, 10.08 MB, 10.11 MB, 10.11 MB - BytesReceived: 10.11 MB (10596031) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 71.729ms - FirstBatchArrivalWaitTime: 1s740ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:309 (host=vd1123.foo:22000):(Total: 55.360ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 1023.01 MB, 7.21 GB, 14.25 GB, 20.91 GB, 27.81 GB, 34.69 GB, 41.63 GB, 48.56 GB, 55.05 GB, 61.59 GB, 67.93 GB, 74.52 GB, 81.39 GB, 87.93 GB, 94.16 GB, 100.99 GB, 107.58 GB, 114.38 GB, 120.58 GB, 127.03 GB, 133.27 GB, 137.42 GB, 142.26 GB, 147.96 GB, 152.98 GB, 156.85 GB, 154.99 GB, 154.68 GB, 157.73 GB, 158.49 GB, 155.53 GB, 152.23 GB, 153.25 GB, 155.94 GB, 156.96 GB, 155.73 GB, 153.56 GB, 152.73 GB, 155.09 GB, 155.29 GB ThreadUsage(16s000ms): 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.03 - BloomFilterBytes: 49.00 MB (51380224) - PeakMemoryUsage: 160.99 GB (172859422991) - PerHostPeakMemUsage: 169.57 GB (182077736965) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 1m52s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 1.71K (1706) - TotalThreadsTotalWallClockTime: 21s760ms - TotalThreadsSysTime: 2s136ms - TotalThreadsUserTime: 8s052ms - TotalThreadsVoluntaryContextSwitches: 21.73K (21728) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 55.290ms - ExecTreePrepareTime: 930.475us BlockMgr: - BlockWritesOutstanding: 1 (1) - BlocksCreated: 24.12K (24119) - BlocksRecycled: 354 (354) - BufferedPins: 0 (0) - BytesWritten: 42.30 GB (45415923712) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 161.38 GB (173283483648) - ScratchFileUsedBytes: 42.30 GB (45415923712) - TotalBufferWaitTime: 6s098ms - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=28):(Total: 1.025ms, non-child: 1.025ms, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.05 MB (1105280) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 623.222ms, non-child: 623.222ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 198.480ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 122 (122) - NumInstructions: 8.95K (8951) - OptimizationTime: 401.891ms - PeakMemoryUsage: 4.37 MB (4582912) - PrepareTime: 22.288ms HASH_JOIN_NODE (id=15):(Total: 1.760ms, non-child: 959.959us, % non-child: 54.54%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 451.92K (451915) - BuildTime: 155.079ms - PeakMemoryUsage: 153.09 MB (160524544) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=15): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 116.412ms - BuildRowsPartitioned: 451.92K (451915) - GetNewBlockTime: 535.157us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 35.556ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160449664) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=26):(Total: 2s060ms, non-child: 24.696ms, % non-child: 1.20%) BytesReceived(16s000ms): 5.39 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB - BytesReceived: 6.21 MB (6513198) - ConvertRowBatchTime: 13.808ms - DeserializeRowBatchTimer: 50.085ms - FirstBatchArrivalWaitTime: 1s209ms - PeakMemoryUsage: 0 - RowsReturned: 451.92K (451915) - RowsReturnedRate: 219.32 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=14):(Total: 1.435ms, non-child: 1.044ms, % non-child: 72.73%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 458.73K (458728) - BuildTime: 170.064ms - PeakMemoryUsage: 25.08 MB (26298624) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 106.507ms - BuildRowsPartitioned: 458.73K (458728) - GetNewBlockTime: 378.451us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 21.968ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 25.02 MB (26231936) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 4s099ms, non-child: 16.188ms, % non-child: 0.39%) BytesReceived(16s000ms): 5.83 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB - BytesReceived: 7.33 MB (7685174) - ConvertRowBatchTime: 11.889ms - DeserializeRowBatchTimer: 16.446ms - FirstBatchArrivalWaitTime: 2s126ms - PeakMemoryUsage: 0 - RowsReturned: 458.73K (458728) - RowsReturnedRate: 111.91 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=13):(Total: 1.027ms, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 4.03B (4027680016) - BuildTime: 6m31s - PeakMemoryUsage: 157.92 GB (169560672512) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled, Spilled Runtime filters: 0 of 1 Runtime Filter Published, 1 Disabled - BuildRowsPartitionTime: 6m31s - BuildRowsPartitioned: 4.03B (4027680016) - GetNewBlockTime: 59s965ms - HashBuckets: 536.87M (536870912) - HashCollisions: 0 (0) - HashTablesBuildTime: 26s157ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 157.92 GB (169560614016) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 4 (4) - UnpinTime: 301.325ms HASH_JOIN_NODE (id=12):(Total: 3m1s, non-child: 1m16s, % non-child: 41.94%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 40.18M (40176892) - BuildTime: 8s399ms - PeakMemoryUsage: 3.02 GB (3240188542) - ProbeRows: 76.39M (76391201) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1m7s - RowsReturned: 4.03B (4027680016) - RowsReturnedRate: 22.13 M/sec Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 5s591ms - BuildRowsPartitioned: 40.18M (40176892) - GetNewBlockTime: 3.280ms - HashBuckets: 67.11M (67108864) - HashCollisions: 0 (0) - HashTablesBuildTime: 2s765ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 3.02 GB (3240125568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 6s774ms, non-child: 1s490ms, % non-child: 22.00%) BytesReceived(16s000ms): 212.96 MB, 380.49 MB, 380.49 MB, 380.49 MB, 380.49 MB, 380.49 MB, 380.49 MB, 380.49 MB, 380.49 MB, 380.49 MB, 380.49 MB, 380.49 MB, 380.49 MB, 380.49 MB, 380.49 MB, 380.49 MB, 380.49 MB, 380.49 MB, 380.49 MB, 380.49 MB, 380.49 MB, 380.49 MB, 380.49 MB, 380.49 MB, 380.49 MB, 380.49 MB, 380.49 MB, 380.49 MB, 380.49 MB, 380.49 MB, 380.49 MB, 380.49 MB, 380.49 MB, 380.49 MB, 380.49 MB, 380.49 MB, 380.49 MB, 380.49 MB, 380.49 MB, 380.49 MB - BytesReceived: 380.49 MB (398968392) - ConvertRowBatchTime: 956.235ms - DeserializeRowBatchTimer: 1s438ms - FirstBatchArrivalWaitTime: 1s125ms - PeakMemoryUsage: 0 - RowsReturned: 40.18M (40176892) - RowsReturnedRate: 5.93 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=22):(Total: 1m39s, non-child: 1s271ms, % non-child: 1.28%) BytesReceived(16s000ms): 2.16 MB, 15.77 MB, 42.81 MB, 69.01 MB, 96.13 MB, 123.20 MB, 150.50 MB, 177.80 MB, 203.54 MB, 229.26 MB, 254.35 MB, 280.35 MB, 307.30 MB, 333.64 MB, 358.09 MB, 385.28 MB, 411.08 MB, 438.66 MB, 462.08 MB, 487.28 MB, 511.01 MB, 528.00 MB, 546.95 MB, 569.63 MB, 589.14 MB, 603.78 MB, 624.39 MB, 640.44 MB, 652.68 MB, 657.52 MB, 666.88 MB, 679.85 MB, 684.71 MB, 694.50 MB, 703.08 MB, 707.11 MB, 707.11 MB, 707.11 MB, 707.11 MB, 707.11 MB - BytesReceived: 707.11 MB (741455519) - ConvertRowBatchTime: 835.175ms - DeserializeRowBatchTimer: 7s174ms - FirstBatchArrivalWaitTime: 810.091ms - PeakMemoryUsage: 0 - RowsReturned: 76.39M (76391201) - RowsReturnedRate: 766.39 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=24):(Total: 1s737ms, non-child: 4.106us, % non-child: 0.00%) BytesReceived(16s000ms): 8.81 MB, 10.52 MB, 10.52 MB, 10.52 MB, 10.52 MB, 10.52 MB, 10.52 MB, 10.52 MB, 10.52 MB, 10.52 MB, 10.52 MB, 10.52 MB, 10.52 MB, 10.52 MB, 10.52 MB, 10.52 MB, 10.52 MB, 10.52 MB, 10.52 MB, 10.52 MB, 10.52 MB, 10.52 MB, 10.52 MB, 10.52 MB, 10.52 MB, 10.52 MB, 10.52 MB, 10.52 MB, 10.52 MB, 10.52 MB, 10.52 MB, 10.52 MB, 10.52 MB, 10.52 MB, 10.52 MB, 10.52 MB, 10.52 MB, 10.58 MB, 10.74 MB, 10.74 MB - BytesReceived: 10.75 MB (11272540) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 85.866ms - FirstBatchArrivalWaitTime: 1s737ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:34a (host=vd1142.foo:22000):(Total: 55.207ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 983.97 MB, 6.83 GB, 13.94 GB, 20.35 GB, 27.10 GB, 33.78 GB, 40.52 GB, 47.24 GB, 53.53 GB, 59.85 GB, 66.03 GB, 72.39 GB, 79.05 GB, 85.50 GB, 91.52 GB, 98.26 GB, 104.62 GB, 111.37 GB, 117.29 GB, 123.54 GB, 129.51 GB, 133.65 GB, 138.30 GB, 143.91 GB, 148.51 GB, 151.74 GB, 156.53 GB, 156.08 GB, 153.52 GB, 154.60 GB, 156.48 GB, 159.61 GB, 151.60 GB, 151.39 GB, 153.41 GB, 154.52 GB, 151.16 GB, 152.89 GB, 151.19 GB, 152.55 GB ThreadUsage(16s000ms): 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.03 - BloomFilterBytes: 49.00 MB (51380224) - PeakMemoryUsage: 160.60 GB (172447048687) - PerHostPeakMemUsage: 169.56 GB (182068790410) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 2m36s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 1.31K (1310) - TotalThreadsTotalWallClockTime: 21s911ms - TotalThreadsSysTime: 2s068ms - TotalThreadsUserTime: 7s630ms - TotalThreadsVoluntaryContextSwitches: 24.24K (24244) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 55.169ms - ExecTreePrepareTime: 581.278us DataStreamSender (dst_id=28):(Total: 894.899us, non-child: 894.899us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.05 MB (1105280) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 632.617ms, non-child: 632.617ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 208.217ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 122 (122) - NumInstructions: 8.95K (8951) - OptimizationTime: 400.848ms - PeakMemoryUsage: 4.37 MB (4582912) - PrepareTime: 23.160ms HASH_JOIN_NODE (id=15):(Total: 1.101ms, non-child: 892.234us, % non-child: 81.03%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 451.92K (451915) - BuildTime: 127.891ms - PeakMemoryUsage: 153.09 MB (160524544) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=15): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 95.983ms - BuildRowsPartitioned: 451.92K (451915) - GetNewBlockTime: 350.080us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 29.044ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160449664) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=26):(Total: 2s052ms, non-child: 22.210ms, % non-child: 1.08%) BytesReceived(16s000ms): 5.41 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB - BytesReceived: 6.21 MB (6513198) - ConvertRowBatchTime: 11.596ms - DeserializeRowBatchTimer: 48.449ms - FirstBatchArrivalWaitTime: 1s184ms - PeakMemoryUsage: 0 - RowsReturned: 451.92K (451915) - RowsReturnedRate: 220.18 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=14):(Total: 799.195us, non-child: 819.610us, % non-child: 100.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 458.72K (458724) - BuildTime: 161.602ms - PeakMemoryUsage: 25.08 MB (26298624) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 101.910ms - BuildRowsPartitioned: 458.72K (458724) - GetNewBlockTime: 216.811us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 21.921ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 25.02 MB (26231936) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 4s134ms, non-child: 15.107ms, % non-child: 0.37%) BytesReceived(16s000ms): 5.83 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB - BytesReceived: 7.33 MB (7684466) - ConvertRowBatchTime: 11.534ms - DeserializeRowBatchTimer: 15.837ms - FirstBatchArrivalWaitTime: 2s089ms - PeakMemoryUsage: 0 - RowsReturned: 458.72K (458724) - RowsReturnedRate: 110.95 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=13):(Total: 546.167us, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 3.91B (3913827483) - BuildTime: 5m37s - PeakMemoryUsage: 160.16 GB (171968203008) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled, Spilled Runtime filters: 0 of 1 Runtime Filter Published, 1 Disabled - BuildRowsPartitionTime: 5m36s - BuildRowsPartitioned: 3.91B (3913827483) - GetNewBlockTime: 26s006ms - HashBuckets: 536.87M (536870912) - HashCollisions: 0 (0) - HashTablesBuildTime: 56s673ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 160.16 GB (171968144512) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 4 (4) - UnpinTime: 338.074ms HASH_JOIN_NODE (id=12):(Total: 3m44s, non-child: 1m15s, % non-child: 33.53%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 40.16M (40155473) - BuildTime: 7s959ms - PeakMemoryUsage: 3.02 GB (3240188300) - ProbeRows: 73.94M (73935413) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1m3s - RowsReturned: 3.91B (3913827483) - RowsReturnedRate: 17.41 M/sec Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 5s360ms - BuildRowsPartitioned: 40.16M (40155473) - GetNewBlockTime: 6.888ms - HashBuckets: 67.11M (67108864) - HashCollisions: 0 (0) - HashTablesBuildTime: 2s560ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 3.02 GB (3240125568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 7s400ms, non-child: 1s561ms, % non-child: 21.10%) BytesReceived(16s000ms): 213.27 MB, 380.29 MB, 380.29 MB, 380.29 MB, 380.29 MB, 380.29 MB, 380.29 MB, 380.29 MB, 380.29 MB, 380.29 MB, 380.29 MB, 380.29 MB, 380.29 MB, 380.29 MB, 380.29 MB, 380.29 MB, 380.29 MB, 380.29 MB, 380.29 MB, 380.29 MB, 380.29 MB, 380.29 MB, 380.29 MB, 380.29 MB, 380.29 MB, 380.29 MB, 380.29 MB, 380.29 MB, 380.29 MB, 380.29 MB, 380.29 MB, 380.29 MB, 380.29 MB, 380.29 MB, 380.29 MB, 380.29 MB, 380.29 MB, 380.29 MB, 380.29 MB, 380.29 MB - BytesReceived: 380.29 MB (398758967) - ConvertRowBatchTime: 950.173ms - DeserializeRowBatchTimer: 1s633ms - FirstBatchArrivalWaitTime: 1s114ms - PeakMemoryUsage: 0 - RowsReturned: 40.16M (40155473) - RowsReturnedRate: 5.43 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=22):(Total: 2m22s, non-child: 1s244ms, % non-child: 0.87%) BytesReceived(16s000ms): 2.12 MB, 15.33 MB, 41.37 MB, 66.62 MB, 92.89 MB, 119.06 MB, 145.49 MB, 171.86 MB, 196.84 MB, 221.60 MB, 245.93 MB, 270.94 MB, 296.92 MB, 322.57 MB, 346.24 MB, 372.55 MB, 397.49 MB, 424.02 MB, 446.70 MB, 471.32 MB, 494.24 MB, 510.90 MB, 529.17 MB, 551.11 MB, 568.98 MB, 581.31 MB, 600.56 MB, 616.74 MB, 630.72 MB, 635.13 MB, 643.54 MB, 656.25 MB, 661.83 MB, 670.20 MB, 679.45 MB, 684.40 MB, 684.40 MB, 684.40 MB, 684.40 MB, 684.40 MB - BytesReceived: 684.40 MB (717646104) - ConvertRowBatchTime: 779.236ms - DeserializeRowBatchTimer: 5s724ms - FirstBatchArrivalWaitTime: 788.730ms - PeakMemoryUsage: 0 - RowsReturned: 73.94M (73935413) - RowsReturnedRate: 517.85 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=24):(Total: 1s711ms, non-child: 4.043us, % non-child: 0.00%) BytesReceived(16s000ms): 8.43 MB, 10.04 MB, 10.04 MB, 10.04 MB, 10.04 MB, 10.04 MB, 10.04 MB, 10.04 MB, 10.04 MB, 10.04 MB, 10.04 MB, 10.04 MB, 10.04 MB, 10.04 MB, 10.04 MB, 10.04 MB, 10.04 MB, 10.04 MB, 10.04 MB, 10.04 MB, 10.04 MB, 10.04 MB, 10.04 MB, 10.04 MB, 10.04 MB, 10.04 MB, 10.04 MB, 10.04 MB, 10.04 MB, 10.04 MB, 10.04 MB, 10.04 MB, 10.04 MB, 10.04 MB, 10.04 MB, 10.04 MB, 10.04 MB, 10.05 MB, 10.07 MB, 10.07 MB - BytesReceived: 10.08 MB (10570441) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 77.703ms - FirstBatchArrivalWaitTime: 1s711ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:30b (host=vc1526.foo:22000):(Total: 55.143ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 983.35 MB, 7.05 GB, 14.12 GB, 20.75 GB, 27.59 GB, 34.44 GB, 41.33 GB, 48.25 GB, 54.82 GB, 61.32 GB, 67.63 GB, 74.10 GB, 80.97 GB, 87.43 GB, 93.83 GB, 100.57 GB, 107.13 GB, 113.67 GB, 120.20 GB, 127.14 GB, 133.20 GB, 137.65 GB, 142.40 GB, 148.07 GB, 152.74 GB, 156.07 GB, 155.02 GB, 154.26 GB, 157.46 GB, 158.43 GB, 155.53 GB, 151.97 GB, 153.25 GB, 155.52 GB, 157.06 GB, 153.00 GB, 152.74 GB, 153.39 GB, 153.83 GB, 155.94 GB ThreadUsage(16s000ms): 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.03 - BloomFilterBytes: 49.00 MB (51380224) - PeakMemoryUsage: 160.60 GB (172437860287) - PerHostPeakMemUsage: 169.56 GB (182060487844) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 1m48s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 1.66K (1657) - TotalThreadsTotalWallClockTime: 21s701ms - TotalThreadsSysTime: 2s283ms - TotalThreadsUserTime: 8s036ms - TotalThreadsVoluntaryContextSwitches: 21.54K (21544) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 55.021ms - ExecTreePrepareTime: 556.455us DataStreamSender (dst_id=28):(Total: 857.877us, non-child: 857.877us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.05 MB (1105280) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 667.663ms, non-child: 667.663ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 214.872ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 122 (122) - NumInstructions: 8.95K (8951) - OptimizationTime: 425.825ms - PeakMemoryUsage: 4.37 MB (4582912) - PrepareTime: 26.499ms HASH_JOIN_NODE (id=15):(Total: 1.061ms, non-child: 949.725us, % non-child: 89.48%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 451.92K (451915) - BuildTime: 148.964ms - PeakMemoryUsage: 153.09 MB (160524544) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=15): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 110.587ms - BuildRowsPartitioned: 451.92K (451915) - GetNewBlockTime: 337.098us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 35.513ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160449664) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=26):(Total: 2s013ms, non-child: 25.614ms, % non-child: 1.27%) BytesReceived(16s000ms): 5.38 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB - BytesReceived: 6.21 MB (6513198) - ConvertRowBatchTime: 12.103ms - DeserializeRowBatchTimer: 53.335ms - FirstBatchArrivalWaitTime: 1s170ms - PeakMemoryUsage: 0 - RowsReturned: 451.92K (451915) - RowsReturnedRate: 224.44 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=14):(Total: 840.535us, non-child: 876.503us, % non-child: 100.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 458.95K (458954) - BuildTime: 140.980ms - PeakMemoryUsage: 25.08 MB (26298624) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 84.778ms - BuildRowsPartitioned: 458.95K (458954) - GetNewBlockTime: 164.773us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 24.494ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 25.02 MB (26231936) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 4s092ms, non-child: 15.321ms, % non-child: 0.37%) BytesReceived(16s000ms): 5.81 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB - BytesReceived: 7.33 MB (7687673) - ConvertRowBatchTime: 11.146ms - DeserializeRowBatchTimer: 15.850ms - FirstBatchArrivalWaitTime: 2s073ms - PeakMemoryUsage: 0 - RowsReturned: 458.95K (458954) - RowsReturnedRate: 112.15 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=13):(Total: 571.883us, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 4.01B (4014861986) - BuildTime: 6m32s - PeakMemoryUsage: 157.31 GB (168914143472) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled, Spilled Runtime filters: 0 of 1 Runtime Filter Published, 1 Disabled - BuildRowsPartitionTime: 6m32s - BuildRowsPartitioned: 4.01B (4014861986) - GetNewBlockTime: 45s767ms - HashBuckets: 536.87M (536870912) - HashCollisions: 0 (0) - HashTablesBuildTime: 53s657ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 157.31 GB (168914068608) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 4 (4) - UnpinTime: 284.237ms HASH_JOIN_NODE (id=12):(Total: 2m52s, non-child: 1m11s, % non-child: 41.25%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 40.14M (40143073) - BuildTime: 8s519ms - PeakMemoryUsage: 3.02 GB (3240196320) - ProbeRows: 76.14M (76139934) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1m1s - RowsReturned: 4.01B (4014861986) - RowsReturnedRate: 23.24 M/sec Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 5s649ms - BuildRowsPartitioned: 40.14M (40143073) - GetNewBlockTime: 3.468ms - HashBuckets: 67.11M (67108864) - HashCollisions: 0 (0) - HashTablesBuildTime: 2s825ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 3.02 GB (3240125568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 6s684ms, non-child: 1s549ms, % non-child: 23.18%) BytesReceived(16s000ms): 209.45 MB, 380.17 MB, 380.17 MB, 380.17 MB, 380.17 MB, 380.17 MB, 380.17 MB, 380.17 MB, 380.17 MB, 380.17 MB, 380.17 MB, 380.17 MB, 380.17 MB, 380.17 MB, 380.17 MB, 380.17 MB, 380.17 MB, 380.17 MB, 380.17 MB, 380.17 MB, 380.17 MB, 380.17 MB, 380.17 MB, 380.17 MB, 380.17 MB, 380.17 MB, 380.17 MB, 380.17 MB, 380.17 MB, 380.17 MB, 380.17 MB, 380.17 MB, 380.17 MB, 380.17 MB, 380.17 MB, 380.17 MB, 380.17 MB, 380.17 MB, 380.17 MB, 380.17 MB - BytesReceived: 380.17 MB (398635974) - ConvertRowBatchTime: 951.544ms - DeserializeRowBatchTimer: 1s530ms - FirstBatchArrivalWaitTime: 1s090ms - PeakMemoryUsage: 0 - RowsReturned: 40.14M (40143073) - RowsReturnedRate: 6.01 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=22):(Total: 1m35s, non-child: 2s543ms, % non-child: 2.66%) BytesReceived(16s000ms): 2.17 MB, 15.44 MB, 42.26 MB, 68.30 MB, 95.23 MB, 122.22 MB, 149.44 MB, 176.75 MB, 202.61 MB, 228.15 MB, 253.16 MB, 278.94 MB, 305.82 MB, 332.18 MB, 356.59 MB, 383.58 MB, 409.16 MB, 438.27 MB, 462.80 MB, 488.97 MB, 511.23 MB, 528.79 MB, 547.87 MB, 570.32 MB, 588.18 MB, 600.78 MB, 621.20 MB, 637.43 MB, 650.50 MB, 655.22 MB, 664.27 MB, 677.41 MB, 682.55 MB, 691.80 MB, 700.47 MB, 705.24 MB, 705.24 MB, 705.24 MB, 705.24 MB, 705.24 MB - BytesReceived: 705.24 MB (739502456) - ConvertRowBatchTime: 840.336ms - DeserializeRowBatchTimer: 8s075ms - FirstBatchArrivalWaitTime: 757.544ms - PeakMemoryUsage: 0 - RowsReturned: 76.14M (76139934) - RowsReturnedRate: 796.87 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=24):(Total: 1s698ms, non-child: 3.398us, % non-child: 0.00%) BytesReceived(16s000ms): 8.36 MB, 10.16 MB, 10.16 MB, 10.16 MB, 10.16 MB, 10.16 MB, 10.16 MB, 10.16 MB, 10.16 MB, 10.16 MB, 10.16 MB, 10.16 MB, 10.16 MB, 10.16 MB, 10.16 MB, 10.16 MB, 10.16 MB, 10.16 MB, 10.16 MB, 10.16 MB, 10.16 MB, 10.16 MB, 10.16 MB, 10.16 MB, 10.16 MB, 10.16 MB, 10.16 MB, 10.16 MB, 10.16 MB, 10.16 MB, 10.16 MB, 10.16 MB, 10.16 MB, 10.16 MB, 10.16 MB, 10.16 MB, 10.16 MB, 10.18 MB, 10.23 MB, 10.23 MB - BytesReceived: 10.31 MB (10809606) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 71.029ms - FirstBatchArrivalWaitTime: 1s698ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:318 (host=vc1503.foo:22000):(Total: 55.126ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 995.37 MB, 7.13 GB, 14.04 GB, 20.59 GB, 27.32 GB, 34.05 GB, 40.85 GB, 47.65 GB, 54.05 GB, 60.45 GB, 66.66 GB, 73.09 GB, 79.87 GB, 86.28 GB, 92.58 GB, 99.32 GB, 105.81 GB, 112.51 GB, 119.27 GB, 125.82 GB, 131.56 GB, 135.93 GB, 140.60 GB, 146.20 GB, 150.76 GB, 153.95 GB, 156.84 GB, 152.10 GB, 155.24 GB, 156.37 GB, 158.47 GB, 151.82 GB, 151.09 GB, 153.32 GB, 154.92 GB, 150.80 GB, 153.31 GB, 145.98 GB, 152.59 GB, 154.59 GB ThreadUsage(16s000ms): 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.03 - BloomFilterBytes: 49.00 MB (51380224) - PeakMemoryUsage: 160.60 GB (172445521999) - PerHostPeakMemUsage: 169.56 GB (182068796986) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 2m30s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 1.69K (1694) - TotalThreadsTotalWallClockTime: 21s843ms - TotalThreadsSysTime: 2s238ms - TotalThreadsUserTime: 7s882ms - TotalThreadsVoluntaryContextSwitches: 22.65K (22652) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 54.947ms - ExecTreePrepareTime: 1.209ms DataStreamSender (dst_id=28):(Total: 1.091ms, non-child: 1.091ms, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.05 MB (1105280) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 641.960ms, non-child: 641.960ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 205.648ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 122 (122) - NumInstructions: 8.95K (8951) - OptimizationTime: 413.865ms - PeakMemoryUsage: 4.37 MB (4582912) - PrepareTime: 21.962ms HASH_JOIN_NODE (id=15):(Total: 2.319ms, non-child: 982.612us, % non-child: 42.36%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 451.92K (451915) - BuildTime: 132.034ms - PeakMemoryUsage: 153.09 MB (160524544) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=15): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 95.755ms - BuildRowsPartitioned: 451.92K (451915) - GetNewBlockTime: 357.737us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 33.444ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160449664) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=26):(Total: 2s051ms, non-child: 22.593ms, % non-child: 1.10%) BytesReceived(16s000ms): 5.38 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB - BytesReceived: 6.21 MB (6513198) - ConvertRowBatchTime: 12.066ms - DeserializeRowBatchTimer: 52.183ms - FirstBatchArrivalWaitTime: 1s188ms - PeakMemoryUsage: 0 - RowsReturned: 451.92K (451915) - RowsReturnedRate: 220.28 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=14):(Total: 1.871ms, non-child: 1.058ms, % non-child: 56.55%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 459.82K (459822) - BuildTime: 131.434ms - PeakMemoryUsage: 25.08 MB (26298624) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 81.110ms - BuildRowsPartitioned: 459.82K (459822) - GetNewBlockTime: 116.733us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 21.754ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 25.02 MB (26231936) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 4s126ms, non-child: 14.734ms, % non-child: 0.36%) BytesReceived(16s000ms): 5.83 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB - BytesReceived: 7.34 MB (7700431) - ConvertRowBatchTime: 11.394ms - DeserializeRowBatchTimer: 16.076ms - FirstBatchArrivalWaitTime: 2s098ms - PeakMemoryUsage: 0 - RowsReturned: 459.82K (459822) - RowsReturnedRate: 111.42 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=13):(Total: 1.294ms, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 3.95B (3954447449) - BuildTime: 5m46s - PeakMemoryUsage: 157.31 GB (168914159840) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled, Spilled Runtime filters: 0 of 1 Runtime Filter Published, 1 Disabled - BuildRowsPartitionTime: 5m46s - BuildRowsPartitioned: 3.95B (3954447449) - GetNewBlockTime: 26s857ms - HashBuckets: 536.87M (536870912) - HashCollisions: 0 (0) - HashTablesBuildTime: 31s200ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 157.31 GB (168914068608) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 4 (4) - UnpinTime: 291.587ms HASH_JOIN_NODE (id=12):(Total: 3m35s, non-child: 1m12s, % non-child: 33.51%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 40.18M (40182790) - BuildTime: 8s391ms - PeakMemoryUsage: 3.02 GB (3240188128) - ProbeRows: 74.72M (74716448) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1m3s - RowsReturned: 3.95B (3954447449) - RowsReturnedRate: 18.31 M/sec Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 5s451ms - BuildRowsPartitioned: 40.18M (40182790) - GetNewBlockTime: 2.583ms - HashBuckets: 67.11M (67108864) - HashCollisions: 0 (0) - HashTablesBuildTime: 2s892ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 3.02 GB (3240125568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 6s917ms, non-child: 1s482ms, % non-child: 21.43%) BytesReceived(16s000ms): 211.46 MB, 380.57 MB, 380.57 MB, 380.57 MB, 380.57 MB, 380.57 MB, 380.57 MB, 380.57 MB, 380.57 MB, 380.57 MB, 380.57 MB, 380.57 MB, 380.57 MB, 380.57 MB, 380.57 MB, 380.57 MB, 380.57 MB, 380.57 MB, 380.57 MB, 380.57 MB, 380.57 MB, 380.57 MB, 380.57 MB, 380.57 MB, 380.57 MB, 380.57 MB, 380.57 MB, 380.57 MB, 380.57 MB, 380.57 MB, 380.57 MB, 380.57 MB, 380.57 MB, 380.57 MB, 380.57 MB, 380.57 MB, 380.57 MB, 380.57 MB, 380.57 MB, 380.57 MB - BytesReceived: 380.57 MB (399058321) - ConvertRowBatchTime: 941.712ms - DeserializeRowBatchTimer: 1s430ms - FirstBatchArrivalWaitTime: 1s117ms - PeakMemoryUsage: 0 - RowsReturned: 40.18M (40182790) - RowsReturnedRate: 5.81 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=22):(Total: 2m17s, non-child: 1s370ms, % non-child: 1.00%) BytesReceived(16s000ms): 2.12 MB, 15.32 MB, 41.67 MB, 67.20 MB, 93.58 MB, 120.00 MB, 146.71 MB, 173.41 MB, 198.62 MB, 223.69 MB, 248.24 MB, 273.60 MB, 299.96 MB, 325.86 MB, 349.93 MB, 376.68 MB, 401.89 MB, 430.66 MB, 454.90 MB, 480.56 MB, 502.26 MB, 519.63 MB, 538.26 MB, 560.53 MB, 577.87 MB, 590.12 MB, 610.03 MB, 625.78 MB, 638.33 MB, 642.97 MB, 651.90 MB, 664.59 MB, 669.58 MB, 678.75 MB, 687.17 MB, 691.68 MB, 691.68 MB, 691.68 MB, 691.68 MB, 691.68 MB - BytesReceived: 691.68 MB (725280924) - ConvertRowBatchTime: 882.915ms - DeserializeRowBatchTimer: 5s760ms - FirstBatchArrivalWaitTime: 769.512ms - PeakMemoryUsage: 0 - RowsReturned: 74.72M (74716448) - RowsReturnedRate: 543.74 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=24):(Total: 1s721ms, non-child: 3.568us, % non-child: 0.00%) BytesReceived(16s000ms): 8.82 MB, 10.64 MB, 10.64 MB, 10.64 MB, 10.64 MB, 10.64 MB, 10.64 MB, 10.64 MB, 10.64 MB, 10.64 MB, 10.64 MB, 10.64 MB, 10.64 MB, 10.64 MB, 10.64 MB, 10.64 MB, 10.64 MB, 10.64 MB, 10.64 MB, 10.64 MB, 10.64 MB, 10.64 MB, 10.64 MB, 10.64 MB, 10.64 MB, 10.64 MB, 10.64 MB, 10.64 MB, 10.64 MB, 10.64 MB, 10.64 MB, 10.64 MB, 10.64 MB, 10.64 MB, 10.64 MB, 10.64 MB, 10.64 MB, 10.64 MB, 10.66 MB, 10.69 MB - BytesReceived: 10.84 MB (11365878) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 72.340ms - FirstBatchArrivalWaitTime: 1s721ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:354 (host=vd1129.foo:22000):(Total: 55.104ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 965.70 MB, 6.87 GB, 14.08 GB, 20.65 GB, 27.42 GB, 34.20 GB, 41.03 GB, 47.89 GB, 54.34 GB, 60.77 GB, 67.00 GB, 73.44 GB, 80.29 GB, 86.83 GB, 92.99 GB, 99.74 GB, 106.18 GB, 113.16 GB, 119.64 GB, 126.21 GB, 132.01 GB, 136.27 GB, 141.10 GB, 146.76 GB, 151.36 GB, 154.59 GB, 156.19 GB, 152.79 GB, 155.93 GB, 156.79 GB, 159.21 GB, 151.11 GB, 151.73 GB, 153.98 GB, 155.48 GB, 152.96 GB, 153.01 GB, 153.79 GB, 152.08 GB, 153.36 GB ThreadUsage(16s000ms): 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.03 - BloomFilterBytes: 49.00 MB (51380224) - PeakMemoryUsage: 160.60 GB (172447198559) - PerHostPeakMemUsage: 169.56 GB (182059979970) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 2m10s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 1.70K (1700) - TotalThreadsTotalWallClockTime: 22s530ms - TotalThreadsSysTime: 2s208ms - TotalThreadsUserTime: 8s326ms - TotalThreadsVoluntaryContextSwitches: 21.73K (21727) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 55.016ms - ExecTreePrepareTime: 628.520us DataStreamSender (dst_id=28):(Total: 1.077ms, non-child: 1.077ms, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.05 MB (1105280) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 632.133ms, non-child: 632.133ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 212.773ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 122 (122) - NumInstructions: 8.95K (8951) - OptimizationTime: 396.777ms - PeakMemoryUsage: 4.37 MB (4582912) - PrepareTime: 22.053ms HASH_JOIN_NODE (id=15):(Total: 1.198ms, non-child: 878.378us, % non-child: 73.28%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 451.92K (451915) - BuildTime: 132.564ms - PeakMemoryUsage: 153.09 MB (160524544) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=15): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 97.813ms - BuildRowsPartitioned: 451.92K (451915) - GetNewBlockTime: 438.933us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 32.171ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160449664) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=26):(Total: 2s040ms, non-child: 23.881ms, % non-child: 1.17%) BytesReceived(16s000ms): 5.43 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB - BytesReceived: 6.21 MB (6513198) - ConvertRowBatchTime: 12.102ms - DeserializeRowBatchTimer: 49.525ms - FirstBatchArrivalWaitTime: 1s180ms - PeakMemoryUsage: 0 - RowsReturned: 451.92K (451915) - RowsReturnedRate: 221.42 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=14):(Total: 959.462us, non-child: 773.210us, % non-child: 80.59%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 459.78K (459782) - BuildTime: 163.729ms - PeakMemoryUsage: 25.08 MB (26298624) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 101.724ms - BuildRowsPartitioned: 459.78K (459782) - GetNewBlockTime: 247.404us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 24.186ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 25.02 MB (26231936) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 4s149ms, non-child: 14.791ms, % non-child: 0.36%) BytesReceived(16s000ms): 5.92 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB - BytesReceived: 7.35 MB (7701836) - ConvertRowBatchTime: 10.873ms - DeserializeRowBatchTimer: 16.202ms - FirstBatchArrivalWaitTime: 2s084ms - PeakMemoryUsage: 0 - RowsReturned: 459.78K (459782) - RowsReturnedRate: 110.80 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=13):(Total: 700.607us, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 3.97B (3973459715) - BuildTime: 6m12s - PeakMemoryUsage: 157.31 GB (168914159840) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled, Spilled Runtime filters: 0 of 1 Runtime Filter Published, 1 Disabled - BuildRowsPartitionTime: 6m12s - BuildRowsPartitioned: 3.97B (3973459715) - GetNewBlockTime: 44s143ms - HashBuckets: 536.87M (536870912) - HashCollisions: 0 (0) - HashTablesBuildTime: 37s438ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 157.31 GB (168914068608) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 4 (4) - UnpinTime: 126.425ms HASH_JOIN_NODE (id=12):(Total: 3m16s, non-child: 1m12s, % non-child: 36.73%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 40.19M (40194134) - BuildTime: 8s827ms - PeakMemoryUsage: 3.02 GB (3240189554) - ProbeRows: 74.91M (74909167) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1m2s - RowsReturned: 3.97B (3973459715) - RowsReturnedRate: 20.24 M/sec Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 5s642ms - BuildRowsPartitioned: 40.19M (40194134) - GetNewBlockTime: 3.486ms - HashBuckets: 67.11M (67108864) - HashCollisions: 0 (0) - HashTablesBuildTime: 3s141ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 3.02 GB (3240125568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 7s124ms, non-child: 1s443ms, % non-child: 20.26%) BytesReceived(16s000ms): 214.93 MB, 380.66 MB, 380.66 MB, 380.66 MB, 380.66 MB, 380.66 MB, 380.66 MB, 380.66 MB, 380.66 MB, 380.66 MB, 380.66 MB, 380.66 MB, 380.66 MB, 380.66 MB, 380.66 MB, 380.66 MB, 380.66 MB, 380.66 MB, 380.66 MB, 380.66 MB, 380.66 MB, 380.66 MB, 380.66 MB, 380.66 MB, 380.66 MB, 380.66 MB, 380.66 MB, 380.66 MB, 380.66 MB, 380.66 MB, 380.66 MB, 380.66 MB, 380.66 MB, 380.66 MB, 380.66 MB, 380.66 MB, 380.66 MB, 380.66 MB, 380.66 MB, 380.66 MB - BytesReceived: 380.66 MB (399149392) - ConvertRowBatchTime: 921.902ms - DeserializeRowBatchTimer: 1s444ms - FirstBatchArrivalWaitTime: 1s107ms - PeakMemoryUsage: 0 - RowsReturned: 40.19M (40194134) - RowsReturnedRate: 5.64 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=22):(Total: 1m57s, non-child: 2s387ms, % non-child: 2.03%) BytesReceived(16s000ms): 2.14 MB, 15.61 MB, 42.05 MB, 67.76 MB, 94.28 MB, 120.86 MB, 147.65 MB, 174.51 MB, 199.85 MB, 225.00 MB, 249.56 MB, 274.85 MB, 301.39 MB, 327.46 MB, 351.59 MB, 378.17 MB, 405.64 MB, 433.54 MB, 456.13 MB, 481.75 MB, 503.43 MB, 520.86 MB, 539.56 MB, 561.89 MB, 579.40 MB, 591.84 MB, 611.95 MB, 627.76 MB, 640.27 MB, 644.94 MB, 653.89 MB, 666.78 MB, 671.71 MB, 680.87 MB, 689.44 MB, 694.00 MB, 694.00 MB, 694.00 MB, 694.00 MB, 694.00 MB - BytesReceived: 694.00 MB (727713521) - ConvertRowBatchTime: 872.193ms - DeserializeRowBatchTimer: 10s056ms - FirstBatchArrivalWaitTime: 772.750ms - PeakMemoryUsage: 0 - RowsReturned: 74.91M (74909167) - RowsReturnedRate: 635.58 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=24):(Total: 1s710ms, non-child: 3.592us, % non-child: 0.00%) BytesReceived(16s000ms): 8.64 MB, 10.24 MB, 10.24 MB, 10.24 MB, 10.24 MB, 10.24 MB, 10.24 MB, 10.24 MB, 10.24 MB, 10.24 MB, 10.24 MB, 10.24 MB, 10.24 MB, 10.24 MB, 10.24 MB, 10.24 MB, 10.24 MB, 10.24 MB, 10.24 MB, 10.24 MB, 10.24 MB, 10.24 MB, 10.24 MB, 10.24 MB, 10.24 MB, 10.24 MB, 10.24 MB, 10.24 MB, 10.24 MB, 10.24 MB, 10.24 MB, 10.24 MB, 10.24 MB, 10.24 MB, 10.24 MB, 10.24 MB, 10.24 MB, 10.25 MB, 10.30 MB, 10.30 MB - BytesReceived: 10.47 MB (10973704) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 68.747ms - FirstBatchArrivalWaitTime: 1s710ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:355 (host=ve1126.foo:22000):(Total: 54.896ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 1010.95 MB, 7.31 GB, 14.31 GB, 20.95 GB, 27.82 GB, 34.69 GB, 41.62 GB, 48.59 GB, 55.11 GB, 61.68 GB, 68.06 GB, 74.57 GB, 81.40 GB, 88.08 GB, 94.38 GB, 101.22 GB, 107.84 GB, 114.69 GB, 120.81 GB, 127.08 GB, 133.43 GB, 137.86 GB, 142.58 GB, 148.29 GB, 153.02 GB, 156.31 GB, 154.00 GB, 154.34 GB, 157.37 GB, 158.42 GB, 151.22 GB, 152.34 GB, 154.08 GB, 156.04 GB, 157.44 GB, 153.64 GB, 157.05 GB, 157.87 GB, 155.24 GB, 157.17 GB ThreadUsage(16s000ms): 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.03 - BloomFilterBytes: 49.00 MB (51380224) - PeakMemoryUsage: 160.60 GB (172442367439) - PerHostPeakMemUsage: 169.56 GB (182065029600) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 1m59s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 1.34K (1337) - TotalThreadsTotalWallClockTime: 22s079ms - TotalThreadsSysTime: 2s160ms - TotalThreadsUserTime: 7s870ms - TotalThreadsVoluntaryContextSwitches: 23.42K (23418) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 54.855ms - ExecTreePrepareTime: 495.969us DataStreamSender (dst_id=28):(Total: 917.803us, non-child: 917.803us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.05 MB (1105280) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 613.754ms, non-child: 613.754ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 204.175ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 122 (122) - NumInstructions: 8.95K (8951) - OptimizationTime: 384.241ms - PeakMemoryUsage: 4.37 MB (4582912) - PrepareTime: 24.934ms HASH_JOIN_NODE (id=15):(Total: 934.819us, non-child: 834.224us, % non-child: 89.24%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 451.92K (451915) - BuildTime: 128.316ms - PeakMemoryUsage: 153.09 MB (160524544) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=15): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 99.429ms - BuildRowsPartitioned: 451.92K (451915) - GetNewBlockTime: 340.360us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 26.231ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160449664) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=26):(Total: 2s064ms, non-child: 24.549ms, % non-child: 1.19%) BytesReceived(16s000ms): 5.47 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB - BytesReceived: 6.21 MB (6513198) - ConvertRowBatchTime: 12.220ms - DeserializeRowBatchTimer: 49.519ms - FirstBatchArrivalWaitTime: 1s205ms - PeakMemoryUsage: 0 - RowsReturned: 451.92K (451915) - RowsReturnedRate: 218.91 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=14):(Total: 698.999us, non-child: 783.752us, % non-child: 100.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 458.52K (458516) - BuildTime: 136.079ms - PeakMemoryUsage: 25.08 MB (26298624) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 80.232ms - BuildRowsPartitioned: 458.52K (458516) - GetNewBlockTime: 246.663us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 22.873ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 25.02 MB (26231936) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 4s194ms, non-child: 12.567ms, % non-child: 0.30%) BytesReceived(16s000ms): 5.95 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB - BytesReceived: 7.32 MB (7680350) - ConvertRowBatchTime: 8.864ms - DeserializeRowBatchTimer: 17.857ms - FirstBatchArrivalWaitTime: 2s114ms - PeakMemoryUsage: 0 - RowsReturned: 458.52K (458516) - RowsReturnedRate: 109.31 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=13):(Total: 453.933us, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 4.03B (4033255980) - BuildTime: 6m15s - PeakMemoryUsage: 160.16 GB (171968792832) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled, Spilled Runtime filters: 0 of 1 Runtime Filter Published, 1 Disabled - BuildRowsPartitionTime: 6m15s - BuildRowsPartitioned: 4.03B (4033255980) - GetNewBlockTime: 49s694ms - HashBuckets: 536.87M (536870912) - HashCollisions: 0 (0) - HashTablesBuildTime: 1m20s - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 160.16 GB (171968734336) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 5 (5) - UnpinTime: 274.000ms HASH_JOIN_NODE (id=12):(Total: 3m7s, non-child: 1m14s, % non-child: 39.96%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 40.11M (40111941) - BuildTime: 8s155ms - PeakMemoryUsage: 3.02 GB (3240188128) - ProbeRows: 76.04M (76035803) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1m6s - RowsReturned: 4.03B (4033255980) - RowsReturnedRate: 21.49 M/sec Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 5s485ms - BuildRowsPartitioned: 40.11M (40111941) - GetNewBlockTime: 3.273ms - HashBuckets: 67.11M (67108864) - HashCollisions: 0 (0) - HashTablesBuildTime: 2s622ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 3.02 GB (3240125568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 7s285ms, non-child: 1s807ms, % non-child: 24.80%) BytesReceived(16s000ms): 216.44 MB, 379.89 MB, 379.89 MB, 379.89 MB, 379.89 MB, 379.89 MB, 379.89 MB, 379.89 MB, 379.89 MB, 379.89 MB, 379.89 MB, 379.89 MB, 379.89 MB, 379.89 MB, 379.89 MB, 379.89 MB, 379.89 MB, 379.89 MB, 379.89 MB, 379.89 MB, 379.89 MB, 379.89 MB, 379.89 MB, 379.89 MB, 379.89 MB, 379.89 MB, 379.89 MB, 379.89 MB, 379.89 MB, 379.89 MB, 379.89 MB, 379.89 MB, 379.89 MB, 379.89 MB, 379.89 MB, 379.89 MB, 379.89 MB, 379.89 MB, 379.89 MB, 379.89 MB - BytesReceived: 379.89 MB (398346470) - ConvertRowBatchTime: 969.728ms - DeserializeRowBatchTimer: 1s894ms - FirstBatchArrivalWaitTime: 1s136ms - PeakMemoryUsage: 0 - RowsReturned: 40.11M (40111941) - RowsReturnedRate: 5.51 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=22):(Total: 1m46s, non-child: 1s313ms, % non-child: 1.24%) BytesReceived(16s000ms): 2.21 MB, 15.94 MB, 42.77 MB, 68.75 MB, 95.63 MB, 122.50 MB, 149.72 MB, 177.12 MB, 203.01 MB, 228.66 MB, 253.76 MB, 279.48 MB, 306.25 MB, 332.70 MB, 357.24 MB, 384.49 MB, 410.44 MB, 437.88 MB, 461.09 MB, 486.26 MB, 509.69 MB, 526.57 MB, 545.21 MB, 567.64 MB, 585.86 MB, 598.42 MB, 618.09 MB, 634.63 MB, 649.02 MB, 653.56 MB, 662.20 MB, 675.64 MB, 681.87 MB, 691.65 MB, 700.15 MB, 704.19 MB, 704.19 MB, 704.19 MB, 704.19 MB, 704.19 MB - BytesReceived: 704.19 MB (738397228) - ConvertRowBatchTime: 854.970ms - DeserializeRowBatchTimer: 6s573ms - FirstBatchArrivalWaitTime: 789.928ms - PeakMemoryUsage: 0 - RowsReturned: 76.04M (76035803) - RowsReturnedRate: 716.09 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=24):(Total: 1s738ms, non-child: 3.482us, % non-child: 0.00%) BytesReceived(16s000ms): 8.34 MB, 9.88 MB, 9.88 MB, 9.88 MB, 9.88 MB, 9.88 MB, 9.88 MB, 9.88 MB, 9.88 MB, 9.88 MB, 9.88 MB, 9.88 MB, 9.88 MB, 9.88 MB, 9.88 MB, 9.88 MB, 9.88 MB, 9.88 MB, 9.88 MB, 9.88 MB, 9.88 MB, 9.88 MB, 9.88 MB, 9.88 MB, 9.88 MB, 9.88 MB, 9.88 MB, 9.88 MB, 9.88 MB, 9.88 MB, 9.88 MB, 9.88 MB, 9.88 MB, 9.88 MB, 9.88 MB, 9.88 MB, 9.88 MB, 9.88 MB, 9.88 MB, 9.88 MB - BytesReceived: 9.88 MB (10358292) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 78.946ms - FirstBatchArrivalWaitTime: 1s738ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:323 (host=va1042.foo:22000):(Total: 54.889ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 976.29 MB, 7.15 GB, 14.03 GB, 20.60 GB, 27.45 GB, 34.31 GB, 41.27 GB, 48.20 GB, 54.72 GB, 61.25 GB, 67.56 GB, 74.05 GB, 80.86 GB, 87.49 GB, 94.22 GB, 101.20 GB, 107.55 GB, 114.28 GB, 120.52 GB, 127.11 GB, 132.86 GB, 137.28 GB, 142.02 GB, 147.74 GB, 152.35 GB, 155.63 GB, 156.13 GB, 153.65 GB, 156.86 GB, 157.66 GB, 156.58 GB, 151.66 GB, 152.58 GB, 154.84 GB, 156.56 GB, 153.62 GB, 154.02 GB, 153.57 GB, 155.33 GB, 155.57 GB ThreadUsage(16s000ms): 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.03 - BloomFilterBytes: 49.00 MB (51380224) - PeakMemoryUsage: 160.60 GB (172446523423) - PerHostPeakMemUsage: 169.58 GB (182088609238) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 2m31s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 1.63K (1630) - TotalThreadsTotalWallClockTime: 21s611ms - TotalThreadsSysTime: 2s219ms - TotalThreadsUserTime: 8s174ms - TotalThreadsVoluntaryContextSwitches: 19.81K (19812) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 54.795ms - ExecTreePrepareTime: 825.163us DataStreamSender (dst_id=28):(Total: 912.823us, non-child: 912.823us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.05 MB (1105280) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 634.470ms, non-child: 634.470ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 203.120ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 122 (122) - NumInstructions: 8.95K (8951) - OptimizationTime: 407.015ms - PeakMemoryUsage: 4.37 MB (4582912) - PrepareTime: 23.893ms HASH_JOIN_NODE (id=15):(Total: 1.546ms, non-child: 1.044ms, % non-child: 67.57%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 451.92K (451915) - BuildTime: 141.311ms - PeakMemoryUsage: 153.09 MB (160524544) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=15): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 105.291ms - BuildRowsPartitioned: 451.92K (451915) - GetNewBlockTime: 370.517us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 33.230ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160449664) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=26):(Total: 2s056ms, non-child: 23.379ms, % non-child: 1.14%) BytesReceived(16s000ms): 5.32 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB - BytesReceived: 6.21 MB (6513198) - ConvertRowBatchTime: 12.916ms - DeserializeRowBatchTimer: 49.733ms - FirstBatchArrivalWaitTime: 1s194ms - PeakMemoryUsage: 0 - RowsReturned: 451.92K (451915) - RowsReturnedRate: 219.78 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=14):(Total: 1.173ms, non-child: 1.022ms, % non-child: 87.13%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 460.36K (460355) - BuildTime: 142.024ms - PeakMemoryUsage: 25.08 MB (26298624) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 86.705ms - BuildRowsPartitioned: 460.36K (460355) - GetNewBlockTime: 197.741us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 21.255ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 25.02 MB (26231936) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 4s135ms, non-child: 15.928ms, % non-child: 0.39%) BytesReceived(16s000ms): 5.80 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB - BytesReceived: 7.35 MB (7711228) - ConvertRowBatchTime: 11.918ms - DeserializeRowBatchTimer: 16.495ms - FirstBatchArrivalWaitTime: 2s106ms - PeakMemoryUsage: 0 - RowsReturned: 460.36K (460355) - RowsReturnedRate: 111.31 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=13):(Total: 792.141us, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 4.00B (4001120524) - BuildTime: 5m52s - PeakMemoryUsage: 160.16 GB (171968792832) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled, Spilled Runtime filters: 0 of 1 Runtime Filter Published, 1 Disabled - BuildRowsPartitionTime: 5m51s - BuildRowsPartitioned: 4.00B (4001120524) - GetNewBlockTime: 46s937ms - HashBuckets: 536.87M (536870912) - HashCollisions: 0 (0) - HashTablesBuildTime: 23s879ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 160.16 GB (171968734336) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 4 (4) - UnpinTime: 463.857ms HASH_JOIN_NODE (id=12):(Total: 3m35s, non-child: 1m10s, % non-child: 32.65%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 40.20M (40201700) - BuildTime: 8s616ms - PeakMemoryUsage: 3.02 GB (3240188128) - ProbeRows: 75.59M (75588416) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1m - RowsReturned: 4.00B (4001120524) - RowsReturnedRate: 18.57 M/sec Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 5s954ms - BuildRowsPartitioned: 40.20M (40201700) - GetNewBlockTime: 3.752ms - HashBuckets: 67.11M (67108864) - HashCollisions: 0 (0) - HashTablesBuildTime: 2s608ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 3.02 GB (3240125568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 6s411ms, non-child: 1s563ms, % non-child: 24.38%) BytesReceived(16s000ms): 206.82 MB, 380.72 MB, 380.72 MB, 380.72 MB, 380.72 MB, 380.72 MB, 380.72 MB, 380.72 MB, 380.72 MB, 380.72 MB, 380.72 MB, 380.72 MB, 380.72 MB, 380.72 MB, 380.72 MB, 380.72 MB, 380.72 MB, 380.72 MB, 380.72 MB, 380.72 MB, 380.72 MB, 380.72 MB, 380.72 MB, 380.72 MB, 380.72 MB, 380.72 MB, 380.72 MB, 380.72 MB, 380.72 MB, 380.72 MB, 380.72 MB, 380.72 MB, 380.72 MB, 380.72 MB, 380.72 MB, 380.72 MB, 380.72 MB, 380.72 MB, 380.72 MB, 380.72 MB - BytesReceived: 380.72 MB (399212580) - ConvertRowBatchTime: 953.622ms - DeserializeRowBatchTimer: 1s559ms - FirstBatchArrivalWaitTime: 1s112ms - PeakMemoryUsage: 0 - RowsReturned: 40.20M (40201700) - RowsReturnedRate: 6.27 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=22):(Total: 2m19s, non-child: 1s278ms, % non-child: 0.92%) BytesReceived(16s000ms): 2.12 MB, 15.07 MB, 41.63 MB, 67.34 MB, 94.09 MB, 120.94 MB, 148.13 MB, 175.39 MB, 201.17 MB, 226.69 MB, 251.65 MB, 277.21 MB, 303.68 MB, 332.35 MB, 356.53 MB, 383.64 MB, 409.16 MB, 436.34 MB, 459.31 MB, 485.09 MB, 507.36 MB, 524.79 MB, 543.71 MB, 566.24 MB, 583.95 MB, 596.41 MB, 616.58 MB, 632.59 MB, 645.67 MB, 650.30 MB, 659.24 MB, 672.15 MB, 677.30 MB, 686.40 MB, 695.01 MB, 699.87 MB, 699.87 MB, 699.87 MB, 699.87 MB, 699.87 MB - BytesReceived: 699.87 MB (733865174) - ConvertRowBatchTime: 814.680ms - DeserializeRowBatchTimer: 6s648ms - FirstBatchArrivalWaitTime: 784.837ms - PeakMemoryUsage: 0 - RowsReturned: 75.59M (75588416) - RowsReturnedRate: 541.80 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=24):(Total: 1s726ms, non-child: 3.910us, % non-child: 0.00%) BytesReceived(16s000ms): 8.60 MB, 10.55 MB, 10.55 MB, 10.55 MB, 10.55 MB, 10.55 MB, 10.55 MB, 10.55 MB, 10.55 MB, 10.55 MB, 10.55 MB, 10.55 MB, 10.55 MB, 10.55 MB, 10.55 MB, 10.55 MB, 10.55 MB, 10.55 MB, 10.55 MB, 10.55 MB, 10.55 MB, 10.55 MB, 10.55 MB, 10.55 MB, 10.55 MB, 10.55 MB, 10.55 MB, 10.55 MB, 10.55 MB, 10.55 MB, 10.55 MB, 10.55 MB, 10.55 MB, 10.55 MB, 10.55 MB, 10.55 MB, 10.55 MB, 10.60 MB, 10.75 MB, 10.75 MB - BytesReceived: 11.10 MB (11637014) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 72.294ms - FirstBatchArrivalWaitTime: 1s726ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:333 (host=vc1542.foo:22000):(Total: 54.875ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 987.04 MB, 7.14 GB, 13.93 GB, 20.44 GB, 27.23 GB, 34.03 GB, 40.94 GB, 47.81 GB, 54.27 GB, 61.12 GB, 67.41 GB, 73.89 GB, 80.63 GB, 87.09 GB, 93.27 GB, 100.16 GB, 106.52 GB, 113.45 GB, 119.41 GB, 125.90 GB, 131.68 GB, 135.92 GB, 140.65 GB, 146.27 GB, 150.89 GB, 154.12 GB, 156.69 GB, 152.33 GB, 155.65 GB, 156.30 GB, 158.85 GB, 151.85 GB, 151.15 GB, 153.80 GB, 155.54 GB, 154.55 GB, 153.23 GB, 153.33 GB, 154.28 GB, 154.21 GB ThreadUsage(16s000ms): 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.03 - BloomFilterBytes: 49.00 MB (51380224) - PeakMemoryUsage: 160.60 GB (172447812031) - PerHostPeakMemUsage: 169.57 GB (182073432523) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 2m32s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 1.70K (1704) - TotalThreadsTotalWallClockTime: 21s565ms - TotalThreadsSysTime: 1s992ms - TotalThreadsUserTime: 7s849ms - TotalThreadsVoluntaryContextSwitches: 22.13K (22126) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 54.830ms - ExecTreePrepareTime: 596.029us DataStreamSender (dst_id=28):(Total: 1.027ms, non-child: 1.027ms, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.05 MB (1105280) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 649.124ms, non-child: 649.124ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 210.131ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 122 (122) - NumInstructions: 8.95K (8951) - OptimizationTime: 416.784ms - PeakMemoryUsage: 4.37 MB (4582912) - PrepareTime: 21.783ms HASH_JOIN_NODE (id=15):(Total: 1.130ms, non-child: 904.855us, % non-child: 80.03%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 451.92K (451915) - BuildTime: 141.336ms - PeakMemoryUsage: 153.09 MB (160524544) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=15): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 103.620ms - BuildRowsPartitioned: 451.92K (451915) - GetNewBlockTime: 336.044us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 35.059ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160449664) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=26):(Total: 2s029ms, non-child: 24.144ms, % non-child: 1.19%) BytesReceived(16s000ms): 5.37 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB - BytesReceived: 6.21 MB (6513198) - ConvertRowBatchTime: 12.060ms - DeserializeRowBatchTimer: 47.851ms - FirstBatchArrivalWaitTime: 1s173ms - PeakMemoryUsage: 0 - RowsReturned: 451.92K (451915) - RowsReturnedRate: 222.67 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=14):(Total: 855.117us, non-child: 910.199us, % non-child: 100.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 458.82K (458825) - BuildTime: 148.135ms - PeakMemoryUsage: 25.08 MB (26298624) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 86.474ms - BuildRowsPartitioned: 458.82K (458825) - GetNewBlockTime: 198.812us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 26.597ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 25.02 MB (26231936) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 4s121ms, non-child: 14.767ms, % non-child: 0.36%) BytesReceived(16s000ms): 5.80 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB - BytesReceived: 7.33 MB (7685186) - ConvertRowBatchTime: 10.787ms - DeserializeRowBatchTimer: 15.234ms - FirstBatchArrivalWaitTime: 2s089ms - PeakMemoryUsage: 0 - RowsReturned: 458.82K (458825) - RowsReturnedRate: 111.32 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=13):(Total: 553.751us, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 3.97B (3967888888) - BuildTime: 5m56s - PeakMemoryUsage: 159.14 GB (170878273792) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled, Spilled Runtime filters: 0 of 1 Runtime Filter Published, 1 Disabled - BuildRowsPartitionTime: 5m56s - BuildRowsPartitioned: 3.97B (3967888888) - GetNewBlockTime: 57s681ms - HashBuckets: 1.07B (1073741824) - HashCollisions: 0 (0) - HashTablesBuildTime: 55s117ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 159.14 GB (170878215296) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 5 (5) - UnpinTime: 245.054ms HASH_JOIN_NODE (id=12):(Total: 3m36s, non-child: 1m10s, % non-child: 32.62%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 40.11M (40108333) - BuildTime: 8s117ms - PeakMemoryUsage: 3.02 GB (3240192224) - ProbeRows: 75.09M (75087923) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1m1s - RowsReturned: 3.97B (3967888888) - RowsReturnedRate: 18.37 M/sec Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 5s497ms - BuildRowsPartitioned: 40.11M (40108333) - GetNewBlockTime: 2.468ms - HashBuckets: 67.11M (67108864) - HashCollisions: 0 (0) - HashTablesBuildTime: 2s567ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 3.02 GB (3240125568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 6s920ms, non-child: 1s477ms, % non-child: 21.34%) BytesReceived(16s000ms): 208.27 MB, 379.86 MB, 379.86 MB, 379.86 MB, 379.86 MB, 379.86 MB, 379.86 MB, 379.86 MB, 379.86 MB, 379.86 MB, 379.86 MB, 379.86 MB, 379.86 MB, 379.86 MB, 379.86 MB, 379.86 MB, 379.86 MB, 379.86 MB, 379.86 MB, 379.86 MB, 379.86 MB, 379.86 MB, 379.86 MB, 379.86 MB, 379.86 MB, 379.86 MB, 379.86 MB, 379.86 MB, 379.86 MB, 379.86 MB, 379.86 MB, 379.86 MB, 379.86 MB, 379.86 MB, 379.86 MB, 379.86 MB, 379.86 MB, 379.86 MB, 379.86 MB, 379.86 MB - BytesReceived: 379.86 MB (398307093) - ConvertRowBatchTime: 977.809ms - DeserializeRowBatchTimer: 1s408ms - FirstBatchArrivalWaitTime: 1s094ms - PeakMemoryUsage: 0 - RowsReturned: 40.11M (40108333) - RowsReturnedRate: 5.80 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=22):(Total: 2m19s, non-child: 2s217ms, % non-child: 1.59%) BytesReceived(16s000ms): 2.09 MB, 15.09 MB, 41.43 MB, 66.99 MB, 93.57 MB, 120.18 MB, 147.18 MB, 174.12 MB, 199.81 MB, 226.60 MB, 251.32 MB, 276.72 MB, 303.24 MB, 329.29 MB, 353.42 MB, 380.38 MB, 405.65 MB, 432.78 MB, 455.58 MB, 480.97 MB, 503.38 MB, 520.33 MB, 539.11 MB, 561.17 MB, 579.07 MB, 591.48 MB, 611.37 MB, 627.34 MB, 640.89 MB, 645.48 MB, 654.24 MB, 667.25 MB, 672.54 MB, 681.39 MB, 690.06 MB, 695.18 MB, 695.18 MB, 695.18 MB, 695.18 MB, 695.18 MB - BytesReceived: 695.18 MB (728954190) - ConvertRowBatchTime: 830.427ms - DeserializeRowBatchTimer: 5s611ms - FirstBatchArrivalWaitTime: 765.068ms - PeakMemoryUsage: 0 - RowsReturned: 75.09M (75087923) - RowsReturnedRate: 538.67 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=24):(Total: 1s699ms, non-child: 3.445us, % non-child: 0.00%) BytesReceived(16s000ms): 8.34 MB, 10.18 MB, 10.18 MB, 10.18 MB, 10.18 MB, 10.18 MB, 10.18 MB, 10.18 MB, 10.18 MB, 10.18 MB, 10.18 MB, 10.18 MB, 10.18 MB, 10.18 MB, 10.18 MB, 10.18 MB, 10.18 MB, 10.18 MB, 10.18 MB, 10.18 MB, 10.18 MB, 10.18 MB, 10.18 MB, 10.18 MB, 10.18 MB, 10.18 MB, 10.18 MB, 10.18 MB, 10.18 MB, 10.18 MB, 10.18 MB, 10.18 MB, 10.18 MB, 10.18 MB, 10.18 MB, 10.18 MB, 10.18 MB, 10.21 MB, 10.30 MB, 10.32 MB - BytesReceived: 10.36 MB (10861383) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 66.830ms - FirstBatchArrivalWaitTime: 1s699ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:366 (host=va1037.foo:22000):(Total: 54.817ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 940.39 MB, 6.77 GB, 13.83 GB, 20.22 GB, 26.81 GB, 33.39 GB, 40.07 GB, 46.73 GB, 52.98 GB, 59.26 GB, 65.35 GB, 71.61 GB, 78.21 GB, 84.31 GB, 90.43 GB, 96.93 GB, 103.20 GB, 109.72 GB, 116.34 GB, 122.47 GB, 128.24 GB, 132.54 GB, 137.07 GB, 142.55 GB, 147.03 GB, 150.19 GB, 154.98 GB, 157.99 GB, 151.73 GB, 152.83 GB, 154.65 GB, 157.78 GB, 158.95 GB, 154.82 GB, 151.86 GB, 151.84 GB, 155.63 GB, 150.70 GB, 153.61 GB, 149.03 GB ThreadUsage(16s000ms): 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.04 - BloomFilterBytes: 49.00 MB (51380224) - PeakMemoryUsage: 160.61 GB (172453330519) - PerHostPeakMemUsage: 169.56 GB (182068666281) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 2m38s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 1.68K (1680) - TotalThreadsTotalWallClockTime: 22s671ms - TotalThreadsSysTime: 2s194ms - TotalThreadsUserTime: 7s997ms - TotalThreadsVoluntaryContextSwitches: 22.51K (22507) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 54.781ms - ExecTreePrepareTime: 637.614us DataStreamSender (dst_id=28):(Total: 729.735us, non-child: 729.735us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.05 MB (1105280) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 626.856ms, non-child: 626.856ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 205.853ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 122 (122) - NumInstructions: 8.95K (8951) - OptimizationTime: 394.547ms - PeakMemoryUsage: 4.37 MB (4582912) - PrepareTime: 25.923ms HASH_JOIN_NODE (id=15):(Total: 1.246ms, non-child: 845.277us, % non-child: 67.80%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 451.92K (451915) - BuildTime: 128.498ms - PeakMemoryUsage: 153.09 MB (160524544) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=15): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 94.687ms - BuildRowsPartitioned: 451.92K (451915) - GetNewBlockTime: 445.192us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 30.367ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160449664) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=26):(Total: 2s061ms, non-child: 23.011ms, % non-child: 1.12%) BytesReceived(16s000ms): 5.43 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB - BytesReceived: 6.21 MB (6513198) - ConvertRowBatchTime: 11.838ms - DeserializeRowBatchTimer: 50.757ms - FirstBatchArrivalWaitTime: 1s187ms - PeakMemoryUsage: 0 - RowsReturned: 451.92K (451915) - RowsReturnedRate: 219.25 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=14):(Total: 1.089ms, non-child: 910.180us, % non-child: 83.52%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 458.60K (458600) - BuildTime: 151.907ms - PeakMemoryUsage: 25.08 MB (26298624) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 94.359ms - BuildRowsPartitioned: 458.60K (458600) - GetNewBlockTime: 194.089us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 22.043ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 25.02 MB (26231936) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 4s177ms, non-child: 15.304ms, % non-child: 0.37%) BytesReceived(16s000ms): 5.85 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB - BytesReceived: 7.33 MB (7682231) - ConvertRowBatchTime: 11.585ms - DeserializeRowBatchTimer: 15.518ms - FirstBatchArrivalWaitTime: 2s093ms - PeakMemoryUsage: 0 - RowsReturned: 458.60K (458600) - RowsReturnedRate: 109.79 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=13):(Total: 795.789us, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 3.86B (3862886632) - BuildTime: 5m35s - PeakMemoryUsage: 160.16 GB (171968792832) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled, Spilled Runtime filters: 0 of 1 Runtime Filter Published, 1 Disabled - BuildRowsPartitionTime: 5m34s - BuildRowsPartitioned: 3.86B (3862886632) - GetNewBlockTime: 18s979ms - HashBuckets: 1.07B (1073741824) - HashCollisions: 0 (0) - HashTablesBuildTime: 1m27s - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 160.16 GB (171968734336) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 5 (5) - UnpinTime: 259.105ms HASH_JOIN_NODE (id=12):(Total: 3m47s, non-child: 1m15s, % non-child: 33.33%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 40.15M (40150068) - BuildTime: 8s454ms - PeakMemoryUsage: 3.02 GB (3240192240) - ProbeRows: 72.26M (72259712) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1m6s - RowsReturned: 3.86B (3862886632) - RowsReturnedRate: 16.95 M/sec Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 5s462ms - BuildRowsPartitioned: 40.15M (40150068) - GetNewBlockTime: 2.790ms - HashBuckets: 67.11M (67108864) - HashCollisions: 0 (0) - HashTablesBuildTime: 2s943ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 3.02 GB (3240125568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 7s611ms, non-child: 1s469ms, % non-child: 19.30%) BytesReceived(16s000ms): 213.93 MB, 380.26 MB, 380.26 MB, 380.26 MB, 380.26 MB, 380.26 MB, 380.26 MB, 380.26 MB, 380.26 MB, 380.26 MB, 380.26 MB, 380.26 MB, 380.26 MB, 380.26 MB, 380.26 MB, 380.26 MB, 380.26 MB, 380.26 MB, 380.26 MB, 380.26 MB, 380.26 MB, 380.26 MB, 380.26 MB, 380.26 MB, 380.26 MB, 380.26 MB, 380.26 MB, 380.26 MB, 380.26 MB, 380.26 MB, 380.26 MB, 380.26 MB, 380.26 MB, 380.26 MB, 380.26 MB, 380.26 MB, 380.26 MB, 380.26 MB, 380.26 MB, 380.26 MB - BytesReceived: 380.26 MB (398730263) - ConvertRowBatchTime: 962.762ms - DeserializeRowBatchTimer: 1s418ms - FirstBatchArrivalWaitTime: 1s107ms - PeakMemoryUsage: 0 - RowsReturned: 40.15M (40150068) - RowsReturnedRate: 5.28 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=22):(Total: 2m25s, non-child: 1s246ms, % non-child: 0.86%) BytesReceived(16s000ms): 2.06 MB, 15.03 MB, 40.54 MB, 65.31 MB, 90.89 MB, 116.40 MB, 142.29 MB, 168.28 MB, 192.74 MB, 217.16 MB, 240.92 MB, 265.42 MB, 290.75 MB, 315.54 MB, 338.60 MB, 364.22 MB, 389.05 MB, 417.04 MB, 438.93 MB, 463.65 MB, 484.82 MB, 501.40 MB, 519.36 MB, 540.80 MB, 557.72 MB, 569.65 MB, 588.87 MB, 604.10 MB, 616.67 MB, 621.12 MB, 629.74 MB, 642.16 MB, 647.04 MB, 655.92 MB, 664.23 MB, 668.91 MB, 668.91 MB, 668.91 MB, 668.91 MB, 668.91 MB - BytesReceived: 668.91 MB (701402821) - ConvertRowBatchTime: 801.654ms - DeserializeRowBatchTimer: 5s003ms - FirstBatchArrivalWaitTime: 773.489ms - PeakMemoryUsage: 0 - RowsReturned: 72.26M (72259712) - RowsReturnedRate: 497.85 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=24):(Total: 1s714ms, non-child: 6.012us, % non-child: 0.00%) BytesReceived(16s000ms): 8.70 MB, 10.31 MB, 10.31 MB, 10.31 MB, 10.31 MB, 10.31 MB, 10.31 MB, 10.31 MB, 10.31 MB, 10.31 MB, 10.31 MB, 10.31 MB, 10.31 MB, 10.31 MB, 10.31 MB, 10.31 MB, 10.31 MB, 10.31 MB, 10.31 MB, 10.31 MB, 10.31 MB, 10.31 MB, 10.31 MB, 10.31 MB, 10.31 MB, 10.31 MB, 10.31 MB, 10.31 MB, 10.31 MB, 10.31 MB, 10.31 MB, 10.31 MB, 10.31 MB, 10.31 MB, 10.31 MB, 10.31 MB, 10.31 MB, 10.33 MB, 10.44 MB, 10.44 MB - BytesReceived: 10.62 MB (11133447) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 67.861ms - FirstBatchArrivalWaitTime: 1s714ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:360 (host=vc1527.foo:22000):(Total: 54.797ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 925.50 MB, 6.65 GB, 13.68 GB, 20.59 GB, 27.39 GB, 34.20 GB, 41.05 GB, 47.64 GB, 54.24 GB, 60.82 GB, 67.15 GB, 73.55 GB, 80.43 GB, 86.95 GB, 93.27 GB, 100.05 GB, 106.63 GB, 113.12 GB, 119.56 GB, 125.68 GB, 131.99 GB, 136.31 GB, 141.73 GB, 147.61 GB, 152.17 GB, 155.43 GB, 156.05 GB, 153.55 GB, 156.73 GB, 157.72 GB, 156.20 GB, 151.70 GB, 152.46 GB, 154.87 GB, 156.69 GB, 154.15 GB, 154.31 GB, 151.57 GB, 154.06 GB, 154.12 GB ThreadUsage(16s000ms): 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.03 - BloomFilterBytes: 49.00 MB (51380224) - PeakMemoryUsage: 160.60 GB (172444798831) - PerHostPeakMemUsage: 169.56 GB (182068626035) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 1m44s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 1.34K (1336) - TotalThreadsTotalWallClockTime: 22s139ms - TotalThreadsSysTime: 2s181ms - TotalThreadsUserTime: 7s817ms - TotalThreadsVoluntaryContextSwitches: 23.66K (23664) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 54.733ms - ExecTreePrepareTime: 641.100us DataStreamSender (dst_id=28):(Total: 977.243us, non-child: 977.243us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.05 MB (1105280) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 613.572ms, non-child: 613.572ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 202.399ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 122 (122) - NumInstructions: 8.95K (8951) - OptimizationTime: 389.454ms - PeakMemoryUsage: 4.37 MB (4582912) - PrepareTime: 21.329ms HASH_JOIN_NODE (id=15):(Total: 1.225ms, non-child: 906.512us, % non-child: 73.95%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 451.92K (451915) - BuildTime: 135.784ms - PeakMemoryUsage: 153.09 MB (160524544) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=15): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 100.924ms - BuildRowsPartitioned: 451.92K (451915) - GetNewBlockTime: 363.649us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 32.011ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160449664) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=26):(Total: 2s058ms, non-child: 24.700ms, % non-child: 1.20%) BytesReceived(16s000ms): 5.32 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB - BytesReceived: 6.21 MB (6513198) - ConvertRowBatchTime: 12.652ms - DeserializeRowBatchTimer: 55.012ms - FirstBatchArrivalWaitTime: 1s198ms - PeakMemoryUsage: 0 - RowsReturned: 451.92K (451915) - RowsReturnedRate: 219.56 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=14):(Total: 941.212us, non-child: 982.913us, % non-child: 100.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 458.92K (458915) - BuildTime: 162.746ms - PeakMemoryUsage: 25.08 MB (26298624) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 105.452ms - BuildRowsPartitioned: 458.92K (458915) - GetNewBlockTime: 283.433us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 23.583ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 25.02 MB (26231936) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 4s169ms, non-child: 16.420ms, % non-child: 0.39%) BytesReceived(16s000ms): 5.78 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB - BytesReceived: 7.33 MB (7686936) - ConvertRowBatchTime: 12.303ms - DeserializeRowBatchTimer: 17.465ms - FirstBatchArrivalWaitTime: 2s110ms - PeakMemoryUsage: 0 - RowsReturned: 458.92K (458915) - RowsReturnedRate: 110.05 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=13):(Total: 628.341us, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 4.00B (3995166974) - BuildTime: 6m32s - PeakMemoryUsage: 157.63 GB (169259272448) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled, Spilled Runtime filters: 0 of 1 Runtime Filter Published, 1 Disabled - BuildRowsPartitionTime: 6m31s - BuildRowsPartitioned: 4.00B (3995166974) - GetNewBlockTime: 40s612ms - HashBuckets: 536.87M (536870912) - HashCollisions: 0 (0) - HashTablesBuildTime: 24s981ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 157.63 GB (169259213952) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 4 (4) - UnpinTime: 254.834ms HASH_JOIN_NODE (id=12):(Total: 2m56s, non-child: 1m18s, % non-child: 44.63%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 40.17M (40166321) - BuildTime: 8s130ms - PeakMemoryUsage: 3.02 GB (3240196320) - ProbeRows: 75.02M (75024735) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1m9s - RowsReturned: 4.00B (3995166974) - RowsReturnedRate: 22.63 M/sec Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 5s437ms - BuildRowsPartitioned: 40.17M (40166321) - GetNewBlockTime: 3.188ms - HashBuckets: 67.11M (67108864) - HashCollisions: 0 (0) - HashTablesBuildTime: 2s655ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 3.02 GB (3240125568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 7s392ms, non-child: 1s713ms, % non-child: 23.18%) BytesReceived(16s000ms): 206.99 MB, 380.39 MB, 380.39 MB, 380.39 MB, 380.39 MB, 380.39 MB, 380.39 MB, 380.39 MB, 380.39 MB, 380.39 MB, 380.39 MB, 380.39 MB, 380.39 MB, 380.39 MB, 380.39 MB, 380.39 MB, 380.39 MB, 380.39 MB, 380.39 MB, 380.39 MB, 380.39 MB, 380.39 MB, 380.39 MB, 380.39 MB, 380.39 MB, 380.39 MB, 380.39 MB, 380.39 MB, 380.39 MB, 380.39 MB, 380.39 MB, 380.39 MB, 380.39 MB, 380.39 MB, 380.39 MB, 380.39 MB, 380.39 MB, 380.39 MB, 380.39 MB, 380.39 MB - BytesReceived: 380.39 MB (398862790) - ConvertRowBatchTime: 993.393ms - DeserializeRowBatchTimer: 1s762ms - FirstBatchArrivalWaitTime: 1s117ms - PeakMemoryUsage: 0 - RowsReturned: 40.17M (40166321) - RowsReturnedRate: 5.43 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=22):(Total: 1m31s, non-child: 1s298ms, % non-child: 1.42%) BytesReceived(16s000ms): 2.07 MB, 15.08 MB, 41.48 MB, 67.05 MB, 93.56 MB, 120.12 MB, 146.89 MB, 173.70 MB, 198.99 MB, 224.16 MB, 248.86 MB, 274.31 MB, 300.84 MB, 326.76 MB, 350.94 MB, 377.63 MB, 403.10 MB, 430.14 MB, 453.23 MB, 477.89 MB, 501.42 MB, 518.21 MB, 539.84 MB, 562.54 MB, 579.71 MB, 592.21 MB, 612.40 MB, 628.23 MB, 640.58 MB, 645.32 MB, 654.39 MB, 667.29 MB, 672.21 MB, 681.63 MB, 690.22 MB, 694.54 MB, 694.54 MB, 694.54 MB, 694.54 MB, 694.54 MB - BytesReceived: 694.54 MB (728282265) - ConvertRowBatchTime: 848.258ms - DeserializeRowBatchTimer: 10s698ms - FirstBatchArrivalWaitTime: 782.453ms - PeakMemoryUsage: 0 - RowsReturned: 75.02M (75024735) - RowsReturnedRate: 823.19 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=24):(Total: 1s726ms, non-child: 3.968us, % non-child: 0.00%) BytesReceived(16s000ms): 8.45 MB, 10.37 MB, 10.37 MB, 10.37 MB, 10.37 MB, 10.37 MB, 10.37 MB, 10.37 MB, 10.37 MB, 10.37 MB, 10.37 MB, 10.37 MB, 10.37 MB, 10.37 MB, 10.37 MB, 10.37 MB, 10.37 MB, 10.37 MB, 10.37 MB, 10.37 MB, 10.37 MB, 10.37 MB, 10.37 MB, 10.37 MB, 10.37 MB, 10.37 MB, 10.37 MB, 10.37 MB, 10.37 MB, 10.37 MB, 10.37 MB, 10.37 MB, 10.37 MB, 10.37 MB, 10.37 MB, 10.37 MB, 10.37 MB, 10.40 MB, 10.52 MB, 10.52 MB - BytesReceived: 10.72 MB (11243429) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 73.475ms - FirstBatchArrivalWaitTime: 1s726ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:353 (host=vd1334.foo:22000):(Total: 54.790ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 971.47 MB, 6.85 GB, 14.14 GB, 20.94 GB, 27.74 GB, 34.62 GB, 41.52 GB, 48.42 GB, 54.95 GB, 61.46 GB, 67.89 GB, 74.49 GB, 81.51 GB, 88.13 GB, 94.38 GB, 101.29 GB, 107.87 GB, 114.73 GB, 120.79 GB, 127.26 GB, 133.53 GB, 137.83 GB, 142.61 GB, 148.33 GB, 153.10 GB, 156.37 GB, 154.13 GB, 154.50 GB, 157.48 GB, 158.84 GB, 150.95 GB, 152.03 GB, 154.08 GB, 156.37 GB, 157.41 GB, 154.42 GB, 157.91 GB, 155.19 GB, 157.00 GB, 155.11 GB ThreadUsage(16s000ms): 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.03 - BloomFilterBytes: 49.00 MB (51380224) - PeakMemoryUsage: 160.60 GB (172444900015) - PerHostPeakMemUsage: 169.57 GB (182073588045) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 1m43s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 1.70K (1696) - TotalThreadsTotalWallClockTime: 22s308ms - TotalThreadsSysTime: 2s343ms - TotalThreadsUserTime: 8s114ms - TotalThreadsVoluntaryContextSwitches: 21.34K (21340) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 54.753ms - ExecTreePrepareTime: 571.168us DataStreamSender (dst_id=28):(Total: 721.441us, non-child: 721.441us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.05 MB (1105280) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 644.956ms, non-child: 644.956ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 212.897ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 122 (122) - NumInstructions: 8.95K (8951) - OptimizationTime: 408.182ms - PeakMemoryUsage: 4.37 MB (4582912) - PrepareTime: 23.478ms HASH_JOIN_NODE (id=15):(Total: 1.093ms, non-child: 853.399us, % non-child: 78.03%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 451.92K (451915) - BuildTime: 129.648ms - PeakMemoryUsage: 153.09 MB (160524544) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=15): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 97.097ms - BuildRowsPartitioned: 451.92K (451915) - GetNewBlockTime: 384.969us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 29.648ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160449664) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=26):(Total: 2s040ms, non-child: 26.039ms, % non-child: 1.28%) BytesReceived(16s000ms): 5.43 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB - BytesReceived: 6.21 MB (6513198) - ConvertRowBatchTime: 12.109ms - DeserializeRowBatchTimer: 48.596ms - FirstBatchArrivalWaitTime: 1s174ms - PeakMemoryUsage: 0 - RowsReturned: 451.92K (451915) - RowsReturnedRate: 221.43 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=14):(Total: 890.059us, non-child: 809.423us, % non-child: 90.94%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 460.12K (460118) - BuildTime: 149.523ms - PeakMemoryUsage: 25.08 MB (26298624) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 86.776ms - BuildRowsPartitioned: 460.12K (460118) - GetNewBlockTime: 242.257us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 26.171ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 25.02 MB (26231936) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 4s152ms, non-child: 16.003ms, % non-child: 0.39%) BytesReceived(16s000ms): 5.88 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB - BytesReceived: 7.35 MB (7707848) - ConvertRowBatchTime: 11.989ms - DeserializeRowBatchTimer: 16.593ms - FirstBatchArrivalWaitTime: 2s088ms - PeakMemoryUsage: 0 - RowsReturned: 460.12K (460118) - RowsReturnedRate: 110.81 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=13):(Total: 673.163us, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 4.04B (4035338888) - BuildTime: 6m28s - PeakMemoryUsage: 160.13 GB (171935238400) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled, Spilled Runtime filters: 0 of 1 Runtime Filter Published, 1 Disabled - BuildRowsPartitionTime: 6m28s - BuildRowsPartitioned: 4.04B (4035338888) - GetNewBlockTime: 50s859ms - HashBuckets: 1.07B (1073741824) - HashCollisions: 0 (0) - HashTablesBuildTime: 1m3s - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 160.13 GB (171935179904) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 5 (5) - UnpinTime: 118.812ms HASH_JOIN_NODE (id=12):(Total: 2m54s, non-child: 1m17s, % non-child: 44.47%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 40.23M (40226025) - BuildTime: 8s682ms - PeakMemoryUsage: 3.02 GB (3240188128) - ProbeRows: 75.45M (75450586) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1m4s - RowsReturned: 4.04B (4035338888) - RowsReturnedRate: 23.12 M/sec Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 5s695ms - BuildRowsPartitioned: 40.23M (40226025) - GetNewBlockTime: 2.994ms - HashBuckets: 67.11M (67108864) - HashCollisions: 0 (0) - HashTablesBuildTime: 2s940ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 3.02 GB (3240125568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 7s050ms, non-child: 1s543ms, % non-child: 21.90%) BytesReceived(16s000ms): 214.42 MB, 380.96 MB, 380.96 MB, 380.96 MB, 380.96 MB, 380.96 MB, 380.96 MB, 380.96 MB, 380.96 MB, 380.96 MB, 380.96 MB, 380.96 MB, 380.96 MB, 380.96 MB, 380.96 MB, 380.96 MB, 380.96 MB, 380.96 MB, 380.96 MB, 380.96 MB, 380.96 MB, 380.96 MB, 380.96 MB, 380.96 MB, 380.96 MB, 380.96 MB, 380.96 MB, 380.96 MB, 380.96 MB, 380.96 MB, 380.96 MB, 380.96 MB, 380.96 MB, 380.96 MB, 380.96 MB, 380.96 MB, 380.96 MB, 380.96 MB, 380.96 MB, 380.96 MB - BytesReceived: 380.96 MB (399463292) - ConvertRowBatchTime: 957.063ms - DeserializeRowBatchTimer: 1s524ms - FirstBatchArrivalWaitTime: 1s097ms - PeakMemoryUsage: 0 - RowsReturned: 40.23M (40226025) - RowsReturnedRate: 5.71 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=22):(Total: 1m30s, non-child: 2s314ms, % non-child: 2.55%) BytesReceived(16s000ms): 2.17 MB, 15.69 MB, 42.48 MB, 68.10 MB, 94.66 MB, 121.25 MB, 148.18 MB, 175.06 MB, 200.43 MB, 225.80 MB, 250.81 MB, 276.61 MB, 303.37 MB, 329.76 MB, 354.03 MB, 381.06 MB, 406.53 MB, 433.80 MB, 456.92 MB, 482.11 MB, 505.29 MB, 522.07 MB, 540.85 MB, 562.99 MB, 581.17 MB, 593.63 MB, 613.22 MB, 629.51 MB, 643.54 MB, 648.05 MB, 657.46 MB, 671.57 MB, 676.34 MB, 686.26 MB, 694.75 MB, 698.55 MB, 698.55 MB, 698.55 MB, 698.55 MB, 698.55 MB - BytesReceived: 698.55 MB (732487920) - ConvertRowBatchTime: 874.070ms - DeserializeRowBatchTimer: 12s119ms - FirstBatchArrivalWaitTime: 761.163ms - PeakMemoryUsage: 0 - RowsReturned: 75.45M (75450586) - RowsReturnedRate: 832.76 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=24):(Total: 1s690ms, non-child: 3.772us, % non-child: 0.00%) BytesReceived(16s000ms): 8.55 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.17 MB, 10.23 MB, 10.24 MB - BytesReceived: 10.26 MB (10753281) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 73.243ms - FirstBatchArrivalWaitTime: 1s690ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:341 (host=vd1120.foo:22000):(Total: 54.433ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 978.77 MB, 6.92 GB, 14.23 GB, 20.86 GB, 27.66 GB, 34.45 GB, 41.31 GB, 48.17 GB, 54.61 GB, 61.28 GB, 67.90 GB, 74.46 GB, 81.35 GB, 88.00 GB, 94.18 GB, 101.09 GB, 107.60 GB, 114.44 GB, 120.60 GB, 127.06 GB, 133.04 GB, 137.34 GB, 142.08 GB, 147.73 GB, 152.40 GB, 155.66 GB, 156.03 GB, 153.50 GB, 156.83 GB, 157.12 GB, 156.31 GB, 151.59 GB, 152.68 GB, 155.03 GB, 156.33 GB, 152.72 GB, 153.43 GB, 150.93 GB, 153.50 GB, 153.58 GB ThreadUsage(16s000ms): 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.04 - BloomFilterBytes: 49.00 MB (51380224) - PeakMemoryUsage: 160.60 GB (172446975775) - PerHostPeakMemUsage: 169.56 GB (182061714716) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 2m1s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 1.73K (1725) - TotalThreadsTotalWallClockTime: 22s324ms - TotalThreadsSysTime: 2s230ms - TotalThreadsUserTime: 8s289ms - TotalThreadsVoluntaryContextSwitches: 22.35K (22353) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 54.389ms - ExecTreePrepareTime: 775.181us DataStreamSender (dst_id=28):(Total: 1.023ms, non-child: 1.023ms, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.05 MB (1105280) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 639.045ms, non-child: 639.045ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 211.565ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 122 (122) - NumInstructions: 8.95K (8951) - OptimizationTime: 403.515ms - PeakMemoryUsage: 4.37 MB (4582912) - PrepareTime: 23.512ms HASH_JOIN_NODE (id=15):(Total: 1.511ms, non-child: 919.824us, % non-child: 60.84%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 451.92K (451915) - BuildTime: 136.068ms - PeakMemoryUsage: 153.09 MB (160524544) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=15): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 96.024ms - BuildRowsPartitioned: 451.92K (451915) - GetNewBlockTime: 321.618us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 36.997ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160449664) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=26):(Total: 2s058ms, non-child: 22.596ms, % non-child: 1.10%) BytesReceived(16s000ms): 5.39 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB - BytesReceived: 6.21 MB (6513198) - ConvertRowBatchTime: 12.133ms - DeserializeRowBatchTimer: 44.838ms - FirstBatchArrivalWaitTime: 1s181ms - PeakMemoryUsage: 0 - RowsReturned: 451.92K (451915) - RowsReturnedRate: 219.58 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=14):(Total: 1.239ms, non-child: 1.014ms, % non-child: 81.84%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 458.70K (458699) - BuildTime: 166.774ms - PeakMemoryUsage: 25.08 MB (26298624) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 102.581ms - BuildRowsPartitioned: 458.70K (458699) - GetNewBlockTime: 156.709us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 23.068ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 25.02 MB (26231936) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 4s119ms, non-child: 15.868ms, % non-child: 0.39%) BytesReceived(16s000ms): 5.82 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB - BytesReceived: 7.33 MB (7683863) - ConvertRowBatchTime: 12.194ms - DeserializeRowBatchTimer: 15.399ms - FirstBatchArrivalWaitTime: 2s090ms - PeakMemoryUsage: 0 - RowsReturned: 458.70K (458699) - RowsReturnedRate: 111.36 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=13):(Total: 856.013us, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 4.01B (4006873143) - BuildTime: 6m20s - PeakMemoryUsage: 157.31 GB (168914159840) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled, Spilled Runtime filters: 0 of 1 Runtime Filter Published, 1 Disabled - BuildRowsPartitionTime: 6m19s - BuildRowsPartitioned: 4.01B (4006873143) - GetNewBlockTime: 1m - HashBuckets: 536.87M (536870912) - HashCollisions: 0 (0) - HashTablesBuildTime: 25s385ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 157.31 GB (168914068608) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 4 (4) - UnpinTime: 345.476ms HASH_JOIN_NODE (id=12):(Total: 3m6s, non-child: 1m11s, % non-child: 38.42%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 40.09M (40091214) - BuildTime: 8s741ms - PeakMemoryUsage: 3.02 GB (3240191792) - ProbeRows: 75.49M (75494976) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1m2s - RowsReturned: 4.01B (4006873143) - RowsReturnedRate: 21.49 M/sec Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 5s459ms - BuildRowsPartitioned: 40.09M (40091214) - GetNewBlockTime: 2.852ms - HashBuckets: 67.11M (67108864) - HashCollisions: 0 (0) - HashTablesBuildTime: 3s244ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 3.02 GB (3240125568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 7s008ms, non-child: 1s502ms, % non-child: 21.44%) BytesReceived(16s000ms): 212.34 MB, 379.69 MB, 379.69 MB, 379.69 MB, 379.69 MB, 379.69 MB, 379.69 MB, 379.69 MB, 379.69 MB, 379.69 MB, 379.69 MB, 379.69 MB, 379.69 MB, 379.69 MB, 379.69 MB, 379.69 MB, 379.69 MB, 379.69 MB, 379.69 MB, 379.69 MB, 379.69 MB, 379.69 MB, 379.69 MB, 379.69 MB, 379.69 MB, 379.69 MB, 379.69 MB, 379.69 MB, 379.69 MB, 379.69 MB, 379.69 MB, 379.69 MB, 379.69 MB, 379.69 MB, 379.69 MB, 379.69 MB, 379.69 MB, 379.69 MB, 379.69 MB, 379.69 MB - BytesReceived: 379.69 MB (398132727) - ConvertRowBatchTime: 962.227ms - DeserializeRowBatchTimer: 1s426ms - FirstBatchArrivalWaitTime: 1s109ms - PeakMemoryUsage: 0 - RowsReturned: 40.09M (40091214) - RowsReturnedRate: 5.72 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=22):(Total: 1m48s, non-child: 1s550ms, % non-child: 1.43%) BytesReceived(16s000ms): 2.19 MB, 15.69 MB, 42.46 MB, 68.33 MB, 94.93 MB, 121.47 MB, 148.32 MB, 175.28 MB, 200.59 MB, 226.94 MB, 252.82 MB, 278.51 MB, 305.32 MB, 331.77 MB, 355.94 MB, 383.13 MB, 408.68 MB, 435.94 MB, 458.89 MB, 484.69 MB, 507.14 MB, 524.22 MB, 543.03 MB, 565.14 MB, 582.99 MB, 595.49 MB, 615.33 MB, 631.35 MB, 644.85 MB, 649.41 MB, 658.25 MB, 671.34 MB, 676.66 MB, 685.64 MB, 695.86 MB, 699.26 MB, 699.26 MB, 699.26 MB, 699.26 MB, 699.26 MB - BytesReceived: 699.26 MB (733222167) - ConvertRowBatchTime: 832.134ms - DeserializeRowBatchTimer: 5s622ms - FirstBatchArrivalWaitTime: 772.330ms - PeakMemoryUsage: 0 - RowsReturned: 75.49M (75494976) - RowsReturnedRate: 695.14 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=24):(Total: 1s698ms, non-child: 4.595us, % non-child: 0.00%) BytesReceived(16s000ms): 8.60 MB, 10.29 MB, 10.29 MB, 10.29 MB, 10.29 MB, 10.29 MB, 10.29 MB, 10.29 MB, 10.29 MB, 10.29 MB, 10.29 MB, 10.29 MB, 10.29 MB, 10.29 MB, 10.29 MB, 10.29 MB, 10.29 MB, 10.29 MB, 10.29 MB, 10.29 MB, 10.29 MB, 10.29 MB, 10.29 MB, 10.29 MB, 10.29 MB, 10.29 MB, 10.29 MB, 10.29 MB, 10.29 MB, 10.29 MB, 10.29 MB, 10.29 MB, 10.29 MB, 10.29 MB, 10.29 MB, 10.29 MB, 10.29 MB, 10.35 MB, 10.44 MB, 10.46 MB - BytesReceived: 10.57 MB (11083237) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 73.426ms - FirstBatchArrivalWaitTime: 1s698ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:2f3 (host=vd1134.foo:22000):(Total: 54.363ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 1017.16 MB, 6.71 GB, 13.36 GB, 20.02 GB, 26.93 GB, 33.82 GB, 40.66 GB, 47.45 GB, 53.85 GB, 60.18 GB, 66.43 GB, 72.90 GB, 79.67 GB, 86.74 GB, 92.90 GB, 99.23 GB, 105.87 GB, 112.63 GB, 118.78 GB, 124.97 GB, 131.08 GB, 135.43 GB, 140.19 GB, 145.82 GB, 150.49 GB, 153.76 GB, 157.85 GB, 152.19 GB, 155.47 GB, 155.86 GB, 157.94 GB, 153.50 GB, 151.26 GB, 153.63 GB, 155.53 GB, 151.62 GB, 152.73 GB, 149.50 GB, 152.75 GB, 153.16 GB ThreadUsage(16s000ms): 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.03 - BloomFilterBytes: 49.00 MB (51380224) - PeakMemoryUsage: 160.99 GB (172863740133) - PerHostPeakMemUsage: 169.55 GB (182057958244) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 1m36s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 1.42K (1419) - TotalThreadsTotalWallClockTime: 21s907ms - TotalThreadsSysTime: 2s169ms - TotalThreadsUserTime: 8s190ms - TotalThreadsVoluntaryContextSwitches: 22.59K (22595) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 54.310ms - ExecTreePrepareTime: 596.702us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 23.84K (23839) - BlocksRecycled: 354 (354) - BufferedPins: 0 (0) - BytesWritten: 40.11 GB (43067113472) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 161.38 GB (173283483648) - ScratchFileUsedBytes: 40.11 GB (43067113472) - TotalBufferWaitTime: 9s379ms - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=28):(Total: 756.172us, non-child: 756.172us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.05 MB (1105280) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 616.899ms, non-child: 616.899ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 195.715ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 122 (122) - NumInstructions: 8.95K (8951) - OptimizationTime: 398.195ms - PeakMemoryUsage: 4.37 MB (4582912) - PrepareTime: 22.375ms HASH_JOIN_NODE (id=15):(Total: 1.124ms, non-child: 890.203us, % non-child: 79.14%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 451.92K (451915) - BuildTime: 141.615ms - PeakMemoryUsage: 153.09 MB (160524544) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=15): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 99.361ms - BuildRowsPartitioned: 451.92K (451915) - GetNewBlockTime: 472.651us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 38.926ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160449664) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=26):(Total: 2s096ms, non-child: 25.981ms, % non-child: 1.24%) BytesReceived(16s000ms): 5.40 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB - BytesReceived: 6.21 MB (6513198) - ConvertRowBatchTime: 12.459ms - DeserializeRowBatchTimer: 50.889ms - FirstBatchArrivalWaitTime: 1s222ms - PeakMemoryUsage: 0 - RowsReturned: 451.92K (451915) - RowsReturnedRate: 215.61 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=14):(Total: 875.275us, non-child: 886.075us, % non-child: 100.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 458.56K (458561) - BuildTime: 170.657ms - PeakMemoryUsage: 25.08 MB (26298624) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 107.753ms - BuildRowsPartitioned: 458.56K (458561) - GetNewBlockTime: 230.736us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 26.387ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 25.02 MB (26231936) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 4s106ms, non-child: 17.291ms, % non-child: 0.42%) BytesReceived(16s000ms): 5.83 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB - BytesReceived: 7.33 MB (7681300) - ConvertRowBatchTime: 12.701ms - DeserializeRowBatchTimer: 17.298ms - FirstBatchArrivalWaitTime: 2s128ms - PeakMemoryUsage: 0 - RowsReturned: 458.56K (458561) - RowsReturnedRate: 111.66 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=13):(Total: 622.732us, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 3.95B (3952753355) - BuildTime: 6m44s - PeakMemoryUsage: 157.70 GB (169333590240) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled, Spilled Runtime filters: 0 of 1 Runtime Filter Published, 1 Disabled - BuildRowsPartitionTime: 6m44s - BuildRowsPartitioned: 3.95B (3952753355) - GetNewBlockTime: 51s424ms - HashBuckets: 536.87M (536870912) - HashCollisions: 0 (0) - HashTablesBuildTime: 29s875ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 157.70 GB (169333499008) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 4 (4) - UnpinTime: 307.082ms HASH_JOIN_NODE (id=12):(Total: 2m41s, non-child: 1m11s, % non-child: 44.36%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 40.16M (40164926) - BuildTime: 8s519ms - PeakMemoryUsage: 3.02 GB (3240189246) - ProbeRows: 74.75M (74754502) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1m2s - RowsReturned: 3.95B (3952753355) - RowsReturnedRate: 24.51 M/sec Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 5s586ms - BuildRowsPartitioned: 40.16M (40164926) - GetNewBlockTime: 3.633ms - HashBuckets: 67.11M (67108864) - HashCollisions: 0 (0) - HashTablesBuildTime: 2s884ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 3.02 GB (3240125568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 6s769ms, non-child: 1s701ms, % non-child: 25.13%) BytesReceived(16s000ms): 213.14 MB, 380.38 MB, 380.38 MB, 380.38 MB, 380.38 MB, 380.38 MB, 380.38 MB, 380.38 MB, 380.38 MB, 380.38 MB, 380.38 MB, 380.38 MB, 380.38 MB, 380.38 MB, 380.38 MB, 380.38 MB, 380.38 MB, 380.38 MB, 380.38 MB, 380.38 MB, 380.38 MB, 380.38 MB, 380.38 MB, 380.38 MB, 380.38 MB, 380.38 MB, 380.38 MB, 380.38 MB, 380.38 MB, 380.38 MB, 380.38 MB, 380.38 MB, 380.38 MB, 380.38 MB, 380.38 MB, 380.38 MB, 380.38 MB, 380.38 MB, 380.38 MB, 380.38 MB - BytesReceived: 380.38 MB (398853239) - ConvertRowBatchTime: 976.061ms - DeserializeRowBatchTimer: 1s742ms - FirstBatchArrivalWaitTime: 1s141ms - PeakMemoryUsage: 0 - RowsReturned: 40.16M (40164926) - RowsReturnedRate: 5.93 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=22):(Total: 1m23s, non-child: 1s308ms, % non-child: 1.56%) BytesReceived(16s000ms): 2.15 MB, 15.42 MB, 41.63 MB, 67.00 MB, 93.26 MB, 119.71 MB, 146.43 MB, 173.16 MB, 198.31 MB, 223.51 MB, 248.68 MB, 275.83 MB, 302.30 MB, 328.22 MB, 352.02 MB, 378.80 MB, 403.97 MB, 430.88 MB, 453.63 MB, 479.14 MB, 501.52 MB, 518.51 MB, 537.28 MB, 559.49 MB, 577.27 MB, 589.60 MB, 609.18 MB, 624.95 MB, 638.26 MB, 642.80 MB, 651.45 MB, 664.29 MB, 669.48 MB, 678.35 MB, 686.88 MB, 691.87 MB, 691.87 MB, 691.87 MB, 691.87 MB, 691.87 MB - BytesReceived: 691.87 MB (725482104) - ConvertRowBatchTime: 846.755ms - DeserializeRowBatchTimer: 5s512ms - FirstBatchArrivalWaitTime: 808.176ms - PeakMemoryUsage: 0 - RowsReturned: 74.75M (74754502) - RowsReturnedRate: 892.53 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=24):(Total: 1s760ms, non-child: 3.659us, % non-child: 0.00%) BytesReceived(16s000ms): 8.46 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.11 MB, 10.17 MB, 10.17 MB - BytesReceived: 10.17 MB (10666324) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 75.138ms - FirstBatchArrivalWaitTime: 1s760ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:34e (host=ve1139.foo:22000):(Total: 54.352ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 994.57 MB, 6.99 GB, 14.34 GB, 20.99 GB, 27.86 GB, 34.69 GB, 41.61 GB, 48.53 GB, 55.03 GB, 61.50 GB, 67.86 GB, 74.45 GB, 81.34 GB, 87.92 GB, 94.05 GB, 100.97 GB, 107.60 GB, 114.49 GB, 120.34 GB, 126.63 GB, 132.90 GB, 137.35 GB, 141.98 GB, 147.83 GB, 152.64 GB, 155.81 GB, 154.72 GB, 153.86 GB, 157.27 GB, 157.77 GB, 156.63 GB, 151.47 GB, 152.06 GB, 155.25 GB, 156.67 GB, 155.55 GB, 154.08 GB, 155.50 GB, 156.92 GB, 154.05 GB ThreadUsage(16s000ms): 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.03 - BloomFilterBytes: 49.00 MB (51380224) - PeakMemoryUsage: 160.60 GB (172437617743) - PerHostPeakMemUsage: 169.57 GB (182077340353) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 1m59s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 1.48K (1477) - TotalThreadsTotalWallClockTime: 22s536ms - TotalThreadsSysTime: 2s116ms - TotalThreadsUserTime: 8s000ms - TotalThreadsVoluntaryContextSwitches: 23.93K (23934) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 54.307ms - ExecTreePrepareTime: 632.873us DataStreamSender (dst_id=28):(Total: 1.010ms, non-child: 1.010ms, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.05 MB (1105280) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 609.294ms, non-child: 609.294ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 200.580ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 122 (122) - NumInstructions: 8.95K (8951) - OptimizationTime: 384.209ms - PeakMemoryUsage: 4.37 MB (4582912) - PrepareTime: 24.071ms HASH_JOIN_NODE (id=15):(Total: 1.189ms, non-child: 905.848us, % non-child: 76.16%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 451.92K (451915) - BuildTime: 134.188ms - PeakMemoryUsage: 153.09 MB (160524544) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=15): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 100.345ms - BuildRowsPartitioned: 451.92K (451915) - GetNewBlockTime: 347.331us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 31.113ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160449664) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=26):(Total: 2s066ms, non-child: 26.080ms, % non-child: 1.26%) BytesReceived(16s000ms): 5.51 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB - BytesReceived: 6.21 MB (6513198) - ConvertRowBatchTime: 12.566ms - DeserializeRowBatchTimer: 51.815ms - FirstBatchArrivalWaitTime: 1s208ms - PeakMemoryUsage: 0 - RowsReturned: 451.92K (451915) - RowsReturnedRate: 218.65 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=14):(Total: 892.081us, non-child: 936.109us, % non-child: 100.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 457.97K (457967) - BuildTime: 158.453ms - PeakMemoryUsage: 25.08 MB (26298624) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 90.742ms - BuildRowsPartitioned: 457.97K (457967) - GetNewBlockTime: 298.155us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 26.587ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 25.02 MB (26231936) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 4s179ms, non-child: 15.470ms, % non-child: 0.37%) BytesReceived(16s000ms): 5.99 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB - BytesReceived: 7.32 MB (7671886) - ConvertRowBatchTime: 11.951ms - DeserializeRowBatchTimer: 17.226ms - FirstBatchArrivalWaitTime: 2s121ms - PeakMemoryUsage: 0 - RowsReturned: 457.97K (457967) - RowsReturnedRate: 109.58 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=13):(Total: 554.440us, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 4.02B (4023929856) - BuildTime: 6m25s - PeakMemoryUsage: 158.54 GB (170231761152) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled, Spilled Runtime filters: 0 of 1 Runtime Filter Published, 1 Disabled - BuildRowsPartitionTime: 6m24s - BuildRowsPartitioned: 4.02B (4023929856) - GetNewBlockTime: 1m10s - HashBuckets: 536.87M (536870912) - HashCollisions: 0 (0) - HashTablesBuildTime: 54s317ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 158.54 GB (170231702656) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 4 (4) - UnpinTime: 143.687ms HASH_JOIN_NODE (id=12):(Total: 3m8s, non-child: 1m15s, % non-child: 40.19%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 40.12M (40120706) - BuildTime: 8s530ms - PeakMemoryUsage: 3.02 GB (3240192224) - ProbeRows: 75.80M (75802981) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1m6s - RowsReturned: 4.02B (4023929856) - RowsReturnedRate: 21.35 M/sec Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 5s400ms - BuildRowsPartitioned: 40.12M (40120706) - GetNewBlockTime: 5.041ms - HashBuckets: 67.11M (67108864) - HashCollisions: 0 (0) - HashTablesBuildTime: 3s087ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 3.02 GB (3240125568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 7s381ms, non-child: 1s619ms, % non-child: 21.94%) BytesReceived(16s000ms): 218.11 MB, 379.96 MB, 379.96 MB, 379.96 MB, 379.96 MB, 379.96 MB, 379.96 MB, 379.96 MB, 379.96 MB, 379.96 MB, 379.96 MB, 379.96 MB, 379.96 MB, 379.96 MB, 379.96 MB, 379.96 MB, 379.96 MB, 379.96 MB, 379.96 MB, 379.96 MB, 379.96 MB, 379.96 MB, 379.96 MB, 379.96 MB, 379.96 MB, 379.96 MB, 379.96 MB, 379.96 MB, 379.96 MB, 379.96 MB, 379.96 MB, 379.96 MB, 379.96 MB, 379.96 MB, 379.96 MB, 379.96 MB, 379.96 MB, 379.96 MB, 379.96 MB, 379.96 MB - BytesReceived: 379.96 MB (398414645) - ConvertRowBatchTime: 952.539ms - DeserializeRowBatchTimer: 1s633ms - FirstBatchArrivalWaitTime: 1s136ms - PeakMemoryUsage: 0 - RowsReturned: 40.12M (40120706) - RowsReturnedRate: 5.44 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=22):(Total: 1m46s, non-child: 1s897ms, % non-child: 1.79%) BytesReceived(16s000ms): 2.22 MB, 16.08 MB, 42.79 MB, 68.73 MB, 95.50 MB, 122.17 MB, 149.20 MB, 176.26 MB, 201.87 MB, 227.25 MB, 252.26 MB, 278.01 MB, 304.73 MB, 330.95 MB, 355.15 MB, 382.23 MB, 407.84 MB, 435.16 MB, 458.31 MB, 483.43 MB, 506.77 MB, 523.80 MB, 542.56 MB, 565.13 MB, 583.41 MB, 595.87 MB, 615.61 MB, 631.90 MB, 646.16 MB, 650.72 MB, 659.41 MB, 672.51 MB, 678.22 MB, 686.81 MB, 697.01 MB, 701.47 MB, 701.47 MB, 701.47 MB, 701.47 MB, 701.47 MB - BytesReceived: 701.47 MB (735545231) - ConvertRowBatchTime: 918.443ms - DeserializeRowBatchTimer: 8s771ms - FirstBatchArrivalWaitTime: 790.635ms - PeakMemoryUsage: 0 - RowsReturned: 75.80M (75802981) - RowsReturnedRate: 714.21 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=24):(Total: 1s741ms, non-child: 3.590us, % non-child: 0.00%) BytesReceived(16s000ms): 8.44 MB, 9.97 MB, 9.97 MB, 9.97 MB, 9.97 MB, 9.97 MB, 9.97 MB, 9.97 MB, 9.97 MB, 9.97 MB, 9.97 MB, 9.97 MB, 9.97 MB, 9.97 MB, 9.97 MB, 9.97 MB, 9.97 MB, 9.97 MB, 9.97 MB, 9.97 MB, 9.97 MB, 9.97 MB, 9.97 MB, 9.97 MB, 9.97 MB, 9.97 MB, 9.97 MB, 9.97 MB, 9.97 MB, 9.97 MB, 9.97 MB, 9.97 MB, 9.97 MB, 9.97 MB, 9.97 MB, 9.97 MB, 9.97 MB, 9.97 MB, 9.97 MB, 9.97 MB - BytesReceived: 9.97 MB (10459331) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 71.040ms - FirstBatchArrivalWaitTime: 1s741ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:30a (host=vd1130.foo:22000):(Total: 54.147ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 1.03 GB, 7.24 GB, 14.16 GB, 20.74 GB, 27.59 GB, 34.53 GB, 41.44 GB, 48.32 GB, 54.76 GB, 61.25 GB, 67.58 GB, 74.12 GB, 80.99 GB, 87.59 GB, 93.83 GB, 100.68 GB, 107.26 GB, 114.00 GB, 120.19 GB, 126.54 GB, 132.77 GB, 137.04 GB, 141.77 GB, 147.50 GB, 152.23 GB, 155.53 GB, 156.96 GB, 154.45 GB, 157.42 GB, 158.15 GB, 155.90 GB, 152.27 GB, 153.02 GB, 155.55 GB, 157.25 GB, 153.35 GB, 152.56 GB, 155.59 GB, 153.56 GB, 156.90 GB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.03 - BloomFilterBytes: 49.00 MB (51380224) - PeakMemoryUsage: 160.99 GB (172864992575) - PerHostPeakMemUsage: 169.56 GB (182062973292) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 1m59s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 1.33K (1334) - TotalThreadsTotalWallClockTime: 21s542ms - TotalThreadsSysTime: 2s060ms - TotalThreadsUserTime: 7s636ms - TotalThreadsVoluntaryContextSwitches: 24.42K (24419) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 54.097ms - ExecTreePrepareTime: 609.640us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 24.49K (24491) - BlocksRecycled: 354 (354) - BufferedPins: 0 (0) - BytesWritten: 53.18 GB (57101254656) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 161.38 GB (173283483648) - ScratchFileUsedBytes: 53.18 GB (57101254656) - TotalBufferWaitTime: 9s104ms - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=28):(Total: 712.318us, non-child: 712.318us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.05 MB (1105280) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 616.262ms, non-child: 616.262ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 200.352ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 122 (122) - NumInstructions: 8.95K (8951) - OptimizationTime: 390.946ms - PeakMemoryUsage: 4.37 MB (4582912) - PrepareTime: 24.454ms HASH_JOIN_NODE (id=15):(Total: 1.148ms, non-child: 958.714us, % non-child: 83.46%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 451.92K (451915) - BuildTime: 137.569ms - PeakMemoryUsage: 153.09 MB (160524544) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=15): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 101.149ms - BuildRowsPartitioned: 451.92K (451915) - GetNewBlockTime: 473.653us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 33.386ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160449664) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=26):(Total: 2s079ms, non-child: 24.200ms, % non-child: 1.16%) BytesReceived(16s000ms): 5.43 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB - BytesReceived: 6.21 MB (6513198) - ConvertRowBatchTime: 11.983ms - DeserializeRowBatchTimer: 50.126ms - FirstBatchArrivalWaitTime: 1s220ms - PeakMemoryUsage: 0 - RowsReturned: 451.92K (451915) - RowsReturnedRate: 217.31 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=14):(Total: 903.215us, non-child: 907.104us, % non-child: 100.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 459.51K (459514) - BuildTime: 167.658ms - PeakMemoryUsage: 25.08 MB (26298624) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 102.240ms - BuildRowsPartitioned: 459.51K (459514) - GetNewBlockTime: 190.454us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 28.638ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 25.02 MB (26231936) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 4s125ms, non-child: 15.917ms, % non-child: 0.39%) BytesReceived(16s000ms): 5.90 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB - BytesReceived: 7.34 MB (7696308) - ConvertRowBatchTime: 12.380ms - DeserializeRowBatchTimer: 16.737ms - FirstBatchArrivalWaitTime: 2s132ms - PeakMemoryUsage: 0 - RowsReturned: 459.51K (459514) - RowsReturnedRate: 111.39 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=13):(Total: 602.977us, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 4.01B (4009398283) - BuildTime: 6m18s - PeakMemoryUsage: 158.96 GB (170676947200) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled, Spilled Runtime filters: 0 of 1 Runtime Filter Published, 1 Disabled - BuildRowsPartitionTime: 6m18s - BuildRowsPartitioned: 4.01B (4009398283) - GetNewBlockTime: 48s874ms - HashBuckets: 1.07B (1073741824) - HashCollisions: 0 (0) - HashTablesBuildTime: 44s183ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 158.96 GB (170676888704) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 5 (5) - UnpinTime: 252.682ms HASH_JOIN_NODE (id=12):(Total: 3m10s, non-child: 1m17s, % non-child: 40.84%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 40.15M (40154924) - BuildTime: 7s907ms - PeakMemoryUsage: 3.02 GB (3240188128) - ProbeRows: 76.42M (76422870) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1m9s - RowsReturned: 4.01B (4009398283) - RowsReturnedRate: 21.02 M/sec Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 5s355ms - BuildRowsPartitioned: 40.15M (40154924) - GetNewBlockTime: 3.164ms - HashBuckets: 67.11M (67108864) - HashCollisions: 0 (0) - HashTablesBuildTime: 2s508ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 3.02 GB (3240125568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 7s043ms, non-child: 1s564ms, % non-child: 22.22%) BytesReceived(16s000ms): 214.56 MB, 380.27 MB, 380.27 MB, 380.27 MB, 380.27 MB, 380.27 MB, 380.27 MB, 380.27 MB, 380.27 MB, 380.27 MB, 380.27 MB, 380.27 MB, 380.27 MB, 380.27 MB, 380.27 MB, 380.27 MB, 380.27 MB, 380.27 MB, 380.27 MB, 380.27 MB, 380.27 MB, 380.27 MB, 380.27 MB, 380.27 MB, 380.27 MB, 380.27 MB, 380.27 MB, 380.27 MB, 380.27 MB, 380.27 MB, 380.27 MB, 380.27 MB, 380.27 MB, 380.27 MB, 380.27 MB, 380.27 MB, 380.27 MB, 380.27 MB, 380.27 MB, 380.27 MB - BytesReceived: 380.27 MB (398747116) - ConvertRowBatchTime: 918.310ms - DeserializeRowBatchTimer: 1s639ms - FirstBatchArrivalWaitTime: 1s143ms - PeakMemoryUsage: 0 - RowsReturned: 40.15M (40154924) - RowsReturnedRate: 5.70 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=22):(Total: 1m46s, non-child: 1s214ms, % non-child: 1.14%) BytesReceived(16s000ms): 2.19 MB, 15.85 MB, 42.70 MB, 68.72 MB, 96.02 MB, 123.21 MB, 150.54 MB, 177.76 MB, 203.44 MB, 229.10 MB, 254.33 MB, 280.33 MB, 307.26 MB, 333.85 MB, 358.38 MB, 385.75 MB, 411.64 MB, 439.22 MB, 462.67 MB, 488.17 MB, 511.76 MB, 528.87 MB, 547.96 MB, 570.44 MB, 588.91 MB, 601.53 MB, 621.60 MB, 641.48 MB, 653.35 MB, 658.27 MB, 667.87 MB, 680.52 MB, 685.28 MB, 695.32 MB, 703.80 MB, 707.54 MB, 707.54 MB, 707.54 MB, 707.54 MB, 707.54 MB - BytesReceived: 707.54 MB (741906439) - ConvertRowBatchTime: 793.077ms - DeserializeRowBatchTimer: 6s735ms - FirstBatchArrivalWaitTime: 813.799ms - PeakMemoryUsage: 0 - RowsReturned: 76.42M (76422870) - RowsReturnedRate: 716.87 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=24):(Total: 1s733ms, non-child: 4.210us, % non-child: 0.00%) BytesReceived(16s000ms): 8.83 MB, 10.46 MB, 10.46 MB, 10.46 MB, 10.46 MB, 10.46 MB, 10.46 MB, 10.46 MB, 10.46 MB, 10.46 MB, 10.46 MB, 10.46 MB, 10.46 MB, 10.46 MB, 10.46 MB, 10.46 MB, 10.46 MB, 10.46 MB, 10.46 MB, 10.46 MB, 10.46 MB, 10.46 MB, 10.46 MB, 10.46 MB, 10.46 MB, 10.46 MB, 10.46 MB, 10.46 MB, 10.46 MB, 10.46 MB, 10.46 MB, 10.46 MB, 10.46 MB, 10.46 MB, 10.46 MB, 10.46 MB, 10.46 MB, 10.48 MB, 10.50 MB, 10.56 MB - BytesReceived: 10.73 MB (11254309) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 69.718ms - FirstBatchArrivalWaitTime: 1s733ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:2e6 (host=vd1114.foo:22000):(Total: 53.858ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 1.07 GB, 7.36 GB, 14.24 GB, 20.82 GB, 27.64 GB, 34.50 GB, 41.46 GB, 48.39 GB, 54.89 GB, 61.42 GB, 67.69 GB, 74.22 GB, 80.99 GB, 87.56 GB, 93.69 GB, 100.64 GB, 107.06 GB, 113.73 GB, 119.81 GB, 126.40 GB, 132.37 GB, 136.43 GB, 142.37 GB, 148.06 GB, 152.49 GB, 155.70 GB, 156.99 GB, 153.91 GB, 156.82 GB, 158.01 GB, 158.53 GB, 151.67 GB, 152.99 GB, 155.18 GB, 157.02 GB, 152.36 GB, 151.34 GB, 156.14 GB, 154.89 GB, 147.00 GB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.03 - BloomFilterBytes: 49.00 MB (51380224) - PeakMemoryUsage: 161.01 GB (172882928107) - PerHostPeakMemUsage: 169.50 GB (181998655423) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 2m46s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 1.56K (1563) - TotalThreadsTotalWallClockTime: 21s564ms - TotalThreadsSysTime: 2s066ms - TotalThreadsUserTime: 7s799ms - TotalThreadsVoluntaryContextSwitches: 22.61K (22608) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 53.801ms - ExecTreePrepareTime: 521.039us BlockMgr: - BlockWritesOutstanding: 15 (15) - BlocksCreated: 24.40K (24402) - BlocksRecycled: 1.07K (1071) - BufferedPins: 0 (0) - BytesWritten: 47.21 GB (50692358144) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 161.38 GB (173283475456) - ScratchFileUsedBytes: 47.21 GB (50692358144) - TotalBufferWaitTime: 10s046ms - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=28):(Total: 651.946us, non-child: 651.946us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.05 MB (1105280) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 612.251ms, non-child: 612.251ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 195.879ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 122 (122) - NumInstructions: 8.95K (8951) - OptimizationTime: 393.887ms - PeakMemoryUsage: 4.37 MB (4582912) - PrepareTime: 21.927ms HASH_JOIN_NODE (id=15):(Total: 986.466us, non-child: 1.017ms, % non-child: 100.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 451.92K (451915) - BuildTime: 133.898ms - PeakMemoryUsage: 153.09 MB (160524544) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=15): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 101.374ms - BuildRowsPartitioned: 451.92K (451915) - GetNewBlockTime: 466.821us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 29.587ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160449664) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=26):(Total: 2s100ms, non-child: 24.730ms, % non-child: 1.18%) BytesReceived(16s000ms): 5.50 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB - BytesReceived: 6.21 MB (6513198) - ConvertRowBatchTime: 12.051ms - DeserializeRowBatchTimer: 50.232ms - FirstBatchArrivalWaitTime: 1s231ms - PeakMemoryUsage: 0 - RowsReturned: 451.92K (451915) - RowsReturnedRate: 215.19 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=14):(Total: 773.205us, non-child: 794.479us, % non-child: 100.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 459.32K (459317) - BuildTime: 164.791ms - PeakMemoryUsage: 25.08 MB (26298624) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 98.878ms - BuildRowsPartitioned: 459.32K (459317) - GetNewBlockTime: 104.830us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 25.409ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 25.02 MB (26231936) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 4s107ms, non-child: 15.220ms, % non-child: 0.37%) BytesReceived(16s000ms): 6.03 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB - BytesReceived: 7.34 MB (7693980) - ConvertRowBatchTime: 11.611ms - DeserializeRowBatchTimer: 14.926ms - FirstBatchArrivalWaitTime: 2s139ms - PeakMemoryUsage: 0 - RowsReturned: 459.32K (459317) - RowsReturnedRate: 111.81 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=13):(Total: 553.301us, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 4.00B (3995491272) - BuildTime: 5m29s - PeakMemoryUsage: 160.56 GB (172396611840) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled, Spilled Runtime filters: 0 of 1 Runtime Filter Published, 1 Disabled - BuildRowsPartitionTime: 5m28s - BuildRowsPartitioned: 4.00B (3995491272) - GetNewBlockTime: 24s312ms - HashBuckets: 1.07B (1073741824) - HashCollisions: 0 (0) - HashTablesBuildTime: 1m12s - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 160.56 GB (172396553344) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 5 (5) - UnpinTime: 4s090ms HASH_JOIN_NODE (id=12):(Total: 3m53s, non-child: 1m13s, % non-child: 31.62%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 40.14M (40144326) - BuildTime: 8s180ms - PeakMemoryUsage: 3.02 GB (3240188294) - ProbeRows: 75.73M (75727900) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1m4s - RowsReturned: 4.00B (3995491272) - RowsReturnedRate: 17.12 M/sec Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 5s573ms - BuildRowsPartitioned: 40.14M (40144326) - GetNewBlockTime: 3.659ms - HashBuckets: 67.11M (67108864) - HashCollisions: 0 (0) - HashTablesBuildTime: 2s560ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 3.02 GB (3240125568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 6s794ms, non-child: 1s418ms, % non-child: 20.88%) BytesReceived(16s000ms): 217.72 MB, 380.18 MB, 380.18 MB, 380.18 MB, 380.18 MB, 380.18 MB, 380.18 MB, 380.18 MB, 380.18 MB, 380.18 MB, 380.18 MB, 380.18 MB, 380.18 MB, 380.18 MB, 380.18 MB, 380.18 MB, 380.18 MB, 380.18 MB, 380.18 MB, 380.18 MB, 380.18 MB, 380.18 MB, 380.18 MB, 380.18 MB, 380.18 MB, 380.18 MB, 380.18 MB, 380.18 MB, 380.18 MB, 380.18 MB, 380.18 MB, 380.18 MB, 380.18 MB, 380.18 MB, 380.18 MB, 380.18 MB, 380.18 MB, 380.18 MB, 380.18 MB, 380.18 MB - BytesReceived: 380.18 MB (398642983) - ConvertRowBatchTime: 894.505ms - DeserializeRowBatchTimer: 1s475ms - FirstBatchArrivalWaitTime: 1s155ms - PeakMemoryUsage: 0 - RowsReturned: 40.14M (40144326) - RowsReturnedRate: 5.91 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=22):(Total: 2m33s, non-child: 1s321ms, % non-child: 0.86%) BytesReceived(16s000ms): 2.12 MB, 15.90 MB, 42.86 MB, 68.76 MB, 95.63 MB, 122.61 MB, 149.92 MB, 177.26 MB, 203.00 MB, 228.57 MB, 253.42 MB, 279.16 MB, 305.74 MB, 331.92 MB, 356.13 MB, 383.21 MB, 408.75 MB, 435.90 MB, 459.00 MB, 484.23 MB, 507.47 MB, 525.09 MB, 547.54 MB, 569.87 MB, 586.59 MB, 599.48 MB, 619.96 MB, 635.69 MB, 647.50 MB, 652.43 MB, 661.92 MB, 674.51 MB, 679.25 MB, 689.29 MB, 697.79 MB, 701.51 MB, 701.51 MB, 701.51 MB, 701.51 MB, 701.51 MB - BytesReceived: 701.51 MB (735591155) - ConvertRowBatchTime: 825.143ms - DeserializeRowBatchTimer: 12s422ms - FirstBatchArrivalWaitTime: 829.546ms - PeakMemoryUsage: 0 - RowsReturned: 75.73M (75727900) - RowsReturnedRate: 493.04 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=24):(Total: 1s756ms, non-child: 18.423us, % non-child: 0.00%) BytesReceived(16s000ms): 8.79 MB, 10.40 MB, 10.40 MB, 10.40 MB, 10.40 MB, 10.40 MB, 10.40 MB, 10.40 MB, 10.40 MB, 10.40 MB, 10.40 MB, 10.40 MB, 10.40 MB, 10.40 MB, 10.40 MB, 10.40 MB, 10.40 MB, 10.40 MB, 10.40 MB, 10.40 MB, 10.40 MB, 10.40 MB, 10.40 MB, 10.40 MB, 10.40 MB, 10.40 MB, 10.40 MB, 10.40 MB, 10.40 MB, 10.40 MB, 10.40 MB, 10.40 MB, 10.40 MB, 10.40 MB, 10.40 MB, 10.40 MB, 10.40 MB, 10.46 MB, 10.60 MB, 10.60 MB - BytesReceived: 10.63 MB (11143304) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 75.105ms - FirstBatchArrivalWaitTime: 1s756ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:2fe (host=ve1132.foo:22000):(Total: 53.628ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 1.04 GB, 7.35 GB, 14.25 GB, 20.90 GB, 27.71 GB, 34.53 GB, 41.39 GB, 48.22 GB, 54.62 GB, 61.12 GB, 67.41 GB, 73.91 GB, 80.71 GB, 87.31 GB, 93.34 GB, 100.06 GB, 106.56 GB, 113.01 GB, 119.35 GB, 125.68 GB, 131.96 GB, 136.41 GB, 142.03 GB, 147.88 GB, 152.41 GB, 155.66 GB, 155.46 GB, 153.46 GB, 156.62 GB, 157.33 GB, 156.40 GB, 151.12 GB, 152.11 GB, 154.41 GB, 155.82 GB, 154.14 GB, 152.94 GB, 154.50 GB, 149.33 GB, 149.09 GB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.03 - BloomFilterBytes: 49.00 MB (51380224) - PeakMemoryUsage: 160.60 GB (172445929711) - PerHostPeakMemUsage: 169.57 GB (182073146432) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 1m47s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 1.37K (1373) - TotalThreadsTotalWallClockTime: 21s611ms - TotalThreadsSysTime: 2s243ms - TotalThreadsUserTime: 7s767ms - TotalThreadsVoluntaryContextSwitches: 23.54K (23540) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 53.566ms - ExecTreePrepareTime: 879.773us DataStreamSender (dst_id=28):(Total: 1.520ms, non-child: 1.520ms, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.05 MB (1105280) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 632.004ms, non-child: 632.004ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 205.403ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 122 (122) - NumInstructions: 8.95K (8951) - OptimizationTime: 408.000ms - PeakMemoryUsage: 4.37 MB (4582912) - PrepareTime: 18.161ms HASH_JOIN_NODE (id=15):(Total: 1.655ms, non-child: 1.089ms, % non-child: 65.83%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 451.92K (451915) - BuildTime: 134.111ms - PeakMemoryUsage: 153.09 MB (160524544) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=15): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 102.400ms - BuildRowsPartitioned: 451.92K (451915) - GetNewBlockTime: 389.110us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 28.933ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160449664) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=26):(Total: 2s059ms, non-child: 26.634ms, % non-child: 1.29%) BytesReceived(16s000ms): 5.47 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB - BytesReceived: 6.21 MB (6513198) - ConvertRowBatchTime: 13.049ms - DeserializeRowBatchTimer: 53.800ms - FirstBatchArrivalWaitTime: 1s202ms - PeakMemoryUsage: 0 - RowsReturned: 451.92K (451915) - RowsReturnedRate: 219.39 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=14):(Total: 1.275ms, non-child: 898.258us, % non-child: 70.43%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 461.06K (461062) - BuildTime: 148.126ms - PeakMemoryUsage: 25.08 MB (26298624) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 87.110ms - BuildRowsPartitioned: 461.06K (461062) - GetNewBlockTime: 311.641us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 25.363ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 25.02 MB (26231936) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 4s108ms, non-child: 14.635ms, % non-child: 0.36%) BytesReceived(16s000ms): 6.00 MB, 7.36 MB, 7.36 MB, 7.36 MB, 7.36 MB, 7.36 MB, 7.36 MB, 7.36 MB, 7.36 MB, 7.36 MB, 7.36 MB, 7.36 MB, 7.36 MB, 7.36 MB, 7.36 MB, 7.36 MB, 7.36 MB, 7.36 MB, 7.36 MB, 7.36 MB, 7.36 MB, 7.36 MB, 7.36 MB, 7.36 MB, 7.36 MB, 7.36 MB, 7.36 MB, 7.36 MB, 7.36 MB, 7.36 MB, 7.36 MB, 7.36 MB, 7.36 MB, 7.36 MB, 7.36 MB, 7.36 MB, 7.36 MB, 7.36 MB, 7.36 MB, 7.36 MB - BytesReceived: 7.36 MB (7722040) - ConvertRowBatchTime: 10.979ms - DeserializeRowBatchTimer: 15.463ms - FirstBatchArrivalWaitTime: 2s107ms - PeakMemoryUsage: 0 - RowsReturned: 461.06K (461062) - RowsReturnedRate: 112.23 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=13):(Total: 935.559us, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 4.00B (4001175631) - BuildTime: 6m34s - PeakMemoryUsage: 157.31 GB (168914159840) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled, Spilled Runtime filters: 0 of 1 Runtime Filter Published, 1 Disabled - BuildRowsPartitionTime: 6m34s - BuildRowsPartitioned: 4.00B (4001175631) - GetNewBlockTime: 51s608ms - HashBuckets: 536.87M (536870912) - HashCollisions: 0 (0) - HashTablesBuildTime: 39s947ms - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 157.31 GB (168914068608) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 4 (4) - UnpinTime: 309.792ms HASH_JOIN_NODE (id=12):(Total: 2m57s, non-child: 1m16s, % non-child: 43.01%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 40.28M (40281969) - BuildTime: 8s211ms - PeakMemoryUsage: 3.02 GB (3240188476) - ProbeRows: 75.83M (75828068) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1m7s - RowsReturned: 4.00B (4001175631) - RowsReturnedRate: 22.53 M/sec Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 5s499ms - BuildRowsPartitioned: 40.28M (40281969) - GetNewBlockTime: 3.295ms - HashBuckets: 67.11M (67108864) - HashCollisions: 0 (0) - HashTablesBuildTime: 2s665ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 3.02 GB (3240125568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 6s866ms, non-child: 1s594ms, % non-child: 23.22%) BytesReceived(16s000ms): 217.15 MB, 381.50 MB, 381.50 MB, 381.50 MB, 381.50 MB, 381.50 MB, 381.50 MB, 381.50 MB, 381.50 MB, 381.50 MB, 381.50 MB, 381.50 MB, 381.50 MB, 381.50 MB, 381.50 MB, 381.50 MB, 381.50 MB, 381.50 MB, 381.50 MB, 381.50 MB, 381.50 MB, 381.50 MB, 381.50 MB, 381.50 MB, 381.50 MB, 381.50 MB, 381.50 MB, 381.50 MB, 381.50 MB, 381.50 MB, 381.50 MB, 381.50 MB, 381.50 MB, 381.50 MB, 381.50 MB, 381.50 MB, 381.50 MB, 381.50 MB, 381.50 MB, 381.50 MB - BytesReceived: 381.50 MB (400031319) - ConvertRowBatchTime: 957.874ms - DeserializeRowBatchTimer: 1s652ms - FirstBatchArrivalWaitTime: 1s120ms - PeakMemoryUsage: 0 - RowsReturned: 40.28M (40281969) - RowsReturnedRate: 5.87 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=22):(Total: 1m35s, non-child: 1s377ms, % non-child: 1.45%) BytesReceived(16s000ms): 2.22 MB, 15.92 MB, 42.67 MB, 68.71 MB, 95.46 MB, 122.24 MB, 149.28 MB, 176.29 MB, 201.83 MB, 227.29 MB, 252.35 MB, 278.17 MB, 304.97 MB, 331.09 MB, 355.27 MB, 382.06 MB, 407.47 MB, 434.72 MB, 458.10 MB, 483.44 MB, 507.03 MB, 524.71 MB, 546.55 MB, 569.00 MB, 586.39 MB, 599.04 MB, 619.56 MB, 635.65 MB, 648.03 MB, 652.85 MB, 662.15 MB, 674.98 MB, 679.88 MB, 689.44 MB, 697.93 MB, 702.11 MB, 702.11 MB, 702.11 MB, 702.11 MB, 702.11 MB - BytesReceived: 702.11 MB (736215915) - ConvertRowBatchTime: 879.275ms - DeserializeRowBatchTimer: 5s966ms - FirstBatchArrivalWaitTime: 795.153ms - PeakMemoryUsage: 0 - RowsReturned: 75.83M (75828068) - RowsReturnedRate: 797.04 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=24):(Total: 1s708ms, non-child: 4.556us, % non-child: 0.00%) BytesReceived(16s000ms): 8.70 MB, 10.31 MB, 10.31 MB, 10.31 MB, 10.31 MB, 10.31 MB, 10.31 MB, 10.31 MB, 10.31 MB, 10.31 MB, 10.31 MB, 10.31 MB, 10.31 MB, 10.31 MB, 10.31 MB, 10.31 MB, 10.31 MB, 10.31 MB, 10.31 MB, 10.31 MB, 10.31 MB, 10.31 MB, 10.31 MB, 10.31 MB, 10.31 MB, 10.31 MB, 10.31 MB, 10.31 MB, 10.31 MB, 10.31 MB, 10.31 MB, 10.31 MB, 10.31 MB, 10.31 MB, 10.31 MB, 10.31 MB, 10.31 MB, 10.35 MB, 10.42 MB, 10.43 MB - BytesReceived: 10.60 MB (11117178) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 73.586ms - FirstBatchArrivalWaitTime: 1s708ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:351 (host=vd1102.foo:22000):(Total: 53.560ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 990.29 MB, 7.19 GB, 14.33 GB, 21.01 GB, 28.02 GB, 34.85 GB, 41.76 GB, 48.65 GB, 55.12 GB, 61.64 GB, 67.90 GB, 74.44 GB, 81.30 GB, 87.86 GB, 94.10 GB, 100.95 GB, 107.46 GB, 114.16 GB, 120.50 GB, 126.89 GB, 133.05 GB, 137.19 GB, 142.00 GB, 147.76 GB, 153.09 GB, 156.40 GB, 154.67 GB, 154.32 GB, 157.42 GB, 158.43 GB, 155.16 GB, 152.22 GB, 153.26 GB, 155.43 GB, 156.91 GB, 153.47 GB, 155.70 GB, 155.84 GB, 154.43 GB, 155.76 GB ThreadUsage(16s000ms): 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.03 - BloomFilterBytes: 49.00 MB (51380224) - PeakMemoryUsage: 160.60 GB (172439302159) - PerHostPeakMemUsage: 169.56 GB (182064217136) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 2m3s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 1.65K (1648) - TotalThreadsTotalWallClockTime: 22s069ms - TotalThreadsSysTime: 2s111ms - TotalThreadsUserTime: 7s927ms - TotalThreadsVoluntaryContextSwitches: 21.96K (21965) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 53.520ms - ExecTreePrepareTime: 706.015us DataStreamSender (dst_id=28):(Total: 837.845us, non-child: 837.845us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.05 MB (1105280) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 633.921ms, non-child: 633.921ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 210.527ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 122 (122) - NumInstructions: 8.95K (8951) - OptimizationTime: 402.258ms - PeakMemoryUsage: 4.37 MB (4582912) - PrepareTime: 20.680ms HASH_JOIN_NODE (id=15):(Total: 1.358ms, non-child: 1.104ms, % non-child: 81.27%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 451.92K (451915) - BuildTime: 128.605ms - PeakMemoryUsage: 153.09 MB (160524544) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=15): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 93.730ms - BuildRowsPartitioned: 451.92K (451915) - GetNewBlockTime: 383.863us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 32.168ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160449664) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=26):(Total: 2s047ms, non-child: 24.454ms, % non-child: 1.19%) BytesReceived(16s000ms): 5.43 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB - BytesReceived: 6.21 MB (6513198) - ConvertRowBatchTime: 12.377ms - DeserializeRowBatchTimer: 51.886ms - FirstBatchArrivalWaitTime: 1s182ms - PeakMemoryUsage: 0 - RowsReturned: 451.92K (451915) - RowsReturnedRate: 220.69 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=14):(Total: 972.421us, non-child: 844.555us, % non-child: 86.85%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 460.16K (460158) - BuildTime: 148.652ms - PeakMemoryUsage: 25.08 MB (26298624) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 90.275ms - BuildRowsPartitioned: 460.16K (460158) - GetNewBlockTime: 167.986us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 24.774ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 25.02 MB (26231936) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 4s158ms, non-child: 16.013ms, % non-child: 0.39%) BytesReceived(16s000ms): 5.91 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB - BytesReceived: 7.35 MB (7707583) - ConvertRowBatchTime: 11.950ms - DeserializeRowBatchTimer: 15.664ms - FirstBatchArrivalWaitTime: 2s091ms - PeakMemoryUsage: 0 - RowsReturned: 460.16K (460158) - RowsReturnedRate: 110.66 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=13):(Total: 717.628us, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 4.01B (4014429108) - BuildTime: 6m16s - PeakMemoryUsage: 158.35 GB (170030434560) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled, Spilled Runtime filters: 0 of 1 Runtime Filter Published, 1 Disabled - BuildRowsPartitionTime: 6m15s - BuildRowsPartitioned: 4.01B (4014429108) - GetNewBlockTime: 42s381ms - HashBuckets: 536.87M (536870912) - HashCollisions: 0 (0) - HashTablesBuildTime: 53s783ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 158.35 GB (170030376064) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 4 (4) - UnpinTime: 301.971ms HASH_JOIN_NODE (id=12):(Total: 3m7s, non-child: 1m10s, % non-child: 37.80%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 40.22M (40216058) - BuildTime: 8s299ms - PeakMemoryUsage: 3.02 GB (3240188630) - ProbeRows: 76.28M (76282084) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1m1s - RowsReturned: 4.01B (4014429108) - RowsReturnedRate: 21.44 M/sec Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 5s554ms - BuildRowsPartitioned: 40.22M (40216058) - GetNewBlockTime: 7.173ms - HashBuckets: 67.11M (67108864) - HashCollisions: 0 (0) - HashTablesBuildTime: 2s693ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 3.02 GB (3240125568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 7s189ms, non-child: 1s477ms, % non-child: 20.55%) BytesReceived(16s000ms): 214.93 MB, 380.88 MB, 380.88 MB, 380.88 MB, 380.88 MB, 380.88 MB, 380.88 MB, 380.88 MB, 380.88 MB, 380.88 MB, 380.88 MB, 380.88 MB, 380.88 MB, 380.88 MB, 380.88 MB, 380.88 MB, 380.88 MB, 380.88 MB, 380.88 MB, 380.88 MB, 380.88 MB, 380.88 MB, 380.88 MB, 380.88 MB, 380.88 MB, 380.88 MB, 380.88 MB, 380.88 MB, 380.88 MB, 380.88 MB, 380.88 MB, 380.88 MB, 380.88 MB, 380.88 MB, 380.88 MB, 380.88 MB, 380.88 MB, 380.88 MB, 380.88 MB, 380.88 MB - BytesReceived: 380.88 MB (399382936) - ConvertRowBatchTime: 948.680ms - DeserializeRowBatchTimer: 1s412ms - FirstBatchArrivalWaitTime: 1s111ms - PeakMemoryUsage: 0 - RowsReturned: 40.22M (40216058) - RowsReturnedRate: 5.59 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=22):(Total: 1m50s, non-child: 1s344ms, % non-child: 1.22%) BytesReceived(16s000ms): 2.16 MB, 15.98 MB, 43.14 MB, 69.54 MB, 97.00 MB, 123.93 MB, 151.16 MB, 178.45 MB, 204.24 MB, 229.72 MB, 254.63 MB, 280.46 MB, 307.37 MB, 333.93 MB, 358.33 MB, 385.66 MB, 411.35 MB, 438.82 MB, 462.22 MB, 487.70 MB, 511.12 MB, 528.20 MB, 547.23 MB, 570.38 MB, 590.49 MB, 603.34 MB, 623.86 MB, 639.85 MB, 652.07 MB, 656.97 MB, 666.23 MB, 679.15 MB, 684.02 MB, 693.69 MB, 702.28 MB, 706.39 MB, 706.39 MB, 706.39 MB, 706.39 MB, 706.39 MB - BytesReceived: 706.39 MB (740699341) - ConvertRowBatchTime: 846.577ms - DeserializeRowBatchTimer: 6s844ms - FirstBatchArrivalWaitTime: 769.284ms - PeakMemoryUsage: 0 - RowsReturned: 76.28M (76282084) - RowsReturnedRate: 693.00 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=24):(Total: 1s713ms, non-child: 3.229us, % non-child: 0.00%) BytesReceived(16s000ms): 8.59 MB, 10.18 MB, 10.18 MB, 10.18 MB, 10.18 MB, 10.18 MB, 10.18 MB, 10.18 MB, 10.18 MB, 10.18 MB, 10.18 MB, 10.18 MB, 10.18 MB, 10.18 MB, 10.18 MB, 10.18 MB, 10.18 MB, 10.18 MB, 10.18 MB, 10.18 MB, 10.18 MB, 10.18 MB, 10.18 MB, 10.18 MB, 10.18 MB, 10.18 MB, 10.18 MB, 10.18 MB, 10.18 MB, 10.18 MB, 10.18 MB, 10.18 MB, 10.18 MB, 10.18 MB, 10.18 MB, 10.18 MB, 10.18 MB, 10.21 MB, 10.27 MB, 10.27 MB - BytesReceived: 10.37 MB (10876428) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 66.768ms - FirstBatchArrivalWaitTime: 1s713ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:367 (host=ve1141.foo:22000):(Total: 53.537ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 919.76 MB, 6.86 GB, 14.02 GB, 20.54 GB, 27.45 GB, 34.23 GB, 41.08 GB, 47.92 GB, 54.29 GB, 60.73 GB, 66.95 GB, 73.40 GB, 80.17 GB, 86.64 GB, 92.70 GB, 99.52 GB, 105.91 GB, 112.69 GB, 118.65 GB, 124.82 GB, 130.99 GB, 135.33 GB, 139.87 GB, 145.61 GB, 150.32 GB, 153.48 GB, 156.89 GB, 151.64 GB, 155.05 GB, 155.91 GB, 158.21 GB, 151.94 GB, 150.70 GB, 152.77 GB, 154.42 GB, 150.72 GB, 150.52 GB, 145.04 GB, 151.20 GB, 154.43 GB ThreadUsage(16s000ms): 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.03 - BloomFilterBytes: 49.00 MB (51380224) - PeakMemoryUsage: 160.60 GB (172443333151) - PerHostPeakMemUsage: 169.58 GB (182080120448) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 2m23s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 1.64K (1638) - TotalThreadsTotalWallClockTime: 22s499ms - TotalThreadsSysTime: 2s104ms - TotalThreadsUserTime: 8s035ms - TotalThreadsVoluntaryContextSwitches: 21.96K (21964) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 53.491ms - ExecTreePrepareTime: 534.456us DataStreamSender (dst_id=28):(Total: 794.792us, non-child: 794.792us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.05 MB (1105280) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 623.044ms, non-child: 623.044ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 204.321ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 122 (122) - NumInstructions: 8.95K (8951) - OptimizationTime: 393.948ms - PeakMemoryUsage: 4.37 MB (4582912) - PrepareTime: 24.347ms HASH_JOIN_NODE (id=15):(Total: 1.024ms, non-child: 857.209us, % non-child: 83.66%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 451.92K (451915) - BuildTime: 133.641ms - PeakMemoryUsage: 153.09 MB (160524544) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=15): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 98.321ms - BuildRowsPartitioned: 451.92K (451915) - GetNewBlockTime: 375.034us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 32.488ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160449664) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=26):(Total: 2s056ms, non-child: 26.289ms, % non-child: 1.28%) BytesReceived(16s000ms): 5.38 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB - BytesReceived: 6.21 MB (6513198) - ConvertRowBatchTime: 12.914ms - DeserializeRowBatchTimer: 50.896ms - FirstBatchArrivalWaitTime: 1s192ms - PeakMemoryUsage: 0 - RowsReturned: 451.92K (451915) - RowsReturnedRate: 219.73 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=14):(Total: 785.152us, non-child: 814.148us, % non-child: 100.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 459.94K (459937) - BuildTime: 171.063ms - PeakMemoryUsage: 25.08 MB (26298624) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 96.880ms - BuildRowsPartitioned: 459.94K (459937) - GetNewBlockTime: 173.834us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 28.211ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 25.02 MB (26231936) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 4s172ms, non-child: 15.496ms, % non-child: 0.37%) BytesReceived(16s000ms): 5.83 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB - BytesReceived: 7.35 MB (7703205) - ConvertRowBatchTime: 11.833ms - DeserializeRowBatchTimer: 15.475ms - FirstBatchArrivalWaitTime: 2s098ms - PeakMemoryUsage: 0 - RowsReturned: 459.94K (459937) - RowsReturnedRate: 110.22 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=13):(Total: 564.542us, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 3.96B (3961966897) - BuildTime: 5m54s - PeakMemoryUsage: 158.19 GB (169854863616) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled, Spilled Runtime filters: 0 of 1 Runtime Filter Published, 1 Disabled - BuildRowsPartitionTime: 5m54s - BuildRowsPartitioned: 3.96B (3961966897) - GetNewBlockTime: 31s637ms - HashBuckets: 1.07B (1073741824) - HashCollisions: 0 (0) - HashTablesBuildTime: 1m10s - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 158.19 GB (169854805120) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 5 (5) - UnpinTime: 162.232ms HASH_JOIN_NODE (id=12):(Total: 3m27s, non-child: 1m10s, % non-child: 34.11%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 40.17M (40173368) - BuildTime: 8s335ms - PeakMemoryUsage: 3.02 GB (3240192224) - ProbeRows: 74.70M (74701075) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1m1s - RowsReturned: 3.96B (3961966897) - RowsReturnedRate: 19.11 M/sec Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 5s540ms - BuildRowsPartitioned: 40.17M (40173368) - GetNewBlockTime: 3.225ms - HashBuckets: 67.11M (67108864) - HashCollisions: 0 (0) - HashTablesBuildTime: 2s746ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 3.02 GB (3240125568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 7s537ms, non-child: 1s498ms, % non-child: 19.89%) BytesReceived(16s000ms): 210.50 MB, 380.46 MB, 380.46 MB, 380.46 MB, 380.46 MB, 380.46 MB, 380.46 MB, 380.46 MB, 380.46 MB, 380.46 MB, 380.46 MB, 380.46 MB, 380.46 MB, 380.46 MB, 380.46 MB, 380.46 MB, 380.46 MB, 380.46 MB, 380.46 MB, 380.46 MB, 380.46 MB, 380.46 MB, 380.46 MB, 380.46 MB, 380.46 MB, 380.46 MB, 380.46 MB, 380.46 MB, 380.46 MB, 380.46 MB, 380.46 MB, 380.46 MB, 380.46 MB, 380.46 MB, 380.46 MB, 380.46 MB, 380.46 MB, 380.46 MB, 380.46 MB, 380.46 MB - BytesReceived: 380.46 MB (398943732) - ConvertRowBatchTime: 976.115ms - DeserializeRowBatchTimer: 1s399ms - FirstBatchArrivalWaitTime: 1s116ms - PeakMemoryUsage: 0 - RowsReturned: 40.17M (40173368) - RowsReturnedRate: 5.33 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=22):(Total: 2m9s, non-child: 1s277ms, % non-child: 0.98%) BytesReceived(16s000ms): 2.17 MB, 15.28 MB, 41.58 MB, 67.34 MB, 94.11 MB, 120.63 MB, 147.44 MB, 174.08 MB, 199.32 MB, 224.38 MB, 248.96 MB, 274.18 MB, 300.48 MB, 326.34 MB, 350.22 MB, 376.84 MB, 402.05 MB, 428.99 MB, 451.81 MB, 476.63 MB, 499.67 MB, 516.46 MB, 534.96 MB, 557.15 MB, 575.11 MB, 587.53 MB, 607.09 MB, 623.31 MB, 637.35 MB, 641.83 MB, 650.31 MB, 663.13 MB, 668.80 MB, 677.17 MB, 685.91 MB, 691.51 MB, 691.52 MB, 691.52 MB, 691.52 MB, 691.52 MB - BytesReceived: 691.52 MB (725108427) - ConvertRowBatchTime: 823.303ms - DeserializeRowBatchTimer: 7s904ms - FirstBatchArrivalWaitTime: 790.171ms - PeakMemoryUsage: 0 - RowsReturned: 74.70M (74701075) - RowsReturnedRate: 575.12 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=24):(Total: 1s720ms, non-child: 3.538us, % non-child: 0.00%) BytesReceived(16s000ms): 8.57 MB, 10.38 MB, 10.38 MB, 10.38 MB, 10.38 MB, 10.38 MB, 10.38 MB, 10.38 MB, 10.38 MB, 10.38 MB, 10.38 MB, 10.38 MB, 10.38 MB, 10.38 MB, 10.38 MB, 10.38 MB, 10.38 MB, 10.38 MB, 10.38 MB, 10.38 MB, 10.38 MB, 10.38 MB, 10.38 MB, 10.38 MB, 10.38 MB, 10.38 MB, 10.38 MB, 10.38 MB, 10.38 MB, 10.38 MB, 10.38 MB, 10.38 MB, 10.38 MB, 10.38 MB, 10.38 MB, 10.38 MB, 10.38 MB, 10.41 MB, 10.48 MB, 10.51 MB - BytesReceived: 10.76 MB (11287816) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 69.391ms - FirstBatchArrivalWaitTime: 1s720ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:361 (host=ve1127.foo:22000):(Total: 53.395ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 930.92 MB, 6.95 GB, 14.25 GB, 20.95 GB, 27.89 GB, 34.89 GB, 41.96 GB, 48.95 GB, 55.50 GB, 62.10 GB, 68.51 GB, 75.08 GB, 82.08 GB, 88.81 GB, 95.02 GB, 102.02 GB, 108.70 GB, 115.79 GB, 121.85 GB, 128.36 GB, 134.60 GB, 138.84 GB, 143.68 GB, 149.52 GB, 154.39 GB, 158.31 GB, 152.20 GB, 156.10 GB, 158.29 GB, 158.43 GB, 152.78 GB, 152.80 GB, 154.60 GB, 156.37 GB, 158.77 GB, 153.02 GB, 153.19 GB, 154.99 GB, 154.80 GB, 155.35 GB ThreadUsage(16s000ms): 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.04 - BloomFilterBytes: 49.00 MB (51380224) - PeakMemoryUsage: 160.62 GB (172461128143) - PerHostPeakMemUsage: 169.56 GB (182064155503) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 1m56s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 1.52K (1522) - TotalThreadsTotalWallClockTime: 22s661ms - TotalThreadsSysTime: 2s219ms - TotalThreadsUserTime: 8s230ms - TotalThreadsVoluntaryContextSwitches: 23.77K (23774) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 53.239ms - ExecTreePrepareTime: 472.807us DataStreamSender (dst_id=28):(Total: 892.399us, non-child: 892.399us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.05 MB (1105280) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 602.340ms, non-child: 602.340ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 196.860ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 122 (122) - NumInstructions: 8.95K (8951) - OptimizationTime: 380.520ms - PeakMemoryUsage: 4.37 MB (4582912) - PrepareTime: 24.541ms HASH_JOIN_NODE (id=15):(Total: 912.638us, non-child: 872.300us, % non-child: 95.58%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 451.92K (451915) - BuildTime: 147.198ms - PeakMemoryUsage: 153.09 MB (160524544) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=15): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 108.060ms - BuildRowsPartitioned: 451.92K (451915) - GetNewBlockTime: 469.201us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 36.172ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160449664) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=26):(Total: 2s070ms, non-child: 27.748ms, % non-child: 1.34%) BytesReceived(16s000ms): 5.38 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB - BytesReceived: 6.21 MB (6513198) - ConvertRowBatchTime: 12.861ms - DeserializeRowBatchTimer: 52.407ms - FirstBatchArrivalWaitTime: 1s210ms - PeakMemoryUsage: 0 - RowsReturned: 451.92K (451915) - RowsReturnedRate: 218.23 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=14):(Total: 714.091us, non-child: 710.816us, % non-child: 99.54%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 458.71K (458712) - BuildTime: 152.370ms - PeakMemoryUsage: 25.08 MB (26298624) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 94.998ms - BuildRowsPartitioned: 458.71K (458712) - GetNewBlockTime: 204.217us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 21.898ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 25.02 MB (26231936) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 4s194ms, non-child: 17.087ms, % non-child: 0.41%) BytesReceived(16s000ms): 5.81 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB - BytesReceived: 7.33 MB (7684312) - ConvertRowBatchTime: 13.115ms - DeserializeRowBatchTimer: 18.627ms - FirstBatchArrivalWaitTime: 2s121ms - PeakMemoryUsage: 0 - RowsReturned: 458.71K (458712) - RowsReturnedRate: 109.36 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=13):(Total: 543.655us, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 4.06B (4063751623) - BuildTime: 6m16s - PeakMemoryUsage: 157.63 GB (169258682624) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled, Spilled Runtime filters: 0 of 1 Runtime Filter Published, 1 Disabled - BuildRowsPartitionTime: 6m16s - BuildRowsPartitioned: 4.06B (4063751623) - GetNewBlockTime: 1m1s - HashBuckets: 536.87M (536870912) - HashCollisions: 0 (0) - HashTablesBuildTime: 43s873ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 157.63 GB (169258624128) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 4 (4) - UnpinTime: 106.448ms HASH_JOIN_NODE (id=12):(Total: 3m6s, non-child: 1m16s, % non-child: 41.05%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 40.19M (40185310) - BuildTime: 8s566ms - PeakMemoryUsage: 3.02 GB (3240188894) - ProbeRows: 76.38M (76378016) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1m7s - RowsReturned: 4.06B (4063751623) - RowsReturnedRate: 21.77 M/sec Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 5s402ms - BuildRowsPartitioned: 40.19M (40185310) - GetNewBlockTime: 3.103ms - HashBuckets: 67.11M (67108864) - HashCollisions: 0 (0) - HashTablesBuildTime: 3s123ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 3.02 GB (3240125568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 7s433ms, non-child: 1s724ms, % non-child: 23.19%) BytesReceived(16s000ms): 210.36 MB, 380.58 MB, 380.58 MB, 380.58 MB, 380.58 MB, 380.58 MB, 380.58 MB, 380.58 MB, 380.58 MB, 380.58 MB, 380.58 MB, 380.58 MB, 380.58 MB, 380.58 MB, 380.58 MB, 380.58 MB, 380.58 MB, 380.58 MB, 380.58 MB, 380.58 MB, 380.58 MB, 380.58 MB, 380.58 MB, 380.58 MB, 380.58 MB, 380.58 MB, 380.58 MB, 380.58 MB, 380.58 MB, 380.58 MB, 380.58 MB, 380.58 MB, 380.58 MB, 380.58 MB, 380.58 MB, 380.58 MB, 380.58 MB, 380.58 MB, 380.58 MB, 380.58 MB - BytesReceived: 380.58 MB (399062666) - ConvertRowBatchTime: 990.420ms - DeserializeRowBatchTimer: 1s730ms - FirstBatchArrivalWaitTime: 1s131ms - PeakMemoryUsage: 0 - RowsReturned: 40.19M (40185310) - RowsReturnedRate: 5.41 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=22):(Total: 1m43s, non-child: 1s420ms, % non-child: 1.37%) BytesReceived(16s000ms): 2.08 MB, 15.44 MB, 42.38 MB, 68.50 MB, 95.56 MB, 122.84 MB, 150.41 MB, 177.82 MB, 203.72 MB, 229.42 MB, 254.48 MB, 280.34 MB, 307.28 MB, 333.71 MB, 358.17 MB, 385.49 MB, 411.41 MB, 439.11 MB, 462.54 MB, 487.80 MB, 511.66 MB, 528.64 MB, 547.71 MB, 570.31 MB, 589.35 MB, 604.16 MB, 624.61 MB, 640.53 MB, 652.96 MB, 657.61 MB, 666.99 MB, 679.79 MB, 684.74 MB, 694.33 MB, 702.90 MB, 707.19 MB, 707.19 MB, 707.19 MB, 707.19 MB, 707.19 MB - BytesReceived: 707.19 MB (741542327) - ConvertRowBatchTime: 905.341ms - DeserializeRowBatchTimer: 7s383ms - FirstBatchArrivalWaitTime: 799.716ms - PeakMemoryUsage: 0 - RowsReturned: 76.38M (76378016) - RowsReturnedRate: 738.42 K/sec - SendersBlockedTimer: 6s484ms - SendersBlockedTotalTimer(*): 13m EXCHANGE_NODE (id=24):(Total: 1s731ms, non-child: 3.943us, % non-child: 0.00%) BytesReceived(16s000ms): 8.48 MB, 10.28 MB, 10.28 MB, 10.28 MB, 10.28 MB, 10.28 MB, 10.28 MB, 10.28 MB, 10.28 MB, 10.28 MB, 10.28 MB, 10.28 MB, 10.28 MB, 10.28 MB, 10.28 MB, 10.28 MB, 10.28 MB, 10.28 MB, 10.28 MB, 10.28 MB, 10.28 MB, 10.28 MB, 10.28 MB, 10.28 MB, 10.28 MB, 10.28 MB, 10.28 MB, 10.28 MB, 10.28 MB, 10.28 MB, 10.28 MB, 10.28 MB, 10.28 MB, 10.28 MB, 10.28 MB, 10.28 MB, 10.28 MB, 10.29 MB, 10.31 MB, 10.31 MB - BytesReceived: 10.56 MB (11073161) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 81.073ms - FirstBatchArrivalWaitTime: 1s730ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:31d (host=vd1117.foo:22000):(Total: 53.359ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 968.19 MB, 6.95 GB, 13.85 GB, 20.34 GB, 27.06 GB, 33.79 GB, 40.56 GB, 47.33 GB, 53.68 GB, 60.04 GB, 66.25 GB, 72.64 GB, 79.39 GB, 85.79 GB, 91.84 GB, 98.50 GB, 104.92 GB, 111.58 GB, 117.51 GB, 123.79 GB, 129.94 GB, 134.05 GB, 138.70 GB, 144.35 GB, 149.24 GB, 152.90 GB, 157.90 GB, 151.31 GB, 153.67 GB, 154.55 GB, 156.92 GB, 159.86 GB, 158.36 GB, 151.68 GB, 153.17 GB, 153.93 GB, 155.13 GB, 150.00 GB, 150.18 GB, 150.63 GB ThreadUsage(16s000ms): 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.03 - BloomFilterBytes: 49.00 MB (51380224) - PeakMemoryUsage: 160.61 GB (172453632367) - PerHostPeakMemUsage: 169.56 GB (182068232415) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 2m5s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 1.57K (1573) - TotalThreadsTotalWallClockTime: 21s793ms - TotalThreadsSysTime: 2s228ms - TotalThreadsUserTime: 8s039ms - TotalThreadsVoluntaryContextSwitches: 21.27K (21266) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 53.324ms - ExecTreePrepareTime: 543.479us DataStreamSender (dst_id=28):(Total: 870.269us, non-child: 870.269us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.05 MB (1105280) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 600.857ms, non-child: 600.857ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 195.184ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 122 (122) - NumInstructions: 8.95K (8951) - OptimizationTime: 382.421ms - PeakMemoryUsage: 4.37 MB (4582912) - PrepareTime: 22.853ms HASH_JOIN_NODE (id=15):(Total: 1.017ms, non-child: 920.783us, % non-child: 90.46%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 451.92K (451915) - BuildTime: 135.359ms - PeakMemoryUsage: 153.09 MB (160524544) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=15): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 99.735ms - BuildRowsPartitioned: 451.92K (451915) - GetNewBlockTime: 378.644us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 32.496ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160449664) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=26):(Total: 2s085ms, non-child: 23.346ms, % non-child: 1.12%) BytesReceived(16s000ms): 5.32 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB - BytesReceived: 6.21 MB (6513198) - ConvertRowBatchTime: 11.773ms - DeserializeRowBatchTimer: 49.700ms - FirstBatchArrivalWaitTime: 1s232ms - PeakMemoryUsage: 0 - RowsReturned: 451.92K (451915) - RowsReturnedRate: 216.71 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=14):(Total: 762.407us, non-child: 933.182us, % non-child: 100.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 458.06K (458060) - BuildTime: 180.859ms - PeakMemoryUsage: 25.08 MB (26298624) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 110.870ms - BuildRowsPartitioned: 458.06K (458060) - GetNewBlockTime: 257.558us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 25.515ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 25.02 MB (26231936) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 4s134ms, non-child: 16.633ms, % non-child: 0.40%) BytesReceived(16s000ms): 5.78 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB - BytesReceived: 7.32 MB (7673540) - ConvertRowBatchTime: 12.338ms - DeserializeRowBatchTimer: 16.156ms - FirstBatchArrivalWaitTime: 2s138ms - PeakMemoryUsage: 0 - RowsReturned: 458.06K (458060) - RowsReturnedRate: 110.79 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=13):(Total: 509.056us, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 3.93B (3927223232) - BuildTime: 6m24s - PeakMemoryUsage: 160.16 GB (171968203008) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled, Spilled Runtime filters: 0 of 1 Runtime Filter Published, 1 Disabled - BuildRowsPartitionTime: 6m24s - BuildRowsPartitioned: 3.93B (3927223232) - GetNewBlockTime: 53s220ms - HashBuckets: 536.87M (536870912) - HashCollisions: 0 (0) - HashTablesBuildTime: 58s803ms - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 160.16 GB (171968144512) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 4 (4) - UnpinTime: 276.284ms HASH_JOIN_NODE (id=12):(Total: 3m9s, non-child: 1m11s, % non-child: 37.70%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 40.12M (40122148) - BuildTime: 8s465ms - PeakMemoryUsage: 3.02 GB (3240188608) - ProbeRows: 74.33M (74327084) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1m2s - RowsReturned: 3.93B (3927223232) - RowsReturnedRate: 20.70 M/sec Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 5s722ms - BuildRowsPartitioned: 40.12M (40122148) - GetNewBlockTime: 4.082ms - HashBuckets: 67.11M (67108864) - HashCollisions: 0 (0) - HashTablesBuildTime: 2s705ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 3.02 GB (3240125568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 6s691ms, non-child: 1s526ms, % non-child: 22.81%) BytesReceived(16s000ms): 206.80 MB, 380.00 MB, 380.00 MB, 380.00 MB, 380.00 MB, 380.00 MB, 380.00 MB, 380.00 MB, 380.00 MB, 380.00 MB, 380.00 MB, 380.00 MB, 380.00 MB, 380.00 MB, 380.00 MB, 380.00 MB, 380.00 MB, 380.00 MB, 380.00 MB, 380.00 MB, 380.00 MB, 380.00 MB, 380.00 MB, 380.00 MB, 380.00 MB, 380.00 MB, 380.00 MB, 380.00 MB, 380.00 MB, 380.00 MB, 380.00 MB, 380.00 MB, 380.00 MB, 380.00 MB, 380.00 MB, 380.00 MB, 380.00 MB, 380.00 MB, 380.00 MB, 380.00 MB - BytesReceived: 380.00 MB (398456314) - ConvertRowBatchTime: 937.488ms - DeserializeRowBatchTimer: 1s501ms - FirstBatchArrivalWaitTime: 1s150ms - PeakMemoryUsage: 0 - RowsReturned: 40.12M (40122148) - RowsReturnedRate: 6.00 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=22):(Total: 1m52s, non-child: 1s271ms, % non-child: 1.13%) BytesReceived(16s000ms): 2.04 MB, 14.85 MB, 41.09 MB, 66.47 MB, 92.82 MB, 119.22 MB, 145.85 MB, 172.46 MB, 197.65 MB, 222.67 MB, 247.20 MB, 272.44 MB, 298.75 MB, 324.43 MB, 348.26 MB, 374.73 MB, 399.83 MB, 426.59 MB, 449.63 MB, 474.17 MB, 497.43 MB, 513.93 MB, 532.24 MB, 554.36 MB, 574.10 MB, 587.47 MB, 607.48 MB, 623.07 MB, 635.25 MB, 639.98 MB, 649.08 MB, 661.71 MB, 666.60 MB, 675.98 MB, 684.34 MB, 688.49 MB, 688.49 MB, 688.49 MB, 688.49 MB, 688.49 MB - BytesReceived: 688.49 MB (721939039) - ConvertRowBatchTime: 829.534ms - DeserializeRowBatchTimer: 7s320ms - FirstBatchArrivalWaitTime: 825.968ms - PeakMemoryUsage: 0 - RowsReturned: 74.33M (74327084) - RowsReturnedRate: 661.75 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=24):(Total: 1s759ms, non-child: 2.939us, % non-child: 0.00%) BytesReceived(16s000ms): 8.44 MB, 10.35 MB, 10.35 MB, 10.35 MB, 10.35 MB, 10.35 MB, 10.35 MB, 10.35 MB, 10.35 MB, 10.35 MB, 10.35 MB, 10.35 MB, 10.35 MB, 10.35 MB, 10.35 MB, 10.35 MB, 10.35 MB, 10.35 MB, 10.35 MB, 10.35 MB, 10.35 MB, 10.35 MB, 10.35 MB, 10.35 MB, 10.35 MB, 10.35 MB, 10.35 MB, 10.35 MB, 10.35 MB, 10.35 MB, 10.35 MB, 10.35 MB, 10.35 MB, 10.35 MB, 10.35 MB, 10.35 MB, 10.35 MB, 10.40 MB, 10.50 MB, 10.50 MB - BytesReceived: 10.69 MB (11207006) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 71.129ms - FirstBatchArrivalWaitTime: 1s759ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:32e (host=vd1105.foo:22000):(Total: 53.067ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 967.11 MB, 7.19 GB, 14.13 GB, 20.81 GB, 27.69 GB, 34.58 GB, 41.56 GB, 48.54 GB, 55.08 GB, 61.64 GB, 67.99 GB, 74.52 GB, 81.77 GB, 88.49 GB, 94.66 GB, 101.55 GB, 108.16 GB, 114.97 GB, 121.09 GB, 127.47 GB, 133.62 GB, 137.90 GB, 142.76 GB, 148.56 GB, 153.32 GB, 156.72 GB, 153.92 GB, 154.97 GB, 158.28 GB, 159.13 GB, 150.33 GB, 152.82 GB, 154.29 GB, 156.39 GB, 157.97 GB, 155.09 GB, 156.09 GB, 154.21 GB, 156.47 GB, 156.76 GB ThreadUsage(16s000ms): 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.03 - BloomFilterBytes: 49.00 MB (51380224) - PeakMemoryUsage: 160.60 GB (172445533903) - PerHostPeakMemUsage: 169.57 GB (182070840498) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 1m58s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 1.39K (1394) - TotalThreadsTotalWallClockTime: 21s618ms - TotalThreadsSysTime: 2s104ms - TotalThreadsUserTime: 8s255ms - TotalThreadsVoluntaryContextSwitches: 21.28K (21281) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 53.002ms - ExecTreePrepareTime: 530.714us DataStreamSender (dst_id=28):(Total: 923.674us, non-child: 923.674us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.05 MB (1105280) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 644.707ms, non-child: 644.707ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 205.337ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 122 (122) - NumInstructions: 8.95K (8951) - OptimizationTime: 416.618ms - PeakMemoryUsage: 4.37 MB (4582912) - PrepareTime: 22.364ms HASH_JOIN_NODE (id=15):(Total: 1.018ms, non-child: 877.628us, % non-child: 86.16%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 451.92K (451915) - BuildTime: 136.435ms - PeakMemoryUsage: 153.09 MB (160524544) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=15): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 99.848ms - BuildRowsPartitioned: 451.92K (451915) - GetNewBlockTime: 365.436us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 33.758ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160449664) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=26):(Total: 2s035ms, non-child: 24.501ms, % non-child: 1.20%) BytesReceived(16s000ms): 5.33 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB - BytesReceived: 6.21 MB (6513198) - ConvertRowBatchTime: 12.028ms - DeserializeRowBatchTimer: 49.940ms - FirstBatchArrivalWaitTime: 1s181ms - PeakMemoryUsage: 0 - RowsReturned: 451.92K (451915) - RowsReturnedRate: 222.03 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=14):(Total: 807.099us, non-child: 808.522us, % non-child: 100.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 458.83K (458826) - BuildTime: 153.741ms - PeakMemoryUsage: 25.08 MB (26298624) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 89.181ms - BuildRowsPartitioned: 458.83K (458826) - GetNewBlockTime: 232.383us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 28.651ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 25.02 MB (26231936) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 4s123ms, non-child: 16.246ms, % non-child: 0.39%) BytesReceived(16s000ms): 5.78 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB - BytesReceived: 7.33 MB (7684896) - ConvertRowBatchTime: 12.233ms - DeserializeRowBatchTimer: 16.831ms - FirstBatchArrivalWaitTime: 2s087ms - PeakMemoryUsage: 0 - RowsReturned: 458.83K (458826) - RowsReturnedRate: 111.26 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=13):(Total: 588.978us, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 4.04B (4037609195) - BuildTime: 6m14s - PeakMemoryUsage: 159.49 GB (171246782720) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled, Spilled Runtime filters: 0 of 1 Runtime Filter Published, 1 Disabled - BuildRowsPartitionTime: 6m13s - BuildRowsPartitioned: 4.04B (4037609195) - GetNewBlockTime: 44s496ms - HashBuckets: 536.87M (536870912) - HashCollisions: 0 (0) - HashTablesBuildTime: 24s239ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 159.49 GB (171246724224) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 4 (4) - UnpinTime: 319.707ms HASH_JOIN_NODE (id=12):(Total: 3m8s, non-child: 1m16s, % non-child: 40.73%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 40.15M (40151819) - BuildTime: 8s586ms - PeakMemoryUsage: 3.02 GB (3240190570) - ProbeRows: 75.73M (75731358) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1m7s - RowsReturned: 4.04B (4037609195) - RowsReturnedRate: 21.39 M/sec Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 5s914ms - BuildRowsPartitioned: 40.15M (40151819) - GetNewBlockTime: 3.364ms - HashBuckets: 67.11M (67108864) - HashCollisions: 0 (0) - HashTablesBuildTime: 2s617ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 3.02 GB (3240125568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 6s484ms, non-child: 1s659ms, % non-child: 25.60%) BytesReceived(16s000ms): 207.01 MB, 380.25 MB, 380.25 MB, 380.25 MB, 380.25 MB, 380.25 MB, 380.25 MB, 380.25 MB, 380.25 MB, 380.25 MB, 380.25 MB, 380.25 MB, 380.25 MB, 380.25 MB, 380.25 MB, 380.25 MB, 380.25 MB, 380.25 MB, 380.25 MB, 380.25 MB, 380.25 MB, 380.25 MB, 380.25 MB, 380.25 MB, 380.25 MB, 380.25 MB, 380.25 MB, 380.25 MB, 380.25 MB, 380.25 MB, 380.25 MB, 380.25 MB, 380.25 MB, 380.25 MB, 380.25 MB, 380.25 MB, 380.25 MB, 380.25 MB, 380.25 MB, 380.25 MB - BytesReceived: 380.25 MB (398723511) - ConvertRowBatchTime: 936.833ms - DeserializeRowBatchTimer: 1s786ms - FirstBatchArrivalWaitTime: 1s110ms - PeakMemoryUsage: 0 - RowsReturned: 40.15M (40151819) - RowsReturnedRate: 6.19 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=22):(Total: 1m46s, non-child: 1s714ms, % non-child: 1.61%) BytesReceived(16s000ms): 2.11 MB, 15.18 MB, 41.85 MB, 67.77 MB, 94.62 MB, 121.47 MB, 148.64 MB, 175.78 MB, 201.47 MB, 226.88 MB, 252.12 MB, 279.53 MB, 306.08 MB, 332.14 MB, 356.10 MB, 383.21 MB, 408.82 MB, 436.09 MB, 458.82 MB, 484.36 MB, 507.04 MB, 524.18 MB, 543.22 MB, 565.66 MB, 583.97 MB, 596.56 MB, 616.62 MB, 632.90 MB, 646.61 MB, 651.24 MB, 659.99 MB, 673.17 MB, 678.51 MB, 687.44 MB, 696.22 MB, 701.36 MB, 701.36 MB, 701.36 MB, 701.36 MB, 701.36 MB - BytesReceived: 701.36 MB (735431519) - ConvertRowBatchTime: 844.183ms - DeserializeRowBatchTimer: 7s145ms - FirstBatchArrivalWaitTime: 773.519ms - PeakMemoryUsage: 0 - RowsReturned: 75.73M (75731358) - RowsReturnedRate: 713.14 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=24):(Total: 1s713ms, non-child: 3.035us, % non-child: 0.00%) BytesReceived(16s000ms): 8.28 MB, 10.16 MB, 10.16 MB, 10.16 MB, 10.16 MB, 10.16 MB, 10.16 MB, 10.16 MB, 10.16 MB, 10.16 MB, 10.16 MB, 10.16 MB, 10.16 MB, 10.16 MB, 10.16 MB, 10.16 MB, 10.16 MB, 10.16 MB, 10.16 MB, 10.16 MB, 10.16 MB, 10.16 MB, 10.16 MB, 10.16 MB, 10.16 MB, 10.16 MB, 10.16 MB, 10.16 MB, 10.16 MB, 10.16 MB, 10.16 MB, 10.16 MB, 10.16 MB, 10.16 MB, 10.16 MB, 10.16 MB, 10.16 MB, 10.16 MB, 10.16 MB, 10.19 MB - BytesReceived: 10.31 MB (10806112) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 70.833ms - FirstBatchArrivalWaitTime: 1s713ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:358 (host=vd1126.foo:22000):(Total: 52.850ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 987.93 MB, 6.87 GB, 14.19 GB, 20.73 GB, 27.42 GB, 34.10 GB, 40.83 GB, 47.61 GB, 53.98 GB, 60.39 GB, 66.52 GB, 72.87 GB, 79.57 GB, 85.97 GB, 92.02 GB, 98.77 GB, 105.22 GB, 111.90 GB, 117.95 GB, 124.19 GB, 130.28 GB, 134.37 GB, 138.99 GB, 144.54 GB, 149.17 GB, 152.44 GB, 157.21 GB, 152.65 GB, 154.01 GB, 155.07 GB, 157.17 GB, 155.28 GB, 149.90 GB, 152.50 GB, 154.27 GB, 156.26 GB, 151.84 GB, 150.06 GB, 152.37 GB, 156.40 GB ThreadUsage(16s000ms): 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.03 - BloomFilterBytes: 49.00 MB (51380224) - PeakMemoryUsage: 160.60 GB (172438098367) - PerHostPeakMemUsage: 169.56 GB (182067882047) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 2m33s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 1.67K (1674) - TotalThreadsTotalWallClockTime: 22s383ms - TotalThreadsSysTime: 2s338ms - TotalThreadsUserTime: 8s253ms - TotalThreadsVoluntaryContextSwitches: 20.88K (20883) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 52.814ms - ExecTreePrepareTime: 675.069us DataStreamSender (dst_id=28):(Total: 818.344us, non-child: 818.344us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.05 MB (1105280) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 627.589ms, non-child: 627.589ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 207.729ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 122 (122) - NumInstructions: 8.95K (8951) - OptimizationTime: 397.553ms - PeakMemoryUsage: 4.37 MB (4582912) - PrepareTime: 21.881ms HASH_JOIN_NODE (id=15):(Total: 1.291ms, non-child: 968.422us, % non-child: 75.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 451.92K (451915) - BuildTime: 127.996ms - PeakMemoryUsage: 153.09 MB (160524544) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=15): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 97.213ms - BuildRowsPartitioned: 451.92K (451915) - GetNewBlockTime: 422.677us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 27.968ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160449664) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=26):(Total: 2s047ms, non-child: 25.198ms, % non-child: 1.23%) BytesReceived(16s000ms): 5.47 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB - BytesReceived: 6.21 MB (6513198) - ConvertRowBatchTime: 11.745ms - DeserializeRowBatchTimer: 49.245ms - FirstBatchArrivalWaitTime: 1s188ms - PeakMemoryUsage: 0 - RowsReturned: 451.92K (451915) - RowsReturnedRate: 220.70 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=14):(Total: 930.012us, non-child: 914.444us, % non-child: 98.33%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 459.37K (459368) - BuildTime: 165.904ms - PeakMemoryUsage: 25.08 MB (26298624) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 102.409ms - BuildRowsPartitioned: 459.37K (459368) - GetNewBlockTime: 183.556us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 25.151ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 25.02 MB (26231936) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 4s157ms, non-child: 15.987ms, % non-child: 0.38%) BytesReceived(16s000ms): 5.97 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB - BytesReceived: 7.34 MB (7694130) - ConvertRowBatchTime: 11.943ms - DeserializeRowBatchTimer: 16.493ms - FirstBatchArrivalWaitTime: 2s099ms - PeakMemoryUsage: 0 - RowsReturned: 459.37K (459368) - RowsReturnedRate: 110.50 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=13):(Total: 602.539us, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 3.93B (3929349846) - BuildTime: 5m53s - PeakMemoryUsage: 160.16 GB (171968203008) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled, Spilled Runtime filters: 0 of 1 Runtime Filter Published, 1 Disabled - BuildRowsPartitionTime: 5m52s - BuildRowsPartitioned: 3.93B (3929349846) - GetNewBlockTime: 37s885ms - HashBuckets: 536.87M (536870912) - HashCollisions: 0 (0) - HashTablesBuildTime: 31s864ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 160.16 GB (171968144512) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 4 (4) - UnpinTime: 138.345ms HASH_JOIN_NODE (id=12):(Total: 3m36s, non-child: 1m10s, % non-child: 32.56%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 40.19M (40187909) - BuildTime: 8s815ms - PeakMemoryUsage: 3.02 GB (3240188128) - ProbeRows: 74.32M (74315330) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1m1s - RowsReturned: 3.93B (3929349846) - RowsReturnedRate: 18.12 M/sec Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 5s811ms - BuildRowsPartitioned: 40.19M (40187909) - GetNewBlockTime: 4.035ms - HashBuckets: 67.11M (67108864) - HashCollisions: 0 (0) - HashTablesBuildTime: 2s957ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 3.02 GB (3240125568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 6s964ms, non-child: 1s539ms, % non-child: 22.11%) BytesReceived(16s000ms): 216.82 MB, 380.61 MB, 380.61 MB, 380.61 MB, 380.61 MB, 380.61 MB, 380.61 MB, 380.61 MB, 380.61 MB, 380.61 MB, 380.61 MB, 380.61 MB, 380.61 MB, 380.61 MB, 380.61 MB, 380.61 MB, 380.61 MB, 380.61 MB, 380.61 MB, 380.61 MB, 380.61 MB, 380.61 MB, 380.61 MB, 380.61 MB, 380.61 MB, 380.61 MB, 380.61 MB, 380.61 MB, 380.61 MB, 380.61 MB, 380.61 MB, 380.61 MB, 380.61 MB, 380.61 MB, 380.61 MB, 380.61 MB, 380.61 MB, 380.61 MB, 380.61 MB, 380.61 MB - BytesReceived: 380.61 MB (399100072) - ConvertRowBatchTime: 936.155ms - DeserializeRowBatchTimer: 1s543ms - FirstBatchArrivalWaitTime: 1s115ms - PeakMemoryUsage: 0 - RowsReturned: 40.19M (40187909) - RowsReturnedRate: 5.77 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=22):(Total: 2m20s, non-child: 2s550ms, % non-child: 1.82%) BytesReceived(16s000ms): 2.18 MB, 15.94 MB, 42.42 MB, 67.98 MB, 94.25 MB, 120.53 MB, 147.06 MB, 173.78 MB, 199.05 MB, 224.05 MB, 248.37 MB, 273.42 MB, 299.54 MB, 325.18 MB, 348.91 MB, 375.50 MB, 400.66 MB, 427.39 MB, 450.13 MB, 474.89 MB, 497.78 MB, 514.37 MB, 532.74 MB, 554.51 MB, 572.33 MB, 584.79 MB, 604.19 MB, 620.34 MB, 634.25 MB, 638.70 MB, 647.23 MB, 660.07 MB, 665.69 MB, 675.98 MB, 684.32 MB, 688.25 MB, 688.25 MB, 688.25 MB, 688.25 MB, 688.25 MB - BytesReceived: 688.25 MB (721679799) - ConvertRowBatchTime: 822.808ms - DeserializeRowBatchTimer: 6s665ms - FirstBatchArrivalWaitTime: 775.401ms - PeakMemoryUsage: 0 - RowsReturned: 74.32M (74315330) - RowsReturnedRate: 530.50 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=24):(Total: 1s724ms, non-child: 2.041us, % non-child: 0.00%) BytesReceived(16s000ms): 8.27 MB, 9.80 MB, 9.80 MB, 9.80 MB, 9.80 MB, 9.80 MB, 9.80 MB, 9.80 MB, 9.80 MB, 9.80 MB, 9.80 MB, 9.80 MB, 9.80 MB, 9.80 MB, 9.80 MB, 9.80 MB, 9.80 MB, 9.80 MB, 9.80 MB, 9.80 MB, 9.80 MB, 9.80 MB, 9.80 MB, 9.80 MB, 9.80 MB, 9.80 MB, 9.80 MB, 9.80 MB, 9.80 MB, 9.80 MB, 9.80 MB, 9.80 MB, 9.80 MB, 9.80 MB, 9.80 MB, 9.80 MB, 9.80 MB, 9.80 MB, 9.80 MB, 9.80 MB - BytesReceived: 9.81 MB (10287371) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 68.523ms - FirstBatchArrivalWaitTime: 1s724ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:352 (host=vc1501.foo:22000):(Total: 52.745ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 958.10 MB, 7.06 GB, 14.24 GB, 20.86 GB, 27.74 GB, 34.63 GB, 41.57 GB, 48.51 GB, 55.30 GB, 62.00 GB, 68.35 GB, 75.01 GB, 81.85 GB, 88.19 GB, 94.56 GB, 101.51 GB, 108.00 GB, 114.79 GB, 121.04 GB, 127.47 GB, 133.44 GB, 137.80 GB, 142.52 GB, 148.26 GB, 153.02 GB, 156.34 GB, 153.87 GB, 154.53 GB, 157.89 GB, 158.89 GB, 151.12 GB, 152.62 GB, 154.29 GB, 156.58 GB, 158.10 GB, 153.38 GB, 153.51 GB, 153.13 GB, 155.83 GB, 149.96 GB ThreadUsage(16s000ms): 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.03 - BloomFilterBytes: 49.00 MB (51380224) - PeakMemoryUsage: 160.60 GB (172440162223) - PerHostPeakMemUsage: 169.58 GB (182084640221) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 2m28s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 1.38K (1380) - TotalThreadsTotalWallClockTime: 22s450ms - TotalThreadsSysTime: 2s121ms - TotalThreadsUserTime: 7s893ms - TotalThreadsVoluntaryContextSwitches: 25.22K (25218) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 52.696ms - ExecTreePrepareTime: 468.255us DataStreamSender (dst_id=28):(Total: 790.372us, non-child: 790.372us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.05 MB (1105280) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 603.791ms, non-child: 603.791ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 202.579ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 122 (122) - NumInstructions: 8.95K (8951) - OptimizationTime: 377.275ms - PeakMemoryUsage: 4.37 MB (4582912) - PrepareTime: 23.499ms HASH_JOIN_NODE (id=15):(Total: 887.884us, non-child: 932.992us, % non-child: 100.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 451.92K (451915) - BuildTime: 138.231ms - PeakMemoryUsage: 153.09 MB (160524544) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=15): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 100.573ms - BuildRowsPartitioned: 451.92K (451915) - GetNewBlockTime: 365.852us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 34.969ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160449664) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=26):(Total: 2s072ms, non-child: 25.615ms, % non-child: 1.24%) BytesReceived(16s000ms): 5.39 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB - BytesReceived: 6.21 MB (6513198) - ConvertRowBatchTime: 12.141ms - DeserializeRowBatchTimer: 51.708ms - FirstBatchArrivalWaitTime: 1s214ms - PeakMemoryUsage: 0 - RowsReturned: 451.92K (451915) - RowsReturnedRate: 218.09 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=14):(Total: 698.449us, non-child: 764.687us, % non-child: 100.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 459.60K (459601) - BuildTime: 152.807ms - PeakMemoryUsage: 25.08 MB (26298624) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 92.436ms - BuildRowsPartitioned: 459.60K (459601) - GetNewBlockTime: 194.273us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 19.968ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 25.02 MB (26231936) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 4s185ms, non-child: 15.593ms, % non-child: 0.37%) BytesReceived(16s000ms): 5.83 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB - BytesReceived: 7.34 MB (7699671) - ConvertRowBatchTime: 11.525ms - DeserializeRowBatchTimer: 17.106ms - FirstBatchArrivalWaitTime: 2s127ms - PeakMemoryUsage: 0 - RowsReturned: 459.60K (459601) - RowsReturnedRate: 109.79 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=13):(Total: 507.151us, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 4.03B (4026878370) - BuildTime: 5m48s - PeakMemoryUsage: 160.16 GB (171968792832) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled, Spilled Runtime filters: 0 of 1 Runtime Filter Published, 1 Disabled - BuildRowsPartitionTime: 5m47s - BuildRowsPartitioned: 4.03B (4026878370) - GetNewBlockTime: 35s474ms - HashBuckets: 1.07B (1073741824) - HashCollisions: 0 (0) - HashTablesBuildTime: 1m22s - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 160.16 GB (171968734336) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 5 (5) - UnpinTime: 250.944ms HASH_JOIN_NODE (id=12):(Total: 3m34s, non-child: 1m13s, % non-child: 34.16%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 40.26M (40258819) - BuildTime: 8s216ms - PeakMemoryUsage: 3.02 GB (3240188740) - ProbeRows: 76.57M (76572044) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1m4s - RowsReturned: 4.03B (4026878370) - RowsReturnedRate: 18.73 M/sec Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 5s205ms - BuildRowsPartitioned: 40.26M (40258819) - GetNewBlockTime: 2.258ms - HashBuckets: 67.11M (67108864) - HashCollisions: 0 (0) - HashTablesBuildTime: 2s967ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 3.02 GB (3240125568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 7s598ms, non-child: 1s560ms, % non-child: 20.53%) BytesReceived(16s000ms): 213.36 MB, 381.25 MB, 381.25 MB, 381.25 MB, 381.25 MB, 381.25 MB, 381.25 MB, 381.25 MB, 381.25 MB, 381.25 MB, 381.25 MB, 381.25 MB, 381.25 MB, 381.25 MB, 381.25 MB, 381.25 MB, 381.25 MB, 381.25 MB, 381.25 MB, 381.25 MB, 381.25 MB, 381.25 MB, 381.25 MB, 381.25 MB, 381.25 MB, 381.25 MB, 381.25 MB, 381.25 MB, 381.25 MB, 381.25 MB, 381.25 MB, 381.25 MB, 381.25 MB, 381.25 MB, 381.25 MB, 381.25 MB, 381.25 MB, 381.25 MB, 381.25 MB, 381.25 MB - BytesReceived: 381.25 MB (399774421) - ConvertRowBatchTime: 935.870ms - DeserializeRowBatchTimer: 1s557ms - FirstBatchArrivalWaitTime: 1s138ms - PeakMemoryUsage: 0 - RowsReturned: 40.26M (40258819) - RowsReturnedRate: 5.30 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=22):(Total: 2m14s, non-child: 1s399ms, % non-child: 1.04%) BytesReceived(16s000ms): 2.25 MB, 15.82 MB, 42.78 MB, 68.84 MB, 95.87 MB, 123.02 MB, 150.40 MB, 177.75 MB, 204.97 MB, 231.01 MB, 256.31 MB, 282.50 MB, 309.51 MB, 335.94 MB, 360.34 MB, 387.81 MB, 413.67 MB, 441.32 MB, 464.46 MB, 490.27 MB, 513.08 MB, 530.42 MB, 549.59 MB, 572.25 MB, 590.55 MB, 603.21 MB, 623.42 MB, 639.72 MB, 653.49 MB, 658.14 MB, 667.11 MB, 680.55 MB, 686.65 MB, 696.95 MB, 705.45 MB, 708.99 MB, 708.99 MB, 708.99 MB, 708.99 MB, 708.99 MB - BytesReceived: 708.99 MB (743429447) - ConvertRowBatchTime: 887.600ms - DeserializeRowBatchTimer: 5s824ms - FirstBatchArrivalWaitTime: 797.789ms - PeakMemoryUsage: 0 - RowsReturned: 76.57M (76572044) - RowsReturnedRate: 568.36 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=24):(Total: 1s735ms, non-child: 4.411us, % non-child: 0.00%) BytesReceived(16s000ms): 8.89 MB, 10.62 MB, 10.62 MB, 10.62 MB, 10.62 MB, 10.62 MB, 10.62 MB, 10.62 MB, 10.62 MB, 10.62 MB, 10.62 MB, 10.62 MB, 10.62 MB, 10.62 MB, 10.62 MB, 10.62 MB, 10.62 MB, 10.62 MB, 10.62 MB, 10.62 MB, 10.62 MB, 10.62 MB, 10.62 MB, 10.62 MB, 10.62 MB, 10.62 MB, 10.62 MB, 10.62 MB, 10.62 MB, 10.62 MB, 10.62 MB, 10.62 MB, 10.62 MB, 10.62 MB, 10.62 MB, 10.62 MB, 10.62 MB, 10.67 MB, 10.79 MB, 10.80 MB - BytesReceived: 11.22 MB (11767151) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 70.091ms - FirstBatchArrivalWaitTime: 1s735ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:302 (host=vd1328.foo:22000):(Total: 52.632ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 1.03 GB, 6.80 GB, 13.63 GB, 20.33 GB, 27.17 GB, 34.02 GB, 40.94 GB, 47.85 GB, 54.41 GB, 60.90 GB, 67.29 GB, 73.81 GB, 80.63 GB, 87.44 GB, 93.76 GB, 100.53 GB, 107.23 GB, 114.13 GB, 120.07 GB, 126.42 GB, 132.73 GB, 137.11 GB, 141.85 GB, 147.55 GB, 152.35 GB, 155.63 GB, 156.70 GB, 153.86 GB, 157.30 GB, 157.96 GB, 157.64 GB, 151.79 GB, 152.77 GB, 154.94 GB, 157.13 GB, 154.09 GB, 152.25 GB, 154.28 GB, 152.58 GB, 154.33 GB ThreadUsage(16s000ms): 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.03 - BloomFilterBytes: 49.00 MB (51380224) - PeakMemoryUsage: 161.02 GB (172896576863) - PerHostPeakMemUsage: 169.56 GB (182066128678) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 1m46s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 2.09K (2086) - TotalThreadsTotalWallClockTime: 21s924ms - TotalThreadsSysTime: 2s403ms - TotalThreadsUserTime: 8s826ms - TotalThreadsVoluntaryContextSwitches: 28.84K (28844) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 52.582ms - ExecTreePrepareTime: 471.882us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 23.81K (23814) - BlocksRecycled: 354 (354) - BufferedPins: 0 (0) - BytesWritten: 39.91 GB (42849009664) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 161.38 GB (173283483648) - ScratchFileUsedBytes: 39.91 GB (42849009664) - TotalBufferWaitTime: 3s991ms - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=28):(Total: 611.958us, non-child: 611.958us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.05 MB (1105280) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 612.653ms, non-child: 612.653ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 196.887ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 122 (122) - NumInstructions: 8.95K (8951) - OptimizationTime: 392.055ms - PeakMemoryUsage: 4.37 MB (4582912) - PrepareTime: 23.220ms HASH_JOIN_NODE (id=15):(Total: 902.211us, non-child: 814.270us, % non-child: 90.25%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 451.92K (451915) - BuildTime: 141.465ms - PeakMemoryUsage: 153.09 MB (160524544) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=15): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 101.035ms - BuildRowsPartitioned: 451.92K (451915) - GetNewBlockTime: 406.960us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 37.448ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160449664) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=26):(Total: 2s090ms, non-child: 24.370ms, % non-child: 1.17%) BytesReceived(16s000ms): 5.39 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB - BytesReceived: 6.21 MB (6513198) - ConvertRowBatchTime: 12.417ms - DeserializeRowBatchTimer: 51.680ms - FirstBatchArrivalWaitTime: 1s226ms - PeakMemoryUsage: 0 - RowsReturned: 451.92K (451915) - RowsReturnedRate: 216.18 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=14):(Total: 726.334us, non-child: 799.982us, % non-child: 100.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 459.25K (459247) - BuildTime: 172.015ms - PeakMemoryUsage: 25.08 MB (26298624) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 105.133ms - BuildRowsPartitioned: 459.25K (459247) - GetNewBlockTime: 295.191us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 23.544ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 25.02 MB (26231936) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 4s112ms, non-child: 15.916ms, % non-child: 0.39%) BytesReceived(16s000ms): 5.68 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB - BytesReceived: 7.34 MB (7692043) - ConvertRowBatchTime: 12.172ms - DeserializeRowBatchTimer: 17.446ms - FirstBatchArrivalWaitTime: 2s133ms - PeakMemoryUsage: 0 - RowsReturned: 459.25K (459247) - RowsReturnedRate: 111.68 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=13):(Total: 556.635us, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 4.01B (4011123623) - BuildTime: 6m21s - PeakMemoryUsage: 157.70 GB (169333590240) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled, Spilled Runtime filters: 0 of 1 Runtime Filter Published, 1 Disabled - BuildRowsPartitionTime: 6m21s - BuildRowsPartitioned: 4.01B (4011123623) - GetNewBlockTime: 47s910ms - HashBuckets: 536.87M (536870912) - HashCollisions: 0 (0) - HashTablesBuildTime: 41s278ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 157.70 GB (169333499008) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 4 (4) - UnpinTime: 352.263ms HASH_JOIN_NODE (id=12):(Total: 3m7s, non-child: 1m22s, % non-child: 44.29%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 53.70M (53700636) - BuildTime: 8s842ms - PeakMemoryUsage: 3.02 GB (3240188190) - ProbeRows: 321.01M (321009977) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1m12s - RowsReturned: 4.01B (4011123623) - RowsReturnedRate: 21.42 M/sec Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 5s910ms - BuildRowsPartitioned: 53.70M (53700636) - GetNewBlockTime: 3.121ms - HashBuckets: 67.11M (67108864) - HashCollisions: 0 (0) - HashTablesBuildTime: 2s884ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 3.02 GB (3240125568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 6s405ms, non-child: 2s565ms, % non-child: 40.05%) BytesReceived(16s000ms): 307.73 MB, 549.44 MB, 549.44 MB, 549.44 MB, 549.44 MB, 549.44 MB, 549.44 MB, 549.44 MB, 549.44 MB, 549.44 MB, 549.44 MB, 549.44 MB, 549.44 MB, 549.44 MB, 549.44 MB, 549.44 MB, 549.44 MB, 549.44 MB, 549.44 MB, 549.44 MB, 549.44 MB, 549.44 MB, 549.44 MB, 549.44 MB, 549.44 MB, 549.44 MB, 549.44 MB, 549.44 MB, 549.44 MB, 549.44 MB, 549.44 MB, 549.44 MB, 549.44 MB, 549.44 MB, 549.44 MB, 549.44 MB, 549.44 MB, 549.44 MB, 549.44 MB, 549.44 MB - BytesReceived: 549.44 MB (576128345) - ConvertRowBatchTime: 1s289ms - DeserializeRowBatchTimer: 2s429ms - FirstBatchArrivalWaitTime: 1s140ms - PeakMemoryUsage: 0 - RowsReturned: 53.70M (53700636) - RowsReturnedRate: 8.38 M/sec - SendersBlockedTimer: 4s642ms - SendersBlockedTotalTimer(*): 7m EXCHANGE_NODE (id=22):(Total: 1m38s, non-child: 10s399ms, % non-child: 10.54%) BytesReceived(16s000ms): 9.87 MB, 66.84 MB, 179.18 MB, 289.64 MB, 402.60 MB, 515.54 MB, 629.90 MB, 743.99 MB, 851.88 MB, 959.13 MB, 1.04 GB, 1.14 GB, 1.25 GB, 1.36 GB, 1.46 GB, 1.57 GB, 1.68 GB, 1.79 GB, 1.89 GB, 1.99 GB, 2.09 GB, 2.16 GB, 2.23 GB, 2.33 GB, 2.40 GB, 2.45 GB, 2.53 GB, 2.60 GB, 2.66 GB, 2.68 GB, 2.71 GB, 2.77 GB, 2.79 GB, 2.83 GB, 2.87 GB, 2.88 GB, 2.88 GB, 2.88 GB, 2.88 GB, 2.88 GB - BytesReceived: 2.88 GB (3096167016) - ConvertRowBatchTime: 4s447ms - DeserializeRowBatchTimer: 18s698ms - FirstBatchArrivalWaitTime: 793.441ms - PeakMemoryUsage: 0 - RowsReturned: 321.01M (321009977) - RowsReturnedRate: 3.25 M/sec - SendersBlockedTimer: 5m32s - SendersBlockedTotalTimer(*): 11h39m EXCHANGE_NODE (id=24):(Total: 1s747ms, non-child: 5.030us, % non-child: 0.00%) BytesReceived(16s000ms): 9.01 MB, 10.75 MB, 10.75 MB, 10.75 MB, 10.75 MB, 10.75 MB, 10.75 MB, 10.75 MB, 10.75 MB, 10.75 MB, 10.75 MB, 10.75 MB, 10.75 MB, 10.75 MB, 10.75 MB, 10.75 MB, 10.75 MB, 10.75 MB, 10.75 MB, 10.75 MB, 10.75 MB, 10.75 MB, 10.75 MB, 10.75 MB, 10.75 MB, 10.75 MB, 10.75 MB, 10.75 MB, 10.75 MB, 10.75 MB, 10.75 MB, 10.75 MB, 10.75 MB, 10.75 MB, 10.75 MB, 10.75 MB, 10.75 MB, 10.80 MB, 10.87 MB, 10.88 MB - BytesReceived: 10.97 MB (11507875) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 81.358ms - FirstBatchArrivalWaitTime: 1s747ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:2ec (host=ve1136.foo:22000):(Total: 52.631ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 1022.78 MB, 7.26 GB, 14.18 GB, 20.80 GB, 27.57 GB, 34.34 GB, 41.19 GB, 47.98 GB, 54.35 GB, 60.79 GB, 67.04 GB, 73.53 GB, 80.34 GB, 86.92 GB, 93.04 GB, 99.90 GB, 107.14 GB, 114.16 GB, 119.81 GB, 126.68 GB, 132.25 GB, 136.64 GB, 141.34 GB, 147.03 GB, 151.66 GB, 154.80 GB, 156.09 GB, 152.70 GB, 155.86 GB, 156.75 GB, 159.13 GB, 150.66 GB, 151.55 GB, 153.86 GB, 155.35 GB, 151.12 GB, 151.14 GB, 153.53 GB, 153.54 GB, 154.90 GB ThreadUsage(16s000ms): 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.03 - BloomFilterBytes: 49.00 MB (51380224) - PeakMemoryUsage: 160.60 GB (172445335999) - PerHostPeakMemUsage: 169.56 GB (182064805489) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 2m37s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 1.68K (1681) - TotalThreadsTotalWallClockTime: 21s662ms - TotalThreadsSysTime: 2s180ms - TotalThreadsUserTime: 8s106ms - TotalThreadsVoluntaryContextSwitches: 20.58K (20579) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 52.590ms - ExecTreePrepareTime: 515.049us DataStreamSender (dst_id=28):(Total: 992.220us, non-child: 992.220us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.05 MB (1105280) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 605.375ms, non-child: 605.375ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 193.017ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 122 (122) - NumInstructions: 8.95K (8951) - OptimizationTime: 391.101ms - PeakMemoryUsage: 4.37 MB (4582912) - PrepareTime: 20.803ms HASH_JOIN_NODE (id=15):(Total: 986.988us, non-child: 870.121us, % non-child: 88.16%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 451.92K (451915) - BuildTime: 140.055ms - PeakMemoryUsage: 153.09 MB (160524544) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=15): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 107.516ms - BuildRowsPartitioned: 451.92K (451915) - GetNewBlockTime: 383.150us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 29.698ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160449664) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=26):(Total: 2s088ms, non-child: 26.221ms, % non-child: 1.26%) BytesReceived(16s000ms): 5.38 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB - BytesReceived: 6.21 MB (6513198) - ConvertRowBatchTime: 12.730ms - DeserializeRowBatchTimer: 51.920ms - FirstBatchArrivalWaitTime: 1s238ms - PeakMemoryUsage: 0 - RowsReturned: 451.92K (451915) - RowsReturnedRate: 216.35 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=14):(Total: 779.213us, non-child: 799.858us, % non-child: 100.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 459.23K (459225) - BuildTime: 170.325ms - PeakMemoryUsage: 25.08 MB (26298624) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 105.787ms - BuildRowsPartitioned: 459.23K (459225) - GetNewBlockTime: 241.797us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 25.149ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 25.02 MB (26231936) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 4s115ms, non-child: 15.411ms, % non-child: 0.37%) BytesReceived(16s000ms): 5.83 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB - BytesReceived: 7.34 MB (7691952) - ConvertRowBatchTime: 11.681ms - DeserializeRowBatchTimer: 16.380ms - FirstBatchArrivalWaitTime: 2s150ms - PeakMemoryUsage: 0 - RowsReturned: 459.23K (459225) - RowsReturnedRate: 111.57 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=13):(Total: 581.836us, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 3.98B (3979297994) - BuildTime: 5m40s - PeakMemoryUsage: 158.57 GB (170265905408) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled, Spilled Runtime filters: 0 of 1 Runtime Filter Published, 1 Disabled - BuildRowsPartitionTime: 5m40s - BuildRowsPartitioned: 3.98B (3979297994) - GetNewBlockTime: 37s978ms - HashBuckets: 1.07B (1073741824) - HashCollisions: 0 (0) - HashTablesBuildTime: 1m18s - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 158.57 GB (170265846912) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 5 (5) - UnpinTime: 241.135ms HASH_JOIN_NODE (id=12):(Total: 3m41s, non-child: 1m11s, % non-child: 32.09%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 40.12M (40122524) - BuildTime: 8s556ms - PeakMemoryUsage: 3.02 GB (3240199008) - ProbeRows: 75.02M (75021703) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1m1s - RowsReturned: 3.98B (3979297994) - RowsReturnedRate: 17.93 M/sec Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 5s877ms - BuildRowsPartitioned: 40.12M (40122524) - GetNewBlockTime: 3.730ms - HashBuckets: 67.11M (67108864) - HashCollisions: 0 (0) - HashTablesBuildTime: 2s629ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 3.02 GB (3240125568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 6s486ms, non-child: 1s497ms, % non-child: 23.09%) BytesReceived(16s000ms): 211.75 MB, 379.97 MB, 379.97 MB, 379.97 MB, 379.97 MB, 379.97 MB, 379.97 MB, 379.97 MB, 379.97 MB, 379.97 MB, 379.97 MB, 379.97 MB, 379.97 MB, 379.97 MB, 379.97 MB, 379.97 MB, 379.97 MB, 379.97 MB, 379.97 MB, 379.97 MB, 379.97 MB, 379.97 MB, 379.97 MB, 379.97 MB, 379.97 MB, 379.97 MB, 379.97 MB, 379.97 MB, 379.97 MB, 379.97 MB, 379.97 MB, 379.97 MB, 379.97 MB, 379.97 MB, 379.97 MB, 379.97 MB, 379.97 MB, 379.97 MB, 379.97 MB, 379.97 MB - BytesReceived: 379.97 MB (398432046) - ConvertRowBatchTime: 911.437ms - DeserializeRowBatchTimer: 1s515ms - FirstBatchArrivalWaitTime: 1s154ms - PeakMemoryUsage: 0 - RowsReturned: 40.12M (40122524) - RowsReturnedRate: 6.19 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=22):(Total: 2m25s, non-child: 1s659ms, % non-child: 1.14%) BytesReceived(16s000ms): 2.18 MB, 15.50 MB, 42.17 MB, 67.97 MB, 94.45 MB, 120.91 MB, 147.67 MB, 174.33 MB, 199.43 MB, 224.61 MB, 249.23 MB, 274.78 MB, 301.26 MB, 327.34 MB, 351.51 MB, 378.30 MB, 406.87 MB, 433.80 MB, 456.50 MB, 482.24 MB, 503.88 MB, 521.37 MB, 540.07 MB, 562.56 MB, 580.00 MB, 592.38 MB, 612.49 MB, 628.34 MB, 640.97 MB, 645.63 MB, 654.67 MB, 667.42 MB, 672.42 MB, 681.67 MB, 690.13 MB, 694.64 MB, 694.64 MB, 694.64 MB, 694.64 MB, 694.64 MB - BytesReceived: 694.64 MB (728387697) - ConvertRowBatchTime: 810.600ms - DeserializeRowBatchTimer: 7s069ms - FirstBatchArrivalWaitTime: 820.315ms - PeakMemoryUsage: 0 - RowsReturned: 75.02M (75021703) - RowsReturnedRate: 517.07 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=24):(Total: 1s765ms, non-child: 3.949us, % non-child: 0.00%) BytesReceived(16s000ms): 8.43 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.15 MB, 10.20 MB, 10.20 MB - BytesReceived: 10.25 MB (10748862) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 68.052ms - FirstBatchArrivalWaitTime: 1s765ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:307 (host=vc1541.foo:22000):(Total: 52.577ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 1.02 GB, 7.09 GB, 14.06 GB, 20.59 GB, 27.33 GB, 34.10 GB, 40.93 GB, 47.96 GB, 54.36 GB, 60.79 GB, 66.99 GB, 73.43 GB, 80.17 GB, 86.55 GB, 92.70 GB, 99.42 GB, 105.86 GB, 112.61 GB, 118.65 GB, 124.78 GB, 130.92 GB, 135.23 GB, 139.87 GB, 145.47 GB, 150.13 GB, 153.39 GB, 157.19 GB, 151.73 GB, 155.11 GB, 155.94 GB, 158.30 GB, 156.59 GB, 150.50 GB, 152.82 GB, 154.45 GB, 151.17 GB, 153.20 GB, 154.81 GB, 151.93 GB, 153.13 GB ThreadUsage(16s000ms): 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.03 - BloomFilterBytes: 49.00 MB (51380224) - PeakMemoryUsage: 160.62 GB (172459132165) - PerHostPeakMemUsage: 169.55 GB (182053501934) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 2m14s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 1.62K (1622) - TotalThreadsTotalWallClockTime: 21s854ms - TotalThreadsSysTime: 2s196ms - TotalThreadsUserTime: 8s085ms - TotalThreadsVoluntaryContextSwitches: 21.07K (21071) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 52.518ms - ExecTreePrepareTime: 607.301us DataStreamSender (dst_id=28):(Total: 893.082us, non-child: 893.082us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.05 MB (1105280) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 603.802ms, non-child: 603.802ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 193.253ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 122 (122) - NumInstructions: 8.95K (8951) - OptimizationTime: 388.548ms - PeakMemoryUsage: 4.37 MB (4582912) - PrepareTime: 21.613ms HASH_JOIN_NODE (id=15):(Total: 1.160ms, non-child: 905.618us, % non-child: 78.06%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 451.92K (451915) - BuildTime: 131.528ms - PeakMemoryUsage: 153.09 MB (160524544) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=15): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 99.790ms - BuildRowsPartitioned: 451.92K (451915) - GetNewBlockTime: 307.929us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 28.857ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160449664) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=26):(Total: 2s090ms, non-child: 27.667ms, % non-child: 1.32%) BytesReceived(16s000ms): 5.45 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB - BytesReceived: 6.21 MB (6513198) - ConvertRowBatchTime: 12.682ms - DeserializeRowBatchTimer: 54.440ms - FirstBatchArrivalWaitTime: 1s231ms - PeakMemoryUsage: 0 - RowsReturned: 451.92K (451915) - RowsReturnedRate: 216.21 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=14):(Total: 864.062us, non-child: 526.913us, % non-child: 60.98%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 458.62K (458623) - BuildTime: 134.095ms - PeakMemoryUsage: 25.08 MB (26298624) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 71.146ms - BuildRowsPartitioned: 458.62K (458623) - GetNewBlockTime: 221.396us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 27.053ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 25.02 MB (26231936) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 4s162ms, non-child: 11.582ms, % non-child: 0.28%) BytesReceived(16s000ms): 5.95 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB - BytesReceived: 7.33 MB (7681784) - ConvertRowBatchTime: 8.623ms - DeserializeRowBatchTimer: 16.564ms - FirstBatchArrivalWaitTime: 2s139ms - PeakMemoryUsage: 0 - RowsReturned: 458.62K (458623) - RowsReturnedRate: 110.17 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=13):(Total: 629.886us, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 3.95B (3952668643) - BuildTime: 6m6s - PeakMemoryUsage: 157.31 GB (168914159840) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled, Spilled Runtime filters: 0 of 1 Runtime Filter Published, 1 Disabled - BuildRowsPartitionTime: 6m6s - BuildRowsPartitioned: 3.95B (3952668643) - GetNewBlockTime: 46s608ms - HashBuckets: 536.87M (536870912) - HashCollisions: 0 (0) - HashTablesBuildTime: 45s602ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 157.31 GB (168914068608) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 4 (4) - UnpinTime: 324.907ms HASH_JOIN_NODE (id=12):(Total: 3m19s, non-child: 1m10s, % non-child: 35.65%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 40.13M (40134766) - BuildTime: 8s516ms - PeakMemoryUsage: 3.02 GB (3240188964) - ProbeRows: 74.96M (74959315) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1m1s - RowsReturned: 3.95B (3952668643) - RowsReturnedRate: 19.85 M/sec Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 5s666ms - BuildRowsPartitioned: 40.13M (40134766) - GetNewBlockTime: 4.240ms - HashBuckets: 67.11M (67108864) - HashCollisions: 0 (0) - HashTablesBuildTime: 2s808ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 3.02 GB (3240125568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 6s721ms, non-child: 1s536ms, % non-child: 22.86%) BytesReceived(16s000ms): 215.76 MB, 380.08 MB, 380.08 MB, 380.08 MB, 380.08 MB, 380.08 MB, 380.08 MB, 380.08 MB, 380.08 MB, 380.08 MB, 380.08 MB, 380.08 MB, 380.08 MB, 380.08 MB, 380.08 MB, 380.08 MB, 380.08 MB, 380.08 MB, 380.08 MB, 380.08 MB, 380.08 MB, 380.08 MB, 380.08 MB, 380.08 MB, 380.08 MB, 380.08 MB, 380.08 MB, 380.08 MB, 380.08 MB, 380.08 MB, 380.08 MB, 380.08 MB, 380.08 MB, 380.08 MB, 380.08 MB, 380.08 MB, 380.08 MB, 380.08 MB, 380.08 MB, 380.08 MB - BytesReceived: 380.08 MB (398542332) - ConvertRowBatchTime: 954.432ms - DeserializeRowBatchTimer: 1s485ms - FirstBatchArrivalWaitTime: 1s161ms - PeakMemoryUsage: 0 - RowsReturned: 40.13M (40134766) - RowsReturnedRate: 5.97 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=22):(Total: 2m2s, non-child: 3s285ms, % non-child: 2.69%) BytesReceived(16s000ms): 2.09 MB, 15.64 MB, 42.04 MB, 67.66 MB, 94.20 MB, 120.89 MB, 148.07 MB, 175.52 MB, 200.80 MB, 226.01 MB, 250.67 MB, 276.13 MB, 302.56 MB, 328.46 MB, 352.40 MB, 379.10 MB, 404.30 MB, 431.27 MB, 454.09 MB, 479.17 MB, 502.05 MB, 518.96 MB, 537.61 MB, 559.63 MB, 577.69 MB, 590.19 MB, 609.82 MB, 625.93 MB, 639.74 MB, 644.23 MB, 652.86 MB, 665.67 MB, 671.16 MB, 679.73 MB, 688.46 MB, 693.81 MB, 693.82 MB, 693.82 MB, 693.82 MB, 693.82 MB - BytesReceived: 693.82 MB (727519731) - ConvertRowBatchTime: 830.925ms - DeserializeRowBatchTimer: 5s443ms - FirstBatchArrivalWaitTime: 816.889ms - PeakMemoryUsage: 0 - RowsReturned: 74.96M (74959315) - RowsReturnedRate: 613.36 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=24):(Total: 1s755ms, non-child: 3.823us, % non-child: 0.00%) BytesReceived(16s000ms): 9.01 MB, 10.68 MB, 10.68 MB, 10.68 MB, 10.68 MB, 10.68 MB, 10.68 MB, 10.68 MB, 10.68 MB, 10.68 MB, 10.68 MB, 10.68 MB, 10.68 MB, 10.68 MB, 10.68 MB, 10.68 MB, 10.68 MB, 10.68 MB, 10.68 MB, 10.68 MB, 10.68 MB, 10.68 MB, 10.68 MB, 10.68 MB, 10.68 MB, 10.68 MB, 10.68 MB, 10.68 MB, 10.68 MB, 10.68 MB, 10.68 MB, 10.68 MB, 10.68 MB, 10.68 MB, 10.68 MB, 10.68 MB, 10.68 MB, 10.69 MB, 10.80 MB, 10.80 MB - BytesReceived: 10.92 MB (11452567) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 66.299ms - FirstBatchArrivalWaitTime: 1s755ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:365 (host=vc1514.foo:22000):(Total: 52.518ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 976.24 MB, 7.03 GB, 14.58 GB, 21.40 GB, 28.43 GB, 35.47 GB, 42.58 GB, 49.63 GB, 56.22 GB, 62.87 GB, 69.34 GB, 76.02 GB, 83.05 GB, 89.65 GB, 96.17 GB, 103.23 GB, 110.01 GB, 116.96 GB, 123.41 GB, 129.68 GB, 136.18 GB, 141.12 GB, 146.09 GB, 151.90 GB, 156.56 GB, 157.26 GB, 154.00 GB, 157.90 GB, 159.12 GB, 154.32 GB, 153.39 GB, 154.46 GB, 157.02 GB, 156.64 GB, 149.30 GB, 153.75 GB, 158.87 GB, 160.00 GB, 151.32 GB, 152.99 GB ThreadUsage(16s000ms): 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.03 - BloomFilterBytes: 49.00 MB (51380224) - PeakMemoryUsage: 160.62 GB (172464956767) - PerHostPeakMemUsage: 169.56 GB (182059706145) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 1m40s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 1.65K (1651) - TotalThreadsTotalWallClockTime: 22s421ms - TotalThreadsSysTime: 2s183ms - TotalThreadsUserTime: 7s954ms - TotalThreadsVoluntaryContextSwitches: 21.89K (21890) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 52.456ms - ExecTreePrepareTime: 515.073us DataStreamSender (dst_id=28):(Total: 692.533us, non-child: 692.533us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.05 MB (1105280) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 650.817ms, non-child: 650.817ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 219.675ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 122 (122) - NumInstructions: 8.95K (8951) - OptimizationTime: 407.117ms - PeakMemoryUsage: 4.37 MB (4582912) - PrepareTime: 23.640ms HASH_JOIN_NODE (id=15):(Total: 987.730us, non-child: 894.954us, % non-child: 90.61%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 451.92K (451915) - BuildTime: 138.732ms - PeakMemoryUsage: 153.09 MB (160524544) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=15): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 100.823ms - BuildRowsPartitioned: 451.92K (451915) - GetNewBlockTime: 385.494us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 34.761ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160449664) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=26):(Total: 2s025ms, non-child: 25.268ms, % non-child: 1.25%) BytesReceived(16s000ms): 5.49 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB - BytesReceived: 6.21 MB (6513198) - ConvertRowBatchTime: 12.087ms - DeserializeRowBatchTimer: 50.343ms - FirstBatchArrivalWaitTime: 1s164ms - PeakMemoryUsage: 0 - RowsReturned: 451.92K (451915) - RowsReturnedRate: 223.13 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=14):(Total: 776.835us, non-child: 786.382us, % non-child: 100.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 459.52K (459519) - BuildTime: 147.115ms - PeakMemoryUsage: 25.08 MB (26298624) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 83.232ms - BuildRowsPartitioned: 459.52K (459519) - GetNewBlockTime: 223.439us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 22.245ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 25.02 MB (26231936) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 4s156ms, non-child: 14.725ms, % non-child: 0.35%) BytesReceived(16s000ms): 5.98 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB - BytesReceived: 7.34 MB (7696273) - ConvertRowBatchTime: 10.491ms - DeserializeRowBatchTimer: 16.819ms - FirstBatchArrivalWaitTime: 2s076ms - PeakMemoryUsage: 0 - RowsReturned: 459.52K (459519) - RowsReturnedRate: 110.56 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=13):(Total: 575.257us, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 4.11B (4113522680) - BuildTime: 6m36s - PeakMemoryUsage: 160.16 GB (171968203008) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled, Spilled Runtime filters: 0 of 1 Runtime Filter Published, 1 Disabled - BuildRowsPartitionTime: 6m35s - BuildRowsPartitioned: 4.11B (4113522680) - GetNewBlockTime: 48s814ms - HashBuckets: 536.87M (536870912) - HashCollisions: 0 (0) - HashTablesBuildTime: 1m8s - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 160.16 GB (171968144512) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 4 (4) - UnpinTime: 369.401ms HASH_JOIN_NODE (id=12):(Total: 2m46s, non-child: 1m12s, % non-child: 43.62%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 40.21M (40213785) - BuildTime: 8s349ms - PeakMemoryUsage: 3.02 GB (3240192224) - ProbeRows: 77.78M (77780784) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1m3s - RowsReturned: 4.11B (4113522680) - RowsReturnedRate: 24.67 M/sec Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 5s517ms - BuildRowsPartitioned: 40.21M (40213785) - GetNewBlockTime: 3.695ms - HashBuckets: 67.11M (67108864) - HashCollisions: 0 (0) - HashTablesBuildTime: 2s777ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 3.02 GB (3240125568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 7s506ms, non-child: 1s538ms, % non-child: 20.50%) BytesReceived(16s000ms): 217.65 MB, 380.83 MB, 380.83 MB, 380.83 MB, 380.83 MB, 380.83 MB, 380.83 MB, 380.83 MB, 380.83 MB, 380.83 MB, 380.83 MB, 380.83 MB, 380.83 MB, 380.83 MB, 380.83 MB, 380.83 MB, 380.83 MB, 380.83 MB, 380.83 MB, 380.83 MB, 380.83 MB, 380.83 MB, 380.83 MB, 380.83 MB, 380.83 MB, 380.83 MB, 380.83 MB, 380.83 MB, 380.83 MB, 380.83 MB, 380.83 MB, 380.83 MB, 380.83 MB, 380.83 MB, 380.83 MB, 380.83 MB, 380.83 MB, 380.83 MB, 380.83 MB, 380.83 MB - BytesReceived: 380.83 MB (399328458) - ConvertRowBatchTime: 972.980ms - DeserializeRowBatchTimer: 1s460ms - FirstBatchArrivalWaitTime: 1s087ms - PeakMemoryUsage: 0 - RowsReturned: 40.21M (40213785) - RowsReturnedRate: 5.36 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=22):(Total: 1m27s, non-child: 1s363ms, % non-child: 1.56%) BytesReceived(16s000ms): 2.23 MB, 16.49 MB, 43.92 MB, 70.57 MB, 98.13 MB, 125.76 MB, 153.62 MB, 181.35 MB, 207.49 MB, 233.54 MB, 259.12 MB, 285.41 MB, 312.78 MB, 339.80 MB, 364.90 MB, 392.91 MB, 419.38 MB, 447.52 MB, 471.37 MB, 497.10 MB, 521.55 MB, 541.15 MB, 560.51 MB, 583.50 MB, 601.43 MB, 614.30 MB, 635.22 MB, 651.66 MB, 664.51 MB, 669.43 MB, 678.85 MB, 692.11 MB, 697.32 MB, 706.99 MB, 715.79 MB, 720.37 MB, 720.37 MB, 720.37 MB, 720.37 MB, 720.37 MB - BytesReceived: 720.37 MB (755360889) - ConvertRowBatchTime: 868.520ms - DeserializeRowBatchTimer: 6s693ms - FirstBatchArrivalWaitTime: 742.948ms - PeakMemoryUsage: 0 - RowsReturned: 77.78M (77780784) - RowsReturnedRate: 891.55 K/sec - SendersBlockedTimer: 19s404ms - SendersBlockedTotalTimer(*): 31m9s EXCHANGE_NODE (id=24):(Total: 1s700ms, non-child: 14.142us, % non-child: 0.00%) BytesReceived(16s000ms): 8.77 MB, 10.39 MB, 10.39 MB, 10.39 MB, 10.39 MB, 10.39 MB, 10.39 MB, 10.39 MB, 10.39 MB, 10.39 MB, 10.39 MB, 10.39 MB, 10.39 MB, 10.39 MB, 10.39 MB, 10.39 MB, 10.39 MB, 10.39 MB, 10.39 MB, 10.39 MB, 10.39 MB, 10.39 MB, 10.39 MB, 10.39 MB, 10.39 MB, 10.39 MB, 10.39 MB, 10.39 MB, 10.39 MB, 10.39 MB, 10.39 MB, 10.39 MB, 10.39 MB, 10.39 MB, 10.39 MB, 10.39 MB, 10.39 MB, 10.41 MB, 10.49 MB, 10.50 MB - BytesReceived: 10.76 MB (11284975) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 73.338ms - FirstBatchArrivalWaitTime: 1s700ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:33d (host=vc1522.foo:22000):(Total: 52.460ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 967.35 MB, 7.18 GB, 14.11 GB, 20.74 GB, 27.58 GB, 34.42 GB, 41.32 GB, 48.29 GB, 54.92 GB, 61.40 GB, 67.70 GB, 74.24 GB, 81.09 GB, 87.54 GB, 93.82 GB, 100.67 GB, 107.19 GB, 113.96 GB, 120.12 GB, 126.46 GB, 132.45 GB, 136.70 GB, 141.40 GB, 147.12 GB, 151.83 GB, 155.16 GB, 156.67 GB, 153.43 GB, 156.87 GB, 157.68 GB, 157.24 GB, 151.60 GB, 152.54 GB, 154.73 GB, 156.36 GB, 154.20 GB, 154.43 GB, 155.04 GB, 156.05 GB, 156.16 GB ThreadUsage(16s000ms): 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.03 - BloomFilterBytes: 49.00 MB (51380224) - PeakMemoryUsage: 160.60 GB (172445352367) - PerHostPeakMemUsage: 169.56 GB (182064280165) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 2m39s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 1.59K (1589) - TotalThreadsTotalWallClockTime: 21s700ms - TotalThreadsSysTime: 2s155ms - TotalThreadsUserTime: 8s146ms - TotalThreadsVoluntaryContextSwitches: 20.64K (20635) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 52.416ms - ExecTreePrepareTime: 492.297us DataStreamSender (dst_id=28):(Total: 753.988us, non-child: 753.988us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.05 MB (1105280) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 635.933ms, non-child: 635.933ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 208.617ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 122 (122) - NumInstructions: 8.95K (8951) - OptimizationTime: 406.451ms - PeakMemoryUsage: 4.37 MB (4582912) - PrepareTime: 20.413ms HASH_JOIN_NODE (id=15):(Total: 930.575us, non-child: 845.295us, % non-child: 90.84%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 451.92K (451915) - BuildTime: 136.073ms - PeakMemoryUsage: 153.09 MB (160524544) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=15): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 97.025ms - BuildRowsPartitioned: 451.92K (451915) - GetNewBlockTime: 268.483us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 36.293ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160449664) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=26):(Total: 2s043ms, non-child: 28.552ms, % non-child: 1.40%) BytesReceived(16s000ms): 5.34 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB - BytesReceived: 6.21 MB (6513198) - ConvertRowBatchTime: 12.104ms - DeserializeRowBatchTimer: 55.946ms - FirstBatchArrivalWaitTime: 1s184ms - PeakMemoryUsage: 0 - RowsReturned: 451.92K (451915) - RowsReturnedRate: 221.10 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=14):(Total: 712.520us, non-child: 826.488us, % non-child: 100.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 459.64K (459642) - BuildTime: 170.741ms - PeakMemoryUsage: 25.08 MB (26298624) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 103.573ms - BuildRowsPartitioned: 459.64K (459642) - GetNewBlockTime: 252.973us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 24.541ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 25.02 MB (26231936) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 4s118ms, non-child: 15.720ms, % non-child: 0.38%) BytesReceived(16s000ms): 5.82 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB - BytesReceived: 7.34 MB (7699439) - ConvertRowBatchTime: 11.331ms - DeserializeRowBatchTimer: 16.755ms - FirstBatchArrivalWaitTime: 2s094ms - PeakMemoryUsage: 0 - RowsReturned: 459.64K (459642) - RowsReturnedRate: 111.59 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=13):(Total: 489.163us, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 4.00B (3999882574) - BuildTime: 5m41s - PeakMemoryUsage: 158.13 GB (169787164928) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled, Spilled Runtime filters: 0 of 1 Runtime Filter Published, 1 Disabled - BuildRowsPartitionTime: 5m41s - BuildRowsPartitioned: 4.00B (3999882574) - GetNewBlockTime: 41s539ms - HashBuckets: 536.87M (536870912) - HashCollisions: 0 (0) - HashTablesBuildTime: 23s810ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 158.13 GB (169787106432) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 4 (4) - UnpinTime: 265.325ms HASH_JOIN_NODE (id=12):(Total: 3m46s, non-child: 1m13s, % non-child: 32.62%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 40.20M (40200327) - BuildTime: 8s506ms - PeakMemoryUsage: 3.02 GB (3240188850) - ProbeRows: 75.67M (75670153) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1m4s - RowsReturned: 4.00B (3999882574) - RowsReturnedRate: 17.69 M/sec Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 5s827ms - BuildRowsPartitioned: 40.20M (40200327) - GetNewBlockTime: 4.435ms - HashBuckets: 67.11M (67108864) - HashCollisions: 0 (0) - HashTablesBuildTime: 2s629ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 3.02 GB (3240125568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 6s621ms, non-child: 1s551ms, % non-child: 23.42%) BytesReceived(16s000ms): 207.93 MB, 380.71 MB, 380.71 MB, 380.71 MB, 380.71 MB, 380.71 MB, 380.71 MB, 380.71 MB, 380.71 MB, 380.71 MB, 380.71 MB, 380.71 MB, 380.71 MB, 380.71 MB, 380.71 MB, 380.71 MB, 380.71 MB, 380.71 MB, 380.71 MB, 380.71 MB, 380.71 MB, 380.71 MB, 380.71 MB, 380.71 MB, 380.71 MB, 380.71 MB, 380.71 MB, 380.71 MB, 380.71 MB, 380.71 MB, 380.71 MB, 380.71 MB, 380.71 MB, 380.71 MB, 380.71 MB, 380.71 MB, 380.71 MB, 380.71 MB, 380.71 MB, 380.71 MB - BytesReceived: 380.71 MB (399204190) - ConvertRowBatchTime: 944.937ms - DeserializeRowBatchTimer: 1s543ms - FirstBatchArrivalWaitTime: 1s101ms - PeakMemoryUsage: 0 - RowsReturned: 40.20M (40200327) - RowsReturnedRate: 6.07 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=22):(Total: 2m26s, non-child: 2s013ms, % non-child: 1.37%) BytesReceived(16s000ms): 2.10 MB, 15.31 MB, 42.06 MB, 67.99 MB, 94.80 MB, 121.64 MB, 148.72 MB, 176.58 MB, 202.56 MB, 227.97 MB, 252.89 MB, 278.61 MB, 305.31 MB, 331.47 MB, 355.55 MB, 382.66 MB, 408.27 MB, 435.52 MB, 458.52 MB, 483.69 MB, 506.87 MB, 523.81 MB, 542.75 MB, 565.09 MB, 583.44 MB, 595.98 MB, 615.67 MB, 632.12 MB, 646.13 MB, 650.71 MB, 659.30 MB, 672.31 MB, 677.94 MB, 686.46 MB, 695.26 MB, 700.82 MB, 700.83 MB, 700.83 MB, 700.83 MB, 700.83 MB - BytesReceived: 700.83 MB (734872283) - ConvertRowBatchTime: 819.334ms - DeserializeRowBatchTimer: 6s163ms - FirstBatchArrivalWaitTime: 772.152ms - PeakMemoryUsage: 0 - RowsReturned: 75.67M (75670153) - RowsReturnedRate: 516.60 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=24):(Total: 1s718ms, non-child: 3.247us, % non-child: 0.00%) BytesReceived(16s000ms): 8.66 MB, 10.59 MB, 10.59 MB, 10.59 MB, 10.59 MB, 10.59 MB, 10.59 MB, 10.59 MB, 10.59 MB, 10.59 MB, 10.59 MB, 10.59 MB, 10.59 MB, 10.59 MB, 10.59 MB, 10.59 MB, 10.59 MB, 10.59 MB, 10.59 MB, 10.59 MB, 10.59 MB, 10.59 MB, 10.59 MB, 10.59 MB, 10.59 MB, 10.59 MB, 10.59 MB, 10.59 MB, 10.59 MB, 10.59 MB, 10.59 MB, 10.59 MB, 10.59 MB, 10.59 MB, 10.59 MB, 10.59 MB, 10.59 MB, 10.60 MB, 10.61 MB, 10.67 MB - BytesReceived: 10.89 MB (11419845) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 75.964ms - FirstBatchArrivalWaitTime: 1s718ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:32f (host=va1027.foo:22000):(Total: 52.257ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 957.18 MB, 6.95 GB, 13.92 GB, 20.43 GB, 27.22 GB, 33.99 GB, 40.80 GB, 47.62 GB, 53.96 GB, 60.38 GB, 66.65 GB, 73.05 GB, 79.79 GB, 86.08 GB, 92.33 GB, 98.98 GB, 105.49 GB, 112.07 GB, 118.71 GB, 125.29 GB, 131.18 GB, 135.50 GB, 140.26 GB, 145.89 GB, 150.50 GB, 153.76 GB, 156.81 GB, 151.35 GB, 154.55 GB, 155.48 GB, 157.73 GB, 153.77 GB, 149.85 GB, 152.21 GB, 153.92 GB, 155.85 GB, 152.66 GB, 145.80 GB, 153.38 GB, 151.46 GB ThreadUsage(16s000ms): 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.03 - BloomFilterBytes: 49.00 MB (51380224) - PeakMemoryUsage: 160.60 GB (172443441775) - PerHostPeakMemUsage: 169.54 GB (182043355220) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 2m11s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 1.35K (1349) - TotalThreadsTotalWallClockTime: 22s060ms - TotalThreadsSysTime: 2s038ms - TotalThreadsUserTime: 7s727ms - TotalThreadsVoluntaryContextSwitches: 26.49K (26492) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 52.147ms - ExecTreePrepareTime: 623.502us DataStreamSender (dst_id=28):(Total: 783.482us, non-child: 783.482us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.05 MB (1105280) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 620.957ms, non-child: 620.957ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 198.299ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 122 (122) - NumInstructions: 8.95K (8951) - OptimizationTime: 398.920ms - PeakMemoryUsage: 4.37 MB (4582912) - PrepareTime: 23.321ms HASH_JOIN_NODE (id=15):(Total: 1.193ms, non-child: 1.003ms, % non-child: 84.06%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 451.92K (451915) - BuildTime: 134.077ms - PeakMemoryUsage: 153.09 MB (160524544) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=15): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 98.991ms - BuildRowsPartitioned: 451.92K (451915) - GetNewBlockTime: 376.143us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 31.941ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160449664) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=26):(Total: 2s062ms, non-child: 22.224ms, % non-child: 1.08%) BytesReceived(16s000ms): 5.35 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB - BytesReceived: 6.21 MB (6513198) - ConvertRowBatchTime: 10.721ms - DeserializeRowBatchTimer: 49.361ms - FirstBatchArrivalWaitTime: 1s205ms - PeakMemoryUsage: 0 - RowsReturned: 451.92K (451915) - RowsReturnedRate: 219.16 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=14):(Total: 900.343us, non-child: 725.195us, % non-child: 80.55%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 459.27K (459272) - BuildTime: 133.449ms - PeakMemoryUsage: 25.08 MB (26298624) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 84.737ms - BuildRowsPartitioned: 459.27K (459272) - GetNewBlockTime: 351.297us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 21.653ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 25.02 MB (26231936) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 4s159ms, non-child: 13.656ms, % non-child: 0.33%) BytesReceived(16s000ms): 5.81 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB - BytesReceived: 7.34 MB (7693470) - ConvertRowBatchTime: 10.763ms - DeserializeRowBatchTimer: 14.969ms - FirstBatchArrivalWaitTime: 2s117ms - PeakMemoryUsage: 0 - RowsReturned: 459.27K (459272) - RowsReturnedRate: 110.43 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=13):(Total: 588.933us, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 3.95B (3952532748) - BuildTime: 6m3s - PeakMemoryUsage: 160.16 GB (171968203008) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled, Spilled Runtime filters: 0 of 1 Runtime Filter Published, 1 Disabled - BuildRowsPartitionTime: 6m2s - BuildRowsPartitioned: 3.95B (3952532748) - GetNewBlockTime: 32s259ms - HashBuckets: 1.07B (1073741824) - HashCollisions: 0 (0) - HashTablesBuildTime: 1m6s - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 160.16 GB (171968144512) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 5 (5) - UnpinTime: 329.517ms HASH_JOIN_NODE (id=12):(Total: 3m19s, non-child: 1m15s, % non-child: 37.58%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 40.23M (40234496) - BuildTime: 8s058ms - PeakMemoryUsage: 3.02 GB (3240188128) - ProbeRows: 75.35M (75350113) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1m6s - RowsReturned: 3.95B (3952532748) - RowsReturnedRate: 19.78 M/sec Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 5s018ms - BuildRowsPartitioned: 40.23M (40234496) - GetNewBlockTime: 3.206ms - HashBuckets: 67.11M (67108864) - HashCollisions: 0 (0) - HashTablesBuildTime: 2s997ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 3.02 GB (3240125568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 7s436ms, non-child: 1s483ms, % non-child: 19.95%) BytesReceived(16s000ms): 208.36 MB, 381.04 MB, 381.04 MB, 381.04 MB, 381.04 MB, 381.04 MB, 381.04 MB, 381.04 MB, 381.04 MB, 381.04 MB, 381.04 MB, 381.04 MB, 381.04 MB, 381.04 MB, 381.04 MB, 381.04 MB, 381.04 MB, 381.04 MB, 381.04 MB, 381.04 MB, 381.04 MB, 381.04 MB, 381.04 MB, 381.04 MB, 381.04 MB, 381.04 MB, 381.04 MB, 381.04 MB, 381.04 MB, 381.04 MB, 381.04 MB, 381.04 MB, 381.04 MB, 381.04 MB, 381.04 MB, 381.04 MB, 381.04 MB, 381.04 MB, 381.04 MB, 381.04 MB - BytesReceived: 381.04 MB (399551728) - ConvertRowBatchTime: 934.489ms - DeserializeRowBatchTimer: 1s503ms - FirstBatchArrivalWaitTime: 1s134ms - PeakMemoryUsage: 0 - RowsReturned: 40.23M (40234496) - RowsReturnedRate: 5.41 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=22):(Total: 1m58s, non-child: 1s366ms, % non-child: 1.16%) BytesReceived(16s000ms): 2.11 MB, 15.17 MB, 41.74 MB, 67.47 MB, 94.28 MB, 121.06 MB, 148.03 MB, 174.97 MB, 200.31 MB, 225.68 MB, 250.59 MB, 276.10 MB, 302.65 MB, 328.62 MB, 352.74 MB, 379.56 MB, 404.95 MB, 433.53 MB, 457.88 MB, 483.65 MB, 505.76 MB, 523.15 MB, 541.99 MB, 564.38 MB, 582.10 MB, 594.62 MB, 614.76 MB, 630.67 MB, 643.73 MB, 648.33 MB, 657.24 MB, 670.12 MB, 675.21 MB, 684.38 MB, 692.94 MB, 697.77 MB, 697.78 MB, 697.78 MB, 697.78 MB, 697.78 MB - BytesReceived: 697.78 MB (731671994) - ConvertRowBatchTime: 902.630ms - DeserializeRowBatchTimer: 5s964ms - FirstBatchArrivalWaitTime: 796.122ms - PeakMemoryUsage: 0 - RowsReturned: 75.35M (75350113) - RowsReturnedRate: 638.24 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=24):(Total: 1s730ms, non-child: 3.926us, % non-child: 0.00%) BytesReceived(16s000ms): 8.50 MB, 10.40 MB, 10.40 MB, 10.40 MB, 10.40 MB, 10.40 MB, 10.40 MB, 10.40 MB, 10.40 MB, 10.40 MB, 10.40 MB, 10.40 MB, 10.40 MB, 10.40 MB, 10.40 MB, 10.40 MB, 10.40 MB, 10.40 MB, 10.40 MB, 10.40 MB, 10.40 MB, 10.40 MB, 10.40 MB, 10.40 MB, 10.40 MB, 10.40 MB, 10.40 MB, 10.40 MB, 10.40 MB, 10.40 MB, 10.40 MB, 10.40 MB, 10.40 MB, 10.40 MB, 10.40 MB, 10.40 MB, 10.40 MB, 10.40 MB, 10.40 MB, 10.40 MB - BytesReceived: 10.79 MB (11315724) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 67.759ms - FirstBatchArrivalWaitTime: 1s730ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:34f (host=vd1340.foo:22000):(Total: 52.066ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 942.53 MB, 6.67 GB, 14.00 GB, 20.67 GB, 27.51 GB, 34.39 GB, 41.35 GB, 48.34 GB, 54.92 GB, 61.43 GB, 67.79 GB, 74.34 GB, 81.29 GB, 87.95 GB, 94.19 GB, 101.04 GB, 107.59 GB, 114.51 GB, 120.52 GB, 126.90 GB, 133.21 GB, 137.38 GB, 142.20 GB, 147.99 GB, 152.73 GB, 156.02 GB, 153.77 GB, 153.64 GB, 156.94 GB, 158.16 GB, 155.24 GB, 151.45 GB, 153.05 GB, 154.81 GB, 156.59 GB, 152.99 GB, 155.24 GB, 155.41 GB, 156.28 GB, 158.31 GB ThreadUsage(16s000ms): 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.04 - BloomFilterBytes: 49.00 MB (51380224) - PeakMemoryUsage: 160.60 GB (172440982111) - PerHostPeakMemUsage: 169.56 GB (182064352999) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 1m59s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 1.75K (1754) - TotalThreadsTotalWallClockTime: 22s678ms - TotalThreadsSysTime: 2s327ms - TotalThreadsUserTime: 8s445ms - TotalThreadsVoluntaryContextSwitches: 20.70K (20698) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 51.989ms - ExecTreePrepareTime: 597.749us DataStreamSender (dst_id=28):(Total: 813.142us, non-child: 813.142us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.05 MB (1105280) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 611.856ms, non-child: 611.856ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 204.352ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 122 (122) - NumInstructions: 8.95K (8951) - OptimizationTime: 383.375ms - PeakMemoryUsage: 4.37 MB (4582912) - PrepareTime: 23.749ms HASH_JOIN_NODE (id=15):(Total: 1.131ms, non-child: 907.119us, % non-child: 80.20%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 451.92K (451915) - BuildTime: 130.186ms - PeakMemoryUsage: 153.09 MB (160524544) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=15): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 94.094ms - BuildRowsPartitioned: 451.92K (451915) - GetNewBlockTime: 301.433us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 33.075ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160449664) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=26):(Total: 2s077ms, non-child: 23.666ms, % non-child: 1.14%) BytesReceived(16s000ms): 5.38 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB - BytesReceived: 6.21 MB (6513198) - ConvertRowBatchTime: 11.137ms - DeserializeRowBatchTimer: 51.188ms - FirstBatchArrivalWaitTime: 1s209ms - PeakMemoryUsage: 0 - RowsReturned: 451.92K (451915) - RowsReturnedRate: 217.53 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=14):(Total: 873.897us, non-child: 745.575us, % non-child: 85.32%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 459.35K (459346) - BuildTime: 138.814ms - PeakMemoryUsage: 25.08 MB (26298624) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 80.485ms - BuildRowsPartitioned: 459.35K (459346) - GetNewBlockTime: 267.360us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 25.829ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 25.02 MB (26231936) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 4s196ms, non-child: 14.120ms, % non-child: 0.34%) BytesReceived(16s000ms): 5.82 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB - BytesReceived: 7.34 MB (7695228) - ConvertRowBatchTime: 10.963ms - DeserializeRowBatchTimer: 15.568ms - FirstBatchArrivalWaitTime: 2s121ms - PeakMemoryUsage: 0 - RowsReturned: 459.35K (459346) - RowsReturnedRate: 109.45 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=13):(Total: 585.356us, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 4.02B (4024988519) - BuildTime: 6m12s - PeakMemoryUsage: 160.16 GB (171968792832) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled, Spilled Runtime filters: 0 of 1 Runtime Filter Published, 1 Disabled - BuildRowsPartitionTime: 6m11s - BuildRowsPartitioned: 4.02B (4024988519) - GetNewBlockTime: 45s102ms - HashBuckets: 536.87M (536870912) - HashCollisions: 0 (0) - HashTablesBuildTime: 1m15s - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 160.16 GB (171968734336) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 5 (5) - UnpinTime: 155.763ms HASH_JOIN_NODE (id=12):(Total: 3m13s, non-child: 1m20s, % non-child: 41.43%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 40.20M (40202175) - BuildTime: 9s054ms - PeakMemoryUsage: 3.02 GB (3240189734) - ProbeRows: 75.37M (75366025) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1m6s - RowsReturned: 4.02B (4024988519) - RowsReturnedRate: 20.83 M/sec Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 5s787ms - BuildRowsPartitioned: 40.20M (40202175) - GetNewBlockTime: 3.312ms - HashBuckets: 67.11M (67108864) - HashCollisions: 0 (0) - HashTablesBuildTime: 3s218ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 3.02 GB (3240125568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 6s984ms, non-child: 1s482ms, % non-child: 21.22%) BytesReceived(16s000ms): 211.04 MB, 380.71 MB, 380.71 MB, 380.71 MB, 380.71 MB, 380.71 MB, 380.71 MB, 380.71 MB, 380.71 MB, 380.71 MB, 380.71 MB, 380.71 MB, 380.71 MB, 380.71 MB, 380.71 MB, 380.71 MB, 380.71 MB, 380.71 MB, 380.71 MB, 380.71 MB, 380.71 MB, 380.71 MB, 380.71 MB, 380.71 MB, 380.71 MB, 380.71 MB, 380.71 MB, 380.71 MB, 380.71 MB, 380.71 MB, 380.71 MB, 380.71 MB, 380.71 MB, 380.71 MB, 380.71 MB, 380.71 MB, 380.71 MB, 380.71 MB, 380.71 MB, 380.71 MB - BytesReceived: 380.71 MB (399203559) - ConvertRowBatchTime: 937.218ms - DeserializeRowBatchTimer: 1s461ms - FirstBatchArrivalWaitTime: 1s133ms - PeakMemoryUsage: 0 - RowsReturned: 40.20M (40202175) - RowsReturnedRate: 5.76 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=22):(Total: 1m46s, non-child: 1s398ms, % non-child: 1.31%) BytesReceived(16s000ms): 2.18 MB, 15.32 MB, 41.70 MB, 67.30 MB, 93.88 MB, 120.64 MB, 147.73 MB, 174.90 MB, 200.52 MB, 225.93 MB, 250.79 MB, 276.44 MB, 303.22 MB, 329.41 MB, 353.58 MB, 380.52 MB, 405.98 MB, 433.15 MB, 456.28 MB, 481.12 MB, 504.63 MB, 521.38 MB, 540.14 MB, 562.55 MB, 580.76 MB, 593.28 MB, 612.70 MB, 629.15 MB, 643.77 MB, 649.18 MB, 658.29 MB, 670.96 MB, 675.81 MB, 685.23 MB, 693.59 MB, 697.76 MB, 697.76 MB, 697.76 MB, 697.76 MB, 697.76 MB - BytesReceived: 697.76 MB (731658357) - ConvertRowBatchTime: 896.079ms - DeserializeRowBatchTimer: 7s839ms - FirstBatchArrivalWaitTime: 792.555ms - PeakMemoryUsage: 0 - RowsReturned: 75.37M (75366025) - RowsReturnedRate: 704.52 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=24):(Total: 1s739ms, non-child: 3.880us, % non-child: 0.00%) BytesReceived(16s000ms): 8.82 MB, 10.66 MB, 10.66 MB, 10.66 MB, 10.66 MB, 10.66 MB, 10.66 MB, 10.66 MB, 10.66 MB, 10.66 MB, 10.66 MB, 10.66 MB, 10.66 MB, 10.66 MB, 10.66 MB, 10.66 MB, 10.66 MB, 10.66 MB, 10.66 MB, 10.66 MB, 10.66 MB, 10.66 MB, 10.66 MB, 10.66 MB, 10.66 MB, 10.66 MB, 10.66 MB, 10.66 MB, 10.66 MB, 10.66 MB, 10.66 MB, 10.66 MB, 10.66 MB, 10.66 MB, 10.66 MB, 10.66 MB, 10.66 MB, 10.66 MB, 10.66 MB, 10.66 MB - BytesReceived: 11.30 MB (11852180) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 71.293ms - FirstBatchArrivalWaitTime: 1s739ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:337 (host=vd1342.foo:22000):(Total: 52.006ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 962.52 MB, 6.78 GB, 13.93 GB, 20.44 GB, 27.19 GB, 33.95 GB, 40.75 GB, 47.57 GB, 54.01 GB, 60.48 GB, 66.67 GB, 73.07 GB, 79.85 GB, 86.43 GB, 92.51 GB, 99.30 GB, 105.78 GB, 112.59 GB, 118.45 GB, 124.66 GB, 130.93 GB, 135.06 GB, 139.75 GB, 145.39 GB, 150.07 GB, 153.33 GB, 157.71 GB, 151.37 GB, 154.79 GB, 155.80 GB, 157.94 GB, 152.57 GB, 150.96 GB, 152.80 GB, 154.26 GB, 151.63 GB, 153.79 GB, 155.41 GB, 151.87 GB, 153.71 GB ThreadUsage(16s000ms): 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.03 - BloomFilterBytes: 49.00 MB (51380224) - PeakMemoryUsage: 160.60 GB (172442141263) - PerHostPeakMemUsage: 169.55 GB (182056923792) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 2m15s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 1.64K (1643) - TotalThreadsTotalWallClockTime: 22s543ms - TotalThreadsSysTime: 2s441ms - TotalThreadsUserTime: 8s236ms - TotalThreadsVoluntaryContextSwitches: 21.14K (21140) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 51.981ms - ExecTreePrepareTime: 600.447us DataStreamSender (dst_id=28):(Total: 837.079us, non-child: 837.079us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.05 MB (1105280) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 607.609ms, non-child: 607.609ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 201.012ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 122 (122) - NumInstructions: 8.95K (8951) - OptimizationTime: 384.256ms - PeakMemoryUsage: 4.37 MB (4582912) - PrepareTime: 21.908ms HASH_JOIN_NODE (id=15):(Total: 1.107ms, non-child: 1.081ms, % non-child: 97.70%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 451.92K (451915) - BuildTime: 137.753ms - PeakMemoryUsage: 153.09 MB (160524544) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=15): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 94.781ms - BuildRowsPartitioned: 451.92K (451915) - GetNewBlockTime: 421.077us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 40.105ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160449664) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=26):(Total: 2s092ms, non-child: 21.076ms, % non-child: 1.01%) BytesReceived(16s000ms): 5.38 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB - BytesReceived: 6.21 MB (6513198) - ConvertRowBatchTime: 11.916ms - DeserializeRowBatchTimer: 45.482ms - FirstBatchArrivalWaitTime: 1s219ms - PeakMemoryUsage: 0 - RowsReturned: 451.92K (451915) - RowsReturnedRate: 216.01 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=14):(Total: 732.692us, non-child: 898.759us, % non-child: 100.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 459.04K (459039) - BuildTime: 171.614ms - PeakMemoryUsage: 25.08 MB (26298624) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 105.677ms - BuildRowsPartitioned: 459.04K (459039) - GetNewBlockTime: 190.180us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 26.716ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 25.02 MB (26231936) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 4s147ms, non-child: 16.160ms, % non-child: 0.39%) BytesReceived(16s000ms): 5.82 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB - BytesReceived: 7.33 MB (7688192) - ConvertRowBatchTime: 12.369ms - DeserializeRowBatchTimer: 15.599ms - FirstBatchArrivalWaitTime: 2s123ms - PeakMemoryUsage: 0 - RowsReturned: 459.04K (459039) - RowsReturnedRate: 110.69 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=13):(Total: 485.642us, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 3.95B (3953606054) - BuildTime: 6m5s - PeakMemoryUsage: 157.31 GB (168914159840) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled, Spilled Runtime filters: 0 of 1 Runtime Filter Published, 1 Disabled - BuildRowsPartitionTime: 6m5s - BuildRowsPartitioned: 3.95B (3953606054) - GetNewBlockTime: 47s925ms - HashBuckets: 536.87M (536870912) - HashCollisions: 0 (0) - HashTablesBuildTime: 43s343ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 157.31 GB (168914068608) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 4 (4) - UnpinTime: 326.007ms HASH_JOIN_NODE (id=12):(Total: 3m20s, non-child: 1m12s, % non-child: 35.94%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 40.09M (40092577) - BuildTime: 9s140ms - PeakMemoryUsage: 3.02 GB (3240188696) - ProbeRows: 74.55M (74546405) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1m2s - RowsReturned: 3.95B (3953606054) - RowsReturnedRate: 19.70 M/sec Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 5s712ms - BuildRowsPartitioned: 40.09M (40092577) - GetNewBlockTime: 5.188ms - HashBuckets: 67.11M (67108864) - HashCollisions: 0 (0) - HashTablesBuildTime: 3s385ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 3.02 GB (3240125568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 6s746ms, non-child: 1s542ms, % non-child: 22.86%) BytesReceived(16s000ms): 208.73 MB, 379.71 MB, 379.71 MB, 379.71 MB, 379.71 MB, 379.71 MB, 379.71 MB, 379.71 MB, 379.71 MB, 379.71 MB, 379.71 MB, 379.71 MB, 379.71 MB, 379.71 MB, 379.71 MB, 379.71 MB, 379.71 MB, 379.71 MB, 379.71 MB, 379.71 MB, 379.71 MB, 379.71 MB, 379.71 MB, 379.71 MB, 379.71 MB, 379.71 MB, 379.71 MB, 379.71 MB, 379.71 MB, 379.71 MB, 379.71 MB, 379.71 MB, 379.71 MB, 379.71 MB, 379.71 MB, 379.71 MB, 379.71 MB, 379.71 MB, 379.71 MB, 379.71 MB - BytesReceived: 379.71 MB (398158665) - ConvertRowBatchTime: 949.722ms - DeserializeRowBatchTimer: 1s491ms - FirstBatchArrivalWaitTime: 1s138ms - PeakMemoryUsage: 0 - RowsReturned: 40.09M (40092577) - RowsReturnedRate: 5.94 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=22):(Total: 2m2s, non-child: 2s087ms, % non-child: 1.70%) BytesReceived(16s000ms): 2.11 MB, 15.07 MB, 41.27 MB, 66.70 MB, 93.02 MB, 119.38 MB, 146.01 MB, 172.77 MB, 198.03 MB, 223.17 MB, 247.62 MB, 272.91 MB, 299.34 MB, 325.34 MB, 349.30 MB, 375.95 MB, 401.17 MB, 428.02 MB, 450.81 MB, 475.34 MB, 498.56 MB, 515.08 MB, 533.59 MB, 555.65 MB, 573.73 MB, 586.07 MB, 605.26 MB, 621.63 MB, 635.81 MB, 640.30 MB, 648.70 MB, 661.46 MB, 667.30 MB, 675.45 MB, 685.81 MB, 689.98 MB, 689.98 MB, 689.98 MB, 689.98 MB, 689.98 MB - BytesReceived: 689.98 MB (723496137) - ConvertRowBatchTime: 843.814ms - DeserializeRowBatchTimer: 6s907ms - FirstBatchArrivalWaitTime: 805.570ms - PeakMemoryUsage: 0 - RowsReturned: 74.55M (74546405) - RowsReturnedRate: 608.04 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=24):(Total: 1s759ms, non-child: 3.913us, % non-child: 0.00%) BytesReceived(16s000ms): 8.01 MB, 9.75 MB, 9.75 MB, 9.75 MB, 9.75 MB, 9.75 MB, 9.75 MB, 9.75 MB, 9.75 MB, 9.75 MB, 9.75 MB, 9.75 MB, 9.75 MB, 9.75 MB, 9.75 MB, 9.75 MB, 9.75 MB, 9.75 MB, 9.75 MB, 9.75 MB, 9.75 MB, 9.75 MB, 9.75 MB, 9.75 MB, 9.75 MB, 9.75 MB, 9.75 MB, 9.75 MB, 9.75 MB, 9.75 MB, 9.75 MB, 9.75 MB, 9.75 MB, 9.75 MB, 9.75 MB, 9.75 MB, 9.75 MB, 9.75 MB, 9.75 MB, 9.75 MB - BytesReceived: 9.75 MB (10226416) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 66.760ms - FirstBatchArrivalWaitTime: 1s759ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:369 (host=va1030.foo:22000):(Total: 51.214ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 915.21 MB, 6.96 GB, 14.08 GB, 20.64 GB, 27.41 GB, 34.24 GB, 41.22 GB, 48.27 GB, 54.73 GB, 61.22 GB, 67.51 GB, 74.02 GB, 80.80 GB, 86.99 GB, 93.36 GB, 100.14 GB, 106.67 GB, 113.31 GB, 119.59 GB, 125.72 GB, 131.85 GB, 136.18 GB, 140.82 GB, 146.49 GB, 151.15 GB, 154.42 GB, 156.78 GB, 152.34 GB, 155.73 GB, 156.15 GB, 157.03 GB, 152.69 GB, 151.60 GB, 152.02 GB, 155.42 GB, 146.76 GB, 146.94 GB, 153.63 GB, 154.19 GB, 152.06 GB ThreadUsage(16s000ms): 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.03 - BloomFilterBytes: 49.00 MB (51380224) - PeakMemoryUsage: 160.61 GB (172456257417) - PerHostPeakMemUsage: 169.57 GB (182077449644) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 2m14s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 1.71K (1708) - TotalThreadsTotalWallClockTime: 22s519ms - TotalThreadsSysTime: 2s340ms - TotalThreadsUserTime: 8s019ms - TotalThreadsVoluntaryContextSwitches: 21.11K (21108) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 51.167ms - ExecTreePrepareTime: 565.368us DataStreamSender (dst_id=28):(Total: 790.476us, non-child: 790.476us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.05 MB (1105280) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 628.467ms, non-child: 628.467ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 206.745ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 122 (122) - NumInstructions: 8.95K (8951) - OptimizationTime: 400.046ms - PeakMemoryUsage: 4.37 MB (4582912) - PrepareTime: 21.281ms HASH_JOIN_NODE (id=15):(Total: 1.076ms, non-child: 893.503us, % non-child: 83.01%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 451.92K (451915) - BuildTime: 125.339ms - PeakMemoryUsage: 153.09 MB (160524544) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=15): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 91.445ms - BuildRowsPartitioned: 451.92K (451915) - GetNewBlockTime: 382.860us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 31.294ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160449664) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=26):(Total: 2s047ms, non-child: 26.098ms, % non-child: 1.27%) BytesReceived(16s000ms): 5.38 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB - BytesReceived: 6.21 MB (6513198) - ConvertRowBatchTime: 11.334ms - DeserializeRowBatchTimer: 55.434ms - FirstBatchArrivalWaitTime: 1s186ms - PeakMemoryUsage: 0 - RowsReturned: 451.92K (451915) - RowsReturnedRate: 220.72 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=14):(Total: 798.692us, non-child: 893.259us, % non-child: 100.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 458.57K (458566) - BuildTime: 191.346ms - PeakMemoryUsage: 25.08 MB (26298624) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 114.162ms - BuildRowsPartitioned: 458.57K (458566) - GetNewBlockTime: 192.447us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 27.949ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 25.02 MB (26231936) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 4s147ms, non-child: 17.349ms, % non-child: 0.42%) BytesReceived(16s000ms): 5.81 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB - BytesReceived: 7.33 MB (7681954) - ConvertRowBatchTime: 12.768ms - DeserializeRowBatchTimer: 17.075ms - FirstBatchArrivalWaitTime: 2s094ms - PeakMemoryUsage: 0 - RowsReturned: 458.57K (458566) - RowsReturnedRate: 110.57 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=13):(Total: 565.285us, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 3.98B (3976350807) - BuildTime: 6m4s - PeakMemoryUsage: 157.31 GB (168914127104) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled, Spilled Runtime filters: 0 of 1 Runtime Filter Published, 1 Disabled - BuildRowsPartitionTime: 6m3s - BuildRowsPartitioned: 3.98B (3976350807) - GetNewBlockTime: 45s656ms - HashBuckets: 536.87M (536870912) - HashCollisions: 0 (0) - HashTablesBuildTime: 1m - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 157.31 GB (168914068608) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 4 (4) - UnpinTime: 285.807ms HASH_JOIN_NODE (id=12):(Total: 3m18s, non-child: 1m10s, % non-child: 35.44%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 40.15M (40149516) - BuildTime: 8s525ms - PeakMemoryUsage: 3.02 GB (3240188388) - ProbeRows: 75.09M (75089661) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1m1s - RowsReturned: 3.98B (3976350807) - RowsReturnedRate: 20.01 M/sec Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 5s685ms - BuildRowsPartitioned: 40.15M (40149516) - GetNewBlockTime: 3.588ms - HashBuckets: 67.11M (67108864) - HashCollisions: 0 (0) - HashTablesBuildTime: 2s787ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 3.02 GB (3240125568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 7s377ms, non-child: 1s561ms, % non-child: 21.16%) BytesReceived(16s000ms): 210.38 MB, 380.20 MB, 380.20 MB, 380.20 MB, 380.20 MB, 380.20 MB, 380.20 MB, 380.20 MB, 380.20 MB, 380.20 MB, 380.20 MB, 380.20 MB, 380.20 MB, 380.20 MB, 380.20 MB, 380.20 MB, 380.20 MB, 380.20 MB, 380.20 MB, 380.20 MB, 380.20 MB, 380.20 MB, 380.20 MB, 380.20 MB, 380.20 MB, 380.20 MB, 380.20 MB, 380.20 MB, 380.20 MB, 380.20 MB, 380.20 MB, 380.20 MB, 380.20 MB, 380.20 MB, 380.20 MB, 380.20 MB, 380.20 MB, 380.20 MB, 380.20 MB, 380.20 MB - BytesReceived: 380.20 MB (398673177) - ConvertRowBatchTime: 963.889ms - DeserializeRowBatchTimer: 1s506ms - FirstBatchArrivalWaitTime: 1s110ms - PeakMemoryUsage: 0 - RowsReturned: 40.15M (40149516) - RowsReturnedRate: 5.44 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=22):(Total: 2m1s, non-child: 1s315ms, % non-child: 1.08%) BytesReceived(16s000ms): 2.16 MB, 15.42 MB, 41.97 MB, 67.65 MB, 94.15 MB, 120.83 MB, 148.42 MB, 175.90 MB, 201.28 MB, 226.56 MB, 251.34 MB, 276.94 MB, 303.35 MB, 329.22 MB, 353.07 MB, 379.88 MB, 405.32 MB, 432.42 MB, 455.33 MB, 480.41 MB, 503.34 MB, 520.22 MB, 538.90 MB, 561.02 MB, 579.05 MB, 591.43 MB, 611.00 MB, 627.11 MB, 640.91 MB, 645.43 MB, 653.93 MB, 666.75 MB, 672.28 MB, 680.71 MB, 689.48 MB, 694.89 MB, 694.90 MB, 694.90 MB, 694.90 MB, 694.90 MB - BytesReceived: 694.90 MB (728653152) - ConvertRowBatchTime: 862.891ms - DeserializeRowBatchTimer: 6s339ms - FirstBatchArrivalWaitTime: 771.489ms - PeakMemoryUsage: 0 - RowsReturned: 75.09M (75089661) - RowsReturnedRate: 617.21 K/sec - SendersBlockedTimer: 10s234ms - SendersBlockedTotalTimer(*): 8m17s EXCHANGE_NODE (id=24):(Total: 1s704ms, non-child: 4.018us, % non-child: 0.00%) BytesReceived(16s000ms): 8.53 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.33 MB, 10.39 MB, 10.42 MB - BytesReceived: 10.65 MB (11167920) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 71.962ms - FirstBatchArrivalWaitTime: 1s704ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:36b (host=vc1529.foo:22000):(Total: 51.030ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 887.53 MB, 6.36 GB, 13.46 GB, 20.58 GB, 27.59 GB, 34.41 GB, 41.20 GB, 47.96 GB, 54.66 GB, 61.20 GB, 67.66 GB, 74.58 GB, 81.43 GB, 87.99 GB, 94.24 GB, 100.98 GB, 107.48 GB, 113.86 GB, 120.17 GB, 126.54 GB, 132.65 GB, 136.94 GB, 141.89 GB, 147.56 GB, 152.28 GB, 155.55 GB, 155.92 GB, 153.43 GB, 156.78 GB, 157.97 GB, 155.44 GB, 151.71 GB, 152.77 GB, 155.09 GB, 156.68 GB, 152.92 GB, 153.47 GB, 153.61 GB, 153.58 GB, 153.50 GB ThreadUsage(16s000ms): 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.03 - BloomFilterBytes: 49.00 MB (51380224) - PeakMemoryUsage: 160.60 GB (172447032319) - PerHostPeakMemUsage: 169.56 GB (182068133972) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 1m28s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 1.41K (1414) - TotalThreadsTotalWallClockTime: 22s925ms - TotalThreadsSysTime: 2s235ms - TotalThreadsUserTime: 8s136ms - TotalThreadsVoluntaryContextSwitches: 23.95K (23953) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 51.004ms - ExecTreePrepareTime: 556.781us DataStreamSender (dst_id=28):(Total: 799.634us, non-child: 799.634us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.05 MB (1105280) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 593.849ms, non-child: 593.849ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 191.026ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 122 (122) - NumInstructions: 8.95K (8951) - OptimizationTime: 381.576ms - PeakMemoryUsage: 4.37 MB (4582912) - PrepareTime: 20.867ms HASH_JOIN_NODE (id=15):(Total: 1.060ms, non-child: 916.677us, % non-child: 86.46%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 451.92K (451915) - BuildTime: 131.551ms - PeakMemoryUsage: 153.09 MB (160524544) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=15): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 100.447ms - BuildRowsPartitioned: 451.92K (451915) - GetNewBlockTime: 392.213us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 28.685ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160449664) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=26):(Total: 2s084ms, non-child: 26.733ms, % non-child: 1.28%) BytesReceived(16s000ms): 5.33 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB - BytesReceived: 6.21 MB (6513198) - ConvertRowBatchTime: 12.815ms - DeserializeRowBatchTimer: 51.703ms - FirstBatchArrivalWaitTime: 1s217ms - PeakMemoryUsage: 0 - RowsReturned: 451.92K (451915) - RowsReturnedRate: 216.79 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=14):(Total: 831.024us, non-child: 840.205us, % non-child: 100.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 458.92K (458924) - BuildTime: 152.612ms - PeakMemoryUsage: 25.08 MB (26298624) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 87.257ms - BuildRowsPartitioned: 458.92K (458924) - GetNewBlockTime: 289.685us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 28.003ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 25.02 MB (26231936) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 4s217ms, non-child: 15.545ms, % non-child: 0.37%) BytesReceived(16s000ms): 5.79 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB - BytesReceived: 7.33 MB (7686201) - ConvertRowBatchTime: 11.438ms - DeserializeRowBatchTimer: 17.210ms - FirstBatchArrivalWaitTime: 2s126ms - PeakMemoryUsage: 0 - RowsReturned: 458.92K (458924) - RowsReturnedRate: 108.82 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=13):(Total: 594.109us, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 4.01B (4010074843) - BuildTime: 6m49s - PeakMemoryUsage: 157.31 GB (168914159840) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled, Spilled Runtime filters: 0 of 1 Runtime Filter Published, 1 Disabled - BuildRowsPartitionTime: 6m49s - BuildRowsPartitioned: 4.01B (4010074843) - GetNewBlockTime: 41s953ms - HashBuckets: 536.87M (536870912) - HashCollisions: 0 (0) - HashTablesBuildTime: 55s695ms - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 157.31 GB (168914068608) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 4 (4) - UnpinTime: 139.130ms HASH_JOIN_NODE (id=12):(Total: 2m36s, non-child: 1m14s, % non-child: 47.71%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 40.11M (40106877) - BuildTime: 8s559ms - PeakMemoryUsage: 3.02 GB (3240188128) - ProbeRows: 75.84M (75837745) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1m5s - RowsReturned: 4.01B (4010074843) - RowsReturnedRate: 25.62 M/sec Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 5s430ms - BuildRowsPartitioned: 40.11M (40106877) - GetNewBlockTime: 3.226ms - HashBuckets: 67.11M (67108864) - HashCollisions: 0 (0) - HashTablesBuildTime: 3s077ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 3.02 GB (3240125568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 7s689ms, non-child: 1s614ms, % non-child: 21.00%) BytesReceived(16s000ms): 207.28 MB, 379.84 MB, 379.84 MB, 379.84 MB, 379.84 MB, 379.84 MB, 379.84 MB, 379.84 MB, 379.84 MB, 379.84 MB, 379.84 MB, 379.84 MB, 379.84 MB, 379.84 MB, 379.84 MB, 379.84 MB, 379.84 MB, 379.84 MB, 379.84 MB, 379.84 MB, 379.84 MB, 379.84 MB, 379.84 MB, 379.84 MB, 379.84 MB, 379.84 MB, 379.84 MB, 379.84 MB, 379.84 MB, 379.84 MB, 379.84 MB, 379.84 MB, 379.84 MB, 379.84 MB, 379.84 MB, 379.84 MB, 379.84 MB, 379.84 MB, 379.84 MB, 379.84 MB - BytesReceived: 379.84 MB (398292051) - ConvertRowBatchTime: 935.656ms - DeserializeRowBatchTimer: 1s664ms - FirstBatchArrivalWaitTime: 1s145ms - PeakMemoryUsage: 0 - RowsReturned: 40.11M (40106877) - RowsReturnedRate: 5.22 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=22):(Total: 1m14s, non-child: 1s376ms, % non-child: 1.84%) BytesReceived(16s000ms): 2.17 MB, 15.35 MB, 42.23 MB, 68.14 MB, 94.92 MB, 121.71 MB, 148.79 MB, 176.08 MB, 201.87 MB, 227.54 MB, 254.27 MB, 280.12 MB, 306.86 MB, 333.12 MB, 357.33 MB, 384.59 MB, 410.15 MB, 437.38 MB, 460.16 MB, 485.61 MB, 508.18 MB, 525.28 MB, 544.20 MB, 566.42 MB, 584.53 MB, 597.09 MB, 617.07 MB, 633.23 MB, 646.86 MB, 652.93 MB, 662.73 MB, 675.11 MB, 679.80 MB, 689.99 MB, 698.38 MB, 701.85 MB, 701.85 MB, 701.85 MB, 701.85 MB, 701.85 MB - BytesReceived: 701.85 MB (735948271) - ConvertRowBatchTime: 864.219ms - DeserializeRowBatchTimer: 6s578ms - FirstBatchArrivalWaitTime: 804.007ms - PeakMemoryUsage: 0 - RowsReturned: 75.84M (75837745) - RowsReturnedRate: 1.01 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=24):(Total: 1s742ms, non-child: 4.671us, % non-child: 0.00%) BytesReceived(16s000ms): 8.11 MB, 9.94 MB, 9.94 MB, 9.94 MB, 9.94 MB, 9.94 MB, 9.94 MB, 9.94 MB, 9.94 MB, 9.94 MB, 9.94 MB, 9.94 MB, 9.94 MB, 9.94 MB, 9.94 MB, 9.94 MB, 9.94 MB, 9.94 MB, 9.94 MB, 9.94 MB, 9.94 MB, 9.94 MB, 9.94 MB, 9.94 MB, 9.94 MB, 9.94 MB, 9.94 MB, 9.94 MB, 9.94 MB, 9.94 MB, 9.94 MB, 9.94 MB, 9.94 MB, 9.94 MB, 9.94 MB, 9.94 MB, 9.94 MB, 9.94 MB, 9.94 MB, 9.94 MB - BytesReceived: 9.94 MB (10418314) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 71.084ms - FirstBatchArrivalWaitTime: 1s742ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:330 (host=vc1520.foo:22000):(Total: 50.978ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 1.01 GB, 7.25 GB, 14.48 GB, 21.24 GB, 28.25 GB, 35.26 GB, 42.35 GB, 49.45 GB, 56.05 GB, 62.67 GB, 69.14 GB, 75.77 GB, 82.79 GB, 89.48 GB, 95.92 GB, 102.82 GB, 109.59 GB, 116.51 GB, 122.94 GB, 129.30 GB, 135.73 GB, 139.89 GB, 144.88 GB, 150.71 GB, 155.59 GB, 156.53 GB, 153.63 GB, 157.52 GB, 158.65 GB, 151.58 GB, 152.68 GB, 153.77 GB, 156.36 GB, 158.82 GB, 157.22 GB, 153.21 GB, 156.48 GB, 155.89 GB, 157.04 GB, 157.49 GB ThreadUsage(16s000ms): 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.03 - BloomFilterBytes: 49.00 MB (51380224) - PeakMemoryUsage: 160.62 GB (172465606719) - PerHostPeakMemUsage: 169.57 GB (182072367876) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 1m40s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 1.55K (1552) - TotalThreadsTotalWallClockTime: 21s822ms - TotalThreadsSysTime: 2s165ms - TotalThreadsUserTime: 8s012ms - TotalThreadsVoluntaryContextSwitches: 22.32K (22320) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 50.923ms - ExecTreePrepareTime: 631.431us DataStreamSender (dst_id=28):(Total: 835.122us, non-child: 835.122us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.05 MB (1105280) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 624.572ms, non-child: 624.572ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 201.379ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 122 (122) - NumInstructions: 8.95K (8951) - OptimizationTime: 401.328ms - PeakMemoryUsage: 4.37 MB (4582912) - PrepareTime: 21.439ms HASH_JOIN_NODE (id=15):(Total: 1.192ms, non-child: 960.343us, % non-child: 80.51%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 451.92K (451915) - BuildTime: 139.399ms - PeakMemoryUsage: 153.09 MB (160524544) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=15): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 102.522ms - BuildRowsPartitioned: 451.92K (451915) - GetNewBlockTime: 408.968us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 33.918ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160449664) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=26):(Total: 2s052ms, non-child: 33.570ms, % non-child: 1.64%) BytesReceived(16s000ms): 5.44 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB - BytesReceived: 6.21 MB (6513198) - ConvertRowBatchTime: 12.935ms - DeserializeRowBatchTimer: 58.269ms - FirstBatchArrivalWaitTime: 1s202ms - PeakMemoryUsage: 0 - RowsReturned: 451.92K (451915) - RowsReturnedRate: 220.22 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=14):(Total: 943.484us, non-child: 838.575us, % non-child: 88.88%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 460.00K (460002) - BuildTime: 147.485ms - PeakMemoryUsage: 25.08 MB (26298624) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 91.884ms - BuildRowsPartitioned: 460.00K (460002) - GetNewBlockTime: 152.164us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 22.108ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 25.02 MB (26231936) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 4s142ms, non-child: 16.245ms, % non-child: 0.39%) BytesReceived(16s000ms): 5.96 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB - BytesReceived: 7.35 MB (7705544) - ConvertRowBatchTime: 12.081ms - DeserializeRowBatchTimer: 17.426ms - FirstBatchArrivalWaitTime: 2s116ms - PeakMemoryUsage: 0 - RowsReturned: 460.00K (460002) - RowsReturnedRate: 111.03 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=13):(Total: 677.010us, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 4.10B (4102139053) - BuildTime: 6m34s - PeakMemoryUsage: 159.91 GB (171700357376) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled, Spilled Runtime filters: 0 of 1 Runtime Filter Published, 1 Disabled - BuildRowsPartitionTime: 6m33s - BuildRowsPartitioned: 4.10B (4102139053) - GetNewBlockTime: 47s183ms - HashBuckets: 536.87M (536870912) - HashCollisions: 0 (0) - HashTablesBuildTime: 32s964ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 159.91 GB (171700298880) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 4 (4) - UnpinTime: 283.059ms HASH_JOIN_NODE (id=12):(Total: 2m48s, non-child: 1m14s, % non-child: 44.25%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 40.21M (40213999) - BuildTime: 8s411ms - PeakMemoryUsage: 3.02 GB (3240192848) - ProbeRows: 77.54M (77542754) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1m5s - RowsReturned: 4.10B (4102139053) - RowsReturnedRate: 24.30 M/sec Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 5s593ms - BuildRowsPartitioned: 40.21M (40213999) - GetNewBlockTime: 3.110ms - HashBuckets: 67.11M (67108864) - HashCollisions: 0 (0) - HashTablesBuildTime: 2s768ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 3.02 GB (3240125568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 6s840ms, non-child: 1s546ms, % non-child: 22.61%) BytesReceived(16s000ms): 215.73 MB, 380.84 MB, 380.84 MB, 380.84 MB, 380.84 MB, 380.84 MB, 380.84 MB, 380.84 MB, 380.84 MB, 380.84 MB, 380.84 MB, 380.84 MB, 380.84 MB, 380.84 MB, 380.84 MB, 380.84 MB, 380.84 MB, 380.84 MB, 380.84 MB, 380.84 MB, 380.84 MB, 380.84 MB, 380.84 MB, 380.84 MB, 380.84 MB, 380.84 MB, 380.84 MB, 380.84 MB, 380.84 MB, 380.84 MB, 380.84 MB, 380.84 MB, 380.84 MB, 380.84 MB, 380.84 MB, 380.84 MB, 380.84 MB, 380.84 MB, 380.84 MB, 380.84 MB - BytesReceived: 380.84 MB (399335810) - ConvertRowBatchTime: 956.825ms - DeserializeRowBatchTimer: 1s549ms - FirstBatchArrivalWaitTime: 1s123ms - PeakMemoryUsage: 0 - RowsReturned: 40.21M (40213999) - RowsReturnedRate: 5.88 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=22):(Total: 1m28s, non-child: 1s374ms, % non-child: 1.56%) BytesReceived(16s000ms): 2.27 MB, 16.22 MB, 43.56 MB, 70.03 MB, 97.47 MB, 124.93 MB, 152.71 MB, 180.57 MB, 206.87 MB, 232.87 MB, 258.39 MB, 284.60 MB, 311.90 MB, 338.84 MB, 363.79 MB, 391.41 MB, 417.64 MB, 445.66 MB, 469.49 MB, 495.27 MB, 519.32 MB, 536.63 MB, 555.75 MB, 578.61 MB, 597.33 MB, 612.44 MB, 634.74 MB, 651.03 MB, 663.07 MB, 668.13 MB, 677.74 MB, 690.54 MB, 695.35 MB, 705.46 MB, 714.01 MB, 717.79 MB, 717.79 MB, 717.79 MB, 717.79 MB, 717.79 MB - BytesReceived: 717.79 MB (752653504) - ConvertRowBatchTime: 889.530ms - DeserializeRowBatchTimer: 6s268ms - FirstBatchArrivalWaitTime: 791.120ms - PeakMemoryUsage: 0 - RowsReturned: 77.54M (77542754) - RowsReturnedRate: 880.72 K/sec - SendersBlockedTimer: 16s321ms - SendersBlockedTotalTimer(*): 22m45s EXCHANGE_NODE (id=24):(Total: 1s744ms, non-child: 3.741us, % non-child: 0.00%) BytesReceived(16s000ms): 8.32 MB, 9.86 MB, 9.86 MB, 9.86 MB, 9.86 MB, 9.86 MB, 9.86 MB, 9.86 MB, 9.86 MB, 9.86 MB, 9.86 MB, 9.86 MB, 9.86 MB, 9.86 MB, 9.86 MB, 9.86 MB, 9.86 MB, 9.86 MB, 9.86 MB, 9.86 MB, 9.86 MB, 9.86 MB, 9.86 MB, 9.86 MB, 9.86 MB, 9.86 MB, 9.86 MB, 9.86 MB, 9.86 MB, 9.86 MB, 9.86 MB, 9.86 MB, 9.86 MB, 9.86 MB, 9.86 MB, 9.86 MB, 9.86 MB, 9.86 MB, 9.86 MB, 9.86 MB - BytesReceived: 9.86 MB (10342718) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 78.662ms - FirstBatchArrivalWaitTime: 1s744ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:34b (host=va1031.foo:22000):(Total: 50.956ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 1016.04 MB, 6.91 GB, 14.04 GB, 20.51 GB, 27.16 GB, 33.82 GB, 40.59 GB, 47.34 GB, 53.69 GB, 60.09 GB, 66.24 GB, 72.62 GB, 79.27 GB, 85.58 GB, 91.77 GB, 98.41 GB, 104.84 GB, 111.43 GB, 117.54 GB, 123.69 GB, 129.61 GB, 133.78 GB, 138.35 GB, 143.94 GB, 148.55 GB, 151.79 GB, 157.00 GB, 154.11 GB, 153.32 GB, 154.29 GB, 156.53 GB, 159.45 GB, 155.54 GB, 151.01 GB, 152.70 GB, 153.11 GB, 158.71 GB, 149.59 GB, 150.53 GB, 151.23 GB ThreadUsage(16s000ms): 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.03 - BloomFilterBytes: 49.00 MB (51380224) - PeakMemoryUsage: 160.60 GB (172446975775) - PerHostPeakMemUsage: 169.55 GB (182054131090) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 2m22s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 1.70K (1699) - TotalThreadsTotalWallClockTime: 22s293ms - TotalThreadsSysTime: 2s314ms - TotalThreadsUserTime: 8s192ms - TotalThreadsVoluntaryContextSwitches: 20.49K (20492) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 50.916ms - ExecTreePrepareTime: 601.349us DataStreamSender (dst_id=28):(Total: 901.017us, non-child: 901.017us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.05 MB (1105280) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 617.360ms, non-child: 617.360ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 205.423ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 122 (122) - NumInstructions: 8.95K (8951) - OptimizationTime: 391.828ms - PeakMemoryUsage: 4.37 MB (4582912) - PrepareTime: 19.723ms HASH_JOIN_NODE (id=15):(Total: 1.153ms, non-child: 748.237us, % non-child: 64.84%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 451.92K (451915) - BuildTime: 117.726ms - PeakMemoryUsage: 153.09 MB (160524544) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=15): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 83.184ms - BuildRowsPartitioned: 451.92K (451915) - GetNewBlockTime: 358.130us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 31.760ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160449664) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=26):(Total: 2s088ms, non-child: 22.025ms, % non-child: 1.05%) BytesReceived(16s000ms): 5.51 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB - BytesReceived: 6.21 MB (6513198) - ConvertRowBatchTime: 10.689ms - DeserializeRowBatchTimer: 48.459ms - FirstBatchArrivalWaitTime: 1s199ms - PeakMemoryUsage: 0 - RowsReturned: 451.92K (451915) - RowsReturnedRate: 216.34 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=14):(Total: 904.797us, non-child: 888.086us, % non-child: 98.15%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 459.86K (459855) - BuildTime: 160.419ms - PeakMemoryUsage: 25.08 MB (26298624) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 97.729ms - BuildRowsPartitioned: 459.86K (459855) - GetNewBlockTime: 138.171us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 23.835ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 25.02 MB (26231936) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 4s155ms, non-child: 15.520ms, % non-child: 0.37%) BytesReceived(16s000ms): 6.01 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB - BytesReceived: 7.35 MB (7702091) - ConvertRowBatchTime: 11.694ms - DeserializeRowBatchTimer: 16.199ms - FirstBatchArrivalWaitTime: 2s108ms - PeakMemoryUsage: 0 - RowsReturned: 459.86K (459855) - RowsReturnedRate: 110.67 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=13):(Total: 607.557us, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 3.91B (3909661505) - BuildTime: 6m9s - PeakMemoryUsage: 160.16 GB (171968203008) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled, Spilled Runtime filters: 0 of 1 Runtime Filter Published, 1 Disabled - BuildRowsPartitionTime: 6m9s - BuildRowsPartitioned: 3.91B (3909661505) - GetNewBlockTime: 32s921ms - HashBuckets: 536.87M (536870912) - HashCollisions: 0 (0) - HashTablesBuildTime: 47s177ms - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 160.16 GB (171968144512) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 4 (4) - UnpinTime: 259.144ms HASH_JOIN_NODE (id=12):(Total: 3m26s, non-child: 1m10s, % non-child: 34.14%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 40.20M (40198146) - BuildTime: 8s742ms - PeakMemoryUsage: 3.02 GB (3240192224) - ProbeRows: 73.68M (73675735) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1m - RowsReturned: 3.91B (3909661505) - RowsReturnedRate: 18.96 M/sec Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 5s821ms - BuildRowsPartitioned: 40.20M (40198146) - GetNewBlockTime: 3.830ms - HashBuckets: 67.11M (67108864) - HashCollisions: 0 (0) - HashTablesBuildTime: 2s872ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 3.02 GB (3240125568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 6s928ms, non-child: 1s525ms, % non-child: 22.02%) BytesReceived(16s000ms): 218.54 MB, 380.72 MB, 380.72 MB, 380.72 MB, 380.72 MB, 380.72 MB, 380.72 MB, 380.72 MB, 380.72 MB, 380.72 MB, 380.72 MB, 380.72 MB, 380.72 MB, 380.72 MB, 380.72 MB, 380.72 MB, 380.72 MB, 380.72 MB, 380.72 MB, 380.72 MB, 380.72 MB, 380.72 MB, 380.72 MB, 380.72 MB, 380.72 MB, 380.72 MB, 380.72 MB, 380.72 MB, 380.72 MB, 380.72 MB, 380.72 MB, 380.72 MB, 380.72 MB, 380.72 MB, 380.72 MB, 380.72 MB, 380.72 MB, 380.72 MB, 380.72 MB, 380.72 MB - BytesReceived: 380.72 MB (399210464) - ConvertRowBatchTime: 940.363ms - DeserializeRowBatchTimer: 1s494ms - FirstBatchArrivalWaitTime: 1s130ms - PeakMemoryUsage: 0 - RowsReturned: 40.20M (40198146) - RowsReturnedRate: 5.80 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=22):(Total: 2m9s, non-child: 1s295ms, % non-child: 1.00%) BytesReceived(16s000ms): 2.10 MB, 15.69 MB, 41.69 MB, 66.94 MB, 92.90 MB, 118.96 MB, 145.46 MB, 172.02 MB, 197.05 MB, 221.93 MB, 246.24 MB, 271.26 MB, 297.24 MB, 322.88 MB, 346.49 MB, 372.87 MB, 397.86 MB, 424.50 MB, 446.90 MB, 471.28 MB, 493.91 MB, 510.35 MB, 528.65 MB, 550.35 MB, 568.20 MB, 580.40 MB, 602.03 MB, 618.67 MB, 630.12 MB, 634.85 MB, 644.04 MB, 656.22 MB, 660.83 MB, 670.48 MB, 678.63 MB, 682.28 MB, 682.28 MB, 682.28 MB, 682.28 MB, 682.28 MB - BytesReceived: 682.28 MB (715419763) - ConvertRowBatchTime: 819.629ms - DeserializeRowBatchTimer: 5s558ms - FirstBatchArrivalWaitTime: 788.749ms - PeakMemoryUsage: 0 - RowsReturned: 73.68M (73675735) - RowsReturnedRate: 568.15 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=24):(Total: 1s724ms, non-child: 3.316us, % non-child: 0.00%) BytesReceived(16s000ms): 8.69 MB, 10.27 MB, 10.27 MB, 10.27 MB, 10.27 MB, 10.27 MB, 10.27 MB, 10.27 MB, 10.27 MB, 10.27 MB, 10.27 MB, 10.27 MB, 10.27 MB, 10.27 MB, 10.27 MB, 10.27 MB, 10.27 MB, 10.27 MB, 10.27 MB, 10.27 MB, 10.27 MB, 10.27 MB, 10.27 MB, 10.27 MB, 10.27 MB, 10.27 MB, 10.27 MB, 10.27 MB, 10.27 MB, 10.27 MB, 10.27 MB, 10.27 MB, 10.27 MB, 10.27 MB, 10.27 MB, 10.27 MB, 10.27 MB, 10.31 MB, 10.41 MB, 10.43 MB - BytesReceived: 10.53 MB (11045729) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 68.895ms - FirstBatchArrivalWaitTime: 1s724ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:36a (host=vd1326.foo:22000):(Total: 50.786ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 930.22 MB, 7.06 GB, 14.10 GB, 20.70 GB, 27.48 GB, 34.31 GB, 41.17 GB, 48.02 GB, 54.44 GB, 60.87 GB, 67.10 GB, 73.55 GB, 80.33 GB, 86.90 GB, 92.99 GB, 99.85 GB, 106.27 GB, 113.19 GB, 119.38 GB, 126.62 GB, 132.13 GB, 136.48 GB, 141.24 GB, 146.92 GB, 151.50 GB, 154.70 GB, 156.00 GB, 152.64 GB, 155.78 GB, 156.73 GB, 159.06 GB, 150.66 GB, 151.43 GB, 153.73 GB, 155.59 GB, 150.56 GB, 154.19 GB, 151.48 GB, 156.27 GB, 155.50 GB ThreadUsage(16s000ms): 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.03 - BloomFilterBytes: 49.00 MB (51380224) - PeakMemoryUsage: 160.60 GB (172447044479) - PerHostPeakMemUsage: 169.56 GB (182062806114) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 2m35s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 1.83K (1834) - TotalThreadsTotalWallClockTime: 22s468ms - TotalThreadsSysTime: 2s166ms - TotalThreadsUserTime: 8s129ms - TotalThreadsVoluntaryContextSwitches: 20.56K (20556) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 50.738ms - ExecTreePrepareTime: 538.857us DataStreamSender (dst_id=28):(Total: 977.390us, non-child: 977.390us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.05 MB (1105280) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 607.685ms, non-child: 607.685ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 199.136ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 122 (122) - NumInstructions: 8.95K (8951) - OptimizationTime: 388.418ms - PeakMemoryUsage: 4.37 MB (4582912) - PrepareTime: 19.742ms HASH_JOIN_NODE (id=15):(Total: 987.379us, non-child: 1.020ms, % non-child: 100.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 451.92K (451915) - BuildTime: 134.446ms - PeakMemoryUsage: 153.09 MB (160524544) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=15): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 95.550ms - BuildRowsPartitioned: 451.92K (451915) - GetNewBlockTime: 467.695us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 35.715ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160449664) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=26):(Total: 2s065ms, non-child: 23.462ms, % non-child: 1.14%) BytesReceived(16s000ms): 5.38 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB - BytesReceived: 6.21 MB (6513198) - ConvertRowBatchTime: 11.749ms - DeserializeRowBatchTimer: 47.161ms - FirstBatchArrivalWaitTime: 1s202ms - PeakMemoryUsage: 0 - RowsReturned: 451.92K (451915) - RowsReturnedRate: 218.83 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=14):(Total: 740.637us, non-child: 808.419us, % non-child: 100.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 458.35K (458345) - BuildTime: 150.837ms - PeakMemoryUsage: 25.08 MB (26298624) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 90.844ms - BuildRowsPartitioned: 458.35K (458345) - GetNewBlockTime: 226.721us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 27.111ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 25.02 MB (26231936) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 4s198ms, non-child: 16.699ms, % non-child: 0.40%) BytesReceived(16s000ms): 5.81 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB - BytesReceived: 7.32 MB (7677674) - ConvertRowBatchTime: 12.257ms - DeserializeRowBatchTimer: 15.890ms - FirstBatchArrivalWaitTime: 2s112ms - PeakMemoryUsage: 0 - RowsReturned: 458.35K (458345) - RowsReturnedRate: 109.16 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=13):(Total: 529.135us, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 3.98B (3975891908) - BuildTime: 5m41s - PeakMemoryUsage: 159.24 GB (170978937088) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled, Spilled Runtime filters: 0 of 1 Runtime Filter Published, 1 Disabled - BuildRowsPartitionTime: 5m40s - BuildRowsPartitioned: 3.98B (3975891908) - GetNewBlockTime: 35s547ms - HashBuckets: 1.07B (1073741824) - HashCollisions: 0 (0) - HashTablesBuildTime: 1m1s - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 159.24 GB (170978878592) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 5 (5) - UnpinTime: 136.574ms HASH_JOIN_NODE (id=12):(Total: 3m41s, non-child: 1m12s, % non-child: 32.86%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 40.14M (40135595) - BuildTime: 8s500ms - PeakMemoryUsage: 3.02 GB (3240192224) - ProbeRows: 75.91M (75908206) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1m3s - RowsReturned: 3.98B (3975891908) - RowsReturnedRate: 17.93 M/sec Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 5s765ms - BuildRowsPartitioned: 40.14M (40135595) - GetNewBlockTime: 3.181ms - HashBuckets: 67.11M (67108864) - HashCollisions: 0 (0) - HashTablesBuildTime: 2s678ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 3.02 GB (3240125568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 7s289ms, non-child: 1s552ms, % non-child: 21.30%) BytesReceived(16s000ms): 212.00 MB, 380.09 MB, 380.09 MB, 380.09 MB, 380.09 MB, 380.09 MB, 380.09 MB, 380.09 MB, 380.09 MB, 380.09 MB, 380.09 MB, 380.09 MB, 380.09 MB, 380.09 MB, 380.09 MB, 380.09 MB, 380.09 MB, 380.09 MB, 380.09 MB, 380.09 MB, 380.09 MB, 380.09 MB, 380.09 MB, 380.09 MB, 380.09 MB, 380.09 MB, 380.09 MB, 380.09 MB, 380.09 MB, 380.09 MB, 380.09 MB, 380.09 MB, 380.09 MB, 380.09 MB, 380.09 MB, 380.09 MB, 380.09 MB, 380.09 MB, 380.09 MB, 380.09 MB - BytesReceived: 380.09 MB (398557962) - ConvertRowBatchTime: 945.279ms - DeserializeRowBatchTimer: 1s544ms - FirstBatchArrivalWaitTime: 1s124ms - PeakMemoryUsage: 0 - RowsReturned: 40.14M (40135595) - RowsReturnedRate: 5.51 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=22):(Total: 2m22s, non-child: 1s560ms, % non-child: 1.10%) BytesReceived(16s000ms): 2.21 MB, 15.65 MB, 42.44 MB, 68.52 MB, 95.39 MB, 122.40 MB, 149.58 MB, 176.73 MB, 202.27 MB, 227.68 MB, 252.53 MB, 278.27 MB, 305.01 MB, 331.22 MB, 355.60 MB, 382.63 MB, 408.19 MB, 435.63 MB, 460.35 MB, 488.42 MB, 510.00 MB, 527.55 MB, 546.42 MB, 568.97 MB, 586.52 MB, 599.15 MB, 619.60 MB, 635.68 MB, 648.24 MB, 652.99 MB, 662.12 MB, 675.03 MB, 679.98 MB, 689.42 MB, 698.03 MB, 702.45 MB, 702.45 MB, 702.45 MB, 702.45 MB, 702.45 MB - BytesReceived: 702.45 MB (736572425) - ConvertRowBatchTime: 828.955ms - DeserializeRowBatchTimer: 6s758ms - FirstBatchArrivalWaitTime: 793.167ms - PeakMemoryUsage: 0 - RowsReturned: 75.91M (75908206) - RowsReturnedRate: 533.23 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=24):(Total: 1s720ms, non-child: 2.842us, % non-child: 0.00%) BytesReceived(16s000ms): 8.75 MB, 10.49 MB, 10.49 MB, 10.49 MB, 10.49 MB, 10.49 MB, 10.49 MB, 10.49 MB, 10.49 MB, 10.49 MB, 10.49 MB, 10.49 MB, 10.49 MB, 10.49 MB, 10.49 MB, 10.49 MB, 10.49 MB, 10.49 MB, 10.49 MB, 10.49 MB, 10.49 MB, 10.49 MB, 10.49 MB, 10.49 MB, 10.49 MB, 10.49 MB, 10.49 MB, 10.49 MB, 10.49 MB, 10.49 MB, 10.49 MB, 10.49 MB, 10.49 MB, 10.49 MB, 10.49 MB, 10.49 MB, 10.49 MB, 10.55 MB, 10.64 MB, 10.65 MB - BytesReceived: 10.96 MB (11494570) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 72.708ms - FirstBatchArrivalWaitTime: 1s720ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:359 (host=vd1131.foo:22000):(Total: 49.002ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 971.41 MB, 6.85 GB, 14.35 GB, 21.19 GB, 28.14 GB, 35.09 GB, 42.14 GB, 49.21 GB, 55.88 GB, 62.55 GB, 68.88 GB, 75.68 GB, 83.16 GB, 89.87 GB, 96.14 GB, 103.17 GB, 109.85 GB, 116.80 GB, 123.00 GB, 129.41 GB, 135.70 GB, 140.19 GB, 145.03 GB, 150.82 GB, 155.58 GB, 157.84 GB, 152.63 GB, 156.56 GB, 158.03 GB, 154.54 GB, 151.45 GB, 152.52 GB, 155.37 GB, 157.36 GB, 158.94 GB, 153.04 GB, 155.80 GB, 147.70 GB, 154.22 GB, 156.93 GB ThreadUsage(16s000ms): 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.03 - BloomFilterBytes: 49.00 MB (51380224) - PeakMemoryUsage: 160.60 GB (172446958527) - PerHostPeakMemUsage: 169.56 GB (182064558770) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 1m52s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 1.68K (1675) - TotalThreadsTotalWallClockTime: 22s317ms - TotalThreadsSysTime: 2s232ms - TotalThreadsUserTime: 8s189ms - TotalThreadsVoluntaryContextSwitches: 21.66K (21657) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 48.952ms - ExecTreePrepareTime: 608.082us DataStreamSender (dst_id=28):(Total: 845.500us, non-child: 845.500us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.05 MB (1105280) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 647.577ms, non-child: 647.577ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 216.976ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 122 (122) - NumInstructions: 8.95K (8951) - OptimizationTime: 406.696ms - PeakMemoryUsage: 4.37 MB (4582912) - PrepareTime: 23.511ms HASH_JOIN_NODE (id=15):(Total: 1.137ms, non-child: 943.663us, % non-child: 82.92%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 451.92K (451915) - BuildTime: 132.567ms - PeakMemoryUsage: 153.09 MB (160524544) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=15): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 99.005ms - BuildRowsPartitioned: 451.92K (451915) - GetNewBlockTime: 435.046us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 30.807ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160449664) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=26):(Total: 2s044ms, non-child: 32.226ms, % non-child: 1.58%) BytesReceived(16s000ms): 5.43 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB - BytesReceived: 6.21 MB (6513198) - ConvertRowBatchTime: 11.859ms - DeserializeRowBatchTimer: 52.961ms - FirstBatchArrivalWaitTime: 1s175ms - PeakMemoryUsage: 0 - RowsReturned: 451.92K (451915) - RowsReturnedRate: 221.00 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=14):(Total: 856.412us, non-child: 913.260us, % non-child: 100.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 459.10K (459099) - BuildTime: 174.310ms - PeakMemoryUsage: 25.08 MB (26298624) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 107.582ms - BuildRowsPartitioned: 459.10K (459099) - GetNewBlockTime: 262.900us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 25.594ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 25.02 MB (26231936) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 4s136ms, non-child: 16.714ms, % non-child: 0.40%) BytesReceived(16s000ms): 5.86 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB, 7.33 MB - BytesReceived: 7.33 MB (7689256) - ConvertRowBatchTime: 12.707ms - DeserializeRowBatchTimer: 16.564ms - FirstBatchArrivalWaitTime: 2s086ms - PeakMemoryUsage: 0 - RowsReturned: 459.10K (459099) - RowsReturnedRate: 110.98 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=13):(Total: 599.847us, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 4.09B (4089422230) - BuildTime: 6m19s - PeakMemoryUsage: 160.16 GB (171968792832) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled, Spilled Runtime filters: 0 of 1 Runtime Filter Published, 1 Disabled - BuildRowsPartitionTime: 6m19s - BuildRowsPartitioned: 4.09B (4089422230) - GetNewBlockTime: 45s964ms - HashBuckets: 536.87M (536870912) - HashCollisions: 0 (0) - HashTablesBuildTime: 1m25s - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 160.16 GB (171968734336) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 5 (5) - UnpinTime: 265.783ms HASH_JOIN_NODE (id=12):(Total: 3m2s, non-child: 1m16s, % non-child: 41.95%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 40.16M (40164427) - BuildTime: 8s673ms - PeakMemoryUsage: 3.02 GB (3240188190) - ProbeRows: 77.23M (77234079) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1m7s - RowsReturned: 4.09B (4089422230) - RowsReturnedRate: 22.36 M/sec Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 5s701ms - BuildRowsPartitioned: 40.16M (40164427) - GetNewBlockTime: 3.297ms - HashBuckets: 67.11M (67108864) - HashCollisions: 0 (0) - HashTablesBuildTime: 2s911ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 3.02 GB (3240125568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 7s055ms, non-child: 1s493ms, % non-child: 21.17%) BytesReceived(16s000ms): 214.06 MB, 380.39 MB, 380.39 MB, 380.39 MB, 380.39 MB, 380.39 MB, 380.39 MB, 380.39 MB, 380.39 MB, 380.39 MB, 380.39 MB, 380.39 MB, 380.39 MB, 380.39 MB, 380.39 MB, 380.39 MB, 380.39 MB, 380.39 MB, 380.39 MB, 380.39 MB, 380.39 MB, 380.39 MB, 380.39 MB, 380.39 MB, 380.39 MB, 380.39 MB, 380.39 MB, 380.39 MB, 380.39 MB, 380.39 MB, 380.39 MB, 380.39 MB, 380.39 MB, 380.39 MB, 380.39 MB, 380.39 MB, 380.39 MB, 380.39 MB, 380.39 MB, 380.39 MB - BytesReceived: 380.39 MB (398871294) - ConvertRowBatchTime: 919.972ms - DeserializeRowBatchTimer: 1s498ms - FirstBatchArrivalWaitTime: 1s095ms - PeakMemoryUsage: 0 - RowsReturned: 40.16M (40164427) - RowsReturnedRate: 5.69 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=22):(Total: 1m39s, non-child: 3s145ms, % non-child: 3.15%) BytesReceived(16s000ms): 2.20 MB, 16.02 MB, 43.26 MB, 69.61 MB, 96.87 MB, 124.16 MB, 151.84 MB, 179.63 MB, 205.92 MB, 231.96 MB, 257.42 MB, 285.02 MB, 313.03 MB, 339.78 MB, 364.33 MB, 392.19 MB, 418.22 MB, 445.94 MB, 469.25 MB, 495.50 MB, 518.56 MB, 536.09 MB, 555.38 MB, 578.09 MB, 596.35 MB, 609.10 MB, 629.49 MB, 645.92 MB, 659.75 MB, 664.46 MB, 673.42 MB, 686.57 MB, 692.02 MB, 701.17 MB, 710.05 MB, 715.23 MB, 715.23 MB, 715.23 MB, 715.23 MB, 715.23 MB - BytesReceived: 715.23 MB (749973355) - ConvertRowBatchTime: 883.617ms - DeserializeRowBatchTimer: 7s405ms - FirstBatchArrivalWaitTime: 758.995ms - PeakMemoryUsage: 0 - RowsReturned: 77.23M (77234079) - RowsReturnedRate: 773.36 K/sec - SendersBlockedTimer: 6s554ms - SendersBlockedTotalTimer(*): 10m56s EXCHANGE_NODE (id=24):(Total: 1s699ms, non-child: 3.002us, % non-child: 0.00%) BytesReceived(16s000ms): 8.73 MB, 10.35 MB, 10.35 MB, 10.35 MB, 10.35 MB, 10.35 MB, 10.35 MB, 10.35 MB, 10.35 MB, 10.35 MB, 10.35 MB, 10.35 MB, 10.35 MB, 10.35 MB, 10.35 MB, 10.35 MB, 10.35 MB, 10.35 MB, 10.35 MB, 10.35 MB, 10.35 MB, 10.35 MB, 10.35 MB, 10.35 MB, 10.35 MB, 10.35 MB, 10.35 MB, 10.35 MB, 10.35 MB, 10.35 MB, 10.35 MB, 10.35 MB, 10.35 MB, 10.35 MB, 10.35 MB, 10.35 MB, 10.35 MB, 10.36 MB, 10.36 MB, 10.40 MB - BytesReceived: 10.70 MB (11220854) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 72.873ms - FirstBatchArrivalWaitTime: 1s699ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:33b (host=vc1530.foo:22000):(Total: 48.693ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 1.03 GB, 7.36 GB, 14.29 GB, 20.93 GB, 27.94 GB, 34.80 GB, 41.71 GB, 48.61 GB, 55.11 GB, 61.67 GB, 68.01 GB, 74.62 GB, 81.54 GB, 88.12 GB, 94.44 GB, 101.35 GB, 107.87 GB, 114.82 GB, 120.96 GB, 127.43 GB, 133.61 GB, 137.72 GB, 142.73 GB, 149.23 GB, 153.73 GB, 157.08 GB, 153.02 GB, 155.08 GB, 158.07 GB, 158.49 GB, 150.32 GB, 152.44 GB, 154.26 GB, 156.23 GB, 158.05 GB, 153.40 GB, 156.37 GB, 156.06 GB, 155.41 GB, 149.49 GB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.03 - BloomFilterBytes: 49.00 MB (51380224) - PeakMemoryUsage: 160.60 GB (172442807887) - PerHostPeakMemUsage: 169.56 GB (182062118557) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 2m20s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 1.56K (1562) - TotalThreadsTotalWallClockTime: 21s792ms - TotalThreadsSysTime: 2s163ms - TotalThreadsUserTime: 8s028ms - TotalThreadsVoluntaryContextSwitches: 21.17K (21172) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 48.655ms - ExecTreePrepareTime: 557.191us DataStreamSender (dst_id=28):(Total: 764.471us, non-child: 764.471us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.05 MB (1105280) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 598.135ms, non-child: 598.135ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 200.529ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 122 (122) - NumInstructions: 8.95K (8951) - OptimizationTime: 376.853ms - PeakMemoryUsage: 4.37 MB (4582912) - PrepareTime: 20.370ms HASH_JOIN_NODE (id=15):(Total: 1.046ms, non-child: 936.330us, % non-child: 89.46%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 451.92K (451915) - BuildTime: 140.728ms - PeakMemoryUsage: 153.09 MB (160524544) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=15): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 104.941ms - BuildRowsPartitioned: 451.92K (451915) - GetNewBlockTime: 352.401us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 32.951ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160449664) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=26):(Total: 2s092ms, non-child: 35.414ms, % non-child: 1.69%) BytesReceived(16s000ms): 5.46 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB - BytesReceived: 6.21 MB (6513198) - ConvertRowBatchTime: 12.321ms - DeserializeRowBatchTimer: 60.525ms - FirstBatchArrivalWaitTime: 1s226ms - PeakMemoryUsage: 0 - RowsReturned: 451.92K (451915) - RowsReturnedRate: 215.97 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=14):(Total: 814.767us, non-child: 804.690us, % non-child: 98.76%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 459.40K (459399) - BuildTime: 146.366ms - PeakMemoryUsage: 25.08 MB (26298624) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 87.101ms - BuildRowsPartitioned: 459.40K (459399) - GetNewBlockTime: 184.367us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 24.743ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 25.02 MB (26231936) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 4s180ms, non-child: 16.862ms, % non-child: 0.40%) BytesReceived(16s000ms): 5.98 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB, 7.34 MB - BytesReceived: 7.34 MB (7694434) - ConvertRowBatchTime: 12.228ms - DeserializeRowBatchTimer: 16.629ms - FirstBatchArrivalWaitTime: 2s134ms - PeakMemoryUsage: 0 - RowsReturned: 459.40K (459399) - RowsReturnedRate: 109.89 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=13):(Total: 577.508us, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 4.03B (4031142517) - BuildTime: 5m55s - PeakMemoryUsage: 160.16 GB (171968792832) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled, Spilled Runtime filters: 0 of 1 Runtime Filter Published, 1 Disabled - BuildRowsPartitionTime: 5m55s - BuildRowsPartitioned: 4.03B (4031142517) - GetNewBlockTime: 39s528ms - HashBuckets: 536.87M (536870912) - HashCollisions: 0 (0) - HashTablesBuildTime: 1m6s - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 160.16 GB (171968734336) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 5 (5) - UnpinTime: 226.273ms HASH_JOIN_NODE (id=12):(Total: 3m27s, non-child: 1m13s, % non-child: 35.57%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 40.21M (40213826) - BuildTime: 8s443ms - PeakMemoryUsage: 3.02 GB (3240192052) - ProbeRows: 76.48M (76483835) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1m4s - RowsReturned: 4.03B (4031142517) - RowsReturnedRate: 19.45 M/sec Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 5s803ms - BuildRowsPartitioned: 40.21M (40213826) - GetNewBlockTime: 2.966ms - HashBuckets: 67.11M (67108864) - HashCollisions: 0 (0) - HashTablesBuildTime: 2s592ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 3.02 GB (3240125568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 6s689ms, non-child: 1s523ms, % non-child: 22.77%) BytesReceived(16s000ms): 216.65 MB, 380.84 MB, 380.84 MB, 380.84 MB, 380.84 MB, 380.84 MB, 380.84 MB, 380.84 MB, 380.84 MB, 380.84 MB, 380.84 MB, 380.84 MB, 380.84 MB, 380.84 MB, 380.84 MB, 380.84 MB, 380.84 MB, 380.84 MB, 380.84 MB, 380.84 MB, 380.84 MB, 380.84 MB, 380.84 MB, 380.84 MB, 380.84 MB, 380.84 MB, 380.84 MB, 380.84 MB, 380.84 MB, 380.84 MB, 380.84 MB, 380.84 MB, 380.84 MB, 380.84 MB, 380.84 MB, 380.84 MB, 380.84 MB, 380.84 MB, 380.84 MB, 380.84 MB - BytesReceived: 380.84 MB (399341329) - ConvertRowBatchTime: 919.999ms - DeserializeRowBatchTimer: 1s554ms - FirstBatchArrivalWaitTime: 1s159ms - PeakMemoryUsage: 0 - RowsReturned: 40.21M (40213826) - RowsReturnedRate: 6.01 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=22):(Total: 2m7s, non-child: 1s379ms, % non-child: 1.08%) BytesReceived(16s000ms): 2.21 MB, 16.07 MB, 42.97 MB, 69.24 MB, 96.70 MB, 123.72 MB, 150.98 MB, 178.31 MB, 204.06 MB, 229.81 MB, 255.01 MB, 281.19 MB, 308.32 MB, 334.94 MB, 359.43 MB, 386.81 MB, 412.60 MB, 440.25 MB, 463.71 MB, 489.55 MB, 513.07 MB, 530.27 MB, 551.16 MB, 575.53 MB, 592.69 MB, 605.57 MB, 626.22 MB, 642.10 MB, 654.30 MB, 659.17 MB, 668.60 MB, 681.46 MB, 686.27 MB, 696.21 MB, 704.72 MB, 708.69 MB, 708.69 MB, 708.69 MB, 708.69 MB, 708.69 MB - BytesReceived: 708.69 MB (743112738) - ConvertRowBatchTime: 858.559ms - DeserializeRowBatchTimer: 6s319ms - FirstBatchArrivalWaitTime: 825.964ms - PeakMemoryUsage: 0 - RowsReturned: 76.48M (76483835) - RowsReturnedRate: 599.07 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=24):(Total: 1s754ms, non-child: 3.645us, % non-child: 0.00%) BytesReceived(16s000ms): 8.56 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.16 MB, 10.22 MB, 10.22 MB - BytesReceived: 10.27 MB (10768986) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 74.478ms - FirstBatchArrivalWaitTime: 1s754ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:35d (host=vc1504.foo:22000):(Total: 46.719ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 946.91 MB, 6.85 GB, 14.14 GB, 20.74 GB, 27.54 GB, 34.39 GB, 41.28 GB, 48.17 GB, 54.62 GB, 61.10 GB, 67.42 GB, 73.92 GB, 80.76 GB, 87.19 GB, 93.56 GB, 100.38 GB, 106.98 GB, 113.72 GB, 120.03 GB, 126.12 GB, 132.45 GB, 136.87 GB, 141.58 GB, 147.32 GB, 152.07 GB, 155.39 GB, 154.98 GB, 154.05 GB, 157.14 GB, 157.95 GB, 155.44 GB, 152.32 GB, 153.15 GB, 155.54 GB, 156.98 GB, 154.48 GB, 154.02 GB, 152.11 GB, 154.17 GB, 154.19 GB ThreadUsage(16s000ms): 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.03 - BloomFilterBytes: 49.00 MB (51380224) - PeakMemoryUsage: 160.60 GB (172446834415) - PerHostPeakMemUsage: 169.55 GB (182051120599) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 1m53s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 1.64K (1636) - TotalThreadsTotalWallClockTime: 22s284ms - TotalThreadsSysTime: 2s268ms - TotalThreadsUserTime: 8s074ms - TotalThreadsVoluntaryContextSwitches: 21.76K (21759) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 46.671ms - ExecTreePrepareTime: 344.254us DataStreamSender (dst_id=28):(Total: 641.469us, non-child: 641.469us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.05 MB (1105280) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 636.644ms, non-child: 636.644ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 209.785ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 122 (122) - NumInstructions: 8.95K (8951) - OptimizationTime: 409.108ms - PeakMemoryUsage: 4.37 MB (4582912) - PrepareTime: 17.288ms HASH_JOIN_NODE (id=15):(Total: 642.983us, non-child: 922.817us, % non-child: 100.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 451.92K (451915) - BuildTime: 136.711ms - PeakMemoryUsage: 153.09 MB (160524544) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=15): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 99.599ms - BuildRowsPartitioned: 451.92K (451915) - GetNewBlockTime: 403.057us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 34.268ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160449664) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=26):(Total: 2s036ms, non-child: 24.345ms, % non-child: 1.20%) BytesReceived(16s000ms): 5.38 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB - BytesReceived: 6.21 MB (6513198) - ConvertRowBatchTime: 12.085ms - DeserializeRowBatchTimer: 49.083ms - FirstBatchArrivalWaitTime: 1s179ms - PeakMemoryUsage: 0 - RowsReturned: 451.92K (451915) - RowsReturnedRate: 221.87 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=14):(Total: 495.348us, non-child: 760.970us, % non-child: 100.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 460.72K (460718) - BuildTime: 178.254ms - PeakMemoryUsage: 25.08 MB (26298624) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 104.180ms - BuildRowsPartitioned: 460.72K (460718) - GetNewBlockTime: 169.787us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 31.283ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 25.02 MB (26231936) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 4s150ms, non-child: 16.262ms, % non-child: 0.39%) BytesReceived(16s000ms): 5.85 MB, 7.36 MB, 7.36 MB, 7.36 MB, 7.36 MB, 7.36 MB, 7.36 MB, 7.36 MB, 7.36 MB, 7.36 MB, 7.36 MB, 7.36 MB, 7.36 MB, 7.36 MB, 7.36 MB, 7.36 MB, 7.36 MB, 7.36 MB, 7.36 MB, 7.36 MB, 7.36 MB, 7.36 MB, 7.36 MB, 7.36 MB, 7.36 MB, 7.36 MB, 7.36 MB, 7.36 MB, 7.36 MB, 7.36 MB, 7.36 MB, 7.36 MB, 7.36 MB, 7.36 MB, 7.36 MB, 7.36 MB, 7.36 MB, 7.36 MB, 7.36 MB, 7.36 MB - BytesReceived: 7.36 MB (7716875) - ConvertRowBatchTime: 11.862ms - DeserializeRowBatchTimer: 17.173ms - FirstBatchArrivalWaitTime: 2s088ms - PeakMemoryUsage: 0 - RowsReturned: 460.72K (460718) - RowsReturnedRate: 110.99 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=13):(Total: 378.528us, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 4.01B (4009779349) - BuildTime: 6m31s - PeakMemoryUsage: 157.53 GB (169141242112) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled, Spilled Runtime filters: 0 of 1 Runtime Filter Published, 1 Disabled - BuildRowsPartitionTime: 6m31s - BuildRowsPartitioned: 4.01B (4009779349) - GetNewBlockTime: 49s470ms - HashBuckets: 536.87M (536870912) - HashCollisions: 0 (0) - HashTablesBuildTime: 26s220ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 157.53 GB (169141183616) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 4 (4) - UnpinTime: 248.961ms HASH_JOIN_NODE (id=12):(Total: 2m58s, non-child: 1m12s, % non-child: 40.43%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 40.32M (40315889) - BuildTime: 8s522ms - PeakMemoryUsage: 3.02 GB (3240192224) - ProbeRows: 75.26M (75264565) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1m2s - RowsReturned: 4.01B (4009779349) - RowsReturnedRate: 22.44 M/sec Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 5s624ms - BuildRowsPartitioned: 40.32M (40315889) - GetNewBlockTime: 2.511ms - HashBuckets: 67.11M (67108864) - HashCollisions: 0 (0) - HashTablesBuildTime: 2s847ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 3.02 GB (3240125568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 7s158ms, non-child: 1s560ms, % non-child: 21.80%) BytesReceived(16s000ms): 212.27 MB, 381.81 MB, 381.81 MB, 381.81 MB, 381.81 MB, 381.81 MB, 381.81 MB, 381.81 MB, 381.81 MB, 381.81 MB, 381.81 MB, 381.81 MB, 381.81 MB, 381.81 MB, 381.81 MB, 381.81 MB, 381.81 MB, 381.81 MB, 381.81 MB, 381.81 MB, 381.81 MB, 381.81 MB, 381.81 MB, 381.81 MB, 381.81 MB, 381.81 MB, 381.81 MB, 381.81 MB, 381.81 MB, 381.81 MB, 381.81 MB, 381.81 MB, 381.81 MB, 381.81 MB, 381.81 MB, 381.81 MB, 381.81 MB, 381.81 MB, 381.81 MB, 381.81 MB - BytesReceived: 381.81 MB (400352294) - ConvertRowBatchTime: 960.155ms - DeserializeRowBatchTimer: 1s526ms - FirstBatchArrivalWaitTime: 1s104ms - PeakMemoryUsage: 0 - RowsReturned: 40.32M (40315889) - RowsReturnedRate: 5.63 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=22):(Total: 1m40s, non-child: 1s349ms, % non-child: 1.35%) BytesReceived(16s000ms): 2.10 MB, 15.37 MB, 41.96 MB, 67.62 MB, 94.08 MB, 120.69 MB, 147.56 MB, 174.45 MB, 199.67 MB, 224.88 MB, 249.65 MB, 275.15 MB, 301.73 MB, 327.77 MB, 351.98 MB, 378.90 MB, 404.56 MB, 431.84 MB, 454.97 MB, 479.89 MB, 503.28 MB, 520.17 MB, 538.91 MB, 561.28 MB, 579.43 MB, 592.19 MB, 614.94 MB, 630.84 MB, 643.02 MB, 647.79 MB, 657.02 MB, 669.77 MB, 674.66 MB, 684.21 MB, 692.65 MB, 696.84 MB, 696.84 MB, 696.84 MB, 696.84 MB, 696.84 MB - BytesReceived: 696.84 MB (730692226) - ConvertRowBatchTime: 831.830ms - DeserializeRowBatchTimer: 6s295ms - FirstBatchArrivalWaitTime: 771.349ms - PeakMemoryUsage: 0 - RowsReturned: 75.26M (75264565) - RowsReturnedRate: 752.07 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=24):(Total: 1s707ms, non-child: 4.371us, % non-child: 0.00%) BytesReceived(16s000ms): 8.25 MB, 9.95 MB, 9.95 MB, 9.95 MB, 9.95 MB, 9.95 MB, 9.95 MB, 9.95 MB, 9.95 MB, 9.95 MB, 9.95 MB, 9.95 MB, 9.95 MB, 9.95 MB, 9.95 MB, 9.95 MB, 9.95 MB, 9.95 MB, 9.95 MB, 9.95 MB, 9.95 MB, 9.95 MB, 9.95 MB, 9.95 MB, 9.95 MB, 9.95 MB, 9.95 MB, 9.95 MB, 9.95 MB, 9.95 MB, 9.95 MB, 9.95 MB, 9.95 MB, 9.95 MB, 9.95 MB, 9.95 MB, 9.95 MB, 9.95 MB, 9.95 MB, 9.95 MB - BytesReceived: 9.96 MB (10438593) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 70.467ms - FirstBatchArrivalWaitTime: 1s707ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 7f40dcb034de70b7:33e (host=vd1338.foo:22000):(Total: 40.702ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 1.02 GB, 7.30 GB, 14.39 GB, 21.11 GB, 28.03 GB, 34.94 GB, 41.94 GB, 48.88 GB, 55.40 GB, 61.97 GB, 68.28 GB, 75.00 GB, 82.08 GB, 88.86 GB, 94.99 GB, 101.95 GB, 108.51 GB, 115.32 GB, 121.30 GB, 127.75 GB, 133.84 GB, 138.18 GB, 143.01 GB, 148.74 GB, 153.50 GB, 156.76 GB, 153.92 GB, 155.33 GB, 158.57 GB, 158.54 GB, 150.75 GB, 153.21 GB, 154.83 GB, 156.79 GB, 158.55 GB, 154.29 GB, 157.99 GB, 157.90 GB, 154.85 GB, 156.33 GB ThreadUsage(16s000ms): 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.03 - BloomFilterBytes: 49.00 MB (51380224) - PeakMemoryUsage: 160.60 GB (172446313615) - PerHostPeakMemUsage: 169.56 GB (182065416325) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 2m6s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 1.34K (1345) - TotalThreadsTotalWallClockTime: 21s882ms - TotalThreadsSysTime: 2s229ms - TotalThreadsUserTime: 7s893ms - TotalThreadsVoluntaryContextSwitches: 23.57K (23569) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 40.661ms - ExecTreePrepareTime: 289.485us DataStreamSender (dst_id=28):(Total: 527.046us, non-child: 527.046us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.05 MB (1105280) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 632.667ms, non-child: 632.667ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 210.469ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 122 (122) - NumInstructions: 8.95K (8951) - OptimizationTime: 406.142ms - PeakMemoryUsage: 4.37 MB (4582912) - PrepareTime: 15.658ms HASH_JOIN_NODE (id=15):(Total: 553.126us, non-child: 656.491us, % non-child: 100.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 451.92K (451915) - BuildTime: 126.820ms - PeakMemoryUsage: 153.09 MB (160524544) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=15): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 94.018ms - BuildRowsPartitioned: 451.92K (451915) - GetNewBlockTime: 340.108us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 30.117ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160449664) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=26):(Total: 2s059ms, non-child: 24.788ms, % non-child: 1.20%) BytesReceived(16s000ms): 5.49 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB, 6.21 MB - BytesReceived: 6.21 MB (6513198) - ConvertRowBatchTime: 11.678ms - DeserializeRowBatchTimer: 54.098ms - FirstBatchArrivalWaitTime: 1s194ms - PeakMemoryUsage: 0 - RowsReturned: 451.92K (451915) - RowsReturnedRate: 219.40 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=14):(Total: 448.671us, non-child: 712.650us, % non-child: 100.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 458.58K (458577) - BuildTime: 148.697ms - PeakMemoryUsage: 25.08 MB (26298624) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 89.991ms - BuildRowsPartitioned: 458.58K (458577) - GetNewBlockTime: 130.523us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 28.151ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 25.02 MB (26231936) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 4s153ms, non-child: 15.833ms, % non-child: 0.38%) BytesReceived(16s000ms): 5.99 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB, 7.32 MB - BytesReceived: 7.32 MB (7680806) - ConvertRowBatchTime: 11.815ms - DeserializeRowBatchTimer: 17.199ms - FirstBatchArrivalWaitTime: 2s107ms - PeakMemoryUsage: 0 - RowsReturned: 458.58K (458577) - RowsReturnedRate: 110.41 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=13):(Total: 342.215us, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 4.04B (4036399873) - BuildTime: 6m4s - PeakMemoryUsage: 160.16 GB (171968792832) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled, Spilled Runtime filters: 0 of 1 Runtime Filter Published, 1 Disabled - BuildRowsPartitionTime: 6m4s - BuildRowsPartitioned: 4.04B (4036399873) - GetNewBlockTime: 34s212ms - HashBuckets: 536.87M (536870912) - HashCollisions: 0 (0) - HashTablesBuildTime: 1m17s - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 160.16 GB (171968734336) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 5 (5) - UnpinTime: 145.473ms HASH_JOIN_NODE (id=12):(Total: 3m16s, non-child: 1m16s, % non-child: 38.92%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 40.14M (40142504) - BuildTime: 8s266ms - PeakMemoryUsage: 3.02 GB (3240195462) - ProbeRows: 76.25M (76247306) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1m7s - RowsReturned: 4.04B (4036399873) - RowsReturnedRate: 20.51 M/sec Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 5s439ms - BuildRowsPartitioned: 40.14M (40142504) - GetNewBlockTime: 3.025ms - HashBuckets: 67.11M (67108864) - HashCollisions: 0 (0) - HashTablesBuildTime: 2s778ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 3.02 GB (3240125568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 7s035ms, non-child: 1s734ms, % non-child: 24.65%) BytesReceived(16s000ms): 217.38 MB, 380.19 MB, 380.19 MB, 380.19 MB, 380.19 MB, 380.19 MB, 380.19 MB, 380.19 MB, 380.19 MB, 380.19 MB, 380.19 MB, 380.19 MB, 380.19 MB, 380.19 MB, 380.19 MB, 380.19 MB, 380.19 MB, 380.19 MB, 380.19 MB, 380.19 MB, 380.19 MB, 380.19 MB, 380.19 MB, 380.19 MB, 380.19 MB, 380.19 MB, 380.19 MB, 380.19 MB, 380.19 MB, 380.19 MB, 380.19 MB, 380.19 MB, 380.19 MB, 380.19 MB, 380.19 MB, 380.19 MB, 380.19 MB, 380.19 MB, 380.19 MB, 380.19 MB - BytesReceived: 380.19 MB (398653577) - ConvertRowBatchTime: 1s003ms - DeserializeRowBatchTimer: 1s779ms - FirstBatchArrivalWaitTime: 1s112ms - PeakMemoryUsage: 0 - RowsReturned: 40.14M (40142504) - RowsReturnedRate: 5.71 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=22):(Total: 1m53s, non-child: 1s457ms, % non-child: 1.28%) BytesReceived(16s000ms): 2.21 MB, 16.13 MB, 43.18 MB, 69.48 MB, 96.59 MB, 123.61 MB, 150.97 MB, 178.28 MB, 204.17 MB, 229.87 MB, 255.47 MB, 282.93 MB, 309.74 MB, 335.99 MB, 360.10 MB, 387.54 MB, 413.21 MB, 440.57 MB, 463.36 MB, 489.25 MB, 511.65 MB, 529.09 MB, 548.21 MB, 570.68 MB, 588.82 MB, 601.36 MB, 621.70 MB, 637.85 MB, 651.14 MB, 655.84 MB, 664.69 MB, 677.77 MB, 682.99 MB, 692.03 MB, 700.79 MB, 705.76 MB, 705.77 MB, 705.77 MB, 705.77 MB, 705.77 MB - BytesReceived: 705.77 MB (740051240) - ConvertRowBatchTime: 890.691ms - DeserializeRowBatchTimer: 6s873ms - FirstBatchArrivalWaitTime: 783.053ms - PeakMemoryUsage: 0 - RowsReturned: 76.25M (76247306) - RowsReturnedRate: 668.97 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=24):(Total: 1s725ms, non-child: 3.279us, % non-child: 0.00%) BytesReceived(16s000ms): 8.65 MB, 10.24 MB, 10.24 MB, 10.24 MB, 10.24 MB, 10.24 MB, 10.24 MB, 10.24 MB, 10.24 MB, 10.24 MB, 10.24 MB, 10.24 MB, 10.24 MB, 10.24 MB, 10.24 MB, 10.24 MB, 10.24 MB, 10.24 MB, 10.24 MB, 10.24 MB, 10.24 MB, 10.24 MB, 10.24 MB, 10.24 MB, 10.24 MB, 10.24 MB, 10.24 MB, 10.24 MB, 10.24 MB, 10.24 MB, 10.24 MB, 10.24 MB, 10.24 MB, 10.24 MB, 10.24 MB, 10.24 MB, 10.24 MB, 10.25 MB, 10.27 MB, 10.30 MB - BytesReceived: 10.48 MB (10983975) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 70.454ms - FirstBatchArrivalWaitTime: 1s725ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Averaged Fragment F03:(Total: 9m5s, non-child: 8m44s, % non-child: 96.07%) split sizes: min: 4.38 GB, max: 105.72 GB, avg: 104.92 GB, stddev: 8.72 GB completion times: min:36s843ms max:9m25s mean: 9m5s stddev:46s362ms execution rates: min:121.60 MB/sec max:220.95 MB/sec mean:196.42 MB/sec stddev:8.41 MB/sec num instances: 134 - AverageThreadTokens: 12.85 - BloomFilterBytes: 33.00 MB (34603008) - PeakMemoryUsage: 67.45 MB (70725883) - PerHostPeakMemUsage: 160.56 GB (172398270757) - RowsProduced: 77.21M (77213598) - TotalNetworkReceiveTime: 696.878ms - TotalNetworkSendTime: 8m38s - TotalStorageWaitTime: 13s160ms - TotalThreadsInvoluntaryContextSwitches: 27.89K (27894) - TotalThreadsTotalWallClockTime: 1h57m - TotalThreadsSysTime: 1m33s - TotalThreadsUserTime: 2m19s - TotalThreadsVoluntaryContextSwitches: 7.24M (7242400) Fragment Instance Lifecycle Timings: - ExecTime: 9m4s - ExecTreeExecTime: 3s808ms - OpenTime: 1s171ms - ExecTreeOpenTime: 982.751ms - PrepareTime: 57.387ms - ExecTreePrepareTime: 7.517ms DataStreamSender (dst_id=22):(Total: 16s501ms, non-child: 16s501ms, % non-child: 100.00%) - BytesSent: 714.78 MB (749497970) - NetworkThroughput(*): 76.67 MB/sec - OverallThroughput: 43.33 MB/sec - PeakMemoryUsage: 4.96 MB (5198637) - RowsReturned: 77.21M (77213598) - SerializeBatchTime: 7s155ms - TransmitDataRPCTime: 9s325ms - UncompressedRowBatchSize: 2.16 GB (2317238753) CodeGen:(Total: 208.387ms, non-child: 208.387ms, % non-child: 100.00%) - CodegenTime: 1.099ms - CompileTime: 55.336ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 131.221ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 21.389ms HASH_JOIN_NODE (id=5):(Total: 4s760ms, non-child: 3s222ms, % non-child: 67.70%) - BuildRows: 120 (120) - BuildTime: 1.599ms - PeakMemoryUsage: 1.23 MB (1294604) - ProbeRows: 77.21M (77213598) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3s066ms - RowsReturned: 77.21M (77213598) - RowsReturnedRate: 16.22 M/sec Hash Join Builder (join_node_id=5): - BuildRowsPartitionTime: 28.879us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 204.057us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 57.024us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 696.889ms, non-child: 696.889ms, % non-child: 100.00%) - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 5.200us - DeserializeRowBatchTimer: 29.195us - FirstBatchArrivalWaitTime: 669.402ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 74.43 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=3):(Total: 841.490ms, non-child: 841.490ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 11.92 - BytesRead: 141.33 MB (148194651) - BytesReadDataNodeCache: 0 - BytesReadLocal: 141.33 MB (148194651) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 141.33 MB (148194651) - DecompressionTime: 1s424ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 7 (7) - NumRowGroups: 117 (117) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 29.28 MB (30701666) - PerReadThreadRawHdfsThroughput: 21.48 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 136.772ms - RowBatchQueuePutWaitTime: 1h44m - RowsRead: 77.35M (77354261) - RowsReturned: 77.21M (77213598) - RowsReturnedRate: 99.94 M/sec - ScanRangesComplete: 1.81K (1810) - ScannerThreadsInvoluntaryContextSwitches: 23.02K (23023) - ScannerThreadsTotalWallClockTime: 1h48m - MaterializeTupleTime(*): 6s291ms - ScannerThreadsSysTime: 1m32s - ScannerThreadsUserTime: 1m56s - ScannerThreadsVoluntaryContextSwitches: 7.24M (7239283) - TotalRawHdfsReadTime(*): 6s588ms - TotalReadThroughput: 267.49 KB/sec Filter 2 (16.00 MB): - Rows processed: 2.02M (2016949) - Rows rejected: 140.63K (140627) - Rows total: 77.35M (77354261) Filter 5 (16.00 MB): - Rows processed: 1.84M (1839076) - Rows rejected: 35 (35) - Rows total: 77.21M (77213634) Filter 6 (1.00 MB): - Files processed: 1.81K (1810) - Files rejected: 1.69K (1693) - Files total: 1.81K (1810) - RowGroups processed: 75.38K (75377) - RowGroups rejected: 0 (0) - RowGroups total: 75.38K (75377) - Rows processed: 1.92M (1920596) - Rows rejected: 0 (0) - Rows total: 77.21M (77213598) - Splits processed: 117 (117) - Splits rejected: 0 (0) - Splits total: 117 (117) Fragment F03: Instance 7f40dcb034de70b7:79 (host=ve1135.foo:22000):(Total: 9m24s, non-child: 9m3s, % non-child: 96.23%) Hdfs split stats (:<# splits>/): 6:234/13.82 GB 4:221/12.28 GB 5:232/14.18 GB 3:229/12.76 GB 2:224/13.66 GB 7:232/13.54 GB 0:216/12.60 GB 1:221/12.84 GB Filter 6 arrival: 1s188ms Filter 2 arrival: 11s020ms Filter 5 arrival: 15s657ms MemoryUsage(16s000ms): 37.20 MB, 66.85 MB, 66.74 MB, 66.53 MB, 66.87 MB, 66.76 MB, 66.50 MB, 66.85 MB, 66.76 MB, 66.62 MB, 66.84 MB, 66.72 MB, 66.80 MB, 66.37 MB, 65.42 MB, 65.80 MB, 66.21 MB, 66.72 MB, 66.84 MB, 66.76 MB, 65.78 MB, 65.71 MB, 65.72 MB, 65.74 MB, 66.61 MB, 66.79 MB, 66.74 MB, 66.86 MB, 66.68 MB, 66.13 MB, 62.41 MB, 62.30 MB, 62.32 MB, 58.57 MB, 44.46 MB ThreadUsage(16s000ms): 12, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 5 - AverageThreadTokens: 12.75 - BloomFilterBytes: 33.00 MB (34603008) - PeakMemoryUsage: 67.44 MB (70713959) - PerHostPeakMemUsage: 161.67 GB (173594548754) - RowsProduced: 78.20M (78200738) - TotalNetworkReceiveTime: 955.518ms - TotalNetworkSendTime: 8m48s - TotalStorageWaitTime: 12s310ms - TotalThreadsInvoluntaryContextSwitches: 30.40K (30401) - TotalThreadsTotalWallClockTime: 2h - TotalThreadsSysTime: 1m3s - TotalThreadsUserTime: 2m38s - TotalThreadsVoluntaryContextSwitches: 4.17M (4169614) Fragment Instance Lifecycle Timings: - ExecTime: 9m23s - ExecTreeExecTime: 3s612ms - OpenTime: 1s286ms - ExecTreeOpenTime: 1s099ms - PrepareTime: 50.086ms - ExecTreePrepareTime: 6.647ms DataStreamSender (dst_id=22):(Total: 16s436ms, non-child: 16s436ms, % non-child: 100.00%) - BytesSent: 723.14 MB (758266102) - NetworkThroughput(*): 74.85 MB/sec - OverallThroughput: 44.00 MB/sec - PeakMemoryUsage: 5.05 MB (5297920) - RowsReturned: 78.20M (78200738) - SerializeBatchTime: 6s756ms - TransmitDataRPCTime: 9s661ms - UncompressedRowBatchSize: 2.19 GB (2346863540) CodeGen:(Total: 206.019ms, non-child: 206.019ms, % non-child: 100.00%) - CodegenTime: 1.016ms - CompileTime: 54.658ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 131.212ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 19.710ms HASH_JOIN_NODE (id=5):(Total: 4s676ms, non-child: 3s096ms, % non-child: 66.22%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.491ms - PeakMemoryUsage: 1.24 MB (1295350) - ProbeRows: 78.20M (78200738) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 2s954ms - RowsReturned: 78.20M (78200738) - RowsReturnedRate: 16.72 M/sec Hash Join Builder (join_node_id=5): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 24.757us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 148.122us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 46.269us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 955.530ms, non-child: 22.432us, % non-child: 0.00%) BytesReceived(16s000ms): 932.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 5.616us - DeserializeRowBatchTimer: 18.225us - FirstBatchArrivalWaitTime: 937.439ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 125.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=3):(Total: 624.613ms, non-child: 624.613ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 6:234/13.82 GB 4:221/12.28 GB 5:232/14.18 GB 3:229/12.76 GB 2:224/13.66 GB 7:232/13.54 GB 0:216/12.60 GB 1:221/12.84 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 118 out of 118 Runtime filters: Only following filters arrived: 6, waited 41ms Hdfs Read Thread Concurrency Bucket: 0:99% 1:0.8174% 2:0.1817% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1691 PARQUET/SNAPPY:118 BytesRead(16s000ms): 13.14 MB, 14.50 MB, 15.32 MB, 21.24 MB, 28.86 MB, 30.55 MB, 39.67 MB, 43.62 MB, 46.46 MB, 56.43 MB, 58.43 MB, 62.78 MB, 72.78 MB, 73.97 MB, 79.30 MB, 87.20 MB, 88.88 MB, 97.37 MB, 102.01 MB, 104.43 MB, 111.62 MB, 116.23 MB, 117.10 MB, 120.47 MB, 129.50 MB, 130.46 MB, 131.10 MB, 133.21 MB, 136.89 MB, 139.41 MB, 142.66 MB, 142.66 MB, 142.66 MB, 142.66 MB - FooterProcessingTime: (Avg: 56.707ms ; Min: 25.510ms ; Max: 215.297ms ; Number of samples: 118) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 11.98 - BytesRead: 142.66 MB (149594866) - BytesReadDataNodeCache: 0 - BytesReadLocal: 142.66 MB (149594866) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 142.66 MB (149594866) - DecompressionTime: 1s170ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 118 (118) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 29.20 MB (30619965) - PerReadThreadRawHdfsThroughput: 21.84 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 96.964ms - RowBatchQueuePutWaitTime: 1h46m - RowsRead: 78.34M (78338209) - RowsReturned: 78.20M (78200738) - RowsReturnedRate: 125.20 M/sec - ScanRangesComplete: 1.81K (1809) - ScannerThreadsInvoluntaryContextSwitches: 25.64K (25641) - ScannerThreadsTotalWallClockTime: 1h50m - MaterializeTupleTime(*): 6s547ms - ScannerThreadsSysTime: 1m2s - ScannerThreadsUserTime: 2m17s - ScannerThreadsVoluntaryContextSwitches: 4.17M (4166444) - TotalRawHdfsReadTime(*): 6s531ms - TotalReadThroughput: 265.37 KB/sec Filter 2 (16.00 MB): - Rows processed: 1.98M (1978623) - Rows rejected: 137.44K (137440) - Rows total: 78.34M (78338209) Filter 5 (16.00 MB): - Rows processed: 1.84M (1841183) - Rows rejected: 31 (31) - Rows total: 78.20M (78200769) Filter 6 (1.00 MB): - Files processed: 1.81K (1809) - Files rejected: 1.69K (1691) - Files total: 1.81K (1809) - RowGroups processed: 76.35K (76348) - RowGroups rejected: 0 (0) - RowGroups total: 76.35K (76348) - Rows processed: 1.93M (1933312) - Rows rejected: 0 (0) - Rows total: 78.20M (78200738) - Splits processed: 118 (118) - Splits rejected: 0 (0) - Splits total: 118 (118) Instance 7f40dcb034de70b7:ed (host=vc1535.foo:22000):(Total: 9m23s, non-child: 9m2s, % non-child: 96.28%) Hdfs split stats (:<# splits>/): 2:227/12.81 GB 7:210/12.20 GB 1:220/12.22 GB 0:251/16.32 GB 5:235/13.30 GB 6:234/12.36 GB 4:210/12.64 GB 3:224/13.85 GB Filter 6 arrival: 663ms Filter 2 arrival: 13s495ms Filter 5 arrival: 16s988ms MemoryUsage(16s000ms): 35.01 MB, 65.83 MB, 66.83 MB, 66.35 MB, 66.81 MB, 66.63 MB, 65.45 MB, 65.86 MB, 66.20 MB, 66.56 MB, 66.83 MB, 66.67 MB, 66.75 MB, 66.83 MB, 66.46 MB, 66.84 MB, 66.79 MB, 66.49 MB, 66.78 MB, 66.87 MB, 66.76 MB, 66.81 MB, 66.79 MB, 66.34 MB, 66.65 MB, 66.78 MB, 66.87 MB, 66.71 MB, 66.01 MB, 64.05 MB, 63.50 MB, 63.61 MB, 63.59 MB, 63.64 MB, 57.74 MB ThreadUsage(16s000ms): 12, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 10 - AverageThreadTokens: 12.86 - BloomFilterBytes: 33.00 MB (34603008) - PeakMemoryUsage: 67.54 MB (70822063) - PerHostPeakMemUsage: 161.67 GB (173587848869) - RowsProduced: 78.88M (78878240) - TotalNetworkReceiveTime: 429.319ms - TotalNetworkSendTime: 8m54s - TotalStorageWaitTime: 13s291ms - TotalThreadsInvoluntaryContextSwitches: 15.28K (15276) - TotalThreadsTotalWallClockTime: 2h - TotalThreadsSysTime: 1s674ms - TotalThreadsUserTime: 1m50s - TotalThreadsVoluntaryContextSwitches: 111.16K (111160) Fragment Instance Lifecycle Timings: - ExecTime: 9m22s - ExecTreeExecTime: 3s594ms - OpenTime: 1s084ms - ExecTreeOpenTime: 899.771ms - PrepareTime: 55.259ms - ExecTreePrepareTime: 7.287ms DataStreamSender (dst_id=22):(Total: 16s283ms, non-child: 16s283ms, % non-child: 100.00%) - BytesSent: 733.95 MB (769601246) - NetworkThroughput(*): 76.69 MB/sec - OverallThroughput: 45.07 MB/sec - PeakMemoryUsage: 4.94 MB (5183232) - RowsReturned: 78.88M (78878240) - SerializeBatchTime: 6s694ms - TransmitDataRPCTime: 9s569ms - UncompressedRowBatchSize: 2.20 GB (2367195856) CodeGen:(Total: 204.652ms, non-child: 204.652ms, % non-child: 100.00%) - CodegenTime: 1.211ms - CompileTime: 57.139ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 125.399ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 21.628ms HASH_JOIN_NODE (id=5):(Total: 4s467ms, non-child: 3s167ms, % non-child: 70.89%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.114ms - PeakMemoryUsage: 1.24 MB (1296572) - ProbeRows: 78.88M (78878240) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3s028ms - RowsReturned: 78.88M (78878240) - RowsReturnedRate: 17.65 M/sec Hash Join Builder (join_node_id=5): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 17.911us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 167.711us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 37.140us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 429.326ms, non-child: 15.877us, % non-child: 0.00%) BytesReceived(16s000ms): 963.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 3.228us - DeserializeRowBatchTimer: 13.778us - FirstBatchArrivalWaitTime: 422.042ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 279.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=3):(Total: 872.024ms, non-child: 872.024ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:227/12.81 GB 7:210/12.20 GB 1:220/12.22 GB 0:251/16.32 GB 5:235/13.30 GB 6:234/12.36 GB 4:210/12.64 GB 3:224/13.85 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 119 out of 119 Runtime filters: Only following filters arrived: 6, waited 362ms Hdfs Read Thread Concurrency Bucket: 0:98.92% 1:0.9883% 2:0% 3:0.08985% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1692 PARQUET/SNAPPY:119 BytesRead(16s000ms): 13.93 MB, 14.97 MB, 14.97 MB, 19.83 MB, 30.00 MB, 30.17 MB, 39.75 MB, 44.49 MB, 45.34 MB, 57.75 MB, 59.26 MB, 61.87 MB, 74.05 MB, 74.05 MB, 80.31 MB, 89.11 MB, 89.36 MB, 100.96 MB, 104.00 MB, 104.74 MB, 117.13 MB, 118.84 MB, 118.84 MB, 120.06 MB, 133.05 MB, 133.61 MB, 133.61 MB, 133.82 MB, 139.71 MB, 143.59 MB, 147.04 MB, 147.04 MB, 147.04 MB, 147.04 MB - FooterProcessingTime: (Avg: 58.306ms ; Min: 21.966ms ; Max: 189.695ms ; Number of samples: 119) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 11.98 - BytesRead: 147.04 MB (154180095) - BytesReadDataNodeCache: 0 - BytesReadLocal: 147.04 MB (154180095) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 147.04 MB (154180095) - DecompressionTime: 1s791ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 119 (119) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 29.44 MB (30873384) - PerReadThreadRawHdfsThroughput: 20.07 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 102.495ms - RowBatchQueuePutWaitTime: 1h49m - RowsRead: 79.02M (79023294) - RowsReturned: 78.88M (78878240) - RowsReturnedRate: 90.45 M/sec - ScanRangesComplete: 1.81K (1811) - ScannerThreadsInvoluntaryContextSwitches: 10.60K (10603) - ScannerThreadsTotalWallClockTime: 1h51m - MaterializeTupleTime(*): 6s260ms - ScannerThreadsSysTime: 1s006ms - ScannerThreadsUserTime: 1m29s - ScannerThreadsVoluntaryContextSwitches: 108.04K (108036) - TotalRawHdfsReadTime(*): 7s325ms - TotalReadThroughput: 270.56 KB/sec Filter 2 (16.00 MB): - Rows processed: 2.07M (2066078) - Rows rejected: 145.03K (145031) - Rows total: 79.02M (79023294) Filter 5 (16.00 MB): - Rows processed: 1.89M (1891351) - Rows rejected: 23 (23) - Rows total: 78.88M (78878263) Filter 6 (1.00 MB): - Files processed: 1.81K (1811) - Files rejected: 1.69K (1692) - Files total: 1.81K (1811) - RowGroups processed: 77.00K (77000) - RowGroups rejected: 0 (0) - RowGroups total: 77.00K (77000) - Rows processed: 1.95M (1949696) - Rows rejected: 0 (0) - Rows total: 78.88M (78878240) - Splits processed: 119 (119) - Splits rejected: 0 (0) - Splits total: 119 (119) Instance 7f40dcb034de70b7:d9 (host=vd1340.foo:22000):(Total: 9m23s, non-child: 9m1s, % non-child: 96.17%) Hdfs split stats (:<# splits>/): 5:206/12.38 GB 0:229/13.74 GB 3:220/12.60 GB 2:225/12.54 GB 1:227/13.26 GB 4:238/13.67 GB 7:245/14.27 GB 6:227/13.25 GB Filter 6 arrival: 774ms Filter 2 arrival: 13s274ms Filter 5 arrival: 16s771ms MemoryUsage(16s000ms): 33.02 MB, 64.78 MB, 65.78 MB, 65.96 MB, 66.76 MB, 66.81 MB, 65.72 MB, 64.79 MB, 64.76 MB, 65.14 MB, 65.81 MB, 65.74 MB, 66.76 MB, 66.75 MB, 66.77 MB, 66.80 MB, 66.82 MB, 66.80 MB, 66.77 MB, 66.72 MB, 66.20 MB, 66.74 MB, 66.77 MB, 66.78 MB, 66.87 MB, 66.79 MB, 66.84 MB, 66.79 MB, 66.00 MB, 63.72 MB, 63.56 MB, 63.58 MB, 63.58 MB, 63.63 MB, 53.21 MB ThreadUsage(16s000ms): 12, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 8 - AverageThreadTokens: 12.85 - BloomFilterBytes: 33.00 MB (34603008) - PeakMemoryUsage: 67.67 MB (70959939) - PerHostPeakMemUsage: 161.66 GB (173585588972) - RowsProduced: 78.90M (78898568) - TotalNetworkReceiveTime: 540.768ms - TotalNetworkSendTime: 8m49s - TotalStorageWaitTime: 13s739ms - TotalThreadsInvoluntaryContextSwitches: 15.51K (15507) - TotalThreadsTotalWallClockTime: 2h - TotalThreadsSysTime: 5s535ms - TotalThreadsUserTime: 1m57s - TotalThreadsVoluntaryContextSwitches: 499.80K (499798) Fragment Instance Lifecycle Timings: - ExecTime: 9m22s - ExecTreeExecTime: 3s737ms - OpenTime: 1s104ms - ExecTreeOpenTime: 921.156ms - PrepareTime: 54.809ms - ExecTreePrepareTime: 6.978ms DataStreamSender (dst_id=22):(Total: 16s731ms, non-child: 16s731ms, % non-child: 100.00%) - BytesSent: 731.24 MB (766762941) - NetworkThroughput(*): 78.51 MB/sec - OverallThroughput: 43.71 MB/sec - PeakMemoryUsage: 5.00 MB (5240576) - RowsReturned: 78.90M (78898568) - SerializeBatchTime: 7s396ms - TransmitDataRPCTime: 9s314ms - UncompressedRowBatchSize: 2.21 GB (2367805960) CodeGen:(Total: 204.921ms, non-child: 204.921ms, % non-child: 100.00%) - CodegenTime: 1.308ms - CompileTime: 54.947ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 126.775ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 22.711ms HASH_JOIN_NODE (id=5):(Total: 4s627ms, non-child: 3s276ms, % non-child: 70.81%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.333ms - PeakMemoryUsage: 1.23 MB (1294551) - ProbeRows: 78.90M (78898568) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3s127ms - RowsReturned: 78.90M (78898568) - RowsReturnedRate: 17.05 M/sec Hash Join Builder (join_node_id=5): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 24.930us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 132.614us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 46.587us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 540.780ms, non-child: 21.102us, % non-child: 0.00%) BytesReceived(16s000ms): 932.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 6.642us - DeserializeRowBatchTimer: 19.548us - FirstBatchArrivalWaitTime: 499.597ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 221.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=3):(Total: 810.271ms, non-child: 810.271ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:206/12.38 GB 0:229/13.74 GB 3:220/12.60 GB 2:225/12.54 GB 1:227/13.26 GB 4:238/13.67 GB 7:245/14.27 GB 6:227/13.25 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 119 out of 119 Runtime filters: Only following filters arrived: 6, waited 261ms Hdfs Read Thread Concurrency Bucket: 0:99.28% 1:0.5415% 2:0% 3:0% 4:0% 5:0.1805% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1698 PARQUET/SNAPPY:119 BytesRead(16s000ms): 12.97 MB, 14.31 MB, 14.31 MB, 17.92 MB, 28.65 MB, 28.73 MB, 36.15 MB, 42.83 MB, 43.40 MB, 54.28 MB, 57.38 MB, 59.49 MB, 71.96 MB, 72.15 MB, 78.92 MB, 86.98 MB, 87.20 MB, 97.70 MB, 101.72 MB, 101.95 MB, 110.46 MB, 116.34 MB, 116.34 MB, 117.99 MB, 129.84 MB, 131.16 MB, 131.16 MB, 131.45 MB, 137.68 MB, 143.05 MB, 144.31 MB, 144.31 MB, 144.31 MB, 144.31 MB - FooterProcessingTime: (Avg: 63.225ms ; Min: 23.585ms ; Max: 300.753ms ; Number of samples: 119) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 11.99 - BytesRead: 144.31 MB (151323316) - BytesReadDataNodeCache: 0 - BytesReadLocal: 144.31 MB (151323316) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 144.31 MB (151323316) - DecompressionTime: 1s573ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 119 (119) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 29.53 MB (30960583) - PerReadThreadRawHdfsThroughput: 19.39 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 112.003ms - RowBatchQueuePutWaitTime: 1h49m - RowsRead: 79.04M (79044055) - RowsReturned: 78.90M (78898568) - RowsReturnedRate: 97.37 M/sec - ScanRangesComplete: 1.82K (1817) - ScannerThreadsInvoluntaryContextSwitches: 10.55K (10552) - ScannerThreadsTotalWallClockTime: 1h51m - MaterializeTupleTime(*): 6s342ms - ScannerThreadsSysTime: 4s840ms - ScannerThreadsUserTime: 1m34s - ScannerThreadsVoluntaryContextSwitches: 496.56K (496557) - TotalRawHdfsReadTime(*): 7s441ms - TotalReadThroughput: 266.50 KB/sec Filter 2 (16.00 MB): - Rows processed: 2.07M (2072655) - Rows rejected: 145.43K (145430) - Rows total: 79.04M (79044055) Filter 5 (16.00 MB): - Rows processed: 1.91M (1910841) - Rows rejected: 57 (57) - Rows total: 78.90M (78898625) Filter 6 (1.00 MB): - Files processed: 1.82K (1817) - Files rejected: 1.70K (1698) - Files total: 1.82K (1817) - RowGroups processed: 77.02K (77021) - RowGroups rejected: 0 (0) - RowGroups total: 77.02K (77021) - Rows processed: 1.95M (1949696) - Rows rejected: 0 (0) - Rows total: 78.90M (78898568) - Splits processed: 119 (119) - Splits rejected: 0 (0) - Splits total: 119 (119) Instance 7f40dcb034de70b7:ea (host=vc1527.foo:22000):(Total: 9m23s, non-child: 9m2s, % non-child: 96.27%) Hdfs split stats (:<# splits>/): 4:231/13.34 GB 6:248/14.76 GB 0:250/14.85 GB 2:215/12.42 GB 5:219/12.72 GB 7:233/13.04 GB 1:205/11.10 GB 3:224/13.46 GB Filter 6 arrival: 707ms Filter 2 arrival: 13s426ms Filter 5 arrival: 16s946ms MemoryUsage(16s000ms): 34.91 MB, 65.86 MB, 66.75 MB, 66.31 MB, 65.77 MB, 65.77 MB, 64.94 MB, 64.83 MB, 64.63 MB, 66.50 MB, 66.80 MB, 66.55 MB, 66.75 MB, 66.80 MB, 65.72 MB, 64.77 MB, 64.79 MB, 65.74 MB, 65.75 MB, 65.78 MB, 66.60 MB, 66.82 MB, 66.79 MB, 65.67 MB, 64.73 MB, 64.74 MB, 64.83 MB, 65.36 MB, 65.34 MB, 64.66 MB, 64.54 MB, 64.46 MB, 64.54 MB, 64.63 MB, 54.83 MB ThreadUsage(16s000ms): 12, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 8 - AverageThreadTokens: 12.86 - BloomFilterBytes: 33.00 MB (34603008) - PeakMemoryUsage: 67.63 MB (70910310) - PerHostPeakMemUsage: 161.67 GB (173591668267) - RowsProduced: 78.80M (78803627) - TotalNetworkReceiveTime: 474.715ms - TotalNetworkSendTime: 8m49s - TotalStorageWaitTime: 12s480ms - TotalThreadsInvoluntaryContextSwitches: 17.16K (17158) - TotalThreadsTotalWallClockTime: 2h - TotalThreadsSysTime: 4s282ms - TotalThreadsUserTime: 2m3s - TotalThreadsVoluntaryContextSwitches: 443.27K (443272) Fragment Instance Lifecycle Timings: - ExecTime: 9m21s - ExecTreeExecTime: 3s596ms - OpenTime: 1s081ms - ExecTreeOpenTime: 900.687ms - PrepareTime: 57.820ms - ExecTreePrepareTime: 7.549ms DataStreamSender (dst_id=22):(Total: 16s354ms, non-child: 16s354ms, % non-child: 100.00%) - BytesSent: 727.17 MB (762488455) - NetworkThroughput(*): 76.60 MB/sec - OverallThroughput: 44.46 MB/sec - PeakMemoryUsage: 4.91 MB (5150464) - RowsReturned: 78.80M (78803627) - SerializeBatchTime: 6s843ms - TransmitDataRPCTime: 9s492ms - UncompressedRowBatchSize: 2.20 GB (2364956658) CodeGen:(Total: 202.435ms, non-child: 202.435ms, % non-child: 100.00%) - CodegenTime: 1.045ms - CompileTime: 52.061ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 126.775ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 23.211ms HASH_JOIN_NODE (id=5):(Total: 4s467ms, non-child: 3s158ms, % non-child: 70.69%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.668ms - PeakMemoryUsage: 1.24 MB (1297517) - ProbeRows: 78.80M (78803627) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 2s998ms - RowsReturned: 78.80M (78803627) - RowsReturnedRate: 17.64 M/sec Hash Join Builder (join_node_id=5): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 32.391us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 211.305us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 75.436us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 474.728ms, non-child: 23.152us, % non-child: 0.00%) BytesReceived(16s000ms): 963.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 5.816us - DeserializeRowBatchTimer: 42.675us - FirstBatchArrivalWaitTime: 434.786ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 252.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=3):(Total: 834.853ms, non-child: 834.853ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:231/13.34 GB 6:248/14.76 GB 0:250/14.85 GB 2:215/12.42 GB 5:219/12.72 GB 7:233/13.04 GB 1:205/11.10 GB 3:224/13.46 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 119 out of 119 Runtime filters: Only following filters arrived: 6, waited 322ms Hdfs Read Thread Concurrency Bucket: 0:99.1% 1:0.7214% 2:0.1803% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1706 PARQUET/SNAPPY:119 BytesRead(16s000ms): 13.75 MB, 14.67 MB, 14.67 MB, 20.02 MB, 28.88 MB, 29.12 MB, 38.54 MB, 42.97 MB, 43.95 MB, 56.93 MB, 57.52 MB, 62.35 MB, 71.81 MB, 72.03 MB, 78.65 MB, 85.96 MB, 86.53 MB, 98.20 MB, 100.48 MB, 101.83 MB, 114.43 MB, 115.22 MB, 115.29 MB, 120.70 MB, 129.45 MB, 129.45 MB, 129.45 MB, 131.49 MB, 139.25 MB, 142.38 MB, 142.38 MB, 142.38 MB, 142.38 MB, 142.38 MB - FooterProcessingTime: (Avg: 57.176ms ; Min: 15.059ms ; Max: 150.201ms ; Number of samples: 119) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 11.98 - BytesRead: 142.38 MB (149300103) - BytesReadDataNodeCache: 0 - BytesReadLocal: 142.38 MB (149300103) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 142.38 MB (149300103) - DecompressionTime: 950.166ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 119 (119) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 29.36 MB (30790658) - PerReadThreadRawHdfsThroughput: 20.88 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 97.235ms - RowBatchQueuePutWaitTime: 1h49m - RowsRead: 78.95M (78946960) - RowsReturned: 78.80M (78803627) - RowsReturnedRate: 94.39 M/sec - ScanRangesComplete: 1.82K (1825) - ScannerThreadsInvoluntaryContextSwitches: 12.39K (12387) - ScannerThreadsTotalWallClockTime: 1h51m - MaterializeTupleTime(*): 6s185ms - ScannerThreadsSysTime: 3s559ms - ScannerThreadsUserTime: 1m41s - ScannerThreadsVoluntaryContextSwitches: 440.12K (440124) - TotalRawHdfsReadTime(*): 6s820ms - TotalReadThroughput: 262.94 KB/sec Filter 2 (16.00 MB): - Rows processed: 2.07M (2067429) - Rows rejected: 143.32K (143320) - Rows total: 78.95M (78946960) Filter 5 (16.00 MB): - Rows processed: 1.89M (1885197) - Rows rejected: 13 (13) - Rows total: 78.80M (78803640) Filter 6 (1.00 MB): - Files processed: 1.82K (1825) - Files rejected: 1.71K (1706) - Files total: 1.82K (1825) - RowGroups processed: 76.93K (76930) - RowGroups rejected: 0 (0) - RowGroups total: 76.93K (76930) - Rows processed: 1.95M (1949696) - Rows rejected: 0 (0) - Rows total: 78.80M (78803627) - Splits processed: 119 (119) - Splits rejected: 0 (0) - Splits total: 119 (119) Instance 7f40dcb034de70b7:ca (host=ve1142.foo:22000):(Total: 9m22s, non-child: 9m, % non-child: 96.00%) Hdfs split stats (:<# splits>/): 7:210/11.75 GB 5:222/12.63 GB 3:231/13.91 GB 0:251/14.60 GB 1:232/13.48 GB 2:226/13.11 GB 4:227/13.22 GB 6:220/12.98 GB Filter 6 arrival: 867ms Filter 2 arrival: 13s067ms Filter 5 arrival: 16s601ms MemoryUsage(16s000ms): 34.00 MB, 64.81 MB, 65.76 MB, 66.65 MB, 66.71 MB, 66.84 MB, 65.98 MB, 65.81 MB, 65.79 MB, 66.50 MB, 66.81 MB, 66.34 MB, 65.80 MB, 65.78 MB, 65.52 MB, 65.74 MB, 65.83 MB, 65.17 MB, 65.93 MB, 65.67 MB, 66.58 MB, 66.72 MB, 66.79 MB, 66.68 MB, 66.73 MB, 66.75 MB, 66.90 MB, 66.75 MB, 66.34 MB, 66.72 MB, 65.52 MB, 64.59 MB, 64.48 MB, 64.55 MB, 56.14 MB ThreadUsage(16s000ms): 12, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 9 - AverageThreadTokens: 12.86 - BloomFilterBytes: 33.00 MB (34603008) - PeakMemoryUsage: 67.43 MB (70701437) - PerHostPeakMemUsage: 161.69 GB (173617409578) - RowsProduced: 78.84M (78842844) - TotalNetworkReceiveTime: 636.779ms - TotalNetworkSendTime: 8m48s - TotalStorageWaitTime: 13s150ms - TotalThreadsInvoluntaryContextSwitches: 13.62K (13616) - TotalThreadsTotalWallClockTime: 2h - TotalThreadsSysTime: 2s168ms - TotalThreadsUserTime: 1m41s - TotalThreadsVoluntaryContextSwitches: 99.92K (99921) Fragment Instance Lifecycle Timings: - ExecTime: 9m21s - ExecTreeExecTime: 3s864ms - OpenTime: 1s097ms - ExecTreeOpenTime: 914.392ms - PrepareTime: 52.616ms - ExecTreePrepareTime: 7.144ms DataStreamSender (dst_id=22):(Total: 17s547ms, non-child: 17s547ms, % non-child: 100.00%) - BytesSent: 729.14 MB (764559678) - NetworkThroughput(*): 73.96 MB/sec - OverallThroughput: 41.55 MB/sec - PeakMemoryUsage: 4.93 MB (5166848) - RowsReturned: 78.84M (78842844) - SerializeBatchTime: 7s668ms - TransmitDataRPCTime: 9s858ms - UncompressedRowBatchSize: 2.20 GB (2366133640) CodeGen:(Total: 201.750ms, non-child: 201.750ms, % non-child: 100.00%) - CodegenTime: 1.042ms - CompileTime: 53.887ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 127.440ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 20.034ms HASH_JOIN_NODE (id=5):(Total: 4s744ms, non-child: 3s370ms, % non-child: 71.05%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.512ms - PeakMemoryUsage: 1.23 MB (1292255) - ProbeRows: 78.84M (78842844) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3s194ms - RowsReturned: 78.84M (78842844) - RowsReturnedRate: 16.62 M/sec Hash Join Builder (join_node_id=5): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 38.495us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 138.434us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 78.832us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 636.793ms, non-child: 24.036us, % non-child: 0.00%) BytesReceived(16s000ms): 932.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 6.548us - DeserializeRowBatchTimer: 23.758us - FirstBatchArrivalWaitTime: 592.405ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 188.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=3):(Total: 737.281ms, non-child: 737.281ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:210/11.75 GB 5:222/12.63 GB 3:231/13.91 GB 0:251/14.60 GB 1:232/13.48 GB 2:226/13.11 GB 4:227/13.22 GB 6:220/12.98 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 119 out of 119 Runtime filters: Only following filters arrived: 6, waited 161ms Hdfs Read Thread Concurrency Bucket: 0:99.01% 1:0.9017% 2:0% 3:0.09017% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1700 PARQUET/SNAPPY:119 BytesRead(16s000ms): 12.94 MB, 14.28 MB, 14.28 MB, 19.34 MB, 28.37 MB, 28.60 MB, 36.96 MB, 42.65 MB, 43.29 MB, 56.31 MB, 57.52 MB, 59.49 MB, 71.90 MB, 71.90 MB, 76.68 MB, 86.29 MB, 86.51 MB, 97.39 MB, 100.92 MB, 101.35 MB, 111.57 MB, 115.63 MB, 115.63 MB, 117.44 MB, 128.25 MB, 130.15 MB, 130.15 MB, 130.45 MB, 133.63 MB, 136.52 MB, 141.80 MB, 143.31 MB, 143.31 MB, 143.31 MB - FooterProcessingTime: (Avg: 62.375ms ; Min: 4.231ms ; Max: 190.860ms ; Number of samples: 119) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 11.99 - BytesRead: 143.31 MB (150269932) - BytesReadDataNodeCache: 0 - BytesReadLocal: 143.31 MB (150269932) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 143.31 MB (150269932) - DecompressionTime: 1s514ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 119 (119) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 29.28 MB (30702449) - PerReadThreadRawHdfsThroughput: 21.59 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 110.138ms - RowBatchQueuePutWaitTime: 1h49m - RowsRead: 78.99M (78986587) - RowsReturned: 78.84M (78842844) - RowsReturnedRate: 106.94 M/sec - ScanRangesComplete: 1.82K (1819) - ScannerThreadsInvoluntaryContextSwitches: 8.51K (8507) - ScannerThreadsTotalWallClockTime: 1h51m - MaterializeTupleTime(*): 6s737ms - ScannerThreadsSysTime: 1s462ms - ScannerThreadsUserTime: 1m16s - ScannerThreadsVoluntaryContextSwitches: 96.81K (96806) - TotalRawHdfsReadTime(*): 6s638ms - TotalReadThroughput: 264.41 KB/sec Filter 2 (16.00 MB): - Rows processed: 2.08M (2080127) - Rows rejected: 143.74K (143735) - Rows total: 78.99M (78986587) Filter 5 (16.00 MB): - Rows processed: 1.87M (1867784) - Rows rejected: 8 (8) - Rows total: 78.84M (78842852) Filter 6 (1.00 MB): - Files processed: 1.82K (1819) - Files rejected: 1.70K (1700) - Files total: 1.82K (1819) - RowGroups processed: 76.97K (76966) - RowGroups rejected: 0 (0) - RowGroups total: 76.97K (76966) - Rows processed: 1.95M (1949696) - Rows rejected: 0 (0) - Rows total: 78.84M (78842844) - Splits processed: 119 (119) - Splits rejected: 0 (0) - Splits total: 119 (119) Instance 7f40dcb034de70b7:a6 (host=ve1137.foo:22000):(Total: 9m22s, non-child: 9m1s, % non-child: 96.26%) Hdfs split stats (:<# splits>/): 2:224/12.92 GB 4:239/13.81 GB 6:236/14.04 GB 1:220/12.65 GB 3:217/12.87 GB 5:245/14.37 GB 0:224/12.88 GB 7:209/12.13 GB Filter 6 arrival: 1s021ms Filter 2 arrival: 12s229ms Filter 5 arrival: 16s182ms MemoryUsage(16s000ms): 36.57 MB, 66.83 MB, 66.77 MB, 66.56 MB, 66.83 MB, 66.79 MB, 65.71 MB, 66.79 MB, 66.77 MB, 66.73 MB, 66.78 MB, 66.69 MB, 65.73 MB, 65.81 MB, 65.58 MB, 66.83 MB, 66.80 MB, 66.70 MB, 66.81 MB, 66.78 MB, 66.29 MB, 66.71 MB, 66.78 MB, 66.75 MB, 66.74 MB, 66.78 MB, 66.90 MB, 66.75 MB, 66.43 MB, 66.91 MB, 65.31 MB, 62.26 MB, 62.38 MB, 62.34 MB, 55.05 MB ThreadUsage(16s000ms): 12, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 9 - AverageThreadTokens: 12.87 - BloomFilterBytes: 33.00 MB (34603008) - PeakMemoryUsage: 67.45 MB (70729789) - PerHostPeakMemUsage: 161.66 GB (173584045649) - RowsProduced: 78.43M (78434234) - TotalNetworkReceiveTime: 780.111ms - TotalNetworkSendTime: 8m50s - TotalStorageWaitTime: 12s737ms - TotalThreadsInvoluntaryContextSwitches: 19.64K (19644) - TotalThreadsTotalWallClockTime: 2h - TotalThreadsSysTime: 34s245ms - TotalThreadsUserTime: 2m2s - TotalThreadsVoluntaryContextSwitches: 4.73M (4733882) Fragment Instance Lifecycle Timings: - ExecTime: 9m21s - ExecTreeExecTime: 3s853ms - OpenTime: 1s190ms - ExecTreeOpenTime: 1s001ms - PrepareTime: 57.757ms - ExecTreePrepareTime: 7.731ms DataStreamSender (dst_id=22):(Total: 15s999ms, non-child: 15s999ms, % non-child: 100.00%) - BytesSent: 729.40 MB (764835509) - NetworkThroughput(*): 83.88 MB/sec - OverallThroughput: 45.59 MB/sec - PeakMemoryUsage: 4.81 MB (5043968) - RowsReturned: 78.43M (78434234) - SerializeBatchTime: 7s282ms - TransmitDataRPCTime: 8s695ms - UncompressedRowBatchSize: 2.19 GB (2353870964) CodeGen:(Total: 209.238ms, non-child: 209.238ms, % non-child: 100.00%) - CodegenTime: 1.273ms - CompileTime: 57.708ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 129.154ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 21.940ms HASH_JOIN_NODE (id=5):(Total: 4s822ms, non-child: 3s364ms, % non-child: 69.76%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.480ms - PeakMemoryUsage: 1.23 MB (1292372) - ProbeRows: 78.43M (78434234) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3s205ms - RowsReturned: 78.43M (78434234) - RowsReturnedRate: 16.26 M/sec Hash Join Builder (join_node_id=5): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 27.200us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 122.466us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 49.435us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 780.123ms, non-child: 20.030us, % non-child: 0.00%) BytesReceived(16s000ms): 932.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 5.289us - DeserializeRowBatchTimer: 21.012us - FirstBatchArrivalWaitTime: 735.845ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 153.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=3):(Total: 678.683ms, non-child: 678.683ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:224/12.92 GB 4:239/13.81 GB 6:236/14.04 GB 1:220/12.65 GB 3:217/12.87 GB 5:245/14.37 GB 0:224/12.88 GB 7:209/12.13 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 119 out of 119 Runtime filters: Only following filters arrived: 6, waited 40ms Hdfs Read Thread Concurrency Bucket: 0:98.92% 1:0.9001% 2:0% 3:0.18% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1695 PARQUET/SNAPPY:119 BytesRead(16s000ms): 13.62 MB, 14.75 MB, 14.79 MB, 20.16 MB, 29.77 MB, 30.32 MB, 38.48 MB, 45.10 MB, 45.74 MB, 55.85 MB, 59.87 MB, 61.91 MB, 73.56 MB, 74.70 MB, 78.81 MB, 89.15 MB, 90.16 MB, 97.47 MB, 104.22 MB, 105.05 MB, 112.82 MB, 118.51 MB, 118.78 MB, 120.73 MB, 130.88 MB, 133.48 MB, 133.48 MB, 134.17 MB, 136.12 MB, 139.92 MB, 145.50 MB, 145.50 MB, 145.50 MB, 145.50 MB - FooterProcessingTime: (Avg: 59.042ms ; Min: 3.761ms ; Max: 289.143ms ; Number of samples: 119) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 11.98 - BytesRead: 145.50 MB (152563231) - BytesReadDataNodeCache: 0 - BytesReadLocal: 145.50 MB (152563231) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 145.50 MB (152563231) - DecompressionTime: 2s227ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 119 (119) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 29.29 MB (30708964) - PerReadThreadRawHdfsThroughput: 23.77 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 174.650ms - RowBatchQueuePutWaitTime: 1h48m - RowsRead: 78.58M (78575596) - RowsReturned: 78.43M (78434234) - RowsReturnedRate: 115.57 M/sec - ScanRangesComplete: 1.81K (1814) - ScannerThreadsInvoluntaryContextSwitches: 14.56K (14558) - ScannerThreadsTotalWallClockTime: 1h51m - MaterializeTupleTime(*): 5s999ms - ScannerThreadsSysTime: 33s541ms - ScannerThreadsUserTime: 1m39s - ScannerThreadsVoluntaryContextSwitches: 4.73M (4730532) - TotalRawHdfsReadTime(*): 6s121ms - TotalReadThroughput: 268.20 KB/sec Filter 2 (16.00 MB): - Rows processed: 2.04M (2038834) - Rows rejected: 141.29K (141287) - Rows total: 78.58M (78575596) Filter 5 (16.00 MB): - Rows processed: 1.86M (1863755) - Rows rejected: 75 (75) - Rows total: 78.43M (78434309) Filter 6 (1.00 MB): - Files processed: 1.81K (1814) - Files rejected: 1.70K (1695) - Files total: 1.81K (1814) - RowGroups processed: 76.57K (76567) - RowGroups rejected: 0 (0) - RowGroups total: 76.57K (76567) - Rows processed: 1.95M (1949696) - Rows rejected: 0 (0) - Rows total: 78.43M (78434234) - Splits processed: 119 (119) - Splits rejected: 0 (0) - Splits total: 119 (119) Instance 7f40dcb034de70b7:b2 (host=ve1138.foo:22000):(Total: 9m22s, non-child: 9m1s, % non-child: 96.22%) Hdfs split stats (:<# splits>/): 5:227/13.68 GB 2:227/12.63 GB 6:235/14.13 GB 3:228/12.44 GB 0:227/13.13 GB 4:211/12.69 GB 7:229/13.81 GB 1:225/13.16 GB Filter 6 arrival: 960ms Filter 2 arrival: 12s585ms Filter 5 arrival: 16s303ms MemoryUsage(16s000ms): 35.82 MB, 66.28 MB, 66.84 MB, 66.62 MB, 66.79 MB, 66.81 MB, 66.00 MB, 65.86 MB, 65.69 MB, 65.40 MB, 65.76 MB, 64.96 MB, 65.42 MB, 65.99 MB, 66.69 MB, 66.70 MB, 66.80 MB, 66.52 MB, 66.81 MB, 66.81 MB, 66.92 MB, 66.82 MB, 66.75 MB, 66.84 MB, 65.60 MB, 65.76 MB, 65.75 MB, 65.80 MB, 65.87 MB, 65.91 MB, 61.62 MB, 56.87 MB, 56.87 MB, 55.00 MB ThreadUsage(16s000ms): 12, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.81 - BloomFilterBytes: 33.00 MB (34603008) - PeakMemoryUsage: 67.54 MB (70817847) - PerHostPeakMemUsage: 161.65 GB (173569909647) - RowsProduced: 76.96M (76961455) - TotalNetworkReceiveTime: 726.324ms - TotalNetworkSendTime: 8m51s - TotalStorageWaitTime: 12s610ms - TotalThreadsInvoluntaryContextSwitches: 32.42K (32422) - TotalThreadsTotalWallClockTime: 2h - TotalThreadsSysTime: 2m18s - TotalThreadsUserTime: 2m27s - TotalThreadsVoluntaryContextSwitches: 14.12M (14122376) Fragment Instance Lifecycle Timings: - ExecTime: 9m21s - ExecTreeExecTime: 3s649ms - OpenTime: 1s118ms - ExecTreeOpenTime: 929.845ms - PrepareTime: 50.219ms - ExecTreePrepareTime: 6.522ms DataStreamSender (dst_id=22):(Total: 16s489ms, non-child: 16s489ms, % non-child: 100.00%) - BytesSent: 713.72 MB (748389611) - NetworkThroughput(*): 78.31 MB/sec - OverallThroughput: 43.28 MB/sec - PeakMemoryUsage: 4.91 MB (5150464) - RowsReturned: 76.96M (76961455) - SerializeBatchTime: 7s353ms - TransmitDataRPCTime: 9s114ms - UncompressedRowBatchSize: 2.15 GB (2309671754) CodeGen:(Total: 205.334ms, non-child: 205.334ms, % non-child: 100.00%) - CodegenTime: 1.029ms - CompileTime: 56.098ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 130.781ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 18.028ms HASH_JOIN_NODE (id=5):(Total: 4s543ms, non-child: 3s181ms, % non-child: 70.01%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.583ms - PeakMemoryUsage: 1.23 MB (1291260) - ProbeRows: 76.96M (76961455) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3s008ms - RowsReturned: 76.96M (76961455) - RowsReturnedRate: 16.94 M/sec Hash Join Builder (join_node_id=5): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 26.234us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 168.604us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 73.331us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 726.334ms, non-child: 19.739us, % non-child: 0.00%) BytesReceived(16s000ms): 932.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 4.998us - DeserializeRowBatchTimer: 15.880us - FirstBatchArrivalWaitTime: 694.082ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 165.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=3):(Total: 636.748ms, non-child: 636.748ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:227/13.68 GB 2:227/12.63 GB 6:235/14.13 GB 3:228/12.44 GB 0:227/13.13 GB 4:211/12.69 GB 7:229/13.81 GB 1:225/13.16 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 116 out of 116 Runtime filters: Only following filters arrived: 6, waited 60ms Hdfs Read Thread Concurrency Bucket: 0:99.28% 1:0.5415% 2:0.09025% 3:0% 4:0% 5:0.09025% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1693 PARQUET/SNAPPY:116 BytesRead(16s000ms): 13.32 MB, 14.47 MB, 14.83 MB, 19.33 MB, 29.14 MB, 29.79 MB, 38.53 MB, 43.61 MB, 44.75 MB, 55.30 MB, 58.27 MB, 59.72 MB, 71.39 MB, 72.95 MB, 75.67 MB, 87.33 MB, 88.00 MB, 93.78 MB, 102.43 MB, 103.08 MB, 109.93 MB, 117.05 MB, 117.24 MB, 118.37 MB, 127.67 MB, 131.94 MB, 132.09 MB, 133.19 MB, 133.42 MB, 136.31 MB, 141.23 MB, 141.63 MB, 141.63 MB, 141.63 MB - FooterProcessingTime: (Avg: 60.937ms ; Min: 3.867ms ; Max: 256.446ms ; Number of samples: 116) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 11.91 - BytesRead: 141.63 MB (148511826) - BytesReadDataNodeCache: 0 - BytesReadLocal: 141.63 MB (148511826) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 141.63 MB (148511826) - DecompressionTime: 1s466ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 116 (116) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 29.30 MB (30727133) - PerReadThreadRawHdfsThroughput: 22.23 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 136.576ms - RowBatchQueuePutWaitTime: 1h45m - RowsRead: 77.10M (77101601) - RowsReturned: 76.96M (76961455) - RowsReturnedRate: 120.87 M/sec - ScanRangesComplete: 1.81K (1809) - ScannerThreadsInvoluntaryContextSwitches: 27.52K (27516) - ScannerThreadsTotalWallClockTime: 1h50m - MaterializeTupleTime(*): 5s981ms - ScannerThreadsSysTime: 2m17s - ScannerThreadsUserTime: 2m3s - ScannerThreadsVoluntaryContextSwitches: 14.12M (14119262) - TotalRawHdfsReadTime(*): 6s371ms - TotalReadThroughput: 261.79 KB/sec Filter 2 (16.00 MB): - Rows processed: 1.99M (1990514) - Rows rejected: 140.10K (140102) - Rows total: 77.10M (77101601) Filter 5 (16.00 MB): - Rows processed: 1.80M (1797164) - Rows rejected: 44 (44) - Rows total: 76.96M (76961499) Filter 6 (1.00 MB): - Files processed: 1.81K (1809) - Files rejected: 1.69K (1693) - Files total: 1.81K (1809) - RowGroups processed: 75.13K (75132) - RowGroups rejected: 0 (0) - RowGroups total: 75.13K (75132) - Rows processed: 1.90M (1900544) - Rows rejected: 0 (0) - Rows total: 76.96M (76961455) - Splits processed: 116 (116) - Splits rejected: 0 (0) - Splits total: 116 (116) Instance 7f40dcb034de70b7:76 (host=ve1136.foo:22000):(Total: 9m22s, non-child: 8m59s, % non-child: 95.97%) Hdfs split stats (:<# splits>/): 3:225/11.98 GB 0:245/14.73 GB 2:217/12.71 GB 4:224/13.57 GB 6:245/14.49 GB 7:237/13.10 GB 5:216/12.58 GB 1:213/12.54 GB Filter 6 arrival: 1s208ms Filter 2 arrival: 10s887ms Filter 5 arrival: 15s525ms MemoryUsage(16s000ms): 36.99 MB, 66.84 MB, 66.71 MB, 66.50 MB, 66.84 MB, 66.64 MB, 65.64 MB, 65.72 MB, 66.11 MB, 66.68 MB, 66.85 MB, 66.51 MB, 66.78 MB, 66.82 MB, 65.52 MB, 66.75 MB, 66.45 MB, 65.61 MB, 65.74 MB, 65.98 MB, 66.66 MB, 66.79 MB, 66.85 MB, 66.73 MB, 66.80 MB, 66.75 MB, 66.78 MB, 66.90 MB, 66.67 MB, 66.61 MB, 62.40 MB, 60.11 MB, 60.10 MB, 57.22 MB, 45.39 MB ThreadUsage(16s000ms): 11, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 7 - AverageThreadTokens: 12.80 - BloomFilterBytes: 33.00 MB (34603008) - PeakMemoryUsage: 67.42 MB (70694363) - PerHostPeakMemUsage: 161.66 GB (173583718231) - RowsProduced: 77.80M (77801859) - TotalNetworkReceiveTime: 972.717ms - TotalNetworkSendTime: 8m44s - TotalStorageWaitTime: 12s992ms - TotalThreadsInvoluntaryContextSwitches: 33.15K (33150) - TotalThreadsTotalWallClockTime: 1h59m - TotalThreadsSysTime: 1m51s - TotalThreadsUserTime: 2m34s - TotalThreadsVoluntaryContextSwitches: 9.12M (9123811) Fragment Instance Lifecycle Timings: - ExecTime: 9m20s - ExecTreeExecTime: 3s981ms - OpenTime: 1s312ms - ExecTreeOpenTime: 1s122ms - PrepareTime: 49.902ms - ExecTreePrepareTime: 6.136ms DataStreamSender (dst_id=22):(Total: 17s401ms, non-child: 17s401ms, % non-child: 100.00%) - BytesSent: 718.85 MB (753768919) - NetworkThroughput(*): 73.69 MB/sec - OverallThroughput: 41.31 MB/sec - PeakMemoryUsage: 4.83 MB (5068544) - RowsReturned: 77.80M (77801859) - SerializeBatchTime: 7s624ms - TransmitDataRPCTime: 9s754ms - UncompressedRowBatchSize: 2.17 GB (2334892890) CodeGen:(Total: 209.104ms, non-child: 209.104ms, % non-child: 100.00%) - CodegenTime: 946.748us - CompileTime: 56.037ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 132.524ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 20.197ms HASH_JOIN_NODE (id=5):(Total: 5s066ms, non-child: 3s430ms, % non-child: 67.71%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.534ms - PeakMemoryUsage: 1.23 MB (1292660) - ProbeRows: 77.80M (77801859) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3s286ms - RowsReturned: 77.80M (77801859) - RowsReturnedRate: 15.36 M/sec Hash Join Builder (join_node_id=5): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 29.521us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 144.086us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 64.952us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 972.727ms, non-child: 21.914us, % non-child: 0.00%) BytesReceived(16s000ms): 901.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 4.811us - DeserializeRowBatchTimer: 14.957us - FirstBatchArrivalWaitTime: 944.681ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 123.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=3):(Total: 663.999ms, non-child: 663.999ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:225/11.98 GB 0:245/14.73 GB 2:217/12.71 GB 4:224/13.57 GB 6:245/14.49 GB 7:237/13.10 GB 5:216/12.58 GB 1:213/12.54 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 118 out of 118 Runtime filters: Only following filters arrived: 6, waited 40ms Hdfs Read Thread Concurrency Bucket: 0:99.09% 1:0.816% 2:0.09066% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1704 PARQUET/SNAPPY:118 BytesRead(16s000ms): 13.08 MB, 14.44 MB, 15.08 MB, 23.20 MB, 29.25 MB, 30.34 MB, 40.51 MB, 43.49 MB, 45.97 MB, 57.38 MB, 58.32 MB, 61.78 MB, 72.49 MB, 73.07 MB, 77.99 MB, 87.50 MB, 88.73 MB, 99.27 MB, 101.85 MB, 103.91 MB, 113.95 MB, 116.36 MB, 116.73 MB, 119.06 MB, 129.09 MB, 131.01 MB, 131.40 MB, 132.65 MB, 134.80 MB, 139.59 MB, 141.96 MB, 141.96 MB, 141.96 MB, 141.96 MB - FooterProcessingTime: (Avg: 59.603ms ; Min: 4.405ms ; Max: 182.370ms ; Number of samples: 118) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 11.98 - BytesRead: 141.96 MB (148860049) - BytesReadDataNodeCache: 0 - BytesReadLocal: 141.96 MB (148860049) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 141.96 MB (148860049) - DecompressionTime: 1s352ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 118 (118) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 29.23 MB (30649786) - PerReadThreadRawHdfsThroughput: 20.61 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 102.634ms - RowBatchQueuePutWaitTime: 1h46m - RowsRead: 77.94M (77939636) - RowsReturned: 77.80M (77801859) - RowsReturnedRate: 117.17 M/sec - ScanRangesComplete: 1.82K (1822) - ScannerThreadsInvoluntaryContextSwitches: 28.04K (28038) - ScannerThreadsTotalWallClockTime: 1h50m - MaterializeTupleTime(*): 6s764ms - ScannerThreadsSysTime: 1m50s - ScannerThreadsUserTime: 2m9s - ScannerThreadsVoluntaryContextSwitches: 9.12M (9120696) - TotalRawHdfsReadTime(*): 6s887ms - TotalReadThroughput: 263.35 KB/sec Filter 2 (16.00 MB): - Rows processed: 1.99M (1991217) - Rows rejected: 137.72K (137725) - Rows total: 77.94M (77939636) Filter 5 (16.00 MB): - Rows processed: 1.85M (1853492) - Rows rejected: 52 (52) - Rows total: 77.80M (77801911) Filter 6 (1.00 MB): - Files processed: 1.82K (1822) - Files rejected: 1.70K (1704) - Files total: 1.82K (1822) - RowGroups processed: 75.95K (75955) - RowGroups rejected: 0 (0) - RowGroups total: 75.95K (75955) - Rows processed: 1.93M (1933312) - Rows rejected: 0 (0) - Rows total: 77.80M (77801859) - Splits processed: 118 (118) - Splits rejected: 0 (0) - Splits total: 118 (118) Instance 7f40dcb034de70b7:75 (host=vc1506.foo:22000):(Total: 9m22s, non-child: 9m, % non-child: 96.14%) Hdfs split stats (:<# splits>/): 4:231/13.27 GB 1:221/13.37 GB 0:228/13.59 GB 3:244/14.15 GB 7:223/12.42 GB 2:218/12.61 GB 6:240/14.06 GB 5:209/12.22 GB Filter 6 arrival: 1s218ms Filter 2 arrival: 10s878ms Filter 5 arrival: 15s552ms MemoryUsage(16s000ms): 37.09 MB, 66.78 MB, 66.72 MB, 66.24 MB, 65.82 MB, 65.72 MB, 66.32 MB, 66.84 MB, 66.79 MB, 66.68 MB, 66.83 MB, 66.24 MB, 64.77 MB, 64.83 MB, 65.42 MB, 66.73 MB, 66.45 MB, 65.93 MB, 65.80 MB, 65.56 MB, 65.66 MB, 65.83 MB, 65.85 MB, 66.11 MB, 66.79 MB, 66.84 MB, 66.75 MB, 66.63 MB, 66.73 MB, 66.73 MB, 66.72 MB, 66.85 MB, 66.87 MB, 66.76 MB, 61.99 MB ThreadUsage(16s000ms): 11, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 11 - AverageThreadTokens: 12.88 - BloomFilterBytes: 33.00 MB (34603008) - PeakMemoryUsage: 67.56 MB (70841492) - PerHostPeakMemUsage: 161.66 GB (173580859691) - RowsProduced: 80.12M (80119618) - TotalNetworkReceiveTime: 996.899ms - TotalNetworkSendTime: 8m51s - TotalStorageWaitTime: 13s238ms - TotalThreadsInvoluntaryContextSwitches: 6.86K (6858) - TotalThreadsTotalWallClockTime: 2h - TotalThreadsSysTime: 2s702ms - TotalThreadsUserTime: 32s009ms - TotalThreadsVoluntaryContextSwitches: 137.64K (137644) Fragment Instance Lifecycle Timings: - ExecTime: 9m20s - ExecTreeExecTime: 3s736ms - OpenTime: 1s357ms - ExecTreeOpenTime: 1s175ms - PrepareTime: 44.679ms - ExecTreePrepareTime: 6.491ms DataStreamSender (dst_id=22):(Total: 16s620ms, non-child: 16s620ms, % non-child: 100.00%) - BytesSent: 741.53 MB (777548087) - NetworkThroughput(*): 78.37 MB/sec - OverallThroughput: 44.62 MB/sec - PeakMemoryUsage: 4.91 MB (5150464) - RowsReturned: 80.12M (80119618) - SerializeBatchTime: 7s138ms - TransmitDataRPCTime: 9s462ms - UncompressedRowBatchSize: 2.24 GB (2404450564) CodeGen:(Total: 196.273ms, non-child: 196.273ms, % non-child: 100.00%) - CodegenTime: 948.158us - CompileTime: 53.709ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 126.131ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 16.039ms HASH_JOIN_NODE (id=5):(Total: 4s882ms, non-child: 3s279ms, % non-child: 67.16%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.384ms - PeakMemoryUsage: 1.24 MB (1298356) - ProbeRows: 80.12M (80119618) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3s119ms - RowsReturned: 80.12M (80119618) - RowsReturnedRate: 16.41 M/sec Hash Join Builder (join_node_id=5): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 24.246us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 106.169us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 56.280us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 996.909ms, non-child: 18.387us, % non-child: 0.00%) BytesReceived(16s000ms): 932.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 4.775us - DeserializeRowBatchTimer: 16.896us - FirstBatchArrivalWaitTime: 955.915ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 120.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=3):(Total: 607.145ms, non-child: 607.145ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:231/13.27 GB 1:221/13.37 GB 0:228/13.59 GB 3:244/14.15 GB 7:223/12.42 GB 2:218/12.61 GB 6:240/14.06 GB 5:209/12.22 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 121 out of 121 Runtime filters: Only following filters arrived: 6, waited 41ms Hdfs Read Thread Concurrency Bucket: 0:99.19% 1:0.6284% 2:0.1795% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1693 PARQUET/SNAPPY:121 BytesRead(16s000ms): 13.03 MB, 14.38 MB, 14.80 MB, 20.73 MB, 28.93 MB, 29.91 MB, 40.15 MB, 43.57 MB, 45.33 MB, 56.77 MB, 58.32 MB, 62.48 MB, 72.55 MB, 73.38 MB, 81.03 MB, 87.49 MB, 89.51 MB, 101.23 MB, 102.06 MB, 105.57 MB, 116.39 MB, 116.54 MB, 117.26 MB, 124.04 MB, 131.47 MB, 131.47 MB, 132.36 MB, 135.63 MB, 145.24 MB, 145.82 MB, 145.82 MB, 145.82 MB, 145.82 MB, 146.63 MB - FooterProcessingTime: (Avg: 61.654ms ; Min: 24.128ms ; Max: 324.709ms ; Number of samples: 121) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 11.98 - BytesRead: 147.05 MB (154193101) - BytesReadDataNodeCache: 0 - BytesReadLocal: 147.05 MB (154193101) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 147.05 MB (154193101) - DecompressionTime: 1s130ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 121 (121) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 29.42 MB (30850069) - PerReadThreadRawHdfsThroughput: 21.58 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 131.877ms - RowBatchQueuePutWaitTime: 1h50m - RowsRead: 80.27M (80267207) - RowsReturned: 80.12M (80119618) - RowsReturnedRate: 131.96 M/sec - ScanRangesComplete: 1.81K (1814) - ScannerThreadsInvoluntaryContextSwitches: 1.89K (1891) - ScannerThreadsTotalWallClockTime: 1h51m - MaterializeTupleTime(*): 6s314ms - ScannerThreadsSysTime: 1s987ms - ScannerThreadsUserTime: 9s175ms - ScannerThreadsVoluntaryContextSwitches: 134.52K (134519) - TotalRawHdfsReadTime(*): 6s813ms - TotalReadThroughput: 270.10 KB/sec Filter 2 (16.00 MB): - Rows processed: 2.09M (2093189) - Rows rejected: 147.56K (147565) - Rows total: 80.27M (80267207) Filter 5 (16.00 MB): - Rows processed: 1.95M (1945624) - Rows rejected: 24 (24) - Rows total: 80.12M (80119642) Filter 6 (1.00 MB): - Files processed: 1.81K (1814) - Files rejected: 1.69K (1693) - Files total: 1.81K (1814) - RowGroups processed: 78.21K (78214) - RowGroups rejected: 0 (0) - RowGroups total: 78.21K (78214) - Rows processed: 1.98M (1982464) - Rows rejected: 0 (0) - Rows total: 80.12M (80119618) - Splits processed: 121 (121) - Splits rejected: 0 (0) - Splits total: 121 (121) Instance 7f40dcb034de70b7:bc (host=vd1139.foo:22000):(Total: 9m21s, non-child: 9m, % non-child: 96.15%) Hdfs split stats (:<# splits>/): 5:223/13.28 GB 7:248/15.17 GB 6:236/13.07 GB 3:247/13.48 GB 4:218/12.90 GB 0:208/12.60 GB 1:214/12.37 GB 2:224/12.80 GB Filter 6 arrival: 888ms Filter 2 arrival: 12s833ms Filter 5 arrival: 16s394ms MemoryUsage(16s000ms): 33.55 MB, 65.23 MB, 65.83 MB, 65.91 MB, 66.76 MB, 66.86 MB, 66.50 MB, 66.80 MB, 66.77 MB, 66.38 MB, 66.79 MB, 66.43 MB, 66.77 MB, 66.80 MB, 66.32 MB, 66.77 MB, 66.76 MB, 65.46 MB, 63.85 MB, 63.83 MB, 65.42 MB, 66.83 MB, 66.82 MB, 66.43 MB, 65.27 MB, 63.62 MB, 63.75 MB, 63.83 MB, 63.79 MB, 63.66 MB, 65.68 MB, 65.74 MB, 65.67 MB, 65.85 MB, 60.98 MB ThreadUsage(16s000ms): 12, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 11 - AverageThreadTokens: 12.90 - BloomFilterBytes: 33.00 MB (34603008) - PeakMemoryUsage: 67.42 MB (70691300) - PerHostPeakMemUsage: 161.66 GB (173581214843) - RowsProduced: 79.45M (79447345) - TotalNetworkReceiveTime: 652.060ms - TotalNetworkSendTime: 8m53s - TotalStorageWaitTime: 12s771ms - TotalThreadsInvoluntaryContextSwitches: 9.52K (9516) - TotalThreadsTotalWallClockTime: 2h - TotalThreadsSysTime: 3s233ms - TotalThreadsUserTime: 32s028ms - TotalThreadsVoluntaryContextSwitches: 131.02K (131020) Fragment Instance Lifecycle Timings: - ExecTime: 9m20s - ExecTreeExecTime: 3s707ms - OpenTime: 1s145ms - ExecTreeOpenTime: 958.735ms - PrepareTime: 53.622ms - ExecTreePrepareTime: 6.630ms DataStreamSender (dst_id=22):(Total: 16s796ms, non-child: 16s796ms, % non-child: 100.00%) - BytesSent: 735.92 MB (771666827) - NetworkThroughput(*): 74.94 MB/sec - OverallThroughput: 43.81 MB/sec - PeakMemoryUsage: 5.01 MB (5248768) - RowsReturned: 79.45M (79447345) - SerializeBatchTime: 6s955ms - TransmitDataRPCTime: 9s820ms - UncompressedRowBatchSize: 2.22 GB (2384275166) CodeGen:(Total: 207.310ms, non-child: 207.310ms, % non-child: 100.00%) - CodegenTime: 1.101ms - CompileTime: 56.242ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 129.104ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 21.572ms HASH_JOIN_NODE (id=5):(Total: 4s631ms, non-child: 3s226ms, % non-child: 69.68%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.591ms - PeakMemoryUsage: 1.23 MB (1293539) - ProbeRows: 79.45M (79447345) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3s091ms - RowsReturned: 79.45M (79447345) - RowsReturnedRate: 17.16 M/sec Hash Join Builder (join_node_id=5): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 26.398us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 185.305us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 59.572us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 652.071ms, non-child: 20.521us, % non-child: 0.00%) BytesReceived(16s000ms): 932.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 5.346us - DeserializeRowBatchTimer: 24.376us - FirstBatchArrivalWaitTime: 638.454ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 184.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=3):(Total: 752.640ms, non-child: 752.640ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:223/13.28 GB 7:248/15.17 GB 6:236/13.07 GB 3:247/13.48 GB 4:218/12.90 GB 0:208/12.60 GB 1:214/12.37 GB 2:224/12.80 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 120 out of 120 Runtime filters: Only following filters arrived: 6, waited 141ms Hdfs Read Thread Concurrency Bucket: 0:99.37% 1:0.4488% 2:0.08977% 3:0.08977% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1698 PARQUET/SNAPPY:120 BytesRead(16s000ms): 12.99 MB, 14.33 MB, 14.33 MB, 20.33 MB, 29.17 MB, 29.17 MB, 38.92 MB, 43.53 MB, 44.02 MB, 55.21 MB, 57.80 MB, 60.34 MB, 72.70 MB, 72.70 MB, 76.79 MB, 87.21 MB, 87.21 MB, 93.19 MB, 101.71 MB, 101.90 MB, 109.90 MB, 116.53 MB, 116.53 MB, 116.75 MB, 125.65 MB, 130.59 MB, 130.59 MB, 130.70 MB, 131.83 MB, 134.06 MB, 145.20 MB, 145.24 MB, 145.24 MB, 145.24 MB - FooterProcessingTime: (Avg: 57.720ms ; Min: 4.452ms ; Max: 215.023ms ; Number of samples: 120) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 11.99 - BytesRead: 145.24 MB (152295848) - BytesReadDataNodeCache: 0 - BytesReadLocal: 145.24 MB (152295848) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 145.24 MB (152295848) - DecompressionTime: 1s039ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 120 (120) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 29.30 MB (30722390) - PerReadThreadRawHdfsThroughput: 22.41 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 159.185ms - RowBatchQueuePutWaitTime: 1h51m - RowsRead: 79.59M (79593224) - RowsReturned: 79.45M (79447345) - RowsReturnedRate: 105.56 M/sec - ScanRangesComplete: 1.82K (1818) - ScannerThreadsInvoluntaryContextSwitches: 4.78K (4776) - ScannerThreadsTotalWallClockTime: 1h51m - MaterializeTupleTime(*): 6s496ms - ScannerThreadsSysTime: 2s445ms - ScannerThreadsUserTime: 10s650ms - ScannerThreadsVoluntaryContextSwitches: 127.92K (127919) - TotalRawHdfsReadTime(*): 6s482ms - TotalReadThroughput: 266.77 KB/sec Filter 2 (16.00 MB): - Rows processed: 2.09M (2087369) - Rows rejected: 145.82K (145823) - Rows total: 79.59M (79593224) Filter 5 (16.00 MB): - Rows processed: 1.85M (1850424) - Rows rejected: 56 (56) - Rows total: 79.45M (79447401) Filter 6 (1.00 MB): - Files processed: 1.82K (1818) - Files rejected: 1.70K (1698) - Files total: 1.82K (1818) - RowGroups processed: 77.56K (77562) - RowGroups rejected: 0 (0) - RowGroups total: 77.56K (77562) - Rows processed: 1.97M (1966080) - Rows rejected: 0 (0) - Rows total: 79.45M (79447345) - Splits processed: 120 (120) - Splits rejected: 0 (0) - Splits total: 120 (120) Instance 7f40dcb034de70b7:97 (host=vd1327.foo:22000):(Total: 9m21s, non-child: 8m59s, % non-child: 96.01%) Hdfs split stats (:<# splits>/): 5:213/12.68 GB 7:227/13.67 GB 4:236/13.04 GB 0:233/12.63 GB 3:236/13.76 GB 6:223/13.17 GB 2:212/12.39 GB 1:236/14.34 GB Filter 6 arrival: 1s078ms Filter 2 arrival: 11s848ms Filter 5 arrival: 15s975ms MemoryUsage(16s000ms): 33.85 MB, 64.80 MB, 64.78 MB, 66.07 MB, 66.78 MB, 66.25 MB, 63.86 MB, 63.69 MB, 64.49 MB, 66.73 MB, 66.77 MB, 66.31 MB, 66.80 MB, 66.76 MB, 66.74 MB, 66.74 MB, 65.95 MB, 64.75 MB, 64.81 MB, 65.20 MB, 65.16 MB, 65.79 MB, 65.62 MB, 66.27 MB, 66.33 MB, 66.82 MB, 66.35 MB, 65.51 MB, 65.70 MB, 65.62 MB, 65.27 MB, 63.56 MB, 63.57 MB, 62.87 MB, 57.67 MB ThreadUsage(16s000ms): 11, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 10 - AverageThreadTokens: 12.89 - BloomFilterBytes: 33.00 MB (34603008) - PeakMemoryUsage: 67.51 MB (70787689) - PerHostPeakMemUsage: 161.66 GB (173580428662) - RowsProduced: 78.73M (78734414) - TotalNetworkReceiveTime: 865.328ms - TotalNetworkSendTime: 8m50s - TotalStorageWaitTime: 13s417ms - TotalThreadsInvoluntaryContextSwitches: 18.36K (18364) - TotalThreadsTotalWallClockTime: 2h - TotalThreadsSysTime: 8s967ms - TotalThreadsUserTime: 1m53s - TotalThreadsVoluntaryContextSwitches: 1.07M (1066911) Fragment Instance Lifecycle Timings: - ExecTime: 9m20s - ExecTreeExecTime: 3s824ms - OpenTime: 1s204ms - ExecTreeOpenTime: 1s028ms - PrepareTime: 40.047ms - ExecTreePrepareTime: 5.779ms DataStreamSender (dst_id=22):(Total: 17s409ms, non-child: 17s409ms, % non-child: 100.00%) - BytesSent: 727.28 MB (762610473) - NetworkThroughput(*): 73.65 MB/sec - OverallThroughput: 41.78 MB/sec - PeakMemoryUsage: 5.04 MB (5281536) - RowsReturned: 78.73M (78734414) - SerializeBatchTime: 7s513ms - TransmitDataRPCTime: 9s875ms - UncompressedRowBatchSize: 2.20 GB (2362879596) CodeGen:(Total: 189.465ms, non-child: 189.465ms, % non-child: 100.00%) - CodegenTime: 913.047us - CompileTime: 52.723ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 121.373ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 15.003ms HASH_JOIN_NODE (id=5):(Total: 4s812ms, non-child: 3s316ms, % non-child: 68.91%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 2.049ms - PeakMemoryUsage: 1.23 MB (1294174) - ProbeRows: 78.73M (78734414) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3s166ms - RowsReturned: 78.73M (78734414) - RowsReturnedRate: 16.36 M/sec Hash Join Builder (join_node_id=5): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 27.824us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 455.744us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 60.879us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 865.340ms, non-child: 20.678us, % non-child: 0.00%) BytesReceived(16s000ms): 901.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 4.731us - DeserializeRowBatchTimer: 15.363us - FirstBatchArrivalWaitTime: 825.721ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 138.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=3):(Total: 631.296ms, non-child: 631.296ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:213/12.68 GB 7:227/13.67 GB 4:236/13.04 GB 0:233/12.63 GB 3:236/13.76 GB 6:223/13.17 GB 2:212/12.39 GB 1:236/14.34 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 119 out of 119 Runtime filters: Only following filters arrived: 6, waited 40ms Hdfs Read Thread Concurrency Bucket: 0:99.01% 1:0.8985% 2:0% 3:0.08985% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1697 PARQUET/SNAPPY:119 BytesRead(16s000ms): 12.96 MB, 14.31 MB, 14.70 MB, 21.61 MB, 28.73 MB, 30.04 MB, 40.05 MB, 42.89 MB, 45.67 MB, 57.06 MB, 57.72 MB, 62.30 MB, 71.76 MB, 72.49 MB, 78.40 MB, 85.98 MB, 87.24 MB, 96.91 MB, 100.35 MB, 102.30 MB, 110.64 MB, 114.56 MB, 115.16 MB, 117.71 MB, 126.88 MB, 129.27 MB, 129.63 MB, 130.64 MB, 134.64 MB, 136.17 MB, 142.37 MB, 142.59 MB, 142.59 MB, 142.59 MB - FooterProcessingTime: (Avg: 64.439ms ; Min: 27.233ms ; Max: 454.975ms ; Number of samples: 119) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 11.98 - BytesRead: 142.59 MB (149520131) - BytesReadDataNodeCache: 0 - BytesReadLocal: 142.59 MB (149520131) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 142.59 MB (149520131) - DecompressionTime: 2s292ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 119 (119) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 29.27 MB (30696660) - PerReadThreadRawHdfsThroughput: 21.83 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 116.220ms - RowBatchQueuePutWaitTime: 1h49m - RowsRead: 78.88M (78877678) - RowsReturned: 78.73M (78734414) - RowsReturnedRate: 124.72 M/sec - ScanRangesComplete: 1.82K (1816) - ScannerThreadsInvoluntaryContextSwitches: 13.39K (13392) - ScannerThreadsTotalWallClockTime: 1h51m - MaterializeTupleTime(*): 7s150ms - ScannerThreadsSysTime: 8s236ms - ScannerThreadsUserTime: 1m29s - ScannerThreadsVoluntaryContextSwitches: 1.06M (1063810) - TotalRawHdfsReadTime(*): 6s532ms - TotalReadThroughput: 262.15 KB/sec Filter 2 (16.00 MB): - Rows processed: 2.04M (2037664) - Rows rejected: 143.20K (143201) - Rows total: 78.88M (78877678) Filter 5 (16.00 MB): - Rows processed: 1.86M (1862719) - Rows rejected: 63 (63) - Rows total: 78.73M (78734477) Filter 6 (1.00 MB): - Files processed: 1.82K (1816) - Files rejected: 1.70K (1697) - Files total: 1.82K (1816) - RowGroups processed: 76.86K (76864) - RowGroups rejected: 0 (0) - RowGroups total: 76.86K (76864) - Rows processed: 1.95M (1949696) - Rows rejected: 0 (0) - Rows total: 78.73M (78734414) - Splits processed: 119 (119) - Splits rejected: 0 (0) - Splits total: 119 (119) Instance 7f40dcb034de70b7:d6 (host=va1026.foo:22000):(Total: 9m20s, non-child: 8m57s, % non-child: 95.89%) Hdfs split stats (:<# splits>/): 3:214/12.65 GB 5:223/12.26 GB 2:219/13.13 GB 7:222/12.78 GB 6:226/13.31 GB 0:230/13.31 GB 1:225/13.86 GB 4:256/14.38 GB Filter 6 arrival: 764ms Filter 2 arrival: 13s100ms Filter 5 arrival: 16s621ms MemoryUsage(16s000ms): 32.07 MB, 63.78 MB, 64.80 MB, 65.16 MB, 65.75 MB, 65.77 MB, 66.20 MB, 66.79 MB, 66.52 MB, 66.64 MB, 66.79 MB, 66.43 MB, 66.77 MB, 66.86 MB, 66.49 MB, 66.80 MB, 66.76 MB, 65.94 MB, 65.86 MB, 65.52 MB, 64.92 MB, 65.81 MB, 65.76 MB, 66.29 MB, 66.49 MB, 66.70 MB, 66.90 MB, 66.70 MB, 66.72 MB, 66.33 MB, 62.56 MB, 62.51 MB, 62.53 MB, 62.59 MB ThreadUsage(16s000ms): 11, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.92 - BloomFilterBytes: 33.00 MB (34603008) - PeakMemoryUsage: 67.52 MB (70797399) - PerHostPeakMemUsage: 161.66 GB (173585883461) - RowsProduced: 78.92M (78924828) - TotalNetworkReceiveTime: 514.884ms - TotalNetworkSendTime: 8m43s - TotalStorageWaitTime: 13s957ms - TotalThreadsInvoluntaryContextSwitches: 15.13K (15129) - TotalThreadsTotalWallClockTime: 2h - TotalThreadsSysTime: 3s251ms - TotalThreadsUserTime: 1m48s - TotalThreadsVoluntaryContextSwitches: 202.42K (202416) Fragment Instance Lifecycle Timings: - ExecTime: 9m19s - ExecTreeExecTime: 5s505ms - OpenTime: 1s075ms - ExecTreeOpenTime: 879.353ms - PrepareTime: 59.848ms - ExecTreePrepareTime: 8.878ms DataStreamSender (dst_id=22):(Total: 16s487ms, non-child: 16s487ms, % non-child: 100.00%) - BytesSent: 727.27 MB (762602072) - NetworkThroughput(*): 79.41 MB/sec - OverallThroughput: 44.11 MB/sec - PeakMemoryUsage: 4.99 MB (5232384) - RowsReturned: 78.92M (78924828) - SerializeBatchTime: 7s309ms - TransmitDataRPCTime: 9s158ms - UncompressedRowBatchSize: 2.21 GB (2368594056) CodeGen:(Total: 216.324ms, non-child: 216.324ms, % non-child: 100.00%) - CodegenTime: 976.416us - CompileTime: 56.988ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 137.568ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 21.327ms HASH_JOIN_NODE (id=5):(Total: 6s354ms, non-child: 3s290ms, % non-child: 51.77%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.310ms - PeakMemoryUsage: 1.24 MB (1295820) - ProbeRows: 78.92M (78924828) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3s122ms - RowsReturned: 78.92M (78924828) - RowsReturnedRate: 12.42 M/sec Hash Join Builder (join_node_id=5): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 23.487us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 117.190us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 54.424us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 514.895ms, non-child: 19.469us, % non-child: 0.00%) BytesReceived(16s000ms): 963.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 4.558us - DeserializeRowBatchTimer: 26.003us - FirstBatchArrivalWaitTime: 493.984ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 233.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=3):(Total: 2s551ms, non-child: 2s551ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:214/12.65 GB 5:223/12.26 GB 2:219/13.13 GB 7:222/12.78 GB 6:226/13.31 GB 0:230/13.31 GB 1:225/13.86 GB 4:256/14.38 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 119 out of 119 Runtime filters: Only following filters arrived: 6, waited 261ms Hdfs Read Thread Concurrency Bucket: 0:99.1% 1:0.8094% 2:0.08993% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1696 PARQUET/SNAPPY:119 BytesRead(16s000ms): 12.65 MB, 13.96 MB, 13.96 MB, 19.52 MB, 27.98 MB, 27.98 MB, 37.52 MB, 42.16 MB, 42.83 MB, 56.31 MB, 56.72 MB, 60.36 MB, 71.54 MB, 71.54 MB, 76.83 MB, 85.99 MB, 86.11 MB, 97.16 MB, 100.27 MB, 100.58 MB, 111.07 MB, 114.24 MB, 114.24 MB, 115.23 MB, 127.11 MB, 128.53 MB, 128.53 MB, 128.79 MB, 130.95 MB, 136.08 MB, 141.29 MB, 141.32 MB, 141.32 MB, 141.32 MB - FooterProcessingTime: (Avg: 64.155ms ; Min: 27.221ms ; Max: 185.783ms ; Number of samples: 119) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 11.98 - BytesRead: 141.32 MB (148188145) - BytesReadDataNodeCache: 0 - BytesReadLocal: 141.32 MB (148188145) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 141.32 MB (148188145) - DecompressionTime: 3s661ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 119 (119) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 29.35 MB (30778762) - PerReadThreadRawHdfsThroughput: 18.43 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 94.972ms - RowBatchQueuePutWaitTime: 1h49m - RowsRead: 79.07M (79069391) - RowsReturned: 78.92M (78924828) - RowsReturnedRate: 30.94 M/sec - ScanRangesComplete: 1.81K (1815) - ScannerThreadsInvoluntaryContextSwitches: 9.99K (9993) - ScannerThreadsTotalWallClockTime: 1h51m - MaterializeTupleTime(*): 6s120ms - ScannerThreadsSysTime: 2s459ms - ScannerThreadsUserTime: 1m25s - ScannerThreadsVoluntaryContextSwitches: 198.93K (198930) - TotalRawHdfsReadTime(*): 7s667ms - TotalReadThroughput: 260.04 KB/sec Filter 2 (16.00 MB): - Rows processed: 2.07M (2067635) - Rows rejected: 144.55K (144552) - Rows total: 79.07M (79069391) Filter 5 (16.00 MB): - Rows processed: 1.92M (1920011) - Rows rejected: 11 (11) - Rows total: 78.92M (78924839) Filter 6 (1.00 MB): - Files processed: 1.81K (1815) - Files rejected: 1.70K (1696) - Files total: 1.81K (1815) - RowGroups processed: 77.05K (77046) - RowGroups rejected: 0 (0) - RowGroups total: 77.05K (77046) - Rows processed: 1.95M (1949696) - Rows rejected: 0 (0) - Rows total: 78.92M (78924828) - Splits processed: 119 (119) - Splits rejected: 0 (0) - Splits total: 119 (119) Instance 7f40dcb034de70b7:88 (host=ve1132.foo:22000):(Total: 9m20s, non-child: 8m58s, % non-child: 96.08%) Hdfs split stats (:<# splits>/): 6:237/13.33 GB 0:220/12.84 GB 7:234/14.38 GB 1:230/12.44 GB 4:232/13.27 GB 3:218/13.22 GB 5:219/12.13 GB 2:233/14.04 GB Filter 6 arrival: 1s090ms Filter 2 arrival: 11s369ms Filter 5 arrival: 15s760ms MemoryUsage(16s000ms): 34.88 MB, 65.79 MB, 65.86 MB, 66.20 MB, 65.76 MB, 65.81 MB, 66.01 MB, 66.81 MB, 66.77 MB, 66.62 MB, 66.82 MB, 65.65 MB, 65.68 MB, 65.83 MB, 65.64 MB, 65.79 MB, 65.86 MB, 64.99 MB, 64.75 MB, 64.81 MB, 63.54 MB, 64.03 MB, 64.83 MB, 65.04 MB, 66.75 MB, 66.85 MB, 66.86 MB, 66.75 MB, 66.33 MB, 66.92 MB, 66.81 MB, 66.74 MB, 66.87 MB, 66.83 MB ThreadUsage(16s000ms): 12, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.94 - BloomFilterBytes: 33.00 MB (34603008) - PeakMemoryUsage: 67.47 MB (70751743) - PerHostPeakMemUsage: 161.68 GB (173598578534) - RowsProduced: 79.79M (79794012) - TotalNetworkReceiveTime: 846.099ms - TotalNetworkSendTime: 8m52s - TotalStorageWaitTime: 15s747ms - TotalThreadsInvoluntaryContextSwitches: 7.09K (7089) - TotalThreadsTotalWallClockTime: 2h - TotalThreadsSysTime: 3s099ms - TotalThreadsUserTime: 31s956ms - TotalThreadsVoluntaryContextSwitches: 146.83K (146830) Fragment Instance Lifecycle Timings: - ExecTime: 9m19s - ExecTreeExecTime: 3s804ms - OpenTime: 1s444ms - ExecTreeOpenTime: 1s257ms - PrepareTime: 54.275ms - ExecTreePrepareTime: 7.450ms DataStreamSender (dst_id=22):(Total: 16s749ms, non-child: 16s749ms, % non-child: 100.00%) - BytesSent: 740.83 MB (776818986) - NetworkThroughput(*): 76.74 MB/sec - OverallThroughput: 44.23 MB/sec - PeakMemoryUsage: 4.98 MB (5224192) - RowsReturned: 79.79M (79794012) - SerializeBatchTime: 7s076ms - TransmitDataRPCTime: 9s653ms - UncompressedRowBatchSize: 2.23 GB (2394678880) CodeGen:(Total: 207.071ms, non-child: 207.071ms, % non-child: 100.00%) - CodegenTime: 1.051ms - CompileTime: 57.328ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 127.788ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 21.584ms HASH_JOIN_NODE (id=5):(Total: 5s033ms, non-child: 3s345ms, % non-child: 66.47%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 8.696ms - PeakMemoryUsage: 1.23 MB (1291121) - ProbeRows: 79.79M (79794012) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3s183ms - RowsReturned: 79.79M (79794012) - RowsReturnedRate: 15.85 M/sec Hash Join Builder (join_node_id=5): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 42.973us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 4.313ms - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 99.162us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 846.109ms, non-child: 59.353us, % non-child: 0.01%) BytesReceived(16s000ms): 932.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 4.267us - DeserializeRowBatchTimer: 330.087us - FirstBatchArrivalWaitTime: 838.755ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 141.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=3):(Total: 842.449ms, non-child: 842.449ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 6:237/13.33 GB 0:220/12.84 GB 7:234/14.38 GB 1:230/12.44 GB 4:232/13.27 GB 3:218/13.22 GB 5:219/12.13 GB 2:233/14.04 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 122 out of 122 Runtime filters: Only following filters arrived: 6, waited 41ms Hdfs Read Thread Concurrency Bucket: 0:99.1% 1:0.8108% 2:0.09009% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1701 PARQUET/SNAPPY:122 BytesRead(16s000ms): 13.16 MB, 14.52 MB, 14.52 MB, 19.75 MB, 28.96 MB, 29.29 MB, 38.80 MB, 43.77 MB, 44.44 MB, 55.48 MB, 58.63 MB, 59.45 MB, 73.10 MB, 73.51 MB, 76.37 MB, 88.53 MB, 88.57 MB, 95.18 MB, 102.77 MB, 102.77 MB, 112.02 MB, 117.20 MB, 117.71 MB, 120.98 MB, 131.08 MB, 132.22 MB, 132.22 MB, 133.41 MB, 139.67 MB, 145.85 MB, 146.26 MB, 147.05 MB, 147.05 MB, 147.05 MB - FooterProcessingTime: (Avg: 83.171ms ; Min: 3.760ms ; Max: 395.236ms ; Number of samples: 122) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 11.99 - BytesRead: 147.05 MB (154190517) - BytesReadDataNodeCache: 0 - BytesReadLocal: 147.05 MB (154190517) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 147.05 MB (154190517) - DecompressionTime: 1s275ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 122 (122) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 29.50 MB (30932352) - PerReadThreadRawHdfsThroughput: 22.59 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 337.903ms - RowBatchQueuePutWaitTime: 1h50m - RowsRead: 79.94M (79942754) - RowsReturned: 79.79M (79794012) - RowsReturnedRate: 94.72 M/sec - ScanRangesComplete: 1.82K (1823) - ScannerThreadsInvoluntaryContextSwitches: 2.25K (2252) - ScannerThreadsTotalWallClockTime: 1h51m - MaterializeTupleTime(*): 6s476ms - ScannerThreadsSysTime: 2s394ms - ScannerThreadsUserTime: 9s714ms - ScannerThreadsVoluntaryContextSwitches: 143.58K (143579) - TotalRawHdfsReadTime(*): 6s510ms - TotalReadThroughput: 271.06 KB/sec Filter 2 (16.00 MB): - Rows processed: 2.12M (2123014) - Rows rejected: 148.72K (148717) - Rows total: 79.94M (79942754) Filter 5 (16.00 MB): - Rows processed: 1.97M (1974297) - Rows rejected: 25 (25) - Rows total: 79.79M (79794037) Filter 6 (1.00 MB): - Files processed: 1.82K (1823) - Files rejected: 1.70K (1701) - Files total: 1.82K (1823) - RowGroups processed: 77.89K (77887) - RowGroups rejected: 0 (0) - RowGroups total: 77.89K (77887) - Rows processed: 2.00M (1998848) - Rows rejected: 0 (0) - Rows total: 79.79M (79794012) - Splits processed: 122 (122) - Splits rejected: 0 (0) - Splits total: 122 (122) Instance 7f40dcb034de70b7:de (host=vd1129.foo:22000):(Total: 9m20s, non-child: 8m59s, % non-child: 96.25%) Hdfs split stats (:<# splits>/): 4:228/12.91 GB 1:229/13.27 GB 7:249/14.78 GB 5:234/13.86 GB 0:235/14.37 GB 2:209/11.66 GB 3:211/12.73 GB 6:210/12.13 GB Filter 6 arrival: 735ms Filter 2 arrival: 13s303ms Filter 5 arrival: 16s786ms MemoryUsage(16s000ms): 34.86 MB, 65.76 MB, 66.84 MB, 65.87 MB, 63.78 MB, 63.77 MB, 65.30 MB, 66.71 MB, 66.82 MB, 65.57 MB, 65.78 MB, 65.60 MB, 65.80 MB, 65.77 MB, 64.96 MB, 64.84 MB, 64.59 MB, 65.21 MB, 64.76 MB, 64.66 MB, 65.70 MB, 66.80 MB, 66.81 MB, 65.96 MB, 65.75 MB, 65.78 MB, 65.75 MB, 65.38 MB, 65.57 MB, 64.94 MB, 63.54 MB, 63.57 MB, 63.56 MB, 63.65 MB ThreadUsage(16s000ms): 12, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.93 - BloomFilterBytes: 33.00 MB (34603008) - PeakMemoryUsage: 67.47 MB (70743584) - PerHostPeakMemUsage: 161.66 GB (173576326920) - RowsProduced: 78.85M (78854876) - TotalNetworkReceiveTime: 514.391ms - TotalNetworkSendTime: 8m50s - TotalStorageWaitTime: 13s789ms - TotalThreadsInvoluntaryContextSwitches: 15.91K (15912) - TotalThreadsTotalWallClockTime: 2h - TotalThreadsSysTime: 3s256ms - TotalThreadsUserTime: 1m53s - TotalThreadsVoluntaryContextSwitches: 165.98K (165984) Fragment Instance Lifecycle Timings: - ExecTime: 9m19s - ExecTreeExecTime: 3s667ms - OpenTime: 1s103ms - ExecTreeOpenTime: 928.779ms - PrepareTime: 49.545ms - ExecTreePrepareTime: 6.013ms DataStreamSender (dst_id=22):(Total: 16s237ms, non-child: 16s237ms, % non-child: 100.00%) - BytesSent: 727.27 MB (762600261) - NetworkThroughput(*): 78.98 MB/sec - OverallThroughput: 44.79 MB/sec - PeakMemoryUsage: 4.96 MB (5199616) - RowsReturned: 78.85M (78854876) - SerializeBatchTime: 7s008ms - TransmitDataRPCTime: 9s208ms - UncompressedRowBatchSize: 2.20 GB (2366494736) CodeGen:(Total: 196.291ms, non-child: 196.291ms, % non-child: 100.00%) - CodegenTime: 970.374us - CompileTime: 51.253ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 122.404ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 22.223ms HASH_JOIN_NODE (id=5):(Total: 4s565ms, non-child: 3s240ms, % non-child: 70.99%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.511ms - PeakMemoryUsage: 1.24 MB (1298065) - ProbeRows: 78.85M (78854876) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3s081ms - RowsReturned: 78.85M (78854876) - RowsReturnedRate: 17.27 M/sec Hash Join Builder (join_node_id=5): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 25.025us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 153.717us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 58.570us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 514.401ms, non-child: 20.207us, % non-child: 0.00%) BytesReceived(16s000ms): 963.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 4.481us - DeserializeRowBatchTimer: 33.654us - FirstBatchArrivalWaitTime: 500.592ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 233.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=3):(Total: 810.451ms, non-child: 810.451ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:228/12.91 GB 1:229/13.27 GB 7:249/14.78 GB 5:234/13.86 GB 0:235/14.37 GB 2:209/11.66 GB 3:211/12.73 GB 6:210/12.13 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 119 out of 119 Runtime filters: Only following filters arrived: 6, waited 301ms Hdfs Read Thread Concurrency Bucket: 0:98.83% 1:0.9901% 2:0.09001% 3:0% 4:0.09001% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1686 PARQUET/SNAPPY:119 BytesRead(16s000ms): 13.16 MB, 14.18 MB, 14.18 MB, 19.15 MB, 28.20 MB, 28.38 MB, 37.11 MB, 42.36 MB, 43.10 MB, 55.51 MB, 56.72 MB, 60.83 MB, 70.98 MB, 71.05 MB, 78.49 MB, 85.27 MB, 85.49 MB, 96.82 MB, 99.49 MB, 99.92 MB, 110.80 MB, 114.49 MB, 114.49 MB, 117.96 MB, 128.37 MB, 128.69 MB, 128.69 MB, 130.43 MB, 140.93 MB, 141.74 MB, 141.74 MB, 141.74 MB, 141.74 MB, 141.74 MB - FooterProcessingTime: (Avg: 63.964ms ; Min: 4.275ms ; Max: 323.981ms ; Number of samples: 119) - AverageHdfsReadThreadConcurrency: 0.02 - AverageScannerThreadConcurrency: 11.98 - BytesRead: 141.74 MB (148629576) - BytesReadDataNodeCache: 0 - BytesReadLocal: 141.74 MB (148629576) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 141.74 MB (148629576) - DecompressionTime: 1s437ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 119 (119) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 29.34 MB (30760353) - PerReadThreadRawHdfsThroughput: 19.56 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 105.660ms - RowBatchQueuePutWaitTime: 1h49m - RowsRead: 79.00M (79000938) - RowsReturned: 78.85M (78854876) - RowsReturnedRate: 97.30 M/sec - ScanRangesComplete: 1.80K (1805) - ScannerThreadsInvoluntaryContextSwitches: 11.10K (11096) - ScannerThreadsTotalWallClockTime: 1h51m - MaterializeTupleTime(*): 5s741ms - ScannerThreadsSysTime: 2s619ms - ScannerThreadsUserTime: 1m31s - ScannerThreadsVoluntaryContextSwitches: 162.80K (162801) - TotalRawHdfsReadTime(*): 7s245ms - TotalReadThroughput: 261.29 KB/sec Filter 2 (16.00 MB): - Rows processed: 2.07M (2071182) - Rows rejected: 146.03K (146026) - Rows total: 79.00M (79000938) Filter 5 (16.00 MB): - Rows processed: 1.93M (1926180) - Rows rejected: 36 (36) - Rows total: 78.85M (78854912) Filter 6 (1.00 MB): - Files processed: 1.80K (1805) - Files rejected: 1.69K (1686) - Files total: 1.80K (1805) - RowGroups processed: 76.97K (76974) - RowGroups rejected: 0 (0) - RowGroups total: 76.97K (76974) - Rows processed: 1.95M (1949696) - Rows rejected: 0 (0) - Rows total: 78.85M (78854876) - Splits processed: 119 (119) - Splits rejected: 0 (0) - Splits total: 119 (119) Instance 7f40dcb034de70b7:7f (host=vc1540.foo:22000):(Total: 9m20s, non-child: 8m58s, % non-child: 96.05%) Hdfs split stats (:<# splits>/): 4:215/12.34 GB 1:218/12.17 GB 5:227/13.32 GB 3:245/14.88 GB 2:240/13.72 GB 6:219/12.84 GB 0:236/13.65 GB 7:217/12.75 GB Filter 6 arrival: 1s141ms Filter 2 arrival: 11s161ms Filter 5 arrival: 15s635ms MemoryUsage(16s000ms): 36.13 MB, 65.79 MB, 65.75 MB, 65.50 MB, 65.74 MB, 65.74 MB, 66.18 MB, 66.82 MB, 66.42 MB, 65.02 MB, 65.89 MB, 65.88 MB, 66.79 MB, 66.71 MB, 66.12 MB, 65.74 MB, 65.83 MB, 66.07 MB, 66.80 MB, 66.63 MB, 66.62 MB, 66.82 MB, 66.78 MB, 66.70 MB, 66.53 MB, 66.80 MB, 66.78 MB, 66.61 MB, 66.67 MB, 66.07 MB, 60.14 MB, 60.12 MB, 60.19 MB, 59.48 MB ThreadUsage(16s000ms): 12, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.82 - BloomFilterBytes: 33.00 MB (34603008) - PeakMemoryUsage: 67.48 MB (70760759) - PerHostPeakMemUsage: 161.68 GB (173604717499) - RowsProduced: 77.59M (77590723) - TotalNetworkReceiveTime: 916.624ms - TotalNetworkSendTime: 8m48s - TotalStorageWaitTime: 15s150ms - TotalThreadsInvoluntaryContextSwitches: 31.20K (31195) - TotalThreadsTotalWallClockTime: 1h59m - TotalThreadsSysTime: 1m38s - TotalThreadsUserTime: 2m51s - TotalThreadsVoluntaryContextSwitches: 9.36M (9356352) Fragment Instance Lifecycle Timings: - ExecTime: 9m18s - ExecTreeExecTime: 4s400ms - OpenTime: 1s476ms - ExecTreeOpenTime: 1s299ms - PrepareTime: 52.491ms - ExecTreePrepareTime: 6.481ms DataStreamSender (dst_id=22):(Total: 16s272ms, non-child: 16s272ms, % non-child: 100.00%) - BytesSent: 714.93 MB (749658365) - NetworkThroughput(*): 76.10 MB/sec - OverallThroughput: 43.93 MB/sec - PeakMemoryUsage: 4.94 MB (5183232) - RowsReturned: 77.59M (77590723) - SerializeBatchTime: 6s859ms - TransmitDataRPCTime: 9s394ms - UncompressedRowBatchSize: 2.17 GB (2328556506) CodeGen:(Total: 198.644ms, non-child: 198.644ms, % non-child: 100.00%) - CodegenTime: 1.151ms - CompileTime: 52.798ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 123.008ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 22.397ms HASH_JOIN_NODE (id=5):(Total: 5s667ms, non-child: 3s623ms, % non-child: 63.93%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.088ms - PeakMemoryUsage: 1.23 MB (1288375) - ProbeRows: 77.59M (77590723) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3s477ms - RowsReturned: 77.59M (77590723) - RowsReturnedRate: 13.69 M/sec Hash Join Builder (join_node_id=5): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 32.542us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 135.146us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 43.427us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 916.636ms, non-child: 18.137us, % non-child: 0.00%) BytesReceived(16s000ms): 932.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 4.890us - DeserializeRowBatchTimer: 55.621us - FirstBatchArrivalWaitTime: 905.736ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 130.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=3):(Total: 1s128ms, non-child: 1s128ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:215/12.34 GB 1:218/12.17 GB 5:227/13.32 GB 3:245/14.88 GB 2:240/13.72 GB 6:219/12.84 GB 0:236/13.65 GB 7:217/12.75 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 118 out of 118 Runtime filters: Only following filters arrived: 6, waited 41ms Hdfs Read Thread Concurrency Bucket: 0:98.64% 1:1.356% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1699 PARQUET/SNAPPY:118 BytesRead(16s000ms): 13.18 MB, 14.55 MB, 14.55 MB, 19.83 MB, 28.78 MB, 29.17 MB, 39.15 MB, 42.75 MB, 44.94 MB, 57.04 MB, 57.61 MB, 62.17 MB, 71.77 MB, 72.20 MB, 77.20 MB, 86.23 MB, 86.82 MB, 97.24 MB, 100.83 MB, 101.47 MB, 112.15 MB, 115.09 MB, 115.09 MB, 118.51 MB, 128.49 MB, 129.32 MB, 129.32 MB, 130.61 MB, 136.57 MB, 140.05 MB, 140.20 MB, 140.20 MB, 140.20 MB, 140.20 MB - FooterProcessingTime: (Avg: 78.551ms ; Min: 23.241ms ; Max: 334.103ms ; Number of samples: 118) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 11.95 - BytesRead: 140.20 MB (147009749) - BytesReadDataNodeCache: 0 - BytesReadLocal: 140.20 MB (147009749) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 140.20 MB (147009749) - DecompressionTime: 1s261ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 118 (118) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 29.20 MB (30621880) - PerReadThreadRawHdfsThroughput: 21.26 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 319.746ms - RowBatchQueuePutWaitTime: 1h45m - RowsRead: 77.73M (77732926) - RowsReturned: 77.59M (77590723) - RowsReturnedRate: 68.78 M/sec - ScanRangesComplete: 1.82K (1817) - ScannerThreadsInvoluntaryContextSwitches: 26.40K (26404) - ScannerThreadsTotalWallClockTime: 1h50m - MaterializeTupleTime(*): 6s293ms - ScannerThreadsSysTime: 1m37s - ScannerThreadsUserTime: 2m29s - ScannerThreadsVoluntaryContextSwitches: 9.35M (9353149) - TotalRawHdfsReadTime(*): 6s593ms - TotalReadThroughput: 259.61 KB/sec Filter 2 (16.00 MB): - Rows processed: 2.05M (2048891) - Rows rejected: 142.17K (142168) - Rows total: 77.73M (77732926) Filter 5 (16.00 MB): - Rows processed: 1.91M (1906723) - Rows rejected: 35 (35) - Rows total: 77.59M (77590758) Filter 6 (1.00 MB): - Files processed: 1.82K (1817) - Files rejected: 1.70K (1699) - Files total: 1.82K (1817) - RowGroups processed: 75.75K (75749) - RowGroups rejected: 0 (0) - RowGroups total: 75.75K (75749) - Rows processed: 1.93M (1933312) - Rows rejected: 0 (0) - Rows total: 77.59M (77590723) - Splits processed: 118 (118) - Splits rejected: 0 (0) - Splits total: 118 (118) Instance 7f40dcb034de70b7:dd (host=vd1334.foo:22000):(Total: 9m19s, non-child: 8m58s, % non-child: 96.22%) Hdfs split stats (:<# splits>/): 4:240/13.82 GB 5:238/13.50 GB 7:248/14.60 GB 1:233/13.45 GB 0:236/14.17 GB 3:214/12.32 GB 6:216/11.77 GB 2:206/12.05 GB Filter 6 arrival: 739ms Filter 2 arrival: 13s270ms Filter 5 arrival: 16s796ms MemoryUsage(16s000ms): 34.05 MB, 64.80 MB, 65.82 MB, 65.90 MB, 66.82 MB, 66.76 MB, 65.81 MB, 65.80 MB, 65.69 MB, 66.80 MB, 66.81 MB, 66.12 MB, 64.76 MB, 64.73 MB, 65.39 MB, 66.77 MB, 66.75 MB, 66.34 MB, 66.72 MB, 66.75 MB, 65.40 MB, 66.29 MB, 66.80 MB, 65.56 MB, 65.88 MB, 65.76 MB, 65.85 MB, 65.78 MB, 66.92 MB, 66.40 MB, 66.70 MB, 64.55 MB, 64.55 MB, 64.62 MB ThreadUsage(16s000ms): 12, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.94 - BloomFilterBytes: 33.00 MB (34603008) - PeakMemoryUsage: 67.52 MB (70795265) - PerHostPeakMemUsage: 161.68 GB (173607757937) - RowsProduced: 78.98M (78984302) - TotalNetworkReceiveTime: 508.472ms - TotalNetworkSendTime: 8m53s - TotalStorageWaitTime: 14s134ms - TotalThreadsInvoluntaryContextSwitches: 15.04K (15042) - TotalThreadsTotalWallClockTime: 2h - TotalThreadsSysTime: 6s056ms - TotalThreadsUserTime: 1m36s - TotalThreadsVoluntaryContextSwitches: 574.95K (574945) Fragment Instance Lifecycle Timings: - ExecTime: 9m18s - ExecTreeExecTime: 3s699ms - OpenTime: 1s082ms - ExecTreeOpenTime: 901.401ms - PrepareTime: 56.887ms - ExecTreePrepareTime: 7.832ms DataStreamSender (dst_id=22):(Total: 16s364ms, non-child: 16s364ms, % non-child: 100.00%) - BytesSent: 729.79 MB (765240508) - NetworkThroughput(*): 77.18 MB/sec - OverallThroughput: 44.60 MB/sec - PeakMemoryUsage: 4.99 MB (5232384) - RowsReturned: 78.98M (78984302) - SerializeBatchTime: 6s889ms - TransmitDataRPCTime: 9s455ms - UncompressedRowBatchSize: 2.21 GB (2370378860) CodeGen:(Total: 200.654ms, non-child: 200.654ms, % non-child: 100.00%) - CodegenTime: 1.087ms - CompileTime: 51.838ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 127.164ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 21.262ms HASH_JOIN_NODE (id=5):(Total: 4s568ms, non-child: 3s245ms, % non-child: 71.05%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.497ms - PeakMemoryUsage: 1.24 MB (1296830) - ProbeRows: 78.98M (78984302) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3s077ms - RowsReturned: 78.98M (78984302) - RowsReturnedRate: 17.29 M/sec Hash Join Builder (join_node_id=5): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 25.699us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 126.846us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 62.294us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 508.482ms, non-child: 19.543us, % non-child: 0.00%) BytesReceived(16s000ms): 963.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 4.721us - DeserializeRowBatchTimer: 14.437us - FirstBatchArrivalWaitTime: 504.736ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 235.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=3):(Total: 815.009ms, non-child: 815.009ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:240/13.82 GB 5:238/13.50 GB 7:248/14.60 GB 1:233/13.45 GB 0:236/14.17 GB 3:214/12.32 GB 6:216/11.77 GB 2:206/12.05 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 120 out of 120 Runtime filters: Only following filters arrived: 6, waited 282ms Hdfs Read Thread Concurrency Bucket: 0:98.56% 1:1.264% 2:0% 3:0.09025% 4:0.09025% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1711 PARQUET/SNAPPY:120 BytesRead(16s000ms): 13.44 MB, 14.48 MB, 14.48 MB, 19.62 MB, 29.03 MB, 29.42 MB, 38.43 MB, 43.49 MB, 44.64 MB, 57.49 MB, 58.23 MB, 61.53 MB, 72.32 MB, 72.52 MB, 77.60 MB, 86.99 MB, 87.52 MB, 97.72 MB, 101.49 MB, 102.22 MB, 112.78 MB, 115.66 MB, 116.15 MB, 119.72 MB, 128.85 MB, 129.85 MB, 130.40 MB, 131.73 MB, 137.73 MB, 142.44 MB, 143.66 MB, 143.66 MB, 143.66 MB, 143.66 MB - FooterProcessingTime: (Avg: 61.552ms ; Min: 4.544ms ; Max: 327.618ms ; Number of samples: 120) - AverageHdfsReadThreadConcurrency: 0.02 - AverageScannerThreadConcurrency: 11.98 - BytesRead: 143.66 MB (150639445) - BytesReadDataNodeCache: 0 - BytesReadLocal: 143.66 MB (150639445) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 143.66 MB (150639445) - DecompressionTime: 6s654ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 120 (120) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 29.44 MB (30865167) - PerReadThreadRawHdfsThroughput: 19.74 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 104.271ms - RowBatchQueuePutWaitTime: 1h49m - RowsRead: 79.13M (79128018) - RowsReturned: 78.98M (78984302) - RowsReturnedRate: 96.91 M/sec - ScanRangesComplete: 1.83K (1831) - ScannerThreadsInvoluntaryContextSwitches: 10.27K (10268) - ScannerThreadsTotalWallClockTime: 1h51m - MaterializeTupleTime(*): 6s203ms - ScannerThreadsSysTime: 5s322ms - ScannerThreadsUserTime: 1m15s - ScannerThreadsVoluntaryContextSwitches: 571.82K (571818) - TotalRawHdfsReadTime(*): 7s277ms - TotalReadThroughput: 265.54 KB/sec Filter 2 (16.00 MB): - Rows processed: 2.08M (2084196) - Rows rejected: 143.68K (143677) - Rows total: 79.13M (79128018) Filter 5 (16.00 MB): - Rows processed: 1.92M (1920039) - Rows rejected: 39 (39) - Rows total: 78.98M (78984341) Filter 6 (1.00 MB): - Files processed: 1.83K (1831) - Files rejected: 1.71K (1711) - Files total: 1.83K (1831) - RowGroups processed: 77.10K (77099) - RowGroups rejected: 0 (0) - RowGroups total: 77.10K (77099) - Rows processed: 1.97M (1966080) - Rows rejected: 0 (0) - Rows total: 78.98M (78984302) - Splits processed: 120 (120) - Splits rejected: 0 (0) - Splits total: 120 (120) Instance 7f40dcb034de70b7:bf (host=va1032.foo:22000):(Total: 9m19s, non-child: 8m57s, % non-child: 96.06%) Hdfs split stats (:<# splits>/): 5:240/13.91 GB 3:234/13.53 GB 0:225/13.43 GB 4:232/12.82 GB 6:226/13.76 GB 1:224/12.48 GB 2:209/11.87 GB 7:231/13.87 GB Filter 6 arrival: 917ms Filter 2 arrival: 12s841ms Filter 5 arrival: 16s493ms MemoryUsage(16s000ms): 34.77 MB, 66.25 MB, 66.81 MB, 66.52 MB, 66.82 MB, 66.75 MB, 66.56 MB, 66.81 MB, 66.85 MB, 66.63 MB, 66.82 MB, 66.72 MB, 66.32 MB, 66.75 MB, 66.46 MB, 66.84 MB, 66.78 MB, 66.30 MB, 66.76 MB, 66.78 MB, 65.64 MB, 66.12 MB, 66.85 MB, 66.74 MB, 66.63 MB, 66.77 MB, 66.82 MB, 66.66 MB, 65.89 MB, 66.60 MB, 66.89 MB, 66.87 MB, 66.82 MB, 66.92 MB ThreadUsage(16s000ms): 12, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.95 - BloomFilterBytes: 33.00 MB (34603008) - PeakMemoryUsage: 68.06 MB (71362696) - PerHostPeakMemUsage: 161.68 GB (173597751233) - RowsProduced: 80.23M (80232856) - TotalNetworkReceiveTime: 672.198ms - TotalNetworkSendTime: 8m51s - TotalStorageWaitTime: 14s619ms - TotalThreadsInvoluntaryContextSwitches: 6.79K (6791) - TotalThreadsTotalWallClockTime: 2h - TotalThreadsSysTime: 2s355ms - TotalThreadsUserTime: 33s307ms - TotalThreadsVoluntaryContextSwitches: 111.65K (111653) Fragment Instance Lifecycle Timings: - ExecTime: 9m18s - ExecTreeExecTime: 3s916ms - OpenTime: 1s191ms - ExecTreeOpenTime: 996.886ms - PrepareTime: 56.531ms - ExecTreePrepareTime: 7.175ms DataStreamSender (dst_id=22):(Total: 16s958ms, non-child: 16s958ms, % non-child: 100.00%) - BytesSent: 747.97 MB (784302670) - NetworkThroughput(*): 78.58 MB/sec - OverallThroughput: 44.11 MB/sec - PeakMemoryUsage: 4.89 MB (5125888) - RowsReturned: 80.23M (80232856) - SerializeBatchTime: 7s420ms - TransmitDataRPCTime: 9s518ms - UncompressedRowBatchSize: 2.24 GB (2407848936) CodeGen:(Total: 215.859ms, non-child: 215.859ms, % non-child: 100.00%) - CodegenTime: 1.125ms - CompileTime: 56.762ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 136.383ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 22.180ms HASH_JOIN_NODE (id=5):(Total: 4s885ms, non-child: 3s458ms, % non-child: 70.80%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.275ms - PeakMemoryUsage: 1.23 MB (1291642) - ProbeRows: 80.23M (80232856) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3s319ms - RowsReturned: 80.23M (80232856) - RowsReturnedRate: 16.42 M/sec Hash Join Builder (join_node_id=5): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 25.483us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 118.254us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 45.354us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 672.212ms, non-child: 22.185us, % non-child: 0.00%) BytesReceived(16s000ms): 932.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 5.269us - DeserializeRowBatchTimer: 25.252us - FirstBatchArrivalWaitTime: 626.220ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 178.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=3):(Total: 754.859ms, non-child: 754.859ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:240/13.91 GB 3:234/13.53 GB 0:225/13.43 GB 4:232/12.82 GB 6:226/13.76 GB 1:224/12.48 GB 2:209/11.87 GB 7:231/13.87 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 122 out of 122 Runtime filters: Only following filters arrived: 6, waited 121ms Hdfs Read Thread Concurrency Bucket: 0:99.1% 1:0.5386% 2:0.2693% 3:0.08977% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1699 PARQUET/SNAPPY:122 BytesRead(16s000ms): 13.45 MB, 14.82 MB, 14.82 MB, 18.76 MB, 29.43 MB, 29.55 MB, 36.65 MB, 44.55 MB, 44.98 MB, 55.07 MB, 59.37 MB, 60.07 MB, 72.28 MB, 74.00 MB, 76.55 MB, 88.79 MB, 89.07 MB, 95.74 MB, 103.68 MB, 103.92 MB, 109.61 MB, 118.06 MB, 118.76 MB, 119.45 MB, 128.43 MB, 133.16 MB, 133.45 MB, 134.09 MB, 135.82 MB, 139.56 MB, 147.13 MB, 148.13 MB, 148.13 MB, 148.13 MB - FooterProcessingTime: (Avg: 68.578ms ; Min: 5.503ms ; Max: 225.831ms ; Number of samples: 122) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 11.99 - BytesRead: 149.42 MB (156682654) - BytesReadDataNodeCache: 0 - BytesReadLocal: 149.42 MB (156682654) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 149.42 MB (156682654) - DecompressionTime: 509.879ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 122 (122) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 29.74 MB (31185365) - PerReadThreadRawHdfsThroughput: 20.14 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 198.311ms - RowBatchQueuePutWaitTime: 1h51m - RowsRead: 80.38M (80380648) - RowsReturned: 80.23M (80232856) - RowsReturnedRate: 106.29 M/sec - ScanRangesComplete: 1.82K (1821) - ScannerThreadsInvoluntaryContextSwitches: 1.85K (1853) - ScannerThreadsTotalWallClockTime: 1h51m - MaterializeTupleTime(*): 6s482ms - ScannerThreadsSysTime: 1s626ms - ScannerThreadsUserTime: 10s035ms - ScannerThreadsVoluntaryContextSwitches: 108.56K (108555) - TotalRawHdfsReadTime(*): 7s419ms - TotalReadThroughput: 274.46 KB/sec Filter 2 (16.00 MB): - Rows processed: 2.12M (2118992) - Rows rejected: 147.77K (147770) - Rows total: 80.38M (80380648) Filter 5 (16.00 MB): - Rows processed: 1.87M (1869846) - Rows rejected: 22 (22) - Rows total: 80.23M (80232878) Filter 6 (1.00 MB): - Files processed: 1.82K (1821) - Files rejected: 1.70K (1699) - Files total: 1.82K (1821) - RowGroups processed: 78.32K (78323) - RowGroups rejected: 0 (0) - RowGroups total: 78.32K (78323) - Rows processed: 2.00M (1998848) - Rows rejected: 0 (0) - Rows total: 80.23M (80232856) - Splits processed: 122 (122) - Splits rejected: 0 (0) - Splits total: 122 (122) Instance 7f40dcb034de70b7:c4 (host=va1039.foo:22000):(Total: 9m19s, non-child: 8m57s, % non-child: 96.11%) Hdfs split stats (:<# splits>/): 5:208/12.09 GB 3:221/13.04 GB 1:241/14.72 GB 7:242/13.90 GB 6:230/12.80 GB 2:216/12.23 GB 0:241/14.12 GB 4:219/12.77 GB Filter 6 arrival: 867ms Filter 2 arrival: 12s877ms Filter 5 arrival: 16s477ms MemoryUsage(16s000ms): 35.42 MB, 66.28 MB, 66.79 MB, 66.41 MB, 66.78 MB, 66.81 MB, 66.71 MB, 66.82 MB, 66.74 MB, 64.99 MB, 65.77 MB, 65.61 MB, 66.47 MB, 66.78 MB, 66.40 MB, 65.76 MB, 65.86 MB, 66.22 MB, 66.85 MB, 66.80 MB, 66.51 MB, 66.80 MB, 66.85 MB, 66.79 MB, 65.95 MB, 65.48 MB, 65.71 MB, 65.77 MB, 65.80 MB, 65.96 MB, 63.03 MB, 60.18 MB, 60.02 MB, 60.09 MB ThreadUsage(16s000ms): 12, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.86 - BloomFilterBytes: 33.00 MB (34603008) - PeakMemoryUsage: 67.54 MB (70822762) - PerHostPeakMemUsage: 161.68 GB (173602097978) - RowsProduced: 77.69M (77694453) - TotalNetworkReceiveTime: 630.092ms - TotalNetworkSendTime: 8m51s - TotalStorageWaitTime: 13s167ms - TotalThreadsInvoluntaryContextSwitches: 25.69K (25689) - TotalThreadsTotalWallClockTime: 2h - TotalThreadsSysTime: 1m7s - TotalThreadsUserTime: 2m31s - TotalThreadsVoluntaryContextSwitches: 6.60M (6604173) Fragment Instance Lifecycle Timings: - ExecTime: 9m18s - ExecTreeExecTime: 4s061ms - OpenTime: 1s109ms - ExecTreeOpenTime: 922.584ms - PrepareTime: 55.679ms - ExecTreePrepareTime: 7.492ms DataStreamSender (dst_id=22):(Total: 16s589ms, non-child: 16s589ms, % non-child: 100.00%) - BytesSent: 719.63 MB (754583629) - NetworkThroughput(*): 77.00 MB/sec - OverallThroughput: 43.38 MB/sec - PeakMemoryUsage: 4.85 MB (5084928) - RowsReturned: 77.69M (77694453) - SerializeBatchTime: 7s222ms - TransmitDataRPCTime: 9s346ms - UncompressedRowBatchSize: 2.17 GB (2331669494) CodeGen:(Total: 207.227ms, non-child: 207.227ms, % non-child: 100.00%) - CodegenTime: 1.121ms - CompileTime: 53.284ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 131.256ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 22.269ms HASH_JOIN_NODE (id=5):(Total: 4s954ms, non-child: 3s184ms, % non-child: 64.27%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.640ms - PeakMemoryUsage: 1.24 MB (1299240) - ProbeRows: 77.69M (77694453) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3s015ms - RowsReturned: 77.69M (77694453) - RowsReturnedRate: 15.68 M/sec Hash Join Builder (join_node_id=5): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 25.054us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 161.186us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 57.715us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 630.107ms, non-child: 24.337us, % non-child: 0.00%) BytesReceived(16s000ms): 932.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 8.296us - DeserializeRowBatchTimer: 19.919us - FirstBatchArrivalWaitTime: 593.745ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 190.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=3):(Total: 1s140ms, non-child: 1s140ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:208/12.09 GB 3:221/13.04 GB 1:241/14.72 GB 7:242/13.90 GB 6:230/12.80 GB 2:216/12.23 GB 0:241/14.12 GB 4:219/12.77 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 118 out of 118 Runtime filters: Only following filters arrived: 6, waited 161ms Hdfs Read Thread Concurrency Bucket: 0:98.83% 1:0.9928% 2:0.09025% 3:0% 4:0.09025% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1700 PARQUET/SNAPPY:118 BytesRead(16s000ms): 13.40 MB, 14.51 MB, 14.51 MB, 16.72 MB, 29.14 MB, 29.21 MB, 36.06 MB, 43.69 MB, 44.13 MB, 54.23 MB, 58.65 MB, 59.48 MB, 71.73 MB, 73.27 MB, 75.30 MB, 87.26 MB, 87.73 MB, 93.81 MB, 101.93 MB, 102.30 MB, 108.83 MB, 116.28 MB, 116.82 MB, 117.53 MB, 126.21 MB, 130.92 MB, 131.51 MB, 131.66 MB, 132.71 MB, 134.86 MB, 141.87 MB, 142.32 MB, 142.32 MB, 142.32 MB - FooterProcessingTime: (Avg: 58.033ms ; Min: 3.978ms ; Max: 190.363ms ; Number of samples: 118) - AverageHdfsReadThreadConcurrency: 0.02 - AverageScannerThreadConcurrency: 11.91 - BytesRead: 142.32 MB (149230317) - BytesReadDataNodeCache: 0 - BytesReadLocal: 142.32 MB (149230317) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 142.32 MB (149230317) - DecompressionTime: 1s479ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 118 (118) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 29.54 MB (30974983) - PerReadThreadRawHdfsThroughput: 20.38 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 124.879ms - RowBatchQueuePutWaitTime: 1h46m - RowsRead: 77.84M (77836243) - RowsReturned: 77.69M (77694453) - RowsReturnedRate: 68.12 M/sec - ScanRangesComplete: 1.82K (1818) - ScannerThreadsInvoluntaryContextSwitches: 20.76K (20761) - ScannerThreadsTotalWallClockTime: 1h50m - MaterializeTupleTime(*): 6s495ms - ScannerThreadsSysTime: 1m6s - ScannerThreadsUserTime: 2m8s - ScannerThreadsVoluntaryContextSwitches: 6.60M (6601028) - TotalRawHdfsReadTime(*): 6s984ms - TotalReadThroughput: 263.05 KB/sec Filter 2 (16.00 MB): - Rows processed: 2.05M (2046430) - Rows rejected: 141.72K (141722) - Rows total: 77.84M (77836243) Filter 5 (16.00 MB): - Rows processed: 1.77M (1771588) - Rows rejected: 68 (68) - Rows total: 77.69M (77694521) Filter 6 (1.00 MB): - Files processed: 1.82K (1818) - Files rejected: 1.70K (1700) - Files total: 1.82K (1818) - RowGroups processed: 75.85K (75850) - RowGroups rejected: 0 (0) - RowGroups total: 75.85K (75850) - Rows processed: 1.93M (1933312) - Rows rejected: 0 (0) - Rows total: 77.69M (77694453) - Splits processed: 118 (118) - Splits rejected: 0 (0) - Splits total: 118 (118) Instance 7f40dcb034de70b7:a0 (host=vd1135.foo:22000):(Total: 9m19s, non-child: 8m57s, % non-child: 96.07%) Hdfs split stats (:<# splits>/): 7:218/13.28 GB 1:205/11.92 GB 5:262/14.86 GB 3:227/13.05 GB 2:225/12.72 GB 0:236/13.55 GB 4:207/12.63 GB 6:234/13.65 GB Filter 6 arrival: 1s013ms Filter 2 arrival: 12s087ms Filter 5 arrival: 16s063ms MemoryUsage(16s000ms): 34.80 MB, 66.78 MB, 66.82 MB, 66.09 MB, 65.77 MB, 65.77 MB, 66.27 MB, 66.84 MB, 66.47 MB, 65.61 MB, 65.73 MB, 65.70 MB, 65.77 MB, 65.82 MB, 65.96 MB, 66.79 MB, 66.79 MB, 64.86 MB, 64.83 MB, 64.97 MB, 66.13 MB, 66.75 MB, 66.81 MB, 66.38 MB, 66.23 MB, 66.84 MB, 66.85 MB, 66.68 MB, 66.67 MB, 66.70 MB, 66.71 MB, 66.75 MB, 66.78 MB, 66.85 MB ThreadUsage(16s000ms): 11, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.93 - BloomFilterBytes: 33.00 MB (34603008) - PeakMemoryUsage: 67.45 MB (70726449) - PerHostPeakMemUsage: 161.68 GB (173605070871) - RowsProduced: 80.10M (80100056) - TotalNetworkReceiveTime: 778.036ms - TotalNetworkSendTime: 8m51s - TotalStorageWaitTime: 13s156ms - TotalThreadsInvoluntaryContextSwitches: 6.79K (6793) - TotalThreadsTotalWallClockTime: 2h - TotalThreadsSysTime: 5s061ms - TotalThreadsUserTime: 37s013ms - TotalThreadsVoluntaryContextSwitches: 471.44K (471435) Fragment Instance Lifecycle Timings: - ExecTime: 9m18s - ExecTreeExecTime: 3s751ms - OpenTime: 1s143ms - ExecTreeOpenTime: 955.408ms - PrepareTime: 52.438ms - ExecTreePrepareTime: 6.971ms DataStreamSender (dst_id=22):(Total: 17s126ms, non-child: 17s126ms, % non-child: 100.00%) - BytesSent: 742.90 MB (778982345) - NetworkThroughput(*): 77.18 MB/sec - OverallThroughput: 43.38 MB/sec - PeakMemoryUsage: 4.84 MB (5076736) - RowsReturned: 80.10M (80100056) - SerializeBatchTime: 7s478ms - TransmitDataRPCTime: 9s625ms - UncompressedRowBatchSize: 2.24 GB (2403863504) CodeGen:(Total: 206.480ms, non-child: 206.480ms, % non-child: 100.00%) - CodegenTime: 1.243ms - CompileTime: 56.427ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 129.231ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 20.428ms HASH_JOIN_NODE (id=5):(Total: 4s668ms, non-child: 3s259ms, % non-child: 69.81%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.893ms - PeakMemoryUsage: 1.24 MB (1297019) - ProbeRows: 80.10M (80100056) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3s079ms - RowsReturned: 80.10M (80100056) - RowsReturnedRate: 17.16 M/sec Hash Join Builder (join_node_id=5): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 25.629us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 218.341us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 53.697us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 778.047ms, non-child: 20.614us, % non-child: 0.00%) BytesReceived(16s000ms): 932.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 4.952us - DeserializeRowBatchTimer: 16.658us - FirstBatchArrivalWaitTime: 743.551ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 154.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=3):(Total: 631.895ms, non-child: 631.895ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:218/13.28 GB 1:205/11.92 GB 5:262/14.86 GB 3:227/13.05 GB 2:225/12.72 GB 0:236/13.55 GB 4:207/12.63 GB 6:234/13.65 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 121 out of 121 Runtime filters: Only following filters arrived: 6, waited 40ms Hdfs Read Thread Concurrency Bucket: 0:98.92% 1:0.9025% 2:0.1805% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1693 PARQUET/SNAPPY:121 BytesRead(16s000ms): 13.31 MB, 14.68 MB, 14.90 MB, 20.20 MB, 29.17 MB, 29.73 MB, 39.32 MB, 43.81 MB, 45.71 MB, 58.10 MB, 58.57 MB, 62.55 MB, 72.96 MB, 73.40 MB, 79.36 MB, 87.75 MB, 88.27 MB, 97.14 MB, 101.96 MB, 102.83 MB, 112.70 MB, 116.55 MB, 116.70 MB, 120.82 MB, 130.00 MB, 131.06 MB, 131.30 MB, 133.46 MB, 141.49 MB, 144.57 MB, 145.75 MB, 145.75 MB, 145.75 MB, 146.28 MB - FooterProcessingTime: (Avg: 58.305ms ; Min: 4.061ms ; Max: 180.109ms ; Number of samples: 121) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 11.98 - BytesRead: 147.03 MB (154174534) - BytesReadDataNodeCache: 0 - BytesReadLocal: 147.03 MB (154174534) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 147.03 MB (154174534) - DecompressionTime: 912.295ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 121 (121) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 29.36 MB (30789710) - PerReadThreadRawHdfsThroughput: 21.39 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 129.906ms - RowBatchQueuePutWaitTime: 1h50m - RowsRead: 80.24M (80242243) - RowsReturned: 80.10M (80100056) - RowsReturnedRate: 126.76 M/sec - ScanRangesComplete: 1.81K (1814) - ScannerThreadsInvoluntaryContextSwitches: 1.89K (1890) - ScannerThreadsTotalWallClockTime: 1h51m - MaterializeTupleTime(*): 6s473ms - ScannerThreadsSysTime: 4s285ms - ScannerThreadsUserTime: 13s556ms - ScannerThreadsVoluntaryContextSwitches: 468.32K (468321) - TotalRawHdfsReadTime(*): 6s872ms - TotalReadThroughput: 271.53 KB/sec Filter 2 (16.00 MB): - Rows processed: 2.05M (2047851) - Rows rejected: 142.19K (142187) - Rows total: 80.24M (80242243) Filter 5 (16.00 MB): - Rows processed: 1.90M (1896448) - Rows rejected: 0 (0) - Rows total: 80.10M (80100056) Filter 6 (1.00 MB): - Files processed: 1.81K (1814) - Files rejected: 1.69K (1693) - Files total: 1.81K (1814) - RowGroups processed: 78.19K (78193) - RowGroups rejected: 0 (0) - RowGroups total: 78.19K (78193) - Rows processed: 1.98M (1982464) - Rows rejected: 0 (0) - Rows total: 80.10M (80100056) - Splits processed: 121 (121) - Splits rejected: 0 (0) - Splits total: 121 (121) Instance 7f40dcb034de70b7:d8 (host=ve1139.foo:22000):(Total: 9m19s, non-child: 8m57s, % non-child: 96.10%) Hdfs split stats (:<# splits>/): 2:261/15.33 GB 0:216/12.87 GB 7:232/13.32 GB 5:227/13.33 GB 4:225/11.86 GB 6:224/13.63 GB 3:208/12.16 GB 1:225/13.19 GB Filter 6 arrival: 761ms Filter 2 arrival: 13s184ms Filter 5 arrival: 16s713ms MemoryUsage(16s000ms): 35.70 MB, 66.30 MB, 66.76 MB, 65.52 MB, 65.78 MB, 66.07 MB, 65.73 MB, 65.84 MB, 65.66 MB, 66.79 MB, 66.86 MB, 66.11 MB, 64.80 MB, 64.71 MB, 65.66 MB, 66.70 MB, 66.76 MB, 66.46 MB, 66.76 MB, 66.74 MB, 65.93 MB, 65.91 MB, 65.78 MB, 65.67 MB, 66.49 MB, 66.80 MB, 66.81 MB, 66.80 MB, 66.87 MB, 66.46 MB, 64.70 MB, 64.58 MB, 64.57 MB, 64.62 MB ThreadUsage(16s000ms): 12, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.95 - BloomFilterBytes: 33.00 MB (34603008) - PeakMemoryUsage: 67.63 MB (70913239) - PerHostPeakMemUsage: 161.69 GB (173612786668) - RowsProduced: 78.91M (78912536) - TotalNetworkReceiveTime: 532.532ms - TotalNetworkSendTime: 8m48s - TotalStorageWaitTime: 12s832ms - TotalThreadsInvoluntaryContextSwitches: 13.25K (13248) - TotalThreadsTotalWallClockTime: 2h - TotalThreadsSysTime: 2s517ms - TotalThreadsUserTime: 1m47s - TotalThreadsVoluntaryContextSwitches: 177.39K (177388) Fragment Instance Lifecycle Timings: - ExecTime: 9m18s - ExecTreeExecTime: 3s789ms - OpenTime: 1s104ms - ExecTreeOpenTime: 922.932ms - PrepareTime: 52.155ms - ExecTreePrepareTime: 6.854ms DataStreamSender (dst_id=22):(Total: 16s956ms, non-child: 16s956ms, % non-child: 100.00%) - BytesSent: 729.13 MB (764543035) - NetworkThroughput(*): 76.65 MB/sec - OverallThroughput: 43.00 MB/sec - PeakMemoryUsage: 4.96 MB (5199616) - RowsReturned: 78.91M (78912536) - SerializeBatchTime: 7s422ms - TransmitDataRPCTime: 9s512ms - UncompressedRowBatchSize: 2.21 GB (2368225160) CodeGen:(Total: 199.702ms, non-child: 199.702ms, % non-child: 100.00%) - CodegenTime: 1.041ms - CompileTime: 51.956ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 128.325ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 18.985ms HASH_JOIN_NODE (id=5):(Total: 4s672ms, non-child: 3s261ms, % non-child: 69.80%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.287ms - PeakMemoryUsage: 1.24 MB (1296509) - ProbeRows: 78.91M (78912536) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3s094ms - RowsReturned: 78.91M (78912536) - RowsReturnedRate: 16.89 M/sec Hash Join Builder (join_node_id=5): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 34.332us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 86.771us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 51.054us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 532.543ms, non-child: 19.625us, % non-child: 0.00%) BytesReceived(16s000ms): 963.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 5.088us - DeserializeRowBatchTimer: 15.570us - FirstBatchArrivalWaitTime: 512.907ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 225.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=3):(Total: 878.942ms, non-child: 878.942ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:261/15.33 GB 0:216/12.87 GB 7:232/13.32 GB 5:227/13.33 GB 4:225/11.86 GB 6:224/13.63 GB 3:208/12.16 GB 1:225/13.19 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 119 out of 119 Runtime filters: Only following filters arrived: 6, waited 262ms Hdfs Read Thread Concurrency Bucket: 0:99.19% 1:0.8115% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1699 PARQUET/SNAPPY:119 BytesRead(16s000ms): 13.70 MB, 14.61 MB, 14.61 MB, 19.88 MB, 29.12 MB, 29.44 MB, 39.90 MB, 43.73 MB, 45.98 MB, 58.29 MB, 58.29 MB, 62.60 MB, 72.62 MB, 72.83 MB, 80.01 MB, 86.93 MB, 87.49 MB, 98.42 MB, 101.40 MB, 102.34 MB, 113.36 MB, 115.95 MB, 115.95 MB, 118.14 MB, 129.25 MB, 130.66 MB, 130.66 MB, 130.95 MB, 133.68 MB, 135.86 MB, 143.78 MB, 144.01 MB, 144.01 MB, 144.01 MB - FooterProcessingTime: (Avg: 56.809ms ; Min: 4.064ms ; Max: 175.391ms ; Number of samples: 119) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 11.98 - BytesRead: 144.01 MB (151004658) - BytesReadDataNodeCache: 0 - BytesReadLocal: 144.01 MB (151004658) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 144.01 MB (151004658) - DecompressionTime: 2s220ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 119 (119) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 29.32 MB (30739323) - PerReadThreadRawHdfsThroughput: 20.79 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 121.629ms - RowBatchQueuePutWaitTime: 1h49m - RowsRead: 79.06M (79055733) - RowsReturned: 78.91M (78912536) - RowsReturnedRate: 89.78 M/sec - ScanRangesComplete: 1.82K (1818) - ScannerThreadsInvoluntaryContextSwitches: 8.24K (8240) - ScannerThreadsTotalWallClockTime: 1h51m - MaterializeTupleTime(*): 6s362ms - ScannerThreadsSysTime: 1s777ms - ScannerThreadsUserTime: 1m23s - ScannerThreadsVoluntaryContextSwitches: 174.14K (174143) - TotalRawHdfsReadTime(*): 6s925ms - TotalReadThroughput: 265.94 KB/sec Filter 2 (16.00 MB): - Rows processed: 2.06M (2063187) - Rows rejected: 143.15K (143150) - Rows total: 79.06M (79055733) Filter 5 (16.00 MB): - Rows processed: 1.90M (1902639) - Rows rejected: 47 (47) - Rows total: 78.91M (78912583) Filter 6 (1.00 MB): - Files processed: 1.82K (1818) - Files rejected: 1.70K (1699) - Files total: 1.82K (1818) - RowGroups processed: 77.03K (77034) - RowGroups rejected: 0 (0) - RowGroups total: 77.03K (77034) - Rows processed: 1.95M (1949696) - Rows rejected: 0 (0) - Rows total: 78.91M (78912536) - Splits processed: 119 (119) - Splits rejected: 0 (0) - Splits total: 119 (119) Instance 7f40dcb034de70b7:87 (host=va1044.foo:22000):(Total: 9m19s, non-child: 8m56s, % non-child: 95.95%) Hdfs split stats (:<# splits>/): 1:246/13.94 GB 4:230/12.78 GB 0:208/11.96 GB 7:218/12.92 GB 2:229/13.04 GB 3:220/12.67 GB 5:234/14.07 GB 6:242/14.28 GB Filter 6 arrival: 1s135ms Filter 2 arrival: 11s318ms Filter 5 arrival: 15s756ms MemoryUsage(16s000ms): 35.93 MB, 66.80 MB, 66.81 MB, 65.32 MB, 63.74 MB, 63.82 MB, 65.11 MB, 65.34 MB, 64.96 MB, 66.51 MB, 66.81 MB, 66.68 MB, 65.94 MB, 65.82 MB, 65.52 MB, 66.72 MB, 66.85 MB, 66.01 MB, 65.82 MB, 65.87 MB, 65.96 MB, 65.68 MB, 65.77 MB, 65.68 MB, 65.26 MB, 64.84 MB, 64.85 MB, 64.71 MB, 64.24 MB, 64.63 MB, 65.56 MB, 64.62 MB, 64.56 MB, 64.55 MB ThreadUsage(16s000ms): 11, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.94 - BloomFilterBytes: 33.00 MB (34603008) - PeakMemoryUsage: 67.33 MB (70604209) - PerHostPeakMemUsage: 161.68 GB (173598812704) - RowsProduced: 79.03M (79028025) - TotalNetworkReceiveTime: 893.946ms - TotalNetworkSendTime: 8m50s - TotalStorageWaitTime: 12s701ms - TotalThreadsInvoluntaryContextSwitches: 13.39K (13387) - TotalThreadsTotalWallClockTime: 2h - TotalThreadsSysTime: 2s941ms - TotalThreadsUserTime: 1m39s - TotalThreadsVoluntaryContextSwitches: 159.67K (159671) Fragment Instance Lifecycle Timings: - ExecTime: 9m18s - ExecTreeExecTime: 4s198ms - OpenTime: 1s227ms - ExecTreeOpenTime: 1s033ms - PrepareTime: 51.971ms - ExecTreePrepareTime: 6.300ms DataStreamSender (dst_id=22):(Total: 17s249ms, non-child: 17s249ms, % non-child: 100.00%) - BytesSent: 731.42 MB (766951021) - NetworkThroughput(*): 75.77 MB/sec - OverallThroughput: 42.40 MB/sec - PeakMemoryUsage: 5.00 MB (5240576) - RowsReturned: 79.03M (79028025) - SerializeBatchTime: 7s575ms - TransmitDataRPCTime: 9s652ms - UncompressedRowBatchSize: 2.21 GB (2371691078) CodeGen:(Total: 214.483ms, non-child: 214.483ms, % non-child: 100.00%) - CodegenTime: 1.114ms - CompileTime: 57.704ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 134.236ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 22.054ms HASH_JOIN_NODE (id=5):(Total: 5s199ms, non-child: 3s315ms, % non-child: 63.76%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.423ms - PeakMemoryUsage: 1.24 MB (1298363) - ProbeRows: 79.03M (79028025) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3s136ms - RowsReturned: 79.03M (79028025) - RowsReturnedRate: 15.20 M/sec Hash Join Builder (join_node_id=5): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 26.712us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 148.374us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 36.552us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 893.957ms, non-child: 20.090us, % non-child: 0.00%) BytesReceived(16s000ms): 901.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 5.630us - DeserializeRowBatchTimer: 14.040us - FirstBatchArrivalWaitTime: 870.102ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 134.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=3):(Total: 991.087ms, non-child: 991.087ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:246/13.94 GB 4:230/12.78 GB 0:208/11.96 GB 7:218/12.92 GB 2:229/13.04 GB 3:220/12.67 GB 5:234/14.07 GB 6:242/14.28 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 120 out of 120 Runtime filters: Only following filters arrived: 6, waited 41ms Hdfs Read Thread Concurrency Bucket: 0:99.55% 1:0.4488% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1707 PARQUET/SNAPPY:120 BytesRead(16s000ms): 13.43 MB, 14.82 MB, 15.63 MB, 20.77 MB, 28.78 MB, 29.98 MB, 39.31 MB, 43.45 MB, 45.34 MB, 55.98 MB, 58.26 MB, 61.18 MB, 72.14 MB, 72.77 MB, 77.67 MB, 87.55 MB, 87.74 MB, 95.01 MB, 102.17 MB, 102.53 MB, 109.69 MB, 116.12 MB, 116.66 MB, 118.24 MB, 127.26 MB, 131.29 MB, 131.29 MB, 131.88 MB, 135.69 MB, 139.20 MB, 144.03 MB, 144.97 MB, 144.97 MB, 144.97 MB - FooterProcessingTime: (Avg: 61.840ms ; Min: 4.438ms ; Max: 488.140ms ; Number of samples: 120) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 11.97 - BytesRead: 144.97 MB (152009718) - BytesReadDataNodeCache: 0 - BytesReadLocal: 144.97 MB (152009718) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 144.97 MB (152009718) - DecompressionTime: 1s269ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 120 (120) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 29.13 MB (30541376) - PerReadThreadRawHdfsThroughput: 23.88 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 92.434ms - RowBatchQueuePutWaitTime: 1h49m - RowsRead: 79.17M (79168809) - RowsReturned: 79.03M (79028025) - RowsReturnedRate: 79.74 M/sec - ScanRangesComplete: 1.83K (1827) - ScannerThreadsInvoluntaryContextSwitches: 8.07K (8072) - ScannerThreadsTotalWallClockTime: 1h51m - MaterializeTupleTime(*): 6s730ms - ScannerThreadsSysTime: 2s210ms - ScannerThreadsUserTime: 1m14s - ScannerThreadsVoluntaryContextSwitches: 156.58K (156579) - TotalRawHdfsReadTime(*): 6s071ms - TotalReadThroughput: 266.27 KB/sec Filter 2 (16.00 MB): - Rows processed: 2.02M (2023920) - Rows rejected: 140.76K (140763) - Rows total: 79.17M (79168809) Filter 5 (16.00 MB): - Rows processed: 1.88M (1883157) - Rows rejected: 21 (21) - Rows total: 79.03M (79028046) Filter 6 (1.00 MB): - Files processed: 1.83K (1827) - Files rejected: 1.71K (1707) - Files total: 1.83K (1827) - RowGroups processed: 77.15K (77150) - RowGroups rejected: 0 (0) - RowGroups total: 77.15K (77150) - Rows processed: 1.97M (1966080) - Rows rejected: 0 (0) - Rows total: 79.03M (79028025) - Splits processed: 120 (120) - Splits rejected: 0 (0) - Splits total: 120 (120) Instance 7f40dcb034de70b7:df (host=ve1126.foo:22000):(Total: 9m19s, non-child: 8m57s, % non-child: 96.13%) Hdfs split stats (:<# splits>/): 2:215/12.82 GB 4:236/13.99 GB 0:219/13.35 GB 1:215/12.17 GB 5:234/14.19 GB 7:235/13.62 GB 6:231/13.17 GB 3:218/12.36 GB Filter 6 arrival: 753ms Filter 2 arrival: 13s261ms Filter 5 arrival: 16s782ms MemoryUsage(16s000ms): 34.91 MB, 65.27 MB, 65.80 MB, 66.69 MB, 66.77 MB, 66.83 MB, 65.89 MB, 65.80 MB, 65.77 MB, 66.20 MB, 66.81 MB, 66.78 MB, 66.64 MB, 66.79 MB, 66.63 MB, 66.78 MB, 66.78 MB, 66.36 MB, 65.85 MB, 65.74 MB, 66.13 MB, 66.52 MB, 66.84 MB, 66.76 MB, 65.59 MB, 65.83 MB, 65.80 MB, 65.79 MB, 65.77 MB, 65.53 MB, 63.92 MB, 62.34 MB, 62.35 MB, 62.39 MB ThreadUsage(16s000ms): 12, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.95 - BloomFilterBytes: 33.00 MB (34603008) - PeakMemoryUsage: 67.52 MB (70796158) - PerHostPeakMemUsage: 161.67 GB (173593966143) - RowsProduced: 78.22M (78215827) - TotalNetworkReceiveTime: 524.008ms - TotalNetworkSendTime: 8m50s - TotalStorageWaitTime: 12s091ms - TotalThreadsInvoluntaryContextSwitches: 20.10K (20098) - TotalThreadsTotalWallClockTime: 2h - TotalThreadsSysTime: 27s290ms - TotalThreadsUserTime: 2m18s - TotalThreadsVoluntaryContextSwitches: 3.41M (3409010) Fragment Instance Lifecycle Timings: - ExecTime: 9m18s - ExecTreeExecTime: 3s751ms - OpenTime: 1s076ms - ExecTreeOpenTime: 896.880ms - PrepareTime: 54.216ms - ExecTreePrepareTime: 6.777ms DataStreamSender (dst_id=22):(Total: 16s842ms, non-child: 16s842ms, % non-child: 100.00%) - BytesSent: 725.56 MB (760807873) - NetworkThroughput(*): 77.34 MB/sec - OverallThroughput: 43.08 MB/sec - PeakMemoryUsage: 5.04 MB (5289728) - RowsReturned: 78.22M (78215827) - SerializeBatchTime: 7s439ms - TransmitDataRPCTime: 9s381ms - UncompressedRowBatchSize: 2.19 GB (2347316394) CodeGen:(Total: 200.215ms, non-child: 200.215ms, % non-child: 100.00%) - CodegenTime: 1.310ms - CompileTime: 53.212ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 124.568ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 21.996ms HASH_JOIN_NODE (id=5):(Total: 4s613ms, non-child: 3s263ms, % non-child: 70.74%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.321ms - PeakMemoryUsage: 1.23 MB (1292171) - ProbeRows: 78.22M (78215827) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3s094ms - RowsReturned: 78.22M (78215827) - RowsReturnedRate: 16.95 M/sec Hash Join Builder (join_node_id=5): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 23.080us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 110.054us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 46.840us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 524.018ms, non-child: 18.613us, % non-child: 0.00%) BytesReceived(16s000ms): 963.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 5.041us - DeserializeRowBatchTimer: 14.584us - FirstBatchArrivalWaitTime: 484.040ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 228.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=3):(Total: 826.626ms, non-child: 826.626ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:215/12.82 GB 4:236/13.99 GB 0:219/13.35 GB 1:215/12.17 GB 5:234/14.19 GB 7:235/13.62 GB 6:231/13.17 GB 3:218/12.36 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 118 out of 118 Runtime filters: Only following filters arrived: 6, waited 281ms Hdfs Read Thread Concurrency Bucket: 0:99.19% 1:0.7214% 2:0.09017% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1685 PARQUET/SNAPPY:118 BytesRead(16s000ms): 13.65 MB, 14.56 MB, 14.56 MB, 19.94 MB, 29.37 MB, 29.81 MB, 38.97 MB, 43.85 MB, 44.56 MB, 55.54 MB, 58.51 MB, 59.28 MB, 72.67 MB, 73.26 MB, 75.85 MB, 87.85 MB, 88.11 MB, 93.74 MB, 102.49 MB, 102.87 MB, 106.63 MB, 116.99 MB, 117.32 MB, 117.97 MB, 124.32 MB, 131.89 MB, 131.89 MB, 132.06 MB, 133.23 MB, 134.06 MB, 144.03 MB, 144.22 MB, 144.22 MB, 144.22 MB - FooterProcessingTime: (Avg: 58.543ms ; Min: 4.299ms ; Max: 142.801ms ; Number of samples: 118) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 11.98 - BytesRead: 144.22 MB (151222390) - BytesReadDataNodeCache: 0 - BytesReadLocal: 144.22 MB (151222390) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 144.22 MB (151222390) - DecompressionTime: 900.888ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 118 (118) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 29.45 MB (30875700) - PerReadThreadRawHdfsThroughput: 23.28 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 83.529ms - RowBatchQueuePutWaitTime: 1h48m - RowsRead: 78.36M (78360620) - RowsReturned: 78.22M (78215827) - RowsReturnedRate: 94.62 M/sec - ScanRangesComplete: 1.80K (1803) - ScannerThreadsInvoluntaryContextSwitches: 15.07K (15075) - ScannerThreadsTotalWallClockTime: 1h51m - MaterializeTupleTime(*): 6s523ms - ScannerThreadsSysTime: 26s608ms - ScannerThreadsUserTime: 1m54s - ScannerThreadsVoluntaryContextSwitches: 3.41M (3405866) - TotalRawHdfsReadTime(*): 6s194ms - TotalReadThroughput: 266.33 KB/sec Filter 2 (16.00 MB): - Rows processed: 2.06M (2063765) - Rows rejected: 144.73K (144727) - Rows total: 78.36M (78360620) Filter 5 (16.00 MB): - Rows processed: 1.85M (1854530) - Rows rejected: 66 (66) - Rows total: 78.22M (78215893) Filter 6 (1.00 MB): - Files processed: 1.80K (1803) - Files rejected: 1.69K (1685) - Files total: 1.80K (1803) - RowGroups processed: 76.36K (76359) - RowGroups rejected: 0 (0) - RowGroups total: 76.36K (76359) - Rows processed: 1.93M (1933312) - Rows rejected: 0 (0) - Rows total: 78.22M (78215827) - Splits processed: 118 (118) - Splits rejected: 0 (0) - Splits total: 118 (118) Instance 7f40dcb034de70b7:cd (host=va1045.foo:22000):(Total: 9m19s, non-child: 8m57s, % non-child: 96.03%) Hdfs split stats (:<# splits>/): 3:212/13.09 GB 0:218/12.27 GB 2:236/13.78 GB 7:234/13.51 GB 4:230/13.40 GB 1:217/11.63 GB 5:242/14.22 GB 6:227/13.78 GB Filter 6 arrival: 845ms Filter 2 arrival: 12s916ms Filter 5 arrival: 16s487ms MemoryUsage(16s000ms): 35.26 MB, 66.30 MB, 66.78 MB, 66.67 MB, 66.77 MB, 66.80 MB, 65.62 MB, 65.80 MB, 65.59 MB, 66.68 MB, 66.76 MB, 66.40 MB, 66.77 MB, 66.72 MB, 66.72 MB, 66.80 MB, 66.85 MB, 66.57 MB, 66.79 MB, 66.78 MB, 66.59 MB, 66.86 MB, 66.88 MB, 66.73 MB, 65.10 MB, 66.69 MB, 66.81 MB, 66.79 MB, 65.90 MB, 63.87 MB, 62.57 MB, 61.35 MB, 61.34 MB, 61.35 MB ThreadUsage(16s000ms): 12, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.94 - BloomFilterBytes: 33.00 MB (34603008) - PeakMemoryUsage: 67.80 MB (71094561) - PerHostPeakMemUsage: 161.66 GB (173585092155) - RowsProduced: 78.28M (78282932) - TotalNetworkReceiveTime: 3.906us - TotalNetworkSendTime: 8m48s - TotalStorageWaitTime: 13s929ms - TotalThreadsInvoluntaryContextSwitches: 23.25K (23248) - TotalThreadsTotalWallClockTime: 2h - TotalThreadsSysTime: 12s436ms - TotalThreadsUserTime: 2m52s - TotalThreadsVoluntaryContextSwitches: 1.33M (1333245) Fragment Instance Lifecycle Timings: - ExecTime: 9m18s - ExecTreeExecTime: 3s827ms - OpenTime: 591.388ms - ExecTreeOpenTime: 271.022ms - PrepareTime: 572.772ms - ExecTreePrepareTime: 103.886ms DataStreamSender (dst_id=22):(Total: 17s606ms, non-child: 17s606ms, % non-child: 100.00%) - BytesSent: 727.21 MB (762535227) - NetworkThroughput(*): 73.01 MB/sec - OverallThroughput: 41.30 MB/sec - PeakMemoryUsage: 4.99 MB (5232384) - RowsReturned: 78.28M (78282932) - SerializeBatchTime: 7s619ms - TransmitDataRPCTime: 9s960ms - UncompressedRowBatchSize: 2.19 GB (2349330248) CodeGen:(Total: 355.733ms, non-child: 355.733ms, % non-child: 100.00%) - CodegenTime: 1.665ms - CompileTime: 71.628ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 235.592ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 47.690ms HASH_JOIN_NODE (id=5):(Total: 4s258ms, non-child: 3s368ms, % non-child: 79.09%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.160ms - PeakMemoryUsage: 1.23 MB (1290355) - ProbeRows: 78.28M (78282932) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3s224ms - RowsReturned: 78.28M (78282932) - RowsReturnedRate: 18.38 M/sec Hash Join Builder (join_node_id=5): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 22.472us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 94.171us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 47.800us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 12.061us, non-child: 12.061us, % non-child: 100.00%) BytesReceived(16s000ms): 963.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 3.909us - DeserializeRowBatchTimer: 109.065us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 9.95 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=3):(Total: 890.395ms, non-child: 890.395ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:212/13.09 GB 0:218/12.27 GB 2:236/13.78 GB 7:234/13.51 GB 4:230/13.40 GB 1:217/11.63 GB 5:242/14.22 GB 6:227/13.78 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 119 out of 119 Runtime filters: Only following filters arrived: 6, waited 181ms Hdfs Read Thread Concurrency Bucket: 0:99.01% 1:0.9033% 2:0.09033% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1697 PARQUET/SNAPPY:119 BytesRead(16s000ms): 13.66 MB, 14.57 MB, 14.57 MB, 20.39 MB, 29.05 MB, 29.36 MB, 40.87 MB, 43.60 MB, 44.80 MB, 57.83 MB, 58.04 MB, 61.77 MB, 72.62 MB, 72.66 MB, 79.44 MB, 87.29 MB, 87.56 MB, 97.70 MB, 101.83 MB, 102.35 MB, 113.94 MB, 116.84 MB, 116.84 MB, 118.17 MB, 130.29 MB, 131.73 MB, 131.77 MB, 132.42 MB, 136.59 MB, 143.88 MB, 143.88 MB, 143.88 MB, 143.88 MB, 143.88 MB - FooterProcessingTime: (Avg: 60.954ms ; Min: 28.019ms ; Max: 417.213ms ; Number of samples: 119) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 11.99 - BytesRead: 143.88 MB (150864768) - BytesReadDataNodeCache: 0 - BytesReadLocal: 143.88 MB (150864768) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 143.88 MB (150864768) - DecompressionTime: 932.390ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 119 (119) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 29.67 MB (31111330) - PerReadThreadRawHdfsThroughput: 23.15 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 82.916ms - RowBatchQueuePutWaitTime: 1h48m - RowsRead: 78.43M (78426777) - RowsReturned: 78.28M (78282932) - RowsReturnedRate: 87.92 M/sec - ScanRangesComplete: 1.82K (1816) - ScannerThreadsInvoluntaryContextSwitches: 18.11K (18113) - ScannerThreadsTotalWallClockTime: 1h51m - MaterializeTupleTime(*): 6s898ms - ScannerThreadsSysTime: 11s760ms - ScannerThreadsUserTime: 2m27s - ScannerThreadsVoluntaryContextSwitches: 1.33M (1330029) - TotalRawHdfsReadTime(*): 6s214ms - TotalReadThroughput: 265.94 KB/sec Filter 2 (16.00 MB): - Rows processed: 2.07M (2069989) - Rows rejected: 143.82K (143823) - Rows total: 78.43M (78426777) Filter 5 (16.00 MB): - Rows processed: 1.88M (1875990) - Rows rejected: 22 (22) - Rows total: 78.28M (78282954) Filter 6 (1.00 MB): - Files processed: 1.82K (1816) - Files rejected: 1.70K (1697) - Files total: 1.82K (1816) - RowGroups processed: 76.42K (76423) - RowGroups rejected: 0 (0) - RowGroups total: 76.42K (76423) - Rows processed: 1.95M (1949696) - Rows rejected: 0 (0) - Rows total: 78.28M (78282932) - Splits processed: 119 (119) - Splits rejected: 0 (0) - Splits total: 119 (119) Instance 7f40dcb034de70b7:d2 (host=vd1125.foo:22000):(Total: 9m19s, non-child: 8m56s, % non-child: 96.02%) Hdfs split stats (:<# splits>/): 2:231/13.94 GB 5:231/13.31 GB 0:221/12.87 GB 3:212/12.13 GB 1:215/12.47 GB 4:241/13.81 GB 6:233/13.47 GB 7:232/13.67 GB Filter 6 arrival: 785ms Filter 2 arrival: 13s125ms Filter 5 arrival: 16s687ms MemoryUsage(16s000ms): 33.00 MB, 64.77 MB, 65.77 MB, 65.47 MB, 66.73 MB, 66.78 MB, 66.66 MB, 66.81 MB, 66.69 MB, 65.71 MB, 65.76 MB, 65.92 MB, 66.81 MB, 66.81 MB, 66.11 MB, 65.74 MB, 65.56 MB, 65.24 MB, 65.77 MB, 65.91 MB, 66.41 MB, 66.82 MB, 66.91 MB, 66.72 MB, 65.67 MB, 65.79 MB, 65.82 MB, 65.70 MB, 65.15 MB, 63.42 MB, 61.25 MB, 61.37 MB, 61.39 MB, 60.46 MB ThreadUsage(16s000ms): 12, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.95 - BloomFilterBytes: 33.00 MB (34603008) - PeakMemoryUsage: 68.27 MB (71591425) - PerHostPeakMemUsage: 161.67 GB (173588284718) - RowsProduced: 78.20M (78196193) - TotalNetworkReceiveTime: 546.369ms - TotalNetworkSendTime: 8m48s - TotalStorageWaitTime: 13s358ms - TotalThreadsInvoluntaryContextSwitches: 24.17K (24170) - TotalThreadsTotalWallClockTime: 2h - TotalThreadsSysTime: 31s857ms - TotalThreadsUserTime: 2m52s - TotalThreadsVoluntaryContextSwitches: 2.97M (2970872) Fragment Instance Lifecycle Timings: - ExecTime: 9m17s - ExecTreeExecTime: 3s766ms - OpenTime: 1s104ms - ExecTreeOpenTime: 916.390ms - PrepareTime: 55.446ms - ExecTreePrepareTime: 7.312ms DataStreamSender (dst_id=22):(Total: 17s412ms, non-child: 17s412ms, % non-child: 100.00%) - BytesSent: 724.69 MB (759887425) - NetworkThroughput(*): 71.11 MB/sec - OverallThroughput: 41.62 MB/sec - PeakMemoryUsage: 4.87 MB (5109504) - RowsReturned: 78.20M (78196193) - SerializeBatchTime: 7s200ms - TransmitDataRPCTime: 10s190ms - UncompressedRowBatchSize: 2.19 GB (2346727166) CodeGen:(Total: 207.766ms, non-child: 207.766ms, % non-child: 100.00%) - CodegenTime: 1.100ms - CompileTime: 58.514ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 127.701ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 21.120ms HASH_JOIN_NODE (id=5):(Total: 4s651ms, non-child: 3s235ms, % non-child: 69.56%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.621ms - PeakMemoryUsage: 1.23 MB (1292229) - ProbeRows: 78.20M (78196193) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3s062ms - RowsReturned: 78.20M (78196193) - RowsReturnedRate: 16.81 M/sec Hash Join Builder (join_node_id=5): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 26.684us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 180.149us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 60.096us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 546.380ms, non-child: 21.567us, % non-child: 0.00%) BytesReceived(16s000ms): 932.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 5.730us - DeserializeRowBatchTimer: 17.283us - FirstBatchArrivalWaitTime: 541.700ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 219.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=3):(Total: 870.092ms, non-child: 870.092ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:231/13.94 GB 5:231/13.31 GB 0:221/12.87 GB 3:212/12.13 GB 1:215/12.47 GB 4:241/13.81 GB 6:233/13.47 GB 7:232/13.67 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 118 out of 118 Runtime filters: Only following filters arrived: 6, waited 241ms Hdfs Read Thread Concurrency Bucket: 0:98.83% 1:1.171% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1698 PARQUET/SNAPPY:118 BytesRead(16s000ms): 13.33 MB, 14.71 MB, 14.71 MB, 18.83 MB, 29.10 MB, 29.47 MB, 38.72 MB, 43.77 MB, 45.06 MB, 57.90 MB, 58.36 MB, 63.08 MB, 72.90 MB, 73.37 MB, 79.56 MB, 87.44 MB, 88.01 MB, 99.03 MB, 101.69 MB, 102.55 MB, 114.44 MB, 116.69 MB, 116.69 MB, 118.68 MB, 130.06 MB, 131.28 MB, 131.28 MB, 132.11 MB, 134.42 MB, 139.34 MB, 143.63 MB, 143.63 MB, 143.63 MB, 143.63 MB - FooterProcessingTime: (Avg: 65.786ms ; Min: 3.890ms ; Max: 345.040ms ; Number of samples: 118) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 11.99 - BytesRead: 143.63 MB (150603630) - BytesReadDataNodeCache: 0 - BytesReadLocal: 143.63 MB (150603630) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 143.63 MB (150603630) - DecompressionTime: 1s918ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 118 (118) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 30.09 MB (31550850) - PerReadThreadRawHdfsThroughput: 20.80 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 120.640ms - RowBatchQueuePutWaitTime: 1h48m - RowsRead: 78.34M (78339920) - RowsReturned: 78.20M (78196193) - RowsReturnedRate: 89.87 M/sec - ScanRangesComplete: 1.82K (1816) - ScannerThreadsInvoluntaryContextSwitches: 19.22K (19217) - ScannerThreadsTotalWallClockTime: 1h51m - MaterializeTupleTime(*): 6s826ms - ScannerThreadsSysTime: 31s090ms - ScannerThreadsUserTime: 2m29s - ScannerThreadsVoluntaryContextSwitches: 2.97M (2967651) - TotalRawHdfsReadTime(*): 6s903ms - TotalReadThroughput: 264.76 KB/sec Filter 2 (16.00 MB): - Rows processed: 2.05M (2052454) - Rows rejected: 143.68K (143681) - Rows total: 78.34M (78339920) Filter 5 (16.00 MB): - Rows processed: 1.89M (1885230) - Rows rejected: 46 (46) - Rows total: 78.20M (78196239) Filter 6 (1.00 MB): - Files processed: 1.82K (1816) - Files rejected: 1.70K (1698) - Files total: 1.82K (1816) - RowGroups processed: 76.34K (76341) - RowGroups rejected: 0 (0) - RowGroups total: 76.34K (76341) - Rows processed: 1.93M (1933312) - Rows rejected: 0 (0) - Rows total: 78.20M (78196193) - Splits processed: 118 (118) - Splits rejected: 0 (0) - Splits total: 118 (118) Instance 7f40dcb034de70b7:cc (host=vd1121.foo:22000):(Total: 9m18s, non-child: 8m57s, % non-child: 96.18%) Hdfs split stats (:<# splits>/): 7:221/13.40 GB 5:225/13.11 GB 0:219/12.58 GB 6:231/12.81 GB 3:236/14.01 GB 2:246/14.15 GB 4:227/13.12 GB 1:220/12.47 GB Filter 6 arrival: 820ms Filter 2 arrival: 12s997ms Filter 5 arrival: 16s582ms MemoryUsage(16s000ms): 35.49 MB, 66.31 MB, 66.76 MB, 66.59 MB, 66.82 MB, 66.74 MB, 66.66 MB, 66.82 MB, 66.58 MB, 65.80 MB, 65.90 MB, 65.26 MB, 65.09 MB, 65.86 MB, 65.89 MB, 66.74 MB, 66.57 MB, 66.71 MB, 66.82 MB, 66.53 MB, 66.53 MB, 66.77 MB, 66.79 MB, 66.69 MB, 66.83 MB, 66.86 MB, 66.77 MB, 66.35 MB, 64.89 MB, 63.62 MB, 62.29 MB, 62.34 MB, 62.29 MB, 61.59 MB ThreadUsage(16s000ms): 12, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.95 - BloomFilterBytes: 33.00 MB (34603008) - PeakMemoryUsage: 67.93 MB (71234735) - PerHostPeakMemUsage: 161.67 GB (173594478297) - RowsProduced: 78.56M (78562074) - TotalNetworkReceiveTime: 598.109ms - TotalNetworkSendTime: 8m50s - TotalStorageWaitTime: 16s177ms - TotalThreadsInvoluntaryContextSwitches: 25.15K (25150) - TotalThreadsTotalWallClockTime: 2h - TotalThreadsSysTime: 40s719ms - TotalThreadsUserTime: 2m54s - TotalThreadsVoluntaryContextSwitches: 3.47M (3470484) Fragment Instance Lifecycle Timings: - ExecTime: 9m17s - ExecTreeExecTime: 3s696ms - OpenTime: 1s094ms - ExecTreeOpenTime: 915.329ms - PrepareTime: 47.481ms - ExecTreePrepareTime: 6.499ms DataStreamSender (dst_id=22):(Total: 16s561ms, non-child: 16s561ms, % non-child: 100.00%) - BytesSent: 726.04 MB (761306444) - NetworkThroughput(*): 76.86 MB/sec - OverallThroughput: 43.84 MB/sec - PeakMemoryUsage: 4.85 MB (5084928) - RowsReturned: 78.56M (78562074) - SerializeBatchTime: 7s095ms - TransmitDataRPCTime: 9s446ms - UncompressedRowBatchSize: 2.20 GB (2357707500) CodeGen:(Total: 195.841ms, non-child: 195.841ms, % non-child: 100.00%) - CodegenTime: 974.018us - CompileTime: 52.519ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 125.031ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 17.920ms HASH_JOIN_NODE (id=5):(Total: 4s579ms, non-child: 3s216ms, % non-child: 70.24%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.786ms - PeakMemoryUsage: 1.24 MB (1296751) - ProbeRows: 78.56M (78562074) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3s049ms - RowsReturned: 78.56M (78562074) - RowsReturnedRate: 17.16 M/sec Hash Join Builder (join_node_id=5): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 30.560us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 255.686us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 65.814us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 598.118ms, non-child: 18.288us, % non-child: 0.00%) BytesReceived(16s000ms): 963.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 3.772us - DeserializeRowBatchTimer: 20.140us - FirstBatchArrivalWaitTime: 571.810ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 200.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=3):(Total: 765.248ms, non-child: 765.248ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:221/13.40 GB 5:225/13.11 GB 0:219/12.58 GB 6:231/12.81 GB 3:236/14.01 GB 2:246/14.15 GB 4:227/13.12 GB 1:220/12.47 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 120 out of 120 Runtime filters: Only following filters arrived: 6, waited 201ms Hdfs Read Thread Concurrency Bucket: 0:98.92% 1:0.9883% 2:0.08985% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1705 PARQUET/SNAPPY:120 BytesRead(16s000ms): 13.61 MB, 14.52 MB, 14.52 MB, 20.07 MB, 29.06 MB, 29.52 MB, 39.11 MB, 43.54 MB, 45.05 MB, 57.98 MB, 58.22 MB, 62.02 MB, 72.58 MB, 73.34 MB, 79.33 MB, 87.38 MB, 88.32 MB, 99.84 MB, 102.03 MB, 103.85 MB, 114.85 MB, 116.59 MB, 116.59 MB, 120.98 MB, 130.04 MB, 131.20 MB, 131.20 MB, 132.41 MB, 137.41 MB, 142.94 MB, 143.72 MB, 143.72 MB, 143.72 MB, 143.72 MB - FooterProcessingTime: (Avg: 76.973ms ; Min: 4.473ms ; Max: 1s150ms ; Number of samples: 120) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 11.98 - BytesRead: 143.72 MB (150706348) - BytesReadDataNodeCache: 0 - BytesReadLocal: 143.72 MB (150706348) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 143.72 MB (150706348) - DecompressionTime: 2s186ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 120 (120) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 29.62 MB (31060724) - PerReadThreadRawHdfsThroughput: 21.96 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 106.976ms - RowBatchQueuePutWaitTime: 1h47m - RowsRead: 78.71M (78708446) - RowsReturned: 78.56M (78562074) - RowsReturnedRate: 102.66 M/sec - ScanRangesComplete: 1.82K (1825) - ScannerThreadsInvoluntaryContextSwitches: 20.28K (20277) - ScannerThreadsTotalWallClockTime: 1h51m - MaterializeTupleTime(*): 6s456ms - ScannerThreadsSysTime: 40s025ms - ScannerThreadsUserTime: 2m32s - ScannerThreadsVoluntaryContextSwitches: 3.47M (3467310) - TotalRawHdfsReadTime(*): 6s546ms - TotalReadThroughput: 264.46 KB/sec Filter 2 (16.00 MB): - Rows processed: 2.09M (2085828) - Rows rejected: 146.26K (146264) - Rows total: 78.71M (78708446) Filter 5 (16.00 MB): - Rows processed: 1.91M (1911916) - Rows rejected: 108 (108) - Rows total: 78.56M (78562182) Filter 6 (1.00 MB): - Files processed: 1.82K (1825) - Files rejected: 1.71K (1705) - Files total: 1.82K (1825) - RowGroups processed: 76.69K (76691) - RowGroups rejected: 0 (0) - RowGroups total: 76.69K (76691) - Rows processed: 1.97M (1966080) - Rows rejected: 0 (0) - Rows total: 78.56M (78562074) - Splits processed: 120 (120) - Splits rejected: 0 (0) - Splits total: 120 (120) Instance 7f40dcb034de70b7:e5 (host=vd1110.foo:22000):(Total: 9m18s, non-child: 8m57s, % non-child: 96.21%) Hdfs split stats (:<# splits>/): 0:230/13.16 GB 3:215/12.02 GB 6:228/13.54 GB 7:237/13.32 GB 2:241/13.99 GB 1:233/14.18 GB 4:216/12.76 GB 5:220/12.71 GB Filter 6 arrival: 742ms Filter 2 arrival: 13s644ms Filter 5 arrival: 16s879ms MemoryUsage(16s000ms): 33.50 MB, 65.78 MB, 66.80 MB, 65.81 MB, 65.24 MB, 65.78 MB, 65.72 MB, 65.84 MB, 65.76 MB, 66.41 MB, 66.82 MB, 66.68 MB, 64.70 MB, 65.73 MB, 64.92 MB, 65.69 MB, 66.02 MB, 66.47 MB, 66.82 MB, 66.77 MB, 66.41 MB, 66.82 MB, 66.87 MB, 66.83 MB, 66.44 MB, 66.82 MB, 66.84 MB, 66.60 MB, 66.54 MB, 66.79 MB, 64.73 MB, 64.66 MB, 64.60 MB, 63.44 MB ThreadUsage(16s000ms): 12, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.94 - BloomFilterBytes: 33.00 MB (34603008) - PeakMemoryUsage: 67.81 MB (71102915) - PerHostPeakMemUsage: 161.65 GB (173574257856) - RowsProduced: 79.12M (79116999) - TotalNetworkReceiveTime: 509.433ms - TotalNetworkSendTime: 8m50s - TotalStorageWaitTime: 12s594ms - TotalThreadsInvoluntaryContextSwitches: 19.09K (19089) - TotalThreadsTotalWallClockTime: 2h - TotalThreadsSysTime: 33s841ms - TotalThreadsUserTime: 1m59s - TotalThreadsVoluntaryContextSwitches: 1.02M (1024114) Fragment Instance Lifecycle Timings: - ExecTime: 9m17s - ExecTreeExecTime: 3s656ms - OpenTime: 1s096ms - ExecTreeOpenTime: 911.552ms - PrepareTime: 53.261ms - ExecTreePrepareTime: 7.248ms DataStreamSender (dst_id=22):(Total: 16s415ms, non-child: 16s415ms, % non-child: 100.00%) - BytesSent: 733.77 MB (769417482) - NetworkThroughput(*): 80.32 MB/sec - OverallThroughput: 44.70 MB/sec - PeakMemoryUsage: 4.81 MB (5043968) - RowsReturned: 79.12M (79116999) - SerializeBatchTime: 7s259ms - TransmitDataRPCTime: 9s135ms - UncompressedRowBatchSize: 2.21 GB (2374361250) CodeGen:(Total: 204.298ms, non-child: 204.298ms, % non-child: 100.00%) - CodegenTime: 1.097ms - CompileTime: 54.047ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 128.972ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 20.822ms HASH_JOIN_NODE (id=5):(Total: 4s540ms, non-child: 3s213ms, % non-child: 70.78%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.522ms - PeakMemoryUsage: 1.23 MB (1290816) - ProbeRows: 79.12M (79116999) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3s045ms - RowsReturned: 79.12M (79116999) - RowsReturnedRate: 17.43 M/sec Hash Join Builder (join_node_id=5): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 26.554us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 131.277us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 52.317us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 509.443ms, non-child: 19.749us, % non-child: 0.00%) BytesReceived(16s000ms): 932.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 5.079us - DeserializeRowBatchTimer: 19.290us - FirstBatchArrivalWaitTime: 465.463ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 235.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=3):(Total: 817.862ms, non-child: 817.862ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:230/13.16 GB 3:215/12.02 GB 6:228/13.54 GB 7:237/13.32 GB 2:241/13.99 GB 1:233/14.18 GB 4:216/12.76 GB 5:220/12.71 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 121 out of 121 Runtime filters: Only following filters arrived: 6, waited 282ms Hdfs Read Thread Concurrency Bucket: 0:99.28% 1:0.6323% 2:0% 3:0% 4:0.09033% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1699 PARQUET/SNAPPY:121 BytesRead(16s000ms): 13.43 MB, 14.81 MB, 14.81 MB, 18.28 MB, 29.18 MB, 29.60 MB, 37.85 MB, 44.32 MB, 44.70 MB, 55.55 MB, 58.93 MB, 60.32 MB, 72.35 MB, 73.59 MB, 77.31 MB, 87.21 MB, 88.02 MB, 96.56 MB, 102.39 MB, 102.93 MB, 111.89 MB, 116.78 MB, 117.13 MB, 119.32 MB, 130.41 MB, 131.84 MB, 132.00 MB, 134.33 MB, 143.87 MB, 144.37 MB, 145.26 MB, 145.26 MB, 145.26 MB, 145.26 MB - FooterProcessingTime: (Avg: 54.662ms ; Min: 25.658ms ; Max: 128.477ms ; Number of samples: 121) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 11.98 - BytesRead: 145.26 MB (152318003) - BytesReadDataNodeCache: 0 - BytesReadLocal: 145.26 MB (152318003) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 145.26 MB (152318003) - DecompressionTime: 627.653ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 121 (121) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 29.41 MB (30841156) - PerReadThreadRawHdfsThroughput: 21.44 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 114.435ms - RowBatchQueuePutWaitTime: 1h48m - RowsRead: 79.26M (79263211) - RowsReturned: 79.12M (79116999) - RowsReturnedRate: 96.74 M/sec - ScanRangesComplete: 1.82K (1820) - ScannerThreadsInvoluntaryContextSwitches: 14.10K (14098) - ScannerThreadsTotalWallClockTime: 1h51m - MaterializeTupleTime(*): 5s880ms - ScannerThreadsSysTime: 33s099ms - ScannerThreadsUserTime: 1m36s - ScannerThreadsVoluntaryContextSwitches: 1.02M (1020954) - TotalRawHdfsReadTime(*): 6s776ms - TotalReadThroughput: 268.50 KB/sec Filter 2 (16.00 MB): - Rows processed: 2.09M (2087716) - Rows rejected: 146.14K (146140) - Rows total: 79.26M (79263211) Filter 5 (16.00 MB): - Rows processed: 1.92M (1919048) - Rows rejected: 72 (72) - Rows total: 79.12M (79117071) Filter 6 (1.00 MB): - Files processed: 1.82K (1820) - Files rejected: 1.70K (1699) - Files total: 1.82K (1820) - RowGroups processed: 77.23K (77234) - RowGroups rejected: 0 (0) - RowGroups total: 77.23K (77234) - Rows processed: 1.98M (1982464) - Rows rejected: 0 (0) - Rows total: 79.12M (79116999) - Splits processed: 121 (121) - Splits rejected: 0 (0) - Splits total: 121 (121) Instance 7f40dcb034de70b7:77 (host=vc1533.foo:22000):(Total: 9m18s, non-child: 8m55s, % non-child: 95.81%) Hdfs split stats (:<# splits>/): 7:233/13.58 GB 5:211/12.09 GB 1:228/13.19 GB 0:236/12.81 GB 6:222/14.07 GB 2:229/13.88 GB 3:221/12.60 GB 4:240/13.46 GB Filter 6 arrival: 1s209ms Filter 2 arrival: 10s895ms Filter 5 arrival: 15s519ms MemoryUsage(16s000ms): 37.27 MB, 66.76 MB, 66.80 MB, 66.14 MB, 65.77 MB, 65.82 MB, 66.17 MB, 66.80 MB, 66.56 MB, 65.82 MB, 65.78 MB, 66.03 MB, 66.79 MB, 66.82 MB, 66.32 MB, 66.12 MB, 66.71 MB, 66.51 MB, 66.78 MB, 66.72 MB, 66.84 MB, 66.74 MB, 66.74 MB, 66.69 MB, 66.66 MB, 66.83 MB, 66.80 MB, 66.52 MB, 66.76 MB, 65.69 MB, 66.70 MB, 66.73 MB, 66.77 MB, 66.77 MB ThreadUsage(16s000ms): 12, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.98 - BloomFilterBytes: 33.00 MB (34603008) - PeakMemoryUsage: 67.46 MB (70737959) - PerHostPeakMemUsage: 161.68 GB (173603250979) - RowsProduced: 80.30M (80295807) - TotalNetworkReceiveTime: 966.658ms - TotalNetworkSendTime: 8m50s - TotalStorageWaitTime: 14s031ms - TotalThreadsInvoluntaryContextSwitches: 7.75K (7746) - TotalThreadsTotalWallClockTime: 2h - TotalThreadsSysTime: 2s963ms - TotalThreadsUserTime: 36s053ms - TotalThreadsVoluntaryContextSwitches: 145.04K (145036) Fragment Instance Lifecycle Timings: - ExecTime: 9m17s - ExecTreeExecTime: 4s353ms - OpenTime: 1s345ms - ExecTreeOpenTime: 1s154ms - PrepareTime: 57.958ms - ExecTreePrepareTime: 8.048ms DataStreamSender (dst_id=22):(Total: 17s709ms, non-child: 17s709ms, % non-child: 100.00%) - BytesSent: 741.14 MB (777138795) - NetworkThroughput(*): 74.34 MB/sec - OverallThroughput: 41.85 MB/sec - PeakMemoryUsage: 5.05 MB (5297920) - RowsReturned: 80.30M (80295807) - SerializeBatchTime: 7s719ms - TransmitDataRPCTime: 9s969ms - UncompressedRowBatchSize: 2.24 GB (2409738114) CodeGen:(Total: 210.708ms, non-child: 210.708ms, % non-child: 100.00%) - CodegenTime: 1.209ms - CompileTime: 55.333ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 133.081ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 21.904ms HASH_JOIN_NODE (id=5):(Total: 5s473ms, non-child: 3s424ms, % non-child: 62.57%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.527ms - PeakMemoryUsage: 1.24 MB (1297180) - ProbeRows: 80.30M (80295807) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3s250ms - RowsReturned: 80.30M (80295807) - RowsReturnedRate: 14.67 M/sec Hash Join Builder (join_node_id=5): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 23.835us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 141.929us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 58.499us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 966.669ms, non-child: 20.464us, % non-child: 0.00%) BytesReceived(16s000ms): 932.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 5.125us - DeserializeRowBatchTimer: 11.670us - FirstBatchArrivalWaitTime: 928.262ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 124.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=3):(Total: 1s082ms, non-child: 1s082ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:233/13.58 GB 5:211/12.09 GB 1:228/13.19 GB 0:236/12.81 GB 6:222/14.07 GB 2:229/13.88 GB 3:221/12.60 GB 4:240/13.46 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 122 out of 122 Runtime filters: Only following filters arrived: 6, waited 40ms Hdfs Read Thread Concurrency Bucket: 0:98.83% 1:0.991% 2:0.09009% 3:0.09009% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1698 PARQUET/SNAPPY:122 BytesRead(16s000ms): 13.08 MB, 14.43 MB, 14.43 MB, 19.44 MB, 28.67 MB, 28.67 MB, 37.97 MB, 43.06 MB, 44.10 MB, 57.00 MB, 57.50 MB, 61.90 MB, 71.73 MB, 71.73 MB, 77.92 MB, 86.23 MB, 86.65 MB, 96.59 MB, 101.21 MB, 101.51 MB, 110.49 MB, 115.52 MB, 115.99 MB, 118.06 MB, 129.05 MB, 130.58 MB, 130.69 MB, 132.29 MB, 137.61 MB, 143.14 MB, 143.85 MB, 144.93 MB, 144.93 MB, 144.93 MB - FooterProcessingTime: (Avg: 62.527ms ; Min: 16.223ms ; Max: 438.274ms ; Number of samples: 122) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 11.98 - BytesRead: 146.17 MB (153267837) - BytesReadDataNodeCache: 0 - BytesReadLocal: 146.17 MB (153267837) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 146.17 MB (153267837) - DecompressionTime: 1s015ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 122 (122) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 29.33 MB (30753240) - PerReadThreadRawHdfsThroughput: 20.26 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 139.683ms - RowBatchQueuePutWaitTime: 1h51m - RowsRead: 80.44M (80441520) - RowsReturned: 80.30M (80295807) - RowsReturnedRate: 74.17 M/sec - ScanRangesComplete: 1.82K (1820) - ScannerThreadsInvoluntaryContextSwitches: 2.54K (2535) - ScannerThreadsTotalWallClockTime: 1h51m - MaterializeTupleTime(*): 6s948ms - ScannerThreadsSysTime: 2s174ms - ScannerThreadsUserTime: 10s951ms - ScannerThreadsVoluntaryContextSwitches: 141.84K (141844) - TotalRawHdfsReadTime(*): 7s213ms - TotalReadThroughput: 269.69 KB/sec Filter 2 (16.00 MB): - Rows processed: 2.10M (2098481) - Rows rejected: 145.70K (145699) - Rows total: 80.44M (80441520) Filter 5 (16.00 MB): - Rows processed: 1.95M (1952782) - Rows rejected: 14 (14) - Rows total: 80.30M (80295821) Filter 6 (1.00 MB): - Files processed: 1.82K (1820) - Files rejected: 1.70K (1698) - Files total: 1.82K (1820) - RowGroups processed: 78.39K (78386) - RowGroups rejected: 0 (0) - RowGroups total: 78.39K (78386) - Rows processed: 2.00M (1998848) - Rows rejected: 0 (0) - Rows total: 80.30M (80295807) - Splits processed: 122 (122) - Splits rejected: 0 (0) - Splits total: 122 (122) Instance 7f40dcb034de70b7:83 (host=vc1523.foo:22000):(Total: 9m18s, non-child: 8m55s, % non-child: 95.85%) Hdfs split stats (:<# splits>/): 3:230/13.26 GB 4:232/12.95 GB 7:215/13.14 GB 0:216/12.92 GB 2:229/12.80 GB 1:255/14.30 GB 5:223/13.51 GB 6:220/12.78 GB Filter 6 arrival: 1s123ms Filter 2 arrival: 11s237ms Filter 5 arrival: 15s748ms MemoryUsage(16s000ms): 36.05 MB, 66.83 MB, 66.75 MB, 66.68 MB, 66.75 MB, 66.58 MB, 65.74 MB, 65.75 MB, 66.05 MB, 66.72 MB, 66.80 MB, 66.40 MB, 65.83 MB, 65.71 MB, 65.50 MB, 65.71 MB, 65.81 MB, 66.17 MB, 66.74 MB, 66.74 MB, 66.32 MB, 66.79 MB, 66.80 MB, 66.66 MB, 66.82 MB, 66.77 MB, 66.71 MB, 66.77 MB, 66.51 MB, 66.75 MB, 66.92 MB, 66.72 MB, 66.88 MB, 66.82 MB ThreadUsage(16s000ms): 11, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.96 - BloomFilterBytes: 33.00 MB (34603008) - PeakMemoryUsage: 67.55 MB (70833516) - PerHostPeakMemUsage: 161.67 GB (173589483862) - RowsProduced: 80.28M (80284399) - TotalNetworkReceiveTime: 872.793ms - TotalNetworkSendTime: 8m49s - TotalStorageWaitTime: 13s342ms - TotalThreadsInvoluntaryContextSwitches: 9.96K (9958) - TotalThreadsTotalWallClockTime: 2h - TotalThreadsSysTime: 4s115ms - TotalThreadsUserTime: 40s779ms - TotalThreadsVoluntaryContextSwitches: 170.47K (170466) Fragment Instance Lifecycle Timings: - ExecTime: 9m17s - ExecTreeExecTime: 4s037ms - OpenTime: 1s182ms - ExecTreeOpenTime: 986.020ms - PrepareTime: 57.585ms - ExecTreePrepareTime: 6.902ms DataStreamSender (dst_id=22):(Total: 17s986ms, non-child: 17s986ms, % non-child: 100.00%) - BytesSent: 741.61 MB (777630336) - NetworkThroughput(*): 73.31 MB/sec - OverallThroughput: 41.23 MB/sec - PeakMemoryUsage: 5.01 MB (5248768) - RowsReturned: 80.28M (80284399) - SerializeBatchTime: 7s848ms - TransmitDataRPCTime: 10s116ms - UncompressedRowBatchSize: 2.24 GB (2409395762) CodeGen:(Total: 219.012ms, non-child: 219.012ms, % non-child: 100.00%) - CodegenTime: 1.215ms - CompileTime: 57.043ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 137.941ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 23.612ms HASH_JOIN_NODE (id=5):(Total: 4s985ms, non-child: 3s506ms, % non-child: 70.33%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.361ms - PeakMemoryUsage: 1.24 MB (1297481) - ProbeRows: 80.28M (80284399) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3s359ms - RowsReturned: 80.28M (80284399) - RowsReturnedRate: 16.10 M/sec Hash Join Builder (join_node_id=5): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 20.785us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 140.655us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 40.834us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 872.803ms, non-child: 19.818us, % non-child: 0.00%) BytesReceived(16s000ms): 901.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 4.972us - DeserializeRowBatchTimer: 14.861us - FirstBatchArrivalWaitTime: 868.364ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 137.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=3):(Total: 607.009ms, non-child: 607.009ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:230/13.26 GB 4:232/12.95 GB 7:215/13.14 GB 0:216/12.92 GB 2:229/12.80 GB 1:255/14.30 GB 5:223/13.51 GB 6:220/12.78 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 121 out of 121 Runtime filters: Only following filters arrived: 6, waited 41ms Hdfs Read Thread Concurrency Bucket: 0:98.38% 1:1.622% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1699 PARQUET/SNAPPY:121 BytesRead(16s000ms): 13.01 MB, 14.36 MB, 15.63 MB, 23.54 MB, 29.27 MB, 31.09 MB, 41.36 MB, 43.96 MB, 47.66 MB, 57.65 MB, 58.95 MB, 64.66 MB, 72.46 MB, 73.87 MB, 80.18 MB, 87.12 MB, 88.54 MB, 97.59 MB, 101.41 MB, 103.17 MB, 112.20 MB, 115.57 MB, 116.50 MB, 118.90 MB, 129.14 MB, 130.14 MB, 131.21 MB, 132.34 MB, 135.13 MB, 139.84 MB, 144.14 MB, 144.63 MB, 144.74 MB, 145.83 MB - FooterProcessingTime: (Avg: 57.035ms ; Min: 12.315ms ; Max: 176.972ms ; Number of samples: 121) - AverageHdfsReadThreadConcurrency: 0.02 - AverageScannerThreadConcurrency: 11.98 - BytesRead: 145.83 MB (152910973) - BytesReadDataNodeCache: 0 - BytesReadLocal: 145.83 MB (152910973) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 145.83 MB (152910973) - DecompressionTime: 960.643ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 121 (121) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 29.30 MB (30726239) - PerReadThreadRawHdfsThroughput: 20.13 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 66.225ms - RowBatchQueuePutWaitTime: 1h50m - RowsRead: 80.43M (80425012) - RowsReturned: 80.28M (80284399) - RowsReturnedRate: 132.26 M/sec - ScanRangesComplete: 1.82K (1820) - ScannerThreadsInvoluntaryContextSwitches: 4.76K (4757) - ScannerThreadsTotalWallClockTime: 1h51m - MaterializeTupleTime(*): 7s099ms - ScannerThreadsSysTime: 3s416ms - ScannerThreadsUserTime: 14s899ms - ScannerThreadsVoluntaryContextSwitches: 167.31K (167306) - TotalRawHdfsReadTime(*): 7s243ms - TotalReadThroughput: 268.81 KB/sec Filter 2 (16.00 MB): - Rows processed: 2.02M (2023749) - Rows rejected: 140.60K (140598) - Rows total: 80.43M (80425012) Filter 5 (16.00 MB): - Rows processed: 1.88M (1883151) - Rows rejected: 15 (15) - Rows total: 80.28M (80284414) Filter 6 (1.00 MB): - Files processed: 1.82K (1820) - Files rejected: 1.70K (1699) - Files total: 1.82K (1820) - RowGroups processed: 78.38K (78376) - RowGroups rejected: 0 (0) - RowGroups total: 78.38K (78376) - Rows processed: 1.98M (1982464) - Rows rejected: 0 (0) - Rows total: 80.28M (80284399) - Splits processed: 121 (121) - Splits rejected: 0 (0) - Splits total: 121 (121) Instance 7f40dcb034de70b7:b1 (host=vd1107.foo:22000):(Total: 9m18s, non-child: 8m57s, % non-child: 96.21%) Hdfs split stats (:<# splits>/): 7:221/12.82 GB 3:240/14.50 GB 1:219/13.17 GB 4:207/12.35 GB 6:238/13.81 GB 2:224/13.45 GB 5:223/13.17 GB 0:227/12.39 GB Filter 6 arrival: 797ms Filter 2 arrival: 12s374ms Filter 5 arrival: 16s093ms MemoryUsage(16s000ms): 36.56 MB, 66.77 MB, 66.77 MB, 66.15 MB, 65.70 MB, 65.51 MB, 65.22 MB, 65.80 MB, 66.22 MB, 66.55 MB, 66.83 MB, 66.63 MB, 66.66 MB, 66.80 MB, 66.58 MB, 65.78 MB, 65.74 MB, 65.64 MB, 66.81 MB, 66.78 MB, 66.26 MB, 66.78 MB, 66.91 MB, 66.87 MB, 66.50 MB, 66.77 MB, 66.84 MB, 66.39 MB, 65.30 MB, 65.26 MB, 61.29 MB, 61.38 MB, 61.33 MB, 61.32 MB ThreadUsage(16s000ms): 12, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.96 - BloomFilterBytes: 33.00 MB (34603008) - PeakMemoryUsage: 67.57 MB (70848473) - PerHostPeakMemUsage: 161.68 GB (173602762163) - RowsProduced: 78.13M (78127640) - TotalNetworkReceiveTime: 549.246ms - TotalNetworkSendTime: 8m50s - TotalStorageWaitTime: 15s762ms - TotalThreadsInvoluntaryContextSwitches: 21.88K (21883) - TotalThreadsTotalWallClockTime: 2h - TotalThreadsSysTime: 20s775ms - TotalThreadsUserTime: 2m48s - TotalThreadsVoluntaryContextSwitches: 1.49M (1493108) Fragment Instance Lifecycle Timings: - ExecTime: 9m17s - ExecTreeExecTime: 3s654ms - OpenTime: 1s106ms - ExecTreeOpenTime: 907.141ms - PrepareTime: 52.563ms - ExecTreePrepareTime: 6.523ms DataStreamSender (dst_id=22):(Total: 16s426ms, non-child: 16s426ms, % non-child: 100.00%) - BytesSent: 723.60 MB (758751641) - NetworkThroughput(*): 79.81 MB/sec - OverallThroughput: 44.05 MB/sec - PeakMemoryUsage: 5.00 MB (5240576) - RowsReturned: 78.13M (78127640) - SerializeBatchTime: 7s339ms - TransmitDataRPCTime: 9s066ms - UncompressedRowBatchSize: 2.18 GB (2344669792) CodeGen:(Total: 218.384ms, non-child: 218.384ms, % non-child: 100.00%) - CodegenTime: 1.257ms - CompileTime: 59.665ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 136.598ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 21.626ms HASH_JOIN_NODE (id=5):(Total: 4s529ms, non-child: 3s205ms, % non-child: 70.77%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.524ms - PeakMemoryUsage: 1.23 MB (1288789) - ProbeRows: 78.13M (78127640) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3s041ms - RowsReturned: 78.13M (78127640) - RowsReturnedRate: 17.25 M/sec Hash Join Builder (join_node_id=5): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 28.803us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 165.829us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 63.969us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 549.256ms, non-child: 20.841us, % non-child: 0.00%) BytesReceived(16s000ms): 963.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 4.396us - DeserializeRowBatchTimer: 30.347us - FirstBatchArrivalWaitTime: 504.463ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 218.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=3):(Total: 775.370ms, non-child: 775.370ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:221/12.82 GB 3:240/14.50 GB 1:219/13.17 GB 4:207/12.35 GB 6:238/13.81 GB 2:224/13.45 GB 5:223/13.17 GB 0:227/12.39 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 118 out of 118 Runtime filters: Only following filters arrived: 6, waited 241ms Hdfs Read Thread Concurrency Bucket: 0:99.1% 1:0.8115% 2:0.09017% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1681 PARQUET/SNAPPY:118 BytesRead(16s000ms): 13.75 MB, 14.67 MB, 14.67 MB, 19.80 MB, 28.74 MB, 28.98 MB, 37.96 MB, 43.25 MB, 43.83 MB, 54.59 MB, 57.77 MB, 58.48 MB, 70.64 MB, 72.06 MB, 74.70 MB, 86.45 MB, 86.60 MB, 92.97 MB, 101.27 MB, 101.53 MB, 108.35 MB, 115.83 MB, 115.83 MB, 116.63 MB, 128.83 MB, 130.51 MB, 130.51 MB, 131.07 MB, 133.51 MB, 141.24 MB, 142.59 MB, 142.59 MB, 142.59 MB, 142.59 MB - FooterProcessingTime: (Avg: 64.741ms ; Min: 23.324ms ; Max: 318.060ms ; Number of samples: 118) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 11.98 - BytesRead: 142.59 MB (149521506) - BytesReadDataNodeCache: 0 - BytesReadLocal: 142.59 MB (149521506) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 142.59 MB (149521506) - DecompressionTime: 1s485ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 118 (118) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 29.32 MB (30742362) - PerReadThreadRawHdfsThroughput: 19.85 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 110.320ms - RowBatchQueuePutWaitTime: 1h48m - RowsRead: 78.27M (78269530) - RowsReturned: 78.13M (78127640) - RowsReturnedRate: 100.76 M/sec - ScanRangesComplete: 1.80K (1799) - ScannerThreadsInvoluntaryContextSwitches: 16.93K (16928) - ScannerThreadsTotalWallClockTime: 1h51m - MaterializeTupleTime(*): 5s869ms - ScannerThreadsSysTime: 20s132ms - ScannerThreadsUserTime: 2m25s - ScannerThreadsVoluntaryContextSwitches: 1.49M (1489982) - TotalRawHdfsReadTime(*): 7s183ms - TotalReadThroughput: 263.33 KB/sec Filter 2 (16.00 MB): - Rows processed: 2.05M (2047554) - Rows rejected: 141.87K (141866) - Rows total: 78.27M (78269530) Filter 5 (16.00 MB): - Rows processed: 1.82M (1823768) - Rows rejected: 24 (24) - Rows total: 78.13M (78127664) Filter 6 (1.00 MB): - Files processed: 1.80K (1799) - Files rejected: 1.68K (1681) - Files total: 1.80K (1799) - RowGroups processed: 76.27K (76272) - RowGroups rejected: 0 (0) - RowGroups total: 76.27K (76272) - Rows processed: 1.93M (1933312) - Rows rejected: 0 (0) - Rows total: 78.13M (78127640) - Splits processed: 118 (118) - Splits rejected: 0 (0) - Splits total: 118 (118) Instance 7f40dcb034de70b7:8a (host=ve1140.foo:22000):(Total: 9m18s, non-child: 8m56s, % non-child: 96.13%) Hdfs split stats (:<# splits>/): 1:255/15.20 GB 2:224/13.75 GB 5:215/12.93 GB 6:217/12.81 GB 3:222/12.41 GB 7:210/11.50 GB 0:237/13.70 GB 4:237/13.39 GB Filter 6 arrival: 1s091ms Filter 2 arrival: 11s404ms Filter 5 arrival: 15s837ms MemoryUsage(16s000ms): 34.69 MB, 65.93 MB, 66.84 MB, 65.88 MB, 65.80 MB, 65.82 MB, 66.57 MB, 66.76 MB, 66.60 MB, 66.79 MB, 66.89 MB, 66.55 MB, 66.80 MB, 66.83 MB, 66.65 MB, 66.80 MB, 66.76 MB, 66.64 MB, 66.78 MB, 66.66 MB, 66.85 MB, 66.68 MB, 66.80 MB, 66.50 MB, 66.79 MB, 66.78 MB, 66.78 MB, 66.75 MB, 66.00 MB, 63.80 MB, 61.45 MB, 60.18 MB, 60.22 MB, 57.43 MB ThreadUsage(16s000ms): 12, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.79 - BloomFilterBytes: 33.00 MB (34603008) - PeakMemoryUsage: 67.44 MB (70713069) - PerHostPeakMemUsage: 161.69 GB (173615250840) - RowsProduced: 77.65M (77645207) - TotalNetworkReceiveTime: 835.665ms - TotalNetworkSendTime: 8m40s - TotalStorageWaitTime: 12s900ms - TotalThreadsInvoluntaryContextSwitches: 31.28K (31280) - TotalThreadsTotalWallClockTime: 1h58m - TotalThreadsSysTime: 1m35s - TotalThreadsUserTime: 2m51s - TotalThreadsVoluntaryContextSwitches: 8.12M (8118941) Fragment Instance Lifecycle Timings: - ExecTime: 9m17s - ExecTreeExecTime: 3s682ms - OpenTime: 1s215ms - ExecTreeOpenTime: 1s017ms - PrepareTime: 63.302ms - ExecTreePrepareTime: 7.678ms DataStreamSender (dst_id=22):(Total: 16s710ms, non-child: 16s710ms, % non-child: 100.00%) - BytesSent: 719.38 MB (754329710) - NetworkThroughput(*): 76.95 MB/sec - OverallThroughput: 43.05 MB/sec - PeakMemoryUsage: 4.98 MB (5224192) - RowsReturned: 77.65M (77645207) - SerializeBatchTime: 7s341ms - TransmitDataRPCTime: 9s348ms - UncompressedRowBatchSize: 2.17 GB (2330191634) CodeGen:(Total: 223.368ms, non-child: 223.368ms, % non-child: 100.00%) - CodegenTime: 1.232ms - CompileTime: 57.432ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 138.570ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 26.820ms HASH_JOIN_NODE (id=5):(Total: 4s669ms, non-child: 3s239ms, % non-child: 69.38%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.716ms - PeakMemoryUsage: 1.24 MB (1298114) - ProbeRows: 77.65M (77645207) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3s081ms - RowsReturned: 77.65M (77645207) - RowsReturnedRate: 16.63 M/sec Hash Join Builder (join_node_id=5): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 26.879us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 216.190us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 64.805us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 835.676ms, non-child: 20.270us, % non-child: 0.00%) BytesReceived(16s000ms): 932.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 4.979us - DeserializeRowBatchTimer: 22.552us - FirstBatchArrivalWaitTime: 808.185ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 143.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=3):(Total: 594.414ms, non-child: 594.414ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:255/15.20 GB 2:224/13.75 GB 5:215/12.93 GB 6:217/12.81 GB 3:222/12.41 GB 7:210/11.50 GB 0:237/13.70 GB 4:237/13.39 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 118 out of 118 Runtime filters: Only following filters arrived: 6, waited 40ms Hdfs Read Thread Concurrency Bucket: 0:98.81% 1:1.097% 2:0% 3:0.09141% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1699 PARQUET/SNAPPY:118 BytesRead(16s000ms): 12.45 MB, 14.44 MB, 15.00 MB, 22.15 MB, 29.25 MB, 29.87 MB, 40.28 MB, 43.98 MB, 47.21 MB, 58.28 MB, 58.92 MB, 63.87 MB, 73.05 MB, 73.96 MB, 83.12 MB, 88.04 MB, 88.77 MB, 100.22 MB, 102.49 MB, 103.93 MB, 115.09 MB, 116.95 MB, 117.26 MB, 120.08 MB, 130.14 MB, 131.15 MB, 131.63 MB, 132.51 MB, 139.87 MB, 142.31 MB, 142.31 MB, 142.31 MB, 142.31 MB, 142.31 MB - FooterProcessingTime: (Avg: 59.912ms ; Min: 27.737ms ; Max: 176.702ms ; Number of samples: 118) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 11.99 - BytesRead: 142.31 MB (149226078) - BytesReadDataNodeCache: 0 - BytesReadLocal: 142.31 MB (149226078) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 142.31 MB (149226078) - DecompressionTime: 507.398ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 118 (118) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 29.23 MB (30646871) - PerReadThreadRawHdfsThroughput: 20.84 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 133.639ms - RowBatchQueuePutWaitTime: 1h45m - RowsRead: 77.78M (77783646) - RowsReturned: 77.65M (77645207) - RowsReturnedRate: 130.62 M/sec - ScanRangesComplete: 1.82K (1817) - ScannerThreadsInvoluntaryContextSwitches: 26.27K (26269) - ScannerThreadsTotalWallClockTime: 1h49m - MaterializeTupleTime(*): 6s451ms - ScannerThreadsSysTime: 1m34s - ScannerThreadsUserTime: 2m27s - ScannerThreadsVoluntaryContextSwitches: 8.12M (8115788) - TotalRawHdfsReadTime(*): 6s830ms - TotalReadThroughput: 266.17 KB/sec Filter 2 (16.00 MB): - Rows processed: 2.00M (2000071) - Rows rejected: 138.39K (138394) - Rows total: 77.78M (77783646) Filter 5 (16.00 MB): - Rows processed: 1.86M (1861677) - Rows rejected: 45 (45) - Rows total: 77.65M (77645252) Filter 6 (1.00 MB): - Files processed: 1.82K (1817) - Files rejected: 1.70K (1699) - Files total: 1.82K (1817) - RowGroups processed: 75.80K (75795) - RowGroups rejected: 0 (0) - RowGroups total: 75.80K (75795) - Rows processed: 1.93M (1933312) - Rows rejected: 0 (0) - Rows total: 77.65M (77645207) - Splits processed: 118 (118) - Splits rejected: 0 (0) - Splits total: 118 (118) Instance 7f40dcb034de70b7:b7 (host=vc1509.foo:22000):(Total: 9m18s, non-child: 8m56s, % non-child: 96.10%) Hdfs split stats (:<# splits>/): 0:232/13.18 GB 4:240/14.63 GB 5:226/13.09 GB 2:229/12.46 GB 3:213/12.57 GB 1:228/13.43 GB 6:227/13.56 GB 7:216/12.81 GB Filter 6 arrival: 946ms Filter 2 arrival: 12s734ms Filter 5 arrival: 16s391ms MemoryUsage(16s000ms): 36.15 MB, 66.80 MB, 66.83 MB, 66.27 MB, 65.82 MB, 65.79 MB, 65.45 MB, 65.79 MB, 65.67 MB, 64.67 MB, 64.84 MB, 64.73 MB, 66.78 MB, 66.76 MB, 65.76 MB, 64.74 MB, 64.82 MB, 65.20 MB, 66.64 MB, 66.72 MB, 66.33 MB, 65.79 MB, 65.75 MB, 65.70 MB, 65.80 MB, 66.68 MB, 66.75 MB, 66.77 MB, 66.85 MB, 66.91 MB, 64.81 MB, 62.26 MB, 62.24 MB, 62.38 MB ThreadUsage(16s000ms): 12, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.97 - BloomFilterBytes: 33.00 MB (34603008) - PeakMemoryUsage: 67.54 MB (70820233) - PerHostPeakMemUsage: 161.66 GB (173582071668) - RowsProduced: 78.31M (78308882) - TotalNetworkReceiveTime: 726.216ms - TotalNetworkSendTime: 8m49s - TotalStorageWaitTime: 12s262ms - TotalThreadsInvoluntaryContextSwitches: 19.03K (19033) - TotalThreadsTotalWallClockTime: 2h - TotalThreadsSysTime: 31s982ms - TotalThreadsUserTime: 2m8s - TotalThreadsVoluntaryContextSwitches: 4.45M (4445576) Fragment Instance Lifecycle Timings: - ExecTime: 9m17s - ExecTreeExecTime: 3s724ms - OpenTime: 1s131ms - ExecTreeOpenTime: 951.956ms - PrepareTime: 44.075ms - ExecTreePrepareTime: 5.956ms DataStreamSender (dst_id=22):(Total: 16s956ms, non-child: 16s956ms, % non-child: 100.00%) - BytesSent: 722.66 MB (757768875) - NetworkThroughput(*): 76.59 MB/sec - OverallThroughput: 42.62 MB/sec - PeakMemoryUsage: 4.83 MB (5060352) - RowsReturned: 78.31M (78308882) - SerializeBatchTime: 7s500ms - TransmitDataRPCTime: 9s436ms - UncompressedRowBatchSize: 2.19 GB (2350109044) CodeGen:(Total: 197.141ms, non-child: 197.141ms, % non-child: 100.00%) - CodegenTime: 957.684us - CompileTime: 55.663ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 122.739ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 18.354ms HASH_JOIN_NODE (id=5):(Total: 4s642ms, non-child: 3s228ms, % non-child: 69.55%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.504ms - PeakMemoryUsage: 1.23 MB (1291683) - ProbeRows: 78.31M (78308882) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3s055ms - RowsReturned: 78.31M (78308882) - RowsReturnedRate: 16.87 M/sec Hash Join Builder (join_node_id=5): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 38.619us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 158.160us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 52.084us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 726.226ms, non-child: 17.629us, % non-child: 0.00%) BytesReceived(16s000ms): 963.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 4.804us - DeserializeRowBatchTimer: 33.360us - FirstBatchArrivalWaitTime: 681.737ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 165.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=3):(Total: 687.938ms, non-child: 687.938ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:232/13.18 GB 4:240/14.63 GB 5:226/13.09 GB 2:229/12.46 GB 3:213/12.57 GB 1:228/13.43 GB 6:227/13.56 GB 7:216/12.81 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 118 out of 118 Runtime filters: Only following filters arrived: 6, waited 80ms Hdfs Read Thread Concurrency Bucket: 0:98.83% 1:1.084% 2:0.09033% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1693 PARQUET/SNAPPY:118 BytesRead(16s000ms): 13.55 MB, 14.45 MB, 14.53 MB, 20.08 MB, 28.98 MB, 29.58 MB, 39.75 MB, 43.31 MB, 45.23 MB, 57.37 MB, 57.60 MB, 59.38 MB, 71.65 MB, 71.89 MB, 76.28 MB, 86.25 MB, 86.36 MB, 93.02 MB, 100.77 MB, 101.06 MB, 108.15 MB, 115.38 MB, 115.38 MB, 116.04 MB, 124.26 MB, 129.70 MB, 129.70 MB, 129.86 MB, 130.96 MB, 133.46 MB, 140.73 MB, 141.81 MB, 141.81 MB, 141.81 MB - FooterProcessingTime: (Avg: 57.588ms ; Min: 23.732ms ; Max: 196.713ms ; Number of samples: 118) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 11.98 - BytesRead: 141.81 MB (148701154) - BytesReadDataNodeCache: 0 - BytesReadLocal: 141.81 MB (148701154) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 141.81 MB (148701154) - DecompressionTime: 1s261ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 118 (118) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 29.36 MB (30787471) - PerReadThreadRawHdfsThroughput: 22.41 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 138.870ms - RowBatchQueuePutWaitTime: 1h48m - RowsRead: 78.45M (78446936) - RowsReturned: 78.31M (78308882) - RowsReturnedRate: 113.83 M/sec - ScanRangesComplete: 1.81K (1811) - ScannerThreadsInvoluntaryContextSwitches: 13.85K (13847) - ScannerThreadsTotalWallClockTime: 1h51m - MaterializeTupleTime(*): 6s438ms - ScannerThreadsSysTime: 31s210ms - ScannerThreadsUserTime: 1m44s - ScannerThreadsVoluntaryContextSwitches: 4.44M (4442310) - TotalRawHdfsReadTime(*): 6s328ms - TotalReadThroughput: 262.36 KB/sec Filter 2 (16.00 MB): - Rows processed: 2.03M (2028358) - Rows rejected: 137.99K (137992) - Rows total: 78.45M (78446936) Filter 5 (16.00 MB): - Rows processed: 1.79M (1791038) - Rows rejected: 62 (62) - Rows total: 78.31M (78308944) Filter 6 (1.00 MB): - Files processed: 1.81K (1811) - Files rejected: 1.69K (1693) - Files total: 1.81K (1811) - RowGroups processed: 76.45K (76447) - RowGroups rejected: 0 (0) - RowGroups total: 76.45K (76447) - Rows processed: 1.93M (1933312) - Rows rejected: 0 (0) - Rows total: 78.31M (78308882) - Splits processed: 118 (118) - Splits rejected: 0 (0) - Splits total: 118 (118) Instance 7f40dcb034de70b7:8f (host=vd1112.foo:22000):(Total: 9m18s, non-child: 8m55s, % non-child: 95.98%) Hdfs split stats (:<# splits>/): 5:245/15.09 GB 0:237/14.21 GB 1:232/12.54 GB 6:234/13.55 GB 2:213/12.14 GB 4:218/12.82 GB 7:238/13.07 GB 3:212/12.23 GB Filter 6 arrival: 1s106ms Filter 2 arrival: 11s560ms Filter 5 arrival: 15s855ms MemoryUsage(16s000ms): 35.59 MB, 66.79 MB, 66.75 MB, 66.58 MB, 66.82 MB, 66.77 MB, 66.78 MB, 66.78 MB, 66.67 MB, 66.53 MB, 66.84 MB, 66.55 MB, 66.69 MB, 66.78 MB, 66.27 MB, 64.80 MB, 64.75 MB, 65.88 MB, 66.78 MB, 66.71 MB, 66.77 MB, 66.72 MB, 66.83 MB, 66.67 MB, 65.71 MB, 65.80 MB, 65.82 MB, 65.48 MB, 65.64 MB, 67.02 MB, 66.81 MB, 66.75 MB, 66.88 MB, 66.77 MB ThreadUsage(16s000ms): 11, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.97 - BloomFilterBytes: 33.00 MB (34603008) - PeakMemoryUsage: 67.54 MB (70822304) - PerHostPeakMemUsage: 161.66 GB (173576484277) - RowsProduced: 80.07M (80074397) - TotalNetworkReceiveTime: 861.097ms - TotalNetworkSendTime: 8m49s - TotalStorageWaitTime: 14s379ms - TotalThreadsInvoluntaryContextSwitches: 6.52K (6523) - TotalThreadsTotalWallClockTime: 2h - TotalThreadsSysTime: 2s951ms - TotalThreadsUserTime: 34s209ms - TotalThreadsVoluntaryContextSwitches: 130.76K (130764) Fragment Instance Lifecycle Timings: - ExecTime: 9m16s - ExecTreeExecTime: 3s807ms - OpenTime: 1s251ms - ExecTreeOpenTime: 1s060ms - PrepareTime: 58.821ms - ExecTreePrepareTime: 7.406ms DataStreamSender (dst_id=22):(Total: 17s368ms, non-child: 17s368ms, % non-child: 100.00%) - BytesSent: 740.71 MB (776686909) - NetworkThroughput(*): 76.37 MB/sec - OverallThroughput: 42.65 MB/sec - PeakMemoryUsage: 5.02 MB (5265152) - RowsReturned: 80.07M (80074397) - SerializeBatchTime: 7s647ms - TransmitDataRPCTime: 9s699ms - UncompressedRowBatchSize: 2.24 GB (2403093478) CodeGen:(Total: 214.398ms, non-child: 214.398ms, % non-child: 100.00%) - CodegenTime: 1.273ms - CompileTime: 57.595ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 132.592ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 23.698ms HASH_JOIN_NODE (id=5):(Total: 4s834ms, non-child: 3s343ms, % non-child: 69.15%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.459ms - PeakMemoryUsage: 1.23 MB (1291773) - ProbeRows: 80.07M (80074397) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3s175ms - RowsReturned: 80.07M (80074397) - RowsReturnedRate: 16.56 M/sec Hash Join Builder (join_node_id=5): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 23.504us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 133.197us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 48.676us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 861.107ms, non-child: 20.292us, % non-child: 0.00%) BytesReceived(16s000ms): 901.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 4.256us - DeserializeRowBatchTimer: 15.794us - FirstBatchArrivalWaitTime: 818.927ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 139.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=3):(Total: 631.199ms, non-child: 631.199ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:245/15.09 GB 0:237/14.21 GB 1:232/12.54 GB 6:234/13.55 GB 2:213/12.14 GB 4:218/12.82 GB 7:238/13.07 GB 3:212/12.23 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 121 out of 121 Runtime filters: Only following filters arrived: 6, waited 40ms Hdfs Read Thread Concurrency Bucket: 0:98.83% 1:0.9892% 2:0.1799% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1708 PARQUET/SNAPPY:121 BytesRead(16s000ms): 13.03 MB, 14.38 MB, 15.24 MB, 20.29 MB, 29.03 MB, 30.18 MB, 39.21 MB, 43.72 MB, 44.73 MB, 57.04 MB, 58.28 MB, 61.19 MB, 72.12 MB, 73.07 MB, 77.81 MB, 86.67 MB, 87.78 MB, 97.93 MB, 101.23 MB, 102.48 MB, 113.94 MB, 115.58 MB, 116.74 MB, 121.08 MB, 129.62 MB, 129.78 MB, 130.95 MB, 131.96 MB, 140.60 MB, 143.34 MB, 144.23 MB, 144.23 MB, 144.65 MB, 145.36 MB - FooterProcessingTime: (Avg: 70.750ms ; Min: 4.682ms ; Max: 868.634ms ; Number of samples: 121) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 11.98 - BytesRead: 145.36 MB (152418900) - BytesReadDataNodeCache: 0 - BytesReadLocal: 145.36 MB (152418900) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 145.36 MB (152418900) - DecompressionTime: 645.969ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 121 (121) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 29.29 MB (30708986) - PerReadThreadRawHdfsThroughput: 23.95 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 153.044ms - RowBatchQueuePutWaitTime: 1h50m - RowsRead: 80.22M (80220489) - RowsReturned: 80.07M (80074397) - RowsReturnedRate: 126.86 M/sec - ScanRangesComplete: 1.83K (1829) - ScannerThreadsInvoluntaryContextSwitches: 1.42K (1422) - ScannerThreadsTotalWallClockTime: 1h51m - MaterializeTupleTime(*): 6s715ms - ScannerThreadsSysTime: 2s270ms - ScannerThreadsUserTime: 9s594ms - ScannerThreadsVoluntaryContextSwitches: 127.61K (127615) - TotalRawHdfsReadTime(*): 6s068ms - TotalReadThroughput: 267.47 KB/sec Filter 2 (16.00 MB): - Rows processed: 2.09M (2087596) - Rows rejected: 146.08K (146079) - Rows total: 80.22M (80220489) Filter 5 (16.00 MB): - Rows processed: 1.92M (1915917) - Rows rejected: 13 (13) - Rows total: 80.07M (80074410) Filter 6 (1.00 MB): - Files processed: 1.83K (1829) - Files rejected: 1.71K (1708) - Files total: 1.83K (1829) - RowGroups processed: 78.16K (78162) - RowGroups rejected: 0 (0) - RowGroups total: 78.16K (78162) - Rows processed: 1.98M (1982464) - Rows rejected: 0 (0) - Rows total: 80.07M (80074397) - Splits processed: 121 (121) - Splits rejected: 0 (0) - Splits total: 121 (121) Instance 7f40dcb034de70b7:8c (host=vd1328.foo:22000):(Total: 9m18s, non-child: 8m55s, % non-child: 95.95%) Hdfs split stats (:<# splits>/): 5:208/11.90 GB 1:224/13.52 GB 0:220/12.31 GB 4:227/13.73 GB 2:233/13.84 GB 7:236/13.98 GB 3:222/13.21 GB 6:240/13.17 GB Filter 6 arrival: 1s083ms Filter 2 arrival: 11s460ms Filter 5 arrival: 15s867ms MemoryUsage(16s000ms): 36.18 MB, 66.72 MB, 66.78 MB, 66.67 MB, 66.82 MB, 66.74 MB, 66.52 MB, 66.72 MB, 66.72 MB, 66.62 MB, 66.76 MB, 66.48 MB, 66.78 MB, 66.73 MB, 66.75 MB, 66.82 MB, 66.75 MB, 66.58 MB, 66.80 MB, 66.73 MB, 66.50 MB, 66.61 MB, 66.88 MB, 66.76 MB, 66.45 MB, 66.90 MB, 66.77 MB, 66.80 MB, 66.68 MB, 66.74 MB, 66.23 MB, 62.31 MB, 62.36 MB, 62.33 MB ThreadUsage(16s000ms): 11, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.96 - BloomFilterBytes: 33.00 MB (34603008) - PeakMemoryUsage: 67.48 MB (70754090) - PerHostPeakMemUsage: 161.69 GB (173614677967) - RowsProduced: 78.24M (78235644) - TotalNetworkReceiveTime: 847.520ms - TotalNetworkSendTime: 8m48s - TotalStorageWaitTime: 13s285ms - TotalThreadsInvoluntaryContextSwitches: 19.78K (19784) - TotalThreadsTotalWallClockTime: 2h - TotalThreadsSysTime: 22s862ms - TotalThreadsUserTime: 2m26s - TotalThreadsVoluntaryContextSwitches: 1.98M (1976853) Fragment Instance Lifecycle Timings: - ExecTime: 9m16s - ExecTreeExecTime: 3s919ms - OpenTime: 1s238ms - ExecTreeOpenTime: 1s048ms - PrepareTime: 51.466ms - ExecTreePrepareTime: 6.877ms DataStreamSender (dst_id=22):(Total: 17s489ms, non-child: 17s489ms, % non-child: 100.00%) - BytesSent: 726.20 MB (761472360) - NetworkThroughput(*): 76.36 MB/sec - OverallThroughput: 41.52 MB/sec - PeakMemoryUsage: 5.08 MB (5330688) - RowsReturned: 78.24M (78235644) - SerializeBatchTime: 7s957ms - TransmitDataRPCTime: 9s510ms - UncompressedRowBatchSize: 2.19 GB (2347911120) CodeGen:(Total: 204.708ms, non-child: 204.708ms, % non-child: 100.00%) - CodegenTime: 1.077ms - CompileTime: 55.750ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 132.407ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 16.069ms HASH_JOIN_NODE (id=5):(Total: 4s928ms, non-child: 3s419ms, % non-child: 69.38%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.597ms - PeakMemoryUsage: 1.23 MB (1293434) - ProbeRows: 78.24M (78235644) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3s241ms - RowsReturned: 78.24M (78235644) - RowsReturnedRate: 15.87 M/sec Hash Join Builder (join_node_id=5): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 36.027us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 146.968us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 58.757us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 847.533ms, non-child: 22.224us, % non-child: 0.00%) BytesReceived(16s000ms): 901.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 5.373us - DeserializeRowBatchTimer: 16.721us - FirstBatchArrivalWaitTime: 840.230ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 141.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=3):(Total: 662.134ms, non-child: 662.134ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:208/11.90 GB 1:224/13.52 GB 0:220/12.31 GB 4:227/13.73 GB 2:233/13.84 GB 7:236/13.98 GB 3:222/13.21 GB 6:240/13.17 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 118 out of 118 Runtime filters: Only following filters arrived: 6, waited 40ms Hdfs Read Thread Concurrency Bucket: 0:98.74% 1:1.262% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1692 PARQUET/SNAPPY:118 BytesRead(16s000ms): 13.26 MB, 14.63 MB, 15.25 MB, 22.66 MB, 29.53 MB, 31.40 MB, 41.72 MB, 44.30 MB, 48.02 MB, 58.61 MB, 59.05 MB, 63.74 MB, 73.64 MB, 74.23 MB, 79.73 MB, 88.34 MB, 89.00 MB, 95.49 MB, 103.04 MB, 104.09 MB, 108.50 MB, 116.90 MB, 117.77 MB, 119.56 MB, 122.93 MB, 131.47 MB, 132.47 MB, 133.15 MB, 136.00 MB, 136.28 MB, 140.43 MB, 144.53 MB, 144.53 MB, 144.53 MB - FooterProcessingTime: (Avg: 62.520ms ; Min: 4.260ms ; Max: 202.847ms ; Number of samples: 118) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 11.97 - BytesRead: 144.53 MB (151550723) - BytesReadDataNodeCache: 0 - BytesReadLocal: 144.53 MB (151550723) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 144.53 MB (151550723) - DecompressionTime: 2s093ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 118 (118) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 29.31 MB (30735352) - PerReadThreadRawHdfsThroughput: 21.34 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 152.976ms - RowBatchQueuePutWaitTime: 1h48m - RowsRead: 78.37M (78374714) - RowsReturned: 78.24M (78235644) - RowsReturnedRate: 118.16 M/sec - ScanRangesComplete: 1.81K (1810) - ScannerThreadsInvoluntaryContextSwitches: 14.54K (14543) - ScannerThreadsTotalWallClockTime: 1h51m - MaterializeTupleTime(*): 6s691ms - ScannerThreadsSysTime: 22s038ms - ScannerThreadsUserTime: 2m - ScannerThreadsVoluntaryContextSwitches: 1.97M (1973752) - TotalRawHdfsReadTime(*): 6s773ms - TotalReadThroughput: 266.66 KB/sec Filter 2 (16.00 MB): - Rows processed: 1.99M (1991472) - Rows rejected: 139.02K (139018) - Rows total: 78.37M (78374714) Filter 5 (16.00 MB): - Rows processed: 1.86M (1862708) - Rows rejected: 52 (52) - Rows total: 78.24M (78235696) Filter 6 (1.00 MB): - Files processed: 1.81K (1810) - Files rejected: 1.69K (1692) - Files total: 1.81K (1810) - RowGroups processed: 76.38K (76379) - RowGroups rejected: 0 (0) - RowGroups total: 76.38K (76379) - Rows processed: 1.93M (1933312) - Rows rejected: 0 (0) - Rows total: 78.24M (78235644) - Splits processed: 118 (118) - Splits rejected: 0 (0) - Splits total: 118 (118) Instance 7f40dcb034de70b7:d7 (host=va1036.foo:22000):(Total: 9m18s, non-child: 8m56s, % non-child: 96.06%) Hdfs split stats (:<# splits>/): 1:231/12.88 GB 4:227/13.31 GB 2:240/14.03 GB 7:193/11.57 GB 0:241/14.11 GB 6:229/13.86 GB 3:238/13.98 GB 5:215/11.97 GB Filter 6 arrival: 772ms Filter 2 arrival: 13s132ms Filter 5 arrival: 16s677ms MemoryUsage(16s000ms): 32.52 MB, 63.24 MB, 63.70 MB, 64.62 MB, 65.80 MB, 65.76 MB, 65.12 MB, 65.78 MB, 65.62 MB, 65.58 MB, 65.80 MB, 65.36 MB, 65.79 MB, 65.79 MB, 66.11 MB, 66.81 MB, 66.79 MB, 66.62 MB, 66.84 MB, 66.89 MB, 65.94 MB, 65.71 MB, 65.79 MB, 65.21 MB, 65.34 MB, 65.79 MB, 65.83 MB, 65.82 MB, 65.71 MB, 65.26 MB, 64.89 MB, 64.80 MB, 64.82 MB, 65.15 MB ThreadUsage(16s000ms): 12, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.97 - BloomFilterBytes: 33.00 MB (34603008) - PeakMemoryUsage: 67.48 MB (70753727) - PerHostPeakMemUsage: 161.66 GB (173580156863) - RowsProduced: 80.29M (80285075) - TotalNetworkReceiveTime: 543.955ms - TotalNetworkSendTime: 8m51s - TotalStorageWaitTime: 14s669ms - TotalThreadsInvoluntaryContextSwitches: 7.84K (7839) - TotalThreadsTotalWallClockTime: 2h - TotalThreadsSysTime: 4s361ms - TotalThreadsUserTime: 36s383ms - TotalThreadsVoluntaryContextSwitches: 168.82K (168824) Fragment Instance Lifecycle Timings: - ExecTime: 9m17s - ExecTreeExecTime: 4s016ms - OpenTime: 1s109ms - ExecTreeOpenTime: 921.331ms - PrepareTime: 45.128ms - ExecTreePrepareTime: 7.335ms DataStreamSender (dst_id=22):(Total: 16s851ms, non-child: 16s851ms, % non-child: 100.00%) - BytesSent: 742.40 MB (778465623) - NetworkThroughput(*): 79.29 MB/sec - OverallThroughput: 44.06 MB/sec - PeakMemoryUsage: 4.90 MB (5134080) - RowsReturned: 80.29M (80285075) - SerializeBatchTime: 7s470ms - TransmitDataRPCTime: 9s362ms - UncompressedRowBatchSize: 2.24 GB (2409416098) CodeGen:(Total: 202.657ms, non-child: 202.657ms, % non-child: 100.00%) - CodegenTime: 1.111ms - CompileTime: 54.653ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 131.379ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 16.201ms HASH_JOIN_NODE (id=5):(Total: 4s914ms, non-child: 3s586ms, % non-child: 72.97%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.846ms - PeakMemoryUsage: 1.24 MB (1298142) - ProbeRows: 80.29M (80285075) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3s446ms - RowsReturned: 80.29M (80285075) - RowsReturnedRate: 16.34 M/sec Hash Join Builder (join_node_id=5): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 25.623us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 296.736us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 67.265us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 543.967ms, non-child: 19.678us, % non-child: 0.00%) BytesReceived(16s000ms): 963.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 5.510us - DeserializeRowBatchTimer: 25.983us - FirstBatchArrivalWaitTime: 520.479ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 220.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=3):(Total: 785.137ms, non-child: 785.137ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:231/12.88 GB 4:227/13.31 GB 2:240/14.03 GB 7:193/11.57 GB 0:241/14.11 GB 6:229/13.86 GB 3:238/13.98 GB 5:215/11.97 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 121 out of 121 Runtime filters: Only following filters arrived: 6, waited 262ms Hdfs Read Thread Concurrency Bucket: 0:99.28% 1:0.6318% 2:0.09025% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1693 PARQUET/SNAPPY:121 BytesRead(16s000ms): 13.12 MB, 14.00 MB, 14.03 MB, 20.27 MB, 28.33 MB, 28.75 MB, 38.91 MB, 42.51 MB, 43.55 MB, 56.05 MB, 56.99 MB, 59.20 MB, 71.14 MB, 71.45 MB, 75.56 MB, 85.99 MB, 86.22 MB, 93.81 MB, 100.66 MB, 100.92 MB, 109.65 MB, 115.10 MB, 115.10 MB, 116.02 MB, 126.36 MB, 129.78 MB, 129.78 MB, 130.77 MB, 135.59 MB, 137.83 MB, 144.04 MB, 144.04 MB, 144.04 MB, 144.50 MB - FooterProcessingTime: (Avg: 70.259ms ; Min: 21.822ms ; Max: 1s153ms ; Number of samples: 121) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 11.98 - BytesRead: 145.27 MB (152324013) - BytesReadDataNodeCache: 0 - BytesReadLocal: 145.27 MB (152324013) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 145.27 MB (152324013) - DecompressionTime: 1s016ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 121 (121) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 29.47 MB (30897739) - PerReadThreadRawHdfsThroughput: 20.98 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 108.234ms - RowBatchQueuePutWaitTime: 1h50m - RowsRead: 80.43M (80432036) - RowsReturned: 80.29M (80285075) - RowsReturnedRate: 102.26 M/sec - ScanRangesComplete: 1.81K (1814) - ScannerThreadsInvoluntaryContextSwitches: 2.87K (2865) - ScannerThreadsTotalWallClockTime: 1h51m - MaterializeTupleTime(*): 6s442ms - ScannerThreadsSysTime: 3s682ms - ScannerThreadsUserTime: 12s760ms - ScannerThreadsVoluntaryContextSwitches: 165.62K (165623) - TotalRawHdfsReadTime(*): 6s925ms - TotalReadThroughput: 268.51 KB/sec Filter 2 (16.00 MB): - Rows processed: 2.11M (2105862) - Rows rejected: 146.92K (146919) - Rows total: 80.43M (80432036) Filter 5 (16.00 MB): - Rows processed: 1.94M (1937450) - Rows rejected: 42 (42) - Rows total: 80.29M (80285117) Filter 6 (1.00 MB): - Files processed: 1.81K (1814) - Files rejected: 1.69K (1693) - Files total: 1.81K (1814) - RowGroups processed: 78.37K (78373) - RowGroups rejected: 0 (0) - RowGroups total: 78.37K (78373) - Rows processed: 1.98M (1982464) - Rows rejected: 0 (0) - Rows total: 80.29M (80285075) - Splits processed: 121 (121) - Splits rejected: 0 (0) - Splits total: 121 (121) Instance 7f40dcb034de70b7:81 (host=vc1537.foo:22000):(Total: 9m18s, non-child: 8m54s, % non-child: 95.77%) Hdfs split stats (:<# splits>/): 2:213/12.34 GB 4:230/13.61 GB 3:224/13.42 GB 0:233/13.50 GB 7:244/13.88 GB 6:238/13.10 GB 5:207/11.97 GB 1:234/13.85 GB Filter 6 arrival: 1s142ms Filter 2 arrival: 11s124ms Filter 5 arrival: 15s709ms MemoryUsage(16s000ms): 34.50 MB, 64.76 MB, 64.84 MB, 65.05 MB, 66.82 MB, 66.81 MB, 66.56 MB, 66.82 MB, 66.72 MB, 66.23 MB, 66.81 MB, 66.40 MB, 66.82 MB, 66.79 MB, 66.71 MB, 66.74 MB, 66.80 MB, 66.47 MB, 65.78 MB, 65.73 MB, 65.32 MB, 66.78 MB, 66.72 MB, 66.60 MB, 66.01 MB, 66.82 MB, 66.75 MB, 66.88 MB, 66.66 MB, 66.48 MB, 63.61 MB, 62.57 MB, 62.36 MB, 62.60 MB ThreadUsage(16s000ms): 12, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.97 - BloomFilterBytes: 33.00 MB (34603008) - PeakMemoryUsage: 67.71 MB (70994150) - PerHostPeakMemUsage: 161.69 GB (173612444150) - RowsProduced: 78.88M (78883651) - TotalNetworkReceiveTime: 901.021ms - TotalNetworkSendTime: 8m48s - TotalStorageWaitTime: 14s710ms - TotalThreadsInvoluntaryContextSwitches: 17.33K (17326) - TotalThreadsTotalWallClockTime: 2h - TotalThreadsSysTime: 3s501ms - TotalThreadsUserTime: 1m51s - TotalThreadsVoluntaryContextSwitches: 193.94K (193945) Fragment Instance Lifecycle Timings: - ExecTime: 9m16s - ExecTreeExecTime: 4s300ms - OpenTime: 1s335ms - ExecTreeOpenTime: 1s147ms - PrepareTime: 59.934ms - ExecTreePrepareTime: 7.104ms DataStreamSender (dst_id=22):(Total: 17s973ms, non-child: 17s973ms, % non-child: 100.00%) - BytesSent: 729.16 MB (764574455) - NetworkThroughput(*): 71.75 MB/sec - OverallThroughput: 40.57 MB/sec - PeakMemoryUsage: 4.91 MB (5150464) - RowsReturned: 78.88M (78883651) - SerializeBatchTime: 7s789ms - TransmitDataRPCTime: 10s162ms - UncompressedRowBatchSize: 2.20 GB (2367358330) CodeGen:(Total: 209.807ms, non-child: 209.807ms, % non-child: 100.00%) - CodegenTime: 1.187ms - CompileTime: 55.437ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 130.928ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 22.992ms HASH_JOIN_NODE (id=5):(Total: 5s413ms, non-child: 3s471ms, % non-child: 64.12%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 2.214ms - PeakMemoryUsage: 1.24 MB (1295466) - ProbeRows: 78.88M (78883651) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3s320ms - RowsReturned: 78.88M (78883651) - RowsReturnedRate: 14.57 M/sec Hash Join Builder (join_node_id=5): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 66.778us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 432.688us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 62.495us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 901.031ms, non-child: 19.099us, % non-child: 0.00%) BytesReceived(16s000ms): 932.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 4.162us - DeserializeRowBatchTimer: 44.659us - FirstBatchArrivalWaitTime: 867.399ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 133.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=3):(Total: 1s041ms, non-child: 1s041ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:213/12.34 GB 4:230/13.61 GB 3:224/13.42 GB 0:233/13.50 GB 7:244/13.88 GB 6:238/13.10 GB 5:207/11.97 GB 1:234/13.85 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 119 out of 119 Runtime filters: Only following filters arrived: 6, waited 41ms Hdfs Read Thread Concurrency Bucket: 0:99.01% 1:0.991% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1704 PARQUET/SNAPPY:119 BytesRead(16s000ms): 12.83 MB, 14.16 MB, 14.16 MB, 19.35 MB, 28.69 MB, 29.00 MB, 38.52 MB, 43.11 MB, 44.07 MB, 55.34 MB, 57.74 MB, 58.92 MB, 71.62 MB, 72.57 MB, 74.44 MB, 86.25 MB, 86.66 MB, 92.11 MB, 100.91 MB, 101.17 MB, 108.35 MB, 115.29 MB, 115.29 MB, 116.81 MB, 127.92 MB, 129.92 MB, 129.92 MB, 131.23 MB, 132.49 MB, 136.65 MB, 142.74 MB, 142.74 MB, 142.74 MB, 142.74 MB - FooterProcessingTime: (Avg: 70.217ms ; Min: 13.358ms ; Max: 581.702ms ; Number of samples: 119) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 11.98 - BytesRead: 142.74 MB (149674322) - BytesReadDataNodeCache: 0 - BytesReadLocal: 142.74 MB (149674322) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 142.74 MB (149674322) - DecompressionTime: 3s604ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 119 (119) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 29.54 MB (30969959) - PerReadThreadRawHdfsThroughput: 21.88 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 199.228ms - RowBatchQueuePutWaitTime: 1h49m - RowsRead: 79.03M (79029268) - RowsReturned: 78.88M (78883651) - RowsReturnedRate: 75.72 M/sec - ScanRangesComplete: 1.82K (1823) - ScannerThreadsInvoluntaryContextSwitches: 12.26K (12263) - ScannerThreadsTotalWallClockTime: 1h51m - MaterializeTupleTime(*): 7s414ms - ScannerThreadsSysTime: 2s813ms - ScannerThreadsUserTime: 1m26s - ScannerThreadsVoluntaryContextSwitches: 190.79K (190790) - TotalRawHdfsReadTime(*): 6s524ms - TotalReadThroughput: 263.12 KB/sec Filter 2 (16.00 MB): - Rows processed: 2.06M (2055377) - Rows rejected: 145.59K (145589) - Rows total: 79.03M (79029268) Filter 5 (16.00 MB): - Rows processed: 1.91M (1909788) - Rows rejected: 28 (28) - Rows total: 78.88M (78883679) Filter 6 (1.00 MB): - Files processed: 1.82K (1823) - Files rejected: 1.70K (1704) - Files total: 1.82K (1823) - RowGroups processed: 77.01K (77012) - RowGroups rejected: 0 (0) - RowGroups total: 77.01K (77012) - Rows processed: 1.95M (1949696) - Rows rejected: 0 (0) - Rows total: 78.88M (78883651) - Splits processed: 119 (119) - Splits rejected: 0 (0) - Splits total: 119 (119) Instance 7f40dcb034de70b7:7a (host=vd1103.foo:22000):(Total: 9m18s, non-child: 8m56s, % non-child: 96.09%) Hdfs split stats (:<# splits>/): 4:245/13.28 GB 1:236/13.43 GB 6:211/11.63 GB 0:229/14.25 GB 3:225/13.47 GB 7:206/11.91 GB 2:254/15.49 GB 5:213/12.21 GB Filter 6 arrival: 1s210ms Filter 2 arrival: 11s036ms Filter 5 arrival: 15s665ms MemoryUsage(16s000ms): 36.36 MB, 65.74 MB, 65.75 MB, 65.90 MB, 66.78 MB, 66.81 MB, 66.41 MB, 66.35 MB, 65.49 MB, 65.75 MB, 66.57 MB, 66.63 MB, 65.83 MB, 65.82 MB, 65.78 MB, 66.80 MB, 66.65 MB, 66.50 MB, 66.86 MB, 66.76 MB, 65.79 MB, 65.71 MB, 64.82 MB, 65.21 MB, 65.76 MB, 65.66 MB, 66.80 MB, 66.78 MB, 66.42 MB, 66.13 MB, 64.50 MB, 64.45 MB, 62.49 MB, 61.70 MB ThreadUsage(16s000ms): 12, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.90 - BloomFilterBytes: 33.00 MB (34603008) - PeakMemoryUsage: 67.42 MB (70700219) - PerHostPeakMemUsage: 161.68 GB (173597548591) - RowsProduced: 78.85M (78852098) - TotalNetworkReceiveTime: 982.035ms - TotalNetworkSendTime: 8m43s - TotalStorageWaitTime: 17s799ms - TotalThreadsInvoluntaryContextSwitches: 19.86K (19861) - TotalThreadsTotalWallClockTime: 1h59m - TotalThreadsSysTime: 20s407ms - TotalThreadsUserTime: 2m24s - TotalThreadsVoluntaryContextSwitches: 1.73M (1727350) Fragment Instance Lifecycle Timings: - ExecTime: 9m16s - ExecTreeExecTime: 3s880ms - OpenTime: 1s339ms - ExecTreeOpenTime: 1s154ms - PrepareTime: 47.910ms - ExecTreePrepareTime: 6.675ms DataStreamSender (dst_id=22):(Total: 16s596ms, non-child: 16s596ms, % non-child: 100.00%) - BytesSent: 727.84 MB (763193112) - NetworkThroughput(*): 77.69 MB/sec - OverallThroughput: 43.86 MB/sec - PeakMemoryUsage: 4.79 MB (5027584) - RowsReturned: 78.85M (78852098) - SerializeBatchTime: 7s209ms - TransmitDataRPCTime: 9s367ms - UncompressedRowBatchSize: 2.20 GB (2366411308) CodeGen:(Total: 202.147ms, non-child: 202.147ms, % non-child: 100.00%) - CodegenTime: 978.567us - CompileTime: 55.985ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 126.585ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 19.115ms HASH_JOIN_NODE (id=5):(Total: 5s008ms, non-child: 3s429ms, % non-child: 68.46%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.307ms - PeakMemoryUsage: 1.24 MB (1298005) - ProbeRows: 78.85M (78852098) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3s296ms - RowsReturned: 78.85M (78852098) - RowsReturnedRate: 15.74 M/sec Hash Join Builder (join_node_id=5): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 21.854us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 125.256us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 41.084us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 982.044ms, non-child: 16.769us, % non-child: 0.00%) BytesReceived(16s000ms): 932.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 4.728us - DeserializeRowBatchTimer: 18.790us - FirstBatchArrivalWaitTime: 948.443ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 122.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=3):(Total: 598.092ms, non-child: 598.092ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:245/13.28 GB 1:236/13.43 GB 6:211/11.63 GB 0:229/14.25 GB 3:225/13.47 GB 7:206/11.91 GB 2:254/15.49 GB 5:213/12.21 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 119 out of 119 Runtime filters: Only following filters arrived: 6, waited 40ms Hdfs Read Thread Concurrency Bucket: 0:98.64% 1:1.178% 2:0.1812% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1700 PARQUET/SNAPPY:119 BytesRead(16s000ms): 12.84 MB, 14.15 MB, 15.01 MB, 20.34 MB, 28.77 MB, 29.92 MB, 39.25 MB, 43.55 MB, 46.00 MB, 57.38 MB, 58.34 MB, 62.18 MB, 71.49 MB, 72.54 MB, 78.78 MB, 86.01 MB, 87.34 MB, 97.88 MB, 100.56 MB, 102.21 MB, 112.17 MB, 114.31 MB, 115.36 MB, 118.40 MB, 127.82 MB, 128.49 MB, 129.59 MB, 131.03 MB, 136.39 MB, 139.93 MB, 141.53 MB, 141.53 MB, 141.53 MB, 141.53 MB - FooterProcessingTime: (Avg: 87.315ms ; Min: 25.994ms ; Max: 2s815ms ; Number of samples: 119) - AverageHdfsReadThreadConcurrency: 0.02 - AverageScannerThreadConcurrency: 11.98 - BytesRead: 141.53 MB (148409587) - BytesReadDataNodeCache: 0 - BytesReadLocal: 141.53 MB (148409587) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 141.53 MB (148409587) - DecompressionTime: 1s050ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 119 (119) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 29.26 MB (30685852) - PerReadThreadRawHdfsThroughput: 17.53 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 127.078ms - RowBatchQueuePutWaitTime: 1h47m - RowsRead: 78.99M (78989909) - RowsReturned: 78.85M (78852098) - RowsReturnedRate: 131.84 M/sec - ScanRangesComplete: 1.82K (1819) - ScannerThreadsInvoluntaryContextSwitches: 14.95K (14947) - ScannerThreadsTotalWallClockTime: 1h50m - MaterializeTupleTime(*): 8s456ms - ScannerThreadsSysTime: 19s723ms - ScannerThreadsUserTime: 2m1s - ScannerThreadsVoluntaryContextSwitches: 1.72M (1724212) - TotalRawHdfsReadTime(*): 8s075ms - TotalReadThroughput: 262.56 KB/sec Filter 2 (16.00 MB): - Rows processed: 2.00M (2001491) - Rows rejected: 137.78K (137783) - Rows total: 78.99M (78989909) Filter 5 (16.00 MB): - Rows processed: 1.86M (1863708) - Rows rejected: 28 (28) - Rows total: 78.85M (78852126) Filter 6 (1.00 MB): - Files processed: 1.82K (1819) - Files rejected: 1.70K (1700) - Files total: 1.82K (1819) - RowGroups processed: 76.97K (76975) - RowGroups rejected: 0 (0) - RowGroups total: 76.97K (76975) - Rows processed: 1.95M (1949696) - Rows rejected: 0 (0) - Rows total: 78.85M (78852098) - Splits processed: 119 (119) - Splits rejected: 0 (0) - Splits total: 119 (119) Instance 7f40dcb034de70b7:f1 (host=ve1141.foo:22000):(Total: 9m17s, non-child: 8m57s, % non-child: 96.24%) Hdfs split stats (:<# splits>/): 5:254/14.56 GB 0:229/13.80 GB 3:224/12.75 GB 4:217/12.08 GB 7:232/12.69 GB 1:210/12.16 GB 6:226/13.82 GB 2:236/13.82 GB Filter 6 arrival: 691ms Filter 2 arrival: 13s549ms Filter 5 arrival: 16s987ms MemoryUsage(16s000ms): 33.39 MB, 65.81 MB, 66.83 MB, 66.50 MB, 66.77 MB, 66.87 MB, 66.63 MB, 66.80 MB, 66.75 MB, 66.53 MB, 66.82 MB, 66.62 MB, 66.67 MB, 66.82 MB, 66.66 MB, 66.73 MB, 66.67 MB, 66.55 MB, 66.87 MB, 66.76 MB, 66.68 MB, 66.83 MB, 66.82 MB, 66.46 MB, 66.48 MB, 66.77 MB, 66.80 MB, 66.75 MB, 65.93 MB, 65.86 MB, 63.90 MB, 63.66 MB, 63.55 MB, 63.63 MB ThreadUsage(16s000ms): 11, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.97 - BloomFilterBytes: 33.00 MB (34603008) - PeakMemoryUsage: 67.61 MB (70896219) - PerHostPeakMemUsage: 161.68 GB (173602285020) - RowsProduced: 78.85M (78849947) - TotalNetworkReceiveTime: 450.728ms - TotalNetworkSendTime: 8m51s - TotalStorageWaitTime: 13s106ms - TotalThreadsInvoluntaryContextSwitches: 15.47K (15469) - TotalThreadsTotalWallClockTime: 2h - TotalThreadsSysTime: 4s510ms - TotalThreadsUserTime: 1m43s - TotalThreadsVoluntaryContextSwitches: 475.15K (475154) Fragment Instance Lifecycle Timings: - ExecTime: 9m16s - ExecTreeExecTime: 3s616ms - OpenTime: 1s056ms - ExecTreeOpenTime: 872.918ms - PrepareTime: 63.935ms - ExecTreePrepareTime: 7.919ms DataStreamSender (dst_id=22):(Total: 16s326ms, non-child: 16s326ms, % non-child: 100.00%) - BytesSent: 733.04 MB (768647988) - NetworkThroughput(*): 76.44 MB/sec - OverallThroughput: 44.90 MB/sec - PeakMemoryUsage: 4.91 MB (5150464) - RowsReturned: 78.85M (78849947) - SerializeBatchTime: 6s718ms - TransmitDataRPCTime: 9s589ms - UncompressedRowBatchSize: 2.20 GB (2366346794) CodeGen:(Total: 206.606ms, non-child: 206.606ms, % non-child: 100.00%) - CodegenTime: 1.401ms - CompileTime: 53.456ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 128.026ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 24.687ms HASH_JOIN_NODE (id=5):(Total: 4s459ms, non-child: 3s172ms, % non-child: 71.14%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.574ms - PeakMemoryUsage: 1.24 MB (1298165) - ProbeRows: 78.85M (78849947) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3s012ms - RowsReturned: 78.85M (78849947) - RowsReturnedRate: 17.68 M/sec Hash Join Builder (join_node_id=5): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 26.017us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 164.641us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 59.158us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 450.739ms, non-child: 20.133us, % non-child: 0.00%) BytesReceived(16s000ms): 963.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 5.429us - DeserializeRowBatchTimer: 14.787us - FirstBatchArrivalWaitTime: 404.803ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 266.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=3):(Total: 836.765ms, non-child: 836.765ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:254/14.56 GB 0:229/13.80 GB 3:224/12.75 GB 4:217/12.08 GB 7:232/12.69 GB 1:210/12.16 GB 6:226/13.82 GB 2:236/13.82 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 119 out of 119 Runtime filters: Only following filters arrived: 6, waited 342ms Hdfs Read Thread Concurrency Bucket: 0:98.83% 1:0.9874% 2:0.08977% 3:0.08977% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1709 PARQUET/SNAPPY:119 BytesRead(16s000ms): 13.44 MB, 14.83 MB, 14.83 MB, 19.86 MB, 29.90 MB, 30.20 MB, 39.39 MB, 44.78 MB, 45.44 MB, 57.93 MB, 59.62 MB, 61.47 MB, 73.81 MB, 74.54 MB, 79.72 MB, 88.90 MB, 89.42 MB, 99.21 MB, 103.66 MB, 104.46 MB, 115.48 MB, 118.41 MB, 118.44 MB, 121.22 MB, 131.89 MB, 133.30 MB, 133.30 MB, 134.40 MB, 139.31 MB, 143.81 MB, 146.39 MB, 146.51 MB, 146.51 MB, 146.51 MB - FooterProcessingTime: (Avg: 54.937ms ; Min: 4.005ms ; Max: 236.823ms ; Number of samples: 119) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 11.98 - BytesRead: 146.51 MB (153626376) - BytesReadDataNodeCache: 0 - BytesReadLocal: 146.51 MB (153626376) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 146.51 MB (153626376) - DecompressionTime: 4s229ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 119 (119) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 29.46 MB (30886181) - PerReadThreadRawHdfsThroughput: 20.68 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 74.068ms - RowBatchQueuePutWaitTime: 1h49m - RowsRead: 78.99M (78993784) - RowsReturned: 78.85M (78849947) - RowsReturnedRate: 94.23 M/sec - ScanRangesComplete: 1.83K (1828) - ScannerThreadsInvoluntaryContextSwitches: 10.78K (10784) - ScannerThreadsTotalWallClockTime: 1h51m - MaterializeTupleTime(*): 6s589ms - ScannerThreadsSysTime: 3s774ms - ScannerThreadsUserTime: 1m23s - ScannerThreadsVoluntaryContextSwitches: 471.94K (471939) - TotalRawHdfsReadTime(*): 7s084ms - TotalReadThroughput: 269.10 KB/sec Filter 2 (16.00 MB): - Rows processed: 2.07M (2066909) - Rows rejected: 143.80K (143799) - Rows total: 78.99M (78993784) Filter 5 (16.00 MB): - Rows processed: 1.85M (1852454) - Rows rejected: 38 (38) - Rows total: 78.85M (78849985) Filter 6 (1.00 MB): - Files processed: 1.83K (1828) - Files rejected: 1.71K (1709) - Files total: 1.83K (1828) - RowGroups processed: 76.97K (76972) - RowGroups rejected: 0 (0) - RowGroups total: 76.97K (76972) - Rows processed: 1.95M (1949696) - Rows rejected: 0 (0) - Rows total: 78.85M (78849947) - Splits processed: 119 (119) - Splits rejected: 0 (0) - Splits total: 119 (119) Instance 7f40dcb034de70b7:72 (host=vc1505.foo:22000):(Total: 9m17s, non-child: 8m56s, % non-child: 96.11%) Hdfs split stats (:<# splits>/): 2:211/12.00 GB 6:226/12.60 GB 0:217/13.03 GB 4:239/14.17 GB 5:211/12.34 GB 7:231/13.48 GB 1:228/13.60 GB 3:245/14.44 GB Filter 6 arrival: 1s213ms Filter 2 arrival: 10s733ms Filter 5 arrival: 15s557ms MemoryUsage(16s000ms): 36.56 MB, 66.81 MB, 66.74 MB, 66.46 MB, 66.78 MB, 66.73 MB, 66.56 MB, 66.82 MB, 66.63 MB, 66.63 MB, 66.75 MB, 66.78 MB, 66.82 MB, 66.82 MB, 66.63 MB, 66.80 MB, 66.84 MB, 66.00 MB, 65.81 MB, 65.73 MB, 65.45 MB, 65.70 MB, 65.71 MB, 65.05 MB, 65.66 MB, 65.85 MB, 65.76 MB, 65.79 MB, 64.98 MB, 64.17 MB, 61.40 MB, 61.39 MB, 61.48 MB, 59.81 MB ThreadUsage(16s000ms): 11, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.88 - BloomFilterBytes: 33.00 MB (34603008) - PeakMemoryUsage: 67.50 MB (70774327) - PerHostPeakMemUsage: 161.67 GB (173588733744) - RowsProduced: 78.12M (78116527) - TotalNetworkReceiveTime: 969.517ms - TotalNetworkSendTime: 8m49s - TotalStorageWaitTime: 13s827ms - TotalThreadsInvoluntaryContextSwitches: 24.53K (24532) - TotalThreadsTotalWallClockTime: 1h59m - TotalThreadsSysTime: 38s672ms - TotalThreadsUserTime: 2m54s - TotalThreadsVoluntaryContextSwitches: 4.34M (4344176) Fragment Instance Lifecycle Timings: - ExecTime: 9m16s - ExecTreeExecTime: 4s045ms - OpenTime: 1s346ms - ExecTreeOpenTime: 1s156ms - PrepareTime: 58.460ms - ExecTreePrepareTime: 6.880ms DataStreamSender (dst_id=22):(Total: 16s300ms, non-child: 16s300ms, % non-child: 100.00%) - BytesSent: 721.13 MB (756159051) - NetworkThroughput(*): 77.88 MB/sec - OverallThroughput: 44.24 MB/sec - PeakMemoryUsage: 4.95 MB (5191424) - RowsReturned: 78.12M (78116527) - SerializeBatchTime: 7s020ms - TransmitDataRPCTime: 9s259ms - UncompressedRowBatchSize: 2.18 GB (2344336322) CodeGen:(Total: 213.938ms, non-child: 213.938ms, % non-child: 100.00%) - CodegenTime: 995.406us - CompileTime: 54.052ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 134.029ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 25.399ms HASH_JOIN_NODE (id=5):(Total: 5s170ms, non-child: 3s590ms, % non-child: 69.44%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 2.147ms - PeakMemoryUsage: 1.23 MB (1293484) - ProbeRows: 78.12M (78116527) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3s438ms - RowsReturned: 78.12M (78116527) - RowsReturnedRate: 15.11 M/sec Hash Join Builder (join_node_id=5): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 25.626us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 220.339us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 57.220us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 969.530ms, non-child: 21.227us, % non-child: 0.00%) BytesReceived(16s000ms): 932.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 6.578us - DeserializeRowBatchTimer: 15.686us - FirstBatchArrivalWaitTime: 935.474ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 123.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=3):(Total: 611.010ms, non-child: 611.010ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:211/12.00 GB 6:226/12.60 GB 0:217/13.03 GB 4:239/14.17 GB 5:211/12.34 GB 7:231/13.48 GB 1:228/13.60 GB 3:245/14.44 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 118 out of 118 Runtime filters: Only following filters arrived: 6, waited 40ms Hdfs Read Thread Concurrency Bucket: 0:98.46% 1:1.36% 2:0.1813% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1690 PARQUET/SNAPPY:118 BytesRead(16s000ms): 13.27 MB, 14.72 MB, 15.00 MB, 21.05 MB, 29.42 MB, 29.97 MB, 39.58 MB, 43.92 MB, 45.17 MB, 57.42 MB, 58.16 MB, 62.81 MB, 72.75 MB, 73.13 MB, 78.79 MB, 87.17 MB, 87.85 MB, 97.37 MB, 101.37 MB, 102.23 MB, 112.18 MB, 115.68 MB, 115.98 MB, 118.76 MB, 129.99 MB, 130.37 MB, 130.72 MB, 131.97 MB, 135.60 MB, 141.45 MB, 142.28 MB, 142.28 MB, 142.28 MB, 142.28 MB - FooterProcessingTime: (Avg: 62.100ms ; Min: 23.489ms ; Max: 419.081ms ; Number of samples: 118) - AverageHdfsReadThreadConcurrency: 0.02 - AverageScannerThreadConcurrency: 11.98 - BytesRead: 142.28 MB (149196094) - BytesReadDataNodeCache: 0 - BytesReadLocal: 142.28 MB (149196094) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 142.28 MB (149196094) - DecompressionTime: 750.474ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 118 (118) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 29.38 MB (30807480) - PerReadThreadRawHdfsThroughput: 19.73 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 138.570ms - RowBatchQueuePutWaitTime: 1h47m - RowsRead: 78.25M (78254670) - RowsReturned: 78.12M (78116527) - RowsReturnedRate: 127.85 M/sec - ScanRangesComplete: 1.81K (1808) - ScannerThreadsInvoluntaryContextSwitches: 19.75K (19745) - ScannerThreadsTotalWallClockTime: 1h50m - MaterializeTupleTime(*): 6s301ms - ScannerThreadsSysTime: 37s957ms - ScannerThreadsUserTime: 2m32s - ScannerThreadsVoluntaryContextSwitches: 4.34M (4341054) - TotalRawHdfsReadTime(*): 7s211ms - TotalReadThroughput: 263.95 KB/sec Filter 2 (16.00 MB): - Rows processed: 2.02M (2015135) - Rows rejected: 138.13K (138131) - Rows total: 78.25M (78254670) Filter 5 (16.00 MB): - Rows processed: 1.88M (1877004) - Rows rejected: 12 (12) - Rows total: 78.12M (78116539) Filter 6 (1.00 MB): - Files processed: 1.81K (1808) - Files rejected: 1.69K (1690) - Files total: 1.81K (1808) - RowGroups processed: 76.27K (76267) - RowGroups rejected: 0 (0) - RowGroups total: 76.27K (76267) - Rows processed: 1.93M (1933312) - Rows rejected: 0 (0) - Rows total: 78.12M (78116527) - Splits processed: 118 (118) - Splits rejected: 0 (0) - Splits total: 118 (118) Instance 7f40dcb034de70b7:71 (host=vd1136.foo:22000):(Total: 9m17s, non-child: 8m56s, % non-child: 96.09%) Hdfs split stats (:<# splits>/): 0:220/12.57 GB 4:212/12.93 GB 5:217/12.39 GB 6:228/13.45 GB 7:250/14.82 GB 2:218/12.67 GB 1:244/13.70 GB 3:226/13.13 GB Filter 6 arrival: 1s188ms Filter 2 arrival: 10s745ms Filter 5 arrival: 15s558ms MemoryUsage(16s000ms): 38.53 MB, 66.76 MB, 66.78 MB, 66.24 MB, 65.80 MB, 65.48 MB, 65.26 MB, 65.74 MB, 65.91 MB, 65.79 MB, 65.80 MB, 65.94 MB, 66.82 MB, 66.16 MB, 65.30 MB, 64.76 MB, 65.71 MB, 66.65 MB, 66.79 MB, 66.59 MB, 65.06 MB, 66.78 MB, 66.74 MB, 66.81 MB, 66.72 MB, 66.77 MB, 66.85 MB, 66.61 MB, 66.18 MB, 64.85 MB, 63.80 MB, 62.41 MB, 62.43 MB, 59.79 MB ThreadUsage(16s000ms): 12, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.89 - BloomFilterBytes: 33.00 MB (34603008) - PeakMemoryUsage: 67.37 MB (70646084) - PerHostPeakMemUsage: 161.66 GB (173585049342) - RowsProduced: 78.37M (78372807) - TotalNetworkReceiveTime: 943.470ms - TotalNetworkSendTime: 8m47s - TotalStorageWaitTime: 12s946ms - TotalThreadsInvoluntaryContextSwitches: 23.17K (23169) - TotalThreadsTotalWallClockTime: 1h59m - TotalThreadsSysTime: 48s817ms - TotalThreadsUserTime: 2m25s - TotalThreadsVoluntaryContextSwitches: 4.90M (4902792) Fragment Instance Lifecycle Timings: - ExecTime: 9m16s - ExecTreeExecTime: 3s754ms - OpenTime: 1s294ms - ExecTreeOpenTime: 1s101ms - PrepareTime: 55.304ms - ExecTreePrepareTime: 6.580ms DataStreamSender (dst_id=22):(Total: 16s803ms, non-child: 16s803ms, % non-child: 100.00%) - BytesSent: 724.32 MB (759509014) - NetworkThroughput(*): 77.92 MB/sec - OverallThroughput: 43.11 MB/sec - PeakMemoryUsage: 4.96 MB (5199616) - RowsReturned: 78.37M (78372807) - SerializeBatchTime: 7s486ms - TransmitDataRPCTime: 9s295ms - UncompressedRowBatchSize: 2.19 GB (2352027474) CodeGen:(Total: 215.491ms, non-child: 215.491ms, % non-child: 100.00%) - CodegenTime: 997.301us - CompileTime: 55.677ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 136.466ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 22.856ms HASH_JOIN_NODE (id=5):(Total: 4s823ms, non-child: 3s291ms, % non-child: 68.23%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.324ms - PeakMemoryUsage: 1.24 MB (1297014) - ProbeRows: 78.37M (78372807) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3s125ms - RowsReturned: 78.37M (78372807) - RowsReturnedRate: 16.25 M/sec Hash Join Builder (join_node_id=5): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 29.365us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 107.243us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 59.667us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 943.481ms, non-child: 21.052us, % non-child: 0.00%) BytesReceived(16s000ms): 932.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 5.106us - DeserializeRowBatchTimer: 25.940us - FirstBatchArrivalWaitTime: 928.111ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 127.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=3):(Total: 589.668ms, non-child: 589.668ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:220/12.57 GB 4:212/12.93 GB 5:217/12.39 GB 6:228/13.45 GB 7:250/14.82 GB 2:218/12.67 GB 1:244/13.70 GB 3:226/13.13 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 119 out of 119 Runtime filters: Only following filters arrived: 6, waited 41ms Hdfs Read Thread Concurrency Bucket: 0:99.09% 1:0.8167% 2:0% 3:0% 4:0.09074% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1696 PARQUET/SNAPPY:119 BytesRead(16s000ms): 13.36 MB, 14.51 MB, 15.12 MB, 21.66 MB, 28.79 MB, 29.84 MB, 40.30 MB, 43.24 MB, 46.24 MB, 57.38 MB, 57.85 MB, 63.83 MB, 71.78 MB, 72.53 MB, 80.92 MB, 86.41 MB, 88.52 MB, 100.28 MB, 101.14 MB, 102.91 MB, 114.09 MB, 116.01 MB, 116.55 MB, 119.85 MB, 129.54 MB, 130.61 MB, 130.93 MB, 132.32 MB, 137.95 MB, 142.89 MB, 142.89 MB, 142.89 MB, 142.89 MB, 142.89 MB - FooterProcessingTime: (Avg: 56.182ms ; Min: 3.954ms ; Max: 175.533ms ; Number of samples: 119) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 11.97 - BytesRead: 142.89 MB (149831017) - BytesReadDataNodeCache: 0 - BytesReadLocal: 142.89 MB (149831017) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 142.89 MB (149831017) - DecompressionTime: 1s035ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 119 (119) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 29.19 MB (30611572) - PerReadThreadRawHdfsThroughput: 20.60 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 109.320ms - RowBatchQueuePutWaitTime: 1h47m - RowsRead: 78.52M (78515495) - RowsReturned: 78.37M (78372807) - RowsReturnedRate: 132.91 M/sec - ScanRangesComplete: 1.81K (1815) - ScannerThreadsInvoluntaryContextSwitches: 18.15K (18148) - ScannerThreadsTotalWallClockTime: 1h50m - MaterializeTupleTime(*): 6s550ms - ScannerThreadsSysTime: 48s087ms - ScannerThreadsUserTime: 2m1s - ScannerThreadsVoluntaryContextSwitches: 4.90M (4899723) - TotalRawHdfsReadTime(*): 6s937ms - TotalReadThroughput: 265.55 KB/sec Filter 2 (16.00 MB): - Rows processed: 2.03M (2029920) - Rows rejected: 142.62K (142625) - Rows total: 78.52M (78515495) Filter 5 (16.00 MB): - Rows processed: 1.89M (1887295) - Rows rejected: 63 (63) - Rows total: 78.37M (78372870) Filter 6 (1.00 MB): - Files processed: 1.81K (1815) - Files rejected: 1.70K (1696) - Files total: 1.81K (1815) - RowGroups processed: 76.51K (76508) - RowGroups rejected: 0 (0) - RowGroups total: 76.51K (76508) - Rows processed: 1.95M (1949696) - Rows rejected: 0 (0) - Rows total: 78.37M (78372807) - Splits processed: 119 (119) - Splits rejected: 0 (0) - Splits total: 119 (119) Instance 7f40dcb034de70b7:7b (host=vc1507.foo:22000):(Total: 9m17s, non-child: 8m55s, % non-child: 96.00%) Hdfs split stats (:<# splits>/): 4:246/13.77 GB 1:216/12.67 GB 3:218/12.68 GB 0:205/11.46 GB 6:230/13.65 GB 2:215/12.33 GB 7:238/13.85 GB 5:246/15.24 GB Filter 6 arrival: 1s209ms Filter 2 arrival: 11s040ms Filter 5 arrival: 15s651ms MemoryUsage(16s000ms): 35.97 MB, 66.80 MB, 66.82 MB, 66.84 MB, 66.77 MB, 66.78 MB, 66.64 MB, 66.82 MB, 66.70 MB, 66.61 MB, 66.81 MB, 66.72 MB, 65.68 MB, 65.82 MB, 65.47 MB, 65.77 MB, 65.74 MB, 65.06 MB, 64.78 MB, 64.67 MB, 65.11 MB, 65.78 MB, 65.84 MB, 65.77 MB, 65.95 MB, 66.83 MB, 66.78 MB, 66.69 MB, 66.65 MB, 64.90 MB, 65.03 MB, 57.87 MB, 57.95 MB, 57.84 MB ThreadUsage(16s000ms): 11, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.88 - BloomFilterBytes: 33.00 MB (34603008) - PeakMemoryUsage: 67.51 MB (70788973) - PerHostPeakMemUsage: 161.68 GB (173601312365) - RowsProduced: 76.90M (76897713) - TotalNetworkReceiveTime: 969.677ms - TotalNetworkSendTime: 8m48s - TotalStorageWaitTime: 16s101ms - TotalThreadsInvoluntaryContextSwitches: 31.57K (31575) - TotalThreadsTotalWallClockTime: 1h59m - TotalThreadsSysTime: 2m9s - TotalThreadsUserTime: 2m10s - TotalThreadsVoluntaryContextSwitches: 9.20M (9196290) Fragment Instance Lifecycle Timings: - ExecTime: 9m16s - ExecTreeExecTime: 3s840ms - OpenTime: 1s383ms - ExecTreeOpenTime: 1s193ms - PrepareTime: 54.883ms - ExecTreePrepareTime: 7.257ms DataStreamSender (dst_id=22):(Total: 17s086ms, non-child: 17s086ms, % non-child: 100.00%) - BytesSent: 710.55 MB (745068609) - NetworkThroughput(*): 73.99 MB/sec - OverallThroughput: 41.59 MB/sec - PeakMemoryUsage: 4.97 MB (5216000) - RowsReturned: 76.90M (76897713) - SerializeBatchTime: 7s462ms - TransmitDataRPCTime: 9s603ms - UncompressedRowBatchSize: 2.15 GB (2307758790) CodeGen:(Total: 207.927ms, non-child: 207.927ms, % non-child: 100.00%) - CodegenTime: 1.134ms - CompileTime: 56.683ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 130.842ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 19.945ms HASH_JOIN_NODE (id=5):(Total: 5s001ms, non-child: 3s320ms, % non-child: 66.39%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.356ms - PeakMemoryUsage: 1.24 MB (1297668) - ProbeRows: 76.90M (76897713) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3s179ms - RowsReturned: 76.90M (76897713) - RowsReturnedRate: 15.38 M/sec Hash Join Builder (join_node_id=5): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 29.909us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 127.930us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 76.544us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 969.688ms, non-child: 18.539us, % non-child: 0.00%) BytesReceived(16s000ms): 901.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 4.711us - DeserializeRowBatchTimer: 16.140us - FirstBatchArrivalWaitTime: 927.922ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 123.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=3):(Total: 711.814ms, non-child: 711.814ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:246/13.77 GB 1:216/12.67 GB 3:218/12.68 GB 0:205/11.46 GB 6:230/13.65 GB 2:215/12.33 GB 7:238/13.85 GB 5:246/15.24 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 116 out of 116 Runtime filters: Only following filters arrived: 6, waited 40ms Hdfs Read Thread Concurrency Bucket: 0:99.01% 1:0.8137% 2:0.09042% 3:0.09042% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1698 PARQUET/SNAPPY:116 BytesRead(16s000ms): 13.24 MB, 14.77 MB, 15.04 MB, 19.43 MB, 29.04 MB, 29.55 MB, 37.72 MB, 43.46 MB, 44.16 MB, 54.20 MB, 58.08 MB, 59.64 MB, 71.43 MB, 72.15 MB, 75.34 MB, 86.96 MB, 87.00 MB, 92.65 MB, 100.93 MB, 101.11 MB, 107.66 MB, 115.06 MB, 115.36 MB, 115.93 MB, 123.90 MB, 129.55 MB, 129.62 MB, 129.62 MB, 130.85 MB, 131.25 MB, 135.32 MB, 139.31 MB, 139.31 MB, 139.31 MB - FooterProcessingTime: (Avg: 86.056ms ; Min: 18.381ms ; Max: 2s838ms ; Number of samples: 116) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 11.98 - BytesRead: 139.31 MB (146074956) - BytesReadDataNodeCache: 0 - BytesReadLocal: 139.31 MB (146074956) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 139.31 MB (146074956) - DecompressionTime: 2s147ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 116 (116) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 29.34 MB (30763984) - PerReadThreadRawHdfsThroughput: 23.24 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 178.088ms - RowBatchQueuePutWaitTime: 1h46m - RowsRead: 77.04M (77038759) - RowsReturned: 76.90M (76897713) - RowsReturnedRate: 108.03 M/sec - ScanRangesComplete: 1.81K (1814) - ScannerThreadsInvoluntaryContextSwitches: 26.63K (26629) - ScannerThreadsTotalWallClockTime: 1h50m - MaterializeTupleTime(*): 6s671ms - ScannerThreadsSysTime: 2m8s - ScannerThreadsUserTime: 1m45s - ScannerThreadsVoluntaryContextSwitches: 9.19M (9193219) - TotalRawHdfsReadTime(*): 5s994ms - TotalReadThroughput: 257.73 KB/sec Filter 2 (16.00 MB): - Rows processed: 2.02M (2019062) - Rows rejected: 141.00K (140997) - Rows total: 77.04M (77038759) Filter 5 (16.00 MB): - Rows processed: 1.88M (1878065) - Rows rejected: 49 (49) - Rows total: 76.90M (76897762) Filter 6 (1.00 MB): - Files processed: 1.81K (1814) - Files rejected: 1.70K (1698) - Files total: 1.81K (1814) - RowGroups processed: 75.06K (75065) - RowGroups rejected: 0 (0) - RowGroups total: 75.06K (75065) - Rows processed: 1.90M (1900544) - Rows rejected: 0 (0) - Rows total: 76.90M (76897713) - Splits processed: 116 (116) - Splits rejected: 0 (0) - Splits total: 116 (116) Instance 7f40dcb034de70b7:74 (host=ve1125.foo:22000):(Total: 9m17s, non-child: 8m56s, % non-child: 96.08%) Hdfs split stats (:<# splits>/): 6:215/12.35 GB 3:234/13.27 GB 0:210/12.83 GB 1:230/13.14 GB 4:235/13.79 GB 5:216/12.07 GB 2:232/13.74 GB 7:247/14.49 GB Filter 6 arrival: 1s212ms Filter 2 arrival: 10s821ms Filter 5 arrival: 15s525ms MemoryUsage(16s000ms): 37.86 MB, 66.81 MB, 66.80 MB, 66.19 MB, 65.74 MB, 65.76 MB, 64.80 MB, 64.72 MB, 64.75 MB, 65.75 MB, 65.72 MB, 65.82 MB, 66.78 MB, 66.79 MB, 66.44 MB, 66.84 MB, 66.80 MB, 66.00 MB, 65.78 MB, 65.68 MB, 64.79 MB, 66.64 MB, 66.69 MB, 66.36 MB, 65.82 MB, 65.90 MB, 65.43 MB, 65.49 MB, 66.83 MB, 66.14 MB, 64.61 MB, 64.56 MB, 64.60 MB, 62.84 MB ThreadUsage(16s000ms): 12, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.90 - BloomFilterBytes: 33.00 MB (34603008) - PeakMemoryUsage: 67.47 MB (70752565) - PerHostPeakMemUsage: 161.68 GB (173604525209) - RowsProduced: 78.98M (78981533) - TotalNetworkReceiveTime: 975.583ms - TotalNetworkSendTime: 8m51s - TotalStorageWaitTime: 14s234ms - TotalThreadsInvoluntaryContextSwitches: 16.99K (16994) - TotalThreadsTotalWallClockTime: 1h59m - TotalThreadsSysTime: 19s973ms - TotalThreadsUserTime: 1m54s - TotalThreadsVoluntaryContextSwitches: 2.36M (2359480) Fragment Instance Lifecycle Timings: - ExecTime: 9m16s - ExecTreeExecTime: 3s732ms - OpenTime: 1s352ms - ExecTreeOpenTime: 1s160ms - PrepareTime: 47.908ms - ExecTreePrepareTime: 6.279ms DataStreamSender (dst_id=22):(Total: 16s814ms, non-child: 16s814ms, % non-child: 100.00%) - BytesSent: 732.84 MB (768438268) - NetworkThroughput(*): 75.81 MB/sec - OverallThroughput: 43.58 MB/sec - PeakMemoryUsage: 4.96 MB (5199616) - RowsReturned: 78.98M (78981533) - SerializeBatchTime: 7s129ms - TransmitDataRPCTime: 9s666ms - UncompressedRowBatchSize: 2.21 GB (2370295806) CodeGen:(Total: 208.936ms, non-child: 208.936ms, % non-child: 100.00%) - CodegenTime: 975.283us - CompileTime: 54.969ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 135.084ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 18.397ms HASH_JOIN_NODE (id=5):(Total: 4s857ms, non-child: 3s240ms, % non-child: 66.71%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.571ms - PeakMemoryUsage: 1.23 MB (1293408) - ProbeRows: 78.98M (78981533) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3s074ms - RowsReturned: 78.98M (78981533) - RowsReturnedRate: 16.26 M/sec Hash Join Builder (join_node_id=5): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 47.703us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 136.065us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 75.664us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 975.596ms, non-child: 21.577us, % non-child: 0.00%) BytesReceived(16s000ms): 932.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 5.663us - DeserializeRowBatchTimer: 13.321us - FirstBatchArrivalWaitTime: 935.770ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 123.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=3):(Total: 641.951ms, non-child: 641.951ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 6:215/12.35 GB 3:234/13.27 GB 0:210/12.83 GB 1:230/13.14 GB 4:235/13.79 GB 5:216/12.07 GB 2:232/13.74 GB 7:247/14.49 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 120 out of 120 Runtime filters: Only following filters arrived: 6, waited 40ms Hdfs Read Thread Concurrency Bucket: 0:98.64% 1:1.269% 2:0% 3:0% 4:0% 5:0.09066% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1699 PARQUET/SNAPPY:120 BytesRead(16s000ms): 13.28 MB, 14.50 MB, 14.94 MB, 20.68 MB, 29.18 MB, 29.91 MB, 39.06 MB, 43.65 MB, 45.63 MB, 57.76 MB, 58.41 MB, 61.70 MB, 72.67 MB, 73.28 MB, 79.17 MB, 87.52 MB, 88.28 MB, 99.83 MB, 102.14 MB, 103.92 MB, 115.20 MB, 117.06 MB, 117.67 MB, 125.76 MB, 131.52 MB, 131.89 MB, 132.55 MB, 138.17 MB, 145.38 MB, 145.50 MB, 145.50 MB, 145.50 MB, 145.50 MB, 145.50 MB - FooterProcessingTime: (Avg: 65.616ms ; Min: 5.240ms ; Max: 509.050ms ; Number of samples: 120) - AverageHdfsReadThreadConcurrency: 0.02 - AverageScannerThreadConcurrency: 11.98 - BytesRead: 145.50 MB (152568002) - BytesReadDataNodeCache: 0 - BytesReadLocal: 145.50 MB (152568002) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 145.50 MB (152568002) - DecompressionTime: 1s671ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 120 (120) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 29.31 MB (30733888) - PerReadThreadRawHdfsThroughput: 19.47 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 136.551ms - RowBatchQueuePutWaitTime: 1h48m - RowsRead: 79.12M (79121430) - RowsReturned: 78.98M (78981533) - RowsReturnedRate: 123.03 M/sec - ScanRangesComplete: 1.82K (1819) - ScannerThreadsInvoluntaryContextSwitches: 12.16K (12163) - ScannerThreadsTotalWallClockTime: 1h50m - MaterializeTupleTime(*): 7s009ms - ScannerThreadsSysTime: 19s236ms - ScannerThreadsUserTime: 1m32s - ScannerThreadsVoluntaryContextSwitches: 2.36M (2356296) - TotalRawHdfsReadTime(*): 7s472ms - TotalReadThroughput: 270.16 KB/sec Filter 2 (16.00 MB): - Rows processed: 2.06M (2056825) - Rows rejected: 139.86K (139858) - Rows total: 79.12M (79121430) Filter 5 (16.00 MB): - Rows processed: 1.92M (1916967) - Rows rejected: 39 (39) - Rows total: 78.98M (78981572) Filter 6 (1.00 MB): - Files processed: 1.82K (1819) - Files rejected: 1.70K (1699) - Files total: 1.82K (1819) - RowGroups processed: 77.10K (77096) - RowGroups rejected: 0 (0) - RowGroups total: 77.10K (77096) - Rows processed: 1.97M (1966080) - Rows rejected: 0 (0) - Rows total: 78.98M (78981533) - Splits processed: 120 (120) - Splits rejected: 0 (0) - Splits total: 120 (120) Instance 7f40dcb034de70b7:a2 (host=vc1503.foo:22000):(Total: 9m17s, non-child: 8m56s, % non-child: 96.10%) Hdfs split stats (:<# splits>/): 4:226/13.23 GB 7:237/13.41 GB 6:231/13.77 GB 1:251/15.02 GB 2:211/11.88 GB 5:215/12.17 GB 0:229/13.48 GB 3:228/12.71 GB Filter 6 arrival: 1s006ms Filter 2 arrival: 12s108ms Filter 5 arrival: 16s082ms MemoryUsage(16s000ms): 34.55 MB, 64.78 MB, 64.74 MB, 65.93 MB, 66.79 MB, 66.75 MB, 66.62 MB, 66.77 MB, 66.67 MB, 66.82 MB, 66.82 MB, 66.48 MB, 66.80 MB, 66.71 MB, 66.69 MB, 66.81 MB, 66.83 MB, 66.56 MB, 66.39 MB, 65.55 MB, 65.78 MB, 65.99 MB, 66.72 MB, 65.77 MB, 65.75 MB, 65.78 MB, 65.75 MB, 65.78 MB, 66.70 MB, 66.82 MB, 66.98 MB, 66.72 MB, 66.84 MB, 64.48 MB ThreadUsage(16s000ms): 12, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.98 - BloomFilterBytes: 33.00 MB (34603008) - PeakMemoryUsage: 67.52 MB (70795126) - PerHostPeakMemUsage: 161.67 GB (173587724808) - RowsProduced: 80.10M (80103382) - TotalNetworkReceiveTime: 782.904ms - TotalNetworkSendTime: 8m51s - TotalStorageWaitTime: 13s822ms - TotalThreadsInvoluntaryContextSwitches: 10.60K (10600) - TotalThreadsTotalWallClockTime: 2h - TotalThreadsSysTime: 11s352ms - TotalThreadsUserTime: 1m7s - TotalThreadsVoluntaryContextSwitches: 1.01M (1008466) Fragment Instance Lifecycle Timings: - ExecTime: 9m16s - ExecTreeExecTime: 3s764ms - OpenTime: 1s105ms - ExecTreeOpenTime: 927.404ms - PrepareTime: 48.789ms - ExecTreePrepareTime: 5.563ms DataStreamSender (dst_id=22):(Total: 16s921ms, non-child: 16s921ms, % non-child: 100.00%) - BytesSent: 742.03 MB (778071310) - NetworkThroughput(*): 78.00 MB/sec - OverallThroughput: 43.85 MB/sec - PeakMemoryUsage: 5.00 MB (5240576) - RowsReturned: 80.10M (80103382) - SerializeBatchTime: 7s387ms - TransmitDataRPCTime: 9s512ms - UncompressedRowBatchSize: 2.24 GB (2403963324) CodeGen:(Total: 199.466ms, non-child: 199.466ms, % non-child: 100.00%) - CodegenTime: 1.013ms - CompileTime: 55.436ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 120.929ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 22.716ms HASH_JOIN_NODE (id=5):(Total: 4s655ms, non-child: 3s277ms, % non-child: 70.41%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.529ms - PeakMemoryUsage: 1.23 MB (1294794) - ProbeRows: 80.10M (80103382) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3s105ms - RowsReturned: 80.10M (80103382) - RowsReturnedRate: 17.21 M/sec Hash Join Builder (join_node_id=5): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 27.163us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 159.913us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 55.410us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 782.916ms, non-child: 21.316us, % non-child: 0.00%) BytesReceived(16s000ms): 932.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 5.720us - DeserializeRowBatchTimer: 11.192us - FirstBatchArrivalWaitTime: 762.113ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 153.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=3):(Total: 595.015ms, non-child: 595.015ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:226/13.23 GB 7:237/13.41 GB 6:231/13.77 GB 1:251/15.02 GB 2:211/11.88 GB 5:215/12.17 GB 0:229/13.48 GB 3:228/12.71 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 121 out of 121 Runtime filters: Only following filters arrived: 6, waited 41ms Hdfs Read Thread Concurrency Bucket: 0:98.65% 1:1.26% 2:0.09001% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1707 PARQUET/SNAPPY:121 BytesRead(16s000ms): 13.27 MB, 14.15 MB, 15.40 MB, 22.44 MB, 28.68 MB, 31.03 MB, 41.16 MB, 44.02 MB, 48.13 MB, 58.23 MB, 59.07 MB, 64.61 MB, 72.90 MB, 74.89 MB, 82.97 MB, 87.97 MB, 90.80 MB, 101.49 MB, 102.97 MB, 108.15 MB, 116.69 MB, 116.83 MB, 118.55 MB, 126.29 MB, 130.91 MB, 131.23 MB, 133.19 MB, 137.76 MB, 145.47 MB, 145.47 MB, 145.47 MB, 145.55 MB, 146.73 MB, 146.73 MB - FooterProcessingTime: (Avg: 62.179ms ; Min: 16.694ms ; Max: 222.881ms ; Number of samples: 121) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 11.98 - BytesRead: 146.73 MB (153860473) - BytesReadDataNodeCache: 0 - BytesReadLocal: 146.73 MB (153860473) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 146.73 MB (153860473) - DecompressionTime: 565.391ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 121 (121) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 29.49 MB (30918391) - PerReadThreadRawHdfsThroughput: 20.07 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 97.211ms - RowBatchQueuePutWaitTime: 1h50m - RowsRead: 80.25M (80246071) - RowsReturned: 80.10M (80103382) - RowsReturnedRate: 134.62 M/sec - ScanRangesComplete: 1.83K (1828) - ScannerThreadsInvoluntaryContextSwitches: 5.58K (5585) - ScannerThreadsTotalWallClockTime: 1h51m - MaterializeTupleTime(*): 6s441ms - ScannerThreadsSysTime: 10s649ms - ScannerThreadsUserTime: 44s346ms - ScannerThreadsVoluntaryContextSwitches: 1.01M (1005297) - TotalRawHdfsReadTime(*): 7s312ms - TotalReadThroughput: 270.48 KB/sec Filter 2 (16.00 MB): - Rows processed: 2.06M (2061665) - Rows rejected: 142.68K (142681) - Rows total: 80.25M (80246071) Filter 5 (16.00 MB): - Rows processed: 1.88M (1883144) - Rows rejected: 8 (8) - Rows total: 80.10M (80103390) Filter 6 (1.00 MB): - Files processed: 1.83K (1828) - Files rejected: 1.71K (1707) - Files total: 1.83K (1828) - RowGroups processed: 78.20K (78198) - RowGroups rejected: 0 (0) - RowGroups total: 78.20K (78198) - Rows processed: 1.98M (1982464) - Rows rejected: 0 (0) - Rows total: 80.10M (80103382) - Splits processed: 121 (121) - Splits rejected: 0 (0) - Splits total: 121 (121) Instance 7f40dcb034de70b7:a3 (host=vc1536.foo:22000):(Total: 9m17s, non-child: 8m54s, % non-child: 95.83%) Hdfs split stats (:<# splits>/): 6:221/13.27 GB 0:221/13.66 GB 2:246/14.03 GB 3:220/12.64 GB 5:226/13.57 GB 4:242/14.14 GB 7:221/12.76 GB 1:212/11.60 GB Filter 6 arrival: 990ms Filter 2 arrival: 12s200ms Filter 5 arrival: 16s142ms MemoryUsage(16s000ms): 36.55 MB, 66.76 MB, 66.83 MB, 66.53 MB, 66.81 MB, 66.75 MB, 66.73 MB, 66.86 MB, 66.81 MB, 66.69 MB, 66.82 MB, 66.77 MB, 66.79 MB, 66.76 MB, 66.23 MB, 65.76 MB, 64.98 MB, 64.78 MB, 64.97 MB, 65.83 MB, 65.81 MB, 66.83 MB, 66.77 MB, 66.74 MB, 66.75 MB, 66.76 MB, 66.87 MB, 66.47 MB, 65.90 MB, 63.95 MB, 64.61 MB, 65.80 MB, 65.07 MB, 63.51 MB ThreadUsage(16s000ms): 12, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.98 - BloomFilterBytes: 33.00 MB (34603008) - PeakMemoryUsage: 67.42 MB (70698058) - PerHostPeakMemUsage: 161.67 GB (173591875861) - RowsProduced: 79.69M (79693600) - TotalNetworkReceiveTime: 751.140ms - TotalNetworkSendTime: 8m50s - TotalStorageWaitTime: 12s508ms - TotalThreadsInvoluntaryContextSwitches: 13.86K (13859) - TotalThreadsTotalWallClockTime: 2h - TotalThreadsSysTime: 4s980ms - TotalThreadsUserTime: 1m18s - TotalThreadsVoluntaryContextSwitches: 410.22K (410216) Fragment Instance Lifecycle Timings: - ExecTime: 9m16s - ExecTreeExecTime: 4s511ms - OpenTime: 1s123ms - ExecTreeOpenTime: 933.682ms - PrepareTime: 54.258ms - ExecTreePrepareTime: 7.231ms DataStreamSender (dst_id=22):(Total: 17s642ms, non-child: 17s642ms, % non-child: 100.00%) - BytesSent: 738.05 MB (773905210) - NetworkThroughput(*): 73.69 MB/sec - OverallThroughput: 41.83 MB/sec - PeakMemoryUsage: 4.90 MB (5134080) - RowsReturned: 79.69M (79693600) - SerializeBatchTime: 7s605ms - TransmitDataRPCTime: 10s015ms - UncompressedRowBatchSize: 2.23 GB (2391665480) CodeGen:(Total: 210.065ms, non-child: 210.065ms, % non-child: 100.00%) - CodegenTime: 1.121ms - CompileTime: 58.207ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 129.916ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 21.437ms HASH_JOIN_NODE (id=5):(Total: 5s409ms, non-child: 3s460ms, % non-child: 63.96%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.563ms - PeakMemoryUsage: 1.24 MB (1297700) - ProbeRows: 79.69M (79693600) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3s320ms - RowsReturned: 79.69M (79693600) - RowsReturnedRate: 14.73 M/sec Hash Join Builder (join_node_id=5): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 48.836us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 176.849us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 63.401us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 751.151ms, non-child: 21.085us, % non-child: 0.00%) BytesReceived(16s000ms): 932.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 4.808us - DeserializeRowBatchTimer: 19.828us - FirstBatchArrivalWaitTime: 741.977ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 159.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=3):(Total: 1s198ms, non-child: 1s198ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 6:221/13.27 GB 0:221/13.66 GB 2:246/14.03 GB 3:220/12.64 GB 5:226/13.57 GB 4:242/14.14 GB 7:221/12.76 GB 1:212/11.60 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 121 out of 121 Runtime filters: Only following filters arrived: 6, waited 40ms Hdfs Read Thread Concurrency Bucket: 0:99.01% 1:0.8086% 2:0.1797% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1688 PARQUET/SNAPPY:121 BytesRead(16s000ms): 13.37 MB, 14.48 MB, 15.33 MB, 21.43 MB, 29.18 MB, 30.76 MB, 39.81 MB, 44.10 MB, 45.97 MB, 57.22 MB, 58.80 MB, 60.90 MB, 72.93 MB, 73.96 MB, 78.65 MB, 87.86 MB, 88.86 MB, 96.02 MB, 102.25 MB, 103.68 MB, 112.09 MB, 116.67 MB, 117.67 MB, 120.40 MB, 130.24 MB, 131.57 MB, 132.78 MB, 134.62 MB, 139.14 MB, 144.31 MB, 145.69 MB, 146.51 MB, 146.51 MB, 146.51 MB - FooterProcessingTime: (Avg: 59.021ms ; Min: 20.738ms ; Max: 211.110ms ; Number of samples: 121) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 11.98 - BytesRead: 146.51 MB (153622091) - BytesReadDataNodeCache: 0 - BytesReadLocal: 146.51 MB (153622091) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 146.51 MB (153622091) - DecompressionTime: 1s596ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 121 (121) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 29.34 MB (30762306) - PerReadThreadRawHdfsThroughput: 23.87 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 136.230ms - RowBatchQueuePutWaitTime: 1h50m - RowsRead: 79.84M (79837217) - RowsReturned: 79.69M (79693600) - RowsReturnedRate: 66.48 M/sec - ScanRangesComplete: 1.81K (1809) - ScannerThreadsInvoluntaryContextSwitches: 8.78K (8777) - ScannerThreadsTotalWallClockTime: 1h51m - MaterializeTupleTime(*): 6s813ms - ScannerThreadsSysTime: 4s235ms - ScannerThreadsUserTime: 54s039ms - ScannerThreadsVoluntaryContextSwitches: 407.05K (407053) - TotalRawHdfsReadTime(*): 6s137ms - TotalReadThroughput: 269.58 KB/sec Filter 2 (16.00 MB): - Rows processed: 2.04M (2043137) - Rows rejected: 143.56K (143564) - Rows total: 79.84M (79837217) Filter 5 (16.00 MB): - Rows processed: 1.88M (1881141) - Rows rejected: 53 (53) - Rows total: 79.69M (79693653) Filter 6 (1.00 MB): - Files processed: 1.81K (1809) - Files rejected: 1.69K (1688) - Files total: 1.81K (1809) - RowGroups processed: 77.80K (77800) - RowGroups rejected: 0 (0) - RowGroups total: 77.80K (77800) - Rows processed: 1.98M (1982464) - Rows rejected: 0 (0) - Rows total: 79.69M (79693600) - Splits processed: 121 (121) - Splits rejected: 0 (0) - Splits total: 121 (121) Instance 7f40dcb034de70b7:94 (host=vd1130.foo:22000):(Total: 9m17s, non-child: 8m55s, % non-child: 95.91%) Hdfs split stats (:<# splits>/): 0:233/14.24 GB 6:227/13.84 GB 5:233/13.20 GB 3:222/13.11 GB 2:242/14.08 GB 4:204/11.59 GB 7:247/14.02 GB 1:204/11.59 GB Filter 6 arrival: 1s066ms Filter 2 arrival: 11s684ms Filter 5 arrival: 15s958ms MemoryUsage(16s000ms): 35.89 MB, 66.73 MB, 66.73 MB, 66.46 MB, 66.83 MB, 66.81 MB, 66.51 MB, 66.78 MB, 66.78 MB, 66.69 MB, 66.81 MB, 66.74 MB, 66.58 MB, 66.83 MB, 66.45 MB, 66.74 MB, 66.82 MB, 66.75 MB, 66.81 MB, 66.72 MB, 66.21 MB, 66.76 MB, 66.76 MB, 66.82 MB, 66.16 MB, 66.89 MB, 66.85 MB, 66.73 MB, 66.85 MB, 65.98 MB, 62.31 MB, 62.27 MB, 62.33 MB, 59.85 MB ThreadUsage(16s000ms): 11, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.96 - BloomFilterBytes: 33.00 MB (34603008) - PeakMemoryUsage: 67.55 MB (70832305) - PerHostPeakMemUsage: 161.67 GB (173588397754) - RowsProduced: 78.10M (78100749) - TotalNetworkReceiveTime: 822.318ms - TotalNetworkSendTime: 8m48s - TotalStorageWaitTime: 15s169ms - TotalThreadsInvoluntaryContextSwitches: 29.51K (29512) - TotalThreadsTotalWallClockTime: 2h - TotalThreadsSysTime: 1m2s - TotalThreadsUserTime: 2m44s - TotalThreadsVoluntaryContextSwitches: 4.31M (4313986) Fragment Instance Lifecycle Timings: - ExecTime: 9m16s - ExecTreeExecTime: 3s831ms - OpenTime: 1s223ms - ExecTreeOpenTime: 1s032ms - PrepareTime: 57.464ms - ExecTreePrepareTime: 7.191ms DataStreamSender (dst_id=22):(Total: 17s772ms, non-child: 17s772ms, % non-child: 100.00%) - BytesSent: 722.84 MB (757948186) - NetworkThroughput(*): 72.30 MB/sec - OverallThroughput: 40.67 MB/sec - PeakMemoryUsage: 5.00 MB (5240576) - RowsReturned: 78.10M (78100749) - SerializeBatchTime: 7s753ms - TransmitDataRPCTime: 9s997ms - UncompressedRowBatchSize: 2.18 GB (2343862790) CodeGen:(Total: 214.040ms, non-child: 214.040ms, % non-child: 100.00%) - CodegenTime: 1.253ms - CompileTime: 59.772ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 129.980ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 23.778ms HASH_JOIN_NODE (id=5):(Total: 4s829ms, non-child: 3s326ms, % non-child: 68.86%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.416ms - PeakMemoryUsage: 1.23 MB (1292336) - ProbeRows: 78.10M (78100749) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3s183ms - RowsReturned: 78.10M (78100749) - RowsReturnedRate: 16.17 M/sec Hash Join Builder (join_node_id=5): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 25.505us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 110.218us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 44.610us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 822.329ms, non-child: 19.535us, % non-child: 0.00%) BytesReceived(16s000ms): 932.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 4.694us - DeserializeRowBatchTimer: 17.670us - FirstBatchArrivalWaitTime: 785.469ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 145.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=3):(Total: 681.992ms, non-child: 681.992ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:233/14.24 GB 6:227/13.84 GB 5:233/13.20 GB 3:222/13.11 GB 2:242/14.08 GB 4:204/11.59 GB 7:247/14.02 GB 1:204/11.59 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 118 out of 118 Runtime filters: Only following filters arrived: 6, waited 40ms Hdfs Read Thread Concurrency Bucket: 0:99.01% 1:0.7227% 2:0.1807% 3:0.09033% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1694 PARQUET/SNAPPY:118 BytesRead(16s000ms): 13.23 MB, 14.60 MB, 14.72 MB, 20.70 MB, 29.10 MB, 29.65 MB, 38.74 MB, 43.34 MB, 44.69 MB, 55.74 MB, 57.99 MB, 60.30 MB, 72.45 MB, 72.98 MB, 77.77 MB, 86.97 MB, 87.80 MB, 96.26 MB, 101.45 MB, 102.49 MB, 110.74 MB, 116.03 MB, 116.03 MB, 118.50 MB, 127.01 MB, 130.64 MB, 130.87 MB, 132.84 MB, 135.30 MB, 136.54 MB, 142.82 MB, 142.82 MB, 142.82 MB, 142.82 MB - FooterProcessingTime: (Avg: 65.635ms ; Min: 4.560ms ; Max: 522.757ms ; Number of samples: 118) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 11.98 - BytesRead: 142.82 MB (149762834) - BytesReadDataNodeCache: 0 - BytesReadLocal: 142.82 MB (149762834) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 142.82 MB (149762834) - DecompressionTime: 2s141ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 118 (118) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 29.36 MB (30785211) - PerReadThreadRawHdfsThroughput: 21.59 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 163.328ms - RowBatchQueuePutWaitTime: 1h47m - RowsRead: 78.24M (78241361) - RowsReturned: 78.10M (78100749) - RowsReturnedRate: 114.52 M/sec - ScanRangesComplete: 1.81K (1812) - ScannerThreadsInvoluntaryContextSwitches: 24.43K (24431) - ScannerThreadsTotalWallClockTime: 1h51m - MaterializeTupleTime(*): 7s218ms - ScannerThreadsSysTime: 1m1s - ScannerThreadsUserTime: 2m18s - ScannerThreadsVoluntaryContextSwitches: 4.31M (4310863) - TotalRawHdfsReadTime(*): 6s614ms - TotalReadThroughput: 263.99 KB/sec Filter 2 (16.00 MB): - Rows processed: 2.02M (2015556) - Rows rejected: 140.59K (140593) - Rows total: 78.24M (78241361) Filter 5 (16.00 MB): - Rows processed: 1.84M (1840147) - Rows rejected: 19 (19) - Rows total: 78.10M (78100768) Filter 6 (1.00 MB): - Files processed: 1.81K (1812) - Files rejected: 1.69K (1694) - Files total: 1.81K (1812) - RowGroups processed: 76.25K (76249) - RowGroups rejected: 0 (0) - RowGroups total: 76.25K (76249) - Rows processed: 1.93M (1933312) - Rows rejected: 0 (0) - Rows total: 78.10M (78100749) - Splits processed: 118 (118) - Splits rejected: 0 (0) - Splits total: 118 (118) Instance 7f40dcb034de70b7:82 (host=vc1539.foo:22000):(Total: 9m17s, non-child: 8m56s, % non-child: 96.17%) Hdfs split stats (:<# splits>/): 3:222/13.03 GB 2:230/13.62 GB 7:217/12.64 GB 1:244/14.38 GB 6:219/12.91 GB 4:241/13.42 GB 5:217/12.71 GB 0:230/12.98 GB Filter 6 arrival: 1s173ms Filter 2 arrival: 11s200ms Filter 5 arrival: 15s786ms MemoryUsage(16s000ms): 37.91 MB, 66.74 MB, 66.82 MB, 66.74 MB, 66.84 MB, 66.72 MB, 66.67 MB, 66.68 MB, 66.54 MB, 66.69 MB, 66.82 MB, 65.66 MB, 63.72 MB, 63.75 MB, 64.39 MB, 65.84 MB, 65.66 MB, 65.69 MB, 65.82 MB, 65.77 MB, 66.59 MB, 66.87 MB, 66.76 MB, 66.69 MB, 66.78 MB, 66.89 MB, 66.63 MB, 66.62 MB, 62.76 MB, 62.46 MB, 62.24 MB, 62.32 MB, 62.23 MB, 60.08 MB ThreadUsage(16s000ms): 12, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.90 - BloomFilterBytes: 33.00 MB (34603008) - PeakMemoryUsage: 67.63 MB (70916232) - PerHostPeakMemUsage: 161.67 GB (173591338441) - RowsProduced: 78.19M (78194947) - TotalNetworkReceiveTime: 949.373ms - TotalNetworkSendTime: 8m53s - TotalStorageWaitTime: 13s339ms - TotalThreadsInvoluntaryContextSwitches: 29.50K (29503) - TotalThreadsTotalWallClockTime: 1h59m - TotalThreadsSysTime: 39s970ms - TotalThreadsUserTime: 3m29s - TotalThreadsVoluntaryContextSwitches: 4.26M (4255964) Fragment Instance Lifecycle Timings: - ExecTime: 9m16s - ExecTreeExecTime: 3s715ms - OpenTime: 1s292ms - ExecTreeOpenTime: 1s112ms - PrepareTime: 47.968ms - ExecTreePrepareTime: 6.133ms DataStreamSender (dst_id=22):(Total: 16s397ms, non-child: 16s397ms, % non-child: 100.00%) - BytesSent: 721.35 MB (756392976) - NetworkThroughput(*): 74.64 MB/sec - OverallThroughput: 43.99 MB/sec - PeakMemoryUsage: 4.99 MB (5232384) - RowsReturned: 78.19M (78194947) - SerializeBatchTime: 6s713ms - TransmitDataRPCTime: 9s664ms - UncompressedRowBatchSize: 2.19 GB (2346689730) CodeGen:(Total: 198.389ms, non-child: 198.389ms, % non-child: 100.00%) - CodegenTime: 952.471us - CompileTime: 53.366ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 125.109ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 19.538ms HASH_JOIN_NODE (id=5):(Total: 4s795ms, non-child: 3s263ms, % non-child: 68.04%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.521ms - PeakMemoryUsage: 1.24 MB (1297573) - ProbeRows: 78.19M (78194947) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3s109ms - RowsReturned: 78.19M (78194947) - RowsReturnedRate: 16.30 M/sec Hash Join Builder (join_node_id=5): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 25.913us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 157.948us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 53.945us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 949.387ms, non-child: 23.749us, % non-child: 0.00%) BytesReceived(16s000ms): 932.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 6.969us - DeserializeRowBatchTimer: 16.445us - FirstBatchArrivalWaitTime: 908.108ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 126.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=3):(Total: 583.898ms, non-child: 583.898ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:222/13.03 GB 2:230/13.62 GB 7:217/12.64 GB 1:244/14.38 GB 6:219/12.91 GB 4:241/13.42 GB 5:217/12.71 GB 0:230/12.98 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 118 out of 118 Runtime filters: Only following filters arrived: 6, waited 40ms Hdfs Read Thread Concurrency Bucket: 0:99% 1:0.8167% 2:0.09074% 3:0.09074% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1702 PARQUET/SNAPPY:118 BytesRead(16s000ms): 13.30 MB, 14.33 MB, 15.07 MB, 21.03 MB, 28.59 MB, 29.95 MB, 40.70 MB, 43.44 MB, 45.45 MB, 57.46 MB, 58.52 MB, 62.64 MB, 72.01 MB, 72.91 MB, 78.53 MB, 86.48 MB, 87.32 MB, 97.76 MB, 100.86 MB, 102.08 MB, 113.82 MB, 115.26 MB, 116.00 MB, 120.88 MB, 129.67 MB, 129.71 MB, 130.19 MB, 131.29 MB, 140.79 MB, 141.82 MB, 141.82 MB, 141.82 MB, 141.82 MB, 141.82 MB - FooterProcessingTime: (Avg: 61.933ms ; Min: 25.190ms ; Max: 252.138ms ; Number of samples: 118) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 11.98 - BytesRead: 141.82 MB (148710416) - BytesReadDataNodeCache: 0 - BytesReadLocal: 141.82 MB (148710416) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 141.82 MB (148710416) - DecompressionTime: 1s558ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 118 (118) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 29.53 MB (30965769) - PerReadThreadRawHdfsThroughput: 21.09 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 116.248ms - RowBatchQueuePutWaitTime: 1h46m - RowsRead: 78.33M (78334283) - RowsReturned: 78.19M (78194947) - RowsReturnedRate: 133.92 M/sec - ScanRangesComplete: 1.82K (1820) - ScannerThreadsInvoluntaryContextSwitches: 24.77K (24772) - ScannerThreadsTotalWallClockTime: 1h50m - MaterializeTupleTime(*): 6s087ms - ScannerThreadsSysTime: 39s306ms - ScannerThreadsUserTime: 3m8s - ScannerThreadsVoluntaryContextSwitches: 4.25M (4252805) - TotalRawHdfsReadTime(*): 6s725ms - TotalReadThroughput: 263.57 KB/sec Filter 2 (16.00 MB): - Rows processed: 2.00M (1996872) - Rows rejected: 139.32K (139322) - Rows total: 78.33M (78334283) Filter 5 (16.00 MB): - Rows processed: 1.86M (1857550) - Rows rejected: 14 (14) - Rows total: 78.19M (78194961) Filter 6 (1.00 MB): - Files processed: 1.82K (1820) - Files rejected: 1.70K (1702) - Files total: 1.82K (1820) - RowGroups processed: 76.33K (76327) - RowGroups rejected: 0 (0) - RowGroups total: 76.33K (76327) - Rows processed: 1.93M (1933312) - Rows rejected: 0 (0) - Rows total: 78.19M (78194947) - Splits processed: 118 (118) - Splits rejected: 0 (0) - Splits total: 118 (118) Instance 7f40dcb034de70b7:e6 (host=vd1113.foo:22000):(Total: 9m17s, non-child: 8m55s, % non-child: 96.04%) Hdfs split stats (:<# splits>/): 6:207/11.56 GB 5:219/12.64 GB 3:234/13.58 GB 7:236/14.18 GB 1:225/13.13 GB 0:250/14.79 GB 4:221/12.45 GB 2:232/13.37 GB Filter 6 arrival: 719ms Filter 2 arrival: 13s377ms Filter 5 arrival: 16s873ms MemoryUsage(16s000ms): 34.51 MB, 65.23 MB, 65.80 MB, 65.81 MB, 65.81 MB, 65.82 MB, 65.33 MB, 65.81 MB, 65.68 MB, 66.39 MB, 66.81 MB, 66.47 MB, 66.72 MB, 66.85 MB, 66.55 MB, 66.72 MB, 66.74 MB, 66.62 MB, 66.81 MB, 66.79 MB, 66.42 MB, 66.43 MB, 66.80 MB, 66.83 MB, 66.60 MB, 66.07 MB, 66.79 MB, 66.75 MB, 66.84 MB, 66.89 MB, 66.59 MB, 61.33 MB, 57.75 MB, 57.82 MB ThreadUsage(16s000ms): 12, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.98 - BloomFilterBytes: 33.00 MB (34603008) - PeakMemoryUsage: 67.54 MB (70819191) - PerHostPeakMemUsage: 161.68 GB (173602615637) - RowsProduced: 76.99M (76986448) - TotalNetworkReceiveTime: 486.212ms - TotalNetworkSendTime: 8m47s - TotalStorageWaitTime: 13s944ms - TotalThreadsInvoluntaryContextSwitches: 30.21K (30207) - TotalThreadsTotalWallClockTime: 2h - TotalThreadsSysTime: 1m41s - TotalThreadsUserTime: 2m7s - TotalThreadsVoluntaryContextSwitches: 9.68M (9680421) Fragment Instance Lifecycle Timings: - ExecTime: 9m16s - ExecTreeExecTime: 4s063ms - OpenTime: 1s074ms - ExecTreeOpenTime: 891.218ms - PrepareTime: 54.707ms - ExecTreePrepareTime: 8.774ms DataStreamSender (dst_id=22):(Total: 16s954ms, non-child: 16s954ms, % non-child: 100.00%) - BytesSent: 713.30 MB (747944481) - NetworkThroughput(*): 73.66 MB/sec - OverallThroughput: 42.07 MB/sec - PeakMemoryUsage: 4.95 MB (5191424) - RowsReturned: 76.99M (76986448) - SerializeBatchTime: 7s251ms - TransmitDataRPCTime: 9s683ms - UncompressedRowBatchSize: 2.15 GB (2310421816) CodeGen:(Total: 203.226ms, non-child: 203.226ms, % non-child: 100.00%) - CodegenTime: 1.371ms - CompileTime: 52.524ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 129.233ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 21.078ms HASH_JOIN_NODE (id=5):(Total: 4s921ms, non-child: 3s120ms, % non-child: 63.41%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.930ms - PeakMemoryUsage: 1.24 MB (1297154) - ProbeRows: 76.99M (76986448) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 2s976ms - RowsReturned: 76.99M (76986448) - RowsReturnedRate: 15.64 M/sec Hash Join Builder (join_node_id=5): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 26.888us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 187.518us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 80.609us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 486.224ms, non-child: 23.543us, % non-child: 0.00%) BytesReceived(16s000ms): 963.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 5.506us - DeserializeRowBatchTimer: 22.548us - FirstBatchArrivalWaitTime: 450.417ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 246.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=3):(Total: 1s315ms, non-child: 1s315ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 6:207/11.56 GB 5:219/12.64 GB 3:234/13.58 GB 7:236/14.18 GB 1:225/13.13 GB 0:250/14.79 GB 4:221/12.45 GB 2:232/13.37 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 116 out of 116 Runtime filters: Only following filters arrived: 6, waited 302ms Hdfs Read Thread Concurrency Bucket: 0:98.56% 1:1.26% 2:0.09001% 3:0% 4:0.09001% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1708 PARQUET/SNAPPY:116 BytesRead(16s000ms): 13.49 MB, 14.39 MB, 14.39 MB, 18.50 MB, 28.90 MB, 28.90 MB, 37.84 MB, 43.22 MB, 43.62 MB, 55.73 MB, 57.75 MB, 58.88 MB, 71.91 MB, 72.43 MB, 75.15 MB, 86.95 MB, 87.03 MB, 90.52 MB, 101.58 MB, 101.65 MB, 102.54 MB, 113.22 MB, 116.51 MB, 116.51 MB, 117.97 MB, 127.93 MB, 131.38 MB, 131.38 MB, 131.38 MB, 131.38 MB, 133.18 MB, 141.15 MB, 141.15 MB, 141.15 MB - FooterProcessingTime: (Avg: 67.526ms ; Min: 21.387ms ; Max: 922.016ms ; Number of samples: 116) - AverageHdfsReadThreadConcurrency: 0.02 - AverageScannerThreadConcurrency: 11.98 - BytesRead: 141.15 MB (148002229) - BytesReadDataNodeCache: 0 - BytesReadLocal: 141.15 MB (148002229) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 141.15 MB (148002229) - DecompressionTime: 2s015ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 116 (116) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 29.40 MB (30828935) - PerReadThreadRawHdfsThroughput: 19.21 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 96.889ms - RowBatchQueuePutWaitTime: 1h47m - RowsRead: 77.13M (77125583) - RowsReturned: 76.99M (76986448) - RowsReturnedRate: 58.53 M/sec - ScanRangesComplete: 1.82K (1824) - ScannerThreadsInvoluntaryContextSwitches: 25.24K (25243) - ScannerThreadsTotalWallClockTime: 1h51m - MaterializeTupleTime(*): 7s046ms - ScannerThreadsSysTime: 1m40s - ScannerThreadsUserTime: 1m44s - ScannerThreadsVoluntaryContextSwitches: 9.68M (9677158) - TotalRawHdfsReadTime(*): 7s348ms - TotalReadThroughput: 260.19 KB/sec Filter 2 (16.00 MB): - Rows processed: 2.01M (2013055) - Rows rejected: 139.12K (139121) - Rows total: 77.13M (77125583) Filter 5 (16.00 MB): - Rows processed: 1.81M (1813518) - Rows rejected: 14 (14) - Rows total: 76.99M (76986462) Filter 6 (1.00 MB): - Files processed: 1.82K (1824) - Files rejected: 1.71K (1708) - Files total: 1.82K (1824) - RowGroups processed: 75.15K (75149) - RowGroups rejected: 0 (0) - RowGroups total: 75.15K (75149) - Rows processed: 1.90M (1900544) - Rows rejected: 0 (0) - Rows total: 76.99M (76986448) - Splits processed: 116 (116) - Splits rejected: 0 (0) - Splits total: 116 (116) Instance 7f40dcb034de70b7:b0 (host=vd1132.foo:22000):(Total: 9m17s, non-child: 8m56s, % non-child: 96.14%) Hdfs split stats (:<# splits>/): 7:227/12.97 GB 5:221/13.27 GB 1:200/10.96 GB 0:228/13.32 GB 2:238/13.41 GB 3:249/13.62 GB 4:219/13.63 GB 6:240/14.49 GB Filter 6 arrival: 963ms Filter 2 arrival: 12s523ms Filter 5 arrival: 16s272ms MemoryUsage(16s000ms): 33.80 MB, 64.28 MB, 64.82 MB, 64.75 MB, 65.81 MB, 65.68 MB, 66.18 MB, 66.81 MB, 66.79 MB, 65.62 MB, 65.78 MB, 65.64 MB, 65.80 MB, 65.84 MB, 65.28 MB, 64.80 MB, 64.88 MB, 66.23 MB, 66.70 MB, 66.73 MB, 66.51 MB, 66.81 MB, 66.82 MB, 66.84 MB, 65.37 MB, 65.80 MB, 65.84 MB, 65.81 MB, 65.78 MB, 65.72 MB, 64.08 MB, 62.33 MB, 62.39 MB, 60.82 MB ThreadUsage(16s000ms): 12, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.98 - BloomFilterBytes: 33.00 MB (34603008) - PeakMemoryUsage: 67.40 MB (70671772) - PerHostPeakMemUsage: 161.67 GB (173595102673) - RowsProduced: 78.13M (78130457) - TotalNetworkReceiveTime: 728.059ms - TotalNetworkSendTime: 8m51s - TotalStorageWaitTime: 13s038ms - TotalThreadsInvoluntaryContextSwitches: 22.32K (22324) - TotalThreadsTotalWallClockTime: 2h - TotalThreadsSysTime: 37s692ms - TotalThreadsUserTime: 2m29s - TotalThreadsVoluntaryContextSwitches: 3.79M (3790639) Fragment Instance Lifecycle Timings: - ExecTime: 9m16s - ExecTreeExecTime: 3s731ms - OpenTime: 1s120ms - ExecTreeOpenTime: 933.271ms - PrepareTime: 52.956ms - ExecTreePrepareTime: 7.007ms DataStreamSender (dst_id=22):(Total: 16s719ms, non-child: 16s719ms, % non-child: 100.00%) - BytesSent: 724.18 MB (759354896) - NetworkThroughput(*): 77.31 MB/sec - OverallThroughput: 43.31 MB/sec - PeakMemoryUsage: 4.86 MB (5101312) - RowsReturned: 78.13M (78130457) - SerializeBatchTime: 7s330ms - TransmitDataRPCTime: 9s366ms - UncompressedRowBatchSize: 2.18 GB (2344754382) CodeGen:(Total: 207.376ms, non-child: 207.376ms, % non-child: 100.00%) - CodegenTime: 1.099ms - CompileTime: 56.768ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 128.640ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 21.569ms HASH_JOIN_NODE (id=5):(Total: 4s626ms, non-child: 3s237ms, % non-child: 69.99%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.391ms - PeakMemoryUsage: 1.23 MB (1292856) - ProbeRows: 78.13M (78130457) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3s071ms - RowsReturned: 78.13M (78130457) - RowsReturnedRate: 16.89 M/sec Hash Join Builder (join_node_id=5): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 26.508us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 125.649us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 58.464us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 728.069ms, non-child: 20.451us, % non-child: 0.00%) BytesReceived(16s000ms): 932.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 4.807us - DeserializeRowBatchTimer: 15.559us - FirstBatchArrivalWaitTime: 693.585ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 164.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=3):(Total: 660.677ms, non-child: 660.677ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:227/12.97 GB 5:221/13.27 GB 1:200/10.96 GB 0:228/13.32 GB 2:238/13.41 GB 3:249/13.62 GB 4:219/13.63 GB 6:240/14.49 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 118 out of 118 Runtime filters: Only following filters arrived: 6, waited 60ms Hdfs Read Thread Concurrency Bucket: 0:99.46% 1:0.3597% 2:0.08993% 3:0% 4:0.08993% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1704 PARQUET/SNAPPY:118 BytesRead(16s000ms): 13.27 MB, 14.48 MB, 14.89 MB, 20.99 MB, 29.03 MB, 29.76 MB, 40.19 MB, 43.59 MB, 44.89 MB, 56.86 MB, 58.16 MB, 60.62 MB, 72.74 MB, 73.25 MB, 77.18 MB, 87.16 MB, 87.99 MB, 96.44 MB, 101.48 MB, 102.40 MB, 107.64 MB, 116.47 MB, 116.66 MB, 117.65 MB, 126.74 MB, 130.67 MB, 130.89 MB, 131.86 MB, 131.94 MB, 135.35 MB, 142.46 MB, 143.11 MB, 143.11 MB, 143.11 MB - FooterProcessingTime: (Avg: 62.840ms ; Min: 25.429ms ; Max: 223.346ms ; Number of samples: 118) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 11.99 - BytesRead: 143.11 MB (150057719) - BytesReadDataNodeCache: 0 - BytesReadLocal: 143.11 MB (150057719) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 143.11 MB (150057719) - DecompressionTime: 1s260ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 118 (118) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 29.19 MB (30607645) - PerReadThreadRawHdfsThroughput: 21.67 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 137.858ms - RowBatchQueuePutWaitTime: 1h48m - RowsRead: 78.27M (78272397) - RowsReturned: 78.13M (78130457) - RowsReturnedRate: 118.26 M/sec - ScanRangesComplete: 1.82K (1822) - ScannerThreadsInvoluntaryContextSwitches: 17.43K (17431) - ScannerThreadsTotalWallClockTime: 1h51m - MaterializeTupleTime(*): 6s343ms - ScannerThreadsSysTime: 36s994ms - ScannerThreadsUserTime: 2m5s - ScannerThreadsVoluntaryContextSwitches: 3.79M (3787547) - TotalRawHdfsReadTime(*): 6s602ms - TotalReadThroughput: 263.33 KB/sec Filter 2 (16.00 MB): - Rows processed: 2.02M (2019956) - Rows rejected: 141.87K (141866) - Rows total: 78.27M (78272397) Filter 5 (16.00 MB): - Rows processed: 1.82M (1824842) - Rows rejected: 74 (74) - Rows total: 78.13M (78130531) Filter 6 (1.00 MB): - Files processed: 1.82K (1822) - Files rejected: 1.70K (1704) - Files total: 1.82K (1822) - RowGroups processed: 76.27K (76272) - RowGroups rejected: 0 (0) - RowGroups total: 76.27K (76272) - Rows processed: 1.93M (1933312) - Rows rejected: 0 (0) - Rows total: 78.13M (78130457) - Splits processed: 118 (118) - Splits rejected: 0 (0) - Splits total: 118 (118) Instance 7f40dcb034de70b7:a8 (host=vc1531.foo:22000):(Total: 9m17s, non-child: 8m56s, % non-child: 96.16%) Hdfs split stats (:<# splits>/): 1:229/13.66 GB 6:204/12.55 GB 5:234/12.82 GB 3:215/12.85 GB 0:225/12.69 GB 4:244/14.63 GB 7:216/12.89 GB 2:238/13.56 GB Filter 6 arrival: 989ms Filter 2 arrival: 12s367ms Filter 5 arrival: 16s193ms MemoryUsage(16s000ms): 35.58 MB, 65.78 MB, 65.79 MB, 66.11 MB, 66.74 MB, 66.83 MB, 66.41 MB, 66.77 MB, 66.70 MB, 66.68 MB, 66.81 MB, 66.17 MB, 65.53 MB, 65.81 MB, 65.57 MB, 64.77 MB, 64.76 MB, 66.43 MB, 66.87 MB, 66.53 MB, 65.83 MB, 65.70 MB, 65.82 MB, 65.44 MB, 66.79 MB, 66.81 MB, 66.77 MB, 66.66 MB, 66.69 MB, 65.73 MB, 65.65 MB, 63.57 MB, 63.54 MB, 63.61 MB ThreadUsage(16s000ms): 12, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.98 - BloomFilterBytes: 33.00 MB (34603008) - PeakMemoryUsage: 67.39 MB (70664361) - PerHostPeakMemUsage: 161.67 GB (173588632378) - RowsProduced: 79.78M (79777079) - TotalNetworkReceiveTime: 765.744ms - TotalNetworkSendTime: 8m53s - TotalStorageWaitTime: 12s805ms - TotalThreadsInvoluntaryContextSwitches: 13.08K (13076) - TotalThreadsTotalWallClockTime: 2h - TotalThreadsSysTime: 6s342ms - TotalThreadsUserTime: 1m30s - TotalThreadsVoluntaryContextSwitches: 670.79K (670794) Fragment Instance Lifecycle Timings: - ExecTime: 9m16s - ExecTreeExecTime: 3s630ms - OpenTime: 1s092ms - ExecTreeOpenTime: 913.709ms - PrepareTime: 48.685ms - ExecTreePrepareTime: 5.704ms DataStreamSender (dst_id=22):(Total: 16s704ms, non-child: 16s704ms, % non-child: 100.00%) - BytesSent: 739.24 MB (775151727) - NetworkThroughput(*): 75.81 MB/sec - OverallThroughput: 44.25 MB/sec - PeakMemoryUsage: 4.86 MB (5101312) - RowsReturned: 79.78M (79777079) - SerializeBatchTime: 6s934ms - TransmitDataRPCTime: 9s750ms - UncompressedRowBatchSize: 2.23 GB (2394170762) CodeGen:(Total: 199.651ms, non-child: 199.651ms, % non-child: 100.00%) - CodegenTime: 1.042ms - CompileTime: 55.496ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 122.163ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 21.600ms HASH_JOIN_NODE (id=5):(Total: 4s512ms, non-child: 3s184ms, % non-child: 70.57%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.556ms - PeakMemoryUsage: 1.23 MB (1290488) - ProbeRows: 79.78M (79777079) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3s023ms - RowsReturned: 79.78M (79777079) - RowsReturnedRate: 17.68 M/sec Hash Join Builder (join_node_id=5): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 45.916us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 155.757us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 85.526us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 765.756ms, non-child: 20.697us, % non-child: 0.00%) BytesReceived(16s000ms): 932.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 5.406us - DeserializeRowBatchTimer: 14.396us - FirstBatchArrivalWaitTime: 745.173ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 156.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=3):(Total: 562.626ms, non-child: 562.626ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:229/13.66 GB 6:204/12.55 GB 5:234/12.82 GB 3:215/12.85 GB 0:225/12.69 GB 4:244/14.63 GB 7:216/12.89 GB 2:238/13.56 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 120 out of 120 Runtime filters: Only following filters arrived: 6, waited 40ms Hdfs Read Thread Concurrency Bucket: 0:99.19% 1:0.8123% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1685 PARQUET/SNAPPY:120 BytesRead(16s000ms): 13.52 MB, 14.46 MB, 15.56 MB, 22.21 MB, 29.14 MB, 30.15 MB, 39.27 MB, 44.55 MB, 46.00 MB, 57.25 MB, 59.69 MB, 62.57 MB, 72.82 MB, 74.27 MB, 79.97 MB, 88.07 MB, 89.10 MB, 99.98 MB, 103.00 MB, 104.75 MB, 115.88 MB, 117.60 MB, 118.03 MB, 124.79 MB, 131.19 MB, 132.02 MB, 132.56 MB, 134.45 MB, 142.38 MB, 145.91 MB, 145.95 MB, 145.95 MB, 145.95 MB, 145.95 MB - FooterProcessingTime: (Avg: 58.773ms ; Min: 26.398ms ; Max: 204.290ms ; Number of samples: 120) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 11.98 - BytesRead: 145.95 MB (153038912) - BytesReadDataNodeCache: 0 - BytesReadLocal: 145.95 MB (153038912) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 145.95 MB (153038912) - DecompressionTime: 719.645ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 120 (120) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 29.28 MB (30705706) - PerReadThreadRawHdfsThroughput: 22.06 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 101.195ms - RowBatchQueuePutWaitTime: 1h49m - RowsRead: 79.92M (79920130) - RowsReturned: 79.78M (79777079) - RowsReturnedRate: 141.79 M/sec - ScanRangesComplete: 1.80K (1805) - ScannerThreadsInvoluntaryContextSwitches: 8.32K (8319) - ScannerThreadsTotalWallClockTime: 1h51m - MaterializeTupleTime(*): 6s389ms - ScannerThreadsSysTime: 5s621ms - ScannerThreadsUserTime: 1m9s - ScannerThreadsVoluntaryContextSwitches: 667.67K (667672) - TotalRawHdfsReadTime(*): 6s616ms - TotalReadThroughput: 269.77 KB/sec Filter 2 (16.00 MB): - Rows processed: 2.04M (2038467) - Rows rejected: 143.00K (143002) - Rows total: 79.92M (79920130) Filter 5 (16.00 MB): - Rows processed: 1.85M (1847345) - Rows rejected: 49 (49) - Rows total: 79.78M (79777128) Filter 6 (1.00 MB): - Files processed: 1.80K (1805) - Files rejected: 1.69K (1685) - Files total: 1.80K (1805) - RowGroups processed: 77.88K (77881) - RowGroups rejected: 0 (0) - RowGroups total: 77.88K (77881) - Rows processed: 1.97M (1966080) - Rows rejected: 0 (0) - Rows total: 79.78M (79777079) - Splits processed: 120 (120) - Splits rejected: 0 (0) - Splits total: 120 (120) Instance 7f40dcb034de70b7:bb (host=vc1534.foo:22000):(Total: 9m17s, non-child: 8m56s, % non-child: 96.11%) Hdfs split stats (:<# splits>/): 1:216/12.14 GB 2:214/12.87 GB 0:233/13.31 GB 7:229/13.12 GB 6:214/12.10 GB 4:222/13.87 GB 5:245/14.08 GB 3:242/14.16 GB Filter 6 arrival: 930ms Filter 2 arrival: 12s841ms Filter 5 arrival: 16s401ms MemoryUsage(16s000ms): 34.81 MB, 66.29 MB, 66.83 MB, 66.51 MB, 66.76 MB, 66.77 MB, 66.65 MB, 66.87 MB, 66.77 MB, 66.38 MB, 66.82 MB, 66.79 MB, 65.83 MB, 66.82 MB, 66.61 MB, 66.86 MB, 66.79 MB, 66.27 MB, 65.82 MB, 65.80 MB, 66.07 MB, 66.72 MB, 66.88 MB, 66.80 MB, 66.78 MB, 66.64 MB, 66.80 MB, 66.87 MB, 66.65 MB, 67.07 MB, 65.38 MB, 64.50 MB, 64.72 MB, 63.49 MB ThreadUsage(16s000ms): 12, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.97 - BloomFilterBytes: 33.00 MB (34603008) - PeakMemoryUsage: 67.60 MB (70887254) - PerHostPeakMemUsage: 161.67 GB (173591836170) - RowsProduced: 79.06M (79060734) - TotalNetworkReceiveTime: 692.534ms - TotalNetworkSendTime: 8m48s - TotalStorageWaitTime: 15s474ms - TotalThreadsInvoluntaryContextSwitches: 14.96K (14960) - TotalThreadsTotalWallClockTime: 2h - TotalThreadsSysTime: 4s915ms - TotalThreadsUserTime: 1m55s - TotalThreadsVoluntaryContextSwitches: 423.54K (423538) Fragment Instance Lifecycle Timings: - ExecTime: 9m16s - ExecTreeExecTime: 3s709ms - OpenTime: 1s124ms - ExecTreeOpenTime: 932.435ms - PrepareTime: 50.502ms - ExecTreePrepareTime: 6.340ms DataStreamSender (dst_id=22):(Total: 16s879ms, non-child: 16s879ms, % non-child: 100.00%) - BytesSent: 735.65 MB (771388449) - NetworkThroughput(*): 77.53 MB/sec - OverallThroughput: 43.58 MB/sec - PeakMemoryUsage: 4.94 MB (5175040) - RowsReturned: 79.06M (79060734) - SerializeBatchTime: 7s370ms - TransmitDataRPCTime: 9s489ms - UncompressedRowBatchSize: 2.21 GB (2372672652) CodeGen:(Total: 211.438ms, non-child: 211.438ms, % non-child: 100.00%) - CodegenTime: 1.077ms - CompileTime: 58.207ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 132.125ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 20.683ms HASH_JOIN_NODE (id=5):(Total: 4s606ms, non-child: 3s236ms, % non-child: 70.27%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.542ms - PeakMemoryUsage: 1.24 MB (1295925) - ProbeRows: 79.06M (79060734) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3s068ms - RowsReturned: 79.06M (79060734) - RowsReturnedRate: 17.16 M/sec Hash Join Builder (join_node_id=5): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 25.104us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 133.663us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 45.895us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 692.546ms, non-child: 20.408us, % non-child: 0.00%) BytesReceived(16s000ms): 932.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 4.434us - DeserializeRowBatchTimer: 16.341us - FirstBatchArrivalWaitTime: 648.133ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 173.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=3):(Total: 677.438ms, non-child: 677.438ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:216/12.14 GB 2:214/12.87 GB 0:233/13.31 GB 7:229/13.12 GB 6:214/12.10 GB 4:222/13.87 GB 5:245/14.08 GB 3:242/14.16 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 120 out of 120 Runtime filters: Only following filters arrived: 6, waited 101ms Hdfs Read Thread Concurrency Bucket: 0:98.83% 1:0.9928% 2:0.1805% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1695 PARQUET/SNAPPY:120 BytesRead(16s000ms): 13.34 MB, 14.72 MB, 15.02 MB, 19.88 MB, 29.53 MB, 30.07 MB, 39.35 MB, 44.47 MB, 45.41 MB, 55.99 MB, 59.01 MB, 60.18 MB, 72.05 MB, 73.86 MB, 76.58 MB, 88.14 MB, 88.93 MB, 95.67 MB, 103.01 MB, 103.69 MB, 111.50 MB, 117.18 MB, 117.73 MB, 119.76 MB, 130.91 MB, 132.35 MB, 132.55 MB, 134.07 MB, 137.79 MB, 146.18 MB, 146.18 MB, 146.18 MB, 146.18 MB, 146.18 MB - FooterProcessingTime: (Avg: 66.793ms ; Min: 10.400ms ; Max: 536.851ms ; Number of samples: 120) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 11.98 - BytesRead: 146.18 MB (153280204) - BytesReadDataNodeCache: 0 - BytesReadLocal: 146.18 MB (153280204) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 146.18 MB (153280204) - DecompressionTime: 1s783ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 120 (120) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 29.47 MB (30904640) - PerReadThreadRawHdfsThroughput: 21.01 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 132.814ms - RowBatchQueuePutWaitTime: 1h49m - RowsRead: 79.21M (79205448) - RowsReturned: 79.06M (79060734) - RowsReturnedRate: 116.71 M/sec - ScanRangesComplete: 1.81K (1815) - ScannerThreadsInvoluntaryContextSwitches: 9.84K (9842) - ScannerThreadsTotalWallClockTime: 1h51m - MaterializeTupleTime(*): 6s402ms - ScannerThreadsSysTime: 4s199ms - ScannerThreadsUserTime: 1m31s - ScannerThreadsVoluntaryContextSwitches: 420.35K (420351) - TotalRawHdfsReadTime(*): 6s956ms - TotalReadThroughput: 269.95 KB/sec Filter 2 (16.00 MB): - Rows processed: 2.09M (2087242) - Rows rejected: 144.66K (144664) - Rows total: 79.21M (79205448) Filter 5 (16.00 MB): - Rows processed: 1.82M (1815602) - Rows rejected: 50 (50) - Rows total: 79.06M (79060784) Filter 6 (1.00 MB): - Files processed: 1.81K (1815) - Files rejected: 1.70K (1695) - Files total: 1.81K (1815) - RowGroups processed: 77.18K (77180) - RowGroups rejected: 0 (0) - RowGroups total: 77.18K (77180) - Rows processed: 1.97M (1966080) - Rows rejected: 0 (0) - Rows total: 79.06M (79060734) - Splits processed: 120 (120) - Splits rejected: 0 (0) - Splits total: 120 (120) Instance 7f40dcb034de70b7:99 (host=ve1128.foo:22000):(Total: 9m17s, non-child: 8m57s, % non-child: 96.28%) Hdfs split stats (:<# splits>/): 1:210/12.01 GB 0:213/12.67 GB 2:235/14.05 GB 3:224/12.36 GB 6:232/13.95 GB 7:253/14.80 GB 4:224/13.14 GB 5:221/12.69 GB Filter 6 arrival: 1s075ms Filter 2 arrival: 11s844ms Filter 5 arrival: 15s966ms MemoryUsage(16s000ms): 36.31 MB, 65.75 MB, 66.39 MB, 66.52 MB, 66.80 MB, 66.73 MB, 66.78 MB, 66.75 MB, 66.57 MB, 66.67 MB, 66.82 MB, 66.38 MB, 66.80 MB, 66.83 MB, 66.79 MB, 66.86 MB, 66.74 MB, 66.62 MB, 66.74 MB, 66.47 MB, 65.87 MB, 65.74 MB, 65.77 MB, 66.36 MB, 66.77 MB, 66.51 MB, 66.74 MB, 65.98 MB, 66.77 MB, 66.76 MB, 66.85 MB, 66.91 MB, 65.22 MB, 63.18 MB ThreadUsage(16s000ms): 12, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.90 - BloomFilterBytes: 33.00 MB (34603008) - PeakMemoryUsage: 67.58 MB (70860915) - PerHostPeakMemUsage: 161.66 GB (173580163284) - RowsProduced: 79.52M (79517319) - TotalNetworkReceiveTime: 858.491ms - TotalNetworkSendTime: 8m51s - TotalStorageWaitTime: 12s234ms - TotalThreadsInvoluntaryContextSwitches: 11.59K (11586) - TotalThreadsTotalWallClockTime: 1h59m - TotalThreadsSysTime: 4s367ms - TotalThreadsUserTime: 1m16s - TotalThreadsVoluntaryContextSwitches: 364.30K (364299) Fragment Instance Lifecycle Timings: - ExecTime: 9m16s - ExecTreeExecTime: 3s927ms - OpenTime: 1s195ms - ExecTreeOpenTime: 1s017ms - PrepareTime: 40.951ms - ExecTreePrepareTime: 6.268ms DataStreamSender (dst_id=22):(Total: 15s629ms, non-child: 15s629ms, % non-child: 100.00%) - BytesSent: 734.86 MB (770553034) - NetworkThroughput(*): 87.55 MB/sec - OverallThroughput: 47.02 MB/sec - PeakMemoryUsage: 4.97 MB (5216000) - RowsReturned: 79.52M (79517319) - SerializeBatchTime: 7s216ms - TransmitDataRPCTime: 8s393ms - UncompressedRowBatchSize: 2.22 GB (2386375162) CodeGen:(Total: 190.438ms, non-child: 190.438ms, % non-child: 100.00%) - CodegenTime: 917.816us - CompileTime: 52.830ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 122.148ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 15.082ms HASH_JOIN_NODE (id=5):(Total: 4s915ms, non-child: 3s354ms, % non-child: 68.25%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 2.799ms - PeakMemoryUsage: 1.24 MB (1297769) - ProbeRows: 79.52M (79517319) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3s192ms - RowsReturned: 79.52M (79517319) - RowsReturnedRate: 16.18 M/sec Hash Join Builder (join_node_id=5): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 27.668us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 957.657us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 70.274us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 858.509ms, non-child: 29.806us, % non-child: 0.00%) BytesReceived(16s000ms): 932.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 8.356us - DeserializeRowBatchTimer: 19.758us - FirstBatchArrivalWaitTime: 817.129ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 139.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=3):(Total: 702.867ms, non-child: 702.867ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:210/12.01 GB 0:213/12.67 GB 2:235/14.05 GB 3:224/12.36 GB 6:232/13.95 GB 7:253/14.80 GB 4:224/13.14 GB 5:221/12.69 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 120 out of 120 Runtime filters: Only following filters arrived: 6, waited 40ms Hdfs Read Thread Concurrency Bucket: 0:98.55% 1:1.175% 2:0.09042% 3:0.1808% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1692 PARQUET/SNAPPY:120 BytesRead(16s000ms): 13.25 MB, 14.28 MB, 15.01 MB, 20.96 MB, 28.89 MB, 30.37 MB, 40.29 MB, 43.30 MB, 45.85 MB, 56.85 MB, 57.87 MB, 64.08 MB, 71.63 MB, 73.00 MB, 81.15 MB, 86.55 MB, 88.42 MB, 99.78 MB, 101.38 MB, 104.11 MB, 115.15 MB, 115.45 MB, 116.92 MB, 125.42 MB, 130.10 MB, 130.10 MB, 131.54 MB, 135.13 MB, 144.40 MB, 144.40 MB, 144.40 MB, 144.40 MB, 144.40 MB, 144.40 MB - FooterProcessingTime: (Avg: 55.835ms ; Min: 23.024ms ; Max: 187.691ms ; Number of samples: 120) - AverageHdfsReadThreadConcurrency: 0.02 - AverageScannerThreadConcurrency: 11.97 - BytesRead: 144.40 MB (151413521) - BytesReadDataNodeCache: 0 - BytesReadLocal: 144.40 MB (151413521) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 144.40 MB (151413521) - DecompressionTime: 1s396ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 120 (120) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 29.40 MB (30830210) - PerReadThreadRawHdfsThroughput: 23.07 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 110.721ms - RowBatchQueuePutWaitTime: 1h49m - RowsRead: 79.66M (79660921) - RowsReturned: 79.52M (79517319) - RowsReturnedRate: 113.13 M/sec - ScanRangesComplete: 1.81K (1812) - ScannerThreadsInvoluntaryContextSwitches: 6.68K (6676) - ScannerThreadsTotalWallClockTime: 1h50m - MaterializeTupleTime(*): 5s980ms - ScannerThreadsSysTime: 3s734ms - ScannerThreadsUserTime: 53s625ms - ScannerThreadsVoluntaryContextSwitches: 361.13K (361130) - TotalRawHdfsReadTime(*): 6s260ms - TotalReadThroughput: 267.39 KB/sec Filter 2 (16.00 MB): - Rows processed: 2.04M (2041074) - Rows rejected: 143.57K (143568) - Rows total: 79.66M (79660921) Filter 5 (16.00 MB): - Rows processed: 1.88M (1876002) - Rows rejected: 34 (34) - Rows total: 79.52M (79517353) Filter 6 (1.00 MB): - Files processed: 1.81K (1812) - Files rejected: 1.69K (1692) - Files total: 1.81K (1812) - RowGroups processed: 77.63K (77634) - RowGroups rejected: 0 (0) - RowGroups total: 77.63K (77634) - Rows processed: 1.97M (1966080) - Rows rejected: 0 (0) - Rows total: 79.52M (79517319) - Splits processed: 120 (120) - Splits rejected: 0 (0) - Splits total: 120 (120) Instance 7f40dcb034de70b7:98 (host=va1029.foo:22000):(Total: 9m17s, non-child: 8m54s, % non-child: 95.87%) Hdfs split stats (:<# splits>/): 6:246/13.81 GB 0:230/13.52 GB 2:227/13.04 GB 1:241/14.09 GB 3:237/13.57 GB 5:215/12.87 GB 7:224/12.69 GB 4:210/12.08 GB Filter 6 arrival: 1s070ms Filter 2 arrival: 11s838ms Filter 5 arrival: 15s986ms MemoryUsage(16s000ms): 35.59 MB, 66.79 MB, 66.81 MB, 66.77 MB, 66.84 MB, 65.93 MB, 65.71 MB, 65.82 MB, 66.71 MB, 66.75 MB, 66.82 MB, 66.44 MB, 66.81 MB, 66.72 MB, 66.56 MB, 66.80 MB, 66.86 MB, 66.44 MB, 65.87 MB, 65.71 MB, 66.13 MB, 66.83 MB, 66.70 MB, 66.39 MB, 65.38 MB, 65.79 MB, 65.68 MB, 65.61 MB, 66.51 MB, 65.87 MB, 62.36 MB, 62.36 MB, 62.45 MB, 60.54 MB ThreadUsage(16s000ms): 12, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.89 - BloomFilterBytes: 33.00 MB (34603008) - PeakMemoryUsage: 67.56 MB (70837563) - PerHostPeakMemUsage: 161.69 GB (173609992006) - RowsProduced: 78.35M (78349307) - TotalNetworkReceiveTime: 817.776ms - TotalNetworkSendTime: 8m48s - TotalStorageWaitTime: 14s395ms - TotalThreadsInvoluntaryContextSwitches: 28.15K (28151) - TotalThreadsTotalWallClockTime: 1h59m - TotalThreadsSysTime: 33s656ms - TotalThreadsUserTime: 2m58s - TotalThreadsVoluntaryContextSwitches: 3.78M (3778690) Fragment Instance Lifecycle Timings: - ExecTime: 9m16s - ExecTreeExecTime: 4s406ms - OpenTime: 1s174ms - ExecTreeOpenTime: 980.408ms - PrepareTime: 62.737ms - ExecTreePrepareTime: 6.940ms DataStreamSender (dst_id=22):(Total: 17s477ms, non-child: 17s477ms, % non-child: 100.00%) - BytesSent: 725.83 MB (761090524) - NetworkThroughput(*): 73.97 MB/sec - OverallThroughput: 41.53 MB/sec - PeakMemoryUsage: 5.01 MB (5248768) - RowsReturned: 78.35M (78349307) - SerializeBatchTime: 7s643ms - TransmitDataRPCTime: 9s812ms - UncompressedRowBatchSize: 2.19 GB (2351322258) CodeGen:(Total: 218.579ms, non-child: 218.579ms, % non-child: 100.00%) - CodegenTime: 1.087ms - CompileTime: 54.191ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 137.890ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 26.062ms HASH_JOIN_NODE (id=5):(Total: 5s355ms, non-child: 3s244ms, % non-child: 60.58%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.881ms - PeakMemoryUsage: 1.24 MB (1297872) - ProbeRows: 78.35M (78349307) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3s099ms - RowsReturned: 78.35M (78349307) - RowsReturnedRate: 14.63 M/sec Hash Join Builder (join_node_id=5): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 26.898us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 425.989us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 47.090us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 817.790ms, non-child: 24.918us, % non-child: 0.00%) BytesReceived(16s000ms): 932.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 5.617us - DeserializeRowBatchTimer: 25.569us - FirstBatchArrivalWaitTime: 778.127ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 146.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=3):(Total: 1s293ms, non-child: 1s293ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 6:246/13.81 GB 0:230/13.52 GB 2:227/13.04 GB 1:241/14.09 GB 3:237/13.57 GB 5:215/12.87 GB 7:224/12.69 GB 4:210/12.08 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 119 out of 119 Runtime filters: Only following filters arrived: 6, waited 40ms Hdfs Read Thread Concurrency Bucket: 0:98.82% 1:0.9982% 2:0.1815% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1711 PARQUET/SNAPPY:119 BytesRead(16s000ms): 13.41 MB, 14.79 MB, 15.35 MB, 21.63 MB, 29.44 MB, 30.52 MB, 40.19 MB, 43.80 MB, 46.24 MB, 57.43 MB, 58.71 MB, 62.78 MB, 73.42 MB, 73.88 MB, 79.63 MB, 88.15 MB, 89.15 MB, 97.05 MB, 102.57 MB, 103.96 MB, 111.32 MB, 116.84 MB, 117.26 MB, 120.50 MB, 129.94 MB, 131.39 MB, 132.04 MB, 133.43 MB, 139.56 MB, 142.94 MB, 143.73 MB, 143.73 MB, 143.73 MB, 143.73 MB - FooterProcessingTime: (Avg: 66.545ms ; Min: 20.065ms ; Max: 222.292ms ; Number of samples: 119) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 11.99 - BytesRead: 143.73 MB (150709560) - BytesReadDataNodeCache: 0 - BytesReadLocal: 143.73 MB (150709560) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 143.73 MB (150709560) - DecompressionTime: 1s204ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 119 (119) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 29.40 MB (30829756) - PerReadThreadRawHdfsThroughput: 18.92 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 115.663ms - RowBatchQueuePutWaitTime: 1h47m - RowsRead: 78.49M (78491899) - RowsReturned: 78.35M (78349307) - RowsReturnedRate: 60.57 M/sec - ScanRangesComplete: 1.83K (1830) - ScannerThreadsInvoluntaryContextSwitches: 23.09K (23090) - ScannerThreadsTotalWallClockTime: 1h50m - MaterializeTupleTime(*): 6s727ms - ScannerThreadsSysTime: 32s885ms - ScannerThreadsUserTime: 2m33s - ScannerThreadsVoluntaryContextSwitches: 3.78M (3775567) - TotalRawHdfsReadTime(*): 7s596ms - TotalReadThroughput: 266.87 KB/sec Filter 2 (16.00 MB): - Rows processed: 2.02M (2020608) - Rows rejected: 142.58K (142578) - Rows total: 78.49M (78491899) Filter 5 (16.00 MB): - Rows processed: 1.86M (1864718) - Rows rejected: 14 (14) - Rows total: 78.35M (78349321) Filter 6 (1.00 MB): - Files processed: 1.83K (1830) - Files rejected: 1.71K (1711) - Files total: 1.83K (1830) - RowGroups processed: 76.48K (76483) - RowGroups rejected: 0 (0) - RowGroups total: 76.48K (76483) - Rows processed: 1.95M (1949696) - Rows rejected: 0 (0) - Rows total: 78.35M (78349307) - Splits processed: 119 (119) - Splits rejected: 0 (0) - Splits total: 119 (119) Instance 7f40dcb034de70b7:b5 (host=vc1517.foo:22000):(Total: 9m17s, non-child: 8m56s, % non-child: 96.10%) Hdfs split stats (:<# splits>/): 4:232/13.26 GB 5:207/12.74 GB 6:235/13.19 GB 1:224/12.33 GB 7:234/13.97 GB 2:242/13.85 GB 0:210/11.83 GB 3:232/14.49 GB Filter 6 arrival: 950ms Filter 2 arrival: 12s674ms Filter 5 arrival: 16s352ms MemoryUsage(16s000ms): 34.23 MB, 65.38 MB, 66.77 MB, 66.02 MB, 65.81 MB, 65.71 MB, 65.45 MB, 65.74 MB, 65.72 MB, 66.62 MB, 66.84 MB, 66.63 MB, 66.66 MB, 66.77 MB, 66.09 MB, 65.78 MB, 65.82 MB, 66.49 MB, 66.77 MB, 66.73 MB, 66.71 MB, 66.61 MB, 66.85 MB, 66.64 MB, 65.79 MB, 65.44 MB, 65.77 MB, 65.67 MB, 65.86 MB, 65.94 MB, 66.62 MB, 64.54 MB, 64.56 MB, 63.02 MB ThreadUsage(16s000ms): 12, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.98 - BloomFilterBytes: 33.00 MB (34603008) - PeakMemoryUsage: 67.63 MB (70915297) - PerHostPeakMemUsage: 161.67 GB (173595249376) - RowsProduced: 79.03M (79027239) - TotalNetworkReceiveTime: 725.128ms - TotalNetworkSendTime: 8m50s - TotalStorageWaitTime: 12s338ms - TotalThreadsInvoluntaryContextSwitches: 17.44K (17442) - TotalThreadsTotalWallClockTime: 2h - TotalThreadsSysTime: 21s221ms - TotalThreadsUserTime: 1m51s - TotalThreadsVoluntaryContextSwitches: 900.30K (900299) Fragment Instance Lifecycle Timings: - ExecTime: 9m16s - ExecTreeExecTime: 4s235ms - OpenTime: 1s102ms - ExecTreeOpenTime: 923.038ms - PrepareTime: 49.350ms - ExecTreePrepareTime: 6.286ms DataStreamSender (dst_id=22):(Total: 16s411ms, non-child: 16s411ms, % non-child: 100.00%) - BytesSent: 730.57 MB (766058488) - NetworkThroughput(*): 78.13 MB/sec - OverallThroughput: 44.52 MB/sec - PeakMemoryUsage: 4.98 MB (5224192) - RowsReturned: 79.03M (79027239) - SerializeBatchTime: 7s041ms - TransmitDataRPCTime: 9s351ms - UncompressedRowBatchSize: 2.21 GB (2371667474) CodeGen:(Total: 199.060ms, non-child: 199.060ms, % non-child: 100.00%) - CodegenTime: 1.044ms - CompileTime: 54.957ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 122.767ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 20.926ms HASH_JOIN_NODE (id=5):(Total: 5s128ms, non-child: 3s321ms, % non-child: 64.76%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.616ms - PeakMemoryUsage: 1.24 MB (1298249) - ProbeRows: 79.03M (79027239) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3s173ms - RowsReturned: 79.03M (79027239) - RowsReturnedRate: 15.41 M/sec Hash Join Builder (join_node_id=5): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 54.609us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 137.135us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 67.099us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 725.142ms, non-child: 23.380us, % non-child: 0.00%) BytesReceived(16s000ms): 932.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 6.696us - DeserializeRowBatchTimer: 16.739us - FirstBatchArrivalWaitTime: 697.925ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 165.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=3):(Total: 1s082ms, non-child: 1s082ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:232/13.26 GB 5:207/12.74 GB 6:235/13.19 GB 1:224/12.33 GB 7:234/13.97 GB 2:242/13.85 GB 0:210/11.83 GB 3:232/14.49 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 120 out of 120 Runtime filters: Only following filters arrived: 6, waited 80ms Hdfs Read Thread Concurrency Bucket: 0:99.01% 1:0.7201% 2:0.09001% 3:0.09001% 4:0.09001% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1696 PARQUET/SNAPPY:120 BytesRead(16s000ms): 12.48 MB, 13.98 MB, 15.34 MB, 21.46 MB, 28.77 MB, 30.06 MB, 38.80 MB, 43.46 MB, 45.06 MB, 55.83 MB, 58.44 MB, 60.93 MB, 71.61 MB, 73.07 MB, 77.40 MB, 86.41 MB, 87.82 MB, 96.03 MB, 101.20 MB, 102.79 MB, 111.59 MB, 115.23 MB, 116.35 MB, 119.46 MB, 129.01 MB, 129.88 MB, 130.94 MB, 132.05 MB, 137.42 MB, 141.37 MB, 143.81 MB, 143.81 MB, 143.81 MB, 143.81 MB - FooterProcessingTime: (Avg: 57.909ms ; Min: 25.339ms ; Max: 191.229ms ; Number of samples: 120) - AverageHdfsReadThreadConcurrency: 0.02 - AverageScannerThreadConcurrency: 11.98 - BytesRead: 143.81 MB (150793104) - BytesReadDataNodeCache: 0 - BytesReadLocal: 143.81 MB (150793104) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 143.81 MB (150793104) - DecompressionTime: 2s543ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 120 (120) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 29.39 MB (30820609) - PerReadThreadRawHdfsThroughput: 23.24 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 110.621ms - RowBatchQueuePutWaitTime: 1h49m - RowsRead: 79.17M (79172716) - RowsReturned: 79.03M (79027239) - RowsReturnedRate: 73.01 M/sec - ScanRangesComplete: 1.82K (1816) - ScannerThreadsInvoluntaryContextSwitches: 12.51K (12509) - ScannerThreadsTotalWallClockTime: 1h51m - MaterializeTupleTime(*): 6s444ms - ScannerThreadsSysTime: 20s325ms - ScannerThreadsUserTime: 1m29s - ScannerThreadsVoluntaryContextSwitches: 897.12K (897118) - TotalRawHdfsReadTime(*): 6s187ms - TotalReadThroughput: 265.09 KB/sec Filter 2 (16.00 MB): - Rows processed: 2.07M (2069573) - Rows rejected: 145.45K (145452) - Rows total: 79.17M (79172716) Filter 5 (16.00 MB): - Rows processed: 1.85M (1849369) - Rows rejected: 25 (25) - Rows total: 79.03M (79027264) Filter 6 (1.00 MB): - Files processed: 1.82K (1816) - Files rejected: 1.70K (1696) - Files total: 1.82K (1816) - RowGroups processed: 77.15K (77148) - RowGroups rejected: 0 (0) - RowGroups total: 77.15K (77148) - Rows processed: 1.97M (1966080) - Rows rejected: 0 (0) - Rows total: 79.03M (79027239) - Splits processed: 120 (120) - Splits rejected: 0 (0) - Splits total: 120 (120) Instance 7f40dcb034de70b7:c2 (host=vd1124.foo:22000):(Total: 9m17s, non-child: 8m55s, % non-child: 96.06%) Hdfs split stats (:<# splits>/): 0:229/14.13 GB 7:205/11.82 GB 5:242/14.57 GB 6:215/11.77 GB 4:248/14.63 GB 1:221/13.35 GB 3:212/11.61 GB 2:225/13.83 GB Filter 6 arrival: 878ms Filter 2 arrival: 12s875ms Filter 5 arrival: 16s463ms MemoryUsage(16s000ms): 34.61 MB, 66.30 MB, 66.81 MB, 66.39 MB, 66.77 MB, 66.79 MB, 66.63 MB, 66.76 MB, 66.78 MB, 65.85 MB, 65.79 MB, 65.76 MB, 66.45 MB, 66.80 MB, 66.57 MB, 65.80 MB, 65.81 MB, 65.50 MB, 64.78 MB, 64.70 MB, 64.87 MB, 66.48 MB, 66.74 MB, 66.77 MB, 66.64 MB, 66.36 MB, 66.83 MB, 66.78 MB, 66.79 MB, 66.70 MB, 61.72 MB, 60.12 MB, 60.07 MB, 60.16 MB ThreadUsage(16s000ms): 12, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.98 - BloomFilterBytes: 33.00 MB (34603008) - PeakMemoryUsage: 67.59 MB (70872527) - PerHostPeakMemUsage: 161.66 GB (173581060307) - RowsProduced: 77.61M (77608273) - TotalNetworkReceiveTime: 657.843ms - TotalNetworkSendTime: 8m50s - TotalStorageWaitTime: 14s422ms - TotalThreadsInvoluntaryContextSwitches: 26.88K (26875) - TotalThreadsTotalWallClockTime: 2h - TotalThreadsSysTime: 1m29s - TotalThreadsUserTime: 2m17s - TotalThreadsVoluntaryContextSwitches: 8.01M (8007607) Fragment Instance Lifecycle Timings: - ExecTime: 9m16s - ExecTreeExecTime: 3s737ms - OpenTime: 1s199ms - ExecTreeOpenTime: 1s022ms - PrepareTime: 48.873ms - ExecTreePrepareTime: 5.881ms DataStreamSender (dst_id=22):(Total: 17s061ms, non-child: 17s061ms, % non-child: 100.00%) - BytesSent: 719.14 MB (754076973) - NetworkThroughput(*): 74.19 MB/sec - OverallThroughput: 42.15 MB/sec - PeakMemoryUsage: 4.92 MB (5158656) - RowsReturned: 77.61M (77608273) - SerializeBatchTime: 7s348ms - TransmitDataRPCTime: 9s692ms - UncompressedRowBatchSize: 2.17 GB (2329083214) CodeGen:(Total: 192.283ms, non-child: 192.283ms, % non-child: 100.00%) - CodegenTime: 913.822us - CompileTime: 53.375ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 121.616ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 16.927ms HASH_JOIN_NODE (id=5):(Total: 4s721ms, non-child: 3s224ms, % non-child: 68.30%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.451ms - PeakMemoryUsage: 1.24 MB (1296613) - ProbeRows: 77.61M (77608273) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3s052ms - RowsReturned: 77.61M (77608273) - RowsReturnedRate: 16.44 M/sec Hash Join Builder (join_node_id=5): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 25.412us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 153.589us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 45.959us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 657.852ms, non-child: 19.906us, % non-child: 0.00%) BytesReceived(16s000ms): 932.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 3.813us - DeserializeRowBatchTimer: 19.298us - FirstBatchArrivalWaitTime: 612.910ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 182.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=3):(Total: 839.489ms, non-child: 839.489ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:229/14.13 GB 7:205/11.82 GB 5:242/14.57 GB 6:215/11.77 GB 4:248/14.63 GB 1:221/13.35 GB 3:212/11.61 GB 2:225/13.83 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 117 out of 117 Runtime filters: Only following filters arrived: 6, waited 161ms Hdfs Read Thread Concurrency Bucket: 0:98.92% 1:0.9017% 2:0.1803% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1680 PARQUET/SNAPPY:117 BytesRead(16s000ms): 13.37 MB, 14.75 MB, 14.75 MB, 18.95 MB, 29.01 MB, 29.55 MB, 38.28 MB, 43.32 MB, 43.95 MB, 54.69 MB, 57.89 MB, 58.90 MB, 71.46 MB, 72.60 MB, 74.78 MB, 87.20 MB, 87.39 MB, 92.88 MB, 101.74 MB, 101.93 MB, 104.61 MB, 115.75 MB, 116.38 MB, 117.05 MB, 121.72 MB, 130.73 MB, 131.05 MB, 131.53 MB, 132.22 MB, 133.46 MB, 141.04 MB, 142.02 MB, 142.02 MB, 142.02 MB - FooterProcessingTime: (Avg: 72.556ms ; Min: 4.380ms ; Max: 401.391ms ; Number of samples: 117) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 11.99 - BytesRead: 142.02 MB (148923450) - BytesReadDataNodeCache: 0 - BytesReadLocal: 142.02 MB (148923450) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 142.02 MB (148923450) - DecompressionTime: 1s846ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 117 (117) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 29.33 MB (30758224) - PerReadThreadRawHdfsThroughput: 20.24 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 197.466ms - RowBatchQueuePutWaitTime: 1h47m - RowsRead: 77.75M (77749927) - RowsReturned: 77.61M (77608273) - RowsReturnedRate: 92.45 M/sec - ScanRangesComplete: 1.80K (1797) - ScannerThreadsInvoluntaryContextSwitches: 21.86K (21858) - ScannerThreadsTotalWallClockTime: 1h51m - MaterializeTupleTime(*): 6s672ms - ScannerThreadsSysTime: 1m28s - ScannerThreadsUserTime: 1m53s - ScannerThreadsVoluntaryContextSwitches: 8.00M (8004470) - TotalRawHdfsReadTime(*): 7s018ms - TotalReadThroughput: 262.04 KB/sec Filter 2 (16.00 MB): - Rows processed: 2.03M (2031958) - Rows rejected: 141.62K (141624) - Rows total: 77.75M (77749927) Filter 5 (16.00 MB): - Rows processed: 1.78M (1775646) - Rows rejected: 30 (30) - Rows total: 77.61M (77608303) Filter 6 (1.00 MB): - Files processed: 1.80K (1797) - Files rejected: 1.68K (1680) - Files total: 1.80K (1797) - RowGroups processed: 75.76K (75762) - RowGroups rejected: 0 (0) - RowGroups total: 75.76K (75762) - Rows processed: 1.92M (1916928) - Rows rejected: 0 (0) - Rows total: 77.61M (77608273) - Splits processed: 117 (117) - Splits rejected: 0 (0) - Splits total: 117 (117) Instance 7f40dcb034de70b7:e7 (host=vc1504.foo:22000):(Total: 9m17s, non-child: 8m56s, % non-child: 96.28%) Hdfs split stats (:<# splits>/): 2:235/13.45 GB 4:211/12.88 GB 0:213/12.05 GB 7:229/12.92 GB 1:238/13.96 GB 5:233/12.95 GB 3:216/13.50 GB 6:240/13.94 GB Filter 6 arrival: 718ms Filter 2 arrival: 13s435ms Filter 5 arrival: 16s907ms MemoryUsage(16s000ms): 34.16 MB, 65.76 MB, 66.73 MB, 66.56 MB, 66.79 MB, 66.79 MB, 66.69 MB, 66.80 MB, 66.70 MB, 66.49 MB, 66.80 MB, 66.73 MB, 65.79 MB, 65.88 MB, 65.76 MB, 65.72 MB, 65.78 MB, 66.08 MB, 66.80 MB, 66.77 MB, 66.46 MB, 65.63 MB, 65.85 MB, 65.73 MB, 65.93 MB, 66.83 MB, 66.81 MB, 66.82 MB, 66.62 MB, 66.70 MB, 63.40 MB, 62.43 MB, 62.33 MB, 62.45 MB ThreadUsage(16s000ms): 12, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.97 - BloomFilterBytes: 33.00 MB (34603008) - PeakMemoryUsage: 67.62 MB (70903471) - PerHostPeakMemUsage: 161.66 GB (173576966506) - RowsProduced: 78.12M (78117763) - TotalNetworkReceiveTime: 482.497ms - TotalNetworkSendTime: 8m54s - TotalStorageWaitTime: 13s391ms - TotalThreadsInvoluntaryContextSwitches: 21.04K (21043) - TotalThreadsTotalWallClockTime: 2h - TotalThreadsSysTime: 8s768ms - TotalThreadsUserTime: 2m46s - TotalThreadsVoluntaryContextSwitches: 1.58M (1575809) Fragment Instance Lifecycle Timings: - ExecTime: 9m16s - ExecTreeExecTime: 3s509ms - OpenTime: 1s054ms - ExecTreeOpenTime: 873.901ms - PrepareTime: 61.561ms - ExecTreePrepareTime: 7.375ms DataStreamSender (dst_id=22):(Total: 16s203ms, non-child: 16s203ms, % non-child: 100.00%) - BytesSent: 721.51 MB (756553886) - NetworkThroughput(*): 75.83 MB/sec - OverallThroughput: 44.53 MB/sec - PeakMemoryUsage: 4.88 MB (5117696) - RowsReturned: 78.12M (78117763) - SerializeBatchTime: 6s669ms - TransmitDataRPCTime: 9s514ms - UncompressedRowBatchSize: 2.18 GB (2344373378) CodeGen:(Total: 205.529ms, non-child: 205.529ms, % non-child: 100.00%) - CodegenTime: 1.132ms - CompileTime: 51.330ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 127.511ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 26.241ms HASH_JOIN_NODE (id=5):(Total: 4s356ms, non-child: 3s085ms, % non-child: 70.84%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.418ms - PeakMemoryUsage: 1.24 MB (1295751) - ProbeRows: 78.12M (78117763) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 2s936ms - RowsReturned: 78.12M (78117763) - RowsReturnedRate: 17.93 M/sec Hash Join Builder (join_node_id=5): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 26.892us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 134.643us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 60.416us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 482.512ms, non-child: 24.744us, % non-child: 0.01%) BytesReceived(16s000ms): 932.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 4.470us - DeserializeRowBatchTimer: 24.537us - FirstBatchArrivalWaitTime: 446.778ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 248.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=3):(Total: 788.427ms, non-child: 788.427ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:235/13.45 GB 4:211/12.88 GB 0:213/12.05 GB 7:229/12.92 GB 1:238/13.96 GB 5:233/12.95 GB 3:216/13.50 GB 6:240/13.94 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 118 out of 118 Runtime filters: Only following filters arrived: 6, waited 301ms Hdfs Read Thread Concurrency Bucket: 0:98.92% 1:0.9928% 2:0% 3:0.09025% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1697 PARQUET/SNAPPY:118 BytesRead(16s000ms): 13.21 MB, 14.57 MB, 14.57 MB, 19.42 MB, 29.04 MB, 29.29 MB, 38.45 MB, 43.35 MB, 44.09 MB, 56.02 MB, 57.62 MB, 58.48 MB, 71.27 MB, 72.07 MB, 74.44 MB, 86.49 MB, 86.57 MB, 91.62 MB, 101.05 MB, 101.13 MB, 104.89 MB, 114.94 MB, 115.39 MB, 115.98 MB, 126.52 MB, 130.38 MB, 130.38 MB, 130.64 MB, 131.98 MB, 137.27 MB, 142.25 MB, 142.25 MB, 142.25 MB, 142.25 MB - FooterProcessingTime: (Avg: 63.814ms ; Min: 19.897ms ; Max: 168.050ms ; Number of samples: 118) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 11.99 - BytesRead: 142.25 MB (149161459) - BytesReadDataNodeCache: 0 - BytesReadLocal: 142.25 MB (149161459) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 142.25 MB (149161459) - DecompressionTime: 3s703ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 118 (118) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 29.53 MB (30963180) - PerReadThreadRawHdfsThroughput: 20.02 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 83.126ms - RowBatchQueuePutWaitTime: 1h48m - RowsRead: 78.26M (78262647) - RowsReturned: 78.12M (78117763) - RowsReturnedRate: 99.08 M/sec - ScanRangesComplete: 1.81K (1815) - ScannerThreadsInvoluntaryContextSwitches: 16.42K (16422) - ScannerThreadsTotalWallClockTime: 1h51m - MaterializeTupleTime(*): 6s052ms - ScannerThreadsSysTime: 8s053ms - ScannerThreadsUserTime: 2m26s - ScannerThreadsVoluntaryContextSwitches: 1.57M (1572686) - TotalRawHdfsReadTime(*): 7s105ms - TotalReadThroughput: 262.70 KB/sec Filter 2 (16.00 MB): - Rows processed: 2.05M (2051572) - Rows rejected: 144.86K (144860) - Rows total: 78.26M (78262647) Filter 5 (16.00 MB): - Rows processed: 1.86M (1860632) - Rows rejected: 24 (24) - Rows total: 78.12M (78117787) Filter 6 (1.00 MB): - Files processed: 1.81K (1815) - Files rejected: 1.70K (1697) - Files total: 1.81K (1815) - RowGroups processed: 76.26K (76261) - RowGroups rejected: 0 (0) - RowGroups total: 76.26K (76261) - Rows processed: 1.93M (1933312) - Rows rejected: 0 (0) - Rows total: 78.12M (78117763) - Splits processed: 118 (118) - Splits rejected: 0 (0) - Splits total: 118 (118) Instance 7f40dcb034de70b7:b6 (host=vd1329.foo:22000):(Total: 9m17s, non-child: 8m55s, % non-child: 96.02%) Hdfs split stats (:<# splits>/): 3:238/14.00 GB 4:223/13.53 GB 6:224/13.29 GB 2:221/12.77 GB 0:211/12.16 GB 1:235/13.54 GB 7:226/12.87 GB 5:240/13.50 GB Filter 6 arrival: 933ms Filter 2 arrival: 12s693ms Filter 5 arrival: 16s390ms MemoryUsage(16s000ms): 34.40 MB, 66.31 MB, 66.80 MB, 66.55 MB, 66.80 MB, 66.76 MB, 66.53 MB, 66.78 MB, 66.64 MB, 66.73 MB, 66.76 MB, 66.14 MB, 66.78 MB, 66.61 MB, 65.33 MB, 64.74 MB, 64.17 MB, 64.77 MB, 64.76 MB, 65.23 MB, 64.72 MB, 64.79 MB, 64.77 MB, 64.72 MB, 65.79 MB, 65.79 MB, 65.79 MB, 65.74 MB, 65.28 MB, 64.54 MB, 64.54 MB, 64.52 MB, 64.56 MB, 64.52 MB ThreadUsage(16s000ms): 12, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.98 - BloomFilterBytes: 33.00 MB (34603008) - PeakMemoryUsage: 67.62 MB (70904464) - PerHostPeakMemUsage: 161.68 GB (173605114777) - RowsProduced: 78.84M (78835967) - TotalNetworkReceiveTime: 693.370ms - TotalNetworkSendTime: 8m51s - TotalStorageWaitTime: 12s426ms - TotalThreadsInvoluntaryContextSwitches: 20.07K (20069) - TotalThreadsTotalWallClockTime: 2h - TotalThreadsSysTime: 21s035ms - TotalThreadsUserTime: 2m17s - TotalThreadsVoluntaryContextSwitches: 1.19M (1189505) Fragment Instance Lifecycle Timings: - ExecTime: 9m16s - ExecTreeExecTime: 4s417ms - OpenTime: 1s142ms - ExecTreeOpenTime: 949.598ms - PrepareTime: 51.718ms - ExecTreePrepareTime: 7.220ms DataStreamSender (dst_id=22):(Total: 16s635ms, non-child: 16s635ms, % non-child: 100.00%) - BytesSent: 729.31 MB (764737269) - NetworkThroughput(*): 77.34 MB/sec - OverallThroughput: 43.84 MB/sec - PeakMemoryUsage: 4.93 MB (5166848) - RowsReturned: 78.84M (78835967) - SerializeBatchTime: 7s186ms - TransmitDataRPCTime: 9s430ms - UncompressedRowBatchSize: 2.20 GB (2365927226) CodeGen:(Total: 211.511ms, non-child: 211.511ms, % non-child: 100.00%) - CodegenTime: 1.116ms - CompileTime: 61.411ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 129.902ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 19.777ms HASH_JOIN_NODE (id=5):(Total: 5s337ms, non-child: 3s480ms, % non-child: 65.20%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.465ms - PeakMemoryUsage: 1.23 MB (1293691) - ProbeRows: 78.84M (78835967) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3s337ms - RowsReturned: 78.84M (78835967) - RowsReturnedRate: 14.77 M/sec Hash Join Builder (join_node_id=5): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 36.831us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 114.752us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 56.986us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 693.379ms, non-child: 19.919us, % non-child: 0.00%) BytesReceived(16s000ms): 932.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 4.497us - DeserializeRowBatchTimer: 19.104us - FirstBatchArrivalWaitTime: 655.828ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 173.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=3):(Total: 1s164ms, non-child: 1s164ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:238/14.00 GB 4:223/13.53 GB 6:224/13.29 GB 2:221/12.77 GB 0:211/12.16 GB 1:235/13.54 GB 7:226/12.87 GB 5:240/13.50 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 119 out of 119 Runtime filters: Only following filters arrived: 6, waited 100ms Hdfs Read Thread Concurrency Bucket: 0:98.91% 1:0.9973% 2:0% 3:0% 4:0% 5:0.09066% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1699 PARQUET/SNAPPY:119 BytesRead(16s000ms): 13.35 MB, 14.71 MB, 14.71 MB, 20.71 MB, 29.38 MB, 29.78 MB, 40.68 MB, 44.21 MB, 46.07 MB, 58.61 MB, 58.79 MB, 64.17 MB, 73.21 MB, 73.61 MB, 82.09 MB, 87.44 MB, 88.67 MB, 101.52 MB, 102.02 MB, 104.50 MB, 116.45 MB, 116.48 MB, 116.48 MB, 122.33 MB, 130.98 MB, 130.98 MB, 130.98 MB, 133.00 MB, 143.24 MB, 144.16 MB, 144.16 MB, 144.16 MB, 144.16 MB, 144.16 MB - FooterProcessingTime: (Avg: 58.148ms ; Min: 6.228ms ; Max: 193.888ms ; Number of samples: 119) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 11.99 - BytesRead: 144.16 MB (151164259) - BytesReadDataNodeCache: 0 - BytesReadLocal: 144.16 MB (151164259) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 144.16 MB (151164259) - DecompressionTime: 644.982ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 119 (119) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 29.52 MB (30953846) - PerReadThreadRawHdfsThroughput: 23.48 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 149.172ms - RowBatchQueuePutWaitTime: 1h48m - RowsRead: 78.98M (78982102) - RowsReturned: 78.84M (78835967) - RowsReturnedRate: 67.67 M/sec - ScanRangesComplete: 1.82K (1818) - ScannerThreadsInvoluntaryContextSwitches: 15.11K (15105) - ScannerThreadsTotalWallClockTime: 1h51m - MaterializeTupleTime(*): 6s432ms - ScannerThreadsSysTime: 20s318ms - ScannerThreadsUserTime: 1m54s - ScannerThreadsVoluntaryContextSwitches: 1.19M (1186292) - TotalRawHdfsReadTime(*): 6s140ms - TotalReadThroughput: 267.43 KB/sec Filter 2 (16.00 MB): - Rows processed: 2.08M (2075340) - Rows rejected: 146.09K (146091) - Rows total: 78.98M (78982102) Filter 5 (16.00 MB): - Rows processed: 1.81M (1810476) - Rows rejected: 44 (44) - Rows total: 78.84M (78836011) Filter 6 (1.00 MB): - Files processed: 1.82K (1818) - Files rejected: 1.70K (1699) - Files total: 1.82K (1818) - RowGroups processed: 76.95K (76954) - RowGroups rejected: 0 (0) - RowGroups total: 76.95K (76954) - Rows processed: 1.95M (1949696) - Rows rejected: 0 (0) - Rows total: 78.84M (78835967) - Splits processed: 119 (119) - Splits rejected: 0 (0) - Splits total: 119 (119) Instance 7f40dcb034de70b7:ba (host=vc1520.foo:22000):(Total: 9m17s, non-child: 8m56s, % non-child: 96.12%) Hdfs split stats (:<# splits>/): 5:228/13.70 GB 2:224/13.06 GB 4:241/13.53 GB 0:232/13.45 GB 6:234/13.63 GB 7:227/13.33 GB 1:224/13.47 GB 3:204/11.51 GB Filter 6 arrival: 883ms Filter 2 arrival: 12s767ms Filter 5 arrival: 16s384ms MemoryUsage(16s000ms): 34.95 MB, 65.75 MB, 65.81 MB, 65.73 MB, 66.82 MB, 66.81 MB, 66.58 MB, 66.81 MB, 66.78 MB, 66.52 MB, 66.81 MB, 66.57 MB, 66.79 MB, 66.85 MB, 66.42 MB, 66.80 MB, 66.76 MB, 66.79 MB, 66.85 MB, 66.83 MB, 66.63 MB, 66.82 MB, 66.84 MB, 66.79 MB, 64.66 MB, 65.76 MB, 66.79 MB, 66.85 MB, 66.86 MB, 66.28 MB, 63.40 MB, 60.13 MB, 60.17 MB, 58.51 MB ThreadUsage(16s000ms): 12, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.97 - BloomFilterBytes: 33.00 MB (34603008) - PeakMemoryUsage: 67.66 MB (70949310) - PerHostPeakMemUsage: 161.70 GB (173620278505) - RowsProduced: 77.67M (77672539) - TotalNetworkReceiveTime: 640.787ms - TotalNetworkSendTime: 8m50s - TotalStorageWaitTime: 11s933ms - TotalThreadsInvoluntaryContextSwitches: 28.53K (28531) - TotalThreadsTotalWallClockTime: 2h - TotalThreadsSysTime: 1m37s - TotalThreadsUserTime: 2m28s - TotalThreadsVoluntaryContextSwitches: 9.17M (9171078) Fragment Instance Lifecycle Timings: - ExecTime: 9m16s - ExecTreeExecTime: 3s714ms - OpenTime: 1s114ms - ExecTreeOpenTime: 923.948ms - PrepareTime: 57.267ms - ExecTreePrepareTime: 7.057ms DataStreamSender (dst_id=22):(Total: 16s841ms, non-child: 16s841ms, % non-child: 100.00%) - BytesSent: 723.76 MB (758912957) - NetworkThroughput(*): 77.03 MB/sec - OverallThroughput: 42.97 MB/sec - PeakMemoryUsage: 4.94 MB (5183232) - RowsReturned: 77.67M (77672539) - SerializeBatchTime: 7s425ms - TransmitDataRPCTime: 9s396ms - UncompressedRowBatchSize: 2.17 GB (2331011906) CodeGen:(Total: 211.937ms, non-child: 211.937ms, % non-child: 100.00%) - CodegenTime: 1.119ms - CompileTime: 57.578ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 130.974ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 22.967ms HASH_JOIN_NODE (id=5):(Total: 4s605ms, non-child: 3s256ms, % non-child: 70.70%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.348ms - PeakMemoryUsage: 1.24 MB (1298500) - ProbeRows: 77.67M (77672539) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3s094ms - RowsReturned: 77.67M (77672539) - RowsReturnedRate: 16.87 M/sec Hash Join Builder (join_node_id=5): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 22.712us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 112.576us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 54.027us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 640.797ms, non-child: 17.687us, % non-child: 0.00%) BytesReceived(16s000ms): 963.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 4.942us - DeserializeRowBatchTimer: 16.812us - FirstBatchArrivalWaitTime: 637.413ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 187.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=3):(Total: 708.860ms, non-child: 708.860ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:228/13.70 GB 2:224/13.06 GB 4:241/13.53 GB 0:232/13.45 GB 6:234/13.63 GB 7:227/13.33 GB 1:224/13.47 GB 3:204/11.51 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 118 out of 118 Runtime filters: Only following filters arrived: 6, waited 140ms Hdfs Read Thread Concurrency Bucket: 0:99.1% 1:0.8123% 2:0.09025% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1696 PARQUET/SNAPPY:118 BytesRead(16s000ms): 13.93 MB, 14.86 MB, 15.16 MB, 21.21 MB, 29.79 MB, 30.44 MB, 40.04 MB, 44.77 MB, 45.93 MB, 58.13 MB, 59.70 MB, 62.59 MB, 74.82 MB, 75.17 MB, 78.52 MB, 89.51 MB, 89.97 MB, 95.73 MB, 104.27 MB, 105.08 MB, 110.94 MB, 119.06 MB, 119.14 MB, 120.26 MB, 129.45 MB, 133.45 MB, 134.27 MB, 135.44 MB, 135.44 MB, 137.23 MB, 143.79 MB, 145.11 MB, 145.11 MB, 145.11 MB - FooterProcessingTime: (Avg: 58.040ms ; Min: 22.870ms ; Max: 197.911ms ; Number of samples: 118) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 11.97 - BytesRead: 145.11 MB (152156214) - BytesReadDataNodeCache: 0 - BytesReadLocal: 145.11 MB (152156214) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 145.11 MB (152156214) - DecompressionTime: 858.908ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 118 (118) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 29.47 MB (30900720) - PerReadThreadRawHdfsThroughput: 23.98 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 134.513ms - RowBatchQueuePutWaitTime: 1h47m - RowsRead: 77.82M (77815913) - RowsReturned: 77.67M (77672539) - RowsReturnedRate: 109.57 M/sec - ScanRangesComplete: 1.81K (1814) - ScannerThreadsInvoluntaryContextSwitches: 23.53K (23531) - ScannerThreadsTotalWallClockTime: 1h51m - MaterializeTupleTime(*): 6s484ms - ScannerThreadsSysTime: 1m36s - ScannerThreadsUserTime: 2m5s - ScannerThreadsVoluntaryContextSwitches: 9.17M (9167935) - TotalRawHdfsReadTime(*): 6s050ms - TotalReadThroughput: 268.21 KB/sec Filter 2 (16.00 MB): - Rows processed: 2.04M (2036736) - Rows rejected: 143.32K (143316) - Rows total: 77.82M (77815913) Filter 5 (16.00 MB): - Rows processed: 1.84M (1840186) - Rows rejected: 58 (58) - Rows total: 77.67M (77672597) Filter 6 (1.00 MB): - Files processed: 1.81K (1814) - Files rejected: 1.70K (1696) - Files total: 1.81K (1814) - RowGroups processed: 75.83K (75828) - RowGroups rejected: 0 (0) - RowGroups total: 75.83K (75828) - Rows processed: 1.93M (1933312) - Rows rejected: 0 (0) - Rows total: 77.67M (77672539) - Splits processed: 118 (118) - Splits rejected: 0 (0) - Splits total: 118 (118) Instance 7f40dcb034de70b7:d4 (host=vd1142.foo:22000):(Total: 9m17s, non-child: 8m56s, % non-child: 96.14%) Hdfs split stats (:<# splits>/): 2:230/13.73 GB 7:221/12.51 GB 1:228/13.05 GB 4:239/14.02 GB 3:226/13.64 GB 5:222/12.51 GB 6:243/13.51 GB 0:219/12.74 GB Filter 6 arrival: 780ms Filter 2 arrival: 13s192ms Filter 5 arrival: 16s695ms MemoryUsage(16s000ms): 34.22 MB, 65.26 MB, 65.81 MB, 65.42 MB, 65.81 MB, 65.79 MB, 65.50 MB, 65.82 MB, 65.49 MB, 65.81 MB, 65.81 MB, 65.28 MB, 65.80 MB, 65.84 MB, 65.86 MB, 66.78 MB, 66.40 MB, 65.55 MB, 65.77 MB, 66.14 MB, 66.53 MB, 66.77 MB, 66.83 MB, 66.69 MB, 65.69 MB, 65.90 MB, 65.81 MB, 65.83 MB, 65.26 MB, 65.15 MB, 63.53 MB, 63.60 MB, 63.54 MB, 62.92 MB ThreadUsage(16s000ms): 12, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.98 - BloomFilterBytes: 33.00 MB (34603008) - PeakMemoryUsage: 67.46 MB (70738423) - PerHostPeakMemUsage: 161.67 GB (173589033785) - RowsProduced: 78.82M (78824352) - TotalNetworkReceiveTime: 550.014ms - TotalNetworkSendTime: 8m53s - TotalStorageWaitTime: 13s433ms - TotalThreadsInvoluntaryContextSwitches: 17.14K (17140) - TotalThreadsTotalWallClockTime: 2h - TotalThreadsSysTime: 4s755ms - TotalThreadsUserTime: 2m3s - TotalThreadsVoluntaryContextSwitches: 347.29K (347293) Fragment Instance Lifecycle Timings: - ExecTime: 9m16s - ExecTreeExecTime: 3s973ms - OpenTime: 1s091ms - ExecTreeOpenTime: 909.898ms - PrepareTime: 53.765ms - ExecTreePrepareTime: 7.084ms DataStreamSender (dst_id=22):(Total: 16s445ms, non-child: 16s445ms, % non-child: 100.00%) - BytesSent: 729.19 MB (764608389) - NetworkThroughput(*): 75.85 MB/sec - OverallThroughput: 44.34 MB/sec - PeakMemoryUsage: 4.91 MB (5150464) - RowsReturned: 78.82M (78824352) - SerializeBatchTime: 6s813ms - TransmitDataRPCTime: 9s612ms - UncompressedRowBatchSize: 2.20 GB (2365578688) CodeGen:(Total: 201.831ms, non-child: 201.831ms, % non-child: 100.00%) - CodegenTime: 1.123ms - CompileTime: 51.328ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 128.797ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 21.285ms HASH_JOIN_NODE (id=5):(Total: 4s851ms, non-child: 3s182ms, % non-child: 65.59%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.602ms - PeakMemoryUsage: 1.24 MB (1296277) - ProbeRows: 78.82M (78824352) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3s033ms - RowsReturned: 78.82M (78824352) - RowsReturnedRate: 16.25 M/sec Hash Join Builder (join_node_id=5): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 23.892us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 196.443us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 60.755us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 550.026ms, non-child: 20.969us, % non-child: 0.00%) BytesReceived(16s000ms): 932.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 6.869us - DeserializeRowBatchTimer: 19.484us - FirstBatchArrivalWaitTime: 545.580ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 218.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=3):(Total: 1s120ms, non-child: 1s120ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:230/13.73 GB 7:221/12.51 GB 1:228/13.05 GB 4:239/14.02 GB 3:226/13.64 GB 5:222/12.51 GB 6:243/13.51 GB 0:219/12.74 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 119 out of 119 Runtime filters: Only following filters arrived: 6, waited 242ms Hdfs Read Thread Concurrency Bucket: 0:98.92% 1:0.8115% 2:0.1803% 3:0.09017% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1709 PARQUET/SNAPPY:119 BytesRead(16s000ms): 13.60 MB, 14.54 MB, 14.54 MB, 20.08 MB, 29.11 MB, 29.43 MB, 38.85 MB, 43.71 MB, 45.01 MB, 57.83 MB, 58.08 MB, 60.77 MB, 72.35 MB, 72.51 MB, 78.59 MB, 86.98 MB, 87.22 MB, 96.81 MB, 101.42 MB, 101.84 MB, 112.79 MB, 116.06 MB, 116.06 MB, 118.38 MB, 129.90 MB, 130.70 MB, 130.81 MB, 132.25 MB, 141.37 MB, 142.99 MB, 143.99 MB, 143.99 MB, 143.99 MB, 143.99 MB - FooterProcessingTime: (Avg: 65.850ms ; Min: 4.230ms ; Max: 752.996ms ; Number of samples: 119) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 11.98 - BytesRead: 143.99 MB (150987293) - BytesReadDataNodeCache: 0 - BytesReadLocal: 143.99 MB (150987293) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 143.99 MB (150987293) - DecompressionTime: 900.479ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 119 (119) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 29.29 MB (30714769) - PerReadThreadRawHdfsThroughput: 22.63 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 111.033ms - RowBatchQueuePutWaitTime: 1h49m - RowsRead: 78.97M (78968836) - RowsReturned: 78.82M (78824352) - RowsReturnedRate: 70.38 M/sec - ScanRangesComplete: 1.83K (1828) - ScannerThreadsInvoluntaryContextSwitches: 12.40K (12400) - ScannerThreadsTotalWallClockTime: 1h51m - MaterializeTupleTime(*): 5s935ms - ScannerThreadsSysTime: 4s092ms - ScannerThreadsUserTime: 1m41s - ScannerThreadsVoluntaryContextSwitches: 344.18K (344180) - TotalRawHdfsReadTime(*): 6s362ms - TotalReadThroughput: 265.91 KB/sec Filter 2 (16.00 MB): - Rows processed: 2.07M (2072676) - Rows rejected: 144.48K (144484) - Rows total: 78.97M (78968836) Filter 5 (16.00 MB): - Rows processed: 1.90M (1901568) - Rows rejected: 0 (0) - Rows total: 78.82M (78824352) Filter 6 (1.00 MB): - Files processed: 1.83K (1828) - Files rejected: 1.71K (1709) - Files total: 1.83K (1828) - RowGroups processed: 76.95K (76948) - RowGroups rejected: 0 (0) - RowGroups total: 76.95K (76948) - Rows processed: 1.95M (1949696) - Rows rejected: 0 (0) - Rows total: 78.82M (78824352) - Splits processed: 119 (119) - Splits rejected: 0 (0) - Splits total: 119 (119) Instance 7f40dcb034de70b7:ec (host=vc1508.foo:22000):(Total: 9m17s, non-child: 8m55s, % non-child: 96.09%) Hdfs split stats (:<# splits>/): 4:226/14.00 GB 0:249/14.40 GB 7:245/13.88 GB 3:214/11.63 GB 2:220/12.12 GB 1:211/13.17 GB 5:215/12.49 GB 6:242/14.01 GB Filter 6 arrival: 705ms Filter 2 arrival: 13s530ms Filter 5 arrival: 16s993ms MemoryUsage(16s000ms): 35.02 MB, 65.75 MB, 66.79 MB, 65.91 MB, 66.48 MB, 66.82 MB, 65.95 MB, 65.80 MB, 65.71 MB, 65.65 MB, 65.81 MB, 65.76 MB, 66.74 MB, 66.81 MB, 66.42 MB, 66.69 MB, 66.85 MB, 66.39 MB, 66.70 MB, 66.65 MB, 66.51 MB, 66.73 MB, 66.79 MB, 66.37 MB, 66.37 MB, 66.84 MB, 66.82 MB, 66.48 MB, 65.95 MB, 64.59 MB, 64.75 MB, 63.61 MB, 63.41 MB, 63.53 MB ThreadUsage(16s000ms): 12, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.98 - BloomFilterBytes: 33.00 MB (34603008) - PeakMemoryUsage: 67.53 MB (70808909) - PerHostPeakMemUsage: 161.67 GB (173591646984) - RowsProduced: 79.01M (79008757) - TotalNetworkReceiveTime: 473.838ms - TotalNetworkSendTime: 8m50s - TotalStorageWaitTime: 11s904ms - TotalThreadsInvoluntaryContextSwitches: 12.96K (12960) - TotalThreadsTotalWallClockTime: 2h - TotalThreadsSysTime: 1s698ms - TotalThreadsUserTime: 1m41s - TotalThreadsVoluntaryContextSwitches: 97.74K (97737) Fragment Instance Lifecycle Timings: - ExecTime: 9m16s - ExecTreeExecTime: 3s718ms - OpenTime: 1s060ms - ExecTreeOpenTime: 879.300ms - PrepareTime: 55.591ms - ExecTreePrepareTime: 7.313ms DataStreamSender (dst_id=22):(Total: 17s039ms, non-child: 17s039ms, % non-child: 100.00%) - BytesSent: 731.05 MB (766566610) - NetworkThroughput(*): 76.55 MB/sec - OverallThroughput: 42.90 MB/sec - PeakMemoryUsage: 5.02 MB (5265152) - RowsReturned: 79.01M (79008757) - SerializeBatchTime: 7s469ms - TransmitDataRPCTime: 9s550ms - UncompressedRowBatchSize: 2.21 GB (2371112766) CodeGen:(Total: 202.322ms, non-child: 202.322ms, % non-child: 100.00%) - CodegenTime: 1.145ms - CompileTime: 52.323ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 126.852ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 22.696ms HASH_JOIN_NODE (id=5):(Total: 4s566ms, non-child: 3s276ms, % non-child: 71.76%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.740ms - PeakMemoryUsage: 1.23 MB (1291817) - ProbeRows: 79.01M (79008757) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3s113ms - RowsReturned: 79.01M (79008757) - RowsReturnedRate: 17.30 M/sec Hash Join Builder (join_node_id=5): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 38.733us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 270.289us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 69.377us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 473.849ms, non-child: 21.376us, % non-child: 0.00%) BytesReceived(16s000ms): 963.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 5.659us - DeserializeRowBatchTimer: 24.063us - FirstBatchArrivalWaitTime: 428.949ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 253.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=3):(Total: 816.023ms, non-child: 816.023ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:226/14.00 GB 0:249/14.40 GB 7:245/13.88 GB 3:214/11.63 GB 2:220/12.12 GB 1:211/13.17 GB 5:215/12.49 GB 6:242/14.01 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 120 out of 120 Runtime filters: Only following filters arrived: 6, waited 322ms Hdfs Read Thread Concurrency Bucket: 0:99.01% 1:0.8079% 2:0.1795% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1702 PARQUET/SNAPPY:120 BytesRead(16s000ms): 13.45 MB, 14.38 MB, 14.38 MB, 19.34 MB, 28.72 MB, 29.18 MB, 38.64 MB, 43.23 MB, 44.81 MB, 56.93 MB, 57.45 MB, 60.71 MB, 71.91 MB, 72.32 MB, 78.43 MB, 86.85 MB, 86.93 MB, 96.15 MB, 101.50 MB, 101.65 MB, 111.40 MB, 115.78 MB, 115.85 MB, 117.31 MB, 129.33 MB, 130.53 MB, 130.53 MB, 130.85 MB, 136.23 MB, 140.27 MB, 144.15 MB, 144.15 MB, 144.15 MB, 144.15 MB - FooterProcessingTime: (Avg: 54.813ms ; Min: 23.182ms ; Max: 204.821ms ; Number of samples: 120) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 11.98 - BytesRead: 144.15 MB (151150074) - BytesReadDataNodeCache: 0 - BytesReadLocal: 144.15 MB (151150074) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 144.15 MB (151150074) - DecompressionTime: 577.827ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 120 (120) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 29.38 MB (30808027) - PerReadThreadRawHdfsThroughput: 22.80 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 76.440ms - RowBatchQueuePutWaitTime: 1h49m - RowsRead: 79.15M (79153347) - RowsReturned: 79.01M (79008757) - RowsReturnedRate: 96.82 M/sec - ScanRangesComplete: 1.82K (1822) - ScannerThreadsInvoluntaryContextSwitches: 7.89K (7894) - ScannerThreadsTotalWallClockTime: 1h51m - MaterializeTupleTime(*): 6s617ms - ScannerThreadsSysTime: 976.845ms - ScannerThreadsUserTime: 1m17s - ScannerThreadsVoluntaryContextSwitches: 94.55K (94551) - TotalRawHdfsReadTime(*): 6s321ms - TotalReadThroughput: 265.00 KB/sec Filter 2 (16.00 MB): - Rows processed: 2.08M (2083022) - Rows rejected: 144.56K (144562) - Rows total: 79.15M (79153347) Filter 5 (16.00 MB): - Rows processed: 1.84M (1838108) - Rows rejected: 28 (28) - Rows total: 79.01M (79008785) Filter 6 (1.00 MB): - Files processed: 1.82K (1822) - Files rejected: 1.70K (1702) - Files total: 1.82K (1822) - RowGroups processed: 77.12K (77125) - RowGroups rejected: 0 (0) - RowGroups total: 77.12K (77125) - Rows processed: 1.97M (1966080) - Rows rejected: 0 (0) - Rows total: 79.01M (79008757) - Splits processed: 120 (120) - Splits rejected: 0 (0) - Splits total: 120 (120) Instance 7f40dcb034de70b7:e9 (host=ve1129.foo:22000):(Total: 9m17s, non-child: 8m56s, % non-child: 96.13%) Hdfs split stats (:<# splits>/): 3:232/13.86 GB 5:213/11.67 GB 2:245/13.73 GB 1:214/12.49 GB 7:223/13.19 GB 0:223/13.32 GB 4:227/13.55 GB 6:239/13.86 GB Filter 6 arrival: 712ms Filter 2 arrival: 13s404ms Filter 5 arrival: 16s899ms MemoryUsage(16s000ms): 35.02 MB, 65.73 MB, 66.74 MB, 66.35 MB, 65.83 MB, 65.85 MB, 65.62 MB, 65.84 MB, 65.62 MB, 66.46 MB, 66.86 MB, 66.56 MB, 66.78 MB, 66.79 MB, 66.59 MB, 66.76 MB, 66.89 MB, 66.68 MB, 66.80 MB, 66.83 MB, 66.23 MB, 66.76 MB, 66.82 MB, 66.74 MB, 66.68 MB, 66.77 MB, 66.83 MB, 66.79 MB, 66.57 MB, 64.83 MB, 64.89 MB, 64.49 MB, 64.56 MB, 64.65 MB ThreadUsage(16s000ms): 12, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.98 - BloomFilterBytes: 33.00 MB (34603008) - PeakMemoryUsage: 67.62 MB (70904971) - PerHostPeakMemUsage: 161.69 GB (173609474137) - RowsProduced: 79.20M (79200245) - TotalNetworkReceiveTime: 454.282ms - TotalNetworkSendTime: 8m51s - TotalStorageWaitTime: 11s950ms - TotalThreadsInvoluntaryContextSwitches: 14.95K (14946) - TotalThreadsTotalWallClockTime: 2h - TotalThreadsSysTime: 6s358ms - TotalThreadsUserTime: 1m35s - TotalThreadsVoluntaryContextSwitches: 933.06K (933060) Fragment Instance Lifecycle Timings: - ExecTime: 9m16s - ExecTreeExecTime: 3s943ms - OpenTime: 1s075ms - ExecTreeOpenTime: 878.020ms - PrepareTime: 63.515ms - ExecTreePrepareTime: 8.019ms DataStreamSender (dst_id=22):(Total: 16s556ms, non-child: 16s556ms, % non-child: 100.00%) - BytesSent: 734.02 MB (769672466) - NetworkThroughput(*): 78.08 MB/sec - OverallThroughput: 44.34 MB/sec - PeakMemoryUsage: 4.89 MB (5125888) - RowsReturned: 79.20M (79200245) - SerializeBatchTime: 7s136ms - TransmitDataRPCTime: 9s401ms - UncompressedRowBatchSize: 2.21 GB (2376859534) CodeGen:(Total: 220.988ms, non-child: 220.988ms, % non-child: 100.00%) - CodegenTime: 1.182ms - CompileTime: 63.072ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 132.451ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 24.977ms HASH_JOIN_NODE (id=5):(Total: 4s797ms, non-child: 3s493ms, % non-child: 72.82%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 4.528ms - PeakMemoryUsage: 1.24 MB (1298364) - ProbeRows: 79.20M (79200245) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3s342ms - RowsReturned: 79.20M (79200245) - RowsReturnedRate: 16.51 M/sec Hash Join Builder (join_node_id=5): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 32.631us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 501.349us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 59.152us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 454.301ms, non-child: 35.491us, % non-child: 0.01%) BytesReceived(16s000ms): 963.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 10.410us - DeserializeRowBatchTimer: 797.822us - FirstBatchArrivalWaitTime: 426.766ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 264.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=3):(Total: 850.371ms, non-child: 850.371ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:232/13.86 GB 5:213/11.67 GB 2:245/13.73 GB 1:214/12.49 GB 7:223/13.19 GB 0:223/13.32 GB 4:227/13.55 GB 6:239/13.86 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 120 out of 120 Runtime filters: Only following filters arrived: 6, waited 322ms Hdfs Read Thread Concurrency Bucket: 0:99.28% 1:0.7227% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1696 PARQUET/SNAPPY:120 BytesRead(16s000ms): 13.57 MB, 14.48 MB, 14.48 MB, 20.25 MB, 29.23 MB, 29.58 MB, 38.80 MB, 43.44 MB, 44.07 MB, 56.84 MB, 58.47 MB, 61.98 MB, 73.37 MB, 73.53 MB, 78.59 MB, 88.29 MB, 88.60 MB, 95.73 MB, 102.80 MB, 103.27 MB, 111.02 MB, 117.39 MB, 117.39 MB, 118.73 MB, 130.42 MB, 132.14 MB, 132.14 MB, 133.27 MB, 134.86 MB, 140.04 MB, 145.66 MB, 145.66 MB, 145.66 MB, 145.66 MB - FooterProcessingTime: (Avg: 55.123ms ; Min: 21.502ms ; Max: 131.107ms ; Number of samples: 120) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 11.98 - BytesRead: 145.66 MB (152732780) - BytesReadDataNodeCache: 0 - BytesReadLocal: 145.66 MB (152732780) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 145.66 MB (152732780) - DecompressionTime: 1s334ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 120 (120) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 29.64 MB (31077388) - PerReadThreadRawHdfsThroughput: 22.96 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 92.456ms - RowBatchQueuePutWaitTime: 1h49m - RowsRead: 79.35M (79346625) - RowsReturned: 79.20M (79200245) - RowsReturnedRate: 93.14 M/sec - ScanRangesComplete: 1.82K (1816) - ScannerThreadsInvoluntaryContextSwitches: 9.93K (9932) - ScannerThreadsTotalWallClockTime: 1h51m - MaterializeTupleTime(*): 6s374ms - ScannerThreadsSysTime: 5s662ms - ScannerThreadsUserTime: 1m12s - ScannerThreadsVoluntaryContextSwitches: 929.83K (929826) - TotalRawHdfsReadTime(*): 6s343ms - TotalReadThroughput: 269.47 KB/sec Filter 2 (16.00 MB): - Rows processed: 2.09M (2085836) - Rows rejected: 146.35K (146354) - Rows total: 79.35M (79346625) Filter 5 (16.00 MB): - Rows processed: 1.90M (1904666) - Rows rejected: 26 (26) - Rows total: 79.20M (79200271) Filter 6 (1.00 MB): - Files processed: 1.82K (1816) - Files rejected: 1.70K (1696) - Files total: 1.82K (1816) - RowGroups processed: 77.31K (77311) - RowGroups rejected: 0 (0) - RowGroups total: 77.31K (77311) - Rows processed: 1.97M (1966080) - Rows rejected: 0 (0) - Rows total: 79.20M (79200245) - Splits processed: 120 (120) - Splits rejected: 0 (0) - Splits total: 120 (120) Instance 7f40dcb034de70b7:da (host=vd1341.foo:22000):(Total: 9m17s, non-child: 8m55s, % non-child: 95.98%) Hdfs split stats (:<# splits>/): 1:224/13.69 GB 4:223/13.15 GB 3:221/12.85 GB 5:237/13.83 GB 7:222/12.17 GB 0:220/13.01 GB 2:232/14.42 GB 6:224/12.54 GB Filter 6 arrival: 761ms Filter 2 arrival: 13s203ms Filter 5 arrival: 16s801ms MemoryUsage(16s000ms): 34.68 MB, 65.23 MB, 65.77 MB, 66.02 MB, 66.79 MB, 66.84 MB, 66.66 MB, 66.79 MB, 66.83 MB, 66.34 MB, 66.76 MB, 66.84 MB, 66.36 MB, 66.81 MB, 66.53 MB, 65.98 MB, 66.66 MB, 66.81 MB, 66.82 MB, 66.81 MB, 66.37 MB, 66.84 MB, 66.80 MB, 66.76 MB, 66.79 MB, 66.82 MB, 66.72 MB, 66.80 MB, 66.78 MB, 66.67 MB, 64.53 MB, 62.28 MB, 62.42 MB, 62.33 MB ThreadUsage(16s000ms): 12, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.98 - BloomFilterBytes: 33.00 MB (34603008) - PeakMemoryUsage: 67.81 MB (71108650) - PerHostPeakMemUsage: 161.68 GB (173600653978) - RowsProduced: 78.36M (78364295) - TotalNetworkReceiveTime: 526.504ms - TotalNetworkSendTime: 8m48s - TotalStorageWaitTime: 12s808ms - TotalThreadsInvoluntaryContextSwitches: 20.76K (20761) - TotalThreadsTotalWallClockTime: 2h - TotalThreadsSysTime: 19s270ms - TotalThreadsUserTime: 2m37s - TotalThreadsVoluntaryContextSwitches: 1.66M (1655378) Fragment Instance Lifecycle Timings: - ExecTime: 9m16s - ExecTreeExecTime: 4s476ms - OpenTime: 1s101ms - ExecTreeOpenTime: 918.869ms - PrepareTime: 59.184ms - ExecTreePrepareTime: 7.478ms DataStreamSender (dst_id=22):(Total: 16s836ms, non-child: 16s836ms, % non-child: 100.00%) - BytesSent: 728.60 MB (763987990) - NetworkThroughput(*): 78.19 MB/sec - OverallThroughput: 43.27 MB/sec - PeakMemoryUsage: 4.91 MB (5150464) - RowsReturned: 78.36M (78364295) - SerializeBatchTime: 7s497ms - TransmitDataRPCTime: 9s318ms - UncompressedRowBatchSize: 2.19 GB (2351771986) CodeGen:(Total: 204.941ms, non-child: 204.941ms, % non-child: 100.00%) - CodegenTime: 1.248ms - CompileTime: 52.712ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 128.007ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 23.709ms HASH_JOIN_NODE (id=5):(Total: 5s360ms, non-child: 3s348ms, % non-child: 62.47%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 885.992us - PeakMemoryUsage: 1.23 MB (1292065) - ProbeRows: 78.36M (78364295) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3s183ms - RowsReturned: 78.36M (78364295) - RowsReturnedRate: 14.62 M/sec Hash Join Builder (join_node_id=5): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 24.536us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 91.802us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 43.925us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 526.512ms, non-child: 15.515us, % non-child: 0.00%) BytesReceived(16s000ms): 963.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 3.314us - DeserializeRowBatchTimer: 21.309us - FirstBatchArrivalWaitTime: 498.889ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 227.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=3):(Total: 1s485ms, non-child: 1s485ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:224/13.69 GB 4:223/13.15 GB 3:221/12.85 GB 5:237/13.83 GB 7:222/12.17 GB 0:220/13.01 GB 2:232/14.42 GB 6:224/12.54 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 119 out of 119 Runtime filters: Only following filters arrived: 6, waited 262ms Hdfs Read Thread Concurrency Bucket: 0:99.1% 1:0.9009% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1684 PARQUET/SNAPPY:119 BytesRead(16s000ms): 13.54 MB, 14.45 MB, 14.45 MB, 19.13 MB, 29.31 MB, 29.60 MB, 38.12 MB, 44.24 MB, 44.86 MB, 56.67 MB, 58.85 MB, 59.48 MB, 71.30 MB, 73.79 MB, 76.65 MB, 88.45 MB, 89.06 MB, 95.15 MB, 103.34 MB, 104.06 MB, 109.93 MB, 117.60 MB, 118.52 MB, 119.27 MB, 128.98 MB, 132.82 MB, 133.61 MB, 133.94 MB, 135.03 MB, 138.10 MB, 145.94 MB, 145.94 MB, 145.94 MB, 145.94 MB - FooterProcessingTime: (Avg: 58.454ms ; Min: 3.884ms ; Max: 213.884ms ; Number of samples: 119) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 11.98 - BytesRead: 145.94 MB (153028016) - BytesReadDataNodeCache: 0 - BytesReadLocal: 145.94 MB (153028016) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 145.94 MB (153028016) - DecompressionTime: 813.411ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 119 (119) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 29.75 MB (31193514) - PerReadThreadRawHdfsThroughput: 21.33 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 122.028ms - RowBatchQueuePutWaitTime: 1h48m - RowsRead: 78.51M (78509323) - RowsReturned: 78.36M (78364295) - RowsReturnedRate: 52.75 M/sec - ScanRangesComplete: 1.80K (1803) - ScannerThreadsInvoluntaryContextSwitches: 15.61K (15611) - ScannerThreadsTotalWallClockTime: 1h51m - MaterializeTupleTime(*): 6s208ms - ScannerThreadsSysTime: 18s568ms - ScannerThreadsUserTime: 2m12s - ScannerThreadsVoluntaryContextSwitches: 1.65M (1652157) - TotalRawHdfsReadTime(*): 6s842ms - TotalReadThroughput: 269.26 KB/sec Filter 2 (16.00 MB): - Rows processed: 2.08M (2082436) - Rows rejected: 145.01K (145007) - Rows total: 78.51M (78509323) Filter 5 (16.00 MB): - Rows processed: 1.91M (1909781) - Rows rejected: 21 (21) - Rows total: 78.36M (78364316) Filter 6 (1.00 MB): - Files processed: 1.80K (1803) - Files rejected: 1.68K (1684) - Files total: 1.80K (1803) - RowGroups processed: 76.50K (76500) - RowGroups rejected: 0 (0) - RowGroups total: 76.50K (76500) - Rows processed: 1.95M (1949696) - Rows rejected: 0 (0) - Rows total: 78.36M (78364295) - Splits processed: 119 (119) - Splits rejected: 0 (0) - Splits total: 119 (119) Instance 7f40dcb034de70b7:be (host=vd1339.foo:22000):(Total: 9m17s, non-child: 8m56s, % non-child: 96.19%) Hdfs split stats (:<# splits>/): 7:216/12.46 GB 3:217/12.09 GB 2:207/11.99 GB 1:259/15.73 GB 4:217/12.31 GB 6:240/14.66 GB 5:249/13.85 GB 0:213/12.57 GB Filter 6 arrival: 916ms Filter 2 arrival: 12s838ms Filter 5 arrival: 16s464ms MemoryUsage(16s000ms): 36.93 MB, 66.78 MB, 66.83 MB, 66.53 MB, 66.79 MB, 66.79 MB, 66.64 MB, 66.82 MB, 66.68 MB, 66.59 MB, 66.86 MB, 66.63 MB, 66.77 MB, 66.82 MB, 65.61 MB, 65.75 MB, 65.82 MB, 66.25 MB, 66.74 MB, 66.76 MB, 63.62 MB, 63.79 MB, 63.82 MB, 62.86 MB, 64.78 MB, 64.79 MB, 64.72 MB, 65.49 MB, 66.36 MB, 63.73 MB, 62.41 MB, 62.37 MB, 62.40 MB, 60.33 MB ThreadUsage(16s000ms): 12, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.90 - BloomFilterBytes: 33.00 MB (34603008) - PeakMemoryUsage: 67.63 MB (70912982) - PerHostPeakMemUsage: 161.67 GB (173592664522) - RowsProduced: 78.17M (78166261) - TotalNetworkReceiveTime: 691.845ms - TotalNetworkSendTime: 8m48s - TotalStorageWaitTime: 13s308ms - TotalThreadsInvoluntaryContextSwitches: 27.83K (27826) - TotalThreadsTotalWallClockTime: 1h59m - TotalThreadsSysTime: 54s666ms - TotalThreadsUserTime: 3m - TotalThreadsVoluntaryContextSwitches: 2.39M (2386907) Fragment Instance Lifecycle Timings: - ExecTime: 9m16s - ExecTreeExecTime: 3s685ms - OpenTime: 1s142ms - ExecTreeOpenTime: 960.042ms - PrepareTime: 45.085ms - ExecTreePrepareTime: 6.295ms DataStreamSender (dst_id=22):(Total: 16s430ms, non-child: 16s430ms, % non-child: 100.00%) - BytesSent: 725.49 MB (760727478) - NetworkThroughput(*): 76.30 MB/sec - OverallThroughput: 44.15 MB/sec - PeakMemoryUsage: 5.00 MB (5240576) - RowsReturned: 78.17M (78166261) - SerializeBatchTime: 6s903ms - TransmitDataRPCTime: 9s508ms - UncompressedRowBatchSize: 2.18 GB (2345828878) CodeGen:(Total: 197.372ms, non-child: 197.372ms, % non-child: 100.00%) - CodegenTime: 1.060ms - CompileTime: 55.095ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 125.695ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 16.195ms HASH_JOIN_NODE (id=5):(Total: 4s609ms, non-child: 3s208ms, % non-child: 69.59%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.874ms - PeakMemoryUsage: 1.23 MB (1290455) - ProbeRows: 78.17M (78166261) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3s037ms - RowsReturned: 78.17M (78166261) - RowsReturnedRate: 16.96 M/sec Hash Join Builder (join_node_id=5): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 26.956us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 481.764us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 42.171us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 691.856ms, non-child: 18.209us, % non-child: 0.00%) BytesReceived(16s000ms): 963.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 4.988us - DeserializeRowBatchTimer: 17.464us - FirstBatchArrivalWaitTime: 651.583ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 173.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=3):(Total: 710.265ms, non-child: 710.265ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:216/12.46 GB 3:217/12.09 GB 2:207/11.99 GB 1:259/15.73 GB 4:217/12.31 GB 6:240/14.66 GB 5:249/13.85 GB 0:213/12.57 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 118 out of 118 Runtime filters: Only following filters arrived: 6, waited 120ms Hdfs Read Thread Concurrency Bucket: 0:99.09% 1:0.6346% 2:0.272% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1700 PARQUET/SNAPPY:118 BytesRead(16s000ms): 13.94 MB, 14.87 MB, 14.87 MB, 19.99 MB, 29.50 MB, 29.62 MB, 38.81 MB, 44.37 MB, 45.40 MB, 58.58 MB, 59.08 MB, 62.36 MB, 73.77 MB, 73.77 MB, 80.21 MB, 88.21 MB, 88.33 MB, 98.76 MB, 103.26 MB, 104.25 MB, 115.74 MB, 117.40 MB, 117.40 MB, 122.56 MB, 131.76 MB, 131.76 MB, 131.76 MB, 133.84 MB, 140.43 MB, 143.99 MB, 143.99 MB, 143.99 MB, 143.99 MB, 143.99 MB - FooterProcessingTime: (Avg: 63.015ms ; Min: 24.581ms ; Max: 191.475ms ; Number of samples: 118) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 11.98 - BytesRead: 143.99 MB (150983545) - BytesReadDataNodeCache: 0 - BytesReadLocal: 143.99 MB (150983545) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 143.99 MB (150983545) - DecompressionTime: 3s722ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 118 (118) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 29.44 MB (30865550) - PerReadThreadRawHdfsThroughput: 21.22 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 141.547ms - RowBatchQueuePutWaitTime: 1h46m - RowsRead: 78.31M (78309989) - RowsReturned: 78.17M (78166261) - RowsReturnedRate: 110.05 M/sec - ScanRangesComplete: 1.82K (1818) - ScannerThreadsInvoluntaryContextSwitches: 23.04K (23043) - ScannerThreadsTotalWallClockTime: 1h50m - MaterializeTupleTime(*): 6s292ms - ScannerThreadsSysTime: 53s896ms - ScannerThreadsUserTime: 2m38s - ScannerThreadsVoluntaryContextSwitches: 2.38M (2383743) - TotalRawHdfsReadTime(*): 6s785ms - TotalReadThroughput: 267.35 KB/sec Filter 2 (16.00 MB): - Rows processed: 2.06M (2064752) - Rows rejected: 143.71K (143706) - Rows total: 78.31M (78309989) Filter 5 (16.00 MB): - Rows processed: 1.80M (1804310) - Rows rejected: 22 (22) - Rows total: 78.17M (78166283) Filter 6 (1.00 MB): - Files processed: 1.82K (1818) - Files rejected: 1.70K (1700) - Files total: 1.82K (1818) - RowGroups processed: 76.31K (76314) - RowGroups rejected: 0 (0) - RowGroups total: 76.31K (76314) - Rows processed: 1.93M (1933312) - Rows rejected: 0 (0) - Rows total: 78.17M (78166261) - Splits processed: 118 (118) - Splits rejected: 0 (0) - Splits total: 118 (118) Instance 7f40dcb034de70b7:e1 (host=vd1140.foo:22000):(Total: 9m17s, non-child: 8m56s, % non-child: 96.16%) Hdfs split stats (:<# splits>/): 7:225/13.41 GB 0:223/12.72 GB 6:230/13.39 GB 5:237/13.11 GB 3:206/11.87 GB 1:242/13.98 GB 2:223/12.61 GB 4:233/14.56 GB Filter 6 arrival: 726ms Filter 2 arrival: 13s280ms Filter 5 arrival: 16s827ms MemoryUsage(16s000ms): 34.52 MB, 65.29 MB, 65.81 MB, 66.36 MB, 66.78 MB, 66.73 MB, 65.07 MB, 64.76 MB, 64.46 MB, 66.69 MB, 66.87 MB, 65.85 MB, 63.76 MB, 63.79 MB, 64.50 MB, 65.74 MB, 65.84 MB, 65.37 MB, 65.87 MB, 65.74 MB, 64.86 MB, 64.81 MB, 64.81 MB, 64.77 MB, 65.61 MB, 66.73 MB, 66.81 MB, 66.76 MB, 65.60 MB, 65.36 MB, 62.26 MB, 62.30 MB, 62.30 MB, 62.33 MB ThreadUsage(16s000ms): 12, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.98 - BloomFilterBytes: 33.00 MB (34603008) - PeakMemoryUsage: 67.82 MB (71115756) - PerHostPeakMemUsage: 161.67 GB (173594750955) - RowsProduced: 78.22M (78217372) - TotalNetworkReceiveTime: 492.323ms - TotalNetworkSendTime: 8m50s - TotalStorageWaitTime: 13s536ms - TotalThreadsInvoluntaryContextSwitches: 22.52K (22523) - TotalThreadsTotalWallClockTime: 2h - TotalThreadsSysTime: 30s196ms - TotalThreadsUserTime: 2m43s - TotalThreadsVoluntaryContextSwitches: 2.97M (2971677) Fragment Instance Lifecycle Timings: - ExecTime: 9m16s - ExecTreeExecTime: 3s747ms - OpenTime: 1s096ms - ExecTreeOpenTime: 913.734ms - PrepareTime: 56.956ms - ExecTreePrepareTime: 7.487ms DataStreamSender (dst_id=22):(Total: 16s563ms, non-child: 16s563ms, % non-child: 100.00%) - BytesSent: 721.45 MB (756494851) - NetworkThroughput(*): 78.90 MB/sec - OverallThroughput: 43.56 MB/sec - PeakMemoryUsage: 5.07 MB (5314304) - RowsReturned: 78.22M (78217372) - SerializeBatchTime: 7s398ms - TransmitDataRPCTime: 9s143ms - UncompressedRowBatchSize: 2.19 GB (2347362768) CodeGen:(Total: 203.622ms, non-child: 203.622ms, % non-child: 100.00%) - CodegenTime: 1.423ms - CompileTime: 53.142ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 128.359ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 21.456ms HASH_JOIN_NODE (id=5):(Total: 4s629ms, non-child: 3s313ms, % non-child: 71.57%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.206ms - PeakMemoryUsage: 1.23 MB (1292386) - ProbeRows: 78.22M (78217372) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3s136ms - RowsReturned: 78.22M (78217372) - RowsReturnedRate: 16.90 M/sec Hash Join Builder (join_node_id=5): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 25.655us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 91.203us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 47.209us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 492.333ms, non-child: 20.006us, % non-child: 0.00%) BytesReceived(16s000ms): 963.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 5.012us - DeserializeRowBatchTimer: 17.480us - FirstBatchArrivalWaitTime: 456.840ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 243.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=3):(Total: 824.246ms, non-child: 824.246ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:225/13.41 GB 0:223/12.72 GB 6:230/13.39 GB 5:237/13.11 GB 3:206/11.87 GB 1:242/13.98 GB 2:223/12.61 GB 4:233/14.56 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 118 out of 118 Runtime filters: Only following filters arrived: 6, waited 302ms Hdfs Read Thread Concurrency Bucket: 0:99.46% 1:0.3594% 2:0.1797% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1701 PARQUET/SNAPPY:118 BytesRead(16s000ms): 13.22 MB, 14.10 MB, 14.10 MB, 19.07 MB, 28.52 MB, 28.64 MB, 38.88 MB, 42.73 MB, 43.74 MB, 57.21 MB, 57.25 MB, 60.66 MB, 71.38 MB, 71.38 MB, 77.70 MB, 85.92 MB, 85.92 MB, 93.81 MB, 100.35 MB, 100.39 MB, 108.22 MB, 114.54 MB, 114.54 MB, 115.11 MB, 126.07 MB, 128.98 MB, 128.98 MB, 129.30 MB, 133.19 MB, 139.52 MB, 141.27 MB, 141.27 MB, 141.27 MB, 141.27 MB - FooterProcessingTime: (Avg: 67.361ms ; Min: 30.247ms ; Max: 569.766ms ; Number of samples: 118) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 11.98 - BytesRead: 141.27 MB (148128008) - BytesReadDataNodeCache: 0 - BytesReadLocal: 141.27 MB (148128008) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 141.27 MB (148128008) - DecompressionTime: 1s832ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 118 (118) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 29.54 MB (30976877) - PerReadThreadRawHdfsThroughput: 22.12 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 113.684ms - RowBatchQueuePutWaitTime: 1h48m - RowsRead: 78.36M (78361503) - RowsReturned: 78.22M (78217372) - RowsReturnedRate: 94.90 M/sec - ScanRangesComplete: 1.82K (1819) - ScannerThreadsInvoluntaryContextSwitches: 17.50K (17496) - ScannerThreadsTotalWallClockTime: 1h51m - MaterializeTupleTime(*): 6s644ms - ScannerThreadsSysTime: 29s456ms - ScannerThreadsUserTime: 2m19s - ScannerThreadsVoluntaryContextSwitches: 2.97M (2968560) - TotalRawHdfsReadTime(*): 6s386ms - TotalReadThroughput: 259.94 KB/sec Filter 2 (16.00 MB): - Rows processed: 2.05M (2049789) - Rows rejected: 144.09K (144089) - Rows total: 78.36M (78361503) Filter 5 (16.00 MB): - Rows processed: 1.90M (1901610) - Rows rejected: 42 (42) - Rows total: 78.22M (78217414) Filter 6 (1.00 MB): - Files processed: 1.82K (1819) - Files rejected: 1.70K (1701) - Files total: 1.82K (1819) - RowGroups processed: 76.35K (76354) - RowGroups rejected: 0 (0) - RowGroups total: 76.35K (76354) - Rows processed: 1.93M (1933312) - Rows rejected: 0 (0) - Rows total: 78.22M (78217372) - Splits processed: 118 (118) - Splits rejected: 0 (0) - Splits total: 118 (118) Instance 7f40dcb034de70b7:c9 (host=vd1336.foo:22000):(Total: 9m17s, non-child: 8m56s, % non-child: 96.15%) Hdfs split stats (:<# splits>/): 4:204/10.97 GB 2:232/13.90 GB 6:255/15.21 GB 0:226/12.99 GB 3:223/13.33 GB 1:228/13.04 GB 7:216/12.29 GB 5:236/13.94 GB Filter 6 arrival: 830ms Filter 2 arrival: 13s025ms Filter 5 arrival: 16s603ms MemoryUsage(16s000ms): 34.47 MB, 66.28 MB, 66.84 MB, 66.62 MB, 66.78 MB, 66.76 MB, 66.65 MB, 66.78 MB, 66.81 MB, 66.59 MB, 66.80 MB, 66.82 MB, 66.68 MB, 66.82 MB, 66.51 MB, 66.79 MB, 66.86 MB, 66.55 MB, 66.77 MB, 66.81 MB, 66.78 MB, 66.89 MB, 66.84 MB, 66.46 MB, 66.38 MB, 66.73 MB, 66.83 MB, 66.80 MB, 66.76 MB, 65.60 MB, 60.13 MB, 60.13 MB, 60.23 MB, 57.29 MB ThreadUsage(16s000ms): 12, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.90 - BloomFilterBytes: 33.00 MB (34603008) - PeakMemoryUsage: 67.92 MB (71217881) - PerHostPeakMemUsage: 161.68 GB (173601083207) - RowsProduced: 77.61M (77613083) - TotalNetworkReceiveTime: 588.035ms - TotalNetworkSendTime: 8m50s - TotalStorageWaitTime: 13s953ms - TotalThreadsInvoluntaryContextSwitches: 30.92K (30921) - TotalThreadsTotalWallClockTime: 1h59m - TotalThreadsSysTime: 1m53s - TotalThreadsUserTime: 2m33s - TotalThreadsVoluntaryContextSwitches: 11.27M (11266091) Fragment Instance Lifecycle Timings: - ExecTime: 9m16s - ExecTreeExecTime: 3s757ms - OpenTime: 1s156ms - ExecTreeOpenTime: 965.272ms - PrepareTime: 55.124ms - ExecTreePrepareTime: 6.623ms DataStreamSender (dst_id=22):(Total: 16s554ms, non-child: 16s554ms, % non-child: 100.00%) - BytesSent: 719.53 MB (754485958) - NetworkThroughput(*): 77.41 MB/sec - OverallThroughput: 43.46 MB/sec - PeakMemoryUsage: 4.78 MB (5011200) - RowsReturned: 77.61M (77613083) - SerializeBatchTime: 7s238ms - TransmitDataRPCTime: 9s294ms - UncompressedRowBatchSize: 2.17 GB (2329227586) CodeGen:(Total: 213.237ms, non-child: 213.237ms, % non-child: 100.00%) - CodegenTime: 1.081ms - CompileTime: 58.907ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 131.026ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 22.836ms HASH_JOIN_NODE (id=5):(Total: 4s685ms, non-child: 3s267ms, % non-child: 69.74%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.491ms - PeakMemoryUsage: 1.23 MB (1293318) - ProbeRows: 77.61M (77613083) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3s090ms - RowsReturned: 77.61M (77613083) - RowsReturnedRate: 16.57 M/sec Hash Join Builder (join_node_id=5): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 33.751us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 117.843us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 60.611us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 588.048ms, non-child: 22.873us, % non-child: 0.00%) BytesReceived(16s000ms): 932.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 5.392us - DeserializeRowBatchTimer: 18.526us - FirstBatchArrivalWaitTime: 583.396ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 204.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=3):(Total: 830.272ms, non-child: 830.272ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:204/10.97 GB 2:232/13.90 GB 6:255/15.21 GB 0:226/12.99 GB 3:223/13.33 GB 1:228/13.04 GB 7:216/12.29 GB 5:236/13.94 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 117 out of 117 Runtime filters: Only following filters arrived: 6, waited 201ms Hdfs Read Thread Concurrency Bucket: 0:99% 1:0.8197% 2:0.1821% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1703 PARQUET/SNAPPY:117 BytesRead(16s000ms): 13.50 MB, 14.89 MB, 14.89 MB, 19.10 MB, 29.80 MB, 30.01 MB, 38.45 MB, 44.56 MB, 44.93 MB, 54.45 MB, 59.36 MB, 59.84 MB, 72.00 MB, 73.96 MB, 77.75 MB, 88.68 MB, 88.84 MB, 95.42 MB, 102.98 MB, 103.36 MB, 112.30 MB, 117.78 MB, 117.78 MB, 119.88 MB, 129.47 MB, 132.73 MB, 132.73 MB, 134.08 MB, 136.57 MB, 137.96 MB, 143.61 MB, 143.61 MB, 143.61 MB, 143.61 MB - FooterProcessingTime: (Avg: 62.775ms ; Min: 4.273ms ; Max: 198.821ms ; Number of samples: 117) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 11.99 - BytesRead: 143.61 MB (150589859) - BytesReadDataNodeCache: 0 - BytesReadLocal: 143.61 MB (150589859) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 143.61 MB (150589859) - DecompressionTime: 1s265ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 117 (117) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 29.61 MB (31051354) - PerReadThreadRawHdfsThroughput: 21.62 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 169.314ms - RowBatchQueuePutWaitTime: 1h45m - RowsRead: 77.76M (77755839) - RowsReturned: 77.61M (77613083) - RowsReturnedRate: 93.48 M/sec - ScanRangesComplete: 1.82K (1820) - ScannerThreadsInvoluntaryContextSwitches: 26.13K (26133) - ScannerThreadsTotalWallClockTime: 1h50m - MaterializeTupleTime(*): 6s319ms - ScannerThreadsSysTime: 1m53s - ScannerThreadsUserTime: 2m10s - ScannerThreadsVoluntaryContextSwitches: 11.26M (11262906) - TotalRawHdfsReadTime(*): 6s644ms - TotalReadThroughput: 267.62 KB/sec Filter 2 (16.00 MB): - Rows processed: 2.04M (2036132) - Rows rejected: 142.70K (142699) - Rows total: 77.76M (77755839) Filter 5 (16.00 MB): - Rows processed: 1.80M (1799225) - Rows rejected: 57 (57) - Rows total: 77.61M (77613140) Filter 6 (1.00 MB): - Files processed: 1.82K (1820) - Files rejected: 1.70K (1703) - Files total: 1.82K (1820) - RowGroups processed: 75.76K (75760) - RowGroups rejected: 0 (0) - RowGroups total: 75.76K (75760) - Rows processed: 1.92M (1916928) - Rows rejected: 0 (0) - Rows total: 77.61M (77613083) - Splits processed: 117 (117) - Splits rejected: 0 (0) - Splits total: 117 (117) Instance 7f40dcb034de70b7:cf (host=vd1118.foo:22000):(Total: 9m17s, non-child: 8m55s, % non-child: 96.03%) Hdfs split stats (:<# splits>/): 4:236/12.97 GB 2:214/12.30 GB 7:229/13.07 GB 6:243/14.47 GB 0:242/14.30 GB 1:214/12.76 GB 3:229/13.34 GB 5:211/12.45 GB Filter 6 arrival: 794ms Filter 2 arrival: 13s060ms Filter 5 arrival: 16s608ms MemoryUsage(16s000ms): 33.41 MB, 66.33 MB, 66.85 MB, 66.18 MB, 65.83 MB, 65.78 MB, 66.39 MB, 66.82 MB, 66.79 MB, 66.66 MB, 66.82 MB, 66.23 MB, 64.72 MB, 64.84 MB, 64.83 MB, 64.72 MB, 64.79 MB, 65.75 MB, 66.78 MB, 66.87 MB, 66.10 MB, 66.81 MB, 66.84 MB, 66.83 MB, 66.84 MB, 66.72 MB, 66.78 MB, 66.77 MB, 66.78 MB, 66.46 MB, 61.26 MB, 60.22 MB, 60.10 MB, 58.48 MB ThreadUsage(16s000ms): 12, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.90 - BloomFilterBytes: 33.00 MB (34603008) - PeakMemoryUsage: 67.45 MB (70723319) - PerHostPeakMemUsage: 161.65 GB (173571556792) - RowsProduced: 77.57M (77570100) - TotalNetworkReceiveTime: 571.254ms - TotalNetworkSendTime: 8m51s - TotalStorageWaitTime: 22s355ms - TotalThreadsInvoluntaryContextSwitches: 31.79K (31786) - TotalThreadsTotalWallClockTime: 1h59m - TotalThreadsSysTime: 1m29s - TotalThreadsUserTime: 2m36s - TotalThreadsVoluntaryContextSwitches: 9.64M (9641433) Fragment Instance Lifecycle Timings: - ExecTime: 9m15s - ExecTreeExecTime: 3s693ms - OpenTime: 2s004ms - ExecTreeOpenTime: 1s823ms - PrepareTime: 45.320ms - ExecTreePrepareTime: 5.718ms DataStreamSender (dst_id=22):(Total: 16s466ms, non-child: 16s466ms, % non-child: 100.00%) - BytesSent: 720.05 MB (755031311) - NetworkThroughput(*): 75.01 MB/sec - OverallThroughput: 43.73 MB/sec - PeakMemoryUsage: 4.96 MB (5199616) - RowsReturned: 77.57M (77570100) - SerializeBatchTime: 6s848ms - TransmitDataRPCTime: 9s599ms - UncompressedRowBatchSize: 2.17 GB (2327937632) CodeGen:(Total: 198.651ms, non-child: 198.651ms, % non-child: 100.00%) - CodegenTime: 948.626us - CompileTime: 56.903ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 122.947ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 18.436ms HASH_JOIN_NODE (id=5):(Total: 5s479ms, non-child: 3s230ms, % non-child: 58.95%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 2.009ms - PeakMemoryUsage: 1.24 MB (1296922) - ProbeRows: 77.57M (77570100) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3s092ms - RowsReturned: 77.57M (77570100) - RowsReturnedRate: 14.16 M/sec Hash Join Builder (join_node_id=5): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 44.041us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 174.141us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 76.209us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 571.267ms, non-child: 24.611us, % non-child: 0.00%) BytesReceived(16s000ms): 963.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 7.260us - DeserializeRowBatchTimer: 66.452us - FirstBatchArrivalWaitTime: 566.796ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 210.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=3):(Total: 1s678ms, non-child: 1s678ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:236/12.97 GB 2:214/12.30 GB 7:229/13.07 GB 6:243/14.47 GB 0:242/14.30 GB 1:214/12.76 GB 3:229/13.34 GB 5:211/12.45 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 117 out of 117 Runtime filters: Only following filters arrived: 6, waited 241ms Hdfs Read Thread Concurrency Bucket: 0:99.28% 1:0.7246% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1701 PARQUET/SNAPPY:117 BytesRead(16s000ms): 12.98 MB, 14.83 MB, 14.83 MB, 20.66 MB, 29.44 MB, 29.86 MB, 39.92 MB, 44.16 MB, 45.29 MB, 58.39 MB, 59.16 MB, 62.47 MB, 73.55 MB, 73.99 MB, 79.33 MB, 88.13 MB, 88.94 MB, 98.59 MB, 102.88 MB, 103.89 MB, 112.57 MB, 117.85 MB, 118.34 MB, 119.81 MB, 131.49 MB, 132.49 MB, 132.87 MB, 133.69 MB, 134.23 MB, 139.36 MB, 143.46 MB, 143.46 MB, 143.46 MB, 143.46 MB - FooterProcessingTime: (Avg: 140.759ms ; Min: 4.364ms ; Max: 969.296ms ; Number of samples: 117) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 11.98 - BytesRead: 143.46 MB (150424428) - BytesReadDataNodeCache: 0 - BytesReadLocal: 143.46 MB (150424428) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 143.46 MB (150424428) - DecompressionTime: 1s066ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 117 (117) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 29.34 MB (30767639) - PerReadThreadRawHdfsThroughput: 23.33 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 981.336ms - RowBatchQueuePutWaitTime: 1h46m - RowsRead: 77.71M (77711916) - RowsReturned: 77.57M (77570100) - RowsReturnedRate: 46.21 M/sec - ScanRangesComplete: 1.82K (1818) - ScannerThreadsInvoluntaryContextSwitches: 27.00K (26998) - ScannerThreadsTotalWallClockTime: 1h50m - MaterializeTupleTime(*): 6s878ms - ScannerThreadsSysTime: 1m29s - ScannerThreadsUserTime: 2m14s - ScannerThreadsVoluntaryContextSwitches: 9.64M (9638280) - TotalRawHdfsReadTime(*): 6s148ms - TotalReadThroughput: 266.12 KB/sec Filter 2 (16.00 MB): - Rows processed: 2.02M (2021880) - Rows rejected: 141.81K (141807) - Rows total: 77.71M (77711916) Filter 5 (16.00 MB): - Rows processed: 1.84M (1841161) - Rows rejected: 9 (9) - Rows total: 77.57M (77570109) Filter 6 (1.00 MB): - Files processed: 1.82K (1818) - Files rejected: 1.70K (1701) - Files total: 1.82K (1818) - RowGroups processed: 75.73K (75727) - RowGroups rejected: 0 (0) - RowGroups total: 75.73K (75727) - Rows processed: 1.92M (1916928) - Rows rejected: 0 (0) - Rows total: 77.57M (77570100) - Splits processed: 117 (117) - Splits rejected: 0 (0) - Splits total: 117 (117) Instance 7f40dcb034de70b7:dc (host=vc1501.foo:22000):(Total: 9m17s, non-child: 8m56s, % non-child: 96.22%) Hdfs split stats (:<# splits>/): 4:230/13.13 GB 7:241/14.02 GB 2:242/14.47 GB 3:223/12.29 GB 6:225/12.61 GB 0:242/14.35 GB 1:205/11.66 GB 5:225/13.18 GB Filter 6 arrival: 761ms Filter 2 arrival: 13s203ms Filter 5 arrival: 16s795ms MemoryUsage(16s000ms): 35.26 MB, 65.75 MB, 66.75 MB, 66.38 MB, 65.78 MB, 65.84 MB, 66.16 MB, 66.80 MB, 66.65 MB, 66.68 MB, 66.83 MB, 66.68 MB, 66.78 MB, 66.79 MB, 66.69 MB, 66.75 MB, 66.61 MB, 65.37 MB, 65.82 MB, 65.78 MB, 66.58 MB, 66.78 MB, 66.89 MB, 66.63 MB, 66.72 MB, 66.81 MB, 66.84 MB, 66.45 MB, 66.48 MB, 64.98 MB, 60.03 MB, 60.16 MB, 60.15 MB, 59.32 MB ThreadUsage(16s000ms): 12, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.89 - BloomFilterBytes: 33.00 MB (34603008) - PeakMemoryUsage: 67.69 MB (70976179) - PerHostPeakMemUsage: 161.68 GB (173604325639) - RowsProduced: 77.59M (77593204) - TotalNetworkReceiveTime: 526.490ms - TotalNetworkSendTime: 8m49s - TotalStorageWaitTime: 14s546ms - TotalThreadsInvoluntaryContextSwitches: 30.37K (30371) - TotalThreadsTotalWallClockTime: 1h59m - TotalThreadsSysTime: 1m42s - TotalThreadsUserTime: 2m34s - TotalThreadsVoluntaryContextSwitches: 10.79M (10790772) Fragment Instance Lifecycle Timings: - ExecTime: 9m16s - ExecTreeExecTime: 3s688ms - OpenTime: 1s094ms - ExecTreeOpenTime: 911.043ms - PrepareTime: 58.013ms - ExecTreePrepareTime: 7.112ms DataStreamSender (dst_id=22):(Total: 16s280ms, non-child: 16s280ms, % non-child: 100.00%) - BytesSent: 717.83 MB (752702550) - NetworkThroughput(*): 79.03 MB/sec - OverallThroughput: 44.09 MB/sec - PeakMemoryUsage: 4.89 MB (5125888) - RowsReturned: 77.59M (77593204) - SerializeBatchTime: 7s178ms - TransmitDataRPCTime: 9s082ms - UncompressedRowBatchSize: 2.17 GB (2328631000) CodeGen:(Total: 205.586ms, non-child: 205.586ms, % non-child: 100.00%) - CodegenTime: 1.268ms - CompileTime: 53.173ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 128.050ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 23.962ms HASH_JOIN_NODE (id=5):(Total: 4s565ms, non-child: 3s239ms, % non-child: 70.95%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.293ms - PeakMemoryUsage: 1.23 MB (1291205) - ProbeRows: 77.59M (77593204) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3s060ms - RowsReturned: 77.59M (77593204) - RowsReturnedRate: 16.99 M/sec Hash Join Builder (join_node_id=5): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 24.399us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 111.610us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 42.427us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 526.500ms, non-child: 19.560us, % non-child: 0.00%) BytesReceived(16s000ms): 932.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 4.748us - DeserializeRowBatchTimer: 13.582us - FirstBatchArrivalWaitTime: 499.727ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 227.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=3):(Total: 800.378ms, non-child: 800.378ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:230/13.13 GB 7:241/14.02 GB 2:242/14.47 GB 3:223/12.29 GB 6:225/12.61 GB 0:242/14.35 GB 1:205/11.66 GB 5:225/13.18 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 117 out of 117 Runtime filters: Only following filters arrived: 6, waited 262ms Hdfs Read Thread Concurrency Bucket: 0:99.27% 1:0.6375% 2:0% 3:0% 4:0.09107% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1716 PARQUET/SNAPPY:117 BytesRead(16s000ms): 13.35 MB, 14.51 MB, 14.54 MB, 19.92 MB, 28.95 MB, 29.40 MB, 39.34 MB, 43.33 MB, 44.52 MB, 57.45 MB, 57.74 MB, 62.65 MB, 72.39 MB, 72.68 MB, 80.21 MB, 86.75 MB, 87.09 MB, 98.85 MB, 101.44 MB, 102.11 MB, 114.53 MB, 116.12 MB, 116.12 MB, 118.56 MB, 130.59 MB, 130.85 MB, 130.85 MB, 131.34 MB, 134.97 MB, 140.79 MB, 141.66 MB, 141.66 MB, 141.66 MB, 141.66 MB - FooterProcessingTime: (Avg: 64.292ms ; Min: 13.970ms ; Max: 238.739ms ; Number of samples: 117) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 11.99 - BytesRead: 141.66 MB (148543667) - BytesReadDataNodeCache: 0 - BytesReadLocal: 141.66 MB (148543667) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 141.66 MB (148543667) - DecompressionTime: 497.745ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 117 (117) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 29.32 MB (30747188) - PerReadThreadRawHdfsThroughput: 18.23 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 116.239ms - RowBatchQueuePutWaitTime: 1h45m - RowsRead: 77.73M (77732677) - RowsReturned: 77.59M (77593204) - RowsReturnedRate: 96.95 M/sec - ScanRangesComplete: 1.83K (1833) - ScannerThreadsInvoluntaryContextSwitches: 25.51K (25514) - ScannerThreadsTotalWallClockTime: 1h50m - MaterializeTupleTime(*): 6s134ms - ScannerThreadsSysTime: 1m42s - ScannerThreadsUserTime: 2m11s - ScannerThreadsVoluntaryContextSwitches: 10.79M (10787624) - TotalRawHdfsReadTime(*): 7s770ms - TotalReadThroughput: 263.99 KB/sec Filter 2 (16.00 MB): - Rows processed: 2.03M (2029777) - Rows rejected: 139.47K (139473) - Rows total: 77.73M (77732677) Filter 5 (16.00 MB): - Rows processed: 1.87M (1869824) - Rows rejected: 0 (0) - Rows total: 77.59M (77593204) Filter 6 (1.00 MB): - Files processed: 1.83K (1833) - Files rejected: 1.72K (1716) - Files total: 1.83K (1833) - RowGroups processed: 75.75K (75751) - RowGroups rejected: 0 (0) - RowGroups total: 75.75K (75751) - Rows processed: 1.92M (1916928) - Rows rejected: 0 (0) - Rows total: 77.59M (77593204) - Splits processed: 117 (117) - Splits rejected: 0 (0) - Splits total: 117 (117) Instance 7f40dcb034de70b7:e3 (host=vd1131.foo:22000):(Total: 9m17s, non-child: 8m56s, % non-child: 96.28%) Hdfs split stats (:<# splits>/): 0:217/12.48 GB 3:214/12.84 GB 1:234/13.71 GB 7:225/12.74 GB 4:237/14.39 GB 5:228/13.00 GB 6:235/13.99 GB 2:229/12.53 GB Filter 6 arrival: 690ms Filter 2 arrival: 13s288ms Filter 5 arrival: 16s867ms MemoryUsage(16s000ms): 34.78 MB, 65.74 MB, 66.82 MB, 66.70 MB, 66.80 MB, 66.81 MB, 66.63 MB, 66.82 MB, 66.74 MB, 64.79 MB, 64.77 MB, 64.57 MB, 66.70 MB, 66.79 MB, 66.26 MB, 65.79 MB, 65.74 MB, 65.20 MB, 66.49 MB, 66.73 MB, 66.02 MB, 65.73 MB, 65.84 MB, 65.71 MB, 65.09 MB, 64.76 MB, 64.78 MB, 64.77 MB, 64.41 MB, 64.30 MB, 58.56 MB, 56.89 MB, 56.86 MB, 56.28 MB ThreadUsage(16s000ms): 12, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.90 - BloomFilterBytes: 33.00 MB (34603008) - PeakMemoryUsage: 67.61 MB (70894703) - PerHostPeakMemUsage: 161.69 GB (173610398492) - RowsProduced: 77.07M (77073803) - TotalNetworkReceiveTime: 461.543ms - TotalNetworkSendTime: 8m50s - TotalStorageWaitTime: 12s391ms - TotalThreadsInvoluntaryContextSwitches: 35.42K (35420) - TotalThreadsTotalWallClockTime: 1h59m - TotalThreadsSysTime: 2m11s - TotalThreadsUserTime: 2m47s - TotalThreadsVoluntaryContextSwitches: 13.81M (13812755) Fragment Instance Lifecycle Timings: - ExecTime: 9m16s - ExecTreeExecTime: 3s692ms - OpenTime: 1s093ms - ExecTreeOpenTime: 914.086ms - PrepareTime: 54.607ms - ExecTreePrepareTime: 7.805ms DataStreamSender (dst_id=22):(Total: 15s944ms, non-child: 15s944ms, % non-child: 100.00%) - BytesSent: 711.80 MB (746374212) - NetworkThroughput(*): 78.00 MB/sec - OverallThroughput: 44.64 MB/sec - PeakMemoryUsage: 4.94 MB (5183232) - RowsReturned: 77.07M (77073803) - SerializeBatchTime: 6s800ms - TransmitDataRPCTime: 9s125ms - UncompressedRowBatchSize: 2.15 GB (2313043426) CodeGen:(Total: 198.055ms, non-child: 198.055ms, % non-child: 100.00%) - CodegenTime: 1.169ms - CompileTime: 51.624ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 125.585ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 20.401ms HASH_JOIN_NODE (id=5):(Total: 4s579ms, non-child: 3s244ms, % non-child: 70.85%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.339ms - PeakMemoryUsage: 1.23 MB (1290855) - ProbeRows: 77.07M (77073803) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3s095ms - RowsReturned: 77.07M (77073803) - RowsReturnedRate: 16.83 M/sec Hash Join Builder (join_node_id=5): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 26.264us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 158.251us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 41.653us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 461.553ms, non-child: 17.607us, % non-child: 0.00%) BytesReceived(16s000ms): 963.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 4.811us - DeserializeRowBatchTimer: 15.502us - FirstBatchArrivalWaitTime: 459.046ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 259.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=3):(Total: 873.904ms, non-child: 873.904ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:217/12.48 GB 3:214/12.84 GB 1:234/13.71 GB 7:225/12.74 GB 4:237/14.39 GB 5:228/13.00 GB 6:235/13.99 GB 2:229/12.53 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 117 out of 117 Runtime filters: Only following filters arrived: 6, waited 341ms Hdfs Read Thread Concurrency Bucket: 0:98.82% 1:0.8152% 2:0.09058% 3:0% 4:0.2717% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1702 PARQUET/SNAPPY:117 BytesRead(16s000ms): 13.30 MB, 14.45 MB, 14.45 MB, 19.43 MB, 28.71 MB, 28.75 MB, 37.84 MB, 43.31 MB, 43.83 MB, 56.27 MB, 57.55 MB, 59.52 MB, 71.89 MB, 71.96 MB, 75.98 MB, 86.63 MB, 86.63 MB, 93.40 MB, 101.11 MB, 101.56 MB, 109.85 MB, 115.33 MB, 115.71 MB, 116.86 MB, 127.86 MB, 130.11 MB, 130.11 MB, 130.49 MB, 134.44 MB, 137.98 MB, 139.70 MB, 139.70 MB, 139.70 MB, 139.70 MB - FooterProcessingTime: (Avg: 57.953ms ; Min: 6.033ms ; Max: 161.814ms ; Number of samples: 117) - AverageHdfsReadThreadConcurrency: 0.02 - AverageScannerThreadConcurrency: 11.99 - BytesRead: 139.70 MB (146485117) - BytesReadDataNodeCache: 0 - BytesReadLocal: 139.70 MB (146485117) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 139.70 MB (146485117) - DecompressionTime: 636.849ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 117 (117) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 29.58 MB (31018992) - PerReadThreadRawHdfsThroughput: 20.83 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 105.615ms - RowBatchQueuePutWaitTime: 1h45m - RowsRead: 77.22M (77217098) - RowsReturned: 77.07M (77073803) - RowsReturnedRate: 88.19 M/sec - ScanRangesComplete: 1.82K (1819) - ScannerThreadsInvoluntaryContextSwitches: 30.68K (30676) - ScannerThreadsTotalWallClockTime: 1h50m - MaterializeTupleTime(*): 6s113ms - ScannerThreadsSysTime: 2m10s - ScannerThreadsUserTime: 2m25s - ScannerThreadsVoluntaryContextSwitches: 13.81M (13809682) - TotalRawHdfsReadTime(*): 6s705ms - TotalReadThroughput: 258.92 KB/sec Filter 2 (16.00 MB): - Rows processed: 2.03M (2033599) - Rows rejected: 143.27K (143273) - Rows total: 77.22M (77217098) Filter 5 (16.00 MB): - Rows processed: 1.87M (1868822) - Rows rejected: 22 (22) - Rows total: 77.07M (77073825) Filter 6 (1.00 MB): - Files processed: 1.82K (1819) - Files rejected: 1.70K (1702) - Files total: 1.82K (1819) - RowGroups processed: 75.24K (75240) - RowGroups rejected: 0 (0) - RowGroups total: 75.24K (75240) - Rows processed: 1.92M (1916928) - Rows rejected: 0 (0) - Rows total: 77.07M (77073803) - Splits processed: 117 (117) - Splits rejected: 0 (0) - Splits total: 117 (117) Instance 7f40dcb034de70b7:f0 (host=va1037.foo:22000):(Total: 9m17s, non-child: 8m56s, % non-child: 96.31%) Hdfs split stats (:<# splits>/): 3:232/13.35 GB 1:226/13.38 GB 0:238/13.83 GB 2:250/14.46 GB 7:220/12.77 GB 6:224/13.43 GB 4:210/11.82 GB 5:220/12.60 GB Filter 6 arrival: 686ms Filter 2 arrival: 13s559ms Filter 5 arrival: 16s994ms MemoryUsage(16s000ms): 34.53 MB, 65.80 MB, 66.81 MB, 66.54 MB, 66.81 MB, 66.80 MB, 66.33 MB, 66.80 MB, 66.74 MB, 66.71 MB, 66.78 MB, 66.71 MB, 66.77 MB, 66.81 MB, 66.18 MB, 66.76 MB, 66.76 MB, 66.43 MB, 66.81 MB, 66.77 MB, 66.22 MB, 65.84 MB, 65.82 MB, 65.87 MB, 66.62 MB, 66.89 MB, 66.90 MB, 66.66 MB, 65.71 MB, 66.27 MB, 61.62 MB, 60.17 MB, 60.06 MB, 60.15 MB ThreadUsage(16s000ms): 12, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.90 - BloomFilterBytes: 33.00 MB (34603008) - PeakMemoryUsage: 67.73 MB (71024527) - PerHostPeakMemUsage: 161.67 GB (173587519530) - RowsProduced: 77.46M (77455758) - TotalNetworkReceiveTime: 461.542ms - TotalNetworkSendTime: 8m54s - TotalStorageWaitTime: 12s456ms - TotalThreadsInvoluntaryContextSwitches: 26.61K (26614) - TotalThreadsTotalWallClockTime: 1h59m - TotalThreadsSysTime: 1m4s - TotalThreadsUserTime: 2m38s - TotalThreadsVoluntaryContextSwitches: 7.22M (7216486) Fragment Instance Lifecycle Timings: - ExecTime: 9m16s - ExecTreeExecTime: 3s692ms - OpenTime: 1s089ms - ExecTreeOpenTime: 912.507ms - PrepareTime: 53.940ms - ExecTreePrepareTime: 7.103ms DataStreamSender (dst_id=22):(Total: 15s799ms, non-child: 15s799ms, % non-child: 100.00%) - BytesSent: 719.48 MB (754428990) - NetworkThroughput(*): 77.93 MB/sec - OverallThroughput: 45.54 MB/sec - PeakMemoryUsage: 4.97 MB (5216000) - RowsReturned: 77.46M (77455758) - SerializeBatchTime: 6s548ms - TransmitDataRPCTime: 9s232ms - UncompressedRowBatchSize: 2.16 GB (2324506140) CodeGen:(Total: 195.148ms, non-child: 195.148ms, % non-child: 100.00%) - CodegenTime: 1.083ms - CompileTime: 51.009ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 123.761ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 19.958ms HASH_JOIN_NODE (id=5):(Total: 4s575ms, non-child: 3s016ms, % non-child: 65.92%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.474ms - PeakMemoryUsage: 1.23 MB (1291936) - ProbeRows: 77.46M (77455758) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 2s852ms - RowsReturned: 77.46M (77455758) - RowsReturnedRate: 16.93 M/sec Hash Join Builder (join_node_id=5): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 14.344us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 171.868us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 25.272us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 461.550ms, non-child: 14.166us, % non-child: 0.00%) BytesReceived(16s000ms): 963.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 3.893us - DeserializeRowBatchTimer: 17.614us - FirstBatchArrivalWaitTime: 427.089ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 259.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=3):(Total: 1s097ms, non-child: 1s097ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:232/13.35 GB 1:226/13.38 GB 0:238/13.83 GB 2:250/14.46 GB 7:220/12.77 GB 6:224/13.43 GB 4:210/11.82 GB 5:220/12.60 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 117 out of 117 Runtime filters: Only following filters arrived: 6, waited 342ms Hdfs Read Thread Concurrency Bucket: 0:99.09% 1:0.7246% 2:0.09058% 3:0% 4:0% 5:0.09058% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1703 PARQUET/SNAPPY:117 BytesRead(16s000ms): 13.39 MB, 14.62 MB, 14.62 MB, 20.17 MB, 29.37 MB, 29.37 MB, 38.33 MB, 44.28 MB, 44.75 MB, 57.45 MB, 58.93 MB, 59.45 MB, 72.66 MB, 73.59 MB, 77.41 MB, 88.53 MB, 88.53 MB, 96.93 MB, 103.32 MB, 103.35 MB, 113.03 MB, 117.82 MB, 117.82 MB, 119.50 MB, 131.51 MB, 132.67 MB, 132.67 MB, 132.83 MB, 137.28 MB, 140.45 MB, 143.72 MB, 143.72 MB, 143.72 MB, 143.72 MB - FooterProcessingTime: (Avg: 56.720ms ; Min: 3.943ms ; Max: 127.772ms ; Number of samples: 117) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 11.98 - BytesRead: 143.72 MB (150706502) - BytesReadDataNodeCache: 0 - BytesReadLocal: 143.72 MB (150706502) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 143.72 MB (150706502) - DecompressionTime: 423.306ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 117 (117) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 29.48 MB (30910224) - PerReadThreadRawHdfsThroughput: 20.72 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 102.702ms - RowBatchQueuePutWaitTime: 1h46m - RowsRead: 77.60M (77596812) - RowsReturned: 77.46M (77455758) - RowsReturnedRate: 70.54 M/sec - ScanRangesComplete: 1.82K (1820) - ScannerThreadsInvoluntaryContextSwitches: 21.99K (21989) - ScannerThreadsTotalWallClockTime: 1h50m - MaterializeTupleTime(*): 5s467ms - ScannerThreadsSysTime: 1m3s - ScannerThreadsUserTime: 2m17s - ScannerThreadsVoluntaryContextSwitches: 7.21M (7213370) - TotalRawHdfsReadTime(*): 6s935ms - TotalReadThroughput: 266.38 KB/sec Filter 2 (16.00 MB): - Rows processed: 2.03M (2034430) - Rows rejected: 141.03K (141026) - Rows total: 77.60M (77596812) Filter 5 (16.00 MB): - Rows processed: 1.81M (1812508) - Rows rejected: 28 (28) - Rows total: 77.46M (77455786) Filter 6 (1.00 MB): - Files processed: 1.82K (1820) - Files rejected: 1.70K (1703) - Files total: 1.82K (1820) - RowGroups processed: 75.61K (75610) - RowGroups rejected: 0 (0) - RowGroups total: 75.61K (75610) - Rows processed: 1.92M (1916928) - Rows rejected: 0 (0) - Rows total: 77.46M (77455758) - Splits processed: 117 (117) - Splits rejected: 0 (0) - Splits total: 117 (117) Instance 7f40dcb034de70b7:eb (host=ve1127.foo:22000):(Total: 9m17s, non-child: 8m56s, % non-child: 96.20%) Hdfs split stats (:<# splits>/): 1:209/12.12 GB 5:227/13.19 GB 6:243/13.70 GB 4:235/13.48 GB 3:225/13.46 GB 2:234/14.32 GB 7:221/12.82 GB 0:221/12.60 GB Filter 6 arrival: 696ms Filter 2 arrival: 13s409ms Filter 5 arrival: 16s968ms MemoryUsage(16s000ms): 32.86 MB, 64.78 MB, 65.80 MB, 65.55 MB, 64.77 MB, 64.72 MB, 64.14 MB, 65.78 MB, 65.67 MB, 65.71 MB, 65.73 MB, 65.70 MB, 66.68 MB, 66.76 MB, 65.66 MB, 65.74 MB, 65.79 MB, 65.56 MB, 65.80 MB, 65.73 MB, 65.43 MB, 64.66 MB, 64.83 MB, 64.34 MB, 65.47 MB, 65.69 MB, 65.85 MB, 65.72 MB, 65.30 MB, 62.52 MB, 60.97 MB, 59.09 MB, 59.04 MB, 58.39 MB ThreadUsage(16s000ms): 11, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.90 - BloomFilterBytes: 33.00 MB (34603008) - PeakMemoryUsage: 67.38 MB (70653971) - PerHostPeakMemUsage: 161.68 GB (173606286077) - RowsProduced: 77.66M (77655809) - TotalNetworkReceiveTime: 464.582ms - TotalNetworkSendTime: 8m50s - TotalStorageWaitTime: 13s608ms - TotalThreadsInvoluntaryContextSwitches: 29.17K (29169) - TotalThreadsTotalWallClockTime: 1h59m - TotalThreadsSysTime: 1m23s - TotalThreadsUserTime: 2m51s - TotalThreadsVoluntaryContextSwitches: 9.05M (9045669) Fragment Instance Lifecycle Timings: - ExecTime: 9m16s - ExecTreeExecTime: 3s823ms - OpenTime: 1s093ms - ExecTreeOpenTime: 909.734ms - PrepareTime: 54.238ms - ExecTreePrepareTime: 7.109ms DataStreamSender (dst_id=22):(Total: 16s300ms, non-child: 16s300ms, % non-child: 100.00%) - BytesSent: 716.78 MB (751600613) - NetworkThroughput(*): 78.80 MB/sec - OverallThroughput: 43.97 MB/sec - PeakMemoryUsage: 4.95 MB (5191424) - RowsReturned: 77.66M (77655809) - SerializeBatchTime: 7s182ms - TransmitDataRPCTime: 9s096ms - UncompressedRowBatchSize: 2.17 GB (2330509822) CodeGen:(Total: 203.970ms, non-child: 203.970ms, % non-child: 100.00%) - CodegenTime: 1.026ms - CompileTime: 54.129ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 127.527ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 21.876ms HASH_JOIN_NODE (id=5):(Total: 4s697ms, non-child: 3s194ms, % non-child: 68.01%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.977ms - PeakMemoryUsage: 1.23 MB (1294361) - ProbeRows: 77.66M (77655809) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3s028ms - RowsReturned: 77.66M (77655809) - RowsReturnedRate: 16.53 M/sec Hash Join Builder (join_node_id=5): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 26.755us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 162.081us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 55.253us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 464.599ms, non-child: 27.434us, % non-child: 0.01%) BytesReceived(16s000ms): 963.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 9.558us - DeserializeRowBatchTimer: 16.421us - FirstBatchArrivalWaitTime: 422.152ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 258.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=3):(Total: 1s038ms, non-child: 1s038ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:209/12.12 GB 5:227/13.19 GB 6:243/13.70 GB 4:235/13.48 GB 3:225/13.46 GB 2:234/14.32 GB 7:221/12.82 GB 0:221/12.60 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 118 out of 118 Runtime filters: Only following filters arrived: 6, waited 341ms Hdfs Read Thread Concurrency Bucket: 0:98.65% 1:1.173% 2:0.09025% 3:0.09025% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1697 PARQUET/SNAPPY:118 BytesRead(16s000ms): 13.07 MB, 14.42 MB, 14.42 MB, 18.58 MB, 28.28 MB, 28.53 MB, 37.55 MB, 42.98 MB, 43.61 MB, 56.05 MB, 57.05 MB, 60.40 MB, 71.11 MB, 71.77 MB, 78.03 MB, 85.46 MB, 86.26 MB, 95.27 MB, 100.02 MB, 100.72 MB, 109.45 MB, 113.99 MB, 114.57 MB, 116.17 MB, 127.07 MB, 128.28 MB, 128.98 MB, 130.26 MB, 136.74 MB, 139.59 MB, 139.59 MB, 139.59 MB, 139.59 MB, 139.59 MB - FooterProcessingTime: (Avg: 70.682ms ; Min: 28.322ms ; Max: 1s283ms ; Number of samples: 118) - AverageHdfsReadThreadConcurrency: 0.02 - AverageScannerThreadConcurrency: 11.91 - BytesRead: 139.59 MB (146375328) - BytesReadDataNodeCache: 0 - BytesReadLocal: 139.59 MB (146375328) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 139.59 MB (146375328) - DecompressionTime: 868.338ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 118 (118) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 29.19 MB (30603667) - PerReadThreadRawHdfsThroughput: 21.92 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 95.835ms - RowBatchQueuePutWaitTime: 1h46m - RowsRead: 77.80M (77799549) - RowsReturned: 77.66M (77655809) - RowsReturnedRate: 74.77 M/sec - ScanRangesComplete: 1.81K (1815) - ScannerThreadsInvoluntaryContextSwitches: 24.21K (24207) - ScannerThreadsTotalWallClockTime: 1h50m - MaterializeTupleTime(*): 6s150ms - ScannerThreadsSysTime: 1m22s - ScannerThreadsUserTime: 2m29s - ScannerThreadsVoluntaryContextSwitches: 9.04M (9042410) - TotalRawHdfsReadTime(*): 6s368ms - TotalReadThroughput: 257.79 KB/sec Filter 2 (16.00 MB): - Rows processed: 2.05M (2052476) - Rows rejected: 143.70K (143696) - Rows total: 77.80M (77799549) Filter 5 (16.00 MB): - Rows processed: 1.85M (1849202) - Rows rejected: 44 (44) - Rows total: 77.66M (77655853) Filter 6 (1.00 MB): - Files processed: 1.81K (1815) - Files rejected: 1.70K (1697) - Files total: 1.81K (1815) - RowGroups processed: 75.81K (75806) - RowGroups rejected: 0 (0) - RowGroups total: 75.81K (75806) - Rows processed: 1.93M (1933312) - Rows rejected: 0 (0) - Rows total: 77.66M (77655809) - Splits processed: 118 (118) - Splits rejected: 0 (0) - Splits total: 118 (118) Instance 7f40dcb034de70b7:f4 (host=vd1326.foo:22000):(Total: 9m17s, non-child: 8m55s, % non-child: 96.05%) Hdfs split stats (:<# splits>/): 3:212/12.82 GB 7:225/13.21 GB 6:227/13.48 GB 0:210/11.94 GB 5:249/14.71 GB 4:232/13.51 GB 1:221/12.70 GB 2:244/13.32 GB Filter 6 arrival: 646ms Filter 2 arrival: 13s666ms Filter 5 arrival: 17s053ms MemoryUsage(16s000ms): 33.52 MB, 65.80 MB, 66.77 MB, 66.03 MB, 65.83 MB, 65.84 MB, 66.42 MB, 66.79 MB, 66.71 MB, 66.55 MB, 66.81 MB, 66.75 MB, 64.01 MB, 64.76 MB, 64.77 MB, 65.78 MB, 65.83 MB, 65.72 MB, 65.79 MB, 65.82 MB, 66.09 MB, 66.57 MB, 66.83 MB, 66.81 MB, 65.52 MB, 65.77 MB, 65.87 MB, 65.84 MB, 65.65 MB, 65.57 MB, 60.05 MB, 57.98 MB, 57.88 MB, 57.91 MB ThreadUsage(16s000ms): 12, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.89 - BloomFilterBytes: 33.00 MB (34603008) - PeakMemoryUsage: 67.55 MB (70833158) - PerHostPeakMemUsage: 161.66 GB (173580718298) - RowsProduced: 77.04M (77038175) - TotalNetworkReceiveTime: 427.238ms - TotalNetworkSendTime: 8m49s - TotalStorageWaitTime: 10s720ms - TotalThreadsInvoluntaryContextSwitches: 35.21K (35208) - TotalThreadsTotalWallClockTime: 1h59m - TotalThreadsSysTime: 2m23s - TotalThreadsUserTime: 2m27s - TotalThreadsVoluntaryContextSwitches: 12.71M (12706946) Fragment Instance Lifecycle Timings: - ExecTime: 9m16s - ExecTreeExecTime: 3s819ms - OpenTime: 1s093ms - ExecTreeOpenTime: 922.118ms - PrepareTime: 49.373ms - ExecTreePrepareTime: 5.702ms DataStreamSender (dst_id=22):(Total: 17s129ms, non-child: 17s129ms, % non-child: 100.00%) - BytesSent: 712.80 MB (747429714) - NetworkThroughput(*): 73.76 MB/sec - OverallThroughput: 41.61 MB/sec - PeakMemoryUsage: 5.07 MB (5314304) - RowsReturned: 77.04M (77038175) - SerializeBatchTime: 7s444ms - TransmitDataRPCTime: 9s663ms - UncompressedRowBatchSize: 2.15 GB (2311974138) CodeGen:(Total: 190.649ms, non-child: 190.649ms, % non-child: 100.00%) - CodegenTime: 956.966us - CompileTime: 50.841ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 119.445ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 19.999ms HASH_JOIN_NODE (id=5):(Total: 4s703ms, non-child: 3s289ms, % non-child: 69.93%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.880ms - PeakMemoryUsage: 1.23 MB (1291839) - ProbeRows: 77.04M (77038175) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3s140ms - RowsReturned: 77.04M (77038175) - RowsReturnedRate: 16.38 M/sec Hash Join Builder (join_node_id=5): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 26.504us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 204.100us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 64.288us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 427.248ms, non-child: 19.642us, % non-child: 0.00%) BytesReceived(16s000ms): 932.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 4.560us - DeserializeRowBatchTimer: 18.158us - FirstBatchArrivalWaitTime: 416.436ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 280.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=3):(Total: 987.656ms, non-child: 987.656ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:212/12.82 GB 7:225/13.21 GB 6:227/13.48 GB 0:210/11.94 GB 5:249/14.71 GB 4:232/13.51 GB 1:221/12.70 GB 2:244/13.32 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 117 out of 117 Runtime filters: Only following filters arrived: 6, waited 382ms Hdfs Read Thread Concurrency Bucket: 0:98.91% 1:0.9991% 2:0.09083% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1703 PARQUET/SNAPPY:117 BytesRead(16s000ms): 13.29 MB, 14.66 MB, 14.66 MB, 20.19 MB, 29.49 MB, 29.49 MB, 38.83 MB, 44.08 MB, 44.31 MB, 57.20 MB, 59.04 MB, 59.47 MB, 71.69 MB, 73.46 MB, 75.57 MB, 87.55 MB, 88.03 MB, 93.62 MB, 102.32 MB, 102.61 MB, 110.02 MB, 116.66 MB, 117.20 MB, 117.32 MB, 129.47 MB, 131.13 MB, 131.89 MB, 131.89 MB, 131.89 MB, 135.03 MB, 141.48 MB, 141.48 MB, 141.48 MB, 141.48 MB - FooterProcessingTime: (Avg: 44.373ms ; Min: 4.326ms ; Max: 148.426ms ; Number of samples: 117) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 11.99 - BytesRead: 141.48 MB (148352339) - BytesReadDataNodeCache: 0 - BytesReadLocal: 141.48 MB (148352339) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 141.48 MB (148352339) - DecompressionTime: 4s320ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 117 (117) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 29.35 MB (30778075) - PerReadThreadRawHdfsThroughput: 22.89 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 104.434ms - RowBatchQueuePutWaitTime: 1h45m - RowsRead: 77.18M (77178817) - RowsReturned: 77.04M (77038175) - RowsReturnedRate: 78.00 M/sec - ScanRangesComplete: 1.82K (1820) - ScannerThreadsInvoluntaryContextSwitches: 30.27K (30269) - ScannerThreadsTotalWallClockTime: 1h50m - MaterializeTupleTime(*): 6s582ms - ScannerThreadsSysTime: 2m22s - ScannerThreadsUserTime: 2m3s - ScannerThreadsVoluntaryContextSwitches: 12.70M (12703803) - TotalRawHdfsReadTime(*): 6s181ms - TotalReadThroughput: 262.93 KB/sec Filter 2 (16.00 MB): - Rows processed: 2.05M (2048354) - Rows rejected: 140.60K (140605) - Rows total: 77.18M (77178817) Filter 5 (16.00 MB): - Rows processed: 1.80M (1797157) - Rows rejected: 37 (37) - Rows total: 77.04M (77038212) Filter 6 (1.00 MB): - Files processed: 1.82K (1820) - Files rejected: 1.70K (1703) - Files total: 1.82K (1820) - RowGroups processed: 75.21K (75207) - RowGroups rejected: 0 (0) - RowGroups total: 75.21K (75207) - Rows processed: 1.92M (1916928) - Rows rejected: 0 (0) - Rows total: 77.04M (77038175) - Splits processed: 117 (117) - Splits rejected: 0 (0) - Splits total: 117 (117) Instance 7f40dcb034de70b7:85 (host=vd1138.foo:22000):(Total: 9m14s, non-child: 8m51s, % non-child: 95.96%) Hdfs split stats (:<# splits>/): 7:235/13.65 GB 6:219/12.66 GB 2:228/13.11 GB 5:228/12.33 GB 1:221/12.66 GB 3:214/11.93 GB 4:221/12.72 GB 0:252/16.64 GB Filter 6 arrival: 1s144ms Filter 2 arrival: 11s287ms Filter 5 arrival: 15s752ms MemoryUsage(16s000ms): 36.66 MB, 65.80 MB, 65.73 MB, 65.85 MB, 65.79 MB, 65.67 MB, 66.62 MB, 66.80 MB, 66.55 MB, 65.68 MB, 65.73 MB, 65.74 MB, 65.79 MB, 65.76 MB, 65.60 MB, 66.72 MB, 66.85 MB, 66.49 MB, 66.77 MB, 66.76 MB, 66.56 MB, 64.66 MB, 64.75 MB, 64.74 MB, 65.24 MB, 65.79 MB, 65.83 MB, 65.53 MB, 65.76 MB, 65.62 MB, 63.14 MB, 55.60 MB, 55.70 MB, 54.87 MB ThreadUsage(16s000ms): 12, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.98 - BloomFilterBytes: 33.00 MB (34603008) - PeakMemoryUsage: 67.44 MB (70718848) - PerHostPeakMemUsage: 161.65 GB (173574184842) - RowsProduced: 76.06M (76057518) - TotalNetworkReceiveTime: 894.304ms - TotalNetworkSendTime: 8m45s - TotalStorageWaitTime: 13s288ms - TotalThreadsInvoluntaryContextSwitches: 39.65K (39649) - TotalThreadsTotalWallClockTime: 1h59m - TotalThreadsSysTime: 3m15s - TotalThreadsUserTime: 2m15s - TotalThreadsVoluntaryContextSwitches: 11.50M (11496787) Fragment Instance Lifecycle Timings: - ExecTime: 9m12s - ExecTreeExecTime: 3s785ms - OpenTime: 1s305ms - ExecTreeOpenTime: 1s109ms - PrepareTime: 59.230ms - ExecTreePrepareTime: 7.101ms DataStreamSender (dst_id=22):(Total: 17s319ms, non-child: 17s319ms, % non-child: 100.00%) - BytesSent: 704.56 MB (738779976) - NetworkThroughput(*): 72.40 MB/sec - OverallThroughput: 40.68 MB/sec - PeakMemoryUsage: 4.93 MB (5166848) - RowsReturned: 76.06M (76057518) - SerializeBatchTime: 7s566ms - TransmitDataRPCTime: 9s731ms - UncompressedRowBatchSize: 2.13 GB (2282543900) CodeGen:(Total: 217.538ms, non-child: 217.538ms, % non-child: 100.00%) - CodegenTime: 1.308ms - CompileTime: 57.774ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 134.457ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 24.838ms HASH_JOIN_NODE (id=5):(Total: 4s859ms, non-child: 3s302ms, % non-child: 67.96%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.449ms - PeakMemoryUsage: 1.24 MB (1296862) - ProbeRows: 76.06M (76057518) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3s162ms - RowsReturned: 76.06M (76057518) - RowsReturnedRate: 15.65 M/sec Hash Join Builder (join_node_id=5): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 38.568us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 142.212us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 47.212us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 894.315ms, non-child: 20.046us, % non-child: 0.00%) BytesReceived(16s000ms): 932.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 5.082us - DeserializeRowBatchTimer: 21.670us - FirstBatchArrivalWaitTime: 863.620ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 134.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=3):(Total: 663.302ms, non-child: 663.302ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:235/13.65 GB 6:219/12.66 GB 2:228/13.11 GB 5:228/12.33 GB 1:221/12.66 GB 3:214/11.93 GB 4:221/12.72 GB 0:252/16.64 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 115 out of 115 Runtime filters: Only following filters arrived: 6, waited 40ms Hdfs Read Thread Concurrency Bucket: 0:99.1% 1:0.6329% 2:0.2712% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1703 PARQUET/SNAPPY:115 BytesRead(16s000ms): 13.27 MB, 14.54 MB, 14.73 MB, 20.92 MB, 29.03 MB, 29.79 MB, 40.32 MB, 43.69 MB, 46.05 MB, 57.37 MB, 58.19 MB, 61.83 MB, 72.76 MB, 73.12 MB, 76.78 MB, 87.39 MB, 87.80 MB, 93.07 MB, 102.53 MB, 102.90 MB, 104.94 MB, 114.78 MB, 116.84 MB, 117.54 MB, 120.95 MB, 130.19 MB, 131.43 MB, 131.63 MB, 132.72 MB, 132.76 MB, 138.53 MB, 140.10 MB, 140.10 MB, 140.10 MB - FooterProcessingTime: (Avg: 66.206ms ; Min: 4.322ms ; Max: 230.537ms ; Number of samples: 115) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 11.98 - BytesRead: 140.10 MB (146901002) - BytesReadDataNodeCache: 0 - BytesReadLocal: 140.10 MB (146901002) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 140.10 MB (146901002) - DecompressionTime: 545.449ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 115 (115) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 29.24 MB (30660014) - PerReadThreadRawHdfsThroughput: 21.64 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 168.528ms - RowBatchQueuePutWaitTime: 1h44m - RowsRead: 76.20M (76195328) - RowsReturned: 76.06M (76057518) - RowsReturnedRate: 114.66 M/sec - ScanRangesComplete: 1.82K (1818) - ScannerThreadsInvoluntaryContextSwitches: 34.61K (34607) - ScannerThreadsTotalWallClockTime: 1h50m - MaterializeTupleTime(*): 6s669ms - ScannerThreadsSysTime: 3m15s - ScannerThreadsUserTime: 1m50s - ScannerThreadsVoluntaryContextSwitches: 11.49M (11493751) - TotalRawHdfsReadTime(*): 6s474ms - TotalReadThroughput: 259.42 KB/sec Filter 2 (16.00 MB): - Rows processed: 1.99M (1989202) - Rows rejected: 137.78K (137775) - Rows total: 76.20M (76195328) Filter 5 (16.00 MB): - Rows processed: 1.84M (1835043) - Rows rejected: 35 (35) - Rows total: 76.06M (76057553) Filter 6 (1.00 MB): - Files processed: 1.82K (1818) - Files rejected: 1.70K (1703) - Files total: 1.82K (1818) - RowGroups processed: 74.24K (74244) - RowGroups rejected: 0 (0) - RowGroups total: 74.24K (74244) - Rows processed: 1.88M (1884160) - Rows rejected: 0 (0) - Rows total: 76.06M (76057518) - Splits processed: 115 (115) - Splits rejected: 0 (0) - Splits total: 115 (115) Instance 7f40dcb034de70b7:84 (host=vc1516.foo:22000):(Total: 9m14s, non-child: 8m52s, % non-child: 96.12%) Hdfs split stats (:<# splits>/): 0:230/13.91 GB 2:219/13.16 GB 7:227/12.53 GB 1:220/12.79 GB 5:219/12.59 GB 3:216/12.36 GB 6:246/14.83 GB 4:237/13.51 GB Filter 6 arrival: 1s147ms Filter 2 arrival: 11s287ms Filter 5 arrival: 15s768ms MemoryUsage(16s000ms): 35.54 MB, 64.74 MB, 64.79 MB, 65.30 MB, 66.86 MB, 66.70 MB, 65.79 MB, 65.82 MB, 65.56 MB, 66.69 MB, 66.80 MB, 65.35 MB, 65.81 MB, 66.28 MB, 65.62 MB, 65.82 MB, 65.75 MB, 66.23 MB, 66.80 MB, 66.74 MB, 65.98 MB, 65.80 MB, 65.76 MB, 65.34 MB, 66.78 MB, 66.81 MB, 66.79 MB, 65.52 MB, 63.14 MB, 62.02 MB, 62.47 MB, 62.41 MB, 62.34 MB, 58.96 MB ThreadUsage(16s000ms): 12, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.95 - BloomFilterBytes: 33.00 MB (34603008) - PeakMemoryUsage: 67.41 MB (70687597) - PerHostPeakMemUsage: 161.67 GB (173590582774) - RowsProduced: 78.21M (78207793) - TotalNetworkReceiveTime: 923.010ms - TotalNetworkSendTime: 8m48s - TotalStorageWaitTime: 15s117ms - TotalThreadsInvoluntaryContextSwitches: 32.57K (32567) - TotalThreadsTotalWallClockTime: 1h59m - TotalThreadsSysTime: 1m32s - TotalThreadsUserTime: 3m13s - TotalThreadsVoluntaryContextSwitches: 5.16M (5156013) Fragment Instance Lifecycle Timings: - ExecTime: 9m12s - ExecTreeExecTime: 3s740ms - OpenTime: 1s285ms - ExecTreeOpenTime: 1s105ms - PrepareTime: 50.222ms - ExecTreePrepareTime: 6.466ms DataStreamSender (dst_id=22):(Total: 16s484ms, non-child: 16s484ms, % non-child: 100.00%) - BytesSent: 722.51 MB (757608761) - NetworkThroughput(*): 76.85 MB/sec - OverallThroughput: 43.83 MB/sec - PeakMemoryUsage: 5.00 MB (5240576) - RowsReturned: 78.21M (78207793) - SerializeBatchTime: 7s064ms - TransmitDataRPCTime: 9s401ms - UncompressedRowBatchSize: 2.19 GB (2347075270) CodeGen:(Total: 197.683ms, non-child: 197.683ms, % non-child: 100.00%) - CodegenTime: 1.097ms - CompileTime: 53.147ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 125.110ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 19.029ms HASH_JOIN_NODE (id=5):(Total: 4s813ms, non-child: 3s290ms, % non-child: 68.36%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.299ms - PeakMemoryUsage: 1.24 MB (1296743) - ProbeRows: 78.21M (78207793) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3s138ms - RowsReturned: 78.21M (78207793) - RowsReturnedRate: 16.25 M/sec Hash Join Builder (join_node_id=5): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 23.467us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 108.870us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 47.124us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 923.019ms, non-child: 17.126us, % non-child: 0.00%) BytesReceived(16s000ms): 932.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 4.704us - DeserializeRowBatchTimer: 14.660us - FirstBatchArrivalWaitTime: 895.287ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 130.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=3):(Total: 600.749ms, non-child: 600.749ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:230/13.91 GB 2:219/13.16 GB 7:227/12.53 GB 1:220/12.79 GB 5:219/12.59 GB 3:216/12.36 GB 6:246/14.83 GB 4:237/13.51 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 119 out of 119 Runtime filters: Only following filters arrived: 6, waited 40ms Hdfs Read Thread Concurrency Bucket: 0:98.91% 1:0.8174% 2:0.09083% 3:0.09083% 4:0.09083% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1695 PARQUET/SNAPPY:119 BytesRead(16s000ms): 13.19 MB, 14.54 MB, 15.02 MB, 21.83 MB, 28.97 MB, 30.05 MB, 41.39 MB, 43.25 MB, 45.45 MB, 57.55 MB, 57.97 MB, 61.26 MB, 72.34 MB, 72.93 MB, 80.01 MB, 86.84 MB, 87.68 MB, 97.87 MB, 101.31 MB, 102.98 MB, 114.19 MB, 116.07 MB, 116.53 MB, 122.48 MB, 130.56 MB, 130.56 MB, 131.16 MB, 133.60 MB, 141.92 MB, 143.04 MB, 143.04 MB, 143.04 MB, 143.04 MB, 143.04 MB - FooterProcessingTime: (Avg: 73.295ms ; Min: 13.818ms ; Max: 1s230ms ; Number of samples: 119) - AverageHdfsReadThreadConcurrency: 0.02 - AverageScannerThreadConcurrency: 11.98 - BytesRead: 143.04 MB (149989519) - BytesReadDataNodeCache: 0 - BytesReadLocal: 143.04 MB (149989519) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 143.04 MB (149989519) - DecompressionTime: 1s570ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 119 (119) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 29.26 MB (30684749) - PerReadThreadRawHdfsThroughput: 19.99 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 136.240ms - RowBatchQueuePutWaitTime: 1h45m - RowsRead: 78.35M (78347084) - RowsReturned: 78.21M (78207793) - RowsReturnedRate: 130.18 M/sec - ScanRangesComplete: 1.81K (1814) - ScannerThreadsInvoluntaryContextSwitches: 27.72K (27723) - ScannerThreadsTotalWallClockTime: 1h50m - MaterializeTupleTime(*): 6s181ms - ScannerThreadsSysTime: 1m31s - ScannerThreadsUserTime: 2m51s - ScannerThreadsVoluntaryContextSwitches: 5.15M (5152843) - TotalRawHdfsReadTime(*): 7s153ms - TotalReadThroughput: 266.07 KB/sec Filter 2 (16.00 MB): - Rows processed: 2.04M (2040859) - Rows rejected: 139.26K (139262) - Rows total: 78.35M (78347084) Filter 5 (16.00 MB): - Rows processed: 1.90M (1901597) - Rows rejected: 29 (29) - Rows total: 78.21M (78207822) Filter 6 (1.00 MB): - Files processed: 1.81K (1814) - Files rejected: 1.70K (1695) - Files total: 1.81K (1814) - RowGroups processed: 76.35K (76349) - RowGroups rejected: 0 (0) - RowGroups total: 76.35K (76349) - Rows processed: 1.95M (1949696) - Rows rejected: 0 (0) - Rows total: 78.21M (78207793) - Splits processed: 119 (119) - Splits rejected: 0 (0) - Splits total: 119 (119) Instance 7f40dcb034de70b7:89 (host=vd1104.foo:22000):(Total: 9m14s, non-child: 8m52s, % non-child: 96.14%) Hdfs split stats (:<# splits>/): 4:227/12.66 GB 1:209/12.97 GB 0:223/13.03 GB 6:243/14.15 GB 3:228/13.86 GB 7:223/12.51 GB 5:246/13.62 GB 2:227/12.84 GB Filter 6 arrival: 1s086ms Filter 2 arrival: 11s400ms Filter 5 arrival: 15s816ms MemoryUsage(16s000ms): 36.73 MB, 66.78 MB, 66.74 MB, 66.69 MB, 66.81 MB, 66.65 MB, 64.78 MB, 64.80 MB, 65.05 MB, 65.52 MB, 64.82 MB, 64.94 MB, 66.03 MB, 66.80 MB, 66.38 MB, 66.68 MB, 66.66 MB, 66.52 MB, 65.80 MB, 65.81 MB, 65.49 MB, 66.68 MB, 66.75 MB, 66.19 MB, 65.44 MB, 65.83 MB, 65.83 MB, 65.97 MB, 66.86 MB, 66.28 MB, 60.73 MB, 57.92 MB, 57.87 MB, 53.17 MB ThreadUsage(16s000ms): 12, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.87 - BloomFilterBytes: 33.00 MB (34603008) - PeakMemoryUsage: 67.38 MB (70648541) - PerHostPeakMemUsage: 161.68 GB (173602758454) - RowsProduced: 77.65M (77648181) - TotalNetworkReceiveTime: 860.069ms - TotalNetworkSendTime: 8m42s - TotalStorageWaitTime: 12s191ms - TotalThreadsInvoluntaryContextSwitches: 35.09K (35089) - TotalThreadsTotalWallClockTime: 1h58m - TotalThreadsSysTime: 2m30s - TotalThreadsUserTime: 2m38s - TotalThreadsVoluntaryContextSwitches: 14.36M (14364938) Fragment Instance Lifecycle Timings: - ExecTime: 9m12s - ExecTreeExecTime: 3s695ms - OpenTime: 1s175ms - ExecTreeOpenTime: 994.150ms - PrepareTime: 49.719ms - ExecTreePrepareTime: 6.242ms DataStreamSender (dst_id=22):(Total: 16s555ms, non-child: 16s555ms, % non-child: 100.00%) - BytesSent: 717.67 MB (752536473) - NetworkThroughput(*): 76.86 MB/sec - OverallThroughput: 43.35 MB/sec - PeakMemoryUsage: 4.96 MB (5199616) - RowsReturned: 77.65M (77648181) - SerializeBatchTime: 7s197ms - TransmitDataRPCTime: 9s337ms - UncompressedRowBatchSize: 2.17 GB (2330280878) CodeGen:(Total: 199.646ms, non-child: 199.646ms, % non-child: 100.00%) - CodegenTime: 1.038ms - CompileTime: 53.263ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 126.714ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 19.287ms HASH_JOIN_NODE (id=5):(Total: 4s650ms, non-child: 3s233ms, % non-child: 69.51%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.454ms - PeakMemoryUsage: 1.24 MB (1296264) - ProbeRows: 77.65M (77648181) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3s079ms - RowsReturned: 77.65M (77648181) - RowsReturnedRate: 16.70 M/sec Hash Join Builder (join_node_id=5): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 34.941us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 158.430us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 81.971us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 860.079ms, non-child: 17.955us, % non-child: 0.00%) BytesReceived(16s000ms): 932.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 4.918us - DeserializeRowBatchTimer: 12.262us - FirstBatchArrivalWaitTime: 849.074ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 139.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=3):(Total: 558.374ms, non-child: 558.374ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:227/12.66 GB 1:209/12.97 GB 0:223/13.03 GB 6:243/14.15 GB 3:228/13.86 GB 7:223/12.51 GB 5:246/13.62 GB 2:227/12.84 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 117 out of 117 Runtime filters: Only following filters arrived: 6, waited 40ms Hdfs Read Thread Concurrency Bucket: 0:98.81% 1:1.007% 2:0% 3:0% 4:0.1832% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1709 PARQUET/SNAPPY:117 BytesRead(16s000ms): 13.37 MB, 15.02 MB, 15.90 MB, 23.75 MB, 30.46 MB, 31.57 MB, 42.46 MB, 45.43 MB, 48.26 MB, 58.80 MB, 59.73 MB, 64.57 MB, 73.26 MB, 74.24 MB, 78.50 MB, 88.04 MB, 88.89 MB, 98.01 MB, 103.04 MB, 103.79 MB, 111.61 MB, 117.38 MB, 118.01 MB, 119.98 MB, 128.79 MB, 131.58 MB, 132.19 MB, 132.94 MB, 136.83 MB, 138.37 MB, 141.98 MB, 141.98 MB, 141.98 MB, 141.98 MB - FooterProcessingTime: (Avg: 54.898ms ; Min: 4.586ms ; Max: 209.923ms ; Number of samples: 117) - AverageHdfsReadThreadConcurrency: 0.02 - AverageScannerThreadConcurrency: 11.98 - BytesRead: 141.98 MB (148875362) - BytesReadDataNodeCache: 0 - BytesReadLocal: 141.98 MB (148875362) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 141.98 MB (148875362) - DecompressionTime: 776.597ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 117 (117) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 29.23 MB (30654236) - PerReadThreadRawHdfsThroughput: 21.94 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 89.002ms - RowBatchQueuePutWaitTime: 1h44m - RowsRead: 77.78M (77784658) - RowsReturned: 77.65M (77648181) - RowsReturnedRate: 139.06 M/sec - ScanRangesComplete: 1.83K (1826) - ScannerThreadsInvoluntaryContextSwitches: 30.22K (30217) - ScannerThreadsTotalWallClockTime: 1h49m - MaterializeTupleTime(*): 6s231ms - ScannerThreadsSysTime: 2m29s - ScannerThreadsUserTime: 2m16s - ScannerThreadsVoluntaryContextSwitches: 14.36M (14361887) - TotalRawHdfsReadTime(*): 6s471ms - TotalReadThroughput: 266.27 KB/sec Filter 2 (16.00 MB): - Rows processed: 1.96M (1963293) - Rows rejected: 136.45K (136448) - Rows total: 77.78M (77784658) Filter 5 (16.00 MB): - Rows processed: 1.81M (1810461) - Rows rejected: 29 (29) - Rows total: 77.65M (77648210) Filter 6 (1.00 MB): - Files processed: 1.83K (1826) - Files rejected: 1.71K (1709) - Files total: 1.83K (1826) - RowGroups processed: 75.80K (75798) - RowGroups rejected: 0 (0) - RowGroups total: 75.80K (75798) - Rows processed: 1.92M (1916928) - Rows rejected: 0 (0) - Rows total: 77.65M (77648181) - Splits processed: 117 (117) - Splits rejected: 0 (0) - Splits total: 117 (117) Instance 7f40dcb034de70b7:8e (host=vd1333.foo:22000):(Total: 9m14s, non-child: 8m52s, % non-child: 96.13%) Hdfs split stats (:<# splits>/): 0:225/12.59 GB 5:229/14.18 GB 2:220/13.81 GB 6:224/12.79 GB 4:210/12.47 GB 1:219/12.81 GB 3:241/13.29 GB 7:238/13.76 GB Filter 6 arrival: 1s118ms Filter 2 arrival: 11s571ms Filter 5 arrival: 15s868ms MemoryUsage(16s000ms): 35.02 MB, 65.75 MB, 65.82 MB, 65.47 MB, 65.78 MB, 65.81 MB, 65.83 MB, 65.87 MB, 64.66 MB, 64.49 MB, 64.85 MB, 65.67 MB, 66.67 MB, 66.81 MB, 66.62 MB, 66.81 MB, 66.86 MB, 65.95 MB, 65.75 MB, 65.56 MB, 66.65 MB, 66.80 MB, 66.80 MB, 66.70 MB, 65.25 MB, 64.72 MB, 64.77 MB, 64.36 MB, 63.70 MB, 61.19 MB, 59.14 MB, 59.21 MB, 58.83 MB, 54.71 MB ThreadUsage(16s000ms): 12, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.87 - BloomFilterBytes: 33.00 MB (34603008) - PeakMemoryUsage: 67.38 MB (70652966) - PerHostPeakMemUsage: 161.67 GB (173594950580) - RowsProduced: 77.52M (77523927) - TotalNetworkReceiveTime: 879.597ms - TotalNetworkSendTime: 8m44s - TotalStorageWaitTime: 13s063ms - TotalThreadsInvoluntaryContextSwitches: 33.14K (33136) - TotalThreadsTotalWallClockTime: 1h58m - TotalThreadsSysTime: 1m59s - TotalThreadsUserTime: 2m48s - TotalThreadsVoluntaryContextSwitches: 8.64M (8644771) Fragment Instance Lifecycle Timings: - ExecTime: 9m12s - ExecTreeExecTime: 3s664ms - OpenTime: 1s246ms - ExecTreeOpenTime: 1s055ms - PrepareTime: 53.479ms - ExecTreePrepareTime: 5.961ms DataStreamSender (dst_id=22):(Total: 16s530ms, non-child: 16s530ms, % non-child: 100.00%) - BytesSent: 715.43 MB (750183168) - NetworkThroughput(*): 77.95 MB/sec - OverallThroughput: 43.28 MB/sec - PeakMemoryUsage: 4.93 MB (5166848) - RowsReturned: 77.52M (77523927) - SerializeBatchTime: 7s332ms - TransmitDataRPCTime: 9s178ms - UncompressedRowBatchSize: 2.17 GB (2326551922) CodeGen:(Total: 212.989ms, non-child: 212.989ms, % non-child: 100.00%) - CodegenTime: 914.724us - CompileTime: 58.320ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 131.088ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 22.966ms HASH_JOIN_NODE (id=5):(Total: 4s684ms, non-child: 3s231ms, % non-child: 68.97%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 633.710us - PeakMemoryUsage: 1.23 MB (1292519) - ProbeRows: 77.52M (77523927) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3s076ms - RowsReturned: 77.52M (77523927) - RowsReturnedRate: 16.55 M/sec Hash Join Builder (join_node_id=5): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 12.056us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 40.386us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 21.499us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 879.603ms, non-child: 11.257us, % non-child: 0.00%) BytesReceived(16s000ms): 932.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 2.863us - DeserializeRowBatchTimer: 12.395us - FirstBatchArrivalWaitTime: 838.106ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 136.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=3):(Total: 574.554ms, non-child: 574.554ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:225/12.59 GB 5:229/14.18 GB 2:220/13.81 GB 6:224/12.79 GB 4:210/12.47 GB 1:219/12.81 GB 3:241/13.29 GB 7:238/13.76 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 117 out of 117 Runtime filters: Only following filters arrived: 6, waited 40ms Hdfs Read Thread Concurrency Bucket: 0:99.18% 1:0.7333% 2:0.09166% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1689 PARQUET/SNAPPY:117 BytesRead(16s000ms): 13.18 MB, 14.54 MB, 15.06 MB, 21.26 MB, 28.90 MB, 29.72 MB, 39.57 MB, 43.39 MB, 45.01 MB, 56.15 MB, 57.56 MB, 60.93 MB, 72.13 MB, 72.78 MB, 78.96 MB, 86.95 MB, 87.70 MB, 97.32 MB, 101.34 MB, 102.82 MB, 113.98 MB, 116.02 MB, 116.33 MB, 119.71 MB, 129.12 MB, 130.27 MB, 130.57 MB, 132.33 MB, 138.30 MB, 140.92 MB, 140.92 MB, 140.92 MB, 140.92 MB, 140.92 MB - FooterProcessingTime: (Avg: 61.966ms ; Min: 26.946ms ; Max: 193.133ms ; Number of samples: 117) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 11.99 - BytesRead: 140.92 MB (147761528) - BytesReadDataNodeCache: 0 - BytesReadLocal: 140.92 MB (147761528) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 140.92 MB (147761528) - DecompressionTime: 480.029ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 117 (117) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 29.12 MB (30533840) - PerReadThreadRawHdfsThroughput: 20.88 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 129.564ms - RowBatchQueuePutWaitTime: 1h44m - RowsRead: 77.66M (77661914) - RowsReturned: 77.52M (77523927) - RowsReturnedRate: 134.93 M/sec - ScanRangesComplete: 1.81K (1806) - ScannerThreadsInvoluntaryContextSwitches: 28.21K (28210) - ScannerThreadsTotalWallClockTime: 1h49m - MaterializeTupleTime(*): 6s180ms - ScannerThreadsSysTime: 1m59s - ScannerThreadsUserTime: 2m24s - ScannerThreadsVoluntaryContextSwitches: 8.64M (8641663) - TotalRawHdfsReadTime(*): 6s749ms - TotalReadThroughput: 264.28 KB/sec Filter 2 (16.00 MB): - Rows processed: 1.98M (1980163) - Rows rejected: 137.94K (137944) - Rows total: 77.66M (77661914) Filter 5 (16.00 MB): - Rows processed: 1.84M (1842219) - Rows rejected: 43 (43) - Rows total: 77.52M (77523970) Filter 6 (1.00 MB): - Files processed: 1.81K (1806) - Files rejected: 1.69K (1689) - Files total: 1.81K (1806) - RowGroups processed: 75.67K (75674) - RowGroups rejected: 0 (0) - RowGroups total: 75.67K (75674) - Rows processed: 1.92M (1916928) - Rows rejected: 0 (0) - Rows total: 77.52M (77523927) - Splits processed: 117 (117) - Splits rejected: 0 (0) - Splits total: 117 (117) Instance 7f40dcb034de70b7:96 (host=vd1335.foo:22000):(Total: 9m14s, non-child: 8m52s, % non-child: 96.15%) Hdfs split stats (:<# splits>/): 5:240/13.99 GB 0:227/12.45 GB 6:214/13.25 GB 7:222/12.98 GB 3:217/12.31 GB 1:217/12.89 GB 4:240/14.33 GB 2:237/13.49 GB Filter 6 arrival: 1s056ms Filter 2 arrival: 11s771ms Filter 5 arrival: 15s950ms MemoryUsage(16s000ms): 36.68 MB, 66.77 MB, 66.82 MB, 65.86 MB, 64.75 MB, 64.67 MB, 65.56 MB, 65.81 MB, 65.38 MB, 65.75 MB, 65.72 MB, 66.08 MB, 66.76 MB, 66.39 MB, 66.56 MB, 66.80 MB, 66.42 MB, 64.66 MB, 64.82 MB, 64.25 MB, 63.79 MB, 63.79 MB, 63.64 MB, 64.04 MB, 65.59 MB, 65.71 MB, 65.78 MB, 65.85 MB, 64.15 MB, 62.25 MB, 62.45 MB, 61.91 MB, 60.25 MB, 58.12 MB ThreadUsage(16s000ms): 12, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.87 - BloomFilterBytes: 33.00 MB (34603008) - PeakMemoryUsage: 67.44 MB (70715885) - PerHostPeakMemUsage: 161.64 GB (173558926611) - RowsProduced: 78.22M (78220027) - TotalNetworkReceiveTime: 805.640ms - TotalNetworkSendTime: 8m48s - TotalStorageWaitTime: 12s719ms - TotalThreadsInvoluntaryContextSwitches: 30.53K (30534) - TotalThreadsTotalWallClockTime: 1h58m - TotalThreadsSysTime: 1m15s - TotalThreadsUserTime: 3m7s - TotalThreadsVoluntaryContextSwitches: 7.16M (7162126) Fragment Instance Lifecycle Timings: - ExecTime: 9m12s - ExecTreeExecTime: 3s623ms - OpenTime: 1s208ms - ExecTreeOpenTime: 1s015ms - PrepareTime: 62.431ms - ExecTreePrepareTime: 7.128ms DataStreamSender (dst_id=22):(Total: 16s525ms, non-child: 16s525ms, % non-child: 100.00%) - BytesSent: 720.42 MB (755411028) - NetworkThroughput(*): 79.15 MB/sec - OverallThroughput: 43.59 MB/sec - PeakMemoryUsage: 4.95 MB (5191424) - RowsReturned: 78.22M (78220027) - SerializeBatchTime: 7s403ms - TransmitDataRPCTime: 9s102ms - UncompressedRowBatchSize: 2.19 GB (2347442394) CodeGen:(Total: 214.587ms, non-child: 214.587ms, % non-child: 100.00%) - CodegenTime: 1.079ms - CompileTime: 57.427ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 133.592ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 23.118ms HASH_JOIN_NODE (id=5):(Total: 4s612ms, non-child: 3s202ms, % non-child: 69.42%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.751ms - PeakMemoryUsage: 1.24 MB (1296353) - ProbeRows: 78.22M (78220027) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3s043ms - RowsReturned: 78.22M (78220027) - RowsReturnedRate: 16.96 M/sec Hash Join Builder (join_node_id=5): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 25.719us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 183.879us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 61.611us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 805.653ms, non-child: 24.559us, % non-child: 0.00%) BytesReceived(16s000ms): 932.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 5.239us - DeserializeRowBatchTimer: 24.486us - FirstBatchArrivalWaitTime: 779.915ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 148.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=3):(Total: 605.149ms, non-child: 605.149ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:240/13.99 GB 0:227/12.45 GB 6:214/13.25 GB 7:222/12.98 GB 3:217/12.31 GB 1:217/12.89 GB 4:240/14.33 GB 2:237/13.49 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 118 out of 118 Runtime filters: Only following filters arrived: 6, waited 41ms Hdfs Read Thread Concurrency Bucket: 0:99.09% 1:0.726% 2:0.09074% 3:0% 4:0.09074% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1696 PARQUET/SNAPPY:118 BytesRead(16s000ms): 13.23 MB, 14.45 MB, 14.86 MB, 20.86 MB, 28.50 MB, 29.49 MB, 40.23 MB, 42.73 MB, 46.85 MB, 56.81 MB, 57.34 MB, 64.61 MB, 71.43 MB, 72.68 MB, 82.55 MB, 86.11 MB, 88.29 MB, 99.30 MB, 100.21 MB, 103.31 MB, 114.07 MB, 114.23 MB, 115.24 MB, 120.18 MB, 128.58 MB, 128.62 MB, 129.64 MB, 131.69 MB, 140.17 MB, 140.64 MB, 140.64 MB, 140.64 MB, 140.64 MB, 140.64 MB - FooterProcessingTime: (Avg: 62.861ms ; Min: 3.746ms ; Max: 290.615ms ; Number of samples: 118) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 11.90 - BytesRead: 140.64 MB (147469374) - BytesReadDataNodeCache: 0 - BytesReadLocal: 140.64 MB (147469374) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 140.64 MB (147469374) - DecompressionTime: 451.136ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 118 (118) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 29.20 MB (30621634) - PerReadThreadRawHdfsThroughput: 22.43 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 160.235ms - RowBatchQueuePutWaitTime: 1h45m - RowsRead: 78.36M (78362619) - RowsReturned: 78.22M (78220027) - RowsReturnedRate: 129.26 M/sec - ScanRangesComplete: 1.81K (1814) - ScannerThreadsInvoluntaryContextSwitches: 25.67K (25668) - ScannerThreadsTotalWallClockTime: 1h49m - MaterializeTupleTime(*): 5s405ms - ScannerThreadsSysTime: 1m14s - ScannerThreadsUserTime: 2m46s - ScannerThreadsVoluntaryContextSwitches: 7.16M (7158959) - TotalRawHdfsReadTime(*): 6s269ms - TotalReadThroughput: 261.37 KB/sec Filter 2 (16.00 MB): - Rows processed: 2.04M (2038016) - Rows rejected: 142.55K (142553) - Rows total: 78.36M (78362619) Filter 5 (16.00 MB): - Rows processed: 1.86M (1862695) - Rows rejected: 39 (39) - Rows total: 78.22M (78220066) Filter 6 (1.00 MB): - Files processed: 1.81K (1814) - Files rejected: 1.70K (1696) - Files total: 1.81K (1814) - RowGroups processed: 76.37K (76367) - RowGroups rejected: 0 (0) - RowGroups total: 76.37K (76367) - Rows processed: 1.93M (1933312) - Rows rejected: 0 (0) - Rows total: 78.22M (78220027) - Splits processed: 118 (118) - Splits rejected: 0 (0) - Splits total: 118 (118) Instance 7f40dcb034de70b7:a4 (host=vd1108.foo:22000):(Total: 9m14s, non-child: 8m52s, % non-child: 96.07%) Hdfs split stats (:<# splits>/): 5:218/13.82 GB 1:230/12.78 GB 2:222/12.47 GB 7:228/13.11 GB 6:250/14.65 GB 0:210/12.52 GB 3:235/13.28 GB 4:227/13.03 GB Filter 6 arrival: 1s015ms Filter 2 arrival: 12s244ms Filter 5 arrival: 16s181ms MemoryUsage(16s000ms): 35.44 MB, 65.82 MB, 65.75 MB, 66.02 MB, 66.76 MB, 66.72 MB, 66.75 MB, 66.74 MB, 66.84 MB, 65.69 MB, 65.77 MB, 65.81 MB, 66.73 MB, 66.83 MB, 66.77 MB, 66.84 MB, 66.79 MB, 66.76 MB, 66.81 MB, 66.67 MB, 65.48 MB, 65.72 MB, 65.86 MB, 66.29 MB, 66.74 MB, 66.83 MB, 66.81 MB, 66.69 MB, 66.44 MB, 64.10 MB, 59.70 MB, 57.82 MB, 57.92 MB, 52.21 MB ThreadUsage(16s000ms): 12, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.87 - BloomFilterBytes: 33.00 MB (34603008) - PeakMemoryUsage: 67.49 MB (70770462) - PerHostPeakMemUsage: 161.66 GB (173582052364) - RowsProduced: 77.49M (77485031) - TotalNetworkReceiveTime: 795.881ms - TotalNetworkSendTime: 8m45s - TotalStorageWaitTime: 12s713ms - TotalThreadsInvoluntaryContextSwitches: 35.24K (35245) - TotalThreadsTotalWallClockTime: 1h58m - TotalThreadsSysTime: 2m42s - TotalThreadsUserTime: 2m22s - TotalThreadsVoluntaryContextSwitches: 12.29M (12291815) Fragment Instance Lifecycle Timings: - ExecTime: 9m12s - ExecTreeExecTime: 4s176ms - OpenTime: 1s133ms - ExecTreeOpenTime: 956.741ms - PrepareTime: 46.949ms - ExecTreePrepareTime: 6.079ms DataStreamSender (dst_id=22):(Total: 16s458ms, non-child: 16s458ms, % non-child: 100.00%) - BytesSent: 718.72 MB (753628728) - NetworkThroughput(*): 77.29 MB/sec - OverallThroughput: 43.67 MB/sec - PeakMemoryUsage: 4.94 MB (5175040) - RowsReturned: 77.49M (77485031) - SerializeBatchTime: 7s141ms - TransmitDataRPCTime: 9s298ms - UncompressedRowBatchSize: 2.17 GB (2325384610) CodeGen:(Total: 195.352ms, non-child: 195.352ms, % non-child: 100.00%) - CodegenTime: 921.117us - CompileTime: 54.392ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 121.065ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 19.508ms HASH_JOIN_NODE (id=5):(Total: 5s104ms, non-child: 3s334ms, % non-child: 65.32%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.496ms - PeakMemoryUsage: 1.23 MB (1290078) - ProbeRows: 77.49M (77485031) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3s189ms - RowsReturned: 77.49M (77485031) - RowsReturnedRate: 15.18 M/sec Hash Join Builder (join_node_id=5): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 27.694us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 138.585us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 63.649us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 795.892ms, non-child: 20.043us, % non-child: 0.00%) BytesReceived(16s000ms): 932.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 4.981us - DeserializeRowBatchTimer: 20.361us - FirstBatchArrivalWaitTime: 766.201ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 150.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=3):(Total: 975.084ms, non-child: 975.084ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:218/13.82 GB 1:230/12.78 GB 2:222/12.47 GB 7:228/13.11 GB 6:250/14.65 GB 0:210/12.52 GB 3:235/13.28 GB 4:227/13.03 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 117 out of 117 Runtime filters: Only following filters arrived: 6, waited 40ms Hdfs Read Thread Concurrency Bucket: 0:98.99% 1:0.9191% 2:0% 3:0% 4:0% 5:0.09191% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1703 PARQUET/SNAPPY:117 BytesRead(16s000ms): 13.36 MB, 14.63 MB, 15.68 MB, 21.65 MB, 29.61 MB, 31.00 MB, 40.95 MB, 44.74 MB, 46.57 MB, 57.48 MB, 59.29 MB, 61.98 MB, 73.37 MB, 74.57 MB, 78.86 MB, 88.53 MB, 89.66 MB, 98.66 MB, 103.30 MB, 104.69 MB, 114.25 MB, 117.56 MB, 118.80 MB, 121.44 MB, 131.68 MB, 132.42 MB, 133.59 MB, 134.95 MB, 140.46 MB, 142.46 MB, 143.05 MB, 143.05 MB, 143.05 MB, 143.05 MB - FooterProcessingTime: (Avg: 58.740ms ; Min: 28.077ms ; Max: 171.922ms ; Number of samples: 117) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 11.98 - BytesRead: 143.05 MB (149998744) - BytesReadDataNodeCache: 0 - BytesReadLocal: 143.05 MB (149998744) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 143.05 MB (149998744) - DecompressionTime: 554.774ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 117 (117) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 29.53 MB (30967455) - PerReadThreadRawHdfsThroughput: 21.36 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 113.522ms - RowBatchQueuePutWaitTime: 1h44m - RowsRead: 77.62M (77622376) - RowsReturned: 77.49M (77485031) - RowsReturnedRate: 79.46 M/sec - ScanRangesComplete: 1.82K (1820) - ScannerThreadsInvoluntaryContextSwitches: 30.37K (30367) - ScannerThreadsTotalWallClockTime: 1h49m - MaterializeTupleTime(*): 6s078ms - ScannerThreadsSysTime: 2m41s - ScannerThreadsUserTime: 2m - ScannerThreadsVoluntaryContextSwitches: 12.29M (12288700) - TotalRawHdfsReadTime(*): 6s697ms - TotalReadThroughput: 269.27 KB/sec Filter 2 (16.00 MB): - Rows processed: 1.97M (1970305) - Rows rejected: 137.33K (137330) - Rows total: 77.62M (77622376) Filter 5 (16.00 MB): - Rows processed: 1.78M (1782799) - Rows rejected: 15 (15) - Rows total: 77.49M (77485046) Filter 6 (1.00 MB): - Files processed: 1.82K (1820) - Files rejected: 1.70K (1703) - Files total: 1.82K (1820) - RowGroups processed: 75.64K (75644) - RowGroups rejected: 0 (0) - RowGroups total: 75.64K (75644) - Rows processed: 1.92M (1916928) - Rows rejected: 0 (0) - Rows total: 77.49M (77485031) - Splits processed: 117 (117) - Splits rejected: 0 (0) - Splits total: 117 (117) Instance 7f40dcb034de70b7:ad (host=va1042.foo:22000):(Total: 9m13s, non-child: 8m51s, % non-child: 95.96%) Hdfs split stats (:<# splits>/): 5:235/13.66 GB 3:223/13.21 GB 4:223/12.19 GB 1:216/12.63 GB 2:212/12.67 GB 7:246/14.11 GB 6:245/14.69 GB 0:212/12.50 GB Filter 6 arrival: 950ms Filter 2 arrival: 12s525ms Filter 5 arrival: 16s269ms MemoryUsage(16s000ms): 35.40 MB, 66.30 MB, 66.76 MB, 65.52 MB, 63.77 MB, 63.64 MB, 65.36 MB, 65.84 MB, 65.79 MB, 65.75 MB, 65.75 MB, 65.74 MB, 66.79 MB, 66.83 MB, 66.51 MB, 66.73 MB, 66.75 MB, 66.68 MB, 66.84 MB, 66.54 MB, 65.71 MB, 65.81 MB, 65.51 MB, 65.13 MB, 65.60 MB, 65.72 MB, 66.09 MB, 66.72 MB, 66.71 MB, 66.68 MB, 61.36 MB, 60.17 MB, 60.00 MB, 56.66 MB ThreadUsage(16s000ms): 12, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.95 - BloomFilterBytes: 33.00 MB (34603008) - PeakMemoryUsage: 67.62 MB (70905282) - PerHostPeakMemUsage: 161.68 GB (173607688059) - RowsProduced: 77.58M (77580709) - TotalNetworkReceiveTime: 733.478ms - TotalNetworkSendTime: 8m45s - TotalStorageWaitTime: 13s820ms - TotalThreadsInvoluntaryContextSwitches: 34.06K (34056) - TotalThreadsTotalWallClockTime: 1h59m - TotalThreadsSysTime: 2m10s - TotalThreadsUserTime: 2m23s - TotalThreadsVoluntaryContextSwitches: 9.70M (9702364) Fragment Instance Lifecycle Timings: - ExecTime: 9m12s - ExecTreeExecTime: 4s122ms - OpenTime: 1s114ms - ExecTreeOpenTime: 935.146ms - PrepareTime: 41.269ms - ExecTreePrepareTime: 5.588ms DataStreamSender (dst_id=22):(Total: 17s164ms, non-child: 17s164ms, % non-child: 100.00%) - BytesSent: 718.83 MB (753747881) - NetworkThroughput(*): 73.67 MB/sec - OverallThroughput: 41.88 MB/sec - PeakMemoryUsage: 4.90 MB (5134080) - RowsReturned: 77.58M (77580709) - SerializeBatchTime: 7s385ms - TransmitDataRPCTime: 9s757ms - UncompressedRowBatchSize: 2.17 GB (2328256006) CodeGen:(Total: 193.452ms, non-child: 193.452ms, % non-child: 100.00%) - CodegenTime: 949.537us - CompileTime: 55.341ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 122.461ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 15.260ms HASH_JOIN_NODE (id=5):(Total: 5s022ms, non-child: 3s249ms, % non-child: 64.70%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.699ms - PeakMemoryUsage: 1.24 MB (1295919) - ProbeRows: 77.58M (77580709) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3s110ms - RowsReturned: 77.58M (77580709) - RowsReturnedRate: 15.45 M/sec Hash Join Builder (join_node_id=5): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 29.882us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 151.500us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 71.915us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 733.493ms, non-child: 25.408us, % non-child: 0.00%) BytesReceived(16s000ms): 932.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 6.606us - DeserializeRowBatchTimer: 23.097us - FirstBatchArrivalWaitTime: 724.486ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 163.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=3):(Total: 1s040ms, non-child: 1s040ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:235/13.66 GB 3:223/13.21 GB 4:223/12.19 GB 1:216/12.63 GB 2:212/12.67 GB 7:246/14.11 GB 6:245/14.69 GB 0:212/12.50 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 117 out of 117 Runtime filters: Only following filters arrived: 6, waited 81ms Hdfs Read Thread Concurrency Bucket: 0:99% 1:0.8182% 2:0.09091% 3:0% 4:0.09091% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1695 PARQUET/SNAPPY:117 BytesRead(16s000ms): 13.37 MB, 14.73 MB, 15.34 MB, 20.49 MB, 28.90 MB, 30.05 MB, 40.21 MB, 43.80 MB, 45.81 MB, 57.26 MB, 58.30 MB, 62.72 MB, 72.70 MB, 73.48 MB, 80.18 MB, 87.27 MB, 88.36 MB, 96.40 MB, 101.82 MB, 103.52 MB, 112.09 MB, 116.38 MB, 116.74 MB, 118.75 MB, 128.16 MB, 131.02 MB, 131.43 MB, 132.66 MB, 134.95 MB, 139.83 MB, 142.12 MB, 142.12 MB, 142.12 MB, 142.12 MB - FooterProcessingTime: (Avg: 66.125ms ; Min: 27.612ms ; Max: 283.933ms ; Number of samples: 117) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 11.99 - BytesRead: 142.12 MB (149028604) - BytesReadDataNodeCache: 0 - BytesReadLocal: 142.12 MB (149028604) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 142.12 MB (149028604) - DecompressionTime: 906.934ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 117 (117) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 29.54 MB (30971179) - PerReadThreadRawHdfsThroughput: 21.40 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 113.981ms - RowBatchQueuePutWaitTime: 1h45m - RowsRead: 77.72M (77719760) - RowsReturned: 77.58M (77580709) - RowsReturnedRate: 74.59 M/sec - ScanRangesComplete: 1.81K (1812) - ScannerThreadsInvoluntaryContextSwitches: 29.08K (29079) - ScannerThreadsTotalWallClockTime: 1h50m - MaterializeTupleTime(*): 6s691ms - ScannerThreadsSysTime: 2m9s - ScannerThreadsUserTime: 1m59s - ScannerThreadsVoluntaryContextSwitches: 9.70M (9699301) - TotalRawHdfsReadTime(*): 6s642ms - TotalReadThroughput: 264.37 KB/sec Filter 2 (16.00 MB): - Rows processed: 2.00M (2004779) - Rows rejected: 139.03K (139028) - Rows total: 77.72M (77719760) Filter 5 (16.00 MB): - Rows processed: 1.83M (1832983) - Rows rejected: 23 (23) - Rows total: 77.58M (77580732) Filter 6 (1.00 MB): - Files processed: 1.81K (1812) - Files rejected: 1.70K (1695) - Files total: 1.81K (1812) - RowGroups processed: 75.74K (75736) - RowGroups rejected: 0 (0) - RowGroups total: 75.74K (75736) - Rows processed: 1.92M (1916928) - Rows rejected: 0 (0) - Rows total: 77.58M (77580709) - Splits processed: 117 (117) - Splits rejected: 0 (0) - Splits total: 117 (117) Instance 7f40dcb034de70b7:af (host=vd1116.foo:22000):(Total: 9m13s, non-child: 8m51s, % non-child: 95.95%) Hdfs split stats (:<# splits>/): 1:227/13.42 GB 7:238/14.18 GB 0:241/13.72 GB 5:240/13.60 GB 4:214/12.18 GB 6:221/12.46 GB 2:227/12.85 GB 3:225/13.27 GB Filter 6 arrival: 955ms Filter 2 arrival: 12s485ms Filter 5 arrival: 16s274ms MemoryUsage(16s000ms): 34.95 MB, 66.29 MB, 66.85 MB, 66.69 MB, 66.86 MB, 66.80 MB, 66.65 MB, 66.85 MB, 66.41 MB, 66.80 MB, 66.76 MB, 66.67 MB, 66.79 MB, 66.73 MB, 66.32 MB, 66.78 MB, 66.78 MB, 65.14 MB, 64.78 MB, 64.75 MB, 66.66 MB, 66.84 MB, 66.79 MB, 65.64 MB, 64.69 MB, 64.79 MB, 64.79 MB, 63.74 MB, 62.35 MB, 62.30 MB, 62.38 MB, 62.41 MB, 62.34 MB, 59.68 MB ThreadUsage(16s000ms): 11, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.87 - BloomFilterBytes: 33.00 MB (34603008) - PeakMemoryUsage: 67.96 MB (71264047) - PerHostPeakMemUsage: 161.67 GB (173589347940) - RowsProduced: 78.19M (78187833) - TotalNetworkReceiveTime: 719.149ms - TotalNetworkSendTime: 8m45s - TotalStorageWaitTime: 12s701ms - TotalThreadsInvoluntaryContextSwitches: 31.69K (31690) - TotalThreadsTotalWallClockTime: 1h58m - TotalThreadsSysTime: 34s307ms - TotalThreadsUserTime: 3m44s - TotalThreadsVoluntaryContextSwitches: 3.63M (3626419) Fragment Instance Lifecycle Timings: - ExecTime: 9m12s - ExecTreeExecTime: 3s883ms - OpenTime: 1s133ms - ExecTreeOpenTime: 943.881ms - PrepareTime: 48.802ms - ExecTreePrepareTime: 6.137ms DataStreamSender (dst_id=22):(Total: 17s437ms, non-child: 17s437ms, % non-child: 100.00%) - BytesSent: 722.92 MB (758040532) - NetworkThroughput(*): 74.03 MB/sec - OverallThroughput: 41.46 MB/sec - PeakMemoryUsage: 5.03 MB (5273344) - RowsReturned: 78.19M (78187833) - SerializeBatchTime: 7s651ms - TransmitDataRPCTime: 9s765ms - UncompressedRowBatchSize: 2.19 GB (2346476262) CodeGen:(Total: 209.865ms, non-child: 209.865ms, % non-child: 100.00%) - CodegenTime: 1.007ms - CompileTime: 58.481ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 129.743ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 21.280ms HASH_JOIN_NODE (id=5):(Total: 4s790ms, non-child: 3s377ms, % non-child: 70.51%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.659ms - PeakMemoryUsage: 1.23 MB (1291751) - ProbeRows: 78.19M (78187833) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3s187ms - RowsReturned: 78.19M (78187833) - RowsReturnedRate: 16.32 M/sec Hash Join Builder (join_node_id=5): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 40.417us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 114.588us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 60.843us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 719.158ms, non-child: 19.612us, % non-child: 0.00%) BytesReceived(16s000ms): 932.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 4.464us - DeserializeRowBatchTimer: 13.735us - FirstBatchArrivalWaitTime: 703.413ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 166.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=3):(Total: 694.408ms, non-child: 694.408ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:227/13.42 GB 7:238/14.18 GB 0:241/13.72 GB 5:240/13.60 GB 4:214/12.18 GB 6:221/12.46 GB 2:227/12.85 GB 3:225/13.27 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 118 out of 118 Runtime filters: Only following filters arrived: 6, waited 80ms Hdfs Read Thread Concurrency Bucket: 0:99.18% 1:0.8189% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1715 PARQUET/SNAPPY:118 BytesRead(16s000ms): 13.16 MB, 14.52 MB, 14.75 MB, 19.95 MB, 29.27 MB, 29.84 MB, 39.81 MB, 43.56 MB, 45.40 MB, 58.36 MB, 58.43 MB, 63.60 MB, 72.67 MB, 73.03 MB, 79.90 MB, 87.35 MB, 87.94 MB, 99.19 MB, 101.64 MB, 103.06 MB, 115.59 MB, 115.93 MB, 116.21 MB, 123.04 MB, 130.31 MB, 130.31 MB, 130.52 MB, 133.77 MB, 142.67 MB, 142.67 MB, 142.67 MB, 142.67 MB, 142.67 MB, 142.67 MB - FooterProcessingTime: (Avg: 57.277ms ; Min: 3.752ms ; Max: 196.506ms ; Number of samples: 118) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 11.90 - BytesRead: 142.67 MB (149605244) - BytesReadDataNodeCache: 0 - BytesReadLocal: 142.67 MB (149605244) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 142.67 MB (149605244) - DecompressionTime: 876.910ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 118 (118) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 29.86 MB (31313584) - PerReadThreadRawHdfsThroughput: 22.81 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 137.619ms - RowBatchQueuePutWaitTime: 1h45m - RowsRead: 78.33M (78328625) - RowsReturned: 78.19M (78187833) - RowsReturnedRate: 112.60 M/sec - ScanRangesComplete: 1.83K (1833) - ScannerThreadsInvoluntaryContextSwitches: 26.61K (26605) - ScannerThreadsTotalWallClockTime: 1h49m - MaterializeTupleTime(*): 6s650ms - ScannerThreadsSysTime: 33s626ms - ScannerThreadsUserTime: 3m19s - ScannerThreadsVoluntaryContextSwitches: 3.62M (3623317) - TotalRawHdfsReadTime(*): 6s253ms - TotalReadThroughput: 265.63 KB/sec Filter 2 (16.00 MB): - Rows processed: 2.01M (2008568) - Rows rejected: 140.79K (140792) - Rows total: 78.33M (78328625) Filter 5 (16.00 MB): - Rows processed: 1.83M (1833984) - Rows rejected: 0 (0) - Rows total: 78.19M (78187833) Filter 6 (1.00 MB): - Files processed: 1.83K (1833) - Files rejected: 1.72K (1715) - Files total: 1.83K (1833) - RowGroups processed: 76.33K (76328) - RowGroups rejected: 0 (0) - RowGroups total: 76.33K (76328) - Rows processed: 1.93M (1933312) - Rows rejected: 0 (0) - Rows total: 78.19M (78187833) - Splits processed: 118 (118) - Splits rejected: 0 (0) - Splits total: 118 (118) Instance 7f40dcb034de70b7:c7 (host=vc1522.foo:22000):(Total: 9m13s, non-child: 8m51s, % non-child: 96.02%) Hdfs split stats (:<# splits>/): 5:194/11.06 GB 0:220/12.91 GB 3:223/13.70 GB 4:227/13.80 GB 7:234/12.78 GB 1:238/13.97 GB 6:230/13.30 GB 2:235/14.13 GB Filter 6 arrival: 875ms Filter 2 arrival: 13s001ms Filter 5 arrival: 16s560ms MemoryUsage(16s000ms): 33.53 MB, 65.22 MB, 65.85 MB, 66.56 MB, 66.77 MB, 66.80 MB, 66.67 MB, 66.78 MB, 66.82 MB, 66.73 MB, 66.78 MB, 66.87 MB, 66.63 MB, 66.80 MB, 66.65 MB, 66.69 MB, 66.86 MB, 66.51 MB, 66.84 MB, 66.81 MB, 65.84 MB, 65.63 MB, 65.76 MB, 65.78 MB, 65.83 MB, 66.80 MB, 66.72 MB, 66.83 MB, 66.80 MB, 67.00 MB, 61.66 MB, 57.95 MB, 57.85 MB, 56.46 MB ThreadUsage(16s000ms): 12, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.87 - BloomFilterBytes: 33.00 MB (34603008) - PeakMemoryUsage: 67.50 MB (70781493) - PerHostPeakMemUsage: 161.66 GB (173582078169) - RowsProduced: 76.90M (76896926) - TotalNetworkReceiveTime: 637.910ms - TotalNetworkSendTime: 8m46s - TotalStorageWaitTime: 12s396ms - TotalThreadsInvoluntaryContextSwitches: 34.37K (34369) - TotalThreadsTotalWallClockTime: 1h58m - TotalThreadsSysTime: 2m13s - TotalThreadsUserTime: 2m21s - TotalThreadsVoluntaryContextSwitches: 11.68M (11679327) Fragment Instance Lifecycle Timings: - ExecTime: 9m12s - ExecTreeExecTime: 3s771ms - OpenTime: 1s102ms - ExecTreeOpenTime: 916.826ms - PrepareTime: 58.223ms - ExecTreePrepareTime: 7.067ms DataStreamSender (dst_id=22):(Total: 17s156ms, non-child: 17s156ms, % non-child: 100.00%) - BytesSent: 712.28 MB (746879413) - NetworkThroughput(*): 74.04 MB/sec - OverallThroughput: 41.52 MB/sec - PeakMemoryUsage: 4.97 MB (5216000) - RowsReturned: 76.90M (76896926) - SerializeBatchTime: 7s515ms - TransmitDataRPCTime: 9s619ms - UncompressedRowBatchSize: 2.15 GB (2307735180) CodeGen:(Total: 206.731ms, non-child: 206.731ms, % non-child: 100.00%) - CodegenTime: 1.190ms - CompileTime: 53.037ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 130.178ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 23.097ms HASH_JOIN_NODE (id=5):(Total: 4s655ms, non-child: 3s253ms, % non-child: 69.89%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 866.208us - PeakMemoryUsage: 1.24 MB (1297736) - ProbeRows: 76.90M (76896926) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3s110ms - RowsReturned: 76.90M (76896926) - RowsReturnedRate: 16.52 M/sec Hash Join Builder (join_node_id=5): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 27.429us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 75.213us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 49.225us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 637.919ms, non-child: 19.275us, % non-child: 0.00%) BytesReceived(16s000ms): 932.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 3.895us - DeserializeRowBatchTimer: 18.569us - FirstBatchArrivalWaitTime: 595.868ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 188.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=3):(Total: 764.554ms, non-child: 764.554ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:194/11.06 GB 0:220/12.91 GB 3:223/13.70 GB 4:227/13.80 GB 7:234/12.78 GB 1:238/13.97 GB 6:230/13.30 GB 2:235/14.13 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 116 out of 116 Runtime filters: Only following filters arrived: 6, waited 161ms Hdfs Read Thread Concurrency Bucket: 0:99.09% 1:0.7253% 2:0.1813% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1685 PARQUET/SNAPPY:116 BytesRead(16s000ms): 13.08 MB, 14.43 MB, 14.43 MB, 18.85 MB, 29.30 MB, 29.41 MB, 37.54 MB, 43.84 MB, 44.25 MB, 54.59 MB, 58.55 MB, 59.04 MB, 69.00 MB, 73.21 MB, 74.31 MB, 87.62 MB, 88.14 MB, 93.40 MB, 102.84 MB, 103.02 MB, 106.12 MB, 117.03 MB, 117.19 MB, 117.94 MB, 126.13 MB, 131.53 MB, 131.53 MB, 132.15 MB, 132.77 MB, 133.45 MB, 140.98 MB, 141.25 MB, 141.25 MB, 141.25 MB - FooterProcessingTime: (Avg: 59.792ms ; Min: 19.148ms ; Max: 308.611ms ; Number of samples: 116) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 11.91 - BytesRead: 141.25 MB (148106271) - BytesReadDataNodeCache: 0 - BytesReadLocal: 141.25 MB (148106271) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 141.25 MB (148106271) - DecompressionTime: 1s241ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 116 (116) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 29.53 MB (30962102) - PerReadThreadRawHdfsThroughput: 23.60 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 111.683ms - RowBatchQueuePutWaitTime: 1h44m - RowsRead: 77.04M (77039430) - RowsReturned: 76.90M (76896926) - RowsReturnedRate: 100.58 M/sec - ScanRangesComplete: 1.80K (1801) - ScannerThreadsInvoluntaryContextSwitches: 29.43K (29426) - ScannerThreadsTotalWallClockTime: 1h49m - MaterializeTupleTime(*): 6s687ms - ScannerThreadsSysTime: 2m12s - ScannerThreadsUserTime: 1m57s - ScannerThreadsVoluntaryContextSwitches: 11.68M (11676260) - TotalRawHdfsReadTime(*): 5s985ms - TotalReadThroughput: 262.02 KB/sec Filter 2 (16.00 MB): - Rows processed: 2.02M (2019496) - Rows rejected: 142.45K (142446) - Rows total: 77.04M (77039430) Filter 5 (16.00 MB): - Rows processed: 1.74M (1735738) - Rows rejected: 58 (58) - Rows total: 76.90M (76896984) Filter 6 (1.00 MB): - Files processed: 1.80K (1801) - Files rejected: 1.69K (1685) - Files total: 1.80K (1801) - RowGroups processed: 75.06K (75065) - RowGroups rejected: 0 (0) - RowGroups total: 75.06K (75065) - Rows processed: 1.90M (1900544) - Rows rejected: 0 (0) - Rows total: 76.90M (76896926) - Splits processed: 116 (116) - Splits rejected: 0 (0) - Splits total: 116 (116) Instance 7f40dcb034de70b7:c3 (host=va1043.foo:22000):(Total: 9m13s, non-child: 8m51s, % non-child: 96.04%) Hdfs split stats (:<# splits>/): 0:224/12.34 GB 6:217/13.69 GB 1:222/12.24 GB 4:231/13.86 GB 3:244/14.30 GB 7:213/12.87 GB 2:245/14.02 GB 5:225/12.37 GB Filter 6 arrival: 844ms Filter 2 arrival: 13s000ms Filter 5 arrival: 16s490ms MemoryUsage(16s000ms): 35.42 MB, 66.30 MB, 66.86 MB, 66.57 MB, 66.77 MB, 66.76 MB, 66.75 MB, 66.87 MB, 66.20 MB, 64.68 MB, 64.81 MB, 65.57 MB, 65.77 MB, 65.84 MB, 65.77 MB, 66.77 MB, 66.79 MB, 65.41 MB, 65.75 MB, 65.43 MB, 64.84 MB, 64.85 MB, 64.78 MB, 65.58 MB, 65.82 MB, 65.88 MB, 65.76 MB, 65.45 MB, 63.14 MB, 62.29 MB, 62.33 MB, 62.44 MB, 62.40 MB, 57.65 MB ThreadUsage(16s000ms): 12, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.83 - BloomFilterBytes: 33.00 MB (34603008) - PeakMemoryUsage: 67.50 MB (70774577) - PerHostPeakMemUsage: 161.67 GB (173589908623) - RowsProduced: 78.20M (78199133) - TotalNetworkReceiveTime: 600.090ms - TotalNetworkSendTime: 8m46s - TotalStorageWaitTime: 13s605ms - TotalThreadsInvoluntaryContextSwitches: 32.40K (32404) - TotalThreadsTotalWallClockTime: 1h58m - TotalThreadsSysTime: 1m8s - TotalThreadsUserTime: 3m13s - TotalThreadsVoluntaryContextSwitches: 5.31M (5307471) Fragment Instance Lifecycle Timings: - ExecTime: 9m12s - ExecTreeExecTime: 3s858ms - OpenTime: 1s148ms - ExecTreeOpenTime: 956.290ms - PrepareTime: 57.425ms - ExecTreePrepareTime: 6.963ms DataStreamSender (dst_id=22):(Total: 16s923ms, non-child: 16s923ms, % non-child: 100.00%) - BytesSent: 722.25 MB (757337552) - NetworkThroughput(*): 73.92 MB/sec - OverallThroughput: 42.68 MB/sec - PeakMemoryUsage: 5.00 MB (5240576) - RowsReturned: 78.20M (78199133) - SerializeBatchTime: 7s133ms - TransmitDataRPCTime: 9s770ms - UncompressedRowBatchSize: 2.19 GB (2346815398) CodeGen:(Total: 214.674ms, non-child: 214.674ms, % non-child: 100.00%) - CodegenTime: 1.273ms - CompileTime: 54.713ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 135.788ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 23.720ms HASH_JOIN_NODE (id=5):(Total: 4s780ms, non-child: 3s315ms, % non-child: 69.36%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.293ms - PeakMemoryUsage: 1.24 MB (1298495) - ProbeRows: 78.20M (78199133) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3s175ms - RowsReturned: 78.20M (78199133) - RowsReturnedRate: 16.36 M/sec Hash Join Builder (join_node_id=5): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 27.112us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 121.146us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 45.921us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 600.101ms, non-child: 19.351us, % non-child: 0.00%) BytesReceived(16s000ms): 963.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 4.942us - DeserializeRowBatchTimer: 39.948us - FirstBatchArrivalWaitTime: 592.780ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 199.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=3):(Total: 865.281ms, non-child: 865.281ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:224/12.34 GB 6:217/13.69 GB 1:222/12.24 GB 4:231/13.86 GB 3:244/14.30 GB 7:213/12.87 GB 2:245/14.02 GB 5:225/12.37 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 118 out of 118 Runtime filters: Only following filters arrived: 6, waited 181ms Hdfs Read Thread Concurrency Bucket: 0:99% 1:0.8212% 2:0.1825% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1703 PARQUET/SNAPPY:118 BytesRead(16s000ms): 13.63 MB, 14.54 MB, 14.54 MB, 19.78 MB, 28.78 MB, 28.90 MB, 39.35 MB, 43.63 MB, 44.24 MB, 56.65 MB, 57.68 MB, 60.45 MB, 72.12 MB, 72.12 MB, 78.26 MB, 86.63 MB, 87.10 MB, 98.94 MB, 101.02 MB, 102.89 MB, 114.74 MB, 115.34 MB, 115.34 MB, 123.83 MB, 129.89 MB, 129.89 MB, 129.89 MB, 133.73 MB, 142.32 MB, 142.32 MB, 142.32 MB, 142.32 MB, 142.32 MB, 142.32 MB - FooterProcessingTime: (Avg: 64.373ms ; Min: 24.673ms ; Max: 206.911ms ; Number of samples: 118) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 11.93 - BytesRead: 142.32 MB (149236141) - BytesReadDataNodeCache: 0 - BytesReadLocal: 142.32 MB (149236141) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 142.32 MB (149236141) - DecompressionTime: 529.385ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 118 (118) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 29.30 MB (30723468) - PerReadThreadRawHdfsThroughput: 21.07 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 169.031ms - RowBatchQueuePutWaitTime: 1h44m - RowsRead: 78.34M (78342735) - RowsReturned: 78.20M (78199133) - RowsReturnedRate: 90.37 M/sec - ScanRangesComplete: 1.82K (1821) - ScannerThreadsInvoluntaryContextSwitches: 27.54K (27544) - ScannerThreadsTotalWallClockTime: 1h49m - MaterializeTupleTime(*): 6s771ms - ScannerThreadsSysTime: 1m7s - ScannerThreadsUserTime: 2m50s - ScannerThreadsVoluntaryContextSwitches: 5.30M (5304335) - TotalRawHdfsReadTime(*): 6s756ms - TotalReadThroughput: 265.95 KB/sec Filter 2 (16.00 MB): - Rows processed: 2.05M (2052338) - Rows rejected: 143.53K (143525) - Rows total: 78.34M (78342735) Filter 5 (16.00 MB): - Rows processed: 1.79M (1794125) - Rows rejected: 77 (77) - Rows total: 78.20M (78199210) Filter 6 (1.00 MB): - Files processed: 1.82K (1821) - Files rejected: 1.70K (1703) - Files total: 1.82K (1821) - RowGroups processed: 76.33K (76334) - RowGroups rejected: 0 (0) - RowGroups total: 76.33K (76334) - Rows processed: 1.93M (1933312) - Rows rejected: 0 (0) - Rows total: 78.20M (78199133) - Splits processed: 118 (118) - Splits rejected: 0 (0) - Splits total: 118 (118) Instance 7f40dcb034de70b7:d1 (host=vc1515.foo:22000):(Total: 9m13s, non-child: 8m52s, % non-child: 96.14%) Hdfs split stats (:<# splits>/): 7:216/12.20 GB 6:225/13.59 GB 2:236/13.86 GB 5:205/11.63 GB 1:245/14.10 GB 4:223/12.46 GB 0:232/13.98 GB 3:247/13.85 GB Filter 6 arrival: 799ms Filter 2 arrival: 13s098ms Filter 5 arrival: 16s710ms MemoryUsage(16s000ms): 35.46 MB, 66.33 MB, 66.81 MB, 66.67 MB, 66.80 MB, 66.85 MB, 66.69 MB, 66.81 MB, 66.73 MB, 65.79 MB, 65.83 MB, 65.76 MB, 64.96 MB, 64.83 MB, 64.71 MB, 65.90 MB, 66.82 MB, 66.63 MB, 66.82 MB, 66.80 MB, 66.30 MB, 66.79 MB, 66.74 MB, 66.87 MB, 66.21 MB, 66.63 MB, 66.79 MB, 66.09 MB, 64.95 MB, 65.66 MB, 62.46 MB, 55.70 MB, 55.70 MB, 55.60 MB ThreadUsage(16s000ms): 12, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.96 - BloomFilterBytes: 33.00 MB (34603008) - PeakMemoryUsage: 67.54 MB (70815949) - PerHostPeakMemUsage: 161.68 GB (173598610449) - RowsProduced: 76.41M (76410759) - TotalNetworkReceiveTime: 562.778ms - TotalNetworkSendTime: 8m47s - TotalStorageWaitTime: 12s039ms - TotalThreadsInvoluntaryContextSwitches: 37.78K (37785) - TotalThreadsTotalWallClockTime: 1h59m - TotalThreadsSysTime: 3m9s - TotalThreadsUserTime: 2m11s - TotalThreadsVoluntaryContextSwitches: 11.88M (11877324) Fragment Instance Lifecycle Timings: - ExecTime: 9m12s - ExecTreeExecTime: 3s654ms - OpenTime: 1s091ms - ExecTreeOpenTime: 901.003ms - PrepareTime: 49.726ms - ExecTreePrepareTime: 6.416ms DataStreamSender (dst_id=22):(Total: 16s666ms, non-child: 16s666ms, % non-child: 100.00%) - BytesSent: 710.38 MB (744890613) - NetworkThroughput(*): 75.70 MB/sec - OverallThroughput: 42.62 MB/sec - PeakMemoryUsage: 4.95 MB (5191424) - RowsReturned: 76.41M (76410759) - SerializeBatchTime: 7s263ms - TransmitDataRPCTime: 9s384ms - UncompressedRowBatchSize: 2.14 GB (2293144890) CodeGen:(Total: 209.649ms, non-child: 209.649ms, % non-child: 100.00%) - CodegenTime: 1.095ms - CompileTime: 53.626ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 135.584ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 20.064ms HASH_JOIN_NODE (id=5):(Total: 4s521ms, non-child: 3s193ms, % non-child: 70.63%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.552ms - PeakMemoryUsage: 1.24 MB (1298476) - ProbeRows: 76.41M (76410759) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3s024ms - RowsReturned: 76.41M (76410759) - RowsReturnedRate: 16.90 M/sec Hash Join Builder (join_node_id=5): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 27.336us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 160.137us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 53.022us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 562.788ms, non-child: 20.073us, % non-child: 0.00%) BytesReceived(16s000ms): 963.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 4.641us - DeserializeRowBatchTimer: 18.530us - FirstBatchArrivalWaitTime: 545.250ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 213.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=3):(Total: 765.893ms, non-child: 765.893ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:216/12.20 GB 6:225/13.59 GB 2:236/13.86 GB 5:205/11.63 GB 1:245/14.10 GB 4:223/12.46 GB 0:232/13.98 GB 3:247/13.85 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 117 out of 117 Runtime filters: Only following filters arrived: 6, waited 222ms Hdfs Read Thread Concurrency Bucket: 0:99.36% 1:0.6364% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1712 PARQUET/SNAPPY:117 BytesRead(16s000ms): 13.76 MB, 14.67 MB, 14.67 MB, 20.23 MB, 29.60 MB, 29.82 MB, 38.36 MB, 44.18 MB, 44.76 MB, 55.53 MB, 58.73 MB, 59.67 MB, 71.91 MB, 73.12 MB, 75.47 MB, 87.47 MB, 88.40 MB, 94.52 MB, 103.11 MB, 103.52 MB, 109.51 MB, 117.59 MB, 117.87 MB, 118.86 MB, 126.00 MB, 132.15 MB, 132.61 MB, 132.73 MB, 133.02 MB, 135.72 MB, 141.35 MB, 141.35 MB, 141.35 MB, 141.35 MB - FooterProcessingTime: (Avg: 60.625ms ; Min: 24.114ms ; Max: 341.834ms ; Number of samples: 117) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 11.98 - BytesRead: 141.35 MB (148211232) - BytesReadDataNodeCache: 0 - BytesReadLocal: 141.35 MB (148211232) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 141.35 MB (148211232) - DecompressionTime: 720.788ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 117 (117) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 29.36 MB (30782090) - PerReadThreadRawHdfsThroughput: 22.46 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 109.307ms - RowBatchQueuePutWaitTime: 1h44m - RowsRead: 76.55M (76551584) - RowsReturned: 76.41M (76410759) - RowsReturnedRate: 99.77 M/sec - ScanRangesComplete: 1.83K (1829) - ScannerThreadsInvoluntaryContextSwitches: 32.65K (32646) - ScannerThreadsTotalWallClockTime: 1h50m - MaterializeTupleTime(*): 6s258ms - ScannerThreadsSysTime: 3m9s - ScannerThreadsUserTime: 1m47s - ScannerThreadsVoluntaryContextSwitches: 11.87M (11874166) - TotalRawHdfsReadTime(*): 6s294ms - TotalReadThroughput: 263.16 KB/sec Filter 2 (16.00 MB): - Rows processed: 2.03M (2031107) - Rows rejected: 140.79K (140789) - Rows total: 76.55M (76551584) Filter 5 (16.00 MB): - Rows processed: 1.89M (1888292) - Rows rejected: 36 (36) - Rows total: 76.41M (76410795) Filter 6 (1.00 MB): - Files processed: 1.83K (1829) - Files rejected: 1.71K (1712) - Files total: 1.83K (1829) - RowGroups processed: 74.59K (74587) - RowGroups rejected: 0 (0) - RowGroups total: 74.59K (74587) - Rows processed: 1.92M (1916928) - Rows rejected: 0 (0) - Rows total: 76.41M (76410759) - Splits processed: 117 (117) - Splits rejected: 0 (0) - Splits total: 117 (117) Instance 7f40dcb034de70b7:f3 (host=va1030.foo:22000):(Total: 9m13s, non-child: 8m52s, % non-child: 96.10%) Hdfs split stats (:<# splits>/): 6:229/14.78 GB 5:230/13.40 GB 0:220/12.67 GB 7:224/12.52 GB 2:224/13.51 GB 1:212/11.42 GB 3:244/13.89 GB 4:239/13.50 GB Filter 6 arrival: 680ms Filter 2 arrival: 13s627ms Filter 5 arrival: 17s030ms MemoryUsage(16s000ms): 32.78 MB, 64.33 MB, 65.82 MB, 65.67 MB, 65.83 MB, 65.82 MB, 66.04 MB, 66.78 MB, 66.75 MB, 66.73 MB, 66.86 MB, 66.56 MB, 66.64 MB, 66.86 MB, 66.49 MB, 66.63 MB, 66.85 MB, 66.33 MB, 65.77 MB, 65.82 MB, 65.44 MB, 65.35 MB, 65.81 MB, 65.78 MB, 66.03 MB, 66.78 MB, 66.83 MB, 66.76 MB, 66.89 MB, 67.03 MB, 64.17 MB, 54.73 MB, 54.63 MB, 54.24 MB ThreadUsage(16s000ms): 11, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.96 - BloomFilterBytes: 33.00 MB (34603008) - PeakMemoryUsage: 67.58 MB (70867723) - PerHostPeakMemUsage: 161.70 GB (173625135192) - RowsProduced: 76.26M (76257613) - TotalNetworkReceiveTime: 447.665ms - TotalNetworkSendTime: 8m45s - TotalStorageWaitTime: 12s922ms - TotalThreadsInvoluntaryContextSwitches: 36.45K (36451) - TotalThreadsTotalWallClockTime: 1h59m - TotalThreadsSysTime: 3m13s - TotalThreadsUserTime: 2m5s - TotalThreadsVoluntaryContextSwitches: 10.15M (10151107) Fragment Instance Lifecycle Timings: - ExecTime: 9m12s - ExecTreeExecTime: 3s696ms - OpenTime: 1s064ms - ExecTreeOpenTime: 885.342ms - PrepareTime: 57.781ms - ExecTreePrepareTime: 7.496ms DataStreamSender (dst_id=22):(Total: 16s841ms, non-child: 16s841ms, % non-child: 100.00%) - BytesSent: 707.05 MB (741397760) - NetworkThroughput(*): 74.39 MB/sec - OverallThroughput: 41.98 MB/sec - PeakMemoryUsage: 4.90 MB (5134080) - RowsReturned: 76.26M (76257613) - SerializeBatchTime: 7s316ms - TransmitDataRPCTime: 9s505ms - UncompressedRowBatchSize: 2.13 GB (2288548918) CodeGen:(Total: 202.225ms, non-child: 202.225ms, % non-child: 100.00%) - CodegenTime: 1.039ms - CompileTime: 51.073ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 126.645ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 24.117ms HASH_JOIN_NODE (id=5):(Total: 4s550ms, non-child: 3s231ms, % non-child: 71.02%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.435ms - PeakMemoryUsage: 1.23 MB (1290200) - ProbeRows: 76.26M (76257613) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3s072ms - RowsReturned: 76.26M (76257613) - RowsReturnedRate: 16.76 M/sec Hash Join Builder (join_node_id=5): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 26.384us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 139.073us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 61.637us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 447.680ms, non-child: 27.538us, % non-child: 0.01%) BytesReceived(16s000ms): 963.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 6.879us - DeserializeRowBatchTimer: 18.910us - FirstBatchArrivalWaitTime: 411.030ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 268.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=3):(Total: 871.197ms, non-child: 871.197ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 6:229/14.78 GB 5:230/13.40 GB 0:220/12.67 GB 7:224/12.52 GB 2:224/13.51 GB 1:212/11.42 GB 3:244/13.89 GB 4:239/13.50 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 115 out of 115 Runtime filters: Only following filters arrived: 6, waited 342ms Hdfs Read Thread Concurrency Bucket: 0:98.64% 1:1.086% 2:0.181% 3:0% 4:0.0905% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1707 PARQUET/SNAPPY:115 BytesRead(16s000ms): 13.48 MB, 14.87 MB, 14.87 MB, 19.27 MB, 29.53 MB, 29.93 MB, 38.59 MB, 44.09 MB, 44.86 MB, 57.57 MB, 59.12 MB, 60.50 MB, 73.01 MB, 73.86 MB, 76.15 MB, 88.31 MB, 88.61 MB, 93.54 MB, 103.14 MB, 103.26 MB, 106.41 MB, 116.64 MB, 117.65 MB, 117.90 MB, 122.22 MB, 131.86 MB, 132.53 MB, 132.53 MB, 133.45 MB, 133.81 MB, 138.57 MB, 140.87 MB, 140.87 MB, 140.87 MB - FooterProcessingTime: (Avg: 57.721ms ; Min: 5.394ms ; Max: 167.891ms ; Number of samples: 115) - AverageHdfsReadThreadConcurrency: 0.02 - AverageScannerThreadConcurrency: 11.98 - BytesRead: 140.87 MB (147713464) - BytesReadDataNodeCache: 0 - BytesReadLocal: 140.87 MB (147713464) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 140.87 MB (147713464) - DecompressionTime: 1s922ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 115 (115) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 29.37 MB (30795015) - PerReadThreadRawHdfsThroughput: 19.64 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 87.982ms - RowBatchQueuePutWaitTime: 1h44m - RowsRead: 76.40M (76396543) - RowsReturned: 76.26M (76257613) - RowsReturnedRate: 87.53 M/sec - ScanRangesComplete: 1.82K (1822) - ScannerThreadsInvoluntaryContextSwitches: 31.38K (31376) - ScannerThreadsTotalWallClockTime: 1h50m - MaterializeTupleTime(*): 6s473ms - ScannerThreadsSysTime: 3m12s - ScannerThreadsUserTime: 1m41s - ScannerThreadsVoluntaryContextSwitches: 10.15M (10147971) - TotalRawHdfsReadTime(*): 7s171ms - TotalReadThroughput: 260.85 KB/sec Filter 2 (16.00 MB): - Rows processed: 2.01M (2010802) - Rows rejected: 138.88K (138875) - Rows total: 76.40M (76396543) Filter 5 (16.00 MB): - Rows processed: 1.84M (1839159) - Rows rejected: 55 (55) - Rows total: 76.26M (76257668) Filter 6 (1.00 MB): - Files processed: 1.82K (1822) - Files rejected: 1.71K (1707) - Files total: 1.82K (1822) - RowGroups processed: 74.44K (74440) - RowGroups rejected: 0 (0) - RowGroups total: 74.44K (74440) - Rows processed: 1.88M (1884160) - Rows rejected: 0 (0) - Rows total: 76.26M (76257613) - Splits processed: 115 (115) - Splits rejected: 0 (0) - Splits total: 115 (115) Instance 7f40dcb034de70b7:e8 (host=vd1109.foo:22000):(Total: 9m13s, non-child: 8m52s, % non-child: 96.10%) Hdfs split stats (:<# splits>/): 4:209/12.28 GB 2:249/14.62 GB 6:220/13.45 GB 7:232/13.64 GB 1:242/14.41 GB 0:227/13.54 GB 3:227/12.17 GB 5:200/11.55 GB Filter 6 arrival: 716ms Filter 2 arrival: 13s415ms Filter 5 arrival: 16s891ms MemoryUsage(16s000ms): 34.30 MB, 65.24 MB, 65.79 MB, 65.60 MB, 65.79 MB, 65.76 MB, 65.71 MB, 65.75 MB, 65.57 MB, 66.65 MB, 66.80 MB, 66.30 MB, 65.81 MB, 65.84 MB, 66.25 MB, 66.78 MB, 66.75 MB, 66.61 MB, 66.83 MB, 66.71 MB, 65.83 MB, 65.72 MB, 65.80 MB, 65.22 MB, 66.82 MB, 66.77 MB, 66.82 MB, 66.46 MB, 62.78 MB, 59.20 MB, 59.10 MB, 59.07 MB, 59.09 MB, 55.51 MB ThreadUsage(16s000ms): 12, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.89 - BloomFilterBytes: 33.00 MB (34603008) - PeakMemoryUsage: 67.51 MB (70786840) - PerHostPeakMemUsage: 161.66 GB (173580963773) - RowsProduced: 77.57M (77570414) - TotalNetworkReceiveTime: 477.797ms - TotalNetworkSendTime: 8m46s - TotalStorageWaitTime: 13s423ms - TotalThreadsInvoluntaryContextSwitches: 36.07K (36072) - TotalThreadsTotalWallClockTime: 1h58m - TotalThreadsSysTime: 2m7s - TotalThreadsUserTime: 3m13s - TotalThreadsVoluntaryContextSwitches: 9.08M (9078031) Fragment Instance Lifecycle Timings: - ExecTime: 9m12s - ExecTreeExecTime: 3s709ms - OpenTime: 1s120ms - ExecTreeOpenTime: 932.665ms - PrepareTime: 55.738ms - ExecTreePrepareTime: 8.039ms DataStreamSender (dst_id=22):(Total: 16s780ms, non-child: 16s780ms, % non-child: 100.00%) - BytesSent: 715.45 MB (750207651) - NetworkThroughput(*): 76.40 MB/sec - OverallThroughput: 42.64 MB/sec - PeakMemoryUsage: 5.01 MB (5248768) - RowsReturned: 77.57M (77570414) - SerializeBatchTime: 7s395ms - TransmitDataRPCTime: 9s365ms - UncompressedRowBatchSize: 2.17 GB (2327947028) CodeGen:(Total: 207.591ms, non-child: 207.591ms, % non-child: 100.00%) - CodegenTime: 1.215ms - CompileTime: 53.647ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 132.242ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 21.207ms HASH_JOIN_NODE (id=5):(Total: 4s614ms, non-child: 3s239ms, % non-child: 70.20%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.173ms - PeakMemoryUsage: 1.24 MB (1296651) - ProbeRows: 77.57M (77570414) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3s069ms - RowsReturned: 77.57M (77570414) - RowsReturnedRate: 16.81 M/sec Hash Join Builder (join_node_id=5): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 24.884us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 117.684us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 43.182us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 477.808ms, non-child: 20.321us, % non-child: 0.00%) BytesReceived(16s000ms): 963.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 4.858us - DeserializeRowBatchTimer: 19.251us - FirstBatchArrivalWaitTime: 440.589ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 251.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=3):(Total: 897.704ms, non-child: 897.704ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:209/12.28 GB 2:249/14.62 GB 6:220/13.45 GB 7:232/13.64 GB 1:242/14.41 GB 0:227/13.54 GB 3:227/12.17 GB 5:200/11.55 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 117 out of 117 Runtime filters: Only following filters arrived: 6, waited 321ms Hdfs Read Thread Concurrency Bucket: 0:99.09% 1:0.8212% 2:0.09124% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1689 PARQUET/SNAPPY:117 BytesRead(16s000ms): 13.53 MB, 14.43 MB, 14.43 MB, 19.67 MB, 28.77 MB, 29.03 MB, 38.75 MB, 42.99 MB, 44.09 MB, 57.22 MB, 57.44 MB, 59.86 MB, 71.62 MB, 71.85 MB, 79.55 MB, 86.32 MB, 86.58 MB, 98.36 MB, 100.91 MB, 101.81 MB, 114.06 MB, 115.13 MB, 115.13 MB, 118.89 MB, 129.53 MB, 129.53 MB, 129.53 MB, 131.16 MB, 140.06 MB, 140.43 MB, 140.43 MB, 140.43 MB, 140.43 MB, 140.43 MB - FooterProcessingTime: (Avg: 63.853ms ; Min: 23.763ms ; Max: 423.343ms ; Number of samples: 117) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 11.92 - BytesRead: 140.43 MB (147251168) - BytesReadDataNodeCache: 0 - BytesReadLocal: 140.43 MB (147251168) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 140.43 MB (147251168) - DecompressionTime: 1s351ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 117 (117) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 29.28 MB (30698475) - PerReadThreadRawHdfsThroughput: 21.40 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 126.364ms - RowBatchQueuePutWaitTime: 1h43m - RowsRead: 77.71M (77714142) - RowsReturned: 77.57M (77570414) - RowsReturnedRate: 86.41 M/sec - ScanRangesComplete: 1.81K (1806) - ScannerThreadsInvoluntaryContextSwitches: 31.05K (31045) - ScannerThreadsTotalWallClockTime: 1h49m - MaterializeTupleTime(*): 6s388ms - ScannerThreadsSysTime: 2m7s - ScannerThreadsUserTime: 2m49s - ScannerThreadsVoluntaryContextSwitches: 9.07M (9074951) - TotalRawHdfsReadTime(*): 6s561ms - TotalReadThroughput: 262.41 KB/sec Filter 2 (16.00 MB): - Rows processed: 2.04M (2036067) - Rows rejected: 143.68K (143681) - Rows total: 77.71M (77714142) Filter 5 (16.00 MB): - Rows processed: 1.84M (1839151) - Rows rejected: 47 (47) - Rows total: 77.57M (77570461) Filter 6 (1.00 MB): - Files processed: 1.81K (1806) - Files rejected: 1.69K (1689) - Files total: 1.81K (1806) - RowGroups processed: 75.72K (75724) - RowGroups rejected: 0 (0) - RowGroups total: 75.72K (75724) - Rows processed: 1.92M (1916928) - Rows rejected: 0 (0) - Rows total: 77.57M (77570414) - Splits processed: 117 (117) - Splits rejected: 0 (0) - Splits total: 117 (117) Instance 7f40dcb034de70b7:7c (host=va1041.foo:22000):(Total: 9m12s, non-child: 8m51s, % non-child: 96.18%) Hdfs split stats (:<# splits>/): 5:212/11.81 GB 6:249/15.29 GB 0:212/11.74 GB 3:238/13.33 GB 7:224/12.79 GB 4:239/14.37 GB 1:227/13.63 GB 2:222/12.71 GB Filter 6 arrival: 1s167ms Filter 2 arrival: 11s016ms Filter 5 arrival: 15s633ms MemoryUsage(16s000ms): 35.18 MB, 64.86 MB, 65.81 MB, 66.04 MB, 66.74 MB, 66.80 MB, 66.42 MB, 66.72 MB, 66.63 MB, 66.55 MB, 66.83 MB, 65.71 MB, 65.77 MB, 65.95 MB, 66.55 MB, 66.81 MB, 66.84 MB, 65.59 MB, 65.82 MB, 65.89 MB, 66.89 MB, 66.75 MB, 66.75 MB, 66.62 MB, 66.82 MB, 66.76 MB, 66.77 MB, 66.54 MB, 62.91 MB, 62.36 MB, 62.23 MB, 60.15 MB, 60.16 MB, 53.33 MB ThreadUsage(16s000ms): 12, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 10 - AverageThreadTokens: 12.76 - BloomFilterBytes: 33.00 MB (34603008) - PeakMemoryUsage: 67.52 MB (70795117) - PerHostPeakMemUsage: 161.67 GB (173593096083) - RowsProduced: 78.22M (78221905) - TotalNetworkReceiveTime: 944.670ms - TotalNetworkSendTime: 8m47s - TotalStorageWaitTime: 12s676ms - TotalThreadsInvoluntaryContextSwitches: 28.97K (28967) - TotalThreadsTotalWallClockTime: 1h57m - TotalThreadsSysTime: 1m5s - TotalThreadsUserTime: 3m13s - TotalThreadsVoluntaryContextSwitches: 7.00M (6996530) Fragment Instance Lifecycle Timings: - ExecTime: 9m11s - ExecTreeExecTime: 3s568ms - OpenTime: 1s284ms - ExecTreeOpenTime: 1s105ms - PrepareTime: 47.226ms - ExecTreePrepareTime: 6.068ms DataStreamSender (dst_id=22):(Total: 16s305ms, non-child: 16s305ms, % non-child: 100.00%) - BytesSent: 724.29 MB (759477363) - NetworkThroughput(*): 78.95 MB/sec - OverallThroughput: 44.42 MB/sec - PeakMemoryUsage: 4.86 MB (5101312) - RowsReturned: 78.22M (78221905) - SerializeBatchTime: 7s109ms - TransmitDataRPCTime: 9s174ms - UncompressedRowBatchSize: 2.19 GB (2347498806) CodeGen:(Total: 196.579ms, non-child: 196.579ms, % non-child: 100.00%) - CodegenTime: 1.014ms - CompileTime: 52.770ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 125.133ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 18.239ms HASH_JOIN_NODE (id=5):(Total: 4s636ms, non-child: 3s122ms, % non-child: 67.35%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.468ms - PeakMemoryUsage: 1.23 MB (1293445) - ProbeRows: 78.22M (78221905) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 2s963ms - RowsReturned: 78.22M (78221905) - RowsReturnedRate: 16.87 M/sec Hash Join Builder (join_node_id=5): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 30.060us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 170.289us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 70.634us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 944.679ms, non-child: 18.389us, % non-child: 0.00%) BytesReceived(16s000ms): 932.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 4.531us - DeserializeRowBatchTimer: 13.023us - FirstBatchArrivalWaitTime: 910.150ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 127.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=3):(Total: 569.874ms, non-child: 569.874ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:212/11.81 GB 6:249/15.29 GB 0:212/11.74 GB 3:238/13.33 GB 7:224/12.79 GB 4:239/14.37 GB 1:227/13.63 GB 2:222/12.71 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 118 out of 118 Runtime filters: Only following filters arrived: 6, waited 40ms Hdfs Read Thread Concurrency Bucket: 0:98.9% 1:0.9158% 2:0.1832% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1705 PARQUET/SNAPPY:118 BytesRead(16s000ms): 13.32 MB, 14.77 MB, 15.94 MB, 21.19 MB, 29.56 MB, 30.56 MB, 40.44 MB, 44.95 MB, 46.68 MB, 57.92 MB, 59.70 MB, 63.09 MB, 73.14 MB, 74.24 MB, 80.44 MB, 87.96 MB, 89.13 MB, 100.33 MB, 102.74 MB, 104.61 MB, 115.96 MB, 116.88 MB, 117.50 MB, 124.10 MB, 131.02 MB, 131.44 MB, 132.23 MB, 135.47 MB, 143.19 MB, 143.19 MB, 143.19 MB, 143.19 MB, 143.19 MB, 143.19 MB - FooterProcessingTime: (Avg: 58.984ms ; Min: 4.560ms ; Max: 383.545ms ; Number of samples: 118) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 11.85 - BytesRead: 143.19 MB (150145301) - BytesReadDataNodeCache: 0 - BytesReadLocal: 143.19 MB (150145301) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 143.19 MB (150145301) - DecompressionTime: 477.532ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 118 (118) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 29.25 MB (30673507) - PerReadThreadRawHdfsThroughput: 21.68 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 113.431ms - RowBatchQueuePutWaitTime: 1h43m - RowsRead: 78.36M (78360571) - RowsReturned: 78.22M (78221905) - RowsReturnedRate: 137.26 M/sec - ScanRangesComplete: 1.82K (1823) - ScannerThreadsInvoluntaryContextSwitches: 24.18K (24182) - ScannerThreadsTotalWallClockTime: 1h48m - MaterializeTupleTime(*): 6s108ms - ScannerThreadsSysTime: 1m5s - ScannerThreadsUserTime: 2m51s - ScannerThreadsVoluntaryContextSwitches: 6.99M (6993429) - TotalRawHdfsReadTime(*): 6s604ms - TotalReadThroughput: 268.30 KB/sec Filter 2 (16.00 MB): - Rows processed: 1.98M (1976746) - Rows rejected: 138.63K (138627) - Rows total: 78.36M (78360571) Filter 5 (16.00 MB): - Rows processed: 1.84M (1838119) - Rows rejected: 39 (39) - Rows total: 78.22M (78221944) Filter 6 (1.00 MB): - Files processed: 1.82K (1823) - Files rejected: 1.71K (1705) - Files total: 1.82K (1823) - RowGroups processed: 76.36K (76361) - RowGroups rejected: 0 (0) - RowGroups total: 76.36K (76361) - Rows processed: 1.93M (1933312) - Rows rejected: 0 (0) - Rows total: 78.22M (78221905) - Splits processed: 118 (118) - Splits rejected: 0 (0) - Splits total: 118 (118) Instance 7f40dcb034de70b7:7d (host=vd1134.foo:22000):(Total: 9m12s, non-child: 8m50s, % non-child: 96.05%) Hdfs split stats (:<# splits>/): 7:221/14.23 GB 2:222/12.88 GB 3:234/13.24 GB 5:232/13.22 GB 1:232/13.35 GB 4:209/12.00 GB 0:242/14.47 GB 6:220/12.29 GB Filter 6 arrival: 1s146ms Filter 2 arrival: 11s099ms Filter 5 arrival: 15s624ms MemoryUsage(16s000ms): 36.68 MB, 66.74 MB, 66.81 MB, 66.20 MB, 65.83 MB, 65.70 MB, 66.31 MB, 66.84 MB, 66.70 MB, 65.77 MB, 65.80 MB, 65.60 MB, 66.81 MB, 66.83 MB, 66.71 MB, 66.83 MB, 66.78 MB, 66.50 MB, 66.81 MB, 66.78 MB, 66.20 MB, 66.85 MB, 66.78 MB, 66.76 MB, 65.33 MB, 65.75 MB, 65.84 MB, 65.70 MB, 66.63 MB, 66.58 MB, 59.48 MB, 57.83 MB, 57.89 MB, 55.34 MB ThreadUsage(16s000ms): 11, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.89 - BloomFilterBytes: 33.00 MB (34603008) - PeakMemoryUsage: 67.39 MB (70667804) - PerHostPeakMemUsage: 161.68 GB (173597967953) - RowsProduced: 76.85M (76847531) - TotalNetworkReceiveTime: 907.038ms - TotalNetworkSendTime: 8m44s - TotalStorageWaitTime: 13s696ms - TotalThreadsInvoluntaryContextSwitches: 35.23K (35235) - TotalThreadsTotalWallClockTime: 1h58m - TotalThreadsSysTime: 2m39s - TotalThreadsUserTime: 2m25s - TotalThreadsVoluntaryContextSwitches: 11.82M (11819064) Fragment Instance Lifecycle Timings: - ExecTime: 9m11s - ExecTreeExecTime: 3s754ms - OpenTime: 1s295ms - ExecTreeOpenTime: 1s109ms - PrepareTime: 58.027ms - ExecTreePrepareTime: 7.296ms DataStreamSender (dst_id=22):(Total: 16s816ms, non-child: 16s816ms, % non-child: 100.00%) - BytesSent: 712.64 MB (747253199) - NetworkThroughput(*): 76.46 MB/sec - OverallThroughput: 42.38 MB/sec - PeakMemoryUsage: 5.02 MB (5265152) - RowsReturned: 76.85M (76847531) - SerializeBatchTime: 7s475ms - TransmitDataRPCTime: 9s319ms - UncompressedRowBatchSize: 2.15 GB (2306252730) CodeGen:(Total: 209.285ms, non-child: 209.285ms, % non-child: 100.00%) - CodegenTime: 1.192ms - CompileTime: 54.311ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 130.041ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 24.497ms HASH_JOIN_NODE (id=5):(Total: 4s831ms, non-child: 3s299ms, % non-child: 68.29%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.507ms - PeakMemoryUsage: 1.24 MB (1296658) - ProbeRows: 76.85M (76847531) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3s135ms - RowsReturned: 76.85M (76847531) - RowsReturnedRate: 15.91 M/sec Hash Join Builder (join_node_id=5): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 25.131us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 136.089us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 57.126us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 907.048ms, non-child: 24.938us, % non-child: 0.00%) BytesReceived(16s000ms): 901.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 4.313us - DeserializeRowBatchTimer: 17.741us - FirstBatchArrivalWaitTime: 885.083ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 132.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=3):(Total: 625.552ms, non-child: 625.552ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:221/14.23 GB 2:222/12.88 GB 3:234/13.24 GB 5:232/13.22 GB 1:232/13.35 GB 4:209/12.00 GB 0:242/14.47 GB 6:220/12.29 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 116 out of 116 Runtime filters: Only following filters arrived: 6, waited 40ms Hdfs Read Thread Concurrency Bucket: 0:98.9% 1:1.096% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1696 PARQUET/SNAPPY:116 BytesRead(16s000ms): 13.17 MB, 14.53 MB, 14.61 MB, 21.59 MB, 29.01 MB, 29.49 MB, 40.11 MB, 43.96 MB, 45.70 MB, 57.76 MB, 58.40 MB, 61.57 MB, 72.87 MB, 72.97 MB, 77.33 MB, 87.70 MB, 87.78 MB, 95.35 MB, 102.26 MB, 102.40 MB, 107.44 MB, 116.75 MB, 117.14 MB, 117.69 MB, 126.18 MB, 131.55 MB, 131.55 MB, 131.66 MB, 134.01 MB, 136.83 MB, 141.35 MB, 141.35 MB, 141.35 MB, 141.35 MB - FooterProcessingTime: (Avg: 65.519ms ; Min: 4.218ms ; Max: 245.426ms ; Number of samples: 116) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 11.98 - BytesRead: 141.35 MB (148217577) - BytesReadDataNodeCache: 0 - BytesReadLocal: 141.35 MB (148217577) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 141.35 MB (148217577) - DecompressionTime: 1s041ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 116 (116) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 29.30 MB (30727729) - PerReadThreadRawHdfsThroughput: 20.19 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 155.910ms - RowBatchQueuePutWaitTime: 1h44m - RowsRead: 76.98M (76984779) - RowsReturned: 76.85M (76847531) - RowsReturnedRate: 122.85 M/sec - ScanRangesComplete: 1.81K (1812) - ScannerThreadsInvoluntaryContextSwitches: 30.10K (30096) - ScannerThreadsTotalWallClockTime: 1h49m - MaterializeTupleTime(*): 6s427ms - ScannerThreadsSysTime: 2m38s - ScannerThreadsUserTime: 2m1s - ScannerThreadsVoluntaryContextSwitches: 11.82M (11815980) - TotalRawHdfsReadTime(*): 6s999ms - TotalReadThroughput: 264.13 KB/sec Filter 2 (16.00 MB): - Rows processed: 1.97M (1970208) - Rows rejected: 137.20K (137197) - Rows total: 76.98M (76984779) Filter 5 (16.00 MB): - Rows processed: 1.83M (1833011) - Rows rejected: 51 (51) - Rows total: 76.85M (76847582) Filter 6 (1.00 MB): - Files processed: 1.81K (1812) - Files rejected: 1.70K (1696) - Files total: 1.81K (1812) - RowGroups processed: 75.02K (75024) - RowGroups rejected: 0 (0) - RowGroups total: 75.02K (75024) - Rows processed: 1.90M (1900544) - Rows rejected: 0 (0) - Rows total: 76.85M (76847531) - Splits processed: 116 (116) - Splits rejected: 0 (0) - Splits total: 116 (116) Instance 7f40dcb034de70b7:91 (host=vc1541.foo:22000):(Total: 9m12s, non-child: 8m51s, % non-child: 96.09%) Hdfs split stats (:<# splits>/): 1:209/11.61 GB 3:236/13.13 GB 7:209/12.18 GB 5:217/12.86 GB 4:227/13.19 GB 2:250/14.04 GB 6:250/14.56 GB 0:229/14.14 GB Filter 6 arrival: 1s106ms Filter 2 arrival: 11s631ms Filter 5 arrival: 15s881ms MemoryUsage(16s000ms): 36.06 MB, 66.75 MB, 66.46 MB, 65.39 MB, 65.84 MB, 66.34 MB, 64.83 MB, 64.76 MB, 64.86 MB, 65.22 MB, 66.81 MB, 66.74 MB, 65.84 MB, 66.36 MB, 66.54 MB, 65.70 MB, 65.78 MB, 65.75 MB, 65.67 MB, 65.72 MB, 65.42 MB, 65.77 MB, 65.77 MB, 65.51 MB, 66.87 MB, 66.73 MB, 66.60 MB, 66.57 MB, 65.86 MB, 65.49 MB, 60.64 MB, 58.19 MB, 57.02 MB, 52.46 MB ThreadUsage(16s000ms): 12, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.90 - BloomFilterBytes: 33.00 MB (34603008) - PeakMemoryUsage: 67.39 MB (70659460) - PerHostPeakMemUsage: 161.66 GB (173579901517) - RowsProduced: 77.09M (77093513) - TotalNetworkReceiveTime: 869.792ms - TotalNetworkSendTime: 8m44s - TotalStorageWaitTime: 11s890ms - TotalThreadsInvoluntaryContextSwitches: 35.70K (35704) - TotalThreadsTotalWallClockTime: 1h58m - TotalThreadsSysTime: 2m54s - TotalThreadsUserTime: 2m19s - TotalThreadsVoluntaryContextSwitches: 12.05M (12050395) Fragment Instance Lifecycle Timings: - ExecTime: 9m11s - ExecTreeExecTime: 3s775ms - OpenTime: 1s233ms - ExecTreeOpenTime: 1s047ms - PrepareTime: 53.932ms - ExecTreePrepareTime: 5.729ms DataStreamSender (dst_id=22):(Total: 16s602ms, non-child: 16s602ms, % non-child: 100.00%) - BytesSent: 712.42 MB (747025752) - NetworkThroughput(*): 77.30 MB/sec - OverallThroughput: 42.91 MB/sec - PeakMemoryUsage: 4.99 MB (5232384) - RowsReturned: 77.09M (77093513) - SerializeBatchTime: 7s366ms - TransmitDataRPCTime: 9s215ms - UncompressedRowBatchSize: 2.15 GB (2313634862) CodeGen:(Total: 207.913ms, non-child: 207.913ms, % non-child: 100.00%) - CodegenTime: 980.669us - CompileTime: 56.958ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 127.518ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 23.094ms HASH_JOIN_NODE (id=5):(Total: 4s790ms, non-child: 3s274ms, % non-child: 68.35%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.982ms - PeakMemoryUsage: 1.24 MB (1297421) - ProbeRows: 77.09M (77093513) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3s099ms - RowsReturned: 77.09M (77093513) - RowsReturnedRate: 16.09 M/sec Hash Join Builder (join_node_id=5): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 47.196us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 205.288us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 85.146us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 869.806ms, non-child: 43.905us, % non-child: 0.01%) BytesReceived(16s000ms): 932.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 5.449us - DeserializeRowBatchTimer: 24.740us - FirstBatchArrivalWaitTime: 826.835ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 137.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=3):(Total: 647.028ms, non-child: 647.028ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:209/11.61 GB 3:236/13.13 GB 7:209/12.18 GB 5:217/12.86 GB 4:227/13.19 GB 2:250/14.04 GB 6:250/14.56 GB 0:229/14.14 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 118 out of 118 Runtime filters: Only following filters arrived: 6, waited 40ms Hdfs Read Thread Concurrency Bucket: 0:98.91% 1:0.9124% 2:0.1825% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1709 PARQUET/SNAPPY:118 BytesRead(16s000ms): 13.30 MB, 14.68 MB, 14.94 MB, 20.74 MB, 29.20 MB, 30.31 MB, 38.94 MB, 43.38 MB, 44.97 MB, 54.80 MB, 58.28 MB, 60.46 MB, 70.74 MB, 73.19 MB, 77.39 MB, 86.32 MB, 87.92 MB, 94.81 MB, 100.96 MB, 102.99 MB, 110.74 MB, 115.12 MB, 116.28 MB, 119.31 MB, 128.27 MB, 129.91 MB, 131.01 MB, 133.12 MB, 135.87 MB, 138.45 MB, 140.85 MB, 140.89 MB, 140.89 MB, 140.89 MB - FooterProcessingTime: (Avg: 55.771ms ; Min: 26.346ms ; Max: 190.910ms ; Number of samples: 118) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 11.99 - BytesRead: 140.89 MB (147729333) - BytesReadDataNodeCache: 0 - BytesReadLocal: 140.89 MB (147729333) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 140.89 MB (147729333) - DecompressionTime: 2s133ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 118 (118) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 29.17 MB (30589260) - PerReadThreadRawHdfsThroughput: 23.55 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 128.151ms - RowBatchQueuePutWaitTime: 1h44m - RowsRead: 77.23M (77234337) - RowsReturned: 77.09M (77093513) - RowsReturnedRate: 119.15 M/sec - ScanRangesComplete: 1.83K (1827) - ScannerThreadsInvoluntaryContextSwitches: 30.66K (30664) - ScannerThreadsTotalWallClockTime: 1h49m - MaterializeTupleTime(*): 6s036ms - ScannerThreadsSysTime: 2m53s - ScannerThreadsUserTime: 1m55s - ScannerThreadsVoluntaryContextSwitches: 12.05M (12047283) - TotalRawHdfsReadTime(*): 5s982ms - TotalReadThroughput: 263.02 KB/sec Filter 2 (16.00 MB): - Rows processed: 2.01M (2013720) - Rows rejected: 140.77K (140772) - Rows total: 77.23M (77234337) Filter 5 (16.00 MB): - Rows processed: 1.86M (1863732) - Rows rejected: 52 (52) - Rows total: 77.09M (77093565) Filter 6 (1.00 MB): - Files processed: 1.83K (1827) - Files rejected: 1.71K (1709) - Files total: 1.83K (1827) - RowGroups processed: 75.26K (75260) - RowGroups rejected: 0 (0) - RowGroups total: 75.26K (75260) - Rows processed: 1.93M (1933312) - Rows rejected: 0 (0) - Rows total: 77.09M (77093513) - Splits processed: 118 (118) - Splits rejected: 0 (0) - Splits total: 118 (118) Instance 7f40dcb034de70b7:9a (host=vc1518.foo:22000):(Total: 9m12s, non-child: 8m49s, % non-child: 95.90%) Hdfs split stats (:<# splits>/): 6:229/12.80 GB 1:229/13.41 GB 7:225/13.25 GB 2:234/13.71 GB 4:204/11.59 GB 0:248/14.55 GB 5:213/12.79 GB 3:232/13.60 GB Filter 6 arrival: 1s047ms Filter 2 arrival: 11s859ms Filter 5 arrival: 15s989ms MemoryUsage(16s000ms): 34.50 MB, 64.78 MB, 64.80 MB, 65.36 MB, 66.86 MB, 66.76 MB, 65.73 MB, 66.83 MB, 66.63 MB, 66.63 MB, 66.87 MB, 66.81 MB, 66.81 MB, 66.65 MB, 66.32 MB, 65.06 MB, 64.76 MB, 65.71 MB, 66.83 MB, 66.75 MB, 66.59 MB, 66.78 MB, 66.76 MB, 66.79 MB, 66.71 MB, 66.73 MB, 66.83 MB, 66.78 MB, 65.50 MB, 66.38 MB, 62.78 MB, 57.88 MB, 57.88 MB, 53.32 MB ThreadUsage(16s000ms): 12, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.90 - BloomFilterBytes: 33.00 MB (34603008) - PeakMemoryUsage: 67.46 MB (70737670) - PerHostPeakMemUsage: 161.67 GB (173596752170) - RowsProduced: 76.87M (76869499) - TotalNetworkReceiveTime: 814.908ms - TotalNetworkSendTime: 8m42s - TotalStorageWaitTime: 12s767ms - TotalThreadsInvoluntaryContextSwitches: 37.75K (37746) - TotalThreadsTotalWallClockTime: 1h58m - TotalThreadsSysTime: 2m47s - TotalThreadsUserTime: 2m15s - TotalThreadsVoluntaryContextSwitches: 10.65M (10645451) Fragment Instance Lifecycle Timings: - ExecTime: 9m11s - ExecTreeExecTime: 3s985ms - OpenTime: 1s164ms - ExecTreeOpenTime: 979.755ms - PrepareTime: 51.617ms - ExecTreePrepareTime: 6.276ms DataStreamSender (dst_id=22):(Total: 17s497ms, non-child: 17s497ms, % non-child: 100.00%) - BytesSent: 712.38 MB (746981460) - NetworkThroughput(*): 72.51 MB/sec - OverallThroughput: 40.71 MB/sec - PeakMemoryUsage: 4.99 MB (5232384) - RowsReturned: 76.87M (76869499) - SerializeBatchTime: 7s652ms - TransmitDataRPCTime: 9s824ms - UncompressedRowBatchSize: 2.15 GB (2306912034) CodeGen:(Total: 205.641ms, non-child: 205.641ms, % non-child: 100.00%) - CodegenTime: 1.025ms - CompileTime: 56.989ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 126.674ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 21.556ms HASH_JOIN_NODE (id=5):(Total: 4s931ms, non-child: 3s488ms, % non-child: 70.74%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 2.815ms - PeakMemoryUsage: 1.24 MB (1297263) - ProbeRows: 76.87M (76869499) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3s347ms - RowsReturned: 76.87M (76869499) - RowsReturnedRate: 15.59 M/sec Hash Join Builder (join_node_id=5): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 30.718us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 686.838us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 64.635us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 814.926ms, non-child: 29.191us, % non-child: 0.00%) BytesReceived(16s000ms): 932.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 8.465us - DeserializeRowBatchTimer: 24.236us - FirstBatchArrivalWaitTime: 788.954ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 147.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=3):(Total: 628.494ms, non-child: 628.494ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 6:229/12.80 GB 1:229/13.41 GB 7:225/13.25 GB 2:234/13.71 GB 4:204/11.59 GB 0:248/14.55 GB 5:213/12.79 GB 3:232/13.60 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 117 out of 117 Runtime filters: Only following filters arrived: 6, waited 40ms Hdfs Read Thread Concurrency Bucket: 0:98.91% 1:0.9124% 2:0.09124% 3:0.09124% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1697 PARQUET/SNAPPY:117 BytesRead(16s000ms): 13.24 MB, 14.26 MB, 14.86 MB, 22.03 MB, 29.31 MB, 30.17 MB, 40.56 MB, 44.48 MB, 46.06 MB, 57.19 MB, 59.38 MB, 61.78 MB, 72.48 MB, 73.98 MB, 77.15 MB, 87.16 MB, 88.54 MB, 95.70 MB, 102.83 MB, 103.89 MB, 111.09 MB, 117.49 MB, 117.88 MB, 119.48 MB, 127.40 MB, 132.16 MB, 132.59 MB, 133.65 MB, 135.99 MB, 139.59 MB, 141.69 MB, 142.28 MB, 142.28 MB, 142.28 MB - FooterProcessingTime: (Avg: 62.078ms ; Min: 10.555ms ; Max: 308.783ms ; Number of samples: 117) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 11.98 - BytesRead: 142.28 MB (149187849) - BytesReadDataNodeCache: 0 - BytesReadLocal: 142.28 MB (149187849) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 142.28 MB (149187849) - DecompressionTime: 2s361ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 117 (117) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 29.26 MB (30680711) - PerReadThreadRawHdfsThroughput: 21.98 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 113.724ms - RowBatchQueuePutWaitTime: 1h44m - RowsRead: 77.01M (77006842) - RowsReturned: 76.87M (76869499) - RowsReturnedRate: 122.31 M/sec - ScanRangesComplete: 1.81K (1814) - ScannerThreadsInvoluntaryContextSwitches: 32.54K (32544) - ScannerThreadsTotalWallClockTime: 1h49m - MaterializeTupleTime(*): 6s931ms - ScannerThreadsSysTime: 2m46s - ScannerThreadsUserTime: 1m49s - ScannerThreadsVoluntaryContextSwitches: 10.64M (10642289) - TotalRawHdfsReadTime(*): 6s472ms - TotalReadThroughput: 265.86 KB/sec Filter 2 (16.00 MB): - Rows processed: 1.96M (1962111) - Rows rejected: 137.31K (137312) - Rows total: 77.01M (77006842) Filter 5 (16.00 MB): - Rows processed: 1.83M (1825823) - Rows rejected: 31 (31) - Rows total: 76.87M (76869530) Filter 6 (1.00 MB): - Files processed: 1.81K (1814) - Files rejected: 1.70K (1697) - Files total: 1.81K (1814) - RowGroups processed: 75.04K (75041) - RowGroups rejected: 0 (0) - RowGroups total: 75.04K (75041) - Rows processed: 1.92M (1916928) - Rows rejected: 0 (0) - Rows total: 76.87M (76869499) - Splits processed: 117 (117) - Splits rejected: 0 (0) - Splits total: 117 (117) Instance 7f40dcb034de70b7:a7 (host=vd1117.foo:22000):(Total: 9m12s, non-child: 8m50s, % non-child: 96.09%) Hdfs split stats (:<# splits>/): 1:216/12.81 GB 3:235/13.43 GB 0:205/11.69 GB 5:222/12.82 GB 4:232/14.11 GB 7:235/12.99 GB 6:246/14.60 GB 2:223/13.24 GB Filter 6 arrival: 993ms Filter 2 arrival: 12s300ms Filter 5 arrival: 16s205ms MemoryUsage(16s000ms): 35.75 MB, 66.75 MB, 66.69 MB, 66.52 MB, 66.79 MB, 66.49 MB, 64.88 MB, 64.72 MB, 65.24 MB, 66.73 MB, 66.85 MB, 66.52 MB, 66.80 MB, 66.76 MB, 66.65 MB, 66.79 MB, 66.34 MB, 66.59 MB, 66.88 MB, 66.30 MB, 65.77 MB, 65.78 MB, 65.75 MB, 65.03 MB, 64.81 MB, 64.78 MB, 64.73 MB, 64.03 MB, 61.50 MB, 61.28 MB, 61.30 MB, 61.26 MB, 59.16 MB, 53.85 MB ThreadUsage(16s000ms): 12, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.90 - BloomFilterBytes: 33.00 MB (34603008) - PeakMemoryUsage: 67.50 MB (70778612) - PerHostPeakMemUsage: 161.67 GB (173587762807) - RowsProduced: 78.22M (78223155) - TotalNetworkReceiveTime: 759.828ms - TotalNetworkSendTime: 8m44s - TotalStorageWaitTime: 12s007ms - TotalThreadsInvoluntaryContextSwitches: 33.95K (33945) - TotalThreadsTotalWallClockTime: 1h58m - TotalThreadsSysTime: 1m35s - TotalThreadsUserTime: 3m29s - TotalThreadsVoluntaryContextSwitches: 5.83M (5828763) Fragment Instance Lifecycle Timings: - ExecTime: 9m11s - ExecTreeExecTime: 3s707ms - OpenTime: 1s086ms - ExecTreeOpenTime: 903.545ms - PrepareTime: 55.469ms - ExecTreePrepareTime: 5.804ms DataStreamSender (dst_id=22):(Total: 16s800ms, non-child: 16s800ms, % non-child: 100.00%) - BytesSent: 723.62 MB (758771480) - NetworkThroughput(*): 76.87 MB/sec - OverallThroughput: 43.07 MB/sec - PeakMemoryUsage: 4.91 MB (5150464) - RowsReturned: 78.22M (78223155) - SerializeBatchTime: 7s365ms - TransmitDataRPCTime: 9s413ms - UncompressedRowBatchSize: 2.19 GB (2347536306) CodeGen:(Total: 208.119ms, non-child: 208.119ms, % non-child: 100.00%) - CodegenTime: 1.073ms - CompileTime: 55.303ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 125.940ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 26.445ms HASH_JOIN_NODE (id=5):(Total: 4s578ms, non-child: 3s274ms, % non-child: 71.51%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.648ms - PeakMemoryUsage: 1.24 MB (1296762) - ProbeRows: 78.22M (78223155) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3s110ms - RowsReturned: 78.22M (78223155) - RowsReturnedRate: 17.09 M/sec Hash Join Builder (join_node_id=5): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 27.060us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 141.352us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 72.429us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 759.839ms, non-child: 20.508us, % non-child: 0.00%) BytesReceived(16s000ms): 932.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 4.938us - DeserializeRowBatchTimer: 15.049us - FirstBatchArrivalWaitTime: 745.219ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 157.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=3):(Total: 545.015ms, non-child: 545.015ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:216/12.81 GB 3:235/13.43 GB 0:205/11.69 GB 5:222/12.82 GB 4:232/14.11 GB 7:235/12.99 GB 6:246/14.60 GB 2:223/13.24 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 118 out of 118 Runtime filters: Only following filters arrived: 6, waited 41ms Hdfs Read Thread Concurrency Bucket: 0:98.9% 1:1.008% 2:0% 3:0.09166% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1696 PARQUET/SNAPPY:118 BytesRead(16s000ms): 13.24 MB, 14.41 MB, 15.28 MB, 23.75 MB, 29.21 MB, 31.49 MB, 41.25 MB, 44.01 MB, 47.74 MB, 58.12 MB, 58.88 MB, 65.12 MB, 72.55 MB, 74.52 MB, 82.87 MB, 87.00 MB, 89.51 MB, 100.92 MB, 101.76 MB, 105.84 MB, 115.91 MB, 115.91 MB, 117.14 MB, 124.75 MB, 130.54 MB, 130.54 MB, 132.26 MB, 136.55 MB, 142.90 MB, 142.90 MB, 142.90 MB, 142.90 MB, 142.90 MB, 142.90 MB - FooterProcessingTime: (Avg: 55.897ms ; Min: 23.091ms ; Max: 158.585ms ; Number of samples: 118) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 11.99 - BytesRead: 142.90 MB (149844116) - BytesReadDataNodeCache: 0 - BytesReadLocal: 142.90 MB (149844116) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 142.90 MB (149844116) - DecompressionTime: 2s502ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 118 (118) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 29.36 MB (30782776) - PerReadThreadRawHdfsThroughput: 22.49 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 96.219ms - RowBatchQueuePutWaitTime: 1h44m - RowsRead: 78.36M (78359394) - RowsReturned: 78.22M (78223155) - RowsReturnedRate: 143.52 M/sec - ScanRangesComplete: 1.81K (1814) - ScannerThreadsInvoluntaryContextSwitches: 28.91K (28909) - ScannerThreadsTotalWallClockTime: 1h49m - MaterializeTupleTime(*): 6s415ms - ScannerThreadsSysTime: 1m35s - ScannerThreadsUserTime: 3m5s - ScannerThreadsVoluntaryContextSwitches: 5.83M (5825635) - TotalRawHdfsReadTime(*): 6s355ms - TotalReadThroughput: 268.01 KB/sec Filter 2 (16.00 MB): - Rows processed: 1.99M (1985583) - Rows rejected: 136.19K (136193) - Rows total: 78.36M (78359394) Filter 5 (16.00 MB): - Rows processed: 1.84M (1835054) - Rows rejected: 46 (46) - Rows total: 78.22M (78223201) Filter 6 (1.00 MB): - Files processed: 1.81K (1814) - Files rejected: 1.70K (1696) - Files total: 1.81K (1814) - RowGroups processed: 76.37K (76370) - RowGroups rejected: 0 (0) - RowGroups total: 76.37K (76370) - Rows processed: 1.93M (1933312) - Rows rejected: 0 (0) - Rows total: 78.22M (78223155) - Splits processed: 118 (118) - Splits rejected: 0 (0) - Splits total: 118 (118) Instance 7f40dcb034de70b7:ac (host=va1038.foo:22000):(Total: 9m12s, non-child: 8m51s, % non-child: 96.17%) Hdfs split stats (:<# splits>/): 0:236/14.50 GB 6:230/12.99 GB 5:248/14.88 GB 1:237/13.04 GB 3:234/12.65 GB 4:209/12.43 GB 7:210/12.16 GB 2:228/13.03 GB Filter 6 arrival: 949ms Filter 2 arrival: 12s368ms Filter 5 arrival: 16s235ms MemoryUsage(16s000ms): 36.51 MB, 66.76 MB, 66.78 MB, 66.56 MB, 66.80 MB, 66.81 MB, 66.51 MB, 66.83 MB, 66.84 MB, 65.47 MB, 65.86 MB, 65.91 MB, 66.82 MB, 66.78 MB, 66.65 MB, 66.75 MB, 66.72 MB, 65.66 MB, 65.78 MB, 65.66 MB, 66.66 MB, 66.82 MB, 66.85 MB, 66.61 MB, 66.75 MB, 66.82 MB, 66.83 MB, 66.74 MB, 61.80 MB, 60.14 MB, 60.19 MB, 60.11 MB, 60.10 MB, 50.31 MB ThreadUsage(16s000ms): 12, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 8 - AverageThreadTokens: 12.74 - BloomFilterBytes: 33.00 MB (34603008) - PeakMemoryUsage: 67.63 MB (70919496) - PerHostPeakMemUsage: 161.67 GB (173587044588) - RowsProduced: 77.58M (77580782) - TotalNetworkReceiveTime: 714.723ms - TotalNetworkSendTime: 8m44s - TotalStorageWaitTime: 14s327ms - TotalThreadsInvoluntaryContextSwitches: 34.12K (34119) - TotalThreadsTotalWallClockTime: 1h57m - TotalThreadsSysTime: 1m42s - TotalThreadsUserTime: 3m12s - TotalThreadsVoluntaryContextSwitches: 8.37M (8370642) Fragment Instance Lifecycle Timings: - ExecTime: 9m11s - ExecTreeExecTime: 3s617ms - OpenTime: 1s183ms - ExecTreeOpenTime: 995.276ms - PrepareTime: 51.834ms - ExecTreePrepareTime: 7.216ms DataStreamSender (dst_id=22):(Total: 16s369ms, non-child: 16s369ms, % non-child: 100.00%) - BytesSent: 718.52 MB (753423528) - NetworkThroughput(*): 78.24 MB/sec - OverallThroughput: 43.89 MB/sec - PeakMemoryUsage: 4.86 MB (5093120) - RowsReturned: 77.58M (77580782) - SerializeBatchTime: 7s164ms - TransmitDataRPCTime: 9s183ms - UncompressedRowBatchSize: 2.17 GB (2328258196) CodeGen:(Total: 204.377ms, non-child: 204.377ms, % non-child: 100.00%) - CodegenTime: 1.341ms - CompileTime: 56.827ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 129.578ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 17.365ms HASH_JOIN_NODE (id=5):(Total: 4s579ms, non-child: 3s155ms, % non-child: 68.92%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.352ms - PeakMemoryUsage: 1.24 MB (1298031) - ProbeRows: 77.58M (77580782) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 2s990ms - RowsReturned: 77.58M (77580782) - RowsReturnedRate: 16.94 M/sec Hash Join Builder (join_node_id=5): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 40.981us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 140.188us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 59.882us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 714.733ms, non-child: 21.711us, % non-child: 0.00%) BytesReceived(16s000ms): 932.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 3.992us - DeserializeRowBatchTimer: 20.828us - FirstBatchArrivalWaitTime: 689.175ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 167.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=3):(Total: 709.104ms, non-child: 709.104ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:236/14.50 GB 6:230/12.99 GB 5:248/14.88 GB 1:237/13.04 GB 3:234/12.65 GB 4:209/12.43 GB 7:210/12.16 GB 2:228/13.03 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 117 out of 117 Runtime filters: Only following filters arrived: 6, waited 81ms Hdfs Read Thread Concurrency Bucket: 0:98.71% 1:1.012% 2:0.092% 3:0.092% 4:0% 5:0.092% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1715 PARQUET/SNAPPY:117 BytesRead(16s000ms): 13.73 MB, 14.96 MB, 14.96 MB, 19.62 MB, 29.26 MB, 29.64 MB, 39.68 MB, 44.26 MB, 44.95 MB, 57.68 MB, 58.67 MB, 62.61 MB, 73.51 MB, 73.62 MB, 79.24 MB, 87.80 MB, 88.21 MB, 99.24 MB, 102.09 MB, 102.76 MB, 114.51 MB, 116.54 MB, 116.55 MB, 120.97 MB, 131.10 MB, 131.26 MB, 131.50 MB, 133.91 MB, 142.65 MB, 142.65 MB, 142.65 MB, 142.65 MB, 142.65 MB - FooterProcessingTime: (Avg: 68.900ms ; Min: 4.537ms ; Max: 480.721ms ; Number of samples: 117) - AverageHdfsReadThreadConcurrency: 0.02 - AverageScannerThreadConcurrency: 11.87 - BytesRead: 142.65 MB (149583701) - BytesReadDataNodeCache: 0 - BytesReadLocal: 142.65 MB (149583701) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 142.65 MB (149583701) - DecompressionTime: 479.046ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 117 (117) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 29.40 MB (30826033) - PerReadThreadRawHdfsThroughput: 21.40 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 193.549ms - RowBatchQueuePutWaitTime: 1h43m - RowsRead: 77.72M (77721930) - RowsReturned: 77.58M (77580782) - RowsReturnedRate: 109.41 M/sec - ScanRangesComplete: 1.83K (1832) - ScannerThreadsInvoluntaryContextSwitches: 29.20K (29202) - ScannerThreadsTotalWallClockTime: 1h48m - MaterializeTupleTime(*): 6s341ms - ScannerThreadsSysTime: 1m41s - ScannerThreadsUserTime: 2m49s - ScannerThreadsVoluntaryContextSwitches: 8.37M (8367573) - TotalRawHdfsReadTime(*): 6s665ms - TotalReadThroughput: 268.77 KB/sec Filter 2 (16.00 MB): - Rows processed: 2.03M (2027356) - Rows rejected: 141.10K (141101) - Rows total: 77.72M (77721930) Filter 5 (16.00 MB): - Rows processed: 1.80M (1799215) - Rows rejected: 47 (47) - Rows total: 77.58M (77580829) Filter 6 (1.00 MB): - Files processed: 1.83K (1832) - Files rejected: 1.72K (1715) - Files total: 1.83K (1832) - RowGroups processed: 75.74K (75736) - RowGroups rejected: 0 (0) - RowGroups total: 75.74K (75736) - Rows processed: 1.92M (1916928) - Rows rejected: 0 (0) - Rows total: 77.58M (77580782) - Splits processed: 117 (117) - Splits rejected: 0 (0) - Splits total: 117 (117) Instance 7f40dcb034de70b7:ab (host=vd1115.foo:22000):(Total: 9m12s, non-child: 8m50s, % non-child: 95.96%) Hdfs split stats (:<# splits>/): 3:221/12.93 GB 1:217/12.63 GB 0:223/13.41 GB 4:221/13.14 GB 2:227/13.25 GB 7:241/13.77 GB 5:223/13.15 GB 6:243/13.39 GB Filter 6 arrival: 954ms Filter 2 arrival: 12s359ms Filter 5 arrival: 16s186ms MemoryUsage(16s000ms): 35.62 MB, 66.83 MB, 66.76 MB, 66.43 MB, 65.80 MB, 65.84 MB, 66.39 MB, 66.84 MB, 66.62 MB, 66.70 MB, 66.83 MB, 66.29 MB, 66.31 MB, 66.81 MB, 66.52 MB, 66.76 MB, 66.85 MB, 66.00 MB, 65.78 MB, 65.66 MB, 64.34 MB, 64.83 MB, 64.77 MB, 64.48 MB, 66.15 MB, 65.82 MB, 65.86 MB, 65.72 MB, 65.85 MB, 62.81 MB, 59.01 MB, 57.92 MB, 57.77 MB, 52.52 MB ThreadUsage(16s000ms): 12, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 10 - AverageThreadTokens: 12.76 - BloomFilterBytes: 33.00 MB (34603008) - PeakMemoryUsage: 67.60 MB (70878596) - PerHostPeakMemUsage: 161.68 GB (173604773286) - RowsProduced: 77.02M (77024486) - TotalNetworkReceiveTime: 720.838ms - TotalNetworkSendTime: 8m44s - TotalStorageWaitTime: 13s048ms - TotalThreadsInvoluntaryContextSwitches: 32.50K (32496) - TotalThreadsTotalWallClockTime: 1h57m - TotalThreadsSysTime: 2m8s - TotalThreadsUserTime: 2m37s - TotalThreadsVoluntaryContextSwitches: 12.70M (12699982) Fragment Instance Lifecycle Timings: - ExecTime: 9m11s - ExecTreeExecTime: 4s082ms - OpenTime: 1s129ms - ExecTreeOpenTime: 942.125ms - PrepareTime: 49.752ms - ExecTreePrepareTime: 5.731ms DataStreamSender (dst_id=22):(Total: 17s117ms, non-child: 17s117ms, % non-child: 100.00%) - BytesSent: 711.92 MB (746499369) - NetworkThroughput(*): 74.17 MB/sec - OverallThroughput: 41.59 MB/sec - PeakMemoryUsage: 4.92 MB (5158656) - RowsReturned: 77.02M (77024486) - SerializeBatchTime: 7s499ms - TransmitDataRPCTime: 9s598ms - UncompressedRowBatchSize: 2.15 GB (2311563316) CodeGen:(Total: 208.006ms, non-child: 208.006ms, % non-child: 100.00%) - CodegenTime: 938.989us - CompileTime: 57.049ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 128.679ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 21.862ms HASH_JOIN_NODE (id=5):(Total: 4s989ms, non-child: 3s317ms, % non-child: 66.48%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.527ms - PeakMemoryUsage: 1.23 MB (1290054) - ProbeRows: 77.02M (77024486) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3s139ms - RowsReturned: 77.02M (77024486) - RowsReturnedRate: 15.44 M/sec Hash Join Builder (join_node_id=5): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 28.573us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 130.339us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 58.128us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 720.861ms, non-child: 31.843us, % non-child: 0.00%) BytesReceived(16s000ms): 932.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 4.574us - DeserializeRowBatchTimer: 20.236us - FirstBatchArrivalWaitTime: 709.315ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 166.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=3):(Total: 952.131ms, non-child: 952.131ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:221/12.93 GB 1:217/12.63 GB 0:223/13.41 GB 4:221/13.14 GB 2:227/13.25 GB 7:241/13.77 GB 5:223/13.15 GB 6:243/13.39 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 117 out of 117 Runtime filters: Only following filters arrived: 6, waited 80ms Hdfs Read Thread Concurrency Bucket: 0:98.54% 1:1.28% 2:0.1828% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1699 PARQUET/SNAPPY:117 BytesRead(16s000ms): 13.38 MB, 14.58 MB, 14.95 MB, 21.29 MB, 28.92 MB, 29.79 MB, 40.28 MB, 43.64 MB, 45.84 MB, 57.62 MB, 58.27 MB, 62.18 MB, 72.29 MB, 73.32 MB, 79.50 MB, 87.24 MB, 88.09 MB, 97.06 MB, 101.66 MB, 103.19 MB, 113.37 MB, 116.03 MB, 116.47 MB, 119.28 MB, 128.62 MB, 130.53 MB, 130.83 MB, 132.26 MB, 137.65 MB, 140.19 MB, 140.19 MB, 140.19 MB, 140.19 MB, 140.19 MB - FooterProcessingTime: (Avg: 60.750ms ; Min: 4.234ms ; Max: 215.054ms ; Number of samples: 117) - AverageHdfsReadThreadConcurrency: 0.02 - AverageScannerThreadConcurrency: 11.85 - BytesRead: 140.19 MB (147002437) - BytesReadDataNodeCache: 0 - BytesReadLocal: 140.19 MB (147002437) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 140.19 MB (147002437) - DecompressionTime: 827.985ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 117 (117) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 29.49 MB (30918221) - PerReadThreadRawHdfsThroughput: 20.96 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 133.096ms - RowBatchQueuePutWaitTime: 1h43m - RowsRead: 77.16M (77163193) - RowsReturned: 77.02M (77024486) - RowsReturnedRate: 80.90 M/sec - ScanRangesComplete: 1.82K (1816) - ScannerThreadsInvoluntaryContextSwitches: 27.42K (27418) - ScannerThreadsTotalWallClockTime: 1h48m - MaterializeTupleTime(*): 6s692ms - ScannerThreadsSysTime: 2m8s - ScannerThreadsUserTime: 2m12s - ScannerThreadsVoluntaryContextSwitches: 12.70M (12696868) - TotalRawHdfsReadTime(*): 6s689ms - TotalReadThroughput: 262.20 KB/sec Filter 2 (16.00 MB): - Rows processed: 2.01M (2006483) - Rows rejected: 138.67K (138667) - Rows total: 77.16M (77163193) Filter 5 (16.00 MB): - Rows processed: 1.82M (1821736) - Rows rejected: 40 (40) - Rows total: 77.02M (77024526) Filter 6 (1.00 MB): - Files processed: 1.82K (1816) - Files rejected: 1.70K (1699) - Files total: 1.82K (1816) - RowGroups processed: 75.20K (75196) - RowGroups rejected: 0 (0) - RowGroups total: 75.20K (75196) - Rows processed: 1.92M (1916928) - Rows rejected: 0 (0) - Rows total: 77.02M (77024486) - Splits processed: 117 (117) - Splits rejected: 0 (0) - Splits total: 117 (117) Instance 7f40dcb034de70b7:b8 (host=vd1105.foo:22000):(Total: 9m12s, non-child: 8m50s, % non-child: 96.05%) Hdfs split stats (:<# splits>/): 3:214/12.37 GB 7:233/13.45 GB 2:226/12.24 GB 1:212/13.36 GB 6:236/13.46 GB 4:234/13.43 GB 5:224/13.28 GB 0:236/14.08 GB Filter 6 arrival: 910ms Filter 2 arrival: 12s727ms Filter 5 arrival: 16s370ms MemoryUsage(16s000ms): 35.21 MB, 66.25 MB, 66.81 MB, 66.52 MB, 66.81 MB, 66.77 MB, 66.63 MB, 66.78 MB, 66.71 MB, 66.70 MB, 66.82 MB, 66.01 MB, 64.79 MB, 64.79 MB, 64.41 MB, 63.70 MB, 63.70 MB, 63.92 MB, 65.77 MB, 65.99 MB, 66.74 MB, 66.78 MB, 66.80 MB, 66.61 MB, 66.72 MB, 66.74 MB, 66.85 MB, 66.70 MB, 65.99 MB, 59.22 MB, 59.10 MB, 59.17 MB, 59.15 MB, 52.28 MB ThreadUsage(16s000ms): 12, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 10 - AverageThreadTokens: 12.75 - BloomFilterBytes: 33.00 MB (34603008) - PeakMemoryUsage: 67.45 MB (70729851) - PerHostPeakMemUsage: 161.67 GB (173589280999) - RowsProduced: 77.56M (77558534) - TotalNetworkReceiveTime: 679.070ms - TotalNetworkSendTime: 8m44s - TotalStorageWaitTime: 13s360ms - TotalThreadsInvoluntaryContextSwitches: 30.75K (30747) - TotalThreadsTotalWallClockTime: 1h57m - TotalThreadsSysTime: 1m49s - TotalThreadsUserTime: 2m36s - TotalThreadsVoluntaryContextSwitches: 10.36M (10359083) Fragment Instance Lifecycle Timings: - ExecTime: 9m11s - ExecTreeExecTime: 4s027ms - OpenTime: 1s120ms - ExecTreeOpenTime: 936.785ms - PrepareTime: 51.849ms - ExecTreePrepareTime: 6.013ms DataStreamSender (dst_id=22):(Total: 16s716ms, non-child: 16s716ms, % non-child: 100.00%) - BytesSent: 718.46 MB (753364296) - NetworkThroughput(*): 77.47 MB/sec - OverallThroughput: 42.98 MB/sec - PeakMemoryUsage: 5.00 MB (5240576) - RowsReturned: 77.56M (77558534) - SerializeBatchTime: 7s421ms - TransmitDataRPCTime: 9s273ms - UncompressedRowBatchSize: 2.17 GB (2327590516) CodeGen:(Total: 204.559ms, non-child: 204.559ms, % non-child: 100.00%) - CodegenTime: 1.001ms - CompileTime: 55.863ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 125.841ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 22.448ms HASH_JOIN_NODE (id=5):(Total: 4s928ms, non-child: 3s243ms, % non-child: 65.80%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.464ms - PeakMemoryUsage: 1.23 MB (1290229) - ProbeRows: 77.56M (77558534) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3s078ms - RowsReturned: 77.56M (77558534) - RowsReturnedRate: 15.74 M/sec Hash Join Builder (join_node_id=5): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 25.756us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 163.594us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 47.058us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 679.080ms, non-child: 19.455us, % non-child: 0.00%) BytesReceived(16s000ms): 932.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 5.272us - DeserializeRowBatchTimer: 23.678us - FirstBatchArrivalWaitTime: 654.957ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 176.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=3):(Total: 1s006ms, non-child: 1s006ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:214/12.37 GB 7:233/13.45 GB 2:226/12.24 GB 1:212/13.36 GB 6:236/13.46 GB 4:234/13.43 GB 5:224/13.28 GB 0:236/14.08 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 117 out of 117 Runtime filters: Only following filters arrived: 6, waited 120ms Hdfs Read Thread Concurrency Bucket: 0:98.35% 1:1.005% 2:0.457% 3:0.09141% 4:0% 5:0% 6:0.09141% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1698 PARQUET/SNAPPY:117 BytesRead(16s000ms): 13.13 MB, 14.49 MB, 14.49 MB, 20.56 MB, 29.33 MB, 29.49 MB, 41.10 MB, 44.22 MB, 45.94 MB, 58.48 MB, 58.74 MB, 63.02 MB, 73.48 MB, 73.48 MB, 78.81 MB, 87.47 MB, 87.54 MB, 96.08 MB, 101.73 MB, 102.44 MB, 112.45 MB, 116.60 MB, 116.60 MB, 119.45 MB, 131.03 MB, 131.46 MB, 131.46 MB, 133.22 MB, 139.46 MB, 142.15 MB, 142.15 MB, 142.15 MB, 142.15 MB, 142.15 MB - FooterProcessingTime: (Avg: 62.904ms ; Min: 3.572ms ; Max: 180.099ms ; Number of samples: 117) - AverageHdfsReadThreadConcurrency: 0.03 - AverageScannerThreadConcurrency: 11.84 - BytesRead: 142.15 MB (149054967) - BytesReadDataNodeCache: 0 - BytesReadLocal: 142.15 MB (149054967) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 142.15 MB (149054967) - DecompressionTime: 1s396ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 117 (117) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 29.32 MB (30746620) - PerReadThreadRawHdfsThroughput: 20.03 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 130.699ms - RowBatchQueuePutWaitTime: 1h43m - RowsRead: 77.70M (77701055) - RowsReturned: 77.56M (77558534) - RowsReturnedRate: 77.03 M/sec - ScanRangesComplete: 1.81K (1815) - ScannerThreadsInvoluntaryContextSwitches: 25.79K (25791) - ScannerThreadsTotalWallClockTime: 1h48m - MaterializeTupleTime(*): 6s285ms - ScannerThreadsSysTime: 1m49s - ScannerThreadsUserTime: 2m12s - ScannerThreadsVoluntaryContextSwitches: 10.36M (10355949) - TotalRawHdfsReadTime(*): 7s096ms - TotalReadThroughput: 265.87 KB/sec Filter 2 (16.00 MB): - Rows processed: 2.02M (2021561) - Rows rejected: 142.50K (142501) - Rows total: 77.70M (77701055) Filter 5 (16.00 MB): - Rows processed: 1.81M (1808404) - Rows rejected: 20 (20) - Rows total: 77.56M (77558554) Filter 6 (1.00 MB): - Files processed: 1.81K (1815) - Files rejected: 1.70K (1698) - Files total: 1.81K (1815) - RowGroups processed: 75.72K (75715) - RowGroups rejected: 0 (0) - RowGroups total: 75.72K (75715) - Rows processed: 1.92M (1916928) - Rows rejected: 0 (0) - Rows total: 77.56M (77558534) - Splits processed: 117 (117) - Splits rejected: 0 (0) - Splits total: 117 (117) Instance 7f40dcb034de70b7:d3 (host=va1034.foo:22000):(Total: 9m12s, non-child: 8m50s, % non-child: 96.08%) Hdfs split stats (:<# splits>/): 4:239/14.54 GB 6:218/12.93 GB 7:216/12.24 GB 2:220/12.62 GB 1:237/13.18 GB 3:233/13.54 GB 5:232/13.12 GB 0:230/13.51 GB Filter 6 arrival: 801ms Filter 2 arrival: 13s129ms Filter 5 arrival: 16s694ms MemoryUsage(16s000ms): 34.63 MB, 65.31 MB, 65.82 MB, 65.90 MB, 66.80 MB, 66.79 MB, 66.55 MB, 66.77 MB, 66.59 MB, 66.80 MB, 66.86 MB, 66.36 MB, 66.81 MB, 66.71 MB, 66.35 MB, 66.82 MB, 66.53 MB, 66.53 MB, 66.81 MB, 66.71 MB, 65.79 MB, 65.79 MB, 65.72 MB, 65.48 MB, 66.76 MB, 66.88 MB, 66.76 MB, 65.71 MB, 62.33 MB, 62.21 MB, 62.29 MB, 62.40 MB, 62.28 MB, 58.16 MB ThreadUsage(16s000ms): 12, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.90 - BloomFilterBytes: 33.00 MB (34603008) - PeakMemoryUsage: 67.50 MB (70781575) - PerHostPeakMemUsage: 161.68 GB (173598171537) - RowsProduced: 78.18M (78176684) - TotalNetworkReceiveTime: 567.172ms - TotalNetworkSendTime: 8m48s - TotalStorageWaitTime: 12s713ms - TotalThreadsInvoluntaryContextSwitches: 34.01K (34010) - TotalThreadsTotalWallClockTime: 1h58m - TotalThreadsSysTime: 49s715ms - TotalThreadsUserTime: 3m40s - TotalThreadsVoluntaryContextSwitches: 3.58M (3576898) Fragment Instance Lifecycle Timings: - ExecTime: 9m11s - ExecTreeExecTime: 3s736ms - OpenTime: 1s091ms - ExecTreeOpenTime: 907.160ms - PrepareTime: 55.366ms - ExecTreePrepareTime: 7.414ms DataStreamSender (dst_id=22):(Total: 16s840ms, non-child: 16s840ms, % non-child: 100.00%) - BytesSent: 724.56 MB (759760124) - NetworkThroughput(*): 72.75 MB/sec - OverallThroughput: 43.03 MB/sec - PeakMemoryUsage: 4.99 MB (5232384) - RowsReturned: 78.18M (78176684) - SerializeBatchTime: 6s860ms - TransmitDataRPCTime: 9s960ms - UncompressedRowBatchSize: 2.19 GB (2346141632) CodeGen:(Total: 203.557ms, non-child: 203.557ms, % non-child: 100.00%) - CodegenTime: 1.126ms - CompileTime: 52.269ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 129.620ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 21.234ms HASH_JOIN_NODE (id=5):(Total: 4s610ms, non-child: 3s241ms, % non-child: 70.31%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.471ms - PeakMemoryUsage: 1.23 MB (1294212) - ProbeRows: 78.18M (78176684) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3s103ms - RowsReturned: 78.18M (78176684) - RowsReturnedRate: 16.95 M/sec Hash Join Builder (join_node_id=5): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 25.579us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 108.837us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 54.066us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 567.182ms, non-child: 22.145us, % non-child: 0.00%) BytesReceived(16s000ms): 932.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 4.541us - DeserializeRowBatchTimer: 16.712us - FirstBatchArrivalWaitTime: 551.044ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 211.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=3):(Total: 802.163ms, non-child: 802.163ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:239/14.54 GB 6:218/12.93 GB 7:216/12.24 GB 2:220/12.62 GB 1:237/13.18 GB 3:233/13.54 GB 5:232/13.12 GB 0:230/13.51 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 118 out of 118 Runtime filters: Only following filters arrived: 6, waited 221ms Hdfs Read Thread Concurrency Bucket: 0:98.81% 1:1.007% 2:0.09158% 3:0.09158% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1707 PARQUET/SNAPPY:118 BytesRead(16s000ms): 13.26 MB, 14.32 MB, 14.41 MB, 20.58 MB, 29.45 MB, 29.92 MB, 40.44 MB, 43.94 MB, 46.76 MB, 58.76 MB, 58.76 MB, 64.45 MB, 73.35 MB, 73.59 MB, 82.57 MB, 88.19 MB, 88.92 MB, 100.51 MB, 102.48 MB, 104.72 MB, 116.72 MB, 116.97 MB, 117.47 MB, 126.42 MB, 131.50 MB, 131.50 MB, 132.15 MB, 137.03 MB, 143.77 MB, 143.77 MB, 143.77 MB, 143.77 MB, 143.77 MB, 143.77 MB - FooterProcessingTime: (Avg: 55.242ms ; Min: 4.371ms ; Max: 170.019ms ; Number of samples: 118) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 11.99 - BytesRead: 143.77 MB (150752147) - BytesReadDataNodeCache: 0 - BytesReadLocal: 143.77 MB (150752147) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 143.77 MB (150752147) - DecompressionTime: 581.965ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 118 (118) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 29.27 MB (30687013) - PerReadThreadRawHdfsThroughput: 22.31 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 108.072ms - RowBatchQueuePutWaitTime: 1h45m - RowsRead: 78.32M (78319755) - RowsReturned: 78.18M (78176684) - RowsReturnedRate: 97.46 M/sec - ScanRangesComplete: 1.82K (1825) - ScannerThreadsInvoluntaryContextSwitches: 29.27K (29265) - ScannerThreadsTotalWallClockTime: 1h49m - MaterializeTupleTime(*): 6s562ms - ScannerThreadsSysTime: 48s907ms - ScannerThreadsUserTime: 3m19s - ScannerThreadsVoluntaryContextSwitches: 3.57M (3573781) - TotalRawHdfsReadTime(*): 6s445ms - TotalReadThroughput: 269.38 KB/sec Filter 2 (16.00 MB): - Rows processed: 2.06M (2063071) - Rows rejected: 143.07K (143071) - Rows total: 78.32M (78319755) Filter 5 (16.00 MB): - Rows processed: 1.90M (1896448) - Rows rejected: 0 (0) - Rows total: 78.18M (78176684) Filter 6 (1.00 MB): - Files processed: 1.82K (1825) - Files rejected: 1.71K (1707) - Files total: 1.82K (1825) - RowGroups processed: 76.31K (76314) - RowGroups rejected: 0 (0) - RowGroups total: 76.31K (76314) - Rows processed: 1.93M (1933312) - Rows rejected: 0 (0) - Rows total: 78.18M (78176684) - Splits processed: 118 (118) - Splits rejected: 0 (0) - Splits total: 118 (118) Instance 7f40dcb034de70b7:d5 (host=va1031.foo:22000):(Total: 9m12s, non-child: 8m50s, % non-child: 96.08%) Hdfs split stats (:<# splits>/): 5:228/14.07 GB 3:222/12.16 GB 0:230/13.48 GB 7:241/14.15 GB 1:219/13.14 GB 2:225/12.87 GB 4:225/13.16 GB 6:218/12.63 GB Filter 6 arrival: 812ms Filter 2 arrival: 13s137ms Filter 5 arrival: 16s680ms MemoryUsage(16s000ms): 35.40 MB, 66.24 MB, 66.76 MB, 66.63 MB, 66.81 MB, 66.82 MB, 66.50 MB, 66.85 MB, 66.52 MB, 66.75 MB, 66.85 MB, 66.34 MB, 66.77 MB, 66.81 MB, 66.53 MB, 65.81 MB, 65.76 MB, 66.19 MB, 66.81 MB, 66.86 MB, 66.42 MB, 66.72 MB, 66.76 MB, 66.50 MB, 66.80 MB, 66.82 MB, 66.87 MB, 66.72 MB, 63.27 MB, 60.04 MB, 60.16 MB, 60.20 MB, 60.01 MB, 56.04 MB ThreadUsage(16s000ms): 12, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.90 - BloomFilterBytes: 33.00 MB (34603008) - PeakMemoryUsage: 67.53 MB (70805667) - PerHostPeakMemUsage: 161.65 GB (173568495375) - RowsProduced: 77.43M (77432271) - TotalNetworkReceiveTime: 575.635ms - TotalNetworkSendTime: 8m44s - TotalStorageWaitTime: 13s237ms - TotalThreadsInvoluntaryContextSwitches: 35.62K (35619) - TotalThreadsTotalWallClockTime: 1h58m - TotalThreadsSysTime: 1m51s - TotalThreadsUserTime: 3m27s - TotalThreadsVoluntaryContextSwitches: 12.17M (12167924) Fragment Instance Lifecycle Timings: - ExecTime: 9m11s - ExecTreeExecTime: 3s761ms - OpenTime: 1s105ms - ExecTreeOpenTime: 917.563ms - PrepareTime: 53.418ms - ExecTreePrepareTime: 7.130ms DataStreamSender (dst_id=22):(Total: 16s774ms, non-child: 16s774ms, % non-child: 100.00%) - BytesSent: 718.07 MB (752948552) - NetworkThroughput(*): 76.70 MB/sec - OverallThroughput: 42.81 MB/sec - PeakMemoryUsage: 4.94 MB (5183232) - RowsReturned: 77.43M (77432271) - SerializeBatchTime: 7s393ms - TransmitDataRPCTime: 9s361ms - UncompressedRowBatchSize: 2.16 GB (2323801226) CodeGen:(Total: 207.141ms, non-child: 207.141ms, % non-child: 100.00%) - CodegenTime: 1.118ms - CompileTime: 53.611ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 132.383ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 20.641ms HASH_JOIN_NODE (id=5):(Total: 4s647ms, non-child: 3s274ms, % non-child: 70.45%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.457ms - PeakMemoryUsage: 1.24 MB (1295583) - ProbeRows: 77.43M (77432271) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3s107ms - RowsReturned: 77.43M (77432271) - RowsReturnedRate: 16.66 M/sec Hash Join Builder (join_node_id=5): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 22.445us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 147.633us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 56.083us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 575.647ms, non-child: 19.861us, % non-child: 0.00%) BytesReceived(16s000ms): 963.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 4.821us - DeserializeRowBatchTimer: 51.408us - FirstBatchArrivalWaitTime: 527.081ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 208.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=3):(Total: 798.304ms, non-child: 798.304ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:228/14.07 GB 3:222/12.16 GB 0:230/13.48 GB 7:241/14.15 GB 1:219/13.14 GB 2:225/12.87 GB 4:225/13.16 GB 6:218/12.63 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 117 out of 117 Runtime filters: Only following filters arrived: 6, waited 221ms Hdfs Read Thread Concurrency Bucket: 0:98.62% 1:1.193% 2:0.09174% 3:0.09174% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1691 PARQUET/SNAPPY:117 BytesRead(16s000ms): 13.81 MB, 14.73 MB, 14.80 MB, 20.98 MB, 29.25 MB, 29.80 MB, 40.85 MB, 44.30 MB, 45.28 MB, 58.68 MB, 59.05 MB, 61.54 MB, 73.65 MB, 73.85 MB, 78.44 MB, 88.03 MB, 88.55 MB, 95.79 MB, 102.66 MB, 103.29 MB, 111.42 MB, 117.20 MB, 117.32 MB, 119.13 MB, 130.59 MB, 131.84 MB, 132.30 MB, 133.79 MB, 142.36 MB, 142.77 MB, 142.77 MB, 142.77 MB, 142.77 MB, 142.77 MB - FooterProcessingTime: (Avg: 61.688ms ; Min: 3.783ms ; Max: 203.277ms ; Number of samples: 117) - AverageHdfsReadThreadConcurrency: 0.02 - AverageScannerThreadConcurrency: 11.98 - BytesRead: 142.77 MB (149708445) - BytesReadDataNodeCache: 0 - BytesReadLocal: 142.77 MB (149708445) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 142.77 MB (149708445) - DecompressionTime: 1s084ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 117 (117) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 29.42 MB (30847233) - PerReadThreadRawHdfsThroughput: 21.27 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 112.376ms - RowBatchQueuePutWaitTime: 1h44m - RowsRead: 77.57M (77572214) - RowsReturned: 77.43M (77432271) - RowsReturnedRate: 97.00 M/sec - ScanRangesComplete: 1.81K (1808) - ScannerThreadsInvoluntaryContextSwitches: 30.52K (30516) - ScannerThreadsTotalWallClockTime: 1h49m - MaterializeTupleTime(*): 6s789ms - ScannerThreadsSysTime: 1m50s - ScannerThreadsUserTime: 3m3s - ScannerThreadsVoluntaryContextSwitches: 12.16M (12164766) - TotalRawHdfsReadTime(*): 6s712ms - TotalReadThroughput: 268.26 KB/sec Filter 2 (16.00 MB): - Rows processed: 2.03M (2030240) - Rows rejected: 139.89K (139894) - Rows total: 77.57M (77572214) Filter 5 (16.00 MB): - Rows processed: 1.89M (1890353) - Rows rejected: 49 (49) - Rows total: 77.43M (77432320) Filter 6 (1.00 MB): - Files processed: 1.81K (1808) - Files rejected: 1.69K (1691) - Files total: 1.81K (1808) - RowGroups processed: 75.60K (75597) - RowGroups rejected: 0 (0) - RowGroups total: 75.60K (75597) - Rows processed: 1.92M (1916928) - Rows rejected: 0 (0) - Rows total: 77.43M (77432271) - Splits processed: 117 (117) - Splits rejected: 0 (0) - Splits total: 117 (117) Instance 7f40dcb034de70b7:e4 (host=vd1111.foo:22000):(Total: 9m12s, non-child: 8m51s, % non-child: 96.28%) Hdfs split stats (:<# splits>/): 5:226/13.13 GB 6:222/13.17 GB 3:227/13.78 GB 0:215/12.73 GB 4:222/12.93 GB 2:232/13.67 GB 1:236/13.10 GB 7:238/13.16 GB Filter 6 arrival: 709ms Filter 2 arrival: 13s397ms Filter 5 arrival: 16s887ms MemoryUsage(16s000ms): 34.74 MB, 66.28 MB, 66.77 MB, 66.29 MB, 65.75 MB, 65.63 MB, 64.65 MB, 64.78 MB, 65.21 MB, 66.76 MB, 66.80 MB, 66.36 MB, 65.75 MB, 65.82 MB, 66.24 MB, 66.86 MB, 66.55 MB, 65.74 MB, 65.77 MB, 65.58 MB, 65.82 MB, 65.80 MB, 65.81 MB, 65.57 MB, 65.97 MB, 65.86 MB, 65.80 MB, 65.91 MB, 64.39 MB, 64.61 MB, 64.50 MB, 64.62 MB, 64.60 MB, 63.58 MB ThreadUsage(16s000ms): 12, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.90 - BloomFilterBytes: 33.00 MB (34603008) - PeakMemoryUsage: 67.44 MB (70715382) - PerHostPeakMemUsage: 161.67 GB (173592290419) - RowsProduced: 78.94M (78937208) - TotalNetworkReceiveTime: 487.524ms - TotalNetworkSendTime: 8m48s - TotalStorageWaitTime: 12s335ms - TotalThreadsInvoluntaryContextSwitches: 18.04K (18040) - TotalThreadsTotalWallClockTime: 1h58m - TotalThreadsSysTime: 2s333ms - TotalThreadsUserTime: 2m17s - TotalThreadsVoluntaryContextSwitches: 413.89K (413891) Fragment Instance Lifecycle Timings: - ExecTime: 9m11s - ExecTreeExecTime: 3s630ms - OpenTime: 1s114ms - ExecTreeOpenTime: 933.399ms - PrepareTime: 45.122ms - ExecTreePrepareTime: 5.941ms DataStreamSender (dst_id=22):(Total: 15s840ms, non-child: 15s840ms, % non-child: 100.00%) - BytesSent: 728.60 MB (763997351) - NetworkThroughput(*): 78.81 MB/sec - OverallThroughput: 46.00 MB/sec - PeakMemoryUsage: 4.94 MB (5175040) - RowsReturned: 78.94M (78937208) - SerializeBatchTime: 6s577ms - TransmitDataRPCTime: 9s244ms - UncompressedRowBatchSize: 2.21 GB (2368965528) CodeGen:(Total: 197.881ms, non-child: 197.881ms, % non-child: 100.00%) - CodegenTime: 1.027ms - CompileTime: 55.069ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 123.969ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 18.439ms HASH_JOIN_NODE (id=5):(Total: 4s534ms, non-child: 3s097ms, % non-child: 68.32%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.635ms - PeakMemoryUsage: 1.23 MB (1291576) - ProbeRows: 78.94M (78937208) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 2s947ms - RowsReturned: 78.94M (78937208) - RowsReturnedRate: 17.41 M/sec Hash Join Builder (join_node_id=5): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 27.380us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 183.561us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 58.127us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 487.535ms, non-child: 21.335us, % non-child: 0.00%) BytesReceived(16s000ms): 963.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 6.261us - DeserializeRowBatchTimer: 13.227us - FirstBatchArrivalWaitTime: 476.795ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 246.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=3):(Total: 949.610ms, non-child: 949.610ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:226/13.13 GB 6:222/13.17 GB 3:227/13.78 GB 0:215/12.73 GB 4:222/12.93 GB 2:232/13.67 GB 1:236/13.10 GB 7:238/13.16 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 119 out of 119 Runtime filters: Only following filters arrived: 6, waited 321ms Hdfs Read Thread Concurrency Bucket: 0:98.72% 1:1.189% 2:0.09149% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1699 PARQUET/SNAPPY:119 BytesRead(16s000ms): 13.24 MB, 14.12 MB, 14.12 MB, 20.06 MB, 28.49 MB, 28.66 MB, 38.24 MB, 42.65 MB, 44.61 MB, 57.16 MB, 57.20 MB, 62.16 MB, 71.35 MB, 71.43 MB, 79.79 MB, 86.15 MB, 87.74 MB, 100.16 MB, 100.46 MB, 103.82 MB, 114.40 MB, 114.84 MB, 114.87 MB, 124.91 MB, 129.07 MB, 129.07 MB, 129.32 MB, 137.73 MB, 142.29 MB, 142.29 MB, 142.29 MB, 142.29 MB, 142.29 MB, 142.29 MB - FooterProcessingTime: (Avg: 55.058ms ; Min: 4.201ms ; Max: 144.063ms ; Number of samples: 119) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 11.98 - BytesRead: 142.29 MB (149203687) - BytesReadDataNodeCache: 0 - BytesReadLocal: 142.29 MB (149203687) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 142.29 MB (149203687) - DecompressionTime: 761.647ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 119 (119) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 29.26 MB (30685470) - PerReadThreadRawHdfsThroughput: 22.61 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 116.527ms - RowBatchQueuePutWaitTime: 1h47m - RowsRead: 79.08M (79083362) - RowsReturned: 78.94M (78937208) - RowsReturnedRate: 83.13 M/sec - ScanRangesComplete: 1.82K (1818) - ScannerThreadsInvoluntaryContextSwitches: 13.40K (13399) - ScannerThreadsTotalWallClockTime: 1h49m - MaterializeTupleTime(*): 5s448ms - ScannerThreadsSysTime: 1s671ms - ScannerThreadsUserTime: 1m57s - ScannerThreadsVoluntaryContextSwitches: 410.74K (410736) - TotalRawHdfsReadTime(*): 6s292ms - TotalReadThroughput: 266.62 KB/sec Filter 2 (16.00 MB): - Rows processed: 2.07M (2074346) - Rows rejected: 146.15K (146148) - Rows total: 79.08M (79083362) Filter 5 (16.00 MB): - Rows processed: 1.86M (1862662) - Rows rejected: 6 (6) - Rows total: 78.94M (78937214) Filter 6 (1.00 MB): - Files processed: 1.82K (1818) - Files rejected: 1.70K (1699) - Files total: 1.82K (1818) - RowGroups processed: 77.06K (77056) - RowGroups rejected: 0 (0) - RowGroups total: 77.06K (77056) - Rows processed: 1.95M (1949696) - Rows rejected: 0 (0) - Rows total: 78.94M (78937208) - Splits processed: 119 (119) - Splits rejected: 0 (0) - Splits total: 119 (119) Instance 7f40dcb034de70b7:a5 (host=vc1502.foo:22000):(Total: 9m7s, non-child: 8m45s, % non-child: 96.08%) Hdfs split stats (:<# splits>/): 3:219/12.20 GB 1:242/14.70 GB 6:220/13.57 GB 4:220/11.62 GB 2:236/13.70 GB 5:216/13.60 GB 7:225/12.67 GB 0:248/13.61 GB Filter 6 arrival: 1s007ms Filter 2 arrival: 12s223ms Filter 5 arrival: 16s173ms MemoryUsage(16s000ms): 35.31 MB, 66.29 MB, 66.79 MB, 66.59 MB, 66.79 MB, 66.79 MB, 65.75 MB, 65.10 MB, 64.81 MB, 63.80 MB, 64.59 MB, 64.34 MB, 65.70 MB, 66.15 MB, 66.65 MB, 66.79 MB, 66.75 MB, 66.73 MB, 66.75 MB, 66.38 MB, 66.79 MB, 66.75 MB, 66.76 MB, 66.77 MB, 66.70 MB, 66.75 MB, 66.73 MB, 66.61 MB, 62.39 MB, 62.29 MB, 62.36 MB, 60.29 MB, 59.93 MB, 48.70 MB ThreadUsage(16s000ms): 12, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 8 - AverageThreadTokens: 12.86 - BloomFilterBytes: 33.00 MB (34603008) - PeakMemoryUsage: 67.56 MB (70840681) - PerHostPeakMemUsage: 161.67 GB (173592417503) - RowsProduced: 78.22M (78217289) - TotalNetworkReceiveTime: 783.429ms - TotalNetworkSendTime: 8m42s - TotalStorageWaitTime: 12s759ms - TotalThreadsInvoluntaryContextSwitches: 30.45K (30454) - TotalThreadsTotalWallClockTime: 1h57m - TotalThreadsSysTime: 1m28s - TotalThreadsUserTime: 2m56s - TotalThreadsVoluntaryContextSwitches: 7.08M (7081701) Fragment Instance Lifecycle Timings: - ExecTime: 9m5s - ExecTreeExecTime: 3s679ms - OpenTime: 1s111ms - ExecTreeOpenTime: 933.421ms - PrepareTime: 49.661ms - ExecTreePrepareTime: 6.288ms DataStreamSender (dst_id=22):(Total: 16s683ms, non-child: 16s683ms, % non-child: 100.00%) - BytesSent: 724.71 MB (759916454) - NetworkThroughput(*): 74.64 MB/sec - OverallThroughput: 43.44 MB/sec - PeakMemoryUsage: 4.89 MB (5125888) - RowsReturned: 78.22M (78217289) - SerializeBatchTime: 6s954ms - TransmitDataRPCTime: 9s709ms - UncompressedRowBatchSize: 2.19 GB (2347360246) CodeGen:(Total: 198.705ms, non-child: 198.705ms, % non-child: 100.00%) - CodegenTime: 1.012ms - CompileTime: 54.781ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 121.582ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 21.978ms HASH_JOIN_NODE (id=5):(Total: 4s578ms, non-child: 3s184ms, % non-child: 69.56%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.547ms - PeakMemoryUsage: 1.23 MB (1292934) - ProbeRows: 78.22M (78217289) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3s017ms - RowsReturned: 78.22M (78217289) - RowsReturnedRate: 17.08 M/sec Hash Join Builder (join_node_id=5): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 28.001us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 142.638us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 58.529us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 783.440ms, non-child: 21.310us, % non-child: 0.00%) BytesReceived(16s000ms): 932.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 5.252us - DeserializeRowBatchTimer: 27.202us - FirstBatchArrivalWaitTime: 750.812ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 153.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=3):(Total: 610.823ms, non-child: 610.823ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:219/12.20 GB 1:242/14.70 GB 6:220/13.57 GB 4:220/11.62 GB 2:236/13.70 GB 5:216/13.60 GB 7:225/12.67 GB 0:248/13.61 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 118 out of 118 Runtime filters: Only following filters arrived: 6, waited 40ms Hdfs Read Thread Concurrency Bucket: 0:99.16% 1:0.7428% 2:0% 3:0.09285% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1708 PARQUET/SNAPPY:118 BytesRead(16s000ms): 13.18 MB, 14.52 MB, 15.57 MB, 21.76 MB, 29.45 MB, 30.88 MB, 41.57 MB, 44.44 MB, 48.64 MB, 57.92 MB, 58.87 MB, 64.43 MB, 72.34 MB, 74.07 MB, 82.69 MB, 87.21 MB, 89.10 MB, 100.38 MB, 102.07 MB, 104.32 MB, 115.90 MB, 116.17 MB, 117.52 MB, 121.12 MB, 130.47 MB, 130.66 MB, 132.11 MB, 134.49 MB, 142.90 MB, 142.90 MB, 142.90 MB, 142.90 MB, 142.90 MB - FooterProcessingTime: (Avg: 59.129ms ; Min: 27.011ms ; Max: 158.591ms ; Number of samples: 118) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 11.98 - BytesRead: 142.90 MB (149837604) - BytesReadDataNodeCache: 0 - BytesReadLocal: 142.90 MB (149837604) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 142.90 MB (149837604) - DecompressionTime: 1s023ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 118 (118) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 29.41 MB (30834855) - PerReadThreadRawHdfsThroughput: 23.37 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 102.179ms - RowBatchQueuePutWaitTime: 1h43m - RowsRead: 78.36M (78357027) - RowsReturned: 78.22M (78217289) - RowsReturnedRate: 128.05 M/sec - ScanRangesComplete: 1.83K (1826) - ScannerThreadsInvoluntaryContextSwitches: 25.66K (25660) - ScannerThreadsTotalWallClockTime: 1h48m - MaterializeTupleTime(*): 6s543ms - ScannerThreadsSysTime: 1m27s - ScannerThreadsUserTime: 2m35s - ScannerThreadsVoluntaryContextSwitches: 7.08M (7078588) - TotalRawHdfsReadTime(*): 6s113ms - TotalReadThroughput: 271.48 KB/sec Filter 2 (16.00 MB): - Rows processed: 2.00M (1996250) - Rows rejected: 139.71K (139708) - Rows total: 78.36M (78357027) Filter 5 (16.00 MB): - Rows processed: 1.82M (1816606) - Rows rejected: 30 (30) - Rows total: 78.22M (78217319) Filter 6 (1.00 MB): - Files processed: 1.83K (1826) - Files rejected: 1.71K (1708) - Files total: 1.83K (1826) - RowGroups processed: 76.36K (76362) - RowGroups rejected: 0 (0) - RowGroups total: 76.36K (76362) - Rows processed: 1.93M (1933312) - Rows rejected: 0 (0) - Rows total: 78.22M (78217289) - Splits processed: 118 (118) - Splits rejected: 0 (0) - Splits total: 118 (118) Instance 7f40dcb034de70b7:aa (host=vc1538.foo:22000):(Total: 9m6s, non-child: 8m45s, % non-child: 96.10%) Hdfs split stats (:<# splits>/): 1:208/11.51 GB 4:239/14.28 GB 0:237/13.81 GB 3:219/13.08 GB 2:239/13.53 GB 5:227/13.57 GB 6:215/12.67 GB 7:224/13.21 GB Filter 6 arrival: 1s009ms Filter 2 arrival: 12s434ms Filter 5 arrival: 16s185ms MemoryUsage(16s000ms): 34.65 MB, 64.77 MB, 64.79 MB, 65.96 MB, 66.82 MB, 66.76 MB, 66.67 MB, 66.82 MB, 66.24 MB, 66.05 MB, 66.80 MB, 66.61 MB, 66.78 MB, 66.60 MB, 66.84 MB, 66.82 MB, 66.52 MB, 66.01 MB, 65.78 MB, 65.64 MB, 66.59 MB, 66.77 MB, 66.77 MB, 65.76 MB, 65.86 MB, 65.81 MB, 65.80 MB, 65.68 MB, 61.82 MB, 61.07 MB, 59.06 MB, 59.10 MB, 58.92 MB ThreadUsage(16s000ms): 12, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.85 - BloomFilterBytes: 33.00 MB (34603008) - PeakMemoryUsage: 67.54 MB (70820627) - PerHostPeakMemUsage: 161.68 GB (173598360576) - RowsProduced: 77.66M (77664020) - TotalNetworkReceiveTime: 791.216ms - TotalNetworkSendTime: 8m41s - TotalStorageWaitTime: 13s172ms - TotalThreadsInvoluntaryContextSwitches: 32.87K (32868) - TotalThreadsTotalWallClockTime: 1h57m - TotalThreadsSysTime: 1m36s - TotalThreadsUserTime: 3m7s - TotalThreadsVoluntaryContextSwitches: 8.62M (8621822) Fragment Instance Lifecycle Timings: - ExecTime: 9m5s - ExecTreeExecTime: 3s736ms - OpenTime: 1s143ms - ExecTreeOpenTime: 966.487ms - PrepareTime: 44.099ms - ExecTreePrepareTime: 5.760ms DataStreamSender (dst_id=22):(Total: 16s460ms, non-child: 16s460ms, % non-child: 100.00%) - BytesSent: 718.05 MB (752924937) - NetworkThroughput(*): 75.30 MB/sec - OverallThroughput: 43.62 MB/sec - PeakMemoryUsage: 5.07 MB (5314304) - RowsReturned: 77.66M (77664020) - SerializeBatchTime: 6s906ms - TransmitDataRPCTime: 9s535ms - UncompressedRowBatchSize: 2.17 GB (2330756232) CodeGen:(Total: 193.485ms, non-child: 193.485ms, % non-child: 100.00%) - CodegenTime: 974.926us - CompileTime: 55.155ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 120.899ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 17.029ms HASH_JOIN_NODE (id=5):(Total: 4s669ms, non-child: 3s242ms, % non-child: 69.44%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.444ms - PeakMemoryUsage: 1.24 MB (1298303) - ProbeRows: 77.66M (77664020) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3s090ms - RowsReturned: 77.66M (77664020) - RowsReturnedRate: 16.63 M/sec Hash Join Builder (join_node_id=5): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 29.602us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 157.392us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 64.278us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 791.227ms, non-child: 19.068us, % non-child: 0.00%) BytesReceived(16s000ms): 932.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 5.265us - DeserializeRowBatchTimer: 19.659us - FirstBatchArrivalWaitTime: 748.194ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 151.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=3):(Total: 636.070ms, non-child: 636.070ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:208/11.51 GB 4:239/14.28 GB 0:237/13.81 GB 3:219/13.08 GB 2:239/13.53 GB 5:227/13.57 GB 6:215/12.67 GB 7:224/13.21 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 118 out of 118 Runtime filters: Only following filters arrived: 6, waited 40ms Hdfs Read Thread Concurrency Bucket: 0:99.07% 1:0.9302% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1690 PARQUET/SNAPPY:118 BytesRead(16s000ms): 13.28 MB, 14.16 MB, 14.20 MB, 21.18 MB, 28.70 MB, 29.80 MB, 40.34 MB, 43.16 MB, 46.84 MB, 57.76 MB, 58.48 MB, 64.63 MB, 72.81 MB, 74.14 MB, 81.96 MB, 87.66 MB, 89.28 MB, 99.36 MB, 102.00 MB, 104.40 MB, 114.86 MB, 116.34 MB, 116.75 MB, 121.93 MB, 130.07 MB, 130.98 MB, 131.40 MB, 135.61 MB, 141.81 MB, 141.88 MB, 141.88 MB, 141.88 MB, 141.88 MB - FooterProcessingTime: (Avg: 61.133ms ; Min: 23.076ms ; Max: 209.576ms ; Number of samples: 118) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 11.97 - BytesRead: 141.88 MB (148774049) - BytesReadDataNodeCache: 0 - BytesReadLocal: 141.88 MB (148774049) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 141.88 MB (148774049) - DecompressionTime: 930.764ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 118 (118) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 29.25 MB (30674605) - PerReadThreadRawHdfsThroughput: 20.70 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 128.594ms - RowBatchQueuePutWaitTime: 1h43m - RowsRead: 77.80M (77803750) - RowsReturned: 77.66M (77664020) - RowsReturnedRate: 122.10 M/sec - ScanRangesComplete: 1.81K (1808) - ScannerThreadsInvoluntaryContextSwitches: 28.12K (28122) - ScannerThreadsTotalWallClockTime: 1h47m - MaterializeTupleTime(*): 6s196ms - ScannerThreadsSysTime: 1m35s - ScannerThreadsUserTime: 2m46s - ScannerThreadsVoluntaryContextSwitches: 8.62M (8618675) - TotalRawHdfsReadTime(*): 6s854ms - TotalReadThroughput: 270.30 KB/sec Filter 2 (16.00 MB): - Rows processed: 2.02M (2015698) - Rows rejected: 139.67K (139667) - Rows total: 77.80M (77803750) Filter 5 (16.00 MB): - Rows processed: 1.84M (1842239) - Rows rejected: 63 (63) - Rows total: 77.66M (77664083) Filter 6 (1.00 MB): - Files processed: 1.81K (1808) - Files rejected: 1.69K (1690) - Files total: 1.81K (1808) - RowGroups processed: 75.81K (75813) - RowGroups rejected: 0 (0) - RowGroups total: 75.81K (75813) - Rows processed: 1.93M (1933312) - Rows rejected: 0 (0) - Rows total: 77.66M (77664020) - Splits processed: 118 (118) - Splits rejected: 0 (0) - Splits total: 118 (118) Instance 7f40dcb034de70b7:ae (host=vd1127.foo:22000):(Total: 9m6s, non-child: 8m45s, % non-child: 96.08%) Hdfs split stats (:<# splits>/): 4:222/13.21 GB 7:213/11.94 GB 2:227/13.52 GB 3:230/14.08 GB 1:212/12.43 GB 6:223/12.87 GB 5:231/13.12 GB 0:255/14.51 GB Filter 6 arrival: 959ms Filter 2 arrival: 12s439ms Filter 5 arrival: 16s270ms MemoryUsage(16s000ms): 35.24 MB, 66.80 MB, 66.84 MB, 65.74 MB, 66.45 MB, 66.65 MB, 65.72 MB, 65.82 MB, 65.96 MB, 66.75 MB, 66.89 MB, 66.60 MB, 66.74 MB, 66.82 MB, 66.00 MB, 65.71 MB, 65.77 MB, 64.95 MB, 64.81 MB, 64.75 MB, 66.44 MB, 66.80 MB, 66.77 MB, 66.20 MB, 66.77 MB, 66.83 MB, 66.75 MB, 66.22 MB, 59.92 MB, 58.02 MB, 58.13 MB, 58.12 MB, 58.02 MB, 47.55 MB ThreadUsage(16s000ms): 12, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 8 - AverageThreadTokens: 12.85 - BloomFilterBytes: 33.00 MB (34603008) - PeakMemoryUsage: 67.55 MB (70835388) - PerHostPeakMemUsage: 161.67 GB (173591732658) - RowsProduced: 77.65M (77650170) - TotalNetworkReceiveTime: 706.720ms - TotalNetworkSendTime: 8m38s - TotalStorageWaitTime: 12s877ms - TotalThreadsInvoluntaryContextSwitches: 32.90K (32904) - TotalThreadsTotalWallClockTime: 1h57m - TotalThreadsSysTime: 1m43s - TotalThreadsUserTime: 3m9s - TotalThreadsVoluntaryContextSwitches: 10.71M (10713404) Fragment Instance Lifecycle Timings: - ExecTime: 9m5s - ExecTreeExecTime: 3s655ms - OpenTime: 1s157ms - ExecTreeOpenTime: 962.068ms - PrepareTime: 62.772ms - ExecTreePrepareTime: 7.772ms DataStreamSender (dst_id=22):(Total: 16s638ms, non-child: 16s638ms, % non-child: 100.00%) - BytesSent: 719.80 MB (754765798) - NetworkThroughput(*): 77.24 MB/sec - OverallThroughput: 43.26 MB/sec - PeakMemoryUsage: 5.05 MB (5297920) - RowsReturned: 77.65M (77650170) - SerializeBatchTime: 7s296ms - TransmitDataRPCTime: 9s319ms - UncompressedRowBatchSize: 2.17 GB (2330340588) CodeGen:(Total: 218.447ms, non-child: 218.447ms, % non-child: 100.00%) - CodegenTime: 1.229ms - CompileTime: 58.985ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 134.006ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 24.948ms HASH_JOIN_NODE (id=5):(Total: 4s583ms, non-child: 3s172ms, % non-child: 69.22%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.458ms - PeakMemoryUsage: 1.23 MB (1293077) - ProbeRows: 77.65M (77650170) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3s005ms - RowsReturned: 77.65M (77650170) - RowsReturnedRate: 16.94 M/sec Hash Join Builder (join_node_id=5): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 30.390us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 156.066us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 59.821us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 706.730ms, non-child: 20.782us, % non-child: 0.00%) BytesReceived(16s000ms): 932.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 3.939us - DeserializeRowBatchTimer: 16.062us - FirstBatchArrivalWaitTime: 671.370ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 169.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=3):(Total: 704.784ms, non-child: 704.784ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:222/13.21 GB 7:213/11.94 GB 2:227/13.52 GB 3:230/14.08 GB 1:212/12.43 GB 6:223/12.87 GB 5:231/13.12 GB 0:255/14.51 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 118 out of 118 Runtime filters: Only following filters arrived: 6, waited 61ms Hdfs Read Thread Concurrency Bucket: 0:98.7% 1:0.7428% 2:0.2786% 3:0.09285% 4:0.09285% 5:0.09285% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1695 PARQUET/SNAPPY:118 BytesRead(16s000ms): 13.66 MB, 14.84 MB, 14.84 MB, 20.62 MB, 29.67 MB, 30.07 MB, 39.83 MB, 44.30 MB, 46.02 MB, 58.28 MB, 58.91 MB, 61.84 MB, 73.44 MB, 73.81 MB, 79.81 MB, 88.25 MB, 88.72 MB, 98.73 MB, 102.78 MB, 103.50 MB, 114.69 MB, 117.20 MB, 117.20 MB, 121.75 MB, 131.95 MB, 131.95 MB, 132.02 MB, 135.96 MB, 142.48 MB, 142.59 MB, 142.59 MB, 142.59 MB, 142.59 MB - FooterProcessingTime: (Avg: 63.340ms ; Min: 23.045ms ; Max: 230.330ms ; Number of samples: 118) - AverageHdfsReadThreadConcurrency: 0.02 - AverageScannerThreadConcurrency: 11.97 - BytesRead: 142.59 MB (149519607) - BytesReadDataNodeCache: 0 - BytesReadLocal: 142.59 MB (149519607) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 142.59 MB (149519607) - DecompressionTime: 3s591ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 118 (118) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 29.42 MB (30852157) - PerReadThreadRawHdfsThroughput: 23.26 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 189.156ms - RowBatchQueuePutWaitTime: 1h42m - RowsRead: 77.79M (77791943) - RowsReturned: 77.65M (77650170) - RowsReturnedRate: 110.18 M/sec - ScanRangesComplete: 1.81K (1813) - ScannerThreadsInvoluntaryContextSwitches: 27.81K (27810) - ScannerThreadsTotalWallClockTime: 1h48m - MaterializeTupleTime(*): 6s675ms - ScannerThreadsSysTime: 1m43s - ScannerThreadsUserTime: 2m45s - ScannerThreadsVoluntaryContextSwitches: 10.71M (10710253) - TotalRawHdfsReadTime(*): 6s129ms - TotalReadThroughput: 271.15 KB/sec Filter 2 (16.00 MB): - Rows processed: 2.02M (2018765) - Rows rejected: 141.73K (141732) - Rows total: 77.79M (77791943) Filter 5 (16.00 MB): - Rows processed: 1.82M (1822761) - Rows rejected: 41 (41) - Rows total: 77.65M (77650211) Filter 6 (1.00 MB): - Files processed: 1.81K (1813) - Files rejected: 1.70K (1695) - Files total: 1.81K (1813) - RowGroups processed: 75.80K (75801) - RowGroups rejected: 0 (0) - RowGroups total: 75.80K (75801) - Rows processed: 1.93M (1933312) - Rows rejected: 0 (0) - Rows total: 77.65M (77650170) - Splits processed: 118 (118) - Splits rejected: 0 (0) - Splits total: 118 (118) Instance 7f40dcb034de70b7:9d (host=va1046.foo:22000):(Total: 9m6s, non-child: 8m45s, % non-child: 96.22%) Hdfs split stats (:<# splits>/): 0:230/12.82 GB 3:216/13.19 GB 1:222/12.63 GB 2:213/12.56 GB 6:229/13.17 GB 5:241/14.04 GB 7:214/12.65 GB 4:250/14.58 GB Filter 6 arrival: 1s056ms Filter 2 arrival: 11s978ms Filter 5 arrival: 16s086ms MemoryUsage(16s000ms): 35.18 MB, 65.72 MB, 65.28 MB, 64.93 MB, 65.79 MB, 66.58 MB, 66.62 MB, 66.78 MB, 66.81 MB, 66.61 MB, 66.74 MB, 66.53 MB, 66.67 MB, 66.83 MB, 66.47 MB, 65.72 MB, 65.80 MB, 66.04 MB, 66.76 MB, 66.82 MB, 65.38 MB, 65.82 MB, 65.83 MB, 65.69 MB, 66.81 MB, 66.70 MB, 66.78 MB, 66.79 MB, 66.71 MB, 65.60 MB, 60.67 MB, 53.41 MB, 53.23 MB, 43.45 MB ThreadUsage(16s000ms): 12, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 7 - AverageThreadTokens: 12.83 - BloomFilterBytes: 33.00 MB (34603008) - PeakMemoryUsage: 67.43 MB (70700841) - PerHostPeakMemUsage: 161.66 GB (173585881879) - RowsProduced: 75.62M (75617836) - TotalNetworkReceiveTime: 841.757ms - TotalNetworkSendTime: 8m41s - TotalStorageWaitTime: 11s992ms - TotalThreadsInvoluntaryContextSwitches: 36.21K (36214) - TotalThreadsTotalWallClockTime: 1h56m - TotalThreadsSysTime: 3m23s - TotalThreadsUserTime: 1m49s - TotalThreadsVoluntaryContextSwitches: 11.15M (11147907) Fragment Instance Lifecycle Timings: - ExecTime: 9m5s - ExecTreeExecTime: 3s539ms - OpenTime: 1s194ms - ExecTreeOpenTime: 1s018ms - PrepareTime: 44.235ms - ExecTreePrepareTime: 6.761ms DataStreamSender (dst_id=22):(Total: 15s935ms, non-child: 15s935ms, % non-child: 100.00%) - BytesSent: 698.42 MB (732348648) - NetworkThroughput(*): 78.49 MB/sec - OverallThroughput: 43.83 MB/sec - PeakMemoryUsage: 4.94 MB (5183232) - RowsReturned: 75.62M (75617836) - SerializeBatchTime: 7s018ms - TransmitDataRPCTime: 8s897ms - UncompressedRowBatchSize: 2.11 GB (2269348704) CodeGen:(Total: 189.447ms, non-child: 189.447ms, % non-child: 100.00%) - CodegenTime: 946.946us - CompileTime: 52.721ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 121.335ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 14.994ms HASH_JOIN_NODE (id=5):(Total: 4s528ms, non-child: 3s097ms, % non-child: 68.40%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 704.491us - PeakMemoryUsage: 1.24 MB (1295933) - ProbeRows: 75.62M (75617836) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 2s931ms - RowsReturned: 75.62M (75617836) - RowsReturnedRate: 16.70 M/sec Hash Join Builder (join_node_id=5): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 23.654us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 60.035us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 41.763us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 841.763ms, non-child: 13.999us, % non-child: 0.00%) BytesReceived(16s000ms): 932.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 2.875us - DeserializeRowBatchTimer: 28.966us - FirstBatchArrivalWaitTime: 802.098ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 142.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=3):(Total: 589.714ms, non-child: 589.714ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:230/12.82 GB 3:216/13.19 GB 1:222/12.63 GB 2:213/12.56 GB 6:229/13.17 GB 5:241/14.04 GB 7:214/12.65 GB 4:250/14.58 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 114 out of 114 Runtime filters: Only following filters arrived: 6, waited 40ms Hdfs Read Thread Concurrency Bucket: 0:98.88% 1:0.9294% 2:0.09294% 3:0% 4:0.09294% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1701 PARQUET/SNAPPY:114 BytesRead(16s000ms): 12.85 MB, 14.07 MB, 14.55 MB, 22.07 MB, 28.49 MB, 30.05 MB, 40.43 MB, 43.33 MB, 45.57 MB, 56.82 MB, 57.98 MB, 60.38 MB, 71.75 MB, 72.90 MB, 76.25 MB, 86.67 MB, 87.33 MB, 93.99 MB, 101.20 MB, 101.85 MB, 106.98 MB, 115.26 MB, 115.61 MB, 117.18 MB, 124.23 MB, 129.75 MB, 129.83 MB, 131.00 MB, 132.10 MB, 133.40 MB, 137.03 MB, 137.03 MB, 137.03 MB - FooterProcessingTime: (Avg: 56.484ms ; Min: 4.275ms ; Max: 199.913ms ; Number of samples: 114) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 11.96 - BytesRead: 137.03 MB (143682651) - BytesReadDataNodeCache: 0 - BytesReadLocal: 137.03 MB (143682651) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 137.03 MB (143682651) - DecompressionTime: 991.325ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 114 (114) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 29.32 MB (30744146) - PerReadThreadRawHdfsThroughput: 21.64 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 131.651ms - RowBatchQueuePutWaitTime: 1h42m - RowsRead: 75.75M (75751329) - RowsReturned: 75.62M (75617836) - RowsReturnedRate: 128.23 M/sec - ScanRangesComplete: 1.81K (1815) - ScannerThreadsInvoluntaryContextSwitches: 31.30K (31298) - ScannerThreadsTotalWallClockTime: 1h47m - MaterializeTupleTime(*): 5s773ms - ScannerThreadsSysTime: 3m22s - ScannerThreadsUserTime: 1m26s - ScannerThreadsVoluntaryContextSwitches: 11.14M (11144861) - TotalRawHdfsReadTime(*): 6s332ms - TotalReadThroughput: 260.81 KB/sec Filter 2 (16.00 MB): - Rows processed: 1.92M (1918325) - Rows rejected: 133.46K (133462) - Rows total: 75.75M (75751329) Filter 5 (16.00 MB): - Rows processed: 1.78M (1782815) - Rows rejected: 31 (31) - Rows total: 75.62M (75617867) Filter 6 (1.00 MB): - Files processed: 1.81K (1815) - Files rejected: 1.70K (1701) - Files total: 1.81K (1815) - RowGroups processed: 73.82K (73817) - RowGroups rejected: 0 (0) - RowGroups total: 73.82K (73817) - Rows processed: 1.87M (1867776) - Rows rejected: 0 (0) - Rows total: 75.62M (75617836) - Splits processed: 114 (114) - Splits rejected: 0 (0) - Splits total: 114 (114) Instance 7f40dcb034de70b7:a1 (host=vc1511.foo:22000):(Total: 9m6s, non-child: 8m44s, % non-child: 95.92%) Hdfs split stats (:<# splits>/): 3:382/15.24 GB 1:366/16.02 GB 4:344/13.28 GB 5:376/15.44 GB 6:369/15.07 GB 0:401/16.54 GB 2:368/14.07 GB Filter 6 arrival: 990ms Filter 2 arrival: 12s103ms Filter 5 arrival: 16s086ms MemoryUsage(16s000ms): 29.41 MB, 63.92 MB, 66.80 MB, 64.25 MB, 58.56 MB, 63.50 MB, 63.58 MB, 65.85 MB, 66.72 MB, 65.85 MB, 62.37 MB, 64.17 MB, 65.69 MB, 64.32 MB, 64.45 MB, 62.18 MB, 62.60 MB, 65.31 MB, 63.48 MB, 63.69 MB, 63.06 MB, 65.41 MB, 62.66 MB, 65.39 MB, 63.48 MB, 64.89 MB, 65.35 MB, 63.32 MB, 66.34 MB, 65.16 MB, 64.66 MB, 59.98 MB, 57.66 MB, 47.82 MB ThreadUsage(16s000ms): 12, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 10 - AverageThreadTokens: 12.86 - BloomFilterBytes: 33.00 MB (34603008) - PeakMemoryUsage: 67.35 MB (70619172) - PerHostPeakMemUsage: 161.65 GB (173566246742) - RowsProduced: 77.07M (77069078) - TotalNetworkReceiveTime: 742.249ms - TotalNetworkSendTime: 8m38s - TotalStorageWaitTime: 14s414ms - TotalThreadsInvoluntaryContextSwitches: 28.18K (28184) - TotalThreadsTotalWallClockTime: 1h57m - TotalThreadsSysTime: 1m46s - TotalThreadsUserTime: 1m46s - TotalThreadsVoluntaryContextSwitches: 5.83M (5830591) Fragment Instance Lifecycle Timings: - ExecTime: 9m5s - ExecTreeExecTime: 3s883ms - OpenTime: 1s053ms - ExecTreeOpenTime: 860.855ms - PrepareTime: 59.703ms - ExecTreePrepareTime: 8.475ms DataStreamSender (dst_id=22):(Total: 17s352ms, non-child: 17s352ms, % non-child: 100.00%) - BytesSent: 712.56 MB (747171502) - NetworkThroughput(*): 73.20 MB/sec - OverallThroughput: 41.06 MB/sec - PeakMemoryUsage: 4.84 MB (5076736) - RowsReturned: 77.07M (77069078) - SerializeBatchTime: 7s596ms - TransmitDataRPCTime: 9s734ms - UncompressedRowBatchSize: 2.15 GB (2312901604) CodeGen:(Total: 216.526ms, non-child: 216.526ms, % non-child: 100.00%) - CodegenTime: 1.090ms - CompileTime: 59.627ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 131.310ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 25.149ms HASH_JOIN_NODE (id=5):(Total: 4s713ms, non-child: 3s367ms, % non-child: 71.44%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.540ms - PeakMemoryUsage: 1.23 MB (1288004) - ProbeRows: 77.07M (77069078) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3s225ms - RowsReturned: 77.07M (77069078) - RowsReturnedRate: 16.35 M/sec Hash Join Builder (join_node_id=5): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 28.809us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 161.870us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 54.209us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 742.266ms, non-child: 30.649us, % non-child: 0.00%) BytesReceived(16s000ms): 932.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 7.006us - DeserializeRowBatchTimer: 21.028us - FirstBatchArrivalWaitTime: 736.015ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 161.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=3):(Total: 604.579ms, non-child: 604.579ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:382/15.24 GB 1:366/16.02 GB 4:344/13.28 GB 5:376/15.44 GB 6:369/15.07 GB 0:401/16.54 GB 2:368/14.07 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 167 out of 167 Runtime filters: Only following filters arrived: 6, waited 40ms Hdfs Read Thread Concurrency Bucket: 0:98.89% 1:1.016% 2:0.09234% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:2439 PARQUET/SNAPPY:167 BytesRead(16s000ms): 11.06 MB, 15.10 MB, 17.11 MB, 19.93 MB, 27.23 MB, 33.06 MB, 37.44 MB, 45.39 MB, 49.70 MB, 54.23 MB, 60.18 MB, 65.65 MB, 70.77 MB, 75.62 MB, 79.90 MB, 85.05 MB, 92.45 MB, 97.91 MB, 101.48 MB, 108.06 MB, 112.75 MB, 116.40 MB, 119.02 MB, 125.96 MB, 128.07 MB, 132.07 MB, 134.46 MB, 138.66 MB, 142.16 MB, 142.78 MB, 143.17 MB, 144.59 MB, 144.59 MB - FooterProcessingTime: (Avg: 49.930ms ; Min: 4.685ms ; Max: 348.641ms ; Number of samples: 167) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 11.97 - BytesRead: 144.59 MB (151617135) - BytesReadDataNodeCache: 0 - BytesReadLocal: 144.59 MB (151617135) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 144.59 MB (151617135) - DecompressionTime: 1s287ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 7 (7) - NumRowGroups: 167 (167) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 29.17 MB (30582256) - PerReadThreadRawHdfsThroughput: 20.31 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 90.457ms - RowBatchQueuePutWaitTime: 1h44m - RowsRead: 77.26M (77264788) - RowsReturned: 77.07M (77069078) - RowsReturnedRate: 127.48 M/sec - ScanRangesComplete: 2.61K (2606) - ScannerThreadsInvoluntaryContextSwitches: 23.21K (23206) - ScannerThreadsTotalWallClockTime: 1h48m - MaterializeTupleTime(*): 6s999ms - ScannerThreadsSysTime: 1m45s - ScannerThreadsUserTime: 1m21s - ScannerThreadsVoluntaryContextSwitches: 5.83M (5827536) - TotalRawHdfsReadTime(*): 7s119ms - TotalReadThroughput: 273.43 KB/sec Filter 2 (16.00 MB): - Rows processed: 2.81M (2813981) - Rows rejected: 195.62K (195622) - Rows total: 77.26M (77264788) Filter 5 (16.00 MB): - Rows processed: 2.60M (2595831) - Rows rejected: 88 (88) - Rows total: 77.07M (77069166) Filter 6 (1.00 MB): - Files processed: 2.61K (2606) - Files rejected: 2.44K (2439) - Files total: 2.61K (2606) - RowGroups processed: 75.23K (75229) - RowGroups rejected: 0 (0) - RowGroups total: 75.23K (75229) - Rows processed: 2.74M (2736128) - Rows rejected: 0 (0) - Rows total: 77.07M (77069078) - Splits processed: 167 (167) - Splits rejected: 0 (0) - Splits total: 167 (167) Instance 7f40dcb034de70b7:e2 (host=vd1126.foo:22000):(Total: 9m6s, non-child: 8m44s, % non-child: 95.91%) Hdfs split stats (:<# splits>/): 2:226/13.87 GB 7:223/12.61 GB 4:234/14.04 GB 6:244/14.34 GB 3:238/13.11 GB 5:226/13.25 GB 0:205/12.04 GB 1:211/12.39 GB Filter 6 arrival: 717ms Filter 2 arrival: 13s299ms Filter 5 arrival: 16s869ms MemoryUsage(16s000ms): 34.71 MB, 64.82 MB, 65.79 MB, 65.86 MB, 65.76 MB, 65.79 MB, 65.65 MB, 65.85 MB, 65.75 MB, 66.24 MB, 66.82 MB, 66.75 MB, 66.61 MB, 66.81 MB, 66.82 MB, 66.83 MB, 66.79 MB, 66.65 MB, 66.81 MB, 66.82 MB, 65.92 MB, 65.74 MB, 65.81 MB, 65.82 MB, 66.25 MB, 66.82 MB, 66.85 MB, 66.83 MB, 66.83 MB, 62.86 MB, 55.63 MB, 55.59 MB, 55.64 MB ThreadUsage(16s000ms): 12, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.85 - BloomFilterBytes: 33.00 MB (34603008) - PeakMemoryUsage: 67.48 MB (70756365) - PerHostPeakMemUsage: 161.66 GB (173584377865) - RowsProduced: 76.23M (76225044) - TotalNetworkReceiveTime: 483.693ms - TotalNetworkSendTime: 8m38s - TotalStorageWaitTime: 12s880ms - TotalThreadsInvoluntaryContextSwitches: 35.48K (35476) - TotalThreadsTotalWallClockTime: 1h56m - TotalThreadsSysTime: 2m52s - TotalThreadsUserTime: 2m27s - TotalThreadsVoluntaryContextSwitches: 16.37M (16370426) Fragment Instance Lifecycle Timings: - ExecTime: 9m5s - ExecTreeExecTime: 4s340ms - OpenTime: 1s103ms - ExecTreeOpenTime: 923.186ms - PrepareTime: 58.662ms - ExecTreePrepareTime: 7.401ms DataStreamSender (dst_id=22):(Total: 16s910ms, non-child: 16s910ms, % non-child: 100.00%) - BytesSent: 710.25 MB (744749256) - NetworkThroughput(*): 75.67 MB/sec - OverallThroughput: 42.00 MB/sec - PeakMemoryUsage: 5.08 MB (5330688) - RowsReturned: 76.23M (76225044) - SerializeBatchTime: 7s503ms - TransmitDataRPCTime: 9s386ms - UncompressedRowBatchSize: 2.13 GB (2287571496) CodeGen:(Total: 203.190ms, non-child: 203.190ms, % non-child: 100.00%) - CodegenTime: 1.311ms - CompileTime: 50.935ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 127.115ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 24.615ms HASH_JOIN_NODE (id=5):(Total: 5s234ms, non-child: 3s249ms, % non-child: 62.08%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.537ms - PeakMemoryUsage: 1.23 MB (1291742) - ProbeRows: 76.23M (76225044) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3s082ms - RowsReturned: 76.23M (76225044) - RowsReturnedRate: 14.56 M/sec Hash Join Builder (join_node_id=5): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 27.323us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 145.426us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 62.346us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 483.704ms, non-child: 20.693us, % non-child: 0.00%) BytesReceived(16s000ms): 963.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 4.784us - DeserializeRowBatchTimer: 19.282us - FirstBatchArrivalWaitTime: 469.651ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 248.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=3):(Total: 1s501ms, non-child: 1s501ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:226/13.87 GB 7:223/12.61 GB 4:234/14.04 GB 6:244/14.34 GB 3:238/13.11 GB 5:226/13.25 GB 0:205/12.04 GB 1:211/12.39 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 115 out of 115 Runtime filters: Only following filters arrived: 6, waited 321ms Hdfs Read Thread Concurrency Bucket: 0:98.6% 1:1.116% 2:0.186% 3:0.09302% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1692 PARQUET/SNAPPY:115 BytesRead(16s000ms): 13.98 MB, 14.92 MB, 14.92 MB, 19.47 MB, 29.45 MB, 29.45 MB, 38.67 MB, 44.43 MB, 44.74 MB, 56.98 MB, 59.49 MB, 60.31 MB, 72.95 MB, 74.51 MB, 76.27 MB, 89.02 MB, 89.41 MB, 95.36 MB, 104.55 MB, 104.55 MB, 110.26 MB, 119.01 MB, 119.01 MB, 119.43 MB, 130.97 MB, 133.65 MB, 133.65 MB, 133.80 MB, 137.86 MB, 142.10 MB, 142.10 MB, 142.10 MB, 142.10 MB - FooterProcessingTime: (Avg: 56.576ms ; Min: 25.907ms ; Max: 139.844ms ; Number of samples: 115) - AverageHdfsReadThreadConcurrency: 0.02 - AverageScannerThreadConcurrency: 11.97 - BytesRead: 142.10 MB (149007033) - BytesReadDataNodeCache: 0 - BytesReadLocal: 142.10 MB (149007033) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 142.10 MB (149007033) - DecompressionTime: 1s499ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 115 (115) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 29.37 MB (30793884) - PerReadThreadRawHdfsThroughput: 21.96 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 112.132ms - RowBatchQueuePutWaitTime: 1h42m - RowsRead: 76.37M (76365651) - RowsReturned: 76.23M (76225044) - RowsReturnedRate: 50.76 M/sec - ScanRangesComplete: 1.81K (1807) - ScannerThreadsInvoluntaryContextSwitches: 30.44K (30439) - ScannerThreadsTotalWallClockTime: 1h47m - MaterializeTupleTime(*): 6s526ms - ScannerThreadsSysTime: 2m51s - ScannerThreadsUserTime: 2m2s - ScannerThreadsVoluntaryContextSwitches: 16.37M (16367339) - TotalRawHdfsReadTime(*): 6s471ms - TotalReadThroughput: 270.72 KB/sec Filter 2 (16.00 MB): - Rows processed: 2.00M (1996095) - Rows rejected: 140.55K (140547) - Rows total: 76.37M (76365651) Filter 5 (16.00 MB): - Rows processed: 1.81M (1810492) - Rows rejected: 60 (60) - Rows total: 76.23M (76225104) Filter 6 (1.00 MB): - Files processed: 1.81K (1807) - Files rejected: 1.69K (1692) - Files total: 1.81K (1807) - RowGroups processed: 74.41K (74411) - RowGroups rejected: 0 (0) - RowGroups total: 74.41K (74411) - Rows processed: 1.88M (1884160) - Rows rejected: 0 (0) - Rows total: 76.23M (76225044) - Splits processed: 115 (115) - Splits rejected: 0 (0) - Splits total: 115 (115) Instance 7f40dcb034de70b7:e0 (host=ve1131.foo:22000):(Total: 9m6s, non-child: 8m45s, % non-child: 96.15%) Hdfs split stats (:<# splits>/): 2:223/12.39 GB 4:214/12.95 GB 7:232/13.61 GB 6:218/12.17 GB 1:215/12.38 GB 0:226/13.66 GB 3:227/13.96 GB 5:255/14.58 GB Filter 6 arrival: 732ms Filter 2 arrival: 13s260ms Filter 5 arrival: 16s788ms MemoryUsage(16s000ms): 33.03 MB, 63.77 MB, 64.77 MB, 65.21 MB, 66.75 MB, 66.80 MB, 66.59 MB, 66.82 MB, 66.31 MB, 65.55 MB, 65.81 MB, 66.28 MB, 66.73 MB, 66.82 MB, 64.21 MB, 62.79 MB, 62.99 MB, 66.61 MB, 66.83 MB, 66.30 MB, 65.69 MB, 65.78 MB, 65.79 MB, 65.67 MB, 65.80 MB, 65.94 MB, 65.80 MB, 65.09 MB, 60.25 MB, 60.08 MB, 60.16 MB, 60.07 MB, 60.05 MB, 47.60 MB ThreadUsage(16s000ms): 12, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 8 - AverageThreadTokens: 12.84 - BloomFilterBytes: 33.00 MB (34603008) - PeakMemoryUsage: 67.80 MB (71096869) - PerHostPeakMemUsage: 161.66 GB (173585461719) - RowsProduced: 77.46M (77459751) - TotalNetworkReceiveTime: 497.835ms - TotalNetworkSendTime: 8m40s - TotalStorageWaitTime: 13s689ms - TotalThreadsInvoluntaryContextSwitches: 36.97K (36974) - TotalThreadsTotalWallClockTime: 1h56m - TotalThreadsSysTime: 2m12s - TotalThreadsUserTime: 3m14s - TotalThreadsVoluntaryContextSwitches: 12.57M (12567130) Fragment Instance Lifecycle Timings: - ExecTime: 9m4s - ExecTreeExecTime: 3s968ms - OpenTime: 1s119ms - ExecTreeOpenTime: 935.360ms - PrepareTime: 55.996ms - ExecTreePrepareTime: 7.024ms DataStreamSender (dst_id=22):(Total: 15s968ms, non-child: 15s968ms, % non-child: 100.00%) - BytesSent: 716.54 MB (751349993) - NetworkThroughput(*): 81.67 MB/sec - OverallThroughput: 44.87 MB/sec - PeakMemoryUsage: 5.07 MB (5314304) - RowsReturned: 77.46M (77459751) - SerializeBatchTime: 7s172ms - TransmitDataRPCTime: 8s773ms - UncompressedRowBatchSize: 2.16 GB (2324625954) CodeGen:(Total: 206.807ms, non-child: 206.807ms, % non-child: 100.00%) - CodegenTime: 1.180ms - CompileTime: 54.551ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 128.209ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 23.580ms HASH_JOIN_NODE (id=5):(Total: 4s872ms, non-child: 3s239ms, % non-child: 66.47%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.232ms - PeakMemoryUsage: 1.23 MB (1294424) - ProbeRows: 77.46M (77459751) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3s085ms - RowsReturned: 77.46M (77459751) - RowsReturnedRate: 15.90 M/sec Hash Join Builder (join_node_id=5): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 25.977us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 83.229us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 43.265us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 497.845ms, non-child: 21.181us, % non-child: 0.00%) BytesReceived(16s000ms): 963.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 4.822us - DeserializeRowBatchTimer: 18.736us - FirstBatchArrivalWaitTime: 467.417ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 241.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=3):(Total: 1s136ms, non-child: 1s136ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:223/12.39 GB 4:214/12.95 GB 7:232/13.61 GB 6:218/12.17 GB 1:215/12.38 GB 0:226/13.66 GB 3:227/13.96 GB 5:255/14.58 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 117 out of 117 Runtime filters: Only following filters arrived: 6, waited 302ms Hdfs Read Thread Concurrency Bucket: 0:98.89% 1:1.021% 2:0% 3:0.09285% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1693 PARQUET/SNAPPY:117 BytesRead(16s000ms): 13.18 MB, 14.24 MB, 14.24 MB, 19.15 MB, 28.50 MB, 28.58 MB, 38.00 MB, 43.36 MB, 44.02 MB, 56.14 MB, 57.80 MB, 62.06 MB, 72.26 MB, 72.53 MB, 80.21 MB, 86.26 MB, 87.35 MB, 100.19 MB, 100.75 MB, 104.02 MB, 114.93 MB, 114.93 MB, 115.26 MB, 124.81 MB, 129.25 MB, 129.25 MB, 129.71 MB, 134.27 MB, 140.31 MB, 140.31 MB, 140.31 MB, 140.31 MB, 140.31 MB - FooterProcessingTime: (Avg: 68.902ms ; Min: 4.333ms ; Max: 972.487ms ; Number of samples: 117) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 11.98 - BytesRead: 140.31 MB (147130465) - BytesReadDataNodeCache: 0 - BytesReadLocal: 140.31 MB (147130465) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 140.31 MB (147130465) - DecompressionTime: 1s480ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 117 (117) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 29.48 MB (30917030) - PerReadThreadRawHdfsThroughput: 19.74 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 129.107ms - RowBatchQueuePutWaitTime: 1h42m - RowsRead: 77.60M (77602361) - RowsReturned: 77.46M (77459751) - RowsReturnedRate: 68.17 M/sec - ScanRangesComplete: 1.81K (1810) - ScannerThreadsInvoluntaryContextSwitches: 32.22K (32219) - ScannerThreadsTotalWallClockTime: 1h47m - MaterializeTupleTime(*): 5s893ms - ScannerThreadsSysTime: 2m11s - ScannerThreadsUserTime: 2m51s - ScannerThreadsVoluntaryContextSwitches: 12.56M (12563986) - TotalRawHdfsReadTime(*): 7s107ms - TotalReadThroughput: 266.57 KB/sec Filter 2 (16.00 MB): - Rows processed: 2.03M (2032914) - Rows rejected: 142.55K (142548) - Rows total: 77.60M (77602361) Filter 5 (16.00 MB): - Rows processed: 1.89M (1891390) - Rows rejected: 62 (62) - Rows total: 77.46M (77459813) Filter 6 (1.00 MB): - Files processed: 1.81K (1810) - Files rejected: 1.69K (1693) - Files total: 1.81K (1810) - RowGroups processed: 75.61K (75614) - RowGroups rejected: 0 (0) - RowGroups total: 75.61K (75614) - Rows processed: 1.92M (1916928) - Rows rejected: 0 (0) - Rows total: 77.46M (77459751) - Splits processed: 117 (117) - Splits rejected: 0 (0) - Splits total: 117 (117) Instance 7f40dcb034de70b7:73 (host=vd1141.foo:22000):(Total: 9m1s, non-child: 8m36s, % non-child: 95.42%) Hdfs split stats (:<# splits>/): 3:218/12.85 GB 5:233/13.30 GB 2:233/13.12 GB 7:214/13.35 GB 0:210/12.99 GB 1:219/11.76 GB 4:245/14.45 GB 6:233/13.83 GB Filter 6 arrival: 1s207ms Filter 2 arrival: 10s729ms Filter 5 arrival: 15s522ms MemoryUsage(16s000ms): 36.07 MB, 65.72 MB, 66.41 MB, 66.21 MB, 65.76 MB, 65.64 MB, 65.15 MB, 65.78 MB, 66.19 MB, 66.72 MB, 66.82 MB, 66.35 MB, 65.77 MB, 65.69 MB, 65.75 MB, 65.79 MB, 65.53 MB, 66.39 MB, 66.80 MB, 66.19 MB, 64.65 MB, 65.80 MB, 65.89 MB, 66.24 MB, 66.85 MB, 66.69 MB, 66.81 MB, 66.59 MB, 64.67 MB, 61.97 MB, 60.16 MB, 58.07 MB, 57.90 MB ThreadUsage(16s000ms): 11, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.94 - BloomFilterBytes: 33.00 MB (34603008) - PeakMemoryUsage: 67.49 MB (70767188) - PerHostPeakMemUsage: 161.68 GB (173600729961) - RowsProduced: 77.71M (77713034) - TotalNetworkReceiveTime: 979.070ms - TotalNetworkSendTime: 8m33s - TotalStorageWaitTime: 12s371ms - TotalThreadsInvoluntaryContextSwitches: 36.12K (36125) - TotalThreadsTotalWallClockTime: 1h56m - TotalThreadsSysTime: 1m59s - TotalThreadsUserTime: 2m50s - TotalThreadsVoluntaryContextSwitches: 9.64M (9644216) Fragment Instance Lifecycle Timings: - ExecTime: 9m - ExecTreeExecTime: 3s663ms - OpenTime: 1s342ms - ExecTreeOpenTime: 1s160ms - PrepareTime: 50.983ms - ExecTreePrepareTime: 6.512ms DataStreamSender (dst_id=22):(Total: 19s826ms, non-child: 19s826ms, % non-child: 100.00%) - BytesSent: 716.94 MB (751764662) - NetworkThroughput(*): 73.41 MB/sec - OverallThroughput: 36.16 MB/sec - PeakMemoryUsage: 5.01 MB (5248768) - RowsReturned: 77.71M (77713034) - SerializeBatchTime: 10s041ms - TransmitDataRPCTime: 9s765ms - UncompressedRowBatchSize: 2.17 GB (2332227180) CodeGen:(Total: 200.997ms, non-child: 200.997ms, % non-child: 100.00%) - CodegenTime: 1.045ms - CompileTime: 54.824ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 124.850ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 20.942ms HASH_JOIN_NODE (id=5):(Total: 4s787ms, non-child: 3s190ms, % non-child: 66.63%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.532ms - PeakMemoryUsage: 1.23 MB (1294774) - ProbeRows: 77.71M (77713034) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3s057ms - RowsReturned: 77.71M (77713034) - RowsReturnedRate: 16.23 M/sec Hash Join Builder (join_node_id=5): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 25.759us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 120.206us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 47.802us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 979.084ms, non-child: 23.185us, % non-child: 0.00%) BytesReceived(16s000ms): 901.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 5.309us - DeserializeRowBatchTimer: 18.696us - FirstBatchArrivalWaitTime: 941.757ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 122.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=3):(Total: 619.016ms, non-child: 619.016ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:218/12.85 GB 5:233/13.30 GB 2:233/13.12 GB 7:214/13.35 GB 0:210/12.99 GB 1:219/11.76 GB 4:245/14.45 GB 6:233/13.83 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 118 out of 118 Runtime filters: Only following filters arrived: 6, waited 40ms Hdfs Read Thread Concurrency Bucket: 0:98.7% 1:1.301% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1687 PARQUET/SNAPPY:118 BytesRead(16s000ms): 13.40 MB, 14.79 MB, 15.46 MB, 22.18 MB, 29.15 MB, 30.37 MB, 40.51 MB, 43.79 MB, 47.12 MB, 58.12 MB, 58.79 MB, 63.16 MB, 72.46 MB, 73.50 MB, 81.65 MB, 87.24 MB, 88.57 MB, 100.16 MB, 102.18 MB, 104.76 MB, 115.11 MB, 116.47 MB, 117.57 MB, 121.99 MB, 130.34 MB, 131.09 MB, 132.31 MB, 134.36 MB, 141.94 MB, 142.10 MB, 142.10 MB, 142.10 MB, 142.10 MB - FooterProcessingTime: (Avg: 54.654ms ; Min: 4.011ms ; Max: 168.387ms ; Number of samples: 118) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 11.96 - BytesRead: 142.10 MB (148999367) - BytesReadDataNodeCache: 0 - BytesReadLocal: 142.10 MB (148999367) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 142.10 MB (148999367) - DecompressionTime: 845.937ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 118 (118) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 29.31 MB (30729321) - PerReadThreadRawHdfsThroughput: 21.65 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 134.570ms - RowBatchQueuePutWaitTime: 1h42m - RowsRead: 77.86M (77855032) - RowsReturned: 77.71M (77713034) - RowsReturnedRate: 125.54 M/sec - ScanRangesComplete: 1.80K (1805) - ScannerThreadsInvoluntaryContextSwitches: 31.42K (31420) - ScannerThreadsTotalWallClockTime: 1h47m - MaterializeTupleTime(*): 6s455ms - ScannerThreadsSysTime: 1m58s - ScannerThreadsUserTime: 2m28s - ScannerThreadsVoluntaryContextSwitches: 9.64M (9641096) - TotalRawHdfsReadTime(*): 6s563ms - TotalReadThroughput: 270.21 KB/sec Filter 2 (16.00 MB): - Rows processed: 2.00M (1996462) - Rows rejected: 141.95K (141952) - Rows total: 77.86M (77855032) Filter 5 (16.00 MB): - Rows processed: 1.85M (1854510) - Rows rejected: 46 (46) - Rows total: 77.71M (77713080) Filter 6 (1.00 MB): - Files processed: 1.80K (1805) - Files rejected: 1.69K (1687) - Files total: 1.80K (1805) - RowGroups processed: 75.86K (75865) - RowGroups rejected: 0 (0) - RowGroups total: 75.86K (75865) - Rows processed: 1.93M (1933312) - Rows rejected: 0 (0) - Rows total: 77.71M (77713034) - Splits processed: 118 (118) - Splits rejected: 0 (0) - Splits total: 118 (118) Instance 7f40dcb034de70b7:f5 (host=vc1529.foo:22000):(Total: 9m, non-child: 8m40s, % non-child: 96.17%) Hdfs split stats (:<# splits>/): 3:220/12.54 GB 2:230/13.53 GB 7:226/12.91 GB 6:222/12.74 GB 4:223/14.09 GB 0:239/13.50 GB 5:229/12.76 GB 1:231/13.60 GB Filter 6 arrival: 673ms Filter 2 arrival: 13s714ms Filter 5 arrival: 17s044ms MemoryUsage(16s000ms): 35.18 MB, 65.82 MB, 66.76 MB, 66.52 MB, 66.80 MB, 66.76 MB, 66.61 MB, 66.79 MB, 66.82 MB, 66.58 MB, 66.79 MB, 66.71 MB, 65.62 MB, 65.87 MB, 65.98 MB, 66.76 MB, 66.81 MB, 65.69 MB, 65.85 MB, 65.79 MB, 66.13 MB, 66.79 MB, 66.93 MB, 66.69 MB, 65.84 MB, 65.90 MB, 65.81 MB, 65.79 MB, 65.39 MB, 60.11 MB, 55.72 MB, 55.63 MB, 55.66 MB ThreadUsage(16s000ms): 12, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.87 - BloomFilterBytes: 33.00 MB (34603008) - PeakMemoryUsage: 67.60 MB (70887069) - PerHostPeakMemUsage: 161.66 GB (173585822808) - RowsProduced: 76.25M (76248459) - TotalNetworkReceiveTime: 445.271ms - TotalNetworkSendTime: 8m35s - TotalStorageWaitTime: 11s539ms - TotalThreadsInvoluntaryContextSwitches: 34.13K (34127) - TotalThreadsTotalWallClockTime: 1h55m - TotalThreadsSysTime: 3m - TotalThreadsUserTime: 2m6s - TotalThreadsVoluntaryContextSwitches: 10.50M (10501847) Fragment Instance Lifecycle Timings: - ExecTime: 8m59s - ExecTreeExecTime: 3s578ms - OpenTime: 1s125ms - ExecTreeOpenTime: 946.215ms - PrepareTime: 52.306ms - ExecTreePrepareTime: 5.539ms DataStreamSender (dst_id=22):(Total: 16s033ms, non-child: 16s033ms, % non-child: 100.00%) - BytesSent: 707.68 MB (742059394) - NetworkThroughput(*): 78.85 MB/sec - OverallThroughput: 44.14 MB/sec - PeakMemoryUsage: 4.98 MB (5224192) - RowsReturned: 76.25M (76248459) - SerializeBatchTime: 7s038ms - TransmitDataRPCTime: 8s974ms - UncompressedRowBatchSize: 2.13 GB (2288274234) CodeGen:(Total: 198.885ms, non-child: 198.885ms, % non-child: 100.00%) - CodegenTime: 908.291us - CompileTime: 51.798ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 125.484ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 21.233ms HASH_JOIN_NODE (id=5):(Total: 4s489ms, non-child: 3s064ms, % non-child: 68.28%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.520ms - PeakMemoryUsage: 1.23 MB (1292069) - ProbeRows: 76.25M (76248459) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 2s899ms - RowsReturned: 76.25M (76248459) - RowsReturnedRate: 16.99 M/sec Hash Join Builder (join_node_id=5): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 26.654us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 131.859us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 59.188us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 445.281ms, non-child: 18.971us, % non-child: 0.00%) BytesReceived(16s000ms): 963.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 5.145us - DeserializeRowBatchTimer: 11.233us - FirstBatchArrivalWaitTime: 398.929ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 269.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=3):(Total: 979.258ms, non-child: 979.258ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:220/12.54 GB 2:230/13.53 GB 7:226/12.91 GB 6:222/12.74 GB 4:223/14.09 GB 0:239/13.50 GB 5:229/12.76 GB 1:231/13.60 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 115 out of 115 Runtime filters: Only following filters arrived: 6, waited 361ms Hdfs Read Thread Concurrency Bucket: 0:99.16% 1:0.7477% 2:0.09346% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1705 PARQUET/SNAPPY:115 BytesRead(16s000ms): 13.74 MB, 14.65 MB, 14.65 MB, 20.21 MB, 29.17 MB, 29.37 MB, 37.23 MB, 43.79 MB, 44.25 MB, 53.72 MB, 58.12 MB, 58.77 MB, 70.35 MB, 72.60 MB, 76.46 MB, 87.42 MB, 87.58 MB, 97.76 MB, 102.25 MB, 102.52 MB, 112.57 MB, 117.06 MB, 117.06 MB, 118.52 MB, 131.26 MB, 131.77 MB, 131.77 MB, 132.15 MB, 134.48 MB, 140.03 MB, 140.52 MB, 140.52 MB, 140.52 MB - FooterProcessingTime: (Avg: 52.581ms ; Min: 23.439ms ; Max: 228.886ms ; Number of samples: 115) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 11.89 - BytesRead: 140.52 MB (147345796) - BytesReadDataNodeCache: 0 - BytesReadLocal: 140.52 MB (147345796) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 140.52 MB (147345796) - DecompressionTime: 1s009ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 115 (115) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 29.52 MB (30948906) - PerReadThreadRawHdfsThroughput: 24.75 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 133.804ms - RowBatchQueuePutWaitTime: 1h41m - RowsRead: 76.39M (76386400) - RowsReturned: 76.25M (76248459) - RowsReturnedRate: 77.86 M/sec - ScanRangesComplete: 1.82K (1820) - ScannerThreadsInvoluntaryContextSwitches: 29.32K (29320) - ScannerThreadsTotalWallClockTime: 1h46m - MaterializeTupleTime(*): 6s087ms - ScannerThreadsSysTime: 3m - ScannerThreadsUserTime: 1m44s - ScannerThreadsVoluntaryContextSwitches: 10.50M (10498776) - TotalRawHdfsReadTime(*): 5s678ms - TotalReadThroughput: 268.96 KB/sec Filter 2 (16.00 MB): - Rows processed: 2.01M (2009813) - Rows rejected: 137.91K (137906) - Rows total: 76.39M (76386400) Filter 5 (16.00 MB): - Rows processed: 1.83M (1827875) - Rows rejected: 35 (35) - Rows total: 76.25M (76248494) Filter 6 (1.00 MB): - Files processed: 1.82K (1820) - Files rejected: 1.71K (1705) - Files total: 1.82K (1820) - RowGroups processed: 74.44K (74441) - RowGroups rejected: 0 (0) - RowGroups total: 74.44K (74441) - Rows processed: 1.88M (1884160) - Rows rejected: 0 (0) - Rows total: 76.25M (76248459) - Splits processed: 115 (115) - Splits rejected: 0 (0) - Splits total: 115 (115) Instance 7f40dcb034de70b7:b9 (host=va1027.foo:22000):(Total: 9m, non-child: 8m39s, % non-child: 96.21%) Hdfs split stats (:<# splits>/): 5:228/12.27 GB 1:245/13.78 GB 0:227/12.84 GB 3:240/12.75 GB 6:238/12.98 GB 2:258/14.08 GB 7:238/13.31 GB 4:250/13.65 GB Filter 6 arrival: 894ms Filter 2 arrival: 12s745ms Filter 5 arrival: 16s368ms MemoryUsage(16s000ms): 34.13 MB, 66.28 MB, 66.85 MB, 66.58 MB, 66.80 MB, 66.72 MB, 65.92 MB, 65.82 MB, 65.81 MB, 65.62 MB, 65.83 MB, 65.51 MB, 66.74 MB, 66.78 MB, 66.24 MB, 65.81 MB, 65.81 MB, 65.40 MB, 65.77 MB, 65.65 MB, 66.34 MB, 66.85 MB, 66.86 MB, 66.62 MB, 66.34 MB, 66.76 MB, 66.78 MB, 66.12 MB, 60.43 MB, 60.18 MB, 60.08 MB, 60.21 MB, 59.47 MB ThreadUsage(16s000ms): 12, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.88 - BloomFilterBytes: 33.00 MB (34603008) - PeakMemoryUsage: 67.53 MB (70809168) - PerHostPeakMemUsage: 161.64 GB (173562881619) - RowsProduced: 77.54M (77543297) - TotalNetworkReceiveTime: 646.559ms - TotalNetworkSendTime: 8m33s - TotalStorageWaitTime: 17s992ms - TotalThreadsInvoluntaryContextSwitches: 32.02K (32016) - TotalThreadsTotalWallClockTime: 1h56m - TotalThreadsSysTime: 1m38s - TotalThreadsUserTime: 3m7s - TotalThreadsVoluntaryContextSwitches: 11.46M (11456084) Fragment Instance Lifecycle Timings: - ExecTime: 8m58s - ExecTreeExecTime: 3s686ms - OpenTime: 1s466ms - ExecTreeOpenTime: 1s271ms - PrepareTime: 57.558ms - ExecTreePrepareTime: 6.855ms DataStreamSender (dst_id=22):(Total: 15s319ms, non-child: 15s319ms, % non-child: 100.00%) - BytesSent: 718.35 MB (753245908) - NetworkThroughput(*): 87.45 MB/sec - OverallThroughput: 46.89 MB/sec - PeakMemoryUsage: 5.01 MB (5256960) - RowsReturned: 77.54M (77543297) - SerializeBatchTime: 7s084ms - TransmitDataRPCTime: 8s214ms - UncompressedRowBatchSize: 2.17 GB (2327133246) CodeGen:(Total: 216.884ms, non-child: 216.884ms, % non-child: 100.00%) - CodegenTime: 1.133ms - CompileTime: 62.120ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 131.184ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 23.130ms HASH_JOIN_NODE (id=5):(Total: 4s927ms, non-child: 3s107ms, % non-child: 63.06%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.341ms - PeakMemoryUsage: 1.24 MB (1298058) - ProbeRows: 77.54M (77543297) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 2s950ms - RowsReturned: 77.54M (77543297) - RowsReturnedRate: 15.74 M/sec Hash Join Builder (join_node_id=5): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 26.074us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 123.629us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 43.222us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 646.571ms, non-child: 23.942us, % non-child: 0.00%) BytesReceived(16s000ms): 932.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 5.072us - DeserializeRowBatchTimer: 14.413us - FirstBatchArrivalWaitTime: 638.385ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 185.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=3):(Total: 1s174ms, non-child: 1s174ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:228/12.27 GB 1:245/13.78 GB 0:227/12.84 GB 3:240/12.75 GB 6:238/12.98 GB 2:258/14.08 GB 7:238/13.31 GB 4:250/13.65 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 117 out of 117 Runtime filters: Only following filters arrived: 6, waited 141ms Hdfs Read Thread Concurrency Bucket: 0:98.23% 1:1.581% 2:0.186% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1807 PARQUET/SNAPPY:117 BytesRead(16s000ms): 13.21 MB, 14.72 MB, 14.72 MB, 19.03 MB, 29.58 MB, 29.75 MB, 38.28 MB, 43.85 MB, 44.57 MB, 57.34 MB, 58.47 MB, 61.80 MB, 73.14 MB, 73.30 MB, 80.35 MB, 87.41 MB, 87.78 MB, 99.17 MB, 101.82 MB, 102.37 MB, 113.94 MB, 116.14 MB, 116.14 MB, 122.38 MB, 130.17 MB, 130.52 MB, 130.81 MB, 134.09 MB, 141.78 MB, 141.78 MB, 141.78 MB, 141.78 MB, 141.78 MB - FooterProcessingTime: (Avg: 86.561ms ; Min: 3.807ms ; Max: 647.912ms ; Number of samples: 117) - AverageHdfsReadThreadConcurrency: 0.02 - AverageScannerThreadConcurrency: 11.90 - BytesRead: 141.78 MB (148670743) - BytesReadDataNodeCache: 0 - BytesReadLocal: 141.78 MB (148670743) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 141.78 MB (148670743) - DecompressionTime: 405.957ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 117 (117) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 29.33 MB (30752209) - PerReadThreadRawHdfsThroughput: 19.72 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 477.493ms - RowBatchQueuePutWaitTime: 1h42m - RowsRead: 77.69M (77686174) - RowsReturned: 77.54M (77543297) - RowsReturnedRate: 66.04 M/sec - ScanRangesComplete: 1.92K (1924) - ScannerThreadsInvoluntaryContextSwitches: 27.25K (27253) - ScannerThreadsTotalWallClockTime: 1h47m - MaterializeTupleTime(*): 5s527ms - ScannerThreadsSysTime: 1m37s - ScannerThreadsUserTime: 2m44s - ScannerThreadsVoluntaryContextSwitches: 11.45M (11452912) - TotalRawHdfsReadTime(*): 7s191ms - TotalReadThroughput: 269.86 KB/sec Filter 2 (16.00 MB): - Rows processed: 2.04M (2039325) - Rows rejected: 142.82K (142824) - Rows total: 77.69M (77686174) Filter 5 (16.00 MB): - Rows processed: 1.80M (1797173) - Rows rejected: 53 (53) - Rows total: 77.54M (77543350) Filter 6 (1.00 MB): - Files processed: 1.92K (1924) - Files rejected: 1.81K (1807) - Files total: 1.92K (1924) - RowGroups processed: 75.70K (75697) - RowGroups rejected: 0 (0) - RowGroups total: 75.70K (75697) - Rows processed: 1.92M (1916928) - Rows rejected: 0 (0) - Rows total: 77.54M (77543297) - Splits processed: 117 (117) - Splits rejected: 0 (0) - Splits total: 117 (117) Instance 7f40dcb034de70b7:d0 (host=vc1528.foo:22000):(Total: 9m, non-child: 8m39s, % non-child: 96.13%) Hdfs split stats (:<# splits>/): 6:231/12.83 GB 0:220/12.69 GB 1:230/13.36 GB 7:232/14.04 GB 4:228/13.09 GB 3:228/13.27 GB 5:226/12.92 GB 2:236/13.50 GB Filter 6 arrival: 803ms Filter 2 arrival: 13s064ms Filter 5 arrival: 16s699ms MemoryUsage(16s000ms): 35.41 MB, 66.23 MB, 66.85 MB, 66.23 MB, 65.80 MB, 65.76 MB, 66.07 MB, 66.83 MB, 66.85 MB, 66.67 MB, 66.81 MB, 66.60 MB, 66.76 MB, 66.79 MB, 65.54 MB, 65.80 MB, 65.78 MB, 66.72 MB, 66.77 MB, 66.07 MB, 65.78 MB, 65.79 MB, 66.06 MB, 66.82 MB, 66.79 MB, 66.81 MB, 66.79 MB, 65.40 MB, 60.15 MB, 60.10 MB, 60.22 MB, 59.04 MB, 57.84 MB ThreadUsage(16s000ms): 12, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.88 - BloomFilterBytes: 33.00 MB (34603008) - PeakMemoryUsage: 67.56 MB (70840767) - PerHostPeakMemUsage: 161.68 GB (173605532858) - RowsProduced: 77.48M (77480594) - TotalNetworkReceiveTime: 574.835ms - TotalNetworkSendTime: 8m35s - TotalStorageWaitTime: 11s642ms - TotalThreadsInvoluntaryContextSwitches: 35.99K (35987) - TotalThreadsTotalWallClockTime: 1h55m - TotalThreadsSysTime: 2m3s - TotalThreadsUserTime: 3m7s - TotalThreadsVoluntaryContextSwitches: 13.54M (13540795) Fragment Instance Lifecycle Timings: - ExecTime: 8m58s - ExecTreeExecTime: 3s636ms - OpenTime: 1s085ms - ExecTreeOpenTime: 903.804ms - PrepareTime: 52.501ms - ExecTreePrepareTime: 7.365ms DataStreamSender (dst_id=22):(Total: 16s193ms, non-child: 16s193ms, % non-child: 100.00%) - BytesSent: 714.84 MB (749559554) - NetworkThroughput(*): 74.83 MB/sec - OverallThroughput: 44.14 MB/sec - PeakMemoryUsage: 5.00 MB (5240576) - RowsReturned: 77.48M (77480594) - SerializeBatchTime: 6s622ms - TransmitDataRPCTime: 9s553ms - UncompressedRowBatchSize: 2.17 GB (2325251492) CodeGen:(Total: 199.969ms, non-child: 199.969ms, % non-child: 100.00%) - CodegenTime: 1.072ms - CompileTime: 51.148ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 128.651ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 19.784ms HASH_JOIN_NODE (id=5):(Total: 4s514ms, non-child: 3s198ms, % non-child: 70.84%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.496ms - PeakMemoryUsage: 1.24 MB (1297532) - ProbeRows: 77.48M (77480594) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3s042ms - RowsReturned: 77.48M (77480594) - RowsReturnedRate: 17.16 M/sec Hash Join Builder (join_node_id=5): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 32.525us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 136.227us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 54.197us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 574.844ms, non-child: 18.932us, % non-child: 0.00%) BytesReceived(16s000ms): 963.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 4.687us - DeserializeRowBatchTimer: 14.329us - FirstBatchArrivalWaitTime: 553.306ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 208.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=3):(Total: 742.081ms, non-child: 742.081ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 6:231/12.83 GB 0:220/12.69 GB 1:230/13.36 GB 7:232/14.04 GB 4:228/13.09 GB 3:228/13.27 GB 5:226/12.92 GB 2:236/13.50 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 117 out of 117 Runtime filters: Only following filters arrived: 6, waited 221ms Hdfs Read Thread Concurrency Bucket: 0:98.69% 1:1.124% 2:0.1873% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1714 PARQUET/SNAPPY:117 BytesRead(16s000ms): 13.62 MB, 14.52 MB, 14.52 MB, 19.78 MB, 28.79 MB, 29.12 MB, 38.67 MB, 43.39 MB, 44.55 MB, 57.32 MB, 58.12 MB, 62.22 MB, 72.48 MB, 72.70 MB, 79.55 MB, 86.79 MB, 87.73 MB, 99.13 MB, 101.24 MB, 103.32 MB, 115.05 MB, 115.73 MB, 115.99 MB, 123.34 MB, 130.07 MB, 130.07 MB, 130.64 MB, 134.73 MB, 140.78 MB, 140.78 MB, 140.78 MB, 140.78 MB, 140.78 MB - FooterProcessingTime: (Avg: 53.270ms ; Min: 11.350ms ; Max: 170.849ms ; Number of samples: 117) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 11.98 - BytesRead: 140.78 MB (147619012) - BytesReadDataNodeCache: 0 - BytesReadLocal: 140.78 MB (147619012) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 140.78 MB (147619012) - DecompressionTime: 1s362ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 117 (117) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 29.34 MB (30762886) - PerReadThreadRawHdfsThroughput: 23.31 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 99.712ms - RowBatchQueuePutWaitTime: 1h41m - RowsRead: 77.63M (77625294) - RowsReturned: 77.48M (77480594) - RowsReturnedRate: 104.41 M/sec - ScanRangesComplete: 1.83K (1831) - ScannerThreadsInvoluntaryContextSwitches: 31.37K (31369) - ScannerThreadsTotalWallClockTime: 1h46m - MaterializeTupleTime(*): 5s803ms - ScannerThreadsSysTime: 2m2s - ScannerThreadsUserTime: 2m47s - ScannerThreadsVoluntaryContextSwitches: 13.54M (13537698) - TotalRawHdfsReadTime(*): 6s038ms - TotalReadThroughput: 269.96 KB/sec Filter 2 (16.00 MB): - Rows processed: 2.04M (2036028) - Rows rejected: 144.66K (144665) - Rows total: 77.63M (77625294) Filter 5 (16.00 MB): - Rows processed: 1.84M (1838115) - Rows rejected: 35 (35) - Rows total: 77.48M (77480629) Filter 6 (1.00 MB): - Files processed: 1.83K (1831) - Files rejected: 1.71K (1714) - Files total: 1.83K (1831) - RowGroups processed: 75.64K (75638) - RowGroups rejected: 0 (0) - RowGroups total: 75.64K (75638) - Rows processed: 1.92M (1916928) - Rows rejected: 0 (0) - Rows total: 77.48M (77480594) - Splits processed: 117 (117) - Splits rejected: 0 (0) - Splits total: 117 (117) Instance 7f40dcb034de70b7:ee (host=vc1510.foo:22000):(Total: 9m, non-child: 8m39s, % non-child: 96.26%) Hdfs split stats (:<# splits>/): 3:232/13.79 GB 0:232/13.42 GB 6:229/13.08 GB 7:214/12.46 GB 4:226/12.66 GB 2:245/14.60 GB 5:214/12.65 GB 1:225/13.02 GB Filter 6 arrival: 675ms Filter 2 arrival: 13s567ms Filter 5 arrival: 16s972ms MemoryUsage(16s000ms): 35.41 MB, 65.83 MB, 66.81 MB, 65.64 MB, 64.78 MB, 64.70 MB, 64.10 MB, 65.76 MB, 65.81 MB, 65.64 MB, 65.81 MB, 65.83 MB, 66.75 MB, 66.82 MB, 66.03 MB, 66.84 MB, 66.70 MB, 66.72 MB, 66.83 MB, 66.81 MB, 66.53 MB, 66.80 MB, 66.78 MB, 66.80 MB, 66.67 MB, 66.69 MB, 66.81 MB, 66.61 MB, 64.67 MB, 57.86 MB, 57.81 MB, 57.94 MB, 57.67 MB ThreadUsage(16s000ms): 12, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.88 - BloomFilterBytes: 33.00 MB (34603008) - PeakMemoryUsage: 67.60 MB (70882341) - PerHostPeakMemUsage: 161.69 GB (173611435148) - RowsProduced: 76.99M (76987565) - TotalNetworkReceiveTime: 436.177ms - TotalNetworkSendTime: 8m36s - TotalStorageWaitTime: 12s425ms - TotalThreadsInvoluntaryContextSwitches: 37.65K (37646) - TotalThreadsTotalWallClockTime: 1h55m - TotalThreadsSysTime: 2m18s - TotalThreadsUserTime: 2m55s - TotalThreadsVoluntaryContextSwitches: 15.91M (15911651) Fragment Instance Lifecycle Timings: - ExecTime: 8m58s - ExecTreeExecTime: 3s432ms - OpenTime: 1s098ms - ExecTreeOpenTime: 913.150ms - PrepareTime: 58.491ms - ExecTreePrepareTime: 7.505ms DataStreamSender (dst_id=22):(Total: 15s676ms, non-child: 15s676ms, % non-child: 100.00%) - BytesSent: 711.92 MB (746500904) - NetworkThroughput(*): 76.81 MB/sec - OverallThroughput: 45.41 MB/sec - PeakMemoryUsage: 4.95 MB (5191424) - RowsReturned: 76.99M (76987565) - SerializeBatchTime: 6s389ms - TransmitDataRPCTime: 9s268ms - UncompressedRowBatchSize: 2.15 GB (2310455342) CodeGen:(Total: 209.053ms, non-child: 209.053ms, % non-child: 100.00%) - CodegenTime: 1.121ms - CompileTime: 56.115ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 127.543ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 24.916ms HASH_JOIN_NODE (id=5):(Total: 4s322ms, non-child: 3s042ms, % non-child: 70.39%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.540ms - PeakMemoryUsage: 1.24 MB (1296667) - ProbeRows: 76.99M (76987565) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 2s897ms - RowsReturned: 76.99M (76987565) - RowsReturnedRate: 17.81 M/sec Hash Join Builder (join_node_id=5): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 27.143us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 153.443us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 59.550us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 436.187ms, non-child: 21.807us, % non-child: 0.00%) BytesReceived(16s000ms): 963.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 4.978us - DeserializeRowBatchTimer: 12.181us - FirstBatchArrivalWaitTime: 402.413ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 275.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=3):(Total: 844.361ms, non-child: 844.361ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:232/13.79 GB 0:232/13.42 GB 6:229/13.08 GB 7:214/12.46 GB 4:226/12.66 GB 2:245/14.60 GB 5:214/12.65 GB 1:225/13.02 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 117 out of 117 Runtime filters: Only following filters arrived: 6, waited 362ms Hdfs Read Thread Concurrency Bucket: 0:98.88% 1:1.029% 2:0.09355% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1700 PARQUET/SNAPPY:117 BytesRead(16s000ms): 13.53 MB, 14.43 MB, 14.43 MB, 18.93 MB, 28.45 MB, 28.87 MB, 36.76 MB, 43.05 MB, 43.78 MB, 54.30 MB, 57.45 MB, 59.44 MB, 71.12 MB, 71.76 MB, 77.01 MB, 86.25 MB, 86.99 MB, 97.61 MB, 101.14 MB, 102.11 MB, 113.14 MB, 115.74 MB, 115.93 MB, 122.02 MB, 130.17 MB, 130.24 MB, 130.46 MB, 132.05 MB, 139.52 MB, 140.05 MB, 140.05 MB, 140.05 MB, 140.05 MB - FooterProcessingTime: (Avg: 57.014ms ; Min: 22.411ms ; Max: 132.888ms ; Number of samples: 117) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 11.97 - BytesRead: 140.05 MB (146857846) - BytesReadDataNodeCache: 0 - BytesReadLocal: 140.05 MB (146857846) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 140.05 MB (146857846) - DecompressionTime: 717.557ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 117 (117) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 29.45 MB (30883622) - PerReadThreadRawHdfsThroughput: 20.93 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 106.788ms - RowBatchQueuePutWaitTime: 1h41m - RowsRead: 77.13M (77128817) - RowsReturned: 76.99M (76987565) - RowsReturnedRate: 91.18 M/sec - ScanRangesComplete: 1.82K (1817) - ScannerThreadsInvoluntaryContextSwitches: 33.02K (33015) - ScannerThreadsTotalWallClockTime: 1h46m - MaterializeTupleTime(*): 5s629ms - ScannerThreadsSysTime: 2m17s - ScannerThreadsUserTime: 2m35s - ScannerThreadsVoluntaryContextSwitches: 15.91M (15908460) - TotalRawHdfsReadTime(*): 6s691ms - TotalReadThroughput: 268.32 KB/sec Filter 2 (16.00 MB): - Rows processed: 2.04M (2041783) - Rows rejected: 141.24K (141239) - Rows total: 77.13M (77128817) Filter 5 (16.00 MB): - Rows processed: 1.82M (1818637) - Rows rejected: 13 (13) - Rows total: 76.99M (76987578) Filter 6 (1.00 MB): - Files processed: 1.82K (1817) - Files rejected: 1.70K (1700) - Files total: 1.82K (1817) - RowGroups processed: 75.15K (75153) - RowGroups rejected: 0 (0) - RowGroups total: 75.15K (75153) - Rows processed: 1.92M (1916928) - Rows rejected: 0 (0) - Rows total: 76.99M (76987565) - Splits processed: 117 (117) - Splits rejected: 0 (0) - Splits total: 117 (117) Instance 7f40dcb034de70b7:db (host=vd1102.foo:22000):(Total: 8m59s, non-child: 8m38s, % non-child: 96.10%) Hdfs split stats (:<# splits>/): 1:219/12.88 GB 5:224/13.09 GB 6:245/13.80 GB 7:229/13.30 GB 2:211/11.74 GB 0:218/12.65 GB 3:250/14.67 GB 4:219/13.56 GB Filter 6 arrival: 779ms Filter 2 arrival: 13s216ms Filter 5 arrival: 16s789ms MemoryUsage(16s000ms): 35.40 MB, 65.74 MB, 66.83 MB, 65.74 MB, 65.37 MB, 65.82 MB, 66.15 MB, 66.84 MB, 66.49 MB, 66.77 MB, 66.81 MB, 66.06 MB, 65.78 MB, 65.65 MB, 65.84 MB, 66.89 MB, 66.46 MB, 65.63 MB, 65.82 MB, 66.12 MB, 66.74 MB, 66.80 MB, 66.73 MB, 66.48 MB, 66.75 MB, 66.73 MB, 66.71 MB, 64.16 MB, 61.25 MB, 61.31 MB, 61.30 MB, 61.35 MB, 61.44 MB ThreadUsage(16s000ms): 12, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.88 - BloomFilterBytes: 33.00 MB (34603008) - PeakMemoryUsage: 67.54 MB (70818987) - PerHostPeakMemUsage: 161.66 GB (173583255588) - RowsProduced: 78.33M (78331796) - TotalNetworkReceiveTime: 548.147ms - TotalNetworkSendTime: 8m34s - TotalStorageWaitTime: 13s944ms - TotalThreadsInvoluntaryContextSwitches: 25.01K (25013) - TotalThreadsTotalWallClockTime: 1h55m - TotalThreadsSysTime: 28s523ms - TotalThreadsUserTime: 3m5s - TotalThreadsVoluntaryContextSwitches: 3.00M (3001164) Fragment Instance Lifecycle Timings: - ExecTime: 8m58s - ExecTreeExecTime: 3s933ms - OpenTime: 1s086ms - ExecTreeOpenTime: 906.188ms - PrepareTime: 55.613ms - ExecTreePrepareTime: 7.102ms DataStreamSender (dst_id=22):(Total: 16s050ms, non-child: 16s050ms, % non-child: 100.00%) - BytesSent: 725.38 MB (760616658) - NetworkThroughput(*): 77.34 MB/sec - OverallThroughput: 45.19 MB/sec - PeakMemoryUsage: 5.01 MB (5256960) - RowsReturned: 78.33M (78331796) - SerializeBatchTime: 6s651ms - TransmitDataRPCTime: 9s379ms - UncompressedRowBatchSize: 2.19 GB (2350796720) CodeGen:(Total: 201.622ms, non-child: 201.622ms, % non-child: 100.00%) - CodegenTime: 1.055ms - CompileTime: 51.275ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 126.873ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 23.044ms HASH_JOIN_NODE (id=5):(Total: 4s812ms, non-child: 3s099ms, % non-child: 64.41%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.550ms - PeakMemoryUsage: 1.24 MB (1296369) - ProbeRows: 78.33M (78331796) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 2s947ms - RowsReturned: 78.33M (78331796) - RowsReturnedRate: 16.28 M/sec Hash Join Builder (join_node_id=5): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 24.891us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 126.627us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 56.232us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 548.157ms, non-child: 20.741us, % non-child: 0.00%) BytesReceived(16s000ms): 963.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 4.670us - DeserializeRowBatchTimer: 23.955us - FirstBatchArrivalWaitTime: 509.036ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 218.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=3):(Total: 1s165ms, non-child: 1s165ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:219/12.88 GB 5:224/13.09 GB 6:245/13.80 GB 7:229/13.30 GB 2:211/11.74 GB 0:218/12.65 GB 3:250/14.67 GB 4:219/13.56 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 119 out of 119 Runtime filters: Only following filters arrived: 6, waited 241ms Hdfs Read Thread Concurrency Bucket: 0:98.59% 1:1.408% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1696 PARQUET/SNAPPY:119 BytesRead(16s000ms): 13.81 MB, 14.77 MB, 14.77 MB, 19.69 MB, 29.35 MB, 29.77 MB, 38.90 MB, 44.11 MB, 45.91 MB, 58.09 MB, 58.54 MB, 62.90 MB, 72.92 MB, 73.20 MB, 82.07 MB, 87.72 MB, 88.68 MB, 101.21 MB, 101.83 MB, 105.89 MB, 116.10 MB, 116.32 MB, 116.36 MB, 125.96 MB, 130.76 MB, 130.76 MB, 131.41 MB, 140.08 MB, 142.89 MB, 142.89 MB, 142.89 MB, 142.89 MB, 142.89 MB - FooterProcessingTime: (Avg: 67.268ms ; Min: 25.349ms ; Max: 670.362ms ; Number of samples: 119) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 11.97 - BytesRead: 142.89 MB (149829640) - BytesReadDataNodeCache: 0 - BytesReadLocal: 142.89 MB (149829640) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 142.89 MB (149829640) - DecompressionTime: 1s234ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 119 (119) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 29.32 MB (30745118) - PerReadThreadRawHdfsThroughput: 21.09 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 109.733ms - RowBatchQueuePutWaitTime: 1h43m - RowsRead: 78.48M (78476607) - RowsReturned: 78.33M (78331796) - RowsReturnedRate: 67.21 M/sec - ScanRangesComplete: 1.81K (1815) - ScannerThreadsInvoluntaryContextSwitches: 20.34K (20339) - ScannerThreadsTotalWallClockTime: 1h46m - MaterializeTupleTime(*): 5s644ms - ScannerThreadsSysTime: 27s807ms - ScannerThreadsUserTime: 2m44s - ScannerThreadsVoluntaryContextSwitches: 3.00M (2997960) - TotalRawHdfsReadTime(*): 6s773ms - TotalReadThroughput: 274.78 KB/sec Filter 2 (16.00 MB): - Rows processed: 2.07M (2069916) - Rows rejected: 144.70K (144700) - Rows total: 78.48M (78476607) Filter 5 (16.00 MB): - Rows processed: 1.90M (1900655) - Rows rejected: 111 (111) - Rows total: 78.33M (78331907) Filter 6 (1.00 MB): - Files processed: 1.81K (1815) - Files rejected: 1.70K (1696) - Files total: 1.81K (1815) - RowGroups processed: 76.47K (76466) - RowGroups rejected: 0 (0) - RowGroups total: 76.47K (76466) - Rows processed: 1.95M (1949696) - Rows rejected: 0 (0) - Rows total: 78.33M (78331796) - Splits processed: 119 (119) - Splits rejected: 0 (0) - Splits total: 119 (119) Instance 7f40dcb034de70b7:c0 (host=va1035.foo:22000):(Total: 8m54s, non-child: 8m33s, % non-child: 96.13%) Hdfs split stats (:<# splits>/): 5:213/12.28 GB 2:229/13.06 GB 7:223/12.64 GB 6:229/13.71 GB 3:214/12.37 GB 4:232/13.41 GB 0:244/14.63 GB 1:233/13.59 GB Filter 6 arrival: 901ms Filter 2 arrival: 12s839ms Filter 5 arrival: 16s493ms MemoryUsage(16s000ms): 34.33 MB, 65.30 MB, 65.80 MB, 66.07 MB, 66.75 MB, 66.69 MB, 66.52 MB, 66.84 MB, 66.70 MB, 66.73 MB, 66.84 MB, 66.67 MB, 66.80 MB, 66.84 MB, 65.36 MB, 64.75 MB, 65.24 MB, 66.31 MB, 66.81 MB, 66.04 MB, 65.52 MB, 65.79 MB, 65.93 MB, 66.62 MB, 66.84 MB, 66.71 MB, 66.77 MB, 65.33 MB, 57.83 MB, 57.82 MB, 57.81 MB, 57.58 MB, 55.58 MB ThreadUsage(16s000ms): 12, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.97 - BloomFilterBytes: 33.00 MB (34603008) - PeakMemoryUsage: 67.45 MB (70721512) - PerHostPeakMemUsage: 161.66 GB (173582342136) - RowsProduced: 76.98M (76982502) - TotalNetworkReceiveTime: 669.734ms - TotalNetworkSendTime: 8m28s - TotalStorageWaitTime: 15s211ms - TotalThreadsInvoluntaryContextSwitches: 41.99K (41995) - TotalThreadsTotalWallClockTime: 1h55m - TotalThreadsSysTime: 3m15s - TotalThreadsUserTime: 3m1s - TotalThreadsVoluntaryContextSwitches: 17.84M (17842958) Fragment Instance Lifecycle Timings: - ExecTime: 8m53s - ExecTreeExecTime: 3s501ms - OpenTime: 1s117ms - ExecTreeOpenTime: 929.072ms - PrepareTime: 47.245ms - ExecTreePrepareTime: 6.722ms DataStreamSender (dst_id=22):(Total: 16s105ms, non-child: 16s105ms, % non-child: 100.00%) - BytesSent: 711.00 MB (745535969) - NetworkThroughput(*): 78.10 MB/sec - OverallThroughput: 44.14 MB/sec - PeakMemoryUsage: 5.08 MB (5330688) - RowsReturned: 76.98M (76982502) - SerializeBatchTime: 6s981ms - TransmitDataRPCTime: 9s103ms - UncompressedRowBatchSize: 2.15 GB (2310303404) CodeGen:(Total: 203.245ms, non-child: 203.245ms, % non-child: 100.00%) - CodegenTime: 1.104ms - CompileTime: 56.871ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 129.620ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 16.302ms HASH_JOIN_NODE (id=5):(Total: 4s394ms, non-child: 3s039ms, % non-child: 69.16%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.326ms - PeakMemoryUsage: 1.23 MB (1291868) - ProbeRows: 76.98M (76982502) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 2s864ms - RowsReturned: 76.98M (76982502) - RowsReturnedRate: 17.52 M/sec Hash Join Builder (join_node_id=5): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 16.830us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 134.240us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 31.664us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 669.746ms, non-child: 17.582us, % non-child: 0.00%) BytesReceived(16s000ms): 932.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 5.132us - DeserializeRowBatchTimer: 21.292us - FirstBatchArrivalWaitTime: 631.961ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 179.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=3):(Total: 685.901ms, non-child: 685.901ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:213/12.28 GB 2:229/13.06 GB 7:223/12.64 GB 6:229/13.71 GB 3:214/12.37 GB 4:232/13.41 GB 0:244/14.63 GB 1:233/13.59 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 116 out of 116 Runtime filters: Only following filters arrived: 6, waited 120ms Hdfs Read Thread Concurrency Bucket: 0:99.34% 1:0.656% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1701 PARQUET/SNAPPY:116 BytesRead(16s000ms): 13.27 MB, 14.16 MB, 14.16 MB, 20.09 MB, 28.65 MB, 29.08 MB, 39.85 MB, 43.35 MB, 44.84 MB, 57.69 MB, 57.92 MB, 62.05 MB, 72.23 MB, 72.38 MB, 79.57 MB, 86.36 MB, 87.39 MB, 98.83 MB, 100.70 MB, 102.10 MB, 114.28 MB, 114.91 MB, 115.11 MB, 124.06 MB, 129.73 MB, 129.73 MB, 130.17 MB, 132.70 MB, 139.36 MB, 139.36 MB, 139.36 MB, 139.36 MB, 139.36 MB - FooterProcessingTime: (Avg: 71.423ms ; Min: 5.027ms ; Max: 369.873ms ; Number of samples: 116) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 11.98 - BytesRead: 139.36 MB (146131709) - BytesReadDataNodeCache: 0 - BytesReadLocal: 139.36 MB (146131709) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 139.36 MB (146131709) - DecompressionTime: 999.623ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 116 (116) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 29.38 MB (30807780) - PerReadThreadRawHdfsThroughput: 18.73 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 132.154ms - RowBatchQueuePutWaitTime: 1h39m - RowsRead: 77.12M (77122649) - RowsReturned: 76.98M (76982502) - RowsReturnedRate: 112.24 M/sec - ScanRangesComplete: 1.82K (1817) - ScannerThreadsInvoluntaryContextSwitches: 37.19K (37194) - ScannerThreadsTotalWallClockTime: 1h46m - MaterializeTupleTime(*): 5s904ms - ScannerThreadsSysTime: 3m15s - ScannerThreadsUserTime: 2m39s - ScannerThreadsVoluntaryContextSwitches: 17.84M (17839854) - TotalRawHdfsReadTime(*): 7s442ms - TotalReadThroughput: 267.49 KB/sec Filter 2 (16.00 MB): - Rows processed: 2.00M (2001779) - Rows rejected: 140.14K (140139) - Rows total: 77.12M (77122649) Filter 5 (16.00 MB): - Rows processed: 1.75M (1745928) - Rows rejected: 8 (8) - Rows total: 76.98M (76982510) Filter 6 (1.00 MB): - Files processed: 1.82K (1817) - Files rejected: 1.70K (1701) - Files total: 1.82K (1817) - RowGroups processed: 75.15K (75150) - RowGroups rejected: 0 (0) - RowGroups total: 75.15K (75150) - Rows processed: 1.90M (1900544) - Rows rejected: 0 (0) - Rows total: 76.98M (76982502) - Splits processed: 116 (116) - Splits rejected: 0 (0) - Splits total: 116 (116) Instance 7f40dcb034de70b7:8b (host=vc1525.foo:22000):(Total: 8m54s, non-child: 8m33s, % non-child: 96.04%) Hdfs split stats (:<# splits>/): 2:236/13.40 GB 6:237/14.05 GB 4:214/12.62 GB 1:192/10.55 GB 3:215/12.18 GB 7:268/15.21 GB 0:220/12.91 GB 5:249/14.80 GB Filter 6 arrival: 1s090ms Filter 2 arrival: 11s414ms Filter 5 arrival: 15s861ms MemoryUsage(16s000ms): 35.94 MB, 66.80 MB, 66.77 MB, 65.86 MB, 65.75 MB, 65.79 MB, 65.96 MB, 65.82 MB, 65.84 MB, 65.77 MB, 65.85 MB, 65.46 MB, 65.77 MB, 65.64 MB, 65.88 MB, 66.85 MB, 66.75 MB, 66.64 MB, 66.83 MB, 66.64 MB, 64.79 MB, 64.83 MB, 64.80 MB, 65.20 MB, 65.73 MB, 65.81 MB, 65.81 MB, 65.90 MB, 58.76 MB, 57.88 MB, 57.94 MB, 56.39 MB, 55.67 MB ThreadUsage(16s000ms): 11, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.96 - BloomFilterBytes: 33.00 MB (34603008) - PeakMemoryUsage: 67.33 MB (70602136) - PerHostPeakMemUsage: 161.65 GB (173574409935) - RowsProduced: 76.86M (76860520) - TotalNetworkReceiveTime: 844.722ms - TotalNetworkSendTime: 8m28s - TotalStorageWaitTime: 12s522ms - TotalThreadsInvoluntaryContextSwitches: 40.30K (40297) - TotalThreadsTotalWallClockTime: 1h55m - TotalThreadsSysTime: 3m - TotalThreadsUserTime: 2m55s - TotalThreadsVoluntaryContextSwitches: 20.93M (20933353) Fragment Instance Lifecycle Timings: - ExecTime: 8m53s - ExecTreeExecTime: 4s250ms - OpenTime: 1s220ms - ExecTreeOpenTime: 1s028ms - PrepareTime: 57.548ms - ExecTreePrepareTime: 7.288ms DataStreamSender (dst_id=22):(Total: 15s714ms, non-child: 15s714ms, % non-child: 100.00%) - BytesSent: 711.05 MB (745588957) - NetworkThroughput(*): 84.00 MB/sec - OverallThroughput: 45.25 MB/sec - PeakMemoryUsage: 5.00 MB (5240576) - RowsReturned: 76.86M (76860520) - SerializeBatchTime: 7s229ms - TransmitDataRPCTime: 8s465ms - UncompressedRowBatchSize: 2.15 GB (2306642600) CodeGen:(Total: 215.059ms, non-child: 215.059ms, % non-child: 100.00%) - CodegenTime: 1.230ms - CompileTime: 57.168ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 133.472ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 23.840ms HASH_JOIN_NODE (id=5):(Total: 5s247ms, non-child: 3s105ms, % non-child: 59.17%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.483ms - PeakMemoryUsage: 1.24 MB (1297318) - ProbeRows: 76.86M (76860520) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 2s956ms - RowsReturned: 76.86M (76860520) - RowsReturnedRate: 14.65 M/sec Hash Join Builder (join_node_id=5): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 29.949us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 122.708us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 45.272us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 844.734ms, non-child: 22.269us, % non-child: 0.00%) BytesReceived(16s000ms): 901.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 5.774us - DeserializeRowBatchTimer: 18.282us - FirstBatchArrivalWaitTime: 829.664ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 142.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=3):(Total: 1s298ms, non-child: 1s298ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:236/13.40 GB 6:237/14.05 GB 4:214/12.62 GB 1:192/10.55 GB 3:215/12.18 GB 7:268/15.21 GB 0:220/12.91 GB 5:249/14.80 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 116 out of 116 Runtime filters: Only following filters arrived: 6, waited 40ms Hdfs Read Thread Concurrency Bucket: 0:99.25% 1:0.754% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1715 PARQUET/SNAPPY:116 BytesRead(16s000ms): 13.21 MB, 14.58 MB, 15.16 MB, 21.86 MB, 28.96 MB, 29.94 MB, 40.05 MB, 43.62 MB, 46.21 MB, 57.92 MB, 58.85 MB, 63.39 MB, 72.65 MB, 73.43 MB, 79.92 MB, 87.32 MB, 88.12 MB, 99.52 MB, 102.02 MB, 103.92 MB, 115.36 MB, 116.28 MB, 116.96 MB, 120.77 MB, 130.85 MB, 130.85 MB, 131.49 MB, 133.72 MB, 140.30 MB, 140.41 MB, 140.41 MB, 140.41 MB, 140.41 MB - FooterProcessingTime: (Avg: 59.816ms ; Min: 13.463ms ; Max: 188.527ms ; Number of samples: 116) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 11.98 - BytesRead: 140.41 MB (147235038) - BytesReadDataNodeCache: 0 - BytesReadLocal: 140.41 MB (147235038) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 140.41 MB (147235038) - DecompressionTime: 1s250ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 116 (116) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 29.25 MB (30675778) - PerReadThreadRawHdfsThroughput: 21.87 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 136.543ms - RowBatchQueuePutWaitTime: 1h40m - RowsRead: 77.00M (76998331) - RowsReturned: 76.86M (76860520) - RowsReturnedRate: 59.19 M/sec - ScanRangesComplete: 1.83K (1831) - ScannerThreadsInvoluntaryContextSwitches: 35.39K (35394) - ScannerThreadsTotalWallClockTime: 1h46m - MaterializeTupleTime(*): 5s532ms - ScannerThreadsSysTime: 2m59s - ScannerThreadsUserTime: 2m32s - ScannerThreadsVoluntaryContextSwitches: 20.93M (20930185) - TotalRawHdfsReadTime(*): 6s421ms - TotalReadThroughput: 270.78 KB/sec Filter 2 (16.00 MB): - Rows processed: 2.00M (1997395) - Rows rejected: 137.77K (137770) - Rows total: 77.00M (76998331) Filter 5 (16.00 MB): - Rows processed: 1.86M (1859625) - Rows rejected: 41 (41) - Rows total: 76.86M (76860561) Filter 6 (1.00 MB): - Files processed: 1.83K (1831) - Files rejected: 1.72K (1715) - Files total: 1.83K (1831) - RowGroups processed: 75.04K (75039) - RowGroups rejected: 0 (0) - RowGroups total: 75.04K (75039) - Rows processed: 1.90M (1900544) - Rows rejected: 0 (0) - Rows total: 76.86M (76860520) - Splits processed: 116 (116) - Splits rejected: 0 (0) - Splits total: 116 (116) Instance 7f40dcb034de70b7:9f (host=ve1130.foo:22000):(Total: 8m54s, non-child: 8m33s, % non-child: 96.11%) Hdfs split stats (:<# splits>/): 4:250/14.41 GB 0:230/12.84 GB 3:221/14.13 GB 7:221/13.06 GB 6:222/11.87 GB 5:225/13.03 GB 2:224/12.77 GB 1:222/13.56 GB Filter 6 arrival: 1s047ms Filter 2 arrival: 12s110ms Filter 5 arrival: 16s099ms MemoryUsage(16s000ms): 34.79 MB, 66.03 MB, 66.78 MB, 66.68 MB, 66.79 MB, 65.79 MB, 65.53 MB, 66.14 MB, 66.76 MB, 66.75 MB, 66.77 MB, 65.88 MB, 65.80 MB, 65.77 MB, 66.38 MB, 65.95 MB, 65.78 MB, 65.74 MB, 66.72 MB, 66.81 MB, 64.78 MB, 64.81 MB, 64.81 MB, 64.64 MB, 66.53 MB, 66.84 MB, 66.82 MB, 66.73 MB, 66.39 MB, 62.60 MB, 56.68 MB, 53.72 MB, 52.81 MB ThreadUsage(16s000ms): 12, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.97 - BloomFilterBytes: 33.00 MB (34603008) - PeakMemoryUsage: 67.43 MB (70704110) - PerHostPeakMemUsage: 161.66 GB (173581408433) - RowsProduced: 76.26M (76261011) - TotalNetworkReceiveTime: 834.231ms - TotalNetworkSendTime: 8m28s - TotalStorageWaitTime: 13s230ms - TotalThreadsInvoluntaryContextSwitches: 38.13K (38129) - TotalThreadsTotalWallClockTime: 1h55m - TotalThreadsSysTime: 3m13s - TotalThreadsUserTime: 2m21s - TotalThreadsVoluntaryContextSwitches: 13.40M (13402115) Fragment Instance Lifecycle Timings: - ExecTime: 8m53s - ExecTreeExecTime: 3s567ms - OpenTime: 1s163ms - ExecTreeOpenTime: 987.078ms - PrepareTime: 39.624ms - ExecTreePrepareTime: 5.551ms DataStreamSender (dst_id=22):(Total: 16s051ms, non-child: 16s051ms, % non-child: 100.00%) - BytesSent: 706.65 MB (740976843) - NetworkThroughput(*): 76.66 MB/sec - OverallThroughput: 44.02 MB/sec - PeakMemoryUsage: 4.85 MB (5084928) - RowsReturned: 76.26M (76261011) - SerializeBatchTime: 6s814ms - TransmitDataRPCTime: 9s218ms - UncompressedRowBatchSize: 2.13 GB (2288650874) CodeGen:(Total: 190.207ms, non-child: 190.207ms, % non-child: 100.00%) - CodegenTime: 993.531us - CompileTime: 52.826ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 122.334ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 14.626ms HASH_JOIN_NODE (id=5):(Total: 4s521ms, non-child: 3s112ms, % non-child: 68.85%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.533ms - PeakMemoryUsage: 1.24 MB (1296151) - ProbeRows: 76.26M (76261011) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 2s961ms - RowsReturned: 76.26M (76261011) - RowsReturnedRate: 16.87 M/sec Hash Join Builder (join_node_id=5): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 27.970us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 136.254us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 56.835us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 834.243ms, non-child: 22.837us, % non-child: 0.00%) BytesReceived(16s000ms): 932.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 5.255us - DeserializeRowBatchTimer: 12.391us - FirstBatchArrivalWaitTime: 803.415ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 143.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=3):(Total: 574.754ms, non-child: 574.754ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:250/14.41 GB 0:230/12.84 GB 3:221/14.13 GB 7:221/13.06 GB 6:222/11.87 GB 5:225/13.03 GB 2:224/12.77 GB 1:222/13.56 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 116 out of 116 Runtime filters: Only following filters arrived: 6, waited 40ms Hdfs Read Thread Concurrency Bucket: 0:98.97% 1:1.033% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1699 PARQUET/SNAPPY:116 BytesRead(16s000ms): 12.74 MB, 14.26 MB, 15.60 MB, 21.21 MB, 29.13 MB, 30.59 MB, 39.36 MB, 44.12 MB, 46.30 MB, 57.37 MB, 59.28 MB, 63.42 MB, 72.85 MB, 74.37 MB, 79.94 MB, 87.82 MB, 89.52 MB, 99.11 MB, 102.80 MB, 104.64 MB, 113.27 MB, 116.72 MB, 117.50 MB, 120.31 MB, 129.32 MB, 131.44 MB, 132.10 MB, 133.53 MB, 137.25 MB, 139.84 MB, 139.84 MB, 139.84 MB, 139.84 MB - FooterProcessingTime: (Avg: 64.999ms ; Min: 22.988ms ; Max: 264.047ms ; Number of samples: 116) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 11.98 - BytesRead: 139.84 MB (146632868) - BytesReadDataNodeCache: 0 - BytesReadLocal: 139.84 MB (146632868) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 139.84 MB (146632868) - DecompressionTime: 2s651ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 116 (116) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 29.25 MB (30666602) - PerReadThreadRawHdfsThroughput: 20.54 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 106.553ms - RowBatchQueuePutWaitTime: 1h40m - RowsRead: 76.40M (76401913) - RowsReturned: 76.26M (76261011) - RowsReturnedRate: 132.68 M/sec - ScanRangesComplete: 1.81K (1815) - ScannerThreadsInvoluntaryContextSwitches: 33.46K (33464) - ScannerThreadsTotalWallClockTime: 1h46m - MaterializeTupleTime(*): 6s023ms - ScannerThreadsSysTime: 3m12s - ScannerThreadsUserTime: 2m - ScannerThreadsVoluntaryContextSwitches: 13.40M (13398966) - TotalRawHdfsReadTime(*): 6s809ms - TotalReadThroughput: 268.91 KB/sec Filter 2 (16.00 MB): - Rows processed: 1.99M (1990246) - Rows rejected: 140.86K (140860) - Rows total: 76.40M (76401913) Filter 5 (16.00 MB): - Rows processed: 1.78M (1776682) - Rows rejected: 42 (42) - Rows total: 76.26M (76261053) Filter 6 (1.00 MB): - Files processed: 1.81K (1815) - Files rejected: 1.70K (1699) - Files total: 1.81K (1815) - RowGroups processed: 74.45K (74453) - RowGroups rejected: 0 (0) - RowGroups total: 74.45K (74453) - Rows processed: 1.90M (1900544) - Rows rejected: 0 (0) - Rows total: 76.26M (76261011) - Splits processed: 116 (116) - Splits rejected: 0 (0) - Splits total: 116 (116) Instance 7f40dcb034de70b7:7e (host=vd1119.foo:22000):(Total: 8m54s, non-child: 8m33s, % non-child: 96.09%) Hdfs split stats (:<# splits>/): 6:230/13.28 GB 0:243/14.24 GB 4:224/13.77 GB 3:217/12.26 GB 7:221/13.08 GB 2:215/11.77 GB 1:227/13.23 GB 5:240/14.03 GB Filter 6 arrival: 1s149ms Filter 2 arrival: 11s118ms Filter 5 arrival: 15s640ms MemoryUsage(16s000ms): 37.40 MB, 66.76 MB, 66.76 MB, 66.70 MB, 66.81 MB, 66.75 MB, 66.73 MB, 66.78 MB, 66.44 MB, 66.74 MB, 66.82 MB, 66.72 MB, 66.77 MB, 66.77 MB, 66.62 MB, 66.83 MB, 66.47 MB, 65.80 MB, 65.76 MB, 65.54 MB, 66.21 MB, 66.86 MB, 66.80 MB, 66.56 MB, 65.83 MB, 65.70 MB, 65.58 MB, 65.42 MB, 60.66 MB, 60.09 MB, 59.79 MB, 55.02 MB, 51.45 MB ThreadUsage(16s000ms): 12, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.86 - BloomFilterBytes: 33.00 MB (34603008) - PeakMemoryUsage: 67.40 MB (70674972) - PerHostPeakMemUsage: 161.67 GB (173589808711) - RowsProduced: 77.61M (77605971) - TotalNetworkReceiveTime: 921.753ms - TotalNetworkSendTime: 8m27s - TotalStorageWaitTime: 11s691ms - TotalThreadsInvoluntaryContextSwitches: 39.96K (39959) - TotalThreadsTotalWallClockTime: 1h54m - TotalThreadsSysTime: 2m58s - TotalThreadsUserTime: 2m50s - TotalThreadsVoluntaryContextSwitches: 12.42M (12417559) Fragment Instance Lifecycle Timings: - ExecTime: 8m52s - ExecTreeExecTime: 3s577ms - OpenTime: 1s248ms - ExecTreeOpenTime: 1s069ms - PrepareTime: 52.489ms - ExecTreePrepareTime: 6.113ms DataStreamSender (dst_id=22):(Total: 16s081ms, non-child: 16s081ms, % non-child: 100.00%) - BytesSent: 720.32 MB (755305751) - NetworkThroughput(*): 78.85 MB/sec - OverallThroughput: 44.79 MB/sec - PeakMemoryUsage: 5.03 MB (5273344) - RowsReturned: 77.61M (77605971) - SerializeBatchTime: 6s925ms - TransmitDataRPCTime: 9s135ms - UncompressedRowBatchSize: 2.17 GB (2329014138) CodeGen:(Total: 200.811ms, non-child: 200.811ms, % non-child: 100.00%) - CodegenTime: 1.020ms - CompileTime: 52.809ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 124.305ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 23.246ms HASH_JOIN_NODE (id=5):(Total: 4s608ms, non-child: 3s094ms, % non-child: 67.15%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.477ms - PeakMemoryUsage: 1.23 MB (1293438) - ProbeRows: 77.61M (77605971) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 2s925ms - RowsReturned: 77.61M (77605971) - RowsReturnedRate: 16.84 M/sec Hash Join Builder (join_node_id=5): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 28.343us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 124.017us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 54.241us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 921.766ms, non-child: 21.777us, % non-child: 0.00%) BytesReceived(16s000ms): 932.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 5.771us - DeserializeRowBatchTimer: 20.047us - FirstBatchArrivalWaitTime: 896.803ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 130.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=3):(Total: 592.446ms, non-child: 592.446ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 6:230/13.28 GB 0:243/14.24 GB 4:224/13.77 GB 3:217/12.26 GB 7:221/13.08 GB 2:215/11.77 GB 1:227/13.23 GB 5:240/14.03 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 118 out of 118 Runtime filters: Only following filters arrived: 6, waited 40ms Hdfs Read Thread Concurrency Bucket: 0:98.96% 1:0.754% 2:0.09425% 3:0.09425% 4:0.09425% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1699 PARQUET/SNAPPY:118 BytesRead(16s000ms): 13.26 MB, 14.63 MB, 15.52 MB, 22.91 MB, 29.26 MB, 31.79 MB, 41.54 MB, 44.56 MB, 48.79 MB, 58.41 MB, 59.66 MB, 65.81 MB, 73.48 MB, 75.47 MB, 82.90 MB, 88.56 MB, 92.13 MB, 102.07 MB, 102.96 MB, 107.36 MB, 116.67 MB, 117.55 MB, 120.05 MB, 126.63 MB, 131.91 MB, 132.09 MB, 134.91 MB, 139.49 MB, 143.04 MB, 143.04 MB, 143.04 MB, 143.04 MB, 143.04 MB - FooterProcessingTime: (Avg: 54.909ms ; Min: 22.477ms ; Max: 185.659ms ; Number of samples: 118) - AverageHdfsReadThreadConcurrency: 0.02 - AverageScannerThreadConcurrency: 11.92 - BytesRead: 143.04 MB (149984260) - BytesReadDataNodeCache: 0 - BytesReadLocal: 143.04 MB (149984260) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 143.04 MB (149984260) - DecompressionTime: 670.313ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 118 (118) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 29.22 MB (30640327) - PerReadThreadRawHdfsThroughput: 24.45 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 100.814ms - RowBatchQueuePutWaitTime: 1h39m - RowsRead: 77.75M (77746620) - RowsReturned: 77.61M (77605971) - RowsReturnedRate: 130.99 M/sec - ScanRangesComplete: 1.82K (1817) - ScannerThreadsInvoluntaryContextSwitches: 35.20K (35202) - ScannerThreadsTotalWallClockTime: 1h45m - MaterializeTupleTime(*): 6s285ms - ScannerThreadsSysTime: 2m58s - ScannerThreadsUserTime: 2m28s - ScannerThreadsVoluntaryContextSwitches: 12.41M (12414435) - TotalRawHdfsReadTime(*): 5s850ms - TotalReadThroughput: 276.10 KB/sec Filter 2 (16.00 MB): - Rows processed: 2.00M (2002281) - Rows rejected: 140.62K (140620) - Rows total: 77.75M (77746620) Filter 5 (16.00 MB): - Rows processed: 1.86M (1861661) - Rows rejected: 29 (29) - Rows total: 77.61M (77606000) Filter 6 (1.00 MB): - Files processed: 1.82K (1817) - Files rejected: 1.70K (1699) - Files total: 1.82K (1817) - RowGroups processed: 75.76K (75763) - RowGroups rejected: 0 (0) - RowGroups total: 75.76K (75763) - Rows processed: 1.93M (1933312) - Rows rejected: 0 (0) - Rows total: 77.61M (77605971) - Splits processed: 118 (118) - Splits rejected: 0 (0) - Splits total: 118 (118) Instance 7f40dcb034de70b7:90 (host=vc1519.foo:22000):(Total: 8m54s, non-child: 8m31s, % non-child: 95.67%) Hdfs split stats (:<# splits>/): 0:212/12.17 GB 6:196/11.49 GB 2:253/14.68 GB 4:218/12.85 GB 5:239/14.56 GB 1:239/13.77 GB 7:214/12.61 GB 3:234/13.55 GB Filter 6 arrival: 1s087ms Filter 2 arrival: 11s557ms Filter 5 arrival: 15s868ms MemoryUsage(16s000ms): 37.51 MB, 66.78 MB, 66.80 MB, 66.02 MB, 65.83 MB, 65.75 MB, 66.36 MB, 66.81 MB, 66.61 MB, 64.96 MB, 64.77 MB, 64.88 MB, 66.77 MB, 66.77 MB, 66.27 MB, 66.79 MB, 66.79 MB, 65.39 MB, 66.80 MB, 66.78 MB, 66.70 MB, 66.84 MB, 66.72 MB, 66.72 MB, 66.72 MB, 66.88 MB, 66.81 MB, 66.74 MB, 63.04 MB, 57.66 MB, 55.75 MB, 54.36 MB, 51.93 MB ThreadUsage(16s000ms): 12, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.91 - BloomFilterBytes: 33.00 MB (34603008) - PeakMemoryUsage: 67.51 MB (70793313) - PerHostPeakMemUsage: 161.66 GB (173575931572) - RowsProduced: 76.34M (76341083) - TotalNetworkReceiveTime: 843.602ms - TotalNetworkSendTime: 8m23s - TotalStorageWaitTime: 11s373ms - TotalThreadsInvoluntaryContextSwitches: 42.79K (42786) - TotalThreadsTotalWallClockTime: 1h54m - TotalThreadsSysTime: 3m48s - TotalThreadsUserTime: 2m34s - TotalThreadsVoluntaryContextSwitches: 12.52M (12515918) Fragment Instance Lifecycle Timings: - ExecTime: 8m52s - ExecTreeExecTime: 5s514ms - OpenTime: 1s207ms - ExecTreeOpenTime: 1s015ms - PrepareTime: 56.694ms - ExecTreePrepareTime: 8.634ms DataStreamSender (dst_id=22):(Total: 16s443ms, non-child: 16s443ms, % non-child: 100.00%) - BytesSent: 707.76 MB (742144230) - NetworkThroughput(*): 76.62 MB/sec - OverallThroughput: 43.04 MB/sec - PeakMemoryUsage: 4.98 MB (5224192) - RowsReturned: 76.34M (76341083) - SerializeBatchTime: 7s185ms - TransmitDataRPCTime: 9s237ms - UncompressedRowBatchSize: 2.13 GB (2291053938) CodeGen:(Total: 210.719ms, non-child: 210.719ms, % non-child: 100.00%) - CodegenTime: 1.183ms - CompileTime: 58.482ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 132.182ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 19.592ms HASH_JOIN_NODE (id=5):(Total: 6s501ms, non-child: 3s095ms, % non-child: 47.61%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.487ms - PeakMemoryUsage: 1.24 MB (1297174) - ProbeRows: 76.34M (76341083) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 2s937ms - RowsReturned: 76.34M (76341083) - RowsReturnedRate: 11.74 M/sec Hash Join Builder (join_node_id=5): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 27.102us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 143.156us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 66.033us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 843.611ms, non-child: 18.161us, % non-child: 0.00%) BytesReceived(16s000ms): 932.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 4.243us - DeserializeRowBatchTimer: 13.571us - FirstBatchArrivalWaitTime: 813.669ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 142.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=3):(Total: 2s563ms, non-child: 2s563ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:212/12.17 GB 6:196/11.49 GB 2:253/14.68 GB 4:218/12.85 GB 5:239/14.56 GB 1:239/13.77 GB 7:214/12.61 GB 3:234/13.55 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 116 out of 116 Runtime filters: Only following filters arrived: 6, waited 40ms Hdfs Read Thread Concurrency Bucket: 0:98.58% 1:1.133% 2:0.2833% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1689 PARQUET/SNAPPY:116 BytesRead(16s000ms): 13.74 MB, 14.69 MB, 15.05 MB, 21.74 MB, 29.39 MB, 30.06 MB, 40.78 MB, 44.17 MB, 45.82 MB, 57.16 MB, 58.98 MB, 62.78 MB, 73.63 MB, 74.03 MB, 80.53 MB, 88.39 MB, 89.41 MB, 99.68 MB, 103.22 MB, 104.40 MB, 114.08 MB, 117.83 MB, 118.32 MB, 121.83 MB, 131.97 MB, 133.05 MB, 133.43 MB, 135.66 MB, 141.10 MB, 141.75 MB, 141.75 MB, 141.75 MB, 141.75 MB - FooterProcessingTime: (Avg: 51.722ms ; Min: 21.010ms ; Max: 200.040ms ; Number of samples: 116) - AverageHdfsReadThreadConcurrency: 0.02 - AverageScannerThreadConcurrency: 11.98 - BytesRead: 141.75 MB (148637141) - BytesReadDataNodeCache: 0 - BytesReadLocal: 141.75 MB (148637141) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 141.75 MB (148637141) - DecompressionTime: 2s120ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 116 (116) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 29.25 MB (30672620) - PerReadThreadRawHdfsThroughput: 24.37 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 124.609ms - RowBatchQueuePutWaitTime: 1h39m - RowsRead: 76.48M (76479551) - RowsReturned: 76.34M (76341083) - RowsReturnedRate: 29.78 M/sec - ScanRangesComplete: 1.80K (1805) - ScannerThreadsInvoluntaryContextSwitches: 37.94K (37938) - ScannerThreadsTotalWallClockTime: 1h46m - MaterializeTupleTime(*): 6s901ms - ScannerThreadsSysTime: 3m47s - ScannerThreadsUserTime: 2m11s - ScannerThreadsVoluntaryContextSwitches: 12.51M (12512804) - TotalRawHdfsReadTime(*): 5s816ms - TotalReadThroughput: 274.13 KB/sec Filter 2 (16.00 MB): - Rows processed: 1.96M (1959140) - Rows rejected: 138.43K (138434) - Rows total: 76.48M (76479551) Filter 5 (16.00 MB): - Rows processed: 1.80M (1796130) - Rows rejected: 34 (34) - Rows total: 76.34M (76341117) Filter 6 (1.00 MB): - Files processed: 1.80K (1805) - Files rejected: 1.69K (1689) - Files total: 1.80K (1805) - RowGroups processed: 74.53K (74533) - RowGroups rejected: 0 (0) - RowGroups total: 74.53K (74533) - Rows processed: 1.90M (1900544) - Rows rejected: 0 (0) - Rows total: 76.34M (76341083) - Splits processed: 116 (116) - Splits rejected: 0 (0) - Splits total: 116 (116) Instance 7f40dcb034de70b7:c8 (host=vd1338.foo:22000):(Total: 8m54s, non-child: 8m32s, % non-child: 96.01%) Hdfs split stats (:<# splits>/): 4:244/14.06 GB 0:222/12.58 GB 5:230/13.58 GB 1:217/12.85 GB 7:235/13.46 GB 3:223/12.79 GB 2:220/12.98 GB 6:229/13.36 GB Filter 6 arrival: 845ms Filter 2 arrival: 12s919ms Filter 5 arrival: 16s616ms MemoryUsage(16s000ms): 35.78 MB, 66.27 MB, 66.81 MB, 66.40 MB, 66.77 MB, 66.82 MB, 66.55 MB, 66.80 MB, 66.42 MB, 66.73 MB, 66.78 MB, 66.25 MB, 65.83 MB, 65.77 MB, 65.59 MB, 66.81 MB, 66.67 MB, 66.70 MB, 66.84 MB, 66.61 MB, 65.75 MB, 65.83 MB, 65.85 MB, 65.79 MB, 66.82 MB, 66.87 MB, 66.76 MB, 64.65 MB, 56.81 MB, 56.91 MB, 56.85 MB, 56.81 MB, 56.21 MB ThreadUsage(16s000ms): 12, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.98 - BloomFilterBytes: 33.00 MB (34603008) - PeakMemoryUsage: 67.55 MB (70829094) - PerHostPeakMemUsage: 161.66 GB (173583654385) - RowsProduced: 77.00M (77001344) - TotalNetworkReceiveTime: 609.000ms - TotalNetworkSendTime: 8m25s - TotalStorageWaitTime: 12s207ms - TotalThreadsInvoluntaryContextSwitches: 42.84K (42844) - TotalThreadsTotalWallClockTime: 1h55m - TotalThreadsSysTime: 3m7s - TotalThreadsUserTime: 3m3s - TotalThreadsVoluntaryContextSwitches: 18.85M (18845478) Fragment Instance Lifecycle Timings: - ExecTime: 8m53s - ExecTreeExecTime: 3s654ms - OpenTime: 1s097ms - ExecTreeOpenTime: 908.911ms - PrepareTime: 51.949ms - ExecTreePrepareTime: 6.083ms DataStreamSender (dst_id=22):(Total: 16s597ms, non-child: 16s597ms, % non-child: 100.00%) - BytesSent: 713.27 MB (747916431) - NetworkThroughput(*): 77.10 MB/sec - OverallThroughput: 42.97 MB/sec - PeakMemoryUsage: 4.98 MB (5224192) - RowsReturned: 77.00M (77001344) - SerializeBatchTime: 7s325ms - TransmitDataRPCTime: 9s251ms - UncompressedRowBatchSize: 2.15 GB (2310868800) CodeGen:(Total: 207.798ms, non-child: 207.798ms, % non-child: 100.00%) - CodegenTime: 1.113ms - CompileTime: 55.321ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 131.743ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 20.332ms HASH_JOIN_NODE (id=5):(Total: 4s529ms, non-child: 3s205ms, % non-child: 70.76%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.890ms - PeakMemoryUsage: 1.24 MB (1297846) - ProbeRows: 77.00M (77001344) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3s040ms - RowsReturned: 77.00M (77001344) - RowsReturnedRate: 17.00 M/sec Hash Join Builder (join_node_id=5): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 23.364us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 312.142us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 69.954us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 609.011ms, non-child: 19.005us, % non-child: 0.00%) BytesReceived(16s000ms): 963.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 5.292us - DeserializeRowBatchTimer: 31.289us - FirstBatchArrivalWaitTime: 597.806ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 197.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=3):(Total: 715.749ms, non-child: 715.749ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:244/14.06 GB 0:222/12.58 GB 5:230/13.58 GB 1:217/12.85 GB 7:235/13.46 GB 3:223/12.79 GB 2:220/12.98 GB 6:229/13.36 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 117 out of 117 Runtime filters: Only following filters arrived: 6, waited 181ms Hdfs Read Thread Concurrency Bucket: 0:99.06% 1:0.6573% 2:0.0939% 3:0.0939% 4:0% 5:0.0939% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1703 PARQUET/SNAPPY:117 BytesRead(16s000ms): 13.67 MB, 14.58 MB, 14.58 MB, 20.50 MB, 29.05 MB, 29.05 MB, 40.80 MB, 43.82 MB, 44.75 MB, 58.33 MB, 58.45 MB, 62.74 MB, 72.99 MB, 72.99 MB, 82.14 MB, 87.94 MB, 88.06 MB, 101.77 MB, 102.52 MB, 103.22 MB, 116.97 MB, 117.26 MB, 117.26 MB, 124.68 MB, 131.76 MB, 131.76 MB, 131.76 MB, 134.63 MB, 141.48 MB, 141.48 MB, 141.48 MB, 141.48 MB, 141.48 MB - FooterProcessingTime: (Avg: 58.244ms ; Min: 4.496ms ; Max: 175.122ms ; Number of samples: 117) - AverageHdfsReadThreadConcurrency: 0.02 - AverageScannerThreadConcurrency: 11.98 - BytesRead: 141.48 MB (148348101) - BytesReadDataNodeCache: 0 - BytesReadLocal: 141.48 MB (148348101) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 141.48 MB (148348101) - DecompressionTime: 1s061ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 117 (117) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 29.39 MB (30819681) - PerReadThreadRawHdfsThroughput: 23.21 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 111.899ms - RowBatchQueuePutWaitTime: 1h40m - RowsRead: 77.14M (77141232) - RowsReturned: 77.00M (77001344) - RowsReturnedRate: 107.58 M/sec - ScanRangesComplete: 1.82K (1820) - ScannerThreadsInvoluntaryContextSwitches: 37.88K (37881) - ScannerThreadsTotalWallClockTime: 1h46m - MaterializeTupleTime(*): 6s283ms - ScannerThreadsSysTime: 3m7s - ScannerThreadsUserTime: 2m39s - ScannerThreadsVoluntaryContextSwitches: 18.84M (18842342) - TotalRawHdfsReadTime(*): 6s096ms - TotalReadThroughput: 272.06 KB/sec Filter 2 (16.00 MB): - Rows processed: 2.02M (2020976) - Rows rejected: 139.88K (139875) - Rows total: 77.14M (77141232) Filter 5 (16.00 MB): - Rows processed: 1.82M (1822733) - Rows rejected: 13 (13) - Rows total: 77.00M (77001357) Filter 6 (1.00 MB): - Files processed: 1.82K (1820) - Files rejected: 1.70K (1703) - Files total: 1.82K (1820) - RowGroups processed: 75.18K (75184) - RowGroups rejected: 0 (0) - RowGroups total: 75.18K (75184) - Rows processed: 1.92M (1916928) - Rows rejected: 0 (0) - Rows total: 77.00M (77001344) - Splits processed: 117 (117) - Splits rejected: 0 (0) - Splits total: 117 (117) Instance 7f40dcb034de70b7:92 (host=vd1330.foo:22000):(Total: 8m54s, non-child: 8m32s, % non-child: 95.99%) Hdfs split stats (:<# splits>/): 0:227/13.70 GB 4:229/13.42 GB 3:238/13.32 GB 7:216/13.12 GB 2:243/13.72 GB 5:229/13.47 GB 1:219/12.70 GB 6:219/12.22 GB Filter 6 arrival: 1s096ms Filter 2 arrival: 11s711ms Filter 5 arrival: 15s950ms MemoryUsage(16s000ms): 35.38 MB, 66.77 MB, 66.81 MB, 66.25 MB, 66.12 MB, 66.78 MB, 65.77 MB, 65.83 MB, 65.73 MB, 66.53 MB, 66.79 MB, 66.67 MB, 66.83 MB, 66.81 MB, 66.62 MB, 66.78 MB, 66.30 MB, 65.43 MB, 65.79 MB, 66.27 MB, 66.58 MB, 66.85 MB, 66.90 MB, 66.38 MB, 65.77 MB, 65.81 MB, 65.76 MB, 65.78 MB, 65.88 MB, 61.64 MB, 52.41 MB, 50.70 MB, 45.22 MB ThreadUsage(16s000ms): 11, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 9 - AverageThreadTokens: 12.77 - BloomFilterBytes: 33.00 MB (34603008) - PeakMemoryUsage: 67.49 MB (70763543) - PerHostPeakMemUsage: 161.66 GB (173579058324) - RowsProduced: 74.93M (74929265) - TotalNetworkReceiveTime: 876.144ms - TotalNetworkSendTime: 8m29s - TotalStorageWaitTime: 12s014ms - TotalThreadsInvoluntaryContextSwitches: 42.30K (42296) - TotalThreadsTotalWallClockTime: 1h53m - TotalThreadsSysTime: 3m58s - TotalThreadsUserTime: 1m50s - TotalThreadsVoluntaryContextSwitches: 9.74M (9737825) Fragment Instance Lifecycle Timings: - ExecTime: 8m52s - ExecTreeExecTime: 4s087ms - OpenTime: 1s212ms - ExecTreeOpenTime: 1s037ms - PrepareTime: 50.146ms - ExecTreePrepareTime: 6.145ms DataStreamSender (dst_id=22):(Total: 16s137ms, non-child: 16s137ms, % non-child: 100.00%) - BytesSent: 695.42 MB (729204694) - NetworkThroughput(*): 74.24 MB/sec - OverallThroughput: 43.09 MB/sec - PeakMemoryUsage: 4.98 MB (5224192) - RowsReturned: 74.93M (74929265) - SerializeBatchTime: 6s750ms - TransmitDataRPCTime: 9s367ms - UncompressedRowBatchSize: 2.09 GB (2248684126) CodeGen:(Total: 195.051ms, non-child: 195.051ms, % non-child: 100.00%) - CodegenTime: 969.018us - CompileTime: 52.015ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 120.850ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 21.789ms HASH_JOIN_NODE (id=5):(Total: 5s089ms, non-child: 3s111ms, % non-child: 61.13%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.591ms - PeakMemoryUsage: 1.24 MB (1297277) - ProbeRows: 74.93M (74929265) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 2s970ms - RowsReturned: 74.93M (74929265) - RowsReturnedRate: 14.72 M/sec Hash Join Builder (join_node_id=5): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 28.996us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 194.220us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 47.351us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 876.158ms, non-child: 22.889us, % non-child: 0.00%) BytesReceived(16s000ms): 901.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 7.972us - DeserializeRowBatchTimer: 15.769us - FirstBatchArrivalWaitTime: 842.164ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 136.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=3):(Total: 1s102ms, non-child: 1s102ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:227/13.70 GB 4:229/13.42 GB 3:238/13.32 GB 7:216/13.12 GB 2:243/13.72 GB 5:229/13.47 GB 1:219/12.70 GB 6:219/12.22 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 114 out of 114 Runtime filters: Only following filters arrived: 6, waited 40ms Hdfs Read Thread Concurrency Bucket: 0:98.57% 1:1.426% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1706 PARQUET/SNAPPY:114 BytesRead(16s000ms): 13.23 MB, 14.60 MB, 15.03 MB, 21.39 MB, 29.10 MB, 30.90 MB, 40.03 MB, 43.92 MB, 47.08 MB, 57.67 MB, 59.15 MB, 64.28 MB, 73.16 MB, 74.23 MB, 81.29 MB, 88.36 MB, 89.16 MB, 99.29 MB, 103.11 MB, 104.09 MB, 114.54 MB, 117.72 MB, 117.90 MB, 121.32 MB, 131.34 MB, 132.59 MB, 132.59 MB, 133.82 MB, 136.31 MB, 137.20 MB, 138.68 MB, 138.68 MB - FooterProcessingTime: (Avg: 58.356ms ; Min: 4.758ms ; Max: 189.241ms ; Number of samples: 114) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 11.90 - BytesRead: 138.68 MB (145418449) - BytesReadDataNodeCache: 0 - BytesReadLocal: 138.68 MB (145418449) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 138.68 MB (145418449) - DecompressionTime: 2s544ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 114 (114) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 29.31 MB (30729500) - PerReadThreadRawHdfsThroughput: 22.70 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 115.010ms - RowBatchQueuePutWaitTime: 1h38m - RowsRead: 75.06M (75064044) - RowsReturned: 74.93M (74929265) - RowsReturnedRate: 67.98 M/sec - ScanRangesComplete: 1.82K (1820) - ScannerThreadsInvoluntaryContextSwitches: 37.69K (37686) - ScannerThreadsTotalWallClockTime: 1h44m - MaterializeTupleTime(*): 6s264ms - ScannerThreadsSysTime: 3m57s - ScannerThreadsUserTime: 1m29s - ScannerThreadsVoluntaryContextSwitches: 9.73M (9734801) - TotalRawHdfsReadTime(*): 6s110ms - TotalReadThroughput: 269.72 KB/sec Filter 2 (16.00 MB): - Rows processed: 1.95M (1952379) - Rows rejected: 134.76K (134765) - Rows total: 75.06M (75064044) Filter 5 (16.00 MB): - Rows processed: 1.81M (1806350) - Rows rejected: 14 (14) - Rows total: 74.93M (74929279) Filter 6 (1.00 MB): - Files processed: 1.82K (1820) - Files rejected: 1.71K (1706) - Files total: 1.82K (1820) - RowGroups processed: 73.15K (73150) - RowGroups rejected: 0 (0) - RowGroups total: 73.15K (73150) - Rows processed: 1.87M (1867776) - Rows rejected: 0 (0) - Rows total: 74.93M (74929265) - Splits processed: 114 (114) - Splits rejected: 0 (0) - Splits total: 114 (114) Instance 7f40dcb034de70b7:ef (host=vc1514.foo:22000):(Total: 8m54s, non-child: 8m33s, % non-child: 96.10%) Hdfs split stats (:<# splits>/): 0:232/13.54 GB 5:233/14.52 GB 4:235/12.61 GB 7:225/12.47 GB 2:246/14.42 GB 3:214/12.16 GB 1:222/13.02 GB 6:215/12.92 GB Filter 6 arrival: 697ms Filter 2 arrival: 13s544ms Filter 5 arrival: 16s993ms MemoryUsage(16s000ms): 34.95 MB, 65.86 MB, 66.79 MB, 66.71 MB, 66.79 MB, 66.74 MB, 65.41 MB, 66.81 MB, 66.55 MB, 64.72 MB, 64.77 MB, 64.77 MB, 65.83 MB, 65.82 MB, 65.36 MB, 64.83 MB, 64.74 MB, 66.22 MB, 66.78 MB, 66.46 MB, 65.62 MB, 65.77 MB, 65.87 MB, 65.20 MB, 64.74 MB, 64.78 MB, 64.84 MB, 64.77 MB, 57.42 MB, 55.61 MB, 55.76 MB, 55.70 MB, 55.74 MB ThreadUsage(16s000ms): 12, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.98 - BloomFilterBytes: 33.00 MB (34603008) - PeakMemoryUsage: 67.58 MB (70859070) - PerHostPeakMemUsage: 161.67 GB (173596270576) - RowsProduced: 76.31M (76313973) - TotalNetworkReceiveTime: 234.198ms - TotalNetworkSendTime: 8m30s - TotalStorageWaitTime: 12s500ms - TotalThreadsInvoluntaryContextSwitches: 45.76K (45755) - TotalThreadsTotalWallClockTime: 1h55m - TotalThreadsSysTime: 3m42s - TotalThreadsUserTime: 2m54s - TotalThreadsVoluntaryContextSwitches: 20.28M (20279730) Fragment Instance Lifecycle Timings: - ExecTime: 8m52s - ExecTreeExecTime: 4s244ms - OpenTime: 1s093ms - ExecTreeOpenTime: 688.844ms - PrepareTime: 64.268ms - ExecTreePrepareTime: 7.204ms DataStreamSender (dst_id=22):(Total: 15s505ms, non-child: 15s505ms, % non-child: 100.00%) - BytesSent: 706.89 MB (741229304) - NetworkThroughput(*): 78.58 MB/sec - OverallThroughput: 45.59 MB/sec - PeakMemoryUsage: 5.01 MB (5248768) - RowsReturned: 76.31M (76313973) - SerializeBatchTime: 6s490ms - TransmitDataRPCTime: 8s995ms - UncompressedRowBatchSize: 2.13 GB (2290240294) CodeGen:(Total: 428.104ms, non-child: 428.104ms, % non-child: 100.00%) - CodegenTime: 1.259ms - CompileTime: 62.913ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 339.445ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 25.293ms HASH_JOIN_NODE (id=5):(Total: 4s909ms, non-child: 3s039ms, % non-child: 61.92%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.569ms - PeakMemoryUsage: 1.24 MB (1295794) - ProbeRows: 76.31M (76313973) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 2s891ms - RowsReturned: 76.31M (76313973) - RowsReturnedRate: 15.54 M/sec Hash Join Builder (join_node_id=5): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 38.883us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 170.266us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 72.356us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 234.214ms, non-child: 32.743us, % non-child: 0.01%) BytesReceived(16s000ms): 963.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 9.245us - DeserializeRowBatchTimer: 18.061us - FirstBatchArrivalWaitTime: 188.413ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 512.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=3):(Total: 1s636ms, non-child: 1s636ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:232/13.54 GB 5:233/14.52 GB 4:235/12.61 GB 7:225/12.47 GB 2:246/14.42 GB 3:214/12.16 GB 1:222/13.02 GB 6:215/12.92 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 116 out of 116 Runtime filters: Only following filters arrived: 6, waited 341ms Hdfs Read Thread Concurrency Bucket: 0:98.87% 1:0.9416% 2:0.1883% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1706 PARQUET/SNAPPY:116 BytesRead(16s000ms): 13.57 MB, 14.52 MB, 14.52 MB, 19.90 MB, 28.98 MB, 28.98 MB, 38.36 MB, 43.75 MB, 44.13 MB, 57.44 MB, 58.17 MB, 61.52 MB, 72.93 MB, 73.01 MB, 80.00 MB, 87.41 MB, 87.41 MB, 99.68 MB, 102.06 MB, 103.23 MB, 116.21 MB, 116.66 MB, 116.66 MB, 121.24 MB, 131.18 MB, 131.18 MB, 131.18 MB, 132.59 MB, 139.72 MB, 139.82 MB, 139.82 MB, 139.82 MB, 139.82 MB - FooterProcessingTime: (Avg: 60.946ms ; Min: 25.618ms ; Max: 326.404ms ; Number of samples: 116) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 11.99 - BytesRead: 139.82 MB (146616997) - BytesReadDataNodeCache: 0 - BytesReadLocal: 139.82 MB (146616997) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 139.82 MB (146616997) - DecompressionTime: 1s101ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 116 (116) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 29.39 MB (30818495) - PerReadThreadRawHdfsThroughput: 21.79 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 104.920ms - RowBatchQueuePutWaitTime: 1h39m - RowsRead: 76.46M (76456296) - RowsReturned: 76.31M (76313973) - RowsReturnedRate: 46.63 M/sec - ScanRangesComplete: 1.82K (1822) - ScannerThreadsInvoluntaryContextSwitches: 41.10K (41096) - ScannerThreadsTotalWallClockTime: 1h46m - MaterializeTupleTime(*): 5s148ms - ScannerThreadsSysTime: 3m41s - ScannerThreadsUserTime: 2m34s - ScannerThreadsVoluntaryContextSwitches: 20.28M (20276548) - TotalRawHdfsReadTime(*): 6s417ms - TotalReadThroughput: 269.39 KB/sec Filter 2 (16.00 MB): - Rows processed: 2.02M (2017265) - Rows rejected: 142.30K (142302) - Rows total: 76.46M (76456296) Filter 5 (16.00 MB): - Rows processed: 1.82M (1815573) - Rows rejected: 21 (21) - Rows total: 76.31M (76313994) Filter 6 (1.00 MB): - Files processed: 1.82K (1822) - Files rejected: 1.71K (1706) - Files total: 1.82K (1822) - RowGroups processed: 74.50K (74500) - RowGroups rejected: 0 (0) - RowGroups total: 74.50K (74500) - Rows processed: 1.90M (1900544) - Rows rejected: 0 (0) - Rows total: 76.31M (76313973) - Splits processed: 116 (116) - Splits rejected: 0 (0) - Splits total: 116 (116) Instance 7f40dcb034de70b7:c1 (host=vd1342.foo:22000):(Total: 8m54s, non-child: 8m32s, % non-child: 96.01%) Hdfs split stats (:<# splits>/): 0:230/13.52 GB 3:223/12.50 GB 1:224/13.46 GB 7:241/14.48 GB 6:222/13.06 GB 2:214/12.23 GB 4:212/12.24 GB 5:247/14.15 GB Filter 6 arrival: 899ms Filter 2 arrival: 12s932ms Filter 5 arrival: 16s492ms MemoryUsage(16s000ms): 34.70 MB, 66.31 MB, 66.81 MB, 66.37 MB, 65.80 MB, 65.79 MB, 66.32 MB, 66.75 MB, 66.42 MB, 65.57 MB, 65.80 MB, 65.95 MB, 66.76 MB, 66.81 MB, 66.34 MB, 65.76 MB, 65.80 MB, 66.27 MB, 66.80 MB, 66.68 MB, 65.69 MB, 65.80 MB, 65.83 MB, 64.70 MB, 64.74 MB, 64.76 MB, 64.81 MB, 64.43 MB, 58.73 MB, 58.01 MB, 58.09 MB, 57.92 MB, 57.44 MB ThreadUsage(16s000ms): 12, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.98 - BloomFilterBytes: 33.00 MB (34603008) - PeakMemoryUsage: 67.56 MB (70839481) - PerHostPeakMemUsage: 161.65 GB (173573585076) - RowsProduced: 76.77M (76774608) - TotalNetworkReceiveTime: 677.651ms - TotalNetworkSendTime: 8m26s - TotalStorageWaitTime: 13s017ms - TotalThreadsInvoluntaryContextSwitches: 41.00K (41000) - TotalThreadsTotalWallClockTime: 1h55m - TotalThreadsSysTime: 2m56s - TotalThreadsUserTime: 3m4s - TotalThreadsVoluntaryContextSwitches: 16.95M (16950843) Fragment Instance Lifecycle Timings: - ExecTime: 8m52s - ExecTreeExecTime: 3s658ms - OpenTime: 1s130ms - ExecTreeOpenTime: 954.179ms - PrepareTime: 48.443ms - ExecTreePrepareTime: 5.840ms DataStreamSender (dst_id=22):(Total: 16s514ms, non-child: 16s514ms, % non-child: 100.00%) - BytesSent: 708.03 MB (742419303) - NetworkThroughput(*): 77.52 MB/sec - OverallThroughput: 42.87 MB/sec - PeakMemoryUsage: 5.06 MB (5306112) - RowsReturned: 76.77M (76774608) - SerializeBatchTime: 7s362ms - TransmitDataRPCTime: 9s133ms - UncompressedRowBatchSize: 2.15 GB (2304064296) CodeGen:(Total: 196.288ms, non-child: 196.288ms, % non-child: 100.00%) - CodegenTime: 849.599us - CompileTime: 51.889ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 123.217ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 20.831ms HASH_JOIN_NODE (id=5):(Total: 4s577ms, non-child: 3s184ms, % non-child: 69.56%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.497ms - PeakMemoryUsage: 1.23 MB (1290942) - ProbeRows: 76.77M (76774608) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3s018ms - RowsReturned: 76.77M (76774608) - RowsReturnedRate: 16.77 M/sec Hash Join Builder (join_node_id=5): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 25.649us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 132.557us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 69.348us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 677.662ms, non-child: 21.923us, % non-child: 0.00%) BytesReceived(16s000ms): 932.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 4.784us - DeserializeRowBatchTimer: 17.333us - FirstBatchArrivalWaitTime: 635.162ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 177.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=3):(Total: 716.315ms, non-child: 716.315ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:230/13.52 GB 3:223/12.50 GB 1:224/13.46 GB 7:241/14.48 GB 6:222/13.06 GB 2:214/12.23 GB 4:212/12.24 GB 5:247/14.15 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 116 out of 116 Runtime filters: Only following filters arrived: 6, waited 121ms Hdfs Read Thread Concurrency Bucket: 0:98.78% 1:0.9372% 2:0.1874% 3:0.09372% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1697 PARQUET/SNAPPY:116 BytesRead(16s000ms): 13.18 MB, 14.51 MB, 14.51 MB, 19.97 MB, 28.68 MB, 28.68 MB, 39.51 MB, 42.99 MB, 44.14 MB, 56.93 MB, 57.47 MB, 61.19 MB, 72.11 MB, 72.11 MB, 78.26 MB, 86.33 MB, 86.36 MB, 98.13 MB, 100.92 MB, 101.63 MB, 114.11 MB, 115.30 MB, 115.30 MB, 122.32 MB, 129.34 MB, 129.50 MB, 129.50 MB, 131.31 MB, 139.12 MB, 139.12 MB, 139.12 MB, 139.12 MB, 139.12 MB - FooterProcessingTime: (Avg: 61.052ms ; Min: 4.077ms ; Max: 192.818ms ; Number of samples: 116) - AverageHdfsReadThreadConcurrency: 0.02 - AverageScannerThreadConcurrency: 11.99 - BytesRead: 139.12 MB (145879810) - BytesReadDataNodeCache: 0 - BytesReadLocal: 139.12 MB (145879810) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 139.12 MB (145879810) - DecompressionTime: 2s114ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 116 (116) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 29.33 MB (30757946) - PerReadThreadRawHdfsThroughput: 20.34 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 149.027ms - RowBatchQueuePutWaitTime: 1h40m - RowsRead: 76.92M (76915699) - RowsReturned: 76.77M (76774608) - RowsReturnedRate: 107.18 M/sec - ScanRangesComplete: 1.81K (1813) - ScannerThreadsInvoluntaryContextSwitches: 35.93K (35929) - ScannerThreadsTotalWallClockTime: 1h46m - MaterializeTupleTime(*): 6s358ms - ScannerThreadsSysTime: 2m55s - ScannerThreadsUserTime: 2m40s - ScannerThreadsVoluntaryContextSwitches: 16.95M (16947705) - TotalRawHdfsReadTime(*): 6s841ms - TotalReadThroughput: 266.78 KB/sec Filter 2 (16.00 MB): - Rows processed: 2.02M (2017059) - Rows rejected: 141.06K (141064) - Rows total: 76.92M (76915699) Filter 5 (16.00 MB): - Rows processed: 1.77M (1773595) - Rows rejected: 27 (27) - Rows total: 76.77M (76774635) Filter 6 (1.00 MB): - Files processed: 1.81K (1813) - Files rejected: 1.70K (1697) - Files total: 1.81K (1813) - RowGroups processed: 74.95K (74946) - RowGroups rejected: 0 (0) - RowGroups total: 74.95K (74946) - Rows processed: 1.90M (1900544) - Rows rejected: 0 (0) - Rows total: 76.77M (76774608) - Splits processed: 116 (116) - Splits rejected: 0 (0) - Splits total: 116 (116) Instance 7f40dcb034de70b7:cb (host=vd1120.foo:22000):(Total: 8m53s, non-child: 8m33s, % non-child: 96.15%) Hdfs split stats (:<# splits>/): 1:237/13.57 GB 0:238/13.79 GB 6:211/12.97 GB 7:225/13.74 GB 3:224/13.17 GB 2:227/12.86 GB 4:222/12.39 GB 5:226/13.17 GB Filter 6 arrival: 835ms Filter 2 arrival: 13s011ms Filter 5 arrival: 16s591ms MemoryUsage(16s000ms): 34.63 MB, 65.24 MB, 65.79 MB, 64.97 MB, 65.76 MB, 65.96 MB, 64.91 MB, 64.78 MB, 64.92 MB, 64.69 MB, 64.79 MB, 65.50 MB, 66.76 MB, 66.83 MB, 65.60 MB, 64.81 MB, 64.83 MB, 66.64 MB, 66.85 MB, 66.17 MB, 64.62 MB, 64.76 MB, 64.70 MB, 65.31 MB, 65.75 MB, 65.76 MB, 65.79 MB, 63.55 MB, 57.91 MB, 57.89 MB, 57.88 MB, 57.50 MB, 50.80 MB ThreadUsage(16s000ms): 12, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 10 - AverageThreadTokens: 12.79 - BloomFilterBytes: 33.00 MB (34603008) - PeakMemoryUsage: 67.37 MB (70643422) - PerHostPeakMemUsage: 161.67 GB (173596069509) - RowsProduced: 76.88M (76875071) - TotalNetworkReceiveTime: 604.657ms - TotalNetworkSendTime: 8m30s - TotalStorageWaitTime: 12s215ms - TotalThreadsInvoluntaryContextSwitches: 40.72K (40722) - TotalThreadsTotalWallClockTime: 1h53m - TotalThreadsSysTime: 2m44s - TotalThreadsUserTime: 2m53s - TotalThreadsVoluntaryContextSwitches: 19.94M (19935863) Fragment Instance Lifecycle Timings: - ExecTime: 8m52s - ExecTreeExecTime: 3s610ms - OpenTime: 1s131ms - ExecTreeOpenTime: 948.451ms - PrepareTime: 53.614ms - ExecTreePrepareTime: 7.266ms DataStreamSender (dst_id=22):(Total: 15s815ms, non-child: 15s815ms, % non-child: 100.00%) - BytesSent: 707.72 MB (742100884) - NetworkThroughput(*): 76.60 MB/sec - OverallThroughput: 44.75 MB/sec - PeakMemoryUsage: 4.91 MB (5150464) - RowsReturned: 76.88M (76875071) - SerializeBatchTime: 6s556ms - TransmitDataRPCTime: 9s239ms - UncompressedRowBatchSize: 2.15 GB (2307079266) CodeGen:(Total: 201.378ms, non-child: 201.378ms, % non-child: 100.00%) - CodegenTime: 1.111ms - CompileTime: 52.281ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 128.539ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 20.144ms HASH_JOIN_NODE (id=5):(Total: 4s532ms, non-child: 3s053ms, % non-child: 67.37%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 842.467us - PeakMemoryUsage: 1.24 MB (1296918) - ProbeRows: 76.88M (76875071) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 2s896ms - RowsReturned: 76.88M (76875071) - RowsReturnedRate: 16.96 M/sec Hash Join Builder (join_node_id=5): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 15.096us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 79.997us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 25.565us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 604.663ms, non-child: 10.929us, % non-child: 0.00%) BytesReceived(16s000ms): 932.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 2.609us - DeserializeRowBatchTimer: 16.294us - FirstBatchArrivalWaitTime: 579.396ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 198.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=3):(Total: 874.654ms, non-child: 874.654ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:237/13.57 GB 0:238/13.79 GB 6:211/12.97 GB 7:225/13.74 GB 3:224/13.17 GB 2:227/12.86 GB 4:222/12.39 GB 5:226/13.17 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 116 out of 116 Runtime filters: Only following filters arrived: 6, waited 201ms Hdfs Read Thread Concurrency Bucket: 0:99.05% 1:0.8539% 2:0.09488% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1694 PARQUET/SNAPPY:116 BytesRead(16s000ms): 13.27 MB, 14.23 MB, 14.23 MB, 20.70 MB, 28.68 MB, 28.87 MB, 39.52 MB, 42.84 MB, 44.43 MB, 56.92 MB, 57.11 MB, 62.18 MB, 71.57 MB, 71.57 MB, 79.27 MB, 85.61 MB, 86.58 MB, 99.77 MB, 100.16 MB, 103.11 MB, 114.16 MB, 114.20 MB, 114.20 MB, 123.07 MB, 128.58 MB, 128.58 MB, 128.58 MB, 134.48 MB, 138.01 MB, 138.01 MB, 138.01 MB, 138.01 MB - FooterProcessingTime: (Avg: 55.298ms ; Min: 4.272ms ; Max: 161.798ms ; Number of samples: 116) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 11.91 - BytesRead: 138.01 MB (144719187) - BytesReadDataNodeCache: 0 - BytesReadLocal: 138.01 MB (144719187) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 138.01 MB (144719187) - DecompressionTime: 510.281ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 116 (116) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 29.27 MB (30691189) - PerReadThreadRawHdfsThroughput: 21.91 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 136.212ms - RowBatchQueuePutWaitTime: 1h38m - RowsRead: 77.01M (77014167) - RowsReturned: 76.88M (76875071) - RowsReturnedRate: 87.89 M/sec - ScanRangesComplete: 1.81K (1810) - ScannerThreadsInvoluntaryContextSwitches: 36.12K (36115) - ScannerThreadsTotalWallClockTime: 1h44m - MaterializeTupleTime(*): 5s432ms - ScannerThreadsSysTime: 2m43s - ScannerThreadsUserTime: 2m33s - ScannerThreadsVoluntaryContextSwitches: 19.93M (19932820) - TotalRawHdfsReadTime(*): 6s298ms - TotalReadThroughput: 268.17 KB/sec Filter 2 (16.00 MB): - Rows processed: 2.01M (2011966) - Rows rejected: 139.05K (139047) - Rows total: 77.01M (77014167) Filter 5 (16.00 MB): - Rows processed: 1.86M (1860657) - Rows rejected: 49 (49) - Rows total: 76.88M (76875120) Filter 6 (1.00 MB): - Files processed: 1.81K (1810) - Files rejected: 1.69K (1694) - Files total: 1.81K (1810) - RowGroups processed: 75.05K (75049) - RowGroups rejected: 0 (0) - RowGroups total: 75.05K (75049) - Rows processed: 1.90M (1900544) - Rows rejected: 0 (0) - Rows total: 76.88M (76875071) - Splits processed: 116 (116) - Splits rejected: 0 (0) - Splits total: 116 (116) Instance 7f40dcb034de70b7:f2 (host=vd1122.foo:22000):(Total: 8m53s, non-child: 8m32s, % non-child: 95.98%) Hdfs split stats (:<# splits>/): 6:217/12.94 GB 1:236/13.74 GB 2:201/11.02 GB 5:236/14.36 GB 4:243/13.96 GB 7:219/12.22 GB 0:228/13.10 GB 3:234/14.32 GB Filter 6 arrival: 669ms Filter 2 arrival: 13s565ms Filter 5 arrival: 17s012ms MemoryUsage(16s000ms): 34.15 MB, 64.80 MB, 65.84 MB, 65.37 MB, 66.36 MB, 66.75 MB, 65.98 MB, 65.77 MB, 65.77 MB, 65.64 MB, 65.78 MB, 65.53 MB, 66.81 MB, 66.82 MB, 66.84 MB, 66.68 MB, 66.79 MB, 64.38 MB, 63.75 MB, 63.23 MB, 65.00 MB, 65.71 MB, 65.92 MB, 66.45 MB, 66.70 MB, 66.79 MB, 66.81 MB, 65.96 MB, 58.41 MB, 56.92 MB, 55.65 MB, 54.26 MB, 53.37 MB ThreadUsage(16s000ms): 12, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.97 - BloomFilterBytes: 33.00 MB (34603008) - PeakMemoryUsage: 67.56 MB (70837767) - PerHostPeakMemUsage: 161.65 GB (173574848402) - RowsProduced: 76.39M (76388389) - TotalNetworkReceiveTime: 445.264ms - TotalNetworkSendTime: 8m25s - TotalStorageWaitTime: 12s417ms - TotalThreadsInvoluntaryContextSwitches: 46.74K (46745) - TotalThreadsTotalWallClockTime: 1h55m - TotalThreadsSysTime: 4m3s - TotalThreadsUserTime: 2m54s - TotalThreadsVoluntaryContextSwitches: 14.46M (14457942) Fragment Instance Lifecycle Timings: - ExecTime: 8m52s - ExecTreeExecTime: 3s945ms - OpenTime: 1s102ms - ExecTreeOpenTime: 921.183ms - PrepareTime: 45.294ms - ExecTreePrepareTime: 6.300ms DataStreamSender (dst_id=22):(Total: 16s441ms, non-child: 16s441ms, % non-child: 100.00%) - BytesSent: 705.67 MB (739952436) - NetworkThroughput(*): 76.38 MB/sec - OverallThroughput: 42.92 MB/sec - PeakMemoryUsage: 4.94 MB (5183232) - RowsReturned: 76.39M (76388389) - SerializeBatchTime: 7s182ms - TransmitDataRPCTime: 9s238ms - UncompressedRowBatchSize: 2.14 GB (2292473566) CodeGen:(Total: 195.263ms, non-child: 195.263ms, % non-child: 100.00%) - CodegenTime: 899.770us - CompileTime: 53.663ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 126.235ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 14.988ms HASH_JOIN_NODE (id=5):(Total: 4s834ms, non-child: 3s502ms, % non-child: 72.46%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.612ms - PeakMemoryUsage: 1.24 MB (1296907) - ProbeRows: 76.39M (76388389) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3s349ms - RowsReturned: 76.39M (76388389) - RowsReturnedRate: 15.80 M/sec Hash Join Builder (join_node_id=5): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 35.872us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 137.387us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 53.561us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 445.275ms, non-child: 21.359us, % non-child: 0.00%) BytesReceived(16s000ms): 963.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 5.403us - DeserializeRowBatchTimer: 19.966us - FirstBatchArrivalWaitTime: 420.032ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 269.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=3):(Total: 886.730ms, non-child: 886.730ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 6:217/12.94 GB 1:236/13.74 GB 2:201/11.02 GB 5:236/14.36 GB 4:243/13.96 GB 7:219/12.22 GB 0:228/13.10 GB 3:234/14.32 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 116 out of 116 Runtime filters: Only following filters arrived: 6, waited 361ms Hdfs Read Thread Concurrency Bucket: 0:98.87% 1:0.754% 2:0.377% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1698 PARQUET/SNAPPY:116 BytesRead(16s000ms): 13.52 MB, 14.42 MB, 14.42 MB, 18.68 MB, 28.83 MB, 29.48 MB, 38.50 MB, 43.59 MB, 44.46 MB, 56.77 MB, 57.95 MB, 60.18 MB, 72.08 MB, 72.73 MB, 76.84 MB, 87.06 MB, 87.68 MB, 96.58 MB, 101.28 MB, 101.92 MB, 112.64 MB, 115.71 MB, 115.86 MB, 119.81 MB, 129.74 MB, 130.20 MB, 130.80 MB, 132.91 MB, 138.61 MB, 138.61 MB, 138.61 MB, 138.61 MB, 138.61 MB - FooterProcessingTime: (Avg: 58.814ms ; Min: 5.147ms ; Max: 147.814ms ; Number of samples: 116) - AverageHdfsReadThreadConcurrency: 0.02 - AverageScannerThreadConcurrency: 11.97 - BytesRead: 138.61 MB (145341487) - BytesReadDataNodeCache: 0 - BytesReadLocal: 138.61 MB (145341487) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 138.61 MB (145341487) - DecompressionTime: 1s375ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 116 (116) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 29.46 MB (30888328) - PerReadThreadRawHdfsThroughput: 21.42 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 106.658ms - RowBatchQueuePutWaitTime: 1h39m - RowsRead: 76.53M (76530864) - RowsReturned: 76.39M (76388389) - RowsReturnedRate: 86.15 M/sec - ScanRangesComplete: 1.81K (1814) - ScannerThreadsInvoluntaryContextSwitches: 41.69K (41688) - ScannerThreadsTotalWallClockTime: 1h46m - MaterializeTupleTime(*): 6s250ms - ScannerThreadsSysTime: 4m2s - ScannerThreadsUserTime: 2m30s - ScannerThreadsVoluntaryContextSwitches: 14.45M (14454799) - TotalRawHdfsReadTime(*): 6s469ms - TotalReadThroughput: 267.55 KB/sec Filter 2 (16.00 MB): - Rows processed: 2.03M (2031755) - Rows rejected: 142.46K (142461) - Rows total: 76.53M (76530864) Filter 5 (16.00 MB): - Rows processed: 1.81M (1806350) - Rows rejected: 14 (14) - Rows total: 76.39M (76388403) Filter 6 (1.00 MB): - Files processed: 1.81K (1814) - Files rejected: 1.70K (1698) - Files total: 1.81K (1814) - RowGroups processed: 74.57K (74571) - RowGroups rejected: 0 (0) - RowGroups total: 74.57K (74571) - Rows processed: 1.90M (1900544) - Rows rejected: 0 (0) - Rows total: 76.39M (76388389) - Splits processed: 116 (116) - Splits rejected: 0 (0) - Splits total: 116 (116) Instance 7f40dcb034de70b7:80 (host=ve1134.foo:22000):(Total: 8m51s, non-child: 8m29s, % non-child: 95.90%) Hdfs split stats (:<# splits>/): 0:203/11.69 GB 3:231/13.87 GB 1:229/13.74 GB 2:245/14.12 GB 4:222/12.72 GB 6:205/12.24 GB 7:236/13.36 GB 5:249/13.92 GB Filter 6 arrival: 1s168ms Filter 2 arrival: 11s157ms Filter 5 arrival: 15s785ms MemoryUsage(16s000ms): 36.09 MB, 66.77 MB, 66.81 MB, 66.32 MB, 65.78 MB, 65.66 MB, 66.34 MB, 66.72 MB, 66.72 MB, 66.73 MB, 66.67 MB, 65.87 MB, 65.12 MB, 65.68 MB, 66.09 MB, 66.71 MB, 66.75 MB, 66.62 MB, 66.82 MB, 66.78 MB, 66.68 MB, 66.79 MB, 66.79 MB, 66.27 MB, 66.65 MB, 66.82 MB, 66.82 MB, 66.88 MB, 62.05 MB, 57.01 MB, 55.70 MB, 53.04 MB, 42.97 MB ThreadUsage(16s000ms): 11, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 8 - AverageThreadTokens: 12.83 - BloomFilterBytes: 33.00 MB (34603008) - PeakMemoryUsage: 67.55 MB (70826842) - PerHostPeakMemUsage: 161.67 GB (173588187722) - RowsProduced: 76.28M (76276719) - TotalNetworkReceiveTime: 926.898ms - TotalNetworkSendTime: 8m22s - TotalStorageWaitTime: 12s447ms - TotalThreadsInvoluntaryContextSwitches: 42.39K (42387) - TotalThreadsTotalWallClockTime: 1h53m - TotalThreadsSysTime: 3m39s - TotalThreadsUserTime: 2m34s - TotalThreadsVoluntaryContextSwitches: 14.61M (14609005) Fragment Instance Lifecycle Timings: - ExecTime: 8m50s - ExecTreeExecTime: 3s708ms - OpenTime: 1s281ms - ExecTreeOpenTime: 1s086ms - PrepareTime: 49.855ms - ExecTreePrepareTime: 6.472ms DataStreamSender (dst_id=22):(Total: 16s800ms, non-child: 16s800ms, % non-child: 100.00%) - BytesSent: 704.94 MB (739178292) - NetworkThroughput(*): 75.34 MB/sec - OverallThroughput: 41.96 MB/sec - PeakMemoryUsage: 4.99 MB (5232384) - RowsReturned: 76.28M (76276719) - SerializeBatchTime: 7s422ms - TransmitDataRPCTime: 9s357ms - UncompressedRowBatchSize: 2.13 GB (2289122234) CodeGen:(Total: 214.247ms, non-child: 214.247ms, % non-child: 100.00%) - CodegenTime: 1.138ms - CompileTime: 59.458ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 134.023ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 20.339ms HASH_JOIN_NODE (id=5):(Total: 4s761ms, non-child: 3s244ms, % non-child: 68.14%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.280ms - PeakMemoryUsage: 1.24 MB (1296715) - ProbeRows: 76.28M (76276719) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3s085ms - RowsReturned: 76.28M (76276719) - RowsReturnedRate: 16.02 M/sec Hash Join Builder (join_node_id=5): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 24.189us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 95.800us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 46.114us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 926.909ms, non-child: 18.058us, % non-child: 0.00%) BytesReceived(16s000ms): 901.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 4.907us - DeserializeRowBatchTimer: 21.730us - FirstBatchArrivalWaitTime: 888.671ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 129.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=3):(Total: 590.740ms, non-child: 590.740ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:203/11.69 GB 3:231/13.87 GB 1:229/13.74 GB 2:245/14.12 GB 4:222/12.72 GB 6:205/12.24 GB 7:236/13.36 GB 5:249/13.92 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 116 out of 116 Runtime filters: Only following filters arrived: 6, waited 40ms Hdfs Read Thread Concurrency Bucket: 0:98.85% 1:1.054% 2:0.09579% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1704 PARQUET/SNAPPY:116 BytesRead(16s000ms): 13.27 MB, 14.65 MB, 15.40 MB, 21.00 MB, 29.38 MB, 30.47 MB, 39.91 MB, 43.64 MB, 45.54 MB, 57.21 MB, 58.39 MB, 61.79 MB, 72.50 MB, 73.44 MB, 79.25 MB, 86.96 MB, 88.18 MB, 98.20 MB, 101.85 MB, 103.44 MB, 112.87 MB, 116.29 MB, 116.83 MB, 121.05 MB, 129.98 MB, 130.88 MB, 131.53 MB, 135.59 MB, 139.48 MB, 139.48 MB, 139.48 MB, 139.48 MB - FooterProcessingTime: (Avg: 56.580ms ; Min: 23.860ms ; Max: 187.500ms ; Number of samples: 116) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 11.98 - BytesRead: 139.48 MB (146250365) - BytesReadDataNodeCache: 0 - BytesReadLocal: 139.48 MB (146250365) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 139.48 MB (146250365) - DecompressionTime: 503.155ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 116 (116) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 29.44 MB (30868399) - PerReadThreadRawHdfsThroughput: 22.18 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 112.974ms - RowBatchQueuePutWaitTime: 1h38m - RowsRead: 76.41M (76414929) - RowsReturned: 76.28M (76276719) - RowsReturnedRate: 129.12 M/sec - ScanRangesComplete: 1.82K (1820) - ScannerThreadsInvoluntaryContextSwitches: 37.34K (37339) - ScannerThreadsTotalWallClockTime: 1h44m - MaterializeTupleTime(*): 6s711ms - ScannerThreadsSysTime: 3m38s - ScannerThreadsUserTime: 2m10s - ScannerThreadsVoluntaryContextSwitches: 14.61M (14605905) - TotalRawHdfsReadTime(*): 6s289ms - TotalReadThroughput: 273.34 KB/sec Filter 2 (16.00 MB): - Rows processed: 1.99M (1994722) - Rows rejected: 138.19K (138195) - Rows total: 76.41M (76414929) Filter 5 (16.00 MB): - Rows processed: 1.86M (1856527) - Rows rejected: 15 (15) - Rows total: 76.28M (76276734) Filter 6 (1.00 MB): - Files processed: 1.82K (1820) - Files rejected: 1.70K (1704) - Files total: 1.82K (1820) - RowGroups processed: 74.47K (74466) - RowGroups rejected: 0 (0) - RowGroups total: 74.47K (74466) - Rows processed: 1.90M (1900544) - Rows rejected: 0 (0) - Rows total: 76.28M (76276719) - Splits processed: 116 (116) - Splits rejected: 0 (0) - Splits total: 116 (116) Instance 7f40dcb034de70b7:86 (host=vd1101.foo:22000):(Total: 8m51s, non-child: 8m30s, % non-child: 96.05%) Hdfs split stats (:<# splits>/): 2:260/15.17 GB 1:262/14.91 GB 4:265/15.21 GB 6:251/14.30 GB 3:267/15.11 GB 0:255/14.79 GB 5:270/16.20 GB Filter 6 arrival: 1s168ms Filter 2 arrival: 11s310ms Filter 5 arrival: 15s761ms MemoryUsage(16s000ms): 36.57 MB, 66.59 MB, 66.63 MB, 66.53 MB, 66.66 MB, 66.53 MB, 64.72 MB, 64.53 MB, 65.00 MB, 66.56 MB, 66.60 MB, 66.51 MB, 66.60 MB, 66.58 MB, 66.52 MB, 66.63 MB, 66.32 MB, 66.56 MB, 66.67 MB, 66.52 MB, 66.66 MB, 66.60 MB, 66.50 MB, 65.50 MB, 65.67 MB, 65.63 MB, 65.58 MB, 63.04 MB, 57.78 MB, 57.90 MB, 57.77 MB, 53.14 MB, 43.75 MB ThreadUsage(16s000ms): 12, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 8 - AverageThreadTokens: 12.80 - BloomFilterBytes: 33.00 MB (34603008) - PeakMemoryUsage: 67.37 MB (70638225) - PerHostPeakMemUsage: 161.65 GB (173574600853) - RowsProduced: 76.92M (76915329) - TotalNetworkReceiveTime: 939.178ms - TotalNetworkSendTime: 8m26s - TotalStorageWaitTime: 12s709ms - TotalThreadsInvoluntaryContextSwitches: 42.82K (42822) - TotalThreadsTotalWallClockTime: 1h53m - TotalThreadsSysTime: 3m37s - TotalThreadsUserTime: 2m42s - TotalThreadsVoluntaryContextSwitches: 16.37M (16372768) Fragment Instance Lifecycle Timings: - ExecTime: 8m50s - ExecTreeExecTime: 4s222ms - OpenTime: 1s292ms - ExecTreeOpenTime: 1s110ms - PrepareTime: 51.376ms - ExecTreePrepareTime: 6.796ms DataStreamSender (dst_id=22):(Total: 15s477ms, non-child: 15s477ms, % non-child: 100.00%) - BytesSent: 712.17 MB (746761876) - NetworkThroughput(*): 80.41 MB/sec - OverallThroughput: 46.01 MB/sec - PeakMemoryUsage: 5.00 MB (5240576) - RowsReturned: 76.92M (76915329) - SerializeBatchTime: 6s602ms - TransmitDataRPCTime: 8s857ms - UncompressedRowBatchSize: 2.15 GB (2308287478) CodeGen:(Total: 202.145ms, non-child: 202.145ms, % non-child: 100.00%) - CodegenTime: 1.068ms - CompileTime: 52.799ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 127.407ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 21.541ms HASH_JOIN_NODE (id=5):(Total: 5s305ms, non-child: 3s070ms, % non-child: 57.87%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.363ms - PeakMemoryUsage: 1.24 MB (1298622) - ProbeRows: 76.92M (76915329) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 2s916ms - RowsReturned: 76.92M (76915329) - RowsReturnedRate: 14.50 M/sec Hash Join Builder (join_node_id=5): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 46.962us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 150.959us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 41.059us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 939.188ms, non-child: 18.115us, % non-child: 0.00%) BytesReceived(16s000ms): 932.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 4.818us - DeserializeRowBatchTimer: 14.079us - FirstBatchArrivalWaitTime: 895.265ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 127.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=3):(Total: 1s296ms, non-child: 1s296ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:260/15.17 GB 1:262/14.91 GB 4:265/15.21 GB 6:251/14.30 GB 3:267/15.11 GB 0:255/14.79 GB 5:270/16.20 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 116 out of 116 Runtime filters: Only following filters arrived: 6, waited 40ms Hdfs Read Thread Concurrency Bucket: 0:99.23% 1:0.4785% 2:0.2871% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% File Formats: PARQUET/NONE:1714 PARQUET/SNAPPY:116 BytesRead(16s000ms): 13.35 MB, 14.71 MB, 15.17 MB, 22.22 MB, 29.65 MB, 30.72 MB, 41.48 MB, 44.04 MB, 47.21 MB, 58.05 MB, 58.70 MB, 65.72 MB, 72.68 MB, 74.12 MB, 83.71 MB, 87.27 MB, 91.02 MB, 101.95 MB, 102.40 MB, 108.99 MB, 116.43 MB, 116.43 MB, 117.94 MB, 128.94 MB, 130.92 MB, 130.92 MB, 132.72 MB, 137.54 MB, 140.32 MB, 140.32 MB, 140.32 MB, 140.32 MB - FooterProcessingTime: (Avg: 57.465ms ; Min: 3.918ms ; Max: 211.450ms ; Number of samples: 116) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 11.97 - BytesRead: 140.32 MB (147132942) - BytesReadDataNodeCache: 0 - BytesReadLocal: 140.32 MB (147132942) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 140.32 MB (147132942) - DecompressionTime: 1s923ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 7 (7) - NumRowGroups: 116 (116) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 29.32 MB (30749324) - PerReadThreadRawHdfsThroughput: 22.70 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 125.279ms - RowBatchQueuePutWaitTime: 1h37m - RowsRead: 77.06M (77055560) - RowsReturned: 76.92M (76915329) - RowsReturnedRate: 59.33 M/sec - ScanRangesComplete: 1.83K (1830) - ScannerThreadsInvoluntaryContextSwitches: 38.24K (38243) - ScannerThreadsTotalWallClockTime: 1h44m - MaterializeTupleTime(*): 5s012ms - ScannerThreadsSysTime: 3m36s - ScannerThreadsUserTime: 2m22s - ScannerThreadsVoluntaryContextSwitches: 16.37M (16369654) - TotalRawHdfsReadTime(*): 6s181ms - TotalReadThroughput: 274.99 KB/sec Filter 2 (16.00 MB): - Rows processed: 2.01M (2006983) - Rows rejected: 140.20K (140204) - Rows total: 77.06M (77055560) Filter 5 (16.00 MB): - Rows processed: 1.83M (1834011) - Rows rejected: 27 (27) - Rows total: 76.92M (76915356) Filter 6 (1.00 MB): - Files processed: 1.83K (1830) - Files rejected: 1.71K (1714) - Files total: 1.83K (1830) - RowGroups processed: 75.09K (75090) - RowGroups rejected: 0 (0) - RowGroups total: 75.09K (75090) - Rows processed: 1.90M (1900544) - Rows rejected: 0 (0) - Rows total: 76.92M (76915329) - Splits processed: 116 (116) - Splits rejected: 0 (0) - Splits total: 116 (116) Instance 7f40dcb034de70b7:9e (host=vd1337.foo:22000):(Total: 8m51s, non-child: 8m31s, % non-child: 96.19%) Hdfs split stats (:<# splits>/): 1:240/14.24 GB 7:221/12.73 GB 4:225/12.85 GB 6:224/13.00 GB 3:229/13.81 GB 2:233/13.47 GB 5:230/13.24 GB 0:223/12.35 GB Filter 6 arrival: 1s029ms Filter 2 arrival: 11s980ms Filter 5 arrival: 16s078ms MemoryUsage(16s000ms): 34.74 MB, 64.84 MB, 64.76 MB, 65.90 MB, 66.79 MB, 66.59 MB, 64.64 MB, 64.82 MB, 65.12 MB, 66.82 MB, 66.83 MB, 66.59 MB, 65.89 MB, 66.76 MB, 66.31 MB, 65.80 MB, 65.80 MB, 66.58 MB, 66.77 MB, 66.58 MB, 65.60 MB, 65.78 MB, 65.76 MB, 66.07 MB, 66.65 MB, 66.74 MB, 66.81 MB, 66.09 MB, 57.92 MB, 57.46 MB, 55.58 MB, 53.39 MB, 43.84 MB ThreadUsage(16s000ms): 12, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 8 - AverageThreadTokens: 12.84 - BloomFilterBytes: 33.00 MB (34603008) - PeakMemoryUsage: 67.43 MB (70708365) - PerHostPeakMemUsage: 161.68 GB (173602667239) - RowsProduced: 76.37M (76374552) - TotalNetworkReceiveTime: 796.437ms - TotalNetworkSendTime: 8m25s - TotalStorageWaitTime: 11s760ms - TotalThreadsInvoluntaryContextSwitches: 44.99K (44986) - TotalThreadsTotalWallClockTime: 1h53m - TotalThreadsSysTime: 4m2s - TotalThreadsUserTime: 2m31s - TotalThreadsVoluntaryContextSwitches: 15.21M (15210807) Fragment Instance Lifecycle Timings: - ExecTime: 8m50s - ExecTreeExecTime: 3s556ms - OpenTime: 1s125ms - ExecTreeOpenTime: 943.131ms - PrepareTime: 54.632ms - ExecTreePrepareTime: 6.760ms DataStreamSender (dst_id=22):(Total: 15s541ms, non-child: 15s541ms, % non-child: 100.00%) - BytesSent: 705.68 MB (739963830) - NetworkThroughput(*): 80.64 MB/sec - OverallThroughput: 45.41 MB/sec - PeakMemoryUsage: 5.06 MB (5306112) - RowsReturned: 76.37M (76374552) - SerializeBatchTime: 6s772ms - TransmitDataRPCTime: 8s750ms - UncompressedRowBatchSize: 2.13 GB (2292058312) CodeGen:(Total: 203.005ms, non-child: 203.005ms, % non-child: 100.00%) - CodegenTime: 1.024ms - CompileTime: 51.073ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 130.102ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 21.404ms HASH_JOIN_NODE (id=5):(Total: 4s472ms, non-child: 3s155ms, % non-child: 70.56%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.309ms - PeakMemoryUsage: 1.24 MB (1298144) - ProbeRows: 76.37M (76374552) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3s002ms - RowsReturned: 76.37M (76374552) - RowsReturnedRate: 17.08 M/sec Hash Join Builder (join_node_id=5): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 25.853us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 131.050us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 46.657us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 796.447ms, non-child: 18.172us, % non-child: 0.00%) BytesReceived(16s000ms): 932.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 5.238us - DeserializeRowBatchTimer: 15.272us - FirstBatchArrivalWaitTime: 775.119ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 150.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=3):(Total: 520.769ms, non-child: 520.769ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:240/14.24 GB 7:221/12.73 GB 4:225/12.85 GB 6:224/13.00 GB 3:229/13.81 GB 2:233/13.47 GB 5:230/13.24 GB 0:223/12.35 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 116 out of 116 Runtime filters: Only following filters arrived: 6, waited 40ms Hdfs Read Thread Concurrency Bucket: 0:98.37% 1:1.437% 2:0.1916% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1709 PARQUET/SNAPPY:116 BytesRead(16s000ms): 13.58 MB, 14.48 MB, 15.00 MB, 23.49 MB, 29.16 MB, 30.95 MB, 41.86 MB, 43.23 MB, 48.45 MB, 57.96 MB, 57.96 MB, 62.42 MB, 72.11 MB, 73.26 MB, 81.16 MB, 86.47 MB, 88.21 MB, 98.82 MB, 101.05 MB, 103.84 MB, 114.15 MB, 115.53 MB, 115.75 MB, 123.63 MB, 129.21 MB, 130.19 MB, 130.50 MB, 133.46 MB, 138.83 MB, 138.83 MB, 138.83 MB, 138.83 MB - FooterProcessingTime: (Avg: 55.603ms ; Min: 3.401ms ; Max: 378.666ms ; Number of samples: 116) - AverageHdfsReadThreadConcurrency: 0.02 - AverageScannerThreadConcurrency: 11.98 - BytesRead: 138.83 MB (145578674) - BytesReadDataNodeCache: 0 - BytesReadLocal: 138.83 MB (145578674) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 138.83 MB (145578674) - DecompressionTime: 1s607ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 116 (116) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 29.21 MB (30626568) - PerReadThreadRawHdfsThroughput: 23.40 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 100.020ms - RowBatchQueuePutWaitTime: 1h37m - RowsRead: 76.51M (76511302) - RowsReturned: 76.37M (76374552) - RowsReturnedRate: 146.66 M/sec - ScanRangesComplete: 1.82K (1825) - ScannerThreadsInvoluntaryContextSwitches: 40.26K (40259) - ScannerThreadsTotalWallClockTime: 1h44m - MaterializeTupleTime(*): 5s347ms - ScannerThreadsSysTime: 4m1s - ScannerThreadsUserTime: 2m10s - ScannerThreadsVoluntaryContextSwitches: 15.21M (15207717) - TotalRawHdfsReadTime(*): 5s932ms - TotalReadThroughput: 272.35 KB/sec Filter 2 (16.00 MB): - Rows processed: 1.95M (1954350) - Rows rejected: 136.72K (136721) - Rows total: 76.51M (76511302) Filter 5 (16.00 MB): - Rows processed: 1.81M (1810461) - Rows rejected: 29 (29) - Rows total: 76.37M (76374581) Filter 6 (1.00 MB): - Files processed: 1.82K (1825) - Files rejected: 1.71K (1709) - Files total: 1.82K (1825) - RowGroups processed: 74.56K (74555) - RowGroups rejected: 0 (0) - RowGroups total: 74.56K (74555) - Rows processed: 1.90M (1900544) - Rows rejected: 0 (0) - Rows total: 76.37M (76374552) - Splits processed: 116 (116) - Splits rejected: 0 (0) - Splits total: 116 (116) Instance 7f40dcb034de70b7:c5 (host=vc1530.foo:22000):(Total: 8m51s, non-child: 8m29s, % non-child: 95.96%) Hdfs split stats (:<# splits>/): 4:224/12.11 GB 5:212/12.82 GB 0:239/13.94 GB 3:200/12.06 GB 2:222/12.78 GB 1:252/15.06 GB 6:235/13.12 GB 7:235/13.79 GB Filter 6 arrival: 872ms Filter 2 arrival: 13s004ms Filter 5 arrival: 16s498ms MemoryUsage(16s000ms): 35.41 MB, 66.35 MB, 66.79 MB, 66.36 MB, 66.76 MB, 66.72 MB, 66.75 MB, 66.84 MB, 66.68 MB, 66.78 MB, 66.83 MB, 66.70 MB, 66.80 MB, 66.73 MB, 66.57 MB, 66.79 MB, 66.78 MB, 66.11 MB, 65.77 MB, 65.69 MB, 66.49 MB, 66.94 MB, 66.76 MB, 66.67 MB, 66.71 MB, 66.74 MB, 66.82 MB, 66.81 MB, 65.58 MB, 58.82 MB, 51.32 MB, 49.74 MB ThreadUsage(16s000ms): 12, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.81 - BloomFilterBytes: 33.00 MB (34603008) - PeakMemoryUsage: 67.93 MB (71225541) - PerHostPeakMemUsage: 161.66 GB (173582444373) - RowsProduced: 74.94M (74944521) - TotalNetworkReceiveTime: 639.507ms - TotalNetworkSendTime: 8m24s - TotalStorageWaitTime: 14s420ms - TotalThreadsInvoluntaryContextSwitches: 44.58K (44584) - TotalThreadsTotalWallClockTime: 1h53m - TotalThreadsSysTime: 4m20s - TotalThreadsUserTime: 1m57s - TotalThreadsVoluntaryContextSwitches: 7.68M (7684615) Fragment Instance Lifecycle Timings: - ExecTime: 8m49s - ExecTreeExecTime: 3s625ms - OpenTime: 1s113ms - ExecTreeOpenTime: 928.628ms - PrepareTime: 53.398ms - ExecTreePrepareTime: 6.810ms DataStreamSender (dst_id=22):(Total: 16s740ms, non-child: 16s740ms, % non-child: 100.00%) - BytesSent: 694.81 MB (728564021) - NetworkThroughput(*): 73.94 MB/sec - OverallThroughput: 41.50 MB/sec - PeakMemoryUsage: 5.04 MB (5281536) - RowsReturned: 74.94M (74944521) - SerializeBatchTime: 7s323ms - TransmitDataRPCTime: 9s396ms - UncompressedRowBatchSize: 2.09 GB (2249142038) CodeGen:(Total: 203.907ms, non-child: 203.907ms, % non-child: 100.00%) - CodegenTime: 1.151ms - CompileTime: 52.731ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 130.740ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 20.024ms HASH_JOIN_NODE (id=5):(Total: 4s520ms, non-child: 3s155ms, % non-child: 69.81%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.381ms - PeakMemoryUsage: 1.24 MB (1296436) - ProbeRows: 74.94M (74944521) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3s015ms - RowsReturned: 74.94M (74944521) - RowsReturnedRate: 16.58 M/sec Hash Join Builder (join_node_id=5): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 22.372us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 138.303us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 43.827us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 639.518ms, non-child: 18.855us, % non-child: 0.00%) BytesReceived(16s000ms): 963.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 5.088us - DeserializeRowBatchTimer: 10.754us - FirstBatchArrivalWaitTime: 601.156ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 187.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=3):(Total: 725.546ms, non-child: 725.546ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:224/12.11 GB 5:212/12.82 GB 0:239/13.94 GB 3:200/12.06 GB 2:222/12.78 GB 1:252/15.06 GB 6:235/13.12 GB 7:235/13.79 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 113 out of 113 Runtime filters: Only following filters arrived: 6, waited 161ms Hdfs Read Thread Concurrency Bucket: 0:98.47% 1:1.534% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1706 PARQUET/SNAPPY:113 BytesRead(16s000ms): 13.72 MB, 14.63 MB, 14.67 MB, 20.43 MB, 29.18 MB, 29.55 MB, 39.53 MB, 43.98 MB, 46.00 MB, 58.66 MB, 58.80 MB, 64.20 MB, 73.38 MB, 73.87 MB, 80.71 MB, 88.09 MB, 88.71 MB, 99.36 MB, 102.53 MB, 103.60 MB, 114.19 MB, 117.34 MB, 117.45 MB, 119.59 MB, 130.19 MB, 131.91 MB, 131.99 MB, 133.21 MB, 136.99 MB, 138.02 MB, 138.02 MB, 138.02 MB - FooterProcessingTime: (Avg: 69.007ms ; Min: 18.898ms ; Max: 886.797ms ; Number of samples: 113) - AverageHdfsReadThreadConcurrency: 0.02 - AverageScannerThreadConcurrency: 11.94 - BytesRead: 138.02 MB (144721801) - BytesReadDataNodeCache: 0 - BytesReadLocal: 138.02 MB (144721801) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 138.02 MB (144721801) - DecompressionTime: 682.296ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 113 (113) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 29.72 MB (31161414) - PerReadThreadRawHdfsThroughput: 17.74 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 120.506ms - RowBatchQueuePutWaitTime: 1h38m - RowsRead: 75.08M (75080962) - RowsReturned: 74.94M (74944521) - RowsReturnedRate: 103.29 M/sec - ScanRangesComplete: 1.82K (1819) - ScannerThreadsInvoluntaryContextSwitches: 39.76K (39762) - ScannerThreadsTotalWallClockTime: 1h44m - MaterializeTupleTime(*): 6s496ms - ScannerThreadsSysTime: 4m20s - ScannerThreadsUserTime: 1m33s - ScannerThreadsVoluntaryContextSwitches: 7.68M (7681553) - TotalRawHdfsReadTime(*): 7s780ms - TotalReadThroughput: 271.01 KB/sec Filter 2 (16.00 MB): - Rows processed: 1.96M (1962233) - Rows rejected: 136.43K (136429) - Rows total: 75.08M (75080962) Filter 5 (16.00 MB): - Rows processed: 1.80M (1801228) - Rows rejected: 12 (12) - Rows total: 74.94M (74944533) Filter 6 (1.00 MB): - Files processed: 1.82K (1819) - Files rejected: 1.71K (1706) - Files total: 1.82K (1819) - RowGroups processed: 73.15K (73153) - RowGroups rejected: 0 (0) - RowGroups total: 73.15K (73153) - Rows processed: 1.85M (1851392) - Rows rejected: 0 (0) - Rows total: 74.94M (74944521) - Splits processed: 113 (113) - Splits rejected: 0 (0) - Splits total: 113 (113) Instance 7f40dcb034de70b7:c6 (host=vd1332.foo:22000):(Total: 8m51s, non-child: 8m31s, % non-child: 96.23%) Hdfs split stats (:<# splits>/): 0:212/13.06 GB 5:226/13.44 GB 4:218/13.08 GB 2:246/14.71 GB 6:226/12.99 GB 7:203/11.53 GB 3:247/14.79 GB 1:228/12.07 GB Filter 6 arrival: 871ms Filter 2 arrival: 12s955ms Filter 5 arrival: 16s503ms MemoryUsage(16s000ms): 35.43 MB, 66.28 MB, 66.77 MB, 66.51 MB, 66.74 MB, 66.78 MB, 66.43 MB, 66.81 MB, 66.58 MB, 66.74 MB, 66.83 MB, 65.90 MB, 64.78 MB, 64.81 MB, 65.99 MB, 66.80 MB, 66.83 MB, 66.53 MB, 66.77 MB, 66.62 MB, 66.76 MB, 66.82 MB, 66.80 MB, 66.46 MB, 66.85 MB, 66.78 MB, 66.81 MB, 63.30 MB, 57.84 MB, 57.75 MB, 57.86 MB, 55.35 MB, 44.89 MB ThreadUsage(16s000ms): 12, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 7 - AverageThreadTokens: 12.80 - BloomFilterBytes: 33.00 MB (34603008) - PeakMemoryUsage: 67.82 MB (71110699) - PerHostPeakMemUsage: 161.65 GB (173573461802) - RowsProduced: 76.81M (76808114) - TotalNetworkReceiveTime: 642.605ms - TotalNetworkSendTime: 8m27s - TotalStorageWaitTime: 11s259ms - TotalThreadsInvoluntaryContextSwitches: 39.75K (39749) - TotalThreadsTotalWallClockTime: 1h53m - TotalThreadsSysTime: 3m3s - TotalThreadsUserTime: 2m41s - TotalThreadsVoluntaryContextSwitches: 15.44M (15442524) Fragment Instance Lifecycle Timings: - ExecTime: 8m49s - ExecTreeExecTime: 3s517ms - OpenTime: 1s114ms - ExecTreeOpenTime: 930.124ms - PrepareTime: 49.358ms - ExecTreePrepareTime: 7.294ms DataStreamSender (dst_id=22):(Total: 15s394ms, non-child: 15s394ms, % non-child: 100.00%) - BytesSent: 713.63 MB (748295828) - NetworkThroughput(*): 80.98 MB/sec - OverallThroughput: 46.36 MB/sec - PeakMemoryUsage: 4.80 MB (5035776) - RowsReturned: 76.81M (76808114) - SerializeBatchTime: 6s564ms - TransmitDataRPCTime: 8s812ms - UncompressedRowBatchSize: 2.15 GB (2305069828) CodeGen:(Total: 199.656ms, non-child: 199.656ms, % non-child: 100.00%) - CodegenTime: 1.159ms - CompileTime: 53.737ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 129.189ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 16.274ms HASH_JOIN_NODE (id=5):(Total: 4s424ms, non-child: 3s125ms, % non-child: 70.64%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.524ms - PeakMemoryUsage: 1.23 MB (1290502) - ProbeRows: 76.81M (76808114) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 2s969ms - RowsReturned: 76.81M (76808114) - RowsReturnedRate: 17.36 M/sec Hash Join Builder (join_node_id=5): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 34.032us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 140.899us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 62.598us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 642.615ms, non-child: 19.591us, % non-child: 0.00%) BytesReceived(16s000ms): 963.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 4.777us - DeserializeRowBatchTimer: 23.471us - FirstBatchArrivalWaitTime: 600.183ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 186.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=3):(Total: 656.911ms, non-child: 656.911ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:212/13.06 GB 5:226/13.44 GB 4:218/13.08 GB 2:246/14.71 GB 6:226/12.99 GB 7:203/11.53 GB 3:247/14.79 GB 1:228/12.07 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 116 out of 116 Runtime filters: Only following filters arrived: 6, waited 161ms Hdfs Read Thread Concurrency Bucket: 0:99.43% 1:0.4789% 2:0% 3:0.09579% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1690 PARQUET/SNAPPY:116 BytesRead(16s000ms): 13.55 MB, 14.45 MB, 14.45 MB, 19.53 MB, 29.24 MB, 29.66 MB, 39.67 MB, 44.09 MB, 46.37 MB, 58.77 MB, 58.89 MB, 64.33 MB, 73.35 MB, 73.84 MB, 82.64 MB, 88.21 MB, 89.59 MB, 102.71 MB, 103.24 MB, 106.43 MB, 117.26 MB, 117.40 MB, 117.98 MB, 128.32 MB, 132.47 MB, 132.47 MB, 133.18 MB, 139.58 MB, 142.09 MB, 142.09 MB, 142.09 MB, 142.09 MB - FooterProcessingTime: (Avg: 53.030ms ; Min: 3.544ms ; Max: 162.911ms ; Number of samples: 116) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 11.93 - BytesRead: 142.09 MB (148992669) - BytesReadDataNodeCache: 0 - BytesReadLocal: 142.09 MB (148992669) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 142.09 MB (148992669) - DecompressionTime: 1s396ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 116 (116) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 29.63 MB (31070124) - PerReadThreadRawHdfsThroughput: 24.04 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 120.094ms - RowBatchQueuePutWaitTime: 1h38m - RowsRead: 76.95M (76946399) - RowsReturned: 76.81M (76808114) - RowsReturnedRate: 116.92 M/sec - ScanRangesComplete: 1.81K (1806) - ScannerThreadsInvoluntaryContextSwitches: 35.09K (35088) - ScannerThreadsTotalWallClockTime: 1h44m - MaterializeTupleTime(*): 5s369ms - ScannerThreadsSysTime: 3m2s - ScannerThreadsUserTime: 2m20s - ScannerThreadsVoluntaryContextSwitches: 15.44M (15439420) - TotalRawHdfsReadTime(*): 5s909ms - TotalReadThroughput: 278.74 KB/sec Filter 2 (16.00 MB): - Rows processed: 2.01M (2013229) - Rows rejected: 138.27K (138272) - Rows total: 76.95M (76946399) Filter 5 (16.00 MB): - Rows processed: 1.82M (1815565) - Rows rejected: 13 (13) - Rows total: 76.81M (76808127) Filter 6 (1.00 MB): - Files processed: 1.81K (1806) - Files rejected: 1.69K (1690) - Files total: 1.81K (1806) - RowGroups processed: 74.98K (74978) - RowGroups rejected: 0 (0) - RowGroups total: 74.98K (74978) - Rows processed: 1.90M (1900544) - Rows rejected: 0 (0) - Rows total: 76.81M (76808114) - Splits processed: 116 (116) - Splits rejected: 0 (0) - Splits total: 116 (116) Instance 7f40dcb034de70b7:ce (host=vc1513.foo:22000):(Total: 8m51s, non-child: 8m31s, % non-child: 96.23%) Hdfs split stats (:<# splits>/): 1:215/12.71 GB 3:225/13.05 GB 2:240/14.69 GB 7:233/13.15 GB 0:216/12.57 GB 5:220/13.60 GB 4:217/11.84 GB 6:239/14.04 GB Filter 6 arrival: 811ms Filter 2 arrival: 13s119ms Filter 5 arrival: 16s595ms MemoryUsage(16s000ms): 35.12 MB, 66.27 MB, 66.84 MB, 66.46 MB, 66.78 MB, 66.78 MB, 66.44 MB, 66.85 MB, 66.71 MB, 66.73 MB, 66.80 MB, 66.39 MB, 66.84 MB, 66.83 MB, 66.67 MB, 66.83 MB, 66.81 MB, 66.67 MB, 66.78 MB, 66.57 MB, 66.84 MB, 66.82 MB, 66.87 MB, 66.26 MB, 65.85 MB, 65.87 MB, 65.74 MB, 63.90 MB, 54.60 MB, 54.79 MB, 54.62 MB, 54.42 MB ThreadUsage(16s000ms): 12, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.80 - BloomFilterBytes: 33.00 MB (34603008) - PeakMemoryUsage: 67.70 MB (70991800) - PerHostPeakMemUsage: 161.65 GB (173574922446) - RowsProduced: 76.19M (76194782) - TotalNetworkReceiveTime: 572.124ms - TotalNetworkSendTime: 8m27s - TotalStorageWaitTime: 11s981ms - TotalThreadsInvoluntaryContextSwitches: 43.15K (43145) - TotalThreadsTotalWallClockTime: 1h53m - TotalThreadsSysTime: 3m38s - TotalThreadsUserTime: 2m34s - TotalThreadsVoluntaryContextSwitches: 15.53M (15532780) Fragment Instance Lifecycle Timings: - ExecTime: 8m49s - ExecTreeExecTime: 3s424ms - OpenTime: 1s116ms - ExecTreeOpenTime: 932.457ms - PrepareTime: 59.981ms - ExecTreePrepareTime: 7.441ms DataStreamSender (dst_id=22):(Total: 15s498ms, non-child: 15s498ms, % non-child: 100.00%) - BytesSent: 706.29 MB (740598118) - NetworkThroughput(*): 77.57 MB/sec - OverallThroughput: 45.57 MB/sec - PeakMemoryUsage: 5.01 MB (5256960) - RowsReturned: 76.19M (76194782) - SerializeBatchTime: 6s374ms - TransmitDataRPCTime: 9s105ms - UncompressedRowBatchSize: 2.13 GB (2286663316) CodeGen:(Total: 207.546ms, non-child: 207.546ms, % non-child: 100.00%) - CodegenTime: 1.302ms - CompileTime: 51.799ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 130.504ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 24.818ms HASH_JOIN_NODE (id=5):(Total: 4s334ms, non-child: 2s974ms, % non-child: 68.61%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.499ms - PeakMemoryUsage: 1.23 MB (1290253) - ProbeRows: 76.19M (76194782) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 2s821ms - RowsReturned: 76.19M (76194782) - RowsReturnedRate: 17.58 M/sec Hash Join Builder (join_node_id=5): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 44.863us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 135.030us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 75.598us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 572.134ms, non-child: 19.329us, % non-child: 0.00%) BytesReceived(16s000ms): 932.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 4.491us - DeserializeRowBatchTimer: 16.641us - FirstBatchArrivalWaitTime: 550.383ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 209.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=3):(Total: 788.937ms, non-child: 788.937ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:215/12.71 GB 3:225/13.05 GB 2:240/14.69 GB 7:233/13.15 GB 0:216/12.57 GB 5:220/13.60 GB 4:217/11.84 GB 6:239/14.04 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 115 out of 115 Runtime filters: Only following filters arrived: 6, waited 221ms Hdfs Read Thread Concurrency Bucket: 0:98.94% 1:0.7685% 2:0.09606% 3:0% 4:0.09606% 5:0.09606% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1690 PARQUET/SNAPPY:115 BytesRead(16s000ms): 13.64 MB, 14.81 MB, 14.81 MB, 20.56 MB, 29.46 MB, 29.50 MB, 39.47 MB, 44.01 MB, 44.69 MB, 58.31 MB, 58.57 MB, 63.11 MB, 73.34 MB, 73.34 MB, 80.86 MB, 88.30 MB, 88.80 MB, 102.00 MB, 102.74 MB, 104.06 MB, 117.36 MB, 117.47 MB, 117.47 MB, 125.10 MB, 132.40 MB, 132.40 MB, 132.40 MB, 135.80 MB, 140.89 MB, 140.89 MB, 140.89 MB, 140.89 MB - FooterProcessingTime: (Avg: 53.927ms ; Min: 8.943ms ; Max: 154.171ms ; Number of samples: 115) - AverageHdfsReadThreadConcurrency: 0.02 - AverageScannerThreadConcurrency: 11.94 - BytesRead: 140.89 MB (147734823) - BytesReadDataNodeCache: 0 - BytesReadLocal: 140.89 MB (147734823) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 140.89 MB (147734823) - DecompressionTime: 968.415ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 115 (115) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 29.70 MB (31137924) - PerReadThreadRawHdfsThroughput: 21.06 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 132.158ms - RowBatchQueuePutWaitTime: 1h37m - RowsRead: 76.33M (76333106) - RowsReturned: 76.19M (76194782) - RowsReturnedRate: 96.58 M/sec - ScanRangesComplete: 1.80K (1805) - ScannerThreadsInvoluntaryContextSwitches: 38.61K (38606) - ScannerThreadsTotalWallClockTime: 1h44m - MaterializeTupleTime(*): 5s200ms - ScannerThreadsSysTime: 3m37s - ScannerThreadsUserTime: 2m14s - ScannerThreadsVoluntaryContextSwitches: 15.53M (15529686) - TotalRawHdfsReadTime(*): 6s689ms - TotalReadThroughput: 276.91 KB/sec Filter 2 (16.00 MB): - Rows processed: 2.00M (1997893) - Rows rejected: 138.28K (138277) - Rows total: 76.33M (76333106) Filter 5 (16.00 MB): - Rows processed: 1.83M (1830959) - Rows rejected: 47 (47) - Rows total: 76.19M (76194829) Filter 6 (1.00 MB): - Files processed: 1.80K (1805) - Files rejected: 1.69K (1690) - Files total: 1.80K (1805) - RowGroups processed: 74.39K (74387) - RowGroups rejected: 0 (0) - RowGroups total: 74.39K (74387) - Rows processed: 1.88M (1884160) - Rows rejected: 0 (0) - Rows total: 76.19M (76194782) - Splits processed: 115 (115) - Splits rejected: 0 (0) - Splits total: 115 (115) Instance 7f40dcb034de70b7:78 (host=vc1521.foo:22000):(Total: 8m45s, non-child: 8m24s, % non-child: 96.01%) Hdfs split stats (:<# splits>/): 7:242/13.71 GB 2:233/12.95 GB 4:231/14.14 GB 6:221/12.83 GB 5:213/12.93 GB 1:214/12.04 GB 0:198/11.35 GB 3:253/15.74 GB Filter 6 arrival: 1s194ms Filter 2 arrival: 10s922ms Filter 5 arrival: 15s661ms MemoryUsage(16s000ms): 37.56 MB, 66.69 MB, 66.79 MB, 66.58 MB, 66.75 MB, 66.73 MB, 65.73 MB, 65.82 MB, 65.66 MB, 64.85 MB, 64.69 MB, 65.08 MB, 66.76 MB, 66.57 MB, 66.64 MB, 66.85 MB, 66.07 MB, 64.62 MB, 64.78 MB, 65.59 MB, 66.75 MB, 66.80 MB, 66.76 MB, 66.45 MB, 66.87 MB, 66.79 MB, 66.70 MB, 66.56 MB, 57.16 MB, 55.57 MB, 54.83 MB, 46.35 MB ThreadUsage(16s000ms): 12, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 11 - AverageThreadTokens: 12.65 - BloomFilterBytes: 33.00 MB (34603008) - PeakMemoryUsage: 67.48 MB (70755560) - PerHostPeakMemUsage: 161.66 GB (173585550427) - RowsProduced: 76.14M (76143639) - TotalNetworkReceiveTime: 962.535ms - TotalNetworkSendTime: 8m17s - TotalStorageWaitTime: 11s654ms - TotalThreadsInvoluntaryContextSwitches: 43.46K (43459) - TotalThreadsTotalWallClockTime: 1h50m - TotalThreadsSysTime: 3m56s - TotalThreadsUserTime: 2m8s - TotalThreadsVoluntaryContextSwitches: 10.85M (10850314) Fragment Instance Lifecycle Timings: - ExecTime: 8m44s - ExecTreeExecTime: 3s617ms - OpenTime: 1s273ms - ExecTreeOpenTime: 1s090ms - PrepareTime: 53.304ms - ExecTreePrepareTime: 6.265ms DataStreamSender (dst_id=22):(Total: 16s107ms, non-child: 16s107ms, % non-child: 100.00%) - BytesSent: 706.03 MB (740329828) - NetworkThroughput(*): 77.33 MB/sec - OverallThroughput: 43.83 MB/sec - PeakMemoryUsage: 4.97 MB (5207808) - RowsReturned: 76.14M (76143639) - SerializeBatchTime: 6s957ms - TransmitDataRPCTime: 9s130ms - UncompressedRowBatchSize: 2.13 GB (2285128418) CodeGen:(Total: 204.694ms, non-child: 204.694ms, % non-child: 100.00%) - CodegenTime: 1.026ms - CompileTime: 54.673ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 126.414ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 23.228ms HASH_JOIN_NODE (id=5):(Total: 4s678ms, non-child: 3s133ms, % non-child: 66.99%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.402ms - PeakMemoryUsage: 1.24 MB (1295720) - ProbeRows: 76.14M (76143639) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 2s948ms - RowsReturned: 76.14M (76143639) - RowsReturnedRate: 16.28 M/sec Hash Join Builder (join_node_id=5): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 24.627us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 126.690us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 67.546us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 962.545ms, non-child: 19.488us, % non-child: 0.00%) BytesReceived(16s000ms): 932.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 3.849us - DeserializeRowBatchTimer: 14.350us - FirstBatchArrivalWaitTime: 945.850ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 124.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=3):(Total: 582.410ms, non-child: 582.410ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:242/13.71 GB 2:233/12.95 GB 4:231/14.14 GB 6:221/12.83 GB 5:213/12.93 GB 1:214/12.04 GB 0:198/11.35 GB 3:253/15.74 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 115 out of 115 Runtime filters: Only following filters arrived: 6, waited 40ms Hdfs Read Thread Concurrency Bucket: 0:98.73% 1:1.171% 2:0% 3:0% 4:0.09756% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1690 PARQUET/SNAPPY:115 BytesRead(16s000ms): 13.58 MB, 14.92 MB, 16.98 MB, 23.50 MB, 29.89 MB, 32.74 MB, 41.53 MB, 45.01 MB, 49.10 MB, 58.44 MB, 60.53 MB, 66.23 MB, 73.44 MB, 76.09 MB, 83.83 MB, 88.82 MB, 91.79 MB, 101.87 MB, 103.44 MB, 106.77 MB, 116.78 MB, 117.78 MB, 119.52 MB, 124.80 MB, 131.96 MB, 132.20 MB, 134.19 MB, 137.08 MB, 140.25 MB, 140.25 MB, 140.25 MB, 140.25 MB - FooterProcessingTime: (Avg: 53.051ms ; Min: 23.980ms ; Max: 164.887ms ; Number of samples: 115) - AverageHdfsReadThreadConcurrency: 0.02 - AverageScannerThreadConcurrency: 11.92 - BytesRead: 140.25 MB (147062465) - BytesReadDataNodeCache: 0 - BytesReadLocal: 140.25 MB (147062465) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 140.25 MB (147062465) - DecompressionTime: 1s563ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 115 (115) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 29.29 MB (30716527) - PerReadThreadRawHdfsThroughput: 22.75 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 81.048ms - RowBatchQueuePutWaitTime: 1h35m - RowsRead: 76.28M (76281676) - RowsReturned: 76.14M (76143639) - RowsReturnedRate: 130.74 M/sec - ScanRangesComplete: 1.80K (1805) - ScannerThreadsInvoluntaryContextSwitches: 38.61K (38608) - ScannerThreadsTotalWallClockTime: 1h41m - MaterializeTupleTime(*): 6s341ms - ScannerThreadsSysTime: 3m55s - ScannerThreadsUserTime: 1m46s - ScannerThreadsVoluntaryContextSwitches: 10.85M (10847222) - TotalRawHdfsReadTime(*): 6s166ms - TotalReadThroughput: 280.23 KB/sec Filter 2 (16.00 MB): - Rows processed: 1.97M (1973045) - Rows rejected: 138.01K (138011) - Rows total: 76.28M (76281676) Filter 5 (16.00 MB): - Rows processed: 1.84M (1835034) - Rows rejected: 26 (26) - Rows total: 76.14M (76143665) Filter 6 (1.00 MB): - Files processed: 1.80K (1805) - Files rejected: 1.69K (1690) - Files total: 1.80K (1805) - RowGroups processed: 74.33K (74328) - RowGroups rejected: 0 (0) - RowGroups total: 74.33K (74328) - Rows processed: 1.88M (1884160) - Rows rejected: 0 (0) - Rows total: 76.14M (76143639) - Splits processed: 115 (115) - Splits rejected: 0 (0) - Splits total: 115 (115) Instance 7f40dcb034de70b7:b4 (host=vc1532.foo:22000):(Total: 8m45s, non-child: 8m24s, % non-child: 96.05%) Hdfs split stats (:<# splits>/): 5:241/13.86 GB 4:222/13.09 GB 0:231/13.67 GB 1:218/12.74 GB 2:211/12.55 GB 6:227/13.16 GB 3:234/13.19 GB 7:233/13.40 GB Filter 6 arrival: 939ms Filter 2 arrival: 12s624ms Filter 5 arrival: 16s315ms MemoryUsage(16s000ms): 36.06 MB, 66.79 MB, 66.75 MB, 66.46 MB, 66.80 MB, 66.80 MB, 66.42 MB, 66.78 MB, 66.71 MB, 65.53 MB, 65.81 MB, 65.40 MB, 65.75 MB, 65.84 MB, 66.04 MB, 66.81 MB, 66.80 MB, 65.87 MB, 65.77 MB, 65.72 MB, 64.99 MB, 66.76 MB, 66.88 MB, 66.80 MB, 65.98 MB, 65.72 MB, 65.89 MB, 65.42 MB, 58.92 MB, 51.88 MB, 51.21 MB, 43.63 MB ThreadUsage(16s000ms): 12, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 6 - AverageThreadTokens: 12.54 - BloomFilterBytes: 33.00 MB (34603008) - PeakMemoryUsage: 67.52 MB (70798514) - PerHostPeakMemUsage: 161.66 GB (173576973125) - RowsProduced: 75.04M (75041759) - TotalNetworkReceiveTime: 702.282ms - TotalNetworkSendTime: 8m12s - TotalStorageWaitTime: 12s244ms - TotalThreadsInvoluntaryContextSwitches: 37.05K (37051) - TotalThreadsTotalWallClockTime: 1h49m - TotalThreadsSysTime: 3m17s - TotalThreadsUserTime: 2m5s - TotalThreadsVoluntaryContextSwitches: 13.45M (13451202) Fragment Instance Lifecycle Timings: - ExecTime: 8m43s - ExecTreeExecTime: 3s554ms - OpenTime: 1s194ms - ExecTreeOpenTime: 1s005ms - PrepareTime: 52.722ms - ExecTreePrepareTime: 7.702ms DataStreamSender (dst_id=22):(Total: 15s989ms, non-child: 15s989ms, % non-child: 100.00%) - BytesSent: 694.88 MB (728638625) - NetworkThroughput(*): 78.44 MB/sec - OverallThroughput: 43.46 MB/sec - PeakMemoryUsage: 4.93 MB (5166848) - RowsReturned: 75.04M (75041759) - SerializeBatchTime: 7s110ms - TransmitDataRPCTime: 8s858ms - UncompressedRowBatchSize: 2.10 GB (2252060226) CodeGen:(Total: 208.093ms, non-child: 208.093ms, % non-child: 100.00%) - CodegenTime: 1.122ms - CompileTime: 56.376ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 130.681ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 20.495ms HASH_JOIN_NODE (id=5):(Total: 4s532ms, non-child: 3s130ms, % non-child: 69.06%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.499ms - PeakMemoryUsage: 1.23 MB (1292402) - ProbeRows: 75.04M (75041759) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 2s970ms - RowsReturned: 75.04M (75041759) - RowsReturnedRate: 16.56 M/sec Hash Join Builder (join_node_id=5): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 31.593us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 161.292us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 57.952us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 702.292ms, non-child: 21.968us, % non-child: 0.00%) BytesReceived(16s000ms): 963.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 4.340us - DeserializeRowBatchTimer: 17.494us - FirstBatchArrivalWaitTime: 678.970ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 170.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=3):(Total: 700.373ms, non-child: 700.373ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:241/13.86 GB 4:222/13.09 GB 0:231/13.67 GB 1:218/12.74 GB 2:211/12.55 GB 6:227/13.16 GB 3:234/13.19 GB 7:233/13.40 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 114 out of 114 Runtime filters: Only following filters arrived: 6, waited 100ms Hdfs Read Thread Concurrency Bucket: 0:99.41% 1:0.3949% 2:0.1974% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1703 PARQUET/SNAPPY:114 BytesRead(8s000ms): 13.10 MB, 14.97 MB, 14.97 MB, 14.97 MB, 14.97 MB, 14.97 MB, 15.91 MB, 24.12 MB, 29.44 MB, 29.44 MB, 29.44 MB, 30.05 MB, 34.35 MB, 43.97 MB, 43.97 MB, 43.97 MB, 43.97 MB, 45.18 MB, 53.53 MB, 58.36 MB, 58.36 MB, 58.36 MB, 58.60 MB, 61.08 MB, 73.06 MB, 73.06 MB, 73.06 MB, 73.06 MB, 74.06 MB, 85.53 MB, 87.91 MB, 87.91 MB, 87.91 MB, 88.44 MB, 96.32 MB, 102.17 MB, 102.17 MB, 102.17 MB, 102.17 MB, 103.33 MB, 113.60 MB, 115.90 MB, 117.09 MB, 117.09 MB, 117.09 MB, 117.09 MB, 117.49 MB, 122.64 MB, 130.55 MB, 131.65 MB, 131.65 MB, 131.65 MB, 131.65 MB, 131.65 MB, 132.02 MB, 134.52 MB, 137.75 MB, 137.75 MB, 137.75 MB, 137.75 MB, 137.75 MB, 137.75 MB, 137.75 MB - FooterProcessingTime: (Avg: 57.935ms ; Min: 13.230ms ; Max: 226.435ms ; Number of samples: 114) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 11.89 - BytesRead: 137.75 MB (144441981) - BytesReadDataNodeCache: 0 - BytesReadLocal: 137.75 MB (144441981) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 137.75 MB (144441981) - DecompressionTime: 4s470ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 114 (114) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 29.44 MB (30875151) - PerReadThreadRawHdfsThroughput: 21.69 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 197.604ms - RowBatchQueuePutWaitTime: 1h35m - RowsRead: 75.18M (75177544) - RowsReturned: 75.04M (75041759) - RowsReturnedRate: 107.15 M/sec - ScanRangesComplete: 1.82K (1817) - ScannerThreadsInvoluntaryContextSwitches: 32.05K (32054) - ScannerThreadsTotalWallClockTime: 1h40m - MaterializeTupleTime(*): 6s176ms - ScannerThreadsSysTime: 3m17s - ScannerThreadsUserTime: 1m42s - ScannerThreadsVoluntaryContextSwitches: 13.45M (13448106) - TotalRawHdfsReadTime(*): 6s351ms - TotalReadThroughput: 278.49 KB/sec Filter 2 (16.00 MB): - Rows processed: 1.98M (1976937) - Rows rejected: 135.76K (135756) - Rows total: 75.18M (75177544) Filter 5 (16.00 MB): - Rows processed: 1.74M (1738781) - Rows rejected: 29 (29) - Rows total: 75.04M (75041788) Filter 6 (1.00 MB): - Files processed: 1.82K (1817) - Files rejected: 1.70K (1703) - Files total: 1.82K (1817) - RowGroups processed: 73.26K (73260) - RowGroups rejected: 0 (0) - RowGroups total: 73.26K (73260) - Rows processed: 1.87M (1867776) - Rows rejected: 0 (0) - Rows total: 75.04M (75041759) - Splits processed: 114 (114) - Splits rejected: 0 (0) - Splits total: 114 (114) Instance 7f40dcb034de70b7:bd (host=vc1542.foo:22000):(Total: 8m45s, non-child: 8m24s, % non-child: 96.02%) Hdfs split stats (:<# splits>/): 7:229/13.61 GB 0:217/12.00 GB 1:234/13.70 GB 5:215/12.66 GB 2:220/12.21 GB 3:231/14.44 GB 4:226/12.66 GB 6:248/14.40 GB Filter 6 arrival: 882ms Filter 2 arrival: 12s848ms Filter 5 arrival: 16s406ms MemoryUsage(16s000ms): 34.19 MB, 65.27 MB, 65.79 MB, 65.79 MB, 66.82 MB, 66.78 MB, 66.60 MB, 66.80 MB, 66.77 MB, 66.51 MB, 66.81 MB, 65.89 MB, 65.36 MB, 65.79 MB, 66.05 MB, 66.82 MB, 66.15 MB, 65.44 MB, 65.80 MB, 66.71 MB, 66.56 MB, 66.84 MB, 66.85 MB, 65.84 MB, 66.73 MB, 66.78 MB, 66.82 MB, 66.71 MB, 60.98 MB, 55.18 MB, 53.25 MB, 49.76 MB ThreadUsage(16s000ms): 12, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.70 - BloomFilterBytes: 33.00 MB (34603008) - PeakMemoryUsage: 67.73 MB (71018624) - PerHostPeakMemUsage: 161.67 GB (173590142446) - RowsProduced: 75.66M (75660902) - TotalNetworkReceiveTime: 651.952ms - TotalNetworkSendTime: 8m19s - TotalStorageWaitTime: 12s787ms - TotalThreadsInvoluntaryContextSwitches: 42.23K (42225) - TotalThreadsTotalWallClockTime: 1h51m - TotalThreadsSysTime: 3m39s - TotalThreadsUserTime: 2m12s - TotalThreadsVoluntaryContextSwitches: 11.48M (11484791) Fragment Instance Lifecycle Timings: - ExecTime: 8m43s - ExecTreeExecTime: 3s630ms - OpenTime: 1s117ms - ExecTreeOpenTime: 934.284ms - PrepareTime: 50.716ms - ExecTreePrepareTime: 6.900ms DataStreamSender (dst_id=22):(Total: 16s182ms, non-child: 16s182ms, % non-child: 100.00%) - BytesSent: 699.02 MB (732975197) - NetworkThroughput(*): 73.87 MB/sec - OverallThroughput: 43.19 MB/sec - PeakMemoryUsage: 4.94 MB (5183232) - RowsReturned: 75.66M (75660902) - SerializeBatchTime: 6s701ms - TransmitDataRPCTime: 9s462ms - UncompressedRowBatchSize: 2.11 GB (2270641180) CodeGen:(Total: 202.087ms, non-child: 202.087ms, % non-child: 100.00%) - CodegenTime: 1.067ms - CompileTime: 54.870ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 126.733ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 20.084ms HASH_JOIN_NODE (id=5):(Total: 4s537ms, non-child: 3s083ms, % non-child: 67.96%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.458ms - PeakMemoryUsage: 1.23 MB (1291285) - ProbeRows: 75.66M (75660902) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 2s960ms - RowsReturned: 75.66M (75660902) - RowsReturnedRate: 16.67 M/sec Hash Join Builder (join_node_id=5): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 16.795us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 388.980us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 34.976us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 651.958ms, non-child: 12.946us, % non-child: 0.00%) BytesReceived(16s000ms): 932.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 1.850us - DeserializeRowBatchTimer: 24.212us - FirstBatchArrivalWaitTime: 646.579ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 184.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=3):(Total: 802.104ms, non-child: 802.104ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:229/13.61 GB 0:217/12.00 GB 1:234/13.70 GB 5:215/12.66 GB 2:220/12.21 GB 3:231/14.44 GB 4:226/12.66 GB 6:248/14.40 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 115 out of 115 Runtime filters: Only following filters arrived: 6, waited 140ms Hdfs Read Thread Concurrency Bucket: 0:99.03% 1:0.8763% 2:0% 3:0.09737% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1705 PARQUET/SNAPPY:115 BytesRead(16s000ms): 13.10 MB, 14.39 MB, 14.61 MB, 19.63 MB, 28.78 MB, 29.34 MB, 38.47 MB, 43.29 MB, 44.45 MB, 56.11 MB, 57.98 MB, 60.76 MB, 72.26 MB, 72.92 MB, 77.88 MB, 87.02 MB, 87.71 MB, 97.26 MB, 101.57 MB, 102.81 MB, 113.48 MB, 116.46 MB, 116.88 MB, 118.81 MB, 130.44 MB, 131.09 MB, 131.63 MB, 132.86 MB, 138.22 MB, 138.48 MB, 138.48 MB, 138.48 MB - FooterProcessingTime: (Avg: 64.391ms ; Min: 24.572ms ; Max: 362.358ms ; Number of samples: 115) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 11.94 - BytesRead: 138.48 MB (145210638) - BytesReadDataNodeCache: 0 - BytesReadLocal: 138.48 MB (145210638) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 138.48 MB (145210638) - DecompressionTime: 1s534ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 115 (115) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 29.49 MB (30917847) - PerReadThreadRawHdfsThroughput: 22.47 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 136.523ms - RowBatchQueuePutWaitTime: 1h36m - RowsRead: 75.80M (75801038) - RowsReturned: 75.66M (75660902) - RowsReturnedRate: 94.33 M/sec - ScanRangesComplete: 1.82K (1820) - ScannerThreadsInvoluntaryContextSwitches: 37.61K (37613) - ScannerThreadsTotalWallClockTime: 1h42m - MaterializeTupleTime(*): 6s247ms - ScannerThreadsSysTime: 3m38s - ScannerThreadsUserTime: 1m52s - ScannerThreadsVoluntaryContextSwitches: 11.48M (11481690) - TotalRawHdfsReadTime(*): 6s162ms - TotalReadThroughput: 275.89 KB/sec Filter 2 (16.00 MB): - Rows processed: 1.99M (1988456) - Rows rejected: 140.09K (140093) - Rows total: 75.80M (75801038) Filter 5 (16.00 MB): - Rows processed: 1.78M (1777707) - Rows rejected: 43 (43) - Rows total: 75.66M (75660945) Filter 6 (1.00 MB): - Files processed: 1.82K (1820) - Files rejected: 1.71K (1705) - Files total: 1.82K (1820) - RowGroups processed: 73.86K (73862) - RowGroups rejected: 0 (0) - RowGroups total: 73.86K (73862) - Rows processed: 1.88M (1884160) - Rows rejected: 0 (0) - Rows total: 75.66M (75660902) - Splits processed: 115 (115) - Splits rejected: 0 (0) - Splits total: 115 (115) Instance 7f40dcb034de70b7:a9 (host=va1028.foo:22000):(Total: 8m37s, non-child: 8m16s, % non-child: 95.99%) Hdfs split stats (:<# splits>/): 5:217/12.48 GB 0:220/12.69 GB 2:244/14.36 GB 4:233/13.49 GB 6:233/13.07 GB 3:239/14.46 GB 7:224/12.92 GB 1:209/12.23 GB Filter 6 arrival: 1s015ms Filter 2 arrival: 12s373ms Filter 5 arrival: 16s187ms MemoryUsage(16s000ms): 36.19 MB, 66.80 MB, 66.72 MB, 66.48 MB, 66.77 MB, 66.68 MB, 66.60 MB, 66.75 MB, 66.38 MB, 66.80 MB, 66.07 MB, 65.56 MB, 65.83 MB, 66.57 MB, 64.48 MB, 66.72 MB, 66.72 MB, 66.64 MB, 66.22 MB, 65.64 MB, 63.58 MB, 63.73 MB, 63.79 MB, 63.90 MB, 64.21 MB, 64.05 MB, 64.83 MB, 63.88 MB, 55.83 MB, 55.60 MB, 54.66 MB, 50.82 MB ThreadUsage(16s000ms): 12, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 11 - AverageThreadTokens: 12.85 - BloomFilterBytes: 33.00 MB (34603008) - PeakMemoryUsage: 67.54 MB (70825171) - PerHostPeakMemUsage: 161.66 GB (173584473147) - RowsProduced: 76.50M (76498612) - TotalNetworkReceiveTime: 787.286ms - TotalNetworkSendTime: 8m14s - TotalStorageWaitTime: 14s086ms - TotalThreadsInvoluntaryContextSwitches: 38.78K (38785) - TotalThreadsTotalWallClockTime: 1h50m - TotalThreadsSysTime: 3m16s - TotalThreadsUserTime: 2m21s - TotalThreadsVoluntaryContextSwitches: 15.53M (15532178) Fragment Instance Lifecycle Timings: - ExecTime: 8m35s - ExecTreeExecTime: 3s722ms - OpenTime: 1s116ms - ExecTreeOpenTime: 936.185ms - PrepareTime: 50.180ms - ExecTreePrepareTime: 5.936ms DataStreamSender (dst_id=22):(Total: 15s905ms, non-child: 15s905ms, % non-child: 100.00%) - BytesSent: 708.99 MB (743434966) - NetworkThroughput(*): 75.79 MB/sec - OverallThroughput: 44.58 MB/sec - PeakMemoryUsage: 5.04 MB (5289728) - RowsReturned: 76.50M (76498612) - SerializeBatchTime: 6s532ms - TransmitDataRPCTime: 9s355ms - UncompressedRowBatchSize: 2.14 GB (2295781368) CodeGen:(Total: 201.425ms, non-child: 201.425ms, % non-child: 100.00%) - CodegenTime: 996.360us - CompileTime: 55.223ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 123.366ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 22.451ms HASH_JOIN_NODE (id=5):(Total: 4s629ms, non-child: 3s041ms, % non-child: 65.70%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 2.171ms - PeakMemoryUsage: 1.24 MB (1296755) - ProbeRows: 76.50M (76498612) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 2s898ms - RowsReturned: 76.50M (76498612) - RowsReturnedRate: 16.53 M/sec Hash Join Builder (join_node_id=5): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 25.268us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 375.172us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 61.093us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 787.301ms, non-child: 23.084us, % non-child: 0.00%) BytesReceived(16s000ms): 932.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 6.855us - DeserializeRowBatchTimer: 34.920us - FirstBatchArrivalWaitTime: 747.176ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 152.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=3):(Total: 800.938ms, non-child: 800.938ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:217/12.48 GB 0:220/12.69 GB 2:244/14.36 GB 4:233/13.49 GB 6:233/13.07 GB 3:239/14.46 GB 7:224/12.92 GB 1:209/12.23 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 117 out of 117 Runtime filters: Only following filters arrived: 6, waited 40ms Hdfs Read Thread Concurrency Bucket: 0:99.12% 1:0.878% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1702 PARQUET/SNAPPY:117 BytesRead(16s000ms): 13.72 MB, 14.67 MB, 15.77 MB, 23.35 MB, 29.57 MB, 31.56 MB, 42.35 MB, 44.44 MB, 48.73 MB, 58.57 MB, 59.32 MB, 65.55 MB, 72.98 MB, 74.11 MB, 82.47 MB, 88.66 MB, 89.93 MB, 100.97 MB, 103.86 MB, 104.72 MB, 114.28 MB, 117.23 MB, 118.31 MB, 121.66 MB, 130.99 MB, 131.88 MB, 132.86 MB, 136.33 MB, 140.18 MB, 140.18 MB, 140.18 MB, 140.18 MB - FooterProcessingTime: (Avg: 57.881ms ; Min: 4.349ms ; Max: 192.295ms ; Number of samples: 117) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 11.91 - BytesRead: 140.18 MB (146989958) - BytesReadDataNodeCache: 0 - BytesReadLocal: 140.18 MB (146989958) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 140.18 MB (146989958) - DecompressionTime: 534.392ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 117 (117) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 29.28 MB (30703166) - PerReadThreadRawHdfsThroughput: 17.01 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 101.418ms - RowBatchQueuePutWaitTime: 1h36m - RowsRead: 76.64M (76635376) - RowsReturned: 76.50M (76498612) - RowsReturnedRate: 95.51 M/sec - ScanRangesComplete: 1.82K (1819) - ScannerThreadsInvoluntaryContextSwitches: 34.25K (34251) - ScannerThreadsTotalWallClockTime: 1h42m - MaterializeTupleTime(*): 5s776ms - ScannerThreadsSysTime: 3m16s - ScannerThreadsUserTime: 2m1s - ScannerThreadsVoluntaryContextSwitches: 15.53M (15529141) - TotalRawHdfsReadTime(*): 8s238ms - TotalReadThroughput: 280.09 KB/sec Filter 2 (16.00 MB): - Rows processed: 1.97M (1967676) - Rows rejected: 136.69K (136695) - Rows total: 76.64M (76635376) Filter 5 (16.00 MB): - Rows processed: 1.82M (1818693) - Rows rejected: 69 (69) - Rows total: 76.50M (76498681) Filter 6 (1.00 MB): - Files processed: 1.82K (1819) - Files rejected: 1.70K (1702) - Files total: 1.82K (1819) - RowGroups processed: 74.68K (74684) - RowGroups rejected: 0 (0) - RowGroups total: 74.68K (74684) - Rows processed: 1.92M (1916928) - Rows rejected: 0 (0) - Rows total: 76.50M (76498612) - Splits processed: 117 (117) - Splits rejected: 0 (0) - Splits total: 117 (117) Instance 7f40dcb034de70b7:8d (host=va1033.foo:22000):(Total: 8m36s, non-child: 8m15s, % non-child: 95.94%) Hdfs split stats (:<# splits>/): 4:239/14.25 GB 3:228/13.27 GB 2:221/12.80 GB 1:199/11.24 GB 5:229/13.10 GB 6:243/13.60 GB 7:223/13.18 GB 0:243/14.25 GB Filter 6 arrival: 1s094ms Filter 2 arrival: 11s552ms Filter 5 arrival: 15s870ms MemoryUsage(16s000ms): 35.62 MB, 65.80 MB, 65.65 MB, 64.90 MB, 64.73 MB, 64.46 MB, 64.48 MB, 64.77 MB, 65.70 MB, 65.79 MB, 65.80 MB, 65.12 MB, 65.80 MB, 65.68 MB, 65.57 MB, 65.78 MB, 65.44 MB, 65.80 MB, 65.79 MB, 65.71 MB, 66.37 MB, 66.77 MB, 66.56 MB, 66.55 MB, 66.79 MB, 66.84 MB, 66.84 MB, 63.11 MB, 58.26 MB, 57.82 MB, 57.29 MB, 46.05 MB ThreadUsage(16s000ms): 12, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 9 - AverageThreadTokens: 12.85 - BloomFilterBytes: 33.00 MB (34603008) - PeakMemoryUsage: 67.37 MB (70638424) - PerHostPeakMemUsage: 161.67 GB (173587878448) - RowsProduced: 77.64M (77638893) - TotalNetworkReceiveTime: 871.555ms - TotalNetworkSendTime: 8m11s - TotalStorageWaitTime: 12s128ms - TotalThreadsInvoluntaryContextSwitches: 36.02K (36015) - TotalThreadsTotalWallClockTime: 1h50m - TotalThreadsSysTime: 2m33s - TotalThreadsUserTime: 2m35s - TotalThreadsVoluntaryContextSwitches: 13.71M (13707838) Fragment Instance Lifecycle Timings: - ExecTime: 8m35s - ExecTreeExecTime: 3s602ms - OpenTime: 1s163ms - ExecTreeOpenTime: 985.759ms - PrepareTime: 49.046ms - ExecTreePrepareTime: 6.126ms DataStreamSender (dst_id=22):(Total: 16s212ms, non-child: 16s212ms, % non-child: 100.00%) - BytesSent: 716.20 MB (750986084) - NetworkThroughput(*): 75.34 MB/sec - OverallThroughput: 44.18 MB/sec - PeakMemoryUsage: 4.90 MB (5142272) - RowsReturned: 77.64M (77638893) - SerializeBatchTime: 6s687ms - TransmitDataRPCTime: 9s506ms - UncompressedRowBatchSize: 2.17 GB (2330002174) CodeGen:(Total: 197.028ms, non-child: 197.028ms, % non-child: 100.00%) - CodegenTime: 1.030ms - CompileTime: 51.835ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 124.017ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 20.834ms HASH_JOIN_NODE (id=5):(Total: 4s555ms, non-child: 3s136ms, % non-child: 68.84%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.856ms - PeakMemoryUsage: 1.23 MB (1293589) - ProbeRows: 77.64M (77638893) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 2s975ms - RowsReturned: 77.64M (77638893) - RowsReturnedRate: 17.04 M/sec Hash Join Builder (join_node_id=5): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 30.654us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 324.040us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 70.707us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 871.563ms, non-child: 19.997us, % non-child: 0.00%) BytesReceived(16s000ms): 932.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 3.450us - DeserializeRowBatchTimer: 16.107us - FirstBatchArrivalWaitTime: 858.696ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 137.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=3):(Total: 548.511ms, non-child: 548.511ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:239/14.25 GB 3:228/13.27 GB 2:221/12.80 GB 1:199/11.24 GB 5:229/13.10 GB 6:243/13.60 GB 7:223/13.18 GB 0:243/14.25 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 118 out of 118 Runtime filters: Only following filters arrived: 6, waited 40ms Hdfs Read Thread Concurrency Bucket: 0:99.31% 1:0.4916% 2:0.1967% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1707 PARQUET/SNAPPY:118 BytesRead(8s000ms): 12.35 MB, 14.77 MB, 14.77 MB, 15.24 MB, 16.02 MB, 16.48 MB, 19.12 MB, 26.49 MB, 29.04 MB, 29.84 MB, 30.20 MB, 32.37 MB, 38.20 MB, 43.11 MB, 43.93 MB, 44.31 MB, 45.91 MB, 49.95 MB, 57.27 MB, 57.87 MB, 58.56 MB, 58.63 MB, 61.80 MB, 69.40 MB, 71.77 MB, 72.64 MB, 72.64 MB, 74.79 MB, 80.48 MB, 86.36 MB, 87.45 MB, 87.61 MB, 87.75 MB, 91.90 MB, 100.65 MB, 101.36 MB, 101.86 MB, 101.86 MB, 102.66 MB, 108.23 MB, 115.25 MB, 115.39 MB, 116.38 MB, 116.38 MB, 116.38 MB, 117.91 MB, 124.10 MB, 129.85 MB, 130.32 MB, 131.10 MB, 131.10 MB, 131.10 MB, 131.10 MB, 133.16 MB, 136.24 MB, 140.87 MB, 140.87 MB, 140.87 MB, 140.87 MB, 140.87 MB, 140.87 MB, 140.87 MB, 140.87 MB - FooterProcessingTime: (Avg: 53.872ms ; Min: 4.085ms ; Max: 268.873ms ; Number of samples: 118) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 11.94 - BytesRead: 140.87 MB (147709315) - BytesReadDataNodeCache: 0 - BytesReadLocal: 140.87 MB (147709315) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 140.87 MB (147709315) - DecompressionTime: 2s864ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 118 (118) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 29.16 MB (30573047) - PerReadThreadRawHdfsThroughput: 22.51 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 66.628ms - RowBatchQueuePutWaitTime: 1h36m - RowsRead: 77.78M (77776806) - RowsReturned: 77.64M (77638893) - RowsReturnedRate: 141.54 M/sec - ScanRangesComplete: 1.82K (1825) - ScannerThreadsInvoluntaryContextSwitches: 31.37K (31373) - ScannerThreadsTotalWallClockTime: 1h42m - MaterializeTupleTime(*): 6s116ms - ScannerThreadsSysTime: 2m33s - ScannerThreadsUserTime: 2m15s - ScannerThreadsVoluntaryContextSwitches: 13.70M (13704736) - TotalRawHdfsReadTime(*): 6s257ms - TotalReadThroughput: 283.67 KB/sec Filter 2 (16.00 MB): - Rows processed: 1.98M (1983161) - Rows rejected: 137.87K (137867) - Rows total: 77.78M (77776806) Filter 5 (16.00 MB): - Rows processed: 1.85M (1853486) - Rows rejected: 46 (46) - Rows total: 77.64M (77638939) Filter 6 (1.00 MB): - Files processed: 1.82K (1825) - Files rejected: 1.71K (1707) - Files total: 1.82K (1825) - RowGroups processed: 75.80K (75795) - RowGroups rejected: 0 (0) - RowGroups total: 75.80K (75795) - Rows processed: 1.93M (1933312) - Rows rejected: 0 (0) - Rows total: 77.64M (77638893) - Splits processed: 118 (118) - Splits rejected: 0 (0) - Splits total: 118 (118) Instance 7f40dcb034de70b7:93 (host=vd1123.foo:22000):(Total: 8m36s, non-child: 8m15s, % non-child: 95.78%) Hdfs split stats (:<# splits>/): 2:217/11.73 GB 5:240/13.16 GB 0:226/12.92 GB 4:252/15.03 GB 3:232/13.94 GB 1:213/12.48 GB 6:217/13.19 GB 7:217/13.21 GB Filter 6 arrival: 1s053ms Filter 2 arrival: 11s703ms Filter 5 arrival: 15s976ms MemoryUsage(16s000ms): 35.44 MB, 66.78 MB, 66.75 MB, 66.08 MB, 65.80 MB, 64.89 MB, 65.70 MB, 65.84 MB, 66.63 MB, 65.80 MB, 65.82 MB, 65.78 MB, 66.78 MB, 66.82 MB, 66.05 MB, 65.80 MB, 65.80 MB, 66.55 MB, 66.81 MB, 66.53 MB, 66.72 MB, 66.80 MB, 66.85 MB, 66.03 MB, 65.83 MB, 65.77 MB, 65.79 MB, 63.00 MB, 55.65 MB, 55.75 MB, 55.14 MB, 39.93 MB ThreadUsage(16s000ms): 11, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 4 - AverageThreadTokens: 12.66 - BloomFilterBytes: 33.00 MB (34603008) - PeakMemoryUsage: 67.36 MB (70628307) - PerHostPeakMemUsage: 161.67 GB (173596024188) - RowsProduced: 76.20M (76197922) - TotalNetworkReceiveTime: 814.826ms - TotalNetworkSendTime: 8m2s - TotalStorageWaitTime: 12s370ms - TotalThreadsInvoluntaryContextSwitches: 36.74K (36738) - TotalThreadsTotalWallClockTime: 1h49m - TotalThreadsSysTime: 3m16s - TotalThreadsUserTime: 2m2s - TotalThreadsVoluntaryContextSwitches: 12.57M (12572012) Fragment Instance Lifecycle Timings: - ExecTime: 8m35s - ExecTreeExecTime: 3s950ms - OpenTime: 1s171ms - ExecTreeOpenTime: 979.304ms - PrepareTime: 51.658ms - ExecTreePrepareTime: 7.351ms DataStreamSender (dst_id=22):(Total: 16s711ms, non-child: 16s711ms, % non-child: 100.00%) - BytesSent: 704.07 MB (738273659) - NetworkThroughput(*): 75.56 MB/sec - OverallThroughput: 42.13 MB/sec - PeakMemoryUsage: 4.94 MB (5175040) - RowsReturned: 76.20M (76197922) - SerializeBatchTime: 7s372ms - TransmitDataRPCTime: 9s318ms - UncompressedRowBatchSize: 2.13 GB (2286757516) CodeGen:(Total: 209.904ms, non-child: 209.904ms, % non-child: 100.00%) - CodegenTime: 1.180ms - CompileTime: 58.437ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 132.230ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 18.748ms HASH_JOIN_NODE (id=5):(Total: 4s898ms, non-child: 3s318ms, % non-child: 67.75%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.421ms - PeakMemoryUsage: 1.23 MB (1292994) - ProbeRows: 76.20M (76197922) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3s156ms - RowsReturned: 76.20M (76197922) - RowsReturnedRate: 15.55 M/sec Hash Join Builder (join_node_id=5): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 31.369us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 157.887us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 60.309us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 814.841ms, non-child: 28.245us, % non-child: 0.00%) BytesReceived(16s000ms): 901.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 9.124us - DeserializeRowBatchTimer: 28.078us - FirstBatchArrivalWaitTime: 812.730ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 147.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=3):(Total: 765.713ms, non-child: 765.713ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:217/11.73 GB 5:240/13.16 GB 0:226/12.92 GB 4:252/15.03 GB 3:232/13.94 GB 1:213/12.48 GB 6:217/13.19 GB 7:217/13.21 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 115 out of 115 Runtime filters: Only following filters arrived: 6, waited 40ms Hdfs Read Thread Concurrency Bucket: 0:98.7% 1:1.198% 2:0.0998% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1699 PARQUET/SNAPPY:115 BytesRead(8s000ms): 11.89 MB, 14.64 MB, 14.64 MB, 14.64 MB, 14.64 MB, 15.61 MB, 18.57 MB, 26.19 MB, 28.78 MB, 28.78 MB, 29.33 MB, 31.14 MB, 37.05 MB, 43.24 MB, 43.24 MB, 43.38 MB, 44.39 MB, 48.12 MB, 56.25 MB, 57.58 MB, 57.58 MB, 58.26 MB, 59.73 MB, 65.71 MB, 72.23 MB, 72.23 MB, 72.46 MB, 73.94 MB, 77.55 MB, 85.78 MB, 86.69 MB, 86.69 MB, 87.70 MB, 90.13 MB, 99.11 MB, 101.46 MB, 101.46 MB, 101.46 MB, 102.69 MB, 107.38 MB, 115.31 MB, 115.98 MB, 115.98 MB, 115.98 MB, 115.98 MB, 117.60 MB, 120.95 MB, 129.11 MB, 130.15 MB, 130.15 MB, 130.15 MB, 130.15 MB, 130.31 MB, 132.43 MB, 133.81 MB, 136.99 MB, 138.65 MB, 138.65 MB, 138.65 MB, 138.65 MB, 138.65 MB, 138.65 MB - FooterProcessingTime: (Avg: 58.668ms ; Min: 3.416ms ; Max: 181.995ms ; Number of samples: 115) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 11.96 - BytesRead: 138.65 MB (145386542) - BytesReadDataNodeCache: 0 - BytesReadLocal: 138.65 MB (145386542) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 138.65 MB (145386542) - DecompressionTime: 1s556ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 115 (115) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 29.21 MB (30627755) - PerReadThreadRawHdfsThroughput: 21.18 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 118.254ms - RowBatchQueuePutWaitTime: 1h35m - RowsRead: 76.34M (76337489) - RowsReturned: 76.20M (76197922) - RowsReturnedRate: 99.51 M/sec - ScanRangesComplete: 1.81K (1814) - ScannerThreadsInvoluntaryContextSwitches: 31.75K (31747) - ScannerThreadsTotalWallClockTime: 1h40m - MaterializeTupleTime(*): 6s280ms - ScannerThreadsSysTime: 3m16s - ScannerThreadsUserTime: 1m38s - ScannerThreadsVoluntaryContextSwitches: 12.57M (12568987) - TotalRawHdfsReadTime(*): 6s545ms - TotalReadThroughput: 283.11 KB/sec Filter 2 (16.00 MB): - Rows processed: 1.97M (1966383) - Rows rejected: 139.56K (139563) - Rows total: 76.34M (76337489) Filter 5 (16.00 MB): - Rows processed: 1.81M (1805316) - Rows rejected: 4 (4) - Rows total: 76.20M (76197926) Filter 6 (1.00 MB): - Files processed: 1.81K (1814) - Files rejected: 1.70K (1699) - Files total: 1.81K (1814) - RowGroups processed: 74.39K (74386) - RowGroups rejected: 0 (0) - RowGroups total: 74.39K (74386) - Rows processed: 1.88M (1884160) - Rows rejected: 0 (0) - Rows total: 76.20M (76197922) - Splits processed: 115 (115) - Splits rejected: 0 (0) - Splits total: 115 (115) Instance 7f40dcb034de70b7:95 (host=vc1526.foo:22000):(Total: 8m28s, non-child: 8m7s, % non-child: 95.79%) Hdfs split stats (:<# splits>/): 3:252/14.59 GB 2:223/12.88 GB 0:201/11.81 GB 4:232/13.78 GB 1:230/13.08 GB 7:226/13.81 GB 6:215/12.69 GB 5:225/13.04 GB Filter 6 arrival: 1s036ms Filter 2 arrival: 11s707ms Filter 5 arrival: 15s959ms MemoryUsage(8s000ms): 29.13 MB, 42.06 MB, 65.48 MB, 66.77 MB, 66.77 MB, 66.90 MB, 66.67 MB, 66.79 MB, 66.69 MB, 66.83 MB, 66.87 MB, 66.83 MB, 66.42 MB, 66.84 MB, 66.87 MB, 66.85 MB, 66.77 MB, 66.36 MB, 65.69 MB, 65.63 MB, 65.71 MB, 65.82 MB, 65.60 MB, 65.86 MB, 66.77 MB, 66.70 MB, 66.84 MB, 66.80 MB, 66.48 MB, 65.39 MB, 65.69 MB, 65.74 MB, 65.79 MB, 65.79 MB, 66.14 MB, 66.89 MB, 66.78 MB, 66.77 MB, 66.81 MB, 66.48 MB, 65.77 MB, 65.91 MB, 65.87 MB, 65.78 MB, 65.76 MB, 65.74 MB, 65.63 MB, 66.01 MB, 65.78 MB, 65.78 MB, 65.85 MB, 65.75 MB, 65.80 MB, 65.81 MB, 65.80 MB, 64.56 MB, 57.93 MB, 54.95 MB, 54.73 MB, 52.93 MB, 50.37 MB, 49.62 MB, 40.88 MB ThreadUsage(8s000ms): 11, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 3 - AverageThreadTokens: 12.77 - BloomFilterBytes: 33.00 MB (34603008) - PeakMemoryUsage: 67.41 MB (70684936) - PerHostPeakMemUsage: 161.66 GB (173582959960) - RowsProduced: 75.06M (75057473) - TotalNetworkReceiveTime: 753.004ms - TotalNetworkSendTime: 7m54s - TotalStorageWaitTime: 11s673ms - TotalThreadsInvoluntaryContextSwitches: 32.82K (32823) - TotalThreadsTotalWallClockTime: 1h48m - TotalThreadsSysTime: 2m55s - TotalThreadsUserTime: 1m52s - TotalThreadsVoluntaryContextSwitches: 9.14M (9137413) Fragment Instance Lifecycle Timings: - ExecTime: 8m27s - ExecTreeExecTime: 3s694ms - OpenTime: 1s105ms - ExecTreeOpenTime: 874.408ms - PrepareTime: 56.250ms - ExecTreePrepareTime: 7.516ms DataStreamSender (dst_id=22):(Total: 16s632ms, non-child: 16s632ms, % non-child: 100.00%) - BytesSent: 696.93 MB (730788419) - NetworkThroughput(*): 74.54 MB/sec - OverallThroughput: 41.90 MB/sec - PeakMemoryUsage: 4.97 MB (5216000) - RowsReturned: 75.06M (75057473) - SerializeBatchTime: 7s262ms - TransmitDataRPCTime: 9s350ms - UncompressedRowBatchSize: 2.10 GB (2252531766) CodeGen:(Total: 253.089ms, non-child: 253.089ms, % non-child: 100.00%) - CodegenTime: 1.110ms - CompileTime: 71.367ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 157.646ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 22.939ms HASH_JOIN_NODE (id=5):(Total: 4s538ms, non-child: 3s236ms, % non-child: 71.31%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.533ms - PeakMemoryUsage: 1.23 MB (1292720) - ProbeRows: 75.06M (75057473) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3s063ms - RowsReturned: 75.06M (75057473) - RowsReturnedRate: 16.54 M/sec Hash Join Builder (join_node_id=5): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 23.922us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 150.375us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 52.889us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 753.016ms, non-child: 20.214us, % non-child: 0.00%) BytesReceived(8s000ms): 870.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 5.376us - DeserializeRowBatchTimer: 14.229us - FirstBatchArrivalWaitTime: 740.662ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 159.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=3):(Total: 549.992ms, non-child: 549.992ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:252/14.59 GB 2:223/12.88 GB 0:201/11.81 GB 4:232/13.78 GB 1:230/13.08 GB 7:226/13.81 GB 6:215/12.69 GB 5:225/13.04 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 114 out of 114 Runtime filters: Only following filters arrived: 6, waited 40ms Hdfs Read Thread Concurrency Bucket: 0:99.2% 1:0.7976% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1690 PARQUET/SNAPPY:114 BytesRead(8s000ms): 12.20 MB, 13.94 MB, 14.27 MB, 15.27 MB, 16.22 MB, 16.61 MB, 19.06 MB, 28.02 MB, 29.50 MB, 30.40 MB, 31.19 MB, 32.08 MB, 39.68 MB, 43.82 MB, 44.77 MB, 45.92 MB, 46.08 MB, 50.49 MB, 58.03 MB, 59.14 MB, 59.86 MB, 60.68 MB, 60.99 MB, 66.95 MB, 73.08 MB, 74.12 MB, 74.92 MB, 75.42 MB, 76.72 MB, 85.03 MB, 87.85 MB, 88.82 MB, 89.89 MB, 90.36 MB, 97.25 MB, 102.73 MB, 103.50 MB, 104.11 MB, 104.71 MB, 107.47 MB, 115.85 MB, 116.90 MB, 117.68 MB, 118.03 MB, 118.98 MB, 119.29 MB, 120.77 MB, 126.21 MB, 130.78 MB, 131.57 MB, 132.73 MB, 132.73 MB, 133.65 MB, 134.07 MB, 134.07 MB, 136.04 MB, 138.72 MB, 138.72 MB, 138.72 MB, 138.72 MB, 138.72 MB, 138.72 MB - FooterProcessingTime: (Avg: 58.522ms ; Min: 23.654ms ; Max: 678.201ms ; Number of samples: 114) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 11.88 - BytesRead: 138.72 MB (145463380) - BytesReadDataNodeCache: 0 - BytesReadLocal: 138.72 MB (145463380) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 138.72 MB (145463380) - DecompressionTime: 491.173ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 114 (114) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 29.25 MB (30674608) - PerReadThreadRawHdfsThroughput: 24.12 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 72.935ms - RowBatchQueuePutWaitTime: 1h34m - RowsRead: 75.19M (75189459) - RowsReturned: 75.06M (75057473) - RowsReturnedRate: 136.47 M/sec - ScanRangesComplete: 1.80K (1804) - ScannerThreadsInvoluntaryContextSwitches: 27.87K (27871) - ScannerThreadsTotalWallClockTime: 1h39m - MaterializeTupleTime(*): 6s505ms - ScannerThreadsSysTime: 2m55s - ScannerThreadsUserTime: 1m28s - ScannerThreadsVoluntaryContextSwitches: 9.13M (9134412) - TotalRawHdfsReadTime(*): 5s751ms - TotalReadThroughput: 283.26 KB/sec Filter 2 (16.00 MB): - Rows processed: 1.89M (1894290) - Rows rejected: 131.95K (131946) - Rows total: 75.19M (75189459) Filter 5 (16.00 MB): - Rows processed: 1.77M (1769512) - Rows rejected: 40 (40) - Rows total: 75.06M (75057513) Filter 6 (1.00 MB): - Files processed: 1.80K (1804) - Files rejected: 1.69K (1690) - Files total: 1.80K (1804) - RowGroups processed: 73.28K (73276) - RowGroups rejected: 0 (0) - RowGroups total: 73.28K (73276) - Rows processed: 1.87M (1867776) - Rows rejected: 0 (0) - Rows total: 75.06M (75057473) - Splits processed: 114 (114) - Splits rejected: 0 (0) - Splits total: 114 (114) Instance 7f40dcb034de70b7:b3 (host=vd1133.foo:22000):(Total: 8m24s, non-child: 8m3s, % non-child: 95.78%) Hdfs split stats (:<# splits>/): 3:232/13.97 GB 1:234/13.37 GB 7:236/14.08 GB 4:229/13.67 GB 2:216/12.96 GB 6:221/12.99 GB 0:230/12.46 GB 5:217/12.17 GB Filter 6 arrival: 948ms Filter 2 arrival: 12s621ms Filter 5 arrival: 16s292ms MemoryUsage(8s000ms): 30.76 MB, 41.77 MB, 66.75 MB, 66.83 MB, 66.68 MB, 66.87 MB, 66.26 MB, 65.41 MB, 65.78 MB, 65.82 MB, 65.82 MB, 65.79 MB, 66.38 MB, 66.78 MB, 66.78 MB, 66.60 MB, 66.83 MB, 66.64 MB, 66.44 MB, 66.82 MB, 66.82 MB, 66.79 MB, 66.64 MB, 66.71 MB, 66.75 MB, 66.78 MB, 66.93 MB, 66.85 MB, 66.86 MB, 66.46 MB, 66.82 MB, 66.82 MB, 66.88 MB, 66.87 MB, 66.21 MB, 66.67 MB, 66.81 MB, 66.84 MB, 66.84 MB, 66.70 MB, 66.69 MB, 66.93 MB, 66.73 MB, 66.86 MB, 66.80 MB, 66.72 MB, 66.72 MB, 66.76 MB, 66.64 MB, 66.87 MB, 66.92 MB, 66.83 MB, 65.92 MB, 65.72 MB, 65.80 MB, 65.75 MB, 62.43 MB, 58.00 MB, 49.24 MB, 49.28 MB, 49.30 MB, 48.20 MB ThreadUsage(8s000ms): 11, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.85 - BloomFilterBytes: 33.00 MB (34603008) - PeakMemoryUsage: 67.69 MB (70973577) - PerHostPeakMemUsage: 161.67 GB (173587108289) - RowsProduced: 74.94M (74935426) - TotalNetworkReceiveTime: 710.578ms - TotalNetworkSendTime: 7m59s - TotalStorageWaitTime: 11s632ms - TotalThreadsInvoluntaryContextSwitches: 33.06K (33061) - TotalThreadsTotalWallClockTime: 1h47m - TotalThreadsSysTime: 2m53s - TotalThreadsUserTime: 1m42s - TotalThreadsVoluntaryContextSwitches: 7.57M (7574994) Fragment Instance Lifecycle Timings: - ExecTime: 8m23s - ExecTreeExecTime: 3s782ms - OpenTime: 1s098ms - ExecTreeOpenTime: 913.922ms - PrepareTime: 59.756ms - ExecTreePrepareTime: 7.305ms DataStreamSender (dst_id=22):(Total: 16s411ms, non-child: 16s411ms, % non-child: 100.00%) - BytesSent: 696.06 MB (729873964) - NetworkThroughput(*): 77.16 MB/sec - OverallThroughput: 42.41 MB/sec - PeakMemoryUsage: 5.04 MB (5281536) - RowsReturned: 74.94M (74935426) - SerializeBatchTime: 7s372ms - TransmitDataRPCTime: 9s021ms - UncompressedRowBatchSize: 2.09 GB (2248869132) CodeGen:(Total: 206.780ms, non-child: 206.780ms, % non-child: 100.00%) - CodegenTime: 1.092ms - CompileTime: 55.687ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 126.705ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 23.968ms HASH_JOIN_NODE (id=5):(Total: 4s671ms, non-child: 3s365ms, % non-child: 72.05%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.748ms - PeakMemoryUsage: 1.24 MB (1296881) - ProbeRows: 74.94M (74935426) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3s233ms - RowsReturned: 74.94M (74935426) - RowsReturnedRate: 16.04 M/sec Hash Join Builder (join_node_id=5): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 28.784us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 208.320us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 54.766us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 710.589ms, non-child: 24.972us, % non-child: 0.00%) BytesReceived(8s000ms): 932.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 5.880us - DeserializeRowBatchTimer: 33.808us - FirstBatchArrivalWaitTime: 682.218ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 168.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=3):(Total: 595.952ms, non-child: 595.952ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:232/13.97 GB 1:234/13.37 GB 7:236/14.08 GB 4:229/13.67 GB 2:216/12.96 GB 6:221/12.99 GB 0:230/12.46 GB 5:217/12.17 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 113 out of 113 Runtime filters: Only following filters arrived: 6, waited 81ms Hdfs Read Thread Concurrency Bucket: 0:99.1% 1:0.804% 2:0.1005% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1702 PARQUET/SNAPPY:113 BytesRead(8s000ms): 13.07 MB, 14.93 MB, 14.93 MB, 14.93 MB, 15.48 MB, 16.18 MB, 17.56 MB, 26.54 MB, 29.53 MB, 29.61 MB, 30.79 MB, 31.26 MB, 37.98 MB, 44.08 MB, 44.08 MB, 44.85 MB, 45.30 MB, 47.63 MB, 57.33 MB, 58.88 MB, 58.95 MB, 60.03 MB, 60.42 MB, 65.42 MB, 73.74 MB, 73.74 MB, 74.40 MB, 74.91 MB, 76.43 MB, 83.54 MB, 88.48 MB, 88.48 MB, 89.37 MB, 90.16 MB, 95.82 MB, 103.28 MB, 103.42 MB, 103.50 MB, 104.63 MB, 105.34 MB, 110.31 MB, 118.21 MB, 118.21 MB, 118.21 MB, 118.45 MB, 119.51 MB, 120.42 MB, 123.67 MB, 132.54 MB, 133.08 MB, 133.08 MB, 133.08 MB, 133.90 MB, 134.17 MB, 134.17 MB, 135.82 MB, 138.64 MB, 138.96 MB, 138.96 MB, 138.96 MB, 138.96 MB, 138.96 MB - FooterProcessingTime: (Avg: 55.503ms ; Min: 4.239ms ; Max: 197.608ms ; Number of samples: 113) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 11.96 - BytesRead: 138.96 MB (145706197) - BytesReadDataNodeCache: 0 - BytesReadLocal: 138.96 MB (145706197) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 138.96 MB (145706197) - DecompressionTime: 861.383ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 113 (113) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 29.62 MB (31055882) - PerReadThreadRawHdfsThroughput: 23.04 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 116.773ms - RowBatchQueuePutWaitTime: 1h34m - RowsRead: 75.07M (75070082) - RowsReturned: 74.94M (74935426) - RowsReturnedRate: 125.74 M/sec - ScanRangesComplete: 1.81K (1815) - ScannerThreadsInvoluntaryContextSwitches: 28.09K (28089) - ScannerThreadsTotalWallClockTime: 1h39m - MaterializeTupleTime(*): 6s254ms - ScannerThreadsSysTime: 2m52s - ScannerThreadsUserTime: 1m20s - ScannerThreadsVoluntaryContextSwitches: 7.57M (7571977) - TotalRawHdfsReadTime(*): 6s031ms - TotalReadThroughput: 286.01 KB/sec Filter 2 (16.00 MB): - Rows processed: 1.94M (1944064) - Rows rejected: 134.64K (134640) - Rows total: 75.07M (75070082) Filter 5 (16.00 MB): - Rows processed: 1.75M (1753104) - Rows rejected: 16 (16) - Rows total: 74.94M (74935442) Filter 6 (1.00 MB): - Files processed: 1.81K (1815) - Files rejected: 1.70K (1702) - Files total: 1.81K (1815) - RowGroups processed: 73.16K (73156) - RowGroups rejected: 0 (0) - RowGroups total: 73.16K (73156) - Rows processed: 1.85M (1851392) - Rows rejected: 0 (0) - Rows total: 74.94M (74935426) - Splits processed: 113 (113) - Splits rejected: 0 (0) - Splits total: 113 (113) Instance 7f40dcb034de70b7:9c (host=vd1331.foo:22000):(Total: 8m17s, non-child: 7m56s, % non-child: 95.80%) Hdfs split stats (:<# splits>/): 4:215/11.90 GB 0:232/13.67 GB 3:217/12.76 GB 2:218/12.46 GB 6:226/12.64 GB 1:205/12.17 GB 5:245/14.73 GB 7:254/15.35 GB Filter 6 arrival: 1s040ms Filter 2 arrival: 11s987ms Filter 5 arrival: 16s082ms MemoryUsage(8s000ms): 28.44 MB, 42.48 MB, 65.82 MB, 66.85 MB, 66.87 MB, 66.84 MB, 66.62 MB, 65.89 MB, 65.75 MB, 65.79 MB, 65.82 MB, 65.58 MB, 66.11 MB, 66.87 MB, 66.72 MB, 66.74 MB, 66.86 MB, 66.55 MB, 66.62 MB, 66.84 MB, 66.86 MB, 66.82 MB, 66.70 MB, 66.63 MB, 66.77 MB, 66.77 MB, 66.78 MB, 66.83 MB, 66.18 MB, 65.80 MB, 65.81 MB, 65.85 MB, 65.73 MB, 65.73 MB, 65.63 MB, 65.77 MB, 65.77 MB, 65.85 MB, 65.73 MB, 65.45 MB, 66.53 MB, 66.92 MB, 66.85 MB, 66.85 MB, 66.72 MB, 66.75 MB, 66.73 MB, 66.86 MB, 66.68 MB, 66.84 MB, 66.70 MB, 66.78 MB, 66.80 MB, 66.90 MB, 66.87 MB, 64.70 MB, 54.33 MB, 51.42 MB, 51.25 MB, 51.17 MB, 51.12 MB, 49.12 MB ThreadUsage(8s000ms): 10, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.97 - BloomFilterBytes: 33.00 MB (34603008) - PeakMemoryUsage: 67.53 MB (70807671) - PerHostPeakMemUsage: 161.68 GB (173600258342) - RowsProduced: 74.90M (74896972) - TotalNetworkReceiveTime: 810.622ms - TotalNetworkSendTime: 7m51s - TotalStorageWaitTime: 11s114ms - TotalThreadsInvoluntaryContextSwitches: 40.29K (40291) - TotalThreadsTotalWallClockTime: 1h47m - TotalThreadsSysTime: 3m41s - TotalThreadsUserTime: 2m1s - TotalThreadsVoluntaryContextSwitches: 16.54M (16540421) Fragment Instance Lifecycle Timings: - ExecTime: 8m15s - ExecTreeExecTime: 3s781ms - OpenTime: 1s116ms - ExecTreeOpenTime: 937.421ms - PrepareTime: 55.309ms - ExecTreePrepareTime: 6.248ms DataStreamSender (dst_id=22):(Total: 15s992ms, non-child: 15s992ms, % non-child: 100.00%) - BytesSent: 695.10 MB (728859941) - NetworkThroughput(*): 77.62 MB/sec - OverallThroughput: 43.46 MB/sec - PeakMemoryUsage: 5.01 MB (5256960) - RowsReturned: 74.90M (74896972) - SerializeBatchTime: 7s015ms - TransmitDataRPCTime: 8s955ms - UncompressedRowBatchSize: 2.09 GB (2247715072) CodeGen:(Total: 202.846ms, non-child: 202.846ms, % non-child: 100.00%) - CodegenTime: 1.051ms - CompileTime: 52.871ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 124.254ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 25.308ms HASH_JOIN_NODE (id=5):(Total: 4s685ms, non-child: 3s167ms, % non-child: 67.61%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.585ms - PeakMemoryUsage: 1.23 MB (1290714) - ProbeRows: 74.90M (74896972) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3s006ms - RowsReturned: 74.90M (74896972) - RowsReturnedRate: 15.99 M/sec Hash Join Builder (join_node_id=5): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 23.755us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 108.241us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 73.217us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 810.633ms, non-child: 20.240us, % non-child: 0.00%) BytesReceived(8s000ms): 870.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 4.768us - DeserializeRowBatchTimer: 23.113us - FirstBatchArrivalWaitTime: 793.760ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 148.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=3):(Total: 707.579ms, non-child: 707.579ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:215/11.90 GB 0:232/13.67 GB 3:217/12.76 GB 2:218/12.46 GB 6:226/12.64 GB 1:205/12.17 GB 5:245/14.73 GB 7:254/15.35 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 113 out of 113 Runtime filters: Only following filters arrived: 6, waited 40ms Hdfs Read Thread Concurrency Bucket: 0:98.59% 1:1.413% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1699 PARQUET/SNAPPY:113 BytesRead(8s000ms): 12.02 MB, 14.79 MB, 14.79 MB, 14.79 MB, 15.77 MB, 16.10 MB, 19.24 MB, 27.95 MB, 29.37 MB, 30.00 MB, 30.64 MB, 32.31 MB, 40.48 MB, 44.12 MB, 44.27 MB, 45.36 MB, 45.51 MB, 50.63 MB, 58.51 MB, 59.20 MB, 59.67 MB, 60.42 MB, 61.06 MB, 69.22 MB, 74.13 MB, 74.13 MB, 75.07 MB, 75.68 MB, 80.00 MB, 87.08 MB, 88.82 MB, 89.19 MB, 89.99 MB, 91.71 MB, 99.79 MB, 103.21 MB, 103.21 MB, 103.21 MB, 104.43 MB, 106.23 MB, 112.45 MB, 117.92 MB, 118.08 MB, 118.08 MB, 118.16 MB, 119.33 MB, 121.40 MB, 127.59 MB, 131.64 MB, 132.97 MB, 132.97 MB, 132.97 MB, 133.52 MB, 134.23 MB, 135.10 MB, 138.03 MB, 139.21 MB, 139.21 MB, 139.21 MB, 139.21 MB, 139.21 MB, 139.21 MB - FooterProcessingTime: (Avg: 52.023ms ; Min: 4.256ms ; Max: 133.899ms ; Number of samples: 113) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 11.98 - BytesRead: 139.21 MB (145971821) - BytesReadDataNodeCache: 0 - BytesReadLocal: 139.21 MB (145971821) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 139.21 MB (145971821) - DecompressionTime: 821.749ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 113 (113) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 29.27 MB (30694359) - PerReadThreadRawHdfsThroughput: 23.62 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 79.218ms - RowBatchQueuePutWaitTime: 1h33m - RowsRead: 75.03M (75030991) - RowsReturned: 74.90M (74896972) - RowsReturnedRate: 105.85 M/sec - ScanRangesComplete: 1.81K (1812) - ScannerThreadsInvoluntaryContextSwitches: 35.53K (35532) - ScannerThreadsTotalWallClockTime: 1h39m - MaterializeTupleTime(*): 6s104ms - ScannerThreadsSysTime: 3m40s - ScannerThreadsUserTime: 1m39s - ScannerThreadsVoluntaryContextSwitches: 16.54M (16537417) - TotalRawHdfsReadTime(*): 5s892ms - TotalReadThroughput: 287.40 KB/sec Filter 2 (16.00 MB): - Rows processed: 1.89M (1892227) - Rows rejected: 133.99K (133985) - Rows total: 75.03M (75030991) Filter 5 (16.00 MB): - Rows processed: 1.76M (1764386) - Rows rejected: 34 (34) - Rows total: 74.90M (74897006) Filter 6 (1.00 MB): - Files processed: 1.81K (1812) - Files rejected: 1.70K (1699) - Files total: 1.81K (1812) - RowGroups processed: 73.11K (73112) - RowGroups rejected: 0 (0) - RowGroups total: 73.11K (73112) - Rows processed: 1.85M (1851392) - Rows rejected: 0 (0) - Rows total: 74.90M (74896972) - Splits processed: 113 (113) - Splits rejected: 0 (0) - Splits total: 113 (113) Instance 7f40dcb034de70b7:9b (host=vc1524.foo:22000):(Total: 8m9s, non-child: 7m49s, % non-child: 95.82%) Hdfs split stats (:<# splits>/): 6:246/13.91 GB 1:226/12.72 GB 3:226/13.32 GB 5:224/13.06 GB 2:217/12.92 GB 7:224/13.45 GB 4:231/13.61 GB 0:223/12.72 GB Filter 6 arrival: 722ms Filter 2 arrival: 11s647ms Filter 5 arrival: 15s744ms MemoryUsage(8s000ms): 28.64 MB, 42.61 MB, 66.81 MB, 66.82 MB, 66.80 MB, 66.86 MB, 66.66 MB, 66.02 MB, 66.77 MB, 66.86 MB, 66.81 MB, 66.77 MB, 66.16 MB, 66.74 MB, 66.78 MB, 66.80 MB, 66.65 MB, 66.89 MB, 66.08 MB, 66.76 MB, 66.78 MB, 66.83 MB, 66.77 MB, 66.26 MB, 66.80 MB, 66.78 MB, 66.83 MB, 66.86 MB, 66.79 MB, 66.11 MB, 66.78 MB, 66.88 MB, 66.85 MB, 66.48 MB, 65.53 MB, 65.77 MB, 65.87 MB, 65.78 MB, 65.73 MB, 64.60 MB, 64.80 MB, 64.82 MB, 64.77 MB, 64.71 MB, 64.86 MB, 65.02 MB, 65.73 MB, 65.95 MB, 66.90 MB, 66.78 MB, 66.80 MB, 66.82 MB, 66.80 MB, 66.73 MB, 66.50 MB, 57.81 MB, 46.67 MB, 46.72 MB, 46.81 MB, 43.73 MB ThreadUsage(8s000ms): 11, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 10 - AverageThreadTokens: 12.78 - BloomFilterBytes: 33.00 MB (34603008) - PeakMemoryUsage: 67.57 MB (70855426) - PerHostPeakMemUsage: 161.68 GB (173600261871) - RowsProduced: 73.52M (73516730) - TotalNetworkReceiveTime: 457.286ms - TotalNetworkSendTime: 7m44s - TotalStorageWaitTime: 11s658ms - TotalThreadsInvoluntaryContextSwitches: 36.07K (36066) - TotalThreadsTotalWallClockTime: 1h44m - TotalThreadsSysTime: 3m52s - TotalThreadsUserTime: 1m29s - TotalThreadsVoluntaryContextSwitches: 8.45M (8452051) Fragment Instance Lifecycle Timings: - ExecTime: 8m8s - ExecTreeExecTime: 3s688ms - OpenTime: 1s078ms - ExecTreeOpenTime: 854.492ms - PrepareTime: 103.333ms - ExecTreePrepareTime: 7.667ms DataStreamSender (dst_id=22):(Total: 15s722ms, non-child: 15s722ms, % non-child: 100.00%) - BytesSent: 679.82 MB (712840951) - NetworkThroughput(*): 77.50 MB/sec - OverallThroughput: 43.24 MB/sec - PeakMemoryUsage: 5.06 MB (5306112) - RowsReturned: 73.52M (73516730) - SerializeBatchTime: 6s929ms - TransmitDataRPCTime: 8s772ms - UncompressedRowBatchSize: 2.05 GB (2206292908) CodeGen:(Total: 239.918ms, non-child: 239.918ms, % non-child: 100.00%) - CodegenTime: 978.215us - CompileTime: 65.424ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 156.509ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 17.509ms HASH_JOIN_NODE (id=5):(Total: 4s512ms, non-child: 3s029ms, % non-child: 67.13%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.414ms - PeakMemoryUsage: 1.23 MB (1293813) - ProbeRows: 73.52M (73516730) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 2s868ms - RowsReturned: 73.52M (73516730) - RowsReturnedRate: 16.29 M/sec Hash Join Builder (join_node_id=5): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 25.990us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 127.993us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 68.582us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 457.296ms, non-child: 18.319us, % non-child: 0.00%) BytesReceived(8s000ms): 870.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 4.721us - DeserializeRowBatchTimer: 12.292us - FirstBatchArrivalWaitTime: 427.723ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 262.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=3):(Total: 1s026ms, non-child: 1s026ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 6:246/13.91 GB 1:226/12.72 GB 3:226/13.32 GB 5:224/13.06 GB 2:217/12.92 GB 7:224/13.45 GB 4:231/13.61 GB 0:223/12.72 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 111 out of 111 Runtime filters: Only following filters arrived: 6, waited 301ms Hdfs Read Thread Concurrency Bucket: 0:99.07% 1:0.8282% 2:0.1035% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1706 PARQUET/SNAPPY:111 BytesRead(8s000ms): 12.09 MB, 14.88 MB, 14.88 MB, 14.88 MB, 14.88 MB, 14.88 MB, 15.55 MB, 23.36 MB, 29.51 MB, 29.51 MB, 29.51 MB, 29.75 MB, 33.29 MB, 44.10 MB, 44.10 MB, 44.10 MB, 44.10 MB, 45.29 MB, 56.06 MB, 58.63 MB, 58.63 MB, 58.63 MB, 59.06 MB, 62.54 MB, 73.17 MB, 73.17 MB, 73.17 MB, 73.17 MB, 74.12 MB, 81.62 MB, 87.85 MB, 87.85 MB, 87.85 MB, 88.58 MB, 94.25 MB, 102.46 MB, 102.46 MB, 102.46 MB, 102.59 MB, 103.91 MB, 114.11 MB, 116.70 MB, 116.70 MB, 116.70 MB, 116.70 MB, 116.93 MB, 118.04 MB, 124.86 MB, 131.07 MB, 131.07 MB, 131.07 MB, 131.07 MB, 131.07 MB, 132.11 MB, 132.62 MB, 134.12 MB, 134.54 MB, 134.54 MB, 134.54 MB, 134.54 MB - FooterProcessingTime: (Avg: 59.172ms ; Min: 21.553ms ; Max: 213.711ms ; Number of samples: 111) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 11.86 - BytesRead: 134.54 MB (141075058) - BytesReadDataNodeCache: 0 - BytesReadLocal: 134.54 MB (141075058) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 134.54 MB (141075058) - DecompressionTime: 1s327ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 111 (111) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 29.45 MB (30883190) - PerReadThreadRawHdfsThroughput: 22.27 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 88.825ms - RowBatchQueuePutWaitTime: 1h30m - RowsRead: 73.65M (73648354) - RowsReturned: 73.52M (73516730) - RowsReturnedRate: 71.60 M/sec - ScanRangesComplete: 1.82K (1817) - ScannerThreadsInvoluntaryContextSwitches: 31.31K (31310) - ScannerThreadsTotalWallClockTime: 1h36m - MaterializeTupleTime(*): 6s235ms - ScannerThreadsSysTime: 3m51s - ScannerThreadsUserTime: 1m7s - ScannerThreadsVoluntaryContextSwitches: 8.45M (8448928) - TotalRawHdfsReadTime(*): 6s040ms - TotalReadThroughput: 284.94 KB/sec Filter 2 (16.00 MB): - Rows processed: 1.92M (1923624) - Rows rejected: 131.57K (131574) - Rows total: 73.65M (73648354) Filter 5 (16.00 MB): - Rows processed: 1.76M (1757234) - Rows rejected: 50 (50) - Rows total: 73.52M (73516780) Filter 6 (1.00 MB): - Files processed: 1.82K (1817) - Files rejected: 1.71K (1706) - Files total: 1.82K (1817) - RowGroups processed: 71.77K (71770) - RowGroups rejected: 0 (0) - RowGroups total: 71.77K (71770) - Rows processed: 1.82M (1818624) - Rows rejected: 0 (0) - Rows total: 73.52M (73516730) - Splits processed: 111 (111) - Splits rejected: 0 (0) - Splits total: 111 (111) Instance 7f40dcb034de70b7:70 (host=vd1114.foo:22000):(Total: 36s835ms, non-child: 33s851ms, % non-child: 91.90%) Hdfs split stats (:<# splits>/): 4:8/346.14 MB 6:9/633.99 MB 2:9/613.61 MB 7:8/439.03 MB 5:13/651.40 MB 1:11/386.15 MB 3:8/480.34 MB 0:13/929.39 MB Filter 6 arrival: 1s204ms Filter 2 arrival: 10s695ms Filter 5 arrival: 15s531ms MemoryUsage(1s000ms): 1.58 MB, 12.39 MB, 21.17 MB, 21.17 MB, 21.17 MB, 21.17 MB, 21.17 MB, 21.17 MB, 21.17 MB, 21.17 MB, 29.17 MB, 37.17 MB, 37.17 MB, 37.17 MB, 37.17 MB, 45.17 MB, 53.55 MB, 53.47 MB, 53.44 MB, 53.23 MB, 53.31 MB, 53.56 MB, 53.58 MB, 53.41 MB, 53.38 MB, 53.56 MB, 53.45 MB, 53.46 MB, 53.40 MB, 53.50 MB, 53.54 MB, 53.60 MB, 52.39 MB, 51.15 MB, 50.10 MB, 44.95 MB ThreadUsage(1s000ms): 2, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7 - AverageThreadTokens: 6.78 - BloomFilterBytes: 33.00 MB (34603008) - PeakMemoryUsage: 54.29 MB (56932154) - PerHostPeakMemUsage: 12.82 GB (13760516190) - RowsProduced: 3.98M (3984811) - TotalNetworkReceiveTime: 971.940ms - TotalNetworkSendTime: 33s496ms - TotalStorageWaitTime: 3s669ms - TotalThreadsInvoluntaryContextSwitches: 1.12K (1122) - TotalThreadsTotalWallClockTime: 4m6s - TotalThreadsSysTime: 877.863ms - TotalThreadsUserTime: 6s148ms - TotalThreadsVoluntaryContextSwitches: 70.30K (70300) Fragment Instance Lifecycle Timings: - ExecTime: 35s010ms - ExecTreeExecTime: 230.498ms - OpenTime: 1s774ms - ExecTreeOpenTime: 1s588ms - PrepareTime: 50.905ms - ExecTreePrepareTime: 561.854us DataStreamSender (dst_id=22):(Total: 959.492ms, non-child: 959.492ms, % non-child: 100.00%) - BytesSent: 36.28 MB (38042479) - NetworkThroughput(*): 68.37 MB/sec - OverallThroughput: 37.81 MB/sec - PeakMemoryUsage: 4.90 MB (5142272) - RowsReturned: 3.98M (3984811) - SerializeBatchTime: 427.016ms - TransmitDataRPCTime: 530.671ms - UncompressedRowBatchSize: 114.05 MB (119587698) CodeGen:(Total: 206.833ms, non-child: 206.833ms, % non-child: 100.00%) - CodegenTime: 1.230ms - CompileTime: 54.611ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 129.459ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 22.290ms HASH_JOIN_NODE (id=5):(Total: 1s817ms, non-child: 202.526ms, % non-child: 11.14%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.508ms - PeakMemoryUsage: 1.22 MB (1275844) - ProbeRows: 3.98M (3984811) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 193.151ms - RowsReturned: 3.98M (3984811) - RowsReturnedRate: 2.19 M/sec Hash Join Builder (join_node_id=5): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 28.328us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 149.259us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 86.138us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 971.949ms, non-child: 19.726us, % non-child: 0.00%) BytesReceived(1s000ms): 0, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 4.276us - DeserializeRowBatchTimer: 24.456us - FirstBatchArrivalWaitTime: 939.432ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 123.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=3):(Total: 642.869ms, non-child: 642.869ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:8/346.14 MB 6:9/633.99 MB 2:9/613.61 MB 7:8/439.03 MB 5:13/651.40 MB 1:11/386.15 MB 3:8/480.34 MB 0:13/929.39 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 6 out of 6 Runtime filters: Only following filters arrived: 6, waited 40ms Hdfs Read Thread Concurrency Bucket: 0:98.63% 1:1.37% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:73 PARQUET/SNAPPY:6 BytesRead(1s000ms): 0, 2.05 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB, 7.35 MB - FooterProcessingTime: (Avg: 465.282ms ; Min: 97.197ms ; Max: 598.873ms ; Number of samples: 6) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 5.75 - BytesRead: 7.35 MB (7709549) - BytesReadDataNodeCache: 0 - BytesReadLocal: 7.35 MB (7709549) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 7.35 MB (7709549) - DecompressionTime: 24.925ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 5 (5) - NumRowGroups: 6 (6) - NumScannerThreadsStarted: 6 (6) - PeakMemoryUsage: 15.57 MB (16329712) - PerReadThreadRawHdfsThroughput: 10.25 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 572.749ms - RowBatchQueuePutWaitTime: 3m20s - RowsRead: 3.99M (3990358) - RowsReturned: 3.98M (3984811) - RowsReturnedRate: 6.20 M/sec - ScanRangesComplete: 79 (79) - ScannerThreadsInvoluntaryContextSwitches: 775 (775) - ScannerThreadsTotalWallClockTime: 3m29s - MaterializeTupleTime(*): 374.161ms - ScannerThreadsSysTime: 799.875ms - ScannerThreadsUserTime: 4s531ms - ScannerThreadsVoluntaryContextSwitches: 69.73K (69733) - TotalRawHdfsReadTime(*): 717.215ms - TotalReadThroughput: 206.27 KB/sec Filter 2 (16.00 MB): - Rows processed: 83.37K (83371) - Rows rejected: 5.55K (5547) - Rows total: 3.99M (3990358) Filter 5 (16.00 MB): - Rows processed: 77.82K (77824) - Rows rejected: 0 (0) - Rows total: 3.98M (3984811) Filter 6 (1.00 MB): - Files processed: 79 (79) - Files rejected: 73 (73) - Files total: 79 (79) - RowGroups processed: 3.89K (3892) - RowGroups rejected: 0 (0) - RowGroups total: 3.89K (3892) - Rows processed: 98.30K (98304) - Rows rejected: 0 (0) - Rows total: 3.98M (3984811) - Splits processed: 6 (6) - Splits rejected: 0 (0) - Splits total: 6 (6) Averaged Fragment F04:(Total: 718.805ms, non-child: 303.001ms, % non-child: 42.15%) split sizes: min: 2.15 MB, max: 2.15 MB, avg: 2.15 MB, stddev: 0 completion times: min:1s113ms max:1s113ms mean: 1s113ms stddev:0.000ns execution rates: min:1.93 MB/sec max:1.93 MB/sec mean:1.93 MB/sec stddev:0.00 /sec num instances: 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.44 MB (3602820) - PerHostPeakMemUsage: 20.46 MB (21455757) - RowsProduced: 120 (120) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 2.296ms - TotalStorageWaitTime: 31.419ms - TotalThreadsInvoluntaryContextSwitches: 26 (26) - TotalThreadsTotalWallClockTime: 379.060ms - TotalThreadsSysTime: 12.998ms - TotalThreadsUserTime: 52.992ms - TotalThreadsVoluntaryContextSwitches: 351 (351) Fragment Instance Lifecycle Timings: - ExecTime: 187.698ms - ExecTreeExecTime: 135.167ms - OpenTime: 61.743ms - ExecTreeOpenTime: 830.346us - PrepareTime: 469.310ms - ExecTreePrepareTime: 247.680us DataStreamSender (dst_id=20):(Total: 20.730ms, non-child: 20.730ms, % non-child: 100.00%) - BytesSent: 130.21 KB (133330) - NetworkThroughput(*): 22.48 MB/sec - OverallThroughput: 6.13 MB/sec - PeakMemoryUsage: 1.29 MB (1350720) - RowsReturned: 120 (120) - SerializeBatchTime: 43.611us - TransmitDataRPCTime: 5.656ms - UncompressedRowBatchSize: 267.48 KB (273896) CodeGen:(Total: 258.446ms, non-child: 258.446ms, % non-child: 100.00%) - CodegenTime: 2.498ms - CompileTime: 25.589ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 17 (17) - NumInstructions: 310 (310) - OptimizationTime: 29.715ms - PeakMemoryUsage: 155.00 KB (158720) - PrepareTime: 202.210ms HDFS_SCAN_NODE (id=4):(Total: 136.625ms, non-child: 136.625ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 465.57 KB (476741) - BytesReadDataNodeCache: 0 - BytesReadLocal: 465.57 KB (476741) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 465.57 KB (476741) - DecompressionTime: 257.866us - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 2.14 MB (2243261) - PerReadThreadRawHdfsThroughput: 208.54 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 131.473ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 73.05K (73049) - RowsReturned: 120 (120) - RowsReturnedRate: 878.00 /sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 4 (4) - ScannerThreadsTotalWallClockTime: 131.619ms - MaterializeTupleTime(*): 5.355ms - ScannerThreadsSysTime: 2.999ms - ScannerThreadsUserTime: 3.999ms - ScannerThreadsVoluntaryContextSwitches: 8 (8) - TotalRawHdfsReadTime(*): 2.180ms - TotalReadThroughput: 0.00 /sec Fragment F04: Instance 7f40dcb034de70b7:6f (host=va1045.foo:22000):(Total: 718.805ms, non-child: 303.001ms, % non-child: 42.15%) Hdfs split stats (:<# splits>/): 0:1/2.15 MB MemoryUsage(500.000ms): 1.29 MB ThreadUsage(500.000ms): 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.44 MB (3602820) - PerHostPeakMemUsage: 20.46 MB (21455757) - RowsProduced: 120 (120) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 2.296ms - TotalStorageWaitTime: 31.419ms - TotalThreadsInvoluntaryContextSwitches: 26 (26) - TotalThreadsTotalWallClockTime: 379.060ms - TotalThreadsSysTime: 12.998ms - TotalThreadsUserTime: 52.992ms - TotalThreadsVoluntaryContextSwitches: 351 (351) Fragment Instance Lifecycle Timings: - ExecTime: 187.698ms - ExecTreeExecTime: 135.167ms - OpenTime: 61.743ms - ExecTreeOpenTime: 830.346us - PrepareTime: 469.310ms - ExecTreePrepareTime: 247.680us DataStreamSender (dst_id=20):(Total: 20.730ms, non-child: 20.730ms, % non-child: 100.00%) - BytesSent: 130.21 KB (133330) - NetworkThroughput(*): 22.48 MB/sec - OverallThroughput: 6.13 MB/sec - PeakMemoryUsage: 1.29 MB (1350720) - RowsReturned: 120 (120) - SerializeBatchTime: 43.611us - TransmitDataRPCTime: 5.656ms - UncompressedRowBatchSize: 267.48 KB (273896) CodeGen:(Total: 258.446ms, non-child: 258.446ms, % non-child: 100.00%) - CodegenTime: 2.498ms - CompileTime: 25.589ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 17 (17) - NumInstructions: 310 (310) - OptimizationTime: 29.715ms - PeakMemoryUsage: 155.00 KB (158720) - PrepareTime: 202.210ms HDFS_SCAN_NODE (id=4):(Total: 136.625ms, non-child: 136.625ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/2.15 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:3 BytesRead(500.000ms): 0 - FooterProcessingTime: (Avg: 6.448ms ; Min: 6.448ms ; Max: 6.448ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 465.57 KB (476741) - BytesReadDataNodeCache: 0 - BytesReadLocal: 465.57 KB (476741) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 465.57 KB (476741) - DecompressionTime: 257.866us - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 2.14 MB (2243261) - PerReadThreadRawHdfsThroughput: 208.54 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 131.473ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 73.05K (73049) - RowsReturned: 120 (120) - RowsReturnedRate: 878.00 /sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 4 (4) - ScannerThreadsTotalWallClockTime: 131.619ms - MaterializeTupleTime(*): 5.355ms - ScannerThreadsSysTime: 2.999ms - ScannerThreadsUserTime: 3.999ms - ScannerThreadsVoluntaryContextSwitches: 8 (8) - TotalRawHdfsReadTime(*): 2.180ms - TotalReadThroughput: 0.00 /sec Averaged Fragment F05:(Total: 10s518ms, non-child: 2s338ms, % non-child: 22.23%) split sizes: min: 3.43 GB, max: 75.56 GB, avg: 74.26 GB, stddev: 8.85 GB completion times: min:1s897ms max:12s840ms mean: 10s529ms stddev:1s216ms execution rates: min:1.81 GB/sec max:8.97 GB/sec mean:7.01 GB/sec stddev:778.08 MB/sec num instances: 134 - AverageThreadTokens: 11.81 - BloomFilterBytes: 10.79 MB (11315230) - PeakMemoryUsage: 36.90 MB (38695295) - PerHostPeakMemUsage: 1.36 GB (1462521716) - RowsProduced: 40.28M (40277267) - TotalNetworkReceiveTime: 204.667ms - TotalNetworkSendTime: 2s585ms - TotalStorageWaitTime: 6s103ms - TotalThreadsInvoluntaryContextSwitches: 2.54K (2545) - TotalThreadsTotalWallClockTime: 2m5s - TotalThreadsSysTime: 3s080ms - TotalThreadsUserTime: 10s942ms - TotalThreadsVoluntaryContextSwitches: 165.24K (165236) Fragment Instance Lifecycle Timings: - ExecTime: 9s352ms - ExecTreeExecTime: 1s074ms - OpenTime: 1s109ms - ExecTreeOpenTime: 926.101ms - PrepareTime: 56.425ms - ExecTreePrepareTime: 3.339ms DataStreamSender (dst_id=23):(Total: 5s982ms, non-child: 5s982ms, % non-child: 100.00%) - BytesSent: 381.75 MB (400294250) - NetworkThroughput(*): 101.51 MB/sec - OverallThroughput: 63.79 MB/sec - PeakMemoryUsage: 4.77 MB (5003007) - RowsReturned: 40.28M (40277267) - SerializeBatchTime: 2s214ms - TransmitDataRPCTime: 3s760ms - UncompressedRowBatchSize: 1.28 GB (1369939082) CodeGen:(Total: 204.193ms, non-child: 204.193ms, % non-child: 100.00%) - CodegenTime: 1.066ms - CompileTime: 54.019ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 90 (90) - NumInstructions: 2.97K (2968) - OptimizationTime: 127.368ms - PeakMemoryUsage: 1.45 MB (1519616) - PrepareTime: 22.360ms HASH_JOIN_NODE (id=11):(Total: 1s993ms, non-child: 924.502ms, % non-child: 46.38%) - BuildRows: 120 (120) - BuildTime: 1.521ms - PeakMemoryUsage: 1.23 MB (1294244) - ProbeRows: 40.28M (40277267) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 873.851ms - RowsReturned: 40.28M (40277267) - RowsReturnedRate: 20.13 M/sec Hash Join Builder (join_node_id=11): - BuildRowsPartitionTime: 28.310us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 158.006us - HashBuckets: 212 (212) - HashCollisions: 0 (0) - HashTablesBuildTime: 58.846us - LargestPartitionPercent: 9 (9) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1073600) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 204.678ms, non-child: 204.678ms, % non-child: 100.00%) - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 5.231us - DeserializeRowBatchTimer: 21.821us - FirstBatchArrivalWaitTime: 192.664ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 1.28 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=9):(Total: 864.327ms, non-child: 864.327ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.22 - AverageScannerThreadConcurrency: 11.11 - BytesRead: 54.52 MB (57168515) - BytesReadDataNodeCache: 0 - BytesReadLocal: 54.52 MB (57168515) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 54.52 MB (57168515) - DecompressionTime: 334.508ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 7 (7) - NumRowGroups: 56 (56) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 23.82 MB (24980717) - PerReadThreadRawHdfsThroughput: 25.47 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 148.271ms - RowBatchQueuePutWaitTime: 1m39s - RowsRead: 40.28M (40284662) - RowsReturned: 40.28M (40277267) - RowsReturnedRate: 48.39 M/sec - ScanRangesComplete: 1.17K (1165) - ScannerThreadsInvoluntaryContextSwitches: 1.70K (1701) - ScannerThreadsTotalWallClockTime: 1m54s - MaterializeTupleTime(*): 2s036ms - ScannerThreadsSysTime: 2s809ms - ScannerThreadsUserTime: 4s260ms - ScannerThreadsVoluntaryContextSwitches: 164.60K (164599) - TotalRawHdfsReadTime(*): 2s155ms - TotalReadThroughput: 5.20 MB/sec Filter 2 (16.00 MB): - Rows processed: 104.08K (104080) - Rows rejected: 7.39K (7395) - Rows total: 40.28M (40284662) Filter 7 (1.00 MB): - Files processed: 1.17K (1165) - Files rejected: 1.11K (1108) - Files total: 1.17K (1165) - RowGroups processed: 39.37K (39374) - RowGroups rejected: 0 (0) - RowGroups total: 39.37K (39374) - Rows processed: 929.86K (929860) - Rows rejected: 0 (0) - Rows total: 40.28M (40277267) - Splits processed: 56 (56) - Splits rejected: 0 (0) - Splits total: 56 (56) Fragment F05: Instance 7f40dcb034de70b7:15c (host=va1026.foo:22000):(Total: 12s826ms, non-child: 4s095ms, % non-child: 31.93%) Hdfs split stats (:<# splits>/): 7:125/8.30 GB 1:136/9.01 GB 5:155/9.06 GB 2:172/11.57 GB 4:146/9.63 GB 6:147/8.68 GB 0:143/9.55 GB 3:149/9.64 GB Filter 7 arrival: 283ms Filter 2 arrival: 11s111ms MemoryUsage(500.000ms): 0, 3.38 MB, 3.38 MB, 23.88 MB, 24.08 MB, 24.05 MB, 22.55 MB, 25.92 MB, 26.09 MB, 26.18 MB, 26.44 MB, 26.33 MB, 26.13 MB, 24.15 MB, 25.19 MB, 26.17 MB, 27.18 MB, 23.30 MB, 27.98 MB, 27.20 MB, 27.74 MB, 27.17 MB, 26.85 MB, 38.24 MB, 28.88 MB, 18.68 MB ThreadUsage(500.000ms): 1, 1, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 1 - AverageThreadTokens: 11.62 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 39.77 MB (41706324) - PerHostPeakMemUsage: 1.62 GB (1735352074) - RowsProduced: 42.18M (42175827) - TotalNetworkReceiveTime: 24.362ms - TotalNetworkSendTime: 3s860ms - TotalStorageWaitTime: 7s498ms - TotalThreadsInvoluntaryContextSwitches: 3.26K (3260) - TotalThreadsTotalWallClockTime: 2m28s - TotalThreadsSysTime: 3s458ms - TotalThreadsUserTime: 11s837ms - TotalThreadsVoluntaryContextSwitches: 225.95K (225948) Fragment Instance Lifecycle Timings: - ExecTime: 11s586ms - ExecTreeExecTime: 1s149ms - OpenTime: 1s179ms - ExecTreeOpenTime: 974.927ms - PrepareTime: 61.254ms - ExecTreePrepareTime: 5.475ms DataStreamSender (dst_id=23):(Total: 6s386ms, non-child: 6s386ms, % non-child: 100.00%) - BytesSent: 399.29 MB (418683671) - NetworkThroughput(*): 100.40 MB/sec - OverallThroughput: 62.52 MB/sec - PeakMemoryUsage: 4.76 MB (4987968) - RowsReturned: 42.18M (42175827) - SerializeBatchTime: 2s401ms - TransmitDataRPCTime: 3s977ms - UncompressedRowBatchSize: 1.34 GB (1434514190) CodeGen:(Total: 223.753ms, non-child: 223.753ms, % non-child: 100.00%) - CodegenTime: 997.301us - CompileTime: 63.502ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 90 (90) - NumInstructions: 2.97K (2968) - OptimizationTime: 138.594ms - PeakMemoryUsage: 1.45 MB (1519616) - PrepareTime: 21.143ms HASH_JOIN_NODE (id=11):(Total: 2s121ms, non-child: 1s005ms, % non-child: 47.38%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.298ms - PeakMemoryUsage: 1.27 MB (1326602) - ProbeRows: 42.18M (42175827) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 955.681ms - RowsReturned: 42.18M (42175827) - RowsReturnedRate: 19.88 M/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 28.305us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 120.485us - HashBuckets: 212 (212) - HashCollisions: 0 (0) - HashTablesBuildTime: 62.408us - LargestPartitionPercent: 9 (9) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1073600) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 24.372ms, non-child: 19.834us, % non-child: 0.08%) BytesReceived(500.000ms): 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 4.721us - DeserializeRowBatchTimer: 35.008us - FirstBatchArrivalWaitTime: 18.582ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 4.92 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=9):(Total: 1s092ms, non-child: 1s092ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:125/8.30 GB 1:136/9.01 GB 5:155/9.06 GB 2:172/11.57 GB 4:146/9.63 GB 6:147/8.68 GB 0:143/9.55 GB 3:149/9.64 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 61 out of 61 Runtime filters: Only following filters arrived: 7, waited 723ms Hdfs Read Thread Concurrency Bucket: 0:83.33% 1:12.5% 2:0% 3:4.167% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1112 PARQUET/SNAPPY:61 BytesRead(500.000ms): 0, 0, 0, 10.72 MB, 10.72 MB, 11.57 MB, 15.34 MB, 21.17 MB, 22.00 MB, 22.00 MB, 22.00 MB, 22.00 MB, 22.00 MB, 22.00 MB, 24.54 MB, 29.97 MB, 31.37 MB, 35.94 MB, 41.87 MB, 41.87 MB, 49.12 MB, 49.96 MB, 53.21 MB, 57.63 MB, 57.63 MB - FooterProcessingTime: (Avg: 67.824ms ; Min: 24.496ms ; Max: 311.648ms ; Number of samples: 61) - AverageHdfsReadThreadConcurrency: 0.25 - AverageScannerThreadConcurrency: 11.50 - BytesRead: 57.63 MB (60426591) - BytesReadDataNodeCache: 0 - BytesReadLocal: 57.63 MB (60426591) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 57.63 MB (60426591) - DecompressionTime: 388.332ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 61 (61) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 23.52 MB (24659572) - PerReadThreadRawHdfsThroughput: 23.60 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 223.353ms - RowBatchQueuePutWaitTime: 1m57s - RowsRead: 42.18M (42182241) - RowsReturned: 42.18M (42175827) - RowsReturnedRate: 38.59 M/sec - ScanRangesComplete: 1.17K (1173) - ScannerThreadsInvoluntaryContextSwitches: 1.78K (1782) - ScannerThreadsTotalWallClockTime: 2m15s - MaterializeTupleTime(*): 2s009ms - ScannerThreadsSysTime: 3s183ms - ScannerThreadsUserTime: 4s619ms - ScannerThreadsVoluntaryContextSwitches: 225.19K (225191) - TotalRawHdfsReadTime(*): 2s442ms - TotalReadThroughput: 4.61 MB/sec Filter 2 (16.00 MB): - Rows processed: 94.66K (94661) - Rows rejected: 6.41K (6414) - Rows total: 42.18M (42182241) Filter 7 (1.00 MB): - Files processed: 1.17K (1173) - Files rejected: 1.11K (1112) - Files total: 1.17K (1173) - RowGroups processed: 41.23K (41232) - RowGroups rejected: 0 (0) - RowGroups total: 41.23K (41232) - Rows processed: 999.42K (999424) - Rows rejected: 0 (0) - Rows total: 42.18M (42175827) - Splits processed: 61 (61) - Splits rejected: 0 (0) - Splits total: 61 (61) Instance 7f40dcb034de70b7:123 (host=vc1528.foo:22000):(Total: 12s172ms, non-child: 3s775ms, % non-child: 31.02%) Hdfs split stats (:<# splits>/): 0:151/9.50 GB 5:144/9.25 GB 4:156/10.27 GB 6:161/10.46 GB 3:141/8.91 GB 7:143/8.71 GB 2:151/9.71 GB 1:138/8.67 GB Filter 7 arrival: 504ms Filter 2 arrival: 9s423ms MemoryUsage(500.000ms): 2.79 MB, 3.38 MB, 5.29 MB, 23.35 MB, 24.12 MB, 23.85 MB, 23.85 MB, 23.85 MB, 24.26 MB, 23.59 MB, 26.03 MB, 26.36 MB, 28.92 MB, 28.92 MB, 28.86 MB, 29.29 MB, 28.33 MB, 27.04 MB, 26.11 MB, 43.26 MB, 41.21 MB, 41.24 MB, 38.47 MB, 38.49 MB, 19.27 MB ThreadUsage(500.000ms): 1, 1, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 1 - AverageThreadTokens: 11.56 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 43.80 MB (45927317) - PerHostPeakMemUsage: 1.42 GB (1522298860) - RowsProduced: 42.10M (42097456) - TotalNetworkReceiveTime: 295.626ms - TotalNetworkSendTime: 4s248ms - TotalStorageWaitTime: 5s986ms - TotalThreadsInvoluntaryContextSwitches: 2.43K (2429) - TotalThreadsTotalWallClockTime: 2m25s - TotalThreadsSysTime: 1s534ms - TotalThreadsUserTime: 11s190ms - TotalThreadsVoluntaryContextSwitches: 140.68K (140677) Fragment Instance Lifecycle Timings: - ExecTime: 11s015ms - ExecTreeExecTime: 1s112ms - OpenTime: 1s115ms - ExecTreeOpenTime: 945.909ms - PrepareTime: 41.851ms - ExecTreePrepareTime: 2.913ms DataStreamSender (dst_id=23):(Total: 6s163ms, non-child: 6s163ms, % non-child: 100.00%) - BytesSent: 398.94 MB (418319546) - NetworkThroughput(*): 100.55 MB/sec - OverallThroughput: 64.72 MB/sec - PeakMemoryUsage: 4.65 MB (4873280) - RowsReturned: 42.10M (42097456) - SerializeBatchTime: 2s189ms - TransmitDataRPCTime: 3s967ms - UncompressedRowBatchSize: 1.33 GB (1431848632) CodeGen:(Total: 184.082ms, non-child: 184.082ms, % non-child: 100.00%) - CodegenTime: 879.381us - CompileTime: 50.038ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 90 (90) - NumInstructions: 2.97K (2968) - OptimizationTime: 117.740ms - PeakMemoryUsage: 1.45 MB (1519616) - PrepareTime: 15.922ms HASH_JOIN_NODE (id=11):(Total: 2s049ms, non-child: 966.554ms, % non-child: 47.16%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.498ms - PeakMemoryUsage: 1.27 MB (1331004) - ProbeRows: 42.10M (42097456) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 910.813ms - RowsReturned: 42.10M (42097456) - RowsReturnedRate: 20.54 M/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 26.571us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 134.949us - HashBuckets: 212 (212) - HashCollisions: 0 (0) - HashTablesBuildTime: 51.798us - LargestPartitionPercent: 9 (9) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1073600) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 295.636ms, non-child: 18.919us, % non-child: 0.01%) BytesReceived(500.000ms): 0, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 4.638us - DeserializeRowBatchTimer: 11.072us - FirstBatchArrivalWaitTime: 295.061ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 405.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=9):(Total: 787.478ms, non-child: 787.478ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:151/9.50 GB 5:144/9.25 GB 4:156/10.27 GB 6:161/10.46 GB 3:141/8.91 GB 7:143/8.71 GB 2:151/9.71 GB 1:138/8.67 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 63 out of 63 Runtime filters: Only following filters arrived: 7, waited 502ms Hdfs Read Thread Concurrency Bucket: 0:91.3% 1:0% 2:4.348% 3:0% 4:4.348% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1122 PARQUET/SNAPPY:63 BytesRead(500.000ms): 0, 0, 700.00 KB, 10.86 MB, 11.68 MB, 11.68 MB, 11.68 MB, 11.68 MB, 11.68 MB, 16.34 MB, 22.08 MB, 23.75 MB, 31.33 MB, 31.33 MB, 31.33 MB, 32.18 MB, 33.84 MB, 37.98 MB, 38.83 MB, 40.85 MB, 49.50 MB, 51.19 MB, 53.69 MB, 57.91 MB - FooterProcessingTime: (Avg: 57.132ms ; Min: 3.880ms ; Max: 146.402ms ; Number of samples: 63) - AverageHdfsReadThreadConcurrency: 0.26 - AverageScannerThreadConcurrency: 11.48 - BytesRead: 57.91 MB (60727400) - BytesReadDataNodeCache: 0 - BytesReadLocal: 57.91 MB (60727400) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 57.91 MB (60727400) - DecompressionTime: 342.935ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 63 (63) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 23.92 MB (25078454) - PerReadThreadRawHdfsThroughput: 24.96 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 144.553ms - RowBatchQueuePutWaitTime: 2m1s - RowsRead: 42.13M (42131491) - RowsReturned: 42.10M (42097456) - RowsReturnedRate: 53.46 M/sec - ScanRangesComplete: 1.19K (1185) - ScannerThreadsInvoluntaryContextSwitches: 1.64K (1639) - ScannerThreadsTotalWallClockTime: 2m13s - MaterializeTupleTime(*): 2s114ms - ScannerThreadsSysTime: 1s254ms - ScannerThreadsUserTime: 4s524ms - ScannerThreadsVoluntaryContextSwitches: 140.11K (140110) - TotalRawHdfsReadTime(*): 2s320ms - TotalReadThroughput: 4.83 MB/sec Filter 2 (16.00 MB): - Rows processed: 485.62K (485619) - Rows rejected: 34.03K (34035) - Rows total: 42.13M (42131491) Filter 7 (1.00 MB): - Files processed: 1.19K (1185) - Files rejected: 1.12K (1122) - Files total: 1.19K (1185) - RowGroups processed: 41.14K (41139) - RowGroups rejected: 0 (0) - RowGroups total: 41.14K (41139) - Rows processed: 1.03M (1032192) - Rows rejected: 0 (0) - Rows total: 42.10M (42097456) - Splits processed: 63 (63) - Splits rejected: 0 (0) - Splits total: 63 (63) Instance 7f40dcb034de70b7:101 (host=vc1525.foo:22000):(Total: 12s112ms, non-child: 4s407ms, % non-child: 36.39%) Hdfs split stats (:<# splits>/): 7:156/9.73 GB 4:144/9.08 GB 6:150/10.19 GB 5:134/8.58 GB 3:140/9.00 GB 1:146/9.61 GB 0:143/9.49 GB 2:147/9.77 GB Filter 7 arrival: 624ms Filter 2 arrival: 8s944ms MemoryUsage(500.000ms): 2.79 MB, 1.38 MB, 5.44 MB, 26.62 MB, 26.72 MB, 27.15 MB, 27.15 MB, 27.15 MB, 27.31 MB, 28.33 MB, 29.00 MB, 28.99 MB, 30.44 MB, 30.44 MB, 23.41 MB, 27.81 MB, 28.07 MB, 27.45 MB, 43.39 MB, 42.19 MB, 40.02 MB, 42.06 MB, 41.40 MB, 37.40 MB, 19.58 MB ThreadUsage(500.000ms): 1, 2, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 1 - AverageThreadTokens: 11.60 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 43.60 MB (45713640) - PerHostPeakMemUsage: 1.40 GB (1499467594) - RowsProduced: 40.75M (40750633) - TotalNetworkReceiveTime: 408.222ms - TotalNetworkSendTime: 4s187ms - TotalStorageWaitTime: 5s121ms - TotalThreadsInvoluntaryContextSwitches: 2.25K (2252) - TotalThreadsTotalWallClockTime: 2m24s - TotalThreadsSysTime: 3s469ms - TotalThreadsUserTime: 10s939ms - TotalThreadsVoluntaryContextSwitches: 230.07K (230072) Fragment Instance Lifecycle Timings: - ExecTime: 11s016ms - ExecTreeExecTime: 994.472ms - OpenTime: 1s044ms - ExecTreeOpenTime: 876.142ms - PrepareTime: 51.073ms - ExecTreePrepareTime: 2.678ms DataStreamSender (dst_id=23):(Total: 5s652ms, non-child: 5s652ms, % non-child: 100.00%) - BytesSent: 385.87 MB (404614803) - NetworkThroughput(*): 111.96 MB/sec - OverallThroughput: 68.27 MB/sec - PeakMemoryUsage: 4.69 MB (4914240) - RowsReturned: 40.75M (40750633) - SerializeBatchTime: 2s197ms - TransmitDataRPCTime: 3s446ms - UncompressedRowBatchSize: 1.29 GB (1386039546) CodeGen:(Total: 190.430ms, non-child: 190.430ms, % non-child: 100.00%) - CodegenTime: 1.007ms - CompileTime: 50.173ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 90 (90) - NumInstructions: 2.97K (2968) - OptimizationTime: 116.743ms - PeakMemoryUsage: 1.45 MB (1519616) - PrepareTime: 23.099ms HASH_JOIN_NODE (id=11):(Total: 1s862ms, non-child: 862.200ms, % non-child: 46.30%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.547ms - PeakMemoryUsage: 1.27 MB (1330764) - ProbeRows: 40.75M (40750633) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 809.720ms - RowsReturned: 40.75M (40750633) - RowsReturnedRate: 21.89 M/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 26.287us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 133.931us - HashBuckets: 212 (212) - HashCollisions: 0 (0) - HashTablesBuildTime: 59.432us - LargestPartitionPercent: 9 (9) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1073600) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 408.233ms, non-child: 23.287us, % non-child: 0.01%) BytesReceived(500.000ms): 0, 0, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 4.590us - DeserializeRowBatchTimer: 25.553us - FirstBatchArrivalWaitTime: 406.076ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 293.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=9):(Total: 591.909ms, non-child: 591.909ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:156/9.73 GB 4:144/9.08 GB 6:150/10.19 GB 5:134/8.58 GB 3:140/9.00 GB 1:146/9.61 GB 0:143/9.49 GB 2:147/9.77 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 56 out of 56 Runtime filters: Only following filters arrived: 7, waited 381ms Hdfs Read Thread Concurrency Bucket: 0:86.96% 1:4.348% 2:4.348% 3:0% 4:0% 5:0% 6:0% 7:4.348% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1104 PARQUET/SNAPPY:56 BytesRead(500.000ms): 0, 0, 200.00 KB, 12.41 MB, 12.41 MB, 12.41 MB, 12.41 MB, 12.41 MB, 12.41 MB, 14.66 MB, 20.33 MB, 20.33 MB, 21.72 MB, 21.72 MB, 26.57 MB, 30.41 MB, 30.41 MB, 31.24 MB, 38.51 MB, 39.33 MB, 43.50 MB, 49.31 MB, 51.85 MB, 54.98 MB - FooterProcessingTime: (Avg: 52.085ms ; Min: 22.078ms ; Max: 126.793ms ; Number of samples: 56) - AverageHdfsReadThreadConcurrency: 0.43 - AverageScannerThreadConcurrency: 11.48 - BytesRead: 54.98 MB (57646675) - BytesReadDataNodeCache: 0 - BytesReadLocal: 54.98 MB (57646675) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 54.98 MB (57646675) - DecompressionTime: 325.280ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 56 (56) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 24.97 MB (26179204) - PerReadThreadRawHdfsThroughput: 24.09 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 80.535ms - RowBatchQueuePutWaitTime: 1m59s - RowsRead: 40.78M (40780303) - RowsReturned: 40.75M (40750633) - RowsReturnedRate: 68.85 M/sec - ScanRangesComplete: 1.16K (1160) - ScannerThreadsInvoluntaryContextSwitches: 1.39K (1392) - ScannerThreadsTotalWallClockTime: 2m12s - MaterializeTupleTime(*): 1s906ms - ScannerThreadsSysTime: 3s239ms - ScannerThreadsUserTime: 4s168ms - ScannerThreadsVoluntaryContextSwitches: 229.49K (229490) - TotalRawHdfsReadTime(*): 2s282ms - TotalReadThroughput: 4.58 MB/sec Filter 2 (16.00 MB): - Rows processed: 424.63K (424626) - Rows rejected: 29.67K (29670) - Rows total: 40.78M (40780303) Filter 7 (1.00 MB): - Files processed: 1.16K (1160) - Files rejected: 1.10K (1104) - Files total: 1.16K (1160) - RowGroups processed: 39.82K (39822) - RowGroups rejected: 0 (0) - RowGroups total: 39.82K (39822) - Rows processed: 917.50K (917504) - Rows rejected: 0 (0) - Rows total: 40.75M (40750633) - Splits processed: 56 (56) - Splits rejected: 0 (0) - Splits total: 56 (56) Instance 7f40dcb034de70b7:fa (host=vc1539.foo:22000):(Total: 11s684ms, non-child: 2s760ms, % non-child: 23.62%) Hdfs split stats (:<# splits>/): 0:150/9.49 GB 3:135/8.45 GB 5:141/9.58 GB 4:154/9.84 GB 7:151/9.44 GB 1:156/10.39 GB 6:152/9.68 GB 2:142/8.68 GB Filter 7 arrival: 665ms Filter 2 arrival: 8s848ms MemoryUsage(500.000ms): 1.38 MB, 3.38 MB, 24.92 MB, 24.79 MB, 25.00 MB, 26.02 MB, 28.83 MB, 29.04 MB, 29.24 MB, 28.94 MB, 30.15 MB, 29.57 MB, 29.62 MB, 29.29 MB, 24.87 MB, 26.35 MB, 24.66 MB, 42.06 MB, 42.25 MB, 39.98 MB, 43.09 MB, 44.11 MB, 29.02 MB ThreadUsage(500.000ms): 2, 1, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.00 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 44.67 MB (46836397) - PerHostPeakMemUsage: 1.43 GB (1533869115) - RowsProduced: 43.73M (43734748) - TotalNetworkReceiveTime: 449.893ms - TotalNetworkSendTime: 3s124ms - TotalStorageWaitTime: 5s522ms - TotalThreadsInvoluntaryContextSwitches: 2.57K (2574) - TotalThreadsTotalWallClockTime: 2m18s - TotalThreadsSysTime: 3s155ms - TotalThreadsUserTime: 11s559ms - TotalThreadsVoluntaryContextSwitches: 142.51K (142515) Fragment Instance Lifecycle Timings: - ExecTime: 10s581ms - ExecTreeExecTime: 1s212ms - OpenTime: 1s056ms - ExecTreeOpenTime: 884.140ms - PrepareTime: 46.189ms - ExecTreePrepareTime: 3.087ms DataStreamSender (dst_id=23):(Total: 6s647ms, non-child: 6s647ms, % non-child: 100.00%) - BytesSent: 414.74 MB (434886458) - NetworkThroughput(*): 98.99 MB/sec - OverallThroughput: 62.39 MB/sec - PeakMemoryUsage: 4.86 MB (5094464) - RowsReturned: 43.73M (43734748) - SerializeBatchTime: 2s449ms - TransmitDataRPCTime: 4s189ms - UncompressedRowBatchSize: 1.39 GB (1487537360) CodeGen:(Total: 190.259ms, non-child: 190.259ms, % non-child: 100.00%) - CodegenTime: 926.466us - CompileTime: 50.285ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 90 (90) - NumInstructions: 2.97K (2968) - OptimizationTime: 120.905ms - PeakMemoryUsage: 1.45 MB (1519616) - PrepareTime: 18.641ms HASH_JOIN_NODE (id=11):(Total: 2s086ms, non-child: 1s044ms, % non-child: 50.08%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.743ms - PeakMemoryUsage: 1.27 MB (1333817) - ProbeRows: 43.73M (43734748) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 988.748ms - RowsReturned: 43.73M (43734748) - RowsReturnedRate: 20.96 M/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 36.237us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 173.117us - HashBuckets: 212 (212) - HashCollisions: 0 (0) - HashTablesBuildTime: 72.835us - LargestPartitionPercent: 9 (9) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1073600) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 449.904ms, non-child: 20.862us, % non-child: 0.00%) BytesReceived(500.000ms): 0, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 4.647us - DeserializeRowBatchTimer: 12.662us - FirstBatchArrivalWaitTime: 428.064ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 266.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=9):(Total: 592.144ms, non-child: 592.144ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:150/9.49 GB 3:135/8.45 GB 5:141/9.58 GB 4:154/9.84 GB 7:151/9.44 GB 1:156/10.39 GB 6:152/9.68 GB 2:142/8.68 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 61 out of 61 Runtime filters: Only following filters arrived: 7, waited 342ms Hdfs Read Thread Concurrency Bucket: 0:82.61% 1:8.696% 2:4.348% 3:4.348% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1120 PARQUET/SNAPPY:61 BytesRead(500.000ms): 0, 0, 11.26 MB, 11.26 MB, 11.26 MB, 13.61 MB, 22.02 MB, 22.02 MB, 25.09 MB, 28.15 MB, 30.40 MB, 32.93 MB, 32.93 MB, 32.93 MB, 37.14 MB, 37.99 MB, 39.12 MB, 49.72 MB, 49.72 MB, 51.48 MB, 57.79 MB, 57.88 MB, 59.21 MB - FooterProcessingTime: (Avg: 54.565ms ; Min: 4.345ms ; Max: 164.210ms ; Number of samples: 61) - AverageHdfsReadThreadConcurrency: 0.30 - AverageScannerThreadConcurrency: 10.96 - BytesRead: 59.21 MB (62089272) - BytesReadDataNodeCache: 0 - BytesReadLocal: 59.21 MB (62089272) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 59.21 MB (62089272) - DecompressionTime: 391.569ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 61 (61) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 24.68 MB (25878211) - PerReadThreadRawHdfsThroughput: 23.48 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 83.871ms - RowBatchQueuePutWaitTime: 1m54s - RowsRead: 43.76M (43757476) - RowsReturned: 43.73M (43734748) - RowsReturnedRate: 73.86 M/sec - ScanRangesComplete: 1.18K (1181) - ScannerThreadsInvoluntaryContextSwitches: 1.73K (1728) - ScannerThreadsTotalWallClockTime: 2m6s - MaterializeTupleTime(*): 2s319ms - ScannerThreadsSysTime: 2s806ms - ScannerThreadsUserTime: 4s262ms - ScannerThreadsVoluntaryContextSwitches: 141.81K (141813) - TotalRawHdfsReadTime(*): 2s522ms - TotalReadThroughput: 5.15 MB/sec Filter 2 (16.00 MB): - Rows processed: 313.54K (313544) - Rows rejected: 22.73K (22728) - Rows total: 43.76M (43757476) Filter 7 (1.00 MB): - Files processed: 1.18K (1181) - Files rejected: 1.12K (1120) - Files total: 1.18K (1181) - RowGroups processed: 42.75K (42746) - RowGroups rejected: 0 (0) - RowGroups total: 42.75K (42746) - Rows processed: 999.42K (999424) - Rows rejected: 0 (0) - Rows total: 43.73M (43734748) - Splits processed: 61 (61) - Splits rejected: 0 (0) - Splits total: 61 (61) Instance 7f40dcb034de70b7:16c (host=ve1129.foo:22000):(Total: 11s653ms, non-child: 2s860ms, % non-child: 24.55%) Hdfs split stats (:<# splits>/): 0:141/8.34 GB 6:148/9.54 GB 1:150/9.46 GB 4:138/8.33 GB 2:171/10.32 GB 3:155/10.05 GB 5:142/8.77 GB 7:171/10.71 GB Filter 7 arrival: 479ms Filter 2 arrival: 11s564ms MemoryUsage(500.000ms): 2.80 MB, 3.38 MB, 19.99 MB, 22.73 MB, 23.17 MB, 22.10 MB, 23.94 MB, 24.03 MB, 21.32 MB, 25.08 MB, 24.86 MB, 24.89 MB, 24.89 MB, 25.47 MB, 28.07 MB, 28.04 MB, 27.11 MB, 27.93 MB, 29.19 MB, 29.08 MB, 28.04 MB, 27.93 MB, 16.37 MB ThreadUsage(500.000ms): 1, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.48 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 30.31 MB (31781175) - PerHostPeakMemUsage: 1.40 GB (1501656743) - RowsProduced: 44.60M (44600308) - TotalNetworkReceiveTime: 7.327us - TotalNetworkSendTime: 2s646ms - TotalStorageWaitTime: 7s102ms - TotalThreadsInvoluntaryContextSwitches: 2.40K (2405) - TotalThreadsTotalWallClockTime: 2m22s - TotalThreadsSysTime: 2s578ms - TotalThreadsUserTime: 11s754ms - TotalThreadsVoluntaryContextSwitches: 128.81K (128811) Fragment Instance Lifecycle Timings: - ExecTime: 10s418ms - ExecTreeExecTime: 1s163ms - OpenTime: 1s000ms - ExecTreeOpenTime: 744.579ms - PrepareTime: 233.740ms - ExecTreePrepareTime: 3.999ms DataStreamSender (dst_id=23):(Total: 6s600ms, non-child: 6s600ms, % non-child: 100.00%) - BytesSent: 423.28 MB (443842917) - NetworkThroughput(*): 103.59 MB/sec - OverallThroughput: 64.13 MB/sec - PeakMemoryUsage: 4.76 MB (4996160) - RowsReturned: 44.60M (44600308) - SerializeBatchTime: 2s504ms - TransmitDataRPCTime: 4s086ms - UncompressedRowBatchSize: 1.41 GB (1516977320) CodeGen:(Total: 290.108ms, non-child: 290.108ms, % non-child: 100.00%) - CodegenTime: 1.665ms - CompileTime: 83.115ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 90 (90) - NumInstructions: 2.97K (2968) - OptimizationTime: 169.720ms - PeakMemoryUsage: 1.45 MB (1519616) - PrepareTime: 36.546ms HASH_JOIN_NODE (id=11):(Total: 1s901ms, non-child: 991.203ms, % non-child: 52.12%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.777ms - PeakMemoryUsage: 1.20 MB (1255232) - ProbeRows: 44.60M (44600308) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 929.177ms - RowsReturned: 44.60M (44600308) - RowsReturnedRate: 23.45 M/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 25.572us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 187.314us - HashBuckets: 212 (212) - HashCollisions: 0 (0) - HashTablesBuildTime: 83.142us - LargestPartitionPercent: 9 (9) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1073600) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 22.030us, non-child: 22.030us, % non-child: 100.00%) BytesReceived(500.000ms): 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 7.534us - DeserializeRowBatchTimer: 38.307us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 5.45 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=9):(Total: 910.390ms, non-child: 910.390ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:141/8.34 GB 6:148/9.54 GB 1:150/9.46 GB 4:138/8.33 GB 2:171/10.32 GB 3:155/10.05 GB 5:142/8.77 GB 7:171/10.71 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 65 out of 65 Runtime filters: Only following filters arrived: 7, waited 524ms Hdfs Read Thread Concurrency Bucket: 0:81.82% 1:13.64% 2:4.545% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1151 PARQUET/SNAPPY:65 BytesRead(500.000ms): 0, 0, 6.97 MB, 10.06 MB, 10.06 MB, 14.34 MB, 20.67 MB, 20.67 MB, 27.92 MB, 30.44 MB, 30.44 MB, 30.44 MB, 30.44 MB, 31.28 MB, 42.63 MB, 42.63 MB, 44.02 MB, 47.40 MB, 50.47 MB, 50.47 MB, 58.35 MB, 59.18 MB, 60.81 MB - FooterProcessingTime: (Avg: 74.864ms ; Min: 3.983ms ; Max: 318.269ms ; Number of samples: 65) - AverageHdfsReadThreadConcurrency: 0.23 - AverageScannerThreadConcurrency: 12.00 - BytesRead: 60.81 MB (63768868) - BytesReadDataNodeCache: 0 - BytesReadLocal: 60.81 MB (63768868) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 60.81 MB (63768868) - DecompressionTime: 371.250ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 65 (65) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 24.79 MB (25996048) - PerReadThreadRawHdfsThroughput: 25.14 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 215.259ms - RowBatchQueuePutWaitTime: 1m53s - RowsRead: 44.60M (44600308) - RowsReturned: 44.60M (44600308) - RowsReturnedRate: 48.99 M/sec - ScanRangesComplete: 1.22K (1216) - ScannerThreadsInvoluntaryContextSwitches: 1.41K (1409) - ScannerThreadsTotalWallClockTime: 2m10s - MaterializeTupleTime(*): 2s315ms - ScannerThreadsSysTime: 2s258ms - ScannerThreadsUserTime: 4s038ms - ScannerThreadsVoluntaryContextSwitches: 128.13K (128128) - TotalRawHdfsReadTime(*): 2s419ms - TotalReadThroughput: 5.29 MB/sec Filter 2 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 44.60M (44600308) Filter 7 (1.00 MB): - Files processed: 1.22K (1216) - Files rejected: 1.15K (1151) - Files total: 1.22K (1216) - RowGroups processed: 43.61K (43608) - RowGroups rejected: 0 (0) - RowGroups total: 43.61K (43608) - Rows processed: 1.06M (1064960) - Rows rejected: 0 (0) - Rows total: 44.60M (44600308) - Splits processed: 65 (65) - Splits rejected: 0 (0) - Splits total: 65 (65) Instance 7f40dcb034de70b7:14c (host=vd1107.foo:22000):(Total: 11s632ms, non-child: 3s493ms, % non-child: 30.04%) Hdfs split stats (:<# splits>/): 3:148/9.75 GB 4:148/9.60 GB 7:156/10.08 GB 5:141/8.78 GB 6:143/9.05 GB 2:148/9.05 GB 1:153/9.97 GB 0:151/9.28 GB Filter 7 arrival: 380ms Filter 2 arrival: 10s661ms MemoryUsage(500.000ms): 1.33 MB, 3.38 MB, 4.52 MB, 27.84 MB, 28.05 MB, 28.05 MB, 27.86 MB, 28.02 MB, 28.32 MB, 28.00 MB, 26.91 MB, 27.10 MB, 25.13 MB, 25.13 MB, 24.15 MB, 25.16 MB, 26.11 MB, 26.34 MB, 27.06 MB, 24.06 MB, 24.16 MB, 25.21 MB, 35.93 MB, 26.41 MB ThreadUsage(500.000ms): 1, 1, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.00 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 38.99 MB (40886034) - PerHostPeakMemUsage: 1.39 GB (1493683687) - RowsProduced: 41.18M (41178346) - TotalNetworkReceiveTime: 142.668ms - TotalNetworkSendTime: 3s401ms - TotalStorageWaitTime: 6s640ms - TotalThreadsInvoluntaryContextSwitches: 2.97K (2974) - TotalThreadsTotalWallClockTime: 2m20s - TotalThreadsSysTime: 3s510ms - TotalThreadsUserTime: 11s444ms - TotalThreadsVoluntaryContextSwitches: 184.96K (184955) Fragment Instance Lifecycle Timings: - ExecTime: 10s545ms - ExecTreeExecTime: 1s213ms - OpenTime: 1s028ms - ExecTreeOpenTime: 845.862ms - PrepareTime: 58.903ms - ExecTreePrepareTime: 2.940ms DataStreamSender (dst_id=23):(Total: 5s886ms, non-child: 5s886ms, % non-child: 100.00%) - BytesSent: 390.09 MB (409036833) - NetworkThroughput(*): 108.59 MB/sec - OverallThroughput: 66.27 MB/sec - PeakMemoryUsage: 4.73 MB (4955200) - RowsReturned: 41.18M (41178346) - SerializeBatchTime: 2s286ms - TransmitDataRPCTime: 3s592ms - UncompressedRowBatchSize: 1.30 GB (1400587220) CodeGen:(Total: 205.688ms, non-child: 205.688ms, % non-child: 100.00%) - CodegenTime: 1.202ms - CompileTime: 53.478ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 90 (90) - NumInstructions: 2.97K (2968) - OptimizationTime: 124.873ms - PeakMemoryUsage: 1.45 MB (1519616) - PrepareTime: 26.868ms HASH_JOIN_NODE (id=11):(Total: 2s046ms, non-child: 1s042ms, % non-child: 50.95%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.562ms - PeakMemoryUsage: 1.25 MB (1310625) - ProbeRows: 41.18M (41178346) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 977.920ms - RowsReturned: 41.18M (41178346) - RowsReturnedRate: 20.12 M/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 26.278us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 214.715us - HashBuckets: 212 (212) - HashCollisions: 0 (0) - HashTablesBuildTime: 50.087us - LargestPartitionPercent: 9 (9) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1073600) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 142.679ms, non-child: 21.777us, % non-child: 0.02%) BytesReceived(500.000ms): 0, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 6.398us - DeserializeRowBatchTimer: 29.518us - FirstBatchArrivalWaitTime: 123.760ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 841.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=9):(Total: 861.633ms, non-child: 861.633ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:148/9.75 GB 4:148/9.60 GB 7:156/10.08 GB 5:141/8.78 GB 6:143/9.05 GB 2:148/9.05 GB 1:153/9.97 GB 0:151/9.28 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 60 out of 60 Runtime filters: Only following filters arrived: 7, waited 623ms Hdfs Read Thread Concurrency Bucket: 0:91.3% 1:8.696% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1128 PARQUET/SNAPPY:60 BytesRead(500.000ms): 0, 0, 0, 12.75 MB, 12.75 MB, 12.75 MB, 12.75 MB, 13.60 MB, 13.60 MB, 18.67 MB, 18.67 MB, 20.35 MB, 22.03 MB, 22.03 MB, 29.35 MB, 30.74 MB, 33.84 MB, 39.82 MB, 40.75 MB, 44.83 MB, 47.36 MB, 52.71 MB, 56.12 MB, 56.12 MB - FooterProcessingTime: (Avg: 56.160ms ; Min: 19.298ms ; Max: 145.074ms ; Number of samples: 60) - AverageHdfsReadThreadConcurrency: 0.09 - AverageScannerThreadConcurrency: 11.48 - BytesRead: 56.12 MB (58843542) - BytesReadDataNodeCache: 0 - BytesReadLocal: 56.12 MB (58843542) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 56.12 MB (58843542) - DecompressionTime: 328.665ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 60 (60) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 22.97 MB (24085746) - PerReadThreadRawHdfsThroughput: 25.25 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 76.463ms - RowBatchQueuePutWaitTime: 1m52s - RowsRead: 41.19M (41187913) - RowsReturned: 41.18M (41178346) - RowsReturnedRate: 47.79 M/sec - ScanRangesComplete: 1.19K (1188) - ScannerThreadsInvoluntaryContextSwitches: 1.95K (1945) - ScannerThreadsTotalWallClockTime: 2m8s - MaterializeTupleTime(*): 2s056ms - ScannerThreadsSysTime: 3s238ms - ScannerThreadsUserTime: 4s396ms - ScannerThreadsVoluntaryContextSwitches: 184.38K (184380) - TotalRawHdfsReadTime(*): 2s222ms - TotalReadThroughput: 4.68 MB/sec Filter 2 (16.00 MB): - Rows processed: 134.50K (134495) - Rows rejected: 9.57K (9567) - Rows total: 41.19M (41187913) Filter 7 (1.00 MB): - Files processed: 1.19K (1188) - Files rejected: 1.13K (1128) - Files total: 1.19K (1188) - RowGroups processed: 40.25K (40254) - RowGroups rejected: 0 (0) - RowGroups total: 40.25K (40254) - Rows processed: 983.04K (983040) - Rows rejected: 0 (0) - Rows total: 41.18M (41178346) - Splits processed: 60 (60) - Splits rejected: 0 (0) - Splits total: 60 (60) Instance 7f40dcb034de70b7:145 (host=vd1121.foo:22000):(Total: 11s589ms, non-child: 2s448ms, % non-child: 21.13%) Hdfs split stats (:<# splits>/): 7:139/9.37 GB 4:153/9.33 GB 0:149/9.95 GB 5:152/9.73 GB 6:126/8.48 GB 1:170/10.73 GB 3:153/9.88 GB 2:120/8.03 GB Filter 7 arrival: 402ms Filter 2 arrival: 10s498ms MemoryUsage(500.000ms): 3.38 MB, 3.38 MB, 24.79 MB, 24.91 MB, 24.05 MB, 17.56 MB, 29.05 MB, 29.25 MB, 29.23 MB, 27.71 MB, 30.08 MB, 29.29 MB, 29.29 MB, 24.30 MB, 28.37 MB, 28.32 MB, 26.22 MB, 24.05 MB, 27.07 MB, 25.65 MB, 27.02 MB, 38.52 MB, 31.25 MB ThreadUsage(500.000ms): 1, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.48 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 43.86 MB (45992534) - PerHostPeakMemUsage: 1.41 GB (1519071704) - RowsProduced: 45.36M (45359574) - TotalNetworkReceiveTime: 157.793ms - TotalNetworkSendTime: 2s883ms - TotalStorageWaitTime: 6s152ms - TotalThreadsInvoluntaryContextSwitches: 2.73K (2729) - TotalThreadsTotalWallClockTime: 2m19s - TotalThreadsSysTime: 2s576ms - TotalThreadsUserTime: 12s116ms - TotalThreadsVoluntaryContextSwitches: 163.06K (163061) Fragment Instance Lifecycle Timings: - ExecTime: 10s494ms - ExecTreeExecTime: 1s273ms - OpenTime: 1s040ms - ExecTreeOpenTime: 846.590ms - PrepareTime: 54.649ms - ExecTreePrepareTime: 3.185ms DataStreamSender (dst_id=23):(Total: 6s816ms, non-child: 6s816ms, % non-child: 100.00%) - BytesSent: 430.26 MB (451159997) - NetworkThroughput(*): 99.37 MB/sec - OverallThroughput: 63.12 MB/sec - PeakMemoryUsage: 4.69 MB (4914240) - RowsReturned: 45.36M (45359574) - SerializeBatchTime: 2s478ms - TransmitDataRPCTime: 4s330ms - UncompressedRowBatchSize: 1.44 GB (1542802028) CodeGen:(Total: 214.225ms, non-child: 214.225ms, % non-child: 100.00%) - CodegenTime: 1.057ms - CompileTime: 57.136ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 90 (90) - NumInstructions: 2.97K (2968) - OptimizationTime: 134.618ms - PeakMemoryUsage: 1.45 MB (1519616) - PrepareTime: 22.003ms HASH_JOIN_NODE (id=11):(Total: 2s110ms, non-child: 1s117ms, % non-child: 52.93%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.881ms - PeakMemoryUsage: 1.27 MB (1332952) - ProbeRows: 45.36M (45359574) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1s060ms - RowsReturned: 45.36M (45359574) - RowsReturnedRate: 21.49 M/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 26.712us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 281.747us - HashBuckets: 212 (212) - HashCollisions: 0 (0) - HashTablesBuildTime: 67.965us - LargestPartitionPercent: 9 (9) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1073600) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 157.813ms, non-child: 29.507us, % non-child: 0.02%) BytesReceived(500.000ms): 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 4.580us - DeserializeRowBatchTimer: 29.040us - FirstBatchArrivalWaitTime: 138.784ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 760.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=9):(Total: 835.768ms, non-child: 835.768ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:139/9.37 GB 4:153/9.33 GB 0:149/9.95 GB 5:152/9.73 GB 6:126/8.48 GB 1:170/10.73 GB 3:153/9.88 GB 2:120/8.03 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 63 out of 63 Runtime filters: Only following filters arrived: 7, waited 602ms Hdfs Read Thread Concurrency Bucket: 0:82.61% 1:8.696% 2:8.696% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1099 PARQUET/SNAPPY:63 BytesRead(500.000ms): 0, 0, 11.18 MB, 11.18 MB, 11.18 MB, 12.68 MB, 22.08 MB, 22.08 MB, 22.08 MB, 28.25 MB, 30.49 MB, 31.33 MB, 31.33 MB, 33.60 MB, 38.40 MB, 39.21 MB, 40.16 MB, 46.82 MB, 49.93 MB, 54.77 MB, 58.62 MB, 59.45 MB, 61.11 MB - FooterProcessingTime: (Avg: 56.898ms ; Min: 22.306ms ; Max: 136.716ms ; Number of samples: 63) - AverageHdfsReadThreadConcurrency: 0.26 - AverageScannerThreadConcurrency: 11.48 - BytesRead: 61.11 MB (64075514) - BytesReadDataNodeCache: 0 - BytesReadLocal: 61.11 MB (64075514) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 61.11 MB (64075514) - DecompressionTime: 394.155ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 63 (63) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 24.78 MB (25979337) - PerReadThreadRawHdfsThroughput: 24.48 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 82.468ms - RowBatchQueuePutWaitTime: 1m53s - RowsRead: 45.37M (45374383) - RowsReturned: 45.36M (45359574) - RowsReturnedRate: 54.27 M/sec - ScanRangesComplete: 1.16K (1162) - ScannerThreadsInvoluntaryContextSwitches: 1.86K (1856) - ScannerThreadsTotalWallClockTime: 2m8s - MaterializeTupleTime(*): 2s352ms - ScannerThreadsSysTime: 2s265ms - ScannerThreadsUserTime: 4s604ms - ScannerThreadsVoluntaryContextSwitches: 162.41K (162414) - TotalRawHdfsReadTime(*): 2s495ms - TotalReadThroughput: 5.31 MB/sec Filter 2 (16.00 MB): - Rows processed: 206.30K (206297) - Rows rejected: 14.81K (14809) - Rows total: 45.37M (45374383) Filter 7 (1.00 MB): - Files processed: 1.16K (1162) - Files rejected: 1.10K (1099) - Files total: 1.16K (1162) - RowGroups processed: 44.34K (44337) - RowGroups rejected: 0 (0) - RowGroups total: 44.34K (44337) - Rows processed: 1.03M (1032192) - Rows rejected: 0 (0) - Rows total: 45.36M (45359574) - Splits processed: 63 (63) - Splits rejected: 0 (0) - Splits total: 63 (63) Instance 7f40dcb034de70b7:177 (host=vd1113.foo:22000):(Total: 11s509ms, non-child: 2s207ms, % non-child: 19.18%) Hdfs split stats (:<# splits>/): 7:160/10.73 GB 3:149/9.76 GB 6:153/9.74 GB 1:151/9.62 GB 0:133/8.02 GB 2:147/9.68 GB 5:141/8.19 GB 4:158/9.82 GB Filter 7 arrival: 232ms MemoryUsage(500.000ms): 3.38 MB, 3.38 MB, 24.49 MB, 25.01 MB, 24.17 MB, 28.89 MB, 28.85 MB, 29.34 MB, 25.55 MB, 30.12 MB, 30.32 MB, 30.22 MB, 30.22 MB, 29.23 MB, 27.99 MB, 28.23 MB, 23.82 MB, 27.15 MB, 26.15 MB, 28.55 MB, 27.52 MB, 22.36 MB, 16.53 MB ThreadUsage(500.000ms): 1, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.48 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 30.81 MB (32311164) - PerHostPeakMemUsage: 1.39 GB (1490839920) - RowsProduced: 47.22M (47221102) - TotalNetworkReceiveTime: 3.795us - TotalNetworkSendTime: 2s673ms - TotalStorageWaitTime: 7s009ms - TotalThreadsInvoluntaryContextSwitches: 3.13K (3130) - TotalThreadsTotalWallClockTime: 2m21s - TotalThreadsSysTime: 2s180ms - TotalThreadsUserTime: 12s338ms - TotalThreadsVoluntaryContextSwitches: 156.57K (156572) Fragment Instance Lifecycle Timings: - ExecTime: 10s290ms - ExecTreeExecTime: 1s259ms - OpenTime: 1s165ms - ExecTreeOpenTime: 981.705ms - PrepareTime: 53.032ms - ExecTreePrepareTime: 3.572ms DataStreamSender (dst_id=23):(Total: 6s865ms, non-child: 6s865ms, % non-child: 100.00%) - BytesSent: 448.11 MB (469875515) - NetworkThroughput(*): 102.86 MB/sec - OverallThroughput: 65.27 MB/sec - PeakMemoryUsage: 4.76 MB (4996160) - RowsReturned: 47.22M (47221102) - SerializeBatchTime: 2s500ms - TransmitDataRPCTime: 4s356ms - UncompressedRowBatchSize: 1.50 GB (1606117596) CodeGen:(Total: 204.139ms, non-child: 204.139ms, % non-child: 100.00%) - CodegenTime: 1.315ms - CompileTime: 54.118ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 90 (90) - NumInstructions: 2.97K (2968) - OptimizationTime: 127.818ms - PeakMemoryUsage: 1.45 MB (1519616) - PrepareTime: 21.774ms HASH_JOIN_NODE (id=11):(Total: 2s232ms, non-child: 1s079ms, % non-child: 48.35%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.365ms - PeakMemoryUsage: 1.20 MB (1255232) - ProbeRows: 47.22M (47221102) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1s028ms - RowsReturned: 47.22M (47221102) - RowsReturnedRate: 21.15 M/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 25.324us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 112.748us - HashBuckets: 212 (212) - HashCollisions: 0 (0) - HashTablesBuildTime: 47.920us - LargestPartitionPercent: 9 (9) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1073600) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 12.717us, non-child: 12.717us, % non-child: 100.00%) BytesReceived(500.000ms): 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 4.785us - DeserializeRowBatchTimer: 35.676us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 9.44 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=9):(Total: 1s153ms, non-child: 1s153ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:160/10.73 GB 3:149/9.76 GB 6:153/9.74 GB 1:151/9.62 GB 0:133/8.02 GB 2:147/9.68 GB 5:141/8.19 GB 4:158/9.82 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 64 out of 64 Runtime filters: Only following filters arrived: 7, waited 784ms Hdfs Read Thread Concurrency Bucket: 0:69.57% 1:21.74% 2:8.696% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1128 PARQUET/SNAPPY:64 BytesRead(500.000ms): 0, 0, 9.89 MB, 11.24 MB, 11.24 MB, 22.57 MB, 22.57 MB, 23.41 MB, 25.00 MB, 30.88 MB, 30.88 MB, 30.88 MB, 30.88 MB, 31.84 MB, 38.20 MB, 38.20 MB, 42.23 MB, 49.11 MB, 51.01 MB, 58.40 MB, 58.40 MB, 63.49 MB, 63.49 MB - FooterProcessingTime: (Avg: 75.355ms ; Min: 17.262ms ; Max: 270.475ms ; Number of samples: 64) - AverageHdfsReadThreadConcurrency: 0.39 - AverageScannerThreadConcurrency: 11.48 - BytesRead: 63.49 MB (66575289) - BytesReadDataNodeCache: 0 - BytesReadLocal: 63.49 MB (66575289) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 63.49 MB (66575289) - DecompressionTime: 400.310ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 64 (64) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 25.03 MB (26248448) - PerReadThreadRawHdfsThroughput: 25.10 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 193.875ms - RowBatchQueuePutWaitTime: 1m51s - RowsRead: 47.22M (47221102) - RowsReturned: 47.22M (47221102) - RowsReturnedRate: 40.95 M/sec - ScanRangesComplete: 1.19K (1192) - ScannerThreadsInvoluntaryContextSwitches: 2.21K (2205) - ScannerThreadsTotalWallClockTime: 2m9s - MaterializeTupleTime(*): 2s447ms - ScannerThreadsSysTime: 1s858ms - ScannerThreadsUserTime: 4s844ms - ScannerThreadsVoluntaryContextSwitches: 155.89K (155890) - TotalRawHdfsReadTime(*): 2s529ms - TotalReadThroughput: 5.52 MB/sec Filter 2 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 47.22M (47221102) Filter 7 (1.00 MB): - Files processed: 1.19K (1192) - Files rejected: 1.13K (1128) - Files total: 1.19K (1192) - RowGroups processed: 46.16K (46165) - RowGroups rejected: 0 (0) - RowGroups total: 46.16K (46165) - Rows processed: 1.05M (1048576) - Rows rejected: 0 (0) - Rows total: 47.22M (47221102) - Splits processed: 64 (64) - Splits rejected: 0 (0) - Splits total: 64 (64) Instance 7f40dcb034de70b7:166 (host=va1046.foo:22000):(Total: 11s467ms, non-child: 3s274ms, % non-child: 28.55%) Hdfs split stats (:<# splits>/): 5:145/9.49 GB 0:154/9.61 GB 7:153/9.48 GB 4:155/9.61 GB 1:153/9.78 GB 3:153/9.72 GB 2:140/9.01 GB 6:152/8.77 GB Filter 7 arrival: 246ms Filter 2 arrival: 11s443ms MemoryUsage(500.000ms): 3.38 MB, 3.38 MB, 25.95 MB, 26.84 MB, 26.84 MB, 27.11 MB, 27.22 MB, 26.90 MB, 28.95 MB, 26.78 MB, 26.86 MB, 26.98 MB, 26.97 MB, 27.52 MB, 25.34 MB, 26.32 MB, 26.37 MB, 23.98 MB, 26.02 MB, 26.13 MB, 27.18 MB, 21.14 MB ThreadUsage(500.000ms): 1, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.45 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 30.36 MB (31829571) - PerHostPeakMemUsage: 1.39 GB (1492831159) - RowsProduced: 41.20M (41204155) - TotalNetworkReceiveTime: 8.621ms - TotalNetworkSendTime: 3s403ms - TotalStorageWaitTime: 6s916ms - TotalThreadsInvoluntaryContextSwitches: 2.48K (2475) - TotalThreadsTotalWallClockTime: 2m19s - TotalThreadsSysTime: 4s525ms - TotalThreadsUserTime: 10s850ms - TotalThreadsVoluntaryContextSwitches: 195.46K (195462) Fragment Instance Lifecycle Timings: - ExecTime: 10s191ms - ExecTreeExecTime: 1s013ms - OpenTime: 1s218ms - ExecTreeOpenTime: 1s033ms - PrepareTime: 58.199ms - ExecTreePrepareTime: 3.454ms DataStreamSender (dst_id=23):(Total: 5s944ms, non-child: 5s944ms, % non-child: 100.00%) - BytesSent: 390.18 MB (409133488) - NetworkThroughput(*): 105.33 MB/sec - OverallThroughput: 65.64 MB/sec - PeakMemoryUsage: 4.80 MB (5028928) - RowsReturned: 41.20M (41204155) - SerializeBatchTime: 2s232ms - TransmitDataRPCTime: 3s704ms - UncompressedRowBatchSize: 1.31 GB (1401465054) CodeGen:(Total: 207.733ms, non-child: 207.733ms, % non-child: 100.00%) - CodegenTime: 1.073ms - CompileTime: 51.766ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 90 (90) - NumInstructions: 2.97K (2968) - OptimizationTime: 130.952ms - PeakMemoryUsage: 1.45 MB (1519616) - PrepareTime: 24.545ms HASH_JOIN_NODE (id=11):(Total: 2s040ms, non-child: 874.824ms, % non-child: 42.86%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.240ms - PeakMemoryUsage: 1.20 MB (1255232) - ProbeRows: 41.20M (41204155) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 825.699ms - RowsReturned: 41.20M (41204155) - RowsReturnedRate: 20.19 M/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 23.628us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 126.606us - HashBuckets: 212 (212) - HashCollisions: 0 (0) - HashTablesBuildTime: 43.665us - LargestPartitionPercent: 9 (9) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1073600) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 8.632ms, non-child: 18.675us, % non-child: 0.22%) BytesReceived(500.000ms): 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 4.758us - DeserializeRowBatchTimer: 28.733us - FirstBatchArrivalWaitTime: 5.130ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 13.90 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=9):(Total: 1s157ms, non-child: 1s157ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:145/9.49 GB 0:154/9.61 GB 7:153/9.48 GB 4:155/9.61 GB 1:153/9.78 GB 3:153/9.72 GB 2:140/9.01 GB 6:152/8.77 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 57 out of 57 Runtime filters: Only following filters arrived: 7, waited 763ms Hdfs Read Thread Concurrency Bucket: 0:81.82% 1:4.545% 2:9.091% 3:4.545% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1148 PARQUET/SNAPPY:57 BytesRead(500.000ms): 0, 0, 11.87 MB, 12.71 MB, 12.71 MB, 12.71 MB, 12.71 MB, 17.51 MB, 20.54 MB, 26.34 MB, 30.05 MB, 30.05 MB, 30.05 MB, 30.05 MB, 34.32 MB, 39.03 MB, 39.03 MB, 40.07 MB, 49.37 MB, 49.37 MB, 53.71 MB, 55.36 MB - FooterProcessingTime: (Avg: 85.764ms ; Min: 3.274ms ; Max: 343.299ms ; Number of samples: 57) - AverageHdfsReadThreadConcurrency: 0.36 - AverageScannerThreadConcurrency: 11.45 - BytesRead: 55.36 MB (58046310) - BytesReadDataNodeCache: 0 - BytesReadLocal: 55.36 MB (58046310) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 55.36 MB (58046310) - DecompressionTime: 314.343ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 57 (57) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 24.65 MB (25850908) - PerReadThreadRawHdfsThroughput: 25.74 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 258.264ms - RowBatchQueuePutWaitTime: 1m49s - RowsRead: 41.20M (41204155) - RowsReturned: 41.20M (41204155) - RowsReturnedRate: 35.58 M/sec - ScanRangesComplete: 1.21K (1205) - ScannerThreadsInvoluntaryContextSwitches: 1.71K (1706) - ScannerThreadsTotalWallClockTime: 2m8s - MaterializeTupleTime(*): 1s939ms - ScannerThreadsSysTime: 4s275ms - ScannerThreadsUserTime: 4s122ms - ScannerThreadsVoluntaryContextSwitches: 194.79K (194794) - TotalRawHdfsReadTime(*): 2s150ms - TotalReadThroughput: 5.03 MB/sec Filter 2 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 41.20M (41204155) Filter 7 (1.00 MB): - Files processed: 1.21K (1205) - Files rejected: 1.15K (1148) - Files total: 1.21K (1205) - RowGroups processed: 40.28K (40284) - RowGroups rejected: 0 (0) - RowGroups total: 40.28K (40284) - Rows processed: 933.89K (933888) - Rows rejected: 0 (0) - Rows total: 41.20M (41204155) - Splits processed: 57 (57) - Splits rejected: 0 (0) - Splits total: 57 (57) Instance 7f40dcb034de70b7:144 (host=va1045.foo:22000):(Total: 11s461ms, non-child: 3s068ms, % non-child: 26.78%) Hdfs split stats (:<# splits>/): 7:133/8.55 GB 0:153/9.43 GB 1:139/8.96 GB 4:153/9.29 GB 6:169/10.72 GB 2:155/9.53 GB 3:136/9.23 GB 5:158/9.77 GB Filter 7 arrival: 326ms Filter 2 arrival: 10s202ms MemoryUsage(500.000ms): 1.35 MB, 3.38 MB, 26.87 MB, 26.82 MB, 27.64 MB, 28.06 MB, 30.99 MB, 31.18 MB, 31.49 MB, 24.83 MB, 28.89 MB, 29.24 MB, 29.24 MB, 29.35 MB, 26.39 MB, 28.11 MB, 27.20 MB, 23.07 MB, 27.03 MB, 26.00 MB, 37.02 MB, 36.09 MB, 26.45 MB ThreadUsage(500.000ms): 1, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.48 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 40.55 MB (42520590) - PerHostPeakMemUsage: 1.40 GB (1500443734) - RowsProduced: 42.12M (42118448) - TotalNetworkReceiveTime: 3.418us - TotalNetworkSendTime: 2s902ms - TotalStorageWaitTime: 5s289ms - TotalThreadsInvoluntaryContextSwitches: 3.34K (3336) - TotalThreadsTotalWallClockTime: 2m20s - TotalThreadsSysTime: 5s140ms - TotalThreadsUserTime: 12s017ms - TotalThreadsVoluntaryContextSwitches: 218.25K (218246) Fragment Instance Lifecycle Timings: - ExecTime: 10s237ms - ExecTreeExecTime: 1s125ms - OpenTime: 1s074ms - ExecTreeOpenTime: 836.121ms - PrepareTime: 149.405ms - ExecTreePrepareTime: 15.706ms DataStreamSender (dst_id=23):(Total: 6s150ms, non-child: 6s150ms, % non-child: 100.00%) - BytesSent: 398.83 MB (418200781) - NetworkThroughput(*): 105.67 MB/sec - OverallThroughput: 64.85 MB/sec - PeakMemoryUsage: 4.76 MB (4987968) - RowsReturned: 42.12M (42118448) - SerializeBatchTime: 2s367ms - TransmitDataRPCTime: 3s774ms - UncompressedRowBatchSize: 1.33 GB (1432562600) CodeGen:(Total: 264.573ms, non-child: 264.573ms, % non-child: 100.00%) - CodegenTime: 1.301ms - CompileTime: 64.277ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 90 (90) - NumInstructions: 2.97K (2968) - OptimizationTime: 171.629ms - PeakMemoryUsage: 1.45 MB (1519616) - PrepareTime: 28.120ms HASH_JOIN_NODE (id=11):(Total: 1s977ms, non-child: 969.685ms, % non-child: 49.04%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.459ms - PeakMemoryUsage: 1.26 MB (1326071) - ProbeRows: 42.12M (42118448) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 920.808ms - RowsReturned: 42.12M (42118448) - RowsReturnedRate: 21.30 M/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 25.212us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 130.160us - HashBuckets: 212 (212) - HashCollisions: 0 (0) - HashTablesBuildTime: 84.845us - LargestPartitionPercent: 9 (9) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1073600) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 13.688us, non-child: 13.688us, % non-child: 100.00%) BytesReceived(500.000ms): 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 4.473us - DeserializeRowBatchTimer: 57.833us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 8.77 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=9):(Total: 1s007ms, non-child: 1s007ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:133/8.55 GB 0:153/9.43 GB 1:139/8.96 GB 4:153/9.29 GB 6:169/10.72 GB 2:155/9.53 GB 3:136/9.23 GB 5:158/9.77 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 55 out of 55 Runtime filters: Only following filters arrived: 7, waited 683ms Hdfs Read Thread Concurrency Bucket: 0:81.82% 1:9.091% 2:4.545% 3:4.545% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1141 PARQUET/SNAPPY:55 BytesRead(500.000ms): 0, 0, 12.41 MB, 12.41 MB, 12.41 MB, 13.80 MB, 21.42 MB, 21.42 MB, 21.42 MB, 24.62 MB, 29.22 MB, 29.22 MB, 29.22 MB, 30.65 MB, 37.21 MB, 39.47 MB, 39.56 MB, 41.13 MB, 48.22 MB, 49.05 MB, 55.08 MB, 55.81 MB, 55.81 MB - FooterProcessingTime: (Avg: 62.026ms ; Min: 19.384ms ; Max: 185.166ms ; Number of samples: 55) - AverageHdfsReadThreadConcurrency: 0.32 - AverageScannerThreadConcurrency: 12.00 - BytesRead: 55.81 MB (58524482) - BytesReadDataNodeCache: 0 - BytesReadLocal: 55.81 MB (58524482) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 55.81 MB (58524482) - DecompressionTime: 362.554ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 55 (55) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 25.99 MB (27252198) - PerReadThreadRawHdfsThroughput: 28.52 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 149.402ms - RowBatchQueuePutWaitTime: 1m48s - RowsRead: 42.13M (42128206) - RowsReturned: 42.12M (42118448) - RowsReturnedRate: 41.79 M/sec - ScanRangesComplete: 1.20K (1196) - ScannerThreadsInvoluntaryContextSwitches: 2.44K (2435) - ScannerThreadsTotalWallClockTime: 2m9s - MaterializeTupleTime(*): 2s143ms - ScannerThreadsSysTime: 4s852ms - ScannerThreadsUserTime: 4s726ms - ScannerThreadsVoluntaryContextSwitches: 217.63K (217626) - TotalRawHdfsReadTime(*): 1s956ms - TotalReadThroughput: 4.85 MB/sec Filter 2 (16.00 MB): - Rows processed: 131.40K (131396) - Rows rejected: 9.76K (9758) - Rows total: 42.13M (42128206) Filter 7 (1.00 MB): - Files processed: 1.20K (1196) - Files rejected: 1.14K (1141) - Files total: 1.20K (1196) - RowGroups processed: 41.17K (41170) - RowGroups rejected: 0 (0) - RowGroups total: 41.17K (41170) - Rows processed: 901.12K (901120) - Rows rejected: 0 (0) - Rows total: 42.12M (42118448) - Splits processed: 55 (55) - Splits rejected: 0 (0) - Splits total: 55 (55) Instance 7f40dcb034de70b7:10a (host=vd1328.foo:22000):(Total: 11s461ms, non-child: 2s518ms, % non-child: 21.97%) Hdfs split stats (:<# splits>/): 6:138/9.07 GB 5:151/9.68 GB 7:162/10.65 GB 4:137/8.50 GB 3:141/8.81 GB 2:153/9.71 GB 0:142/9.26 GB 1:149/9.79 GB Filter 7 arrival: 604ms Filter 2 arrival: 9s060ms MemoryUsage(500.000ms): 1.33 MB, 1.38 MB, 4.54 MB, 26.73 MB, 26.71 MB, 27.15 MB, 28.72 MB, 29.08 MB, 28.44 MB, 27.04 MB, 27.12 MB, 28.28 MB, 24.32 MB, 25.42 MB, 27.82 MB, 28.34 MB, 28.38 MB, 25.02 MB, 25.83 MB, 41.42 MB, 39.93 MB, 41.02 MB, 38.74 MB ThreadUsage(500.000ms): 1, 2, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.00 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 42.21 MB (44258665) - PerHostPeakMemUsage: 1.47 GB (1577999111) - RowsProduced: 42.73M (42725370) - TotalNetworkReceiveTime: 389.316ms - TotalNetworkSendTime: 2s507ms - TotalStorageWaitTime: 5s193ms - TotalThreadsInvoluntaryContextSwitches: 2.62K (2616) - TotalThreadsTotalWallClockTime: 2m16s - TotalThreadsSysTime: 2s006ms - TotalThreadsUserTime: 12s089ms - TotalThreadsVoluntaryContextSwitches: 89.97K (89970) Fragment Instance Lifecycle Timings: - ExecTime: 10s381ms - ExecTreeExecTime: 1s205ms - OpenTime: 1s030ms - ExecTreeOpenTime: 861.562ms - PrepareTime: 49.163ms - ExecTreePrepareTime: 2.870ms DataStreamSender (dst_id=23):(Total: 6s696ms, non-child: 6s696ms, % non-child: 100.00%) - BytesSent: 405.08 MB (424752521) - NetworkThroughput(*): 98.50 MB/sec - OverallThroughput: 60.49 MB/sec - PeakMemoryUsage: 4.74 MB (4971584) - RowsReturned: 42.73M (42725370) - SerializeBatchTime: 2s575ms - TransmitDataRPCTime: 4s112ms - UncompressedRowBatchSize: 1.35 GB (1453205612) CodeGen:(Total: 189.758ms, non-child: 189.758ms, % non-child: 100.00%) - CodegenTime: 960.521us - CompileTime: 50.274ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 90 (90) - NumInstructions: 2.97K (2968) - OptimizationTime: 117.357ms - PeakMemoryUsage: 1.45 MB (1519616) - PrepareTime: 21.731ms HASH_JOIN_NODE (id=11):(Total: 2s056ms, non-child: 1s023ms, % non-child: 49.74%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.775ms - PeakMemoryUsage: 1.27 MB (1331719) - ProbeRows: 42.73M (42725370) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 959.727ms - RowsReturned: 42.73M (42725370) - RowsReturnedRate: 20.77 M/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 29.220us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 153.910us - HashBuckets: 212 (212) - HashCollisions: 0 (0) - HashTablesBuildTime: 64.824us - LargestPartitionPercent: 9 (9) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1073600) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 389.326ms, non-child: 19.704us, % non-child: 0.01%) BytesReceived(500.000ms): 0, 0, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 5.185us - DeserializeRowBatchTimer: 13.534us - FirstBatchArrivalWaitTime: 380.843ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 308.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=9):(Total: 644.779ms, non-child: 644.779ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 6:138/9.07 GB 5:151/9.68 GB 7:162/10.65 GB 4:137/8.50 GB 3:141/8.81 GB 2:153/9.71 GB 0:142/9.26 GB 1:149/9.79 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 60 out of 60 Runtime filters: Only following filters arrived: 7, waited 401ms Hdfs Read Thread Concurrency Bucket: 0:90.91% 1:9.091% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1113 PARQUET/SNAPPY:60 BytesRead(500.000ms): 0, 0, 100.00 KB, 12.22 MB, 12.22 MB, 12.22 MB, 19.34 MB, 20.07 MB, 20.91 MB, 29.59 MB, 29.59 MB, 31.01 MB, 32.69 MB, 33.52 MB, 40.17 MB, 40.17 MB, 40.17 MB, 44.65 MB, 47.91 MB, 48.74 MB, 52.21 MB, 57.79 MB, 57.79 MB - FooterProcessingTime: (Avg: 47.662ms ; Min: 4.283ms ; Max: 142.496ms ; Number of samples: 60) - AverageHdfsReadThreadConcurrency: 0.09 - AverageScannerThreadConcurrency: 11.45 - BytesRead: 57.79 MB (60592754) - BytesReadDataNodeCache: 0 - BytesReadLocal: 57.79 MB (60592754) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 57.79 MB (60592754) - DecompressionTime: 364.735ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 60 (60) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 23.61 MB (24753148) - PerReadThreadRawHdfsThroughput: 25.80 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 65.429ms - RowBatchQueuePutWaitTime: 1m53s - RowsRead: 42.75M (42747975) - RowsReturned: 42.73M (42725370) - RowsReturnedRate: 66.26 M/sec - ScanRangesComplete: 1.17K (1173) - ScannerThreadsInvoluntaryContextSwitches: 1.45K (1450) - ScannerThreadsTotalWallClockTime: 2m4s - MaterializeTupleTime(*): 2s283ms - ScannerThreadsSysTime: 1s675ms - ScannerThreadsUserTime: 4s375ms - ScannerThreadsVoluntaryContextSwitches: 89.36K (89356) - TotalRawHdfsReadTime(*): 2s239ms - TotalReadThroughput: 5.02 MB/sec Filter 2 (16.00 MB): - Rows processed: 318.66K (318659) - Rows rejected: 22.61K (22605) - Rows total: 42.75M (42747975) Filter 7 (1.00 MB): - Files processed: 1.17K (1173) - Files rejected: 1.11K (1113) - Files total: 1.17K (1173) - RowGroups processed: 41.76K (41759) - RowGroups rejected: 0 (0) - RowGroups total: 41.76K (41759) - Rows processed: 983.04K (983040) - Rows rejected: 0 (0) - Rows total: 42.73M (42725370) - Splits processed: 60 (60) - Splits rejected: 0 (0) - Splits total: 60 (60) Instance 7f40dcb034de70b7:135 (host=vd1118.foo:22000):(Total: 11s456ms, non-child: 2s320ms, % non-child: 20.25%) Hdfs split stats (:<# splits>/): 5:140/9.00 GB 2:153/8.97 GB 4:151/9.52 GB 7:150/9.33 GB 6:171/10.84 GB 1:146/9.27 GB 0:143/9.13 GB 3:153/9.43 GB Filter 7 arrival: 445ms Filter 2 arrival: 9s673ms MemoryUsage(500.000ms): 3.38 MB, 3.38 MB, 3.38 MB, 26.66 MB, 26.86 MB, 26.39 MB, 30.12 MB, 30.37 MB, 30.22 MB, 26.29 MB, 25.87 MB, 26.08 MB, 26.08 MB, 26.29 MB, 21.48 MB, 25.07 MB, 24.97 MB, 22.09 MB, 27.14 MB, 44.74 MB, 42.62 MB, 42.94 MB ThreadUsage(500.000ms): 1, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.45 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 45.13 MB (47324824) - PerHostPeakMemUsage: 1.39 GB (1497544075) - RowsProduced: 42.98M (42981347) - TotalNetworkReceiveTime: 221.219ms - TotalNetworkSendTime: 2s923ms - TotalStorageWaitTime: 5s552ms - TotalThreadsInvoluntaryContextSwitches: 3.01K (3014) - TotalThreadsTotalWallClockTime: 2m16s - TotalThreadsSysTime: 2s481ms - TotalThreadsUserTime: 12s044ms - TotalThreadsVoluntaryContextSwitches: 102.00K (102001) Fragment Instance Lifecycle Timings: - ExecTime: 9s703ms - ExecTreeExecTime: 1s155ms - OpenTime: 1s707ms - ExecTreeOpenTime: 1s527ms - PrepareTime: 45.476ms - ExecTreePrepareTime: 2.811ms DataStreamSender (dst_id=23):(Total: 6s261ms, non-child: 6s261ms, % non-child: 100.00%) - BytesSent: 407.94 MB (427755053) - NetworkThroughput(*): 101.12 MB/sec - OverallThroughput: 65.15 MB/sec - PeakMemoryUsage: 4.77 MB (5004352) - RowsReturned: 42.98M (42981347) - SerializeBatchTime: 2s220ms - TransmitDataRPCTime: 4s034ms - UncompressedRowBatchSize: 1.36 GB (1461912118) CodeGen:(Total: 199.083ms, non-child: 199.083ms, % non-child: 100.00%) - CodegenTime: 919.783us - CompileTime: 52.934ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 90 (90) - NumInstructions: 2.97K (2968) - OptimizationTime: 126.056ms - PeakMemoryUsage: 1.45 MB (1519616) - PrepareTime: 19.652ms HASH_JOIN_NODE (id=11):(Total: 2s675ms, non-child: 1s003ms, % non-child: 37.49%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 2.295ms - PeakMemoryUsage: 1.27 MB (1329165) - ProbeRows: 42.98M (42981347) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 960.625ms - RowsReturned: 42.98M (42981347) - RowsReturnedRate: 16.07 M/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 29.214us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 231.165us - HashBuckets: 212 (212) - HashCollisions: 0 (0) - HashTablesBuildTime: 59.034us - LargestPartitionPercent: 9 (9) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1073600) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 221.231ms, non-child: 20.486us, % non-child: 0.01%) BytesReceived(500.000ms): 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 4.571us - DeserializeRowBatchTimer: 26.311us - FirstBatchArrivalWaitTime: 216.794ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 542.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=9):(Total: 1s451ms, non-child: 1s451ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:140/9.00 GB 2:153/8.97 GB 4:151/9.52 GB 7:150/9.33 GB 6:171/10.84 GB 1:146/9.27 GB 0:143/9.13 GB 3:153/9.43 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 60 out of 60 Runtime filters: Only following filters arrived: 7, waited 566ms Hdfs Read Thread Concurrency Bucket: 0:90.91% 1:4.545% 2:0% 3:0% 4:4.545% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1147 PARQUET/SNAPPY:60 BytesRead(500.000ms): 0, 0, 0, 12.43 MB, 12.43 MB, 12.43 MB, 21.49 MB, 21.49 MB, 21.49 MB, 25.71 MB, 29.08 MB, 29.08 MB, 29.08 MB, 29.08 MB, 30.42 MB, 39.10 MB, 39.10 MB, 42.90 MB, 50.47 MB, 51.92 MB, 58.08 MB, 58.08 MB - FooterProcessingTime: (Avg: 51.200ms ; Min: 4.308ms ; Max: 124.141ms ; Number of samples: 60) - AverageHdfsReadThreadConcurrency: 0.23 - AverageScannerThreadConcurrency: 11.45 - BytesRead: 58.08 MB (60901878) - BytesReadDataNodeCache: 0 - BytesReadLocal: 58.08 MB (60901878) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 58.08 MB (60901878) - DecompressionTime: 371.760ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 60 (60) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 24.99 MB (26203768) - PerReadThreadRawHdfsThroughput: 25.90 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 735.116ms - RowBatchQueuePutWaitTime: 1m44s - RowsRead: 43.00M (42999644) - RowsReturned: 42.98M (42981347) - RowsReturnedRate: 29.62 M/sec - ScanRangesComplete: 1.21K (1207) - ScannerThreadsInvoluntaryContextSwitches: 2.22K (2216) - ScannerThreadsTotalWallClockTime: 2m4s - MaterializeTupleTime(*): 2s258ms - ScannerThreadsSysTime: 2s179ms - ScannerThreadsUserTime: 5s368ms - ScannerThreadsVoluntaryContextSwitches: 101.34K (101343) - TotalRawHdfsReadTime(*): 2s242ms - TotalReadThroughput: 5.28 MB/sec Filter 2 (16.00 MB): - Rows processed: 262.01K (262009) - Rows rejected: 18.30K (18297) - Rows total: 43.00M (42999644) Filter 7 (1.00 MB): - Files processed: 1.21K (1207) - Files rejected: 1.15K (1147) - Files total: 1.21K (1207) - RowGroups processed: 42.01K (42009) - RowGroups rejected: 0 (0) - RowGroups total: 42.01K (42009) - Rows processed: 983.04K (983040) - Rows rejected: 0 (0) - Rows total: 42.98M (42981347) - Splits processed: 60 (60) - Splits rejected: 0 (0) - Splits total: 60 (60) Instance 7f40dcb034de70b7:156 (host=vc1542.foo:22000):(Total: 11s382ms, non-child: 2s373ms, % non-child: 20.85%) Hdfs split stats (:<# splits>/): 1:151/9.63 GB 6:155/9.29 GB 0:158/9.77 GB 4:157/9.81 GB 5:156/9.55 GB 7:147/9.44 GB 2:147/8.61 GB 3:146/9.43 GB Filter 7 arrival: 319ms Filter 2 arrival: 10s919ms MemoryUsage(500.000ms): 2.79 MB, 3.38 MB, 4.54 MB, 22.91 MB, 22.76 MB, 23.29 MB, 24.44 MB, 26.65 MB, 27.16 MB, 29.88 MB, 29.05 MB, 29.93 MB, 29.99 MB, 30.14 MB, 30.32 MB, 27.25 MB, 26.97 MB, 23.92 MB, 25.30 MB, 25.65 MB, 27.10 MB, 25.44 MB, 35.55 MB ThreadUsage(500.000ms): 1, 1, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 11.96 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 36.92 MB (38716686) - PerHostPeakMemUsage: 1.40 GB (1507618170) - RowsProduced: 43.58M (43581589) - TotalNetworkReceiveTime: 61.539ms - TotalNetworkSendTime: 2s468ms - TotalStorageWaitTime: 7s605ms - TotalThreadsInvoluntaryContextSwitches: 3.06K (3056) - TotalThreadsTotalWallClockTime: 2m18s - TotalThreadsSysTime: 3s643ms - TotalThreadsUserTime: 12s587ms - TotalThreadsVoluntaryContextSwitches: 196.04K (196042) Fragment Instance Lifecycle Timings: - ExecTime: 10s100ms - ExecTreeExecTime: 1s264ms - OpenTime: 1s225ms - ExecTreeOpenTime: 1s018ms - PrepareTime: 56.240ms - ExecTreePrepareTime: 3.381ms DataStreamSender (dst_id=23):(Total: 6s504ms, non-child: 6s504ms, % non-child: 100.00%) - BytesSent: 413.70 MB (433798085) - NetworkThroughput(*): 102.06 MB/sec - OverallThroughput: 63.61 MB/sec - PeakMemoryUsage: 4.81 MB (5045312) - RowsReturned: 43.58M (43581589) - SerializeBatchTime: 2s442ms - TransmitDataRPCTime: 4s053ms - UncompressedRowBatchSize: 1.38 GB (1482327994) CodeGen:(Total: 230.089ms, non-child: 230.089ms, % non-child: 100.00%) - CodegenTime: 1.024ms - CompileTime: 67.915ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 90 (90) - NumInstructions: 2.97K (2968) - OptimizationTime: 137.429ms - PeakMemoryUsage: 1.45 MB (1519616) - PrepareTime: 24.277ms HASH_JOIN_NODE (id=11):(Total: 2s274ms, non-child: 1s096ms, % non-child: 48.21%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.481ms - PeakMemoryUsage: 1.24 MB (1304024) - ProbeRows: 43.58M (43581589) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1s044ms - RowsReturned: 43.58M (43581589) - RowsReturnedRate: 19.16 M/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 28.433us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 163.917us - HashBuckets: 212 (212) - HashCollisions: 0 (0) - HashTablesBuildTime: 61.079us - LargestPartitionPercent: 9 (9) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1073600) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 61.549ms, non-child: 17.393us, % non-child: 0.03%) BytesReceived(500.000ms): 0, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 4.520us - DeserializeRowBatchTimer: 28.081us - FirstBatchArrivalWaitTime: 48.101ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 1.95 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=9):(Total: 1s117ms, non-child: 1s117ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:151/9.63 GB 6:155/9.29 GB 0:158/9.77 GB 4:157/9.81 GB 5:156/9.55 GB 7:147/9.44 GB 2:147/8.61 GB 3:146/9.43 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 61 out of 61 Runtime filters: Only following filters arrived: 7, waited 682ms Hdfs Read Thread Concurrency Bucket: 0:77.27% 1:13.64% 2:0% 3:9.091% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1156 PARQUET/SNAPPY:61 BytesRead(500.000ms): 0, 0, 100.00 KB, 10.23 MB, 10.23 MB, 10.23 MB, 18.25 MB, 22.04 MB, 23.64 MB, 30.44 MB, 30.44 MB, 31.26 MB, 31.26 MB, 31.26 MB, 33.45 MB, 38.51 MB, 39.36 MB, 41.03 MB, 49.83 MB, 52.12 MB, 56.55 MB, 58.82 MB, 58.82 MB - FooterProcessingTime: (Avg: 64.737ms ; Min: 23.405ms ; Max: 309.530ms ; Number of samples: 61) - AverageHdfsReadThreadConcurrency: 0.41 - AverageScannerThreadConcurrency: 11.45 - BytesRead: 58.82 MB (61674601) - BytesReadDataNodeCache: 0 - BytesReadLocal: 58.82 MB (61674601) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 58.82 MB (61674601) - DecompressionTime: 377.127ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 61 (61) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 24.86 MB (26064536) - PerReadThreadRawHdfsThroughput: 24.30 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 269.766ms - RowBatchQueuePutWaitTime: 1m47s - RowsRead: 43.59M (43585820) - RowsReturned: 43.58M (43581589) - RowsReturnedRate: 39.01 M/sec - ScanRangesComplete: 1.22K (1217) - ScannerThreadsInvoluntaryContextSwitches: 2.11K (2108) - ScannerThreadsTotalWallClockTime: 2m6s - MaterializeTupleTime(*): 2s351ms - ScannerThreadsSysTime: 3s388ms - ScannerThreadsUserTime: 5s015ms - ScannerThreadsVoluntaryContextSwitches: 195.41K (195409) - TotalRawHdfsReadTime(*): 2s420ms - TotalReadThroughput: 5.11 MB/sec Filter 2 (16.00 MB): - Rows processed: 56.90K (56899) - Rows rejected: 4.23K (4231) - Rows total: 43.59M (43585820) Filter 7 (1.00 MB): - Files processed: 1.22K (1217) - Files rejected: 1.16K (1156) - Files total: 1.22K (1217) - RowGroups processed: 42.60K (42603) - RowGroups rejected: 0 (0) - RowGroups total: 42.60K (42603) - Rows processed: 999.42K (999424) - Rows rejected: 0 (0) - Rows total: 43.58M (43581589) - Splits processed: 61 (61) - Splits rejected: 0 (0) - Splits total: 61 (61) Instance 7f40dcb034de70b7:178 (host=vd1332.foo:22000):(Total: 11s379ms, non-child: 2s528ms, % non-child: 22.22%) Hdfs split stats (:<# splits>/): 2:148/9.37 GB 1:146/9.17 GB 0:146/9.62 GB 5:156/10.10 GB 7:139/9.34 GB 3:148/8.79 GB 6:146/9.28 GB 4:157/9.74 GB Filter 7 arrival: 235ms MemoryUsage(500.000ms): 1.35 MB, 3.38 MB, 17.46 MB, 26.99 MB, 27.01 MB, 27.01 MB, 27.32 MB, 24.71 MB, 27.90 MB, 28.09 MB, 29.15 MB, 28.98 MB, 28.98 MB, 29.44 MB, 25.16 MB, 30.81 MB, 30.01 MB, 29.55 MB, 28.14 MB, 30.42 MB, 26.84 MB, 26.34 MB, 10.66 MB ThreadUsage(500.000ms): 1, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.48 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 32.57 MB (34156228) - PerHostPeakMemUsage: 1.38 GB (1477590292) - RowsProduced: 44.70M (44702208) - TotalNetworkReceiveTime: 3.561us - TotalNetworkSendTime: 3s051ms - TotalStorageWaitTime: 5s759ms - TotalThreadsInvoluntaryContextSwitches: 2.50K (2503) - TotalThreadsTotalWallClockTime: 2m19s - TotalThreadsSysTime: 2s875ms - TotalThreadsUserTime: 10s769ms - TotalThreadsVoluntaryContextSwitches: 125.02K (125021) Fragment Instance Lifecycle Timings: - ExecTime: 10s187ms - ExecTreeExecTime: 1s167ms - OpenTime: 1s131ms - ExecTreeOpenTime: 952.368ms - PrepareTime: 60.756ms - ExecTreePrepareTime: 3.470ms DataStreamSender (dst_id=23):(Total: 6s535ms, non-child: 6s535ms, % non-child: 100.00%) - BytesSent: 423.75 MB (444332515) - NetworkThroughput(*): 101.61 MB/sec - OverallThroughput: 64.84 MB/sec - PeakMemoryUsage: 4.81 MB (5045312) - RowsReturned: 44.70M (44702208) - SerializeBatchTime: 2s357ms - TransmitDataRPCTime: 4s170ms - UncompressedRowBatchSize: 1.42 GB (1520443248) CodeGen:(Total: 203.658ms, non-child: 203.658ms, % non-child: 100.00%) - CodegenTime: 1.373ms - CompileTime: 52.297ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 90 (90) - NumInstructions: 2.97K (2968) - OptimizationTime: 124.946ms - PeakMemoryUsage: 1.45 MB (1519616) - PrepareTime: 25.815ms HASH_JOIN_NODE (id=11):(Total: 2s111ms, non-child: 1s020ms, % non-child: 48.31%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.236ms - PeakMemoryUsage: 1.20 MB (1255232) - ProbeRows: 44.70M (44702208) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 963.178ms - RowsReturned: 44.70M (44702208) - RowsReturnedRate: 21.17 M/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 22.385us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 100.612us - HashBuckets: 212 (212) - HashCollisions: 0 (0) - HashTablesBuildTime: 47.135us - LargestPartitionPercent: 9 (9) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1073600) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 12.064us, non-child: 12.064us, % non-child: 100.00%) BytesReceived(500.000ms): 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 4.585us - DeserializeRowBatchTimer: 17.173us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 9.95 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=9):(Total: 1s091ms, non-child: 1s091ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:148/9.37 GB 1:146/9.17 GB 0:146/9.62 GB 5:156/10.10 GB 7:139/9.34 GB 3:148/8.79 GB 6:146/9.28 GB 4:157/9.74 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 57 out of 57 Runtime filters: Only following filters arrived: 7, waited 783ms Hdfs Read Thread Concurrency Bucket: 0:81.82% 1:18.18% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1129 PARQUET/SNAPPY:57 BytesRead(500.000ms): 0, 0, 4.20 MB, 13.40 MB, 13.40 MB, 13.40 MB, 13.40 MB, 16.85 MB, 20.70 MB, 22.37 MB, 29.94 MB, 29.94 MB, 29.94 MB, 30.76 MB, 32.96 MB, 40.10 MB, 40.10 MB, 46.33 MB, 47.05 MB, 51.34 MB, 57.18 MB, 58.87 MB, 58.87 MB - FooterProcessingTime: (Avg: 65.011ms ; Min: 3.566ms ; Max: 213.371ms ; Number of samples: 57) - AverageHdfsReadThreadConcurrency: 0.18 - AverageScannerThreadConcurrency: 12.00 - BytesRead: 58.87 MB (61727410) - BytesReadDataNodeCache: 0 - BytesReadLocal: 58.87 MB (61727410) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 58.87 MB (61727410) - DecompressionTime: 366.917ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 57 (57) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 26.90 MB (28202762) - PerReadThreadRawHdfsThroughput: 27.64 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 165.633ms - RowBatchQueuePutWaitTime: 1m51s - RowsRead: 44.70M (44702208) - RowsReturned: 44.70M (44702208) - RowsReturnedRate: 40.96 M/sec - ScanRangesComplete: 1.19K (1186) - ScannerThreadsInvoluntaryContextSwitches: 1.67K (1671) - ScannerThreadsTotalWallClockTime: 2m7s - MaterializeTupleTime(*): 2s023ms - ScannerThreadsSysTime: 2s559ms - ScannerThreadsUserTime: 3s759ms - ScannerThreadsVoluntaryContextSwitches: 124.38K (124375) - TotalRawHdfsReadTime(*): 2s130ms - TotalReadThroughput: 5.12 MB/sec Filter 2 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 44.70M (44702208) Filter 7 (1.00 MB): - Files processed: 1.19K (1186) - Files rejected: 1.13K (1129) - Files total: 1.19K (1186) - RowGroups processed: 43.70K (43700) - RowGroups rejected: 0 (0) - RowGroups total: 43.70K (43700) - Rows processed: 933.89K (933888) - Rows rejected: 0 (0) - Rows total: 44.70M (44702208) - Splits processed: 57 (57) - Splits rejected: 0 (0) - Splits total: 57 (57) Instance 7f40dcb034de70b7:13e (host=vc1532.foo:22000):(Total: 11s327ms, non-child: 2s994ms, % non-child: 26.44%) Hdfs split stats (:<# splits>/): 7:136/8.32 GB 1:160/10.90 GB 3:138/9.05 GB 4:158/10.11 GB 2:149/9.18 GB 0:143/9.72 GB 6:144/8.73 GB 5:146/9.46 GB Filter 7 arrival: 414ms Filter 2 arrival: 9s788ms MemoryUsage(500.000ms): 3.38 MB, 3.38 MB, 27.86 MB, 27.89 MB, 27.76 MB, 27.76 MB, 27.28 MB, 29.17 MB, 29.03 MB, 27.14 MB, 25.94 MB, 25.93 MB, 25.93 MB, 26.29 MB, 24.99 MB, 25.06 MB, 27.54 MB, 26.44 MB, 27.01 MB, 42.42 MB, 42.96 MB, 38.37 MB ThreadUsage(500.000ms): 1, 1, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 11.91 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 43.85 MB (45981623) - PerHostPeakMemUsage: 1.39 GB (1496414328) - RowsProduced: 42.99M (42985150) - TotalNetworkReceiveTime: 185.590ms - TotalNetworkSendTime: 3s020ms - TotalStorageWaitTime: 5s712ms - TotalThreadsInvoluntaryContextSwitches: 2.27K (2269) - TotalThreadsTotalWallClockTime: 2m13s - TotalThreadsSysTime: 2s123ms - TotalThreadsUserTime: 11s665ms - TotalThreadsVoluntaryContextSwitches: 143.65K (143646) Fragment Instance Lifecycle Timings: - ExecTime: 10s204ms - ExecTreeExecTime: 1s076ms - OpenTime: 1s066ms - ExecTreeOpenTime: 889.412ms - PrepareTime: 55.750ms - ExecTreePrepareTime: 3.327ms DataStreamSender (dst_id=23):(Total: 6s175ms, non-child: 6s175ms, % non-child: 100.00%) - BytesSent: 407.73 MB (427538889) - NetworkThroughput(*): 105.94 MB/sec - OverallThroughput: 66.02 MB/sec - PeakMemoryUsage: 4.84 MB (5078080) - RowsReturned: 42.99M (42985150) - SerializeBatchTime: 2s319ms - TransmitDataRPCTime: 3s848ms - UncompressedRowBatchSize: 1.36 GB (1462041468) CodeGen:(Total: 199.695ms, non-child: 199.695ms, % non-child: 100.00%) - CodegenTime: 1.161ms - CompileTime: 50.208ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 90 (90) - NumInstructions: 2.97K (2968) - OptimizationTime: 125.424ms - PeakMemoryUsage: 1.45 MB (1519616) - PrepareTime: 23.652ms HASH_JOIN_NODE (id=11):(Total: 1s956ms, non-child: 921.731ms, % non-child: 47.11%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.483ms - PeakMemoryUsage: 1.27 MB (1330592) - ProbeRows: 42.99M (42985150) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 862.929ms - RowsReturned: 42.99M (42985150) - RowsReturnedRate: 21.97 M/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 27.714us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 172.690us - HashBuckets: 212 (212) - HashCollisions: 0 (0) - HashTablesBuildTime: 60.446us - LargestPartitionPercent: 9 (9) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1073600) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 185.600ms, non-child: 18.697us, % non-child: 0.01%) BytesReceived(500.000ms): 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 4.707us - DeserializeRowBatchTimer: 22.488us - FirstBatchArrivalWaitTime: 181.001ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 646.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=9):(Total: 849.600ms, non-child: 849.600ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:136/8.32 GB 1:160/10.90 GB 3:138/9.05 GB 4:158/10.11 GB 2:149/9.18 GB 0:143/9.72 GB 6:144/8.73 GB 5:146/9.46 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 61 out of 61 Runtime filters: Only following filters arrived: 7, waited 602ms Hdfs Read Thread Concurrency Bucket: 0:90.91% 1:9.091% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1113 PARQUET/SNAPPY:61 BytesRead(500.000ms): 0, 0, 12.98 MB, 12.98 MB, 12.98 MB, 12.98 MB, 13.27 MB, 19.75 MB, 19.75 MB, 19.75 MB, 30.13 MB, 30.13 MB, 30.13 MB, 30.13 MB, 31.06 MB, 38.73 MB, 40.74 MB, 48.96 MB, 50.27 MB, 52.63 MB, 58.14 MB, 58.14 MB - FooterProcessingTime: (Avg: 49.982ms ; Min: 3.290ms ; Max: 139.917ms ; Number of samples: 61) - AverageHdfsReadThreadConcurrency: 0.09 - AverageScannerThreadConcurrency: 10.91 - BytesRead: 58.14 MB (60963585) - BytesReadDataNodeCache: 0 - BytesReadLocal: 58.14 MB (60963585) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 58.14 MB (60963585) - DecompressionTime: 361.979ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 61 (61) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 23.93 MB (25097355) - PerReadThreadRawHdfsThroughput: 25.70 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 95.263ms - RowBatchQueuePutWaitTime: 1m50s - RowsRead: 43.00M (43003664) - RowsReturned: 42.99M (42985150) - RowsReturnedRate: 50.59 M/sec - ScanRangesComplete: 1.17K (1174) - ScannerThreadsInvoluntaryContextSwitches: 1.42K (1422) - ScannerThreadsTotalWallClockTime: 2m2s - MaterializeTupleTime(*): 2s161ms - ScannerThreadsSysTime: 1s871ms - ScannerThreadsUserTime: 4s552ms - ScannerThreadsVoluntaryContextSwitches: 142.97K (142965) - TotalRawHdfsReadTime(*): 2s261ms - TotalReadThroughput: 5.29 MB/sec Filter 2 (16.00 MB): - Rows processed: 270.42K (270418) - Rows rejected: 18.51K (18514) - Rows total: 43.00M (43003664) Filter 7 (1.00 MB): - Files processed: 1.17K (1174) - Files rejected: 1.11K (1113) - Files total: 1.17K (1174) - RowGroups processed: 42.02K (42015) - RowGroups rejected: 0 (0) - RowGroups total: 42.02K (42015) - Rows processed: 999.42K (999424) - Rows rejected: 0 (0) - Rows total: 42.99M (42985150) - Splits processed: 61 (61) - Splits rejected: 0 (0) - Splits total: 61 (61) Instance 7f40dcb034de70b7:165 (host=vd1334.foo:22000):(Total: 11s242ms, non-child: 1s874ms, % non-child: 16.67%) Hdfs split stats (:<# splits>/): 6:125/8.06 GB 0:153/10.43 GB 4:154/9.99 GB 5:139/9.42 GB 1:136/8.81 GB 7:162/9.79 GB 2:155/9.59 GB 3:155/9.38 GB Filter 7 arrival: 253ms MemoryUsage(500.000ms): 1.35 MB, 3.38 MB, 6.44 MB, 27.87 MB, 28.24 MB, 28.26 MB, 29.15 MB, 29.05 MB, 23.14 MB, 27.68 MB, 28.14 MB, 28.99 MB, 28.99 MB, 28.91 MB, 29.19 MB, 29.29 MB, 26.00 MB, 28.67 MB, 28.99 MB, 30.14 MB, 28.92 MB, 21.02 MB, 2.51 MB ThreadUsage(500.000ms): 1, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 1 - AverageThreadTokens: 11.96 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 30.57 MB (32058388) - PerHostPeakMemUsage: 1.40 GB (1501295066) - RowsProduced: 46.23M (46232549) - TotalNetworkReceiveTime: 14.934ms - TotalNetworkSendTime: 2s414ms - TotalStorageWaitTime: 7s303ms - TotalThreadsInvoluntaryContextSwitches: 2.74K (2743) - TotalThreadsTotalWallClockTime: 2m17s - TotalThreadsSysTime: 3s274ms - TotalThreadsUserTime: 11s841ms - TotalThreadsVoluntaryContextSwitches: 196.88K (196884) Fragment Instance Lifecycle Timings: - ExecTime: 9s936ms - ExecTreeExecTime: 1s224ms - OpenTime: 1s245ms - ExecTreeOpenTime: 1s062ms - PrepareTime: 60.106ms - ExecTreePrepareTime: 3.600ms DataStreamSender (dst_id=23):(Total: 6s881ms, non-child: 6s881ms, % non-child: 100.00%) - BytesSent: 438.32 MB (459609573) - NetworkThroughput(*): 99.93 MB/sec - OverallThroughput: 63.70 MB/sec - PeakMemoryUsage: 4.84 MB (5078080) - RowsReturned: 46.23M (46232549) - SerializeBatchTime: 2s486ms - TransmitDataRPCTime: 4s386ms - UncompressedRowBatchSize: 1.46 GB (1572494290) CodeGen:(Total: 207.897ms, non-child: 207.897ms, % non-child: 100.00%) - CodegenTime: 1.025ms - CompileTime: 52.134ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 90 (90) - NumInstructions: 2.97K (2968) - OptimizationTime: 129.604ms - PeakMemoryUsage: 1.45 MB (1519616) - PrepareTime: 25.727ms HASH_JOIN_NODE (id=11):(Total: 2s279ms, non-child: 1s064ms, % non-child: 46.70%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.393ms - PeakMemoryUsage: 1.20 MB (1255232) - ProbeRows: 46.23M (46232549) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1s009ms - RowsReturned: 46.23M (46232549) - RowsReturnedRate: 20.28 M/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 26.454us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 124.840us - HashBuckets: 212 (212) - HashCollisions: 0 (0) - HashTablesBuildTime: 54.685us - LargestPartitionPercent: 9 (9) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1073600) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 14.943ms, non-child: 19.275us, % non-child: 0.13%) BytesReceived(500.000ms): 0, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 4.123us - DeserializeRowBatchTimer: 15.866us - FirstBatchArrivalWaitTime: 7.848ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 8.03 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=9):(Total: 1s200ms, non-child: 1s200ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 6:125/8.06 GB 0:153/10.43 GB 4:154/9.99 GB 5:139/9.42 GB 1:136/8.81 GB 7:162/9.79 GB 2:155/9.59 GB 3:155/9.38 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 60 out of 60 Runtime filters: Only following filters arrived: 7, waited 763ms Hdfs Read Thread Concurrency Bucket: 0:76.19% 1:9.524% 2:9.524% 3:0% 4:0% 5:4.762% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1119 PARQUET/SNAPPY:60 BytesRead(500.000ms): 0, 0, 200.00 KB, 12.94 MB, 12.94 MB, 12.94 MB, 19.40 MB, 19.40 MB, 25.28 MB, 30.95 MB, 30.95 MB, 36.87 MB, 36.87 MB, 39.39 MB, 39.39 MB, 39.39 MB, 45.69 MB, 49.02 MB, 52.61 MB, 57.33 MB, 58.26 MB, 61.27 MB - FooterProcessingTime: (Avg: 85.987ms ; Min: 3.643ms ; Max: 306.497ms ; Number of samples: 60) - AverageHdfsReadThreadConcurrency: 0.52 - AverageScannerThreadConcurrency: 12.00 - BytesRead: 61.27 MB (64248848) - BytesReadDataNodeCache: 0 - BytesReadLocal: 61.27 MB (64248848) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 61.27 MB (64248848) - DecompressionTime: 393.275ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 60 (60) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 24.81 MB (26014189) - PerReadThreadRawHdfsThroughput: 26.01 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 280.730ms - RowBatchQueuePutWaitTime: 1m47s - RowsRead: 46.23M (46232549) - RowsReturned: 46.23M (46232549) - RowsReturnedRate: 38.51 M/sec - ScanRangesComplete: 1.18K (1179) - ScannerThreadsInvoluntaryContextSwitches: 1.89K (1885) - ScannerThreadsTotalWallClockTime: 2m5s - MaterializeTupleTime(*): 2s269ms - ScannerThreadsSysTime: 2s956ms - ScannerThreadsUserTime: 4s432ms - ScannerThreadsVoluntaryContextSwitches: 196.21K (196213) - TotalRawHdfsReadTime(*): 2s355ms - TotalReadThroughput: 5.57 MB/sec Filter 2 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 46.23M (46232549) Filter 7 (1.00 MB): - Files processed: 1.18K (1179) - Files rejected: 1.12K (1119) - Files total: 1.18K (1179) - RowGroups processed: 45.20K (45196) - RowGroups rejected: 0 (0) - RowGroups total: 45.20K (45196) - Rows processed: 983.04K (983040) - Rows rejected: 0 (0) - Rows total: 46.23M (46232549) - Splits processed: 60 (60) - Splits rejected: 0 (0) - Splits total: 60 (60) Instance 7f40dcb034de70b7:12e (host=va1034.foo:22000):(Total: 11s236ms, non-child: 2s548ms, % non-child: 22.68%) Hdfs split stats (:<# splits>/): 3:159/10.00 GB 2:145/8.98 GB 1:138/8.60 GB 6:148/9.50 GB 4:139/9.37 GB 5:150/9.97 GB 0:147/9.60 GB 7:142/9.49 GB Filter 7 arrival: 467ms Filter 2 arrival: 9s554ms MemoryUsage(500.000ms): 1.38 MB, 3.38 MB, 23.32 MB, 24.35 MB, 26.57 MB, 23.96 MB, 28.91 MB, 29.11 MB, 27.37 MB, 28.17 MB, 28.29 MB, 26.90 MB, 27.09 MB, 27.86 MB, 28.13 MB, 29.17 MB, 29.47 MB, 28.96 MB, 29.11 MB, 44.18 MB, 43.76 MB, 33.52 MB ThreadUsage(500.000ms): 2, 1, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 11.95 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 46.70 MB (48963861) - PerHostPeakMemUsage: 1.41 GB (1515296880) - RowsProduced: 43.72M (43723493) - TotalNetworkReceiveTime: 226.978ms - TotalNetworkSendTime: 2s685ms - TotalStorageWaitTime: 5s047ms - TotalThreadsInvoluntaryContextSwitches: 2.84K (2844) - TotalThreadsTotalWallClockTime: 2m14s - TotalThreadsSysTime: 3s138ms - TotalThreadsUserTime: 11s883ms - TotalThreadsVoluntaryContextSwitches: 112.00K (112000) Fragment Instance Lifecycle Timings: - ExecTime: 10s111ms - ExecTreeExecTime: 1s140ms - OpenTime: 1s069ms - ExecTreeOpenTime: 881.091ms - PrepareTime: 54.878ms - ExecTreePrepareTime: 3.276ms DataStreamSender (dst_id=23):(Total: 6s462ms, non-child: 6s462ms, % non-child: 100.00%) - BytesSent: 414.64 MB (434778512) - NetworkThroughput(*): 103.38 MB/sec - OverallThroughput: 64.16 MB/sec - PeakMemoryUsage: 4.74 MB (4971584) - RowsReturned: 43.72M (43723493) - SerializeBatchTime: 2s443ms - TransmitDataRPCTime: 4s010ms - UncompressedRowBatchSize: 1.39 GB (1487154530) CodeGen:(Total: 211.498ms, non-child: 211.498ms, % non-child: 100.00%) - CodegenTime: 1.051ms - CompileTime: 53.557ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 90 (90) - NumInstructions: 2.97K (2968) - OptimizationTime: 133.254ms - PeakMemoryUsage: 1.45 MB (1519616) - PrepareTime: 24.187ms HASH_JOIN_NODE (id=11):(Total: 2s013ms, non-child: 970.488ms, % non-child: 48.20%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.727ms - PeakMemoryUsage: 1.27 MB (1326544) - ProbeRows: 43.72M (43723493) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 919.609ms - RowsReturned: 43.72M (43723493) - RowsReturnedRate: 21.72 M/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 28.509us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 235.226us - HashBuckets: 212 (212) - HashCollisions: 0 (0) - HashTablesBuildTime: 74.980us - LargestPartitionPercent: 9 (9) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1073600) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 226.990ms, non-child: 22.402us, % non-child: 0.01%) BytesReceived(500.000ms): 0, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 5.864us - DeserializeRowBatchTimer: 15.158us - FirstBatchArrivalWaitTime: 217.702ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 528.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=9):(Total: 816.317ms, non-child: 816.317ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:159/10.00 GB 2:145/8.98 GB 1:138/8.60 GB 6:148/9.50 GB 4:139/9.37 GB 5:150/9.97 GB 0:147/9.60 GB 7:142/9.49 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 59 out of 59 Runtime filters: Only following filters arrived: 7, waited 543ms Hdfs Read Thread Concurrency Bucket: 0:90.91% 1:9.091% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1109 PARQUET/SNAPPY:59 BytesRead(500.000ms): 0, 0, 11.36 MB, 12.22 MB, 13.61 MB, 15.27 MB, 22.76 MB, 22.76 MB, 25.28 MB, 28.65 MB, 29.48 MB, 39.99 MB, 39.99 MB, 42.21 MB, 42.21 MB, 43.98 MB, 47.63 MB, 48.47 MB, 48.57 MB, 54.65 MB, 58.29 MB, 58.29 MB - FooterProcessingTime: (Avg: 50.143ms ; Min: 3.931ms ; Max: 143.723ms ; Number of samples: 59) - AverageHdfsReadThreadConcurrency: 0.09 - AverageScannerThreadConcurrency: 10.91 - BytesRead: 58.29 MB (61117664) - BytesReadDataNodeCache: 0 - BytesReadLocal: 58.29 MB (61117664) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 58.29 MB (61117664) - DecompressionTime: 384.252ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 59 (59) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 25.04 MB (26260512) - PerReadThreadRawHdfsThroughput: 25.96 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 107.475ms - RowBatchQueuePutWaitTime: 1m49s - RowsRead: 43.74M (43741793) - RowsReturned: 43.72M (43723493) - RowsReturnedRate: 53.56 M/sec - ScanRangesComplete: 1.17K (1168) - ScannerThreadsInvoluntaryContextSwitches: 1.92K (1921) - ScannerThreadsTotalWallClockTime: 2m3s - MaterializeTupleTime(*): 2s358ms - ScannerThreadsSysTime: 2s867ms - ScannerThreadsUserTime: 4s534ms - ScannerThreadsVoluntaryContextSwitches: 111.38K (111380) - TotalRawHdfsReadTime(*): 2s245ms - TotalReadThroughput: 5.30 MB/sec Filter 2 (16.00 MB): - Rows processed: 251.53K (251534) - Rows rejected: 18.30K (18300) - Rows total: 43.74M (43741793) Filter 7 (1.00 MB): - Files processed: 1.17K (1168) - Files rejected: 1.11K (1109) - Files total: 1.17K (1168) - RowGroups processed: 42.73K (42734) - RowGroups rejected: 0 (0) - RowGroups total: 42.73K (42734) - Rows processed: 966.66K (966656) - Rows rejected: 0 (0) - Rows total: 43.72M (43723493) - Splits processed: 59 (59) - Splits rejected: 0 (0) - Splits total: 59 (59) Instance 7f40dcb034de70b7:11e (host=vd1119.foo:22000):(Total: 11s228ms, non-child: 2s624ms, % non-child: 23.37%) Hdfs split stats (:<# splits>/): 0:143/8.90 GB 3:137/8.72 GB 7:158/11.00 GB 6:150/9.22 GB 1:149/10.05 GB 4:128/8.51 GB 5:142/9.26 GB 2:156/9.86 GB Filter 7 arrival: 523ms Filter 2 arrival: 9s324ms MemoryUsage(500.000ms): 2.79 MB, 3.38 MB, 5.27 MB, 26.73 MB, 26.95 MB, 27.46 MB, 26.50 MB, 25.85 MB, 22.21 MB, 23.77 MB, 26.62 MB, 27.20 MB, 27.18 MB, 27.18 MB, 26.45 MB, 28.14 MB, 28.09 MB, 28.68 MB, 28.81 MB, 45.62 MB, 44.38 MB, 41.95 MB, 27.93 MB ThreadUsage(500.000ms): 1, 1, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 11.96 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 45.94 MB (48166987) - PerHostPeakMemUsage: 1.43 GB (1534242393) - RowsProduced: 42.90M (42896964) - TotalNetworkReceiveTime: 292.355ms - TotalNetworkSendTime: 3s027ms - TotalStorageWaitTime: 6s146ms - TotalThreadsInvoluntaryContextSwitches: 2.49K (2492) - TotalThreadsTotalWallClockTime: 2m13s - TotalThreadsSysTime: 1s842ms - TotalThreadsUserTime: 11s002ms - TotalThreadsVoluntaryContextSwitches: 95.30K (95304) Fragment Instance Lifecycle Timings: - ExecTime: 10s134ms - ExecTreeExecTime: 1s184ms - OpenTime: 1s039ms - ExecTreeOpenTime: 860.210ms - PrepareTime: 54.664ms - ExecTreePrepareTime: 3.309ms DataStreamSender (dst_id=23):(Total: 6s366ms, non-child: 6s366ms, % non-child: 100.00%) - BytesSent: 406.44 MB (426179845) - NetworkThroughput(*): 100.15 MB/sec - OverallThroughput: 63.84 MB/sec - PeakMemoryUsage: 4.66 MB (4889664) - RowsReturned: 42.90M (42896964) - SerializeBatchTime: 2s300ms - TransmitDataRPCTime: 4s058ms - UncompressedRowBatchSize: 1.36 GB (1459042048) CodeGen:(Total: 201.288ms, non-child: 201.288ms, % non-child: 100.00%) - CodegenTime: 1.036ms - CompileTime: 53.814ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 90 (90) - NumInstructions: 2.97K (2968) - OptimizationTime: 123.808ms - PeakMemoryUsage: 1.45 MB (1519616) - PrepareTime: 23.237ms HASH_JOIN_NODE (id=11):(Total: 2s036ms, non-child: 964.285ms, % non-child: 47.36%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 2.266ms - PeakMemoryUsage: 1.27 MB (1329011) - ProbeRows: 42.90M (42896964) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 909.830ms - RowsReturned: 42.90M (42896964) - RowsReturnedRate: 21.07 M/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 87.548us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 171.661us - HashBuckets: 212 (212) - HashCollisions: 0 (0) - HashTablesBuildTime: 102.703us - LargestPartitionPercent: 9 (9) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1073600) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 292.368ms, non-child: 21.800us, % non-child: 0.01%) BytesReceived(500.000ms): 0, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 6.318us - DeserializeRowBatchTimer: 21.747us - FirstBatchArrivalWaitTime: 285.309ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 410.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=9):(Total: 779.796ms, non-child: 779.796ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:143/8.90 GB 3:137/8.72 GB 7:158/11.00 GB 6:150/9.22 GB 1:149/10.05 GB 4:128/8.51 GB 5:142/9.26 GB 2:156/9.86 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 59 out of 59 Runtime filters: Only following filters arrived: 7, waited 482ms Hdfs Read Thread Concurrency Bucket: 0:77.27% 1:13.64% 2:0% 3:9.091% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1104 PARQUET/SNAPPY:59 BytesRead(500.000ms): 0, 0, 619.76 KB, 13.08 MB, 13.08 MB, 13.93 MB, 19.46 MB, 19.46 MB, 21.13 MB, 27.89 MB, 30.97 MB, 30.97 MB, 31.79 MB, 31.79 MB, 33.77 MB, 40.24 MB, 41.06 MB, 43.57 MB, 49.44 MB, 50.29 MB, 56.67 MB, 56.76 MB, 57.51 MB - FooterProcessingTime: (Avg: 61.073ms ; Min: 4.008ms ; Max: 177.804ms ; Number of samples: 59) - AverageHdfsReadThreadConcurrency: 0.41 - AverageScannerThreadConcurrency: 11.45 - BytesRead: 57.51 MB (60300591) - BytesReadDataNodeCache: 0 - BytesReadLocal: 57.51 MB (60300591) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 57.51 MB (60300591) - DecompressionTime: 373.588ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 59 (59) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 24.13 MB (25298654) - PerReadThreadRawHdfsThroughput: 26.03 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 153.717ms - RowBatchQueuePutWaitTime: 1m50s - RowsRead: 42.91M (42914452) - RowsReturned: 42.90M (42896964) - RowsReturnedRate: 55.01 M/sec - ScanRangesComplete: 1.16K (1163) - ScannerThreadsInvoluntaryContextSwitches: 1.68K (1679) - ScannerThreadsTotalWallClockTime: 2m1s - MaterializeTupleTime(*): 2s190ms - ScannerThreadsSysTime: 1s568ms - ScannerThreadsUserTime: 4s046ms - ScannerThreadsVoluntaryContextSwitches: 94.66K (94658) - TotalRawHdfsReadTime(*): 2s209ms - TotalReadThroughput: 5.00 MB/sec Filter 2 (16.00 MB): - Rows processed: 244.82K (244816) - Rows rejected: 17.49K (17488) - Rows total: 42.91M (42914452) Filter 7 (1.00 MB): - Files processed: 1.16K (1163) - Files rejected: 1.10K (1104) - Files total: 1.16K (1163) - RowGroups processed: 41.93K (41926) - RowGroups rejected: 0 (0) - RowGroups total: 41.93K (41926) - Rows processed: 966.46K (966455) - Rows rejected: 0 (0) - Rows total: 42.90M (42896964) - Splits processed: 59 (59) - Splits rejected: 0 (0) - Splits total: 59 (59) Instance 7f40dcb034de70b7:11d (host=va1038.foo:22000):(Total: 11s202ms, non-child: 2s791ms, % non-child: 24.92%) Hdfs split stats (:<# splits>/): 3:128/8.38 GB 2:152/9.60 GB 4:157/10.17 GB 1:137/9.07 GB 0:161/10.88 GB 5:143/8.90 GB 7:149/9.80 GB 6:145/8.70 GB Filter 7 arrival: 516ms Filter 2 arrival: 9s297ms MemoryUsage(500.000ms): 1.38 MB, 3.38 MB, 24.38 MB, 25.10 MB, 25.47 MB, 15.66 MB, 29.01 MB, 28.16 MB, 24.65 MB, 29.16 MB, 29.12 MB, 29.18 MB, 29.42 MB, 26.99 MB, 23.05 MB, 23.96 MB, 25.28 MB, 23.69 MB, 40.27 MB, 41.55 MB, 35.63 MB, 31.71 MB ThreadUsage(500.000ms): 2, 1, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 11.95 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 41.98 MB (44016803) - PerHostPeakMemUsage: 1.41 GB (1508826574) - RowsProduced: 40.89M (40887031) - TotalNetworkReceiveTime: 295.390ms - TotalNetworkSendTime: 3s254ms - TotalStorageWaitTime: 5s297ms - TotalThreadsInvoluntaryContextSwitches: 2.85K (2846) - TotalThreadsTotalWallClockTime: 2m12s - TotalThreadsSysTime: 4s795ms - TotalThreadsUserTime: 11s266ms - TotalThreadsVoluntaryContextSwitches: 200.41K (200405) Fragment Instance Lifecycle Timings: - ExecTime: 10s057ms - ExecTreeExecTime: 1s143ms - OpenTime: 1s092ms - ExecTreeOpenTime: 920.829ms - PrepareTime: 52.822ms - ExecTreePrepareTime: 3.007ms DataStreamSender (dst_id=23):(Total: 6s159ms, non-child: 6s159ms, % non-child: 100.00%) - BytesSent: 386.87 MB (405660224) - NetworkThroughput(*): 98.78 MB/sec - OverallThroughput: 62.81 MB/sec - PeakMemoryUsage: 4.80 MB (5037120) - RowsReturned: 40.89M (40887031) - SerializeBatchTime: 2s235ms - TransmitDataRPCTime: 3s916ms - UncompressedRowBatchSize: 1.30 GB (1390678806) CodeGen:(Total: 194.484ms, non-child: 194.484ms, % non-child: 100.00%) - CodegenTime: 1.078ms - CompileTime: 50.204ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 90 (90) - NumInstructions: 2.97K (2968) - OptimizationTime: 119.413ms - PeakMemoryUsage: 1.45 MB (1519616) - PrepareTime: 24.455ms HASH_JOIN_NODE (id=11):(Total: 2s057ms, non-child: 992.818ms, % non-child: 48.26%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.534ms - PeakMemoryUsage: 1.27 MB (1329299) - ProbeRows: 40.89M (40887031) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 943.346ms - RowsReturned: 40.89M (40887031) - RowsReturnedRate: 19.87 M/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 25.669us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 149.732us - HashBuckets: 212 (212) - HashCollisions: 0 (0) - HashTablesBuildTime: 52.476us - LargestPartitionPercent: 9 (9) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1073600) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 295.400ms, non-child: 21.934us, % non-child: 0.01%) BytesReceived(500.000ms): 0, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 4.458us - DeserializeRowBatchTimer: 31.680us - FirstBatchArrivalWaitTime: 294.977ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 406.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=9):(Total: 769.675ms, non-child: 769.675ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:128/8.38 GB 2:152/9.60 GB 4:157/10.17 GB 1:137/9.07 GB 0:161/10.88 GB 5:143/8.90 GB 7:149/9.80 GB 6:145/8.70 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 58 out of 58 Runtime filters: Only following filters arrived: 7, waited 502ms Hdfs Read Thread Concurrency Bucket: 0:86.36% 1:4.545% 2:4.545% 3:4.545% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1114 PARQUET/SNAPPY:58 BytesRead(500.000ms): 0, 0, 11.70 MB, 11.70 MB, 11.70 MB, 12.64 MB, 22.40 MB, 24.08 MB, 25.00 MB, 28.81 MB, 28.81 MB, 30.49 MB, 30.49 MB, 30.49 MB, 33.81 MB, 38.04 MB, 40.26 MB, 48.61 MB, 48.61 MB, 50.03 MB, 53.47 MB, 55.36 MB - FooterProcessingTime: (Avg: 55.201ms ; Min: 4.818ms ; Max: 144.877ms ; Number of samples: 58) - AverageHdfsReadThreadConcurrency: 0.27 - AverageScannerThreadConcurrency: 10.91 - BytesRead: 55.36 MB (58047533) - BytesReadDataNodeCache: 0 - BytesReadLocal: 55.36 MB (58047533) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 55.36 MB (58047533) - DecompressionTime: 354.121ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 58 (58) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 23.94 MB (25106239) - PerReadThreadRawHdfsThroughput: 27.01 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 117.193ms - RowBatchQueuePutWaitTime: 1m46s - RowsRead: 40.90M (40901760) - RowsReturned: 40.89M (40887031) - RowsReturnedRate: 53.12 M/sec - ScanRangesComplete: 1.17K (1172) - ScannerThreadsInvoluntaryContextSwitches: 2.06K (2065) - ScannerThreadsTotalWallClockTime: 2m - MaterializeTupleTime(*): 2s184ms - ScannerThreadsSysTime: 4s499ms - ScannerThreadsUserTime: 4s574ms - ScannerThreadsVoluntaryContextSwitches: 199.72K (199721) - TotalRawHdfsReadTime(*): 2s049ms - TotalReadThroughput: 5.03 MB/sec Filter 2 (16.00 MB): - Rows processed: 207.24K (207241) - Rows rejected: 14.73K (14729) - Rows total: 40.90M (40901760) Filter 7 (1.00 MB): - Files processed: 1.17K (1172) - Files rejected: 1.11K (1114) - Files total: 1.17K (1172) - RowGroups processed: 39.96K (39964) - RowGroups rejected: 0 (0) - RowGroups total: 39.96K (39964) - Rows processed: 950.27K (950272) - Rows rejected: 0 (0) - Rows total: 40.89M (40887031) - Splits processed: 58 (58) - Splits rejected: 0 (0) - Splits total: 58 (58) Instance 7f40dcb034de70b7:129 (host=vc1535.foo:22000):(Total: 11s191ms, non-child: 2s527ms, % non-child: 22.58%) Hdfs split stats (:<# splits>/): 5:149/9.18 GB 4:152/9.30 GB 6:165/10.29 GB 1:149/9.11 GB 3:155/10.04 GB 7:159/9.27 GB 0:132/8.06 GB 2:156/10.18 GB Filter 7 arrival: 495ms Filter 2 arrival: 9s539ms MemoryUsage(500.000ms): 1.33 MB, 3.38 MB, 3.98 MB, 25.67 MB, 26.29 MB, 27.44 MB, 29.06 MB, 28.82 MB, 29.14 MB, 28.74 MB, 29.05 MB, 25.03 MB, 26.89 MB, 27.35 MB, 27.06 MB, 27.17 MB, 27.62 MB, 24.84 MB, 27.12 MB, 42.01 MB, 43.16 MB, 43.46 MB, 27.86 MB ThreadUsage(500.000ms): 1, 1, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 11.96 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 43.82 MB (45945806) - PerHostPeakMemUsage: 1.41 GB (1513079259) - RowsProduced: 43.42M (43415646) - TotalNetworkReceiveTime: 264.712ms - TotalNetworkSendTime: 2s655ms - TotalStorageWaitTime: 5s500ms - TotalThreadsInvoluntaryContextSwitches: 2.49K (2487) - TotalThreadsTotalWallClockTime: 2m13s - TotalThreadsSysTime: 2s199ms - TotalThreadsUserTime: 11s157ms - TotalThreadsVoluntaryContextSwitches: 99.18K (99176) Fragment Instance Lifecycle Timings: - ExecTime: 10s017ms - ExecTreeExecTime: 1s104ms - OpenTime: 1s121ms - ExecTreeOpenTime: 939.922ms - PrepareTime: 52.845ms - ExecTreePrepareTime: 2.994ms DataStreamSender (dst_id=23):(Total: 6s425ms, non-child: 6s425ms, % non-child: 100.00%) - BytesSent: 411.64 MB (431634277) - NetworkThroughput(*): 102.94 MB/sec - OverallThroughput: 64.06 MB/sec - PeakMemoryUsage: 4.80 MB (5037120) - RowsReturned: 43.42M (43415646) - SerializeBatchTime: 2s417ms - TransmitDataRPCTime: 3s998ms - UncompressedRowBatchSize: 1.38 GB (1476683836) CodeGen:(Total: 204.336ms, non-child: 204.336ms, % non-child: 100.00%) - CodegenTime: 918.461us - CompileTime: 52.924ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 90 (90) - NumInstructions: 2.97K (2968) - OptimizationTime: 126.709ms - PeakMemoryUsage: 1.45 MB (1519616) - PrepareTime: 24.276ms HASH_JOIN_NODE (id=11):(Total: 2s033ms, non-child: 946.210ms, % non-child: 46.53%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.518ms - PeakMemoryUsage: 1.27 MB (1329005) - ProbeRows: 43.42M (43415646) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 880.669ms - RowsReturned: 43.42M (43415646) - RowsReturnedRate: 21.35 M/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 28.144us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 120.440us - HashBuckets: 212 (212) - HashCollisions: 0 (0) - HashTablesBuildTime: 56.684us - LargestPartitionPercent: 9 (9) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1073600) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 264.723ms, non-child: 20.940us, % non-child: 0.01%) BytesReceived(500.000ms): 0, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 5.276us - DeserializeRowBatchTimer: 14.837us - FirstBatchArrivalWaitTime: 247.375ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 453.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=9):(Total: 823.187ms, non-child: 823.187ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:149/9.18 GB 4:152/9.30 GB 6:165/10.29 GB 1:149/9.11 GB 3:155/10.04 GB 7:159/9.27 GB 0:132/8.06 GB 2:156/10.18 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 61 out of 61 Runtime filters: Only following filters arrived: 7, waited 523ms Hdfs Read Thread Concurrency Bucket: 0:86.36% 1:9.091% 2:4.545% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1156 PARQUET/SNAPPY:61 BytesRead(500.000ms): 0, 0, 0, 11.96 MB, 11.96 MB, 13.38 MB, 20.31 MB, 21.16 MB, 21.16 MB, 29.69 MB, 30.43 MB, 30.43 MB, 34.40 MB, 36.10 MB, 38.60 MB, 38.60 MB, 39.45 MB, 41.82 MB, 49.84 MB, 51.52 MB, 57.99 MB, 57.99 MB, 58.83 MB - FooterProcessingTime: (Avg: 53.505ms ; Min: 20.172ms ; Max: 152.343ms ; Number of samples: 61) - AverageHdfsReadThreadConcurrency: 0.18 - AverageScannerThreadConcurrency: 11.45 - BytesRead: 58.83 MB (61692244) - BytesReadDataNodeCache: 0 - BytesReadLocal: 58.83 MB (61692244) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 58.83 MB (61692244) - DecompressionTime: 386.306ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 61 (61) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 24.05 MB (25220608) - PerReadThreadRawHdfsThroughput: 25.68 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 148.521ms - RowBatchQueuePutWaitTime: 1m49s - RowsRead: 43.43M (43432042) - RowsReturned: 43.42M (43415646) - RowsReturnedRate: 52.74 M/sec - ScanRangesComplete: 1.22K (1217) - ScannerThreadsInvoluntaryContextSwitches: 1.52K (1525) - ScannerThreadsTotalWallClockTime: 2m2s - MaterializeTupleTime(*): 2s286ms - ScannerThreadsSysTime: 1s929ms - ScannerThreadsUserTime: 3s881ms - ScannerThreadsVoluntaryContextSwitches: 98.48K (98484) - TotalRawHdfsReadTime(*): 2s291ms - TotalReadThroughput: 5.12 MB/sec Filter 2 (16.00 MB): - Rows processed: 228.36K (228364) - Rows rejected: 16.40K (16396) - Rows total: 43.43M (43432042) Filter 7 (1.00 MB): - Files processed: 1.22K (1217) - Files rejected: 1.16K (1156) - Files total: 1.22K (1217) - RowGroups processed: 42.43K (42434) - RowGroups rejected: 0 (0) - RowGroups total: 42.43K (42434) - Rows processed: 999.42K (999424) - Rows rejected: 0 (0) - Rows total: 43.42M (43415646) - Splits processed: 61 (61) - Splits rejected: 0 (0) - Splits total: 61 (61) Instance 7f40dcb034de70b7:17b (host=vd1104.foo:22000):(Total: 11s178ms, non-child: 2s945ms, % non-child: 26.35%) Hdfs split stats (:<# splits>/): 0:144/9.54 GB 3:144/8.51 GB 1:148/9.80 GB 7:159/10.36 GB 4:138/9.23 GB 5:143/8.35 GB 2:161/10.05 GB 6:146/9.63 GB Filter 7 arrival: 285ms MemoryUsage(500.000ms): 3.38 MB, 3.38 MB, 24.79 MB, 24.87 MB, 25.88 MB, 25.32 MB, 27.71 MB, 28.31 MB, 28.40 MB, 26.81 MB, 27.82 MB, 27.96 MB, 27.96 MB, 28.23 MB, 28.35 MB, 26.85 MB, 24.97 MB, 27.35 MB, 29.07 MB, 28.95 MB, 23.45 MB, 23.69 MB ThreadUsage(500.000ms): 1, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.45 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 29.66 MB (31098316) - PerHostPeakMemUsage: 1.42 GB (1520461156) - RowsProduced: 40.97M (40966578) - TotalNetworkReceiveTime: 5.997us - TotalNetworkSendTime: 3s049ms - TotalStorageWaitTime: 6s024ms - TotalThreadsInvoluntaryContextSwitches: 2.17K (2168) - TotalThreadsTotalWallClockTime: 2m16s - TotalThreadsSysTime: 1s494ms - TotalThreadsUserTime: 11s531ms - TotalThreadsVoluntaryContextSwitches: 112.32K (112316) Fragment Instance Lifecycle Timings: - ExecTime: 10s000ms - ExecTreeExecTime: 1s078ms - OpenTime: 1s114ms - ExecTreeOpenTime: 888.565ms - PrepareTime: 63.407ms - ExecTreePrepareTime: 3.966ms DataStreamSender (dst_id=23):(Total: 6s026ms, non-child: 6s026ms, % non-child: 100.00%) - BytesSent: 388.65 MB (407531707) - NetworkThroughput(*): 104.02 MB/sec - OverallThroughput: 64.49 MB/sec - PeakMemoryUsage: 4.73 MB (4955200) - RowsReturned: 40.97M (40966578) - SerializeBatchTime: 2s281ms - TransmitDataRPCTime: 3s736ms - UncompressedRowBatchSize: 1.30 GB (1393384380) CodeGen:(Total: 246.721ms, non-child: 246.721ms, % non-child: 100.00%) - CodegenTime: 1.484ms - CompileTime: 75.689ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 90 (90) - NumInstructions: 2.97K (2968) - OptimizationTime: 148.478ms - PeakMemoryUsage: 1.45 MB (1519616) - PrepareTime: 21.891ms HASH_JOIN_NODE (id=11):(Total: 1s959ms, non-child: 913.781ms, % non-child: 46.62%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.947ms - PeakMemoryUsage: 1.20 MB (1255232) - ProbeRows: 40.97M (40966578) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 860.941ms - RowsReturned: 40.97M (40966578) - RowsReturnedRate: 20.90 M/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 22.111us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 205.761us - HashBuckets: 212 (212) - HashCollisions: 0 (0) - HashTablesBuildTime: 59.178us - LargestPartitionPercent: 9 (9) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1073600) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 15.017us, non-child: 15.017us, % non-child: 100.00%) BytesReceived(500.000ms): 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 4.387us - DeserializeRowBatchTimer: 11.026us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 7.99 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=9):(Total: 1s046ms, non-child: 1s046ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:144/9.54 GB 3:144/8.51 GB 1:148/9.80 GB 7:159/10.36 GB 4:138/9.23 GB 5:143/8.35 GB 2:161/10.05 GB 6:146/9.63 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 56 out of 56 Runtime filters: Only following filters arrived: 7, waited 724ms Hdfs Read Thread Concurrency Bucket: 0:81.82% 1:13.64% 2:4.545% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1127 PARQUET/SNAPPY:56 BytesRead(500.000ms): 0, 0, 11.20 MB, 11.20 MB, 13.20 MB, 14.04 MB, 21.87 MB, 21.87 MB, 21.87 MB, 27.69 MB, 30.61 MB, 30.61 MB, 30.61 MB, 30.61 MB, 30.61 MB, 38.76 MB, 38.76 MB, 40.18 MB, 50.90 MB, 50.90 MB, 52.80 MB, 55.14 MB - FooterProcessingTime: (Avg: 69.760ms ; Min: 4.060ms ; Max: 204.586ms ; Number of samples: 56) - AverageHdfsReadThreadConcurrency: 0.23 - AverageScannerThreadConcurrency: 11.45 - BytesRead: 55.14 MB (57813753) - BytesReadDataNodeCache: 0 - BytesReadLocal: 55.14 MB (57813753) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 55.14 MB (57813753) - DecompressionTime: 351.004ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 56 (56) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 23.85 MB (25013305) - PerReadThreadRawHdfsThroughput: 25.75 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 160.718ms - RowBatchQueuePutWaitTime: 1m49s - RowsRead: 40.97M (40966578) - RowsReturned: 40.97M (40966578) - RowsReturnedRate: 39.16 M/sec - ScanRangesComplete: 1.18K (1183) - ScannerThreadsInvoluntaryContextSwitches: 1.26K (1257) - ScannerThreadsTotalWallClockTime: 2m5s - MaterializeTupleTime(*): 2s173ms - ScannerThreadsSysTime: 1s237ms - ScannerThreadsUserTime: 4s608ms - ScannerThreadsVoluntaryContextSwitches: 111.67K (111665) - TotalRawHdfsReadTime(*): 2s141ms - TotalReadThroughput: 5.01 MB/sec Filter 2 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 40.97M (40966578) Filter 7 (1.00 MB): - Files processed: 1.18K (1183) - Files rejected: 1.13K (1127) - Files total: 1.18K (1183) - RowGroups processed: 40.05K (40052) - RowGroups rejected: 0 (0) - RowGroups total: 40.05K (40052) - Rows processed: 917.50K (917504) - Rows rejected: 0 (0) - Rows total: 40.97M (40966578) - Splits processed: 56 (56) - Splits rejected: 0 (0) - Splits total: 56 (56) Instance 7f40dcb034de70b7:15a (host=ve1126.foo:22000):(Total: 11s176ms, non-child: 1s688ms, % non-child: 15.11%) Hdfs split stats (:<# splits>/): 1:137/8.67 GB 2:165/10.13 GB 0:171/11.28 GB 7:151/8.81 GB 5:137/9.26 GB 3:153/9.83 GB 4:146/9.41 GB 6:136/8.11 GB Filter 7 arrival: 320ms Filter 2 arrival: 11s077ms MemoryUsage(500.000ms): 3.38 MB, 3.38 MB, 24.67 MB, 24.78 MB, 25.24 MB, 22.85 MB, 26.82 MB, 27.06 MB, 26.79 MB, 28.13 MB, 27.80 MB, 28.28 MB, 28.28 MB, 27.64 MB, 28.99 MB, 28.94 MB, 30.25 MB, 30.15 MB, 29.24 MB, 28.99 MB, 24.99 MB, 16.39 MB ThreadUsage(500.000ms): 1, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.45 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 31.46 MB (32983786) - PerHostPeakMemUsage: 1.39 GB (1492811477) - RowsProduced: 45.75M (45747480) - TotalNetworkReceiveTime: 79.179ms - TotalNetworkSendTime: 2s351ms - TotalStorageWaitTime: 7s525ms - TotalThreadsInvoluntaryContextSwitches: 3.28K (3280) - TotalThreadsTotalWallClockTime: 2m15s - TotalThreadsSysTime: 2s746ms - TotalThreadsUserTime: 12s235ms - TotalThreadsVoluntaryContextSwitches: 172.33K (172334) Fragment Instance Lifecycle Timings: - ExecTime: 9s917ms - ExecTreeExecTime: 1s297ms - OpenTime: 1s199ms - ExecTreeOpenTime: 1s012ms - PrepareTime: 59.075ms - ExecTreePrepareTime: 3.519ms DataStreamSender (dst_id=23):(Total: 6s975ms, non-child: 6s975ms, % non-child: 100.00%) - BytesSent: 433.99 MB (455072568) - NetworkThroughput(*): 96.64 MB/sec - OverallThroughput: 62.22 MB/sec - PeakMemoryUsage: 4.79 MB (5020736) - RowsReturned: 45.75M (45747480) - SerializeBatchTime: 2s476ms - TransmitDataRPCTime: 4s490ms - UncompressedRowBatchSize: 1.45 GB (1555995776) CodeGen:(Total: 211.667ms, non-child: 211.667ms, % non-child: 100.00%) - CodegenTime: 1.143ms - CompileTime: 53.428ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 90 (90) - NumInstructions: 2.97K (2968) - OptimizationTime: 132.269ms - PeakMemoryUsage: 1.45 MB (1519616) - PrepareTime: 25.517ms HASH_JOIN_NODE (id=11):(Total: 2s300ms, non-child: 1s133ms, % non-child: 49.26%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.511ms - PeakMemoryUsage: 1.20 MB (1255232) - ProbeRows: 45.75M (45747480) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1s069ms - RowsReturned: 45.75M (45747480) - RowsReturnedRate: 19.88 M/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 28.259us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 127.433us - HashBuckets: 212 (212) - HashCollisions: 0 (0) - HashTablesBuildTime: 56.980us - LargestPartitionPercent: 9 (9) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1073600) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 79.189ms, non-child: 20.290us, % non-child: 0.03%) BytesReceived(500.000ms): 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 4.350us - DeserializeRowBatchTimer: 21.533us - FirstBatchArrivalWaitTime: 51.434ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 1.51 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=9):(Total: 1s088ms, non-child: 1s088ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:137/8.67 GB 2:165/10.13 GB 0:171/11.28 GB 7:151/8.81 GB 5:137/9.26 GB 3:153/9.83 GB 4:146/9.41 GB 6:136/8.11 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 61 out of 61 Runtime filters: Only following filters arrived: 7, waited 683ms Hdfs Read Thread Concurrency Bucket: 0:77.27% 1:18.18% 2:4.545% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1135 PARQUET/SNAPPY:61 BytesRead(500.000ms): 0, 0, 9.91 MB, 11.81 MB, 12.65 MB, 17.09 MB, 21.30 MB, 22.15 MB, 28.12 MB, 30.27 MB, 31.09 MB, 37.67 MB, 37.67 MB, 40.22 MB, 41.16 MB, 43.88 MB, 50.33 MB, 51.19 MB, 53.43 MB, 57.58 MB, 59.27 MB, 60.94 MB - FooterProcessingTime: (Avg: 61.460ms ; Min: 10.543ms ; Max: 290.663ms ; Number of samples: 61) - AverageHdfsReadThreadConcurrency: 0.27 - AverageScannerThreadConcurrency: 11.45 - BytesRead: 60.94 MB (63903253) - BytesReadDataNodeCache: 0 - BytesReadLocal: 60.94 MB (63903253) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 60.94 MB (63903253) - DecompressionTime: 423.389ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 61 (61) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 25.80 MB (27054275) - PerReadThreadRawHdfsThroughput: 25.35 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 246.048ms - RowBatchQueuePutWaitTime: 1m46s - RowsRead: 45.75M (45747480) - RowsReturned: 45.75M (45747480) - RowsReturnedRate: 42.02 M/sec - ScanRangesComplete: 1.20K (1196) - ScannerThreadsInvoluntaryContextSwitches: 2.41K (2410) - ScannerThreadsTotalWallClockTime: 2m3s - MaterializeTupleTime(*): 2s328ms - ScannerThreadsSysTime: 2s392ms - ScannerThreadsUserTime: 4s818ms - ScannerThreadsVoluntaryContextSwitches: 171.65K (171647) - TotalRawHdfsReadTime(*): 2s404ms - TotalReadThroughput: 5.54 MB/sec Filter 2 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 45.75M (45747480) Filter 7 (1.00 MB): - Files processed: 1.20K (1196) - Files rejected: 1.14K (1135) - Files total: 1.20K (1196) - RowGroups processed: 44.72K (44724) - RowGroups rejected: 0 (0) - RowGroups total: 44.72K (44724) - Rows processed: 999.42K (999424) - Rows rejected: 0 (0) - Rows total: 45.75M (45747480) - Splits processed: 61 (61) - Splits rejected: 0 (0) - Splits total: 61 (61) Instance 7f40dcb034de70b7:124 (host=vd1331.foo:22000):(Total: 11s162ms, non-child: 1s804ms, % non-child: 16.17%) Hdfs split stats (:<# splits>/): 3:153/9.85 GB 6:152/10.04 GB 2:158/9.90 GB 0:144/9.23 GB 4:155/9.70 GB 7:137/8.74 GB 5:151/9.39 GB 1:143/8.65 GB Filter 7 arrival: 516ms Filter 2 arrival: 9s438ms MemoryUsage(500.000ms): 1.38 MB, 3.38 MB, 23.67 MB, 23.96 MB, 24.29 MB, 27.87 MB, 27.74 MB, 28.39 MB, 32.16 MB, 32.29 MB, 28.82 MB, 29.26 MB, 29.26 MB, 29.25 MB, 26.34 MB, 25.88 MB, 26.98 MB, 22.47 MB, 45.30 MB, 44.99 MB, 36.88 MB, 31.26 MB ThreadUsage(500.000ms): 2, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.50 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 45.80 MB (48023731) - PerHostPeakMemUsage: 1.41 GB (1513723351) - RowsProduced: 46.67M (46673954) - TotalNetworkReceiveTime: 300.456ms - TotalNetworkSendTime: 2s125ms - TotalStorageWaitTime: 5s705ms - TotalThreadsInvoluntaryContextSwitches: 2.32K (2323) - TotalThreadsTotalWallClockTime: 2m13s - TotalThreadsSysTime: 3s329ms - TotalThreadsUserTime: 12s287ms - TotalThreadsVoluntaryContextSwitches: 159.61K (159614) Fragment Instance Lifecycle Timings: - ExecTime: 10s034ms - ExecTreeExecTime: 1s190ms - OpenTime: 1s079ms - ExecTreeOpenTime: 909.466ms - PrepareTime: 48.569ms - ExecTreePrepareTime: 3.076ms DataStreamSender (dst_id=23):(Total: 7s078ms, non-child: 7s078ms, % non-child: 100.00%) - BytesSent: 442.65 MB (464148918) - NetworkThroughput(*): 99.65 MB/sec - OverallThroughput: 62.54 MB/sec - PeakMemoryUsage: 4.72 MB (4947008) - RowsReturned: 46.67M (46673954) - SerializeBatchTime: 2s627ms - TransmitDataRPCTime: 4s441ms - UncompressedRowBatchSize: 1.48 GB (1587507612) CodeGen:(Total: 189.592ms, non-child: 189.592ms, % non-child: 100.00%) - CodegenTime: 889.302us - CompileTime: 51.710ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 90 (90) - NumInstructions: 2.97K (2968) - OptimizationTime: 116.992ms - PeakMemoryUsage: 1.45 MB (1519616) - PrepareTime: 20.505ms HASH_JOIN_NODE (id=11):(Total: 2s089ms, non-child: 1s021ms, % non-child: 48.90%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.693ms - PeakMemoryUsage: 1.26 MB (1325216) - ProbeRows: 46.67M (46673954) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 966.803ms - RowsReturned: 46.67M (46673954) - RowsReturnedRate: 22.33 M/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 28.271us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 141.531us - HashBuckets: 212 (212) - HashCollisions: 0 (0) - HashTablesBuildTime: 68.044us - LargestPartitionPercent: 9 (9) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1073600) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 300.467ms, non-child: 21.373us, % non-child: 0.01%) BytesReceived(500.000ms): 0, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 5.991us - DeserializeRowBatchTimer: 10.053us - FirstBatchArrivalWaitTime: 291.424ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 399.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=9):(Total: 767.771ms, non-child: 767.771ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:153/9.85 GB 6:152/10.04 GB 2:158/9.90 GB 0:144/9.23 GB 4:155/9.70 GB 7:137/8.74 GB 5:151/9.39 GB 1:143/8.65 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 62 out of 62 Runtime filters: Only following filters arrived: 7, waited 502ms Hdfs Read Thread Concurrency Bucket: 0:90.91% 1:9.091% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1131 PARQUET/SNAPPY:62 BytesRead(500.000ms): 0, 0, 10.62 MB, 10.62 MB, 11.46 MB, 22.19 MB, 22.19 MB, 23.02 MB, 31.62 MB, 32.47 MB, 38.04 MB, 38.04 MB, 38.04 MB, 38.87 MB, 41.43 MB, 48.46 MB, 48.56 MB, 55.19 MB, 59.70 MB, 59.80 MB, 62.17 MB, 62.17 MB - FooterProcessingTime: (Avg: 54.534ms ; Min: 3.583ms ; Max: 153.175ms ; Number of samples: 62) - AverageHdfsReadThreadConcurrency: 0.09 - AverageScannerThreadConcurrency: 11.45 - BytesRead: 62.17 MB (65194677) - BytesReadDataNodeCache: 0 - BytesReadLocal: 62.17 MB (65194677) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 62.17 MB (65194677) - DecompressionTime: 404.449ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 62 (62) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 26.85 MB (28159380) - PerReadThreadRawHdfsThroughput: 26.78 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 103.629ms - RowBatchQueuePutWaitTime: 1m47s - RowsRead: 46.69M (46687974) - RowsReturned: 46.67M (46673954) - RowsReturnedRate: 60.79 M/sec - ScanRangesComplete: 1.19K (1193) - ScannerThreadsInvoluntaryContextSwitches: 1.43K (1434) - ScannerThreadsTotalWallClockTime: 2m1s - MaterializeTupleTime(*): 2s295ms - ScannerThreadsSysTime: 3s012ms - ScannerThreadsUserTime: 4s505ms - ScannerThreadsVoluntaryContextSwitches: 159.00K (159001) - TotalRawHdfsReadTime(*): 2s321ms - TotalReadThroughput: 5.65 MB/sec Filter 2 (16.00 MB): - Rows processed: 195.27K (195268) - Rows rejected: 14.02K (14020) - Rows total: 46.69M (46687974) Filter 7 (1.00 MB): - Files processed: 1.19K (1193) - Files rejected: 1.13K (1131) - Files total: 1.19K (1193) - RowGroups processed: 45.62K (45623) - RowGroups rejected: 0 (0) - RowGroups total: 45.62K (45623) - Rows processed: 1.02M (1015808) - Rows rejected: 0 (0) - Rows total: 46.67M (46673954) - Splits processed: 62 (62) - Splits rejected: 0 (0) - Splits total: 62 (62) Instance 7f40dcb034de70b7:11c (host=vc1519.foo:22000):(Total: 11s157ms, non-child: 2s428ms, % non-child: 21.77%) Hdfs split stats (:<# splits>/): 5:163/10.27 GB 0:154/10.07 GB 2:150/9.39 GB 4:141/9.01 GB 7:139/9.08 GB 1:132/7.94 GB 3:156/9.80 GB 6:153/9.95 GB Filter 7 arrival: 532ms Filter 2 arrival: 9s294ms MemoryUsage(500.000ms): 1.38 MB, 3.38 MB, 25.57 MB, 25.90 MB, 26.04 MB, 26.41 MB, 27.82 MB, 27.74 MB, 24.93 MB, 27.99 MB, 27.14 MB, 27.21 MB, 27.26 MB, 27.28 MB, 28.89 MB, 28.09 MB, 27.38 MB, 27.98 MB, 44.41 MB, 40.90 MB, 42.26 MB, 34.17 MB ThreadUsage(500.000ms): 2, 1, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 11.95 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 44.84 MB (47022781) - PerHostPeakMemUsage: 1.41 GB (1514145830) - RowsProduced: 42.56M (42562712) - TotalNetworkReceiveTime: 300.886ms - TotalNetworkSendTime: 2s818ms - TotalStorageWaitTime: 5s636ms - TotalThreadsInvoluntaryContextSwitches: 2.54K (2540) - TotalThreadsTotalWallClockTime: 2m12s - TotalThreadsSysTime: 2s048ms - TotalThreadsUserTime: 11s170ms - TotalThreadsVoluntaryContextSwitches: 97.06K (97060) Fragment Instance Lifecycle Timings: - ExecTime: 9s982ms - ExecTreeExecTime: 1s166ms - OpenTime: 1s120ms - ExecTreeOpenTime: 939.901ms - PrepareTime: 54.763ms - ExecTreePrepareTime: 3.160ms DataStreamSender (dst_id=23):(Total: 6s430ms, non-child: 6s430ms, % non-child: 100.00%) - BytesSent: 403.42 MB (423017483) - NetworkThroughput(*): 99.23 MB/sec - OverallThroughput: 62.73 MB/sec - PeakMemoryUsage: 4.72 MB (4947008) - RowsReturned: 42.56M (42562712) - SerializeBatchTime: 2s357ms - TransmitDataRPCTime: 4s065ms - UncompressedRowBatchSize: 1.35 GB (1447673216) CodeGen:(Total: 201.202ms, non-child: 201.202ms, % non-child: 100.00%) - CodegenTime: 1.068ms - CompileTime: 51.813ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 90 (90) - NumInstructions: 2.97K (2968) - OptimizationTime: 126.946ms - PeakMemoryUsage: 1.45 MB (1519616) - PrepareTime: 22.004ms HASH_JOIN_NODE (id=11):(Total: 2s097ms, non-child: 1s022ms, % non-child: 48.74%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.470ms - PeakMemoryUsage: 1.27 MB (1330397) - ProbeRows: 42.56M (42562712) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 968.079ms - RowsReturned: 42.56M (42562712) - RowsReturnedRate: 20.29 M/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 26.381us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 132.187us - HashBuckets: 212 (212) - HashCollisions: 0 (0) - HashTablesBuildTime: 55.775us - LargestPartitionPercent: 9 (9) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1073600) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 300.895ms, non-child: 18.790us, % non-child: 0.01%) BytesReceived(500.000ms): 0, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 4.628us - DeserializeRowBatchTimer: 16.859us - FirstBatchArrivalWaitTime: 284.846ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 398.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=9):(Total: 774.394ms, non-child: 774.394ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:163/10.27 GB 0:154/10.07 GB 2:150/9.39 GB 4:141/9.01 GB 7:139/9.08 GB 1:132/7.94 GB 3:156/9.80 GB 6:153/9.95 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 59 out of 59 Runtime filters: Only following filters arrived: 7, waited 482ms Hdfs Read Thread Concurrency Bucket: 0:90.91% 1:4.545% 2:4.545% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1129 PARQUET/SNAPPY:59 BytesRead(500.000ms): 0, 0, 11.82 MB, 11.82 MB, 11.82 MB, 12.64 MB, 20.39 MB, 20.39 MB, 21.34 MB, 29.68 MB, 29.68 MB, 31.33 MB, 31.33 MB, 32.19 MB, 38.97 MB, 39.81 MB, 41.50 MB, 47.62 MB, 49.32 MB, 53.61 MB, 57.45 MB, 57.45 MB - FooterProcessingTime: (Avg: 57.927ms ; Min: 19.756ms ; Max: 156.816ms ; Number of samples: 59) - AverageHdfsReadThreadConcurrency: 0.14 - AverageScannerThreadConcurrency: 10.91 - BytesRead: 57.45 MB (60243667) - BytesReadDataNodeCache: 0 - BytesReadLocal: 57.45 MB (60243667) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 57.45 MB (60243667) - DecompressionTime: 380.518ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 59 (59) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 23.86 MB (25023291) - PerReadThreadRawHdfsThroughput: 26.27 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 153.187ms - RowBatchQueuePutWaitTime: 1m49s - RowsRead: 42.58M (42580567) - RowsReturned: 42.56M (42562712) - RowsReturnedRate: 54.96 M/sec - ScanRangesComplete: 1.19K (1188) - ScannerThreadsInvoluntaryContextSwitches: 1.71K (1711) - ScannerThreadsTotalWallClockTime: 2m1s - MaterializeTupleTime(*): 2s212ms - ScannerThreadsSysTime: 1s736ms - ScannerThreadsUserTime: 4s125ms - ScannerThreadsVoluntaryContextSwitches: 96.44K (96444) - TotalRawHdfsReadTime(*): 2s187ms - TotalReadThroughput: 5.22 MB/sec Filter 2 (16.00 MB): - Rows processed: 247.23K (247231) - Rows rejected: 17.86K (17855) - Rows total: 42.58M (42580567) Filter 7 (1.00 MB): - Files processed: 1.19K (1188) - Files rejected: 1.13K (1129) - Files total: 1.19K (1188) - RowGroups processed: 41.60K (41597) - RowGroups rejected: 0 (0) - RowGroups total: 41.60K (41597) - Rows processed: 966.66K (966656) - Rows rejected: 0 (0) - Rows total: 42.56M (42562712) - Splits processed: 59 (59) - Splits rejected: 0 (0) - Splits total: 59 (59) Instance 7f40dcb034de70b7:125 (host=ve1128.foo:22000):(Total: 11s156ms, non-child: 3s101ms, % non-child: 27.80%) Hdfs split stats (:<# splits>/): 4:155/9.96 GB 3:131/8.15 GB 6:141/8.55 GB 5:165/11.53 GB 2:136/8.53 GB 7:161/10.53 GB 1:149/9.17 GB 0:142/9.08 GB Filter 7 arrival: 520ms Filter 2 arrival: 9s422ms MemoryUsage(500.000ms): 1.38 MB, 3.38 MB, 23.52 MB, 24.14 MB, 23.96 MB, 24.58 MB, 25.81 MB, 26.10 MB, 26.62 MB, 26.68 MB, 29.01 MB, 28.14 MB, 29.40 MB, 29.35 MB, 29.54 MB, 30.09 MB, 29.37 MB, 26.00 MB, 28.02 MB, 44.41 MB, 39.77 MB, 38.54 MB ThreadUsage(500.000ms): 2, 1, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 11.95 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 44.76 MB (46934705) - PerHostPeakMemUsage: 1.39 GB (1495808784) - RowsProduced: 40.57M (40569890) - TotalNetworkReceiveTime: 293.078ms - TotalNetworkSendTime: 2s978ms - TotalStorageWaitTime: 4s809ms - TotalThreadsInvoluntaryContextSwitches: 2.31K (2312) - TotalThreadsTotalWallClockTime: 2m13s - TotalThreadsSysTime: 1s312ms - TotalThreadsUserTime: 11s455ms - TotalThreadsVoluntaryContextSwitches: 113.30K (113304) Fragment Instance Lifecycle Timings: - ExecTime: 10s048ms - ExecTreeExecTime: 1s054ms - OpenTime: 1s055ms - ExecTreeOpenTime: 877.971ms - PrepareTime: 52.845ms - ExecTreePrepareTime: 3.313ms DataStreamSender (dst_id=23):(Total: 5s932ms, non-child: 5s932ms, % non-child: 100.00%) - BytesSent: 384.70 MB (403383857) - NetworkThroughput(*): 106.34 MB/sec - OverallThroughput: 64.85 MB/sec - PeakMemoryUsage: 4.75 MB (4979776) - RowsReturned: 40.57M (40569890) - SerializeBatchTime: 2s306ms - TransmitDataRPCTime: 3s617ms - UncompressedRowBatchSize: 1.29 GB (1379891924) CodeGen:(Total: 198.133ms, non-child: 198.133ms, % non-child: 100.00%) - CodegenTime: 1.053ms - CompileTime: 50.615ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 90 (90) - NumInstructions: 2.97K (2968) - OptimizationTime: 125.315ms - PeakMemoryUsage: 1.45 MB (1519616) - PrepareTime: 21.754ms HASH_JOIN_NODE (id=11):(Total: 1s924ms, non-child: 905.917ms, % non-child: 47.07%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.699ms - PeakMemoryUsage: 1.27 MB (1333909) - ProbeRows: 40.57M (40569890) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 844.982ms - RowsReturned: 40.57M (40569890) - RowsReturnedRate: 21.08 M/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 26.160us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 154.162us - HashBuckets: 212 (212) - HashCollisions: 0 (0) - HashTablesBuildTime: 69.671us - LargestPartitionPercent: 9 (9) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1073600) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 293.089ms, non-child: 21.341us, % non-child: 0.01%) BytesReceived(500.000ms): 0, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 4.945us - DeserializeRowBatchTimer: 12.145us - FirstBatchArrivalWaitTime: 266.577ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 409.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=9):(Total: 725.948ms, non-child: 725.948ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:155/9.96 GB 3:131/8.15 GB 6:141/8.55 GB 5:165/11.53 GB 2:136/8.53 GB 7:161/10.53 GB 1:149/9.17 GB 0:142/9.08 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 57 out of 57 Runtime filters: Only following filters arrived: 7, waited 482ms Hdfs Read Thread Concurrency Bucket: 0:95.45% 1:4.545% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1123 PARQUET/SNAPPY:57 BytesRead(500.000ms): 0, 0, 10.65 MB, 10.65 MB, 10.65 MB, 11.49 MB, 20.98 MB, 20.98 MB, 23.22 MB, 24.90 MB, 31.30 MB, 31.30 MB, 32.14 MB, 32.14 MB, 33.80 MB, 40.29 MB, 41.98 MB, 44.47 MB, 48.96 MB, 50.64 MB, 54.79 MB, 54.79 MB - FooterProcessingTime: (Avg: 51.830ms ; Min: 3.819ms ; Max: 154.433ms ; Number of samples: 57) - AverageHdfsReadThreadConcurrency: 0.05 - AverageScannerThreadConcurrency: 10.91 - BytesRead: 54.79 MB (57453753) - BytesReadDataNodeCache: 0 - BytesReadLocal: 54.79 MB (57453753) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 54.79 MB (57453753) - DecompressionTime: 330.816ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 57 (57) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 24.71 MB (25912111) - PerReadThreadRawHdfsThroughput: 27.79 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 98.536ms - RowBatchQueuePutWaitTime: 1m50s - RowsRead: 40.59M (40586803) - RowsReturned: 40.57M (40569890) - RowsReturnedRate: 55.89 M/sec - ScanRangesComplete: 1.18K (1180) - ScannerThreadsInvoluntaryContextSwitches: 1.41K (1414) - ScannerThreadsTotalWallClockTime: 2m1s - MaterializeTupleTime(*): 2s041ms - ScannerThreadsSysTime: 1s050ms - ScannerThreadsUserTime: 4s463ms - ScannerThreadsVoluntaryContextSwitches: 112.72K (112718) - TotalRawHdfsReadTime(*): 1s971ms - TotalReadThroughput: 4.98 MB/sec Filter 2 (16.00 MB): - Rows processed: 234.00K (234001) - Rows rejected: 16.91K (16913) - Rows total: 40.59M (40586803) Filter 7 (1.00 MB): - Files processed: 1.18K (1180) - Files rejected: 1.12K (1123) - Files total: 1.18K (1180) - RowGroups processed: 39.65K (39654) - RowGroups rejected: 0 (0) - RowGroups total: 39.65K (39654) - Rows processed: 933.89K (933888) - Rows rejected: 0 (0) - Rows total: 40.57M (40569890) - Splits processed: 57 (57) - Splits rejected: 0 (0) - Splits total: 57 (57) Instance 7f40dcb034de70b7:115 (host=vc1503.foo:22000):(Total: 11s134ms, non-child: 2s647ms, % non-child: 23.78%) Hdfs split stats (:<# splits>/): 2:146/8.67 GB 0:161/9.99 GB 3:144/9.71 GB 6:135/8.38 GB 5:146/9.62 GB 7:155/10.28 GB 1:153/9.54 GB 4:149/9.30 GB Filter 7 arrival: 581ms Filter 2 arrival: 9s197ms MemoryUsage(500.000ms): 1.38 MB, 3.38 MB, 25.26 MB, 25.72 MB, 26.01 MB, 25.20 MB, 28.08 MB, 26.97 MB, 27.37 MB, 27.54 MB, 28.02 MB, 29.10 MB, 29.54 MB, 29.95 MB, 28.51 MB, 29.12 MB, 28.17 MB, 28.29 MB, 43.41 MB, 39.07 MB, 41.41 MB, 33.77 MB ThreadUsage(500.000ms): 2, 1, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 11.95 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 44.47 MB (46631368) - PerHostPeakMemUsage: 1.40 GB (1507292125) - RowsProduced: 42.19M (42194833) - TotalNetworkReceiveTime: 355.831ms - TotalNetworkSendTime: 2s695ms - TotalStorageWaitTime: 6s125ms - TotalThreadsInvoluntaryContextSwitches: 2.13K (2131) - TotalThreadsTotalWallClockTime: 2m12s - TotalThreadsSysTime: 1s828ms - TotalThreadsUserTime: 11s046ms - TotalThreadsVoluntaryContextSwitches: 88.50K (88497) Fragment Instance Lifecycle Timings: - ExecTime: 10s009ms - ExecTreeExecTime: 1s138ms - OpenTime: 1s071ms - ExecTreeOpenTime: 895.419ms - PrepareTime: 53.514ms - ExecTreePrepareTime: 3.413ms DataStreamSender (dst_id=23):(Total: 6s263ms, non-child: 6s263ms, % non-child: 100.00%) - BytesSent: 400.30 MB (419741244) - NetworkThroughput(*): 103.28 MB/sec - OverallThroughput: 63.91 MB/sec - PeakMemoryUsage: 4.80 MB (5037120) - RowsReturned: 42.19M (42194833) - SerializeBatchTime: 2s379ms - TransmitDataRPCTime: 3s875ms - UncompressedRowBatchSize: 1.34 GB (1435160634) CodeGen:(Total: 197.011ms, non-child: 197.011ms, % non-child: 100.00%) - CodegenTime: 1.069ms - CompileTime: 51.109ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 90 (90) - NumInstructions: 2.97K (2968) - OptimizationTime: 123.136ms - PeakMemoryUsage: 1.45 MB (1519616) - PrepareTime: 22.322ms HASH_JOIN_NODE (id=11):(Total: 2s025ms, non-child: 978.221ms, % non-child: 48.29%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.541ms - PeakMemoryUsage: 1.27 MB (1330409) - ProbeRows: 42.19M (42194833) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 911.503ms - RowsReturned: 42.19M (42194833) - RowsReturnedRate: 20.83 M/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 25.719us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 152.606us - HashBuckets: 212 (212) - HashCollisions: 0 (0) - HashTablesBuildTime: 56.251us - LargestPartitionPercent: 9 (9) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1073600) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 355.841ms, non-child: 19.052us, % non-child: 0.01%) BytesReceived(500.000ms): 0, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 4.327us - DeserializeRowBatchTimer: 21.383us - FirstBatchArrivalWaitTime: 332.617ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 337.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=9):(Total: 692.198ms, non-child: 692.198ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:146/8.67 GB 0:161/9.99 GB 3:144/9.71 GB 6:135/8.38 GB 5:146/9.62 GB 7:155/10.28 GB 1:153/9.54 GB 4:149/9.30 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 60 out of 60 Runtime filters: Only following filters arrived: 7, waited 422ms Hdfs Read Thread Concurrency Bucket: 0:77.27% 1:18.18% 2:4.545% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1129 PARQUET/SNAPPY:60 BytesRead(500.000ms): 0, 0, 12.40 MB, 12.40 MB, 12.40 MB, 13.25 MB, 21.07 MB, 21.07 MB, 23.59 MB, 27.75 MB, 29.81 MB, 31.25 MB, 31.25 MB, 33.58 MB, 40.05 MB, 40.90 MB, 41.84 MB, 47.23 MB, 48.92 MB, 53.69 MB, 57.05 MB, 57.05 MB - FooterProcessingTime: (Avg: 62.736ms ; Min: 23.810ms ; Max: 182.850ms ; Number of samples: 60) - AverageHdfsReadThreadConcurrency: 0.27 - AverageScannerThreadConcurrency: 10.91 - BytesRead: 57.05 MB (59825499) - BytesReadDataNodeCache: 0 - BytesReadLocal: 57.05 MB (59825499) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 57.05 MB (59825499) - DecompressionTime: 345.496ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 60 (60) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 24.43 MB (25617799) - PerReadThreadRawHdfsThroughput: 24.75 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 114.757ms - RowBatchQueuePutWaitTime: 1m49s - RowsRead: 42.22M (42215382) - RowsReturned: 42.19M (42194833) - RowsReturnedRate: 60.96 M/sec - ScanRangesComplete: 1.19K (1189) - ScannerThreadsInvoluntaryContextSwitches: 1.25K (1254) - ScannerThreadsTotalWallClockTime: 2m - MaterializeTupleTime(*): 2s109ms - ScannerThreadsSysTime: 1s556ms - ScannerThreadsUserTime: 3s823ms - ScannerThreadsVoluntaryContextSwitches: 87.87K (87872) - TotalRawHdfsReadTime(*): 2s305ms - TotalReadThroughput: 5.19 MB/sec Filter 2 (16.00 MB): - Rows processed: 282.69K (282693) - Rows rejected: 20.55K (20549) - Rows total: 42.22M (42215382) Filter 7 (1.00 MB): - Files processed: 1.19K (1189) - Files rejected: 1.13K (1129) - Files total: 1.19K (1189) - RowGroups processed: 41.24K (41241) - RowGroups rejected: 0 (0) - RowGroups total: 41.24K (41241) - Rows processed: 983.04K (983040) - Rows rejected: 0 (0) - Rows total: 42.19M (42194833) - Splits processed: 60 (60) - Splits rejected: 0 (0) - Splits total: 60 (60) Instance 7f40dcb034de70b7:113 (host=vc1502.foo:22000):(Total: 11s133ms, non-child: 2s915ms, % non-child: 26.19%) Hdfs split stats (:<# splits>/): 7:143/9.40 GB 4:140/9.17 GB 6:144/9.70 GB 2:139/8.14 GB 0:160/10.12 GB 5:160/10.11 GB 1:157/10.21 GB 3:146/8.62 GB Filter 7 arrival: 572ms Filter 2 arrival: 9s198ms MemoryUsage(500.000ms): 1.35 MB, 3.38 MB, 20.12 MB, 25.14 MB, 25.04 MB, 25.04 MB, 25.04 MB, 26.29 MB, 28.94 MB, 29.06 MB, 29.28 MB, 27.78 MB, 27.94 MB, 27.94 MB, 27.08 MB, 18.18 MB, 26.10 MB, 27.26 MB, 38.90 MB, 45.41 MB, 45.60 MB, 35.93 MB ThreadUsage(500.000ms): 1, 1, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 11.91 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 45.80 MB (48027862) - PerHostPeakMemUsage: 1.41 GB (1509778584) - RowsProduced: 39.79M (39792978) - TotalNetworkReceiveTime: 349.683ms - TotalNetworkSendTime: 3s306ms - TotalStorageWaitTime: 5s970ms - TotalThreadsInvoluntaryContextSwitches: 2.77K (2766) - TotalThreadsTotalWallClockTime: 2m11s - TotalThreadsSysTime: 3s450ms - TotalThreadsUserTime: 11s114ms - TotalThreadsVoluntaryContextSwitches: 227.63K (227626) Fragment Instance Lifecycle Timings: - ExecTime: 10s003ms - ExecTreeExecTime: 1s110ms - OpenTime: 1s078ms - ExecTreeOpenTime: 902.564ms - PrepareTime: 51.216ms - ExecTreePrepareTime: 3.204ms DataStreamSender (dst_id=23):(Total: 6s015ms, non-child: 6s015ms, % non-child: 100.00%) - BytesSent: 376.89 MB (395198375) - NetworkThroughput(*): 98.56 MB/sec - OverallThroughput: 62.66 MB/sec - PeakMemoryUsage: 4.83 MB (5061696) - RowsReturned: 39.79M (39792978) - SerializeBatchTime: 2s183ms - TransmitDataRPCTime: 3s823ms - UncompressedRowBatchSize: 1.26 GB (1353467084) CodeGen:(Total: 196.836ms, non-child: 196.836ms, % non-child: 100.00%) - CodegenTime: 918.174us - CompileTime: 51.499ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 90 (90) - NumInstructions: 2.97K (2968) - OptimizationTime: 122.409ms - PeakMemoryUsage: 1.45 MB (1519616) - PrepareTime: 22.529ms HASH_JOIN_NODE (id=11):(Total: 2s005ms, non-child: 970.593ms, % non-child: 48.39%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.666ms - PeakMemoryUsage: 1.26 MB (1323908) - ProbeRows: 39.79M (39792978) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 924.634ms - RowsReturned: 39.79M (39792978) - RowsReturnedRate: 19.84 M/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 28.686us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 241.214us - HashBuckets: 212 (212) - HashCollisions: 0 (0) - HashTablesBuildTime: 57.971us - LargestPartitionPercent: 9 (9) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1073600) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 349.694ms, non-child: 21.592us, % non-child: 0.01%) BytesReceived(500.000ms): 0, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 4.653us - DeserializeRowBatchTimer: 17.410us - FirstBatchArrivalWaitTime: 340.108ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 343.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=9):(Total: 685.973ms, non-child: 685.973ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:143/9.40 GB 4:140/9.17 GB 6:144/9.70 GB 2:139/8.14 GB 0:160/10.12 GB 5:160/10.11 GB 1:157/10.21 GB 3:146/8.62 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 54 out of 54 Runtime filters: Only following filters arrived: 7, waited 441ms Hdfs Read Thread Concurrency Bucket: 0:80.95% 1:9.524% 2:9.524% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1135 PARQUET/SNAPPY:54 BytesRead(500.000ms): 0, 0, 4.97 MB, 11.44 MB, 11.44 MB, 11.44 MB, 11.44 MB, 12.83 MB, 22.04 MB, 22.04 MB, 22.04 MB, 27.68 MB, 29.27 MB, 29.27 MB, 30.11 MB, 30.11 MB, 39.65 MB, 41.64 MB, 45.87 MB, 51.45 MB, 51.45 MB, 53.10 MB - FooterProcessingTime: (Avg: 63.753ms ; Min: 26.672ms ; Max: 170.852ms ; Number of samples: 54) - AverageHdfsReadThreadConcurrency: 0.29 - AverageScannerThreadConcurrency: 11.43 - BytesRead: 53.10 MB (55676091) - BytesReadDataNodeCache: 0 - BytesReadLocal: 53.10 MB (55676091) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 53.10 MB (55676091) - DecompressionTime: 341.081ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 54 (54) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 24.80 MB (26001869) - PerReadThreadRawHdfsThroughput: 25.82 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 107.144ms - RowBatchQueuePutWaitTime: 1m46s - RowsRead: 39.81M (39808485) - RowsReturned: 39.79M (39792978) - RowsReturnedRate: 58.01 M/sec - ScanRangesComplete: 1.19K (1189) - ScannerThreadsInvoluntaryContextSwitches: 2.01K (2006) - ScannerThreadsTotalWallClockTime: 2m - MaterializeTupleTime(*): 2s067ms - ScannerThreadsSysTime: 3s179ms - ScannerThreadsUserTime: 4s513ms - ScannerThreadsVoluntaryContextSwitches: 227.03K (227031) - TotalRawHdfsReadTime(*): 2s056ms - TotalReadThroughput: 4.83 MB/sec Filter 2 (16.00 MB): - Rows processed: 217.24K (217235) - Rows rejected: 15.51K (15507) - Rows total: 39.81M (39808485) Filter 7 (1.00 MB): - Files processed: 1.19K (1189) - Files rejected: 1.14K (1135) - Files total: 1.19K (1189) - RowGroups processed: 38.89K (38893) - RowGroups rejected: 0 (0) - RowGroups total: 38.89K (38893) - Rows processed: 884.74K (884736) - Rows rejected: 0 (0) - Rows total: 39.79M (39792978) - Splits processed: 54 (54) - Splits rejected: 0 (0) - Splits total: 54 (54) Instance 7f40dcb034de70b7:139 (host=ve1127.foo:22000):(Total: 11s126ms, non-child: 2s712ms, % non-child: 24.38%) Hdfs split stats (:<# splits>/): 4:144/9.52 GB 2:153/9.72 GB 3:133/8.58 GB 0:142/9.19 GB 1:140/8.97 GB 5:148/9.50 GB 6:150/9.06 GB 7:158/10.99 GB Filter 7 arrival: 431ms Filter 2 arrival: 9s694ms MemoryUsage(500.000ms): 1.38 MB, 3.38 MB, 24.47 MB, 25.04 MB, 24.76 MB, 25.46 MB, 27.14 MB, 27.04 MB, 27.56 MB, 27.91 MB, 28.03 MB, 28.15 MB, 28.18 MB, 28.26 MB, 25.25 MB, 26.89 MB, 28.33 MB, 25.04 MB, 28.02 MB, 44.63 MB, 34.10 MB, 29.09 MB ThreadUsage(500.000ms): 2, 1, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 11.95 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 44.88 MB (47061533) - PerHostPeakMemUsage: 1.40 GB (1500809577) - RowsProduced: 39.10M (39095521) - TotalNetworkReceiveTime: 207.449ms - TotalNetworkSendTime: 2s667ms - TotalStorageWaitTime: 6s906ms - TotalThreadsInvoluntaryContextSwitches: 2.87K (2870) - TotalThreadsTotalWallClockTime: 2m13s - TotalThreadsSysTime: 4s199ms - TotalThreadsUserTime: 11s287ms - TotalThreadsVoluntaryContextSwitches: 187.99K (187992) Fragment Instance Lifecycle Timings: - ExecTime: 9s992ms - ExecTreeExecTime: 1s166ms - OpenTime: 1s083ms - ExecTreeOpenTime: 907.519ms - PrepareTime: 51.231ms - ExecTreePrepareTime: 3.456ms DataStreamSender (dst_id=23):(Total: 6s150ms, non-child: 6s150ms, % non-child: 100.00%) - BytesSent: 370.44 MB (388433285) - NetworkThroughput(*): 98.61 MB/sec - OverallThroughput: 60.23 MB/sec - PeakMemoryUsage: 4.81 MB (5045312) - RowsReturned: 39.10M (39095521) - SerializeBatchTime: 2s386ms - TransmitDataRPCTime: 3s756ms - UncompressedRowBatchSize: 1.24 GB (1329744690) CodeGen:(Total: 196.299ms, non-child: 196.299ms, % non-child: 100.00%) - CodegenTime: 950.123us - CompileTime: 51.204ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 90 (90) - NumInstructions: 2.97K (2968) - OptimizationTime: 122.873ms - PeakMemoryUsage: 1.45 MB (1519616) - PrepareTime: 21.808ms HASH_JOIN_NODE (id=11):(Total: 2s067ms, non-child: 1s026ms, % non-child: 49.65%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.798ms - PeakMemoryUsage: 1.27 MB (1331547) - ProbeRows: 39.10M (39095521) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 971.671ms - RowsReturned: 39.10M (39095521) - RowsReturnedRate: 18.91 M/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 28.239us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 176.144us - HashBuckets: 212 (212) - HashCollisions: 0 (0) - HashTablesBuildTime: 78.862us - LargestPartitionPercent: 9 (9) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1073600) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 207.458ms, non-child: 20.271us, % non-child: 0.01%) BytesReceived(500.000ms): 0, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 4.340us - DeserializeRowBatchTimer: 18.717us - FirstBatchArrivalWaitTime: 196.982ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 578.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=9):(Total: 833.765ms, non-child: 833.765ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:144/9.52 GB 2:153/9.72 GB 3:133/8.58 GB 0:142/9.19 GB 1:140/8.97 GB 5:148/9.50 GB 6:150/9.06 GB 7:158/10.99 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 55 out of 55 Runtime filters: Only following filters arrived: 7, waited 583ms Hdfs Read Thread Concurrency Bucket: 0:86.36% 1:13.64% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1113 PARQUET/SNAPPY:55 BytesRead(500.000ms): 0, 0, 11.21 MB, 11.21 MB, 11.31 MB, 12.05 MB, 20.76 MB, 20.76 MB, 21.60 MB, 30.04 MB, 31.45 MB, 32.21 MB, 32.21 MB, 32.21 MB, 35.28 MB, 39.52 MB, 40.93 MB, 43.48 MB, 49.61 MB, 49.61 MB, 49.61 MB, 52.91 MB - FooterProcessingTime: (Avg: 87.681ms ; Min: 15.160ms ; Max: 556.190ms ; Number of samples: 55) - AverageHdfsReadThreadConcurrency: 0.14 - AverageScannerThreadConcurrency: 10.91 - BytesRead: 52.91 MB (55477990) - BytesReadDataNodeCache: 0 - BytesReadLocal: 52.91 MB (55477990) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 52.91 MB (55477990) - DecompressionTime: 322.748ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 55 (55) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 23.14 MB (24266270) - PerReadThreadRawHdfsThroughput: 28.57 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 113.104ms - RowBatchQueuePutWaitTime: 1m45s - RowsRead: 39.11M (39108524) - RowsReturned: 39.10M (39095521) - RowsReturnedRate: 46.89 M/sec - ScanRangesComplete: 1.17K (1168) - ScannerThreadsInvoluntaryContextSwitches: 1.99K (1986) - ScannerThreadsTotalWallClockTime: 2m2s - MaterializeTupleTime(*): 1s945ms - ScannerThreadsSysTime: 3s916ms - ScannerThreadsUserTime: 4s068ms - ScannerThreadsVoluntaryContextSwitches: 187.37K (187369) - TotalRawHdfsReadTime(*): 1s851ms - TotalReadThroughput: 4.81 MB/sec Filter 2 (16.00 MB): - Rows processed: 182.99K (182987) - Rows rejected: 13.00K (13003) - Rows total: 39.11M (39108524) Filter 7 (1.00 MB): - Files processed: 1.17K (1168) - Files rejected: 1.11K (1113) - Files total: 1.17K (1168) - RowGroups processed: 38.21K (38213) - RowGroups rejected: 0 (0) - RowGroups total: 38.21K (38213) - Rows processed: 901.12K (901120) - Rows rejected: 0 (0) - Rows total: 39.10M (39095521) - Splits processed: 55 (55) - Splits rejected: 0 (0) - Splits total: 55 (55) Instance 7f40dcb034de70b7:16e (host=vc1504.foo:22000):(Total: 11s112ms, non-child: 2s201ms, % non-child: 19.81%) Hdfs split stats (:<# splits>/): 5:158/9.89 GB 6:151/9.21 GB 0:157/10.11 GB 3:139/8.78 GB 1:145/9.18 GB 4:151/10.02 GB 2:140/8.44 GB 7:149/9.86 GB Filter 7 arrival: 240ms MemoryUsage(500.000ms): 2.79 MB, 3.38 MB, 4.52 MB, 26.08 MB, 25.91 MB, 26.26 MB, 27.99 MB, 27.86 MB, 28.09 MB, 26.13 MB, 26.04 MB, 26.62 MB, 26.39 MB, 25.01 MB, 25.84 MB, 27.85 MB, 28.35 MB, 29.00 MB, 29.36 MB, 29.29 MB, 25.80 MB, 24.62 MB, 3.35 MB ThreadUsage(500.000ms): 1, 1, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 1 - AverageThreadTokens: 11.43 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 29.71 MB (31149834) - PerHostPeakMemUsage: 1.37 GB (1475500386) - RowsProduced: 42.61M (42613688) - TotalNetworkReceiveTime: 2.988us - TotalNetworkSendTime: 2s485ms - TotalStorageWaitTime: 6s927ms - TotalThreadsInvoluntaryContextSwitches: 2.61K (2606) - TotalThreadsTotalWallClockTime: 2m15s - TotalThreadsSysTime: 2s297ms - TotalThreadsUserTime: 12s106ms - TotalThreadsVoluntaryContextSwitches: 86.59K (86589) Fragment Instance Lifecycle Timings: - ExecTime: 9s870ms - ExecTreeExecTime: 1s220ms - OpenTime: 1s185ms - ExecTreeOpenTime: 996.642ms - PrepareTime: 56.413ms - ExecTreePrepareTime: 3.397ms DataStreamSender (dst_id=23):(Total: 6s492ms, non-child: 6s492ms, % non-child: 100.00%) - BytesSent: 404.29 MB (423927723) - NetworkThroughput(*): 99.41 MB/sec - OverallThroughput: 62.27 MB/sec - PeakMemoryUsage: 4.76 MB (4987968) - RowsReturned: 42.61M (42613688) - SerializeBatchTime: 2s417ms - TransmitDataRPCTime: 4s066ms - UncompressedRowBatchSize: 1.35 GB (1449407032) CodeGen:(Total: 209.657ms, non-child: 209.657ms, % non-child: 100.00%) - CodegenTime: 1.093ms - CompileTime: 54.074ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 90 (90) - NumInstructions: 2.97K (2968) - OptimizationTime: 133.204ms - PeakMemoryUsage: 1.45 MB (1519616) - PrepareTime: 21.915ms HASH_JOIN_NODE (id=11):(Total: 2s208ms, non-child: 1s055ms, % non-child: 47.79%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 670.507us - PeakMemoryUsage: 1.20 MB (1255232) - ProbeRows: 42.61M (42613688) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1s002ms - RowsReturned: 42.61M (42613688) - RowsReturnedRate: 19.29 M/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 22.602us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 43.107us - HashBuckets: 212 (212) - HashCollisions: 0 (0) - HashTablesBuildTime: 41.130us - LargestPartitionPercent: 9 (9) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1073600) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 10.502us, non-child: 10.502us, % non-child: 100.00%) BytesReceived(500.000ms): 0, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 4.059us - DeserializeRowBatchTimer: 12.839us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 11.43 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=9):(Total: 1s153ms, non-child: 1s153ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:158/9.89 GB 6:151/9.21 GB 0:157/10.11 GB 3:139/8.78 GB 1:145/9.18 GB 4:151/10.02 GB 2:140/8.44 GB 7:149/9.86 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 58 out of 58 Runtime filters: Only following filters arrived: 7, waited 763ms Hdfs Read Thread Concurrency Bucket: 0:90.48% 1:9.524% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1132 PARQUET/SNAPPY:58 BytesRead(500.000ms): 0, 0, 0, 11.80 MB, 11.80 MB, 12.63 MB, 20.49 MB, 20.49 MB, 21.35 MB, 29.44 MB, 29.44 MB, 30.27 MB, 30.27 MB, 30.37 MB, 38.03 MB, 41.58 MB, 42.42 MB, 50.07 MB, 50.07 MB, 50.93 MB, 57.31 MB, 57.31 MB - FooterProcessingTime: (Avg: 82.971ms ; Min: 19.653ms ; Max: 317.868ms ; Number of samples: 58) - AverageHdfsReadThreadConcurrency: 0.10 - AverageScannerThreadConcurrency: 11.43 - BytesRead: 57.31 MB (60093657) - BytesReadDataNodeCache: 0 - BytesReadLocal: 57.31 MB (60093657) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 57.31 MB (60093657) - DecompressionTime: 334.866ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 58 (58) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 23.91 MB (25068720) - PerReadThreadRawHdfsThroughput: 24.24 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 230.716ms - RowBatchQueuePutWaitTime: 1m46s - RowsRead: 42.61M (42613688) - RowsReturned: 42.61M (42613688) - RowsReturnedRate: 36.95 M/sec - ScanRangesComplete: 1.19K (1190) - ScannerThreadsInvoluntaryContextSwitches: 1.74K (1742) - ScannerThreadsTotalWallClockTime: 2m4s - MaterializeTupleTime(*): 2s146ms - ScannerThreadsSysTime: 2s014ms - ScannerThreadsUserTime: 4s798ms - ScannerThreadsVoluntaryContextSwitches: 85.95K (85954) - TotalRawHdfsReadTime(*): 2s363ms - TotalReadThroughput: 5.21 MB/sec Filter 2 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 42.61M (42613688) Filter 7 (1.00 MB): - Files processed: 1.19K (1190) - Files rejected: 1.13K (1132) - Files total: 1.19K (1190) - RowGroups processed: 41.66K (41661) - RowGroups rejected: 0 (0) - RowGroups total: 41.66K (41661) - Rows processed: 950.27K (950272) - Rows rejected: 0 (0) - Rows total: 42.61M (42613688) - Splits processed: 58 (58) - Splits rejected: 0 (0) - Splits total: 58 (58) Instance 7f40dcb034de70b7:14e (host=vd1341.foo:22000):(Total: 11s087ms, non-child: 2s612ms, % non-child: 23.56%) Hdfs split stats (:<# splits>/): 3:145/8.86 GB 4:140/8.81 GB 1:145/9.57 GB 2:155/10.40 GB 0:155/9.96 GB 6:148/9.68 GB 5:125/7.94 GB 7:157/10.25 GB Filter 7 arrival: 358ms Filter 2 arrival: 10s723ms MemoryUsage(500.000ms): 3.38 MB, 3.38 MB, 25.88 MB, 25.99 MB, 26.20 MB, 27.12 MB, 27.07 MB, 27.26 MB, 22.79 MB, 27.27 MB, 26.76 MB, 27.27 MB, 27.27 MB, 26.17 MB, 23.81 MB, 27.17 MB, 26.21 MB, 24.53 MB, 24.97 MB, 24.12 MB, 18.91 MB, 31.13 MB ThreadUsage(500.000ms): 1, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.45 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 32.59 MB (34168159) - PerHostPeakMemUsage: 1.40 GB (1498167950) - RowsProduced: 40.98M (40975951) - TotalNetworkReceiveTime: 128.552ms - TotalNetworkSendTime: 2s509ms - TotalStorageWaitTime: 6s607ms - TotalThreadsInvoluntaryContextSwitches: 2.60K (2605) - TotalThreadsTotalWallClockTime: 2m13s - TotalThreadsSysTime: 4s734ms - TotalThreadsUserTime: 11s988ms - TotalThreadsVoluntaryContextSwitches: 197.47K (197471) Fragment Instance Lifecycle Timings: - ExecTime: 9s995ms - ExecTreeExecTime: 1s136ms - OpenTime: 1s037ms - ExecTreeOpenTime: 858.263ms - PrepareTime: 54.964ms - ExecTreePrepareTime: 3.275ms DataStreamSender (dst_id=23):(Total: 6s288ms, non-child: 6s288ms, % non-child: 100.00%) - BytesSent: 388.22 MB (407078686) - NetworkThroughput(*): 101.22 MB/sec - OverallThroughput: 61.73 MB/sec - PeakMemoryUsage: 4.86 MB (5094464) - RowsReturned: 40.98M (40975951) - SerializeBatchTime: 2s444ms - TransmitDataRPCTime: 3s835ms - UncompressedRowBatchSize: 1.30 GB (1393703182) CodeGen:(Total: 200.916ms, non-child: 200.916ms, % non-child: 100.00%) - CodegenTime: 1.054ms - CompileTime: 53.225ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 90 (90) - NumInstructions: 2.97K (2968) - OptimizationTime: 124.434ms - PeakMemoryUsage: 1.45 MB (1519616) - PrepareTime: 22.777ms HASH_JOIN_NODE (id=11):(Total: 1s985ms, non-child: 969.693ms, % non-child: 48.84%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.307ms - PeakMemoryUsage: 1.20 MB (1255232) - ProbeRows: 40.98M (40975951) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 911.895ms - RowsReturned: 40.98M (40975951) - RowsReturnedRate: 20.64 M/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 26.335us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 113.872us - HashBuckets: 212 (212) - HashCollisions: 0 (0) - HashTablesBuildTime: 45.610us - LargestPartitionPercent: 9 (9) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1073600) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 128.561ms, non-child: 17.220us, % non-child: 0.01%) BytesReceived(500.000ms): 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 4.711us - DeserializeRowBatchTimer: 13.949us - FirstBatchArrivalWaitTime: 104.434ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 933.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=9):(Total: 887.525ms, non-child: 887.525ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:145/8.86 GB 4:140/8.81 GB 1:145/9.57 GB 2:155/10.40 GB 0:155/9.96 GB 6:148/9.68 GB 5:125/7.94 GB 7:157/10.25 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 58 out of 58 Runtime filters: Only following filters arrived: 7, waited 643ms Hdfs Read Thread Concurrency Bucket: 0:81.82% 1:18.18% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1112 PARQUET/SNAPPY:58 BytesRead(500.000ms): 0, 0, 12.31 MB, 12.31 MB, 13.16 MB, 20.48 MB, 20.48 MB, 21.32 MB, 24.79 MB, 30.10 MB, 30.10 MB, 30.94 MB, 30.94 MB, 32.64 MB, 37.40 MB, 39.62 MB, 40.46 MB, 47.24 MB, 48.09 MB, 51.11 MB, 55.65 MB, 55.65 MB - FooterProcessingTime: (Avg: 56.051ms ; Min: 4.985ms ; Max: 132.554ms ; Number of samples: 58) - AverageHdfsReadThreadConcurrency: 0.18 - AverageScannerThreadConcurrency: 11.45 - BytesRead: 55.65 MB (58350870) - BytesReadDataNodeCache: 0 - BytesReadLocal: 55.65 MB (58350870) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 55.65 MB (58350870) - DecompressionTime: 360.045ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 58 (58) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 21.98 MB (23045819) - PerReadThreadRawHdfsThroughput: 24.49 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 83.102ms - RowBatchQueuePutWaitTime: 1m44s - RowsRead: 40.98M (40977877) - RowsReturned: 40.98M (40975951) - RowsReturnedRate: 46.17 M/sec - ScanRangesComplete: 1.17K (1170) - ScannerThreadsInvoluntaryContextSwitches: 1.57K (1575) - ScannerThreadsTotalWallClockTime: 2m2s - MaterializeTupleTime(*): 2s203ms - ScannerThreadsSysTime: 4s419ms - ScannerThreadsUserTime: 4s636ms - ScannerThreadsVoluntaryContextSwitches: 196.81K (196814) - TotalRawHdfsReadTime(*): 2s272ms - TotalReadThroughput: 5.06 MB/sec Filter 2 (16.00 MB): - Rows processed: 26.50K (26502) - Rows rejected: 1.93K (1926) - Rows total: 40.98M (40977877) Filter 7 (1.00 MB): - Files processed: 1.17K (1170) - Files rejected: 1.11K (1112) - Files total: 1.17K (1170) - RowGroups processed: 40.06K (40061) - RowGroups rejected: 0 (0) - RowGroups total: 40.06K (40061) - Rows processed: 950.27K (950272) - Rows rejected: 0 (0) - Rows total: 40.98M (40975951) - Splits processed: 58 (58) - Splits rejected: 0 (0) - Splits total: 58 (58) Instance 7f40dcb034de70b7:130 (host=vd1127.foo:22000):(Total: 11s085ms, non-child: 2s604ms, % non-child: 23.50%) Hdfs split stats (:<# splits>/): 1:154/9.80 GB 0:137/8.83 GB 2:149/9.75 GB 4:146/9.09 GB 5:161/9.58 GB 6:148/9.21 GB 7:164/10.20 GB 3:146/8.99 GB Filter 7 arrival: 474ms Filter 2 arrival: 9s583ms MemoryUsage(500.000ms): 1.38 MB, 3.38 MB, 25.38 MB, 25.04 MB, 24.96 MB, 25.28 MB, 27.15 MB, 26.91 MB, 27.31 MB, 26.61 MB, 26.99 MB, 25.97 MB, 27.40 MB, 26.88 MB, 27.51 MB, 28.13 MB, 28.12 MB, 29.93 MB, 30.16 MB, 47.51 MB, 38.03 MB, 30.63 MB ThreadUsage(500.000ms): 2, 1, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 11.95 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 47.76 MB (50080910) - PerHostPeakMemUsage: 1.40 GB (1506417485) - RowsProduced: 41.45M (41452844) - TotalNetworkReceiveTime: 248.651ms - TotalNetworkSendTime: 2s747ms - TotalStorageWaitTime: 5s451ms - TotalThreadsInvoluntaryContextSwitches: 3.08K (3082) - TotalThreadsTotalWallClockTime: 2m10s - TotalThreadsSysTime: 4s256ms - TotalThreadsUserTime: 11s818ms - TotalThreadsVoluntaryContextSwitches: 300.52K (300521) Fragment Instance Lifecycle Timings: - ExecTime: 9s987ms - ExecTreeExecTime: 1s148ms - OpenTime: 1s044ms - ExecTreeOpenTime: 868.468ms - PrepareTime: 53.719ms - ExecTreePrepareTime: 3.442ms DataStreamSender (dst_id=23):(Total: 6s272ms, non-child: 6s272ms, % non-child: 100.00%) - BytesSent: 392.42 MB (411483877) - NetworkThroughput(*): 99.70 MB/sec - OverallThroughput: 62.56 MB/sec - PeakMemoryUsage: 4.84 MB (5078080) - RowsReturned: 41.45M (41452844) - SerializeBatchTime: 2s328ms - TransmitDataRPCTime: 3s936ms - UncompressedRowBatchSize: 1.31 GB (1409923648) CodeGen:(Total: 197.608ms, non-child: 197.608ms, % non-child: 100.00%) - CodegenTime: 1.125ms - CompileTime: 50.160ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 90 (90) - NumInstructions: 2.97K (2968) - OptimizationTime: 123.660ms - PeakMemoryUsage: 1.45 MB (1519616) - PrepareTime: 23.318ms HASH_JOIN_NODE (id=11):(Total: 2s010ms, non-child: 981.129ms, % non-child: 48.81%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.495ms - PeakMemoryUsage: 1.26 MB (1326159) - ProbeRows: 41.45M (41452844) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 928.537ms - RowsReturned: 41.45M (41452844) - RowsReturnedRate: 20.62 M/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 26.942us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 157.017us - HashBuckets: 212 (212) - HashCollisions: 0 (0) - HashTablesBuildTime: 54.075us - LargestPartitionPercent: 9 (9) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1073600) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 248.661ms, non-child: 21.266us, % non-child: 0.01%) BytesReceived(500.000ms): 0, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 5.019us - DeserializeRowBatchTimer: 20.107us - FirstBatchArrivalWaitTime: 234.391ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 482.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=9):(Total: 780.681ms, non-child: 780.681ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:154/9.80 GB 0:137/8.83 GB 2:149/9.75 GB 4:146/9.09 GB 5:161/9.58 GB 6:148/9.21 GB 7:164/10.20 GB 3:146/8.99 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 57 out of 57 Runtime filters: Only following filters arrived: 7, waited 542ms Hdfs Read Thread Concurrency Bucket: 0:86.36% 1:13.64% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1148 PARQUET/SNAPPY:57 BytesRead(500.000ms): 0, 0, 11.14 MB, 11.14 MB, 11.97 MB, 11.97 MB, 20.67 MB, 20.67 MB, 21.61 MB, 28.91 MB, 30.82 MB, 30.82 MB, 31.66 MB, 31.76 MB, 36.98 MB, 40.90 MB, 41.00 MB, 49.28 MB, 49.28 MB, 51.51 MB, 55.70 MB, 55.70 MB - FooterProcessingTime: (Avg: 61.459ms ; Min: 3.621ms ; Max: 601.217ms ; Number of samples: 57) - AverageHdfsReadThreadConcurrency: 0.14 - AverageScannerThreadConcurrency: 10.91 - BytesRead: 55.70 MB (58406631) - BytesReadDataNodeCache: 0 - BytesReadLocal: 55.70 MB (58406631) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 55.70 MB (58406631) - DecompressionTime: 310.283ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 57 (57) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 26.13 MB (27401195) - PerReadThreadRawHdfsThroughput: 28.39 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 70.118ms - RowBatchQueuePutWaitTime: 1m45s - RowsRead: 41.47M (41469228) - RowsReturned: 41.45M (41452844) - RowsReturnedRate: 53.10 M/sec - ScanRangesComplete: 1.21K (1205) - ScannerThreadsInvoluntaryContextSwitches: 1.93K (1925) - ScannerThreadsTotalWallClockTime: 1m59s - MaterializeTupleTime(*): 2s011ms - ScannerThreadsSysTime: 3s973ms - ScannerThreadsUserTime: 4s688ms - ScannerThreadsVoluntaryContextSwitches: 299.86K (299859) - TotalRawHdfsReadTime(*): 1s961ms - TotalReadThroughput: 5.06 MB/sec Filter 2 (16.00 MB): - Rows processed: 237.41K (237408) - Rows rejected: 16.38K (16384) - Rows total: 41.47M (41469228) Filter 7 (1.00 MB): - Files processed: 1.21K (1205) - Files rejected: 1.15K (1148) - Files total: 1.21K (1205) - RowGroups processed: 40.52K (40517) - RowGroups rejected: 0 (0) - RowGroups total: 40.52K (40517) - Rows processed: 933.89K (933888) - Rows rejected: 0 (0) - Rows total: 41.45M (41452844) - Splits processed: 57 (57) - Splits rejected: 0 (0) - Splits total: 57 (57) Instance 7f40dcb034de70b7:12c (host=ve1135.foo:22000):(Total: 11s083ms, non-child: 2s714ms, % non-child: 24.49%) Hdfs split stats (:<# splits>/): 0:150/9.86 GB 2:134/8.22 GB 5:130/8.41 GB 6:162/10.17 GB 7:150/9.28 GB 3:152/9.78 GB 1:143/8.94 GB 4:159/10.79 GB Filter 7 arrival: 491ms Filter 2 arrival: 9s551ms MemoryUsage(500.000ms): 0, 3.38 MB, 3.38 MB, 26.86 MB, 26.82 MB, 26.82 MB, 26.88 MB, 27.20 MB, 28.01 MB, 27.78 MB, 26.97 MB, 26.78 MB, 27.16 MB, 27.31 MB, 22.89 MB, 25.95 MB, 27.15 MB, 25.35 MB, 26.90 MB, 26.97 MB, 41.49 MB, 39.33 MB, 22.32 MB ThreadUsage(500.000ms): 1, 1, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 1 - AverageThreadTokens: 11.43 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 45.30 MB (47497342) - PerHostPeakMemUsage: 1.42 GB (1522616507) - RowsProduced: 42.76M (42755364) - TotalNetworkReceiveTime: 261.577ms - TotalNetworkSendTime: 3s293ms - TotalStorageWaitTime: 5s770ms - TotalThreadsInvoluntaryContextSwitches: 2.99K (2989) - TotalThreadsTotalWallClockTime: 2m12s - TotalThreadsSysTime: 3s949ms - TotalThreadsUserTime: 11s398ms - TotalThreadsVoluntaryContextSwitches: 225.75K (225746) Fragment Instance Lifecycle Timings: - ExecTime: 9s976ms - ExecTreeExecTime: 1s123ms - OpenTime: 1s050ms - ExecTreeOpenTime: 872.754ms - PrepareTime: 56.367ms - ExecTreePrepareTime: 3.518ms DataStreamSender (dst_id=23):(Total: 6s182ms, non-child: 6s182ms, % non-child: 100.00%) - BytesSent: 404.95 MB (424616891) - NetworkThroughput(*): 100.82 MB/sec - OverallThroughput: 65.49 MB/sec - PeakMemoryUsage: 4.84 MB (5069888) - RowsReturned: 42.76M (42755364) - SerializeBatchTime: 2s159ms - TransmitDataRPCTime: 4s016ms - UncompressedRowBatchSize: 1.35 GB (1454225840) CodeGen:(Total: 198.095ms, non-child: 198.095ms, % non-child: 100.00%) - CodegenTime: 1.151ms - CompileTime: 50.795ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 90 (90) - NumInstructions: 2.97K (2968) - OptimizationTime: 125.227ms - PeakMemoryUsage: 1.45 MB (1519616) - PrepareTime: 21.596ms HASH_JOIN_NODE (id=11):(Total: 1s987ms, non-child: 980.176ms, % non-child: 49.31%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.535ms - PeakMemoryUsage: 1.28 MB (1338336) - ProbeRows: 42.76M (42755364) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 932.830ms - RowsReturned: 42.76M (42755364) - RowsReturnedRate: 21.51 M/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 28.178us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 164.535us - HashBuckets: 212 (212) - HashCollisions: 0 (0) - HashTablesBuildTime: 64.926us - LargestPartitionPercent: 9 (9) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1073600) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 261.593ms, non-child: 25.231us, % non-child: 0.01%) BytesReceived(500.000ms): 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 10.217us - DeserializeRowBatchTimer: 20.658us - FirstBatchArrivalWaitTime: 235.763ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 458.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=9):(Total: 746.418ms, non-child: 746.418ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:150/9.86 GB 2:134/8.22 GB 5:130/8.41 GB 6:162/10.17 GB 7:150/9.28 GB 3:152/9.78 GB 1:143/8.94 GB 4:159/10.79 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 57 out of 57 Runtime filters: Only following filters arrived: 7, waited 522ms Hdfs Read Thread Concurrency Bucket: 0:86.36% 1:13.64% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1123 PARQUET/SNAPPY:57 BytesRead(500.000ms): 0, 0, 12.95 MB, 12.95 MB, 12.95 MB, 12.95 MB, 13.78 MB, 20.26 MB, 20.36 MB, 27.28 MB, 29.77 MB, 30.59 MB, 30.59 MB, 34.84 MB, 38.64 MB, 40.68 MB, 48.83 MB, 50.32 MB, 50.32 MB, 57.09 MB, 57.09 MB, 57.09 MB - FooterProcessingTime: (Avg: 58.029ms ; Min: 3.220ms ; Max: 145.046ms ; Number of samples: 57) - AverageHdfsReadThreadConcurrency: 0.14 - AverageScannerThreadConcurrency: 10.91 - BytesRead: 57.09 MB (59858975) - BytesReadDataNodeCache: 0 - BytesReadLocal: 57.09 MB (59858975) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 57.09 MB (59858975) - DecompressionTime: 327.993ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 57 (57) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 23.55 MB (24692311) - PerReadThreadRawHdfsThroughput: 27.69 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 84.905ms - RowBatchQueuePutWaitTime: 1m45s - RowsRead: 42.77M (42769237) - RowsReturned: 42.76M (42755364) - RowsReturnedRate: 57.28 M/sec - ScanRangesComplete: 1.18K (1180) - ScannerThreadsInvoluntaryContextSwitches: 2.18K (2177) - ScannerThreadsTotalWallClockTime: 2m1s - MaterializeTupleTime(*): 2s030ms - ScannerThreadsSysTime: 3s658ms - ScannerThreadsUserTime: 4s812ms - ScannerThreadsVoluntaryContextSwitches: 225.15K (225152) - TotalRawHdfsReadTime(*): 2s061ms - TotalReadThroughput: 5.19 MB/sec Filter 2 (16.00 MB): - Rows processed: 200.24K (200241) - Rows rejected: 13.87K (13873) - Rows total: 42.77M (42769237) Filter 7 (1.00 MB): - Files processed: 1.18K (1180) - Files rejected: 1.12K (1123) - Files total: 1.18K (1180) - RowGroups processed: 41.79K (41788) - RowGroups rejected: 0 (0) - RowGroups total: 41.79K (41788) - Rows processed: 933.89K (933888) - Rows rejected: 0 (0) - Rows total: 42.76M (42755364) - Splits processed: 57 (57) - Splits rejected: 0 (0) - Splits total: 57 (57) Instance 7f40dcb034de70b7:128 (host=vc1510.foo:22000):(Total: 11s055ms, non-child: 2s763ms, % non-child: 24.99%) Hdfs split stats (:<# splits>/): 0:157/9.55 GB 6:152/9.62 GB 4:150/9.50 GB 7:146/9.20 GB 1:143/8.74 GB 3:144/8.82 GB 5:152/10.16 GB 2:159/9.92 GB Filter 7 arrival: 483ms Filter 2 arrival: 9s521ms MemoryUsage(500.000ms): 1.35 MB, 3.38 MB, 17.26 MB, 24.67 MB, 24.98 MB, 26.01 MB, 28.00 MB, 27.79 MB, 28.55 MB, 28.05 MB, 28.16 MB, 27.38 MB, 27.38 MB, 27.68 MB, 27.00 MB, 26.91 MB, 27.44 MB, 23.85 MB, 25.21 MB, 40.69 MB, 37.64 MB, 36.81 MB ThreadUsage(500.000ms): 1, 1, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 11.91 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 42.02 MB (44061257) - PerHostPeakMemUsage: 1.41 GB (1512589368) - RowsProduced: 41.53M (41526024) - TotalNetworkReceiveTime: 254.237ms - TotalNetworkSendTime: 2s587ms - TotalStorageWaitTime: 6s260ms - TotalThreadsInvoluntaryContextSwitches: 2.32K (2318) - TotalThreadsTotalWallClockTime: 2m11s - TotalThreadsSysTime: 1s968ms - TotalThreadsUserTime: 11s820ms - TotalThreadsVoluntaryContextSwitches: 131.46K (131461) Fragment Instance Lifecycle Timings: - ExecTime: 9s868ms - ExecTreeExecTime: 1s062ms - OpenTime: 1s134ms - ExecTreeOpenTime: 951.699ms - PrepareTime: 51.598ms - ExecTreePrepareTime: 3.575ms DataStreamSender (dst_id=23):(Total: 6s080ms, non-child: 6s080ms, % non-child: 100.00%) - BytesSent: 393.34 MB (412448696) - NetworkThroughput(*): 104.49 MB/sec - OverallThroughput: 64.69 MB/sec - PeakMemoryUsage: 4.86 MB (5094464) - RowsReturned: 41.53M (41526024) - SerializeBatchTime: 2s307ms - TransmitDataRPCTime: 3s764ms - UncompressedRowBatchSize: 1.32 GB (1412412656) CodeGen:(Total: 204.787ms, non-child: 204.787ms, % non-child: 100.00%) - CodegenTime: 1.287ms - CompileTime: 55.307ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 90 (90) - NumInstructions: 2.97K (2968) - OptimizationTime: 126.384ms - PeakMemoryUsage: 1.45 MB (1519616) - PrepareTime: 22.542ms HASH_JOIN_NODE (id=11):(Total: 2s006ms, non-child: 915.468ms, % non-child: 45.62%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.535ms - PeakMemoryUsage: 1.27 MB (1330152) - ProbeRows: 41.53M (41526024) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 855.497ms - RowsReturned: 41.53M (41526024) - RowsReturnedRate: 20.69 M/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 27.681us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 137.892us - HashBuckets: 212 (212) - HashCollisions: 0 (0) - HashTablesBuildTime: 55.870us - LargestPartitionPercent: 9 (9) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1073600) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 254.248ms, non-child: 20.785us, % non-child: 0.01%) BytesReceived(500.000ms): 0, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 5.843us - DeserializeRowBatchTimer: 21.022us - FirstBatchArrivalWaitTime: 248.148ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 471.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=9):(Total: 837.676ms, non-child: 837.676ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:157/9.55 GB 6:152/9.62 GB 4:150/9.50 GB 7:146/9.20 GB 1:143/8.74 GB 3:144/8.82 GB 5:152/10.16 GB 2:159/9.92 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 61 out of 61 Runtime filters: Only following filters arrived: 7, waited 522ms Hdfs Read Thread Concurrency Bucket: 0:90.48% 1:4.762% 2:0% 3:0% 4:4.762% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1142 PARQUET/SNAPPY:61 BytesRead(500.000ms): 0, 0, 4.08 MB, 11.19 MB, 11.19 MB, 12.61 MB, 21.31 MB, 21.31 MB, 21.31 MB, 30.03 MB, 30.03 MB, 30.88 MB, 30.88 MB, 30.88 MB, 39.53 MB, 39.53 MB, 40.36 MB, 47.08 MB, 47.92 MB, 48.76 MB, 56.85 MB, 56.85 MB - FooterProcessingTime: (Avg: 58.577ms ; Min: 16.014ms ; Max: 166.698ms ; Number of samples: 61) - AverageHdfsReadThreadConcurrency: 0.24 - AverageScannerThreadConcurrency: 11.43 - BytesRead: 56.85 MB (59616768) - BytesReadDataNodeCache: 0 - BytesReadLocal: 56.85 MB (59616768) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 56.85 MB (59616768) - DecompressionTime: 339.362ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 61 (61) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 22.93 MB (24040727) - PerReadThreadRawHdfsThroughput: 23.36 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 171.216ms - RowBatchQueuePutWaitTime: 1m46s - RowsRead: 41.55M (41547109) - RowsReturned: 41.53M (41526024) - RowsReturnedRate: 49.57 M/sec - ScanRangesComplete: 1.20K (1203) - ScannerThreadsInvoluntaryContextSwitches: 1.40K (1396) - ScannerThreadsTotalWallClockTime: 2m - MaterializeTupleTime(*): 2s127ms - ScannerThreadsSysTime: 1s736ms - ScannerThreadsUserTime: 4s581ms - ScannerThreadsVoluntaryContextSwitches: 130.85K (130849) - TotalRawHdfsReadTime(*): 2s433ms - TotalReadThroughput: 5.17 MB/sec Filter 2 (16.00 MB): - Rows processed: 299.61K (299613) - Rows rejected: 21.09K (21085) - Rows total: 41.55M (41547109) Filter 7 (1.00 MB): - Files processed: 1.20K (1203) - Files rejected: 1.14K (1142) - Files total: 1.20K (1203) - RowGroups processed: 40.59K (40590) - RowGroups rejected: 0 (0) - RowGroups total: 40.59K (40590) - Rows processed: 999.42K (999424) - Rows rejected: 0 (0) - Rows total: 41.53M (41526024) - Splits processed: 61 (61) - Splits rejected: 0 (0) - Splits total: 61 (61) Instance 7f40dcb034de70b7:108 (host=vd1138.foo:22000):(Total: 11s030ms, non-child: 2s480ms, % non-child: 22.49%) Hdfs split stats (:<# splits>/): 1:175/11.97 GB 7:139/8.06 GB 0:121/7.72 GB 3:157/9.84 GB 4:146/9.22 GB 6:158/10.24 GB 5:155/9.59 GB 2:139/8.84 GB Filter 7 arrival: 608ms Filter 2 arrival: 9s077ms MemoryUsage(500.000ms): 1.38 MB, 3.38 MB, 24.94 MB, 24.85 MB, 24.92 MB, 24.76 MB, 24.71 MB, 24.88 MB, 25.08 MB, 24.81 MB, 24.90 MB, 25.06 MB, 27.88 MB, 27.96 MB, 28.09 MB, 24.01 MB, 27.10 MB, 25.06 MB, 40.18 MB, 42.09 MB, 39.50 MB, 29.10 MB ThreadUsage(500.000ms): 2, 1, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 11.95 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 43.79 MB (45920058) - PerHostPeakMemUsage: 1.40 GB (1501415491) - RowsProduced: 42.01M (42011756) - TotalNetworkReceiveTime: 394.064ms - TotalNetworkSendTime: 3s014ms - TotalStorageWaitTime: 5s163ms - TotalThreadsInvoluntaryContextSwitches: 5.40K (5399) - TotalThreadsTotalWallClockTime: 2m10s - TotalThreadsSysTime: 4s018ms - TotalThreadsUserTime: 12s081ms - TotalThreadsVoluntaryContextSwitches: 179.29K (179289) Fragment Instance Lifecycle Timings: - ExecTime: 9s933ms - ExecTreeExecTime: 1s176ms - OpenTime: 1s051ms - ExecTreeOpenTime: 880.648ms - PrepareTime: 45.087ms - ExecTreePrepareTime: 2.892ms DataStreamSender (dst_id=23):(Total: 6s310ms, non-child: 6s310ms, % non-child: 100.00%) - BytesSent: 398.44 MB (417795196) - NetworkThroughput(*): 99.15 MB/sec - OverallThroughput: 63.14 MB/sec - PeakMemoryUsage: 4.76 MB (4996160) - RowsReturned: 42.01M (42011756) - SerializeBatchTime: 2s284ms - TransmitDataRPCTime: 4s018ms - UncompressedRowBatchSize: 1.33 GB (1428933728) CodeGen:(Total: 190.789ms, non-child: 190.789ms, % non-child: 100.00%) - CodegenTime: 988.831us - CompileTime: 50.969ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 90 (90) - NumInstructions: 2.97K (2968) - OptimizationTime: 118.364ms - PeakMemoryUsage: 1.45 MB (1519616) - PrepareTime: 21.104ms HASH_JOIN_NODE (id=11):(Total: 2s047ms, non-child: 972.920ms, % non-child: 47.51%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.492ms - PeakMemoryUsage: 1.27 MB (1332353) - ProbeRows: 42.01M (42011756) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 926.951ms - RowsReturned: 42.01M (42011756) - RowsReturnedRate: 20.52 M/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 29.044us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 117.252us - HashBuckets: 212 (212) - HashCollisions: 0 (0) - HashTablesBuildTime: 77.494us - LargestPartitionPercent: 9 (9) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1073600) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 394.074ms, non-child: 20.304us, % non-child: 0.01%) BytesReceived(500.000ms): 0, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 4.404us - DeserializeRowBatchTimer: 21.343us - FirstBatchArrivalWaitTime: 388.876ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 304.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=9):(Total: 681.137ms, non-child: 681.137ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:175/11.97 GB 7:139/8.06 GB 0:121/7.72 GB 3:157/9.84 GB 4:146/9.22 GB 6:158/10.24 GB 5:155/9.59 GB 2:139/8.84 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 61 out of 61 Runtime filters: Only following filters arrived: 7, waited 401ms Hdfs Read Thread Concurrency Bucket: 0:72.73% 1:18.18% 2:9.091% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1129 PARQUET/SNAPPY:61 BytesRead(500.000ms): 0, 0, 11.19 MB, 11.19 MB, 11.19 MB, 11.38 MB, 20.11 MB, 21.05 MB, 22.71 MB, 29.84 MB, 30.68 MB, 33.19 MB, 40.30 MB, 40.30 MB, 41.96 MB, 41.96 MB, 48.47 MB, 50.15 MB, 51.57 MB, 57.20 MB, 57.20 MB, 57.20 MB - FooterProcessingTime: (Avg: 49.982ms ; Min: 4.273ms ; Max: 156.962ms ; Number of samples: 61) - AverageHdfsReadThreadConcurrency: 0.36 - AverageScannerThreadConcurrency: 10.91 - BytesRead: 57.20 MB (59974519) - BytesReadDataNodeCache: 0 - BytesReadLocal: 57.20 MB (59974519) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 57.20 MB (59974519) - DecompressionTime: 355.004ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 61 (61) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 22.89 MB (23999567) - PerReadThreadRawHdfsThroughput: 25.64 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 79.966ms - RowBatchQueuePutWaitTime: 1m44s - RowsRead: 42.03M (42028211) - RowsReturned: 42.01M (42011756) - RowsReturnedRate: 61.68 M/sec - ScanRangesComplete: 1.19K (1190) - ScannerThreadsInvoluntaryContextSwitches: 3.36K (3361) - ScannerThreadsTotalWallClockTime: 1m59s - MaterializeTupleTime(*): 2s179ms - ScannerThreadsSysTime: 3s716ms - ScannerThreadsUserTime: 5s329ms - ScannerThreadsVoluntaryContextSwitches: 178.60K (178601) - TotalRawHdfsReadTime(*): 2s230ms - TotalReadThroughput: 5.20 MB/sec Filter 2 (16.00 MB): - Rows processed: 232.52K (232519) - Rows rejected: 16.45K (16455) - Rows total: 42.03M (42028211) Filter 7 (1.00 MB): - Files processed: 1.19K (1190) - Files rejected: 1.13K (1129) - Files total: 1.19K (1190) - RowGroups processed: 41.07K (41066) - RowGroups rejected: 0 (0) - RowGroups total: 41.07K (41066) - Rows processed: 999.42K (999424) - Rows rejected: 0 (0) - Rows total: 42.01M (42011756) - Splits processed: 61 (61) - Splits rejected: 0 (0) - Splits total: 61 (61) Instance 7f40dcb034de70b7:109 (host=vd1125.foo:22000):(Total: 11s024ms, non-child: 2s688ms, % non-child: 24.39%) Hdfs split stats (:<# splits>/): 6:158/10.23 GB 1:154/9.75 GB 4:156/10.04 GB 0:145/9.01 GB 5:154/10.08 GB 7:140/8.94 GB 3:127/8.03 GB 2:143/9.48 GB Filter 7 arrival: 620ms Filter 2 arrival: 9s066ms MemoryUsage(500.000ms): 1.38 MB, 3.38 MB, 24.77 MB, 24.90 MB, 25.02 MB, 26.00 MB, 27.97 MB, 28.23 MB, 27.15 MB, 28.12 MB, 27.99 MB, 29.59 MB, 28.31 MB, 28.03 MB, 27.77 MB, 28.02 MB, 28.50 MB, 24.52 MB, 42.47 MB, 41.16 MB, 37.00 MB, 31.15 MB ThreadUsage(500.000ms): 2, 1, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 11.95 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 42.75 MB (44827810) - PerHostPeakMemUsage: 1.40 GB (1502631841) - RowsProduced: 41.21M (41205895) - TotalNetworkReceiveTime: 399.643ms - TotalNetworkSendTime: 2s757ms - TotalStorageWaitTime: 5s549ms - TotalThreadsInvoluntaryContextSwitches: 2.71K (2710) - TotalThreadsTotalWallClockTime: 2m10s - TotalThreadsSysTime: 3s724ms - TotalThreadsUserTime: 11s702ms - TotalThreadsVoluntaryContextSwitches: 209.89K (209890) Fragment Instance Lifecycle Timings: - ExecTime: 9s901ms - ExecTreeExecTime: 1s091ms - OpenTime: 1s076ms - ExecTreeOpenTime: 898.378ms - PrepareTime: 46.470ms - ExecTreePrepareTime: 2.907ms DataStreamSender (dst_id=23):(Total: 6s158ms, non-child: 6s158ms, % non-child: 100.00%) - BytesSent: 390.65 MB (409630252) - NetworkThroughput(*): 101.72 MB/sec - OverallThroughput: 63.43 MB/sec - PeakMemoryUsage: 4.75 MB (4979776) - RowsReturned: 41.21M (41205895) - SerializeBatchTime: 2s311ms - TransmitDataRPCTime: 3s840ms - UncompressedRowBatchSize: 1.31 GB (1401524262) CodeGen:(Total: 197.194ms, non-child: 197.194ms, % non-child: 100.00%) - CodegenTime: 858.835us - CompileTime: 52.994ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 90 (90) - NumInstructions: 2.97K (2968) - OptimizationTime: 123.781ms - PeakMemoryUsage: 1.45 MB (1519616) - PrepareTime: 20.001ms HASH_JOIN_NODE (id=11):(Total: 1s979ms, non-child: 938.406ms, % non-child: 47.40%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.484ms - PeakMemoryUsage: 1.26 MB (1325718) - ProbeRows: 41.21M (41205895) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 878.121ms - RowsReturned: 41.21M (41205895) - RowsReturnedRate: 20.81 M/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 27.683us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 145.459us - HashBuckets: 212 (212) - HashCollisions: 0 (0) - HashTablesBuildTime: 56.257us - LargestPartitionPercent: 9 (9) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1073600) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 399.654ms, non-child: 21.344us, % non-child: 0.01%) BytesReceived(500.000ms): 0, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 5.466us - DeserializeRowBatchTimer: 16.190us - FirstBatchArrivalWaitTime: 378.880ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 300.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=9):(Total: 642.145ms, non-child: 642.145ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 6:158/10.23 GB 1:154/9.75 GB 4:156/10.04 GB 0:145/9.01 GB 5:154/10.08 GB 7:140/8.94 GB 3:127/8.03 GB 2:143/9.48 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 58 out of 58 Runtime filters: Only following filters arrived: 7, waited 382ms Hdfs Read Thread Concurrency Bucket: 0:95.45% 1:4.545% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1119 PARQUET/SNAPPY:58 BytesRead(500.000ms): 0, 0, 10.83 MB, 10.83 MB, 10.83 MB, 13.09 MB, 20.88 MB, 20.88 MB, 22.57 MB, 29.61 MB, 29.61 MB, 33.32 MB, 34.98 MB, 34.98 MB, 39.72 MB, 39.72 MB, 40.57 MB, 44.98 MB, 47.32 MB, 50.44 MB, 55.76 MB, 55.76 MB - FooterProcessingTime: (Avg: 52.293ms ; Min: 4.365ms ; Max: 133.463ms ; Number of samples: 58) - AverageHdfsReadThreadConcurrency: 0.05 - AverageScannerThreadConcurrency: 10.91 - BytesRead: 55.76 MB (58470299) - BytesReadDataNodeCache: 0 - BytesReadLocal: 55.76 MB (58470299) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 55.76 MB (58470299) - DecompressionTime: 365.926ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 58 (58) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 23.82 MB (24974564) - PerReadThreadRawHdfsThroughput: 23.97 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 111.127ms - RowBatchQueuePutWaitTime: 1m45s - RowsRead: 41.22M (41223171) - RowsReturned: 41.21M (41205895) - RowsReturnedRate: 64.17 M/sec - ScanRangesComplete: 1.18K (1177) - ScannerThreadsInvoluntaryContextSwitches: 1.80K (1804) - ScannerThreadsTotalWallClockTime: 1m59s - MaterializeTupleTime(*): 2s184ms - ScannerThreadsSysTime: 3s457ms - ScannerThreadsUserTime: 4s642ms - ScannerThreadsVoluntaryContextSwitches: 209.21K (209207) - TotalRawHdfsReadTime(*): 2s326ms - TotalReadThroughput: 5.07 MB/sec Filter 2 (16.00 MB): - Rows processed: 240.51K (240508) - Rows rejected: 17.28K (17276) - Rows total: 41.22M (41223171) Filter 7 (1.00 MB): - Files processed: 1.18K (1177) - Files rejected: 1.12K (1119) - Files total: 1.18K (1177) - RowGroups processed: 40.27K (40275) - RowGroups rejected: 0 (0) - RowGroups total: 40.27K (40275) - Rows processed: 950.27K (950272) - Rows rejected: 0 (0) - Rows total: 41.21M (41205895) - Splits processed: 58 (58) - Splits rejected: 0 (0) - Splits total: 58 (58) Instance 7f40dcb034de70b7:149 (host=vc1520.foo:22000):(Total: 11s006ms, non-child: 2s771ms, % non-child: 25.18%) Hdfs split stats (:<# splits>/): 0:152/9.98 GB 5:141/8.87 GB 7:145/9.24 GB 4:144/9.03 GB 3:156/9.98 GB 1:158/9.84 GB 6:158/9.76 GB 2:143/8.77 GB Filter 7 arrival: 380ms Filter 2 arrival: 10s587ms MemoryUsage(500.000ms): 3.38 MB, 3.38 MB, 25.30 MB, 23.92 MB, 26.08 MB, 29.19 MB, 29.09 MB, 29.27 MB, 29.08 MB, 29.82 MB, 29.08 MB, 28.18 MB, 28.18 MB, 25.26 MB, 24.98 MB, 24.88 MB, 25.20 MB, 26.87 MB, 26.93 MB, 27.65 MB, 23.00 MB, 26.70 MB ThreadUsage(500.000ms): 1, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.45 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 38.27 MB (40125497) - PerHostPeakMemUsage: 1.41 GB (1508839886) - RowsProduced: 40.61M (40610186) - TotalNetworkReceiveTime: 156.039ms - TotalNetworkSendTime: 2s838ms - TotalStorageWaitTime: 5s362ms - TotalThreadsInvoluntaryContextSwitches: 2.79K (2793) - TotalThreadsTotalWallClockTime: 2m12s - TotalThreadsSysTime: 4s141ms - TotalThreadsUserTime: 11s552ms - TotalThreadsVoluntaryContextSwitches: 207.72K (207719) Fragment Instance Lifecycle Timings: - ExecTime: 9s918ms - ExecTreeExecTime: 1s106ms - OpenTime: 1s035ms - ExecTreeOpenTime: 859.201ms - PrepareTime: 52.474ms - ExecTreePrepareTime: 3.610ms DataStreamSender (dst_id=23):(Total: 6s081ms, non-child: 6s081ms, % non-child: 100.00%) - BytesSent: 384.84 MB (403530658) - NetworkThroughput(*): 101.08 MB/sec - OverallThroughput: 63.28 MB/sec - PeakMemoryUsage: 4.70 MB (4930624) - RowsReturned: 40.61M (40610186) - SerializeBatchTime: 2s267ms - TransmitDataRPCTime: 3s807ms - UncompressedRowBatchSize: 1.29 GB (1381262588) CodeGen:(Total: 194.307ms, non-child: 194.307ms, % non-child: 100.00%) - CodegenTime: 1.113ms - CompileTime: 52.228ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 90 (90) - NumInstructions: 2.97K (2968) - OptimizationTime: 122.241ms - PeakMemoryUsage: 1.45 MB (1519616) - PrepareTime: 19.445ms HASH_JOIN_NODE (id=11):(Total: 1s958ms, non-child: 963.769ms, % non-child: 49.21%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.549ms - PeakMemoryUsage: 1.25 MB (1306987) - ProbeRows: 40.61M (40610186) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 912.370ms - RowsReturned: 40.61M (40610186) - RowsReturnedRate: 20.74 M/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 27.283us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 125.735us - HashBuckets: 212 (212) - HashCollisions: 0 (0) - HashTablesBuildTime: 56.711us - LargestPartitionPercent: 9 (9) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1073600) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 156.051ms, non-child: 22.137us, % non-child: 0.01%) BytesReceived(500.000ms): 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 5.155us - DeserializeRowBatchTimer: 11.550us - FirstBatchArrivalWaitTime: 143.686ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 768.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=9):(Total: 838.944ms, non-child: 838.944ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:152/9.98 GB 5:141/8.87 GB 7:145/9.24 GB 4:144/9.03 GB 3:156/9.98 GB 1:158/9.84 GB 6:158/9.76 GB 2:143/8.77 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 55 out of 55 Runtime filters: Only following filters arrived: 7, waited 622ms Hdfs Read Thread Concurrency Bucket: 0:77.27% 1:22.73% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1142 PARQUET/SNAPPY:55 BytesRead(500.000ms): 0, 0, 11.57 MB, 11.57 MB, 13.06 MB, 22.18 MB, 22.18 MB, 22.28 MB, 25.26 MB, 29.18 MB, 29.27 MB, 31.68 MB, 31.68 MB, 35.01 MB, 37.50 MB, 37.50 MB, 39.28 MB, 49.87 MB, 50.70 MB, 53.06 MB, 54.41 MB, 54.41 MB - FooterProcessingTime: (Avg: 51.300ms ; Min: 18.726ms ; Max: 140.740ms ; Number of samples: 55) - AverageHdfsReadThreadConcurrency: 0.23 - AverageScannerThreadConcurrency: 11.45 - BytesRead: 54.41 MB (57057781) - BytesReadDataNodeCache: 0 - BytesReadLocal: 54.41 MB (57057781) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 54.41 MB (57057781) - DecompressionTime: 326.112ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 55 (55) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 24.76 MB (25958309) - PerReadThreadRawHdfsThroughput: 26.47 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 76.828ms - RowBatchQueuePutWaitTime: 1m45s - RowsRead: 40.61M (40613132) - RowsReturned: 40.61M (40610186) - RowsReturnedRate: 48.41 M/sec - ScanRangesComplete: 1.20K (1197) - ScannerThreadsInvoluntaryContextSwitches: 1.94K (1936) - ScannerThreadsTotalWallClockTime: 2m1s - MaterializeTupleTime(*): 2s023ms - ScannerThreadsSysTime: 3s890ms - ScannerThreadsUserTime: 4s535ms - ScannerThreadsVoluntaryContextSwitches: 207.02K (207024) - TotalRawHdfsReadTime(*): 2s056ms - TotalReadThroughput: 4.95 MB/sec Filter 2 (16.00 MB): - Rows processed: 41.86K (41858) - Rows rejected: 2.95K (2946) - Rows total: 40.61M (40613132) Filter 7 (1.00 MB): - Files processed: 1.20K (1197) - Files rejected: 1.14K (1142) - Files total: 1.20K (1197) - RowGroups processed: 39.70K (39700) - RowGroups rejected: 0 (0) - RowGroups total: 39.70K (39700) - Rows processed: 901.12K (901120) - Rows rejected: 0 (0) - Rows total: 40.61M (40610186) - Splits processed: 55 (55) - Splits rejected: 0 (0) - Splits total: 55 (55) Instance 7f40dcb034de70b7:10d (host=vc1529.foo:22000):(Total: 10s984ms, non-child: 2s165ms, % non-child: 19.71%) Hdfs split stats (:<# splits>/): 2:123/7.72 GB 5:165/10.62 GB 3:151/9.84 GB 6:158/9.96 GB 1:136/8.82 GB 4:147/8.99 GB 0:152/9.83 GB 7:150/9.73 GB Filter 7 arrival: 604ms Filter 2 arrival: 9s090ms MemoryUsage(500.000ms): 1.38 MB, 3.38 MB, 21.82 MB, 24.90 MB, 25.01 MB, 25.26 MB, 25.18 MB, 25.12 MB, 23.37 MB, 27.93 MB, 27.79 MB, 26.83 MB, 28.19 MB, 28.00 MB, 28.24 MB, 28.21 MB, 24.72 MB, 23.76 MB, 41.46 MB, 43.34 MB, 42.26 MB, 28.97 MB ThreadUsage(500.000ms): 2, 1, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 11.95 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 43.56 MB (45672293) - PerHostPeakMemUsage: 1.41 GB (1510603722) - RowsProduced: 43.34M (43335460) - TotalNetworkReceiveTime: 369.278ms - TotalNetworkSendTime: 2s183ms - TotalStorageWaitTime: 6s363ms - TotalThreadsInvoluntaryContextSwitches: 2.29K (2291) - TotalThreadsTotalWallClockTime: 2m9s - TotalThreadsSysTime: 2s160ms - TotalThreadsUserTime: 11s807ms - TotalThreadsVoluntaryContextSwitches: 103.65K (103651) Fragment Instance Lifecycle Timings: - ExecTime: 9s753ms - ExecTreeExecTime: 1s144ms - OpenTime: 1s174ms - ExecTreeOpenTime: 992.597ms - PrepareTime: 55.708ms - ExecTreePrepareTime: 3.001ms DataStreamSender (dst_id=23):(Total: 6s487ms, non-child: 6s487ms, % non-child: 100.00%) - BytesSent: 411.25 MB (431230804) - NetworkThroughput(*): 102.45 MB/sec - OverallThroughput: 63.39 MB/sec - PeakMemoryUsage: 4.73 MB (4963392) - RowsReturned: 43.34M (43335460) - SerializeBatchTime: 2s464ms - TransmitDataRPCTime: 4s014ms - UncompressedRowBatchSize: 1.37 GB (1473956480) CodeGen:(Total: 204.965ms, non-child: 204.965ms, % non-child: 100.00%) - CodegenTime: 1.117ms - CompileTime: 53.247ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 90 (90) - NumInstructions: 2.97K (2968) - OptimizationTime: 127.244ms - PeakMemoryUsage: 1.45 MB (1519616) - PrepareTime: 24.002ms HASH_JOIN_NODE (id=11):(Total: 2s127ms, non-child: 973.902ms, % non-child: 45.79%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.789ms - PeakMemoryUsage: 1.27 MB (1330931) - ProbeRows: 43.34M (43335460) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 912.755ms - RowsReturned: 43.34M (43335460) - RowsReturnedRate: 20.37 M/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 36.420us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 192.252us - HashBuckets: 212 (212) - HashCollisions: 0 (0) - HashTablesBuildTime: 61.056us - LargestPartitionPercent: 9 (9) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1073600) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 369.295ms, non-child: 27.452us, % non-child: 0.01%) BytesReceived(500.000ms): 0, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 7.668us - DeserializeRowBatchTimer: 15.813us - FirstBatchArrivalWaitTime: 347.171ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 324.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=9):(Total: 784.236ms, non-child: 784.236ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:123/7.72 GB 5:165/10.62 GB 3:151/9.84 GB 6:158/9.96 GB 1:136/8.82 GB 4:147/8.99 GB 0:152/9.83 GB 7:150/9.73 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 63 out of 63 Runtime filters: Only following filters arrived: 7, waited 402ms Hdfs Read Thread Concurrency Bucket: 0:81.82% 1:9.091% 2:4.545% 3:4.545% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1119 PARQUET/SNAPPY:63 BytesRead(500.000ms): 0, 0, 6.92 MB, 11.20 MB, 11.20 MB, 12.04 MB, 19.57 MB, 19.57 MB, 20.42 MB, 32.51 MB, 32.61 MB, 35.11 MB, 38.41 MB, 38.41 MB, 38.41 MB, 39.25 MB, 49.71 MB, 49.71 MB, 50.65 MB, 59.21 MB, 59.21 MB, 59.21 MB - FooterProcessingTime: (Avg: 52.799ms ; Min: 18.069ms ; Max: 175.189ms ; Number of samples: 63) - AverageHdfsReadThreadConcurrency: 0.32 - AverageScannerThreadConcurrency: 10.91 - BytesRead: 59.21 MB (62084788) - BytesReadDataNodeCache: 0 - BytesReadLocal: 59.21 MB (62084788) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 59.21 MB (62084788) - DecompressionTime: 379.491ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 63 (63) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 22.92 MB (24028733) - PerReadThreadRawHdfsThroughput: 29.39 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 214.404ms - RowBatchQueuePutWaitTime: 1m46s - RowsRead: 43.35M (43354353) - RowsReturned: 43.34M (43335460) - RowsReturnedRate: 55.26 M/sec - ScanRangesComplete: 1.18K (1182) - ScannerThreadsInvoluntaryContextSwitches: 1.25K (1253) - ScannerThreadsTotalWallClockTime: 1m58s - MaterializeTupleTime(*): 2s369ms - ScannerThreadsSysTime: 1s877ms - ScannerThreadsUserTime: 4s337ms - ScannerThreadsVoluntaryContextSwitches: 103.02K (103018) - TotalRawHdfsReadTime(*): 2s014ms - TotalReadThroughput: 5.38 MB/sec Filter 2 (16.00 MB): - Rows processed: 268.75K (268749) - Rows rejected: 18.89K (18893) - Rows total: 43.35M (43354353) Filter 7 (1.00 MB): - Files processed: 1.18K (1182) - Files rejected: 1.12K (1119) - Files total: 1.18K (1182) - RowGroups processed: 42.36K (42359) - RowGroups rejected: 0 (0) - RowGroups total: 42.36K (42359) - Rows processed: 1.03M (1032192) - Rows rejected: 0 (0) - Rows total: 43.34M (43335460) - Splits processed: 63 (63) - Splits rejected: 0 (0) - Splits total: 63 (63) Instance 7f40dcb034de70b7:13f (host=vc1505.foo:22000):(Total: 10s979ms, non-child: 2s926ms, % non-child: 26.66%) Hdfs split stats (:<# splits>/): 7:156/9.63 GB 5:151/9.17 GB 6:137/8.51 GB 4:149/10.03 GB 2:155/9.80 GB 1:159/9.82 GB 3:142/8.99 GB 0:144/9.50 GB Filter 7 arrival: 416ms Filter 2 arrival: 9s779ms MemoryUsage(500.000ms): 1.35 MB, 3.38 MB, 21.99 MB, 23.95 MB, 24.01 MB, 23.88 MB, 24.80 MB, 24.94 MB, 24.43 MB, 28.59 MB, 28.60 MB, 29.15 MB, 29.45 MB, 28.95 MB, 29.66 MB, 29.85 MB, 30.01 MB, 29.26 MB, 26.37 MB, 25.09 MB, 35.40 MB, 31.75 MB ThreadUsage(500.000ms): 1, 1, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 11.91 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 43.59 MB (45711882) - PerHostPeakMemUsage: 1.41 GB (1517636411) - RowsProduced: 40.36M (40355899) - TotalNetworkReceiveTime: 197.878ms - TotalNetworkSendTime: 2s987ms - TotalStorageWaitTime: 5s587ms - TotalThreadsInvoluntaryContextSwitches: 2.51K (2509) - TotalThreadsTotalWallClockTime: 2m11s - TotalThreadsSysTime: 3s953ms - TotalThreadsUserTime: 11s077ms - TotalThreadsVoluntaryContextSwitches: 183.82K (183822) Fragment Instance Lifecycle Timings: - ExecTime: 9s877ms - ExecTreeExecTime: 1s121ms - OpenTime: 1s055ms - ExecTreeOpenTime: 880.779ms - PrepareTime: 46.616ms - ExecTreePrepareTime: 3.210ms DataStreamSender (dst_id=23):(Total: 5s869ms, non-child: 5s869ms, % non-child: 100.00%) - BytesSent: 381.98 MB (400534680) - NetworkThroughput(*): 103.78 MB/sec - OverallThroughput: 65.08 MB/sec - PeakMemoryUsage: 4.76 MB (4996160) - RowsReturned: 40.36M (40355899) - SerializeBatchTime: 2s180ms - TransmitDataRPCTime: 3s680ms - UncompressedRowBatchSize: 1.28 GB (1372613526) CodeGen:(Total: 188.870ms, non-child: 188.870ms, % non-child: 100.00%) - CodegenTime: 1.036ms - CompileTime: 50.026ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 90 (90) - NumInstructions: 2.97K (2968) - OptimizationTime: 123.212ms - PeakMemoryUsage: 1.45 MB (1519616) - PrepareTime: 15.195ms HASH_JOIN_NODE (id=11):(Total: 1s994ms, non-child: 970.691ms, % non-child: 48.66%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.501ms - PeakMemoryUsage: 1.27 MB (1329409) - ProbeRows: 40.36M (40355899) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 921.517ms - RowsReturned: 40.36M (40355899) - RowsReturnedRate: 20.23 M/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 56.614us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 143.699us - HashBuckets: 212 (212) - HashCollisions: 0 (0) - HashTablesBuildTime: 61.837us - LargestPartitionPercent: 9 (9) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1073600) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 197.889ms, non-child: 29.815us, % non-child: 0.02%) BytesReceived(500.000ms): 0, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 4.637us - DeserializeRowBatchTimer: 41.536us - FirstBatchArrivalWaitTime: 181.354ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 606.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=9):(Total: 826.674ms, non-child: 826.674ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:156/9.63 GB 5:151/9.17 GB 6:137/8.51 GB 4:149/10.03 GB 2:155/9.80 GB 1:159/9.82 GB 3:142/8.99 GB 0:144/9.50 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 58 out of 58 Runtime filters: Only following filters arrived: 7, waited 602ms Hdfs Read Thread Concurrency Bucket: 0:90.48% 1:9.524% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1135 PARQUET/SNAPPY:58 BytesRead(500.000ms): 0, 0, 7.70 MB, 10.69 MB, 10.69 MB, 11.52 MB, 20.61 MB, 20.61 MB, 21.46 MB, 32.70 MB, 32.70 MB, 32.70 MB, 32.70 MB, 32.70 MB, 34.39 MB, 39.75 MB, 39.75 MB, 43.67 MB, 48.66 MB, 48.66 MB, 53.49 MB, 54.84 MB - FooterProcessingTime: (Avg: 54.029ms ; Min: 3.634ms ; Max: 134.297ms ; Number of samples: 58) - AverageHdfsReadThreadConcurrency: 0.10 - AverageScannerThreadConcurrency: 11.43 - BytesRead: 54.84 MB (57507020) - BytesReadDataNodeCache: 0 - BytesReadLocal: 54.84 MB (57507020) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 54.84 MB (57507020) - DecompressionTime: 349.664ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 58 (58) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 24.90 MB (26110924) - PerReadThreadRawHdfsThroughput: 24.97 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 76.501ms - RowBatchQueuePutWaitTime: 1m44s - RowsRead: 40.37M (40371571) - RowsReturned: 40.36M (40355899) - RowsReturnedRate: 48.82 M/sec - ScanRangesComplete: 1.19K (1193) - ScannerThreadsInvoluntaryContextSwitches: 1.65K (1650) - ScannerThreadsTotalWallClockTime: 2m - MaterializeTupleTime(*): 2s137ms - ScannerThreadsSysTime: 3s692ms - ScannerThreadsUserTime: 4s270ms - ScannerThreadsVoluntaryContextSwitches: 183.21K (183206) - TotalRawHdfsReadTime(*): 2s196ms - TotalReadThroughput: 4.99 MB/sec Filter 2 (16.00 MB): - Rows processed: 216.38K (216376) - Rows rejected: 15.67K (15672) - Rows total: 40.37M (40371571) Filter 7 (1.00 MB): - Files processed: 1.19K (1193) - Files rejected: 1.14K (1135) - Files total: 1.19K (1193) - RowGroups processed: 39.45K (39449) - RowGroups rejected: 0 (0) - RowGroups total: 39.45K (39449) - Rows processed: 936.11K (936105) - Rows rejected: 0 (0) - Rows total: 40.36M (40355899) - Splits processed: 58 (58) - Splits rejected: 0 (0) - Splits total: 58 (58) Instance 7f40dcb034de70b7:11b (host=vd1123.foo:22000):(Total: 10s963ms, non-child: 2s498ms, % non-child: 22.79%) Hdfs split stats (:<# splits>/): 0:152/9.90 GB 7:135/8.61 GB 1:124/7.65 GB 3:149/9.70 GB 4:131/8.71 GB 5:160/10.46 GB 2:145/9.46 GB 6:169/11.04 GB Filter 7 arrival: 534ms Filter 2 arrival: 9s300ms MemoryUsage(500.000ms): 1.38 MB, 3.38 MB, 26.33 MB, 26.74 MB, 26.08 MB, 27.54 MB, 27.20 MB, 27.35 MB, 25.39 MB, 26.71 MB, 27.05 MB, 27.44 MB, 27.44 MB, 26.74 MB, 26.82 MB, 27.35 MB, 21.75 MB, 26.03 MB, 41.27 MB, 42.13 MB, 41.33 MB ThreadUsage(500.000ms): 2, 1, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 11.90 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 42.71 MB (44785832) - PerHostPeakMemUsage: 1.42 GB (1519796275) - RowsProduced: 43.28M (43279527) - TotalNetworkReceiveTime: 319.802ms - TotalNetworkSendTime: 2s706ms - TotalStorageWaitTime: 5s995ms - TotalThreadsInvoluntaryContextSwitches: 2.63K (2627) - TotalThreadsTotalWallClockTime: 2m9s - TotalThreadsSysTime: 2s104ms - TotalThreadsUserTime: 10s772ms - TotalThreadsVoluntaryContextSwitches: 116.87K (116869) Fragment Instance Lifecycle Timings: - ExecTime: 9s826ms - ExecTreeExecTime: 1s123ms - OpenTime: 1s089ms - ExecTreeOpenTime: 919.083ms - PrepareTime: 48.093ms - ExecTreePrepareTime: 3.105ms DataStreamSender (dst_id=23):(Total: 6s243ms, non-child: 6s243ms, % non-child: 100.00%) - BytesSent: 410.84 MB (430794103) - NetworkThroughput(*): 105.20 MB/sec - OverallThroughput: 65.80 MB/sec - PeakMemoryUsage: 4.73 MB (4955200) - RowsReturned: 43.28M (43279527) - SerializeBatchTime: 2s330ms - TransmitDataRPCTime: 3s905ms - UncompressedRowBatchSize: 1.37 GB (1472053966) CodeGen:(Total: 188.110ms, non-child: 188.110ms, % non-child: 100.00%) - CodegenTime: 1.038ms - CompileTime: 50.156ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 90 (90) - NumInstructions: 2.97K (2968) - OptimizationTime: 118.215ms - PeakMemoryUsage: 1.45 MB (1519616) - PrepareTime: 19.316ms HASH_JOIN_NODE (id=11):(Total: 2s034ms, non-child: 966.415ms, % non-child: 47.51%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.480ms - PeakMemoryUsage: 1.27 MB (1328387) - ProbeRows: 43.28M (43279527) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 915.359ms - RowsReturned: 43.28M (43279527) - RowsReturnedRate: 21.28 M/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 27.059us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 149.658us - HashBuckets: 212 (212) - HashCollisions: 0 (0) - HashTablesBuildTime: 55.838us - LargestPartitionPercent: 9 (9) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1073600) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 319.812ms, non-child: 18.754us, % non-child: 0.01%) BytesReceived(500.000ms): 0, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 4.504us - DeserializeRowBatchTimer: 21.316us - FirstBatchArrivalWaitTime: 314.951ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 375.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=9):(Total: 748.186ms, non-child: 748.186ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:152/9.90 GB 7:135/8.61 GB 1:124/7.65 GB 3:149/9.70 GB 4:131/8.71 GB 5:160/10.46 GB 2:145/9.46 GB 6:169/11.04 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 61 out of 61 Runtime filters: Only following filters arrived: 7, waited 482ms Hdfs Read Thread Concurrency Bucket: 0:90.48% 1:4.762% 2:4.762% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1104 PARQUET/SNAPPY:61 BytesRead(500.000ms): 0, 0, 13.50 MB, 13.50 MB, 13.50 MB, 14.36 MB, 20.29 MB, 20.29 MB, 22.80 MB, 29.90 MB, 29.90 MB, 35.28 MB, 35.28 MB, 38.73 MB, 39.48 MB, 39.48 MB, 43.66 MB, 48.50 MB, 53.31 MB, 58.85 MB, 58.85 MB - FooterProcessingTime: (Avg: 62.786ms ; Min: 3.542ms ; Max: 499.971ms ; Number of samples: 61) - AverageHdfsReadThreadConcurrency: 0.14 - AverageScannerThreadConcurrency: 10.86 - BytesRead: 58.85 MB (61710724) - BytesReadDataNodeCache: 0 - BytesReadLocal: 58.85 MB (61710724) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 58.85 MB (61710724) - DecompressionTime: 329.266ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 61 (61) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 21.98 MB (23047420) - PerReadThreadRawHdfsThroughput: 25.40 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 111.607ms - RowBatchQueuePutWaitTime: 1m46s - RowsRead: 43.30M (43301182) - RowsReturned: 43.28M (43279527) - RowsReturnedRate: 57.85 M/sec - ScanRangesComplete: 1.17K (1165) - ScannerThreadsInvoluntaryContextSwitches: 1.63K (1633) - ScannerThreadsTotalWallClockTime: 1m58s - MaterializeTupleTime(*): 2s090ms - ScannerThreadsSysTime: 1s825ms - ScannerThreadsUserTime: 3s754ms - ScannerThreadsVoluntaryContextSwitches: 116.20K (116196) - TotalRawHdfsReadTime(*): 2s316ms - TotalReadThroughput: 5.60 MB/sec Filter 2 (16.00 MB): - Rows processed: 303.28K (303278) - Rows rejected: 21.66K (21655) - Rows total: 43.30M (43301182) Filter 7 (1.00 MB): - Files processed: 1.17K (1165) - Files rejected: 1.10K (1104) - Files total: 1.17K (1165) - RowGroups processed: 42.30K (42301) - RowGroups rejected: 0 (0) - RowGroups total: 42.30K (42301) - Rows processed: 999.42K (999424) - Rows rejected: 0 (0) - Rows total: 43.28M (43279527) - Splits processed: 61 (61) - Splits rejected: 0 (0) - Splits total: 61 (61) Instance 7f40dcb034de70b7:167 (host=vd1103.foo:22000):(Total: 10s959ms, non-child: 1s721ms, % non-child: 15.71%) Hdfs split stats (:<# splits>/): 3:148/9.73 GB 5:157/10.08 GB 6:141/9.27 GB 4:134/8.89 GB 0:168/10.16 GB 1:151/9.71 GB 7:146/9.04 GB 2:133/8.61 GB Filter 7 arrival: 242ms MemoryUsage(500.000ms): 3.38 MB, 3.38 MB, 25.83 MB, 25.91 MB, 26.33 MB, 26.17 MB, 25.98 MB, 27.35 MB, 25.52 MB, 26.17 MB, 26.09 MB, 26.27 MB, 26.27 MB, 28.09 MB, 25.89 MB, 27.42 MB, 26.22 MB, 25.92 MB, 26.72 MB, 25.76 MB, 24.64 MB, 4.38 MB ThreadUsage(500.000ms): 1, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 1 - AverageThreadTokens: 11.91 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 28.57 MB (29953617) - PerHostPeakMemUsage: 1.41 GB (1509083665) - RowsProduced: 44.42M (44422974) - TotalNetworkReceiveTime: 8.220ms - TotalNetworkSendTime: 2s151ms - TotalStorageWaitTime: 7s722ms - TotalThreadsInvoluntaryContextSwitches: 2.82K (2816) - TotalThreadsTotalWallClockTime: 2m13s - TotalThreadsSysTime: 3s667ms - TotalThreadsUserTime: 12s029ms - TotalThreadsVoluntaryContextSwitches: 150.62K (150618) Fragment Instance Lifecycle Timings: - ExecTime: 9s688ms - ExecTreeExecTime: 1s215ms - OpenTime: 1s216ms - ExecTreeOpenTime: 1s032ms - PrepareTime: 54.125ms - ExecTreePrepareTime: 3.143ms DataStreamSender (dst_id=23):(Total: 6s794ms, non-child: 6s794ms, % non-child: 100.00%) - BytesSent: 420.88 MB (441320647) - NetworkThroughput(*): 97.63 MB/sec - OverallThroughput: 61.95 MB/sec - PeakMemoryUsage: 4.83 MB (5061696) - RowsReturned: 44.42M (44422974) - SerializeBatchTime: 2s474ms - TransmitDataRPCTime: 4s310ms - UncompressedRowBatchSize: 1.41 GB (1510945756) CodeGen:(Total: 205.143ms, non-child: 205.143ms, % non-child: 100.00%) - CodegenTime: 1.082ms - CompileTime: 51.906ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 90 (90) - NumInstructions: 2.97K (2968) - OptimizationTime: 130.817ms - PeakMemoryUsage: 1.45 MB (1519616) - PrepareTime: 21.936ms HASH_JOIN_NODE (id=11):(Total: 2s239ms, non-child: 1s044ms, % non-child: 46.65%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.268ms - PeakMemoryUsage: 1.20 MB (1255232) - ProbeRows: 44.42M (44422974) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 991.137ms - RowsReturned: 44.42M (44422974) - RowsReturnedRate: 19.84 M/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 22.445us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 136.419us - HashBuckets: 212 (212) - HashCollisions: 0 (0) - HashTablesBuildTime: 43.225us - LargestPartitionPercent: 9 (9) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1073600) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 8.229ms, non-child: 15.068us, % non-child: 0.18%) BytesReceived(500.000ms): 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 4.781us - DeserializeRowBatchTimer: 13.541us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 14.58 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=9):(Total: 1s186ms, non-child: 1s186ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:148/9.73 GB 5:157/10.08 GB 6:141/9.27 GB 4:134/8.89 GB 0:168/10.16 GB 1:151/9.71 GB 7:146/9.04 GB 2:133/8.61 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 62 out of 62 Runtime filters: Only following filters arrived: 7, waited 763ms Hdfs Read Thread Concurrency Bucket: 0:80.95% 1:14.29% 2:4.762% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1116 PARQUET/SNAPPY:62 BytesRead(500.000ms): 0, 0, 11.86 MB, 11.86 MB, 12.71 MB, 12.81 MB, 19.35 MB, 20.80 MB, 29.70 MB, 31.20 MB, 31.20 MB, 33.75 MB, 33.75 MB, 40.54 MB, 40.54 MB, 42.79 MB, 49.44 MB, 49.44 MB, 53.43 MB, 60.10 MB, 60.10 MB - FooterProcessingTime: (Avg: 88.139ms ; Min: 13.731ms ; Max: 289.247ms ; Number of samples: 62) - AverageHdfsReadThreadConcurrency: 0.24 - AverageScannerThreadConcurrency: 11.43 - BytesRead: 60.10 MB (63023081) - BytesReadDataNodeCache: 0 - BytesReadLocal: 60.10 MB (63023081) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 60.10 MB (63023081) - DecompressionTime: 388.656ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 62 (62) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 22.76 MB (23869644) - PerReadThreadRawHdfsThroughput: 23.91 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 257.197ms - RowBatchQueuePutWaitTime: 1m42s - RowsRead: 44.42M (44422974) - RowsReturned: 44.42M (44422974) - RowsReturnedRate: 37.45 M/sec - ScanRangesComplete: 1.18K (1178) - ScannerThreadsInvoluntaryContextSwitches: 1.96K (1961) - ScannerThreadsTotalWallClockTime: 2m2s - MaterializeTupleTime(*): 2s306ms - ScannerThreadsSysTime: 3s349ms - ScannerThreadsUserTime: 4s610ms - ScannerThreadsVoluntaryContextSwitches: 149.98K (149980) - TotalRawHdfsReadTime(*): 2s513ms - TotalReadThroughput: 5.72 MB/sec Filter 2 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 44.42M (44422974) Filter 7 (1.00 MB): - Files processed: 1.18K (1178) - Files rejected: 1.12K (1116) - Files total: 1.18K (1178) - RowGroups processed: 43.43K (43433) - RowGroups rejected: 0 (0) - RowGroups total: 43.43K (43433) - Rows processed: 1.02M (1015808) - Rows rejected: 0 (0) - Rows total: 44.42M (44422974) - Splits processed: 62 (62) - Splits rejected: 0 (0) - Splits total: 62 (62) Instance 7f40dcb034de70b7:fc (host=ve1141.foo:22000):(Total: 10s937ms, non-child: 2s413ms, % non-child: 22.06%) Hdfs split stats (:<# splits>/): 6:152/9.55 GB 4:151/9.29 GB 1:128/8.15 GB 7:149/9.79 GB 0:152/10.08 GB 2:157/10.46 GB 5:137/9.10 GB 3:141/9.10 GB Filter 7 arrival: 658ms Filter 2 arrival: 8s908ms MemoryUsage(500.000ms): 1.38 MB, 3.38 MB, 24.10 MB, 23.92 MB, 24.08 MB, 24.28 MB, 27.08 MB, 26.86 MB, 25.42 MB, 28.92 MB, 29.12 MB, 29.07 MB, 29.30 MB, 22.77 MB, 25.98 MB, 27.12 MB, 25.07 MB, 43.26 MB, 43.38 MB, 39.48 MB, 37.18 MB ThreadUsage(500.000ms): 2, 1, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 11.90 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 43.84 MB (45972513) - PerHostPeakMemUsage: 1.41 GB (1518407985) - RowsProduced: 41.49M (41493264) - TotalNetworkReceiveTime: 430.818ms - TotalNetworkSendTime: 2s460ms - TotalStorageWaitTime: 6s189ms - TotalThreadsInvoluntaryContextSwitches: 2.76K (2762) - TotalThreadsTotalWallClockTime: 2m9s - TotalThreadsSysTime: 3s521ms - TotalThreadsUserTime: 11s810ms - TotalThreadsVoluntaryContextSwitches: 193.93K (193926) Fragment Instance Lifecycle Timings: - ExecTime: 9s703ms - ExecTreeExecTime: 1s105ms - OpenTime: 1s183ms - ExecTreeOpenTime: 1s004ms - PrepareTime: 50.321ms - ExecTreePrepareTime: 2.863ms DataStreamSender (dst_id=23):(Total: 6s222ms, non-child: 6s222ms, % non-child: 100.00%) - BytesSent: 393.40 MB (412505399) - NetworkThroughput(*): 102.57 MB/sec - OverallThroughput: 63.22 MB/sec - PeakMemoryUsage: 4.70 MB (4930624) - RowsReturned: 41.49M (41493264) - SerializeBatchTime: 2s378ms - TransmitDataRPCTime: 3s835ms - UncompressedRowBatchSize: 1.31 GB (1411298392) CodeGen:(Total: 202.021ms, non-child: 202.021ms, % non-child: 100.00%) - CodegenTime: 875.649us - CompileTime: 53.985ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 90 (90) - NumInstructions: 2.97K (2968) - OptimizationTime: 124.289ms - PeakMemoryUsage: 1.45 MB (1519616) - PrepareTime: 23.337ms HASH_JOIN_NODE (id=11):(Total: 2s099ms, non-child: 944.836ms, % non-child: 45.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.447ms - PeakMemoryUsage: 1.27 MB (1329740) - ProbeRows: 41.49M (41493264) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 883.434ms - RowsReturned: 41.49M (41493264) - RowsReturnedRate: 19.76 M/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 27.627us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 134.548us - HashBuckets: 212 (212) - HashCollisions: 0 (0) - HashTablesBuildTime: 55.072us - LargestPartitionPercent: 9 (9) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1073600) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 430.829ms, non-child: 19.812us, % non-child: 0.00%) BytesReceived(500.000ms): 0, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 5.653us - DeserializeRowBatchTimer: 15.382us - FirstBatchArrivalWaitTime: 403.547ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 278.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=9):(Total: 724.330ms, non-child: 724.330ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 6:152/9.55 GB 4:151/9.29 GB 1:128/8.15 GB 7:149/9.79 GB 0:152/10.08 GB 2:157/10.46 GB 5:137/9.10 GB 3:141/9.10 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 58 out of 58 Runtime filters: Only following filters arrived: 7, waited 342ms Hdfs Read Thread Concurrency Bucket: 0:85.71% 1:9.524% 2:0% 3:4.762% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1109 PARQUET/SNAPPY:58 BytesRead(500.000ms): 0, 0, 10.57 MB, 10.57 MB, 10.57 MB, 11.40 MB, 21.54 MB, 21.54 MB, 23.19 MB, 31.31 MB, 31.31 MB, 32.25 MB, 33.00 MB, 33.19 MB, 38.94 MB, 39.03 MB, 42.56 MB, 50.43 MB, 50.43 MB, 56.03 MB, 56.03 MB - FooterProcessingTime: (Avg: 61.416ms ; Min: 3.747ms ; Max: 208.831ms ; Number of samples: 58) - AverageHdfsReadThreadConcurrency: 0.24 - AverageScannerThreadConcurrency: 10.86 - BytesRead: 56.03 MB (58752994) - BytesReadDataNodeCache: 0 - BytesReadLocal: 56.03 MB (58752994) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 56.03 MB (58752994) - DecompressionTime: 348.450ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 58 (58) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 23.93 MB (25094199) - PerReadThreadRawHdfsThroughput: 25.96 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 222.664ms - RowBatchQueuePutWaitTime: 1m43s - RowsRead: 41.51M (41507170) - RowsReturned: 41.49M (41493264) - RowsReturnedRate: 57.28 M/sec - ScanRangesComplete: 1.17K (1167) - ScannerThreadsInvoluntaryContextSwitches: 1.86K (1863) - ScannerThreadsTotalWallClockTime: 1m58s - MaterializeTupleTime(*): 2s140ms - ScannerThreadsSysTime: 3s234ms - ScannerThreadsUserTime: 4s665ms - ScannerThreadsVoluntaryContextSwitches: 193.32K (193324) - TotalRawHdfsReadTime(*): 2s158ms - TotalReadThroughput: 5.34 MB/sec Filter 2 (16.00 MB): - Rows processed: 204.01K (204006) - Rows rejected: 13.91K (13906) - Rows total: 41.51M (41507170) Filter 7 (1.00 MB): - Files processed: 1.17K (1167) - Files rejected: 1.11K (1109) - Files total: 1.17K (1167) - RowGroups processed: 40.56K (40557) - RowGroups rejected: 0 (0) - RowGroups total: 40.56K (40557) - Rows processed: 950.27K (950272) - Rows rejected: 0 (0) - Rows total: 41.49M (41493264) - Splits processed: 58 (58) - Splits rejected: 0 (0) - Splits total: 58 (58) Instance 7f40dcb034de70b7:12a (host=vc1537.foo:22000):(Total: 10s936ms, non-child: 2s580ms, % non-child: 23.59%) Hdfs split stats (:<# splits>/): 3:150/9.40 GB 4:132/8.87 GB 1:135/8.75 GB 7:148/9.82 GB 0:142/9.61 GB 2:154/9.82 GB 6:137/9.03 GB 5:152/10.17 GB Filter 7 arrival: 474ms Filter 2 arrival: 9s528ms MemoryUsage(500.000ms): 445.84 KB, 3.38 MB, 3.38 MB, 27.83 MB, 28.05 MB, 28.45 MB, 29.00 MB, 30.13 MB, 30.20 MB, 26.82 MB, 26.92 MB, 26.22 MB, 27.36 MB, 27.36 MB, 28.75 MB, 28.94 MB, 26.84 MB, 25.21 MB, 25.98 MB, 42.32 MB, 38.18 MB, 35.96 MB ThreadUsage(500.000ms): 1, 1, 2, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 11.41 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 42.78 MB (44856971) - PerHostPeakMemUsage: 1.42 GB (1522270584) - RowsProduced: 41.36M (41362061) - TotalNetworkReceiveTime: 252.211ms - TotalNetworkSendTime: 2s864ms - TotalStorageWaitTime: 5s018ms - TotalThreadsInvoluntaryContextSwitches: 2.92K (2916) - TotalThreadsTotalWallClockTime: 2m9s - TotalThreadsSysTime: 3s662ms - TotalThreadsUserTime: 11s287ms - TotalThreadsVoluntaryContextSwitches: 153.85K (153851) Fragment Instance Lifecycle Timings: - ExecTime: 9s800ms - ExecTreeExecTime: 1s126ms - OpenTime: 1s085ms - ExecTreeOpenTime: 910.678ms - PrepareTime: 51.315ms - ExecTreePrepareTime: 3.166ms DataStreamSender (dst_id=23):(Total: 6s132ms, non-child: 6s132ms, % non-child: 100.00%) - BytesSent: 392.21 MB (411262824) - NetworkThroughput(*): 102.16 MB/sec - OverallThroughput: 63.96 MB/sec - PeakMemoryUsage: 4.73 MB (4955200) - RowsReturned: 41.36M (41362061) - SerializeBatchTime: 2s285ms - TransmitDataRPCTime: 3s839ms - UncompressedRowBatchSize: 1.31 GB (1406835866) CodeGen:(Total: 195.700ms, non-child: 195.700ms, % non-child: 100.00%) - CodegenTime: 1.130ms - CompileTime: 50.606ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 90 (90) - NumInstructions: 2.97K (2968) - OptimizationTime: 122.052ms - PeakMemoryUsage: 1.45 MB (1519616) - PrepareTime: 22.604ms HASH_JOIN_NODE (id=11):(Total: 2s028ms, non-child: 981.612ms, % non-child: 48.39%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.579ms - PeakMemoryUsage: 1.27 MB (1326530) - ProbeRows: 41.36M (41362061) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 932.729ms - RowsReturned: 41.36M (41362061) - RowsReturnedRate: 20.39 M/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 35.264us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 186.872us - HashBuckets: 212 (212) - HashCollisions: 0 (0) - HashTablesBuildTime: 83.082us - LargestPartitionPercent: 9 (9) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1073600) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 252.221ms, non-child: 24.705us, % non-child: 0.01%) BytesReceived(500.000ms): 0, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 4.805us - DeserializeRowBatchTimer: 21.734us - FirstBatchArrivalWaitTime: 251.385ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 475.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=9):(Total: 794.899ms, non-child: 794.899ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:150/9.40 GB 4:132/8.87 GB 1:135/8.75 GB 7:148/9.82 GB 0:142/9.61 GB 2:154/9.82 GB 6:137/9.03 GB 5:152/10.17 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 55 out of 55 Runtime filters: Only following filters arrived: 7, waited 542ms Hdfs Read Thread Concurrency Bucket: 0:85.71% 1:14.29% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1095 PARQUET/SNAPPY:55 BytesRead(500.000ms): 0, 0, 0, 12.95 MB, 12.95 MB, 13.81 MB, 15.95 MB, 20.39 MB, 20.39 MB, 28.63 MB, 29.97 MB, 30.81 MB, 33.04 MB, 33.04 MB, 39.84 MB, 39.84 MB, 40.69 MB, 44.04 MB, 47.37 MB, 49.05 MB, 55.28 MB, 55.28 MB - FooterProcessingTime: (Avg: 54.362ms ; Min: 3.581ms ; Max: 163.781ms ; Number of samples: 55) - AverageHdfsReadThreadConcurrency: 0.14 - AverageScannerThreadConcurrency: 10.90 - BytesRead: 55.28 MB (57968767) - BytesReadDataNodeCache: 0 - BytesReadLocal: 55.28 MB (57968767) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 55.28 MB (57968767) - DecompressionTime: 357.465ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 55 (55) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 25.85 MB (27108185) - PerReadThreadRawHdfsThroughput: 28.37 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 108.797ms - RowBatchQueuePutWaitTime: 1m45s - RowsRead: 41.38M (41378157) - RowsReturned: 41.36M (41362061) - RowsReturnedRate: 52.03 M/sec - ScanRangesComplete: 1.15K (1150) - ScannerThreadsInvoluntaryContextSwitches: 1.99K (1988) - ScannerThreadsTotalWallClockTime: 1m57s - MaterializeTupleTime(*): 2s088ms - ScannerThreadsSysTime: 3s376ms - ScannerThreadsUserTime: 4s454ms - ScannerThreadsVoluntaryContextSwitches: 153.19K (153194) - TotalRawHdfsReadTime(*): 1s948ms - TotalReadThroughput: 5.03 MB/sec Filter 2 (16.00 MB): - Rows processed: 223.97K (223968) - Rows rejected: 16.10K (16096) - Rows total: 41.38M (41378157) Filter 7 (1.00 MB): - Files processed: 1.15K (1150) - Files rejected: 1.09K (1095) - Files total: 1.15K (1150) - RowGroups processed: 40.42K (40424) - RowGroups rejected: 0 (0) - RowGroups total: 40.42K (40424) - Rows processed: 901.12K (901120) - Rows rejected: 0 (0) - Rows total: 41.36M (41362061) - Splits processed: 55 (55) - Splits rejected: 0 (0) - Splits total: 55 (55) Instance 7f40dcb034de70b7:142 (host=vd1122.foo:22000):(Total: 10s923ms, non-child: 2s076ms, % non-child: 19.01%) Hdfs split stats (:<# splits>/): 7:147/8.59 GB 4:136/8.49 GB 3:148/9.75 GB 0:153/10.04 GB 2:154/10.21 GB 5:165/10.23 GB 6:148/8.97 GB 1:146/9.14 GB Filter 7 arrival: 399ms Filter 2 arrival: 10s406ms MemoryUsage(500.000ms): 2.79 MB, 3.38 MB, 5.29 MB, 23.84 MB, 23.64 MB, 26.19 MB, 33.10 MB, 33.10 MB, 33.38 MB, 33.85 MB, 34.32 MB, 32.38 MB, 28.28 MB, 28.43 MB, 28.21 MB, 28.07 MB, 29.65 MB, 29.96 MB, 28.54 MB, 28.83 MB, 29.28 MB, 36.10 MB ThreadUsage(500.000ms): 1, 1, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 11.91 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 44.46 MB (46618851) - PerHostPeakMemUsage: 1.39 GB (1496345870) - RowsProduced: 44.47M (44472974) - TotalNetworkReceiveTime: 173.235ms - TotalNetworkSendTime: 2s529ms - TotalStorageWaitTime: 6s452ms - TotalThreadsInvoluntaryContextSwitches: 2.23K (2226) - TotalThreadsTotalWallClockTime: 2m8s - TotalThreadsSysTime: 2s209ms - TotalThreadsUserTime: 11s079ms - TotalThreadsVoluntaryContextSwitches: 141.17K (141172) Fragment Instance Lifecycle Timings: - ExecTime: 9s811ms - ExecTreeExecTime: 1s101ms - OpenTime: 1s069ms - ExecTreeOpenTime: 883.651ms - PrepareTime: 42.972ms - ExecTreePrepareTime: 2.864ms DataStreamSender (dst_id=23):(Total: 6s664ms, non-child: 6s664ms, % non-child: 100.00%) - BytesSent: 421.70 MB (442181327) - NetworkThroughput(*): 100.59 MB/sec - OverallThroughput: 63.28 MB/sec - PeakMemoryUsage: 4.69 MB (4914240) - RowsReturned: 44.47M (44472974) - SerializeBatchTime: 2s463ms - TransmitDataRPCTime: 4s192ms - UncompressedRowBatchSize: 1.41 GB (1512646404) CodeGen:(Total: 204.384ms, non-child: 204.384ms, % non-child: 100.00%) - CodegenTime: 866.336us - CompileTime: 62.434ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 90 (90) - NumInstructions: 2.97K (2968) - OptimizationTime: 121.724ms - PeakMemoryUsage: 1.45 MB (1519616) - PrepareTime: 19.806ms HASH_JOIN_NODE (id=11):(Total: 1s977ms, non-child: 960.061ms, % non-child: 48.54%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.663ms - PeakMemoryUsage: 1.27 MB (1328786) - ProbeRows: 44.47M (44472974) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 911.739ms - RowsReturned: 44.47M (44472974) - RowsReturnedRate: 22.49 M/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 26.949us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 163.284us - HashBuckets: 212 (212) - HashCollisions: 0 (0) - HashTablesBuildTime: 54.506us - LargestPartitionPercent: 9 (9) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1073600) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 173.246ms, non-child: 18.576us, % non-child: 0.01%) BytesReceived(500.000ms): 0, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 5.613us - DeserializeRowBatchTimer: 22.639us - FirstBatchArrivalWaitTime: 163.368ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 692.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=9):(Total: 845.006ms, non-child: 845.006ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:147/8.59 GB 4:136/8.49 GB 3:148/9.75 GB 0:153/10.04 GB 2:154/10.21 GB 5:165/10.23 GB 6:148/8.97 GB 1:146/9.14 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 57 out of 57 Runtime filters: Only following filters arrived: 7, waited 603ms Hdfs Read Thread Concurrency Bucket: 0:85.71% 1:9.524% 2:0% 3:0% 4:4.762% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1140 PARQUET/SNAPPY:57 BytesRead(500.000ms): 0, 0, 100.00 KB, 11.25 MB, 11.25 MB, 12.75 MB, 25.68 MB, 25.68 MB, 25.68 MB, 29.64 MB, 29.64 MB, 31.32 MB, 38.54 MB, 38.54 MB, 38.54 MB, 39.38 MB, 47.33 MB, 48.63 MB, 51.73 MB, 57.93 MB, 57.93 MB, 58.77 MB - FooterProcessingTime: (Avg: 58.436ms ; Min: 4.481ms ; Max: 151.099ms ; Number of samples: 57) - AverageHdfsReadThreadConcurrency: 0.29 - AverageScannerThreadConcurrency: 11.43 - BytesRead: 58.77 MB (61623912) - BytesReadDataNodeCache: 0 - BytesReadLocal: 58.77 MB (61623912) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 58.77 MB (61623912) - DecompressionTime: 377.369ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 57 (57) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 28.89 MB (30289408) - PerReadThreadRawHdfsThroughput: 25.08 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 96.786ms - RowBatchQueuePutWaitTime: 1m45s - RowsRead: 44.48M (44479453) - RowsReturned: 44.47M (44472974) - RowsReturnedRate: 52.63 M/sec - ScanRangesComplete: 1.20K (1197) - ScannerThreadsInvoluntaryContextSwitches: 1.39K (1389) - ScannerThreadsTotalWallClockTime: 1m57s - MaterializeTupleTime(*): 2s093ms - ScannerThreadsSysTime: 1s908ms - ScannerThreadsUserTime: 3s894ms - ScannerThreadsVoluntaryContextSwitches: 140.42K (140422) - TotalRawHdfsReadTime(*): 2s342ms - TotalReadThroughput: 5.34 MB/sec Filter 2 (16.00 MB): - Rows processed: 94.54K (94543) - Rows rejected: 6.48K (6479) - Rows total: 44.48M (44479453) Filter 7 (1.00 MB): - Files processed: 1.20K (1197) - Files rejected: 1.14K (1140) - Files total: 1.20K (1197) - RowGroups processed: 43.47K (43470) - RowGroups rejected: 0 (0) - RowGroups total: 43.47K (43470) - Rows processed: 933.89K (933888) - Rows rejected: 0 (0) - Rows total: 44.47M (44472974) - Splits processed: 57 (57) - Splits rejected: 0 (0) - Splits total: 57 (57) Instance 7f40dcb034de70b7:174 (host=va1030.foo:22000):(Total: 10s898ms, non-child: 2s463ms, % non-child: 22.60%) Hdfs split stats (:<# splits>/): 1:125/7.34 GB 3:160/9.74 GB 5:151/10.03 GB 6:163/10.51 GB 7:132/8.17 GB 2:154/9.72 GB 0:147/9.53 GB 4:162/10.42 GB Filter 7 arrival: 234ms MemoryUsage(500.000ms): 42.25 KB, 3.38 MB, 4.52 MB, 25.85 MB, 25.70 MB, 26.52 MB, 27.11 MB, 26.97 MB, 26.33 MB, 24.89 MB, 25.13 MB, 26.39 MB, 26.34 MB, 22.04 MB, 26.91 MB, 27.19 MB, 24.35 MB, 27.63 MB, 27.85 MB, 26.00 MB, 23.30 MB, 20.01 MB ThreadUsage(500.000ms): 1, 1, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 11.91 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 28.42 MB (29796599) - PerHostPeakMemUsage: 1.40 GB (1498598359) - RowsProduced: 41.09M (41091610) - TotalNetworkReceiveTime: 4.106us - TotalNetworkSendTime: 2s833ms - TotalStorageWaitTime: 6s055ms - TotalThreadsInvoluntaryContextSwitches: 2.54K (2538) - TotalThreadsTotalWallClockTime: 2m12s - TotalThreadsSysTime: 3s393ms - TotalThreadsUserTime: 11s110ms - TotalThreadsVoluntaryContextSwitches: 182.15K (182146) Fragment Instance Lifecycle Timings: - ExecTime: 9s650ms - ExecTreeExecTime: 1s051ms - OpenTime: 1s189ms - ExecTreeOpenTime: 1s009ms - PrepareTime: 58.655ms - ExecTreePrepareTime: 3.322ms DataStreamSender (dst_id=23):(Total: 6s178ms, non-child: 6s178ms, % non-child: 100.00%) - BytesSent: 389.72 MB (408648210) - NetworkThroughput(*): 99.80 MB/sec - OverallThroughput: 63.07 MB/sec - PeakMemoryUsage: 4.72 MB (4947008) - RowsReturned: 41.09M (41091610) - SerializeBatchTime: 2s266ms - TransmitDataRPCTime: 3s904ms - UncompressedRowBatchSize: 1.30 GB (1397637068) CodeGen:(Total: 202.168ms, non-child: 202.168ms, % non-child: 100.00%) - CodegenTime: 1.025ms - CompileTime: 51.928ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 90 (90) - NumInstructions: 2.97K (2968) - OptimizationTime: 126.427ms - PeakMemoryUsage: 1.45 MB (1519616) - PrepareTime: 23.362ms HASH_JOIN_NODE (id=11):(Total: 2s054ms, non-child: 911.234ms, % non-child: 44.36%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.458ms - PeakMemoryUsage: 1.20 MB (1255232) - ProbeRows: 41.09M (41091610) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 862.999ms - RowsReturned: 41.09M (41091610) - RowsReturnedRate: 20.00 M/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 22.848us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 144.582us - HashBuckets: 212 (212) - HashCollisions: 0 (0) - HashTablesBuildTime: 54.146us - LargestPartitionPercent: 9 (9) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1073600) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 13.190us, non-child: 13.190us, % non-child: 100.00%) BytesReceived(500.000ms): 0, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 4.380us - DeserializeRowBatchTimer: 34.126us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 9.10 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=9):(Total: 1s143ms, non-child: 1s143ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:125/7.34 GB 3:160/9.74 GB 5:151/10.03 GB 6:163/10.51 GB 7:132/8.17 GB 2:154/9.72 GB 0:147/9.53 GB 4:162/10.42 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 59 out of 59 Runtime filters: Only following filters arrived: 7, waited 783ms Hdfs Read Thread Concurrency Bucket: 0:90.48% 1:9.524% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1135 PARQUET/SNAPPY:59 BytesRead(500.000ms): 0, 0, 0, 12.01 MB, 12.01 MB, 12.01 MB, 19.26 MB, 20.10 MB, 20.95 MB, 29.07 MB, 29.92 MB, 31.34 MB, 31.34 MB, 33.00 MB, 39.83 MB, 40.68 MB, 40.68 MB, 48.94 MB, 49.04 MB, 50.75 MB, 55.93 MB, 55.93 MB - FooterProcessingTime: (Avg: 66.585ms ; Min: 3.812ms ; Max: 248.114ms ; Number of samples: 59) - AverageHdfsReadThreadConcurrency: 0.10 - AverageScannerThreadConcurrency: 11.43 - BytesRead: 55.93 MB (58643922) - BytesReadDataNodeCache: 0 - BytesReadLocal: 55.93 MB (58643922) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 55.93 MB (58643922) - DecompressionTime: 322.031ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 59 (59) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 22.69 MB (23796356) - PerReadThreadRawHdfsThroughput: 26.94 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 222.994ms - RowBatchQueuePutWaitTime: 1m43s - RowsRead: 41.09M (41091610) - RowsReturned: 41.09M (41091610) - RowsReturnedRate: 35.95 M/sec - ScanRangesComplete: 1.19K (1194) - ScannerThreadsInvoluntaryContextSwitches: 1.74K (1743) - ScannerThreadsTotalWallClockTime: 2m1s - MaterializeTupleTime(*): 1s969ms - ScannerThreadsSysTime: 3s133ms - ScannerThreadsUserTime: 4s358ms - ScannerThreadsVoluntaryContextSwitches: 181.53K (181534) - TotalRawHdfsReadTime(*): 2s076ms - TotalReadThroughput: 5.08 MB/sec Filter 2 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 41.09M (41091610) Filter 7 (1.00 MB): - Files processed: 1.19K (1194) - Files rejected: 1.14K (1135) - Files total: 1.19K (1194) - RowGroups processed: 40.18K (40176) - RowGroups rejected: 0 (0) - RowGroups total: 40.18K (40176) - Rows processed: 966.66K (966656) - Rows rejected: 0 (0) - Rows total: 41.09M (41091610) - Splits processed: 59 (59) - Splits rejected: 0 (0) - Splits total: 59 (59) Instance 7f40dcb034de70b7:ff (host=vd1124.foo:22000):(Total: 10s892ms, non-child: 2s350ms, % non-child: 21.58%) Hdfs split stats (:<# splits>/): 5:141/9.03 GB 2:152/9.91 GB 3:158/9.61 GB 1:139/8.52 GB 6:152/9.66 GB 4:150/9.72 GB 0:153/10.11 GB 7:146/8.90 GB Filter 7 arrival: 648ms Filter 2 arrival: 8s950ms MemoryUsage(500.000ms): 1.38 MB, 3.38 MB, 26.99 MB, 27.04 MB, 27.06 MB, 28.29 MB, 28.07 MB, 27.10 MB, 19.75 MB, 24.05 MB, 24.38 MB, 21.99 MB, 23.46 MB, 23.05 MB, 23.98 MB, 25.71 MB, 27.24 MB, 29.01 MB, 45.24 MB, 45.43 MB, 39.71 MB ThreadUsage(500.000ms): 2, 1, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 11.90 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 45.76 MB (47987240) - PerHostPeakMemUsage: 1.39 GB (1495463298) - RowsProduced: 40.02M (40020073) - TotalNetworkReceiveTime: 438.672ms - TotalNetworkSendTime: 2s780ms - TotalStorageWaitTime: 5s974ms - TotalThreadsInvoluntaryContextSwitches: 2.35K (2348) - TotalThreadsTotalWallClockTime: 2m8s - TotalThreadsSysTime: 2s060ms - TotalThreadsUserTime: 10s694ms - TotalThreadsVoluntaryContextSwitches: 181.82K (181823) Fragment Instance Lifecycle Timings: - ExecTime: 9s689ms - ExecTreeExecTime: 1s301ms - OpenTime: 1s158ms - ExecTreeOpenTime: 990.145ms - PrepareTime: 44.436ms - ExecTreePrepareTime: 2.749ms DataStreamSender (dst_id=23):(Total: 6s072ms, non-child: 6s072ms, % non-child: 100.00%) - BytesSent: 379.74 MB (398183812) - NetworkThroughput(*): 97.96 MB/sec - OverallThroughput: 62.54 MB/sec - PeakMemoryUsage: 4.70 MB (4930624) - RowsReturned: 40.02M (40020073) - SerializeBatchTime: 2s188ms - TransmitDataRPCTime: 3s876ms - UncompressedRowBatchSize: 1.27 GB (1361191242) CodeGen:(Total: 186.299ms, non-child: 186.299ms, % non-child: 100.00%) - CodegenTime: 918.019us - CompileTime: 50.329ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 90 (90) - NumInstructions: 2.97K (2968) - OptimizationTime: 116.163ms - PeakMemoryUsage: 1.45 MB (1519616) - PrepareTime: 19.429ms HASH_JOIN_NODE (id=11):(Total: 2s282ms, non-child: 934.190ms, % non-child: 40.93%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.500ms - PeakMemoryUsage: 1.27 MB (1330213) - ProbeRows: 40.02M (40020073) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 885.227ms - RowsReturned: 40.02M (40020073) - RowsReturnedRate: 17.53 M/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 29.905us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 168.509us - HashBuckets: 212 (212) - HashCollisions: 0 (0) - HashTablesBuildTime: 62.051us - LargestPartitionPercent: 9 (9) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1073600) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 438.683ms, non-child: 22.340us, % non-child: 0.01%) BytesReceived(500.000ms): 0, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 4.725us - DeserializeRowBatchTimer: 19.191us - FirstBatchArrivalWaitTime: 415.630ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 273.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=9):(Total: 910.085ms, non-child: 910.085ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:141/9.03 GB 2:152/9.91 GB 3:158/9.61 GB 1:139/8.52 GB 6:152/9.66 GB 4:150/9.72 GB 0:153/10.11 GB 7:146/8.90 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 57 out of 57 Runtime filters: Only following filters arrived: 7, waited 361ms Hdfs Read Thread Concurrency Bucket: 0:85.71% 1:14.29% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1134 PARQUET/SNAPPY:57 BytesRead(500.000ms): 0, 0, 12.43 MB, 12.43 MB, 12.43 MB, 13.84 MB, 19.75 MB, 20.61 MB, 24.01 MB, 28.91 MB, 28.91 MB, 29.76 MB, 31.36 MB, 31.36 MB, 39.26 MB, 41.00 MB, 44.89 MB, 50.25 MB, 51.93 MB, 52.76 MB, 54.43 MB - FooterProcessingTime: (Avg: 59.090ms ; Min: 7.139ms ; Max: 227.348ms ; Number of samples: 57) - AverageHdfsReadThreadConcurrency: 0.10 - AverageScannerThreadConcurrency: 10.86 - BytesRead: 54.43 MB (57075111) - BytesReadDataNodeCache: 0 - BytesReadLocal: 54.43 MB (57075111) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 54.43 MB (57075111) - DecompressionTime: 319.657ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 57 (57) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 24.08 MB (25251852) - PerReadThreadRawHdfsThroughput: 25.31 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 184.553ms - RowBatchQueuePutWaitTime: 1m45s - RowsRead: 40.03M (40034973) - RowsReturned: 40.02M (40020073) - RowsReturnedRate: 43.97 M/sec - ScanRangesComplete: 1.19K (1191) - ScannerThreadsInvoluntaryContextSwitches: 1.48K (1476) - ScannerThreadsTotalWallClockTime: 1m57s - MaterializeTupleTime(*): 1s956ms - ScannerThreadsSysTime: 1s755ms - ScannerThreadsUserTime: 4s131ms - ScannerThreadsVoluntaryContextSwitches: 181.16K (181162) - TotalRawHdfsReadTime(*): 2s150ms - TotalReadThroughput: 5.18 MB/sec Filter 2 (16.00 MB): - Rows processed: 215.60K (215604) - Rows rejected: 14.90K (14900) - Rows total: 40.03M (40034973) Filter 7 (1.00 MB): - Files processed: 1.19K (1191) - Files rejected: 1.13K (1134) - Files total: 1.19K (1191) - RowGroups processed: 39.12K (39116) - RowGroups rejected: 0 (0) - RowGroups total: 39.12K (39116) - Rows processed: 933.89K (933888) - Rows rejected: 0 (0) - Rows total: 40.02M (40020073) - Splits processed: 57 (57) - Splits rejected: 0 (0) - Splits total: 57 (57) Instance 7f40dcb034de70b7:116 (host=ve1130.foo:22000):(Total: 10s875ms, non-child: 2s524ms, % non-child: 23.21%) Hdfs split stats (:<# splits>/): 7:151/9.48 GB 3:167/10.38 GB 5:142/9.37 GB 1:141/9.20 GB 4:143/9.73 GB 2:152/9.56 GB 6:135/8.47 GB 0:150/9.29 GB Filter 7 arrival: 559ms Filter 2 arrival: 9s277ms MemoryUsage(500.000ms): 0, 1.38 MB, 3.38 MB, 25.51 MB, 25.61 MB, 26.50 MB, 24.44 MB, 28.16 MB, 28.37 MB, 27.81 MB, 28.01 MB, 27.89 MB, 28.50 MB, 28.50 MB, 25.92 MB, 27.47 MB, 27.70 MB, 26.01 MB, 25.31 MB, 42.39 MB, 37.26 MB, 34.60 MB ThreadUsage(500.000ms): 1, 2, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 11.95 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 42.86 MB (44938289) - PerHostPeakMemUsage: 1.39 GB (1497579035) - RowsProduced: 40.51M (40509726) - TotalNetworkReceiveTime: 338.608ms - TotalNetworkSendTime: 2s549ms - TotalStorageWaitTime: 5s738ms - TotalThreadsInvoluntaryContextSwitches: 2.76K (2758) - TotalThreadsTotalWallClockTime: 2m8s - TotalThreadsSysTime: 4s199ms - TotalThreadsUserTime: 11s507ms - TotalThreadsVoluntaryContextSwitches: 214.57K (214572) Fragment Instance Lifecycle Timings: - ExecTime: 9s736ms - ExecTreeExecTime: 1s181ms - OpenTime: 1s088ms - ExecTreeOpenTime: 913.501ms - PrepareTime: 49.782ms - ExecTreePrepareTime: 3.187ms DataStreamSender (dst_id=23):(Total: 6s069ms, non-child: 6s069ms, % non-child: 100.00%) - BytesSent: 384.02 MB (402672031) - NetworkThroughput(*): 102.86 MB/sec - OverallThroughput: 63.27 MB/sec - PeakMemoryUsage: 4.73 MB (4963392) - RowsReturned: 40.51M (40509726) - SerializeBatchTime: 2s328ms - TransmitDataRPCTime: 3s733ms - UncompressedRowBatchSize: 1.28 GB (1377845660) CodeGen:(Total: 195.383ms, non-child: 195.383ms, % non-child: 100.00%) - CodegenTime: 1.001ms - CompileTime: 51.573ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 90 (90) - NumInstructions: 2.97K (2968) - OptimizationTime: 122.042ms - PeakMemoryUsage: 1.45 MB (1519616) - PrepareTime: 21.338ms HASH_JOIN_NODE (id=11):(Total: 2s086ms, non-child: 1s031ms, % non-child: 49.46%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.478ms - PeakMemoryUsage: 1.27 MB (1331449) - ProbeRows: 40.51M (40509726) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 973.211ms - RowsReturned: 40.51M (40509726) - RowsReturnedRate: 19.42 M/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 30.065us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 137.300us - HashBuckets: 212 (212) - HashCollisions: 0 (0) - HashTablesBuildTime: 64.482us - LargestPartitionPercent: 9 (9) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1073600) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 338.618ms, non-child: 20.962us, % non-child: 0.01%) BytesReceived(500.000ms): 0, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 5.494us - DeserializeRowBatchTimer: 17.467us - FirstBatchArrivalWaitTime: 337.201ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 354.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=9):(Total: 716.180ms, non-child: 716.180ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:151/9.48 GB 3:167/10.38 GB 5:142/9.37 GB 1:141/9.20 GB 4:143/9.73 GB 2:152/9.56 GB 6:135/8.47 GB 0:150/9.29 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 58 out of 58 Runtime filters: Only following filters arrived: 7, waited 442ms Hdfs Read Thread Concurrency Bucket: 0:85.71% 1:9.524% 2:0% 3:4.762% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1123 PARQUET/SNAPPY:58 BytesRead(500.000ms): 0, 0, 0, 11.41 MB, 11.41 MB, 12.26 MB, 15.77 MB, 20.02 MB, 20.95 MB, 28.00 MB, 30.17 MB, 31.01 MB, 31.01 MB, 31.01 MB, 34.95 MB, 38.32 MB, 39.16 MB, 41.63 MB, 46.66 MB, 51.12 MB, 55.07 MB, 55.07 MB - FooterProcessingTime: (Avg: 57.582ms ; Min: 20.608ms ; Max: 167.308ms ; Number of samples: 58) - AverageHdfsReadThreadConcurrency: 0.24 - AverageScannerThreadConcurrency: 11.43 - BytesRead: 55.07 MB (57742455) - BytesReadDataNodeCache: 0 - BytesReadLocal: 55.07 MB (57742455) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 55.07 MB (57742455) - DecompressionTime: 347.132ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 58 (58) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 22.96 MB (24075829) - PerReadThreadRawHdfsThroughput: 22.04 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 129.399ms - RowBatchQueuePutWaitTime: 1m43s - RowsRead: 40.53M (40526371) - RowsReturned: 40.51M (40509726) - RowsReturnedRate: 56.56 M/sec - ScanRangesComplete: 1.18K (1181) - ScannerThreadsInvoluntaryContextSwitches: 1.84K (1841) - ScannerThreadsTotalWallClockTime: 1m57s - MaterializeTupleTime(*): 2s108ms - ScannerThreadsSysTime: 3s927ms - ScannerThreadsUserTime: 4s411ms - ScannerThreadsVoluntaryContextSwitches: 213.96K (213961) - TotalRawHdfsReadTime(*): 2s498ms - TotalReadThroughput: 5.01 MB/sec Filter 2 (16.00 MB): - Rows processed: 236.81K (236805) - Rows rejected: 16.64K (16645) - Rows total: 40.53M (40526371) Filter 7 (1.00 MB): - Files processed: 1.18K (1181) - Files rejected: 1.12K (1123) - Files total: 1.18K (1181) - RowGroups processed: 39.59K (39594) - RowGroups rejected: 0 (0) - RowGroups total: 39.59K (39594) - Rows processed: 950.27K (950272) - Rows rejected: 0 (0) - Rows total: 40.51M (40509726) - Splits processed: 58 (58) - Splits rejected: 0 (0) - Splits total: 58 (58) Instance 7f40dcb034de70b7:16f (host=va1032.foo:22000):(Total: 10s854ms, non-child: 2s716ms, % non-child: 25.02%) Hdfs split stats (:<# splits>/): 0:161/10.13 GB 7:137/8.94 GB 4:142/8.75 GB 6:144/9.49 GB 3:150/9.66 GB 1:157/10.60 GB 5:139/8.23 GB 2:154/9.69 GB Filter 7 arrival: 219ms MemoryUsage(500.000ms): 0, 3.38 MB, 3.38 MB, 28.07 MB, 27.88 MB, 28.06 MB, 28.31 MB, 28.36 MB, 28.30 MB, 27.12 MB, 25.95 MB, 26.20 MB, 26.20 MB, 25.93 MB, 26.08 MB, 26.30 MB, 29.09 MB, 29.28 MB, 29.78 MB, 30.20 MB, 31.23 MB, 20.84 MB ThreadUsage(500.000ms): 1, 1, 1, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 11.36 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 31.48 MB (33007693) - PerHostPeakMemUsage: 1.39 GB (1492979060) - RowsProduced: 39.79M (39791614) - TotalNetworkReceiveTime: 4.104us - TotalNetworkSendTime: 2s882ms - TotalStorageWaitTime: 6s241ms - TotalThreadsInvoluntaryContextSwitches: 2.48K (2478) - TotalThreadsTotalWallClockTime: 2m7s - TotalThreadsSysTime: 3s588ms - TotalThreadsUserTime: 10s851ms - TotalThreadsVoluntaryContextSwitches: 190.27K (190271) Fragment Instance Lifecycle Timings: - ExecTime: 9s622ms - ExecTreeExecTime: 1s027ms - OpenTime: 1s182ms - ExecTreeOpenTime: 1s009ms - PrepareTime: 49.776ms - ExecTreePrepareTime: 3.398ms DataStreamSender (dst_id=23):(Total: 5s916ms, non-child: 5s916ms, % non-child: 100.00%) - BytesSent: 376.87 MB (395179207) - NetworkThroughput(*): 102.33 MB/sec - OverallThroughput: 63.70 MB/sec - PeakMemoryUsage: 4.79 MB (5020736) - RowsReturned: 39.79M (39791614) - SerializeBatchTime: 2s225ms - TransmitDataRPCTime: 3s683ms - UncompressedRowBatchSize: 1.26 GB (1353420772) CodeGen:(Total: 192.022ms, non-child: 192.022ms, % non-child: 100.00%) - CodegenTime: 1.091ms - CompileTime: 50.371ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 90 (90) - NumInstructions: 2.97K (2968) - OptimizationTime: 121.070ms - PeakMemoryUsage: 1.45 MB (1519616) - PrepareTime: 20.136ms HASH_JOIN_NODE (id=11):(Total: 2s029ms, non-child: 873.858ms, % non-child: 43.06%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.451ms - PeakMemoryUsage: 1.20 MB (1255232) - ProbeRows: 39.79M (39791614) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 818.717ms - RowsReturned: 39.79M (39791614) - RowsReturnedRate: 19.61 M/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 23.868us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 123.765us - HashBuckets: 212 (212) - HashCollisions: 0 (0) - HashTablesBuildTime: 56.877us - LargestPartitionPercent: 9 (9) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1073600) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 14.093us, non-child: 14.093us, % non-child: 100.00%) BytesReceived(500.000ms): 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 4.484us - DeserializeRowBatchTimer: 19.071us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 8.51 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=9):(Total: 1s155ms, non-child: 1s155ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:161/10.13 GB 7:137/8.94 GB 4:142/8.75 GB 6:144/9.49 GB 3:150/9.66 GB 1:157/10.60 GB 5:139/8.23 GB 2:154/9.69 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 51 out of 51 Runtime filters: Only following filters arrived: 7, waited 783ms Hdfs Read Thread Concurrency Bucket: 0:95.24% 1:4.762% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1133 PARQUET/SNAPPY:51 BytesRead(500.000ms): 0, 0, 0, 12.95 MB, 12.95 MB, 13.78 MB, 18.85 MB, 18.85 MB, 21.07 MB, 23.34 MB, 31.23 MB, 31.23 MB, 31.23 MB, 31.23 MB, 31.23 MB, 32.89 MB, 40.49 MB, 40.49 MB, 48.18 MB, 48.93 MB, 51.14 MB, 52.54 MB - FooterProcessingTime: (Avg: 85.498ms ; Min: 4.209ms ; Max: 316.061ms ; Number of samples: 51) - AverageHdfsReadThreadConcurrency: 0.05 - AverageScannerThreadConcurrency: 10.86 - BytesRead: 52.54 MB (55095074) - BytesReadDataNodeCache: 0 - BytesReadLocal: 52.54 MB (55095074) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 52.54 MB (55095074) - DecompressionTime: 360.342ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 51 (51) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 25.78 MB (27029045) - PerReadThreadRawHdfsThroughput: 26.27 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 219.951ms - RowBatchQueuePutWaitTime: 1m43s - RowsRead: 39.79M (39791614) - RowsReturned: 39.79M (39791614) - RowsReturnedRate: 34.43 M/sec - ScanRangesComplete: 1.18K (1184) - ScannerThreadsInvoluntaryContextSwitches: 1.62K (1625) - ScannerThreadsTotalWallClockTime: 1m56s - MaterializeTupleTime(*): 2s088ms - ScannerThreadsSysTime: 3s293ms - ScannerThreadsUserTime: 4s230ms - ScannerThreadsVoluntaryContextSwitches: 189.54K (189536) - TotalRawHdfsReadTime(*): 2s000ms - TotalReadThroughput: 4.78 MB/sec Filter 2 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 39.79M (39791614) Filter 7 (1.00 MB): - Files processed: 1.18K (1184) - Files rejected: 1.13K (1133) - Files total: 1.18K (1184) - RowGroups processed: 38.90K (38900) - RowGroups rejected: 0 (0) - RowGroups total: 38.90K (38900) - Rows processed: 835.58K (835584) - Rows rejected: 0 (0) - Rows total: 39.79M (39791614) - Splits processed: 51 (51) - Splits rejected: 0 (0) - Splits total: 51 (51) Instance 7f40dcb034de70b7:140 (host=vd1136.foo:22000):(Total: 10s845ms, non-child: 2s237ms, % non-child: 20.63%) Hdfs split stats (:<# splits>/): 2:152/9.63 GB 4:150/9.23 GB 5:141/9.83 GB 0:137/8.77 GB 6:154/9.74 GB 3:149/10.19 GB 1:142/8.91 GB 7:150/9.18 GB Filter 7 arrival: 396ms Filter 2 arrival: 9s789ms MemoryUsage(500.000ms): 2.79 MB, 3.38 MB, 16.54 MB, 25.61 MB, 25.36 MB, 24.97 MB, 25.62 MB, 28.97 MB, 30.08 MB, 30.16 MB, 27.56 MB, 27.11 MB, 28.33 MB, 28.30 MB, 26.76 MB, 27.01 MB, 27.13 MB, 27.73 MB, 26.91 MB, 26.73 MB, 40.69 MB, 33.99 MB ThreadUsage(500.000ms): 1, 1, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 11.91 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 42.99 MB (45075384) - PerHostPeakMemUsage: 1.42 GB (1524312420) - RowsProduced: 40.98M (40982465) - TotalNetworkReceiveTime: 156.993ms - TotalNetworkSendTime: 2s799ms - TotalStorageWaitTime: 6s304ms - TotalThreadsInvoluntaryContextSwitches: 2.80K (2797) - TotalThreadsTotalWallClockTime: 2m9s - TotalThreadsSysTime: 2s154ms - TotalThreadsUserTime: 11s561ms - TotalThreadsVoluntaryContextSwitches: 182.46K (182458) Fragment Instance Lifecycle Timings: - ExecTime: 9s734ms - ExecTreeExecTime: 1s246ms - OpenTime: 1s046ms - ExecTreeOpenTime: 866.942ms - PrepareTime: 64.274ms - ExecTreePrepareTime: 3.476ms DataStreamSender (dst_id=23):(Total: 6s293ms, non-child: 6s293ms, % non-child: 100.00%) - BytesSent: 388.65 MB (407532746) - NetworkThroughput(*): 95.89 MB/sec - OverallThroughput: 61.75 MB/sec - PeakMemoryUsage: 4.75 MB (4979776) - RowsReturned: 40.98M (40982465) - SerializeBatchTime: 2s233ms - TransmitDataRPCTime: 4s053ms - UncompressedRowBatchSize: 1.30 GB (1393924754) CodeGen:(Total: 206.767ms, non-child: 206.767ms, % non-child: 100.00%) - CodegenTime: 1.795ms - CompileTime: 51.419ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 90 (90) - NumInstructions: 2.97K (2968) - OptimizationTime: 126.026ms - PeakMemoryUsage: 1.45 MB (1519616) - PrepareTime: 28.801ms HASH_JOIN_NODE (id=11):(Total: 2s107ms, non-child: 1s101ms, % non-child: 52.28%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.584ms - PeakMemoryUsage: 1.27 MB (1328515) - ProbeRows: 40.98M (40982465) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1s041ms - RowsReturned: 40.98M (40982465) - RowsReturnedRate: 19.45 M/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 23.163us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 162.028us - HashBuckets: 212 (212) - HashCollisions: 0 (0) - HashTablesBuildTime: 59.074us - LargestPartitionPercent: 9 (9) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1073600) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 157.004ms, non-child: 16.833us, % non-child: 0.01%) BytesReceived(500.000ms): 0, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 4.998us - DeserializeRowBatchTimer: 33.594us - FirstBatchArrivalWaitTime: 156.986ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 764.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=9):(Total: 849.161ms, non-child: 849.161ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:152/9.63 GB 4:150/9.23 GB 5:141/9.83 GB 0:137/8.77 GB 6:154/9.74 GB 3:149/10.19 GB 1:142/8.91 GB 7:150/9.18 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 58 out of 58 Runtime filters: Only following filters arrived: 7, waited 603ms Hdfs Read Thread Concurrency Bucket: 0:80.95% 1:9.524% 2:4.762% 3:4.762% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1117 PARQUET/SNAPPY:58 BytesRead(500.000ms): 0, 0, 2.44 MB, 11.56 MB, 11.56 MB, 12.41 MB, 15.81 MB, 20.75 MB, 21.67 MB, 22.99 MB, 29.01 MB, 29.86 MB, 30.70 MB, 30.70 MB, 37.64 MB, 38.48 MB, 41.56 MB, 47.60 MB, 48.34 MB, 51.99 MB, 55.36 MB, 55.36 MB - FooterProcessingTime: (Avg: 60.777ms ; Min: 4.540ms ; Max: 172.341ms ; Number of samples: 58) - AverageHdfsReadThreadConcurrency: 0.33 - AverageScannerThreadConcurrency: 11.43 - BytesRead: 55.36 MB (58044748) - BytesReadDataNodeCache: 0 - BytesReadLocal: 55.36 MB (58044748) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 55.36 MB (58044748) - DecompressionTime: 367.773ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 58 (58) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 24.88 MB (26093328) - PerReadThreadRawHdfsThroughput: 21.74 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 102.776ms - RowBatchQueuePutWaitTime: 1m44s - RowsRead: 40.99M (40992692) - RowsReturned: 40.98M (40982465) - RowsReturnedRate: 48.26 M/sec - ScanRangesComplete: 1.18K (1175) - ScannerThreadsInvoluntaryContextSwitches: 1.99K (1994) - ScannerThreadsTotalWallClockTime: 1m59s - MaterializeTupleTime(*): 2s105ms - ScannerThreadsSysTime: 1s841ms - ScannerThreadsUserTime: 4s742ms - ScannerThreadsVoluntaryContextSwitches: 181.78K (181781) - TotalRawHdfsReadTime(*): 2s546ms - TotalReadThroughput: 5.03 MB/sec Filter 2 (16.00 MB): - Rows processed: 136.18K (136179) - Rows rejected: 10.23K (10227) - Rows total: 40.99M (40992692) Filter 7 (1.00 MB): - Files processed: 1.18K (1175) - Files rejected: 1.12K (1117) - Files total: 1.18K (1175) - RowGroups processed: 40.06K (40060) - RowGroups rejected: 0 (0) - RowGroups total: 40.06K (40060) - Rows processed: 950.27K (950272) - Rows rejected: 0 (0) - Rows total: 40.98M (40982465) - Splits processed: 58 (58) - Splits rejected: 0 (0) - Splits total: 58 (58) Instance 7f40dcb034de70b7:104 (host=vd1105.foo:22000):(Total: 10s839ms, non-child: 2s618ms, % non-child: 24.16%) Hdfs split stats (:<# splits>/): 4:143/8.86 GB 0:156/9.73 GB 3:141/8.99 GB 2:147/9.60 GB 1:146/9.01 GB 6:137/9.12 GB 7:155/9.94 GB 5:156/10.21 GB Filter 7 arrival: 620ms Filter 2 arrival: 9s022ms MemoryUsage(500.000ms): 1.38 MB, 3.38 MB, 25.77 MB, 25.66 MB, 26.00 MB, 24.88 MB, 27.81 MB, 28.04 MB, 28.32 MB, 26.78 MB, 26.33 MB, 27.31 MB, 28.19 MB, 28.33 MB, 26.92 MB, 27.15 MB, 25.90 MB, 27.33 MB, 44.35 MB, 42.70 MB, 35.68 MB, 19.16 MB ThreadUsage(500.000ms): 2, 1, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 1 - AverageThreadTokens: 11.41 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 44.73 MB (46900064) - PerHostPeakMemUsage: 1.40 GB (1506986626) - RowsProduced: 40.78M (40778030) - TotalNetworkReceiveTime: 407.646ms - TotalNetworkSendTime: 3s062ms - TotalStorageWaitTime: 5s089ms - TotalThreadsInvoluntaryContextSwitches: 2.56K (2563) - TotalThreadsTotalWallClockTime: 2m8s - TotalThreadsSysTime: 4s266ms - TotalThreadsUserTime: 11s226ms - TotalThreadsVoluntaryContextSwitches: 248.22K (248215) Fragment Instance Lifecycle Timings: - ExecTime: 9s750ms - ExecTreeExecTime: 1s056ms - OpenTime: 1s040ms - ExecTreeOpenTime: 873.856ms - PrepareTime: 48.131ms - ExecTreePrepareTime: 2.581ms DataStreamSender (dst_id=23):(Total: 6s108ms, non-child: 6s108ms, % non-child: 100.00%) - BytesSent: 385.80 MB (404541437) - NetworkThroughput(*): 99.59 MB/sec - OverallThroughput: 63.15 MB/sec - PeakMemoryUsage: 4.82 MB (5053504) - RowsReturned: 40.78M (40778030) - SerializeBatchTime: 2s227ms - TransmitDataRPCTime: 3s874ms - UncompressedRowBatchSize: 1.29 GB (1386971396) CodeGen:(Total: 189.832ms, non-child: 189.832ms, % non-child: 100.00%) - CodegenTime: 818.899us - CompileTime: 49.987ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 90 (90) - NumInstructions: 2.97K (2968) - OptimizationTime: 115.486ms - PeakMemoryUsage: 1.45 MB (1519616) - PrepareTime: 23.987ms HASH_JOIN_NODE (id=11):(Total: 1s921ms, non-child: 918.572ms, % non-child: 47.80%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.486ms - PeakMemoryUsage: 1.26 MB (1324878) - ProbeRows: 40.78M (40778030) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 869.288ms - RowsReturned: 40.78M (40778030) - RowsReturnedRate: 21.22 M/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 24.680us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 170.795us - HashBuckets: 212 (212) - HashCollisions: 0 (0) - HashTablesBuildTime: 53.863us - LargestPartitionPercent: 9 (9) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1073600) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 407.656ms, non-child: 18.469us, % non-child: 0.00%) BytesReceived(500.000ms): 0, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 4.537us - DeserializeRowBatchTimer: 17.353us - FirstBatchArrivalWaitTime: 407.253ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 294.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=9):(Total: 596.115ms, non-child: 596.115ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:143/8.86 GB 0:156/9.73 GB 3:141/8.99 GB 2:147/9.60 GB 1:146/9.01 GB 6:137/9.12 GB 7:155/9.94 GB 5:156/10.21 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 56 out of 56 Runtime filters: Only following filters arrived: 7, waited 382ms Hdfs Read Thread Concurrency Bucket: 0:95.24% 1:4.762% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1125 PARQUET/SNAPPY:56 BytesRead(500.000ms): 0, 0, 11.76 MB, 11.76 MB, 12.60 MB, 12.69 MB, 20.48 MB, 21.33 MB, 21.33 MB, 30.01 MB, 30.01 MB, 30.84 MB, 32.27 MB, 32.27 MB, 39.57 MB, 40.42 MB, 40.51 MB, 49.53 MB, 51.81 MB, 54.88 MB, 54.88 MB - FooterProcessingTime: (Avg: 50.472ms ; Min: 5.074ms ; Max: 122.652ms ; Number of samples: 56) - AverageHdfsReadThreadConcurrency: 0.05 - AverageScannerThreadConcurrency: 10.86 - BytesRead: 54.88 MB (57541687) - BytesReadDataNodeCache: 0 - BytesReadLocal: 54.88 MB (57541687) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 54.88 MB (57541687) - DecompressionTime: 349.518ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 56 (56) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 23.65 MB (24800030) - PerReadThreadRawHdfsThroughput: 24.83 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 78.478ms - RowBatchQueuePutWaitTime: 1m43s - RowsRead: 40.79M (40790595) - RowsReturned: 40.78M (40778030) - RowsReturnedRate: 68.41 M/sec - ScanRangesComplete: 1.18K (1181) - ScannerThreadsInvoluntaryContextSwitches: 1.77K (1767) - ScannerThreadsTotalWallClockTime: 1m56s - MaterializeTupleTime(*): 1s992ms - ScannerThreadsSysTime: 3s998ms - ScannerThreadsUserTime: 4s623ms - ScannerThreadsVoluntaryContextSwitches: 247.58K (247579) - TotalRawHdfsReadTime(*): 2s210ms - TotalReadThroughput: 5.23 MB/sec Filter 2 (16.00 MB): - Rows processed: 183.57K (183573) - Rows rejected: 12.56K (12565) - Rows total: 40.79M (40790595) Filter 7 (1.00 MB): - Files processed: 1.18K (1181) - Files rejected: 1.12K (1125) - Files total: 1.18K (1181) - RowGroups processed: 39.86K (39859) - RowGroups rejected: 0 (0) - RowGroups total: 39.86K (39859) - Rows processed: 917.50K (917504) - Rows rejected: 0 (0) - Rows total: 40.78M (40778030) - Splits processed: 56 (56) - Splits rejected: 0 (0) - Splits total: 56 (56) Instance 7f40dcb034de70b7:11a (host=vd1330.foo:22000):(Total: 10s834ms, non-child: 2s413ms, % non-child: 22.28%) Hdfs split stats (:<# splits>/): 4:158/10.40 GB 3:155/10.00 GB 7:139/8.44 GB 5:154/9.61 GB 1:144/9.24 GB 2:151/9.32 GB 6:153/10.02 GB 0:141/8.47 GB Filter 7 arrival: 551ms Filter 2 arrival: 9s300ms MemoryUsage(500.000ms): 1.38 MB, 3.38 MB, 23.03 MB, 23.05 MB, 23.38 MB, 19.46 MB, 24.99 MB, 25.41 MB, 26.22 MB, 28.19 MB, 29.24 MB, 28.18 MB, 28.18 MB, 29.01 MB, 29.06 MB, 29.22 MB, 15.73 MB, 25.76 MB, 41.97 MB, 36.50 MB, 35.81 MB ThreadUsage(500.000ms): 2, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.48 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 42.98 MB (45071197) - PerHostPeakMemUsage: 1.39 GB (1497693108) - RowsProduced: 41.00M (41004974) - TotalNetworkReceiveTime: 325.694ms - TotalNetworkSendTime: 2s424ms - TotalStorageWaitTime: 7s952ms - TotalThreadsInvoluntaryContextSwitches: 3.05K (3047) - TotalThreadsTotalWallClockTime: 2m8s - TotalThreadsSysTime: 3s606ms - TotalThreadsUserTime: 11s621ms - TotalThreadsVoluntaryContextSwitches: 169.56K (169565) Fragment Instance Lifecycle Timings: - ExecTime: 9s698ms - ExecTreeExecTime: 1s092ms - OpenTime: 1s082ms - ExecTreeOpenTime: 906.717ms - PrepareTime: 53.757ms - ExecTreePrepareTime: 3.395ms DataStreamSender (dst_id=23):(Total: 6s231ms, non-child: 6s231ms, % non-child: 100.00%) - BytesSent: 387.80 MB (406639854) - NetworkThroughput(*): 101.79 MB/sec - OverallThroughput: 62.23 MB/sec - PeakMemoryUsage: 4.74 MB (4971584) - RowsReturned: 41.00M (41004974) - SerializeBatchTime: 2s413ms - TransmitDataRPCTime: 3s809ms - UncompressedRowBatchSize: 1.30 GB (1394690332) CodeGen:(Total: 198.267ms, non-child: 198.267ms, % non-child: 100.00%) - CodegenTime: 1.024ms - CompileTime: 51.267ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 90 (90) - NumInstructions: 2.97K (2968) - OptimizationTime: 122.828ms - PeakMemoryUsage: 1.45 MB (1519616) - PrepareTime: 23.767ms HASH_JOIN_NODE (id=11):(Total: 1s991ms, non-child: 929.483ms, % non-child: 46.68%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.552ms - PeakMemoryUsage: 1.27 MB (1327491) - ProbeRows: 41.00M (41004974) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 878.991ms - RowsReturned: 41.00M (41004974) - RowsReturnedRate: 20.59 M/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 26.888us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 160.953us - HashBuckets: 212 (212) - HashCollisions: 0 (0) - HashTablesBuildTime: 59.431us - LargestPartitionPercent: 9 (9) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1073600) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 325.704ms, non-child: 20.643us, % non-child: 0.01%) BytesReceived(500.000ms): 0, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 4.396us - DeserializeRowBatchTimer: 20.554us - FirstBatchArrivalWaitTime: 310.819ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 368.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=9):(Total: 736.334ms, non-child: 736.334ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:158/10.40 GB 3:155/10.00 GB 7:139/8.44 GB 5:154/9.61 GB 1:144/9.24 GB 2:151/9.32 GB 6:153/10.02 GB 0:141/8.47 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 58 out of 58 Runtime filters: Only following filters arrived: 7, waited 462ms Hdfs Read Thread Concurrency Bucket: 0:95.24% 1:0% 2:0% 3:0% 4:0% 5:4.762% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1137 PARQUET/SNAPPY:58 BytesRead(500.000ms): 0, 0, 10.09 MB, 10.09 MB, 10.92 MB, 14.59 MB, 21.25 MB, 22.08 MB, 23.54 MB, 31.49 MB, 32.92 MB, 36.84 MB, 36.84 MB, 40.76 MB, 40.76 MB, 40.76 MB, 40.76 MB, 51.07 MB, 52.57 MB, 53.51 MB, 55.63 MB - FooterProcessingTime: (Avg: 89.605ms ; Min: 4.047ms ; Max: 516.928ms ; Number of samples: 58) - AverageHdfsReadThreadConcurrency: 0.24 - AverageScannerThreadConcurrency: 11.43 - BytesRead: 55.63 MB (58330859) - BytesReadDataNodeCache: 0 - BytesReadLocal: 55.63 MB (58330859) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 55.63 MB (58330859) - DecompressionTime: 354.019ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 58 (58) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 23.91 MB (25067276) - PerReadThreadRawHdfsThroughput: 25.89 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 115.191ms - RowBatchQueuePutWaitTime: 1m41s - RowsRead: 41.02M (41016663) - RowsReturned: 41.00M (41004974) - RowsReturnedRate: 55.69 M/sec - ScanRangesComplete: 1.20K (1195) - ScannerThreadsInvoluntaryContextSwitches: 2.17K (2174) - ScannerThreadsTotalWallClockTime: 1m57s - MaterializeTupleTime(*): 2s254ms - ScannerThreadsSysTime: 3s320ms - ScannerThreadsUserTime: 4s455ms - ScannerThreadsVoluntaryContextSwitches: 168.95K (168949) - TotalRawHdfsReadTime(*): 2s148ms - TotalReadThroughput: 5.30 MB/sec Filter 2 (16.00 MB): - Rows processed: 161.19K (161193) - Rows rejected: 11.69K (11689) - Rows total: 41.02M (41016663) Filter 7 (1.00 MB): - Files processed: 1.20K (1195) - Files rejected: 1.14K (1137) - Files total: 1.20K (1195) - RowGroups processed: 40.08K (40083) - RowGroups rejected: 0 (0) - RowGroups total: 40.08K (40083) - Rows processed: 950.27K (950272) - Rows rejected: 0 (0) - Rows total: 41.00M (41004974) - Splits processed: 58 (58) - Splits rejected: 0 (0) - Splits total: 58 (58) Instance 7f40dcb034de70b7:134 (host=vd1130.foo:22000):(Total: 10s829ms, non-child: 2s525ms, % non-child: 23.32%) Hdfs split stats (:<# splits>/): 6:136/9.19 GB 0:154/9.77 GB 1:142/8.59 GB 3:156/9.73 GB 2:155/9.34 GB 7:152/9.58 GB 5:148/9.48 GB 4:157/9.85 GB Filter 7 arrival: 454ms Filter 2 arrival: 9s650ms MemoryUsage(500.000ms): 3.38 MB, 3.38 MB, 23.39 MB, 23.38 MB, 23.59 MB, 26.02 MB, 26.05 MB, 24.25 MB, 19.73 MB, 21.76 MB, 26.11 MB, 24.93 MB, 24.93 MB, 25.22 MB, 25.25 MB, 25.68 MB, 25.98 MB, 22.06 MB, 26.62 MB, 43.62 MB, 33.41 MB ThreadUsage(500.000ms): 2, 1, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 11.90 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 43.82 MB (45944985) - PerHostPeakMemUsage: 1.40 GB (1505976497) - RowsProduced: 40.68M (40678682) - TotalNetworkReceiveTime: 217.591ms - TotalNetworkSendTime: 2s477ms - TotalStorageWaitTime: 8s652ms - TotalThreadsInvoluntaryContextSwitches: 3.17K (3173) - TotalThreadsTotalWallClockTime: 2m7s - TotalThreadsSysTime: 2s877ms - TotalThreadsUserTime: 11s283ms - TotalThreadsVoluntaryContextSwitches: 144.83K (144833) Fragment Instance Lifecycle Timings: - ExecTime: 9s719ms - ExecTreeExecTime: 1s101ms - OpenTime: 1s055ms - ExecTreeOpenTime: 868.411ms - PrepareTime: 54.686ms - ExecTreePrepareTime: 3.361ms DataStreamSender (dst_id=23):(Total: 6s133ms, non-child: 6s133ms, % non-child: 100.00%) - BytesSent: 385.33 MB (404052412) - NetworkThroughput(*): 102.73 MB/sec - OverallThroughput: 62.83 MB/sec - PeakMemoryUsage: 4.73 MB (4963392) - RowsReturned: 40.68M (40678682) - SerializeBatchTime: 2s373ms - TransmitDataRPCTime: 3s750ms - UncompressedRowBatchSize: 1.29 GB (1383592236) CodeGen:(Total: 209.325ms, non-child: 209.325ms, % non-child: 100.00%) - CodegenTime: 1.206ms - CompileTime: 53.831ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 90 (90) - NumInstructions: 2.97K (2968) - OptimizationTime: 131.092ms - PeakMemoryUsage: 1.45 MB (1519616) - PrepareTime: 23.973ms HASH_JOIN_NODE (id=11):(Total: 1s961ms, non-child: 936.295ms, % non-child: 47.73%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.352ms - PeakMemoryUsage: 1.27 MB (1332179) - ProbeRows: 40.68M (40678682) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 886.769ms - RowsReturned: 40.68M (40678682) - RowsReturnedRate: 20.74 M/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 29.558us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 149.723us - HashBuckets: 212 (212) - HashCollisions: 0 (0) - HashTablesBuildTime: 61.751us - LargestPartitionPercent: 9 (9) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1073600) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 217.602ms, non-child: 21.386us, % non-child: 0.01%) BytesReceived(500.000ms): 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 5.206us - DeserializeRowBatchTimer: 24.660us - FirstBatchArrivalWaitTime: 190.979ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 551.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=9):(Total: 807.890ms, non-child: 807.890ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 6:136/9.19 GB 0:154/9.77 GB 1:142/8.59 GB 3:156/9.73 GB 2:155/9.34 GB 7:152/9.58 GB 5:148/9.48 GB 4:157/9.85 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 63 out of 63 Runtime filters: Only following filters arrived: 7, waited 563ms Hdfs Read Thread Concurrency Bucket: 0:76.19% 1:14.29% 2:0% 3:4.762% 4:4.762% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1137 PARQUET/SNAPPY:63 BytesRead(500.000ms): 0, 0, 10.28 MB, 10.28 MB, 11.54 MB, 20.89 MB, 20.89 MB, 22.55 MB, 23.39 MB, 25.55 MB, 32.39 MB, 34.64 MB, 34.64 MB, 34.64 MB, 34.64 MB, 42.23 MB, 43.54 MB, 48.43 MB, 54.52 MB, 54.52 MB, 56.28 MB - FooterProcessingTime: (Avg: 102.445ms ; Min: 4.069ms ; Max: 662.728ms ; Number of samples: 63) - AverageHdfsReadThreadConcurrency: 0.48 - AverageScannerThreadConcurrency: 10.86 - BytesRead: 56.28 MB (59017153) - BytesReadDataNodeCache: 0 - BytesReadLocal: 56.28 MB (59017153) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 56.28 MB (59017153) - DecompressionTime: 350.012ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 63 (63) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 22.55 MB (23643711) - PerReadThreadRawHdfsThroughput: 19.81 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 81.289ms - RowBatchQueuePutWaitTime: 1m41s - RowsRead: 40.69M (40688010) - RowsReturned: 40.68M (40678682) - RowsReturnedRate: 50.35 M/sec - ScanRangesComplete: 1.20K (1200) - ScannerThreadsInvoluntaryContextSwitches: 2.20K (2198) - ScannerThreadsTotalWallClockTime: 1m56s - MaterializeTupleTime(*): 2s262ms - ScannerThreadsSysTime: 2s583ms - ScannerThreadsUserTime: 4s144ms - ScannerThreadsVoluntaryContextSwitches: 144.21K (144213) - TotalRawHdfsReadTime(*): 2s841ms - TotalReadThroughput: 5.36 MB/sec Filter 2 (16.00 MB): - Rows processed: 130.16K (130160) - Rows rejected: 9.33K (9328) - Rows total: 40.69M (40688010) Filter 7 (1.00 MB): - Files processed: 1.20K (1200) - Files rejected: 1.14K (1137) - Files total: 1.20K (1200) - RowGroups processed: 39.77K (39767) - RowGroups rejected: 0 (0) - RowGroups total: 39.77K (39767) - Rows processed: 1.03M (1032192) - Rows rejected: 0 (0) - Rows total: 40.68M (40678682) - Splits processed: 63 (63) - Splits rejected: 0 (0) - Splits total: 63 (63) Instance 7f40dcb034de70b7:fe (host=vc1536.foo:22000):(Total: 10s817ms, non-child: 1s967ms, % non-child: 18.19%) Hdfs split stats (:<# splits>/): 4:147/8.67 GB 6:138/8.43 GB 7:134/8.63 GB 5:139/8.99 GB 2:136/8.88 GB 1:158/10.77 GB 3:164/10.97 GB 0:156/10.23 GB Filter 7 arrival: 645ms Filter 2 arrival: 8s963ms MemoryUsage(500.000ms): 1.38 MB, 3.38 MB, 25.02 MB, 25.05 MB, 26.30 MB, 25.98 MB, 27.50 MB, 27.81 MB, 22.86 MB, 28.33 MB, 24.01 MB, 24.04 MB, 23.90 MB, 24.28 MB, 26.15 MB, 27.09 MB, 27.10 MB, 25.03 MB, 43.46 MB, 44.33 MB, 32.40 MB ThreadUsage(500.000ms): 2, 1, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 11.90 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 45.63 MB (47845722) - PerHostPeakMemUsage: 1.40 GB (1507978127) - RowsProduced: 45.78M (45777129) - TotalNetworkReceiveTime: 419.378ms - TotalNetworkSendTime: 2s535ms - TotalStorageWaitTime: 5s153ms - TotalThreadsInvoluntaryContextSwitches: 3.05K (3049) - TotalThreadsTotalWallClockTime: 2m7s - TotalThreadsSysTime: 3s719ms - TotalThreadsUserTime: 11s419ms - TotalThreadsVoluntaryContextSwitches: 141.21K (141209) Fragment Instance Lifecycle Timings: - ExecTime: 9s737ms - ExecTreeExecTime: 1s179ms - OpenTime: 1s028ms - ExecTreeOpenTime: 852.167ms - PrepareTime: 52.544ms - ExecTreePrepareTime: 2.635ms DataStreamSender (dst_id=23):(Total: 6s629ms, non-child: 6s629ms, % non-child: 100.00%) - BytesSent: 433.46 MB (454517987) - NetworkThroughput(*): 102.45 MB/sec - OverallThroughput: 65.38 MB/sec - PeakMemoryUsage: 4.80 MB (5028928) - RowsReturned: 45.78M (45777129) - SerializeBatchTime: 2s390ms - TransmitDataRPCTime: 4s231ms - UncompressedRowBatchSize: 1.45 GB (1557004210) CodeGen:(Total: 200.203ms, non-child: 200.203ms, % non-child: 100.00%) - CodegenTime: 916.948us - CompileTime: 52.185ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 90 (90) - NumInstructions: 2.97K (2968) - OptimizationTime: 122.334ms - PeakMemoryUsage: 1.45 MB (1519616) - PrepareTime: 25.316ms HASH_JOIN_NODE (id=11):(Total: 2s020ms, non-child: 1s016ms, % non-child: 50.31%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.451ms - PeakMemoryUsage: 1.27 MB (1329342) - ProbeRows: 45.78M (45777129) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 966.507ms - RowsReturned: 45.78M (45777129) - RowsReturnedRate: 22.66 M/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 27.701us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 140.622us - HashBuckets: 212 (212) - HashCollisions: 0 (0) - HashTablesBuildTime: 57.402us - LargestPartitionPercent: 9 (9) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1073600) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 419.387ms, non-child: 18.967us, % non-child: 0.00%) BytesReceived(500.000ms): 0, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 4.630us - DeserializeRowBatchTimer: 23.100us - FirstBatchArrivalWaitTime: 411.389ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 286.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=9):(Total: 584.937ms, non-child: 584.937ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:147/8.67 GB 6:138/8.43 GB 7:134/8.63 GB 5:139/8.99 GB 2:136/8.88 GB 1:158/10.77 GB 3:164/10.97 GB 0:156/10.23 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 65 out of 65 Runtime filters: Only following filters arrived: 7, waited 361ms Hdfs Read Thread Concurrency Bucket: 0:80.95% 1:14.29% 2:4.762% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1107 PARQUET/SNAPPY:65 BytesRead(500.000ms): 0, 0, 11.58 MB, 11.58 MB, 13.00 MB, 16.64 MB, 21.42 MB, 21.51 MB, 23.20 MB, 28.68 MB, 31.20 MB, 37.94 MB, 37.94 MB, 37.94 MB, 42.42 MB, 50.28 MB, 51.12 MB, 52.05 MB, 56.96 MB, 62.01 MB, 62.01 MB - FooterProcessingTime: (Avg: 47.612ms ; Min: 5.370ms ; Max: 106.218ms ; Number of samples: 65) - AverageHdfsReadThreadConcurrency: 0.24 - AverageScannerThreadConcurrency: 10.86 - BytesRead: 62.01 MB (65026218) - BytesReadDataNodeCache: 0 - BytesReadLocal: 62.01 MB (65026218) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 62.01 MB (65026218) - DecompressionTime: 399.440ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 65 (65) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 23.88 MB (25040691) - PerReadThreadRawHdfsThroughput: 28.17 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 65.054ms - RowBatchQueuePutWaitTime: 1m44s - RowsRead: 45.79M (45793263) - RowsReturned: 45.78M (45777129) - RowsReturnedRate: 78.26 M/sec - ScanRangesComplete: 1.17K (1172) - ScannerThreadsInvoluntaryContextSwitches: 2.15K (2154) - ScannerThreadsTotalWallClockTime: 1m56s - MaterializeTupleTime(*): 2s374ms - ScannerThreadsSysTime: 3s415ms - ScannerThreadsUserTime: 4s324ms - ScannerThreadsVoluntaryContextSwitches: 140.48K (140484) - TotalRawHdfsReadTime(*): 2s201ms - TotalReadThroughput: 5.91 MB/sec Filter 2 (16.00 MB): - Rows processed: 231.17K (231174) - Rows rejected: 16.13K (16134) - Rows total: 45.79M (45793263) Filter 7 (1.00 MB): - Files processed: 1.17K (1172) - Files rejected: 1.11K (1107) - Files total: 1.17K (1172) - RowGroups processed: 44.75K (44747) - RowGroups rejected: 0 (0) - RowGroups total: 44.75K (44747) - Rows processed: 1.06M (1064960) - Rows rejected: 0 (0) - Rows total: 45.78M (45777129) - Splits processed: 65 (65) - Splits rejected: 0 (0) - Splits total: 65 (65) Instance 7f40dcb034de70b7:133 (host=vc1526.foo:22000):(Total: 10s806ms, non-child: 2s275ms, % non-child: 21.06%) Hdfs split stats (:<# splits>/): 2:146/9.10 GB 4:154/9.74 GB 6:155/10.30 GB 1:138/8.60 GB 7:143/9.25 GB 0:147/9.57 GB 5:154/9.20 GB 3:159/9.72 GB Filter 7 arrival: 470ms Filter 2 arrival: 9s665ms MemoryUsage(500.000ms): 1.38 MB, 3.38 MB, 26.87 MB, 27.38 MB, 27.22 MB, 30.70 MB, 31.91 MB, 33.21 MB, 31.24 MB, 31.04 MB, 30.89 MB, 29.32 MB, 29.27 MB, 28.75 MB, 28.96 MB, 29.17 MB, 31.57 MB, 33.00 MB, 30.53 MB, 46.15 MB, 46.34 MB, 20.05 MB ThreadUsage(500.000ms): 2, 1, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 1 - AverageThreadTokens: 11.41 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 46.88 MB (49155734) - PerHostPeakMemUsage: 1.40 GB (1505256019) - RowsProduced: 42.81M (42814297) - TotalNetworkReceiveTime: 241.349ms - TotalNetworkSendTime: 2s648ms - TotalStorageWaitTime: 4s896ms - TotalThreadsInvoluntaryContextSwitches: 2.12K (2123) - TotalThreadsTotalWallClockTime: 2m9s - TotalThreadsSysTime: 1s316ms - TotalThreadsUserTime: 10s332ms - TotalThreadsVoluntaryContextSwitches: 69.97K (69975) Fragment Instance Lifecycle Timings: - ExecTime: 9s668ms - ExecTreeExecTime: 1s069ms - OpenTime: 1s082ms - ExecTreeOpenTime: 905.075ms - PrepareTime: 55.153ms - ExecTreePrepareTime: 3.273ms DataStreamSender (dst_id=23):(Total: 6s362ms, non-child: 6s362ms, % non-child: 100.00%) - BytesSent: 406.04 MB (425763530) - NetworkThroughput(*): 100.47 MB/sec - OverallThroughput: 63.82 MB/sec - PeakMemoryUsage: 4.84 MB (5078080) - RowsReturned: 42.81M (42814297) - SerializeBatchTime: 2s313ms - TransmitDataRPCTime: 4s041ms - UncompressedRowBatchSize: 1.36 GB (1456230290) CodeGen:(Total: 200.898ms, non-child: 200.898ms, % non-child: 100.00%) - CodegenTime: 1.058ms - CompileTime: 50.400ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 90 (90) - NumInstructions: 2.97K (2968) - OptimizationTime: 125.647ms - PeakMemoryUsage: 1.45 MB (1519616) - PrepareTime: 24.400ms HASH_JOIN_NODE (id=11):(Total: 1s967ms, non-child: 930.998ms, % non-child: 47.33%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.550ms - PeakMemoryUsage: 1.26 MB (1326384) - ProbeRows: 42.81M (42814297) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 879.749ms - RowsReturned: 42.81M (42814297) - RowsReturnedRate: 21.77 M/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 26.647us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 161.816us - HashBuckets: 212 (212) - HashCollisions: 0 (0) - HashTablesBuildTime: 57.543us - LargestPartitionPercent: 9 (9) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1073600) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 241.360ms, non-child: 23.428us, % non-child: 0.01%) BytesReceived(500.000ms): 0, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 4.878us - DeserializeRowBatchTimer: 17.664us - FirstBatchArrivalWaitTime: 219.990ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 497.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=9):(Total: 795.009ms, non-child: 795.009ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:146/9.10 GB 4:154/9.74 GB 6:155/10.30 GB 1:138/8.60 GB 7:143/9.25 GB 0:147/9.57 GB 5:154/9.20 GB 3:159/9.72 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 53 out of 53 Runtime filters: Only following filters arrived: 7, waited 542ms Hdfs Read Thread Concurrency Bucket: 0:90.48% 1:4.762% 2:4.762% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1143 PARQUET/SNAPPY:53 BytesRead(500.000ms): 0, 0, 13.78 MB, 13.78 MB, 13.78 MB, 14.48 MB, 23.03 MB, 23.86 MB, 23.86 MB, 30.31 MB, 30.31 MB, 31.71 MB, 35.05 MB, 36.82 MB, 38.35 MB, 38.35 MB, 46.14 MB, 50.13 MB, 52.38 MB, 55.74 MB, 55.74 MB - FooterProcessingTime: (Avg: 54.234ms ; Min: 20.259ms ; Max: 145.413ms ; Number of samples: 53) - AverageHdfsReadThreadConcurrency: 0.14 - AverageScannerThreadConcurrency: 10.86 - BytesRead: 55.74 MB (58447739) - BytesReadDataNodeCache: 0 - BytesReadLocal: 55.74 MB (58447739) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 55.74 MB (58447739) - DecompressionTime: 363.522ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 53 (53) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 27.93 MB (29284406) - PerReadThreadRawHdfsThroughput: 27.90 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 117.775ms - RowBatchQueuePutWaitTime: 1m47s - RowsRead: 42.82M (42822765) - RowsReturned: 42.81M (42814297) - RowsReturnedRate: 53.85 M/sec - ScanRangesComplete: 1.20K (1196) - ScannerThreadsInvoluntaryContextSwitches: 1.32K (1321) - ScannerThreadsTotalWallClockTime: 1m58s - MaterializeTupleTime(*): 1s997ms - ScannerThreadsSysTime: 1s045ms - ScannerThreadsUserTime: 3s388ms - ScannerThreadsVoluntaryContextSwitches: 69.33K (69329) - TotalRawHdfsReadTime(*): 1s997ms - TotalReadThroughput: 5.31 MB/sec Filter 2 (16.00 MB): - Rows processed: 127.25K (127252) - Rows rejected: 8.47K (8468) - Rows total: 42.82M (42822765) Filter 7 (1.00 MB): - Files processed: 1.20K (1196) - Files rejected: 1.14K (1143) - Files total: 1.20K (1196) - RowGroups processed: 41.84K (41845) - RowGroups rejected: 0 (0) - RowGroups total: 41.84K (41845) - Rows processed: 868.35K (868352) - Rows rejected: 0 (0) - Rows total: 42.81M (42814297) - Splits processed: 53 (53) - Splits rejected: 0 (0) - Splits total: 53 (53) Instance 7f40dcb034de70b7:155 (host=va1033.foo:22000):(Total: 10s800ms, non-child: 2s755ms, % non-child: 25.51%) Hdfs split stats (:<# splits>/): 0:154/10.15 GB 4:152/9.17 GB 7:145/9.11 GB 3:130/8.77 GB 6:144/9.45 GB 5:143/9.53 GB 1:156/10.06 GB 2:146/9.20 GB Filter 7 arrival: 318ms MemoryUsage(500.000ms): 3.38 MB, 3.38 MB, 24.06 MB, 24.18 MB, 23.24 MB, 26.96 MB, 26.01 MB, 27.61 MB, 24.41 MB, 25.76 MB, 25.97 MB, 30.10 MB, 30.06 MB, 30.05 MB, 28.22 MB, 29.09 MB, 29.00 MB, 29.06 MB, 29.17 MB, 25.23 MB, 18.47 MB ThreadUsage(500.000ms): 1, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.43 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 30.50 MB (31983620) - PerHostPeakMemUsage: 1.39 GB (1494065505) - RowsProduced: 40.21M (40211074) - TotalNetworkReceiveTime: 78.079ms - TotalNetworkSendTime: 3s157ms - TotalStorageWaitTime: 6s474ms - TotalThreadsInvoluntaryContextSwitches: 2.72K (2723) - TotalThreadsTotalWallClockTime: 2m10s - TotalThreadsSysTime: 3s547ms - TotalThreadsUserTime: 10s930ms - TotalThreadsVoluntaryContextSwitches: 260.38K (260380) Fragment Instance Lifecycle Timings: - ExecTime: 9s706ms - ExecTreeExecTime: 1s086ms - OpenTime: 1s035ms - ExecTreeOpenTime: 848.761ms - PrepareTime: 58.078ms - ExecTreePrepareTime: 3.322ms DataStreamSender (dst_id=23):(Total: 5s904ms, non-child: 5s904ms, % non-child: 100.00%) - BytesSent: 381.13 MB (399638892) - NetworkThroughput(*): 100.80 MB/sec - OverallThroughput: 64.54 MB/sec - PeakMemoryUsage: 4.82 MB (5053504) - RowsReturned: 40.21M (40211074) - SerializeBatchTime: 2s116ms - TransmitDataRPCTime: 3s780ms - UncompressedRowBatchSize: 1.27 GB (1367687660) CodeGen:(Total: 211.894ms, non-child: 211.894ms, % non-child: 100.00%) - CodegenTime: 1.008ms - CompileTime: 57.237ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 90 (90) - NumInstructions: 2.97K (2968) - OptimizationTime: 127.905ms - PeakMemoryUsage: 1.45 MB (1519616) - PrepareTime: 26.344ms HASH_JOIN_NODE (id=11):(Total: 1s927ms, non-child: 944.520ms, % non-child: 49.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.208ms - PeakMemoryUsage: 1.20 MB (1255232) - ProbeRows: 40.21M (40211074) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 887.721ms - RowsReturned: 40.21M (40211074) - RowsReturnedRate: 20.86 M/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 28.650us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 118.308us - HashBuckets: 212 (212) - HashCollisions: 0 (0) - HashTablesBuildTime: 50.560us - LargestPartitionPercent: 9 (9) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1073600) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 78.088ms, non-child: 17.245us, % non-child: 0.02%) BytesReceived(500.000ms): 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 4.808us - DeserializeRowBatchTimer: 18.462us - FirstBatchArrivalWaitTime: 68.819ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 1.54 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=9):(Total: 905.716ms, non-child: 905.716ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:154/10.15 GB 4:152/9.17 GB 7:145/9.11 GB 3:130/8.77 GB 6:144/9.45 GB 5:143/9.53 GB 1:156/10.06 GB 2:146/9.20 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 57 out of 57 Runtime filters: Only following filters arrived: 7, waited 682ms Hdfs Read Thread Concurrency Bucket: 0:95.24% 1:4.762% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1113 PARQUET/SNAPPY:57 BytesRead(500.000ms): 0, 0, 10.57 MB, 10.57 MB, 12.24 MB, 21.27 MB, 21.27 MB, 25.77 MB, 29.15 MB, 30.92 MB, 31.67 MB, 42.29 MB, 42.29 MB, 42.29 MB, 44.77 MB, 45.60 MB, 48.96 MB, 50.66 MB, 52.34 MB, 54.58 MB, 54.58 MB - FooterProcessingTime: (Avg: 55.262ms ; Min: 4.066ms ; Max: 325.297ms ; Number of samples: 57) - AverageHdfsReadThreadConcurrency: 0.05 - AverageScannerThreadConcurrency: 11.43 - BytesRead: 54.58 MB (57231407) - BytesReadDataNodeCache: 0 - BytesReadLocal: 54.58 MB (57231407) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 54.58 MB (57231407) - DecompressionTime: 325.299ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 57 (57) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 24.69 MB (25891061) - PerReadThreadRawHdfsThroughput: 25.45 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 84.232ms - RowBatchQueuePutWaitTime: 1m42s - RowsRead: 40.21M (40211074) - RowsReturned: 40.21M (40211074) - RowsReturnedRate: 44.40 M/sec - ScanRangesComplete: 1.17K (1170) - ScannerThreadsInvoluntaryContextSwitches: 1.90K (1897) - ScannerThreadsTotalWallClockTime: 1m59s - MaterializeTupleTime(*): 1s929ms - ScannerThreadsSysTime: 3s284ms - ScannerThreadsUserTime: 4s444ms - ScannerThreadsVoluntaryContextSwitches: 259.74K (259738) - TotalRawHdfsReadTime(*): 2s144ms - TotalReadThroughput: 5.20 MB/sec Filter 2 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 40.21M (40211074) Filter 7 (1.00 MB): - Files processed: 1.17K (1170) - Files rejected: 1.11K (1113) - Files total: 1.17K (1170) - RowGroups processed: 39.31K (39314) - RowGroups rejected: 0 (0) - RowGroups total: 39.31K (39314) - Rows processed: 933.89K (933888) - Rows rejected: 0 (0) - Rows total: 40.21M (40211074) - Splits processed: 57 (57) - Splits rejected: 0 (0) - Splits total: 57 (57) Instance 7f40dcb034de70b7:13d (host=vd1335.foo:22000):(Total: 10s798ms, non-child: 2s557ms, % non-child: 23.68%) Hdfs split stats (:<# splits>/): 0:149/9.52 GB 4:137/8.97 GB 3:152/9.21 GB 5:157/10.01 GB 2:166/10.69 GB 1:158/10.27 GB 6:134/8.55 GB 7:137/8.21 GB Filter 7 arrival: 427ms Filter 2 arrival: 9s773ms MemoryUsage(500.000ms): 2.79 MB, 3.38 MB, 17.71 MB, 23.92 MB, 24.35 MB, 23.22 MB, 26.05 MB, 26.36 MB, 22.94 MB, 26.08 MB, 26.12 MB, 24.35 MB, 22.17 MB, 20.57 MB, 26.77 MB, 26.97 MB, 26.97 MB, 25.11 MB, 25.55 MB, 24.07 MB, 33.85 MB, 26.49 MB ThreadUsage(500.000ms): 1, 1, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 11.91 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 42.63 MB (44701782) - PerHostPeakMemUsage: 1.37 GB (1473972891) - RowsProduced: 40.10M (40097999) - TotalNetworkReceiveTime: 209.825ms - TotalNetworkSendTime: 2s818ms - TotalStorageWaitTime: 5s191ms - TotalThreadsInvoluntaryContextSwitches: 2.33K (2327) - TotalThreadsTotalWallClockTime: 2m7s - TotalThreadsSysTime: 5s030ms - TotalThreadsUserTime: 10s896ms - TotalThreadsVoluntaryContextSwitches: 203.60K (203605) Fragment Instance Lifecycle Timings: - ExecTime: 9s679ms - ExecTreeExecTime: 1s046ms - OpenTime: 1s069ms - ExecTreeOpenTime: 897.162ms - PrepareTime: 49.226ms - ExecTreePrepareTime: 3.189ms DataStreamSender (dst_id=23):(Total: 6s112ms, non-child: 6s112ms, % non-child: 100.00%) - BytesSent: 379.67 MB (398110454) - NetworkThroughput(*): 99.36 MB/sec - OverallThroughput: 62.11 MB/sec - PeakMemoryUsage: 4.80 MB (5037120) - RowsReturned: 40.10M (40097999) - SerializeBatchTime: 2s284ms - TransmitDataRPCTime: 3s821ms - UncompressedRowBatchSize: 1.27 GB (1363841734) CodeGen:(Total: 191.190ms, non-child: 191.190ms, % non-child: 100.00%) - CodegenTime: 1.058ms - CompileTime: 49.712ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 90 (90) - NumInstructions: 2.97K (2968) - OptimizationTime: 120.875ms - PeakMemoryUsage: 1.45 MB (1519616) - PrepareTime: 20.168ms HASH_JOIN_NODE (id=11):(Total: 1s936ms, non-child: 908.859ms, % non-child: 46.93%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.529ms - PeakMemoryUsage: 1.27 MB (1332687) - ProbeRows: 40.10M (40097999) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 858.118ms - RowsReturned: 40.10M (40097999) - RowsReturnedRate: 20.70 M/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 28.729us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 130.580us - HashBuckets: 212 (212) - HashCollisions: 0 (0) - HashTablesBuildTime: 70.608us - LargestPartitionPercent: 9 (9) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1073600) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 209.836ms, non-child: 24.803us, % non-child: 0.01%) BytesReceived(500.000ms): 0, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 4.734us - DeserializeRowBatchTimer: 19.421us - FirstBatchArrivalWaitTime: 193.804ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 571.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=9):(Total: 818.424ms, non-child: 818.424ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:149/9.52 GB 4:137/8.97 GB 3:152/9.21 GB 5:157/10.01 GB 2:166/10.69 GB 1:158/10.27 GB 6:134/8.55 GB 7:137/8.21 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 60 out of 60 Runtime filters: Only following filters arrived: 7, waited 583ms Hdfs Read Thread Concurrency Bucket: 0:85.71% 1:4.762% 2:0% 3:4.762% 4:4.762% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1130 PARQUET/SNAPPY:60 BytesRead(500.000ms): 0, 0, 4.97 MB, 10.77 MB, 10.77 MB, 12.44 MB, 21.07 MB, 21.07 MB, 23.62 MB, 30.09 MB, 30.09 MB, 30.93 MB, 32.62 MB, 32.72 MB, 41.07 MB, 41.07 MB, 43.60 MB, 48.34 MB, 48.34 MB, 49.99 MB, 55.09 MB, 55.09 MB - FooterProcessingTime: (Avg: 52.248ms ; Min: 4.595ms ; Max: 118.748ms ; Number of samples: 60) - AverageHdfsReadThreadConcurrency: 0.38 - AverageScannerThreadConcurrency: 11.43 - BytesRead: 55.09 MB (57768158) - BytesReadDataNodeCache: 0 - BytesReadLocal: 55.09 MB (57768158) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 55.09 MB (57768158) - DecompressionTime: 316.974ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 60 (60) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 21.81 MB (22871204) - PerReadThreadRawHdfsThroughput: 25.20 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 97.124ms - RowBatchQueuePutWaitTime: 1m42s - RowsRead: 40.11M (40107858) - RowsReturned: 40.10M (40097999) - RowsReturnedRate: 48.99 M/sec - ScanRangesComplete: 1.19K (1190) - ScannerThreadsInvoluntaryContextSwitches: 1.54K (1540) - ScannerThreadsTotalWallClockTime: 1m56s - MaterializeTupleTime(*): 1s961ms - ScannerThreadsSysTime: 4s773ms - ScannerThreadsUserTime: 4s118ms - ScannerThreadsVoluntaryContextSwitches: 202.94K (202940) - TotalRawHdfsReadTime(*): 2s186ms - TotalReadThroughput: 5.01 MB/sec Filter 2 (16.00 MB): - Rows processed: 146.05K (146051) - Rows rejected: 9.86K (9859) - Rows total: 40.11M (40107858) Filter 7 (1.00 MB): - Files processed: 1.19K (1190) - Files rejected: 1.13K (1130) - Files total: 1.19K (1190) - RowGroups processed: 39.20K (39198) - RowGroups rejected: 0 (0) - RowGroups total: 39.20K (39198) - Rows processed: 983.04K (983040) - Rows rejected: 0 (0) - Rows total: 40.10M (40097999) - Splits processed: 60 (60) - Splits rejected: 0 (0) - Splits total: 60 (60) Instance 7f40dcb034de70b7:160 (host=vd1131.foo:22000):(Total: 10s796ms, non-child: 2s675ms, % non-child: 24.78%) Hdfs split stats (:<# splits>/): 5:135/8.82 GB 3:165/10.58 GB 7:148/9.71 GB 0:150/9.43 GB 4:146/8.93 GB 1:154/9.72 GB 2:140/9.00 GB 6:146/9.29 GB Filter 7 arrival: 264ms MemoryUsage(500.000ms): 1.38 MB, 3.38 MB, 8.25 MB, 24.93 MB, 24.98 MB, 24.98 MB, 24.61 MB, 26.05 MB, 22.35 MB, 26.99 MB, 25.81 MB, 27.99 MB, 28.08 MB, 28.02 MB, 27.38 MB, 30.01 MB, 29.94 MB, 28.49 MB, 28.95 MB, 29.11 MB, 17.62 MB, 3.82 MB ThreadUsage(500.000ms): 2, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 1 - AverageThreadTokens: 11.95 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 30.69 MB (32182630) - PerHostPeakMemUsage: 1.39 GB (1492853595) - RowsProduced: 38.53M (38529235) - TotalNetworkReceiveTime: 34.360ms - TotalNetworkSendTime: 3s024ms - TotalStorageWaitTime: 6s636ms - TotalThreadsInvoluntaryContextSwitches: 2.39K (2393) - TotalThreadsTotalWallClockTime: 2m10s - TotalThreadsSysTime: 2s820ms - TotalThreadsUserTime: 10s346ms - TotalThreadsVoluntaryContextSwitches: 172.16K (172161) Fragment Instance Lifecycle Timings: - ExecTime: 9s532ms - ExecTreeExecTime: 1s050ms - OpenTime: 1s210ms - ExecTreeOpenTime: 1s029ms - PrepareTime: 53.650ms - ExecTreePrepareTime: 3.409ms DataStreamSender (dst_id=23):(Total: 5s844ms, non-child: 5s844ms, % non-child: 100.00%) - BytesSent: 365.48 MB (383229894) - NetworkThroughput(*): 99.23 MB/sec - OverallThroughput: 62.53 MB/sec - PeakMemoryUsage: 4.75 MB (4979776) - RowsReturned: 38.53M (38529235) - SerializeBatchTime: 2s154ms - TransmitDataRPCTime: 3s683ms - UncompressedRowBatchSize: 1.22 GB (1310483822) CodeGen:(Total: 202.607ms, non-child: 202.607ms, % non-child: 100.00%) - CodegenTime: 1.548ms - CompileTime: 51.644ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 90 (90) - NumInstructions: 2.97K (2968) - OptimizationTime: 127.917ms - PeakMemoryUsage: 1.45 MB (1519616) - PrepareTime: 22.562ms HASH_JOIN_NODE (id=11):(Total: 2s073ms, non-child: 915.536ms, % non-child: 44.15%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.264ms - PeakMemoryUsage: 1.20 MB (1255232) - ProbeRows: 38.53M (38529235) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 867.996ms - RowsReturned: 38.53M (38529235) - RowsReturnedRate: 18.58 M/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 24.293us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 112.990us - HashBuckets: 212 (212) - HashCollisions: 0 (0) - HashTablesBuildTime: 43.817us - LargestPartitionPercent: 9 (9) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1073600) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 34.369ms, non-child: 16.705us, % non-child: 0.05%) BytesReceived(500.000ms): 0, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 4.721us - DeserializeRowBatchTimer: 15.673us - FirstBatchArrivalWaitTime: 29.205ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 3.49 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=9):(Total: 1s124ms, non-child: 1s124ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:135/8.82 GB 3:165/10.58 GB 7:148/9.71 GB 0:150/9.43 GB 4:146/8.93 GB 1:154/9.72 GB 2:140/9.00 GB 6:146/9.29 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 53 out of 53 Runtime filters: Only following filters arrived: 7, waited 743ms Hdfs Read Thread Concurrency Bucket: 0:80.95% 1:4.762% 2:9.524% 3:4.762% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1131 PARQUET/SNAPPY:53 BytesRead(500.000ms): 0, 0, 500.00 KB, 11.22 MB, 11.22 MB, 11.22 MB, 11.22 MB, 12.66 MB, 15.32 MB, 20.62 MB, 20.72 MB, 30.68 MB, 30.68 MB, 30.68 MB, 31.53 MB, 40.54 MB, 40.54 MB, 41.37 MB, 48.31 MB, 48.31 MB, 51.67 MB - FooterProcessingTime: (Avg: 81.629ms ; Min: 22.101ms ; Max: 325.414ms ; Number of samples: 53) - AverageHdfsReadThreadConcurrency: 0.38 - AverageScannerThreadConcurrency: 11.43 - BytesRead: 51.67 MB (54182705) - BytesReadDataNodeCache: 0 - BytesReadLocal: 51.67 MB (54182705) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 51.67 MB (54182705) - DecompressionTime: 328.722ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 53 (53) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 24.91 MB (26123323) - PerReadThreadRawHdfsThroughput: 26.47 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 248.481ms - RowBatchQueuePutWaitTime: 1m43s - RowsRead: 38.53M (38529235) - RowsReturned: 38.53M (38529235) - RowsReturnedRate: 34.27 M/sec - ScanRangesComplete: 1.18K (1184) - ScannerThreadsInvoluntaryContextSwitches: 1.66K (1664) - ScannerThreadsTotalWallClockTime: 1m59s - MaterializeTupleTime(*): 1s949ms - ScannerThreadsSysTime: 2s559ms - ScannerThreadsUserTime: 3s905ms - ScannerThreadsVoluntaryContextSwitches: 171.57K (171569) - TotalRawHdfsReadTime(*): 1s951ms - TotalReadThroughput: 4.92 MB/sec Filter 2 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 38.53M (38529235) Filter 7 (1.00 MB): - Files processed: 1.18K (1184) - Files rejected: 1.13K (1131) - Files total: 1.18K (1184) - RowGroups processed: 37.67K (37669) - RowGroups rejected: 0 (0) - RowGroups total: 37.67K (37669) - Rows processed: 868.35K (868352) - Rows rejected: 0 (0) - Rows total: 38.53M (38529235) - Splits processed: 53 (53) - Splits rejected: 0 (0) - Splits total: 53 (53) Instance 7f40dcb034de70b7:105 (host=va1036.foo:22000):(Total: 10s777ms, non-child: 2s653ms, % non-child: 24.62%) Hdfs split stats (:<# splits>/): 7:174/11.34 GB 3:124/7.65 GB 2:144/9.22 GB 6:147/8.95 GB 0:141/8.95 GB 1:146/9.49 GB 5:143/9.64 GB 4:162/10.29 GB Filter 7 arrival: 615ms Filter 2 arrival: 9s023ms MemoryUsage(500.000ms): 1.38 MB, 3.38 MB, 23.12 MB, 23.57 MB, 23.78 MB, 25.13 MB, 26.01 MB, 26.26 MB, 26.33 MB, 26.39 MB, 26.03 MB, 23.73 MB, 25.06 MB, 25.06 MB, 25.40 MB, 24.20 MB, 24.07 MB, 21.93 MB, 42.23 MB, 40.99 MB, 37.21 MB, 18.47 MB ThreadUsage(500.000ms): 2, 1, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 1 - AverageThreadTokens: 11.41 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 44.51 MB (46675983) - PerHostPeakMemUsage: 1.39 GB (1493048384) - RowsProduced: 39.80M (39795746) - TotalNetworkReceiveTime: 403.088ms - TotalNetworkSendTime: 2s851ms - TotalStorageWaitTime: 6s161ms - TotalThreadsInvoluntaryContextSwitches: 1.91K (1905) - TotalThreadsTotalWallClockTime: 2m7s - TotalThreadsSysTime: 2s844ms - TotalThreadsUserTime: 10s733ms - TotalThreadsVoluntaryContextSwitches: 157.70K (157701) Fragment Instance Lifecycle Timings: - ExecTime: 9s578ms - ExecTreeExecTime: 1s019ms - OpenTime: 1s156ms - ExecTreeOpenTime: 984.160ms - PrepareTime: 42.940ms - ExecTreePrepareTime: 2.538ms DataStreamSender (dst_id=23):(Total: 5s938ms, non-child: 5s938ms, % non-child: 100.00%) - BytesSent: 377.13 MB (395447742) - NetworkThroughput(*): 102.20 MB/sec - OverallThroughput: 63.51 MB/sec - PeakMemoryUsage: 4.80 MB (5037120) - RowsReturned: 39.80M (39795746) - SerializeBatchTime: 2s240ms - TransmitDataRPCTime: 3s690ms - UncompressedRowBatchSize: 1.26 GB (1353561236) CodeGen:(Total: 190.444ms, non-child: 190.444ms, % non-child: 100.00%) - CodegenTime: 1.105ms - CompileTime: 51.504ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 90 (90) - NumInstructions: 2.97K (2968) - OptimizationTime: 119.596ms - PeakMemoryUsage: 1.45 MB (1519616) - PrepareTime: 18.922ms HASH_JOIN_NODE (id=11):(Total: 1s995ms, non-child: 865.846ms, % non-child: 43.40%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.554ms - PeakMemoryUsage: 1.27 MB (1330431) - ProbeRows: 39.80M (39795746) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 815.525ms - RowsReturned: 39.80M (39795746) - RowsReturnedRate: 19.95 M/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 39.157us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 182.828us - HashBuckets: 212 (212) - HashCollisions: 0 (0) - HashTablesBuildTime: 51.426us - LargestPartitionPercent: 9 (9) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1073600) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 403.100ms, non-child: 21.379us, % non-child: 0.01%) BytesReceived(500.000ms): 0, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 5.268us - DeserializeRowBatchTimer: 30.270us - FirstBatchArrivalWaitTime: 396.487ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 297.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=9):(Total: 726.645ms, non-child: 726.645ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:174/11.34 GB 3:124/7.65 GB 2:144/9.22 GB 6:147/8.95 GB 0:141/8.95 GB 1:146/9.49 GB 5:143/9.64 GB 4:162/10.29 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 61 out of 61 Runtime filters: Only following filters arrived: 7, waited 402ms Hdfs Read Thread Concurrency Bucket: 0:80.95% 1:14.29% 2:4.762% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1120 PARQUET/SNAPPY:61 BytesRead(500.000ms): 0, 0, 9.18 MB, 10.67 MB, 10.67 MB, 12.09 MB, 21.04 MB, 21.04 MB, 21.04 MB, 23.01 MB, 30.69 MB, 30.69 MB, 31.52 MB, 31.52 MB, 32.36 MB, 39.82 MB, 40.66 MB, 43.17 MB, 51.04 MB, 53.28 MB, 54.93 MB - FooterProcessingTime: (Avg: 55.371ms ; Min: 15.691ms ; Max: 132.389ms ; Number of samples: 61) - AverageHdfsReadThreadConcurrency: 0.24 - AverageScannerThreadConcurrency: 10.86 - BytesRead: 54.93 MB (57597966) - BytesReadDataNodeCache: 0 - BytesReadLocal: 54.93 MB (57597966) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 54.93 MB (57597966) - DecompressionTime: 318.217ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 61 (61) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 22.69 MB (23792118) - PerReadThreadRawHdfsThroughput: 22.58 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 173.077ms - RowBatchQueuePutWaitTime: 1m42s - RowsRead: 39.81M (39810954) - RowsReturned: 39.80M (39795746) - RowsReturnedRate: 54.77 M/sec - ScanRangesComplete: 1.18K (1181) - ScannerThreadsInvoluntaryContextSwitches: 1.09K (1094) - ScannerThreadsTotalWallClockTime: 1m56s - MaterializeTupleTime(*): 2s027ms - ScannerThreadsSysTime: 2s535ms - ScannerThreadsUserTime: 4s135ms - ScannerThreadsVoluntaryContextSwitches: 157.06K (157055) - TotalRawHdfsReadTime(*): 2s433ms - TotalReadThroughput: 5.23 MB/sec Filter 2 (16.00 MB): - Rows processed: 210.79K (210792) - Rows rejected: 15.21K (15208) - Rows total: 39.81M (39810954) Filter 7 (1.00 MB): - Files processed: 1.18K (1181) - Files rejected: 1.12K (1120) - Files total: 1.18K (1181) - RowGroups processed: 38.90K (38902) - RowGroups rejected: 0 (0) - RowGroups total: 38.90K (38902) - Rows processed: 999.42K (999424) - Rows rejected: 0 (0) - Rows total: 39.80M (39795746) - Splits processed: 61 (61) - Splits rejected: 0 (0) - Splits total: 61 (61) Instance 7f40dcb034de70b7:17a (host=va1041.foo:22000):(Total: 10s776ms, non-child: 2s369ms, % non-child: 21.99%) Hdfs split stats (:<# splits>/): 7:141/9.49 GB 2:158/9.50 GB 3:154/9.47 GB 4:142/9.82 GB 0:153/10.02 GB 6:151/9.45 GB 1:148/8.79 GB 5:155/8.98 GB Filter 7 arrival: 309ms MemoryUsage(500.000ms): 2.80 MB, 3.38 MB, 11.86 MB, 25.94 MB, 26.23 MB, 25.31 MB, 28.11 MB, 27.26 MB, 22.84 MB, 25.04 MB, 26.75 MB, 27.55 MB, 27.55 MB, 26.46 MB, 26.68 MB, 27.40 MB, 24.06 MB, 25.10 MB, 24.01 MB, 24.65 MB, 17.50 MB, 4.53 MB ThreadUsage(500.000ms): 1, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 1 - AverageThreadTokens: 11.91 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 28.44 MB (29820195) - PerHostPeakMemUsage: 1.40 GB (1503195416) - RowsProduced: 42.10M (42102601) - TotalNetworkReceiveTime: 3.776us - TotalNetworkSendTime: 2s306ms - TotalStorageWaitTime: 6s476ms - TotalThreadsInvoluntaryContextSwitches: 2.50K (2502) - TotalThreadsTotalWallClockTime: 2m11s - TotalThreadsSysTime: 4s889ms - TotalThreadsUserTime: 11s965ms - TotalThreadsVoluntaryContextSwitches: 188.60K (188601) Fragment Instance Lifecycle Timings: - ExecTime: 9s593ms - ExecTreeExecTime: 1s081ms - OpenTime: 1s105ms - ExecTreeOpenTime: 865.666ms - PrepareTime: 77.645ms - ExecTreePrepareTime: 4.455ms DataStreamSender (dst_id=23):(Total: 6s201ms, non-child: 6s201ms, % non-child: 100.00%) - BytesSent: 398.59 MB (417947259) - NetworkThroughput(*): 104.12 MB/sec - OverallThroughput: 64.27 MB/sec - PeakMemoryUsage: 4.75 MB (4979776) - RowsReturned: 42.10M (42102601) - SerializeBatchTime: 2s364ms - TransmitDataRPCTime: 3s828ms - UncompressedRowBatchSize: 1.33 GB (1432023586) CodeGen:(Total: 263.792ms, non-child: 263.792ms, % non-child: 100.00%) - CodegenTime: 1.359ms - CompileTime: 69.612ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 90 (90) - NumInstructions: 2.97K (2968) - OptimizationTime: 166.218ms - PeakMemoryUsage: 1.45 MB (1519616) - PrepareTime: 27.362ms HASH_JOIN_NODE (id=11):(Total: 1s941ms, non-child: 930.025ms, % non-child: 47.91%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.342ms - PeakMemoryUsage: 1.20 MB (1255232) - ProbeRows: 42.10M (42102601) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 875.728ms - RowsReturned: 42.10M (42102601) - RowsReturnedRate: 21.69 M/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 23.554us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 114.736us - HashBuckets: 212 (212) - HashCollisions: 0 (0) - HashTablesBuildTime: 49.961us - LargestPartitionPercent: 9 (9) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1073600) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 12.857us, non-child: 12.857us, % non-child: 100.00%) BytesReceived(500.000ms): 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 4.297us - DeserializeRowBatchTimer: 29.589us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 9.33 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=9):(Total: 1s011ms, non-child: 1s011ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:141/9.49 GB 2:158/9.50 GB 3:154/9.47 GB 4:142/9.82 GB 0:153/10.02 GB 6:151/9.45 GB 1:148/8.79 GB 5:155/8.98 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 62 out of 62 Runtime filters: Only following filters arrived: 7, waited 703ms Hdfs Read Thread Concurrency Bucket: 0:95% 1:5% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1140 PARQUET/SNAPPY:62 BytesRead(500.000ms): 0, 0, 1.32 MB, 12.37 MB, 12.37 MB, 13.00 MB, 20.91 MB, 22.58 MB, 25.81 MB, 29.73 MB, 31.91 MB, 35.79 MB, 35.79 MB, 40.26 MB, 40.26 MB, 42.80 MB, 46.12 MB, 48.61 MB, 50.29 MB, 57.50 MB, 57.50 MB - FooterProcessingTime: (Avg: 65.704ms ; Min: 4.824ms ; Max: 217.213ms ; Number of samples: 62) - AverageHdfsReadThreadConcurrency: 0.05 - AverageScannerThreadConcurrency: 12.00 - BytesRead: 57.50 MB (60289868) - BytesReadDataNodeCache: 0 - BytesReadLocal: 57.50 MB (60289868) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 57.50 MB (60289868) - DecompressionTime: 352.033ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 62 (62) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 22.65 MB (23746973) - PerReadThreadRawHdfsThroughput: 24.99 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 158.689ms - RowBatchQueuePutWaitTime: 1m40s - RowsRead: 42.10M (42102601) - RowsReturned: 42.10M (42102601) - RowsReturnedRate: 41.64 M/sec - ScanRangesComplete: 1.20K (1202) - ScannerThreadsInvoluntaryContextSwitches: 1.50K (1504) - ScannerThreadsTotalWallClockTime: 2m1s - MaterializeTupleTime(*): 2s158ms - ScannerThreadsSysTime: 4s652ms - ScannerThreadsUserTime: 4s671ms - ScannerThreadsVoluntaryContextSwitches: 187.98K (187981) - TotalRawHdfsReadTime(*): 2s301ms - TotalReadThroughput: 5.48 MB/sec Filter 2 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 42.10M (42102601) Filter 7 (1.00 MB): - Files processed: 1.20K (1202) - Files rejected: 1.14K (1140) - Files total: 1.20K (1202) - RowGroups processed: 41.17K (41166) - RowGroups rejected: 0 (0) - RowGroups total: 41.17K (41166) - Rows processed: 1.02M (1015808) - Rows rejected: 0 (0) - Rows total: 42.10M (42102601) - Splits processed: 62 (62) - Splits rejected: 0 (0) - Splits total: 62 (62) Instance 7f40dcb034de70b7:10b (host=vd1338.foo:22000):(Total: 10s769ms, non-child: 1s700ms, % non-child: 15.79%) Hdfs split stats (:<# splits>/): 4:152/9.65 GB 7:141/8.83 GB 0:147/9.65 GB 6:161/10.74 GB 1:150/9.43 GB 5:148/9.23 GB 2:151/8.79 GB 3:141/9.18 GB Filter 7 arrival: 606ms Filter 2 arrival: 9s103ms MemoryUsage(500.000ms): 1.38 MB, 3.38 MB, 24.98 MB, 26.76 MB, 26.88 MB, 27.31 MB, 29.05 MB, 29.03 MB, 27.91 MB, 27.75 MB, 28.09 MB, 26.74 MB, 29.79 MB, 29.79 MB, 31.08 MB, 29.45 MB, 27.80 MB, 27.85 MB, 45.98 MB, 43.60 MB, 40.32 MB, 19.80 MB ThreadUsage(500.000ms): 2, 1, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 1 - AverageThreadTokens: 11.41 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 46.53 MB (48786023) - PerHostPeakMemUsage: 1.40 GB (1502586023) - RowsProduced: 43.33M (43331709) - TotalNetworkReceiveTime: 397.990ms - TotalNetworkSendTime: 2s099ms - TotalStorageWaitTime: 5s472ms - TotalThreadsInvoluntaryContextSwitches: 3.08K (3083) - TotalThreadsTotalWallClockTime: 2m7s - TotalThreadsSysTime: 3s812ms - TotalThreadsUserTime: 12s946ms - TotalThreadsVoluntaryContextSwitches: 176.59K (176593) Fragment Instance Lifecycle Timings: - ExecTime: 9s619ms - ExecTreeExecTime: 1s315ms - OpenTime: 1s107ms - ExecTreeOpenTime: 939.857ms - PrepareTime: 43.024ms - ExecTreePrepareTime: 2.567ms DataStreamSender (dst_id=23):(Total: 6s638ms, non-child: 6s638ms, % non-child: 100.00%) - BytesSent: 411.02 MB (430989161) - NetworkThroughput(*): 98.20 MB/sec - OverallThroughput: 61.92 MB/sec - PeakMemoryUsage: 4.87 MB (5102656) - RowsReturned: 43.33M (43331709) - SerializeBatchTime: 2s445ms - TransmitDataRPCTime: 4s185ms - UncompressedRowBatchSize: 1.37 GB (1473828898) CodeGen:(Total: 186.260ms, non-child: 186.260ms, % non-child: 100.00%) - CodegenTime: 806.857us - CompileTime: 50.784ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 90 (90) - NumInstructions: 2.97K (2968) - OptimizationTime: 115.114ms - PeakMemoryUsage: 1.45 MB (1519616) - PrepareTime: 20.006ms HASH_JOIN_NODE (id=11):(Total: 2s244ms, non-child: 1s133ms, % non-child: 50.52%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.595ms - PeakMemoryUsage: 1.27 MB (1333945) - ProbeRows: 43.33M (43331709) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1s076ms - RowsReturned: 43.33M (43331709) - RowsReturnedRate: 19.31 M/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 32.405us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 140.903us - HashBuckets: 212 (212) - HashCollisions: 0 (0) - HashTablesBuildTime: 66.159us - LargestPartitionPercent: 9 (9) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1073600) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 398.001ms, non-child: 20.901us, % non-child: 0.01%) BytesReceived(500.000ms): 0, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 4.775us - DeserializeRowBatchTimer: 17.778us - FirstBatchArrivalWaitTime: 383.311ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 301.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=9):(Total: 712.831ms, non-child: 712.831ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:152/9.65 GB 7:141/8.83 GB 0:147/9.65 GB 6:161/10.74 GB 1:150/9.43 GB 5:148/9.23 GB 2:151/8.79 GB 3:141/9.18 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 58 out of 58 Runtime filters: Only following filters arrived: 7, waited 402ms Hdfs Read Thread Concurrency Bucket: 0:85.71% 1:14.29% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1133 PARQUET/SNAPPY:58 BytesRead(500.000ms): 0, 0, 9.53 MB, 12.30 MB, 12.30 MB, 13.14 MB, 20.20 MB, 20.20 MB, 21.90 MB, 30.46 MB, 30.46 MB, 36.98 MB, 40.26 MB, 40.26 MB, 41.69 MB, 42.63 MB, 49.22 MB, 49.22 MB, 55.29 MB, 57.72 MB, 57.72 MB - FooterProcessingTime: (Avg: 49.971ms ; Min: 4.657ms ; Max: 153.801ms ; Number of samples: 58) - AverageHdfsReadThreadConcurrency: 0.14 - AverageScannerThreadConcurrency: 10.86 - BytesRead: 57.72 MB (60519254) - BytesReadDataNodeCache: 0 - BytesReadLocal: 57.72 MB (60519254) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 57.72 MB (60519254) - DecompressionTime: 355.398ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 58 (58) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 25.95 MB (27206197) - PerReadThreadRawHdfsThroughput: 26.95 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 135.970ms - RowBatchQueuePutWaitTime: 1m41s - RowsRead: 43.35M (43348139) - RowsReturned: 43.33M (43331709) - RowsReturnedRate: 60.79 M/sec - ScanRangesComplete: 1.19K (1191) - ScannerThreadsInvoluntaryContextSwitches: 2.22K (2224) - ScannerThreadsTotalWallClockTime: 1m56s - MaterializeTupleTime(*): 2s213ms - ScannerThreadsSysTime: 3s507ms - ScannerThreadsUserTime: 5s549ms - ScannerThreadsVoluntaryContextSwitches: 176.00K (176003) - TotalRawHdfsReadTime(*): 2s141ms - TotalReadThroughput: 5.50 MB/sec Filter 2 (16.00 MB): - Rows processed: 227.37K (227374) - Rows rejected: 16.43K (16430) - Rows total: 43.35M (43348139) Filter 7 (1.00 MB): - Files processed: 1.19K (1191) - Files rejected: 1.13K (1133) - Files total: 1.19K (1191) - RowGroups processed: 42.35K (42354) - RowGroups rejected: 0 (0) - RowGroups total: 42.35K (42354) - Rows processed: 950.27K (950272) - Rows rejected: 0 (0) - Rows total: 43.33M (43331709) - Splits processed: 58 (58) - Splits rejected: 0 (0) - Splits total: 58 (58) Instance 7f40dcb034de70b7:121 (host=vc1524.foo:22000):(Total: 10s767ms, non-child: 2s140ms, % non-child: 19.88%) Hdfs split stats (:<# splits>/): 7:146/8.78 GB 1:147/9.28 GB 6:157/9.96 GB 3:147/9.82 GB 4:156/10.05 GB 2:143/9.21 GB 5:146/9.20 GB 0:139/9.15 GB Filter 7 arrival: 530ms Filter 2 arrival: 9s438ms MemoryUsage(500.000ms): 1.38 MB, 3.38 MB, 24.40 MB, 24.91 MB, 25.39 MB, 20.85 MB, 24.98 MB, 25.36 MB, 23.42 MB, 24.88 MB, 24.97 MB, 23.92 MB, 25.29 MB, 26.93 MB, 26.91 MB, 26.07 MB, 24.88 MB, 25.10 MB, 23.58 MB, 42.26 MB, 36.34 MB ThreadUsage(500.000ms): 2, 1, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 11.90 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 42.87 MB (44955076) - PerHostPeakMemUsage: 1.41 GB (1516881895) - RowsProduced: 43.82M (43815146) - TotalNetworkReceiveTime: 307.421ms - TotalNetworkSendTime: 2s547ms - TotalStorageWaitTime: 6s208ms - TotalThreadsInvoluntaryContextSwitches: 2.17K (2174) - TotalThreadsTotalWallClockTime: 2m8s - TotalThreadsSysTime: 2s664ms - TotalThreadsUserTime: 10s926ms - TotalThreadsVoluntaryContextSwitches: 140.32K (140317) Fragment Instance Lifecycle Timings: - ExecTime: 9s600ms - ExecTreeExecTime: 1s106ms - OpenTime: 1s121ms - ExecTreeOpenTime: 940.423ms - PrepareTime: 44.749ms - ExecTreePrepareTime: 3.127ms DataStreamSender (dst_id=23):(Total: 6s390ms, non-child: 6s390ms, % non-child: 100.00%) - BytesSent: 415.55 MB (435730640) - NetworkThroughput(*): 102.42 MB/sec - OverallThroughput: 65.03 MB/sec - PeakMemoryUsage: 4.65 MB (4873280) - RowsReturned: 43.82M (43815146) - SerializeBatchTime: 2s324ms - TransmitDataRPCTime: 4s057ms - UncompressedRowBatchSize: 1.39 GB (1490271892) CodeGen:(Total: 197.030ms, non-child: 197.030ms, % non-child: 100.00%) - CodegenTime: 1.048ms - CompileTime: 57.124ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 90 (90) - NumInstructions: 2.97K (2968) - OptimizationTime: 122.359ms - PeakMemoryUsage: 1.45 MB (1519616) - PrepareTime: 17.060ms HASH_JOIN_NODE (id=11):(Total: 2s039ms, non-child: 960.556ms, % non-child: 47.10%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.386ms - PeakMemoryUsage: 1.27 MB (1328577) - ProbeRows: 43.82M (43815146) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 909.192ms - RowsReturned: 43.82M (43815146) - RowsReturnedRate: 21.48 M/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 25.582us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 114.267us - HashBuckets: 212 (212) - HashCollisions: 0 (0) - HashTablesBuildTime: 57.157us - LargestPartitionPercent: 9 (9) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1073600) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 307.430ms, non-child: 16.782us, % non-child: 0.01%) BytesReceived(500.000ms): 0, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 4.263us - DeserializeRowBatchTimer: 22.028us - FirstBatchArrivalWaitTime: 300.801ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 390.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=9):(Total: 771.943ms, non-child: 771.943ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:146/8.78 GB 1:147/9.28 GB 6:157/9.96 GB 3:147/9.82 GB 4:156/10.05 GB 2:143/9.21 GB 5:146/9.20 GB 0:139/9.15 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 68 out of 68 Runtime filters: Only following filters arrived: 7, waited 482ms Hdfs Read Thread Concurrency Bucket: 0:85.71% 1:14.29% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1113 PARQUET/SNAPPY:68 BytesRead(500.000ms): 0, 0, 11.29 MB, 11.29 MB, 11.29 MB, 14.87 MB, 19.85 MB, 19.85 MB, 29.01 MB, 30.90 MB, 30.90 MB, 38.49 MB, 39.33 MB, 40.74 MB, 40.74 MB, 43.26 MB, 49.09 MB, 49.09 MB, 57.81 MB, 60.91 MB, 60.91 MB - FooterProcessingTime: (Avg: 53.171ms ; Min: 3.901ms ; Max: 161.928ms ; Number of samples: 68) - AverageHdfsReadThreadConcurrency: 0.14 - AverageScannerThreadConcurrency: 10.86 - BytesRead: 60.91 MB (63867727) - BytesReadDataNodeCache: 0 - BytesReadLocal: 60.91 MB (63867727) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 60.91 MB (63867727) - DecompressionTime: 347.238ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 68 (68) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 21.83 MB (22892225) - PerReadThreadRawHdfsThroughput: 25.67 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 147.879ms - RowBatchQueuePutWaitTime: 1m43s - RowsRead: 43.82M (43824742) - RowsReturned: 43.82M (43815146) - RowsReturnedRate: 56.76 M/sec - ScanRangesComplete: 1.18K (1181) - ScannerThreadsInvoluntaryContextSwitches: 1.36K (1360) - ScannerThreadsTotalWallClockTime: 1m57s - MaterializeTupleTime(*): 2s180ms - ScannerThreadsSysTime: 2s396ms - ScannerThreadsUserTime: 3s939ms - ScannerThreadsVoluntaryContextSwitches: 139.63K (139629) - TotalRawHdfsReadTime(*): 2s373ms - TotalReadThroughput: 5.80 MB/sec Filter 2 (16.00 MB): - Rows processed: 132.48K (132476) - Rows rejected: 9.60K (9596) - Rows total: 43.82M (43824742) Filter 7 (1.00 MB): - Files processed: 1.18K (1181) - Files rejected: 1.11K (1113) - Files total: 1.18K (1181) - RowGroups processed: 42.84K (42838) - RowGroups rejected: 0 (0) - RowGroups total: 42.84K (42838) - Rows processed: 1.11M (1114112) - Rows rejected: 0 (0) - Rows total: 43.82M (43815146) - Splits processed: 68 (68) - Splits rejected: 0 (0) - Splits total: 68 (68) Instance 7f40dcb034de70b7:171 (host=vd1342.foo:22000):(Total: 10s764ms, non-child: 1s953ms, % non-child: 18.15%) Hdfs split stats (:<# splits>/): 3:153/9.57 GB 6:147/9.19 GB 1:162/10.33 GB 4:154/9.96 GB 7:140/8.97 GB 2:149/9.69 GB 5:146/9.00 GB 0:131/8.78 GB Filter 7 arrival: 235ms MemoryUsage(500.000ms): 3.38 MB, 3.38 MB, 24.04 MB, 24.10 MB, 24.38 MB, 25.78 MB, 25.99 MB, 25.01 MB, 26.80 MB, 27.18 MB, 26.47 MB, 25.09 MB, 25.11 MB, 27.06 MB, 27.05 MB, 26.29 MB, 24.89 MB, 24.35 MB, 22.24 MB, 25.99 MB, 19.20 MB ThreadUsage(500.000ms): 1, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.43 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 27.61 MB (28956034) - PerHostPeakMemUsage: 1.38 GB (1481430348) - RowsProduced: 43.20M (43203605) - TotalNetworkReceiveTime: 3.959us - TotalNetworkSendTime: 2s302ms - TotalStorageWaitTime: 7s258ms - TotalThreadsInvoluntaryContextSwitches: 1.99K (1992) - TotalThreadsTotalWallClockTime: 2m11s - TotalThreadsSysTime: 1s909ms - TotalThreadsUserTime: 11s025ms - TotalThreadsVoluntaryContextSwitches: 118.89K (118893) Fragment Instance Lifecycle Timings: - ExecTime: 9s527ms - ExecTreeExecTime: 1s140ms - OpenTime: 1s184ms - ExecTreeOpenTime: 998.684ms - PrepareTime: 52.711ms - ExecTreePrepareTime: 3.344ms DataStreamSender (dst_id=23):(Total: 6s472ms, non-child: 6s472ms, % non-child: 100.00%) - BytesSent: 410.18 MB (430106235) - NetworkThroughput(*): 100.83 MB/sec - OverallThroughput: 63.38 MB/sec - PeakMemoryUsage: 4.80 MB (5037120) - RowsReturned: 43.20M (43203605) - SerializeBatchTime: 2s396ms - TransmitDataRPCTime: 4s068ms - UncompressedRowBatchSize: 1.37 GB (1469471730) CodeGen:(Total: 207.196ms, non-child: 207.196ms, % non-child: 100.00%) - CodegenTime: 1.042ms - CompileTime: 52.775ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 90 (90) - NumInstructions: 2.97K (2968) - OptimizationTime: 131.426ms - PeakMemoryUsage: 1.45 MB (1519616) - PrepareTime: 22.551ms HASH_JOIN_NODE (id=11):(Total: 2s131ms, non-child: 981.741ms, % non-child: 46.05%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.410ms - PeakMemoryUsage: 1.20 MB (1255232) - ProbeRows: 43.20M (43203605) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 932.292ms - RowsReturned: 43.20M (43203605) - RowsReturnedRate: 20.27 M/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 24.576us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 125.274us - HashBuckets: 212 (212) - HashCollisions: 0 (0) - HashTablesBuildTime: 55.231us - LargestPartitionPercent: 9 (9) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1073600) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 13.137us, non-child: 13.137us, % non-child: 100.00%) BytesReceived(500.000ms): 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 4.758us - DeserializeRowBatchTimer: 14.891us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 9.13 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=9):(Total: 1s150ms, non-child: 1s150ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:153/9.57 GB 6:147/9.19 GB 1:162/10.33 GB 4:154/9.96 GB 7:140/8.97 GB 2:149/9.69 GB 5:146/9.00 GB 0:131/8.78 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 64 out of 64 Runtime filters: Only following filters arrived: 7, waited 783ms Hdfs Read Thread Concurrency Bucket: 0:95.24% 1:0% 2:4.762% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1118 PARQUET/SNAPPY:64 BytesRead(500.000ms): 0, 0, 10.55 MB, 10.55 MB, 10.55 MB, 20.95 MB, 20.95 MB, 21.88 MB, 30.57 MB, 30.57 MB, 33.12 MB, 34.80 MB, 34.80 MB, 40.75 MB, 40.75 MB, 45.72 MB, 49.05 MB, 50.49 MB, 56.33 MB, 59.51 MB, 59.51 MB - FooterProcessingTime: (Avg: 78.080ms ; Min: 3.748ms ; Max: 283.090ms ; Number of samples: 64) - AverageHdfsReadThreadConcurrency: 0.10 - AverageScannerThreadConcurrency: 11.43 - BytesRead: 59.51 MB (62397119) - BytesReadDataNodeCache: 0 - BytesReadLocal: 59.51 MB (62397119) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 59.51 MB (62397119) - DecompressionTime: 352.498ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 64 (64) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 21.82 MB (22882558) - PerReadThreadRawHdfsThroughput: 23.27 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 211.304ms - RowBatchQueuePutWaitTime: 1m43s - RowsRead: 43.20M (43203605) - RowsReturned: 43.20M (43203605) - RowsReturnedRate: 37.57 M/sec - ScanRangesComplete: 1.18K (1182) - ScannerThreadsInvoluntaryContextSwitches: 1.16K (1156) - ScannerThreadsTotalWallClockTime: 2m - MaterializeTupleTime(*): 2s177ms - ScannerThreadsSysTime: 1s614ms - ScannerThreadsUserTime: 3s891ms - ScannerThreadsVoluntaryContextSwitches: 118.26K (118259) - TotalRawHdfsReadTime(*): 2s557ms - TotalReadThroughput: 5.67 MB/sec Filter 2 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 43.20M (43203605) Filter 7 (1.00 MB): - Files processed: 1.18K (1182) - Files rejected: 1.12K (1118) - Files total: 1.18K (1182) - RowGroups processed: 42.24K (42244) - RowGroups rejected: 0 (0) - RowGroups total: 42.24K (42244) - Rows processed: 1.05M (1048576) - Rows rejected: 0 (0) - Rows total: 43.20M (43203605) - Splits processed: 64 (64) - Splits rejected: 0 (0) - Splits total: 64 (64) Instance 7f40dcb034de70b7:12f (host=va1042.foo:22000):(Total: 10s759ms, non-child: 2s754ms, % non-child: 25.60%) Hdfs split stats (:<# splits>/): 6:155/10.58 GB 5:156/10.27 GB 2:147/9.08 GB 7:142/9.70 GB 3:148/8.84 GB 1:144/8.80 GB 4:139/9.60 GB 0:138/8.64 GB Filter 7 arrival: 493ms Filter 2 arrival: 9s559ms MemoryUsage(500.000ms): 2.79 MB, 3.38 MB, 16.19 MB, 22.78 MB, 22.92 MB, 22.19 MB, 24.98 MB, 25.44 MB, 24.64 MB, 26.97 MB, 27.11 MB, 27.03 MB, 29.07 MB, 29.07 MB, 28.94 MB, 29.11 MB, 26.92 MB, 29.92 MB, 30.04 MB, 46.43 MB, 41.48 MB, 28.62 MB ThreadUsage(500.000ms): 1, 1, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 11.91 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 46.76 MB (49033674) - PerHostPeakMemUsage: 1.42 GB (1529980357) - RowsProduced: 41.53M (41528413) - TotalNetworkReceiveTime: 251.259ms - TotalNetworkSendTime: 3s327ms - TotalStorageWaitTime: 5s782ms - TotalThreadsInvoluntaryContextSwitches: 2.76K (2762) - TotalThreadsTotalWallClockTime: 2m7s - TotalThreadsSysTime: 2s594ms - TotalThreadsUserTime: 10s865ms - TotalThreadsVoluntaryContextSwitches: 137.79K (137788) Fragment Instance Lifecycle Timings: - ExecTime: 9s654ms - ExecTreeExecTime: 1s079ms - OpenTime: 1s057ms - ExecTreeOpenTime: 857.627ms - PrepareTime: 47.768ms - ExecTreePrepareTime: 3.593ms DataStreamSender (dst_id=23):(Total: 5s863ms, non-child: 5s863ms, % non-child: 100.00%) - BytesSent: 393.45 MB (412558818) - NetworkThroughput(*): 103.07 MB/sec - OverallThroughput: 67.10 MB/sec - PeakMemoryUsage: 4.78 MB (5012544) - RowsReturned: 41.53M (41528413) - SerializeBatchTime: 2s039ms - TransmitDataRPCTime: 3s817ms - UncompressedRowBatchSize: 1.32 GB (1412493954) CodeGen:(Total: 213.841ms, non-child: 213.841ms, % non-child: 100.00%) - CodegenTime: 986.253us - CompileTime: 64.618ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 90 (90) - NumInstructions: 2.97K (2968) - OptimizationTime: 132.294ms - PeakMemoryUsage: 1.45 MB (1519616) - PrepareTime: 16.514ms HASH_JOIN_NODE (id=11):(Total: 1s927ms, non-child: 907.583ms, % non-child: 47.08%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.762ms - PeakMemoryUsage: 1.27 MB (1327242) - ProbeRows: 41.53M (41528413) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 853.038ms - RowsReturned: 41.53M (41528413) - RowsReturnedRate: 21.54 M/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 26.855us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 208.965us - HashBuckets: 212 (212) - HashCollisions: 0 (0) - HashTablesBuildTime: 65.777us - LargestPartitionPercent: 9 (9) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1073600) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 251.269ms, non-child: 18.670us, % non-child: 0.01%) BytesReceived(500.000ms): 0, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 4.825us - DeserializeRowBatchTimer: 19.562us - FirstBatchArrivalWaitTime: 223.744ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 477.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=9):(Total: 769.180ms, non-child: 769.180ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 6:155/10.58 GB 5:156/10.27 GB 2:147/9.08 GB 7:142/9.70 GB 3:148/8.84 GB 1:144/8.80 GB 4:139/9.60 GB 0:138/8.64 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 60 out of 60 Runtime filters: Only following filters arrived: 7, waited 522ms Hdfs Read Thread Concurrency Bucket: 0:80.95% 1:14.29% 2:0% 3:4.762% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1109 PARQUET/SNAPPY:60 BytesRead(500.000ms): 0, 0, 3.11 MB, 10.10 MB, 10.10 MB, 10.94 MB, 22.15 MB, 22.15 MB, 29.12 MB, 31.63 MB, 31.63 MB, 32.45 MB, 41.46 MB, 41.46 MB, 42.30 MB, 42.30 MB, 47.11 MB, 52.38 MB, 52.38 MB, 54.88 MB, 56.58 MB, 56.58 MB - FooterProcessingTime: (Avg: 59.233ms ; Min: 12.335ms ; Max: 164.483ms ; Number of samples: 60) - AverageHdfsReadThreadConcurrency: 0.29 - AverageScannerThreadConcurrency: 11.43 - BytesRead: 56.58 MB (59325758) - BytesReadDataNodeCache: 0 - BytesReadLocal: 56.58 MB (59325758) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 56.58 MB (59325758) - DecompressionTime: 314.529ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 60 (60) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 25.08 MB (26299476) - PerReadThreadRawHdfsThroughput: 22.66 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 80.594ms - RowBatchQueuePutWaitTime: 1m43s - RowsRead: 41.54M (41542037) - RowsReturned: 41.53M (41528413) - RowsReturnedRate: 53.99 M/sec - ScanRangesComplete: 1.17K (1169) - ScannerThreadsInvoluntaryContextSwitches: 1.97K (1974) - ScannerThreadsTotalWallClockTime: 1m57s - MaterializeTupleTime(*): 2s105ms - ScannerThreadsSysTime: 2s281ms - ScannerThreadsUserTime: 4s638ms - ScannerThreadsVoluntaryContextSwitches: 137.08K (137078) - TotalRawHdfsReadTime(*): 2s497ms - TotalReadThroughput: 5.14 MB/sec Filter 2 (16.00 MB): - Rows processed: 184.63K (184632) - Rows rejected: 13.62K (13624) - Rows total: 41.54M (41542037) Filter 7 (1.00 MB): - Files processed: 1.17K (1169) - Files rejected: 1.11K (1109) - Files total: 1.17K (1169) - RowGroups processed: 40.60K (40596) - RowGroups rejected: 0 (0) - RowGroups total: 40.60K (40596) - Rows processed: 983.04K (983040) - Rows rejected: 0 (0) - Rows total: 41.53M (41528413) - Splits processed: 60 (60) - Splits rejected: 0 (0) - Splits total: 60 (60) Instance 7f40dcb034de70b7:15b (host=vc1514.foo:22000):(Total: 10s737ms, non-child: 2s258ms, % non-child: 21.03%) Hdfs split stats (:<# splits>/): 5:155/10.12 GB 1:143/8.89 GB 3:147/9.02 GB 7:152/10.14 GB 0:152/9.26 GB 2:151/9.66 GB 4:143/9.17 GB 6:159/9.27 GB Filter 7 arrival: 309ms MemoryUsage(500.000ms): 3.38 MB, 3.38 MB, 23.75 MB, 23.76 MB, 24.28 MB, 24.31 MB, 27.13 MB, 27.45 MB, 26.91 MB, 27.07 MB, 28.15 MB, 28.13 MB, 28.13 MB, 24.52 MB, 25.99 MB, 26.19 MB, 24.85 MB, 24.02 MB, 24.17 MB, 23.47 MB, 19.53 MB ThreadUsage(500.000ms): 1, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.43 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 28.73 MB (30126708) - PerHostPeakMemUsage: 1.38 GB (1480736236) - RowsProduced: 42.38M (42382962) - TotalNetworkReceiveTime: 71.861ms - TotalNetworkSendTime: 2s470ms - TotalStorageWaitTime: 7s373ms - TotalThreadsInvoluntaryContextSwitches: 2.22K (2223) - TotalThreadsTotalWallClockTime: 2m9s - TotalThreadsSysTime: 1s895ms - TotalThreadsUserTime: 11s026ms - TotalThreadsVoluntaryContextSwitches: 116.19K (116192) Fragment Instance Lifecycle Timings: - ExecTime: 9s495ms - ExecTreeExecTime: 1s049ms - OpenTime: 1s178ms - ExecTreeOpenTime: 997.047ms - PrepareTime: 63.672ms - ExecTreePrepareTime: 6.299ms DataStreamSender (dst_id=23):(Total: 6s231ms, non-child: 6s231ms, % non-child: 100.00%) - BytesSent: 401.68 MB (421192050) - NetworkThroughput(*): 102.94 MB/sec - OverallThroughput: 64.46 MB/sec - PeakMemoryUsage: 4.79 MB (5020736) - RowsReturned: 42.38M (42382962) - SerializeBatchTime: 2s320ms - TransmitDataRPCTime: 3s902ms - UncompressedRowBatchSize: 1.34 GB (1441559444) CodeGen:(Total: 202.454ms, non-child: 202.454ms, % non-child: 100.00%) - CodegenTime: 929.265us - CompileTime: 53.844ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 90 (90) - NumInstructions: 2.97K (2968) - OptimizationTime: 125.860ms - PeakMemoryUsage: 1.45 MB (1519616) - PrepareTime: 22.395ms HASH_JOIN_NODE (id=11):(Total: 2s045ms, non-child: 906.590ms, % non-child: 44.32%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.588ms - PeakMemoryUsage: 1.20 MB (1255232) - ProbeRows: 42.38M (42382962) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 854.363ms - RowsReturned: 42.38M (42382962) - RowsReturnedRate: 20.72 M/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 28.131us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 183.710us - HashBuckets: 212 (212) - HashCollisions: 0 (0) - HashTablesBuildTime: 67.656us - LargestPartitionPercent: 9 (9) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1073600) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 71.870ms, non-child: 18.958us, % non-child: 0.03%) BytesReceived(500.000ms): 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 4.078us - DeserializeRowBatchTimer: 24.750us - FirstBatchArrivalWaitTime: 45.873ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 1.67 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=9):(Total: 1s067ms, non-child: 1s067ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:155/10.12 GB 1:143/8.89 GB 3:147/9.02 GB 7:152/10.14 GB 0:152/9.26 GB 2:151/9.66 GB 4:143/9.17 GB 6:159/9.27 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 65 out of 65 Runtime filters: Only following filters arrived: 7, waited 703ms Hdfs Read Thread Concurrency Bucket: 0:90.48% 1:0% 2:0% 3:9.524% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1137 PARQUET/SNAPPY:65 BytesRead(500.000ms): 0, 0, 10.62 MB, 10.62 MB, 11.44 MB, 17.94 MB, 21.60 MB, 22.43 MB, 29.74 MB, 29.74 MB, 31.14 MB, 31.14 MB, 31.14 MB, 37.22 MB, 40.08 MB, 40.08 MB, 48.45 MB, 49.29 MB, 50.15 MB, 58.73 MB, 58.73 MB - FooterProcessingTime: (Avg: 57.063ms ; Min: 16.077ms ; Max: 291.913ms ; Number of samples: 65) - AverageHdfsReadThreadConcurrency: 0.29 - AverageScannerThreadConcurrency: 11.43 - BytesRead: 58.73 MB (61581403) - BytesReadDataNodeCache: 0 - BytesReadLocal: 58.73 MB (61581403) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 58.73 MB (61581403) - DecompressionTime: 317.433ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 65 (65) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 22.95 MB (24066828) - PerReadThreadRawHdfsThroughput: 26.86 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 218.129ms - RowBatchQueuePutWaitTime: 1m42s - RowsRead: 42.38M (42382962) - RowsReturned: 42.38M (42382962) - RowsReturnedRate: 39.71 M/sec - ScanRangesComplete: 1.20K (1202) - ScannerThreadsInvoluntaryContextSwitches: 1.40K (1398) - ScannerThreadsTotalWallClockTime: 1m58s - MaterializeTupleTime(*): 2s010ms - ScannerThreadsSysTime: 1s606ms - ScannerThreadsUserTime: 4s090ms - ScannerThreadsVoluntaryContextSwitches: 115.55K (115551) - TotalRawHdfsReadTime(*): 2s186ms - TotalReadThroughput: 5.59 MB/sec Filter 2 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 42.38M (42382962) Filter 7 (1.00 MB): - Files processed: 1.20K (1202) - Files rejected: 1.14K (1137) - Files total: 1.20K (1202) - RowGroups processed: 41.44K (41444) - RowGroups rejected: 0 (0) - RowGroups total: 41.44K (41444) - Rows processed: 1.06M (1064960) - Rows rejected: 0 (0) - Rows total: 42.38M (42382962) - Splits processed: 65 (65) - Splits rejected: 0 (0) - Splits total: 65 (65) Instance 7f40dcb034de70b7:11f (host=vd1134.foo:22000):(Total: 10s705ms, non-child: 2s327ms, % non-child: 21.74%) Hdfs split stats (:<# splits>/): 3:150/9.89 GB 1:153/9.65 GB 7:144/9.36 GB 5:147/9.22 GB 4:155/10.50 GB 2:143/8.70 GB 6:154/9.76 GB 0:139/8.39 GB Filter 7 arrival: 521ms Filter 2 arrival: 9s401ms MemoryUsage(500.000ms): 1.38 MB, 3.38 MB, 28.62 MB, 29.01 MB, 29.44 MB, 29.48 MB, 30.36 MB, 30.25 MB, 29.23 MB, 29.98 MB, 30.16 MB, 30.45 MB, 30.45 MB, 28.54 MB, 32.01 MB, 32.39 MB, 26.75 MB, 28.90 MB, 45.14 MB, 38.25 MB, 32.87 MB ThreadUsage(500.000ms): 2, 1, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 11.90 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 46.00 MB (48232251) - PerHostPeakMemUsage: 1.41 GB (1508979221) - RowsProduced: 40.05M (40047980) - TotalNetworkReceiveTime: 295.132ms - TotalNetworkSendTime: 2s684ms - TotalStorageWaitTime: 5s358ms - TotalThreadsInvoluntaryContextSwitches: 2.47K (2467) - TotalThreadsTotalWallClockTime: 2m6s - TotalThreadsSysTime: 3s077ms - TotalThreadsUserTime: 11s320ms - TotalThreadsVoluntaryContextSwitches: 266.09K (266088) Fragment Instance Lifecycle Timings: - ExecTime: 9s568ms - ExecTreeExecTime: 1s080ms - OpenTime: 1s082ms - ExecTreeOpenTime: 905.839ms - PrepareTime: 53.859ms - ExecTreePrepareTime: 3.405ms DataStreamSender (dst_id=23):(Total: 6s200ms, non-child: 6s200ms, % non-child: 100.00%) - BytesSent: 379.61 MB (398051602) - NetworkThroughput(*): 97.18 MB/sec - OverallThroughput: 61.22 MB/sec - PeakMemoryUsage: 4.71 MB (4938816) - RowsReturned: 40.05M (40047980) - SerializeBatchTime: 2s287ms - TransmitDataRPCTime: 3s906ms - UncompressedRowBatchSize: 1.27 GB (1362140392) CodeGen:(Total: 197.976ms, non-child: 197.976ms, % non-child: 100.00%) - CodegenTime: 1.095ms - CompileTime: 50.590ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 90 (90) - NumInstructions: 2.97K (2968) - OptimizationTime: 124.516ms - PeakMemoryUsage: 1.45 MB (1519616) - PrepareTime: 22.460ms HASH_JOIN_NODE (id=11):(Total: 1s979ms, non-child: 934.918ms, % non-child: 47.23%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.477ms - PeakMemoryUsage: 1.26 MB (1325078) - ProbeRows: 40.05M (40047980) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 887.881ms - RowsReturned: 40.05M (40047980) - RowsReturnedRate: 20.23 M/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 30.694us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 125.004us - HashBuckets: 212 (212) - HashCollisions: 0 (0) - HashTablesBuildTime: 54.703us - LargestPartitionPercent: 9 (9) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1073600) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 295.142ms, non-child: 19.785us, % non-child: 0.01%) BytesReceived(500.000ms): 0, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 4.584us - DeserializeRowBatchTimer: 20.959us - FirstBatchArrivalWaitTime: 283.044ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 406.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=9):(Total: 749.804ms, non-child: 749.804ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:150/9.89 GB 1:153/9.65 GB 7:144/9.36 GB 5:147/9.22 GB 4:155/10.50 GB 2:143/8.70 GB 6:154/9.76 GB 0:139/8.39 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 52 out of 52 Runtime filters: Only following filters arrived: 7, waited 482ms Hdfs Read Thread Concurrency Bucket: 0:85.71% 1:4.762% 2:4.762% 3:4.762% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1133 PARQUET/SNAPPY:52 BytesRead(500.000ms): 0, 0, 13.29 MB, 13.29 MB, 14.12 MB, 19.03 MB, 20.53 MB, 22.78 MB, 28.96 MB, 30.65 MB, 30.65 MB, 31.49 MB, 31.49 MB, 34.76 MB, 39.04 MB, 39.04 MB, 45.78 MB, 48.29 MB, 49.14 MB, 52.98 MB, 52.98 MB - FooterProcessingTime: (Avg: 61.393ms ; Min: 5.376ms ; Max: 175.897ms ; Number of samples: 52) - AverageHdfsReadThreadConcurrency: 0.29 - AverageScannerThreadConcurrency: 10.86 - BytesRead: 52.98 MB (55549873) - BytesReadDataNodeCache: 0 - BytesReadLocal: 52.98 MB (55549873) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 52.98 MB (55549873) - DecompressionTime: 336.607ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 52 (52) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 26.83 MB (28133722) - PerReadThreadRawHdfsThroughput: 23.75 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 122.792ms - RowBatchQueuePutWaitTime: 1m42s - RowsRead: 40.06M (40061691) - RowsReturned: 40.05M (40047980) - RowsReturnedRate: 53.41 M/sec - ScanRangesComplete: 1.19K (1185) - ScannerThreadsInvoluntaryContextSwitches: 1.67K (1669) - ScannerThreadsTotalWallClockTime: 1m55s - MaterializeTupleTime(*): 1s983ms - ScannerThreadsSysTime: 2s798ms - ScannerThreadsUserTime: 4s541ms - ScannerThreadsVoluntaryContextSwitches: 265.44K (265438) - TotalRawHdfsReadTime(*): 2s230ms - TotalReadThroughput: 5.05 MB/sec Filter 2 (16.00 MB): - Rows processed: 191.89K (191887) - Rows rejected: 13.71K (13711) - Rows total: 40.06M (40061691) Filter 7 (1.00 MB): - Files processed: 1.19K (1185) - Files rejected: 1.13K (1133) - Files total: 1.19K (1185) - RowGroups processed: 39.14K (39142) - RowGroups rejected: 0 (0) - RowGroups total: 39.14K (39142) - Rows processed: 851.97K (851968) - Rows rejected: 0 (0) - Rows total: 40.05M (40047980) - Splits processed: 52 (52) - Splits rejected: 0 (0) - Splits total: 52 (52) Instance 7f40dcb034de70b7:148 (host=vc1517.foo:22000):(Total: 10s695ms, non-child: 2s285ms, % non-child: 21.37%) Hdfs split stats (:<# splits>/): 1:153/9.28 GB 7:154/9.78 GB 4:146/9.54 GB 5:139/9.12 GB 2:157/9.56 GB 0:143/9.36 GB 6:153/9.57 GB 3:146/9.29 GB Filter 7 arrival: 388ms Filter 2 arrival: 10s543ms MemoryUsage(500.000ms): 1.38 MB, 3.38 MB, 20.22 MB, 24.79 MB, 25.20 MB, 21.92 MB, 29.03 MB, 29.11 MB, 29.92 MB, 29.03 MB, 29.50 MB, 28.36 MB, 28.48 MB, 24.43 MB, 27.11 MB, 25.67 MB, 28.81 MB, 29.02 MB, 28.05 MB, 26.46 MB, 26.87 MB ThreadUsage(500.000ms): 2, 1, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 11.90 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 30.73 MB (32218852) - PerHostPeakMemUsage: 1.40 GB (1498056625) - RowsProduced: 42.33M (42333828) - TotalNetworkReceiveTime: 168.905ms - TotalNetworkSendTime: 2s706ms - TotalStorageWaitTime: 6s334ms - TotalThreadsInvoluntaryContextSwitches: 2.52K (2516) - TotalThreadsTotalWallClockTime: 2m7s - TotalThreadsSysTime: 2s792ms - TotalThreadsUserTime: 11s300ms - TotalThreadsVoluntaryContextSwitches: 180.85K (180852) Fragment Instance Lifecycle Timings: - ExecTime: 9s580ms - ExecTreeExecTime: 1s184ms - OpenTime: 1s064ms - ExecTreeOpenTime: 891.967ms - PrepareTime: 50.720ms - ExecTreePrepareTime: 3.248ms DataStreamSender (dst_id=23):(Total: 6s147ms, non-child: 6s147ms, % non-child: 100.00%) - BytesSent: 401.48 MB (420984718) - NetworkThroughput(*): 102.91 MB/sec - OverallThroughput: 65.31 MB/sec - PeakMemoryUsage: 4.79 MB (5020736) - RowsReturned: 42.33M (42333828) - SerializeBatchTime: 2s238ms - TransmitDataRPCTime: 3s901ms - UncompressedRowBatchSize: 1.34 GB (1439888224) CodeGen:(Total: 190.812ms, non-child: 190.812ms, % non-child: 100.00%) - CodegenTime: 1.270ms - CompileTime: 50.353ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 90 (90) - NumInstructions: 2.97K (2968) - OptimizationTime: 120.155ms - PeakMemoryUsage: 1.45 MB (1519616) - PrepareTime: 19.835ms HASH_JOIN_NODE (id=11):(Total: 2s071ms, non-child: 1s034ms, % non-child: 49.93%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.531ms - PeakMemoryUsage: 1.24 MB (1305160) - ProbeRows: 42.33M (42333828) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 985.682ms - RowsReturned: 42.33M (42333828) - RowsReturnedRate: 20.44 M/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 25.840us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 131.634us - HashBuckets: 212 (212) - HashCollisions: 0 (0) - HashTablesBuildTime: 63.010us - LargestPartitionPercent: 9 (9) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1073600) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 168.918ms, non-child: 21.255us, % non-child: 0.01%) BytesReceived(500.000ms): 0, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 5.833us - DeserializeRowBatchTimer: 12.462us - FirstBatchArrivalWaitTime: 156.832ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 710.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=9):(Total: 868.503ms, non-child: 868.503ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:153/9.28 GB 7:154/9.78 GB 4:146/9.54 GB 5:139/9.12 GB 2:157/9.56 GB 0:143/9.36 GB 6:153/9.57 GB 3:146/9.29 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 57 out of 57 Runtime filters: Only following filters arrived: 7, waited 622ms Hdfs Read Thread Concurrency Bucket: 0:85.71% 1:4.762% 2:4.762% 3:4.762% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1134 PARQUET/SNAPPY:57 BytesRead(500.000ms): 0, 0, 5.47 MB, 11.27 MB, 11.27 MB, 14.36 MB, 21.97 MB, 21.97 MB, 23.38 MB, 29.83 MB, 29.83 MB, 30.67 MB, 31.51 MB, 36.51 MB, 39.39 MB, 39.90 MB, 50.51 MB, 50.51 MB, 51.36 MB, 56.74 MB, 56.74 MB - FooterProcessingTime: (Avg: 57.677ms ; Min: 3.870ms ; Max: 143.382ms ; Number of samples: 57) - AverageHdfsReadThreadConcurrency: 0.29 - AverageScannerThreadConcurrency: 10.86 - BytesRead: 56.74 MB (59498353) - BytesReadDataNodeCache: 0 - BytesReadLocal: 56.74 MB (59498353) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 56.74 MB (59498353) - DecompressionTime: 352.260ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 57 (57) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 24.92 MB (26125759) - PerReadThreadRawHdfsThroughput: 24.84 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 96.520ms - RowBatchQueuePutWaitTime: 1m41s - RowsRead: 42.34M (42335796) - RowsReturned: 42.33M (42333828) - RowsReturnedRate: 48.74 M/sec - ScanRangesComplete: 1.19K (1191) - ScannerThreadsInvoluntaryContextSwitches: 1.71K (1707) - ScannerThreadsTotalWallClockTime: 1m57s - MaterializeTupleTime(*): 2s114ms - ScannerThreadsSysTime: 2s526ms - ScannerThreadsUserTime: 4s500ms - ScannerThreadsVoluntaryContextSwitches: 180.21K (180206) - TotalRawHdfsReadTime(*): 2s284ms - TotalReadThroughput: 5.40 MB/sec Filter 2 (16.00 MB): - Rows processed: 25.52K (25520) - Rows rejected: 1.97K (1968) - Rows total: 42.34M (42335796) Filter 7 (1.00 MB): - Files processed: 1.19K (1191) - Files rejected: 1.13K (1134) - Files total: 1.19K (1191) - RowGroups processed: 41.39K (41387) - RowGroups rejected: 0 (0) - RowGroups total: 41.39K (41387) - Rows processed: 933.89K (933888) - Rows rejected: 0 (0) - Rows total: 42.33M (42333828) - Splits processed: 57 (57) - Splits rejected: 0 (0) - Splits total: 57 (57) Instance 7f40dcb034de70b7:111 (host=vd1111.foo:22000):(Total: 10s690ms, non-child: 2s673ms, % non-child: 25.01%) Hdfs split stats (:<# splits>/): 5:140/9.05 GB 2:148/9.40 GB 7:139/9.71 GB 1:147/9.02 GB 3:147/9.49 GB 6:159/10.07 GB 4:137/8.82 GB 0:155/9.85 GB Filter 7 arrival: 585ms Filter 2 arrival: 9s165ms MemoryUsage(500.000ms): 1.38 MB, 3.38 MB, 16.09 MB, 25.85 MB, 25.86 MB, 26.62 MB, 26.97 MB, 26.89 MB, 25.40 MB, 24.05 MB, 24.07 MB, 25.40 MB, 24.22 MB, 24.22 MB, 26.02 MB, 25.97 MB, 24.14 MB, 26.95 MB, 43.34 MB, 42.36 MB, 36.07 MB ThreadUsage(500.000ms): 2, 1, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 11.90 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 43.65 MB (45774810) - PerHostPeakMemUsage: 1.38 GB (1484498968) - RowsProduced: 39.76M (39763558) - TotalNetworkReceiveTime: 379.190ms - TotalNetworkSendTime: 2s927ms - TotalStorageWaitTime: 5s761ms - TotalThreadsInvoluntaryContextSwitches: 2.30K (2299) - TotalThreadsTotalWallClockTime: 2m6s - TotalThreadsSysTime: 3s131ms - TotalThreadsUserTime: 10s296ms - TotalThreadsVoluntaryContextSwitches: 173.61K (173608) Fragment Instance Lifecycle Timings: - ExecTime: 9s501ms - ExecTreeExecTime: 993.175ms - OpenTime: 1s146ms - ExecTreeOpenTime: 980.220ms - PrepareTime: 42.068ms - ExecTreePrepareTime: 2.696ms DataStreamSender (dst_id=23):(Total: 5s867ms, non-child: 5s867ms, % non-child: 100.00%) - BytesSent: 377.07 MB (395390404) - NetworkThroughput(*): 102.98 MB/sec - OverallThroughput: 64.27 MB/sec - PeakMemoryUsage: 4.80 MB (5028928) - RowsReturned: 39.76M (39763558) - SerializeBatchTime: 2s198ms - TransmitDataRPCTime: 3s661ms - UncompressedRowBatchSize: 1.26 GB (1352466468) CodeGen:(Total: 183.523ms, non-child: 183.523ms, % non-child: 100.00%) - CodegenTime: 873.725us - CompileTime: 49.409ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 90 (90) - NumInstructions: 2.97K (2968) - OptimizationTime: 115.821ms - PeakMemoryUsage: 1.45 MB (1519616) - PrepareTime: 17.920ms HASH_JOIN_NODE (id=11):(Total: 1s966ms, non-child: 861.524ms, % non-child: 43.81%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.561ms - PeakMemoryUsage: 1.27 MB (1328595) - ProbeRows: 39.76M (39763558) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 814.784ms - RowsReturned: 39.76M (39763558) - RowsReturnedRate: 20.22 M/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 26.107us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 212.014us - HashBuckets: 212 (212) - HashCollisions: 0 (0) - HashTablesBuildTime: 55.606us - LargestPartitionPercent: 9 (9) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1073600) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 379.201ms, non-child: 21.271us, % non-child: 0.01%) BytesReceived(500.000ms): 0, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 6.338us - DeserializeRowBatchTimer: 19.458us - FirstBatchArrivalWaitTime: 362.924ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 316.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=9):(Total: 726.111ms, non-child: 726.111ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:140/9.05 GB 2:148/9.40 GB 7:139/9.71 GB 1:147/9.02 GB 3:147/9.49 GB 6:159/10.07 GB 4:137/8.82 GB 0:155/9.85 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 58 out of 58 Runtime filters: Only following filters arrived: 7, waited 422ms Hdfs Read Thread Concurrency Bucket: 0:95% 1:0% 2:5% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1114 PARQUET/SNAPPY:58 BytesRead(500.000ms): 0, 0, 3.27 MB, 11.82 MB, 11.82 MB, 11.82 MB, 20.48 MB, 20.48 MB, 22.14 MB, 29.66 MB, 30.49 MB, 31.93 MB, 31.93 MB, 31.93 MB, 40.03 MB, 40.03 MB, 40.88 MB, 49.58 MB, 49.58 MB, 51.24 MB, 54.31 MB - FooterProcessingTime: (Avg: 54.238ms ; Min: 3.511ms ; Max: 150.746ms ; Number of samples: 58) - AverageHdfsReadThreadConcurrency: 0.10 - AverageScannerThreadConcurrency: 11.40 - BytesRead: 54.31 MB (56949187) - BytesReadDataNodeCache: 0 - BytesReadLocal: 54.31 MB (56949187) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 54.31 MB (56949187) - DecompressionTime: 293.235ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 58 (58) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 21.82 MB (22880157) - PerReadThreadRawHdfsThroughput: 25.24 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 173.567ms - RowBatchQueuePutWaitTime: 1m42s - RowsRead: 39.78M (39778543) - RowsReturned: 39.76M (39763558) - RowsReturnedRate: 54.76 M/sec - ScanRangesComplete: 1.17K (1172) - ScannerThreadsInvoluntaryContextSwitches: 1.51K (1506) - ScannerThreadsTotalWallClockTime: 1m55s - MaterializeTupleTime(*): 1s869ms - ScannerThreadsSysTime: 2s846ms - ScannerThreadsUserTime: 3s822ms - ScannerThreadsVoluntaryContextSwitches: 172.98K (172977) - TotalRawHdfsReadTime(*): 2s152ms - TotalReadThroughput: 5.17 MB/sec Filter 2 (16.00 MB): - Rows processed: 209.54K (209545) - Rows rejected: 14.98K (14985) - Rows total: 39.78M (39778543) Filter 7 (1.00 MB): - Files processed: 1.17K (1172) - Files rejected: 1.11K (1114) - Files total: 1.17K (1172) - RowGroups processed: 38.87K (38868) - RowGroups rejected: 0 (0) - RowGroups total: 38.87K (38868) - Rows processed: 950.27K (950272) - Rows rejected: 0 (0) - Rows total: 39.76M (39763558) - Splits processed: 58 (58) - Splits rejected: 0 (0) - Splits total: 58 (58) Instance 7f40dcb034de70b7:119 (host=vc1541.foo:22000):(Total: 10s688ms, non-child: 2s424ms, % non-child: 22.68%) Hdfs split stats (:<# splits>/): 1:134/8.30 GB 5:148/9.08 GB 4:137/8.52 GB 0:138/9.21 GB 2:156/10.17 GB 6:151/9.94 GB 7:177/10.98 GB 3:149/9.25 GB Filter 7 arrival: 560ms Filter 2 arrival: 9s307ms MemoryUsage(500.000ms): 2.79 MB, 3.38 MB, 6.29 MB, 24.73 MB, 24.91 MB, 25.33 MB, 25.38 MB, 25.97 MB, 27.34 MB, 28.76 MB, 28.05 MB, 28.11 MB, 28.68 MB, 28.68 MB, 29.05 MB, 29.22 MB, 28.57 MB, 28.88 MB, 29.87 MB, 45.38 MB, 41.67 MB, 23.47 MB ThreadUsage(500.000ms): 1, 1, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 1 - AverageThreadTokens: 11.36 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 46.99 MB (49275835) - PerHostPeakMemUsage: 1.39 GB (1494417876) - RowsProduced: 40.74M (40741089) - TotalNetworkReceiveTime: 323.895ms - TotalNetworkSendTime: 2s585ms - TotalStorageWaitTime: 5s128ms - TotalThreadsInvoluntaryContextSwitches: 2.11K (2113) - TotalThreadsTotalWallClockTime: 2m6s - TotalThreadsSysTime: 1s350ms - TotalThreadsUserTime: 11s299ms - TotalThreadsVoluntaryContextSwitches: 110.78K (110782) Fragment Instance Lifecycle Timings: - ExecTime: 9s568ms - ExecTreeExecTime: 1s067ms - OpenTime: 1s066ms - ExecTreeOpenTime: 879.597ms - PrepareTime: 53.408ms - ExecTreePrepareTime: 3.072ms DataStreamSender (dst_id=23):(Total: 6s117ms, non-child: 6s117ms, % non-child: 100.00%) - BytesSent: 386.64 MB (405426212) - NetworkThroughput(*): 101.01 MB/sec - OverallThroughput: 63.21 MB/sec - PeakMemoryUsage: 4.69 MB (4922432) - RowsReturned: 40.74M (40741089) - SerializeBatchTime: 2s281ms - TransmitDataRPCTime: 3s827ms - UncompressedRowBatchSize: 1.29 GB (1385714850) CodeGen:(Total: 208.480ms, non-child: 208.480ms, % non-child: 100.00%) - CodegenTime: 932.261us - CompileTime: 57.727ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 90 (90) - NumInstructions: 2.97K (2968) - OptimizationTime: 127.628ms - PeakMemoryUsage: 1.45 MB (1519616) - PrepareTime: 22.732ms HASH_JOIN_NODE (id=11):(Total: 1s938ms, non-child: 908.575ms, % non-child: 46.86%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 2.022ms - PeakMemoryUsage: 1.27 MB (1328742) - ProbeRows: 40.74M (40741089) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 859.109ms - RowsReturned: 40.74M (40741089) - RowsReturnedRate: 21.01 M/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 25.950us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 183.560us - HashBuckets: 212 (212) - HashCollisions: 0 (0) - HashTablesBuildTime: 65.081us - LargestPartitionPercent: 9 (9) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1073600) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 323.921ms, non-child: 38.004us, % non-child: 0.01%) BytesReceived(500.000ms): 0, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 19.732us - DeserializeRowBatchTimer: 27.286us - FirstBatchArrivalWaitTime: 304.313ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 370.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=9):(Total: 706.551ms, non-child: 706.551ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:134/8.30 GB 5:148/9.08 GB 4:137/8.52 GB 0:138/9.21 GB 2:156/10.17 GB 6:151/9.94 GB 7:177/10.98 GB 3:149/9.25 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 56 out of 56 Runtime filters: Only following filters arrived: 7, waited 442ms Hdfs Read Thread Concurrency Bucket: 0:80.95% 1:14.29% 2:0% 3:4.762% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1134 PARQUET/SNAPPY:56 BytesRead(500.000ms): 0, 0, 700.00 KB, 11.25 MB, 11.25 MB, 12.10 MB, 18.58 MB, 20.83 MB, 22.27 MB, 29.50 MB, 32.85 MB, 32.85 MB, 33.69 MB, 33.69 MB, 39.30 MB, 39.30 MB, 40.15 MB, 49.76 MB, 50.72 MB, 53.14 MB, 54.78 MB, 54.78 MB - FooterProcessingTime: (Avg: 54.089ms ; Min: 20.212ms ; Max: 164.210ms ; Number of samples: 56) - AverageHdfsReadThreadConcurrency: 0.29 - AverageScannerThreadConcurrency: 10.86 - BytesRead: 54.78 MB (57438324) - BytesReadDataNodeCache: 0 - BytesReadLocal: 54.78 MB (57438324) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 54.78 MB (57438324) - DecompressionTime: 321.475ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 56 (56) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 25.12 MB (26338285) - PerReadThreadRawHdfsThroughput: 28.04 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 109.307ms - RowBatchQueuePutWaitTime: 1m44s - RowsRead: 40.75M (40754201) - RowsReturned: 40.74M (40741089) - RowsReturnedRate: 57.66 M/sec - ScanRangesComplete: 1.19K (1190) - ScannerThreadsInvoluntaryContextSwitches: 1.30K (1300) - ScannerThreadsTotalWallClockTime: 1m55s - MaterializeTupleTime(*): 2s039ms - ScannerThreadsSysTime: 1s068ms - ScannerThreadsUserTime: 4s392ms - ScannerThreadsVoluntaryContextSwitches: 110.16K (110162) - TotalRawHdfsReadTime(*): 1s953ms - TotalReadThroughput: 4.98 MB/sec Filter 2 (16.00 MB): - Rows processed: 187.19K (187192) - Rows rejected: 13.11K (13112) - Rows total: 40.75M (40754201) Filter 7 (1.00 MB): - Files processed: 1.19K (1190) - Files rejected: 1.13K (1134) - Files total: 1.19K (1190) - RowGroups processed: 39.82K (39822) - RowGroups rejected: 0 (0) - RowGroups total: 39.82K (39822) - Rows processed: 914.09K (914086) - Rows rejected: 0 (0) - Rows total: 40.74M (40741089) - Splits processed: 56 (56) - Splits rejected: 0 (0) - Splits total: 56 (56) Instance 7f40dcb034de70b7:176 (host=vc1513.foo:22000):(Total: 10s674ms, non-child: 2s153ms, % non-child: 20.18%) Hdfs split stats (:<# splits>/): 0:143/9.08 GB 6:138/8.91 GB 1:140/9.07 GB 5:131/8.42 GB 3:151/9.23 GB 2:131/8.71 GB 4:167/11.07 GB 7:166/11.07 GB Filter 7 arrival: 232ms MemoryUsage(500.000ms): 2.79 MB, 3.38 MB, 4.52 MB, 24.82 MB, 24.99 MB, 25.48 MB, 26.79 MB, 27.09 MB, 26.34 MB, 25.96 MB, 26.08 MB, 25.99 MB, 26.06 MB, 22.21 MB, 26.16 MB, 27.44 MB, 25.96 MB, 26.19 MB, 26.42 MB, 20.88 MB, 22.49 MB, 8.23 MB ThreadUsage(500.000ms): 1, 1, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 1 - AverageThreadTokens: 11.36 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 27.70 MB (29044517) - PerHostPeakMemUsage: 1.38 GB (1480589569) - RowsProduced: 42.08M (42077845) - TotalNetworkReceiveTime: 5.502us - TotalNetworkSendTime: 2s442ms - TotalStorageWaitTime: 6s421ms - TotalThreadsInvoluntaryContextSwitches: 2.42K (2419) - TotalThreadsTotalWallClockTime: 2m9s - TotalThreadsSysTime: 2s916ms - TotalThreadsUserTime: 11s467ms - TotalThreadsVoluntaryContextSwitches: 192.26K (192262) Fragment Instance Lifecycle Timings: - ExecTime: 9s466ms - ExecTreeExecTime: 1s114ms - OpenTime: 1s152ms - ExecTreeOpenTime: 971.242ms - PrepareTime: 54.424ms - ExecTreePrepareTime: 3.494ms DataStreamSender (dst_id=23):(Total: 6s243ms, non-child: 6s243ms, % non-child: 100.00%) - BytesSent: 399.09 MB (418472551) - NetworkThroughput(*): 102.05 MB/sec - OverallThroughput: 63.92 MB/sec - PeakMemoryUsage: 4.79 MB (5020736) - RowsReturned: 42.08M (42077845) - SerializeBatchTime: 2s324ms - TransmitDataRPCTime: 3s910ms - UncompressedRowBatchSize: 1.33 GB (1431181586) CodeGen:(Total: 198.539ms, non-child: 198.539ms, % non-child: 100.00%) - CodegenTime: 926.058us - CompileTime: 52.822ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 90 (90) - NumInstructions: 2.97K (2968) - OptimizationTime: 125.128ms - PeakMemoryUsage: 1.45 MB (1519616) - PrepareTime: 20.184ms HASH_JOIN_NODE (id=11):(Total: 2s078ms, non-child: 966.105ms, % non-child: 46.48%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.624ms - PeakMemoryUsage: 1.20 MB (1255232) - ProbeRows: 42.08M (42077845) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 917.716ms - RowsReturned: 42.08M (42077845) - RowsReturnedRate: 20.24 M/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 27.613us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 286.793us - HashBuckets: 212 (212) - HashCollisions: 0 (0) - HashTablesBuildTime: 54.211us - LargestPartitionPercent: 9 (9) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1073600) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 19.038us, non-child: 19.038us, % non-child: 100.00%) BytesReceived(500.000ms): 0, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 6.300us - DeserializeRowBatchTimer: 25.538us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 6.30 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=9):(Total: 1s112ms, non-child: 1s112ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:143/9.08 GB 6:138/8.91 GB 1:140/9.07 GB 5:131/8.42 GB 3:151/9.23 GB 2:131/8.71 GB 4:167/11.07 GB 7:166/11.07 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 61 out of 61 Runtime filters: Only following filters arrived: 7, waited 783ms Hdfs Read Thread Concurrency Bucket: 0:85.71% 1:9.524% 2:0% 3:4.762% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1106 PARQUET/SNAPPY:61 BytesRead(500.000ms): 0, 0, 0, 11.13 MB, 11.13 MB, 11.13 MB, 20.70 MB, 20.70 MB, 21.55 MB, 29.70 MB, 29.70 MB, 30.53 MB, 30.53 MB, 36.06 MB, 40.58 MB, 42.00 MB, 48.82 MB, 49.58 MB, 49.58 MB, 54.38 MB, 57.46 MB, 57.46 MB - FooterProcessingTime: (Avg: 67.321ms ; Min: 20.888ms ; Max: 242.360ms ; Number of samples: 61) - AverageHdfsReadThreadConcurrency: 0.24 - AverageScannerThreadConcurrency: 10.86 - BytesRead: 57.46 MB (60247097) - BytesReadDataNodeCache: 0 - BytesReadLocal: 57.46 MB (60247097) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 57.46 MB (60247097) - DecompressionTime: 313.592ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 61 (61) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 21.97 MB (23033460) - PerReadThreadRawHdfsThroughput: 29.33 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 183.982ms - RowBatchQueuePutWaitTime: 1m41s - RowsRead: 42.08M (42077845) - RowsReturned: 42.08M (42077845) - RowsReturnedRate: 37.82 M/sec - ScanRangesComplete: 1.17K (1167) - ScannerThreadsInvoluntaryContextSwitches: 1.62K (1618) - ScannerThreadsTotalWallClockTime: 1m59s - MaterializeTupleTime(*): 2s026ms - ScannerThreadsSysTime: 2s655ms - ScannerThreadsUserTime: 4s507ms - ScannerThreadsVoluntaryContextSwitches: 191.50K (191501) - TotalRawHdfsReadTime(*): 1s958ms - TotalReadThroughput: 5.22 MB/sec Filter 2 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 42.08M (42077845) Filter 7 (1.00 MB): - Files processed: 1.17K (1167) - Files rejected: 1.11K (1106) - Files total: 1.17K (1167) - RowGroups processed: 41.14K (41143) - RowGroups rejected: 0 (0) - RowGroups total: 41.14K (41143) - Rows processed: 999.42K (999424) - Rows rejected: 0 (0) - Rows total: 42.08M (42077845) - Splits processed: 61 (61) - Splits rejected: 0 (0) - Splits total: 61 (61) Instance 7f40dcb034de70b7:173 (host=ve1138.foo:22000):(Total: 10s667ms, non-child: 2s126ms, % non-child: 19.93%) Hdfs split stats (:<# splits>/): 0:140/8.77 GB 5:168/10.83 GB 1:139/8.60 GB 3:144/9.29 GB 2:139/8.34 GB 6:158/10.27 GB 4:157/9.86 GB 7:153/9.57 GB Filter 7 arrival: 227ms MemoryUsage(500.000ms): 3.38 MB, 3.38 MB, 23.72 MB, 23.93 MB, 24.13 MB, 24.92 MB, 24.97 MB, 25.32 MB, 24.02 MB, 24.16 MB, 24.23 MB, 24.10 MB, 24.35 MB, 25.96 MB, 26.04 MB, 26.80 MB, 28.08 MB, 27.28 MB, 21.20 MB, 24.88 MB, 14.31 MB ThreadUsage(500.000ms): 1, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.43 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 29.65 MB (31091964) - PerHostPeakMemUsage: 1.37 GB (1469574087) - RowsProduced: 42.14M (42138372) - TotalNetworkReceiveTime: 4.014us - TotalNetworkSendTime: 2s435ms - TotalStorageWaitTime: 6s936ms - TotalThreadsInvoluntaryContextSwitches: 2.10K (2097) - TotalThreadsTotalWallClockTime: 2m9s - TotalThreadsSysTime: 1s838ms - TotalThreadsUserTime: 11s481ms - TotalThreadsVoluntaryContextSwitches: 120.33K (120335) Fragment Instance Lifecycle Timings: - ExecTime: 9s453ms - ExecTreeExecTime: 1s054ms - OpenTime: 1s163ms - ExecTreeOpenTime: 981.860ms - PrepareTime: 50.965ms - ExecTreePrepareTime: 3.559ms DataStreamSender (dst_id=23):(Total: 6s314ms, non-child: 6s314ms, % non-child: 100.00%) - BytesSent: 399.71 MB (419126531) - NetworkThroughput(*): 100.19 MB/sec - OverallThroughput: 63.30 MB/sec - PeakMemoryUsage: 4.73 MB (4963392) - RowsReturned: 42.14M (42138372) - SerializeBatchTime: 2s317ms - TransmitDataRPCTime: 3s989ms - UncompressedRowBatchSize: 1.33 GB (1433240264) CodeGen:(Total: 196.370ms, non-child: 196.370ms, % non-child: 100.00%) - CodegenTime: 1.150ms - CompileTime: 52.054ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 90 (90) - NumInstructions: 2.97K (2968) - OptimizationTime: 127.339ms - PeakMemoryUsage: 1.45 MB (1519616) - PrepareTime: 16.547ms HASH_JOIN_NODE (id=11):(Total: 2s030ms, non-child: 915.352ms, % non-child: 45.09%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.410ms - PeakMemoryUsage: 1.20 MB (1255232) - ProbeRows: 42.14M (42138372) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 861.382ms - RowsReturned: 42.14M (42138372) - RowsReturnedRate: 20.76 M/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 24.526us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 132.693us - HashBuckets: 212 (212) - HashCollisions: 0 (0) - HashTablesBuildTime: 56.472us - LargestPartitionPercent: 9 (9) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1073600) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 13.281us, non-child: 13.281us, % non-child: 100.00%) BytesReceived(500.000ms): 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 4.447us - DeserializeRowBatchTimer: 17.858us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 9.04 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=9):(Total: 1s114ms, non-child: 1s114ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:140/8.77 GB 5:168/10.83 GB 1:139/8.60 GB 3:144/9.29 GB 2:139/8.34 GB 6:158/10.27 GB 4:157/9.86 GB 7:153/9.57 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 64 out of 64 Runtime filters: Only following filters arrived: 7, waited 784ms Hdfs Read Thread Concurrency Bucket: 0:95.24% 1:4.762% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1134 PARQUET/SNAPPY:64 BytesRead(500.000ms): 0, 0, 10.71 MB, 10.71 MB, 11.56 MB, 20.49 MB, 20.49 MB, 21.33 MB, 29.70 MB, 29.70 MB, 32.25 MB, 33.10 MB, 33.10 MB, 41.57 MB, 42.40 MB, 47.00 MB, 50.26 MB, 51.10 MB, 56.00 MB, 58.32 MB, 58.32 MB - FooterProcessingTime: (Avg: 74.424ms ; Min: 15.099ms ; Max: 240.947ms ; Number of samples: 64) - AverageHdfsReadThreadConcurrency: 0.05 - AverageScannerThreadConcurrency: 11.43 - BytesRead: 58.32 MB (61147950) - BytesReadDataNodeCache: 0 - BytesReadLocal: 58.32 MB (61147950) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 58.32 MB (61147950) - DecompressionTime: 354.988ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 64 (64) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 23.85 MB (25012183) - PerReadThreadRawHdfsThroughput: 25.06 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 194.898ms - RowBatchQueuePutWaitTime: 1m41s - RowsRead: 42.14M (42138372) - RowsReturned: 42.14M (42138372) - RowsReturnedRate: 37.80 M/sec - ScanRangesComplete: 1.20K (1198) - ScannerThreadsInvoluntaryContextSwitches: 1.29K (1288) - ScannerThreadsTotalWallClockTime: 1m59s - MaterializeTupleTime(*): 2s107ms - ScannerThreadsSysTime: 1s561ms - ScannerThreadsUserTime: 4s548ms - ScannerThreadsVoluntaryContextSwitches: 119.71K (119712) - TotalRawHdfsReadTime(*): 2s327ms - TotalReadThroughput: 5.55 MB/sec Filter 2 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 42.14M (42138372) Filter 7 (1.00 MB): - Files processed: 1.20K (1198) - Files rejected: 1.13K (1134) - Files total: 1.20K (1198) - RowGroups processed: 41.20K (41205) - RowGroups rejected: 0 (0) - RowGroups total: 41.20K (41205) - Rows processed: 1.05M (1048576) - Rows rejected: 0 (0) - Rows total: 42.14M (42138372) - Splits processed: 64 (64) - Splits rejected: 0 (0) - Splits total: 64 (64) Instance 7f40dcb034de70b7:151 (host=vd1102.foo:22000):(Total: 10s658ms, non-child: 2s935ms, % non-child: 27.54%) Hdfs split stats (:<# splits>/): 5:156/9.46 GB 2:119/7.47 GB 4:150/9.92 GB 7:130/8.70 GB 0:160/10.47 GB 3:162/9.96 GB 1:142/8.95 GB 6:164/10.58 GB Filter 7 arrival: 342ms MemoryUsage(500.000ms): 3.38 MB, 3.38 MB, 24.23 MB, 26.90 MB, 27.11 MB, 26.67 MB, 29.27 MB, 29.16 MB, 25.32 MB, 27.06 MB, 27.28 MB, 27.12 MB, 27.12 MB, 29.86 MB, 29.92 MB, 29.85 MB, 25.83 MB, 29.11 MB, 29.00 MB, 29.29 MB, 15.44 MB ThreadUsage(500.000ms): 2, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.48 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 31.37 MB (32898683) - PerHostPeakMemUsage: 1.38 GB (1486035481) - RowsProduced: 38.51M (38506557) - TotalNetworkReceiveTime: 107.826ms - TotalNetworkSendTime: 2s986ms - TotalStorageWaitTime: 5s978ms - TotalThreadsInvoluntaryContextSwitches: 2.34K (2337) - TotalThreadsTotalWallClockTime: 2m8s - TotalThreadsSysTime: 4s089ms - TotalThreadsUserTime: 10s474ms - TotalThreadsVoluntaryContextSwitches: 162.35K (162353) Fragment Instance Lifecycle Timings: - ExecTime: 9s557ms - ExecTreeExecTime: 1s008ms - OpenTime: 1s043ms - ExecTreeOpenTime: 862.400ms - PrepareTime: 57.415ms - ExecTreePrepareTime: 3.286ms DataStreamSender (dst_id=23):(Total: 5s655ms, non-child: 5s655ms, % non-child: 100.00%) - BytesSent: 364.57 MB (382278826) - NetworkThroughput(*): 104.33 MB/sec - OverallThroughput: 64.46 MB/sec - PeakMemoryUsage: 4.73 MB (4955200) - RowsReturned: 38.51M (38506557) - SerializeBatchTime: 2s153ms - TransmitDataRPCTime: 3s494ms - UncompressedRowBatchSize: 1.22 GB (1309712482) CodeGen:(Total: 203.673ms, non-child: 203.673ms, % non-child: 100.00%) - CodegenTime: 1.038ms - CompileTime: 53.290ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 90 (90) - NumInstructions: 2.97K (2968) - OptimizationTime: 125.488ms - PeakMemoryUsage: 1.45 MB (1519616) - PrepareTime: 24.300ms HASH_JOIN_NODE (id=11):(Total: 1s863ms, non-child: 859.170ms, % non-child: 46.11%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.453ms - PeakMemoryUsage: 1.20 MB (1255232) - ProbeRows: 38.51M (38506557) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 805.181ms - RowsReturned: 38.51M (38506557) - RowsReturnedRate: 20.66 M/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 26.311us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 136.256us - HashBuckets: 212 (212) - HashCollisions: 0 (0) - HashTablesBuildTime: 52.639us - LargestPartitionPercent: 9 (9) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1073600) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 107.836ms, non-child: 20.393us, % non-child: 0.02%) BytesReceived(500.000ms): 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 4.420us - DeserializeRowBatchTimer: 17.814us - FirstBatchArrivalWaitTime: 97.806ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 1.11 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=9):(Total: 896.773ms, non-child: 896.773ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:156/9.46 GB 2:119/7.47 GB 4:150/9.92 GB 7:130/8.70 GB 0:160/10.47 GB 3:162/9.96 GB 1:142/8.95 GB 6:164/10.58 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 51 out of 51 Runtime filters: Only following filters arrived: 7, waited 663ms Hdfs Read Thread Concurrency Bucket: 0:80.95% 1:9.524% 2:4.762% 3:4.762% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1132 PARQUET/SNAPPY:51 BytesRead(500.000ms): 0, 0, 9.64 MB, 12.43 MB, 13.26 MB, 18.17 MB, 20.54 MB, 21.97 MB, 26.10 MB, 30.07 MB, 30.07 MB, 33.96 MB, 33.96 MB, 39.72 MB, 41.13 MB, 41.13 MB, 42.89 MB, 47.53 MB, 47.53 MB, 51.23 MB, 51.23 MB - FooterProcessingTime: (Avg: 59.346ms ; Min: 4.193ms ; Max: 317.783ms ; Number of samples: 51) - AverageHdfsReadThreadConcurrency: 0.33 - AverageScannerThreadConcurrency: 11.43 - BytesRead: 51.23 MB (53719037) - BytesReadDataNodeCache: 0 - BytesReadLocal: 51.23 MB (53719037) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 51.23 MB (53719037) - DecompressionTime: 335.541ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 51 (51) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 25.60 MB (26846292) - PerReadThreadRawHdfsThroughput: 25.14 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 87.902ms - RowBatchQueuePutWaitTime: 1m41s - RowsRead: 38.51M (38506557) - RowsReturned: 38.51M (38506557) - RowsReturnedRate: 42.94 M/sec - ScanRangesComplete: 1.18K (1183) - ScannerThreadsInvoluntaryContextSwitches: 1.51K (1506) - ScannerThreadsTotalWallClockTime: 1m57s - MaterializeTupleTime(*): 1s979ms - ScannerThreadsSysTime: 3s857ms - ScannerThreadsUserTime: 3s945ms - ScannerThreadsVoluntaryContextSwitches: 161.75K (161751) - TotalRawHdfsReadTime(*): 2s037ms - TotalReadThroughput: 4.88 MB/sec Filter 2 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 38.51M (38506557) Filter 7 (1.00 MB): - Files processed: 1.18K (1183) - Files rejected: 1.13K (1132) - Files total: 1.18K (1183) - RowGroups processed: 37.64K (37644) - RowGroups rejected: 0 (0) - RowGroups total: 37.64K (37644) - Rows processed: 835.58K (835584) - Rows rejected: 0 (0) - Rows total: 38.51M (38506557) - Splits processed: 51 (51) - Splits rejected: 0 (0) - Splits total: 51 (51) Instance 7f40dcb034de70b7:152 (host=vc1507.foo:22000):(Total: 10s652ms, non-child: 2s580ms, % non-child: 24.22%) Hdfs split stats (:<# splits>/): 3:152/9.50 GB 2:143/9.19 GB 4:153/9.16 GB 5:147/9.89 GB 7:162/10.61 GB 6:143/9.19 GB 0:143/9.06 GB 1:143/8.84 GB Filter 7 arrival: 348ms MemoryUsage(500.000ms): 2.79 MB, 3.38 MB, 16.71 MB, 23.70 MB, 24.09 MB, 24.01 MB, 25.07 MB, 25.09 MB, 23.26 MB, 27.00 MB, 28.32 MB, 28.09 MB, 29.50 MB, 28.87 MB, 30.14 MB, 30.33 MB, 27.17 MB, 26.16 MB, 25.14 MB, 23.66 MB, 21.32 MB ThreadUsage(500.000ms): 1, 1, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 11.86 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 30.68 MB (32165920) - PerHostPeakMemUsage: 1.41 GB (1511896789) - RowsProduced: 41.44M (41443694) - TotalNetworkReceiveTime: 113.311ms - TotalNetworkSendTime: 2s685ms - TotalStorageWaitTime: 7s141ms - TotalThreadsInvoluntaryContextSwitches: 2.93K (2930) - TotalThreadsTotalWallClockTime: 2m5s - TotalThreadsSysTime: 2s586ms - TotalThreadsUserTime: 11s307ms - TotalThreadsVoluntaryContextSwitches: 123.33K (123325) Fragment Instance Lifecycle Timings: - ExecTime: 9s550ms - ExecTreeExecTime: 1s044ms - OpenTime: 1s047ms - ExecTreeOpenTime: 862.553ms - PrepareTime: 54.839ms - ExecTreePrepareTime: 3.294ms DataStreamSender (dst_id=23):(Total: 5s967ms, non-child: 5s967ms, % non-child: 100.00%) - BytesSent: 392.72 MB (411794286) - NetworkThroughput(*): 105.90 MB/sec - OverallThroughput: 65.81 MB/sec - PeakMemoryUsage: 4.83 MB (5061696) - RowsReturned: 41.44M (41443694) - SerializeBatchTime: 2s251ms - TransmitDataRPCTime: 3s708ms - UncompressedRowBatchSize: 1.31 GB (1409612372) CodeGen:(Total: 207.243ms, non-child: 207.243ms, % non-child: 100.00%) - CodegenTime: 1.136ms - CompileTime: 56.797ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 90 (90) - NumInstructions: 2.97K (2968) - OptimizationTime: 126.167ms - PeakMemoryUsage: 1.45 MB (1519616) - PrepareTime: 23.838ms HASH_JOIN_NODE (id=11):(Total: 1s898ms, non-child: 887.691ms, % non-child: 46.76%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.315ms - PeakMemoryUsage: 1.20 MB (1255232) - ProbeRows: 41.44M (41443694) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 840.159ms - RowsReturned: 41.44M (41443694) - RowsReturnedRate: 21.83 M/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 26.812us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 121.209us - HashBuckets: 212 (212) - HashCollisions: 0 (0) - HashTablesBuildTime: 53.895us - LargestPartitionPercent: 9 (9) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1073600) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 113.321ms, non-child: 17.654us, % non-child: 0.02%) BytesReceived(500.000ms): 0, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 4.660us - DeserializeRowBatchTimer: 23.575us - FirstBatchArrivalWaitTime: 94.252ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 1.06 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=9):(Total: 897.656ms, non-child: 897.656ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:152/9.50 GB 2:143/9.19 GB 4:153/9.16 GB 5:147/9.89 GB 7:162/10.61 GB 6:143/9.19 GB 0:143/9.06 GB 1:143/8.84 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 61 out of 61 Runtime filters: Only following filters arrived: 7, waited 663ms Hdfs Read Thread Concurrency Bucket: 0:80% 1:20% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1125 PARQUET/SNAPPY:61 BytesRead(500.000ms): 0, 0, 1.71 MB, 10.73 MB, 11.48 MB, 11.48 MB, 20.43 MB, 21.27 MB, 22.13 MB, 31.31 MB, 32.72 MB, 34.08 MB, 37.19 MB, 37.29 MB, 41.10 MB, 41.10 MB, 41.10 MB, 48.47 MB, 49.31 MB, 54.16 MB, 56.60 MB - FooterProcessingTime: (Avg: 58.050ms ; Min: 19.737ms ; Max: 301.594ms ; Number of samples: 61) - AverageHdfsReadThreadConcurrency: 0.20 - AverageScannerThreadConcurrency: 11.40 - BytesRead: 56.60 MB (59353423) - BytesReadDataNodeCache: 0 - BytesReadLocal: 56.60 MB (59353423) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 56.60 MB (59353423) - DecompressionTime: 357.313ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 61 (61) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 24.98 MB (26196126) - PerReadThreadRawHdfsThroughput: 25.93 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 78.698ms - RowBatchQueuePutWaitTime: 1m40s - RowsRead: 41.44M (41443694) - RowsReturned: 41.44M (41443694) - RowsReturnedRate: 46.17 M/sec - ScanRangesComplete: 1.19K (1186) - ScannerThreadsInvoluntaryContextSwitches: 2.10K (2105) - ScannerThreadsTotalWallClockTime: 1m54s - MaterializeTupleTime(*): 2s179ms - ScannerThreadsSysTime: 2s334ms - ScannerThreadsUserTime: 4s501ms - ScannerThreadsVoluntaryContextSwitches: 122.64K (122636) - TotalRawHdfsReadTime(*): 2s182ms - TotalReadThroughput: 5.39 MB/sec Filter 2 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 41.44M (41443694) Filter 7 (1.00 MB): - Files processed: 1.19K (1186) - Files rejected: 1.12K (1125) - Files total: 1.19K (1186) - RowGroups processed: 40.52K (40522) - RowGroups rejected: 0 (0) - RowGroups total: 40.52K (40522) - Rows processed: 999.42K (999424) - Rows rejected: 0 (0) - Rows total: 41.44M (41443694) - Splits processed: 61 (61) - Splits rejected: 0 (0) - Splits total: 61 (61) Instance 7f40dcb034de70b7:16b (host=va1037.foo:22000):(Total: 10s649ms, non-child: 2s391ms, % non-child: 22.46%) Hdfs split stats (:<# splits>/): 0:149/9.51 GB 5:131/8.17 GB 2:145/9.18 GB 4:154/9.45 GB 6:161/10.51 GB 7:151/9.29 GB 3:147/9.81 GB 1:148/9.57 GB Filter 7 arrival: 283ms MemoryUsage(500.000ms): 2.79 MB, 3.38 MB, 5.42 MB, 25.16 MB, 24.90 MB, 26.09 MB, 26.01 MB, 28.04 MB, 27.71 MB, 28.11 MB, 28.57 MB, 29.22 MB, 29.22 MB, 29.14 MB, 29.12 MB, 27.92 MB, 29.01 MB, 28.82 MB, 28.59 MB, 23.99 MB, 20.35 MB ThreadUsage(500.000ms): 1, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.43 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 29.86 MB (31313427) - PerHostPeakMemUsage: 1.39 GB (1487647176) - RowsProduced: 40.95M (40947486) - TotalNetworkReceiveTime: 4.240us - TotalNetworkSendTime: 2s484ms - TotalStorageWaitTime: 7s344ms - TotalThreadsInvoluntaryContextSwitches: 2.32K (2322) - TotalThreadsTotalWallClockTime: 2m9s - TotalThreadsSysTime: 1s646ms - TotalThreadsUserTime: 11s205ms - TotalThreadsVoluntaryContextSwitches: 102.48K (102479) Fragment Instance Lifecycle Timings: - ExecTime: 9s395ms - ExecTreeExecTime: 1s050ms - OpenTime: 1s191ms - ExecTreeOpenTime: 967.275ms - PrepareTime: 62.183ms - ExecTreePrepareTime: 3.786ms DataStreamSender (dst_id=23):(Total: 5s996ms, non-child: 5s996ms, % non-child: 100.00%) - BytesSent: 388.96 MB (407858790) - NetworkThroughput(*): 104.55 MB/sec - OverallThroughput: 64.87 MB/sec - PeakMemoryUsage: 4.76 MB (4996160) - RowsReturned: 40.95M (40947486) - SerializeBatchTime: 2s267ms - TransmitDataRPCTime: 3s720ms - UncompressedRowBatchSize: 1.30 GB (1392735020) CodeGen:(Total: 250.680ms, non-child: 250.680ms, % non-child: 100.00%) - CodegenTime: 1.233ms - CompileTime: 66.989ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 90 (90) - NumInstructions: 2.97K (2968) - OptimizationTime: 155.389ms - PeakMemoryUsage: 1.45 MB (1519616) - PrepareTime: 27.688ms HASH_JOIN_NODE (id=11):(Total: 2s010ms, non-child: 903.509ms, % non-child: 44.93%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.445ms - PeakMemoryUsage: 1.20 MB (1255232) - ProbeRows: 40.95M (40947486) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 849.520ms - RowsReturned: 40.95M (40947486) - RowsReturnedRate: 20.36 M/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 24.763us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 127.601us - HashBuckets: 212 (212) - HashCollisions: 0 (0) - HashTablesBuildTime: 55.471us - LargestPartitionPercent: 9 (9) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1073600) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 14.353us, non-child: 14.353us, % non-child: 100.00%) BytesReceived(500.000ms): 0, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 4.962us - DeserializeRowBatchTimer: 15.345us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 8.36 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=9):(Total: 1s107ms, non-child: 1s107ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:149/9.51 GB 5:131/8.17 GB 2:145/9.18 GB 4:154/9.45 GB 6:161/10.51 GB 7:151/9.29 GB 3:147/9.81 GB 1:148/9.57 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 57 out of 57 Runtime filters: Only following filters arrived: 7, waited 724ms Hdfs Read Thread Concurrency Bucket: 0:75% 1:20% 2:5% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1129 PARQUET/SNAPPY:57 BytesRead(500.000ms): 0, 0, 100.00 KB, 11.15 MB, 12.00 MB, 12.92 MB, 19.39 MB, 20.75 MB, 25.50 MB, 32.07 MB, 32.07 MB, 41.49 MB, 41.49 MB, 41.49 MB, 41.49 MB, 41.59 MB, 47.88 MB, 47.88 MB, 48.71 MB, 52.10 MB, 55.39 MB - FooterProcessingTime: (Avg: 90.608ms ; Min: 18.680ms ; Max: 329.920ms ; Number of samples: 57) - AverageHdfsReadThreadConcurrency: 0.30 - AverageScannerThreadConcurrency: 12.00 - BytesRead: 55.39 MB (58085810) - BytesReadDataNodeCache: 0 - BytesReadLocal: 55.39 MB (58085810) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 55.39 MB (58085810) - DecompressionTime: 356.673ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 57 (57) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 24.05 MB (25217765) - PerReadThreadRawHdfsThroughput: 25.40 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 239.775ms - RowBatchQueuePutWaitTime: 1m41s - RowsRead: 40.95M (40947486) - RowsReturned: 40.95M (40947486) - RowsReturnedRate: 36.97 M/sec - ScanRangesComplete: 1.19K (1186) - ScannerThreadsInvoluntaryContextSwitches: 1.48K (1482) - ScannerThreadsTotalWallClockTime: 1m58s - MaterializeTupleTime(*): 2s120ms - ScannerThreadsSysTime: 1s407ms - ScannerThreadsUserTime: 4s304ms - ScannerThreadsVoluntaryContextSwitches: 101.79K (101790) - TotalRawHdfsReadTime(*): 2s180ms - TotalReadThroughput: 5.28 MB/sec Filter 2 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 40.95M (40947486) Filter 7 (1.00 MB): - Files processed: 1.19K (1186) - Files rejected: 1.13K (1129) - Files total: 1.19K (1186) - RowGroups processed: 40.03K (40034) - RowGroups rejected: 0 (0) - RowGroups total: 40.03K (40034) - Rows processed: 933.89K (933888) - Rows rejected: 0 (0) - Rows total: 40.95M (40947486) - Splits processed: 57 (57) - Splits rejected: 0 (0) - Splits total: 57 (57) Instance 7f40dcb034de70b7:100 (host=vd1135.foo:22000):(Total: 10s642ms, non-child: 2s284ms, % non-child: 21.47%) Hdfs split stats (:<# splits>/): 7:148/9.60 GB 5:172/11.58 GB 2:150/8.90 GB 3:132/8.72 GB 0:139/8.66 GB 1:155/10.15 GB 6:151/8.74 GB 4:148/9.10 GB Filter 7 arrival: 660ms Filter 2 arrival: 8s967ms MemoryUsage(500.000ms): 1.35 MB, 3.38 MB, 24.03 MB, 25.95 MB, 26.28 MB, 24.52 MB, 28.79 MB, 29.03 MB, 28.41 MB, 26.93 MB, 27.48 MB, 20.53 MB, 25.98 MB, 25.98 MB, 25.91 MB, 25.20 MB, 12.85 MB, 23.90 MB, 40.18 MB, 39.40 MB, 33.77 MB ThreadUsage(500.000ms): 1, 1, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 11.86 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 40.94 MB (42928072) - PerHostPeakMemUsage: 1.40 GB (1502966080) - RowsProduced: 40.79M (40785819) - TotalNetworkReceiveTime: 453.922ms - TotalNetworkSendTime: 2s545ms - TotalStorageWaitTime: 9s642ms - TotalThreadsInvoluntaryContextSwitches: 2.45K (2449) - TotalThreadsTotalWallClockTime: 2m5s - TotalThreadsSysTime: 3s829ms - TotalThreadsUserTime: 10s818ms - TotalThreadsVoluntaryContextSwitches: 162.17K (162168) Fragment Instance Lifecycle Timings: - ExecTime: 9s548ms - ExecTreeExecTime: 1s134ms - OpenTime: 1s052ms - ExecTreeOpenTime: 885.116ms - PrepareTime: 41.641ms - ExecTreePrepareTime: 2.606ms DataStreamSender (dst_id=23):(Total: 6s163ms, non-child: 6s163ms, % non-child: 100.00%) - BytesSent: 385.82 MB (404559069) - NetworkThroughput(*): 99.91 MB/sec - OverallThroughput: 62.59 MB/sec - PeakMemoryUsage: 4.76 MB (4996160) - RowsReturned: 40.79M (40785819) - SerializeBatchTime: 2s294ms - TransmitDataRPCTime: 3s861ms - UncompressedRowBatchSize: 1.29 GB (1387236278) CodeGen:(Total: 182.809ms, non-child: 182.809ms, % non-child: 100.00%) - CodegenTime: 852.156us - CompileTime: 49.999ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 90 (90) - NumInstructions: 2.97K (2968) - OptimizationTime: 116.075ms - PeakMemoryUsage: 1.45 MB (1519616) - PrepareTime: 16.384ms HASH_JOIN_NODE (id=11):(Total: 2s011ms, non-child: 923.313ms, % non-child: 45.91%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.642ms - PeakMemoryUsage: 1.27 MB (1327717) - ProbeRows: 40.79M (40785819) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 870.305ms - RowsReturned: 40.79M (40785819) - RowsReturnedRate: 20.28 M/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 25.809us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 179.353us - HashBuckets: 212 (212) - HashCollisions: 0 (0) - HashTablesBuildTime: 63.997us - LargestPartitionPercent: 9 (9) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1073600) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 453.931ms, non-child: 18.251us, % non-child: 0.00%) BytesReceived(500.000ms): 0, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 4.534us - DeserializeRowBatchTimer: 43.483us - FirstBatchArrivalWaitTime: 433.629ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 264.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=9):(Total: 634.302ms, non-child: 634.302ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:148/9.60 GB 5:172/11.58 GB 2:150/8.90 GB 3:132/8.72 GB 0:139/8.66 GB 1:155/10.15 GB 6:151/8.74 GB 4:148/9.10 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 59 out of 59 Runtime filters: Only following filters arrived: 7, waited 341ms Hdfs Read Thread Concurrency Bucket: 0:85% 1:10% 2:0% 3:5% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1136 PARQUET/SNAPPY:59 BytesRead(500.000ms): 0, 0, 9.75 MB, 11.76 MB, 11.76 MB, 11.76 MB, 21.57 MB, 21.57 MB, 22.40 MB, 29.60 MB, 29.60 MB, 33.89 MB, 38.55 MB, 38.55 MB, 38.55 MB, 38.55 MB, 39.37 MB, 49.97 MB, 50.79 MB, 52.48 MB, 55.62 MB - FooterProcessingTime: (Avg: 119.419ms ; Min: 17.880ms ; Max: 601.888ms ; Number of samples: 59) - AverageHdfsReadThreadConcurrency: 0.25 - AverageScannerThreadConcurrency: 11.40 - BytesRead: 55.62 MB (58319900) - BytesReadDataNodeCache: 0 - BytesReadLocal: 55.62 MB (58319900) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 55.62 MB (58319900) - DecompressionTime: 309.199ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 59 (59) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 23.90 MB (25060248) - PerReadThreadRawHdfsThroughput: 19.21 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 138.372ms - RowBatchQueuePutWaitTime: 1m36s - RowsRead: 40.80M (40801421) - RowsReturned: 40.79M (40785819) - RowsReturnedRate: 64.30 M/sec - ScanRangesComplete: 1.20K (1195) - ScannerThreadsInvoluntaryContextSwitches: 1.58K (1585) - ScannerThreadsTotalWallClockTime: 1m54s - MaterializeTupleTime(*): 1s969ms - ScannerThreadsSysTime: 3s557ms - ScannerThreadsUserTime: 3s961ms - ScannerThreadsVoluntaryContextSwitches: 161.55K (161550) - TotalRawHdfsReadTime(*): 2s895ms - TotalReadThroughput: 5.30 MB/sec Filter 2 (16.00 MB): - Rows processed: 212.17K (212171) - Rows rejected: 15.60K (15602) - Rows total: 40.80M (40801421) Filter 7 (1.00 MB): - Files processed: 1.20K (1195) - Files rejected: 1.14K (1136) - Files total: 1.20K (1195) - RowGroups processed: 39.87K (39866) - RowGroups rejected: 0 (0) - RowGroups total: 39.87K (39866) - Rows processed: 966.66K (966656) - Rows rejected: 0 (0) - Rows total: 40.79M (40785819) - Splits processed: 59 (59) - Splits rejected: 0 (0) - Splits total: 59 (59) Instance 7f40dcb034de70b7:103 (host=vd1141.foo:22000):(Total: 10s603ms, non-child: 2s242ms, % non-child: 21.15%) Hdfs split stats (:<# splits>/): 3:150/9.73 GB 0:159/10.49 GB 1:140/8.75 GB 6:144/9.15 GB 7:148/9.03 GB 4:136/9.03 GB 5:149/9.53 GB 2:145/9.77 GB Filter 7 arrival: 632ms Filter 2 arrival: 8s989ms MemoryUsage(500.000ms): 2.79 MB, 1.38 MB, 5.42 MB, 26.76 MB, 27.13 MB, 26.15 MB, 27.10 MB, 28.07 MB, 28.20 MB, 24.30 MB, 27.07 MB, 26.39 MB, 28.85 MB, 29.06 MB, 28.22 MB, 27.74 MB, 24.29 MB, 27.83 MB, 44.16 MB, 43.01 MB, 39.56 MB, 19.69 MB ThreadUsage(500.000ms): 1, 2, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 1 - AverageThreadTokens: 11.41 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 44.73 MB (46904951) - PerHostPeakMemUsage: 1.43 GB (1532121184) - RowsProduced: 40.48M (40482762) - TotalNetworkReceiveTime: 411.239ms - TotalNetworkSendTime: 2s310ms - TotalStorageWaitTime: 5s527ms - TotalThreadsInvoluntaryContextSwitches: 3.02K (3018) - TotalThreadsTotalWallClockTime: 2m5s - TotalThreadsSysTime: 2s897ms - TotalThreadsUserTime: 11s596ms - TotalThreadsVoluntaryContextSwitches: 193.10K (193096) Fragment Instance Lifecycle Timings: - ExecTime: 9s525ms - ExecTreeExecTime: 1s125ms - OpenTime: 1s027ms - ExecTreeOpenTime: 854.605ms - PrepareTime: 51.126ms - ExecTreePrepareTime: 2.884ms DataStreamSender (dst_id=23):(Total: 6s195ms, non-child: 6s195ms, % non-child: 100.00%) - BytesSent: 383.57 MB (402201053) - NetworkThroughput(*): 101.43 MB/sec - OverallThroughput: 61.91 MB/sec - PeakMemoryUsage: 4.84 MB (5069888) - RowsReturned: 40.48M (40482762) - SerializeBatchTime: 2s405ms - TransmitDataRPCTime: 3s781ms - UncompressedRowBatchSize: 1.28 GB (1376928508) CodeGen:(Total: 195.166ms, non-child: 195.166ms, % non-child: 100.00%) - CodegenTime: 888.373us - CompileTime: 50.466ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 90 (90) - NumInstructions: 2.97K (2968) - OptimizationTime: 120.688ms - PeakMemoryUsage: 1.45 MB (1519616) - PrepareTime: 23.620ms HASH_JOIN_NODE (id=11):(Total: 1s970ms, non-child: 944.901ms, % non-child: 47.94%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.547ms - PeakMemoryUsage: 1.27 MB (1330143) - ProbeRows: 40.48M (40482762) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 897.068ms - RowsReturned: 40.48M (40482762) - RowsReturnedRate: 20.54 M/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 28.366us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 148.493us - HashBuckets: 212 (212) - HashCollisions: 0 (0) - HashTablesBuildTime: 62.450us - LargestPartitionPercent: 9 (9) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1073600) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 411.250ms, non-child: 20.231us, % non-child: 0.00%) BytesReceived(500.000ms): 0, 0, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 4.874us - DeserializeRowBatchTimer: 14.477us - FirstBatchArrivalWaitTime: 395.900ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 291.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=9):(Total: 614.970ms, non-child: 614.970ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:150/9.73 GB 0:159/10.49 GB 1:140/8.75 GB 6:144/9.15 GB 7:148/9.03 GB 4:136/9.03 GB 5:149/9.53 GB 2:145/9.77 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 56 out of 56 Runtime filters: Only following filters arrived: 7, waited 382ms Hdfs Read Thread Concurrency Bucket: 0:85% 1:5% 2:5% 3:0% 4:0% 5:0% 6:5% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1115 PARQUET/SNAPPY:56 BytesRead(500.000ms): 0, 0, 100.00 KB, 12.26 MB, 12.26 MB, 12.26 MB, 15.62 MB, 19.59 MB, 19.59 MB, 26.99 MB, 30.43 MB, 30.43 MB, 34.39 MB, 35.73 MB, 39.07 MB, 39.07 MB, 39.89 MB, 48.85 MB, 48.85 MB, 52.87 MB, 54.46 MB - FooterProcessingTime: (Avg: 61.493ms ; Min: 3.945ms ; Max: 509.660ms ; Number of samples: 56) - AverageHdfsReadThreadConcurrency: 0.45 - AverageScannerThreadConcurrency: 11.40 - BytesRead: 54.46 MB (57103237) - BytesReadDataNodeCache: 0 - BytesReadLocal: 54.46 MB (57103237) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 54.46 MB (57103237) - DecompressionTime: 352.695ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 56 (56) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 23.55 MB (24693727) - PerReadThreadRawHdfsThroughput: 25.01 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 55.468ms - RowBatchQueuePutWaitTime: 1m41s - RowsRead: 40.50M (40497504) - RowsReturned: 40.48M (40482762) - RowsReturnedRate: 65.83 M/sec - ScanRangesComplete: 1.17K (1171) - ScannerThreadsInvoluntaryContextSwitches: 1.89K (1885) - ScannerThreadsTotalWallClockTime: 1m54s - MaterializeTupleTime(*): 2s173ms - ScannerThreadsSysTime: 2s621ms - ScannerThreadsUserTime: 4s496ms - ScannerThreadsVoluntaryContextSwitches: 192.46K (192461) - TotalRawHdfsReadTime(*): 2s177ms - TotalReadThroughput: 5.19 MB/sec Filter 2 (16.00 MB): - Rows processed: 210.33K (210326) - Rows rejected: 14.74K (14742) - Rows total: 40.50M (40497504) Filter 7 (1.00 MB): - Files processed: 1.17K (1171) - Files rejected: 1.11K (1115) - Files total: 1.17K (1171) - RowGroups processed: 39.57K (39568) - RowGroups rejected: 0 (0) - RowGroups total: 39.57K (39568) - Rows processed: 917.50K (917504) - Rows rejected: 0 (0) - Rows total: 40.48M (40482762) - Splits processed: 56 (56) - Splits rejected: 0 (0) - Splits total: 56 (56) Instance 7f40dcb034de70b7:13b (host=vd1327.foo:22000):(Total: 10s601ms, non-child: 2s245ms, % non-child: 21.18%) Hdfs split stats (:<# splits>/): 7:147/9.86 GB 1:150/10.19 GB 4:143/9.00 GB 2:143/8.87 GB 6:145/8.74 GB 5:152/9.53 GB 3:160/10.16 GB 0:145/9.09 GB Filter 7 arrival: 444ms Filter 2 arrival: 9s791ms MemoryUsage(500.000ms): 1.38 MB, 3.38 MB, 23.26 MB, 24.13 MB, 24.21 MB, 26.83 MB, 26.79 MB, 26.31 MB, 27.95 MB, 28.14 MB, 28.27 MB, 26.55 MB, 26.55 MB, 26.48 MB, 26.50 MB, 23.83 MB, 25.02 MB, 25.21 MB, 19.08 MB, 39.03 MB, 28.58 MB ThreadUsage(500.000ms): 2, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.48 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 39.03 MB (40931065) - PerHostPeakMemUsage: 1.40 GB (1499584051) - RowsProduced: 41.77M (41773556) - TotalNetworkReceiveTime: 225.690ms - TotalNetworkSendTime: 2s769ms - TotalStorageWaitTime: 6s147ms - TotalThreadsInvoluntaryContextSwitches: 2.99K (2988) - TotalThreadsTotalWallClockTime: 2m7s - TotalThreadsSysTime: 3s161ms - TotalThreadsUserTime: 11s932ms - TotalThreadsVoluntaryContextSwitches: 164.27K (164270) Fragment Instance Lifecycle Timings: - ExecTime: 9s498ms - ExecTreeExecTime: 1s158ms - OpenTime: 1s054ms - ExecTreeOpenTime: 880.239ms - PrepareTime: 48.402ms - ExecTreePrepareTime: 3.287ms DataStreamSender (dst_id=23):(Total: 6s137ms, non-child: 6s137ms, % non-child: 100.00%) - BytesSent: 395.92 MB (415150020) - NetworkThroughput(*): 100.28 MB/sec - OverallThroughput: 64.51 MB/sec - PeakMemoryUsage: 4.76 MB (4996160) - RowsReturned: 41.77M (41773556) - SerializeBatchTime: 2s182ms - TransmitDataRPCTime: 3s948ms - UncompressedRowBatchSize: 1.32 GB (1420831872) CodeGen:(Total: 188.875ms, non-child: 188.875ms, % non-child: 100.00%) - CodegenTime: 959.801us - CompileTime: 50.830ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 90 (90) - NumInstructions: 2.97K (2968) - OptimizationTime: 121.897ms - PeakMemoryUsage: 1.45 MB (1519616) - PrepareTime: 15.746ms HASH_JOIN_NODE (id=11):(Total: 2s029ms, non-child: 1s024ms, % non-child: 50.47%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.427ms - PeakMemoryUsage: 1.27 MB (1328428) - ProbeRows: 41.77M (41773556) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 979.011ms - RowsReturned: 41.77M (41773556) - RowsReturnedRate: 20.58 M/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 26.087us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 133.517us - HashBuckets: 212 (212) - HashCollisions: 0 (0) - HashTablesBuildTime: 56.661us - LargestPartitionPercent: 9 (9) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1073600) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 225.701ms, non-child: 18.875us, % non-child: 0.01%) BytesReceived(500.000ms): 0, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 5.219us - DeserializeRowBatchTimer: 15.974us - FirstBatchArrivalWaitTime: 203.444ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 531.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=9):(Total: 780.024ms, non-child: 780.024ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:147/9.86 GB 1:150/10.19 GB 4:143/9.00 GB 2:143/8.87 GB 6:145/8.74 GB 5:152/9.53 GB 3:160/10.16 GB 0:145/9.09 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 64 out of 64 Runtime filters: Only following filters arrived: 7, waited 562ms Hdfs Read Thread Concurrency Bucket: 0:80.95% 1:14.29% 2:4.762% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1121 PARQUET/SNAPPY:64 BytesRead(500.000ms): 0, 0, 10.63 MB, 10.63 MB, 10.73 MB, 21.58 MB, 21.58 MB, 22.43 MB, 30.39 MB, 30.39 MB, 30.49 MB, 39.64 MB, 39.64 MB, 39.64 MB, 39.64 MB, 42.34 MB, 48.26 MB, 49.10 MB, 55.63 MB, 57.77 MB, 57.77 MB - FooterProcessingTime: (Avg: 57.339ms ; Min: 5.117ms ; Max: 146.559ms ; Number of samples: 64) - AverageHdfsReadThreadConcurrency: 0.24 - AverageScannerThreadConcurrency: 11.43 - BytesRead: 57.77 MB (60573892) - BytesReadDataNodeCache: 0 - BytesReadLocal: 57.77 MB (60573892) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 57.77 MB (60573892) - DecompressionTime: 344.968ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 64 (64) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 23.89 MB (25046071) - PerReadThreadRawHdfsThroughput: 23.05 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 88.708ms - RowBatchQueuePutWaitTime: 1m40s - RowsRead: 41.78M (41780391) - RowsReturned: 41.77M (41773556) - RowsReturnedRate: 53.55 M/sec - ScanRangesComplete: 1.19K (1185) - ScannerThreadsInvoluntaryContextSwitches: 2.19K (2189) - ScannerThreadsTotalWallClockTime: 1m56s - MaterializeTupleTime(*): 2s151ms - ScannerThreadsSysTime: 2s886ms - ScannerThreadsUserTime: 5s297ms - ScannerThreadsVoluntaryContextSwitches: 163.62K (163621) - TotalRawHdfsReadTime(*): 2s506ms - TotalReadThroughput: 5.50 MB/sec Filter 2 (16.00 MB): - Rows processed: 92.85K (92851) - Rows rejected: 6.83K (6835) - Rows total: 41.78M (41780391) Filter 7 (1.00 MB): - Files processed: 1.19K (1185) - Files rejected: 1.12K (1121) - Files total: 1.19K (1185) - RowGroups processed: 40.84K (40840) - RowGroups rejected: 0 (0) - RowGroups total: 40.84K (40840) - Rows processed: 1.05M (1047737) - Rows rejected: 0 (0) - Rows total: 41.77M (41773556) - Splits processed: 64 (64) - Splits rejected: 0 (0) - Splits total: 64 (64) Instance 7f40dcb034de70b7:137 (host=vd1117.foo:22000):(Total: 10s587ms, non-child: 2s594ms, % non-child: 24.50%) Hdfs split stats (:<# splits>/): 5:151/9.80 GB 0:141/9.25 GB 1:154/9.48 GB 4:136/8.83 GB 7:130/8.08 GB 3:152/9.79 GB 2:166/10.71 GB 6:145/9.51 GB Filter 7 arrival: 450ms Filter 2 arrival: 9s664ms MemoryUsage(500.000ms): 2.79 MB, 3.38 MB, 14.13 MB, 23.91 MB, 24.04 MB, 24.17 MB, 29.01 MB, 29.35 MB, 28.98 MB, 31.23 MB, 31.13 MB, 31.26 MB, 31.11 MB, 31.15 MB, 28.48 MB, 27.27 MB, 27.17 MB, 25.92 MB, 28.27 MB, 28.30 MB, 34.79 MB ThreadUsage(500.000ms): 1, 1, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 11.86 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 44.46 MB (46624636) - PerHostPeakMemUsage: 1.40 GB (1502030237) - RowsProduced: 39.06M (39055275) - TotalNetworkReceiveTime: 229.945ms - TotalNetworkSendTime: 2s797ms - TotalStorageWaitTime: 5s050ms - TotalThreadsInvoluntaryContextSwitches: 2.50K (2504) - TotalThreadsTotalWallClockTime: 2m6s - TotalThreadsSysTime: 3s596ms - TotalThreadsUserTime: 10s498ms - TotalThreadsVoluntaryContextSwitches: 181.50K (181505) Fragment Instance Lifecycle Timings: - ExecTime: 9s476ms - ExecTreeExecTime: 1s062ms - OpenTime: 1s061ms - ExecTreeOpenTime: 887.127ms - PrepareTime: 49.959ms - ExecTreePrepareTime: 3.401ms DataStreamSender (dst_id=23):(Total: 5s859ms, non-child: 5s859ms, % non-child: 100.00%) - BytesSent: 370.15 MB (388127225) - NetworkThroughput(*): 99.12 MB/sec - OverallThroughput: 63.18 MB/sec - PeakMemoryUsage: 4.80 MB (5028928) - RowsReturned: 39.06M (39055275) - SerializeBatchTime: 2s117ms - TransmitDataRPCTime: 3s734ms - UncompressedRowBatchSize: 1.24 GB (1328375838) CodeGen:(Total: 192.263ms, non-child: 192.263ms, % non-child: 100.00%) - CodegenTime: 1.018ms - CompileTime: 50.168ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 90 (90) - NumInstructions: 2.97K (2968) - OptimizationTime: 122.534ms - PeakMemoryUsage: 1.45 MB (1519616) - PrepareTime: 19.133ms HASH_JOIN_NODE (id=11):(Total: 1s942ms, non-child: 929.673ms, % non-child: 47.86%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.494ms - PeakMemoryUsage: 1.26 MB (1322416) - ProbeRows: 39.06M (39055275) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 878.411ms - RowsReturned: 39.06M (39055275) - RowsReturnedRate: 20.11 M/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 27.269us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 132.059us - HashBuckets: 212 (212) - HashCollisions: 0 (0) - HashTablesBuildTime: 57.643us - LargestPartitionPercent: 9 (9) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1073600) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 229.954ms, non-child: 19.605us, % non-child: 0.01%) BytesReceived(500.000ms): 0, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 4.637us - DeserializeRowBatchTimer: 22.521us - FirstBatchArrivalWaitTime: 208.076ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 521.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=9):(Total: 783.367ms, non-child: 783.367ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:151/9.80 GB 0:141/9.25 GB 1:154/9.48 GB 4:136/8.83 GB 7:130/8.08 GB 3:152/9.79 GB 2:166/10.71 GB 6:145/9.51 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 52 out of 52 Runtime filters: Only following filters arrived: 7, waited 562ms Hdfs Read Thread Concurrency Bucket: 0:80% 1:10% 2:10% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1123 PARQUET/SNAPPY:52 BytesRead(500.000ms): 0, 0, 2.36 MB, 10.69 MB, 10.69 MB, 12.12 MB, 22.81 MB, 22.81 MB, 24.33 MB, 31.56 MB, 31.56 MB, 31.56 MB, 31.56 MB, 31.56 MB, 37.19 MB, 39.64 MB, 39.64 MB, 44.35 MB, 48.19 MB, 49.03 MB, 52.12 MB - FooterProcessingTime: (Avg: 54.378ms ; Min: 5.601ms ; Max: 157.419ms ; Number of samples: 52) - AverageHdfsReadThreadConcurrency: 0.30 - AverageScannerThreadConcurrency: 11.40 - BytesRead: 52.12 MB (54650218) - BytesReadDataNodeCache: 0 - BytesReadLocal: 52.12 MB (54650218) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 52.12 MB (54650218) - DecompressionTime: 304.390ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 52 (52) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 25.83 MB (27079671) - PerReadThreadRawHdfsThroughput: 25.42 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 91.244ms - RowBatchQueuePutWaitTime: 1m41s - RowsRead: 39.07M (39068714) - RowsReturned: 39.06M (39055275) - RowsReturnedRate: 49.86 M/sec - ScanRangesComplete: 1.18K (1175) - ScannerThreadsInvoluntaryContextSwitches: 1.73K (1730) - ScannerThreadsTotalWallClockTime: 1m55s - MaterializeTupleTime(*): 1s852ms - ScannerThreadsSysTime: 3s323ms - ScannerThreadsUserTime: 3s901ms - ScannerThreadsVoluntaryContextSwitches: 180.88K (180881) - TotalRawHdfsReadTime(*): 2s050ms - TotalReadThroughput: 4.96 MB/sec Filter 2 (16.00 MB): - Rows processed: 188.54K (188543) - Rows rejected: 13.44K (13439) - Rows total: 39.07M (39068714) Filter 7 (1.00 MB): - Files processed: 1.18K (1175) - Files rejected: 1.12K (1123) - Files total: 1.18K (1175) - RowGroups processed: 38.17K (38173) - RowGroups rejected: 0 (0) - RowGroups total: 38.17K (38173) - Rows processed: 851.97K (851968) - Rows rejected: 0 (0) - Rows total: 39.06M (39055275) - Splits processed: 52 (52) - Splits rejected: 0 (0) - Splits total: 52 (52) Instance 7f40dcb034de70b7:127 (host=ve1125.foo:22000):(Total: 10s583ms, non-child: 2s042ms, % non-child: 19.30%) Hdfs split stats (:<# splits>/): 1:162/10.37 GB 4:149/9.48 GB 2:147/9.18 GB 3:134/8.29 GB 0:153/9.72 GB 7:149/9.88 GB 6:153/9.91 GB 5:135/8.67 GB Filter 7 arrival: 497ms Filter 2 arrival: 9s463ms MemoryUsage(500.000ms): 1.35 MB, 3.38 MB, 22.88 MB, 25.14 MB, 24.80 MB, 25.34 MB, 25.91 MB, 25.98 MB, 23.41 MB, 27.07 MB, 26.72 MB, 27.24 MB, 28.32 MB, 23.61 MB, 27.11 MB, 27.25 MB, 27.83 MB, 28.23 MB, 27.33 MB, 38.30 MB, 37.53 MB ThreadUsage(500.000ms): 1, 1, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 11.86 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 41.29 MB (43295826) - PerHostPeakMemUsage: 1.42 GB (1530053958) - RowsProduced: 41.33M (41326288) - TotalNetworkReceiveTime: 269.882ms - TotalNetworkSendTime: 2s230ms - TotalStorageWaitTime: 6s869ms - TotalThreadsInvoluntaryContextSwitches: 2.94K (2944) - TotalThreadsTotalWallClockTime: 2m5s - TotalThreadsSysTime: 3s123ms - TotalThreadsUserTime: 11s579ms - TotalThreadsVoluntaryContextSwitches: 182.40K (182404) Fragment Instance Lifecycle Timings: - ExecTime: 9s439ms - ExecTreeExecTime: 1s195ms - OpenTime: 1s089ms - ExecTreeOpenTime: 913.561ms - PrepareTime: 54.818ms - ExecTreePrepareTime: 3.304ms DataStreamSender (dst_id=23):(Total: 6s240ms, non-child: 6s240ms, % non-child: 100.00%) - BytesSent: 391.70 MB (410722183) - NetworkThroughput(*): 100.56 MB/sec - OverallThroughput: 62.77 MB/sec - PeakMemoryUsage: 4.76 MB (4987968) - RowsReturned: 41.33M (41326288) - SerializeBatchTime: 2s337ms - TransmitDataRPCTime: 3s895ms - UncompressedRowBatchSize: 1.31 GB (1405619080) CodeGen:(Total: 199.255ms, non-child: 199.255ms, % non-child: 100.00%) - CodegenTime: 1.083ms - CompileTime: 50.547ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 90 (90) - NumInstructions: 2.97K (2968) - OptimizationTime: 123.524ms - PeakMemoryUsage: 1.45 MB (1519616) - PrepareTime: 24.710ms HASH_JOIN_NODE (id=11):(Total: 2s101ms, non-child: 1s018ms, % non-child: 48.45%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.865ms - PeakMemoryUsage: 1.26 MB (1326355) - ProbeRows: 41.33M (41326288) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 962.860ms - RowsReturned: 41.33M (41326288) - RowsReturnedRate: 19.67 M/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 28.255us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 247.279us - HashBuckets: 212 (212) - HashCollisions: 0 (0) - HashTablesBuildTime: 67.308us - LargestPartitionPercent: 9 (9) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1073600) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 269.892ms, non-child: 20.373us, % non-child: 0.01%) BytesReceived(500.000ms): 0, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 4.721us - DeserializeRowBatchTimer: 17.143us - FirstBatchArrivalWaitTime: 262.337ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 444.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=9):(Total: 813.636ms, non-child: 813.636ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:162/10.37 GB 4:149/9.48 GB 2:147/9.18 GB 3:134/8.29 GB 0:153/9.72 GB 7:149/9.88 GB 6:153/9.91 GB 5:135/8.67 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 59 out of 59 Runtime filters: Only following filters arrived: 7, waited 522ms Hdfs Read Thread Concurrency Bucket: 0:90% 1:5% 2:0% 3:0% 4:5% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1123 PARQUET/SNAPPY:59 BytesRead(500.000ms): 0, 0, 6.96 MB, 11.25 MB, 11.25 MB, 12.09 MB, 20.02 MB, 21.34 MB, 21.34 MB, 31.43 MB, 31.53 MB, 32.87 MB, 38.47 MB, 38.47 MB, 41.00 MB, 41.00 MB, 49.70 MB, 49.70 MB, 50.53 MB, 56.16 MB, 56.16 MB - FooterProcessingTime: (Avg: 72.670ms ; Min: 3.034ms ; Max: 483.546ms ; Number of samples: 59) - AverageHdfsReadThreadConcurrency: 0.25 - AverageScannerThreadConcurrency: 11.40 - BytesRead: 56.16 MB (58886339) - BytesReadDataNodeCache: 0 - BytesReadLocal: 56.16 MB (58886339) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 56.16 MB (58886339) - DecompressionTime: 320.452ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 59 (59) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 22.76 MB (23862905) - PerReadThreadRawHdfsThroughput: 23.21 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 117.668ms - RowBatchQueuePutWaitTime: 1m39s - RowsRead: 41.34M (41335141) - RowsReturned: 41.33M (41326288) - RowsReturnedRate: 50.79 M/sec - ScanRangesComplete: 1.18K (1182) - ScannerThreadsInvoluntaryContextSwitches: 1.73K (1730) - ScannerThreadsTotalWallClockTime: 1m54s - MaterializeTupleTime(*): 2s030ms - ScannerThreadsSysTime: 2s857ms - ScannerThreadsUserTime: 4s474ms - ScannerThreadsVoluntaryContextSwitches: 181.75K (181751) - TotalRawHdfsReadTime(*): 2s419ms - TotalReadThroughput: 5.35 MB/sec Filter 2 (16.00 MB): - Rows processed: 126.44K (126443) - Rows rejected: 8.85K (8853) - Rows total: 41.34M (41335141) Filter 7 (1.00 MB): - Files processed: 1.18K (1182) - Files rejected: 1.12K (1123) - Files total: 1.18K (1182) - RowGroups processed: 40.40K (40399) - RowGroups rejected: 0 (0) - RowGroups total: 40.40K (40399) - Rows processed: 966.66K (966656) - Rows rejected: 0 (0) - Rows total: 41.33M (41326288) - Splits processed: 59 (59) - Splits rejected: 0 (0) - Splits total: 59 (59) Instance 7f40dcb034de70b7:159 (host=vd1140.foo:22000):(Total: 10s568ms, non-child: 2s079ms, % non-child: 19.68%) Hdfs split stats (:<# splits>/): 3:147/9.01 GB 6:150/9.80 GB 5:135/7.86 GB 4:136/8.53 GB 2:165/10.63 GB 7:155/9.48 GB 1:153/10.42 GB 0:156/9.76 GB Filter 7 arrival: 306ms MemoryUsage(500.000ms): 3.38 MB, 3.38 MB, 26.54 MB, 26.83 MB, 26.53 MB, 30.02 MB, 30.00 MB, 30.25 MB, 28.00 MB, 27.01 MB, 27.25 MB, 26.29 MB, 26.29 MB, 28.90 MB, 28.85 MB, 29.18 MB, 27.90 MB, 28.36 MB, 24.87 MB, 20.11 MB, 10.58 MB ThreadUsage(500.000ms): 1, 1, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 11.86 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 30.80 MB (32299454) - PerHostPeakMemUsage: 1.38 GB (1484470376) - RowsProduced: 41.68M (41676214) - TotalNetworkReceiveTime: 77.371ms - TotalNetworkSendTime: 2s431ms - TotalStorageWaitTime: 6s622ms - TotalThreadsInvoluntaryContextSwitches: 2.42K (2419) - TotalThreadsTotalWallClockTime: 2m4s - TotalThreadsSysTime: 2s495ms - TotalThreadsUserTime: 11s312ms - TotalThreadsVoluntaryContextSwitches: 164.35K (164352) Fragment Instance Lifecycle Timings: - ExecTime: 9s501ms - ExecTreeExecTime: 1s151ms - OpenTime: 1s011ms - ExecTreeOpenTime: 834.364ms - PrepareTime: 56.007ms - ExecTreePrepareTime: 3.543ms DataStreamSender (dst_id=23):(Total: 6s310ms, non-child: 6s310ms, % non-child: 100.00%) - BytesSent: 395.31 MB (414515437) - NetworkThroughput(*): 99.94 MB/sec - OverallThroughput: 62.64 MB/sec - PeakMemoryUsage: 4.73 MB (4955200) - RowsReturned: 41.68M (41676214) - SerializeBatchTime: 2s347ms - TransmitDataRPCTime: 3s955ms - UncompressedRowBatchSize: 1.32 GB (1417521036) CodeGen:(Total: 200.454ms, non-child: 200.454ms, % non-child: 100.00%) - CodegenTime: 1.265ms - CompileTime: 50.365ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 90 (90) - NumInstructions: 2.97K (2968) - OptimizationTime: 125.142ms - PeakMemoryUsage: 1.45 MB (1519616) - PrepareTime: 24.519ms HASH_JOIN_NODE (id=11):(Total: 1s977ms, non-child: 1s007ms, % non-child: 50.95%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.511ms - PeakMemoryUsage: 1.20 MB (1255232) - ProbeRows: 41.68M (41676214) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 953.666ms - RowsReturned: 41.68M (41676214) - RowsReturnedRate: 21.07 M/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 31.716us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 179.693us - HashBuckets: 212 (212) - HashCollisions: 0 (0) - HashTablesBuildTime: 102.492us - LargestPartitionPercent: 9 (9) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1073600) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 77.379ms, non-child: 17.697us, % non-child: 0.02%) BytesReceived(500.000ms): 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 3.243us - DeserializeRowBatchTimer: 14.738us - FirstBatchArrivalWaitTime: 64.202ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 1.55 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=9):(Total: 893.006ms, non-child: 893.006ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:147/9.01 GB 6:150/9.80 GB 5:135/7.86 GB 4:136/8.53 GB 2:165/10.63 GB 7:155/9.48 GB 1:153/10.42 GB 0:156/9.76 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 56 out of 56 Runtime filters: Only following filters arrived: 7, waited 703ms Hdfs Read Thread Concurrency Bucket: 0:90.48% 1:9.524% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1141 PARQUET/SNAPPY:56 BytesRead(500.000ms): 0, 0, 13.87 MB, 13.87 MB, 13.87 MB, 22.88 MB, 22.88 MB, 22.88 MB, 25.49 MB, 29.79 MB, 29.79 MB, 32.27 MB, 32.27 MB, 41.03 MB, 41.87 MB, 43.66 MB, 46.92 MB, 47.77 MB, 52.60 MB, 55.87 MB, 55.87 MB - FooterProcessingTime: (Avg: 61.846ms ; Min: 4.651ms ; Max: 308.346ms ; Number of samples: 56) - AverageHdfsReadThreadConcurrency: 0.10 - AverageScannerThreadConcurrency: 10.86 - BytesRead: 55.87 MB (58584508) - BytesReadDataNodeCache: 0 - BytesReadLocal: 55.87 MB (58584508) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 55.87 MB (58584508) - DecompressionTime: 354.311ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 56 (56) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 24.93 MB (26138269) - PerReadThreadRawHdfsThroughput: 25.98 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 47.274ms - RowBatchQueuePutWaitTime: 1m40s - RowsRead: 41.68M (41676214) - RowsReturned: 41.68M (41676214) - RowsReturnedRate: 46.67 M/sec - ScanRangesComplete: 1.20K (1197) - ScannerThreadsInvoluntaryContextSwitches: 1.60K (1598) - ScannerThreadsTotalWallClockTime: 1m53s - MaterializeTupleTime(*): 2s016ms - ScannerThreadsSysTime: 2s214ms - ScannerThreadsUserTime: 4s327ms - ScannerThreadsVoluntaryContextSwitches: 163.71K (163705) - TotalRawHdfsReadTime(*): 2s150ms - TotalReadThroughput: 5.32 MB/sec Filter 2 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 41.68M (41676214) Filter 7 (1.00 MB): - Files processed: 1.20K (1197) - Files rejected: 1.14K (1141) - Files total: 1.20K (1197) - RowGroups processed: 40.74K (40745) - RowGroups rejected: 0 (0) - RowGroups total: 40.74K (40745) - Rows processed: 917.50K (917504) - Rows rejected: 0 (0) - Rows total: 41.68M (41676214) - Splits processed: 56 (56) - Splits rejected: 0 (0) - Splits total: 56 (56) Instance 7f40dcb034de70b7:14f (host=ve1139.foo:22000):(Total: 10s568ms, non-child: 2s080ms, % non-child: 19.69%) Hdfs split stats (:<# splits>/): 0:131/8.28 GB 5:146/9.26 GB 1:158/10.71 GB 6:156/9.98 GB 4:133/8.47 GB 2:161/10.56 GB 7:157/9.21 GB 3:143/8.98 GB Filter 7 arrival: 359ms MemoryUsage(500.000ms): 42.25 KB, 3.38 MB, 4.52 MB, 24.92 MB, 25.18 MB, 24.73 MB, 26.88 MB, 27.25 MB, 27.17 MB, 27.66 MB, 28.21 MB, 26.18 MB, 26.20 MB, 26.20 MB, 28.04 MB, 28.10 MB, 19.58 MB, 21.09 MB, 26.07 MB, 26.21 MB, 18.63 MB, 3.84 MB ThreadUsage(500.000ms): 1, 1, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 1 - AverageThreadTokens: 11.36 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 28.78 MB (30173883) - PerHostPeakMemUsage: 1.39 GB (1495109600) - RowsProduced: 40.91M (40912151) - TotalNetworkReceiveTime: 128.860ms - TotalNetworkSendTime: 2s209ms - TotalStorageWaitTime: 10s879ms - TotalThreadsInvoluntaryContextSwitches: 2.56K (2564) - TotalThreadsTotalWallClockTime: 2m6s - TotalThreadsSysTime: 2s828ms - TotalThreadsUserTime: 11s540ms - TotalThreadsVoluntaryContextSwitches: 215.55K (215553) Fragment Instance Lifecycle Timings: - ExecTime: 9s455ms - ExecTreeExecTime: 1s131ms - OpenTime: 1s055ms - ExecTreeOpenTime: 877.765ms - PrepareTime: 56.712ms - ExecTreePrepareTime: 3.228ms DataStreamSender (dst_id=23):(Total: 6s284ms, non-child: 6s284ms, % non-child: 100.00%) - BytesSent: 387.94 MB (406786601) - NetworkThroughput(*): 100.37 MB/sec - OverallThroughput: 61.73 MB/sec - PeakMemoryUsage: 4.84 MB (5078080) - RowsReturned: 40.91M (40912151) - SerializeBatchTime: 2s411ms - TransmitDataRPCTime: 3s865ms - UncompressedRowBatchSize: 1.30 GB (1391533214) CodeGen:(Total: 200.625ms, non-child: 200.625ms, % non-child: 100.00%) - CodegenTime: 1.080ms - CompileTime: 52.386ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 90 (90) - NumInstructions: 2.97K (2968) - OptimizationTime: 123.598ms - PeakMemoryUsage: 1.45 MB (1519616) - PrepareTime: 24.214ms HASH_JOIN_NODE (id=11):(Total: 2s002ms, non-child: 977.038ms, % non-child: 48.80%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.453ms - PeakMemoryUsage: 1.20 MB (1255232) - ProbeRows: 40.91M (40912151) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 925.939ms - RowsReturned: 40.91M (40912151) - RowsReturnedRate: 20.43 M/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 25.733us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 173.959us - HashBuckets: 212 (212) - HashCollisions: 0 (0) - HashTablesBuildTime: 45.755us - LargestPartitionPercent: 9 (9) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1073600) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 128.870ms, non-child: 21.379us, % non-child: 0.02%) BytesReceived(500.000ms): 0, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 5.212us - DeserializeRowBatchTimer: 40.025us - FirstBatchArrivalWaitTime: 112.403ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 931.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=9):(Total: 896.616ms, non-child: 896.616ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:131/8.28 GB 5:146/9.26 GB 1:158/10.71 GB 6:156/9.98 GB 4:133/8.47 GB 2:161/10.56 GB 7:157/9.21 GB 3:143/8.98 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 57 out of 57 Runtime filters: Only following filters arrived: 7, waited 643ms Hdfs Read Thread Concurrency Bucket: 0:85% 1:5% 2:10% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1128 PARQUET/SNAPPY:57 BytesRead(500.000ms): 0, 0, 0, 11.20 MB, 11.20 MB, 12.22 MB, 20.73 MB, 20.73 MB, 24.69 MB, 31.43 MB, 31.43 MB, 31.53 MB, 36.20 MB, 36.20 MB, 40.15 MB, 40.15 MB, 41.11 MB, 46.18 MB, 52.77 MB, 52.77 MB, 55.29 MB - FooterProcessingTime: (Avg: 122.871ms ; Min: 3.795ms ; Max: 826.215ms ; Number of samples: 57) - AverageHdfsReadThreadConcurrency: 0.25 - AverageScannerThreadConcurrency: 11.40 - BytesRead: 55.29 MB (57977782) - BytesReadDataNodeCache: 0 - BytesReadLocal: 55.29 MB (57977782) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 55.29 MB (57977782) - DecompressionTime: 334.870ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 57 (57) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 22.98 MB (24096288) - PerReadThreadRawHdfsThroughput: 24.62 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 102.073ms - RowBatchQueuePutWaitTime: 1m36s - RowsRead: 40.91M (40912151) - RowsReturned: 40.91M (40912151) - RowsReturnedRate: 45.63 M/sec - ScanRangesComplete: 1.19K (1185) - ScannerThreadsInvoluntaryContextSwitches: 1.56K (1563) - ScannerThreadsTotalWallClockTime: 1m55s - MaterializeTupleTime(*): 2s038ms - ScannerThreadsSysTime: 2s545ms - ScannerThreadsUserTime: 4s393ms - ScannerThreadsVoluntaryContextSwitches: 214.95K (214952) - TotalRawHdfsReadTime(*): 2s246ms - TotalReadThroughput: 5.27 MB/sec Filter 2 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 40.91M (40912151) Filter 7 (1.00 MB): - Files processed: 1.19K (1185) - Files rejected: 1.13K (1128) - Files total: 1.19K (1185) - RowGroups processed: 40.00K (40000) - RowGroups rejected: 0 (0) - RowGroups total: 40.00K (40000) - Rows processed: 933.89K (933888) - Rows rejected: 0 (0) - Rows total: 40.91M (40912151) - Splits processed: 57 (57) - Splits rejected: 0 (0) - Splits total: 57 (57) Instance 7f40dcb034de70b7:118 (host=vc1534.foo:22000):(Total: 10s549ms, non-child: 2s462ms, % non-child: 23.34%) Hdfs split stats (:<# splits>/): 0:158/10.51 GB 1:163/10.74 GB 6:154/10.05 GB 3:148/9.49 GB 5:147/9.08 GB 4:145/8.98 GB 7:125/7.61 GB 2:138/9.04 GB Filter 7 arrival: 577ms Filter 2 arrival: 9s310ms MemoryUsage(500.000ms): 1.35 MB, 3.38 MB, 19.01 MB, 23.83 MB, 23.95 MB, 25.39 MB, 28.03 MB, 27.83 MB, 29.05 MB, 30.98 MB, 31.07 MB, 30.43 MB, 29.29 MB, 29.29 MB, 28.20 MB, 28.14 MB, 26.06 MB, 24.35 MB, 24.80 MB, 41.82 MB, 34.95 MB ThreadUsage(500.000ms): 1, 1, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 11.86 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 41.87 MB (43908626) - PerHostPeakMemUsage: 1.39 GB (1489898848) - RowsProduced: 39.04M (39040069) - TotalNetworkReceiveTime: 359.171ms - TotalNetworkSendTime: 2s486ms - TotalStorageWaitTime: 5s291ms - TotalThreadsInvoluntaryContextSwitches: 2.33K (2333) - TotalThreadsTotalWallClockTime: 2m4s - TotalThreadsSysTime: 2s454ms - TotalThreadsUserTime: 10s849ms - TotalThreadsVoluntaryContextSwitches: 135.32K (135323) Fragment Instance Lifecycle Timings: - ExecTime: 9s417ms - ExecTreeExecTime: 1s060ms - OpenTime: 1s081ms - ExecTreeOpenTime: 910.651ms - PrepareTime: 49.747ms - ExecTreePrepareTime: 2.777ms DataStreamSender (dst_id=23):(Total: 5s932ms, non-child: 5s932ms, % non-child: 100.00%) - BytesSent: 370.18 MB (388164596) - NetworkThroughput(*): 100.48 MB/sec - OverallThroughput: 62.40 MB/sec - PeakMemoryUsage: 4.82 MB (5053504) - RowsReturned: 39.04M (39040069) - SerializeBatchTime: 2s240ms - TransmitDataRPCTime: 3s684ms - UncompressedRowBatchSize: 1.24 GB (1327858650) CodeGen:(Total: 191.887ms, non-child: 191.887ms, % non-child: 100.00%) - CodegenTime: 801.916us - CompileTime: 51.248ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 90 (90) - NumInstructions: 2.97K (2968) - OptimizationTime: 118.247ms - PeakMemoryUsage: 1.45 MB (1519616) - PrepareTime: 21.982ms HASH_JOIN_NODE (id=11):(Total: 1s962ms, non-child: 894.169ms, % non-child: 45.57%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.345ms - PeakMemoryUsage: 1.27 MB (1330942) - ProbeRows: 39.04M (39040069) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 836.763ms - RowsReturned: 39.04M (39040069) - RowsReturnedRate: 19.90 M/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 24.757us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 140.931us - HashBuckets: 212 (212) - HashCollisions: 0 (0) - HashTablesBuildTime: 42.893us - LargestPartitionPercent: 9 (9) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1073600) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 359.182ms, non-child: 19.812us, % non-child: 0.01%) BytesReceived(500.000ms): 0, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 5.025us - DeserializeRowBatchTimer: 19.675us - FirstBatchArrivalWaitTime: 334.221ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 334.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=9):(Total: 709.211ms, non-child: 709.211ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:158/10.51 GB 1:163/10.74 GB 6:154/10.05 GB 3:148/9.49 GB 5:147/9.08 GB 4:145/8.98 GB 7:125/7.61 GB 2:138/9.04 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 55 out of 55 Runtime filters: Only following filters arrived: 7, waited 442ms Hdfs Read Thread Concurrency Bucket: 0:80% 1:10% 2:5% 3:0% 4:5% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1123 PARQUET/SNAPPY:55 BytesRead(500.000ms): 0, 0, 5.50 MB, 10.66 MB, 10.66 MB, 12.05 MB, 22.77 MB, 22.77 MB, 24.25 MB, 31.73 MB, 31.73 MB, 32.57 MB, 33.42 MB, 33.42 MB, 37.63 MB, 37.63 MB, 39.89 MB, 47.30 MB, 48.81 MB, 50.44 MB, 52.97 MB - FooterProcessingTime: (Avg: 56.979ms ; Min: 19.261ms ; Max: 177.710ms ; Number of samples: 55) - AverageHdfsReadThreadConcurrency: 0.40 - AverageScannerThreadConcurrency: 11.40 - BytesRead: 52.97 MB (55546827) - BytesReadDataNodeCache: 0 - BytesReadLocal: 52.97 MB (55546827) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 52.97 MB (55546827) - DecompressionTime: 349.049ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 55 (55) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 25.80 MB (27052365) - PerReadThreadRawHdfsThroughput: 23.77 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 106.160ms - RowBatchQueuePutWaitTime: 1m42s - RowsRead: 39.06M (39055598) - RowsReturned: 39.04M (39040069) - RowsReturnedRate: 55.05 M/sec - ScanRangesComplete: 1.18K (1178) - ScannerThreadsInvoluntaryContextSwitches: 1.44K (1436) - ScannerThreadsTotalWallClockTime: 1m53s - MaterializeTupleTime(*): 2s094ms - ScannerThreadsSysTime: 2s168ms - ScannerThreadsUserTime: 4s028ms - ScannerThreadsVoluntaryContextSwitches: 134.73K (134728) - TotalRawHdfsReadTime(*): 2s228ms - TotalReadThroughput: 5.05 MB/sec Filter 2 (16.00 MB): - Rows processed: 209.06K (209065) - Rows rejected: 15.53K (15529) - Rows total: 39.06M (39055598) Filter 7 (1.00 MB): - Files processed: 1.18K (1178) - Files rejected: 1.12K (1123) - Files total: 1.18K (1178) - RowGroups processed: 38.16K (38163) - RowGroups rejected: 0 (0) - RowGroups total: 38.16K (38163) - Rows processed: 901.12K (901120) - Rows rejected: 0 (0) - Rows total: 39.04M (39040069) - Splits processed: 55 (55) - Splits rejected: 0 (0) - Splits total: 55 (55) Instance 7f40dcb034de70b7:138 (host=vc1508.foo:22000):(Total: 10s536ms, non-child: 1s910ms, % non-child: 18.13%) Hdfs split stats (:<# splits>/): 5:143/9.39 GB 4:152/9.62 GB 7:142/9.31 GB 1:143/9.25 GB 2:145/9.53 GB 0:133/8.24 GB 6:158/9.72 GB 3:165/10.40 GB Filter 7 arrival: 438ms Filter 2 arrival: 9s668ms MemoryUsage(500.000ms): 3.38 MB, 3.38 MB, 26.80 MB, 26.85 MB, 27.10 MB, 29.95 MB, 29.84 MB, 30.16 MB, 27.00 MB, 28.92 MB, 29.28 MB, 27.91 MB, 27.91 MB, 27.97 MB, 28.27 MB, 28.03 MB, 28.07 MB, 28.54 MB, 29.12 MB, 43.23 MB, 19.86 MB ThreadUsage(500.000ms): 1, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 1 - AverageThreadTokens: 11.86 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 45.74 MB (47964295) - PerHostPeakMemUsage: 1.41 GB (1514347859) - RowsProduced: 42.82M (42820113) - TotalNetworkReceiveTime: 213.101ms - TotalNetworkSendTime: 2s355ms - TotalStorageWaitTime: 5s522ms - TotalThreadsInvoluntaryContextSwitches: 2.60K (2596) - TotalThreadsTotalWallClockTime: 2m5s - TotalThreadsSysTime: 2s120ms - TotalThreadsUserTime: 11s147ms - TotalThreadsVoluntaryContextSwitches: 114.91K (114909) Fragment Instance Lifecycle Timings: - ExecTime: 9s391ms - ExecTreeExecTime: 1s165ms - OpenTime: 1s093ms - ExecTreeOpenTime: 916.188ms - PrepareTime: 51.823ms - ExecTreePrepareTime: 3.209ms DataStreamSender (dst_id=23):(Total: 6s353ms, non-child: 6s353ms, % non-child: 100.00%) - BytesSent: 406.31 MB (426050369) - NetworkThroughput(*): 100.43 MB/sec - OverallThroughput: 63.95 MB/sec - PeakMemoryUsage: 4.84 MB (5069888) - RowsReturned: 42.82M (42820113) - SerializeBatchTime: 2s300ms - TransmitDataRPCTime: 4s045ms - UncompressedRowBatchSize: 1.36 GB (1456428130) CodeGen:(Total: 198.483ms, non-child: 198.483ms, % non-child: 100.00%) - CodegenTime: 1.056ms - CompileTime: 50.034ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 90 (90) - NumInstructions: 2.97K (2968) - OptimizationTime: 124.846ms - PeakMemoryUsage: 1.45 MB (1519616) - PrepareTime: 23.151ms HASH_JOIN_NODE (id=11):(Total: 2s074ms, non-child: 1s028ms, % non-child: 49.60%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.911ms - PeakMemoryUsage: 1.20 MB (1255232) - ProbeRows: 42.82M (42820113) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 973.242ms - RowsReturned: 42.82M (42820113) - RowsReturnedRate: 20.64 M/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 38.258us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 152.651us - HashBuckets: 212 (212) - HashCollisions: 0 (0) - HashTablesBuildTime: 89.171us - LargestPartitionPercent: 9 (9) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1073600) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 213.120ms, non-child: 28.810us, % non-child: 0.01%) BytesReceived(500.000ms): 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 13.923us - DeserializeRowBatchTimer: 26.184us - FirstBatchArrivalWaitTime: 193.597ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 563.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=9):(Total: 832.747ms, non-child: 832.747ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:143/9.39 GB 4:152/9.62 GB 7:142/9.31 GB 1:143/9.25 GB 2:145/9.53 GB 0:133/8.24 GB 6:158/9.72 GB 3:165/10.40 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 56 out of 56 Runtime filters: Only following filters arrived: 7, waited 562ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1125 PARQUET/SNAPPY:56 BytesRead(500.000ms): 0, 0, 12.34 MB, 12.34 MB, 12.34 MB, 20.89 MB, 20.89 MB, 22.31 MB, 26.26 MB, 30.16 MB, 30.16 MB, 38.56 MB, 38.56 MB, 39.35 MB, 39.35 MB, 49.24 MB, 49.24 MB, 50.08 MB, 57.13 MB, 57.13 MB - FooterProcessingTime: (Avg: 51.991ms ; Min: 16.399ms ; Max: 149.292ms ; Number of samples: 56) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 11.40 - BytesRead: 57.13 MB (59900274) - BytesReadDataNodeCache: 0 - BytesReadLocal: 57.13 MB (59900274) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 57.13 MB (59900274) - DecompressionTime: 367.850ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 56 (56) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 24.90 MB (26105406) - PerReadThreadRawHdfsThroughput: 28.60 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 136.293ms - RowBatchQueuePutWaitTime: 1m42s - RowsRead: 42.83M (42829752) - RowsReturned: 42.82M (42820113) - RowsReturnedRate: 51.42 M/sec - ScanRangesComplete: 1.18K (1181) - ScannerThreadsInvoluntaryContextSwitches: 1.76K (1761) - ScannerThreadsTotalWallClockTime: 1m54s - MaterializeTupleTime(*): 2s109ms - ScannerThreadsSysTime: 1s840ms - ScannerThreadsUserTime: 4s198ms - ScannerThreadsVoluntaryContextSwitches: 114.28K (114282) - TotalRawHdfsReadTime(*): 1s997ms - TotalReadThroughput: 5.71 MB/sec Filter 2 (16.00 MB): - Rows processed: 139.69K (139687) - Rows rejected: 9.64K (9639) - Rows total: 42.83M (42829752) Filter 7 (1.00 MB): - Files processed: 1.18K (1181) - Files rejected: 1.12K (1125) - Files total: 1.18K (1181) - RowGroups processed: 41.86K (41857) - RowGroups rejected: 0 (0) - RowGroups total: 41.86K (41857) - Rows processed: 917.50K (917504) - Rows rejected: 0 (0) - Rows total: 42.82M (42820113) - Splits processed: 56 (56) - Splits rejected: 0 (0) - Splits total: 56 (56) Instance 7f40dcb034de70b7:15d (host=vc1540.foo:22000):(Total: 10s524ms, non-child: 1s967ms, % non-child: 18.70%) Hdfs split stats (:<# splits>/): 0:139/8.50 GB 7:131/8.26 GB 1:154/9.91 GB 4:150/9.81 GB 3:157/10.01 GB 2:153/9.72 GB 5:164/10.62 GB 6:128/8.65 GB Filter 7 arrival: 525ms MemoryUsage(500.000ms): 2.80 MB, 3.38 MB, 23.78 MB, 25.01 MB, 25.44 MB, 24.77 MB, 24.92 MB, 25.19 MB, 26.03 MB, 26.17 MB, 25.77 MB, 26.08 MB, 27.37 MB, 24.47 MB, 28.87 MB, 29.00 MB, 26.38 MB, 26.84 MB, 28.44 MB, 19.94 MB, 12.68 MB ThreadUsage(500.000ms): 1, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.43 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 29.70 MB (31143938) - PerHostPeakMemUsage: 1.41 GB (1509975436) - RowsProduced: 40.55M (40545133) - TotalNetworkReceiveTime: 3.192us - TotalNetworkSendTime: 2s333ms - TotalStorageWaitTime: 6s881ms - TotalThreadsInvoluntaryContextSwitches: 2.85K (2855) - TotalThreadsTotalWallClockTime: 2m6s - TotalThreadsSysTime: 4s368ms - TotalThreadsUserTime: 11s651ms - TotalThreadsVoluntaryContextSwitches: 167.86K (167858) Fragment Instance Lifecycle Timings: - ExecTime: 9s296ms - ExecTreeExecTime: 1s130ms - OpenTime: 1s132ms - ExecTreeOpenTime: 697.723ms - PrepareTime: 95.495ms - ExecTreePrepareTime: 3.313ms DataStreamSender (dst_id=23):(Total: 6s252ms, non-child: 6s252ms, % non-child: 100.00%) - BytesSent: 384.22 MB (402881530) - NetworkThroughput(*): 96.88 MB/sec - OverallThroughput: 61.45 MB/sec - PeakMemoryUsage: 4.80 MB (5037120) - RowsReturned: 40.55M (40545133) - SerializeBatchTime: 2s278ms - TransmitDataRPCTime: 3s966ms - UncompressedRowBatchSize: 1.28 GB (1379049922) CodeGen:(Total: 483.626ms, non-child: 483.626ms, % non-child: 100.00%) - CodegenTime: 2.535ms - CompileTime: 148.110ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 90 (90) - NumInstructions: 2.97K (2968) - OptimizationTime: 277.811ms - PeakMemoryUsage: 1.45 MB (1519616) - PrepareTime: 56.838ms HASH_JOIN_NODE (id=11):(Total: 1s820ms, non-child: 980.142ms, % non-child: 53.84%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 808.427us - PeakMemoryUsage: 1.20 MB (1255232) - ProbeRows: 40.55M (40545133) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 931.674ms - RowsReturned: 40.55M (40545133) - RowsReturnedRate: 22.27 M/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 24.258us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 71.802us - HashBuckets: 212 (212) - HashCollisions: 0 (0) - HashTablesBuildTime: 38.099us - LargestPartitionPercent: 9 (9) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1073600) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 9.988us, non-child: 9.988us, % non-child: 100.00%) BytesReceived(500.000ms): 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 2.963us - DeserializeRowBatchTimer: 73.500us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 12.01 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=9):(Total: 840.442ms, non-child: 840.442ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:139/8.50 GB 7:131/8.26 GB 1:154/9.91 GB 4:150/9.81 GB 3:157/10.01 GB 2:153/9.72 GB 5:164/10.62 GB 6:128/8.65 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 57 out of 57 Runtime filters: Only following filters arrived: 7, waited 482ms Hdfs Read Thread Concurrency Bucket: 0:80% 1:10% 2:10% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1119 PARQUET/SNAPPY:57 BytesRead(500.000ms): 0, 0, 10.65 MB, 11.49 MB, 12.33 MB, 17.57 MB, 19.92 MB, 20.76 MB, 31.53 MB, 32.36 MB, 33.19 MB, 33.19 MB, 34.63 MB, 35.66 MB, 40.86 MB, 42.45 MB, 44.12 MB, 48.90 MB, 52.61 MB, 54.83 MB, 54.83 MB - FooterProcessingTime: (Avg: 64.059ms ; Min: 24.523ms ; Max: 287.531ms ; Number of samples: 57) - AverageHdfsReadThreadConcurrency: 0.30 - AverageScannerThreadConcurrency: 12.00 - BytesRead: 54.83 MB (57489622) - BytesReadDataNodeCache: 0 - BytesReadLocal: 54.83 MB (57489622) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 54.83 MB (57489622) - DecompressionTime: 351.439ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 57 (57) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 23.84 MB (24997270) - PerReadThreadRawHdfsThroughput: 25.57 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 212.055ms - RowBatchQueuePutWaitTime: 1m37s - RowsRead: 40.55M (40545133) - RowsReturned: 40.55M (40545133) - RowsReturnedRate: 48.24 M/sec - ScanRangesComplete: 1.18K (1176) - ScannerThreadsInvoluntaryContextSwitches: 2.00K (2005) - ScannerThreadsTotalWallClockTime: 1m55s - MaterializeTupleTime(*): 2s111ms - ScannerThreadsSysTime: 4s063ms - ScannerThreadsUserTime: 4s581ms - ScannerThreadsVoluntaryContextSwitches: 167.09K (167090) - TotalRawHdfsReadTime(*): 2s144ms - TotalReadThroughput: 5.22 MB/sec Filter 2 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 40.55M (40545133) Filter 7 (1.00 MB): - Files processed: 1.18K (1176) - Files rejected: 1.12K (1119) - Files total: 1.18K (1176) - RowGroups processed: 39.64K (39642) - RowGroups rejected: 0 (0) - RowGroups total: 39.64K (39642) - Rows processed: 933.89K (933888) - Rows rejected: 0 (0) - Rows total: 40.55M (40545133) - Splits processed: 57 (57) - Splits rejected: 0 (0) - Splits total: 57 (57) Instance 7f40dcb034de70b7:157 (host=vd1339.foo:22000):(Total: 10s514ms, non-child: 1s611ms, % non-child: 15.33%) Hdfs split stats (:<# splits>/): 7:160/10.06 GB 3:139/9.17 GB 1:135/8.72 GB 2:145/9.76 GB 4:133/7.63 GB 5:155/9.88 GB 0:167/11.45 GB 6:146/8.81 GB Filter 7 arrival: 320ms MemoryUsage(500.000ms): 3.38 MB, 3.38 MB, 23.41 MB, 24.83 MB, 25.31 MB, 25.79 MB, 26.12 MB, 26.12 MB, 27.16 MB, 27.13 MB, 27.15 MB, 26.92 MB, 26.92 MB, 27.18 MB, 27.33 MB, 27.02 MB, 26.88 MB, 26.10 MB, 26.88 MB, 25.96 MB, 14.88 MB ThreadUsage(500.000ms): 1, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.43 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 28.54 MB (29931593) - PerHostPeakMemUsage: 1.39 GB (1495790933) - RowsProduced: 44.77M (44767266) - TotalNetworkReceiveTime: 80.254ms - TotalNetworkSendTime: 2s089ms - TotalStorageWaitTime: 7s609ms - TotalThreadsInvoluntaryContextSwitches: 2.85K (2850) - TotalThreadsTotalWallClockTime: 2m6s - TotalThreadsSysTime: 3s657ms - TotalThreadsUserTime: 11s640ms - TotalThreadsVoluntaryContextSwitches: 140.42K (140421) Fragment Instance Lifecycle Timings: - ExecTime: 9s439ms - ExecTreeExecTime: 1s267ms - OpenTime: 1s019ms - ExecTreeOpenTime: 831.244ms - PrepareTime: 55.858ms - ExecTreePrepareTime: 3.463ms DataStreamSender (dst_id=23):(Total: 6s604ms, non-child: 6s604ms, % non-child: 100.00%) - BytesSent: 424.28 MB (444890291) - NetworkThroughput(*): 100.26 MB/sec - OverallThroughput: 64.24 MB/sec - PeakMemoryUsage: 4.76 MB (4987968) - RowsReturned: 44.77M (44767266) - SerializeBatchTime: 2s364ms - TransmitDataRPCTime: 4s231ms - UncompressedRowBatchSize: 1.42 GB (1522656100) CodeGen:(Total: 210.162ms, non-child: 210.162ms, % non-child: 100.00%) - CodegenTime: 1.035ms - CompileTime: 58.131ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 90 (90) - NumInstructions: 2.97K (2968) - OptimizationTime: 128.081ms - PeakMemoryUsage: 1.45 MB (1519616) - PrepareTime: 23.509ms HASH_JOIN_NODE (id=11):(Total: 2s088ms, non-child: 1s097ms, % non-child: 52.57%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.393ms - PeakMemoryUsage: 1.20 MB (1255232) - ProbeRows: 44.77M (44767266) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1s038ms - RowsReturned: 44.77M (44767266) - RowsReturnedRate: 21.43 M/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 38.264us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 141.807us - HashBuckets: 212 (212) - HashCollisions: 0 (0) - HashTablesBuildTime: 49.141us - LargestPartitionPercent: 9 (9) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1073600) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 80.264ms, non-child: 16.921us, % non-child: 0.02%) BytesReceived(500.000ms): 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 4.708us - DeserializeRowBatchTimer: 9.726us - FirstBatchArrivalWaitTime: 65.984ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 1.50 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=9):(Total: 911.108ms, non-child: 911.108ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:160/10.06 GB 3:139/9.17 GB 1:135/8.72 GB 2:145/9.76 GB 4:133/7.63 GB 5:155/9.88 GB 0:167/11.45 GB 6:146/8.81 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 63 out of 63 Runtime filters: Only following filters arrived: 7, waited 683ms Hdfs Read Thread Concurrency Bucket: 0:90.48% 1:4.762% 2:4.762% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1117 PARQUET/SNAPPY:63 BytesRead(500.000ms): 0, 0, 7.88 MB, 12.72 MB, 12.72 MB, 19.92 MB, 21.99 MB, 21.99 MB, 30.64 MB, 31.47 MB, 33.78 MB, 40.30 MB, 40.30 MB, 41.14 MB, 41.14 MB, 49.87 MB, 50.70 MB, 53.22 MB, 59.38 MB, 60.83 MB, 60.83 MB - FooterProcessingTime: (Avg: 65.900ms ; Min: 3.883ms ; Max: 304.526ms ; Number of samples: 63) - AverageHdfsReadThreadConcurrency: 0.14 - AverageScannerThreadConcurrency: 11.43 - BytesRead: 60.83 MB (63789703) - BytesReadDataNodeCache: 0 - BytesReadLocal: 60.83 MB (63789703) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 60.83 MB (63789703) - DecompressionTime: 362.178ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 63 (63) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 22.79 MB (23895586) - PerReadThreadRawHdfsThroughput: 25.10 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 64.099ms - RowBatchQueuePutWaitTime: 1m38s - RowsRead: 44.77M (44767266) - RowsReturned: 44.77M (44767266) - RowsReturnedRate: 49.13 M/sec - ScanRangesComplete: 1.18K (1180) - ScannerThreadsInvoluntaryContextSwitches: 1.99K (1994) - ScannerThreadsTotalWallClockTime: 1m55s - MaterializeTupleTime(*): 2s241ms - ScannerThreadsSysTime: 3s368ms - ScannerThreadsUserTime: 4s372ms - ScannerThreadsVoluntaryContextSwitches: 139.78K (139777) - TotalRawHdfsReadTime(*): 2s423ms - TotalReadThroughput: 5.79 MB/sec Filter 2 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 44.77M (44767266) Filter 7 (1.00 MB): - Files processed: 1.18K (1180) - Files rejected: 1.12K (1117) - Files total: 1.18K (1180) - RowGroups processed: 43.77K (43771) - RowGroups rejected: 0 (0) - RowGroups total: 43.77K (43771) - Rows processed: 1.03M (1032192) - Rows rejected: 0 (0) - Rows total: 44.77M (44767266) - Splits processed: 63 (63) - Splits rejected: 0 (0) - Splits total: 63 (63) Instance 7f40dcb034de70b7:fd (host=vc1538.foo:22000):(Total: 10s512ms, non-child: 2s564ms, % non-child: 24.39%) Hdfs split stats (:<# splits>/): 0:151/9.60 GB 2:148/9.08 GB 4:142/9.10 GB 6:151/9.66 GB 1:139/9.03 GB 5:152/9.75 GB 3:156/9.35 GB 7:148/9.90 GB Filter 7 arrival: 649ms Filter 2 arrival: 8s948ms MemoryUsage(500.000ms): 2.79 MB, 1.38 MB, 12.90 MB, 23.82 MB, 25.92 MB, 26.14 MB, 25.82 MB, 28.00 MB, 26.25 MB, 28.08 MB, 28.32 MB, 28.40 MB, 29.05 MB, 29.05 MB, 26.74 MB, 28.26 MB, 27.17 MB, 29.38 MB, 44.24 MB, 41.04 MB, 31.32 MB ThreadUsage(500.000ms): 1, 2, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 11.90 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 44.90 MB (47083343) - PerHostPeakMemUsage: 1.39 GB (1492505772) - RowsProduced: 39.86M (39862542) - TotalNetworkReceiveTime: 447.308ms - TotalNetworkSendTime: 2s569ms - TotalStorageWaitTime: 5s017ms - TotalThreadsInvoluntaryContextSwitches: 2.49K (2489) - TotalThreadsTotalWallClockTime: 2m3s - TotalThreadsSysTime: 4s789ms - TotalThreadsUserTime: 11s086ms - TotalThreadsVoluntaryContextSwitches: 197.85K (197853) Fragment Instance Lifecycle Timings: - ExecTime: 9s435ms - ExecTreeExecTime: 1s035ms - OpenTime: 1s039ms - ExecTreeOpenTime: 873.209ms - PrepareTime: 37.488ms - ExecTreePrepareTime: 2.769ms DataStreamSender (dst_id=23):(Total: 5s869ms, non-child: 5s869ms, % non-child: 100.00%) - BytesSent: 377.43 MB (395764595) - NetworkThroughput(*): 104.23 MB/sec - OverallThroughput: 64.30 MB/sec - PeakMemoryUsage: 4.80 MB (5028928) - RowsReturned: 39.86M (39862542) - SerializeBatchTime: 2s240ms - TransmitDataRPCTime: 3s621ms - UncompressedRowBatchSize: 1.26 GB (1355833100) CodeGen:(Total: 179.744ms, non-child: 179.744ms, % non-child: 100.00%) - CodegenTime: 824.408us - CompileTime: 50.071ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 90 (90) - NumInstructions: 2.97K (2968) - OptimizationTime: 115.176ms - PeakMemoryUsage: 1.45 MB (1519616) - PrepareTime: 14.113ms HASH_JOIN_NODE (id=11):(Total: 1s898ms, non-child: 887.901ms, % non-child: 46.76%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.376ms - PeakMemoryUsage: 1.27 MB (1333477) - ProbeRows: 39.86M (39862542) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 832.911ms - RowsReturned: 39.86M (39862542) - RowsReturnedRate: 20.99 M/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 28.289us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 149.923us - HashBuckets: 212 (212) - HashCollisions: 0 (0) - HashTablesBuildTime: 62.804us - LargestPartitionPercent: 9 (9) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1073600) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 447.318ms, non-child: 20.123us, % non-child: 0.00%) BytesReceived(500.000ms): 0, 0, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 4.478us - DeserializeRowBatchTimer: 34.579us - FirstBatchArrivalWaitTime: 446.255ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 268.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=9):(Total: 564.056ms, non-child: 564.056ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:151/9.60 GB 2:148/9.08 GB 4:142/9.10 GB 6:151/9.66 GB 1:139/9.03 GB 5:152/9.75 GB 3:156/9.35 GB 7:148/9.90 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 55 out of 55 Runtime filters: Only following filters arrived: 7, waited 362ms Hdfs Read Thread Concurrency Bucket: 0:80% 1:10% 2:5% 3:0% 4:5% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1132 PARQUET/SNAPPY:55 BytesRead(500.000ms): 0, 0, 1.23 MB, 11.11 MB, 13.63 MB, 13.63 MB, 18.71 MB, 21.08 MB, 22.61 MB, 31.68 MB, 31.68 MB, 32.51 MB, 39.34 MB, 39.34 MB, 40.27 MB, 42.42 MB, 42.42 MB, 48.62 MB, 50.30 MB, 53.40 MB, 53.40 MB - FooterProcessingTime: (Avg: 51.727ms ; Min: 24.305ms ; Max: 133.004ms ; Number of samples: 55) - AverageHdfsReadThreadConcurrency: 0.40 - AverageScannerThreadConcurrency: 11.40 - BytesRead: 53.40 MB (55997070) - BytesReadDataNodeCache: 0 - BytesReadLocal: 53.40 MB (55997070) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 53.40 MB (55997070) - DecompressionTime: 341.162ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 55 (55) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 23.75 MB (24904609) - PerReadThreadRawHdfsThroughput: 26.74 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 58.474ms - RowBatchQueuePutWaitTime: 1m39s - RowsRead: 39.87M (39874866) - RowsReturned: 39.86M (39862542) - RowsReturnedRate: 70.67 M/sec - ScanRangesComplete: 1.19K (1187) - ScannerThreadsInvoluntaryContextSwitches: 1.62K (1623) - ScannerThreadsTotalWallClockTime: 1m52s - MaterializeTupleTime(*): 2s021ms - ScannerThreadsSysTime: 4s552ms - ScannerThreadsUserTime: 4s285ms - ScannerThreadsVoluntaryContextSwitches: 197.20K (197199) - TotalRawHdfsReadTime(*): 1s997ms - TotalReadThroughput: 5.09 MB/sec Filter 2 (16.00 MB): - Rows processed: 177.19K (177188) - Rows rejected: 12.32K (12324) - Rows total: 39.87M (39874866) Filter 7 (1.00 MB): - Files processed: 1.19K (1187) - Files rejected: 1.13K (1132) - Files total: 1.19K (1187) - RowGroups processed: 38.96K (38963) - RowGroups rejected: 0 (0) - RowGroups total: 38.96K (38963) - Rows processed: 901.12K (901120) - Rows rejected: 0 (0) - Rows total: 39.86M (39862542) - Splits processed: 55 (55) - Splits rejected: 0 (0) - Splits total: 55 (55) Instance 7f40dcb034de70b7:146 (host=vd1329.foo:22000):(Total: 10s499ms, non-child: 2s151ms, % non-child: 20.49%) Hdfs split stats (:<# splits>/): 1:137/8.55 GB 2:138/8.66 GB 6:146/9.51 GB 4:146/9.50 GB 7:154/9.63 GB 5:166/10.48 GB 3:157/9.59 GB 0:149/9.57 GB Filter 7 arrival: 366ms Filter 2 arrival: 10s492ms MemoryUsage(500.000ms): 2.79 MB, 3.38 MB, 7.38 MB, 24.89 MB, 24.67 MB, 24.17 MB, 25.85 MB, 25.88 MB, 24.32 MB, 26.91 MB, 26.10 MB, 26.42 MB, 26.05 MB, 27.99 MB, 28.07 MB, 27.99 MB, 27.95 MB, 25.89 MB, 26.49 MB, 21.16 MB, 18.86 MB ThreadUsage(500.000ms): 1, 1, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 11.86 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 28.73 MB (30123217) - PerHostPeakMemUsage: 1.39 GB (1497643955) - RowsProduced: 40.71M (40705710) - TotalNetworkReceiveTime: 95.657ms - TotalNetworkSendTime: 2s472ms - TotalStorageWaitTime: 5s861ms - TotalThreadsInvoluntaryContextSwitches: 2.46K (2459) - TotalThreadsTotalWallClockTime: 2m6s - TotalThreadsSysTime: 3s878ms - TotalThreadsUserTime: 11s543ms - TotalThreadsVoluntaryContextSwitches: 240.57K (240571) Fragment Instance Lifecycle Timings: - ExecTime: 9s393ms - ExecTreeExecTime: 1s129ms - OpenTime: 1s040ms - ExecTreeOpenTime: 829.111ms - PrepareTime: 65.182ms - ExecTreePrepareTime: 3.741ms DataStreamSender (dst_id=23):(Total: 6s159ms, non-child: 6s159ms, % non-child: 100.00%) - BytesSent: 385.80 MB (404540993) - NetworkThroughput(*): 99.53 MB/sec - OverallThroughput: 62.63 MB/sec - PeakMemoryUsage: 4.79 MB (5020736) - RowsReturned: 40.71M (40705710) - SerializeBatchTime: 2s275ms - TransmitDataRPCTime: 3s876ms - UncompressedRowBatchSize: 1.29 GB (1384511588) CodeGen:(Total: 235.615ms, non-child: 235.615ms, % non-child: 100.00%) - CodegenTime: 1.173ms - CompileTime: 59.254ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 90 (90) - NumInstructions: 2.97K (2968) - OptimizationTime: 150.083ms - PeakMemoryUsage: 1.45 MB (1519616) - PrepareTime: 25.685ms HASH_JOIN_NODE (id=11):(Total: 1s952ms, non-child: 984.207ms, % non-child: 50.41%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.705ms - PeakMemoryUsage: 1.20 MB (1255232) - ProbeRows: 40.71M (40705710) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 938.411ms - RowsReturned: 40.71M (40705710) - RowsReturnedRate: 20.85 M/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 27.430us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 205.891us - HashBuckets: 212 (212) - HashCollisions: 0 (0) - HashTablesBuildTime: 44.065us - LargestPartitionPercent: 9 (9) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1073600) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 95.668ms, non-child: 19.443us, % non-child: 0.02%) BytesReceived(500.000ms): 0, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 4.437us - DeserializeRowBatchTimer: 16.043us - FirstBatchArrivalWaitTime: 84.590ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 1.25 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=9):(Total: 872.900ms, non-child: 872.900ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:137/8.55 GB 2:138/8.66 GB 6:146/9.51 GB 4:146/9.50 GB 7:154/9.63 GB 5:166/10.48 GB 3:157/9.59 GB 0:149/9.57 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 59 out of 59 Runtime filters: Only following filters arrived: 7, waited 642ms Hdfs Read Thread Concurrency Bucket: 0:85% 1:10% 2:0% 3:0% 4:0% 5:5% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1134 PARQUET/SNAPPY:59 BytesRead(500.000ms): 0, 0, 500.00 KB, 11.23 MB, 11.23 MB, 12.09 MB, 20.19 MB, 20.19 MB, 21.04 MB, 31.12 MB, 31.12 MB, 31.95 MB, 38.38 MB, 39.78 MB, 39.78 MB, 39.78 MB, 41.56 MB, 48.99 MB, 49.85 MB, 55.50 MB, 55.50 MB - FooterProcessingTime: (Avg: 50.774ms ; Min: 3.921ms ; Max: 116.223ms ; Number of samples: 59) - AverageHdfsReadThreadConcurrency: 0.35 - AverageScannerThreadConcurrency: 11.40 - BytesRead: 55.50 MB (58190801) - BytesReadDataNodeCache: 0 - BytesReadLocal: 55.50 MB (58190801) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 55.50 MB (58190801) - DecompressionTime: 338.900ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 59 (59) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 22.98 MB (24095054) - PerReadThreadRawHdfsThroughput: 26.07 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 86.313ms - RowBatchQueuePutWaitTime: 1m38s - RowsRead: 40.71M (40705710) - RowsReturned: 40.71M (40705710) - RowsReturnedRate: 46.63 M/sec - ScanRangesComplete: 1.19K (1193) - ScannerThreadsInvoluntaryContextSwitches: 1.65K (1650) - ScannerThreadsTotalWallClockTime: 1m55s - MaterializeTupleTime(*): 2s088ms - ScannerThreadsSysTime: 3s607ms - ScannerThreadsUserTime: 4s679ms - ScannerThreadsVoluntaryContextSwitches: 239.93K (239932) - TotalRawHdfsReadTime(*): 2s128ms - TotalReadThroughput: 5.29 MB/sec Filter 2 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 40.71M (40705710) Filter 7 (1.00 MB): - Files processed: 1.19K (1193) - Files rejected: 1.13K (1134) - Files total: 1.19K (1193) - RowGroups processed: 39.80K (39798) - RowGroups rejected: 0 (0) - RowGroups total: 39.80K (39798) - Rows processed: 966.66K (966656) - Rows rejected: 0 (0) - Rows total: 40.71M (40705710) - Splits processed: 59 (59) - Splits rejected: 0 (0) - Splits total: 59 (59) Instance 7f40dcb034de70b7:107 (host=va1044.foo:22000):(Total: 10s497ms, non-child: 2s072ms, % non-child: 19.75%) Hdfs split stats (:<# splits>/): 5:151/9.79 GB 2:142/9.60 GB 3:148/9.41 GB 1:146/9.56 GB 6:155/9.90 GB 7:151/9.42 GB 0:145/9.55 GB 4:132/8.25 GB Filter 7 arrival: 621ms Filter 2 arrival: 9s070ms MemoryUsage(500.000ms): 2.79 MB, 1.38 MB, 11.21 MB, 24.45 MB, 24.36 MB, 25.18 MB, 25.86 MB, 24.85 MB, 26.15 MB, 26.04 MB, 27.24 MB, 27.64 MB, 28.07 MB, 28.07 MB, 28.31 MB, 28.09 MB, 28.04 MB, 28.01 MB, 45.43 MB, 40.60 MB, 35.97 MB ThreadUsage(500.000ms): 1, 2, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 11.90 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 45.72 MB (47943744) - PerHostPeakMemUsage: 1.40 GB (1502606692) - RowsProduced: 41.87M (41873294) - TotalNetworkReceiveTime: 395.424ms - TotalNetworkSendTime: 2s431ms - TotalStorageWaitTime: 4s589ms - TotalThreadsInvoluntaryContextSwitches: 2.38K (2384) - TotalThreadsTotalWallClockTime: 2m3s - TotalThreadsSysTime: 3s959ms - TotalThreadsUserTime: 11s820ms - TotalThreadsVoluntaryContextSwitches: 258.14K (258141) Fragment Instance Lifecycle Timings: - ExecTime: 9s430ms - ExecTreeExecTime: 1s073ms - OpenTime: 1s012ms - ExecTreeOpenTime: 836.851ms - PrepareTime: 53.987ms - ExecTreePrepareTime: 3.234ms DataStreamSender (dst_id=23):(Total: 6s322ms, non-child: 6s322ms, % non-child: 100.00%) - BytesSent: 396.91 MB (416187114) - NetworkThroughput(*): 99.32 MB/sec - OverallThroughput: 62.78 MB/sec - PeakMemoryUsage: 4.79 MB (5020736) - RowsReturned: 41.87M (41873294) - SerializeBatchTime: 2s318ms - TransmitDataRPCTime: 3s996ms - UncompressedRowBatchSize: 1.33 GB (1424224260) CodeGen:(Total: 197.503ms, non-child: 197.503ms, % non-child: 100.00%) - CodegenTime: 1.103ms - CompileTime: 50.274ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 90 (90) - NumInstructions: 2.97K (2968) - OptimizationTime: 123.578ms - PeakMemoryUsage: 1.45 MB (1519616) - PrepareTime: 23.188ms HASH_JOIN_NODE (id=11):(Total: 1s904ms, non-child: 927.420ms, % non-child: 48.70%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.658ms - PeakMemoryUsage: 1.25 MB (1310528) - ProbeRows: 41.87M (41873294) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 872.673ms - RowsReturned: 41.87M (41873294) - RowsReturnedRate: 21.99 M/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 36.326us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 146.936us - HashBuckets: 212 (212) - HashCollisions: 0 (0) - HashTablesBuildTime: 69.097us - LargestPartitionPercent: 9 (9) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1073600) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 395.434ms, non-child: 20.248us, % non-child: 0.01%) BytesReceived(500.000ms): 0, 0, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 4.832us - DeserializeRowBatchTimer: 23.247us - FirstBatchArrivalWaitTime: 381.306ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 303.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=9):(Total: 581.779ms, non-child: 581.779ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:151/9.79 GB 2:142/9.60 GB 3:148/9.41 GB 1:146/9.56 GB 6:155/9.90 GB 7:151/9.42 GB 0:145/9.55 GB 4:132/8.25 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 60 out of 60 Runtime filters: Only following filters arrived: 7, waited 382ms Hdfs Read Thread Concurrency Bucket: 0:90% 1:5% 2:5% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1110 PARQUET/SNAPPY:60 BytesRead(500.000ms): 0, 0, 1.61 MB, 11.00 MB, 11.00 MB, 12.71 MB, 19.94 MB, 19.94 MB, 22.45 MB, 30.31 MB, 33.17 MB, 41.01 MB, 41.01 MB, 41.01 MB, 41.86 MB, 41.95 MB, 50.58 MB, 50.58 MB, 52.82 MB, 56.75 MB, 56.75 MB - FooterProcessingTime: (Avg: 44.161ms ; Min: 4.101ms ; Max: 119.432ms ; Number of samples: 60) - AverageHdfsReadThreadConcurrency: 0.15 - AverageScannerThreadConcurrency: 11.40 - BytesRead: 56.75 MB (59504358) - BytesReadDataNodeCache: 0 - BytesReadLocal: 56.75 MB (59504358) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 56.75 MB (59504358) - DecompressionTime: 348.486ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 60 (60) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 24.01 MB (25177782) - PerReadThreadRawHdfsThroughput: 28.80 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 54.346ms - RowBatchQueuePutWaitTime: 1m39s - RowsRead: 41.89M (41888952) - RowsReturned: 41.87M (41873294) - RowsReturnedRate: 71.97 M/sec - ScanRangesComplete: 1.17K (1170) - ScannerThreadsInvoluntaryContextSwitches: 1.58K (1580) - ScannerThreadsTotalWallClockTime: 1m52s - MaterializeTupleTime(*): 2s080ms - ScannerThreadsSysTime: 3s685ms - ScannerThreadsUserTime: 4s901ms - ScannerThreadsVoluntaryContextSwitches: 257.51K (257510) - TotalRawHdfsReadTime(*): 1s970ms - TotalReadThroughput: 5.40 MB/sec Filter 2 (16.00 MB): - Rows processed: 220.46K (220458) - Rows rejected: 15.66K (15658) - Rows total: 41.89M (41888952) Filter 7 (1.00 MB): - Files processed: 1.17K (1170) - Files rejected: 1.11K (1110) - Files total: 1.17K (1170) - RowGroups processed: 40.93K (40930) - RowGroups rejected: 0 (0) - RowGroups total: 40.93K (40930) - Rows processed: 983.04K (983040) - Rows rejected: 0 (0) - Rows total: 41.87M (41873294) - Splits processed: 60 (60) - Splits rejected: 0 (0) - Splits total: 60 (60) Instance 7f40dcb034de70b7:fb (host=va1031.foo:22000):(Total: 10s495ms, non-child: 2s535ms, % non-child: 24.15%) Hdfs split stats (:<# splits>/): 2:142/9.25 GB 4:149/9.53 GB 0:152/9.34 GB 6:168/10.69 GB 7:138/8.45 GB 1:155/10.19 GB 3:147/9.78 GB 5:141/8.23 GB Filter 7 arrival: 668ms Filter 2 arrival: 8s937ms MemoryUsage(500.000ms): 1.38 MB, 3.38 MB, 25.22 MB, 24.98 MB, 25.67 MB, 25.36 MB, 26.90 MB, 27.11 MB, 25.06 MB, 26.83 MB, 28.28 MB, 28.26 MB, 28.11 MB, 28.11 MB, 27.72 MB, 28.32 MB, 23.78 MB, 26.81 MB, 42.12 MB, 41.05 MB, 33.55 MB ThreadUsage(500.000ms): 2, 1, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 11.90 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 43.92 MB (46051827) - PerHostPeakMemUsage: 1.38 GB (1481537169) - RowsProduced: 38.49M (38493145) - TotalNetworkReceiveTime: 458.424ms - TotalNetworkSendTime: 2s841ms - TotalStorageWaitTime: 5s771ms - TotalThreadsInvoluntaryContextSwitches: 2.39K (2390) - TotalThreadsTotalWallClockTime: 2m3s - TotalThreadsSysTime: 3s303ms - TotalThreadsUserTime: 10s381ms - TotalThreadsVoluntaryContextSwitches: 180.02K (180022) Fragment Instance Lifecycle Timings: - ExecTime: 9s340ms - ExecTreeExecTime: 1s042ms - OpenTime: 1s112ms - ExecTreeOpenTime: 943.125ms - PrepareTime: 43.207ms - ExecTreePrepareTime: 2.729ms DataStreamSender (dst_id=23):(Total: 5s794ms, non-child: 5s794ms, % non-child: 100.00%) - BytesSent: 364.47 MB (382175927) - NetworkThroughput(*): 99.93 MB/sec - OverallThroughput: 62.90 MB/sec - PeakMemoryUsage: 4.82 MB (5053504) - RowsReturned: 38.49M (38493145) - SerializeBatchTime: 2s139ms - TransmitDataRPCTime: 3s647ms - UncompressedRowBatchSize: 1.22 GB (1309256234) CodeGen:(Total: 188.328ms, non-child: 188.328ms, % non-child: 100.00%) - CodegenTime: 874.866us - CompileTime: 50.267ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 90 (90) - NumInstructions: 2.97K (2968) - OptimizationTime: 117.591ms - PeakMemoryUsage: 1.45 MB (1519616) - PrepareTime: 20.070ms HASH_JOIN_NODE (id=11):(Total: 1s978ms, non-child: 903.768ms, % non-child: 45.68%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.535ms - PeakMemoryUsage: 1.27 MB (1326736) - ProbeRows: 38.49M (38493145) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 856.978ms - RowsReturned: 38.49M (38493145) - RowsReturnedRate: 19.46 M/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 27.614us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 193.508us - HashBuckets: 212 (212) - HashCollisions: 0 (0) - HashTablesBuildTime: 68.832us - LargestPartitionPercent: 9 (9) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1073600) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 458.433ms, non-child: 18.012us, % non-child: 0.00%) BytesReceived(500.000ms): 0, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 4.357us - DeserializeRowBatchTimer: 10.948us - FirstBatchArrivalWaitTime: 438.312ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 261.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=9):(Total: 616.578ms, non-child: 616.578ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:142/9.25 GB 4:149/9.53 GB 0:152/9.34 GB 6:168/10.69 GB 7:138/8.45 GB 1:155/10.19 GB 3:147/9.78 GB 5:141/8.23 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 53 out of 53 Runtime filters: Only following filters arrived: 7, waited 341ms Hdfs Read Thread Concurrency Bucket: 0:85.71% 1:9.524% 2:4.762% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1139 PARQUET/SNAPPY:53 BytesRead(500.000ms): 0, 0, 11.30 MB, 11.30 MB, 11.39 MB, 12.71 MB, 20.93 MB, 20.93 MB, 24.02 MB, 31.42 MB, 32.27 MB, 35.95 MB, 37.62 MB, 37.62 MB, 39.30 MB, 42.11 MB, 44.49 MB, 50.88 MB, 50.88 MB, 51.72 MB, 51.72 MB - FooterProcessingTime: (Avg: 56.075ms ; Min: 15.270ms ; Max: 108.946ms ; Number of samples: 53) - AverageHdfsReadThreadConcurrency: 0.19 - AverageScannerThreadConcurrency: 10.86 - BytesRead: 51.72 MB (54233376) - BytesReadDataNodeCache: 0 - BytesReadLocal: 51.72 MB (54233376) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 51.72 MB (54233376) - DecompressionTime: 314.823ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 53 (53) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 23.82 MB (24971987) - PerReadThreadRawHdfsThroughput: 22.58 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 137.280ms - RowBatchQueuePutWaitTime: 1m39s - RowsRead: 38.50M (38503191) - RowsReturned: 38.49M (38493145) - RowsReturnedRate: 62.43 M/sec - ScanRangesComplete: 1.19K (1192) - ScannerThreadsInvoluntaryContextSwitches: 1.63K (1631) - ScannerThreadsTotalWallClockTime: 1m52s - MaterializeTupleTime(*): 1s952ms - ScannerThreadsSysTime: 3s035ms - ScannerThreadsUserTime: 3s962ms - ScannerThreadsVoluntaryContextSwitches: 179.41K (179406) - TotalRawHdfsReadTime(*): 2s290ms - TotalReadThroughput: 4.93 MB/sec Filter 2 (16.00 MB): - Rows processed: 142.14K (142142) - Rows rejected: 10.05K (10046) - Rows total: 38.50M (38503191) Filter 7 (1.00 MB): - Files processed: 1.19K (1192) - Files rejected: 1.14K (1139) - Files total: 1.19K (1192) - RowGroups processed: 37.63K (37627) - RowGroups rejected: 0 (0) - RowGroups total: 37.63K (37627) - Rows processed: 861.95K (861950) - Rows rejected: 0 (0) - Rows total: 38.49M (38493145) - Splits processed: 53 (53) - Splits rejected: 0 (0) - Splits total: 53 (53) Instance 7f40dcb034de70b7:114 (host=vd1108.foo:22000):(Total: 10s490ms, non-child: 2s363ms, % non-child: 22.53%) Hdfs split stats (:<# splits>/): 3:149/9.58 GB 0:132/9.02 GB 2:145/9.76 GB 7:142/8.68 GB 6:159/9.57 GB 5:161/10.06 GB 1:154/9.51 GB 4:150/9.30 GB Filter 7 arrival: 566ms Filter 2 arrival: 9s192ms MemoryUsage(500.000ms): 1.38 MB, 3.38 MB, 23.91 MB, 23.74 MB, 23.97 MB, 24.42 MB, 25.86 MB, 25.93 MB, 25.80 MB, 26.04 MB, 26.12 MB, 21.44 MB, 25.04 MB, 24.52 MB, 25.14 MB, 22.61 MB, 24.91 MB, 25.05 MB, 41.46 MB, 35.22 MB, 30.72 MB ThreadUsage(500.000ms): 2, 1, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 11.90 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 41.83 MB (43865597) - PerHostPeakMemUsage: 1.39 GB (1493124303) - RowsProduced: 39.24M (39239942) - TotalNetworkReceiveTime: 342.361ms - TotalNetworkSendTime: 2s612ms - TotalStorageWaitTime: 5s836ms - TotalThreadsInvoluntaryContextSwitches: 2.34K (2343) - TotalThreadsTotalWallClockTime: 2m3s - TotalThreadsSysTime: 3s531ms - TotalThreadsUserTime: 10s730ms - TotalThreadsVoluntaryContextSwitches: 186.58K (186582) Fragment Instance Lifecycle Timings: - ExecTime: 9s311ms - ExecTreeExecTime: 1s032ms - OpenTime: 1s126ms - ExecTreeOpenTime: 951.363ms - PrepareTime: 52.809ms - ExecTreePrepareTime: 3.339ms DataStreamSender (dst_id=23):(Total: 5s954ms, non-child: 5s954ms, % non-child: 100.00%) - BytesSent: 372.01 MB (390081353) - NetworkThroughput(*): 98.82 MB/sec - OverallThroughput: 62.48 MB/sec - PeakMemoryUsage: 4.80 MB (5037120) - RowsReturned: 39.24M (39239942) - SerializeBatchTime: 2s182ms - TransmitDataRPCTime: 3s764ms - UncompressedRowBatchSize: 1.24 GB (1334656900) CodeGen:(Total: 197.070ms, non-child: 197.070ms, % non-child: 100.00%) - CodegenTime: 975.731us - CompileTime: 49.991ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 90 (90) - NumInstructions: 2.97K (2968) - OptimizationTime: 123.125ms - PeakMemoryUsage: 1.45 MB (1519616) - PrepareTime: 23.517ms HASH_JOIN_NODE (id=11):(Total: 1s976ms, non-child: 889.551ms, % non-child: 45.01%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.605ms - PeakMemoryUsage: 1.27 MB (1330613) - ProbeRows: 39.24M (39239942) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 841.098ms - RowsReturned: 39.24M (39239942) - RowsReturnedRate: 19.85 M/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 27.417us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 145.843us - HashBuckets: 212 (212) - HashCollisions: 0 (0) - HashTablesBuildTime: 55.140us - LargestPartitionPercent: 9 (9) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1073600) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 342.372ms, non-child: 19.282us, % non-child: 0.01%) BytesReceived(500.000ms): 0, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 4.965us - DeserializeRowBatchTimer: 20.127us - FirstBatchArrivalWaitTime: 331.824ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 350.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=9):(Total: 744.922ms, non-child: 744.922ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:149/9.58 GB 0:132/9.02 GB 2:145/9.76 GB 7:142/8.68 GB 6:159/9.57 GB 5:161/10.06 GB 1:154/9.51 GB 4:150/9.30 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 60 out of 60 Runtime filters: Only following filters arrived: 7, waited 442ms Hdfs Read Thread Concurrency Bucket: 0:85.71% 1:0% 2:9.524% 3:4.762% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1132 PARQUET/SNAPPY:60 BytesRead(500.000ms): 0, 0, 10.68 MB, 10.68 MB, 10.68 MB, 13.17 MB, 21.06 MB, 21.06 MB, 22.10 MB, 30.03 MB, 30.03 MB, 32.76 MB, 39.88 MB, 39.88 MB, 39.88 MB, 40.07 MB, 49.71 MB, 49.71 MB, 49.71 MB, 54.54 MB, 54.54 MB - FooterProcessingTime: (Avg: 54.836ms ; Min: 4.803ms ; Max: 173.329ms ; Number of samples: 60) - AverageHdfsReadThreadConcurrency: 0.33 - AverageScannerThreadConcurrency: 10.86 - BytesRead: 54.54 MB (57190786) - BytesReadDataNodeCache: 0 - BytesReadLocal: 54.54 MB (57190786) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 54.54 MB (57190786) - DecompressionTime: 325.789ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 60 (60) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 20.99 MB (22009210) - PerReadThreadRawHdfsThroughput: 24.94 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 164.091ms - RowBatchQueuePutWaitTime: 1m39s - RowsRead: 39.25M (39252809) - RowsReturned: 39.24M (39239942) - RowsReturnedRate: 52.68 M/sec - ScanRangesComplete: 1.19K (1192) - ScannerThreadsInvoluntaryContextSwitches: 1.54K (1542) - ScannerThreadsTotalWallClockTime: 1m53s - MaterializeTupleTime(*): 2s063ms - ScannerThreadsSysTime: 3s246ms - ScannerThreadsUserTime: 4s127ms - ScannerThreadsVoluntaryContextSwitches: 186.00K (186003) - TotalRawHdfsReadTime(*): 2s186ms - TotalReadThroughput: 5.19 MB/sec Filter 2 (16.00 MB): - Rows processed: 186.95K (186947) - Rows rejected: 12.87K (12867) - Rows total: 39.25M (39252809) Filter 7 (1.00 MB): - Files processed: 1.19K (1192) - Files rejected: 1.13K (1132) - Files total: 1.19K (1192) - RowGroups processed: 38.36K (38361) - RowGroups rejected: 0 (0) - RowGroups total: 38.36K (38361) - Rows processed: 983.04K (983040) - Rows rejected: 0 (0) - Rows total: 39.24M (39239942) - Splits processed: 60 (60) - Splits rejected: 0 (0) - Splits total: 60 (60) Instance 7f40dcb034de70b7:132 (host=va1043.foo:22000):(Total: 10s477ms, non-child: 2s582ms, % non-child: 24.65%) Hdfs split stats (:<# splits>/): 0:144/9.69 GB 1:150/9.34 GB 7:128/7.85 GB 3:135/8.94 GB 5:144/9.43 GB 2:155/10.65 GB 6:142/9.19 GB 4:158/10.37 GB Filter 7 arrival: 454ms Filter 2 arrival: 9s628ms MemoryUsage(500.000ms): 1.38 MB, 3.38 MB, 23.73 MB, 23.81 MB, 24.30 MB, 26.74 MB, 26.60 MB, 27.43 MB, 29.07 MB, 29.05 MB, 28.93 MB, 29.39 MB, 30.49 MB, 29.24 MB, 28.78 MB, 29.54 MB, 26.02 MB, 26.95 MB, 24.23 MB, 33.54 MB, 19.54 MB ThreadUsage(500.000ms): 2, 1, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 1 - AverageThreadTokens: 11.33 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 40.30 MB (42252999) - PerHostPeakMemUsage: 1.40 GB (1501145295) - RowsProduced: 39.14M (39138137) - TotalNetworkReceiveTime: 234.046ms - TotalNetworkSendTime: 2s726ms - TotalStorageWaitTime: 4s885ms - TotalThreadsInvoluntaryContextSwitches: 2.69K (2694) - TotalThreadsTotalWallClockTime: 2m3s - TotalThreadsSysTime: 3s452ms - TotalThreadsUserTime: 10s688ms - TotalThreadsVoluntaryContextSwitches: 177.87K (177866) Fragment Instance Lifecycle Timings: - ExecTime: 9s338ms - ExecTreeExecTime: 1s010ms - OpenTime: 1s088ms - ExecTreeOpenTime: 914.690ms - PrepareTime: 50.637ms - ExecTreePrepareTime: 3.287ms DataStreamSender (dst_id=23):(Total: 5s784ms, non-child: 5s784ms, % non-child: 100.00%) - BytesSent: 371.30 MB (389332200) - NetworkThroughput(*): 103.83 MB/sec - OverallThroughput: 64.19 MB/sec - PeakMemoryUsage: 4.71 MB (4938816) - RowsReturned: 39.14M (39138137) - SerializeBatchTime: 2s200ms - TransmitDataRPCTime: 3s575ms - UncompressedRowBatchSize: 1.24 GB (1331194146) CodeGen:(Total: 192.402ms, non-child: 192.402ms, % non-child: 100.00%) - CodegenTime: 1.109ms - CompileTime: 51.003ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 90 (90) - NumInstructions: 2.97K (2968) - OptimizationTime: 120.750ms - PeakMemoryUsage: 1.45 MB (1519616) - PrepareTime: 20.270ms HASH_JOIN_NODE (id=11):(Total: 1s918ms, non-child: 867.396ms, % non-child: 45.22%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.205ms - PeakMemoryUsage: 1.27 MB (1334117) - ProbeRows: 39.14M (39138137) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 823.667ms - RowsReturned: 39.14M (39138137) - RowsReturnedRate: 20.40 M/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 24.617us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 102.689us - HashBuckets: 212 (212) - HashCollisions: 0 (0) - HashTablesBuildTime: 39.114us - LargestPartitionPercent: 9 (9) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1073600) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 234.055ms, non-child: 16.074us, % non-child: 0.01%) BytesReceived(500.000ms): 0, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 4.548us - DeserializeRowBatchTimer: 14.777us - FirstBatchArrivalWaitTime: 223.180ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 512.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=9):(Total: 817.176ms, non-child: 817.176ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:144/9.69 GB 1:150/9.34 GB 7:128/7.85 GB 3:135/8.94 GB 5:144/9.43 GB 2:155/10.65 GB 6:142/9.19 GB 4:158/10.37 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 54 out of 54 Runtime filters: Only following filters arrived: 7, waited 562ms Hdfs Read Thread Concurrency Bucket: 0:90% 1:10% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1102 PARQUET/SNAPPY:54 BytesRead(500.000ms): 0, 0, 10.62 MB, 10.62 MB, 10.62 MB, 22.13 MB, 22.13 MB, 22.97 MB, 32.01 MB, 32.01 MB, 32.01 MB, 34.27 MB, 35.12 MB, 39.85 MB, 39.85 MB, 39.85 MB, 43.88 MB, 47.95 MB, 48.78 MB, 52.68 MB - FooterProcessingTime: (Avg: 56.030ms ; Min: 4.551ms ; Max: 135.147ms ; Number of samples: 54) - AverageHdfsReadThreadConcurrency: 0.10 - AverageScannerThreadConcurrency: 10.80 - BytesRead: 52.68 MB (55243626) - BytesReadDataNodeCache: 0 - BytesReadLocal: 52.68 MB (55243626) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 52.68 MB (55243626) - DecompressionTime: 339.453ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 54 (54) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 24.95 MB (26166512) - PerReadThreadRawHdfsThroughput: 26.42 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 111.735ms - RowBatchQueuePutWaitTime: 1m40s - RowsRead: 39.15M (39146885) - RowsReturned: 39.14M (39138137) - RowsReturnedRate: 47.89 M/sec - ScanRangesComplete: 1.16K (1156) - ScannerThreadsInvoluntaryContextSwitches: 1.86K (1857) - ScannerThreadsTotalWallClockTime: 1m52s - MaterializeTupleTime(*): 2s093ms - ScannerThreadsSysTime: 3s215ms - ScannerThreadsUserTime: 4s137ms - ScannerThreadsVoluntaryContextSwitches: 177.24K (177244) - TotalRawHdfsReadTime(*): 1s994ms - TotalReadThroughput: 5.27 MB/sec Filter 2 (16.00 MB): - Rows processed: 118.32K (118316) - Rows rejected: 8.75K (8748) - Rows total: 39.15M (39146885) Filter 7 (1.00 MB): - Files processed: 1.16K (1156) - Files rejected: 1.10K (1102) - Files total: 1.16K (1156) - RowGroups processed: 38.26K (38261) - RowGroups rejected: 0 (0) - RowGroups total: 38.26K (38261) - Rows processed: 884.74K (884736) - Rows rejected: 0 (0) - Rows total: 39.14M (39138137) - Splits processed: 54 (54) - Splits rejected: 0 (0) - Splits total: 54 (54) Instance 7f40dcb034de70b7:14d (host=vd1132.foo:22000):(Total: 10s472ms, non-child: 1s775ms, % non-child: 16.95%) Hdfs split stats (:<# splits>/): 0:154/10.36 GB 1:147/9.63 GB 6:134/8.02 GB 7:142/9.09 GB 3:154/9.67 GB 2:145/9.52 GB 5:146/9.47 GB 4:158/9.73 GB Filter 7 arrival: 356ms MemoryUsage(500.000ms): 2.79 MB, 3.38 MB, 7.23 MB, 24.08 MB, 23.92 MB, 22.11 MB, 24.00 MB, 23.85 MB, 25.71 MB, 26.71 MB, 26.04 MB, 24.90 MB, 27.96 MB, 28.09 MB, 28.11 MB, 26.01 MB, 25.81 MB, 24.90 MB, 24.56 MB, 25.11 MB, 22.20 MB ThreadUsage(500.000ms): 1, 1, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 11.86 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 28.66 MB (30050432) - PerHostPeakMemUsage: 1.39 GB (1493545927) - RowsProduced: 42.53M (42525326) - TotalNetworkReceiveTime: 124.610ms - TotalNetworkSendTime: 2s193ms - TotalStorageWaitTime: 7s221ms - TotalThreadsInvoluntaryContextSwitches: 2.44K (2436) - TotalThreadsTotalWallClockTime: 2m5s - TotalThreadsSysTime: 2s007ms - TotalThreadsUserTime: 11s883ms - TotalThreadsVoluntaryContextSwitches: 123.68K (123677) Fragment Instance Lifecycle Timings: - ExecTime: 9s362ms - ExecTreeExecTime: 1s123ms - OpenTime: 1s052ms - ExecTreeOpenTime: 873.120ms - PrepareTime: 58.129ms - ExecTreePrepareTime: 3.298ms DataStreamSender (dst_id=23):(Total: 6s505ms, non-child: 6s505ms, % non-child: 100.00%) - BytesSent: 403.10 MB (422681223) - NetworkThroughput(*): 98.19 MB/sec - OverallThroughput: 61.97 MB/sec - PeakMemoryUsage: 4.73 MB (4963392) - RowsReturned: 42.53M (42525326) - SerializeBatchTime: 2s391ms - TransmitDataRPCTime: 4s105ms - UncompressedRowBatchSize: 1.35 GB (1446401676) CodeGen:(Total: 201.652ms, non-child: 201.652ms, % non-child: 100.00%) - CodegenTime: 1.119ms - CompileTime: 54.411ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 90 (90) - NumInstructions: 2.97K (2968) - OptimizationTime: 123.156ms - PeakMemoryUsage: 1.45 MB (1519616) - PrepareTime: 23.634ms HASH_JOIN_NODE (id=11):(Total: 1s990ms, non-child: 968.563ms, % non-child: 48.66%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.650ms - PeakMemoryUsage: 1.20 MB (1255232) - ProbeRows: 42.53M (42525326) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 917.255ms - RowsReturned: 42.53M (42525326) - RowsReturnedRate: 21.37 M/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 28.736us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 115.605us - HashBuckets: 212 (212) - HashCollisions: 0 (0) - HashTablesBuildTime: 77.517us - LargestPartitionPercent: 9 (9) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1073600) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 124.623ms, non-child: 25.756us, % non-child: 0.02%) BytesReceived(500.000ms): 0, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 6.525us - DeserializeRowBatchTimer: 17.948us - FirstBatchArrivalWaitTime: 111.048ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 962.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=9):(Total: 898.382ms, non-child: 898.382ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:154/10.36 GB 1:147/9.63 GB 6:134/8.02 GB 7:142/9.09 GB 3:154/9.67 GB 2:145/9.52 GB 5:146/9.47 GB 4:158/9.73 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 64 out of 64 Runtime filters: Only following filters arrived: 7, waited 662ms Hdfs Read Thread Concurrency Bucket: 0:65% 1:20% 2:10% 3:0% 4:0% 5:5% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1116 PARQUET/SNAPPY:64 BytesRead(500.000ms): 0, 0, 400.00 KB, 10.55 MB, 10.55 MB, 12.18 MB, 19.71 MB, 19.71 MB, 22.87 MB, 32.58 MB, 32.58 MB, 34.90 MB, 39.84 MB, 39.84 MB, 39.84 MB, 42.36 MB, 47.67 MB, 49.07 MB, 53.71 MB, 58.50 MB, 58.50 MB - FooterProcessingTime: (Avg: 63.222ms ; Min: 19.179ms ; Max: 308.530ms ; Number of samples: 64) - AverageHdfsReadThreadConcurrency: 0.65 - AverageScannerThreadConcurrency: 11.40 - BytesRead: 58.50 MB (61341899) - BytesReadDataNodeCache: 0 - BytesReadLocal: 58.50 MB (61341899) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 58.50 MB (61341899) - DecompressionTime: 358.763ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 64 (64) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 22.89 MB (23998524) - PerReadThreadRawHdfsThroughput: 25.02 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 81.461ms - RowBatchQueuePutWaitTime: 1m38s - RowsRead: 42.53M (42525326) - RowsReturned: 42.53M (42525326) - RowsReturnedRate: 47.34 M/sec - ScanRangesComplete: 1.18K (1180) - ScannerThreadsInvoluntaryContextSwitches: 1.61K (1615) - ScannerThreadsTotalWallClockTime: 1m55s - MaterializeTupleTime(*): 2s174ms - ScannerThreadsSysTime: 1s728ms - ScannerThreadsUserTime: 4s791ms - ScannerThreadsVoluntaryContextSwitches: 123.06K (123056) - TotalRawHdfsReadTime(*): 2s337ms - TotalReadThroughput: 5.57 MB/sec Filter 2 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 42.53M (42525326) Filter 7 (1.00 MB): - Files processed: 1.18K (1180) - Files rejected: 1.12K (1116) - Files total: 1.18K (1180) - RowGroups processed: 41.58K (41581) - RowGroups rejected: 0 (0) - RowGroups total: 41.58K (41581) - Rows processed: 1.05M (1048576) - Rows rejected: 0 (0) - Rows total: 42.53M (42525326) - Splits processed: 64 (64) - Splits rejected: 0 (0) - Splits total: 64 (64) Instance 7f40dcb034de70b7:10f (host=vc1518.foo:22000):(Total: 10s456ms, non-child: 2s269ms, % non-child: 21.71%) Hdfs split stats (:<# splits>/): 0:143/9.64 GB 4:166/10.46 GB 5:148/9.39 GB 2:161/10.48 GB 7:146/9.55 GB 1:133/7.97 GB 3:143/8.94 GB 6:142/9.10 GB Filter 7 arrival: 599ms Filter 2 arrival: 9s182ms MemoryUsage(500.000ms): 1.38 MB, 3.38 MB, 24.90 MB, 24.98 MB, 25.50 MB, 18.14 MB, 29.99 MB, 29.37 MB, 30.20 MB, 30.36 MB, 29.29 MB, 28.93 MB, 29.00 MB, 29.05 MB, 29.29 MB, 26.26 MB, 26.07 MB, 21.33 MB, 39.25 MB, 38.11 MB, 26.72 MB ThreadUsage(500.000ms): 2, 1, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 11.90 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 39.85 MB (41789548) - PerHostPeakMemUsage: 1.40 GB (1501571178) - RowsProduced: 43.34M (43341272) - TotalNetworkReceiveTime: 384.205ms - TotalNetworkSendTime: 2s865ms - TotalStorageWaitTime: 5s653ms - TotalThreadsInvoluntaryContextSwitches: 2.54K (2535) - TotalThreadsTotalWallClockTime: 2m3s - TotalThreadsSysTime: 1s864ms - TotalThreadsUserTime: 9s879ms - TotalThreadsVoluntaryContextSwitches: 91.50K (91496) Fragment Instance Lifecycle Timings: - ExecTime: 9s351ms - ExecTreeExecTime: 1s104ms - OpenTime: 1s055ms - ExecTreeOpenTime: 888.148ms - PrepareTime: 49.808ms - ExecTreePrepareTime: 2.793ms DataStreamSender (dst_id=23):(Total: 6s014ms, non-child: 6s014ms, % non-child: 100.00%) - BytesSent: 411.42 MB (431401470) - NetworkThroughput(*): 105.31 MB/sec - OverallThroughput: 68.41 MB/sec - PeakMemoryUsage: 4.70 MB (4930624) - RowsReturned: 43.34M (43341272) - SerializeBatchTime: 2s100ms - TransmitDataRPCTime: 3s906ms - UncompressedRowBatchSize: 1.37 GB (1474154168) CodeGen:(Total: 187.163ms, non-child: 187.163ms, % non-child: 100.00%) - CodegenTime: 888.041us - CompileTime: 50.159ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 90 (90) - NumInstructions: 2.97K (2968) - OptimizationTime: 115.789ms - PeakMemoryUsage: 1.45 MB (1519616) - PrepareTime: 20.816ms HASH_JOIN_NODE (id=11):(Total: 1s984ms, non-child: 949.668ms, % non-child: 47.84%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.706ms - PeakMemoryUsage: 1.27 MB (1326516) - ProbeRows: 43.34M (43341272) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 903.428ms - RowsReturned: 43.34M (43341272) - RowsReturnedRate: 21.83 M/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 28.473us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 167.106us - HashBuckets: 212 (212) - HashCollisions: 0 (0) - HashTablesBuildTime: 63.481us - LargestPartitionPercent: 9 (9) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1073600) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 384.215ms, non-child: 22.034us, % non-child: 0.01%) BytesReceived(500.000ms): 0, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 4.788us - DeserializeRowBatchTimer: 16.692us - FirstBatchArrivalWaitTime: 361.212ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 312.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=9):(Total: 651.397ms, non-child: 651.397ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:143/9.64 GB 4:166/10.46 GB 5:148/9.39 GB 2:161/10.48 GB 7:146/9.55 GB 1:133/7.97 GB 3:143/8.94 GB 6:142/9.10 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 61 out of 61 Runtime filters: Only following filters arrived: 7, waited 401ms Hdfs Read Thread Concurrency Bucket: 0:90.48% 1:9.524% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1121 PARQUET/SNAPPY:61 BytesRead(500.000ms): 0, 0, 11.20 MB, 11.20 MB, 11.20 MB, 13.49 MB, 23.05 MB, 23.05 MB, 30.07 MB, 30.07 MB, 32.33 MB, 39.38 MB, 39.38 MB, 39.38 MB, 40.21 MB, 46.94 MB, 46.94 MB, 48.57 MB, 56.93 MB, 57.77 MB, 58.62 MB - FooterProcessingTime: (Avg: 54.826ms ; Min: 5.278ms ; Max: 158.813ms ; Number of samples: 61) - AverageHdfsReadThreadConcurrency: 0.10 - AverageScannerThreadConcurrency: 10.86 - BytesRead: 58.62 MB (61471725) - BytesReadDataNodeCache: 0 - BytesReadLocal: 58.62 MB (61471725) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 58.62 MB (61471725) - DecompressionTime: 301.201ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 61 (61) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 26.73 MB (28029692) - PerReadThreadRawHdfsThroughput: 24.02 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 95.793ms - RowBatchQueuePutWaitTime: 1m42s - RowsRead: 43.35M (43354469) - RowsReturned: 43.34M (43341272) - RowsReturnedRate: 66.54 M/sec - ScanRangesComplete: 1.18K (1182) - ScannerThreadsInvoluntaryContextSwitches: 1.76K (1763) - ScannerThreadsTotalWallClockTime: 1m52s - MaterializeTupleTime(*): 2s045ms - ScannerThreadsSysTime: 1s561ms - ScannerThreadsUserTime: 3s512ms - ScannerThreadsVoluntaryContextSwitches: 90.82K (90821) - TotalRawHdfsReadTime(*): 2s440ms - TotalReadThroughput: 5.58 MB/sec Filter 2 (16.00 MB): - Rows processed: 183.18K (183181) - Rows rejected: 13.20K (13197) - Rows total: 43.35M (43354469) Filter 7 (1.00 MB): - Files processed: 1.18K (1182) - Files rejected: 1.12K (1121) - Files total: 1.18K (1182) - RowGroups processed: 42.37K (42369) - RowGroups rejected: 0 (0) - RowGroups total: 42.37K (42369) - Rows processed: 999.42K (999424) - Rows rejected: 0 (0) - Rows total: 43.34M (43341272) - Splits processed: 61 (61) - Splits rejected: 0 (0) - Splits total: 61 (61) Instance 7f40dcb034de70b7:16a (host=vd1101.foo:22000):(Total: 10s454ms, non-child: 1s868ms, % non-child: 17.88%) Hdfs split stats (:<# splits>/): 1:166/10.38 GB 2:148/9.61 GB 0:173/11.34 GB 4:171/10.66 GB 6:172/11.46 GB 3:164/11.06 GB 5:179/10.99 GB Filter 7 arrival: 236ms MemoryUsage(500.000ms): 3.38 MB, 3.38 MB, 21.89 MB, 23.68 MB, 24.10 MB, 24.02 MB, 27.04 MB, 27.96 MB, 28.82 MB, 29.04 MB, 28.46 MB, 28.83 MB, 28.83 MB, 27.85 MB, 23.90 MB, 28.85 MB, 29.05 MB, 29.14 MB, 26.51 MB, 25.24 MB, 7.50 MB ThreadUsage(500.000ms): 1, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 1 - AverageThreadTokens: 11.86 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 30.20 MB (31669127) - PerHostPeakMemUsage: 1.38 GB (1483555399) - RowsProduced: 43.07M (43070110) - TotalNetworkReceiveTime: 5.029us - TotalNetworkSendTime: 2s202ms - TotalStorageWaitTime: 7s069ms - TotalThreadsInvoluntaryContextSwitches: 2.46K (2455) - TotalThreadsTotalWallClockTime: 2m7s - TotalThreadsSysTime: 3s346ms - TotalThreadsUserTime: 12s104ms - TotalThreadsVoluntaryContextSwitches: 195.73K (195729) Fragment Instance Lifecycle Timings: - ExecTime: 9s203ms - ExecTreeExecTime: 1s047ms - OpenTime: 1s192ms - ExecTreeOpenTime: 1s009ms - PrepareTime: 58.703ms - ExecTreePrepareTime: 3.595ms DataStreamSender (dst_id=23):(Total: 6s329ms, non-child: 6s329ms, % non-child: 100.00%) - BytesSent: 407.61 MB (427407562) - NetworkThroughput(*): 102.56 MB/sec - OverallThroughput: 64.40 MB/sec - PeakMemoryUsage: 4.76 MB (4987968) - RowsReturned: 43.07M (43070110) - SerializeBatchTime: 2s347ms - TransmitDataRPCTime: 3s974ms - UncompressedRowBatchSize: 1.36 GB (1464931196) CodeGen:(Total: 205.808ms, non-child: 205.808ms, % non-child: 100.00%) - CodegenTime: 1.116ms - CompileTime: 52.515ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 90 (90) - NumInstructions: 2.97K (2968) - OptimizationTime: 128.039ms - PeakMemoryUsage: 1.45 MB (1519616) - PrepareTime: 24.811ms HASH_JOIN_NODE (id=11):(Total: 2s050ms, non-child: 901.245ms, % non-child: 43.95%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.193ms - PeakMemoryUsage: 1.20 MB (1255232) - ProbeRows: 43.07M (43070110) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 851.384ms - RowsReturned: 43.07M (43070110) - RowsReturnedRate: 21.00 M/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 21.239us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 88.730us - HashBuckets: 212 (212) - HashCollisions: 0 (0) - HashTablesBuildTime: 41.302us - LargestPartitionPercent: 9 (9) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1073600) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 13.070us, non-child: 13.070us, % non-child: 100.00%) BytesReceived(500.000ms): 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 3.736us - DeserializeRowBatchTimer: 16.766us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 9.18 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=9):(Total: 1s149ms, non-child: 1s149ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:166/10.38 GB 2:148/9.61 GB 0:173/11.34 GB 4:171/10.66 GB 6:172/11.46 GB 3:164/11.06 GB 5:179/10.99 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 58 out of 58 Runtime filters: Only following filters arrived: 7, waited 764ms Hdfs Read Thread Concurrency Bucket: 0:90.48% 1:4.762% 2:0% 3:0% 4:0% 5:4.762% 6:0% 7:0% 8:0% 9:0% 10:0% File Formats: PARQUET/NONE:1115 PARQUET/SNAPPY:58 BytesRead(500.000ms): 0, 0, 9.24 MB, 10.72 MB, 11.51 MB, 15.55 MB, 21.90 MB, 24.17 MB, 31.23 MB, 31.23 MB, 31.82 MB, 41.55 MB, 41.55 MB, 42.39 MB, 42.39 MB, 50.89 MB, 51.74 MB, 51.74 MB, 57.69 MB, 57.69 MB, 57.69 MB - FooterProcessingTime: (Avg: 86.786ms ; Min: 5.082ms ; Max: 335.265ms ; Number of samples: 58) - AverageHdfsReadThreadConcurrency: 0.29 - AverageScannerThreadConcurrency: 10.86 - BytesRead: 57.69 MB (60497492) - BytesReadDataNodeCache: 0 - BytesReadLocal: 57.69 MB (60497492) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 57.69 MB (60497492) - DecompressionTime: 353.924ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 7 (7) - NumRowGroups: 58 (58) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 24.41 MB (25592355) - PerReadThreadRawHdfsThroughput: 25.71 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 242.815ms - RowBatchQueuePutWaitTime: 1m37s - RowsRead: 43.07M (43070110) - RowsReturned: 43.07M (43070110) - RowsReturnedRate: 37.47 M/sec - ScanRangesComplete: 1.17K (1173) - ScannerThreadsInvoluntaryContextSwitches: 1.65K (1654) - ScannerThreadsTotalWallClockTime: 1m56s - MaterializeTupleTime(*): 2s043ms - ScannerThreadsSysTime: 3s046ms - ScannerThreadsUserTime: 5s206ms - ScannerThreadsVoluntaryContextSwitches: 195.09K (195094) - TotalRawHdfsReadTime(*): 2s243ms - TotalReadThroughput: 5.49 MB/sec Filter 2 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 43.07M (43070110) Filter 7 (1.00 MB): - Files processed: 1.17K (1173) - Files rejected: 1.11K (1115) - Files total: 1.17K (1173) - RowGroups processed: 42.11K (42108) - RowGroups rejected: 0 (0) - RowGroups total: 42.11K (42108) - Rows processed: 950.27K (950272) - Rows rejected: 0 (0) - Rows total: 43.07M (43070110) - Splits processed: 58 (58) - Splits rejected: 0 (0) - Splits total: 58 (58) Instance 7f40dcb034de70b7:153 (host=vc1506.foo:22000):(Total: 10s433ms, non-child: 2s483ms, % non-child: 23.81%) Hdfs split stats (:<# splits>/): 1:151/9.03 GB 5:145/8.85 GB 6:156/9.90 GB 2:141/9.08 GB 0:146/9.85 GB 7:154/10.31 GB 3:130/8.14 GB 4:156/10.34 GB Filter 7 arrival: 341ms MemoryUsage(500.000ms): 1.38 MB, 3.38 MB, 22.92 MB, 25.03 MB, 26.24 MB, 23.91 MB, 25.98 MB, 27.24 MB, 24.03 MB, 24.89 MB, 25.31 MB, 25.89 MB, 25.89 MB, 26.04 MB, 28.10 MB, 27.99 MB, 29.09 MB, 27.92 MB, 30.34 MB, 21.24 MB, 13.24 MB ThreadUsage(500.000ms): 2, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.48 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 30.70 MB (32195279) - PerHostPeakMemUsage: 1.39 GB (1494248672) - RowsProduced: 39.43M (39427390) - TotalNetworkReceiveTime: 117.529ms - TotalNetworkSendTime: 2s756ms - TotalStorageWaitTime: 6s675ms - TotalThreadsInvoluntaryContextSwitches: 1.91K (1912) - TotalThreadsTotalWallClockTime: 2m5s - TotalThreadsSysTime: 2s167ms - TotalThreadsUserTime: 10s365ms - TotalThreadsVoluntaryContextSwitches: 166.10K (166101) Fragment Instance Lifecycle Timings: - ExecTime: 9s325ms - ExecTreeExecTime: 994.243ms - OpenTime: 1s058ms - ExecTreeOpenTime: 880.130ms - PrepareTime: 50.213ms - ExecTreePrepareTime: 3.274ms DataStreamSender (dst_id=23):(Total: 5s885ms, non-child: 5s885ms, % non-child: 100.00%) - BytesSent: 373.93 MB (392093136) - NetworkThroughput(*): 101.32 MB/sec - OverallThroughput: 63.53 MB/sec - PeakMemoryUsage: 4.78 MB (5012544) - RowsReturned: 39.43M (39427390) - SerializeBatchTime: 2s187ms - TransmitDataRPCTime: 3s690ms - UncompressedRowBatchSize: 1.25 GB (1341032460) CodeGen:(Total: 195.865ms, non-child: 195.865ms, % non-child: 100.00%) - CodegenTime: 855.805us - CompileTime: 54.388ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 90 (90) - NumInstructions: 2.97K (2968) - OptimizationTime: 121.854ms - PeakMemoryUsage: 1.45 MB (1519616) - PrepareTime: 19.172ms HASH_JOIN_NODE (id=11):(Total: 1s867ms, non-child: 858.754ms, % non-child: 45.97%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.580ms - PeakMemoryUsage: 1.20 MB (1255232) - ProbeRows: 39.43M (39427390) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 810.974ms - RowsReturned: 39.43M (39427390) - RowsReturnedRate: 21.11 M/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 32.545us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 139.322us - HashBuckets: 212 (212) - HashCollisions: 0 (0) - HashTablesBuildTime: 52.092us - LargestPartitionPercent: 9 (9) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1073600) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 117.538ms, non-child: 17.299us, % non-child: 0.01%) BytesReceived(500.000ms): 0, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 4.070us - DeserializeRowBatchTimer: 12.408us - FirstBatchArrivalWaitTime: 104.488ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 1.02 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=9):(Total: 892.004ms, non-child: 892.004ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:151/9.03 GB 5:145/8.85 GB 6:156/9.90 GB 2:141/9.08 GB 0:146/9.85 GB 7:154/10.31 GB 3:130/8.14 GB 4:156/10.34 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 57 out of 57 Runtime filters: Only following filters arrived: 7, waited 662ms Hdfs Read Thread Concurrency Bucket: 0:85.71% 1:4.762% 2:4.762% 3:0% 4:4.762% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1122 PARQUET/SNAPPY:57 BytesRead(500.000ms): 0, 0, 6.11 MB, 11.79 MB, 12.61 MB, 14.40 MB, 19.60 MB, 22.14 MB, 26.39 MB, 29.63 MB, 30.48 MB, 32.73 MB, 32.73 MB, 38.08 MB, 40.89 MB, 43.43 MB, 44.83 MB, 47.93 MB, 50.40 MB, 53.74 MB, 53.74 MB - FooterProcessingTime: (Avg: 56.840ms ; Min: 4.877ms ; Max: 277.475ms ; Number of samples: 57) - AverageHdfsReadThreadConcurrency: 0.33 - AverageScannerThreadConcurrency: 11.43 - BytesRead: 53.74 MB (56350941) - BytesReadDataNodeCache: 0 - BytesReadLocal: 53.74 MB (56350941) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 53.74 MB (56350941) - DecompressionTime: 318.845ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 57 (57) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 24.84 MB (26049912) - PerReadThreadRawHdfsThroughput: 24.84 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 96.509ms - RowBatchQueuePutWaitTime: 1m39s - RowsRead: 39.43M (39427390) - RowsReturned: 39.43M (39427390) - RowsReturnedRate: 44.20 M/sec - ScanRangesComplete: 1.18K (1179) - ScannerThreadsInvoluntaryContextSwitches: 1.14K (1143) - ScannerThreadsTotalWallClockTime: 1m54s - MaterializeTupleTime(*): 1s894ms - ScannerThreadsSysTime: 1s890ms - ScannerThreadsUserTime: 3s878ms - ScannerThreadsVoluntaryContextSwitches: 165.45K (165454) - TotalRawHdfsReadTime(*): 2s163ms - TotalReadThroughput: 5.12 MB/sec Filter 2 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 39.43M (39427390) Filter 7 (1.00 MB): - Files processed: 1.18K (1179) - Files rejected: 1.12K (1122) - Files total: 1.18K (1179) - RowGroups processed: 38.55K (38547) - RowGroups rejected: 0 (0) - RowGroups total: 38.55K (38547) - Rows processed: 933.89K (933888) - Rows rejected: 0 (0) - Rows total: 39.43M (39427390) - Splits processed: 57 (57) - Splits rejected: 0 (0) - Splits total: 57 (57) Instance 7f40dcb034de70b7:12b (host=va1028.foo:22000):(Total: 10s433ms, non-child: 2s876ms, % non-child: 27.57%) Hdfs split stats (:<# splits>/): 6:149/9.02 GB 4:154/10.11 GB 0:153/9.84 GB 5:150/9.56 GB 3:145/9.08 GB 2:132/9.28 GB 1:152/9.55 GB 7:145/9.04 GB Filter 7 arrival: 493ms Filter 2 arrival: 9s553ms MemoryUsage(500.000ms): 1.38 MB, 3.38 MB, 23.47 MB, 24.07 MB, 24.31 MB, 26.46 MB, 26.13 MB, 26.27 MB, 24.32 MB, 25.81 MB, 26.12 MB, 23.23 MB, 23.23 MB, 25.11 MB, 24.90 MB, 24.93 MB, 25.18 MB, 25.82 MB, 25.96 MB, 40.98 MB, 28.91 MB ThreadUsage(500.000ms): 2, 1, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 11.90 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 41.39 MB (43395848) - PerHostPeakMemUsage: 1.40 GB (1500378838) - RowsProduced: 36.04M (36036674) - TotalNetworkReceiveTime: 261.357ms - TotalNetworkSendTime: 3s158ms - TotalStorageWaitTime: 5s078ms - TotalThreadsInvoluntaryContextSwitches: 2.35K (2346) - TotalThreadsTotalWallClockTime: 2m3s - TotalThreadsSysTime: 2s746ms - TotalThreadsUserTime: 10s170ms - TotalThreadsVoluntaryContextSwitches: 155.42K (155420) Fragment Instance Lifecycle Timings: - ExecTime: 9s306ms - ExecTreeExecTime: 985.151ms - OpenTime: 1s072ms - ExecTreeOpenTime: 890.251ms - PrepareTime: 53.897ms - ExecTreePrepareTime: 3.364ms DataStreamSender (dst_id=23):(Total: 5s482ms, non-child: 5s482ms, % non-child: 100.00%) - BytesSent: 341.81 MB (358413458) - NetworkThroughput(*): 98.15 MB/sec - OverallThroughput: 62.34 MB/sec - PeakMemoryUsage: 4.74 MB (4971584) - RowsReturned: 36.04M (36036674) - SerializeBatchTime: 1s993ms - TransmitDataRPCTime: 3s482ms - UncompressedRowBatchSize: 1.14 GB (1225705036) CodeGen:(Total: 203.573ms, non-child: 203.573ms, % non-child: 100.00%) - CodegenTime: 1.096ms - CompileTime: 51.158ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 90 (90) - NumInstructions: 2.97K (2968) - OptimizationTime: 129.041ms - PeakMemoryUsage: 1.45 MB (1519616) - PrepareTime: 22.957ms HASH_JOIN_NODE (id=11):(Total: 1s869ms, non-child: 852.850ms, % non-child: 45.61%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.771ms - PeakMemoryUsage: 1.27 MB (1327605) - ProbeRows: 36.04M (36036674) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 807.397ms - RowsReturned: 36.04M (36036674) - RowsReturnedRate: 19.27 M/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 31.880us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 188.851us - HashBuckets: 212 (212) - HashCollisions: 0 (0) - HashTablesBuildTime: 78.372us - LargestPartitionPercent: 9 (9) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1073600) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 261.370ms, non-child: 26.294us, % non-child: 0.01%) BytesReceived(500.000ms): 0, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 7.601us - DeserializeRowBatchTimer: 20.224us - FirstBatchArrivalWaitTime: 243.475ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 459.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=9):(Total: 755.831ms, non-child: 755.831ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 6:149/9.02 GB 4:154/10.11 GB 0:153/9.84 GB 5:150/9.56 GB 3:145/9.08 GB 2:132/9.28 GB 1:152/9.55 GB 7:145/9.04 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 56 out of 56 Runtime filters: Only following filters arrived: 7, waited 522ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1124 PARQUET/SNAPPY:56 BytesRead(500.000ms): 0, 0, 10.61 MB, 10.61 MB, 10.61 MB, 13.40 MB, 20.93 MB, 20.93 MB, 24.32 MB, 29.86 MB, 29.86 MB, 32.37 MB, 32.37 MB, 36.33 MB, 39.68 MB, 39.68 MB, 42.17 MB, 50.01 MB, 50.01 MB, 50.01 MB, 50.01 MB - FooterProcessingTime: (Avg: 54.192ms ; Min: 3.667ms ; Max: 166.666ms ; Number of samples: 56) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 10.86 - BytesRead: 50.01 MB (52436479) - BytesReadDataNodeCache: 0 - BytesReadLocal: 50.01 MB (52436479) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 50.01 MB (52436479) - DecompressionTime: 300.978ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 56 (56) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 20.99 MB (22009641) - PerReadThreadRawHdfsThroughput: 23.90 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 102.730ms - RowBatchQueuePutWaitTime: 1m40s - RowsRead: 36.04M (36044241) - RowsReturned: 36.04M (36036674) - RowsReturnedRate: 47.68 M/sec - ScanRangesComplete: 1.18K (1180) - ScannerThreadsInvoluntaryContextSwitches: 1.62K (1618) - ScannerThreadsTotalWallClockTime: 1m53s - MaterializeTupleTime(*): 1s916ms - ScannerThreadsSysTime: 2s467ms - ScannerThreadsUserTime: 4s105ms - ScannerThreadsVoluntaryContextSwitches: 154.80K (154802) - TotalRawHdfsReadTime(*): 2s092ms - TotalReadThroughput: 4.76 MB/sec Filter 2 (16.00 MB): - Rows processed: 102.80K (102799) - Rows rejected: 7.57K (7567) - Rows total: 36.04M (36044241) Filter 7 (1.00 MB): - Files processed: 1.18K (1180) - Files rejected: 1.12K (1124) - Files total: 1.18K (1180) - RowGroups processed: 35.23K (35230) - RowGroups rejected: 0 (0) - RowGroups total: 35.23K (35230) - Rows processed: 917.50K (917504) - Rows rejected: 0 (0) - Rows total: 36.04M (36036674) - Splits processed: 56 (56) - Splits rejected: 0 (0) - Splits total: 56 (56) Instance 7f40dcb034de70b7:16d (host=vd1109.foo:22000):(Total: 10s431ms, non-child: 1s987ms, % non-child: 19.05%) Hdfs split stats (:<# splits>/): 6:138/9.44 GB 1:145/9.36 GB 4:149/9.44 GB 5:134/9.06 GB 7:160/9.88 GB 2:144/8.85 GB 3:149/9.43 GB 0:150/10.04 GB Filter 7 arrival: 233ms MemoryUsage(500.000ms): 0, 3.38 MB, 3.38 MB, 23.95 MB, 23.65 MB, 24.51 MB, 25.99 MB, 25.90 MB, 24.39 MB, 24.42 MB, 24.41 MB, 25.41 MB, 24.99 MB, 20.81 MB, 26.93 MB, 26.80 MB, 30.08 MB, 31.12 MB, 31.52 MB, 19.66 MB, 20.95 MB ThreadUsage(500.000ms): 1, 1, 1, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 11.29 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 31.78 MB (33322243) - PerHostPeakMemUsage: 1.37 GB (1476137467) - RowsProduced: 40.64M (40636394) - TotalNetworkReceiveTime: 11.800ms - TotalNetworkSendTime: 2s301ms - TotalStorageWaitTime: 7s189ms - TotalThreadsInvoluntaryContextSwitches: 2.48K (2485) - TotalThreadsTotalWallClockTime: 2m2s - TotalThreadsSysTime: 3s169ms - TotalThreadsUserTime: 11s440ms - TotalThreadsVoluntaryContextSwitches: 309.92K (309920) Fragment Instance Lifecycle Timings: - ExecTime: 9s185ms - ExecTreeExecTime: 1s022ms - OpenTime: 1s196ms - ExecTreeOpenTime: 1s020ms - PrepareTime: 50.014ms - ExecTreePrepareTime: 3.253ms DataStreamSender (dst_id=23):(Total: 6s215ms, non-child: 6s215ms, % non-child: 100.00%) - BytesSent: 385.20 MB (403911338) - NetworkThroughput(*): 98.48 MB/sec - OverallThroughput: 61.98 MB/sec - PeakMemoryUsage: 4.84 MB (5078080) - RowsReturned: 40.64M (40636394) - SerializeBatchTime: 2s296ms - TransmitDataRPCTime: 3s911ms - UncompressedRowBatchSize: 1.29 GB (1382153940) CodeGen:(Total: 193.291ms, non-child: 193.291ms, % non-child: 100.00%) - CodegenTime: 1.027ms - CompileTime: 51.469ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 90 (90) - NumInstructions: 2.97K (2968) - OptimizationTime: 121.410ms - PeakMemoryUsage: 1.45 MB (1519616) - PrepareTime: 19.996ms HASH_JOIN_NODE (id=11):(Total: 2s036ms, non-child: 879.520ms, % non-child: 43.19%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.363ms - PeakMemoryUsage: 1.20 MB (1255232) - ProbeRows: 40.64M (40636394) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 829.973ms - RowsReturned: 40.64M (40636394) - RowsReturnedRate: 19.96 M/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 19.287us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 143.284us - HashBuckets: 212 (212) - HashCollisions: 0 (0) - HashTablesBuildTime: 38.014us - LargestPartitionPercent: 9 (9) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1073600) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 11.810ms, non-child: 16.230us, % non-child: 0.14%) BytesReceived(500.000ms): 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 4.430us - DeserializeRowBatchTimer: 21.760us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 10.16 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=9):(Total: 1s145ms, non-child: 1s145ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 6:138/9.44 GB 1:145/9.36 GB 4:149/9.44 GB 5:134/9.06 GB 7:160/9.88 GB 2:144/8.85 GB 3:149/9.43 GB 0:150/10.04 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 57 out of 57 Runtime filters: Only following filters arrived: 7, waited 783ms Hdfs Read Thread Concurrency Bucket: 0:95% 1:0% 2:5% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1112 PARQUET/SNAPPY:57 BytesRead(500.000ms): 0, 0, 10.59 MB, 10.59 MB, 10.59 MB, 20.96 MB, 20.96 MB, 21.81 MB, 29.06 MB, 29.06 MB, 30.74 MB, 33.00 MB, 33.09 MB, 41.42 MB, 43.37 MB, 46.23 MB, 50.93 MB, 50.93 MB, 52.56 MB, 54.90 MB - FooterProcessingTime: (Avg: 86.762ms ; Min: 5.383ms ; Max: 302.609ms ; Number of samples: 57) - AverageHdfsReadThreadConcurrency: 0.10 - AverageScannerThreadConcurrency: 10.80 - BytesRead: 54.90 MB (57562409) - BytesReadDataNodeCache: 0 - BytesReadLocal: 54.90 MB (57562409) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 54.90 MB (57562409) - DecompressionTime: 336.892ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 57 (57) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 25.96 MB (27224852) - PerReadThreadRawHdfsThroughput: 23.39 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 218.858ms - RowBatchQueuePutWaitTime: 1m37s - RowsRead: 40.64M (40636394) - RowsReturned: 40.64M (40636394) - RowsReturnedRate: 35.49 M/sec - ScanRangesComplete: 1.17K (1169) - ScannerThreadsInvoluntaryContextSwitches: 1.68K (1677) - ScannerThreadsTotalWallClockTime: 1m51s - MaterializeTupleTime(*): 2s040ms - ScannerThreadsSysTime: 2s878ms - ScannerThreadsUserTime: 4s656ms - ScannerThreadsVoluntaryContextSwitches: 309.27K (309266) - TotalRawHdfsReadTime(*): 2s346ms - TotalReadThroughput: 5.49 MB/sec Filter 2 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 40.64M (40636394) Filter 7 (1.00 MB): - Files processed: 1.17K (1169) - Files rejected: 1.11K (1112) - Files total: 1.17K (1169) - RowGroups processed: 39.73K (39730) - RowGroups rejected: 0 (0) - RowGroups total: 39.73K (39730) - Rows processed: 933.89K (933888) - Rows rejected: 0 (0) - Rows total: 40.64M (40636394) - Splits processed: 57 (57) - Splits rejected: 0 (0) - Splits total: 57 (57) Instance 7f40dcb034de70b7:126 (host=ve1136.foo:22000):(Total: 10s428ms, non-child: 1s936ms, % non-child: 18.57%) Hdfs split stats (:<# splits>/): 3:151/9.72 GB 6:159/9.80 GB 0:158/11.08 GB 1:133/9.49 GB 2:124/7.73 GB 5:149/9.12 GB 4:154/9.81 GB 7:142/8.82 GB Filter 7 arrival: 504ms Filter 2 arrival: 9s433ms MemoryUsage(500.000ms): 1.38 MB, 3.38 MB, 24.04 MB, 23.87 MB, 24.28 MB, 20.11 MB, 26.93 MB, 27.09 MB, 21.61 MB, 27.36 MB, 26.10 MB, 26.99 MB, 26.76 MB, 27.14 MB, 26.19 MB, 27.84 MB, 28.12 MB, 27.29 MB, 24.81 MB, 37.59 MB, 19.55 MB ThreadUsage(500.000ms): 2, 1, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 1 - AverageThreadTokens: 11.33 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 41.42 MB (43429591) - PerHostPeakMemUsage: 1.41 GB (1508764293) - RowsProduced: 43.13M (43131155) - TotalNetworkReceiveTime: 279.808ms - TotalNetworkSendTime: 2s455ms - TotalStorageWaitTime: 5s588ms - TotalThreadsInvoluntaryContextSwitches: 3.09K (3088) - TotalThreadsTotalWallClockTime: 2m3s - TotalThreadsSysTime: 3s680ms - TotalThreadsUserTime: 11s834ms - TotalThreadsVoluntaryContextSwitches: 203.35K (203352) Fragment Instance Lifecycle Timings: - ExecTime: 9s315ms - ExecTreeExecTime: 1s111ms - OpenTime: 1s061ms - ExecTreeOpenTime: 884.378ms - PrepareTime: 50.876ms - ExecTreePrepareTime: 3.217ms DataStreamSender (dst_id=23):(Total: 6s307ms, non-child: 6s307ms, % non-child: 100.00%) - BytesSent: 408.35 MB (428180840) - NetworkThroughput(*): 100.79 MB/sec - OverallThroughput: 64.74 MB/sec - PeakMemoryUsage: 4.75 MB (4979776) - RowsReturned: 43.13M (43131155) - SerializeBatchTime: 2s248ms - TransmitDataRPCTime: 4s051ms - UncompressedRowBatchSize: 1.37 GB (1467007486) CodeGen:(Total: 196.151ms, non-child: 196.151ms, % non-child: 100.00%) - CodegenTime: 1.016ms - CompileTime: 50.983ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 90 (90) - NumInstructions: 2.97K (2968) - OptimizationTime: 124.474ms - PeakMemoryUsage: 1.45 MB (1519616) - PrepareTime: 20.293ms HASH_JOIN_NODE (id=11):(Total: 1s987ms, non-child: 970.564ms, % non-child: 48.82%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.487ms - PeakMemoryUsage: 1.20 MB (1255232) - ProbeRows: 43.13M (43131155) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 923.060ms - RowsReturned: 43.13M (43131155) - RowsReturnedRate: 21.70 M/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 26.915us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 162.208us - HashBuckets: 212 (212) - HashCollisions: 0 (0) - HashTablesBuildTime: 57.589us - LargestPartitionPercent: 9 (9) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1073600) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 279.817ms, non-child: 18.903us, % non-child: 0.01%) BytesReceived(500.000ms): 0, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 4.520us - DeserializeRowBatchTimer: 19.525us - FirstBatchArrivalWaitTime: 265.320ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 428.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=9):(Total: 737.890ms, non-child: 737.890ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:151/9.72 GB 6:159/9.80 GB 0:158/11.08 GB 1:133/9.49 GB 2:124/7.73 GB 5:149/9.12 GB 4:154/9.81 GB 7:142/8.82 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 61 out of 61 Runtime filters: Only following filters arrived: 7, waited 502ms Hdfs Read Thread Concurrency Bucket: 0:80% 1:20% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1109 PARQUET/SNAPPY:61 BytesRead(500.000ms): 0, 0, 10.60 MB, 10.60 MB, 10.60 MB, 13.51 MB, 21.38 MB, 22.24 MB, 25.94 MB, 30.16 MB, 31.93 MB, 41.14 MB, 41.14 MB, 41.14 MB, 42.08 MB, 48.43 MB, 48.43 MB, 53.85 MB, 58.62 MB, 58.62 MB - FooterProcessingTime: (Avg: 56.762ms ; Min: 4.371ms ; Max: 175.173ms ; Number of samples: 61) - AverageHdfsReadThreadConcurrency: 0.20 - AverageScannerThreadConcurrency: 10.80 - BytesRead: 58.62 MB (61468453) - BytesReadDataNodeCache: 0 - BytesReadLocal: 58.62 MB (61468453) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 58.62 MB (61468453) - DecompressionTime: 366.000ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 61 (61) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 22.82 MB (23926127) - PerReadThreadRawHdfsThroughput: 24.99 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 98.663ms - RowBatchQueuePutWaitTime: 1m38s - RowsRead: 43.14M (43137053) - RowsReturned: 43.13M (43131155) - RowsReturnedRate: 58.45 M/sec - ScanRangesComplete: 1.17K (1170) - ScannerThreadsInvoluntaryContextSwitches: 2.29K (2294) - ScannerThreadsTotalWallClockTime: 1m53s - MaterializeTupleTime(*): 2s173ms - ScannerThreadsSysTime: 3s387ms - ScannerThreadsUserTime: 5s090ms - ScannerThreadsVoluntaryContextSwitches: 202.69K (202695) - TotalRawHdfsReadTime(*): 2s345ms - TotalReadThroughput: 5.86 MB/sec Filter 2 (16.00 MB): - Rows processed: 85.77K (85770) - Rows rejected: 5.90K (5898) - Rows total: 43.14M (43137053) Filter 7 (1.00 MB): - Files processed: 1.17K (1170) - Files rejected: 1.11K (1109) - Files total: 1.17K (1170) - RowGroups processed: 42.16K (42164) - RowGroups rejected: 0 (0) - RowGroups total: 42.16K (42164) - Rows processed: 999.42K (999424) - Rows rejected: 0 (0) - Rows total: 43.13M (43131155) - Splits processed: 61 (61) - Splits rejected: 0 (0) - Splits total: 61 (61) Instance 7f40dcb034de70b7:12d (host=vd1142.foo:22000):(Total: 10s374ms, non-child: 2s136ms, % non-child: 20.59%) Hdfs split stats (:<# splits>/): 1:151/9.84 GB 6:134/8.40 GB 3:145/9.00 GB 5:151/10.38 GB 7:138/8.66 GB 4:141/9.08 GB 2:142/9.58 GB 0:161/10.58 GB Filter 7 arrival: 480ms Filter 2 arrival: 9s530ms MemoryUsage(500.000ms): 1.38 MB, 3.38 MB, 23.77 MB, 23.73 MB, 23.32 MB, 27.81 MB, 27.90 MB, 28.48 MB, 31.17 MB, 29.27 MB, 28.28 MB, 28.22 MB, 28.22 MB, 28.28 MB, 25.32 MB, 26.97 MB, 27.55 MB, 23.54 MB, 26.97 MB, 39.64 MB ThreadUsage(500.000ms): 2, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.45 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 43.55 MB (45661837) - PerHostPeakMemUsage: 1.39 GB (1494798023) - RowsProduced: 42.76M (42763494) - TotalNetworkReceiveTime: 266.148ms - TotalNetworkSendTime: 2s483ms - TotalStorageWaitTime: 5s453ms - TotalThreadsInvoluntaryContextSwitches: 2.59K (2593) - TotalThreadsTotalWallClockTime: 2m3s - TotalThreadsSysTime: 2s468ms - TotalThreadsUserTime: 11s509ms - TotalThreadsVoluntaryContextSwitches: 117.52K (117523) Fragment Instance Lifecycle Timings: - ExecTime: 9s269ms - ExecTreeExecTime: 1s081ms - OpenTime: 1s059ms - ExecTreeOpenTime: 887.435ms - PrepareTime: 45.129ms - ExecTreePrepareTime: 2.856ms DataStreamSender (dst_id=23):(Total: 6s088ms, non-child: 6s088ms, % non-child: 100.00%) - BytesSent: 405.66 MB (425368886) - NetworkThroughput(*): 106.24 MB/sec - OverallThroughput: 66.62 MB/sec - PeakMemoryUsage: 4.78 MB (5012544) - RowsReturned: 42.76M (42763494) - SerializeBatchTime: 2s263ms - TransmitDataRPCTime: 3s818ms - UncompressedRowBatchSize: 1.35 GB (1454502396) CodeGen:(Total: 189.043ms, non-child: 189.043ms, % non-child: 100.00%) - CodegenTime: 902.840us - CompileTime: 51.261ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 90 (90) - NumInstructions: 2.97K (2968) - OptimizationTime: 119.282ms - PeakMemoryUsage: 1.45 MB (1519616) - PrepareTime: 18.145ms HASH_JOIN_NODE (id=11):(Total: 1s960ms, non-child: 931.969ms, % non-child: 47.53%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.604ms - PeakMemoryUsage: 1.26 MB (1326141) - ProbeRows: 42.76M (42763494) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 883.436ms - RowsReturned: 42.76M (42763494) - RowsReturnedRate: 21.81 M/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 25.442us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 186.973us - HashBuckets: 212 (212) - HashCollisions: 0 (0) - HashTablesBuildTime: 53.000us - LargestPartitionPercent: 9 (9) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1073600) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 266.158ms, non-child: 19.700us, % non-child: 0.01%) BytesReceived(500.000ms): 0, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 4.641us - DeserializeRowBatchTimer: 18.306us - FirstBatchArrivalWaitTime: 250.668ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 450.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=9):(Total: 762.925ms, non-child: 762.925ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:151/9.84 GB 6:134/8.40 GB 3:145/9.00 GB 5:151/10.38 GB 7:138/8.66 GB 4:141/9.08 GB 2:142/9.58 GB 0:161/10.58 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 57 out of 57 Runtime filters: Only following filters arrived: 7, waited 522ms Hdfs Read Thread Concurrency Bucket: 0:90% 1:10% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1106 PARQUET/SNAPPY:57 BytesRead(500.000ms): 0, 0, 10.64 MB, 10.64 MB, 10.64 MB, 22.27 MB, 22.27 MB, 22.27 MB, 31.32 MB, 31.32 MB, 39.16 MB, 39.16 MB, 39.16 MB, 39.16 MB, 40.00 MB, 50.63 MB, 51.45 MB, 54.91 MB, 57.07 MB, 57.07 MB - FooterProcessingTime: (Avg: 60.510ms ; Min: 25.858ms ; Max: 168.626ms ; Number of samples: 57) - AverageHdfsReadThreadConcurrency: 0.10 - AverageScannerThreadConcurrency: 11.40 - BytesRead: 57.07 MB (59841207) - BytesReadDataNodeCache: 0 - BytesReadLocal: 57.07 MB (59841207) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 57.07 MB (59841207) - DecompressionTime: 347.835ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 57 (57) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 25.89 MB (27145576) - PerReadThreadRawHdfsThroughput: 25.98 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 95.494ms - RowBatchQueuePutWaitTime: 1m39s - RowsRead: 42.77M (42768498) - RowsReturned: 42.76M (42763494) - RowsReturnedRate: 56.05 M/sec - ScanRangesComplete: 1.16K (1163) - ScannerThreadsInvoluntaryContextSwitches: 1.81K (1808) - ScannerThreadsTotalWallClockTime: 1m52s - MaterializeTupleTime(*): 2s091ms - ScannerThreadsSysTime: 2s200ms - ScannerThreadsUserTime: 4s802ms - ScannerThreadsVoluntaryContextSwitches: 116.89K (116892) - TotalRawHdfsReadTime(*): 2s196ms - TotalReadThroughput: 5.71 MB/sec Filter 2 (16.00 MB): - Rows processed: 74.64K (74636) - Rows rejected: 5.00K (5004) - Rows total: 42.77M (42768498) Filter 7 (1.00 MB): - Files processed: 1.16K (1163) - Files rejected: 1.11K (1106) - Files total: 1.16K (1163) - RowGroups processed: 41.80K (41802) - RowGroups rejected: 0 (0) - RowGroups total: 41.80K (41802) - Rows processed: 933.89K (933888) - Rows rejected: 0 (0) - Rows total: 42.76M (42763494) - Splits processed: 57 (57) - Splits rejected: 0 (0) - Splits total: 57 (57) Instance 7f40dcb034de70b7:172 (host=vd1133.foo:22000):(Total: 10s353ms, non-child: 1s854ms, % non-child: 17.91%) Hdfs split stats (:<# splits>/): 4:138/8.16 GB 7:152/9.21 GB 0:163/10.42 GB 1:140/8.98 GB 6:141/8.93 GB 3:157/9.77 GB 5:153/9.09 GB 2:165/10.96 GB Filter 7 arrival: 251ms MemoryUsage(500.000ms): 2.79 MB, 3.38 MB, 4.52 MB, 22.75 MB, 23.07 MB, 25.29 MB, 25.77 MB, 25.90 MB, 23.94 MB, 27.19 MB, 25.15 MB, 25.13 MB, 25.13 MB, 24.88 MB, 24.18 MB, 24.76 MB, 26.00 MB, 26.10 MB, 23.28 MB, 23.59 MB, 15.38 MB ThreadUsage(500.000ms): 1, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.43 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 27.57 MB (28905543) - PerHostPeakMemUsage: 1.38 GB (1484147607) - RowsProduced: 41.25M (41249657) - TotalNetworkReceiveTime: 3.656us - TotalNetworkSendTime: 1s840ms - TotalStorageWaitTime: 6s890ms - TotalThreadsInvoluntaryContextSwitches: 2.17K (2173) - TotalThreadsTotalWallClockTime: 2m5s - TotalThreadsSysTime: 1s867ms - TotalThreadsUserTime: 11s641ms - TotalThreadsVoluntaryContextSwitches: 128.45K (128451) Fragment Instance Lifecycle Timings: - ExecTime: 9s112ms - ExecTreeExecTime: 1s110ms - OpenTime: 1s178ms - ExecTreeOpenTime: 984.464ms - PrepareTime: 62.218ms - ExecTreePrepareTime: 3.994ms DataStreamSender (dst_id=23):(Total: 6s199ms, non-child: 6s199ms, % non-child: 100.00%) - BytesSent: 391.17 MB (410168755) - NetworkThroughput(*): 102.37 MB/sec - OverallThroughput: 63.10 MB/sec - PeakMemoryUsage: 4.84 MB (5078080) - RowsReturned: 41.25M (41249657) - SerializeBatchTime: 2s369ms - TransmitDataRPCTime: 3s821ms - UncompressedRowBatchSize: 1.31 GB (1403012666) CodeGen:(Total: 211.594ms, non-child: 211.594ms, % non-child: 100.00%) - CodegenTime: 1.223ms - CompileTime: 55.922ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 90 (90) - NumInstructions: 2.97K (2968) - OptimizationTime: 136.053ms - PeakMemoryUsage: 1.45 MB (1519616) - PrepareTime: 19.173ms HASH_JOIN_NODE (id=11):(Total: 2s088ms, non-child: 950.152ms, % non-child: 45.50%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.171ms - PeakMemoryUsage: 1.20 MB (1255232) - ProbeRows: 41.25M (41249657) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 896.214ms - RowsReturned: 41.25M (41249657) - RowsReturnedRate: 19.75 M/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 29.103us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 92.018us - HashBuckets: 212 (212) - HashCollisions: 0 (0) - HashTablesBuildTime: 39.823us - LargestPartitionPercent: 9 (9) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1073600) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 12.920us, non-child: 12.920us, % non-child: 100.00%) BytesReceived(500.000ms): 0, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 5.106us - DeserializeRowBatchTimer: 19.926us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 9.29 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=9):(Total: 1s138ms, non-child: 1s138ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:138/8.16 GB 7:152/9.21 GB 0:163/10.42 GB 1:140/8.98 GB 6:141/8.93 GB 3:157/9.77 GB 5:153/9.09 GB 2:165/10.96 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 64 out of 64 Runtime filters: Only following filters arrived: 7, waited 762ms Hdfs Read Thread Concurrency Bucket: 0:95% 1:5% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1145 PARQUET/SNAPPY:64 BytesRead(500.000ms): 0, 0, 0, 9.85 MB, 9.85 MB, 12.68 MB, 21.40 MB, 21.40 MB, 22.24 MB, 29.48 MB, 31.98 MB, 39.29 MB, 39.29 MB, 39.29 MB, 40.97 MB, 48.23 MB, 49.87 MB, 51.58 MB, 52.42 MB, 57.33 MB, 57.33 MB - FooterProcessingTime: (Avg: 73.023ms ; Min: 13.406ms ; Max: 271.599ms ; Number of samples: 64) - AverageHdfsReadThreadConcurrency: 0.05 - AverageScannerThreadConcurrency: 12.00 - BytesRead: 57.33 MB (60118974) - BytesReadDataNodeCache: 0 - BytesReadLocal: 57.33 MB (60118974) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 57.33 MB (60118974) - DecompressionTime: 349.592ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 64 (64) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 21.73 MB (22787170) - PerReadThreadRawHdfsThroughput: 27.17 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 218.241ms - RowBatchQueuePutWaitTime: 1m38s - RowsRead: 41.25M (41249657) - RowsReturned: 41.25M (41249657) - RowsReturnedRate: 36.24 M/sec - ScanRangesComplete: 1.21K (1209) - ScannerThreadsInvoluntaryContextSwitches: 1.19K (1188) - ScannerThreadsTotalWallClockTime: 1m55s - MaterializeTupleTime(*): 2s227ms - ScannerThreadsSysTime: 1s567ms - ScannerThreadsUserTime: 4s471ms - ScannerThreadsVoluntaryContextSwitches: 127.87K (127870) - TotalRawHdfsReadTime(*): 2s110ms - TotalReadThroughput: 5.46 MB/sec Filter 2 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 41.25M (41249657) Filter 7 (1.00 MB): - Files processed: 1.21K (1209) - Files rejected: 1.15K (1145) - Files total: 1.21K (1209) - RowGroups processed: 40.34K (40335) - RowGroups rejected: 0 (0) - RowGroups total: 40.34K (40335) - Rows processed: 1.05M (1048576) - Rows rejected: 0 (0) - Rows total: 41.25M (41249657) - Splits processed: 64 (64) - Splits rejected: 0 (0) - Splits total: 64 (64) Instance 7f40dcb034de70b7:131 (host=va1039.foo:22000):(Total: 10s319ms, non-child: 3s025ms, % non-child: 29.32%) Hdfs split stats (:<# splits>/): 0:141/9.41 GB 3:152/9.55 GB 5:135/9.23 GB 7:137/8.89 GB 1:148/9.75 GB 2:151/9.19 GB 4:145/9.42 GB 6:155/10.02 GB Filter 7 arrival: 461ms Filter 2 arrival: 9s620ms MemoryUsage(500.000ms): 1.38 MB, 3.38 MB, 26.49 MB, 25.76 MB, 26.23 MB, 25.40 MB, 26.07 MB, 25.82 MB, 23.10 MB, 24.03 MB, 23.66 MB, 25.11 MB, 25.30 MB, 25.75 MB, 25.65 MB, 26.26 MB, 25.43 MB, 22.10 MB, 24.45 MB, 37.84 MB ThreadUsage(500.000ms): 2, 1, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 11.85 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 39.96 MB (41898660) - PerHostPeakMemUsage: 1.39 GB (1496319297) - RowsProduced: 35.20M (35204285) - TotalNetworkReceiveTime: 235.216ms - TotalNetworkSendTime: 3s244ms - TotalStorageWaitTime: 5s302ms - TotalThreadsInvoluntaryContextSwitches: 2.10K (2103) - TotalThreadsTotalWallClockTime: 2m2s - TotalThreadsSysTime: 3s280ms - TotalThreadsUserTime: 10s343ms - TotalThreadsVoluntaryContextSwitches: 178.27K (178268) Fragment Instance Lifecycle Timings: - ExecTime: 9s191ms - ExecTreeExecTime: 879.493ms - OpenTime: 1s073ms - ExecTreeOpenTime: 896.972ms - PrepareTime: 53.879ms - ExecTreePrepareTime: 3.129ms DataStreamSender (dst_id=23):(Total: 5s323ms, non-child: 5s323ms, % non-child: 100.00%) - BytesSent: 333.89 MB (350107775) - NetworkThroughput(*): 99.47 MB/sec - OverallThroughput: 62.72 MB/sec - PeakMemoryUsage: 4.84 MB (5069888) - RowsReturned: 35.20M (35204285) - SerializeBatchTime: 1s960ms - TransmitDataRPCTime: 3s356ms - UncompressedRowBatchSize: 1.12 GB (1197393266) CodeGen:(Total: 198.490ms, non-child: 198.490ms, % non-child: 100.00%) - CodegenTime: 982.854us - CompileTime: 50.512ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 90 (90) - NumInstructions: 2.97K (2968) - OptimizationTime: 124.033ms - PeakMemoryUsage: 1.45 MB (1519616) - PrepareTime: 23.562ms HASH_JOIN_NODE (id=11):(Total: 1s771ms, non-child: 755.925ms, % non-child: 42.67%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.474ms - PeakMemoryUsage: 1.26 MB (1325830) - ProbeRows: 35.20M (35204285) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 714.885ms - RowsReturned: 35.20M (35204285) - RowsReturnedRate: 19.87 M/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 25.001us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 152.814us - HashBuckets: 212 (212) - HashCollisions: 0 (0) - HashTablesBuildTime: 50.562us - LargestPartitionPercent: 9 (9) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1073600) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 235.226ms, non-child: 17.450us, % non-child: 0.01%) BytesReceived(500.000ms): 0, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 4.468us - DeserializeRowBatchTimer: 17.069us - FirstBatchArrivalWaitTime: 226.996ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 510.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=9):(Total: 780.588ms, non-child: 780.588ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:141/9.41 GB 3:152/9.55 GB 5:135/9.23 GB 7:137/8.89 GB 1:148/9.75 GB 2:151/9.19 GB 4:145/9.42 GB 6:155/10.02 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 52 out of 52 Runtime filters: Only following filters arrived: 7, waited 543ms Hdfs Read Thread Concurrency Bucket: 0:95% 1:0% 2:5% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1112 PARQUET/SNAPPY:52 BytesRead(500.000ms): 0, 0, 11.08 MB, 11.82 MB, 11.82 MB, 11.82 MB, 19.45 MB, 21.22 MB, 24.32 MB, 28.51 MB, 29.23 MB, 30.92 MB, 30.92 MB, 31.95 MB, 39.61 MB, 39.61 MB, 40.47 MB, 44.66 MB, 48.29 MB, 48.29 MB - FooterProcessingTime: (Avg: 58.435ms ; Min: 4.161ms ; Max: 166.708ms ; Number of samples: 52) - AverageHdfsReadThreadConcurrency: 0.10 - AverageScannerThreadConcurrency: 10.80 - BytesRead: 48.29 MB (50639852) - BytesReadDataNodeCache: 0 - BytesReadLocal: 48.29 MB (50639852) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 48.29 MB (50639852) - DecompressionTime: 280.242ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 52 (52) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 21.89 MB (22951974) - PerReadThreadRawHdfsThroughput: 25.26 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 115.594ms - RowBatchQueuePutWaitTime: 1m37s - RowsRead: 35.21M (35209861) - RowsReturned: 35.20M (35204285) - RowsReturnedRate: 45.10 M/sec - ScanRangesComplete: 1.16K (1164) - ScannerThreadsInvoluntaryContextSwitches: 1.40K (1396) - ScannerThreadsTotalWallClockTime: 1m52s - MaterializeTupleTime(*): 1s745ms - ScannerThreadsSysTime: 3s029ms - ScannerThreadsUserTime: 4s455ms - ScannerThreadsVoluntaryContextSwitches: 177.64K (177642) - TotalRawHdfsReadTime(*): 1s911ms - TotalReadThroughput: 4.83 MB/sec Filter 2 (16.00 MB): - Rows processed: 74.18K (74184) - Rows rejected: 5.58K (5576) - Rows total: 35.21M (35209861) Filter 7 (1.00 MB): - Files processed: 1.16K (1164) - Files rejected: 1.11K (1112) - Files total: 1.16K (1164) - RowGroups processed: 34.41K (34415) - RowGroups rejected: 0 (0) - RowGroups total: 34.41K (34415) - Rows processed: 851.97K (851968) - Rows rejected: 0 (0) - Rows total: 35.20M (35204285) - Splits processed: 52 (52) - Splits rejected: 0 (0) - Splits total: 52 (52) Instance 7f40dcb034de70b7:14a (host=vc1516.foo:22000):(Total: 10s290ms, non-child: 2s025ms, % non-child: 19.69%) Hdfs split stats (:<# splits>/): 1:157/9.58 GB 4:164/10.49 GB 7:159/9.73 GB 0:157/9.67 GB 5:143/8.69 GB 2:137/8.63 GB 3:150/9.47 GB 6:145/9.23 GB Filter 7 arrival: 387ms MemoryUsage(500.000ms): 3.38 MB, 3.38 MB, 27.25 MB, 26.64 MB, 27.28 MB, 29.17 MB, 29.13 MB, 25.89 MB, 28.84 MB, 28.93 MB, 28.08 MB, 26.99 MB, 26.99 MB, 28.26 MB, 28.54 MB, 27.13 MB, 25.93 MB, 27.48 MB, 23.43 MB, 19.91 MB ThreadUsage(500.000ms): 1, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.40 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 29.71 MB (31158195) - PerHostPeakMemUsage: 1.38 GB (1485373174) - RowsProduced: 40.90M (40904139) - TotalNetworkReceiveTime: 148.537ms - TotalNetworkSendTime: 2s463ms - TotalStorageWaitTime: 7s403ms - TotalThreadsInvoluntaryContextSwitches: 2.51K (2511) - TotalThreadsTotalWallClockTime: 2m3s - TotalThreadsSysTime: 3s163ms - TotalThreadsUserTime: 10s981ms - TotalThreadsVoluntaryContextSwitches: 159.15K (159147) Fragment Instance Lifecycle Timings: - ExecTime: 9s150ms - ExecTreeExecTime: 1s075ms - OpenTime: 1s076ms - ExecTreeOpenTime: 896.260ms - PrepareTime: 62.938ms - ExecTreePrepareTime: 3.999ms DataStreamSender (dst_id=23):(Total: 6s092ms, non-child: 6s092ms, % non-child: 100.00%) - BytesSent: 387.17 MB (405976591) - NetworkThroughput(*): 99.76 MB/sec - OverallThroughput: 63.55 MB/sec - PeakMemoryUsage: 4.73 MB (4955200) - RowsReturned: 40.90M (40904139) - SerializeBatchTime: 2s203ms - TransmitDataRPCTime: 3s881ms - UncompressedRowBatchSize: 1.30 GB (1391260694) CodeGen:(Total: 206.358ms, non-child: 206.358ms, % non-child: 100.00%) - CodegenTime: 1.084ms - CompileTime: 53.295ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 90 (90) - NumInstructions: 2.97K (2968) - OptimizationTime: 125.198ms - PeakMemoryUsage: 1.45 MB (1519616) - PrepareTime: 27.427ms HASH_JOIN_NODE (id=11):(Total: 1s966ms, non-child: 926.254ms, % non-child: 47.11%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.273ms - PeakMemoryUsage: 1.20 MB (1255232) - ProbeRows: 40.90M (40904139) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 874.927ms - RowsReturned: 40.90M (40904139) - RowsReturnedRate: 20.80 M/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 24.570us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 121.800us - HashBuckets: 212 (212) - HashCollisions: 0 (0) - HashTablesBuildTime: 43.360us - LargestPartitionPercent: 9 (9) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1073600) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 148.546ms, non-child: 17.213us, % non-child: 0.01%) BytesReceived(500.000ms): 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 4.617us - DeserializeRowBatchTimer: 21.178us - FirstBatchArrivalWaitTime: 123.096ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 807.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=9):(Total: 891.929ms, non-child: 891.929ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:157/9.58 GB 4:164/10.49 GB 7:159/9.73 GB 0:157/9.67 GB 5:143/8.69 GB 2:137/8.63 GB 3:150/9.47 GB 6:145/9.23 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 55 out of 55 Runtime filters: Only following filters arrived: 7, waited 622ms Hdfs Read Thread Concurrency Bucket: 0:90% 1:5% 2:0% 3:5% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1157 PARQUET/SNAPPY:55 BytesRead(500.000ms): 0, 0, 12.81 MB, 13.65 MB, 13.65 MB, 20.67 MB, 21.49 MB, 21.68 MB, 29.83 MB, 30.67 MB, 32.35 MB, 37.97 MB, 37.97 MB, 39.39 MB, 40.25 MB, 48.98 MB, 48.98 MB, 49.84 MB, 54.62 MB, 54.62 MB - FooterProcessingTime: (Avg: 63.944ms ; Min: 4.759ms ; Max: 160.616ms ; Number of samples: 55) - AverageHdfsReadThreadConcurrency: 0.20 - AverageScannerThreadConcurrency: 11.40 - BytesRead: 54.62 MB (57270415) - BytesReadDataNodeCache: 0 - BytesReadLocal: 54.62 MB (57270415) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 54.62 MB (57270415) - DecompressionTime: 351.932ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 55 (55) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 23.96 MB (25122188) - PerReadThreadRawHdfsThroughput: 23.07 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 121.679ms - RowBatchQueuePutWaitTime: 1m35s - RowsRead: 40.90M (40904139) - RowsReturned: 40.90M (40904139) - RowsReturnedRate: 45.86 M/sec - ScanRangesComplete: 1.21K (1212) - ScannerThreadsInvoluntaryContextSwitches: 1.74K (1738) - ScannerThreadsTotalWallClockTime: 1m52s - MaterializeTupleTime(*): 2s044ms - ScannerThreadsSysTime: 2s852ms - ScannerThreadsUserTime: 4s410ms - ScannerThreadsVoluntaryContextSwitches: 158.51K (158506) - TotalRawHdfsReadTime(*): 2s367ms - TotalReadThroughput: 5.46 MB/sec Filter 2 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 40.90M (40904139) Filter 7 (1.00 MB): - Files processed: 1.21K (1212) - Files rejected: 1.16K (1157) - Files total: 1.21K (1212) - RowGroups processed: 39.99K (39990) - RowGroups rejected: 0 (0) - RowGroups total: 39.99K (39990) - Rows processed: 901.12K (901120) - Rows rejected: 0 (0) - Rows total: 40.90M (40904139) - Splits processed: 55 (55) - Splits rejected: 0 (0) - Splits total: 55 (55) Instance 7f40dcb034de70b7:154 (host=vd1116.foo:22000):(Total: 10s273ms, non-child: 2s281ms, % non-child: 22.21%) Hdfs split stats (:<# splits>/): 3:165/10.08 GB 2:137/8.57 GB 7:148/9.63 GB 6:138/9.19 GB 5:145/9.47 GB 4:149/9.63 GB 1:160/10.17 GB 0:138/8.79 GB Filter 7 arrival: 321ms MemoryUsage(500.000ms): 3.38 MB, 3.38 MB, 24.89 MB, 28.14 MB, 28.37 MB, 24.76 MB, 26.96 MB, 27.58 MB, 24.69 MB, 25.31 MB, 26.43 MB, 27.31 MB, 27.31 MB, 27.08 MB, 27.16 MB, 26.33 MB, 25.98 MB, 23.15 MB, 24.90 MB, 19.22 MB ThreadUsage(500.000ms): 1, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.40 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 28.80 MB (30197068) - PerHostPeakMemUsage: 1.37 GB (1474781560) - RowsProduced: 41.01M (41010921) - TotalNetworkReceiveTime: 82.674ms - TotalNetworkSendTime: 2s350ms - TotalStorageWaitTime: 7s494ms - TotalThreadsInvoluntaryContextSwitches: 2.51K (2506) - TotalThreadsTotalWallClockTime: 2m3s - TotalThreadsSysTime: 2s358ms - TotalThreadsUserTime: 10s986ms - TotalThreadsVoluntaryContextSwitches: 174.44K (174437) Fragment Instance Lifecycle Timings: - ExecTime: 9s159ms - ExecTreeExecTime: 1s007ms - OpenTime: 1s052ms - ExecTreeOpenTime: 867.578ms - PrepareTime: 60.509ms - ExecTreePrepareTime: 3.168ms DataStreamSender (dst_id=23):(Total: 5s915ms, non-child: 5s915ms, % non-child: 100.00%) - BytesSent: 388.60 MB (407472468) - NetworkThroughput(*): 104.78 MB/sec - OverallThroughput: 65.69 MB/sec - PeakMemoryUsage: 4.74 MB (4971584) - RowsReturned: 41.01M (41010921) - SerializeBatchTime: 2s198ms - TransmitDataRPCTime: 3s708ms - UncompressedRowBatchSize: 1.30 GB (1394892642) CodeGen:(Total: 209.868ms, non-child: 209.868ms, % non-child: 100.00%) - CodegenTime: 1.078ms - CompileTime: 55.120ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 90 (90) - NumInstructions: 2.97K (2968) - OptimizationTime: 128.173ms - PeakMemoryUsage: 1.45 MB (1519616) - PrepareTime: 26.102ms HASH_JOIN_NODE (id=11):(Total: 1s866ms, non-child: 859.638ms, % non-child: 46.05%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.464ms - PeakMemoryUsage: 1.20 MB (1255232) - ProbeRows: 41.01M (41010921) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 799.342ms - RowsReturned: 41.01M (41010921) - RowsReturnedRate: 21.97 M/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 19.882us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 291.943us - HashBuckets: 212 (212) - HashCollisions: 0 (0) - HashTablesBuildTime: 59.965us - LargestPartitionPercent: 9 (9) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1073600) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 82.679ms, non-child: 11.971us, % non-child: 0.01%) BytesReceived(500.000ms): 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 1.667us - DeserializeRowBatchTimer: 16.244us - FirstBatchArrivalWaitTime: 74.402ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 1.45 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=9):(Total: 924.778ms, non-child: 924.778ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:165/10.08 GB 2:137/8.57 GB 7:148/9.63 GB 6:138/9.19 GB 5:145/9.47 GB 4:149/9.63 GB 1:160/10.17 GB 0:138/8.79 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 59 out of 59 Runtime filters: Only following filters arrived: 7, waited 685ms Hdfs Read Thread Concurrency Bucket: 0:85% 1:10% 2:5% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1121 PARQUET/SNAPPY:59 BytesRead(500.000ms): 0, 0, 7.55 MB, 12.98 MB, 12.98 MB, 17.26 MB, 19.67 MB, 19.67 MB, 30.93 MB, 30.93 MB, 32.92 MB, 36.05 MB, 37.74 MB, 41.09 MB, 41.09 MB, 42.76 MB, 50.03 MB, 50.03 MB, 53.47 MB, 55.88 MB - FooterProcessingTime: (Avg: 68.112ms ; Min: 4.154ms ; Max: 327.115ms ; Number of samples: 59) - AverageHdfsReadThreadConcurrency: 0.20 - AverageScannerThreadConcurrency: 11.40 - BytesRead: 55.88 MB (58592982) - BytesReadDataNodeCache: 0 - BytesReadLocal: 55.88 MB (58592982) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 55.88 MB (58592982) - DecompressionTime: 347.851ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 59 (59) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 22.99 MB (24106425) - PerReadThreadRawHdfsThroughput: 26.80 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 96.244ms - RowBatchQueuePutWaitTime: 1m36s - RowsRead: 41.01M (41010921) - RowsReturned: 41.01M (41010921) - RowsReturnedRate: 44.35 M/sec - ScanRangesComplete: 1.18K (1180) - ScannerThreadsInvoluntaryContextSwitches: 1.67K (1673) - ScannerThreadsTotalWallClockTime: 1m53s - MaterializeTupleTime(*): 2s090ms - ScannerThreadsSysTime: 2s126ms - ScannerThreadsUserTime: 4s214ms - ScannerThreadsVoluntaryContextSwitches: 173.80K (173799) - TotalRawHdfsReadTime(*): 2s085ms - TotalReadThroughput: 5.59 MB/sec Filter 2 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 41.01M (41010921) Filter 7 (1.00 MB): - Files processed: 1.18K (1180) - Files rejected: 1.12K (1121) - Files total: 1.18K (1180) - RowGroups processed: 40.10K (40099) - RowGroups rejected: 0 (0) - RowGroups total: 40.10K (40099) - Rows processed: 966.66K (966656) - Rows rejected: 0 (0) - Rows total: 41.01M (41010921) - Splits processed: 59 (59) - Splits rejected: 0 (0) - Splits total: 59 (59) Instance 7f40dcb034de70b7:102 (host=ve1140.foo:22000):(Total: 10s272ms, non-child: 1s751ms, % non-child: 17.05%) Hdfs split stats (:<# splits>/): 0:148/9.49 GB 3:128/7.81 GB 2:145/9.66 GB 5:150/9.56 GB 6:156/10.05 GB 1:150/9.56 GB 7:141/8.81 GB 4:166/10.56 GB Filter 7 arrival: 632ms Filter 2 arrival: 8s950ms MemoryUsage(500.000ms): 1.38 MB, 3.38 MB, 23.45 MB, 23.85 MB, 24.05 MB, 25.00 MB, 26.23 MB, 28.11 MB, 30.14 MB, 30.03 MB, 28.94 MB, 27.90 MB, 26.07 MB, 27.27 MB, 26.48 MB, 26.47 MB, 27.93 MB, 24.83 MB, 42.21 MB, 38.69 MB, 19.46 MB ThreadUsage(500.000ms): 2, 1, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 1 - AverageThreadTokens: 11.33 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 42.80 MB (44876578) - PerHostPeakMemUsage: 1.35 GB (1444579947) - RowsProduced: 43.29M (43289329) - TotalNetworkReceiveTime: 414.287ms - TotalNetworkSendTime: 2s285ms - TotalStorageWaitTime: 5s119ms - TotalThreadsInvoluntaryContextSwitches: 2.53K (2530) - TotalThreadsTotalWallClockTime: 2m - TotalThreadsSysTime: 2s959ms - TotalThreadsUserTime: 10s967ms - TotalThreadsVoluntaryContextSwitches: 171.25K (171250) Fragment Instance Lifecycle Timings: - ExecTime: 9s180ms - ExecTreeExecTime: 1s117ms - OpenTime: 1s040ms - ExecTreeOpenTime: 871.743ms - PrepareTime: 51.895ms - ExecTreePrepareTime: 2.883ms DataStreamSender (dst_id=23):(Total: 6s351ms, non-child: 6s351ms, % non-child: 100.00%) - BytesSent: 410.55 MB (430492856) - NetworkThroughput(*): 101.22 MB/sec - OverallThroughput: 64.63 MB/sec - PeakMemoryUsage: 4.72 MB (4947008) - RowsReturned: 43.29M (43289329) - SerializeBatchTime: 2s288ms - TransmitDataRPCTime: 4s056ms - UncompressedRowBatchSize: 1.37 GB (1472387466) CodeGen:(Total: 188.825ms, non-child: 188.825ms, % non-child: 100.00%) - CodegenTime: 887.563us - CompileTime: 50.425ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 90 (90) - NumInstructions: 2.97K (2968) - OptimizationTime: 116.856ms - PeakMemoryUsage: 1.45 MB (1519616) - PrepareTime: 21.174ms HASH_JOIN_NODE (id=11):(Total: 1s980ms, non-child: 976.857ms, % non-child: 49.32%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.585ms - PeakMemoryUsage: 1.26 MB (1326212) - ProbeRows: 43.29M (43289329) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 925.547ms - RowsReturned: 43.29M (43289329) - RowsReturnedRate: 21.86 M/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 36.380us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 179.685us - HashBuckets: 212 (212) - HashCollisions: 0 (0) - HashTablesBuildTime: 71.010us - LargestPartitionPercent: 9 (9) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1073600) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 414.298ms, non-child: 23.487us, % non-child: 0.01%) BytesReceived(500.000ms): 0, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 5.142us - DeserializeRowBatchTimer: 89.733us - FirstBatchArrivalWaitTime: 398.694ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 289.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=9):(Total: 589.754ms, non-child: 589.754ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:148/9.49 GB 3:128/7.81 GB 2:145/9.66 GB 5:150/9.56 GB 6:156/10.05 GB 1:150/9.56 GB 7:141/8.81 GB 4:166/10.56 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 60 out of 60 Runtime filters: Only following filters arrived: 7, waited 381ms Hdfs Read Thread Concurrency Bucket: 0:85% 1:10% 2:0% 3:5% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1124 PARQUET/SNAPPY:60 BytesRead(500.000ms): 0, 0, 10.52 MB, 11.27 MB, 11.27 MB, 13.91 MB, 21.84 MB, 23.26 MB, 27.51 MB, 30.87 MB, 32.67 MB, 39.67 MB, 40.51 MB, 41.34 MB, 43.00 MB, 46.57 MB, 49.52 MB, 55.12 MB, 57.60 MB, 58.43 MB - FooterProcessingTime: (Avg: 48.354ms ; Min: 4.357ms ; Max: 147.932ms ; Number of samples: 60) - AverageHdfsReadThreadConcurrency: 0.25 - AverageScannerThreadConcurrency: 10.80 - BytesRead: 58.43 MB (61268048) - BytesReadDataNodeCache: 0 - BytesReadLocal: 58.43 MB (61268048) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 58.43 MB (61268048) - DecompressionTime: 367.729ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 60 (60) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 24.91 MB (26115414) - PerReadThreadRawHdfsThroughput: 26.20 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 68.775ms - RowBatchQueuePutWaitTime: 1m38s - RowsRead: 43.30M (43300937) - RowsReturned: 43.29M (43289329) - RowsReturnedRate: 73.40 M/sec - ScanRangesComplete: 1.18K (1184) - ScannerThreadsInvoluntaryContextSwitches: 1.71K (1713) - ScannerThreadsTotalWallClockTime: 1m50s - MaterializeTupleTime(*): 2s132ms - ScannerThreadsSysTime: 2s667ms - ScannerThreadsUserTime: 4s176ms - ScannerThreadsVoluntaryContextSwitches: 170.58K (170578) - TotalRawHdfsReadTime(*): 2s230ms - TotalReadThroughput: 5.84 MB/sec Filter 2 (16.00 MB): - Rows processed: 159.06K (159064) - Rows rejected: 11.61K (11608) - Rows total: 43.30M (43300937) Filter 7 (1.00 MB): - Files processed: 1.18K (1184) - Files rejected: 1.12K (1124) - Files total: 1.18K (1184) - RowGroups processed: 42.32K (42316) - RowGroups rejected: 0 (0) - RowGroups total: 42.32K (42316) - Rows processed: 983.04K (983040) - Rows rejected: 0 (0) - Rows total: 43.29M (43289329) - Splits processed: 60 (60) - Splits rejected: 0 (0) - Splits total: 60 (60) Instance 7f40dcb034de70b7:162 (host=vd1112.foo:22000):(Total: 10s235ms, non-child: 2s043ms, % non-child: 19.96%) Hdfs split stats (:<# splits>/): 5:140/8.61 GB 3:155/9.77 GB 0:155/10.26 GB 4:158/10.58 GB 6:144/9.23 GB 7:142/8.59 GB 1:137/9.22 GB 2:151/9.25 GB Filter 7 arrival: 260ms MemoryUsage(500.000ms): 1.35 MB, 3.38 MB, 6.34 MB, 23.93 MB, 23.93 MB, 23.99 MB, 24.90 MB, 25.09 MB, 21.86 MB, 28.05 MB, 28.94 MB, 29.01 MB, 29.22 MB, 30.04 MB, 30.18 MB, 28.93 MB, 24.86 MB, 26.09 MB, 26.24 MB, 18.98 MB, 3.45 MB ThreadUsage(500.000ms): 1, 1, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 1 - AverageThreadTokens: 11.29 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 30.61 MB (32097584) - PerHostPeakMemUsage: 1.37 GB (1468510263) - RowsProduced: 40.27M (40269921) - TotalNetworkReceiveTime: 40.647ms - TotalNetworkSendTime: 2s435ms - TotalStorageWaitTime: 6s775ms - TotalThreadsInvoluntaryContextSwitches: 2.32K (2322) - TotalThreadsTotalWallClockTime: 1m59s - TotalThreadsSysTime: 3s501ms - TotalThreadsUserTime: 10s610ms - TotalThreadsVoluntaryContextSwitches: 168.16K (168155) Fragment Instance Lifecycle Timings: - ExecTime: 8s988ms - ExecTreeExecTime: 1s015ms - OpenTime: 1s194ms - ExecTreeOpenTime: 1s022ms - PrepareTime: 51.296ms - ExecTreePrepareTime: 3.480ms DataStreamSender (dst_id=23):(Total: 5s968ms, non-child: 5s968ms, % non-child: 100.00%) - BytesSent: 381.69 MB (400228171) - NetworkThroughput(*): 101.17 MB/sec - OverallThroughput: 63.95 MB/sec - PeakMemoryUsage: 4.73 MB (4955200) - RowsReturned: 40.27M (40269921) - SerializeBatchTime: 2s188ms - TransmitDataRPCTime: 3s772ms - UncompressedRowBatchSize: 1.28 GB (1369689130) CodeGen:(Total: 191.583ms, non-child: 191.583ms, % non-child: 100.00%) - CodegenTime: 1.088ms - CompileTime: 50.145ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 90 (90) - NumInstructions: 2.97K (2968) - OptimizationTime: 120.321ms - PeakMemoryUsage: 1.45 MB (1519616) - PrepareTime: 20.709ms HASH_JOIN_NODE (id=11):(Total: 2s032ms, non-child: 870.772ms, % non-child: 42.85%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.318ms - PeakMemoryUsage: 1.20 MB (1255232) - ProbeRows: 40.27M (40269921) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 822.819ms - RowsReturned: 40.27M (40269921) - RowsReturnedRate: 19.82 M/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 40.456us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 140.473us - HashBuckets: 212 (212) - HashCollisions: 0 (0) - HashTablesBuildTime: 61.709us - LargestPartitionPercent: 9 (9) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1073600) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 40.657ms, non-child: 20.304us, % non-child: 0.05%) BytesReceived(500.000ms): 0, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 4.447us - DeserializeRowBatchTimer: 44.711us - FirstBatchArrivalWaitTime: 37.877ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 2.95 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=9):(Total: 1s120ms, non-child: 1s120ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:140/8.61 GB 3:155/9.77 GB 0:155/10.26 GB 4:158/10.58 GB 6:144/9.23 GB 7:142/8.59 GB 1:137/9.22 GB 2:151/9.25 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 59 out of 59 Runtime filters: Only following filters arrived: 7, waited 742ms Hdfs Read Thread Concurrency Bucket: 0:78.95% 1:15.79% 2:5.263% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1123 PARQUET/SNAPPY:59 BytesRead(500.000ms): 0, 0, 300.00 KB, 10.79 MB, 11.62 MB, 14.15 MB, 20.57 MB, 21.33 MB, 25.97 MB, 32.07 MB, 33.48 MB, 35.26 MB, 36.56 MB, 40.43 MB, 40.43 MB, 43.64 MB, 48.59 MB, 49.41 MB, 53.34 MB, 55.01 MB - FooterProcessingTime: (Avg: 73.818ms ; Min: 4.233ms ; Max: 320.682ms ; Number of samples: 59) - AverageHdfsReadThreadConcurrency: 0.26 - AverageScannerThreadConcurrency: 11.37 - BytesRead: 55.01 MB (57680315) - BytesReadDataNodeCache: 0 - BytesReadLocal: 55.01 MB (57680315) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 55.01 MB (57680315) - DecompressionTime: 329.599ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 59 (59) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 24.86 MB (26068509) - PerReadThreadRawHdfsThroughput: 26.87 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 231.657ms - RowBatchQueuePutWaitTime: 1m35s - RowsRead: 40.27M (40269921) - RowsReturned: 40.27M (40269921) - RowsReturnedRate: 35.93 M/sec - ScanRangesComplete: 1.18K (1182) - ScannerThreadsInvoluntaryContextSwitches: 1.55K (1553) - ScannerThreadsTotalWallClockTime: 1m49s - MaterializeTupleTime(*): 2s013ms - ScannerThreadsSysTime: 3s211ms - ScannerThreadsUserTime: 4s158ms - ScannerThreadsVoluntaryContextSwitches: 167.47K (167475) - TotalRawHdfsReadTime(*): 2s047ms - TotalReadThroughput: 5.50 MB/sec Filter 2 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 40.27M (40269921) Filter 7 (1.00 MB): - Files processed: 1.18K (1182) - Files rejected: 1.12K (1123) - Files total: 1.18K (1182) - RowGroups processed: 39.37K (39374) - RowGroups rejected: 0 (0) - RowGroups total: 39.37K (39374) - Rows processed: 959.91K (959906) - Rows rejected: 0 (0) - Rows total: 40.27M (40269921) - Splits processed: 59 (59) - Splits rejected: 0 (0) - Splits total: 59 (59) Instance 7f40dcb034de70b7:175 (host=vd1326.foo:22000):(Total: 10s232ms, non-child: 2s593ms, % non-child: 25.34%) Hdfs split stats (:<# splits>/): 0:154/9.72 GB 3:137/8.58 GB 4:143/8.79 GB 1:143/9.44 GB 7:160/10.43 GB 5:146/9.03 GB 2:147/9.55 GB 6:156/9.99 GB Filter 7 arrival: 241ms MemoryUsage(500.000ms): 2.79 MB, 3.38 MB, 4.52 MB, 22.94 MB, 22.70 MB, 23.41 MB, 23.19 MB, 23.66 MB, 23.24 MB, 26.40 MB, 28.82 MB, 27.86 MB, 28.99 MB, 28.30 MB, 28.01 MB, 30.06 MB, 29.43 MB, 33.33 MB, 28.56 MB, 26.36 MB, 19.32 MB ThreadUsage(500.000ms): 1, 1, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 11.86 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 33.55 MB (35174936) - PerHostPeakMemUsage: 1.37 GB (1472895555) - RowsProduced: 36.05M (36048908) - TotalNetworkReceiveTime: 3.471us - TotalNetworkSendTime: 2s788ms - TotalStorageWaitTime: 6s075ms - TotalThreadsInvoluntaryContextSwitches: 2.78K (2776) - TotalThreadsTotalWallClockTime: 2m4s - TotalThreadsSysTime: 3s604ms - TotalThreadsUserTime: 10s588ms - TotalThreadsVoluntaryContextSwitches: 227.00K (227002) Fragment Instance Lifecycle Timings: - ExecTime: 9s036ms - ExecTreeExecTime: 996.901ms - OpenTime: 1s131ms - ExecTreeOpenTime: 949.620ms - PrepareTime: 64.069ms - ExecTreePrepareTime: 3.572ms DataStreamSender (dst_id=23):(Total: 5s492ms, non-child: 5s492ms, % non-child: 100.00%) - BytesSent: 341.31 MB (357890299) - NetworkThroughput(*): 99.33 MB/sec - OverallThroughput: 62.14 MB/sec - PeakMemoryUsage: 4.73 MB (4955200) - RowsReturned: 36.05M (36048908) - SerializeBatchTime: 2s049ms - TransmitDataRPCTime: 3s436ms - UncompressedRowBatchSize: 1.14 GB (1226121144) CodeGen:(Total: 207.223ms, non-child: 207.223ms, % non-child: 100.00%) - CodegenTime: 1.110ms - CompileTime: 50.170ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 90 (90) - NumInstructions: 2.97K (2968) - OptimizationTime: 129.736ms - PeakMemoryUsage: 1.45 MB (1519616) - PrepareTime: 26.804ms HASH_JOIN_NODE (id=11):(Total: 1s940ms, non-child: 862.983ms, % non-child: 44.48%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.255ms - PeakMemoryUsage: 1.20 MB (1255232) - ProbeRows: 36.05M (36048908) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 822.160ms - RowsReturned: 36.05M (36048908) - RowsReturnedRate: 18.58 M/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 21.419us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 105.321us - HashBuckets: 212 (212) - HashCollisions: 0 (0) - HashTablesBuildTime: 39.495us - LargestPartitionPercent: 9 (9) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1073600) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 12.655us, non-child: 12.655us, % non-child: 100.00%) BytesReceived(500.000ms): 0, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 4.728us - DeserializeRowBatchTimer: 21.686us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 9.48 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=9):(Total: 1s077ms, non-child: 1s077ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:154/9.72 GB 3:137/8.58 GB 4:143/8.79 GB 1:143/9.44 GB 7:160/10.43 GB 5:146/9.03 GB 2:147/9.55 GB 6:156/9.99 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 51 out of 51 Runtime filters: Only following filters arrived: 7, waited 763ms Hdfs Read Thread Concurrency Bucket: 0:90% 1:5% 2:5% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1135 PARQUET/SNAPPY:51 BytesRead(500.000ms): 0, 0, 0, 10.03 MB, 10.03 MB, 10.87 MB, 20.42 MB, 20.42 MB, 22.07 MB, 28.27 MB, 32.46 MB, 33.30 MB, 34.13 MB, 34.13 MB, 36.63 MB, 41.13 MB, 41.13 MB, 47.06 MB, 48.73 MB, 48.73 MB, 48.73 MB - FooterProcessingTime: (Avg: 85.900ms ; Min: 4.385ms ; Max: 286.907ms ; Number of samples: 51) - AverageHdfsReadThreadConcurrency: 0.15 - AverageScannerThreadConcurrency: 11.40 - BytesRead: 48.73 MB (51099340) - BytesReadDataNodeCache: 0 - BytesReadLocal: 48.73 MB (51099340) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 48.73 MB (51099340) - DecompressionTime: 302.015ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 51 (51) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 27.73 MB (29074606) - PerReadThreadRawHdfsThroughput: 26.65 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 182.700ms - RowBatchQueuePutWaitTime: 1m35s - RowsRead: 36.05M (36048908) - RowsReturned: 36.05M (36048908) - RowsReturnedRate: 33.47 M/sec - ScanRangesComplete: 1.19K (1186) - ScannerThreadsInvoluntaryContextSwitches: 1.92K (1920) - ScannerThreadsTotalWallClockTime: 1m53s - MaterializeTupleTime(*): 1s854ms - ScannerThreadsSysTime: 3s342ms - ScannerThreadsUserTime: 4s419ms - ScannerThreadsVoluntaryContextSwitches: 226.40K (226395) - TotalRawHdfsReadTime(*): 1s828ms - TotalReadThroughput: 4.64 MB/sec Filter 2 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 36.05M (36048908) Filter 7 (1.00 MB): - Files processed: 1.19K (1186) - Files rejected: 1.14K (1135) - Files total: 1.19K (1186) - RowGroups processed: 35.24K (35244) - RowGroups rejected: 0 (0) - RowGroups total: 35.24K (35244) - Rows processed: 835.58K (835584) - Rows rejected: 0 (0) - Rows total: 36.05M (36048908) - Splits processed: 51 (51) - Splits rejected: 0 (0) - Splits total: 51 (51) Instance 7f40dcb034de70b7:161 (host=vd1126.foo:22000):(Total: 10s202ms, non-child: 1s735ms, % non-child: 17.01%) Hdfs split stats (:<# splits>/): 7:153/10.15 GB 0:164/10.08 GB 4:150/9.15 GB 3:135/7.93 GB 2:146/9.03 GB 1:145/8.84 GB 6:144/10.11 GB 5:161/10.22 GB Filter 7 arrival: 285ms MemoryUsage(500.000ms): 3.38 MB, 3.38 MB, 24.63 MB, 26.12 MB, 26.66 MB, 23.30 MB, 27.86 MB, 28.07 MB, 26.57 MB, 27.99 MB, 27.48 MB, 25.86 MB, 25.86 MB, 25.93 MB, 25.22 MB, 19.62 MB, 24.64 MB, 25.42 MB, 20.96 MB, 18.45 MB ThreadUsage(500.000ms): 1, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.40 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 28.74 MB (30132341) - PerHostPeakMemUsage: 1.38 GB (1480345143) - RowsProduced: 41.01M (41010670) - TotalNetworkReceiveTime: 50.719ms - TotalNetworkSendTime: 2s115ms - TotalStorageWaitTime: 7s216ms - TotalThreadsInvoluntaryContextSwitches: 2.97K (2966) - TotalThreadsTotalWallClockTime: 2m3s - TotalThreadsSysTime: 4s592ms - TotalThreadsUserTime: 11s537ms - TotalThreadsVoluntaryContextSwitches: 353.64K (353636) Fragment Instance Lifecycle Timings: - ExecTime: 8s941ms - ExecTreeExecTime: 1s098ms - OpenTime: 1s205ms - ExecTreeOpenTime: 1s021ms - PrepareTime: 55.499ms - ExecTreePrepareTime: 3.392ms DataStreamSender (dst_id=23):(Total: 6s149ms, non-child: 6s149ms, % non-child: 100.00%) - BytesSent: 388.41 MB (407278300) - NetworkThroughput(*): 99.28 MB/sec - OverallThroughput: 63.16 MB/sec - PeakMemoryUsage: 4.73 MB (4955200) - RowsReturned: 41.01M (41010670) - SerializeBatchTime: 2s229ms - TransmitDataRPCTime: 3s912ms - UncompressedRowBatchSize: 1.30 GB (1394884036) CodeGen:(Total: 204.364ms, non-child: 204.364ms, % non-child: 100.00%) - CodegenTime: 1.101ms - CompileTime: 51.445ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 90 (90) - NumInstructions: 2.97K (2968) - OptimizationTime: 130.289ms - PeakMemoryUsage: 1.45 MB (1519616) - PrepareTime: 22.144ms HASH_JOIN_NODE (id=11):(Total: 2s113ms, non-child: 961.268ms, % non-child: 45.49%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.470ms - PeakMemoryUsage: 1.20 MB (1255232) - ProbeRows: 41.01M (41010670) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 906.882ms - RowsReturned: 41.01M (41010670) - RowsReturnedRate: 19.41 M/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 28.245us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 137.085us - HashBuckets: 212 (212) - HashCollisions: 0 (0) - HashTablesBuildTime: 56.004us - LargestPartitionPercent: 9 (9) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1073600) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 50.731ms, non-child: 28.879us, % non-child: 0.06%) BytesReceived(500.000ms): 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 4.932us - DeserializeRowBatchTimer: 19.642us - FirstBatchArrivalWaitTime: 28.522ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 2.37 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=9):(Total: 1s101ms, non-child: 1s101ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:153/10.15 GB 0:164/10.08 GB 4:150/9.15 GB 3:135/7.93 GB 2:146/9.03 GB 1:145/8.84 GB 6:144/10.11 GB 5:161/10.22 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 57 out of 57 Runtime filters: Only following filters arrived: 7, waited 723ms Hdfs Read Thread Concurrency Bucket: 0:80% 1:5% 2:10% 3:5% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1141 PARQUET/SNAPPY:57 BytesRead(500.000ms): 0, 0, 10.13 MB, 12.37 MB, 12.37 MB, 15.95 MB, 21.15 MB, 22.57 MB, 24.45 MB, 29.85 MB, 31.29 MB, 38.86 MB, 38.86 MB, 38.86 MB, 39.71 MB, 43.99 MB, 48.66 MB, 50.92 MB, 55.47 MB, 55.47 MB - FooterProcessingTime: (Avg: 81.268ms ; Min: 25.587ms ; Max: 309.357ms ; Number of samples: 57) - AverageHdfsReadThreadConcurrency: 0.40 - AverageScannerThreadConcurrency: 11.40 - BytesRead: 55.47 MB (58166507) - BytesReadDataNodeCache: 0 - BytesReadLocal: 55.47 MB (58166507) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 55.47 MB (58166507) - DecompressionTime: 332.499ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 57 (57) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 22.99 MB (24106246) - PerReadThreadRawHdfsThroughput: 24.36 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 244.197ms - RowBatchQueuePutWaitTime: 1m33s - RowsRead: 41.01M (41010670) - RowsReturned: 41.01M (41010670) - RowsReturnedRate: 37.24 M/sec - ScanRangesComplete: 1.20K (1198) - ScannerThreadsInvoluntaryContextSwitches: 2.16K (2160) - ScannerThreadsTotalWallClockTime: 1m52s - MaterializeTupleTime(*): 2s046ms - ScannerThreadsSysTime: 4s313ms - ScannerThreadsUserTime: 4s790ms - ScannerThreadsVoluntaryContextSwitches: 352.97K (352970) - TotalRawHdfsReadTime(*): 2s277ms - TotalReadThroughput: 5.55 MB/sec Filter 2 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 41.01M (41010670) Filter 7 (1.00 MB): - Files processed: 1.20K (1198) - Files rejected: 1.14K (1141) - Files total: 1.20K (1198) - RowGroups processed: 40.10K (40097) - RowGroups rejected: 0 (0) - RowGroups total: 40.10K (40097) - Rows processed: 933.89K (933888) - Rows rejected: 0 (0) - Rows total: 41.01M (41010670) - Splits processed: 57 (57) - Splits rejected: 0 (0) - Splits total: 57 (57) Instance 7f40dcb034de70b7:143 (host=vc1521.foo:22000):(Total: 10s200ms, non-child: 2s085ms, % non-child: 20.45%) Hdfs split stats (:<# splits>/): 6:144/8.93 GB 1:149/9.12 GB 4:145/9.78 GB 5:148/9.61 GB 2:140/9.10 GB 3:157/10.28 GB 7:129/8.79 GB 0:152/9.92 GB Filter 7 arrival: 389ms MemoryUsage(500.000ms): 0, 3.38 MB, 3.38 MB, 23.60 MB, 22.73 MB, 26.23 MB, 27.70 MB, 27.92 MB, 28.25 MB, 28.97 MB, 26.97 MB, 24.04 MB, 25.15 MB, 25.15 MB, 23.97 MB, 23.99 MB, 23.81 MB, 27.89 MB, 29.28 MB, 23.18 MB, 15.18 MB ThreadUsage(500.000ms): 1, 1, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 11.86 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 29.82 MB (31263812) - PerHostPeakMemUsage: 1.39 GB (1493649520) - RowsProduced: 39.71M (39712392) - TotalNetworkReceiveTime: 165.746ms - TotalNetworkSendTime: 1s954ms - TotalStorageWaitTime: 6s884ms - TotalThreadsInvoluntaryContextSwitches: 3.40K (3398) - TotalThreadsTotalWallClockTime: 2m1s - TotalThreadsSysTime: 3s737ms - TotalThreadsUserTime: 11s737ms - TotalThreadsVoluntaryContextSwitches: 167.60K (167602) Fragment Instance Lifecycle Timings: - ExecTime: 9s097ms - ExecTreeExecTime: 1s179ms - OpenTime: 1s052ms - ExecTreeOpenTime: 876.248ms - PrepareTime: 50.891ms - ExecTreePrepareTime: 3.158ms DataStreamSender (dst_id=23):(Total: 5s872ms, non-child: 5s872ms, % non-child: 100.00%) - BytesSent: 376.46 MB (394743696) - NetworkThroughput(*): 104.04 MB/sec - OverallThroughput: 64.10 MB/sec - PeakMemoryUsage: 4.80 MB (5028928) - RowsReturned: 39.71M (39712392) - SerializeBatchTime: 2s246ms - TransmitDataRPCTime: 3s618ms - UncompressedRowBatchSize: 1.26 GB (1350726096) CodeGen:(Total: 194.161ms, non-child: 194.161ms, % non-child: 100.00%) - CodegenTime: 960.390us - CompileTime: 50.886ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 90 (90) - NumInstructions: 2.97K (2968) - OptimizationTime: 123.828ms - PeakMemoryUsage: 1.45 MB (1519616) - PrepareTime: 19.046ms HASH_JOIN_NODE (id=11):(Total: 2s048ms, non-child: 1s031ms, % non-child: 50.35%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.542ms - PeakMemoryUsage: 1.20 MB (1255232) - ProbeRows: 39.71M (39712392) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 982.119ms - RowsReturned: 39.71M (39712392) - RowsReturnedRate: 19.39 M/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 26.965us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 148.973us - HashBuckets: 212 (212) - HashCollisions: 0 (0) - HashTablesBuildTime: 67.327us - LargestPartitionPercent: 9 (9) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1073600) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 165.756ms, non-child: 19.720us, % non-child: 0.01%) BytesReceived(500.000ms): 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 4.567us - DeserializeRowBatchTimer: 14.076us - FirstBatchArrivalWaitTime: 158.930ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 723.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=9):(Total: 851.617ms, non-child: 851.617ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 6:144/8.93 GB 1:149/9.12 GB 4:145/9.78 GB 5:148/9.61 GB 2:140/9.10 GB 3:157/10.28 GB 7:129/8.79 GB 0:152/9.92 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 57 out of 57 Runtime filters: Only following filters arrived: 7, waited 623ms Hdfs Read Thread Concurrency Bucket: 0:85% 1:10% 2:5% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1107 PARQUET/SNAPPY:57 BytesRead(500.000ms): 0, 0, 10.51 MB, 10.51 MB, 13.29 MB, 21.97 MB, 21.97 MB, 21.97 MB, 29.76 MB, 30.71 MB, 33.99 MB, 38.19 MB, 38.19 MB, 38.19 MB, 39.83 MB, 47.07 MB, 51.42 MB, 53.81 MB, 53.81 MB, 53.81 MB - FooterProcessingTime: (Avg: 63.483ms ; Min: 4.548ms ; Max: 504.036ms ; Number of samples: 57) - AverageHdfsReadThreadConcurrency: 0.20 - AverageScannerThreadConcurrency: 11.40 - BytesRead: 53.81 MB (56423212) - BytesReadDataNodeCache: 0 - BytesReadLocal: 53.81 MB (56423212) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 53.81 MB (56423212) - DecompressionTime: 339.960ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 57 (57) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 24.27 MB (25448989) - PerReadThreadRawHdfsThroughput: 25.70 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 83.651ms - RowBatchQueuePutWaitTime: 1m34s - RowsRead: 39.71M (39712392) - RowsReturned: 39.71M (39712392) - RowsReturnedRate: 46.63 M/sec - ScanRangesComplete: 1.16K (1164) - ScannerThreadsInvoluntaryContextSwitches: 2.43K (2431) - ScannerThreadsTotalWallClockTime: 1m51s - MaterializeTupleTime(*): 2s123ms - ScannerThreadsSysTime: 3s500ms - ScannerThreadsUserTime: 4s658ms - ScannerThreadsVoluntaryContextSwitches: 166.97K (166973) - TotalRawHdfsReadTime(*): 2s093ms - TotalReadThroughput: 5.38 MB/sec Filter 2 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 39.71M (39712392) Filter 7 (1.00 MB): - Files processed: 1.16K (1164) - Files rejected: 1.11K (1107) - Files total: 1.16K (1164) - RowGroups processed: 38.83K (38827) - RowGroups rejected: 0 (0) - RowGroups total: 38.83K (38827) - Rows processed: 933.89K (933888) - Rows rejected: 0 (0) - Rows total: 39.71M (39712392) - Splits processed: 57 (57) - Splits rejected: 0 (0) - Splits total: 57 (57) Instance 7f40dcb034de70b7:13a (host=vc1527.foo:22000):(Total: 10s161ms, non-child: 1s958ms, % non-child: 19.28%) Hdfs split stats (:<# splits>/): 5:152/9.74 GB 7:145/9.05 GB 1:145/8.79 GB 3:136/8.51 GB 0:156/10.13 GB 6:144/9.37 GB 2:170/10.38 GB 4:152/9.53 GB Filter 7 arrival: 437ms Filter 2 arrival: 9s697ms MemoryUsage(500.000ms): 2.79 MB, 3.38 MB, 15.28 MB, 26.93 MB, 26.02 MB, 27.48 MB, 27.04 MB, 26.09 MB, 19.86 MB, 24.84 MB, 24.97 MB, 22.13 MB, 28.04 MB, 27.93 MB, 29.14 MB, 27.95 MB, 26.42 MB, 27.06 MB, 18.40 MB, 16.27 MB, 19.79 MB ThreadUsage(500.000ms): 1, 1, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 1 - AverageThreadTokens: 11.29 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 32.79 MB (34384986) - PerHostPeakMemUsage: 1.38 GB (1486357682) - RowsProduced: 40.50M (40503949) - TotalNetworkReceiveTime: 208.379ms - TotalNetworkSendTime: 2s355ms - TotalStorageWaitTime: 5s920ms - TotalThreadsInvoluntaryContextSwitches: 2.41K (2407) - TotalThreadsTotalWallClockTime: 2m - TotalThreadsSysTime: 5s046ms - TotalThreadsUserTime: 10s957ms - TotalThreadsVoluntaryContextSwitches: 218.45K (218453) Fragment Instance Lifecycle Timings: - ExecTime: 9s060ms - ExecTreeExecTime: 1s033ms - OpenTime: 1s046ms - ExecTreeOpenTime: 868.120ms - PrepareTime: 53.368ms - ExecTreePrepareTime: 3.415ms DataStreamSender (dst_id=23):(Total: 6s107ms, non-child: 6s107ms, % non-child: 100.00%) - BytesSent: 383.49 MB (402121623) - NetworkThroughput(*): 99.85 MB/sec - OverallThroughput: 62.79 MB/sec - PeakMemoryUsage: 4.76 MB (4987968) - RowsReturned: 40.50M (40503949) - SerializeBatchTime: 2s259ms - TransmitDataRPCTime: 3s840ms - UncompressedRowBatchSize: 1.28 GB (1377649122) CodeGen:(Total: 200.428ms, non-child: 200.428ms, % non-child: 100.00%) - CodegenTime: 1.086ms - CompileTime: 50.920ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 90 (90) - NumInstructions: 2.97K (2968) - OptimizationTime: 125.946ms - PeakMemoryUsage: 1.45 MB (1519616) - PrepareTime: 23.105ms HASH_JOIN_NODE (id=11):(Total: 1s894ms, non-child: 895.250ms, % non-child: 47.25%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.633ms - PeakMemoryUsage: 1.23 MB (1294193) - ProbeRows: 40.50M (40503949) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 845.198ms - RowsReturned: 40.50M (40503949) - RowsReturnedRate: 21.38 M/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 26.925us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 168.045us - HashBuckets: 212 (212) - HashCollisions: 0 (0) - HashTablesBuildTime: 56.713us - LargestPartitionPercent: 9 (9) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1073600) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 208.389ms, non-child: 19.924us, % non-child: 0.01%) BytesReceived(500.000ms): 0, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 5.242us - DeserializeRowBatchTimer: 14.524us - FirstBatchArrivalWaitTime: 196.969ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 575.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=9):(Total: 791.274ms, non-child: 791.274ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:152/9.74 GB 7:145/9.05 GB 1:145/8.79 GB 3:136/8.51 GB 0:156/10.13 GB 6:144/9.37 GB 2:170/10.38 GB 4:152/9.53 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 58 out of 58 Runtime filters: Only following filters arrived: 7, waited 563ms Hdfs Read Thread Concurrency Bucket: 0:73.68% 1:15.79% 2:0% 3:10.53% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1142 PARQUET/SNAPPY:58 BytesRead(500.000ms): 0, 0, 1.61 MB, 12.28 MB, 12.28 MB, 13.10 MB, 18.99 MB, 18.99 MB, 20.68 MB, 30.15 MB, 30.99 MB, 34.54 MB, 40.32 MB, 40.32 MB, 41.70 MB, 41.70 MB, 48.11 MB, 48.95 MB, 49.79 MB, 55.06 MB - FooterProcessingTime: (Avg: 59.263ms ; Min: 21.884ms ; Max: 132.880ms ; Number of samples: 58) - AverageHdfsReadThreadConcurrency: 0.47 - AverageScannerThreadConcurrency: 11.37 - BytesRead: 55.06 MB (57731671) - BytesReadDataNodeCache: 0 - BytesReadLocal: 55.06 MB (57731671) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 55.06 MB (57731671) - DecompressionTime: 346.374ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 58 (58) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 23.91 MB (25068617) - PerReadThreadRawHdfsThroughput: 22.84 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 93.969ms - RowBatchQueuePutWaitTime: 1m33s - RowsRead: 40.51M (40506546) - RowsReturned: 40.50M (40503949) - RowsReturnedRate: 51.19 M/sec - ScanRangesComplete: 1.20K (1200) - ScannerThreadsInvoluntaryContextSwitches: 1.63K (1626) - ScannerThreadsTotalWallClockTime: 1m50s - MaterializeTupleTime(*): 2s001ms - ScannerThreadsSysTime: 4s778ms - ScannerThreadsUserTime: 4s326ms - ScannerThreadsVoluntaryContextSwitches: 217.79K (217792) - TotalRawHdfsReadTime(*): 2s410ms - TotalReadThroughput: 5.51 MB/sec Filter 2 (16.00 MB): - Rows processed: 37.41K (37413) - Rows rejected: 2.60K (2597) - Rows total: 40.51M (40506546) Filter 7 (1.00 MB): - Files processed: 1.20K (1200) - Files rejected: 1.14K (1142) - Files total: 1.20K (1200) - RowGroups processed: 39.60K (39597) - RowGroups rejected: 0 (0) - RowGroups total: 39.60K (39597) - Rows processed: 950.27K (950272) - Rows rejected: 0 (0) - Rows total: 40.50M (40503949) - Splits processed: 58 (58) - Splits rejected: 0 (0) - Splits total: 58 (58) Instance 7f40dcb034de70b7:122 (host=vc1515.foo:22000):(Total: 10s148ms, non-child: 1s471ms, % non-child: 14.50%) Hdfs split stats (:<# splits>/): 3:133/7.73 GB 2:141/9.68 GB 1:150/9.58 GB 6:153/9.59 GB 5:164/10.03 GB 4:142/8.99 GB 0:156/10.35 GB 7:142/9.53 GB Filter 7 arrival: 527ms Filter 2 arrival: 9s441ms MemoryUsage(500.000ms): 2.79 MB, 3.38 MB, 6.23 MB, 24.05 MB, 23.83 MB, 25.47 MB, 28.09 MB, 28.15 MB, 28.20 MB, 29.02 MB, 28.35 MB, 26.88 MB, 26.93 MB, 26.93 MB, 25.86 MB, 26.58 MB, 28.89 MB, 29.21 MB, 26.88 MB, 43.63 MB, 19.73 MB ThreadUsage(500.000ms): 1, 1, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 1 - AverageThreadTokens: 11.29 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 43.72 MB (45846870) - PerHostPeakMemUsage: 1.33 GB (1432499202) - RowsProduced: 42.76M (42758328) - TotalNetworkReceiveTime: 318.686ms - TotalNetworkSendTime: 1s853ms - TotalStorageWaitTime: 5s727ms - TotalThreadsInvoluntaryContextSwitches: 2.56K (2560) - TotalThreadsTotalWallClockTime: 1m59s - TotalThreadsSysTime: 1s498ms - TotalThreadsUserTime: 11s008ms - TotalThreadsVoluntaryContextSwitches: 82.40K (82401) Fragment Instance Lifecycle Timings: - ExecTime: 9s030ms - ExecTreeExecTime: 1s167ms - OpenTime: 1s075ms - ExecTreeOpenTime: 906.525ms - PrepareTime: 42.406ms - ExecTreePrepareTime: 2.629ms DataStreamSender (dst_id=23):(Total: 6s428ms, non-child: 6s428ms, % non-child: 100.00%) - BytesSent: 405.78 MB (425494429) - NetworkThroughput(*): 99.87 MB/sec - OverallThroughput: 63.13 MB/sec - PeakMemoryUsage: 4.69 MB (4922432) - RowsReturned: 42.76M (42758328) - SerializeBatchTime: 2s357ms - TransmitDataRPCTime: 4s063ms - UncompressedRowBatchSize: 1.35 GB (1454326656) CodeGen:(Total: 186.141ms, non-child: 186.141ms, % non-child: 100.00%) - CodegenTime: 861.603us - CompileTime: 50.833ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 90 (90) - NumInstructions: 2.97K (2968) - OptimizationTime: 116.776ms - PeakMemoryUsage: 1.45 MB (1519616) - PrepareTime: 18.129ms HASH_JOIN_NODE (id=11):(Total: 2s062ms, non-child: 997.579ms, % non-child: 48.37%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.496ms - PeakMemoryUsage: 1.27 MB (1327806) - ProbeRows: 42.76M (42758328) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 940.048ms - RowsReturned: 42.76M (42758328) - RowsReturnedRate: 20.73 M/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 26.604us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 154.686us - HashBuckets: 212 (212) - HashCollisions: 0 (0) - HashTablesBuildTime: 52.082us - LargestPartitionPercent: 9 (9) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1073600) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 318.696ms, non-child: 19.068us, % non-child: 0.01%) BytesReceived(500.000ms): 0, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 5.025us - DeserializeRowBatchTimer: 24.206us - FirstBatchArrivalWaitTime: 307.925ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 376.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=9):(Total: 746.524ms, non-child: 746.524ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:133/7.73 GB 2:141/9.68 GB 1:150/9.58 GB 6:153/9.59 GB 5:164/10.03 GB 4:142/8.99 GB 0:156/10.35 GB 7:142/9.53 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 60 out of 60 Runtime filters: Only following filters arrived: 7, waited 482ms Hdfs Read Thread Concurrency Bucket: 0:89.47% 1:0% 2:5.263% 3:5.263% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1121 PARQUET/SNAPPY:60 BytesRead(500.000ms): 0, 0, 400.00 KB, 10.68 MB, 10.68 MB, 12.10 MB, 22.25 MB, 22.25 MB, 24.53 MB, 30.12 MB, 30.95 MB, 39.67 MB, 40.52 MB, 40.52 MB, 41.45 MB, 46.92 MB, 51.26 MB, 52.96 MB, 57.16 MB, 58.01 MB - FooterProcessingTime: (Avg: 58.073ms ; Min: 7.268ms ; Max: 166.768ms ; Number of samples: 60) - AverageHdfsReadThreadConcurrency: 0.26 - AverageScannerThreadConcurrency: 11.37 - BytesRead: 58.01 MB (60825624) - BytesReadDataNodeCache: 0 - BytesReadLocal: 58.01 MB (60825624) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 58.01 MB (60825624) - DecompressionTime: 364.946ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 60 (60) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 23.94 MB (25099448) - PerReadThreadRawHdfsThroughput: 26.98 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 101.997ms - RowBatchQueuePutWaitTime: 1m38s - RowsRead: 42.77M (42768489) - RowsReturned: 42.76M (42758328) - RowsReturnedRate: 57.28 M/sec - ScanRangesComplete: 1.18K (1181) - ScannerThreadsInvoluntaryContextSwitches: 1.75K (1750) - ScannerThreadsTotalWallClockTime: 1m49s - MaterializeTupleTime(*): 2s276ms - ScannerThreadsSysTime: 1s186ms - ScannerThreadsUserTime: 3s957ms - ScannerThreadsVoluntaryContextSwitches: 81.80K (81797) - TotalRawHdfsReadTime(*): 2s150ms - TotalReadThroughput: 5.80 MB/sec Filter 2 (16.00 MB): - Rows processed: 139.19K (139185) - Rows rejected: 10.16K (10161) - Rows total: 42.77M (42768489) Filter 7 (1.00 MB): - Files processed: 1.18K (1181) - Files rejected: 1.12K (1121) - Files total: 1.18K (1181) - RowGroups processed: 41.80K (41800) - RowGroups rejected: 0 (0) - RowGroups total: 41.80K (41800) - Rows processed: 983.04K (983040) - Rows rejected: 0 (0) - Rows total: 42.76M (42758328) - Splits processed: 60 (60) - Splits rejected: 0 (0) - Splits total: 60 (60) Instance 7f40dcb034de70b7:15f (host=vd1333.foo:22000):(Total: 10s137ms, non-child: 1s997ms, % non-child: 19.71%) Hdfs split stats (:<# splits>/): 1:127/8.63 GB 6:154/9.78 GB 7:161/10.46 GB 2:144/8.88 GB 3:160/9.88 GB 0:123/8.03 GB 5:141/9.26 GB 4:166/10.61 GB Filter 7 arrival: 275ms MemoryUsage(500.000ms): 3.38 MB, 3.38 MB, 23.71 MB, 26.02 MB, 27.41 MB, 24.73 MB, 26.97 MB, 26.94 MB, 26.90 MB, 26.16 MB, 26.23 MB, 26.67 MB, 26.67 MB, 26.19 MB, 25.82 MB, 24.23 MB, 25.83 MB, 26.12 MB, 23.10 MB, 17.43 MB ThreadUsage(500.000ms): 1, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.40 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 29.15 MB (30562992) - PerHostPeakMemUsage: 1.38 GB (1479840867) - RowsProduced: 39.51M (39505291) - TotalNetworkReceiveTime: 38.744ms - TotalNetworkSendTime: 2s354ms - TotalStorageWaitTime: 6s918ms - TotalThreadsInvoluntaryContextSwitches: 2.39K (2391) - TotalThreadsTotalWallClockTime: 2m2s - TotalThreadsSysTime: 3s746ms - TotalThreadsUserTime: 10s668ms - TotalThreadsVoluntaryContextSwitches: 205.52K (205517) Fragment Instance Lifecycle Timings: - ExecTime: 8s886ms - ExecTreeExecTime: 1s076ms - OpenTime: 1s196ms - ExecTreeOpenTime: 1s009ms - PrepareTime: 54.766ms - ExecTreePrepareTime: 3.383ms DataStreamSender (dst_id=23):(Total: 5s851ms, non-child: 5s851ms, % non-child: 100.00%) - BytesSent: 374.03 MB (392197136) - NetworkThroughput(*): 100.90 MB/sec - OverallThroughput: 63.92 MB/sec - PeakMemoryUsage: 4.84 MB (5069888) - RowsReturned: 39.51M (39505291) - SerializeBatchTime: 2s137ms - TransmitDataRPCTime: 3s706ms - UncompressedRowBatchSize: 1.25 GB (1343682062) CodeGen:(Total: 207.424ms, non-child: 207.424ms, % non-child: 100.00%) - CodegenTime: 1.080ms - CompileTime: 55.546ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 90 (90) - NumInstructions: 2.97K (2968) - OptimizationTime: 128.961ms - PeakMemoryUsage: 1.45 MB (1519616) - PrepareTime: 22.421ms HASH_JOIN_NODE (id=11):(Total: 2s080ms, non-child: 923.576ms, % non-child: 44.39%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.410ms - PeakMemoryUsage: 1.20 MB (1255232) - ProbeRows: 39.51M (39505291) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 876.236ms - RowsReturned: 39.51M (39505291) - RowsReturnedRate: 18.99 M/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 26.541us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 123.730us - HashBuckets: 212 (212) - HashCollisions: 0 (0) - HashTablesBuildTime: 74.597us - LargestPartitionPercent: 9 (9) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1073600) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 38.753ms, non-child: 17.953us, % non-child: 0.05%) BytesReceived(500.000ms): 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 4.377us - DeserializeRowBatchTimer: 17.163us - FirstBatchArrivalWaitTime: 37.695ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 3.10 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=9):(Total: 1s118ms, non-child: 1s118ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:127/8.63 GB 6:154/9.78 GB 7:161/10.46 GB 2:144/8.88 GB 3:160/9.88 GB 0:123/8.03 GB 5:141/9.26 GB 4:166/10.61 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 57 out of 57 Runtime filters: Only following filters arrived: 7, waited 742ms Hdfs Read Thread Concurrency Bucket: 0:90% 1:0% 2:5% 3:0% 4:0% 5:5% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1119 PARQUET/SNAPPY:57 BytesRead(500.000ms): 0, 0, 5.65 MB, 11.57 MB, 12.99 MB, 15.58 MB, 19.68 MB, 21.07 MB, 30.54 MB, 31.38 MB, 31.38 MB, 33.89 MB, 33.89 MB, 38.06 MB, 38.91 MB, 42.03 MB, 49.88 MB, 50.71 MB, 53.81 MB, 53.81 MB - FooterProcessingTime: (Avg: 71.945ms ; Min: 4.380ms ; Max: 284.531ms ; Number of samples: 57) - AverageHdfsReadThreadConcurrency: 0.35 - AverageScannerThreadConcurrency: 11.40 - BytesRead: 53.81 MB (56423956) - BytesReadDataNodeCache: 0 - BytesReadLocal: 53.81 MB (56423956) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 53.81 MB (56423956) - DecompressionTime: 309.221ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 57 (57) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 23.45 MB (24584542) - PerReadThreadRawHdfsThroughput: 25.33 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 224.553ms - RowBatchQueuePutWaitTime: 1m33s - RowsRead: 39.51M (39505291) - RowsReturned: 39.51M (39505291) - RowsReturnedRate: 35.32 M/sec - ScanRangesComplete: 1.18K (1176) - ScannerThreadsInvoluntaryContextSwitches: 1.60K (1605) - ScannerThreadsTotalWallClockTime: 1m52s - MaterializeTupleTime(*): 1s969ms - ScannerThreadsSysTime: 3s464ms - ScannerThreadsUserTime: 4s215ms - ScannerThreadsVoluntaryContextSwitches: 204.86K (204864) - TotalRawHdfsReadTime(*): 2s124ms - TotalReadThroughput: 5.38 MB/sec Filter 2 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 39.51M (39505291) Filter 7 (1.00 MB): - Files processed: 1.18K (1176) - Files rejected: 1.12K (1119) - Files total: 1.18K (1176) - RowGroups processed: 38.63K (38627) - RowGroups rejected: 0 (0) - RowGroups total: 38.63K (38627) - Rows processed: 933.89K (933888) - Rows rejected: 0 (0) - Rows total: 39.51M (39505291) - Splits processed: 57 (57) - Splits rejected: 0 (0) - Splits total: 57 (57) Instance 7f40dcb034de70b7:10e (host=vc1533.foo:22000):(Total: 10s104ms, non-child: 2s235ms, % non-child: 22.13%) Hdfs split stats (:<# splits>/): 7:138/8.97 GB 4:159/9.69 GB 6:130/8.29 GB 2:151/9.65 GB 0:163/10.41 GB 5:154/10.06 GB 1:157/9.28 GB 3:149/9.11 GB Filter 7 arrival: 593ms Filter 2 arrival: 9s191ms MemoryUsage(500.000ms): 1.35 MB, 3.38 MB, 4.40 MB, 27.24 MB, 27.95 MB, 28.38 MB, 25.95 MB, 29.11 MB, 29.17 MB, 26.04 MB, 25.76 MB, 25.89 MB, 25.87 MB, 25.87 MB, 24.17 MB, 24.75 MB, 25.04 MB, 25.07 MB, 39.61 MB, 39.10 MB ThreadUsage(500.000ms): 1, 1, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 11.80 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 40.44 MB (42407807) - PerHostPeakMemUsage: 1.30 GB (1392321886) - RowsProduced: 35.73M (35731676) - TotalNetworkReceiveTime: 383.404ms - TotalNetworkSendTime: 2s531ms - TotalStorageWaitTime: 10s570ms - TotalThreadsInvoluntaryContextSwitches: 1.96K (1956) - TotalThreadsTotalWallClockTime: 1m58s - TotalThreadsSysTime: 1s424ms - TotalThreadsUserTime: 9s844ms - TotalThreadsVoluntaryContextSwitches: 88.48K (88482) Fragment Instance Lifecycle Timings: - ExecTime: 8s535ms - ExecTreeExecTime: 922.971ms - OpenTime: 1s523ms - ExecTreeOpenTime: 1s355ms - PrepareTime: 45.501ms - ExecTreePrepareTime: 2.730ms DataStreamSender (dst_id=23):(Total: 5s412ms, non-child: 5s412ms, % non-child: 100.00%) - BytesSent: 338.69 MB (355141932) - NetworkThroughput(*): 98.79 MB/sec - OverallThroughput: 62.58 MB/sec - PeakMemoryUsage: 4.73 MB (4955200) - RowsReturned: 35.73M (35731676) - SerializeBatchTime: 1s977ms - TransmitDataRPCTime: 3s428ms - UncompressedRowBatchSize: 1.13 GB (1215331256) CodeGen:(Total: 184.764ms, non-child: 184.764ms, % non-child: 100.00%) - CodegenTime: 858.931us - CompileTime: 50.019ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 90 (90) - NumInstructions: 2.97K (2968) - OptimizationTime: 116.201ms - PeakMemoryUsage: 1.45 MB (1519616) - PrepareTime: 18.144ms HASH_JOIN_NODE (id=11):(Total: 2s271ms, non-child: 796.572ms, % non-child: 35.07%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.492ms - PeakMemoryUsage: 1.27 MB (1333323) - ProbeRows: 35.73M (35731676) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 756.740ms - RowsReturned: 35.73M (35731676) - RowsReturnedRate: 15.73 M/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 27.056us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 156.388us - HashBuckets: 212 (212) - HashCollisions: 0 (0) - HashTablesBuildTime: 51.762us - LargestPartitionPercent: 9 (9) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1073600) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 383.415ms, non-child: 20.830us, % non-child: 0.01%) BytesReceived(500.000ms): 0, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 5.453us - DeserializeRowBatchTimer: 9.258us - FirstBatchArrivalWaitTime: 364.753ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 312.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=9):(Total: 1s091ms, non-child: 1s091ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:138/8.97 GB 4:159/9.69 GB 6:130/8.29 GB 2:151/9.65 GB 0:163/10.41 GB 5:154/10.06 GB 1:157/9.28 GB 3:149/9.11 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 51 out of 51 Runtime filters: Only following filters arrived: 7, waited 422ms Hdfs Read Thread Concurrency Bucket: 0:73.68% 1:15.79% 2:10.53% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1150 PARQUET/SNAPPY:51 BytesRead(500.000ms): 0, 0, 0, 9.62 MB, 12.97 MB, 12.97 MB, 16.41 MB, 20.79 MB, 20.79 MB, 29.75 MB, 29.75 MB, 29.75 MB, 29.75 MB, 29.75 MB, 31.44 MB, 38.25 MB, 39.58 MB, 42.70 MB, 48.55 MB, 48.55 MB - FooterProcessingTime: (Avg: 165.030ms ; Min: 24.794ms ; Max: 623.009ms ; Number of samples: 51) - AverageHdfsReadThreadConcurrency: 0.37 - AverageScannerThreadConcurrency: 11.37 - BytesRead: 48.55 MB (50910272) - BytesReadDataNodeCache: 0 - BytesReadLocal: 48.55 MB (50910272) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 48.55 MB (50910272) - DecompressionTime: 285.744ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 51 (51) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 23.95 MB (25111214) - PerReadThreadRawHdfsThroughput: 24.29 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 547.297ms - RowBatchQueuePutWaitTime: 1m32s - RowsRead: 35.74M (35737790) - RowsReturned: 35.73M (35731676) - RowsReturnedRate: 32.73 M/sec - ScanRangesComplete: 1.20K (1201) - ScannerThreadsInvoluntaryContextSwitches: 1.26K (1259) - ScannerThreadsTotalWallClockTime: 1m48s - MaterializeTupleTime(*): 1s722ms - ScannerThreadsSysTime: 1s181ms - ScannerThreadsUserTime: 3s901ms - ScannerThreadsVoluntaryContextSwitches: 87.88K (87882) - TotalRawHdfsReadTime(*): 1s998ms - TotalReadThroughput: 4.86 MB/sec Filter 2 (16.00 MB): - Rows processed: 85.99K (85986) - Rows rejected: 6.11K (6114) - Rows total: 35.74M (35737790) Filter 7 (1.00 MB): - Files processed: 1.20K (1201) - Files rejected: 1.15K (1150) - Files total: 1.20K (1201) - RowGroups processed: 34.93K (34929) - RowGroups rejected: 0 (0) - RowGroups total: 34.93K (34929) - Rows processed: 835.58K (835584) - Rows rejected: 0 (0) - Rows total: 35.73M (35731676) - Splits processed: 51 (51) - Splits rejected: 0 (0) - Splits total: 51 (51) Instance 7f40dcb034de70b7:106 (host=vd1336.foo:22000):(Total: 10s100ms, non-child: 2s299ms, % non-child: 22.77%) Hdfs split stats (:<# splits>/): 6:166/10.32 GB 7:139/8.82 GB 4:147/9.39 GB 0:135/8.84 GB 3:140/8.63 GB 1:155/9.70 GB 2:148/10.25 GB 5:147/9.58 GB Filter 7 arrival: 635ms Filter 2 arrival: 9s069ms MemoryUsage(500.000ms): 1.38 MB, 3.38 MB, 22.96 MB, 22.81 MB, 23.06 MB, 24.36 MB, 23.99 MB, 24.01 MB, 22.11 MB, 26.08 MB, 26.22 MB, 25.07 MB, 24.65 MB, 23.65 MB, 25.95 MB, 25.10 MB, 24.23 MB, 25.07 MB, 41.49 MB, 26.96 MB ThreadUsage(500.000ms): 2, 1, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 11.85 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 42.58 MB (44649748) - PerHostPeakMemUsage: 1.29 GB (1383859485) - RowsProduced: 37.12M (37120211) - TotalNetworkReceiveTime: 432.308ms - TotalNetworkSendTime: 2s693ms - TotalStorageWaitTime: 5s544ms - TotalThreadsInvoluntaryContextSwitches: 2.74K (2741) - TotalThreadsTotalWallClockTime: 1m58s - TotalThreadsSysTime: 3s331ms - TotalThreadsUserTime: 10s197ms - TotalThreadsVoluntaryContextSwitches: 157.71K (157706) Fragment Instance Lifecycle Timings: - ExecTime: 8s927ms - ExecTreeExecTime: 1s064ms - OpenTime: 1s135ms - ExecTreeOpenTime: 967.500ms - PrepareTime: 37.326ms - ExecTreePrepareTime: 2.650ms DataStreamSender (dst_id=23):(Total: 5s594ms, non-child: 5s594ms, % non-child: 100.00%) - BytesSent: 351.57 MB (368648601) - NetworkThroughput(*): 99.33 MB/sec - OverallThroughput: 62.84 MB/sec - PeakMemoryUsage: 4.77 MB (5004352) - RowsReturned: 37.12M (37120211) - SerializeBatchTime: 2s048ms - TransmitDataRPCTime: 3s539ms - UncompressedRowBatchSize: 1.18 GB (1262559054) CodeGen:(Total: 182.255ms, non-child: 182.255ms, % non-child: 100.00%) - CodegenTime: 891.020us - CompileTime: 50.611ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 90 (90) - NumInstructions: 2.97K (2968) - OptimizationTime: 116.401ms - PeakMemoryUsage: 1.45 MB (1519616) - PrepareTime: 14.854ms HASH_JOIN_NODE (id=11):(Total: 2s024ms, non-child: 931.099ms, % non-child: 46.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.498ms - PeakMemoryUsage: 1.27 MB (1327667) - ProbeRows: 37.12M (37120211) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 881.564ms - RowsReturned: 37.12M (37120211) - RowsReturnedRate: 18.34 M/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 28.305us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 138.933us - HashBuckets: 212 (212) - HashCollisions: 0 (0) - HashTablesBuildTime: 59.558us - LargestPartitionPercent: 9 (9) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1073600) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 432.318ms, non-child: 22.777us, % non-child: 0.01%) BytesReceived(500.000ms): 0, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 4.551us - DeserializeRowBatchTimer: 18.408us - FirstBatchArrivalWaitTime: 405.674ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 277.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=9):(Total: 661.051ms, non-child: 661.051ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 6:166/10.32 GB 7:139/8.82 GB 4:147/9.39 GB 0:135/8.84 GB 3:140/8.63 GB 1:155/9.70 GB 2:148/10.25 GB 5:147/9.58 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 58 out of 58 Runtime filters: Only following filters arrived: 7, waited 381ms Hdfs Read Thread Concurrency Bucket: 0:90% 1:10% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1119 PARQUET/SNAPPY:58 BytesRead(500.000ms): 0, 0, 10.07 MB, 10.07 MB, 10.07 MB, 11.46 MB, 20.60 MB, 20.60 MB, 20.60 MB, 31.61 MB, 31.61 MB, 32.46 MB, 34.59 MB, 34.59 MB, 40.95 MB, 40.95 MB, 45.12 MB, 49.45 MB, 50.31 MB, 51.70 MB - FooterProcessingTime: (Avg: 52.623ms ; Min: 4.844ms ; Max: 157.403ms ; Number of samples: 58) - AverageHdfsReadThreadConcurrency: 0.10 - AverageScannerThreadConcurrency: 10.80 - BytesRead: 51.70 MB (54215841) - BytesReadDataNodeCache: 0 - BytesReadLocal: 51.70 MB (54215841) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 51.70 MB (54215841) - DecompressionTime: 313.786ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 58 (58) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 20.88 MB (21894448) - PerReadThreadRawHdfsThroughput: 23.64 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 146.239ms - RowBatchQueuePutWaitTime: 1m35s - RowsRead: 37.13M (37132368) - RowsReturned: 37.12M (37120211) - RowsReturnedRate: 56.15 M/sec - ScanRangesComplete: 1.18K (1177) - ScannerThreadsInvoluntaryContextSwitches: 2.00K (1997) - ScannerThreadsTotalWallClockTime: 1m47s - MaterializeTupleTime(*): 2s069ms - ScannerThreadsSysTime: 3s055ms - ScannerThreadsUserTime: 4s055ms - ScannerThreadsVoluntaryContextSwitches: 157.09K (157093) - TotalRawHdfsReadTime(*): 2s187ms - TotalReadThroughput: 5.17 MB/sec Filter 2 (16.00 MB): - Rows processed: 170.88K (170877) - Rows rejected: 12.16K (12157) - Rows total: 37.13M (37132368) Filter 7 (1.00 MB): - Files processed: 1.18K (1177) - Files rejected: 1.12K (1119) - Files total: 1.18K (1177) - RowGroups processed: 36.29K (36290) - RowGroups rejected: 0 (0) - RowGroups total: 36.29K (36290) - Rows processed: 950.27K (950272) - Rows rejected: 0 (0) - Rows total: 37.12M (37120211) - Splits processed: 58 (58) - Splits rejected: 0 (0) - Splits total: 58 (58) Instance 7f40dcb034de70b7:17c (host=ve1132.foo:22000):(Total: 10s072ms, non-child: 2s433ms, % non-child: 24.16%) Hdfs split stats (:<# splits>/): 7:154/9.71 GB 2:152/9.57 GB 1:132/8.34 GB 4:152/9.61 GB 5:160/9.76 GB 6:148/9.25 GB 0:143/8.93 GB 3:166/10.27 GB Filter 7 arrival: 492ms MemoryUsage(500.000ms): 1.33 MB, 3.38 MB, 18.02 MB, 24.82 MB, 25.29 MB, 23.08 MB, 27.09 MB, 26.36 MB, 27.93 MB, 27.67 MB, 28.29 MB, 27.42 MB, 27.42 MB, 28.18 MB, 27.89 MB, 28.45 MB, 28.38 MB, 28.96 MB, 28.21 MB, 17.70 MB ThreadUsage(500.000ms): 1, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.40 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 29.75 MB (31199651) - PerHostPeakMemUsage: 1.39 GB (1488360254) - RowsProduced: 38.56M (38560036) - TotalNetworkReceiveTime: 2.774us - TotalNetworkSendTime: 2s257ms - TotalStorageWaitTime: 5s351ms - TotalThreadsInvoluntaryContextSwitches: 2.66K (2659) - TotalThreadsTotalWallClockTime: 2m1s - TotalThreadsSysTime: 3s426ms - TotalThreadsUserTime: 10s794ms - TotalThreadsVoluntaryContextSwitches: 136.96K (136956) Fragment Instance Lifecycle Timings: - ExecTime: 8s921ms - ExecTreeExecTime: 1s019ms - OpenTime: 904.368ms - ExecTreeOpenTime: 639.962ms - PrepareTime: 246.912ms - ExecTreePrepareTime: 7.028ms DataStreamSender (dst_id=23):(Total: 5s689ms, non-child: 5s689ms, % non-child: 100.00%) - BytesSent: 365.69 MB (383455937) - NetworkThroughput(*): 104.13 MB/sec - OverallThroughput: 64.28 MB/sec - PeakMemoryUsage: 4.76 MB (4987968) - RowsReturned: 38.56M (38560036) - SerializeBatchTime: 2s167ms - TransmitDataRPCTime: 3s511ms - UncompressedRowBatchSize: 1.22 GB (1311531368) CodeGen:(Total: 290.340ms, non-child: 290.340ms, % non-child: 100.00%) - CodegenTime: 1.552ms - CompileTime: 78.446ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 90 (90) - NumInstructions: 2.97K (2968) - OptimizationTime: 180.770ms - PeakMemoryUsage: 1.45 MB (1519616) - PrepareTime: 30.531ms HASH_JOIN_NODE (id=11):(Total: 1s659ms, non-child: 863.031ms, % non-child: 52.01%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 2.842ms - PeakMemoryUsage: 1.20 MB (1255232) - ProbeRows: 38.56M (38560036) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 811.688ms - RowsReturned: 38.56M (38560036) - RowsReturnedRate: 23.24 M/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 26.364us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 756.717us - HashBuckets: 212 (212) - HashCollisions: 0 (0) - HashTablesBuildTime: 70.186us - LargestPartitionPercent: 9 (9) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1073600) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 17.426us, non-child: 17.426us, % non-child: 100.00%) BytesReceived(500.000ms): 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 7.630us - DeserializeRowBatchTimer: 12.171us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 6.89 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=9):(Total: 796.452ms, non-child: 796.452ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:154/9.71 GB 2:152/9.57 GB 1:132/8.34 GB 4:152/9.61 GB 5:160/9.76 GB 6:148/9.25 GB 0:143/8.93 GB 3:166/10.27 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 53 out of 53 Runtime filters: Only following filters arrived: 7, waited 523ms Hdfs Read Thread Concurrency Bucket: 0:73.68% 1:15.79% 2:5.263% 3:0% 4:5.263% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1154 PARQUET/SNAPPY:53 BytesRead(500.000ms): 0, 0, 5.28 MB, 11.81 MB, 11.81 MB, 15.19 MB, 21.35 MB, 21.35 MB, 25.83 MB, 30.11 MB, 30.11 MB, 33.44 MB, 33.44 MB, 40.78 MB, 40.78 MB, 42.22 MB, 48.61 MB, 50.10 MB, 50.10 MB, 51.80 MB - FooterProcessingTime: (Avg: 65.391ms ; Min: 4.095ms ; Max: 188.720ms ; Number of samples: 53) - AverageHdfsReadThreadConcurrency: 0.47 - AverageScannerThreadConcurrency: 12.00 - BytesRead: 51.80 MB (54319464) - BytesReadDataNodeCache: 0 - BytesReadLocal: 51.80 MB (54319464) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 51.80 MB (54319464) - DecompressionTime: 340.926ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 53 (53) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 23.93 MB (25089381) - PerReadThreadRawHdfsThroughput: 25.32 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 112.539ms - RowBatchQueuePutWaitTime: 1m35s - RowsRead: 38.56M (38560036) - RowsReturned: 38.56M (38560036) - RowsReturnedRate: 48.41 M/sec - ScanRangesComplete: 1.21K (1207) - ScannerThreadsInvoluntaryContextSwitches: 1.79K (1791) - ScannerThreadsTotalWallClockTime: 1m51s - MaterializeTupleTime(*): 2s079ms - ScannerThreadsSysTime: 3s131ms - ScannerThreadsUserTime: 4s158ms - ScannerThreadsVoluntaryContextSwitches: 136.26K (136257) - TotalRawHdfsReadTime(*): 2s045ms - TotalReadThroughput: 5.18 MB/sec Filter 2 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 38.56M (38560036) Filter 7 (1.00 MB): - Files processed: 1.21K (1207) - Files rejected: 1.15K (1154) - Files total: 1.21K (1207) - RowGroups processed: 37.70K (37699) - RowGroups rejected: 0 (0) - RowGroups total: 37.70K (37699) - Rows processed: 868.35K (868352) - Rows rejected: 0 (0) - Rows total: 38.56M (38560036) - Splits processed: 53 (53) - Splits rejected: 0 (0) - Splits total: 53 (53) Instance 7f40dcb034de70b7:168 (host=vd1120.foo:22000):(Total: 10s009ms, non-child: 2s217ms, % non-child: 22.15%) Hdfs split stats (:<# splits>/): 2:141/8.66 GB 6:143/8.62 GB 1:178/11.22 GB 7:137/8.96 GB 3:157/10.27 GB 4:152/9.43 GB 5:156/9.97 GB 0:142/8.35 GB Filter 7 arrival: 263ms MemoryUsage(500.000ms): 2.79 MB, 3.38 MB, 4.52 MB, 25.98 MB, 25.95 MB, 26.19 MB, 26.93 MB, 27.30 MB, 27.09 MB, 26.04 MB, 26.05 MB, 26.21 MB, 26.42 MB, 24.01 MB, 24.95 MB, 24.15 MB, 20.44 MB, 22.83 MB, 23.26 MB, 14.35 MB ThreadUsage(500.000ms): 1, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.40 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 27.67 MB (29008890) - PerHostPeakMemUsage: 1.35 GB (1445537106) - RowsProduced: 38.02M (38015999) - TotalNetworkReceiveTime: 15.797ms - TotalNetworkSendTime: 2s182ms - TotalStorageWaitTime: 6s886ms - TotalThreadsInvoluntaryContextSwitches: 2.59K (2594) - TotalThreadsTotalWallClockTime: 2m1s - TotalThreadsSysTime: 3s865ms - TotalThreadsUserTime: 10s152ms - TotalThreadsVoluntaryContextSwitches: 145.21K (145205) Fragment Instance Lifecycle Timings: - ExecTime: 8s744ms - ExecTreeExecTime: 1s020ms - OpenTime: 1s210ms - ExecTreeOpenTime: 1s013ms - PrepareTime: 53.984ms - ExecTreePrepareTime: 3.292ms DataStreamSender (dst_id=23):(Total: 5s546ms, non-child: 5s546ms, % non-child: 100.00%) - BytesSent: 360.25 MB (377751219) - NetworkThroughput(*): 105.41 MB/sec - OverallThroughput: 64.95 MB/sec - PeakMemoryUsage: 4.83 MB (5061696) - RowsReturned: 38.02M (38015999) - SerializeBatchTime: 2s121ms - TransmitDataRPCTime: 3s417ms - UncompressedRowBatchSize: 1.20 GB (1293027214) CodeGen:(Total: 217.563ms, non-child: 217.563ms, % non-child: 100.00%) - CodegenTime: 1.097ms - CompileTime: 52.381ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 90 (90) - NumInstructions: 2.97K (2968) - OptimizationTime: 142.602ms - PeakMemoryUsage: 1.45 MB (1519616) - PrepareTime: 22.073ms HASH_JOIN_NODE (id=11):(Total: 2s028ms, non-child: 875.526ms, % non-child: 43.17%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.669ms - PeakMemoryUsage: 1.20 MB (1255232) - ProbeRows: 38.02M (38015999) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 815.387ms - RowsReturned: 38.02M (38015999) - RowsReturnedRate: 18.75 M/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 26.896us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 174.861us - HashBuckets: 212 (212) - HashCollisions: 0 (0) - HashTablesBuildTime: 59.379us - LargestPartitionPercent: 9 (9) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1073600) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 15.807ms, non-child: 18.289us, % non-child: 0.12%) BytesReceived(500.000ms): 0, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 4.483us - DeserializeRowBatchTimer: 18.268us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 7.59 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=9):(Total: 1s136ms, non-child: 1s136ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:141/8.66 GB 6:143/8.62 GB 1:178/11.22 GB 7:137/8.96 GB 3:157/10.27 GB 4:152/9.43 GB 5:156/9.97 GB 0:142/8.35 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 58 out of 58 Runtime filters: Only following filters arrived: 7, waited 743ms Hdfs Read Thread Concurrency Bucket: 0:84.21% 1:15.79% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1148 PARQUET/SNAPPY:58 BytesRead(500.000ms): 0, 0, 0, 11.75 MB, 11.75 MB, 13.44 MB, 19.86 MB, 19.86 MB, 20.71 MB, 30.22 MB, 30.22 MB, 31.14 MB, 31.87 MB, 37.70 MB, 38.54 MB, 38.54 MB, 46.17 MB, 48.59 MB, 50.01 MB, 52.53 MB - FooterProcessingTime: (Avg: 85.946ms ; Min: 3.664ms ; Max: 304.572ms ; Number of samples: 58) - AverageHdfsReadThreadConcurrency: 0.16 - AverageScannerThreadConcurrency: 12.00 - BytesRead: 52.53 MB (55079633) - BytesReadDataNodeCache: 0 - BytesReadLocal: 52.53 MB (55079633) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 52.53 MB (55079633) - DecompressionTime: 302.135ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 58 (58) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 21.87 MB (22930771) - PerReadThreadRawHdfsThroughput: 24.84 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 251.089ms - RowBatchQueuePutWaitTime: 1m33s - RowsRead: 38.02M (38015999) - RowsReturned: 38.02M (38015999) - RowsReturnedRate: 33.44 M/sec - ScanRangesComplete: 1.21K (1206) - ScannerThreadsInvoluntaryContextSwitches: 1.76K (1763) - ScannerThreadsTotalWallClockTime: 1m51s - MaterializeTupleTime(*): 1s991ms - ScannerThreadsSysTime: 3s612ms - ScannerThreadsUserTime: 3s638ms - ScannerThreadsVoluntaryContextSwitches: 144.58K (144583) - TotalRawHdfsReadTime(*): 2s114ms - TotalReadThroughput: 5.25 MB/sec Filter 2 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 38.02M (38015999) Filter 7 (1.00 MB): - Files processed: 1.21K (1206) - Files rejected: 1.15K (1148) - Files total: 1.21K (1206) - RowGroups processed: 37.17K (37174) - RowGroups rejected: 0 (0) - RowGroups total: 37.17K (37174) - Rows processed: 950.27K (950272) - Rows rejected: 0 (0) - Rows total: 38.02M (38015999) - Splits processed: 58 (58) - Splits rejected: 0 (0) - Splits total: 58 (58) Instance 7f40dcb034de70b7:164 (host=vd1129.foo:22000):(Total: 9s978ms, non-child: 1s930ms, % non-child: 19.35%) Hdfs split stats (:<# splits>/): 6:141/9.57 GB 7:155/9.63 GB 2:160/9.64 GB 3:149/9.77 GB 5:157/10.29 GB 1:145/9.20 GB 0:148/8.82 GB 4:143/8.57 GB Filter 7 arrival: 247ms MemoryUsage(500.000ms): 3.38 MB, 3.38 MB, 6.23 MB, 22.36 MB, 22.84 MB, 22.18 MB, 23.87 MB, 23.85 MB, 25.82 MB, 26.89 MB, 27.48 MB, 29.97 MB, 29.97 MB, 30.05 MB, 30.05 MB, 21.98 MB, 28.23 MB, 29.48 MB, 19.98 MB, 12.75 MB ThreadUsage(500.000ms): 1, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.40 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 30.67 MB (32159565) - PerHostPeakMemUsage: 1.35 GB (1451098856) - RowsProduced: 40.06M (40056524) - TotalNetworkReceiveTime: 4.794ms - TotalNetworkSendTime: 2s103ms - TotalStorageWaitTime: 7s580ms - TotalThreadsInvoluntaryContextSwitches: 2.50K (2501) - TotalThreadsTotalWallClockTime: 1m59s - TotalThreadsSysTime: 4s407ms - TotalThreadsUserTime: 10s812ms - TotalThreadsVoluntaryContextSwitches: 236.31K (236309) Fragment Instance Lifecycle Timings: - ExecTime: 8s709ms - ExecTreeExecTime: 1s049ms - OpenTime: 1s208ms - ExecTreeOpenTime: 1s021ms - PrepareTime: 60.467ms - ExecTreePrepareTime: 3.281ms DataStreamSender (dst_id=23):(Total: 5s772ms, non-child: 5s772ms, % non-child: 100.00%) - BytesSent: 379.27 MB (397689724) - NetworkThroughput(*): 105.41 MB/sec - OverallThroughput: 65.70 MB/sec - PeakMemoryUsage: 4.80 MB (5037120) - RowsReturned: 40.06M (40056524) - SerializeBatchTime: 2s167ms - TransmitDataRPCTime: 3s598ms - UncompressedRowBatchSize: 1.27 GB (1362431008) CodeGen:(Total: 210.631ms, non-child: 210.631ms, % non-child: 100.00%) - CodegenTime: 1.079ms - CompileTime: 51.774ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 90 (90) - NumInstructions: 2.97K (2968) - OptimizationTime: 132.675ms - PeakMemoryUsage: 1.45 MB (1519616) - PrepareTime: 25.756ms HASH_JOIN_NODE (id=11):(Total: 2s064ms, non-child: 922.335ms, % non-child: 44.68%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.272ms - PeakMemoryUsage: 1.20 MB (1255232) - ProbeRows: 40.06M (40056524) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 875.899ms - RowsReturned: 40.06M (40056524) - RowsReturnedRate: 19.40 M/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 24.998us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 113.185us - HashBuckets: 212 (212) - HashCollisions: 0 (0) - HashTablesBuildTime: 42.989us - LargestPartitionPercent: 9 (9) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1073600) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 4.804ms, non-child: 15.906us, % non-child: 0.33%) BytesReceived(500.000ms): 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 4.825us - DeserializeRowBatchTimer: 34.794us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 24.98 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=9):(Total: 1s137ms, non-child: 1s137ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 6:141/9.57 GB 7:155/9.63 GB 2:160/9.64 GB 3:149/9.77 GB 5:157/10.29 GB 1:145/9.20 GB 0:148/8.82 GB 4:143/8.57 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 57 out of 57 Runtime filters: Only following filters arrived: 7, waited 763ms Hdfs Read Thread Concurrency Bucket: 0:80% 1:0% 2:15% 3:5% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1141 PARQUET/SNAPPY:57 BytesRead(500.000ms): 0, 0, 400.00 KB, 9.55 MB, 11.19 MB, 12.88 MB, 21.57 MB, 22.39 MB, 29.56 MB, 33.48 MB, 34.61 MB, 40.24 MB, 40.24 MB, 41.06 MB, 41.88 MB, 44.43 MB, 50.34 MB, 52.61 MB, 54.27 MB, 54.27 MB - FooterProcessingTime: (Avg: 92.851ms ; Min: 3.195ms ; Max: 327.410ms ; Number of samples: 57) - AverageHdfsReadThreadConcurrency: 0.45 - AverageScannerThreadConcurrency: 11.40 - BytesRead: 54.27 MB (56908553) - BytesReadDataNodeCache: 0 - BytesReadLocal: 54.27 MB (56908553) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 54.27 MB (56908553) - DecompressionTime: 330.012ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 57 (57) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 24.90 MB (26105778) - PerReadThreadRawHdfsThroughput: 22.82 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 249.824ms - RowBatchQueuePutWaitTime: 1m30s - RowsRead: 40.06M (40056524) - RowsReturned: 40.06M (40056524) - RowsReturnedRate: 35.23 M/sec - ScanRangesComplete: 1.20K (1198) - ScannerThreadsInvoluntaryContextSwitches: 1.74K (1742) - ScannerThreadsTotalWallClockTime: 1m50s - MaterializeTupleTime(*): 1s960ms - ScannerThreadsSysTime: 4s177ms - ScannerThreadsUserTime: 4s235ms - ScannerThreadsVoluntaryContextSwitches: 235.68K (235681) - TotalRawHdfsReadTime(*): 2s377ms - TotalReadThroughput: 5.43 MB/sec Filter 2 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 40.06M (40056524) Filter 7 (1.00 MB): - Files processed: 1.20K (1198) - Files rejected: 1.14K (1141) - Files total: 1.20K (1198) - RowGroups processed: 39.16K (39164) - RowGroups rejected: 0 (0) - RowGroups total: 39.16K (39164) - Rows processed: 933.89K (933888) - Rows rejected: 0 (0) - Rows total: 40.06M (40056524) - Splits processed: 57 (57) - Splits rejected: 0 (0) - Splits total: 57 (57) Instance 7f40dcb034de70b7:150 (host=vd1340.foo:22000):(Total: 9s930ms, non-child: 2s068ms, % non-child: 20.83%) Hdfs split stats (:<# splits>/): 3:147/9.81 GB 5:153/9.56 GB 0:140/9.12 GB 7:155/10.08 GB 2:131/7.91 GB 4:147/10.12 GB 6:145/9.52 GB 1:143/9.34 GB Filter 7 arrival: 357ms MemoryUsage(500.000ms): 2.79 MB, 3.38 MB, 17.87 MB, 27.03 MB, 27.24 MB, 26.70 MB, 28.05 MB, 28.07 MB, 27.48 MB, 27.21 MB, 26.95 MB, 25.99 MB, 27.50 MB, 26.98 MB, 27.14 MB, 27.30 MB, 26.87 MB, 26.90 MB, 22.20 MB, 12.94 MB ThreadUsage(500.000ms): 1, 1, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 11.80 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 28.84 MB (30237255) - PerHostPeakMemUsage: 1.26 GB (1356019687) - RowsProduced: 38.96M (38955685) - TotalNetworkReceiveTime: 114.028ms - TotalNetworkSendTime: 2s396ms - TotalStorageWaitTime: 6s047ms - TotalThreadsInvoluntaryContextSwitches: 2.31K (2311) - TotalThreadsTotalWallClockTime: 1m58s - TotalThreadsSysTime: 3s653ms - TotalThreadsUserTime: 10s542ms - TotalThreadsVoluntaryContextSwitches: 243.85K (243854) Fragment Instance Lifecycle Timings: - ExecTime: 8s826ms - ExecTreeExecTime: 1s008ms - OpenTime: 1s046ms - ExecTreeOpenTime: 857.427ms - PrepareTime: 58.199ms - ExecTreePrepareTime: 3.348ms DataStreamSender (dst_id=23):(Total: 5s789ms, non-child: 5s789ms, % non-child: 100.00%) - BytesSent: 368.82 MB (386741019) - NetworkThroughput(*): 101.26 MB/sec - OverallThroughput: 63.71 MB/sec - PeakMemoryUsage: 4.73 MB (4963392) - RowsReturned: 38.96M (38955685) - SerializeBatchTime: 2s139ms - TransmitDataRPCTime: 3s642ms - UncompressedRowBatchSize: 1.23 GB (1324988538) CodeGen:(Total: 213.494ms, non-child: 213.494ms, % non-child: 100.00%) - CodegenTime: 1.186ms - CompileTime: 52.970ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 90 (90) - NumInstructions: 2.97K (2968) - OptimizationTime: 134.169ms - PeakMemoryUsage: 1.45 MB (1519616) - PrepareTime: 25.886ms HASH_JOIN_NODE (id=11):(Total: 1s859ms, non-child: 876.700ms, % non-child: 47.15%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.339ms - PeakMemoryUsage: 1.20 MB (1255232) - ProbeRows: 38.96M (38955685) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 833.784ms - RowsReturned: 38.96M (38955685) - RowsReturnedRate: 20.95 M/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 33.374us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 173.139us - HashBuckets: 212 (212) - HashCollisions: 0 (0) - HashTablesBuildTime: 41.045us - LargestPartitionPercent: 9 (9) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1073600) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 114.037ms, non-child: 18.312us, % non-child: 0.02%) BytesReceived(500.000ms): 0, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 4.855us - DeserializeRowBatchTimer: 25.529us - FirstBatchArrivalWaitTime: 89.526ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 1.05 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=9):(Total: 868.932ms, non-child: 868.932ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:147/9.81 GB 5:153/9.56 GB 0:140/9.12 GB 7:155/10.08 GB 2:131/7.91 GB 4:147/10.12 GB 6:145/9.52 GB 1:143/9.34 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 53 out of 53 Runtime filters: Only following filters arrived: 7, waited 644ms Hdfs Read Thread Concurrency Bucket: 0:89.47% 1:10.53% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1108 PARQUET/SNAPPY:53 BytesRead(500.000ms): 0, 0, 4.51 MB, 12.91 MB, 13.74 MB, 15.47 MB, 20.11 MB, 20.11 MB, 21.80 MB, 28.84 MB, 29.68 MB, 33.66 MB, 36.17 MB, 39.64 MB, 39.64 MB, 40.49 MB, 49.19 MB, 49.19 MB, 52.30 MB, 52.30 MB - FooterProcessingTime: (Avg: 61.353ms ; Min: 15.885ms ; Max: 316.948ms ; Number of samples: 53) - AverageHdfsReadThreadConcurrency: 0.11 - AverageScannerThreadConcurrency: 11.37 - BytesRead: 52.30 MB (54839692) - BytesReadDataNodeCache: 0 - BytesReadLocal: 52.30 MB (54839692) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 52.30 MB (54839692) - DecompressionTime: 325.435ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 53 (53) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 22.95 MB (24067878) - PerReadThreadRawHdfsThroughput: 26.13 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 96.377ms - RowBatchQueuePutWaitTime: 1m32s - RowsRead: 38.96M (38955685) - RowsReturned: 38.96M (38955685) - RowsReturnedRate: 44.83 M/sec - ScanRangesComplete: 1.16K (1161) - ScannerThreadsInvoluntaryContextSwitches: 1.57K (1570) - ScannerThreadsTotalWallClockTime: 1m48s - MaterializeTupleTime(*): 1s929ms - ScannerThreadsSysTime: 3s417ms - ScannerThreadsUserTime: 4s142ms - ScannerThreadsVoluntaryContextSwitches: 243.23K (243231) - TotalRawHdfsReadTime(*): 2s001ms - TotalReadThroughput: 5.23 MB/sec Filter 2 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 38.96M (38955685) Filter 7 (1.00 MB): - Files processed: 1.16K (1161) - Files rejected: 1.11K (1108) - Files total: 1.16K (1161) - RowGroups processed: 38.09K (38085) - RowGroups rejected: 0 (0) - RowGroups total: 38.09K (38085) - Rows processed: 868.35K (868352) - Rows rejected: 0 (0) - Rows total: 38.96M (38955685) - Splits processed: 53 (53) - Splits rejected: 0 (0) - Splits total: 53 (53) Instance 7f40dcb034de70b7:158 (host=ve1131.foo:22000):(Total: 9s921ms, non-child: 2s171ms, % non-child: 21.89%) Hdfs split stats (:<# splits>/): 2:154/10.06 GB 1:145/8.52 GB 6:149/9.86 GB 7:157/10.34 GB 4:140/8.82 GB 0:151/9.57 GB 5:154/9.83 GB 3:125/8.51 GB Filter 7 arrival: 324ms MemoryUsage(500.000ms): 1.38 MB, 3.38 MB, 16.30 MB, 26.07 MB, 26.31 MB, 24.89 MB, 28.01 MB, 28.25 MB, 25.10 MB, 25.86 MB, 26.24 MB, 26.67 MB, 26.67 MB, 26.89 MB, 26.02 MB, 23.15 MB, 25.20 MB, 25.26 MB, 20.53 MB, 10.43 MB ThreadUsage(500.000ms): 2, 1, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 11.85 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 28.68 MB (30078044) - PerHostPeakMemUsage: 1.30 GB (1399797083) - RowsProduced: 38.34M (38341570) - TotalNetworkReceiveTime: 104.013ms - TotalNetworkSendTime: 2s202ms - TotalStorageWaitTime: 6s724ms - TotalThreadsInvoluntaryContextSwitches: 2.25K (2247) - TotalThreadsTotalWallClockTime: 1m55s - TotalThreadsSysTime: 3s609ms - TotalThreadsUserTime: 10s109ms - TotalThreadsVoluntaryContextSwitches: 171.21K (171212) Fragment Instance Lifecycle Timings: - ExecTime: 8s840ms - ExecTreeExecTime: 992.011ms - OpenTime: 1s030ms - ExecTreeOpenTime: 857.869ms - PrepareTime: 50.661ms - ExecTreePrepareTime: 3.007ms DataStreamSender (dst_id=23):(Total: 5s713ms, non-child: 5s713ms, % non-child: 100.00%) - BytesSent: 363.16 MB (380805146) - NetworkThroughput(*): 103.51 MB/sec - OverallThroughput: 63.56 MB/sec - PeakMemoryUsage: 4.77 MB (5004352) - RowsReturned: 38.34M (38341570) - SerializeBatchTime: 2s197ms - TransmitDataRPCTime: 3s508ms - UncompressedRowBatchSize: 1.21 GB (1304100764) CodeGen:(Total: 194.470ms, non-child: 194.470ms, % non-child: 100.00%) - CodegenTime: 1.040ms - CompileTime: 50.078ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 90 (90) - NumInstructions: 2.97K (2968) - OptimizationTime: 120.817ms - PeakMemoryUsage: 1.45 MB (1519616) - PrepareTime: 23.120ms HASH_JOIN_NODE (id=11):(Total: 1s841ms, non-child: 854.382ms, % non-child: 46.39%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.356ms - PeakMemoryUsage: 1.20 MB (1255232) - ProbeRows: 38.34M (38341570) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 797.301ms - RowsReturned: 38.34M (38341570) - RowsReturnedRate: 20.82 M/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 25.899us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 103.309us - HashBuckets: 212 (212) - HashCollisions: 0 (0) - HashTablesBuildTime: 55.601us - LargestPartitionPercent: 9 (9) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1073600) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 104.023ms, non-child: 20.397us, % non-child: 0.02%) BytesReceived(500.000ms): 0, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 4.350us - DeserializeRowBatchTimer: 11.744us - FirstBatchArrivalWaitTime: 81.019ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 1.15 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=9):(Total: 883.623ms, non-child: 883.623ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:154/10.06 GB 1:145/8.52 GB 6:149/9.86 GB 7:157/10.34 GB 4:140/8.82 GB 0:151/9.57 GB 5:154/9.83 GB 3:125/8.51 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 58 out of 58 Runtime filters: Only following filters arrived: 7, waited 683ms Hdfs Read Thread Concurrency Bucket: 0:80% 1:10% 2:10% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1117 PARQUET/SNAPPY:58 BytesRead(500.000ms): 0, 0, 4.56 MB, 12.56 MB, 12.56 MB, 15.20 MB, 21.51 MB, 21.51 MB, 29.10 MB, 30.34 MB, 30.34 MB, 32.04 MB, 32.04 MB, 39.83 MB, 40.65 MB, 40.65 MB, 48.20 MB, 49.02 MB, 51.64 MB, 52.96 MB - FooterProcessingTime: (Avg: 63.293ms ; Min: 21.567ms ; Max: 319.301ms ; Number of samples: 58) - AverageHdfsReadThreadConcurrency: 0.30 - AverageScannerThreadConcurrency: 10.80 - BytesRead: 52.96 MB (55532120) - BytesReadDataNodeCache: 0 - BytesReadLocal: 52.96 MB (55532120) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 52.96 MB (55532120) - DecompressionTime: 311.167ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 58 (58) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 22.92 MB (24033861) - PerReadThreadRawHdfsThroughput: 25.88 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 63.405ms - RowBatchQueuePutWaitTime: 1m32s - RowsRead: 38.34M (38341570) - RowsReturned: 38.34M (38341570) - RowsReturnedRate: 43.39 M/sec - ScanRangesComplete: 1.18K (1175) - ScannerThreadsInvoluntaryContextSwitches: 1.41K (1409) - ScannerThreadsTotalWallClockTime: 1m45s - MaterializeTupleTime(*): 1s913ms - ScannerThreadsSysTime: 3s350ms - ScannerThreadsUserTime: 3s547ms - ScannerThreadsVoluntaryContextSwitches: 170.60K (170599) - TotalRawHdfsReadTime(*): 2s046ms - TotalReadThroughput: 5.30 MB/sec Filter 2 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 38.34M (38341570) Filter 7 (1.00 MB): - Files processed: 1.18K (1175) - Files rejected: 1.12K (1117) - Files total: 1.18K (1175) - RowGroups processed: 37.49K (37490) - RowGroups rejected: 0 (0) - RowGroups total: 37.49K (37490) - Rows processed: 950.27K (950272) - Rows rejected: 0 (0) - Rows total: 38.34M (38341570) - Splits processed: 58 (58) - Splits rejected: 0 (0) - Splits total: 58 (58) Instance 7f40dcb034de70b7:163 (host=vc1501.foo:22000):(Total: 9s910ms, non-child: 2s058ms, % non-child: 20.77%) Hdfs split stats (:<# splits>/): 7:140/9.12 GB 2:147/9.86 GB 0:145/8.92 GB 1:131/8.04 GB 4:135/8.94 GB 6:146/9.40 GB 3:177/11.60 GB 5:154/9.58 GB Filter 7 arrival: 266ms MemoryUsage(500.000ms): 2.79 MB, 3.38 MB, 4.52 MB, 25.98 MB, 25.08 MB, 25.41 MB, 29.15 MB, 29.10 MB, 26.91 MB, 28.01 MB, 28.16 MB, 26.22 MB, 25.10 MB, 25.86 MB, 26.19 MB, 26.05 MB, 27.76 MB, 28.45 MB, 20.98 MB, 18.01 MB ThreadUsage(500.000ms): 1, 1, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 11.80 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 29.81 MB (31261365) - PerHostPeakMemUsage: 1.36 GB (1459170546) - RowsProduced: 39.61M (39610581) - TotalNetworkReceiveTime: 32.043ms - TotalNetworkSendTime: 2s225ms - TotalStorageWaitTime: 7s232ms - TotalThreadsInvoluntaryContextSwitches: 2.94K (2935) - TotalThreadsTotalWallClockTime: 1m59s - TotalThreadsSysTime: 2s621ms - TotalThreadsUserTime: 10s288ms - TotalThreadsVoluntaryContextSwitches: 161.33K (161334) Fragment Instance Lifecycle Timings: - ExecTime: 8s616ms - ExecTreeExecTime: 1s058ms - OpenTime: 1s236ms - ExecTreeOpenTime: 1s054ms - PrepareTime: 57.055ms - ExecTreePrepareTime: 3.571ms DataStreamSender (dst_id=23):(Total: 5s544ms, non-child: 5s544ms, % non-child: 100.00%) - BytesSent: 375.68 MB (393933109) - NetworkThroughput(*): 108.92 MB/sec - OverallThroughput: 67.76 MB/sec - PeakMemoryUsage: 4.74 MB (4971584) - RowsReturned: 39.61M (39610581) - SerializeBatchTime: 2s088ms - TransmitDataRPCTime: 3s449ms - UncompressedRowBatchSize: 1.25 GB (1347263290) CodeGen:(Total: 201.073ms, non-child: 201.073ms, % non-child: 100.00%) - CodegenTime: 1.056ms - CompileTime: 50.550ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 90 (90) - NumInstructions: 2.97K (2968) - OptimizationTime: 129.145ms - PeakMemoryUsage: 1.45 MB (1519616) - PrepareTime: 20.875ms HASH_JOIN_NODE (id=11):(Total: 2s105ms, non-child: 897.863ms, % non-child: 42.63%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.267ms - PeakMemoryUsage: 1.20 MB (1255232) - ProbeRows: 39.61M (39610581) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 843.470ms - RowsReturned: 39.61M (39610581) - RowsReturnedRate: 18.81 M/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 24.774us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 89.554us - HashBuckets: 212 (212) - HashCollisions: 0 (0) - HashTablesBuildTime: 41.812us - LargestPartitionPercent: 9 (9) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1073600) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 32.055ms, non-child: 20.067us, % non-child: 0.06%) BytesReceived(500.000ms): 0, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 6.405us - DeserializeRowBatchTimer: 16.786us - FirstBatchArrivalWaitTime: 12.842ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 3.74 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=9):(Total: 1s176ms, non-child: 1s176ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:140/9.12 GB 2:147/9.86 GB 0:145/8.92 GB 1:131/8.04 GB 4:135/8.94 GB 6:146/9.40 GB 3:177/11.60 GB 5:154/9.58 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 55 out of 55 Runtime filters: Only following filters arrived: 7, waited 743ms Hdfs Read Thread Concurrency Bucket: 0:94.74% 1:5.263% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1120 PARQUET/SNAPPY:55 BytesRead(500.000ms): 0, 0, 0, 12.35 MB, 12.35 MB, 13.19 MB, 21.64 MB, 21.64 MB, 22.49 MB, 28.83 MB, 28.83 MB, 33.60 MB, 33.70 MB, 39.22 MB, 39.22 MB, 41.58 MB, 49.34 MB, 50.17 MB, 53.53 MB, 53.53 MB - FooterProcessingTime: (Avg: 94.144ms ; Min: 22.220ms ; Max: 323.304ms ; Number of samples: 55) - AverageHdfsReadThreadConcurrency: 0.05 - AverageScannerThreadConcurrency: 11.37 - BytesRead: 53.53 MB (56132511) - BytesReadDataNodeCache: 0 - BytesReadLocal: 53.53 MB (56132511) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 53.53 MB (56132511) - DecompressionTime: 322.385ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 55 (55) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 23.97 MB (25132944) - PerReadThreadRawHdfsThroughput: 23.12 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 276.010ms - RowBatchQueuePutWaitTime: 1m32s - RowsRead: 39.61M (39610581) - RowsReturned: 39.61M (39610581) - RowsReturnedRate: 33.67 M/sec - ScanRangesComplete: 1.18K (1175) - ScannerThreadsInvoluntaryContextSwitches: 1.74K (1739) - ScannerThreadsTotalWallClockTime: 1m49s - MaterializeTupleTime(*): 1s911ms - ScannerThreadsSysTime: 2s367ms - ScannerThreadsUserTime: 3s983ms - ScannerThreadsVoluntaryContextSwitches: 160.72K (160723) - TotalRawHdfsReadTime(*): 2s315ms - TotalReadThroughput: 5.35 MB/sec Filter 2 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 39.61M (39610581) Filter 7 (1.00 MB): - Files processed: 1.18K (1175) - Files rejected: 1.12K (1120) - Files total: 1.18K (1175) - RowGroups processed: 38.73K (38727) - RowGroups rejected: 0 (0) - RowGroups total: 38.73K (38727) - Rows processed: 901.12K (901120) - Rows rejected: 0 (0) - Rows total: 39.61M (39610581) - Splits processed: 55 (55) - Splits rejected: 0 (0) - Splits total: 55 (55) Instance 7f40dcb034de70b7:169 (host=ve1142.foo:22000):(Total: 9s891ms, non-child: 2s287ms, % non-child: 23.12%) Hdfs split stats (:<# splits>/): 6:159/9.96 GB 3:135/8.30 GB 5:160/10.40 GB 2:146/8.92 GB 0:151/9.16 GB 4:165/10.78 GB 1:143/9.01 GB 7:150/8.96 GB Filter 7 arrival: 249ms MemoryUsage(500.000ms): 3.38 MB, 3.38 MB, 22.42 MB, 24.06 MB, 24.17 MB, 22.22 MB, 25.99 MB, 25.82 MB, 27.21 MB, 23.67 MB, 25.99 MB, 26.11 MB, 26.00 MB, 26.97 MB, 26.82 MB, 26.31 MB, 25.93 MB, 25.97 MB, 23.85 MB ThreadUsage(500.000ms): 1, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.37 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 27.72 MB (29068177) - PerHostPeakMemUsage: 1.35 GB (1447344975) - RowsProduced: 36.38M (36381964) - TotalNetworkReceiveTime: 15.439ms - TotalNetworkSendTime: 2s653ms - TotalStorageWaitTime: 6s844ms - TotalThreadsInvoluntaryContextSwitches: 1.89K (1885) - TotalThreadsTotalWallClockTime: 1m59s - TotalThreadsSysTime: 2s539ms - TotalThreadsUserTime: 8s986ms - TotalThreadsVoluntaryContextSwitches: 97.22K (97217) Fragment Instance Lifecycle Timings: - ExecTime: 8s631ms - ExecTreeExecTime: 937.634ms - OpenTime: 1s205ms - ExecTreeOpenTime: 1s021ms - PrepareTime: 54.727ms - ExecTreePrepareTime: 3.315ms DataStreamSender (dst_id=23):(Total: 5s445ms, non-child: 5s445ms, % non-child: 100.00%) - BytesSent: 344.77 MB (361522195) - NetworkThroughput(*): 99.90 MB/sec - OverallThroughput: 63.31 MB/sec - PeakMemoryUsage: 4.79 MB (5020736) - RowsReturned: 36.38M (36381964) - SerializeBatchTime: 1s987ms - TransmitDataRPCTime: 3s451ms - UncompressedRowBatchSize: 1.15 GB (1237449312) CodeGen:(Total: 204.037ms, non-child: 204.037ms, % non-child: 100.00%) - CodegenTime: 1.035ms - CompileTime: 52.696ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 90 (90) - NumInstructions: 2.97K (2968) - OptimizationTime: 128.799ms - PeakMemoryUsage: 1.45 MB (1519616) - PrepareTime: 22.124ms HASH_JOIN_NODE (id=11):(Total: 1s954ms, non-child: 808.379ms, % non-child: 41.37%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.569ms - PeakMemoryUsage: 1.20 MB (1255232) - ProbeRows: 36.38M (36381964) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 765.274ms - RowsReturned: 36.38M (36381964) - RowsReturnedRate: 18.62 M/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 37.460us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 129.680us - HashBuckets: 212 (212) - HashCollisions: 0 (0) - HashTablesBuildTime: 72.776us - LargestPartitionPercent: 9 (9) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1073600) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 15.451ms, non-child: 19.532us, % non-child: 0.13%) BytesReceived(500.000ms): 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 4.119us - DeserializeRowBatchTimer: 15.345us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 7.77 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=9):(Total: 1s130ms, non-child: 1s130ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 6:159/9.96 GB 3:135/8.30 GB 5:160/10.40 GB 2:146/8.92 GB 0:151/9.16 GB 4:165/10.78 GB 1:143/9.01 GB 7:150/8.96 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 55 out of 55 Runtime filters: Only following filters arrived: 7, waited 763ms Hdfs Read Thread Concurrency Bucket: 0:94.74% 1:5.263% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1154 PARQUET/SNAPPY:55 BytesRead(500.000ms): 0, 0, 9.48 MB, 10.88 MB, 10.88 MB, 11.73 MB, 21.27 MB, 21.27 MB, 22.70 MB, 26.91 MB, 30.28 MB, 30.28 MB, 30.28 MB, 40.39 MB, 41.21 MB, 42.06 MB, 48.00 MB, 49.34 MB, 50.18 MB - FooterProcessingTime: (Avg: 90.514ms ; Min: 21.377ms ; Max: 318.140ms ; Number of samples: 55) - AverageHdfsReadThreadConcurrency: 0.05 - AverageScannerThreadConcurrency: 11.37 - BytesRead: 50.18 MB (52619156) - BytesReadDataNodeCache: 0 - BytesReadLocal: 50.18 MB (52619156) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 50.18 MB (52619156) - DecompressionTime: 283.837ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 55 (55) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 21.90 MB (22968574) - PerReadThreadRawHdfsThroughput: 23.64 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 238.950ms - RowBatchQueuePutWaitTime: 1m33s - RowsRead: 36.38M (36381964) - RowsReturned: 36.38M (36381964) - RowsReturnedRate: 32.18 M/sec - ScanRangesComplete: 1.21K (1209) - ScannerThreadsInvoluntaryContextSwitches: 1.16K (1155) - ScannerThreadsTotalWallClockTime: 1m49s - MaterializeTupleTime(*): 1s787ms - ScannerThreadsSysTime: 2s298ms - ScannerThreadsUserTime: 3s050ms - ScannerThreadsVoluntaryContextSwitches: 96.53K (96534) - TotalRawHdfsReadTime(*): 2s122ms - TotalReadThroughput: 5.28 MB/sec Filter 2 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 36.38M (36381964) Filter 7 (1.00 MB): - Files processed: 1.21K (1209) - Files rejected: 1.15K (1154) - Files total: 1.21K (1209) - RowGroups processed: 35.58K (35575) - RowGroups rejected: 0 (0) - RowGroups total: 35.58K (35575) - Rows processed: 901.12K (901120) - Rows rejected: 0 (0) - Rows total: 36.38M (36381964) - Splits processed: 55 (55) - Splits rejected: 0 (0) - Splits total: 55 (55) Instance 7f40dcb034de70b7:110 (host=vd1110.foo:22000):(Total: 9s890ms, non-child: 2s252ms, % non-child: 22.78%) Hdfs split stats (:<# splits>/): 5:148/9.70 GB 2:147/9.12 GB 6:152/8.72 GB 1:160/9.85 GB 3:159/9.53 GB 4:140/9.03 GB 7:155/10.43 GB 0:145/9.15 GB Filter 7 arrival: 582ms Filter 2 arrival: 9s164ms MemoryUsage(500.000ms): 1.38 MB, 3.38 MB, 25.72 MB, 26.03 MB, 25.39 MB, 24.98 MB, 28.81 MB, 29.29 MB, 29.34 MB, 28.66 MB, 28.24 MB, 26.20 MB, 25.86 MB, 26.10 MB, 26.21 MB, 26.11 MB, 26.06 MB, 25.09 MB, 34.14 MB ThreadUsage(500.000ms): 2, 1, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 11.79 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 41.85 MB (43883573) - PerHostPeakMemUsage: 1.27 GB (1361822118) - RowsProduced: 37.99M (37985316) - TotalNetworkReceiveTime: 370.228ms - TotalNetworkSendTime: 2s336ms - TotalStorageWaitTime: 5s796ms - TotalThreadsInvoluntaryContextSwitches: 2.37K (2373) - TotalThreadsTotalWallClockTime: 1m56s - TotalThreadsSysTime: 2s581ms - TotalThreadsUserTime: 10s127ms - TotalThreadsVoluntaryContextSwitches: 166.22K (166217) Fragment Instance Lifecycle Timings: - ExecTime: 8s726ms - ExecTreeExecTime: 958.692ms - OpenTime: 1s124ms - ExecTreeOpenTime: 950.514ms - PrepareTime: 39.706ms - ExecTreePrepareTime: 2.801ms DataStreamSender (dst_id=23):(Total: 5s547ms, non-child: 5s547ms, % non-child: 100.00%) - BytesSent: 360.31 MB (377816818) - NetworkThroughput(*): 104.65 MB/sec - OverallThroughput: 64.95 MB/sec - PeakMemoryUsage: 4.80 MB (5028928) - RowsReturned: 37.99M (37985316) - SerializeBatchTime: 2s097ms - TransmitDataRPCTime: 3s442ms - UncompressedRowBatchSize: 1.20 GB (1291983648) CodeGen:(Total: 188.547ms, non-child: 188.547ms, % non-child: 100.00%) - CodegenTime: 923.326us - CompileTime: 51.481ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 90 (90) - NumInstructions: 2.97K (2968) - OptimizationTime: 120.955ms - PeakMemoryUsage: 1.45 MB (1519616) - PrepareTime: 15.668ms HASH_JOIN_NODE (id=11):(Total: 1s901ms, non-child: 820.918ms, % non-child: 43.17%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.671ms - PeakMemoryUsage: 1.24 MB (1303845) - ProbeRows: 37.99M (37985316) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 765.522ms - RowsReturned: 37.99M (37985316) - RowsReturnedRate: 19.98 M/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 30.143us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 152.865us - HashBuckets: 212 (212) - HashCollisions: 0 (0) - HashTablesBuildTime: 59.161us - LargestPartitionPercent: 9 (9) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1073600) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 370.239ms, non-child: 21.413us, % non-child: 0.01%) BytesReceived(500.000ms): 0, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 5.155us - DeserializeRowBatchTimer: 13.445us - FirstBatchArrivalWaitTime: 363.210ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 324.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=9):(Total: 710.619ms, non-child: 710.619ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:148/9.70 GB 2:147/9.12 GB 6:152/8.72 GB 1:160/9.85 GB 3:159/9.53 GB 4:140/9.03 GB 7:155/10.43 GB 0:145/9.15 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 53 out of 53 Runtime filters: Only following filters arrived: 7, waited 422ms Hdfs Read Thread Concurrency Bucket: 0:89.47% 1:10.53% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1153 PARQUET/SNAPPY:53 BytesRead(500.000ms): 0, 0, 10.48 MB, 11.81 MB, 11.91 MB, 13.33 MB, 21.06 MB, 21.06 MB, 23.30 MB, 30.79 MB, 31.63 MB, 38.37 MB, 38.37 MB, 38.37 MB, 38.37 MB, 40.73 MB, 48.77 MB, 48.77 MB, 51.31 MB - FooterProcessingTime: (Avg: 56.186ms ; Min: 4.395ms ; Max: 146.690ms ; Number of samples: 53) - AverageHdfsReadThreadConcurrency: 0.11 - AverageScannerThreadConcurrency: 10.74 - BytesRead: 51.31 MB (53802660) - BytesReadDataNodeCache: 0 - BytesReadLocal: 51.31 MB (53802660) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 51.31 MB (53802660) - DecompressionTime: 330.099ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 53 (53) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 23.95 MB (25114582) - PerReadThreadRawHdfsThroughput: 24.89 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 154.240ms - RowBatchQueuePutWaitTime: 1m33s - RowsRead: 37.99M (37993964) - RowsReturned: 37.99M (37985316) - RowsReturnedRate: 53.45 M/sec - ScanRangesComplete: 1.21K (1206) - ScannerThreadsInvoluntaryContextSwitches: 1.57K (1570) - ScannerThreadsTotalWallClockTime: 1m45s - MaterializeTupleTime(*): 1s993ms - ScannerThreadsSysTime: 2s353ms - ScannerThreadsUserTime: 3s795ms - ScannerThreadsVoluntaryContextSwitches: 165.60K (165603) - TotalRawHdfsReadTime(*): 2s061ms - TotalReadThroughput: 5.40 MB/sec Filter 2 (16.00 MB): - Rows processed: 120.09K (120090) - Rows rejected: 8.65K (8648) - Rows total: 37.99M (37993964) Filter 7 (1.00 MB): - Files processed: 1.21K (1206) - Files rejected: 1.15K (1153) - Files total: 1.21K (1206) - RowGroups processed: 37.13K (37131) - RowGroups rejected: 0 (0) - RowGroups total: 37.13K (37131) - Rows processed: 868.35K (868352) - Rows rejected: 0 (0) - Rows total: 37.99M (37985316) - Splits processed: 53 (53) - Splits rejected: 0 (0) - Splits total: 53 (53) Instance 7f40dcb034de70b7:179 (host=vd1337.foo:22000):(Total: 9s884ms, non-child: 1s930ms, % non-child: 19.53%) Hdfs split stats (:<# splits>/): 2:138/9.08 GB 7:168/10.45 GB 0:146/9.09 GB 5:148/9.45 GB 3:152/9.16 GB 6:157/10.79 GB 4:134/8.62 GB 1:155/8.85 GB Filter 7 arrival: 236ms MemoryUsage(500.000ms): 42.25 KB, 3.38 MB, 3.38 MB, 25.03 MB, 25.08 MB, 24.25 MB, 25.77 MB, 26.04 MB, 25.15 MB, 26.03 MB, 25.34 MB, 28.09 MB, 27.71 MB, 28.11 MB, 27.94 MB, 28.25 MB, 28.07 MB, 27.96 MB, 26.04 MB, 17.77 MB ThreadUsage(500.000ms): 1, 1, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 11.80 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 29.08 MB (30497811) - PerHostPeakMemUsage: 1.36 GB (1461945260) - RowsProduced: 39.40M (39402577) - TotalNetworkReceiveTime: 5.606us - TotalNetworkSendTime: 1s817ms - TotalStorageWaitTime: 5s751ms - TotalThreadsInvoluntaryContextSwitches: 2.69K (2694) - TotalThreadsTotalWallClockTime: 2m - TotalThreadsSysTime: 3s853ms - TotalThreadsUserTime: 10s825ms - TotalThreadsVoluntaryContextSwitches: 190.06K (190057) Fragment Instance Lifecycle Timings: - ExecTime: 8s705ms - ExecTreeExecTime: 1s054ms - OpenTime: 1s123ms - ExecTreeOpenTime: 937.956ms - PrepareTime: 55.321ms - ExecTreePrepareTime: 3.410ms DataStreamSender (dst_id=23):(Total: 5s765ms, non-child: 5s765ms, % non-child: 100.00%) - BytesSent: 373.61 MB (391757180) - NetworkThroughput(*): 107.18 MB/sec - OverallThroughput: 64.80 MB/sec - PeakMemoryUsage: 4.70 MB (4930624) - RowsReturned: 39.40M (39402577) - SerializeBatchTime: 2s272ms - TransmitDataRPCTime: 3s485ms - UncompressedRowBatchSize: 1.25 GB (1340188538) CodeGen:(Total: 203.499ms, non-child: 203.499ms, % non-child: 100.00%) - CodegenTime: 1.431ms - CompileTime: 57.269ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 90 (90) - NumInstructions: 2.97K (2968) - OptimizationTime: 125.255ms - PeakMemoryUsage: 1.45 MB (1519616) - PrepareTime: 20.448ms HASH_JOIN_NODE (id=11):(Total: 1s984ms, non-child: 907.131ms, % non-child: 45.70%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.503ms - PeakMemoryUsage: 1.20 MB (1255232) - ProbeRows: 39.40M (39402577) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 854.817ms - RowsReturned: 39.40M (39402577) - RowsReturnedRate: 19.85 M/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 24.790us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 129.205us - HashBuckets: 212 (212) - HashCollisions: 0 (0) - HashTablesBuildTime: 53.988us - LargestPartitionPercent: 9 (9) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1073600) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 33.704us, non-child: 33.704us, % non-child: 100.00%) BytesReceived(500.000ms): 0, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 23.000us - DeserializeRowBatchTimer: 19.428us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 3.56 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=9):(Total: 1s077ms, non-child: 1s077ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:138/9.08 GB 7:168/10.45 GB 0:146/9.09 GB 5:148/9.45 GB 3:152/9.16 GB 6:157/10.79 GB 4:134/8.62 GB 1:155/8.85 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 57 out of 57 Runtime filters: Only following filters arrived: 7, waited 782ms Hdfs Read Thread Concurrency Bucket: 0:94.74% 1:5.263% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1141 PARQUET/SNAPPY:57 BytesRead(500.000ms): 0, 0, 0, 11.12 MB, 11.12 MB, 11.96 MB, 20.09 MB, 20.09 MB, 20.94 MB, 31.02 MB, 32.44 MB, 41.43 MB, 41.43 MB, 41.43 MB, 41.43 MB, 42.27 MB, 48.73 MB, 50.11 MB, 52.74 MB, 53.50 MB - FooterProcessingTime: (Avg: 66.875ms ; Min: 14.338ms ; Max: 226.327ms ; Number of samples: 57) - AverageHdfsReadThreadConcurrency: 0.05 - AverageScannerThreadConcurrency: 11.37 - BytesRead: 53.50 MB (56100866) - BytesReadDataNodeCache: 0 - BytesReadLocal: 53.50 MB (56100866) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 53.50 MB (56100866) - DecompressionTime: 311.288ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 57 (57) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 23.47 MB (24609260) - PerReadThreadRawHdfsThroughput: 25.14 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 150.867ms - RowBatchQueuePutWaitTime: 1m32s - RowsRead: 39.40M (39402577) - RowsReturned: 39.40M (39402577) - RowsReturnedRate: 36.56 M/sec - ScanRangesComplete: 1.20K (1198) - ScannerThreadsInvoluntaryContextSwitches: 1.75K (1751) - ScannerThreadsTotalWallClockTime: 1m50s - MaterializeTupleTime(*): 1s961ms - ScannerThreadsSysTime: 3s635ms - ScannerThreadsUserTime: 3s974ms - ScannerThreadsVoluntaryContextSwitches: 189.38K (189375) - TotalRawHdfsReadTime(*): 2s127ms - TotalReadThroughput: 5.35 MB/sec Filter 2 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 39.40M (39402577) Filter 7 (1.00 MB): - Files processed: 1.20K (1198) - Files rejected: 1.14K (1141) - Files total: 1.20K (1198) - RowGroups processed: 38.53K (38526) - RowGroups rejected: 0 (0) - RowGroups total: 38.53K (38526) - Rows processed: 933.89K (933888) - Rows rejected: 0 (0) - Rows total: 39.40M (39402577) - Splits processed: 57 (57) - Splits rejected: 0 (0) - Splits total: 57 (57) Instance 7f40dcb034de70b7:15e (host=ve1134.foo:22000):(Total: 9s861ms, non-child: 1s914ms, % non-child: 19.41%) Hdfs split stats (:<# splits>/): 4:140/8.20 GB 7:157/10.06 GB 3:160/9.66 GB 6:161/9.73 GB 5:142/8.50 GB 0:148/9.91 GB 1:146/8.89 GB 2:162/10.53 GB Filter 7 arrival: 280ms MemoryUsage(500.000ms): 1.35 MB, 3.38 MB, 8.19 MB, 24.99 MB, 26.17 MB, 24.17 MB, 30.12 MB, 30.29 MB, 29.84 MB, 30.06 MB, 29.06 MB, 22.29 MB, 25.59 MB, 24.91 MB, 24.89 MB, 25.22 MB, 24.95 MB, 25.32 MB, 19.51 MB, 12.70 MB ThreadUsage(500.000ms): 1, 1, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 11.80 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 30.79 MB (32280440) - PerHostPeakMemUsage: 1.26 GB (1356445920) - RowsProduced: 39.70M (39698336) - TotalNetworkReceiveTime: 53.885ms - TotalNetworkSendTime: 2s330ms - TotalStorageWaitTime: 7s021ms - TotalThreadsInvoluntaryContextSwitches: 2.31K (2307) - TotalThreadsTotalWallClockTime: 1m58s - TotalThreadsSysTime: 4s403ms - TotalThreadsUserTime: 10s191ms - TotalThreadsVoluntaryContextSwitches: 164.75K (164752) Fragment Instance Lifecycle Timings: - ExecTime: 8s628ms - ExecTreeExecTime: 996.905ms - OpenTime: 1s180ms - ExecTreeOpenTime: 1s000ms - PrepareTime: 51.598ms - ExecTreePrepareTime: 3.553ms DataStreamSender (dst_id=23):(Total: 5s757ms, non-child: 5s757ms, % non-child: 100.00%) - BytesSent: 376.35 MB (394634526) - NetworkThroughput(*): 102.69 MB/sec - OverallThroughput: 65.36 MB/sec - PeakMemoryUsage: 4.74 MB (4971584) - RowsReturned: 39.70M (39698336) - SerializeBatchTime: 2s085ms - TransmitDataRPCTime: 3s664ms - UncompressedRowBatchSize: 1.26 GB (1350248048) CodeGen:(Total: 197.305ms, non-child: 197.305ms, % non-child: 100.00%) - CodegenTime: 990.323us - CompileTime: 52.298ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 90 (90) - NumInstructions: 2.97K (2968) - OptimizationTime: 125.960ms - PeakMemoryUsage: 1.45 MB (1519616) - PrepareTime: 18.658ms HASH_JOIN_NODE (id=11):(Total: 1s991ms, non-child: 870.003ms, % non-child: 43.68%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.469ms - PeakMemoryUsage: 1.20 MB (1255232) - ProbeRows: 39.70M (39698336) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 823.207ms - RowsReturned: 39.70M (39698336) - RowsReturnedRate: 19.93 M/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 26.004us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 140.658us - HashBuckets: 212 (212) - HashCollisions: 0 (0) - HashTablesBuildTime: 55.868us - LargestPartitionPercent: 9 (9) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1073600) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 53.895ms, non-child: 21.439us, % non-child: 0.04%) BytesReceived(500.000ms): 0, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 4.563us - DeserializeRowBatchTimer: 19.081us - FirstBatchArrivalWaitTime: 52.152ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 2.23 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=9):(Total: 1s068ms, non-child: 1s068ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:140/8.20 GB 7:157/10.06 GB 3:160/9.66 GB 6:161/9.73 GB 5:142/8.50 GB 0:148/9.91 GB 1:146/8.89 GB 2:162/10.53 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 55 out of 55 Runtime filters: Only following filters arrived: 7, waited 722ms Hdfs Read Thread Concurrency Bucket: 0:84.21% 1:5.263% 2:5.263% 3:5.263% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1161 PARQUET/SNAPPY:55 BytesRead(500.000ms): 0, 0, 800.00 KB, 11.16 MB, 12.58 MB, 17.48 MB, 22.48 MB, 22.48 MB, 29.31 MB, 29.31 MB, 30.14 MB, 34.32 MB, 36.83 MB, 37.67 MB, 37.67 MB, 42.59 MB, 48.97 MB, 51.24 MB, 53.50 MB, 53.50 MB - FooterProcessingTime: (Avg: 66.407ms ; Min: 15.671ms ; Max: 308.759ms ; Number of samples: 55) - AverageHdfsReadThreadConcurrency: 0.32 - AverageScannerThreadConcurrency: 11.37 - BytesRead: 53.50 MB (56099137) - BytesReadDataNodeCache: 0 - BytesReadLocal: 53.50 MB (56099137) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 53.50 MB (56099137) - DecompressionTime: 312.901ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 55 (55) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 24.93 MB (26146206) - PerReadThreadRawHdfsThroughput: 26.69 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 219.247ms - RowBatchQueuePutWaitTime: 1m29s - RowsRead: 39.70M (39698336) - RowsReturned: 39.70M (39698336) - RowsReturnedRate: 37.16 M/sec - ScanRangesComplete: 1.22K (1216) - ScannerThreadsInvoluntaryContextSwitches: 1.58K (1581) - ScannerThreadsTotalWallClockTime: 1m48s - MaterializeTupleTime(*): 1s870ms - ScannerThreadsSysTime: 4s149ms - ScannerThreadsUserTime: 3s949ms - ScannerThreadsVoluntaryContextSwitches: 164.08K (164079) - TotalRawHdfsReadTime(*): 2s004ms - TotalReadThroughput: 5.35 MB/sec Filter 2 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 39.70M (39698336) Filter 7 (1.00 MB): - Files processed: 1.22K (1216) - Files rejected: 1.16K (1161) - Files total: 1.22K (1216) - RowGroups processed: 38.81K (38812) - RowGroups rejected: 0 (0) - RowGroups total: 38.81K (38812) - Rows processed: 901.12K (901120) - Rows rejected: 0 (0) - Rows total: 39.70M (39698336) - Splits processed: 55 (55) - Splits rejected: 0 (0) - Splits total: 55 (55) Instance 7f40dcb034de70b7:10c (host=vc1522.foo:22000):(Total: 9s850ms, non-child: 1s940ms, % non-child: 19.70%) Hdfs split stats (:<# splits>/): 7:149/8.93 GB 0:138/8.67 GB 2:138/9.10 GB 1:140/9.56 GB 4:151/9.97 GB 5:155/10.32 GB 3:154/9.62 GB 6:137/9.34 GB Filter 7 arrival: 618ms Filter 2 arrival: 9s105ms MemoryUsage(500.000ms): 1.38 MB, 3.38 MB, 25.00 MB, 24.58 MB, 25.04 MB, 24.13 MB, 25.18 MB, 23.97 MB, 23.09 MB, 26.98 MB, 27.08 MB, 28.14 MB, 28.15 MB, 27.99 MB, 29.11 MB, 26.72 MB, 27.84 MB, 22.53 MB, 37.51 MB, 19.39 MB ThreadUsage(500.000ms): 2, 1, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 1 - AverageThreadTokens: 11.25 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 37.78 MB (39614364) - PerHostPeakMemUsage: 1.27 GB (1365837685) - RowsProduced: 40.36M (40361060) - TotalNetworkReceiveTime: 410.304ms - TotalNetworkSendTime: 2s494ms - TotalStorageWaitTime: 5s372ms - TotalThreadsInvoluntaryContextSwitches: 2.85K (2852) - TotalThreadsTotalWallClockTime: 1m55s - TotalThreadsSysTime: 2s286ms - TotalThreadsUserTime: 10s696ms - TotalThreadsVoluntaryContextSwitches: 146.79K (146793) Fragment Instance Lifecycle Timings: - ExecTime: 8s735ms - ExecTreeExecTime: 1s092ms - OpenTime: 1s072ms - ExecTreeOpenTime: 905.149ms - PrepareTime: 42.202ms - ExecTreePrepareTime: 2.705ms DataStreamSender (dst_id=23):(Total: 5s739ms, non-child: 5s739ms, % non-child: 100.00%) - BytesSent: 382.81 MB (401401672) - NetworkThroughput(*): 102.63 MB/sec - OverallThroughput: 66.70 MB/sec - PeakMemoryUsage: 4.76 MB (4987968) - RowsReturned: 40.36M (40361060) - SerializeBatchTime: 2s002ms - TransmitDataRPCTime: 3s729ms - UncompressedRowBatchSize: 1.28 GB (1372789072) CodeGen:(Total: 183.545ms, non-child: 183.545ms, % non-child: 100.00%) - CodegenTime: 804.026us - CompileTime: 50.235ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 90 (90) - NumInstructions: 2.97K (2968) - OptimizationTime: 115.557ms - PeakMemoryUsage: 1.45 MB (1519616) - PrepareTime: 17.407ms HASH_JOIN_NODE (id=11):(Total: 1s986ms, non-child: 925.970ms, % non-child: 46.60%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.525ms - PeakMemoryUsage: 1.27 MB (1327401) - ProbeRows: 40.36M (40361060) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 872.519ms - RowsReturned: 40.36M (40361060) - RowsReturnedRate: 20.31 M/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 29.798us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 149.845us - HashBuckets: 212 (212) - HashCollisions: 0 (0) - HashTablesBuildTime: 61.515us - LargestPartitionPercent: 9 (9) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1073600) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 410.315ms, non-child: 20.339us, % non-child: 0.00%) BytesReceived(500.000ms): 0, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 4.825us - DeserializeRowBatchTimer: 20.447us - FirstBatchArrivalWaitTime: 384.481ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 292.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=9):(Total: 650.992ms, non-child: 650.992ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:149/8.93 GB 0:138/8.67 GB 2:138/9.10 GB 1:140/9.56 GB 4:151/9.97 GB 5:155/10.32 GB 3:154/9.62 GB 6:137/9.34 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 58 out of 58 Runtime filters: Only following filters arrived: 7, waited 401ms Hdfs Read Thread Concurrency Bucket: 0:84.21% 1:10.53% 2:5.263% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1104 PARQUET/SNAPPY:58 BytesRead(500.000ms): 0, 0, 11.89 MB, 11.89 MB, 11.89 MB, 12.73 MB, 20.24 MB, 20.24 MB, 27.33 MB, 31.86 MB, 33.54 MB, 40.61 MB, 40.61 MB, 40.61 MB, 42.88 MB, 47.74 MB, 49.30 MB, 50.99 MB, 55.14 MB - FooterProcessingTime: (Avg: 54.614ms ; Min: 4.194ms ; Max: 180.629ms ; Number of samples: 58) - AverageHdfsReadThreadConcurrency: 0.21 - AverageScannerThreadConcurrency: 10.74 - BytesRead: 55.14 MB (57817511) - BytesReadDataNodeCache: 0 - BytesReadLocal: 55.14 MB (57817511) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 55.14 MB (57817511) - DecompressionTime: 320.383ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 58 (58) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 23.90 MB (25056678) - PerReadThreadRawHdfsThroughput: 26.01 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 88.780ms - RowBatchQueuePutWaitTime: 1m33s - RowsRead: 40.37M (40367831) - RowsReturned: 40.36M (40361060) - RowsReturnedRate: 62.00 M/sec - ScanRangesComplete: 1.16K (1162) - ScannerThreadsInvoluntaryContextSwitches: 2.10K (2102) - ScannerThreadsTotalWallClockTime: 1m44s - MaterializeTupleTime(*): 2s116ms - ScannerThreadsSysTime: 2s003ms - ScannerThreadsUserTime: 4s559ms - ScannerThreadsVoluntaryContextSwitches: 146.16K (146159) - TotalRawHdfsReadTime(*): 2s120ms - TotalReadThroughput: 5.80 MB/sec Filter 2 (16.00 MB): - Rows processed: 99.95K (99955) - Rows rejected: 6.77K (6771) - Rows total: 40.37M (40367831) Filter 7 (1.00 MB): - Files processed: 1.16K (1162) - Files rejected: 1.10K (1104) - Files total: 1.16K (1162) - RowGroups processed: 39.46K (39457) - RowGroups rejected: 0 (0) - RowGroups total: 39.46K (39457) - Rows processed: 950.27K (950272) - Rows rejected: 0 (0) - Rows total: 40.36M (40361060) - Splits processed: 58 (58) - Splits rejected: 0 (0) - Splits total: 58 (58) Instance 7f40dcb034de70b7:170 (host=va1035.foo:22000):(Total: 9s826ms, non-child: 2s061ms, % non-child: 20.98%) Hdfs split stats (:<# splits>/): 0:137/8.87 GB 5:145/9.84 GB 6:142/8.68 GB 3:141/8.82 GB 4:157/10.04 GB 1:153/9.23 GB 7:160/10.26 GB 2:152/9.78 GB Filter 7 arrival: 248ms MemoryUsage(500.000ms): 2.79 MB, 3.38 MB, 4.54 MB, 23.69 MB, 23.93 MB, 22.11 MB, 26.90 MB, 27.23 MB, 24.59 MB, 29.14 MB, 28.13 MB, 30.10 MB, 30.10 MB, 30.35 MB, 30.16 MB, 30.14 MB, 29.08 MB, 29.40 MB, 24.77 MB, 14.44 MB ThreadUsage(500.000ms): 1, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.40 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 30.93 MB (32436109) - PerHostPeakMemUsage: 1.31 GB (1407127829) - RowsProduced: 37.18M (37180807) - TotalNetworkReceiveTime: 4.618us - TotalNetworkSendTime: 2s371ms - TotalStorageWaitTime: 6s023ms - TotalThreadsInvoluntaryContextSwitches: 2.34K (2341) - TotalThreadsTotalWallClockTime: 1m58s - TotalThreadsSysTime: 2s400ms - TotalThreadsUserTime: 10s057ms - TotalThreadsVoluntaryContextSwitches: 126.32K (126320) Fragment Instance Lifecycle Timings: - ExecTime: 8s596ms - ExecTreeExecTime: 1s004ms - OpenTime: 1s170ms - ExecTreeOpenTime: 976.626ms - PrepareTime: 59.102ms - ExecTreePrepareTime: 3.392ms DataStreamSender (dst_id=23):(Total: 5s570ms, non-child: 5s570ms, % non-child: 100.00%) - BytesSent: 352.55 MB (369673145) - NetworkThroughput(*): 100.26 MB/sec - OverallThroughput: 63.29 MB/sec - PeakMemoryUsage: 4.78 MB (5012544) - RowsReturned: 37.18M (37180807) - SerializeBatchTime: 2s046ms - TransmitDataRPCTime: 3s516ms - UncompressedRowBatchSize: 1.18 GB (1264620118) CodeGen:(Total: 219.284ms, non-child: 219.284ms, % non-child: 100.00%) - CodegenTime: 1.130ms - CompileTime: 56.837ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 90 (90) - NumInstructions: 2.97K (2968) - OptimizationTime: 134.553ms - PeakMemoryUsage: 1.45 MB (1519616) - PrepareTime: 27.361ms HASH_JOIN_NODE (id=11):(Total: 1s975ms, non-child: 862.684ms, % non-child: 43.67%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.270ms - PeakMemoryUsage: 1.20 MB (1255232) - ProbeRows: 37.18M (37180807) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 818.971ms - RowsReturned: 37.18M (37180807) - RowsReturnedRate: 18.82 M/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 26.260us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 131.395us - HashBuckets: 212 (212) - HashCollisions: 0 (0) - HashTablesBuildTime: 56.687us - LargestPartitionPercent: 9 (9) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1073600) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 14.811us, non-child: 14.811us, % non-child: 100.00%) BytesReceived(500.000ms): 0, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 4.637us - DeserializeRowBatchTimer: 11.273us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 8.10 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=9):(Total: 1s112ms, non-child: 1s112ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:137/8.87 GB 5:145/9.84 GB 6:142/8.68 GB 3:141/8.82 GB 4:157/10.04 GB 1:153/9.23 GB 7:160/10.26 GB 2:152/9.78 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 54 out of 54 Runtime filters: Only following filters arrived: 7, waited 762ms Hdfs Read Thread Concurrency Bucket: 0:89.47% 1:10.53% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1133 PARQUET/SNAPPY:54 BytesRead(500.000ms): 0, 0, 100.00 KB, 10.51 MB, 10.51 MB, 10.71 MB, 21.42 MB, 21.42 MB, 24.83 MB, 32.88 MB, 35.41 MB, 40.16 MB, 40.16 MB, 40.16 MB, 40.16 MB, 42.67 MB, 48.27 MB, 48.27 MB, 50.80 MB, 50.80 MB - FooterProcessingTime: (Avg: 78.396ms ; Min: 13.434ms ; Max: 286.971ms ; Number of samples: 54) - AverageHdfsReadThreadConcurrency: 0.11 - AverageScannerThreadConcurrency: 12.00 - BytesRead: 50.80 MB (53266561) - BytesReadDataNodeCache: 0 - BytesReadLocal: 50.80 MB (53266561) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 50.80 MB (53266561) - DecompressionTime: 311.558ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 54 (54) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 25.44 MB (26678630) - PerReadThreadRawHdfsThroughput: 26.11 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 209.900ms - RowBatchQueuePutWaitTime: 1m32s - RowsRead: 37.18M (37180807) - RowsReturned: 37.18M (37180807) - RowsReturnedRate: 33.41 M/sec - ScanRangesComplete: 1.19K (1187) - ScannerThreadsInvoluntaryContextSwitches: 1.59K (1595) - ScannerThreadsTotalWallClockTime: 1m49s - MaterializeTupleTime(*): 1s961ms - ScannerThreadsSysTime: 2s173ms - ScannerThreadsUserTime: 3s849ms - ScannerThreadsVoluntaryContextSwitches: 125.72K (125723) - TotalRawHdfsReadTime(*): 1s945ms - TotalReadThroughput: 5.08 MB/sec Filter 2 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 37.18M (37180807) Filter 7 (1.00 MB): - Files processed: 1.19K (1187) - Files rejected: 1.13K (1133) - Files total: 1.19K (1187) - RowGroups processed: 36.35K (36353) - RowGroups rejected: 0 (0) - RowGroups total: 36.35K (36353) - Rows processed: 884.74K (884736) - Rows rejected: 0 (0) - Rows total: 37.18M (37180807) - Splits processed: 54 (54) - Splits rejected: 0 (0) - Splits total: 54 (54) Instance 7f40dcb034de70b7:117 (host=vd1139.foo:22000):(Total: 9s669ms, non-child: 1s838ms, % non-child: 19.01%) Hdfs split stats (:<# splits>/): 2:159/10.18 GB 4:147/8.94 GB 7:155/9.98 GB 6:141/9.98 GB 5:145/9.21 GB 0:138/9.19 GB 3:155/9.37 GB 1:143/8.70 GB Filter 7 arrival: 558ms Filter 2 arrival: 9s283ms MemoryUsage(500.000ms): 1.35 MB, 3.38 MB, 21.22 MB, 24.75 MB, 24.94 MB, 25.19 MB, 26.16 MB, 26.06 MB, 27.71 MB, 28.11 MB, 29.23 MB, 29.20 MB, 28.99 MB, 28.99 MB, 30.46 MB, 28.87 MB, 29.13 MB, 26.85 MB, 23.17 MB ThreadUsage(500.000ms): 1, 1, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 11.74 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 37.25 MB (39059054) - PerHostPeakMemUsage: 1.27 GB (1364893602) - RowsProduced: 40.42M (40415177) - TotalNetworkReceiveTime: 341.545ms - TotalNetworkSendTime: 2s396ms - TotalStorageWaitTime: 4s843ms - TotalThreadsInvoluntaryContextSwitches: 2.83K (2833) - TotalThreadsTotalWallClockTime: 1m53s - TotalThreadsSysTime: 4s130ms - TotalThreadsUserTime: 10s276ms - TotalThreadsVoluntaryContextSwitches: 203.21K (203212) Fragment Instance Lifecycle Timings: - ExecTime: 8s538ms - ExecTreeExecTime: 1s041ms - OpenTime: 1s082ms - ExecTreeOpenTime: 910.688ms - PrepareTime: 48.037ms - ExecTreePrepareTime: 2.882ms DataStreamSender (dst_id=23):(Total: 5s695ms, non-child: 5s695ms, % non-child: 100.00%) - BytesSent: 382.83 MB (401425608) - NetworkThroughput(*): 103.60 MB/sec - OverallThroughput: 67.22 MB/sec - PeakMemoryUsage: 4.85 MB (5086272) - RowsReturned: 40.42M (40415177) - SerializeBatchTime: 1s993ms - TransmitDataRPCTime: 3s695ms - UncompressedRowBatchSize: 1.28 GB (1374629794) CodeGen:(Total: 191.409ms, non-child: 191.409ms, % non-child: 100.00%) - CodegenTime: 908.160us - CompileTime: 51.257ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 90 (90) - NumInstructions: 2.97K (2968) - OptimizationTime: 119.410ms - PeakMemoryUsage: 1.45 MB (1519616) - PrepareTime: 20.302ms HASH_JOIN_NODE (id=11):(Total: 1s944ms, non-child: 894.201ms, % non-child: 45.99%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.497ms - PeakMemoryUsage: 1.27 MB (1330628) - ProbeRows: 40.42M (40415177) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 850.761ms - RowsReturned: 40.42M (40415177) - RowsReturnedRate: 20.79 M/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 26.330us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 151.001us - HashBuckets: 212 (212) - HashCollisions: 0 (0) - HashTablesBuildTime: 73.118us - LargestPartitionPercent: 9 (9) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1073600) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 341.556ms, non-child: 19.448us, % non-child: 0.01%) BytesReceived(500.000ms): 0, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 5.359us - DeserializeRowBatchTimer: 12.061us - FirstBatchArrivalWaitTime: 326.248ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 351.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=9):(Total: 708.956ms, non-child: 708.956ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:159/10.18 GB 4:147/8.94 GB 7:155/9.98 GB 6:141/9.98 GB 5:145/9.21 GB 0:138/9.19 GB 3:155/9.37 GB 1:143/8.70 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 53 out of 53 Runtime filters: Only following filters arrived: 7, waited 462ms Hdfs Read Thread Concurrency Bucket: 0:88.89% 1:5.556% 2:0% 3:5.556% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1130 PARQUET/SNAPPY:53 BytesRead(500.000ms): 0, 0, 5.64 MB, 11.28 MB, 11.28 MB, 12.95 MB, 20.36 MB, 20.36 MB, 29.65 MB, 32.39 MB, 34.64 MB, 40.81 MB, 40.81 MB, 40.81 MB, 42.23 MB, 50.12 MB, 50.12 MB, 53.74 MB, 53.74 MB - FooterProcessingTime: (Avg: 55.808ms ; Min: 15.118ms ; Max: 155.374ms ; Number of samples: 53) - AverageHdfsReadThreadConcurrency: 0.22 - AverageScannerThreadConcurrency: 11.33 - BytesRead: 53.74 MB (56349692) - BytesReadDataNodeCache: 0 - BytesReadLocal: 53.74 MB (56349692) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 53.74 MB (56349692) - DecompressionTime: 290.965ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 53 (53) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 24.91 MB (26124835) - PerReadThreadRawHdfsThroughput: 26.64 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 104.057ms - RowBatchQueuePutWaitTime: 1m29s - RowsRead: 40.42M (40418552) - RowsReturned: 40.42M (40415177) - RowsReturnedRate: 57.01 M/sec - ScanRangesComplete: 1.18K (1183) - ScannerThreadsInvoluntaryContextSwitches: 2.10K (2101) - ScannerThreadsTotalWallClockTime: 1m43s - MaterializeTupleTime(*): 1s909ms - ScannerThreadsSysTime: 3s861ms - ScannerThreadsUserTime: 4s218ms - ScannerThreadsVoluntaryContextSwitches: 202.57K (202574) - TotalRawHdfsReadTime(*): 2s017ms - TotalReadThroughput: 5.66 MB/sec Filter 2 (16.00 MB): - Rows processed: 51.50K (51503) - Rows rejected: 3.38K (3375) - Rows total: 40.42M (40418552) Filter 7 (1.00 MB): - Files processed: 1.18K (1183) - Files rejected: 1.13K (1130) - Files total: 1.18K (1183) - RowGroups processed: 39.51K (39508) - RowGroups rejected: 0 (0) - RowGroups total: 39.51K (39508) - Rows processed: 868.35K (868352) - Rows rejected: 0 (0) - Rows total: 40.42M (40415177) - Splits processed: 53 (53) - Splits rejected: 0 (0) - Splits total: 53 (53) Instance 7f40dcb034de70b7:13c (host=va1029.foo:22000):(Total: 9s664ms, non-child: 2s005ms, % non-child: 20.76%) Hdfs split stats (:<# splits>/): 4:118/7.42 GB 5:182/11.55 GB 2:169/10.30 GB 1:149/8.94 GB 7:142/9.28 GB 6:152/9.44 GB 0:144/9.79 GB 3:137/8.80 GB Filter 7 arrival: 444ms MemoryUsage(500.000ms): 42.25 KB, 3.38 MB, 3.38 MB, 25.41 MB, 25.25 MB, 27.44 MB, 28.53 MB, 28.99 MB, 29.13 MB, 29.18 MB, 28.06 MB, 27.05 MB, 27.74 MB, 27.74 MB, 27.34 MB, 29.00 MB, 28.14 MB, 27.85 MB, 21.01 MB, 14.34 MB ThreadUsage(500.000ms): 1, 1, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 11.80 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 29.73 MB (31172228) - PerHostPeakMemUsage: 1.26 GB (1348198399) - RowsProduced: 38.90M (38902297) - TotalNetworkReceiveTime: 226.660ms - TotalNetworkSendTime: 2s435ms - TotalStorageWaitTime: 5s241ms - TotalThreadsInvoluntaryContextSwitches: 2.71K (2713) - TotalThreadsTotalWallClockTime: 1m54s - TotalThreadsSysTime: 2s469ms - TotalThreadsUserTime: 10s203ms - TotalThreadsVoluntaryContextSwitches: 134.63K (134633) Fragment Instance Lifecycle Timings: - ExecTime: 8s553ms - ExecTreeExecTime: 966.599ms - OpenTime: 1s062ms - ExecTreeOpenTime: 891.700ms - PrepareTime: 49.131ms - ExecTreePrepareTime: 2.831ms DataStreamSender (dst_id=23):(Total: 5s617ms, non-child: 5s617ms, % non-child: 100.00%) - BytesSent: 368.91 MB (386833997) - NetworkThroughput(*): 101.86 MB/sec - OverallThroughput: 65.67 MB/sec - PeakMemoryUsage: 4.80 MB (5028928) - RowsReturned: 38.90M (38902297) - SerializeBatchTime: 1s989ms - TransmitDataRPCTime: 3s621ms - UncompressedRowBatchSize: 1.23 GB (1323172658) CodeGen:(Total: 190.791ms, non-child: 190.791ms, % non-child: 100.00%) - CodegenTime: 876.225us - CompileTime: 50.608ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 90 (90) - NumInstructions: 2.97K (2968) - OptimizationTime: 118.499ms - PeakMemoryUsage: 1.45 MB (1519616) - PrepareTime: 21.275ms HASH_JOIN_NODE (id=11):(Total: 1s850ms, non-child: 843.122ms, % non-child: 45.57%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.604ms - PeakMemoryUsage: 1.20 MB (1255232) - ProbeRows: 38.90M (38902297) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 801.498ms - RowsReturned: 38.90M (38902297) - RowsReturnedRate: 21.02 M/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 42.606us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 162.814us - HashBuckets: 212 (212) - HashCollisions: 0 (0) - HashTablesBuildTime: 84.070us - LargestPartitionPercent: 9 (9) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1073600) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 226.671ms, non-child: 22.394us, % non-child: 0.01%) BytesReceived(500.000ms): 0, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 4.959us - DeserializeRowBatchTimer: 72.494us - FirstBatchArrivalWaitTime: 205.784ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 529.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=9):(Total: 780.852ms, non-child: 780.852ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:118/7.42 GB 5:182/11.55 GB 2:169/10.30 GB 1:149/8.94 GB 7:142/9.28 GB 6:152/9.44 GB 0:144/9.79 GB 3:137/8.80 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 53 out of 53 Runtime filters: Only following filters arrived: 7, waited 562ms Hdfs Read Thread Concurrency Bucket: 0:89.47% 1:5.263% 2:5.263% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1140 PARQUET/SNAPPY:53 BytesRead(500.000ms): 0, 0, 0, 12.09 MB, 12.09 MB, 13.49 MB, 18.59 MB, 21.23 MB, 22.08 MB, 29.15 MB, 29.25 MB, 33.10 MB, 39.53 MB, 39.53 MB, 40.92 MB, 43.44 MB, 47.99 MB, 48.83 MB, 52.21 MB, 52.21 MB - FooterProcessingTime: (Avg: 56.180ms ; Min: 5.029ms ; Max: 174.226ms ; Number of samples: 53) - AverageHdfsReadThreadConcurrency: 0.16 - AverageScannerThreadConcurrency: 11.37 - BytesRead: 52.21 MB (54747038) - BytesReadDataNodeCache: 0 - BytesReadLocal: 52.21 MB (54747038) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 52.21 MB (54747038) - DecompressionTime: 329.219ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 53 (53) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 23.96 MB (25128029) - PerReadThreadRawHdfsThroughput: 24.04 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 98.463ms - RowBatchQueuePutWaitTime: 1m31s - RowsRead: 38.90M (38902297) - RowsReturned: 38.90M (38902297) - RowsReturnedRate: 49.82 M/sec - ScanRangesComplete: 1.19K (1193) - ScannerThreadsInvoluntaryContextSwitches: 1.98K (1982) - ScannerThreadsTotalWallClockTime: 1m44s - MaterializeTupleTime(*): 1s918ms - ScannerThreadsSysTime: 2s230ms - ScannerThreadsUserTime: 4s139ms - ScannerThreadsVoluntaryContextSwitches: 134.05K (134051) - TotalRawHdfsReadTime(*): 2s171ms - TotalReadThroughput: 5.22 MB/sec Filter 2 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 38.90M (38902297) Filter 7 (1.00 MB): - Files processed: 1.19K (1193) - Files rejected: 1.14K (1140) - Files total: 1.19K (1193) - RowGroups processed: 38.03K (38031) - RowGroups rejected: 0 (0) - RowGroups total: 38.03K (38031) - Rows processed: 868.35K (868352) - Rows rejected: 0 (0) - Rows total: 38.90M (38902297) - Splits processed: 53 (53) - Splits rejected: 0 (0) - Splits total: 53 (53) Instance 7f40dcb034de70b7:120 (host=vd1115.foo:22000):(Total: 9s637ms, non-child: 2s120ms, % non-child: 22.00%) Hdfs split stats (:<# splits>/): 0:149/9.47 GB 6:146/9.13 GB 4:157/9.81 GB 3:150/9.39 GB 1:153/9.87 GB 7:143/9.15 GB 5:142/9.17 GB 2:148/9.47 GB Filter 7 arrival: 517ms Filter 2 arrival: 9s441ms MemoryUsage(500.000ms): 1.38 MB, 3.38 MB, 25.00 MB, 25.20 MB, 25.14 MB, 26.05 MB, 26.86 MB, 27.15 MB, 17.09 MB, 26.79 MB, 27.19 MB, 30.27 MB, 29.98 MB, 30.03 MB, 30.34 MB, 30.07 MB, 28.07 MB, 27.17 MB, 15.78 MB ThreadUsage(500.000ms): 2, 1, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 11.79 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 30.90 MB (32403771) - PerHostPeakMemUsage: 1.28 GB (1371128965) - RowsProduced: 36.76M (36756054) - TotalNetworkReceiveTime: 287.529ms - TotalNetworkSendTime: 2s547ms - TotalStorageWaitTime: 5s331ms - TotalThreadsInvoluntaryContextSwitches: 2.31K (2315) - TotalThreadsTotalWallClockTime: 1m52s - TotalThreadsSysTime: 2s802ms - TotalThreadsUserTime: 9s546ms - TotalThreadsVoluntaryContextSwitches: 180.83K (180831) Fragment Instance Lifecycle Timings: - ExecTime: 8s514ms - ExecTreeExecTime: 966.911ms - OpenTime: 1s068ms - ExecTreeOpenTime: 889.231ms - PrepareTime: 54.933ms - ExecTreePrepareTime: 3.219ms DataStreamSender (dst_id=23):(Total: 5s466ms, non-child: 5s466ms, % non-child: 100.00%) - BytesSent: 348.42 MB (365339617) - NetworkThroughput(*): 99.98 MB/sec - OverallThroughput: 63.74 MB/sec - PeakMemoryUsage: 4.81 MB (5045312) - RowsReturned: 36.76M (36756054) - SerializeBatchTime: 1s974ms - TransmitDataRPCTime: 3s484ms - UncompressedRowBatchSize: 1.16 GB (1250173148) CodeGen:(Total: 199.693ms, non-child: 199.693ms, % non-child: 100.00%) - CodegenTime: 1.064ms - CompileTime: 50.689ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 90 (90) - NumInstructions: 2.97K (2968) - OptimizationTime: 126.517ms - PeakMemoryUsage: 1.45 MB (1519616) - PrepareTime: 22.044ms HASH_JOIN_NODE (id=11):(Total: 1s851ms, non-child: 836.128ms, % non-child: 45.17%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.552ms - PeakMemoryUsage: 1.20 MB (1255232) - ProbeRows: 36.76M (36756054) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 789.045ms - RowsReturned: 36.76M (36756054) - RowsReturnedRate: 19.86 M/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 27.904us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 142.393us - HashBuckets: 212 (212) - HashCollisions: 0 (0) - HashTablesBuildTime: 55.520us - LargestPartitionPercent: 9 (9) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1073600) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 287.541ms, non-child: 22.167us, % non-child: 0.01%) BytesReceived(500.000ms): 0, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 6.987us - DeserializeRowBatchTimer: 15.472us - FirstBatchArrivalWaitTime: 283.161ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 417.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=9):(Total: 727.721ms, non-child: 727.721ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:149/9.47 GB 6:146/9.13 GB 4:157/9.81 GB 3:150/9.39 GB 1:153/9.87 GB 7:143/9.15 GB 5:142/9.17 GB 2:148/9.47 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 51 out of 51 Runtime filters: Only following filters arrived: 7, waited 482ms Hdfs Read Thread Concurrency Bucket: 0:89.47% 1:5.263% 2:0% 3:0% 4:5.263% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1137 PARQUET/SNAPPY:51 BytesRead(500.000ms): 0, 0, 11.17 MB, 11.17 MB, 11.17 MB, 14.82 MB, 20.69 MB, 20.69 MB, 23.31 MB, 30.20 MB, 32.94 MB, 41.39 MB, 41.39 MB, 41.39 MB, 41.39 MB, 42.23 MB, 47.29 MB, 48.12 MB, 49.55 MB - FooterProcessingTime: (Avg: 62.908ms ; Min: 5.063ms ; Max: 168.789ms ; Number of samples: 51) - AverageHdfsReadThreadConcurrency: 0.26 - AverageScannerThreadConcurrency: 10.74 - BytesRead: 49.55 MB (51961563) - BytesReadDataNodeCache: 0 - BytesReadLocal: 49.55 MB (51961563) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 49.55 MB (51961563) - DecompressionTime: 322.912ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 51 (51) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 24.99 MB (26203592) - PerReadThreadRawHdfsThroughput: 25.80 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 116.273ms - RowBatchQueuePutWaitTime: 1m31s - RowsRead: 36.76M (36757583) - RowsReturned: 36.76M (36756054) - RowsReturnedRate: 50.51 M/sec - ScanRangesComplete: 1.19K (1188) - ScannerThreadsInvoluntaryContextSwitches: 1.60K (1596) - ScannerThreadsTotalWallClockTime: 1m42s - MaterializeTupleTime(*): 1s899ms - ScannerThreadsSysTime: 2s536ms - ScannerThreadsUserTime: 3s653ms - ScannerThreadsVoluntaryContextSwitches: 180.23K (180233) - TotalRawHdfsReadTime(*): 1s920ms - TotalReadThroughput: 5.22 MB/sec Filter 2 (16.00 MB): - Rows processed: 20.98K (20985) - Rows rejected: 1.53K (1529) - Rows total: 36.76M (36757583) Filter 7 (1.00 MB): - Files processed: 1.19K (1188) - Files rejected: 1.14K (1137) - Files total: 1.19K (1188) - RowGroups processed: 35.94K (35936) - RowGroups rejected: 0 (0) - RowGroups total: 35.94K (35936) - Rows processed: 835.58K (835584) - Rows rejected: 0 (0) - Rows total: 36.76M (36756054) - Splits processed: 51 (51) - Splits rejected: 0 (0) - Splits total: 51 (51) Instance 7f40dcb034de70b7:141 (host=vc1530.foo:22000):(Total: 9s505ms, non-child: 2s957ms, % non-child: 31.12%) Hdfs split stats (:<# splits>/): 2:145/9.03 GB 3:143/8.84 GB 6:148/8.95 GB 0:152/9.60 GB 5:146/8.53 GB 4:159/9.97 GB 1:151/10.14 GB 7:155/10.42 GB Filter 7 arrival: 400ms MemoryUsage(500.000ms): 3.38 MB, 3.38 MB, 26.07 MB, 25.91 MB, 25.91 MB, 26.03 MB, 26.01 MB, 26.88 MB, 27.03 MB, 26.42 MB, 24.78 MB, 25.11 MB, 25.11 MB, 25.15 MB, 25.89 MB, 25.20 MB, 25.79 MB, 18.81 MB, 3.73 MB ThreadUsage(500.000ms): 1, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 1 - AverageThreadTokens: 11.74 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 27.65 MB (28997673) - PerHostPeakMemUsage: 1.25 GB (1345127600) - RowsProduced: 32.39M (32389492) - TotalNetworkReceiveTime: 169.697ms - TotalNetworkSendTime: 3s303ms - TotalStorageWaitTime: 5s688ms - TotalThreadsInvoluntaryContextSwitches: 2.51K (2511) - TotalThreadsTotalWallClockTime: 1m53s - TotalThreadsSysTime: 4s619ms - TotalThreadsUserTime: 8s643ms - TotalThreadsVoluntaryContextSwitches: 178.21K (178209) Fragment Instance Lifecycle Timings: - ExecTime: 8s419ms - ExecTreeExecTime: 848.310ms - OpenTime: 1s029ms - ExecTreeOpenTime: 851.654ms - PrepareTime: 56.735ms - ExecTreePrepareTime: 3.399ms DataStreamSender (dst_id=23):(Total: 4s652ms, non-child: 4s652ms, % non-child: 100.00%) - BytesSent: 306.64 MB (321536418) - NetworkThroughput(*): 101.52 MB/sec - OverallThroughput: 65.91 MB/sec - PeakMemoryUsage: 4.80 MB (5028928) - RowsReturned: 32.39M (32389492) - SerializeBatchTime: 1s626ms - TransmitDataRPCTime: 3s020ms - UncompressedRowBatchSize: 1.03 GB (1101654560) CodeGen:(Total: 199.326ms, non-child: 199.326ms, % non-child: 100.00%) - CodegenTime: 1.172ms - CompileTime: 52.425ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 90 (90) - NumInstructions: 2.97K (2968) - OptimizationTime: 123.541ms - PeakMemoryUsage: 1.45 MB (1519616) - PrepareTime: 22.892ms HASH_JOIN_NODE (id=11):(Total: 1s696ms, non-child: 728.015ms, % non-child: 42.92%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.545ms - PeakMemoryUsage: 1.20 MB (1255232) - ProbeRows: 32.39M (32389492) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 691.101ms - RowsReturned: 32.39M (32389492) - RowsReturnedRate: 19.10 M/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 27.460us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 401.595us - HashBuckets: 212 (212) - HashCollisions: 0 (0) - HashTablesBuildTime: 44.693us - LargestPartitionPercent: 9 (9) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1073600) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 169.704ms, non-child: 16.009us, % non-child: 0.01%) BytesReceived(500.000ms): 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 2.145us - DeserializeRowBatchTimer: 23.381us - FirstBatchArrivalWaitTime: 151.593ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 707.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=9):(Total: 798.684ms, non-child: 798.684ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:145/9.03 GB 3:143/8.84 GB 6:148/8.95 GB 0:152/9.60 GB 5:146/8.53 GB 4:159/9.97 GB 1:151/10.14 GB 7:155/10.42 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 47 out of 47 Runtime filters: Only following filters arrived: 7, waited 603ms Hdfs Read Thread Concurrency Bucket: 0:88.89% 1:11.11% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1152 PARQUET/SNAPPY:47 BytesRead(500.000ms): 0, 0, 11.55 MB, 11.55 MB, 11.55 MB, 11.55 MB, 12.37 MB, 19.64 MB, 19.64 MB, 21.31 MB, 29.34 MB, 30.17 MB, 30.17 MB, 31.02 MB, 35.91 MB, 40.28 MB, 42.05 MB, 44.21 MB - FooterProcessingTime: (Avg: 53.715ms ; Min: 3.643ms ; Max: 148.386ms ; Number of samples: 47) - AverageHdfsReadThreadConcurrency: 0.11 - AverageScannerThreadConcurrency: 11.33 - BytesRead: 44.21 MB (46356578) - BytesReadDataNodeCache: 0 - BytesReadLocal: 44.21 MB (46356578) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 44.21 MB (46356578) - DecompressionTime: 230.777ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 47 (47) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 21.84 MB (22902899) - PerReadThreadRawHdfsThroughput: 23.28 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 75.369ms - RowBatchQueuePutWaitTime: 1m27s - RowsRead: 32.39M (32389492) - RowsReturned: 32.39M (32389492) - RowsReturnedRate: 40.55 M/sec - ScanRangesComplete: 1.20K (1199) - ScannerThreadsInvoluntaryContextSwitches: 1.91K (1909) - ScannerThreadsTotalWallClockTime: 1m43s - MaterializeTupleTime(*): 1s562ms - ScannerThreadsSysTime: 4s394ms - ScannerThreadsUserTime: 3s563ms - ScannerThreadsVoluntaryContextSwitches: 177.60K (177599) - TotalRawHdfsReadTime(*): 1s899ms - TotalReadThroughput: 4.91 MB/sec Filter 2 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 32.39M (32389492) Filter 7 (1.00 MB): - Files processed: 1.20K (1199) - Files rejected: 1.15K (1152) - Files total: 1.20K (1199) - RowGroups processed: 31.67K (31669) - RowGroups rejected: 0 (0) - RowGroups total: 31.67K (31669) - Rows processed: 770.05K (770048) - Rows rejected: 0 (0) - Rows total: 32.39M (32389492) - Splits processed: 47 (47) - Splits rejected: 0 (0) - Splits total: 47 (47) Instance 7f40dcb034de70b7:136 (host=vc1531.foo:22000):(Total: 9s448ms, non-child: 2s106ms, % non-child: 22.30%) Hdfs split stats (:<# splits>/): 6:135/8.72 GB 7:141/8.71 GB 1:157/10.39 GB 3:160/10.39 GB 0:157/9.97 GB 5:131/8.39 GB 4:140/9.52 GB 2:148/9.32 GB Filter 7 arrival: 457ms MemoryUsage(500.000ms): 1.38 MB, 3.38 MB, 23.57 MB, 25.06 MB, 25.56 MB, 25.30 MB, 26.89 MB, 27.24 MB, 20.96 MB, 26.06 MB, 26.04 MB, 27.00 MB, 27.00 MB, 26.86 MB, 26.84 MB, 27.16 MB, 25.87 MB, 24.70 MB, 10.64 MB ThreadUsage(500.000ms): 2, 1, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 11.79 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 27.84 MB (29194103) - PerHostPeakMemUsage: 1.26 GB (1349828944) - RowsProduced: 35.14M (35141225) - TotalNetworkReceiveTime: 220.215ms - TotalNetworkSendTime: 2s435ms - TotalStorageWaitTime: 4s369ms - TotalThreadsInvoluntaryContextSwitches: 2.17K (2175) - TotalThreadsTotalWallClockTime: 1m51s - TotalThreadsSysTime: 2s803ms - TotalThreadsUserTime: 10s450ms - TotalThreadsVoluntaryContextSwitches: 132.33K (132328) Fragment Instance Lifecycle Timings: - ExecTime: 8s334ms - ExecTreeExecTime: 943.321ms - OpenTime: 1s055ms - ExecTreeOpenTime: 872.495ms - PrepareTime: 58.346ms - ExecTreePrepareTime: 3.302ms DataStreamSender (dst_id=23):(Total: 5s322ms, non-child: 5s322ms, % non-child: 100.00%) - BytesSent: 332.32 MB (348467726) - NetworkThroughput(*): 98.70 MB/sec - OverallThroughput: 62.43 MB/sec - PeakMemoryUsage: 4.84 MB (5069888) - RowsReturned: 35.14M (35141225) - SerializeBatchTime: 1s949ms - TransmitDataRPCTime: 3s366ms - UncompressedRowBatchSize: 1.11 GB (1195248394) CodeGen:(Total: 207.610ms, non-child: 207.610ms, % non-child: 100.00%) - CodegenTime: 992.473us - CompileTime: 51.750ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 90 (90) - NumInstructions: 2.97K (2968) - OptimizationTime: 128.998ms - PeakMemoryUsage: 1.45 MB (1519616) - PrepareTime: 26.457ms HASH_JOIN_NODE (id=11):(Total: 1s811ms, non-child: 807.677ms, % non-child: 44.59%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.715ms - PeakMemoryUsage: 1.20 MB (1255232) - ProbeRows: 35.14M (35141225) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 766.676ms - RowsReturned: 35.14M (35141225) - RowsReturnedRate: 19.40 M/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 26.287us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 184.450us - HashBuckets: 212 (212) - HashCollisions: 0 (0) - HashTablesBuildTime: 52.968us - LargestPartitionPercent: 9 (9) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1073600) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 220.238ms, non-child: 31.173us, % non-child: 0.01%) BytesReceived(500.000ms): 0, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 5.329us - DeserializeRowBatchTimer: 14.440us - FirstBatchArrivalWaitTime: 193.743ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 544.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=9):(Total: 783.762ms, non-child: 783.762ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 6:135/8.72 GB 7:141/8.71 GB 1:157/10.39 GB 3:160/10.39 GB 0:157/9.97 GB 5:131/8.39 GB 4:140/9.52 GB 2:148/9.32 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 51 out of 51 Runtime filters: Only following filters arrived: 7, waited 563ms Hdfs Read Thread Concurrency Bucket: 0:94.74% 1:0% 2:5.263% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1118 PARQUET/SNAPPY:51 BytesRead(500.000ms): 0, 0, 10.55 MB, 11.41 MB, 11.41 MB, 13.09 MB, 20.95 MB, 20.95 MB, 25.12 MB, 29.94 MB, 30.77 MB, 40.01 MB, 40.01 MB, 40.87 MB, 40.87 MB, 41.71 MB, 47.89 MB, 47.89 MB, 47.89 MB - FooterProcessingTime: (Avg: 52.087ms ; Min: 21.918ms ; Max: 144.209ms ; Number of samples: 51) - AverageHdfsReadThreadConcurrency: 0.11 - AverageScannerThreadConcurrency: 10.74 - BytesRead: 47.89 MB (50214398) - BytesReadDataNodeCache: 0 - BytesReadLocal: 47.89 MB (50214398) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 47.89 MB (50214398) - DecompressionTime: 293.214ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 51 (51) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 22.16 MB (23240016) - PerReadThreadRawHdfsThroughput: 27.50 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 86.175ms - RowBatchQueuePutWaitTime: 1m28s - RowsRead: 35.14M (35141225) - RowsReturned: 35.14M (35141225) - RowsReturnedRate: 44.84 M/sec - ScanRangesComplete: 1.17K (1169) - ScannerThreadsInvoluntaryContextSwitches: 1.50K (1496) - ScannerThreadsTotalWallClockTime: 1m42s - MaterializeTupleTime(*): 1s859ms - ScannerThreadsSysTime: 2s569ms - ScannerThreadsUserTime: 4s590ms - ScannerThreadsVoluntaryContextSwitches: 131.76K (131756) - TotalRawHdfsReadTime(*): 1s741ms - TotalReadThroughput: 5.04 MB/sec Filter 2 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 35.14M (35141225) Filter 7 (1.00 MB): - Files processed: 1.17K (1169) - Files rejected: 1.12K (1118) - Files total: 1.17K (1169) - RowGroups processed: 34.36K (34360) - RowGroups rejected: 0 (0) - RowGroups total: 34.36K (34360) - Rows processed: 835.58K (835584) - Rows rejected: 0 (0) - Rows total: 35.14M (35141225) - Splits processed: 51 (51) - Splits rejected: 0 (0) - Splits total: 51 (51) Instance 7f40dcb034de70b7:112 (host=ve1137.foo:22000):(Total: 9s245ms, non-child: 1s700ms, % non-child: 18.39%) Hdfs split stats (:<# splits>/): 7:135/9.00 GB 4:145/10.32 GB 0:161/10.03 GB 5:146/9.75 GB 2:146/9.72 GB 6:151/9.42 GB 1:145/9.04 GB 3:132/8.16 GB Filter 7 arrival: 574ms Filter 2 arrival: 9s178ms MemoryUsage(500.000ms): 1.38 MB, 3.38 MB, 28.27 MB, 27.90 MB, 28.39 MB, 27.73 MB, 29.11 MB, 29.50 MB, 30.93 MB, 30.97 MB, 26.79 MB, 30.09 MB, 30.12 MB, 30.36 MB, 30.34 MB, 29.87 MB, 28.91 MB, 19.41 MB ThreadUsage(500.000ms): 2, 1, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 11.72 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 31.68 MB (33222810) - PerHostPeakMemUsage: 1.25 GB (1343790174) - RowsProduced: 37.32M (37321751) - TotalNetworkReceiveTime: 355.431ms - TotalNetworkSendTime: 1s973ms - TotalStorageWaitTime: 4s341ms - TotalThreadsInvoluntaryContextSwitches: 2.21K (2214) - TotalThreadsTotalWallClockTime: 1m47s - TotalThreadsSysTime: 3s068ms - TotalThreadsUserTime: 9s687ms - TotalThreadsVoluntaryContextSwitches: 130.70K (130697) Fragment Instance Lifecycle Timings: - ExecTime: 8s108ms - ExecTreeExecTime: 969.325ms - OpenTime: 1s088ms - ExecTreeOpenTime: 915.203ms - PrepareTime: 48.759ms - ExecTreePrepareTime: 3.171ms DataStreamSender (dst_id=23):(Total: 5s473ms, non-child: 5s473ms, % non-child: 100.00%) - BytesSent: 353.87 MB (371056195) - NetworkThroughput(*): 102.84 MB/sec - OverallThroughput: 64.65 MB/sec - PeakMemoryUsage: 4.78 MB (5012544) - RowsReturned: 37.32M (37321751) - SerializeBatchTime: 2s026ms - TransmitDataRPCTime: 3s440ms - UncompressedRowBatchSize: 1.18 GB (1269414014) CodeGen:(Total: 193.538ms, non-child: 193.538ms, % non-child: 100.00%) - CodegenTime: 1.007ms - CompileTime: 50.187ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 90 (90) - NumInstructions: 2.97K (2968) - OptimizationTime: 121.881ms - PeakMemoryUsage: 1.45 MB (1519616) - PrepareTime: 21.017ms HASH_JOIN_NODE (id=11):(Total: 1s878ms, non-child: 845.979ms, % non-child: 45.04%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.524ms - PeakMemoryUsage: 1.20 MB (1255232) - ProbeRows: 37.32M (37321751) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 802.610ms - RowsReturned: 37.32M (37321751) - RowsReturnedRate: 19.87 M/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 29.398us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 142.725us - HashBuckets: 212 (212) - HashCollisions: 0 (0) - HashTablesBuildTime: 58.345us - LargestPartitionPercent: 9 (9) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1073600) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 355.442ms, non-child: 20.427us, % non-child: 0.01%) BytesReceived(500.000ms): 0, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 5.138us - DeserializeRowBatchTimer: 16.160us - FirstBatchArrivalWaitTime: 343.847ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 337.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=9):(Total: 676.986ms, non-child: 676.986ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:135/9.00 GB 4:145/10.32 GB 0:161/10.03 GB 5:146/9.75 GB 2:146/9.72 GB 6:151/9.42 GB 1:145/9.04 GB 3:132/8.16 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 47 out of 47 Runtime filters: Only following filters arrived: 7, waited 442ms Hdfs Read Thread Concurrency Bucket: 0:94.44% 1:0% 2:0% 3:5.556% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1114 PARQUET/SNAPPY:47 BytesRead(500.000ms): 0, 0, 13.56 MB, 13.56 MB, 14.40 MB, 17.10 MB, 20.01 MB, 20.86 MB, 31.86 MB, 31.86 MB, 36.86 MB, 39.13 MB, 39.13 MB, 39.97 MB, 40.81 MB, 49.17 MB, 49.17 MB, 49.17 MB - FooterProcessingTime: (Avg: 50.701ms ; Min: 3.794ms ; Max: 151.093ms ; Number of samples: 47) - AverageHdfsReadThreadConcurrency: 0.17 - AverageScannerThreadConcurrency: 10.67 - BytesRead: 49.17 MB (51558683) - BytesReadDataNodeCache: 0 - BytesReadLocal: 49.17 MB (51558683) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 49.17 MB (51558683) - DecompressionTime: 292.643ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 47 (47) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 25.96 MB (27225075) - PerReadThreadRawHdfsThroughput: 28.72 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 112.049ms - RowBatchQueuePutWaitTime: 1m27s - RowsRead: 37.32M (37321751) - RowsReturned: 37.32M (37321751) - RowsReturnedRate: 55.13 M/sec - ScanRangesComplete: 1.16K (1161) - ScannerThreadsInvoluntaryContextSwitches: 1.51K (1513) - ScannerThreadsTotalWallClockTime: 1m37s - MaterializeTupleTime(*): 1s744ms - ScannerThreadsSysTime: 2s810ms - ScannerThreadsUserTime: 3s622ms - ScannerThreadsVoluntaryContextSwitches: 130.08K (130082) - TotalRawHdfsReadTime(*): 1s711ms - TotalReadThroughput: 5.46 MB/sec Filter 2 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 37.32M (37321751) Filter 7 (1.00 MB): - Files processed: 1.16K (1161) - Files rejected: 1.11K (1114) - Files total: 1.16K (1161) - RowGroups processed: 36.48K (36485) - RowGroups rejected: 0 (0) - RowGroups total: 36.48K (36485) - Rows processed: 770.05K (770048) - Rows rejected: 0 (0) - Rows total: 37.32M (37321751) - Splits processed: 47 (47) - Splits rejected: 0 (0) - Splits total: 47 (47) Instance 7f40dcb034de70b7:147 (host=vc1509.foo:22000):(Total: 8s981ms, non-child: 1s650ms, % non-child: 18.38%) Hdfs split stats (:<# splits>/): 2:128/8.28 GB 3:153/9.53 GB 4:135/8.46 GB 1:162/10.41 GB 5:138/8.71 GB 6:156/9.77 GB 0:165/9.98 GB 7:160/10.37 GB Filter 7 arrival: 394ms MemoryUsage(500.000ms): 3.38 MB, 3.38 MB, 23.87 MB, 23.69 MB, 23.63 MB, 20.37 MB, 28.09 MB, 27.01 MB, 27.32 MB, 28.27 MB, 21.98 MB, 25.19 MB, 25.19 MB, 24.10 MB, 23.47 MB, 23.93 MB, 25.31 MB, 11.91 MB ThreadUsage(500.000ms): 2, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.39 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 28.58 MB (29965507) - PerHostPeakMemUsage: 1.20 GB (1288050428) - RowsProduced: 36.27M (36267075) - TotalNetworkReceiveTime: 161.949ms - TotalNetworkSendTime: 1s982ms - TotalStorageWaitTime: 5s531ms - TotalThreadsInvoluntaryContextSwitches: 1.81K (1811) - TotalThreadsTotalWallClockTime: 1m46s - TotalThreadsSysTime: 1s816ms - TotalThreadsUserTime: 9s009ms - TotalThreadsVoluntaryContextSwitches: 88.34K (88344) Fragment Instance Lifecycle Timings: - ExecTime: 7s860ms - ExecTreeExecTime: 896.287ms - OpenTime: 1s063ms - ExecTreeOpenTime: 885.251ms - PrepareTime: 57.706ms - ExecTreePrepareTime: 3.489ms DataStreamSender (dst_id=23):(Total: 5s352ms, non-child: 5s352ms, % non-child: 100.00%) - BytesSent: 343.67 MB (360366416) - NetworkThroughput(*): 101.80 MB/sec - OverallThroughput: 64.21 MB/sec - PeakMemoryUsage: 4.82 MB (5053504) - RowsReturned: 36.27M (36267075) - SerializeBatchTime: 1s969ms - TransmitDataRPCTime: 3s375ms - UncompressedRowBatchSize: 1.15 GB (1233541654) CodeGen:(Total: 202.324ms, non-child: 202.324ms, % non-child: 100.00%) - CodegenTime: 1.036ms - CompileTime: 50.782ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 90 (90) - NumInstructions: 2.97K (2968) - OptimizationTime: 125.513ms - PeakMemoryUsage: 1.45 MB (1519616) - PrepareTime: 25.584ms HASH_JOIN_NODE (id=11):(Total: 1s776ms, non-child: 763.779ms, % non-child: 42.99%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.385ms - PeakMemoryUsage: 1.20 MB (1255232) - ProbeRows: 36.27M (36267075) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 719.538ms - RowsReturned: 36.27M (36267075) - RowsReturnedRate: 20.41 M/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 26.241us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 159.268us - HashBuckets: 212 (212) - HashCollisions: 0 (0) - HashTablesBuildTime: 46.356us - LargestPartitionPercent: 9 (9) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1073600) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 161.959ms, non-child: 18.505us, % non-child: 0.01%) BytesReceived(500.000ms): 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 4.774us - DeserializeRowBatchTimer: 22.505us - FirstBatchArrivalWaitTime: 144.363ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 740.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=9):(Total: 851.213ms, non-child: 851.213ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:128/8.28 GB 3:153/9.53 GB 4:135/8.46 GB 1:162/10.41 GB 5:138/8.71 GB 6:156/9.77 GB 0:165/9.98 GB 7:160/10.37 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 55 out of 55 Runtime filters: Only following filters arrived: 7, waited 622ms Hdfs Read Thread Concurrency Bucket: 0:77.78% 1:5.556% 2:11.11% 3:5.556% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1142 PARQUET/SNAPPY:55 BytesRead(500.000ms): 0, 0, 10.64 MB, 10.64 MB, 10.64 MB, 16.10 MB, 22.02 MB, 22.12 MB, 28.81 MB, 29.67 MB, 36.28 MB, 39.40 MB, 39.40 MB, 39.50 MB, 44.27 MB, 48.37 MB, 49.21 MB, 50.04 MB - FooterProcessingTime: (Avg: 53.092ms ; Min: 4.687ms ; Max: 131.423ms ; Number of samples: 55) - AverageHdfsReadThreadConcurrency: 0.44 - AverageScannerThreadConcurrency: 11.33 - BytesRead: 50.04 MB (52473677) - BytesReadDataNodeCache: 0 - BytesReadLocal: 50.04 MB (52473677) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 50.04 MB (52473677) - DecompressionTime: 294.133ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 55 (55) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 22.82 MB (23928786) - PerReadThreadRawHdfsThroughput: 24.70 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 97.266ms - RowBatchQueuePutWaitTime: 1m24s - RowsRead: 36.27M (36267075) - RowsReturned: 36.27M (36267075) - RowsReturnedRate: 42.61 M/sec - ScanRangesComplete: 1.20K (1197) - ScannerThreadsInvoluntaryContextSwitches: 1.11K (1112) - ScannerThreadsTotalWallClockTime: 1m37s - MaterializeTupleTime(*): 1s866ms - ScannerThreadsSysTime: 1s591ms - ScannerThreadsUserTime: 3s165ms - ScannerThreadsVoluntaryContextSwitches: 87.76K (87760) - TotalRawHdfsReadTime(*): 2s026ms - TotalReadThroughput: 5.56 MB/sec Filter 2 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 36.27M (36267075) Filter 7 (1.00 MB): - Files processed: 1.20K (1197) - Files rejected: 1.14K (1142) - Files total: 1.20K (1197) - RowGroups processed: 35.46K (35463) - RowGroups rejected: 0 (0) - RowGroups total: 35.46K (35463) - Rows processed: 901.12K (901120) - Rows rejected: 0 (0) - Rows total: 36.27M (36267075) - Splits processed: 55 (55) - Splits rejected: 0 (0) - Splits total: 55 (55) Instance 7f40dcb034de70b7:14b (host=vc1523.foo:22000):(Total: 8s402ms, non-child: 1s482ms, % non-child: 17.64%) Hdfs split stats (:<# splits>/): 4:155/9.63 GB 3:132/8.58 GB 7:141/9.37 GB 6:138/8.68 GB 2:146/9.40 GB 5:154/9.55 GB 0:171/11.45 GB 1:144/8.81 GB Filter 7 arrival: 365ms MemoryUsage(500.000ms): 1.38 MB, 3.38 MB, 22.01 MB, 27.87 MB, 27.99 MB, 24.93 MB, 30.47 MB, 29.45 MB, 26.59 MB, 25.98 MB, 26.06 MB, 26.94 MB, 27.33 MB, 26.08 MB, 23.68 MB, 22.71 MB, 10.38 MB ThreadUsage(500.000ms): 2, 1, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 11.65 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 30.67 MB (32156328) - PerHostPeakMemUsage: 1.11 GB (1196475797) - RowsProduced: 35.42M (35419678) - TotalNetworkReceiveTime: 143.273ms - TotalNetworkSendTime: 1s924ms - TotalStorageWaitTime: 5s216ms - TotalThreadsInvoluntaryContextSwitches: 2.47K (2473) - TotalThreadsTotalWallClockTime: 1m38s - TotalThreadsSysTime: 3s848ms - TotalThreadsUserTime: 9s448ms - TotalThreadsVoluntaryContextSwitches: 225.07K (225072) Fragment Instance Lifecycle Timings: - ExecTime: 7s294ms - ExecTreeExecTime: 914.889ms - OpenTime: 1s058ms - ExecTreeOpenTime: 881.496ms - PrepareTime: 50.293ms - ExecTreePrepareTime: 3.471ms DataStreamSender (dst_id=23):(Total: 4s936ms, non-child: 4s936ms, % non-child: 100.00%) - BytesSent: 335.21 MB (351493221) - NetworkThroughput(*): 104.19 MB/sec - OverallThroughput: 67.90 MB/sec - PeakMemoryUsage: 4.77 MB (5004352) - RowsReturned: 35.42M (35419678) - SerializeBatchTime: 1s713ms - TransmitDataRPCTime: 3s217ms - UncompressedRowBatchSize: 1.12 GB (1204719340) CodeGen:(Total: 192.097ms, non-child: 192.097ms, % non-child: 100.00%) - CodegenTime: 1.058ms - CompileTime: 53.117ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 90 (90) - NumInstructions: 2.97K (2968) - OptimizationTime: 121.913ms - PeakMemoryUsage: 1.45 MB (1519616) - PrepareTime: 16.667ms HASH_JOIN_NODE (id=11):(Total: 1s791ms, non-child: 784.730ms, % non-child: 43.80%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.318ms - PeakMemoryUsage: 1.20 MB (1255232) - ProbeRows: 35.42M (35419678) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 745.075ms - RowsReturned: 35.42M (35419678) - RowsReturnedRate: 19.77 M/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 26.644us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 124.719us - HashBuckets: 212 (212) - HashCollisions: 0 (0) - HashTablesBuildTime: 56.099us - LargestPartitionPercent: 9 (9) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1073600) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 143.284ms, non-child: 18.376us, % non-child: 0.01%) BytesReceived(500.000ms): 0, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 5.566us - DeserializeRowBatchTimer: 17.851us - FirstBatchArrivalWaitTime: 125.000ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 837.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=9):(Total: 863.952ms, non-child: 863.952ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:155/9.63 GB 3:132/8.58 GB 7:141/9.37 GB 6:138/8.68 GB 2:146/9.40 GB 5:154/9.55 GB 0:171/11.45 GB 1:144/8.81 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 48 out of 48 Runtime filters: Only following filters arrived: 7, waited 642ms Hdfs Read Thread Concurrency Bucket: 0:82.35% 1:17.65% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:1133 PARQUET/SNAPPY:48 BytesRead(500.000ms): 0, 0, 6.61 MB, 12.93 MB, 12.93 MB, 14.70 MB, 19.94 MB, 20.74 MB, 29.15 MB, 30.00 MB, 38.14 MB, 39.58 MB, 39.58 MB, 40.41 MB, 47.48 MB, 47.48 MB, 47.48 MB - FooterProcessingTime: (Avg: 52.757ms ; Min: 24.029ms ; Max: 130.243ms ; Number of samples: 48) - AverageHdfsReadThreadConcurrency: 0.18 - AverageScannerThreadConcurrency: 10.59 - BytesRead: 47.48 MB (49787460) - BytesReadDataNodeCache: 0 - BytesReadLocal: 47.48 MB (49787460) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 47.48 MB (49787460) - DecompressionTime: 240.451ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 48 (48) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 24.92 MB (26133407) - PerReadThreadRawHdfsThroughput: 28.14 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 91.961ms - RowBatchQueuePutWaitTime: 1m14s - RowsRead: 35.42M (35419678) - RowsReturned: 35.42M (35419678) - RowsReturnedRate: 41.00 M/sec - ScanRangesComplete: 1.18K (1181) - ScannerThreadsInvoluntaryContextSwitches: 1.85K (1846) - ScannerThreadsTotalWallClockTime: 1m30s - MaterializeTupleTime(*): 1s611ms - ScannerThreadsSysTime: 3s599ms - ScannerThreadsUserTime: 4s140ms - ScannerThreadsVoluntaryContextSwitches: 224.48K (224482) - TotalRawHdfsReadTime(*): 1s687ms - TotalReadThroughput: 5.59 MB/sec Filter 2 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 35.42M (35419678) Filter 7 (1.00 MB): - Files processed: 1.18K (1181) - Files rejected: 1.13K (1133) - Files total: 1.18K (1181) - RowGroups processed: 34.63K (34628) - RowGroups rejected: 0 (0) - RowGroups total: 34.63K (34628) - Rows processed: 786.43K (786432) - Rows rejected: 0 (0) - Rows total: 35.42M (35419678) - Splits processed: 48 (48) - Splits rejected: 0 (0) - Splits total: 48 (48) Instance 7f40dcb034de70b7:f9 (host=vc1511.foo:22000):(Total: 7s827ms, non-child: 2s346ms, % non-child: 29.98%) Hdfs split stats (:<# splits>/): 4:22/1.31 GB 0:13/724.24 MB 6:89/6.12 GB 3:31/1.97 GB 1:138/8.72 GB 5:284/18.21 GB 2:243/15.85 GB Filter 7 arrival: 673ms MemoryUsage(500.000ms): 1.36 MB, 3.37 MB, 25.89 MB, 25.75 MB, 27.22 MB, 27.35 MB, 28.19 MB, 27.96 MB, 19.26 MB, 25.09 MB, 24.85 MB, 23.03 MB, 23.63 MB, 20.00 MB, 14.89 MB ThreadUsage(500.000ms): 2, 1, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 11.47 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 28.70 MB (30093060) - PerHostPeakMemUsage: 983.43 MB (1031197781) - RowsProduced: 25.89M (25885645) - TotalNetworkReceiveTime: 459.045ms - TotalNetworkSendTime: 2s371ms - TotalStorageWaitTime: 3s958ms - TotalThreadsInvoluntaryContextSwitches: 2.50K (2500) - TotalThreadsTotalWallClockTime: 1m28s - TotalThreadsSysTime: 6s368ms - TotalThreadsUserTime: 8s547ms - TotalThreadsVoluntaryContextSwitches: 221.07K (221068) Fragment Instance Lifecycle Timings: - ExecTime: 6s709ms - ExecTreeExecTime: 669.470ms - OpenTime: 1s069ms - ExecTreeOpenTime: 901.958ms - PrepareTime: 48.957ms - ExecTreePrepareTime: 1.814ms DataStreamSender (dst_id=23):(Total: 3s724ms, non-child: 3s724ms, % non-child: 100.00%) - BytesSent: 245.03 MB (256929889) - NetworkThroughput(*): 105.17 MB/sec - OverallThroughput: 65.79 MB/sec - PeakMemoryUsage: 4.71 MB (4938816) - RowsReturned: 25.89M (25885645) - SerializeBatchTime: 1s389ms - TransmitDataRPCTime: 2s329ms - UncompressedRowBatchSize: 839.65 MB (880441170) CodeGen:(Total: 191.161ms, non-child: 191.161ms, % non-child: 100.00%) - CodegenTime: 849.877us - CompileTime: 49.737ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 90 (90) - NumInstructions: 2.97K (2968) - OptimizationTime: 116.176ms - PeakMemoryUsage: 1.45 MB (1519616) - PrepareTime: 24.902ms HASH_JOIN_NODE (id=11):(Total: 1s565ms, non-child: 562.287ms, % non-child: 35.92%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.461ms - PeakMemoryUsage: 1.20 MB (1255232) - ProbeRows: 25.89M (25885645) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 531.408ms - RowsReturned: 25.89M (25885645) - RowsReturnedRate: 16.54 M/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 26.745us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 139.963us - HashBuckets: 212 (212) - HashCollisions: 0 (0) - HashTablesBuildTime: 59.407us - LargestPartitionPercent: 9 (9) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1073600) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 459.055ms, non-child: 19.376us, % non-child: 0.00%) BytesReceived(500.000ms): 0, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 4.785us - DeserializeRowBatchTimer: 15.660us - FirstBatchArrivalWaitTime: 434.772ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 261.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=9):(Total: 544.179ms, non-child: 544.179ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:22/1.31 GB 0:13/724.24 MB 6:89/6.12 GB 3:31/1.97 GB 1:138/8.72 GB 5:284/18.21 GB 2:243/15.85 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 37 out of 37 Runtime filters: Only following filters arrived: 7, waited 341ms Hdfs Read Thread Concurrency Bucket: 0:93.33% 1:6.667% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:783 PARQUET/SNAPPY:37 BytesRead(500.000ms): 0, 0, 11.87 MB, 11.87 MB, 13.29 MB, 20.14 MB, 21.00 MB, 21.00 MB, 24.64 MB, 29.35 MB, 30.78 MB, 32.48 MB, 35.34 MB, 35.34 MB, 35.34 MB - FooterProcessingTime: (Avg: 53.910ms ; Min: 4.674ms ; Max: 110.676ms ; Number of samples: 37) - AverageHdfsReadThreadConcurrency: 0.07 - AverageScannerThreadConcurrency: 10.40 - BytesRead: 35.34 MB (37060271) - BytesReadDataNodeCache: 0 - BytesReadLocal: 35.34 MB (37060271) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 35.34 MB (37060271) - DecompressionTime: 223.779ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 6 (6) - NumRowGroups: 37 (37) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 22.90 MB (24012635) - PerReadThreadRawHdfsThroughput: 26.34 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 96.999ms - RowBatchQueuePutWaitTime: 1m5s - RowsRead: 25.89M (25885645) - RowsReturned: 25.89M (25885645) - RowsReturnedRate: 47.57 M/sec - ScanRangesComplete: 820 (820) - ScannerThreadsInvoluntaryContextSwitches: 1.97K (1971) - ScannerThreadsTotalWallClockTime: 1m20s - MaterializeTupleTime(*): 1s399ms - ScannerThreadsSysTime: 6s189ms - ScannerThreadsUserTime: 4s218ms - ScannerThreadsVoluntaryContextSwitches: 220.53K (220525) - TotalRawHdfsReadTime(*): 1s341ms - TotalReadThroughput: 4.71 MB/sec Filter 2 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 25.89M (25885645) Filter 7 (1.00 MB): - Files processed: 820 (820) - Files rejected: 783 (783) - Files total: 820 (820) - RowGroups processed: 25.31K (25309) - RowGroups rejected: 0 (0) - RowGroups total: 25.31K (25309) - Rows processed: 606.21K (606208) - Rows rejected: 0 (0) - Rows total: 25.89M (25885645) - Splits processed: 37 (37) - Splits rejected: 0 (0) - Splits total: 37 (37) Instance 7f40dcb034de70b7:f8 (host=va1027.foo:22000):(Total: 2s501ms, non-child: 384.945ms, % non-child: 15.39%) Hdfs split stats (:<# splits>/): 7:7/417.25 MB 5:9/493.60 MB 4:11/784.58 MB 1:10/706.48 MB 0:8/462.64 MB 2:7/574.88 MB 3:8/621.61 MB 6:12/828.24 MB Filter 7 arrival: 681ms MemoryUsage(500.000ms): 1.36 MB, 3.36 MB, 4.77 MB, 15.29 MB, 10.81 MB ThreadUsage(500.000ms): 2, 1, 7, 7, 7 - AverageThreadTokens: 4.80 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 15.75 MB (16518243) - PerHostPeakMemUsage: 480.71 MB (504062866) - RowsProduced: 4.10M (4101212) - TotalNetworkReceiveTime: 482.839ms - TotalNetworkSendTime: 343.082ms - TotalStorageWaitTime: 1s707ms - TotalThreadsInvoluntaryContextSwitches: 387 (387) - TotalThreadsTotalWallClockTime: 11s410ms - TotalThreadsSysTime: 280.954ms - TotalThreadsUserTime: 2s001ms - TotalThreadsVoluntaryContextSwitches: 35.20K (35201) Fragment Instance Lifecycle Timings: - ExecTime: 1s111ms - ExecTreeExecTime: 115.387ms - OpenTime: 1s354ms - ExecTreeOpenTime: 1s188ms - PrepareTime: 34.711ms - ExecTreePrepareTime: 330.634us DataStreamSender (dst_id=23):(Total: 634.001ms, non-child: 634.001ms, % non-child: 100.00%) - BytesSent: 38.03 MB (39876603) - NetworkThroughput(*): 99.89 MB/sec - OverallThroughput: 59.98 MB/sec - PeakMemoryUsage: 4.79 MB (5020736) - RowsReturned: 4.10M (4101212) - SerializeBatchTime: 252.211ms - TransmitDataRPCTime: 380.702ms - UncompressedRowBatchSize: 133.03 MB (139493824) CodeGen:(Total: 179.521ms, non-child: 179.521ms, % non-child: 100.00%) - CodegenTime: 922.867us - CompileTime: 49.875ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 90 (90) - NumInstructions: 2.97K (2968) - OptimizationTime: 115.285ms - PeakMemoryUsage: 1.45 MB (1519616) - PrepareTime: 13.985ms HASH_JOIN_NODE (id=11):(Total: 1s302ms, non-child: 98.842ms, % non-child: 7.59%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.472ms - PeakMemoryUsage: 1.20 MB (1255232) - ProbeRows: 4.10M (4101212) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 91.735ms - RowsReturned: 4.10M (4101212) - RowsReturnedRate: 3.15 M/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 27.510us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 156.446us - HashBuckets: 212 (212) - HashCollisions: 0 (0) - HashTablesBuildTime: 61.443us - LargestPartitionPercent: 9 (9) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1073600) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 482.850ms, non-child: 22.625us, % non-child: 0.00%) BytesReceived(500.000ms): 0, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 4.811us - DeserializeRowBatchTimer: 22.208us - FirstBatchArrivalWaitTime: 461.116ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 248.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=9):(Total: 721.112ms, non-child: 721.112ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:7/417.25 MB 5:9/493.60 MB 4:11/784.58 MB 1:10/706.48 MB 0:8/462.64 MB 2:7/574.88 MB 3:8/621.61 MB 6:12/828.24 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 6 out of 6 Runtime filters: Only following filters arrived: 7, waited 321ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:66 PARQUET/SNAPPY:6 BytesRead(500.000ms): 0, 0, 944.26 KB, 5.61 MB, 5.61 MB - FooterProcessingTime: (Avg: 186.954ms ; Min: 10.340ms ; Max: 315.736ms ; Number of samples: 6) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 3.60 - BytesRead: 5.61 MB (5882441) - BytesReadDataNodeCache: 0 - BytesReadLocal: 5.61 MB (5882441) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 5.61 MB (5882441) - DecompressionTime: 34.571ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 4 (4) - NumRowGroups: 6 (6) - NumScannerThreadsStarted: 6 (6) - PeakMemoryUsage: 9.98 MB (10465852) - PerReadThreadRawHdfsThroughput: 27.74 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 380.462ms - RowBatchQueuePutWaitTime: 3s392ms - RowsRead: 4.10M (4101212) - RowsReturned: 4.10M (4101212) - RowsReturnedRate: 5.69 M/sec - ScanRangesComplete: 72 (72) - ScannerThreadsInvoluntaryContextSwitches: 259 (259) - ScannerThreadsTotalWallClockTime: 8s460ms - MaterializeTupleTime(*): 229.133ms - ScannerThreadsSysTime: 255.958ms - ScannerThreadsUserTime: 1s096ms - ScannerThreadsVoluntaryContextSwitches: 34.77K (34766) - TotalRawHdfsReadTime(*): 202.259ms - TotalReadThroughput: 2.24 MB/sec Filter 2 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 4.10M (4101212) Filter 7 (1.00 MB): - Files processed: 72 (72) - Files rejected: 66 (66) - Files total: 72 (72) - RowGroups processed: 4.01K (4010) - RowGroups rejected: 0 (0) - RowGroups total: 4.01K (4010) - Rows processed: 98.30K (98304) - Rows rejected: 0 (0) - Rows total: 4.10M (4101212) - Splits processed: 6 (6) - Splits rejected: 0 (0) - Splits total: 6 (6) Instance 7f40dcb034de70b7:f7 (host=vd1114.foo:22000):(Total: 1s888ms, non-child: 265.612ms, % non-child: 14.07%) Hdfs split stats (:<# splits>/): 0:5/332.81 MB 6:7/537.65 MB 2:6/375.68 MB 1:6/276.75 MB 7:8/661.99 MB 4:6/377.51 MB 3:7/499.68 MB 5:6/451.54 MB Filter 7 arrival: 675ms MemoryUsage(500.000ms): 1.36 MB, 3.36 MB, 3.40 MB, 7.51 MB ThreadUsage(500.000ms): 2, 1, 3, 1 - AverageThreadTokens: 1.75 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 12.32 MB (12921015) - PerHostPeakMemUsage: 344.67 MB (361411403) - RowsProduced: 1.76M (1757604) - TotalNetworkReceiveTime: 461.093ms - TotalNetworkSendTime: 245.873ms - TotalStorageWaitTime: 248.612ms - TotalThreadsInvoluntaryContextSwitches: 105 (105) - TotalThreadsTotalWallClockTime: 3s846ms - TotalThreadsSysTime: 57.990ms - TotalThreadsUserTime: 650.898ms - TotalThreadsVoluntaryContextSwitches: 1.82K (1822) Fragment Instance Lifecycle Timings: - ExecTime: 548.268ms - ExecTreeExecTime: 43.107ms - OpenTime: 1s291ms - ExecTreeOpenTime: 1s122ms - PrepareTime: 48.760ms - ExecTreePrepareTime: 265.343us DataStreamSender (dst_id=23):(Total: 268.449ms, non-child: 268.449ms, % non-child: 100.00%) - BytesSent: 15.87 MB (16642058) - NetworkThroughput(*): 89.73 MB/sec - OverallThroughput: 59.12 MB/sec - PeakMemoryUsage: 4.86 MB (5094464) - RowsReturned: 1.76M (1757604) - SerializeBatchTime: 90.790ms - TransmitDataRPCTime: 176.868ms - UncompressedRowBatchSize: 57.01 MB (59781392) CodeGen:(Total: 188.363ms, non-child: 188.363ms, % non-child: 100.00%) - CodegenTime: 903.593us - CompileTime: 50.271ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 90 (90) - NumInstructions: 2.97K (2968) - OptimizationTime: 116.564ms - PeakMemoryUsage: 1.45 MB (1519616) - PrepareTime: 21.173ms HASH_JOIN_NODE (id=11):(Total: 1s165ms, non-child: 36.285ms, % non-child: 3.11%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.473ms - PeakMemoryUsage: 1.20 MB (1255232) - ProbeRows: 1.76M (1757604) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 32.607ms - RowsReturned: 1.76M (1757604) - RowsReturnedRate: 1.51 M/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 26.006us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 120.719us - HashBuckets: 212 (212) - HashCollisions: 0 (0) - HashTablesBuildTime: 58.735us - LargestPartitionPercent: 9 (9) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1073600) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 461.102ms, non-child: 19.115us, % non-child: 0.00%) BytesReceived(500.000ms): 0, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 4.588us - DeserializeRowBatchTimer: 16.438us - FirstBatchArrivalWaitTime: 440.257ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 260.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=9):(Total: 668.369ms, non-child: 668.369ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:5/332.81 MB 6:7/537.65 MB 2:6/375.68 MB 1:6/276.75 MB 7:8/661.99 MB 4:6/377.51 MB 3:7/499.68 MB 5:6/451.54 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 2 out of 2 Runtime filters: Only following filters arrived: 7, waited 342ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:49 PARQUET/SNAPPY:2 BytesRead(500.000ms): 0, 0, 100.00 KB, 2.25 MB - FooterProcessingTime: (Avg: 53.701ms ; Min: 17.795ms ; Max: 89.606ms ; Number of samples: 2) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.50 - BytesRead: 2.25 MB (2355612) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.25 MB (2355612) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 2.25 MB (2355612) - DecompressionTime: 16.909ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 2 (2) - NumRowGroups: 2 (2) - NumScannerThreadsStarted: 2 (2) - PeakMemoryUsage: 6.10 MB (6400906) - PerReadThreadRawHdfsThroughput: 31.05 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 316.973ms - RowBatchQueuePutWaitTime: 566.513ms - RowsRead: 1.76M (1757604) - RowsReturned: 1.76M (1757604) - RowsReturnedRate: 2.63 M/sec - ScanRangesComplete: 51 (51) - ScannerThreadsInvoluntaryContextSwitches: 49 (49) - ScannerThreadsTotalWallClockTime: 1s545ms - MaterializeTupleTime(*): 95.155ms - ScannerThreadsSysTime: 15.996ms - ScannerThreadsUserTime: 232.963ms - ScannerThreadsVoluntaryContextSwitches: 1.42K (1417) - TotalRawHdfsReadTime(*): 72.356ms - TotalReadThroughput: 1.12 MB/sec Filter 2 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 1.76M (1757604) Filter 7 (1.00 MB): - Files processed: 51 (51) - Files rejected: 49 (49) - Files total: 51 (51) - RowGroups processed: 1.72K (1718) - RowGroups rejected: 0 (0) - RowGroups total: 1.72K (1718) - Rows processed: 32.77K (32768) - Rows rejected: 0 (0) - Rows total: 1.76M (1757604) - Splits processed: 2 (2) - Splits rejected: 0 (0) - Splits total: 2 (2) Averaged Fragment F06:(Total: 224.028ms, non-child: 115.742ms, % non-child: 51.66%) split sizes: min: 2.15 MB, max: 2.15 MB, avg: 2.15 MB, stddev: 0 completion times: min:609.765ms max:609.765ms mean: 609.765ms stddev:0.000ns execution rates: min:3.53 MB/sec max:3.53 MB/sec mean:3.53 MB/sec stddev:0.00 /sec num instances: 1 - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.44 MB (3602820) - PerHostPeakMemUsage: 20.46 MB (21455757) - RowsProduced: 120 (120) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 101.288us - TotalStorageWaitTime: 15.700ms - TotalThreadsInvoluntaryContextSwitches: 13 (13) - TotalThreadsTotalWallClockTime: 119.583ms - TotalThreadsSysTime: 11.997ms - TotalThreadsUserTime: 34.994ms - TotalThreadsVoluntaryContextSwitches: 307 (307) Fragment Instance Lifecycle Timings: - ExecTime: 60.850ms - ExecTreeExecTime: 30.205ms - OpenTime: 29.527ms - ExecTreeOpenTime: 146.431us - PrepareTime: 133.608ms - ExecTreePrepareTime: 1.098ms DataStreamSender (dst_id=21):(Total: 4.181ms, non-child: 4.181ms, % non-child: 100.00%) - BytesSent: 130.21 KB (133330) - NetworkThroughput(*): 92.24 MB/sec - OverallThroughput: 30.41 MB/sec - PeakMemoryUsage: 1.29 MB (1350720) - RowsReturned: 120 (120) - SerializeBatchTime: 11.415us - TransmitDataRPCTime: 1.378ms - UncompressedRowBatchSize: 267.48 KB (273896) CodeGen:(Total: 71.429ms, non-child: 71.429ms, % non-child: 100.00%) - CodegenTime: 1.375ms - CompileTime: 10.008ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 17 (17) - NumInstructions: 310 (310) - OptimizationTime: 18.047ms - PeakMemoryUsage: 155.00 KB (158720) - PrepareTime: 42.759ms HDFS_SCAN_NODE (id=10):(Total: 32.674ms, non-child: 32.674ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 465.57 KB (476741) - BytesReadDataNodeCache: 0 - BytesReadLocal: 465.57 KB (476741) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 465.57 KB (476741) - DecompressionTime: 212.260us - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 2.14 MB (2243261) - PerReadThreadRawHdfsThroughput: 227.14 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 29.078ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 73.05K (73049) - RowsReturned: 120 (120) - RowsReturnedRate: 3.67 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 2 (2) - ScannerThreadsTotalWallClockTime: 29.535ms - MaterializeTupleTime(*): 5.844ms - ScannerThreadsSysTime: 1.999ms - ScannerThreadsUserTime: 4.999ms - ScannerThreadsVoluntaryContextSwitches: 7 (7) - TotalRawHdfsReadTime(*): 2.001ms - TotalReadThroughput: 0.00 /sec Fragment F06: Instance 7f40dcb034de70b7:f6 (host=va1045.foo:22000):(Total: 224.028ms, non-child: 115.742ms, % non-child: 51.66%) Hdfs split stats (:<# splits>/): 0:1/2.15 MB - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.44 MB (3602820) - PerHostPeakMemUsage: 20.46 MB (21455757) - RowsProduced: 120 (120) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 101.288us - TotalStorageWaitTime: 15.700ms - TotalThreadsInvoluntaryContextSwitches: 13 (13) - TotalThreadsTotalWallClockTime: 119.583ms - TotalThreadsSysTime: 11.997ms - TotalThreadsUserTime: 34.994ms - TotalThreadsVoluntaryContextSwitches: 307 (307) Fragment Instance Lifecycle Timings: - ExecTime: 60.850ms - ExecTreeExecTime: 30.205ms - OpenTime: 29.527ms - ExecTreeOpenTime: 146.431us - PrepareTime: 133.608ms - ExecTreePrepareTime: 1.098ms DataStreamSender (dst_id=21):(Total: 4.181ms, non-child: 4.181ms, % non-child: 100.00%) - BytesSent: 130.21 KB (133330) - NetworkThroughput(*): 92.24 MB/sec - OverallThroughput: 30.41 MB/sec - PeakMemoryUsage: 1.29 MB (1350720) - RowsReturned: 120 (120) - SerializeBatchTime: 11.415us - TransmitDataRPCTime: 1.378ms - UncompressedRowBatchSize: 267.48 KB (273896) CodeGen:(Total: 71.429ms, non-child: 71.429ms, % non-child: 100.00%) - CodegenTime: 1.375ms - CompileTime: 10.008ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 17 (17) - NumInstructions: 310 (310) - OptimizationTime: 18.047ms - PeakMemoryUsage: 155.00 KB (158720) - PrepareTime: 42.759ms HDFS_SCAN_NODE (id=10):(Total: 32.674ms, non-child: 32.674ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/2.15 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:3 - FooterProcessingTime: (Avg: 3.729ms ; Min: 3.729ms ; Max: 3.729ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 465.57 KB (476741) - BytesReadDataNodeCache: 0 - BytesReadLocal: 465.57 KB (476741) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 465.57 KB (476741) - DecompressionTime: 212.260us - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 2.14 MB (2243261) - PerReadThreadRawHdfsThroughput: 227.14 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 29.078ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 73.05K (73049) - RowsReturned: 120 (120) - RowsReturnedRate: 3.67 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 2 (2) - ScannerThreadsTotalWallClockTime: 29.535ms - MaterializeTupleTime(*): 5.844ms - ScannerThreadsSysTime: 1.999ms - ScannerThreadsUserTime: 4.999ms - ScannerThreadsVoluntaryContextSwitches: 7 (7) - TotalRawHdfsReadTime(*): 2.001ms - TotalReadThroughput: 0.00 /sec Averaged Fragment F01:(Total: 1s157ms, non-child: 0.000ns, % non-child: 0.00%) split sizes: min: 2.25 GB, max: 36.92 GB, avg: 35.93 GB, stddev: 4.24 GB completion times: min:1s079ms max:10m59s mean: 10m54s stddev:56s671ms execution rates: min:12.45 MB/sec max:2.09 GB/sec mean:71.70 MB/sec stddev:179.01 MB/sec num instances: 134 - AverageThreadTokens: 11.69 - BloomFilterBytes: 16.88 MB (17700588) - PeakMemoryUsage: 59.85 MB (62752070) - PerHostPeakMemUsage: 168.30 GB (180709260728) - RowsProduced: 1.21M (1211751) - TotalNetworkReceiveTime: 102.903ms - TotalNetworkSendTime: 3.882ms - TotalStorageWaitTime: 1s119ms - TotalThreadsInvoluntaryContextSwitches: 29 (29) - TotalThreadsTotalWallClockTime: 1s199ms - TotalThreadsSysTime: 3.916ms - TotalThreadsUserTime: 198.230ms - TotalThreadsVoluntaryContextSwitches: 61 (61) Fragment Instance Lifecycle Timings: - ExecTime: 325.875us - ExecTreeExecTime: 35.711ms - OpenTime: 1s095ms - ExecTreeOpenTime: 894.205ms - PrepareTime: 61.662ms - ExecTreePrepareTime: 663.572us DataStreamSender (dst_id=24):(Total: 171.680ms, non-child: 171.680ms, % non-child: 100.00%) - BytesSent: 10.30 MB (10795920) - NetworkThroughput(*): 94.72 MB/sec - OverallThroughput: 54.38 MB/sec - PeakMemoryUsage: 4.68 MB (4903664) - RowsReturned: 1.21M (1210734) - SerializeBatchTime: 65.535ms - TransmitDataRPCTime: 104.826ms - UncompressedRowBatchSize: 33.22 MB (34837345) CodeGen:(Total: 223.943ms, non-child: 223.943ms, % non-child: 100.00%) - CodegenTime: 1.203ms - CompileTime: 60.057ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 138.991ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 24.380ms HASH_JOIN_NODE (id=8):(Total: 930.753ms, non-child: 31.269ms, % non-child: 3.36%) - BuildRows: 120 (120) - BuildTime: 1.380ms - PeakMemoryUsage: 1.11 MB (1160974) - ProbeRows: 1.21M (1211824) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 28.134ms - RowsReturned: 1.21M (1210808) - RowsReturnedRate: 1.27 M/sec Hash Join Builder (join_node_id=8): - BuildRowsPartitionTime: 23.879us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 141.285us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 53.180us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=19):(Total: 102.913ms, non-child: 102.913ms, % non-child: 100.00%) - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 4.615us - DeserializeRowBatchTimer: 28.514us - FirstBatchArrivalWaitTime: 94.547ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 3.58 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=6):(Total: 796.647ms, non-child: 796.647ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 10.69 - BytesRead: 23.67 MB (24815032) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 7.854ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 0 (0) - NumRowGroups: 6 (6) - NumScannerThreadsStarted: 10 (10) - PeakMemoryUsage: 38.09 MB (39938389) - PerReadThreadRawHdfsThroughput: 47.68 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 1.33M (1329569) - RowsReturned: 1.21M (1211824) - RowsReturnedRate: 1.65 M/sec - ScanRangesComplete: 148 (148) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 2.642ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 507.729ms - TotalReadThroughput: 38.02 KB/sec Filter 2 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 41.32K (41324) Filter 3 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 41.32K (41324) Filter 4 (1.00 MB): - Files processed: 154 (154) - Files rejected: 148 (148) - Files total: 154 (154) - RowGroups processed: 1.30K (1298) - RowGroups rejected: 0 (0) - RowGroups total: 1.30K (1298) - Rows processed: 2.44K (2445) - Rows rejected: 0 (0) - Rows total: 41.32K (41324) - Splits processed: 6 (6) - Splits rejected: 0 (0) - Splits total: 6 (6) Fragment F01: Instance 7f40dcb034de70b7:183 (host=va1041.foo:22000):(Total: 1s316ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 6:21/4.57 GB 3:17/3.76 GB 4:22/4.95 GB 2:21/5.09 GB 1:17/3.67 GB 7:21/4.75 GB 5:17/4.14 GB 0:24/5.81 GB Filter 4 arrival: 567ms Filter 2 arrival: 6s469ms Filter 3 arrival: 9m23s MemoryUsage(16s000ms): 51.21 MB, 61.66 MB, 61.66 MB, 61.66 MB, 61.66 MB, 61.66 MB, 61.66 MB, 61.66 MB, 61.66 MB, 61.66 MB, 61.66 MB, 61.66 MB, 61.66 MB, 61.66 MB, 61.66 MB, 61.66 MB, 61.66 MB, 61.66 MB, 61.66 MB, 61.66 MB, 61.66 MB, 61.66 MB, 61.66 MB, 61.66 MB, 61.66 MB, 61.66 MB, 61.66 MB, 61.66 MB, 61.66 MB, 61.66 MB, 61.66 MB, 61.66 MB, 61.66 MB, 61.66 MB, 61.66 MB, 61.66 MB, 61.66 MB, 61.66 MB, 61.66 MB ThreadUsage(16s000ms): 12, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.99 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 61.66 MB (64657293) - PerHostPeakMemUsage: 169.56 GB (182068847826) - RowsProduced: 1.16M (1160192) - TotalNetworkReceiveTime: 271.301ms - TotalNetworkSendTime: 62.257ms - TotalStorageWaitTime: 1s482ms - TotalThreadsInvoluntaryContextSwitches: 27 (27) - TotalThreadsTotalWallClockTime: 1s516ms - TotalThreadsSysTime: 1.999ms - TotalThreadsUserTime: 232.964ms - TotalThreadsVoluntaryContextSwitches: 35 (35) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 38.583ms - OpenTime: 1s244ms - ExecTreeOpenTime: 1s011ms - PrepareTime: 72.087ms - ExecTreePrepareTime: 836.427us DataStreamSender (dst_id=24):(Total: 175.090ms, non-child: 175.090ms, % non-child: 100.00%) - BytesSent: 9.89 MB (10373707) - NetworkThroughput(*): 96.12 MB/sec - OverallThroughput: 56.50 MB/sec - PeakMemoryUsage: 4.76 MB (4994816) - RowsReturned: 1.16M (1159168) - SerializeBatchTime: 70.810ms - TransmitDataRPCTime: 102.929ms - UncompressedRowBatchSize: 31.83 MB (33380360) CodeGen:(Total: 257.067ms, non-child: 257.067ms, % non-child: 100.00%) - CodegenTime: 1.456ms - CompileTime: 69.691ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 160.734ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 26.070ms HASH_JOIN_NODE (id=8):(Total: 1s051ms, non-child: 33.689ms, % non-child: 3.20%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.201ms - PeakMemoryUsage: 1.11 MB (1162479) - ProbeRows: 1.16M (1160574) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 30.068ms - RowsReturned: 1.16M (1159550) - RowsReturnedRate: 1.10 M/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 22.165us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 94.302us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 41.549us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=19):(Total: 271.310ms, non-child: 17.252us, % non-child: 0.01%) BytesReceived(16s000ms): 963.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 4.657us - DeserializeRowBatchTimer: 21.767us - FirstBatchArrivalWaitTime: 252.084ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 442.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=6):(Total: 746.786ms, non-child: 746.786ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 6:21/4.57 GB 3:17/3.76 GB 4:22/4.95 GB 2:21/5.09 GB 1:17/3.67 GB 7:21/4.75 GB 5:17/4.14 GB 0:24/5.81 GB ExecOption: PARQUET Codegen Enabled Runtime filters: Only following filters arrived: 4, waited 462ms BytesRead(16s000ms): 23.12 MB, 25.51 MB, 25.51 MB, 25.51 MB, 25.51 MB, 25.51 MB, 25.51 MB, 25.51 MB, 25.51 MB, 25.51 MB, 25.51 MB, 25.51 MB, 25.51 MB, 25.51 MB, 25.51 MB, 25.51 MB, 25.51 MB, 25.51 MB, 25.51 MB, 25.51 MB, 25.51 MB, 25.51 MB, 25.51 MB, 25.51 MB, 25.51 MB, 25.51 MB, 25.51 MB, 25.51 MB, 25.51 MB, 25.51 MB, 25.51 MB, 25.51 MB, 25.51 MB, 25.51 MB, 25.51 MB, 25.51 MB, 25.51 MB, 25.51 MB, 25.51 MB - FooterProcessingTime: (Avg: 73.431ms ; Min: 43.118ms ; Max: 122.139ms ; Number of samples: 8) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 12.00 - BytesRead: 25.51 MB (26749468) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 7.036ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 0 (0) - NumRowGroups: 8 (8) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 39.98 MB (41924704) - PerReadThreadRawHdfsThroughput: 55.85 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 1.28M (1280382) - RowsReturned: 1.16M (1160574) - RowsReturnedRate: 1.55 M/sec - ScanRangesComplete: 153 (153) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 4.698ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 456.794ms - TotalReadThroughput: 40.98 KB/sec Filter 2 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 54.65K (54654) Filter 3 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 54.65K (54654) Filter 4 (1.00 MB): - Files processed: 160 (160) - Files rejected: 152 (152) - Files total: 160 (160) - RowGroups processed: 1.25K (1251) - RowGroups rejected: 0 (0) - RowGroups total: 1.25K (1251) - Rows processed: 16.38K (16384) - Rows rejected: 0 (0) - Rows total: 54.65K (54654) - Splits processed: 8 (8) - Splits rejected: 0 (0) - Splits total: 8 (8) Instance 7f40dcb034de70b7:181 (host=vc1507.foo:22000):(Total: 1s253ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 1:18/4.08 GB 3:19/4.66 GB 5:24/5.72 GB 7:20/4.73 GB 2:23/5.03 GB 0:20/4.33 GB 6:19/4.54 GB 4:17/3.72 GB Filter 4 arrival: 569ms Filter 2 arrival: 6s481ms Filter 3 arrival: 9m24s MemoryUsage(16s000ms): 64.66 MB, 74.13 MB, 74.13 MB, 74.13 MB, 74.13 MB, 74.13 MB, 74.13 MB, 74.13 MB, 74.13 MB, 74.13 MB, 74.13 MB, 74.13 MB, 74.13 MB, 74.13 MB, 74.13 MB, 74.13 MB, 74.13 MB, 74.13 MB, 74.13 MB, 74.13 MB, 74.13 MB, 74.13 MB, 74.13 MB, 74.13 MB, 74.13 MB, 74.13 MB, 74.13 MB, 74.13 MB, 74.13 MB, 74.13 MB, 74.13 MB, 74.13 MB, 74.13 MB, 74.13 MB, 74.13 MB, 74.13 MB, 74.13 MB, 74.13 MB, 74.13 MB ThreadUsage(16s000ms): 9, 10, 10, 10, 10, 10, 10, 10, 10, 10, 10, 10, 10, 10, 10, 10, 10, 10, 10, 10, 10, 10, 10, 10, 10, 10, 10, 10, 10, 10, 10, 10, 10, 10, 10, 10, 10, 10, 10 - AverageThreadTokens: 9.99 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 74.13 MB (77733994) - PerHostPeakMemUsage: 169.57 GB (182076389417) - RowsProduced: 2.17M (2167808) - TotalNetworkReceiveTime: 324.324ms - TotalNetworkSendTime: 7.962ms - TotalStorageWaitTime: 2s057ms - TotalThreadsInvoluntaryContextSwitches: 24 (24) - TotalThreadsTotalWallClockTime: 1s523ms - TotalThreadsSysTime: 3.000ms - TotalThreadsUserTime: 192.970ms - TotalThreadsVoluntaryContextSwitches: 47 (47) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 57.785ms - OpenTime: 1s197ms - ExecTreeOpenTime: 1s003ms - PrepareTime: 55.456ms - ExecTreePrepareTime: 776.346us DataStreamSender (dst_id=24):(Total: 296.178ms, non-child: 296.178ms, % non-child: 100.00%) - BytesSent: 18.79 MB (19706213) - NetworkThroughput(*): 103.61 MB/sec - OverallThroughput: 63.45 MB/sec - PeakMemoryUsage: 4.60 MB (4822784) - RowsReturned: 2.17M (2166784) - SerializeBatchTime: 113.742ms - TransmitDataRPCTime: 181.389ms - UncompressedRowBatchSize: 60.58 MB (63523160) CodeGen:(Total: 218.192ms, non-child: 218.192ms, % non-child: 100.00%) - CodegenTime: 1.206ms - CompileTime: 58.703ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 133.500ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 25.501ms HASH_JOIN_NODE (id=8):(Total: 1s062ms, non-child: 49.597ms, % non-child: 4.67%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.423ms - PeakMemoryUsage: 1.11 MB (1162460) - ProbeRows: 2.17M (2167808) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 45.600ms - RowsReturned: 2.17M (2166784) - RowsReturnedRate: 2.04 M/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 25.770us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 142.818us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 70.356us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=19):(Total: 324.335ms, non-child: 20.640us, % non-child: 0.01%) BytesReceived(16s000ms): 963.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 5.286us - DeserializeRowBatchTimer: 20.460us - FirstBatchArrivalWaitTime: 312.457ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 369.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=6):(Total: 688.348ms, non-child: 688.348ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:18/4.08 GB 3:19/4.66 GB 5:24/5.72 GB 7:20/4.73 GB 2:23/5.03 GB 0:20/4.33 GB 6:19/4.54 GB 4:17/3.72 GB ExecOption: PARQUET Codegen Enabled Runtime filters: Only following filters arrived: 4, waited 463ms BytesRead(16s000ms): 34.13 MB, 36.56 MB, 36.56 MB, 36.56 MB, 36.56 MB, 36.56 MB, 36.56 MB, 36.56 MB, 36.56 MB, 36.56 MB, 36.56 MB, 36.56 MB, 36.56 MB, 36.56 MB, 36.56 MB, 36.56 MB, 36.56 MB, 36.56 MB, 36.56 MB, 36.56 MB, 36.56 MB, 36.56 MB, 36.56 MB, 36.56 MB, 36.56 MB, 36.56 MB, 36.56 MB, 36.56 MB, 36.56 MB, 36.56 MB, 36.56 MB, 36.56 MB, 36.56 MB, 36.56 MB, 36.56 MB, 36.56 MB, 36.56 MB, 36.56 MB, 36.56 MB - FooterProcessingTime: (Avg: 93.334ms ; Min: 47.904ms ; Max: 139.999ms ; Number of samples: 9) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 8.99 - BytesRead: 36.56 MB (38330823) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 10.850ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 0 (0) - NumRowGroups: 9 (9) - NumScannerThreadsStarted: 9 (9) - PeakMemoryUsage: 52.33 MB (54876574) - PerReadThreadRawHdfsThroughput: 48.53 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 2.29M (2289664) - RowsReturned: 2.17M (2167808) - RowsReturnedRate: 3.15 M/sec - ScanRangesComplete: 151 (151) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 753.185ms - TotalReadThroughput: 58.81 KB/sec Filter 2 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 3 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 4 (1.00 MB): - Files processed: 160 (160) - Files rejected: 151 (151) - Files total: 160 (160) - RowGroups processed: 2.24K (2236) - RowGroups rejected: 0 (0) - RowGroups total: 2.24K (2236) - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) - Splits processed: 9 (9) - Splits rejected: 0 (0) - Splits total: 9 (9) Instance 7f40dcb034de70b7:182 (host=va1026.foo:22000):(Total: 1s243ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 1:13/2.84 GB 2:21/5.01 GB 7:24/5.64 GB 4:21/4.95 GB 6:14/3.33 GB 5:19/4.69 GB 3:20/4.93 GB 0:21/4.95 GB Filter 4 arrival: 543ms Filter 2 arrival: 6s361ms Filter 3 arrival: 9m23s MemoryUsage(16s000ms): 52.48 MB, 61.42 MB, 61.42 MB, 61.42 MB, 61.42 MB, 61.42 MB, 61.42 MB, 61.42 MB, 61.42 MB, 61.42 MB, 61.42 MB, 61.42 MB, 61.42 MB, 61.42 MB, 61.42 MB, 61.42 MB, 61.42 MB, 61.42 MB, 61.42 MB, 61.42 MB, 61.42 MB, 61.42 MB, 61.42 MB, 61.42 MB, 61.42 MB, 61.42 MB, 61.42 MB, 61.42 MB, 61.42 MB, 61.42 MB, 61.42 MB, 61.42 MB, 61.42 MB, 61.42 MB, 61.42 MB, 61.42 MB, 61.42 MB, 61.42 MB, 61.42 MB ThreadUsage(16s000ms): 12, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.99 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 61.42 MB (64404345) - PerHostPeakMemUsage: 169.56 GB (182068681164) - RowsProduced: 2.24M (2238464) - TotalNetworkReceiveTime: 276.643ms - TotalNetworkSendTime: 756.372us - TotalStorageWaitTime: 1s094ms - TotalThreadsInvoluntaryContextSwitches: 22 (22) - TotalThreadsTotalWallClockTime: 1s446ms - TotalThreadsSysTime: 999.000us - TotalThreadsUserTime: 201.969ms - TotalThreadsVoluntaryContextSwitches: 71 (71) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 59.062ms - OpenTime: 1s168ms - ExecTreeOpenTime: 966.834ms - PrepareTime: 74.291ms - ExecTreePrepareTime: 776.662us DataStreamSender (dst_id=24):(Total: 307.485ms, non-child: 307.485ms, % non-child: 100.00%) - BytesSent: 19.45 MB (20389832) - NetworkThroughput(*): 103.37 MB/sec - OverallThroughput: 63.24 MB/sec - PeakMemoryUsage: 4.66 MB (4888320) - RowsReturned: 2.24M (2237440) - SerializeBatchTime: 118.608ms - TransmitDataRPCTime: 188.119ms - UncompressedRowBatchSize: 62.56 MB (65599664) CodeGen:(Total: 229.339ms, non-child: 229.339ms, % non-child: 100.00%) - CodegenTime: 1.041ms - CompileTime: 58.803ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 140.895ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 29.149ms HASH_JOIN_NODE (id=8):(Total: 1s026ms, non-child: 50.807ms, % non-child: 4.95%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 983.384us - PeakMemoryUsage: 1.11 MB (1162519) - ProbeRows: 2.24M (2238464) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 47.247ms - RowsReturned: 2.24M (2237440) - RowsReturnedRate: 2.18 M/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 26.416us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 82.084us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 31.413us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=19):(Total: 276.651ms, non-child: 14.580us, % non-child: 0.01%) BytesReceived(16s000ms): 963.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 2.914us - DeserializeRowBatchTimer: 25.121us - FirstBatchArrivalWaitTime: 271.254ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 433.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=6):(Total: 699.423ms, non-child: 699.423ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:13/2.84 GB 2:21/5.01 GB 7:24/5.64 GB 4:21/4.95 GB 6:14/3.33 GB 5:19/4.69 GB 3:20/4.93 GB 0:21/4.95 GB ExecOption: PARQUET Codegen Enabled Runtime filters: Only following filters arrived: 4, waited 482ms BytesRead(16s000ms): 20.19 MB, 21.82 MB, 21.82 MB, 21.82 MB, 21.82 MB, 21.82 MB, 21.82 MB, 21.82 MB, 21.82 MB, 21.82 MB, 21.82 MB, 21.82 MB, 21.82 MB, 21.82 MB, 21.82 MB, 21.82 MB, 21.82 MB, 21.82 MB, 21.82 MB, 21.82 MB, 21.82 MB, 21.82 MB, 21.82 MB, 21.82 MB, 21.82 MB, 21.82 MB, 21.82 MB, 21.82 MB, 21.82 MB, 21.82 MB, 21.82 MB, 21.82 MB, 21.82 MB, 21.82 MB, 21.82 MB, 21.82 MB, 21.82 MB, 21.82 MB, 21.82 MB - FooterProcessingTime: (Avg: 98.202ms ; Min: 59.808ms ; Max: 164.178ms ; Number of samples: 5) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 11.99 - BytesRead: 21.82 MB (22875590) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 13.769ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 0 (0) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 39.38 MB (41289178) - PerReadThreadRawHdfsThroughput: 50.70 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 2.36M (2356224) - RowsReturned: 2.24M (2238464) - RowsReturnedRate: 3.20 M/sec - ScanRangesComplete: 148 (148) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 430.312ms - TotalReadThroughput: 35.15 KB/sec Filter 2 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 3 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 4 (1.00 MB): - Files processed: 153 (153) - Files rejected: 148 (148) - Files total: 153 (153) - RowGroups processed: 2.30K (2301) - RowGroups rejected: 0 (0) - RowGroups total: 2.30K (2301) - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) - Splits processed: 5 (5) - Splits rejected: 0 (0) - Splits total: 5 (5) Instance 7f40dcb034de70b7:17e (host=va1027.foo:22000):(Total: 1s211ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 5:7/1.54 GB 6:4/738.76 MB 7:2/504.99 MB 3:6/1.25 GB 0:6/1.30 GB 2:3/554.59 MB 4:5/1.19 GB 1:4/1009.66 MB Filter 4 arrival: 580ms Filter 2 arrival: 6s459ms Filter 3 arrival: 9m24s MemoryUsage(16s000ms): 29.11 MB, 36.75 MB, 36.75 MB, 36.75 MB, 36.75 MB, 36.75 MB, 36.75 MB, 36.75 MB, 36.75 MB, 36.75 MB, 36.75 MB, 36.75 MB, 36.75 MB, 36.75 MB, 36.75 MB, 36.75 MB, 36.75 MB, 36.75 MB, 36.75 MB, 36.75 MB, 36.75 MB, 36.75 MB, 36.75 MB, 36.75 MB, 36.75 MB, 36.75 MB, 36.75 MB, 36.75 MB, 36.75 MB, 36.75 MB, 36.75 MB, 36.75 MB, 36.75 MB, 36.75 MB, 36.75 MB, 36.75 MB, 36.75 MB, 36.75 MB, 36.75 MB ThreadUsage(16s000ms): 12, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.99 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 36.75 MB (38538000) - PerHostPeakMemUsage: 169.54 GB (182043355220) - RowsProduced: 2.58M (2582528) - TotalNetworkReceiveTime: 346.495ms - TotalNetworkSendTime: 853.285us - TotalStorageWaitTime: 545.286ms - TotalThreadsInvoluntaryContextSwitches: 18 (18) - TotalThreadsTotalWallClockTime: 1s502ms - TotalThreadsSysTime: 1.000ms - TotalThreadsUserTime: 180.971ms - TotalThreadsVoluntaryContextSwitches: 31 (31) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 75.719ms - OpenTime: 1s154ms - ExecTreeOpenTime: 974.215ms - PrepareTime: 57.106ms - ExecTreePrepareTime: 271.584us DataStreamSender (dst_id=24):(Total: 347.580ms, non-child: 347.580ms, % non-child: 100.00%) - BytesSent: 22.43 MB (23517366) - NetworkThroughput(*): 106.10 MB/sec - OverallThroughput: 64.53 MB/sec - PeakMemoryUsage: 4.54 MB (4757248) - RowsReturned: 2.58M (2581504) - SerializeBatchTime: 134.988ms - TransmitDataRPCTime: 211.375ms - UncompressedRowBatchSize: 72.44 MB (75959856) CodeGen:(Total: 201.811ms, non-child: 201.811ms, % non-child: 100.00%) - CodegenTime: 1.379ms - CompileTime: 51.202ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 127.296ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 22.796ms HASH_JOIN_NODE (id=8):(Total: 1s049ms, non-child: 58.100ms, % non-child: 5.54%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.284ms - PeakMemoryUsage: 1.11 MB (1162538) - ProbeRows: 2.58M (2583490) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 52.908ms - RowsReturned: 2.58M (2582466) - RowsReturnedRate: 2.46 M/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 34.735us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 98.282us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 37.020us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=19):(Total: 346.504ms, non-child: 16.738us, % non-child: 0.00%) BytesReceived(16s000ms): 963.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 4.507us - DeserializeRowBatchTimer: 19.234us - FirstBatchArrivalWaitTime: 328.032ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 346.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=6):(Total: 645.055ms, non-child: 645.055ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:7/1.54 GB 6:4/738.76 MB 7:2/504.99 MB 3:6/1.25 GB 0:6/1.30 GB 2:3/554.59 MB 4:5/1.19 GB 1:4/1009.66 MB ExecOption: PARQUET Codegen Enabled Runtime filters: Only following filters arrived: 4, waited 442ms BytesRead(16s000ms): 8.62 MB, 9.20 MB, 9.20 MB, 9.20 MB, 9.20 MB, 9.20 MB, 9.20 MB, 9.20 MB, 9.20 MB, 9.20 MB, 9.20 MB, 9.20 MB, 9.20 MB, 9.20 MB, 9.20 MB, 9.20 MB, 9.20 MB, 9.20 MB, 9.20 MB, 9.20 MB, 9.20 MB, 9.20 MB, 9.20 MB, 9.20 MB, 9.20 MB, 9.20 MB, 9.20 MB, 9.20 MB, 9.20 MB, 9.20 MB, 9.20 MB, 9.20 MB, 9.20 MB, 9.20 MB, 9.20 MB, 9.20 MB, 9.20 MB, 9.20 MB, 9.20 MB - FooterProcessingTime: (Avg: 107.526ms ; Min: 49.200ms ; Max: 142.252ms ; Number of samples: 3) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 11.99 - BytesRead: 9.20 MB (9641937) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 25.304ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 0 (0) - NumRowGroups: 3 (3) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 14.82 MB (15545025) - PerReadThreadRawHdfsThroughput: 41.58 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 2.70M (2698178) - RowsReturned: 2.58M (2583490) - RowsReturnedRate: 4.01 M/sec - ScanRangesComplete: 35 (35) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 8.057ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 221.120ms - TotalReadThroughput: 14.79 KB/sec Filter 2 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 144.32K (144322) Filter 3 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 144.32K (144322) Filter 4 (1.00 MB): - Files processed: 37 (37) - Files rejected: 34 (34) - Files total: 37 (37) - RowGroups processed: 2.63K (2635) - RowGroups rejected: 0 (0) - RowGroups total: 2.63K (2635) - Rows processed: 16.38K (16384) - Rows rejected: 0 (0) - Rows total: 144.32K (144322) - Splits processed: 3 (3) - Splits rejected: 0 (0) - Splits total: 3 (3) Instance 7f40dcb034de70b7:188 (host=ve1136.foo:22000):(Total: 1s200ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 3:19/4.51 GB 0:17/3.53 GB 2:18/4.15 GB 4:24/5.29 GB 1:21/4.98 GB 7:16/3.94 GB 6:24/5.35 GB 5:21/4.72 GB Filter 4 arrival: 534ms Filter 2 arrival: 6s562ms Filter 3 arrival: 9m23s MemoryUsage(16s000ms): 48.32 MB, 57.23 MB, 57.23 MB, 57.23 MB, 57.23 MB, 57.23 MB, 57.23 MB, 57.23 MB, 57.23 MB, 57.23 MB, 57.23 MB, 57.23 MB, 57.23 MB, 57.23 MB, 57.23 MB, 57.23 MB, 57.23 MB, 57.23 MB, 57.23 MB, 57.23 MB, 57.23 MB, 57.23 MB, 57.23 MB, 57.23 MB, 57.23 MB, 57.23 MB, 57.23 MB, 57.23 MB, 57.23 MB, 57.23 MB, 57.23 MB, 57.23 MB, 57.23 MB, 57.23 MB, 57.23 MB, 57.23 MB, 57.23 MB, 57.23 MB, 57.23 MB ThreadUsage(16s000ms): 5, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6 - AverageThreadTokens: 5.99 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 57.23 MB (60008283) - PerHostPeakMemUsage: 169.56 GB (182064215665) - RowsProduced: 2.61M (2609152) - TotalNetworkReceiveTime: 295.221ms - TotalNetworkSendTime: 826.576us - TotalStorageWaitTime: 912.055ms - TotalThreadsInvoluntaryContextSwitches: 20 (20) - TotalThreadsTotalWallClockTime: 1s439ms - TotalThreadsSysTime: 4.999ms - TotalThreadsUserTime: 182.972ms - TotalThreadsVoluntaryContextSwitches: 41 (41) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 60.409ms - OpenTime: 1s143ms - ExecTreeOpenTime: 957.629ms - PrepareTime: 56.774ms - ExecTreePrepareTime: 558.370us DataStreamSender (dst_id=24):(Total: 336.596ms, non-child: 336.596ms, % non-child: 100.00%) - BytesSent: 22.76 MB (23867414) - NetworkThroughput(*): 105.11 MB/sec - OverallThroughput: 67.62 MB/sec - PeakMemoryUsage: 4.74 MB (4970240) - RowsReturned: 2.61M (2608128) - SerializeBatchTime: 118.856ms - TransmitDataRPCTime: 216.556ms - UncompressedRowBatchSize: 73.14 MB (76696680) CodeGen:(Total: 210.592ms, non-child: 210.592ms, % non-child: 100.00%) - CodegenTime: 1.105ms - CompileTime: 54.932ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 129.230ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 25.988ms HASH_JOIN_NODE (id=8):(Total: 1s018ms, non-child: 53.476ms, % non-child: 5.25%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.285ms - PeakMemoryUsage: 1.11 MB (1162457) - ProbeRows: 2.61M (2609152) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 49.757ms - RowsReturned: 2.61M (2608128) - RowsReturnedRate: 2.56 M/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 21.156us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 128.464us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 46.182us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=19):(Total: 295.236ms, non-child: 41.743us, % non-child: 0.01%) BytesReceived(16s000ms): 963.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 3.699us - DeserializeRowBatchTimer: 13.741us - FirstBatchArrivalWaitTime: 274.894ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 406.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=6):(Total: 669.761ms, non-child: 669.761ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:19/4.51 GB 0:17/3.53 GB 2:18/4.15 GB 4:24/5.29 GB 1:21/4.98 GB 7:16/3.94 GB 6:24/5.35 GB 5:21/4.72 GB ExecOption: PARQUET Codegen Enabled Runtime filters: Only following filters arrived: 4, waited 503ms BytesRead(16s000ms): 19.43 MB, 20.73 MB, 20.73 MB, 20.73 MB, 20.73 MB, 20.73 MB, 20.73 MB, 20.73 MB, 20.73 MB, 20.73 MB, 20.73 MB, 20.73 MB, 20.73 MB, 20.73 MB, 20.73 MB, 20.73 MB, 20.73 MB, 20.73 MB, 20.73 MB, 20.73 MB, 20.73 MB, 20.73 MB, 20.73 MB, 20.73 MB, 20.73 MB, 20.73 MB, 20.73 MB, 20.73 MB, 20.73 MB, 20.73 MB, 20.73 MB, 20.73 MB, 20.73 MB, 20.73 MB, 20.73 MB, 20.73 MB, 20.73 MB, 20.73 MB, 20.73 MB - FooterProcessingTime: (Avg: 74.513ms ; Min: 43.101ms ; Max: 85.988ms ; Number of samples: 5) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.99 - BytesRead: 20.73 MB (21737503) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 14.890ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 0 (0) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 5 (5) - PeakMemoryUsage: 35.30 MB (37019277) - PerReadThreadRawHdfsThroughput: 49.38 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 2.73M (2726912) - RowsReturned: 2.61M (2609152) - RowsReturnedRate: 3.90 M/sec - ScanRangesComplete: 155 (155) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 419.814ms - TotalReadThroughput: 33.32 KB/sec Filter 2 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 3 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 4 (1.00 MB): - Files processed: 160 (160) - Files rejected: 155 (155) - Files total: 160 (160) - RowGroups processed: 2.66K (2663) - RowGroups rejected: 0 (0) - RowGroups total: 2.66K (2663) - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) - Splits processed: 5 (5) - Splits rejected: 0 (0) - Splits total: 5 (5) Instance 7f40dcb034de70b7:1b0 (host=vd1112.foo:22000):(Total: 1s194ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 5:15/3.48 GB 4:19/4.53 GB 6:30/7.34 GB 0:18/4.14 GB 2:27/6.66 GB 3:13/3.21 GB 7:18/3.96 GB 1:14/3.23 GB Filter 4 arrival: 375ms Filter 2 arrival: 7s055ms Filter 3 arrival: 9m23s MemoryUsage(16s000ms): 45.23 MB, 54.40 MB, 54.40 MB, 54.40 MB, 54.40 MB, 54.40 MB, 54.40 MB, 54.40 MB, 54.40 MB, 54.40 MB, 54.40 MB, 54.40 MB, 54.40 MB, 54.40 MB, 54.40 MB, 54.40 MB, 54.40 MB, 54.40 MB, 54.40 MB, 54.40 MB, 54.40 MB, 54.40 MB, 54.40 MB, 54.40 MB, 54.40 MB, 54.40 MB, 54.40 MB, 54.40 MB, 54.40 MB, 54.40 MB, 54.40 MB, 54.40 MB, 54.40 MB, 54.40 MB, 54.40 MB, 54.40 MB, 54.40 MB, 54.40 MB, 54.40 MB ThreadUsage(16s000ms): 12, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.98 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 54.40 MB (57038816) - PerHostPeakMemUsage: 169.55 GB (182055132687) - RowsProduced: 1.43M (1433600) - TotalNetworkReceiveTime: 119.147ms - TotalNetworkSendTime: 362.753us - TotalStorageWaitTime: 1s135ms - TotalThreadsInvoluntaryContextSwitches: 69 (69) - TotalThreadsTotalWallClockTime: 1s263ms - TotalThreadsSysTime: 7.998ms - TotalThreadsUserTime: 201.969ms - TotalThreadsVoluntaryContextSwitches: 46 (46) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 39.698ms - OpenTime: 1s143ms - ExecTreeOpenTime: 935.489ms - PrepareTime: 51.410ms - ExecTreePrepareTime: 968.404us DataStreamSender (dst_id=24):(Total: 198.335ms, non-child: 198.335ms, % non-child: 100.00%) - BytesSent: 12.28 MB (12880013) - NetworkThroughput(*): 97.57 MB/sec - OverallThroughput: 61.93 MB/sec - PeakMemoryUsage: 4.78 MB (5011200) - RowsReturned: 1.43M (1432576) - SerializeBatchTime: 72.468ms - TransmitDataRPCTime: 125.894ms - UncompressedRowBatchSize: 39.63 MB (41552408) CodeGen:(Total: 229.216ms, non-child: 229.216ms, % non-child: 100.00%) - CodegenTime: 1.026ms - CompileTime: 69.078ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 137.003ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 22.727ms HASH_JOIN_NODE (id=8):(Total: 976.534ms, non-child: 34.028ms, % non-child: 3.48%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.301ms - PeakMemoryUsage: 1.11 MB (1162486) - ProbeRows: 1.43M (1433600) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 30.598ms - RowsReturned: 1.43M (1432576) - RowsReturnedRate: 1.47 M/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 20.708us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 156.131us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 56.480us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=19):(Total: 119.157ms, non-child: 17.071us, % non-child: 0.01%) BytesReceived(16s000ms): 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 4.628us - DeserializeRowBatchTimer: 28.535us - FirstBatchArrivalWaitTime: 108.099ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 1.01 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=6):(Total: 823.560ms, non-child: 823.560ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:15/3.48 GB 4:19/4.53 GB 6:30/7.34 GB 0:18/4.14 GB 2:27/6.66 GB 3:13/3.21 GB 7:18/3.96 GB 1:14/3.23 GB ExecOption: PARQUET Codegen Enabled Runtime filters: Only following filters arrived: 4, waited 663ms BytesRead(16s000ms): 19.64 MB, 20.95 MB, 20.95 MB, 20.95 MB, 20.95 MB, 20.95 MB, 20.95 MB, 20.95 MB, 20.95 MB, 20.95 MB, 20.95 MB, 20.95 MB, 20.95 MB, 20.95 MB, 20.95 MB, 20.95 MB, 20.95 MB, 20.95 MB, 20.95 MB, 20.95 MB, 20.95 MB, 20.95 MB, 20.95 MB, 20.95 MB, 20.95 MB, 20.95 MB, 20.95 MB, 20.95 MB, 20.95 MB, 20.95 MB, 20.95 MB, 20.95 MB, 20.95 MB, 20.95 MB, 20.95 MB, 20.95 MB, 20.95 MB, 20.95 MB, 20.95 MB - FooterProcessingTime: (Avg: 72.111ms ; Min: 42.313ms ; Max: 126.932ms ; Number of samples: 6) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 11.98 - BytesRead: 20.95 MB (21964251) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 8.320ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 0 (0) - NumRowGroups: 6 (6) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 32.45 MB (34026536) - PerReadThreadRawHdfsThroughput: 40.98 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 1.55M (1552384) - RowsReturned: 1.43M (1433600) - RowsReturnedRate: 1.74 M/sec - ScanRangesComplete: 148 (148) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 511.178ms - TotalReadThroughput: 33.62 KB/sec Filter 2 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 3 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 4 (1.00 MB): - Files processed: 154 (154) - Files rejected: 148 (148) - Files total: 154 (154) - RowGroups processed: 1.52K (1516) - RowGroups rejected: 0 (0) - RowGroups total: 1.52K (1516) - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) - Splits processed: 6 (6) - Splits rejected: 0 (0) - Splits total: 6 (6) Instance 7f40dcb034de70b7:180 (host=vc1519.foo:22000):(Total: 1s194ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 6:22/5.04 GB 0:19/4.43 GB 2:17/3.61 GB 7:22/4.77 GB 5:21/4.84 GB 1:22/4.94 GB 4:20/4.56 GB 3:17/4.08 GB Filter 4 arrival: 582ms Filter 2 arrival: 6s502ms Filter 3 arrival: 9m24s MemoryUsage(16s000ms): 53.13 MB, 63.84 MB, 63.84 MB, 63.84 MB, 63.84 MB, 63.84 MB, 63.84 MB, 63.84 MB, 63.84 MB, 63.84 MB, 63.84 MB, 63.84 MB, 63.84 MB, 63.84 MB, 63.84 MB, 63.84 MB, 63.84 MB, 63.84 MB, 63.84 MB, 63.84 MB, 63.84 MB, 63.84 MB, 63.84 MB, 63.84 MB, 63.84 MB, 63.84 MB, 63.84 MB, 63.84 MB, 63.84 MB, 63.84 MB, 63.84 MB, 63.84 MB, 63.84 MB, 63.84 MB, 63.84 MB, 63.84 MB, 63.84 MB, 63.84 MB, 63.84 MB ThreadUsage(16s000ms): 12, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.98 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 63.84 MB (66941270) - PerHostPeakMemUsage: 169.57 GB (182071139285) - RowsProduced: 2.55M (2551808) - TotalNetworkReceiveTime: 342.972ms - TotalNetworkSendTime: 848.555us - TotalStorageWaitTime: 1s606ms - TotalThreadsInvoluntaryContextSwitches: 20 (20) - TotalThreadsTotalWallClockTime: 1s478ms - TotalThreadsSysTime: 1.999ms - TotalThreadsUserTime: 181.972ms - TotalThreadsVoluntaryContextSwitches: 36 (36) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 86.499ms - OpenTime: 1s134ms - ExecTreeOpenTime: 952.223ms - PrepareTime: 60.232ms - ExecTreePrepareTime: 529.660us DataStreamSender (dst_id=24):(Total: 360.521ms, non-child: 360.521ms, % non-child: 100.00%) - BytesSent: 22.65 MB (23745781) - NetworkThroughput(*): 99.04 MB/sec - OverallThroughput: 62.81 MB/sec - PeakMemoryUsage: 4.90 MB (5134080) - RowsReturned: 2.55M (2550784) - SerializeBatchTime: 130.573ms - TransmitDataRPCTime: 228.648ms - UncompressedRowBatchSize: 71.48 MB (74955096) CodeGen:(Total: 207.141ms, non-child: 207.141ms, % non-child: 100.00%) - CodegenTime: 1.052ms - CompileTime: 54.704ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 125.359ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 26.622ms HASH_JOIN_NODE (id=8):(Total: 1s038ms, non-child: 77.815ms, % non-child: 7.49%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.541ms - PeakMemoryUsage: 1.11 MB (1166708) - ProbeRows: 2.55M (2552083) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 73.023ms - RowsReturned: 2.55M (2551059) - RowsReturnedRate: 2.46 M/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 25.178us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 145.724us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 69.875us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=19):(Total: 342.981ms, non-child: 17.970us, % non-child: 0.01%) BytesReceived(16s000ms): 932.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 4.828us - DeserializeRowBatchTimer: 9.261us - FirstBatchArrivalWaitTime: 330.325ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 349.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=6):(Total: 618.098ms, non-child: 618.098ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 6:22/5.04 GB 0:19/4.43 GB 2:17/3.61 GB 7:22/4.77 GB 5:21/4.84 GB 1:22/4.94 GB 4:20/4.56 GB 3:17/4.08 GB ExecOption: PARQUET Codegen Enabled Runtime filters: Only following filters arrived: 4, waited 442ms BytesRead(16s000ms): 25.88 MB, 28.56 MB, 28.56 MB, 28.56 MB, 28.56 MB, 28.56 MB, 28.56 MB, 28.56 MB, 28.56 MB, 28.56 MB, 28.56 MB, 28.56 MB, 28.56 MB, 28.56 MB, 28.56 MB, 28.56 MB, 28.56 MB, 28.56 MB, 28.56 MB, 28.56 MB, 28.56 MB, 28.56 MB, 28.56 MB, 28.56 MB, 28.56 MB, 28.56 MB, 28.56 MB, 28.56 MB, 28.56 MB, 28.56 MB, 28.56 MB, 28.56 MB, 28.56 MB, 28.56 MB, 28.56 MB, 28.56 MB, 28.56 MB, 28.56 MB, 28.56 MB - FooterProcessingTime: (Avg: 110.134ms ; Min: 80.841ms ; Max: 153.731ms ; Number of samples: 8) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 11.99 - BytesRead: 28.56 MB (29945805) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 11.374ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 0 (0) - NumRowGroups: 8 (8) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 42.97 MB (45058415) - PerReadThreadRawHdfsThroughput: 77.38 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 2.67M (2671891) - RowsReturned: 2.55M (2552083) - RowsReturnedRate: 4.13 M/sec - ScanRangesComplete: 153 (153) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 19.236ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 369.052ms - TotalReadThroughput: 45.94 KB/sec Filter 2 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 343.31K (343315) Filter 3 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 343.31K (343315) Filter 4 (1.00 MB): - Files processed: 160 (160) - Files rejected: 152 (152) - Files total: 160 (160) - RowGroups processed: 2.61K (2610) - RowGroups rejected: 0 (0) - RowGroups total: 2.61K (2610) - Rows processed: 16.38K (16384) - Rows rejected: 0 (0) - Rows total: 343.31K (343315) - Splits processed: 8 (8) - Splits rejected: 0 (0) - Splits total: 8 (8) Instance 7f40dcb034de70b7:18e (host=vd1333.foo:22000):(Total: 1s193ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 6:20/4.68 GB 1:20/4.26 GB 3:23/5.02 GB 2:23/5.02 GB 7:18/3.84 GB 4:25/5.93 GB 0:17/3.71 GB 5:19/4.09 GB Filter 4 arrival: 511ms Filter 2 arrival: 6s597ms Filter 3 arrival: 9m23s MemoryUsage(16s000ms): 54.86 MB, 65.55 MB, 65.55 MB, 65.55 MB, 65.55 MB, 65.55 MB, 65.55 MB, 65.55 MB, 65.55 MB, 65.55 MB, 65.55 MB, 65.55 MB, 65.55 MB, 65.55 MB, 65.55 MB, 65.55 MB, 65.55 MB, 65.55 MB, 65.55 MB, 65.55 MB, 65.55 MB, 65.55 MB, 65.55 MB, 65.55 MB, 65.55 MB, 65.55 MB, 65.55 MB, 65.55 MB, 65.55 MB, 65.55 MB, 65.55 MB, 65.55 MB, 65.55 MB, 65.55 MB, 65.55 MB, 65.55 MB, 65.55 MB, 65.55 MB, 65.55 MB ThreadUsage(16s000ms): 12, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.99 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 65.55 MB (68736677) - PerHostPeakMemUsage: 169.57 GB (182072937354) - RowsProduced: 2.22M (2222080) - TotalNetworkReceiveTime: 295.341ms - TotalNetworkSendTime: 800.314us - TotalStorageWaitTime: 1s105ms - TotalThreadsInvoluntaryContextSwitches: 19 (19) - TotalThreadsTotalWallClockTime: 1s444ms - TotalThreadsSysTime: 2.999ms - TotalThreadsUserTime: 171.974ms - TotalThreadsVoluntaryContextSwitches: 57 (57) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 70.013ms - OpenTime: 1s147ms - ExecTreeOpenTime: 975.099ms - PrepareTime: 45.871ms - ExecTreePrepareTime: 523.419us DataStreamSender (dst_id=24):(Total: 315.548ms, non-child: 315.548ms, % non-child: 100.00%) - BytesSent: 19.17 MB (20099564) - NetworkThroughput(*): 96.37 MB/sec - OverallThroughput: 60.75 MB/sec - PeakMemoryUsage: 4.65 MB (4871936) - RowsReturned: 2.22M (2221056) - SerializeBatchTime: 115.971ms - TransmitDataRPCTime: 198.907ms - UncompressedRowBatchSize: 62.09 MB (65108448) CodeGen:(Total: 190.937ms, non-child: 190.937ms, % non-child: 100.00%) - CodegenTime: 853.454us - CompileTime: 51.824ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 119.453ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 19.277ms HASH_JOIN_NODE (id=8):(Total: 1s045ms, non-child: 62.906ms, % non-child: 6.02%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.737ms - PeakMemoryUsage: 1.11 MB (1162456) - ProbeRows: 2.22M (2222670) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 58.353ms - RowsReturned: 2.22M (2221646) - RowsReturnedRate: 2.13 M/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 26.504us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 162.270us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 83.959us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=19):(Total: 295.350ms, non-child: 18.245us, % non-child: 0.01%) BytesReceived(16s000ms): 963.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 4.246us - DeserializeRowBatchTimer: 17.427us - FirstBatchArrivalWaitTime: 289.321ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 406.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=6):(Total: 687.187ms, non-child: 687.187ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 6:20/4.68 GB 1:20/4.26 GB 3:23/5.02 GB 2:23/5.02 GB 7:18/3.84 GB 4:25/5.93 GB 0:17/3.71 GB 5:19/4.09 GB ExecOption: PARQUET Codegen Enabled Runtime filters: Only following filters arrived: 4, waited 523ms BytesRead(16s000ms): 23.29 MB, 25.68 MB, 25.68 MB, 25.68 MB, 25.68 MB, 25.68 MB, 25.68 MB, 25.68 MB, 25.68 MB, 25.68 MB, 25.68 MB, 25.68 MB, 25.68 MB, 25.68 MB, 25.68 MB, 25.68 MB, 25.68 MB, 25.68 MB, 25.68 MB, 25.68 MB, 25.68 MB, 25.68 MB, 25.68 MB, 25.68 MB, 25.68 MB, 25.68 MB, 25.68 MB, 25.68 MB, 25.68 MB, 25.68 MB, 25.68 MB, 25.68 MB, 25.68 MB, 25.68 MB, 25.68 MB, 25.68 MB, 25.68 MB, 25.68 MB, 25.68 MB - FooterProcessingTime: (Avg: 85.642ms ; Min: 49.646ms ; Max: 115.794ms ; Number of samples: 7) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 12.00 - BytesRead: 25.68 MB (26931837) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 12.457ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 0 (0) - NumRowGroups: 7 (7) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 43.59 MB (45703459) - PerReadThreadRawHdfsThroughput: 57.74 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 2.34M (2341454) - RowsReturned: 2.22M (2222670) - RowsReturnedRate: 3.23 M/sec - ScanRangesComplete: 159 (159) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 3.540ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 444.803ms - TotalReadThroughput: 41.29 KB/sec Filter 2 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 65.10K (65102) Filter 3 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 65.10K (65102) Filter 4 (1.00 MB): - Files processed: 165 (165) - Files rejected: 158 (158) - Files total: 165 (165) - RowGroups processed: 2.29K (2287) - RowGroups rejected: 0 (0) - RowGroups total: 2.29K (2287) - Rows processed: 16.38K (16384) - Rows rejected: 0 (0) - Rows total: 65.10K (65102) - Splits processed: 7 (7) - Splits rejected: 0 (0) - Splits total: 7 (7) Instance 7f40dcb034de70b7:1f9 (host=va1032.foo:22000):(Total: 1s191ms, non-child: 15.602ms, % non-child: 1.31%) Hdfs split stats (:<# splits>/): 4:18/4.13 GB 5:14/3.28 GB 0:15/3.54 GB 7:17/4.19 GB 1:24/5.75 GB 6:26/6.02 GB 3:20/4.79 GB 2:20/4.84 GB Filter 4 arrival: 271ms Filter 2 arrival: 9s209ms Filter 3 arrival: 9m23s MemoryUsage(16s000ms): 50.19 MB, 61.83 MB, 61.83 MB, 61.83 MB, 61.83 MB, 61.83 MB, 61.83 MB, 61.83 MB, 61.83 MB, 61.83 MB, 61.83 MB, 61.83 MB, 61.83 MB, 61.83 MB, 61.83 MB, 61.83 MB, 61.83 MB, 61.83 MB, 61.83 MB, 61.83 MB, 61.83 MB, 61.83 MB, 61.83 MB, 61.83 MB, 61.83 MB, 61.83 MB, 61.83 MB, 61.83 MB, 61.83 MB, 61.83 MB, 61.83 MB, 61.83 MB, 61.83 MB, 61.83 MB, 61.83 MB, 61.83 MB, 61.83 MB, 61.83 MB, 61.83 MB ThreadUsage(16s000ms): 12, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.99 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 61.83 MB (64837627) - PerHostPeakMemUsage: 169.56 GB (182062903226) - RowsProduced: 98.30K (98304) - TotalNetworkReceiveTime: 10.665us - TotalNetworkSendTime: 19.810us - TotalStorageWaitTime: 1s300ms - TotalThreadsInvoluntaryContextSwitches: 34 (34) - TotalThreadsTotalWallClockTime: 1s138ms - TotalThreadsSysTime: 2.999ms - TotalThreadsUserTime: 217.967ms - TotalThreadsVoluntaryContextSwitches: 53 (53) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 5.622ms - OpenTime: 1s137ms - ExecTreeOpenTime: 916.379ms - PrepareTime: 54.333ms - ExecTreePrepareTime: 765.614us DataStreamSender (dst_id=24):(Total: 12.899ms, non-child: 12.899ms, % non-child: 100.00%) - BytesSent: 325.87 KB (333694) - NetworkThroughput(*): 77.84 MB/sec - OverallThroughput: 24.67 MB/sec - PeakMemoryUsage: 4.69 MB (4912896) - RowsReturned: 97.28K (97280) - SerializeBatchTime: 8.062ms - TransmitDataRPCTime: 4.088ms - UncompressedRowBatchSize: 1.06 MB (1116400) CodeGen:(Total: 239.719ms, non-child: 239.719ms, % non-child: 100.00%) - CodegenTime: 1.162ms - CompileTime: 71.608ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 147.111ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 20.492ms HASH_JOIN_NODE (id=8):(Total: 923.391ms, non-child: 6.745ms, % non-child: 0.73%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.421ms - PeakMemoryUsage: 1.10 MB (1150906) - ProbeRows: 98.30K (98304) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4.434ms - RowsReturned: 97.28K (97280) - RowsReturnedRate: 105.35 K/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 39.751us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 80.980us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 79.236us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=19):(Total: 20.719us, non-child: 20.719us, % non-child: 100.00%) BytesReceived(16s000ms): 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 5.192us - DeserializeRowBatchTimer: 17.571us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 5.79 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=6):(Total: 916.630ms, non-child: 916.630ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:18/4.13 GB 5:14/3.28 GB 0:15/3.54 GB 7:17/4.19 GB 1:24/5.75 GB 6:26/6.02 GB 3:20/4.79 GB 2:20/4.84 GB ExecOption: PARQUET Codegen Enabled Runtime filters: Only following filters arrived: 4, waited 763ms BytesRead(16s000ms): 22.98 MB, 24.51 MB, 24.51 MB, 24.51 MB, 24.51 MB, 24.51 MB, 24.51 MB, 24.51 MB, 24.51 MB, 24.51 MB, 24.51 MB, 24.51 MB, 24.51 MB, 24.51 MB, 24.51 MB, 24.51 MB, 24.51 MB, 24.51 MB, 24.51 MB, 24.51 MB, 24.51 MB, 24.51 MB, 24.51 MB, 24.51 MB, 24.51 MB, 24.51 MB, 24.51 MB, 24.51 MB, 24.51 MB, 24.51 MB, 24.51 MB, 24.51 MB, 24.51 MB, 24.51 MB, 24.51 MB, 24.51 MB, 24.51 MB, 24.51 MB, 24.51 MB - FooterProcessingTime: (Avg: 84.893ms ; Min: 51.268ms ; Max: 126.936ms ; Number of samples: 6) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 11.99 - BytesRead: 24.51 MB (25701764) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 3.365ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 0 (0) - NumRowGroups: 6 (6) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 39.41 MB (41320316) - PerReadThreadRawHdfsThroughput: 47.42 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 217.09K (217088) - RowsReturned: 98.30K (98304) - RowsReturnedRate: 107.24 K/sec - ScanRangesComplete: 148 (148) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 516.862ms - TotalReadThroughput: 39.25 KB/sec Filter 2 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 3 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 4 (1.00 MB): - Files processed: 154 (154) - Files rejected: 148 (148) - Files total: 154 (154) - RowGroups processed: 212 (212) - RowGroups rejected: 0 (0) - RowGroups total: 212 (212) - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) - Splits processed: 6 (6) - Splits rejected: 0 (0) - Splits total: 6 (6) Instance 7f40dcb034de70b7:19e (host=vc1530.foo:22000):(Total: 1s191ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:18/4.44 GB 6:23/4.63 GB 3:18/4.28 GB 2:18/3.99 GB 1:18/4.44 GB 7:25/5.57 GB 4:19/4.49 GB 5:19/4.48 GB Filter 4 arrival: 442ms Filter 2 arrival: 6s802ms Filter 3 arrival: 9m23s MemoryUsage(16s000ms): 44.88 MB, 55.23 MB, 55.23 MB, 55.23 MB, 55.23 MB, 55.23 MB, 55.23 MB, 55.23 MB, 55.23 MB, 55.23 MB, 55.23 MB, 55.23 MB, 55.23 MB, 55.23 MB, 55.23 MB, 55.23 MB, 55.23 MB, 55.23 MB, 55.23 MB, 55.23 MB, 55.23 MB, 55.23 MB, 55.23 MB, 55.23 MB, 55.23 MB, 55.23 MB, 55.23 MB, 55.23 MB, 55.23 MB, 55.23 MB, 55.23 MB, 55.23 MB, 55.23 MB, 55.23 MB, 55.23 MB, 55.23 MB, 55.23 MB, 55.23 MB, 55.23 MB ThreadUsage(16s000ms): 5, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6 - AverageThreadTokens: 5.99 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 55.23 MB (57910361) - PerHostPeakMemUsage: 169.56 GB (182062118557) - RowsProduced: 1.96M (1955840) - TotalNetworkReceiveTime: 212.613ms - TotalNetworkSendTime: 630.061us - TotalStorageWaitTime: 1s506ms - TotalThreadsInvoluntaryContextSwitches: 25 (25) - TotalThreadsTotalWallClockTime: 1s356ms - TotalThreadsSysTime: 3.999ms - TotalThreadsUserTime: 182.972ms - TotalThreadsVoluntaryContextSwitches: 54 (54) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 50.814ms - OpenTime: 1s143ms - ExecTreeOpenTime: 957.137ms - PrepareTime: 48.144ms - ExecTreePrepareTime: 512.145us DataStreamSender (dst_id=24):(Total: 267.441ms, non-child: 267.441ms, % non-child: 100.00%) - BytesSent: 16.59 MB (17394218) - NetworkThroughput(*): 98.02 MB/sec - OverallThroughput: 62.03 MB/sec - PeakMemoryUsage: 4.53 MB (4749056) - RowsReturned: 1.95M (1954816) - SerializeBatchTime: 97.050ms - TransmitDataRPCTime: 169.228ms - UncompressedRowBatchSize: 54.55 MB (57204336) CodeGen:(Total: 202.621ms, non-child: 202.621ms, % non-child: 100.00%) - CodegenTime: 1.041ms - CompileTime: 58.201ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 126.201ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 17.790ms HASH_JOIN_NODE (id=8):(Total: 1s008ms, non-child: 44.424ms, % non-child: 4.41%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 727.151us - PeakMemoryUsage: 1.11 MB (1162533) - ProbeRows: 1.96M (1955840) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 41.662ms - RowsReturned: 1.95M (1954816) - RowsReturnedRate: 1.94 M/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 23.006us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 55.460us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 50.285us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=19):(Total: 212.620ms, non-child: 13.980us, % non-child: 0.01%) BytesReceived(16s000ms): 963.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 3.039us - DeserializeRowBatchTimer: 9.245us - FirstBatchArrivalWaitTime: 197.827ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 564.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=6):(Total: 751.343ms, non-child: 751.343ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:18/4.44 GB 6:23/4.63 GB 3:18/4.28 GB 2:18/3.99 GB 1:18/4.44 GB 7:25/5.57 GB 4:19/4.49 GB 5:19/4.48 GB ExecOption: PARQUET Codegen Enabled Runtime filters: Only following filters arrived: 4, waited 582ms BytesRead(16s000ms): 17.84 MB, 19.68 MB, 19.68 MB, 19.68 MB, 19.68 MB, 19.68 MB, 19.68 MB, 19.68 MB, 19.68 MB, 19.68 MB, 19.68 MB, 19.68 MB, 19.68 MB, 19.68 MB, 19.68 MB, 19.68 MB, 19.68 MB, 19.68 MB, 19.68 MB, 19.68 MB, 19.68 MB, 19.68 MB, 19.68 MB, 19.68 MB, 19.68 MB, 19.68 MB, 19.68 MB, 19.68 MB, 19.68 MB, 19.68 MB, 19.68 MB, 19.68 MB, 19.68 MB, 19.68 MB, 19.68 MB, 19.68 MB, 19.68 MB, 19.68 MB, 19.68 MB - FooterProcessingTime: (Avg: 104.482ms ; Min: 51.593ms ; Max: 167.802ms ; Number of samples: 5) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 5.00 - BytesRead: 19.68 MB (20641133) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 15.727ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 0 (0) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 5 (5) - PeakMemoryUsage: 33.29 MB (34909146) - PerReadThreadRawHdfsThroughput: 44.94 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 2.07M (2073600) - RowsReturned: 1.96M (1955840) - RowsReturnedRate: 2.60 M/sec - ScanRangesComplete: 153 (153) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 438.052ms - TotalReadThroughput: 31.72 KB/sec Filter 2 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 3 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 4 (1.00 MB): - Files processed: 158 (158) - Files rejected: 153 (153) - Files total: 158 (158) - RowGroups processed: 2.02K (2025) - RowGroups rejected: 0 (0) - RowGroups total: 2.02K (2025) - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) - Splits processed: 5 (5) - Splits rejected: 0 (0) - Splits total: 5 (5) Instance 7f40dcb034de70b7:200 (host=vd1121.foo:22000):(Total: 1s190ms, non-child: 41.920ms, % non-child: 3.52%) Hdfs split stats (:<# splits>/): 0:11/2.49 GB 4:23/5.67 GB 2:18/4.22 GB 7:21/4.89 GB 1:17/3.67 GB 6:26/6.22 GB 3:21/4.83 GB 5:19/4.31 GB Filter 4 arrival: 290ms Filter 2 arrival: 9s473ms Filter 3 arrival: 9m23s MemoryUsage(16s000ms): 56.01 MB, 69.31 MB, 69.31 MB, 69.31 MB, 69.31 MB, 69.31 MB, 69.31 MB, 69.31 MB, 69.31 MB, 69.31 MB, 69.31 MB, 69.31 MB, 69.31 MB, 69.31 MB, 69.31 MB, 69.31 MB, 69.31 MB, 69.31 MB, 69.31 MB, 69.31 MB, 69.31 MB, 69.31 MB, 69.31 MB, 69.31 MB, 69.31 MB, 69.31 MB, 69.31 MB, 69.31 MB, 69.31 MB, 69.31 MB, 69.31 MB, 69.31 MB, 69.31 MB, 69.31 MB, 69.31 MB, 69.31 MB, 69.31 MB, 69.31 MB, 69.31 MB ThreadUsage(16s000ms): 12, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.99 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 69.31 MB (72672286) - PerHostPeakMemUsage: 169.57 GB (182076301709) - RowsProduced: 101.38K (101376) - TotalNetworkReceiveTime: 3.360us - TotalNetworkSendTime: 21.660us - TotalStorageWaitTime: 1s164ms - TotalThreadsInvoluntaryContextSwitches: 25 (25) - TotalThreadsTotalWallClockTime: 1s100ms - TotalThreadsSysTime: 5.999ms - TotalThreadsUserTime: 204.969ms - TotalThreadsVoluntaryContextSwitches: 47 (47) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 3.845ms - OpenTime: 1s099ms - ExecTreeOpenTime: 888.274ms - PrepareTime: 90.959ms - ExecTreePrepareTime: 2.143ms DataStreamSender (dst_id=24):(Total: 13.067ms, non-child: 13.067ms, % non-child: 100.00%) - BytesSent: 490.65 KB (502423) - NetworkThroughput(*): 86.43 MB/sec - OverallThroughput: 36.67 MB/sec - PeakMemoryUsage: 4.65 MB (4880128) - RowsReturned: 100.35K (100352) - SerializeBatchTime: 5.705ms - TransmitDataRPCTime: 5.544ms - UncompressedRowBatchSize: 1.51 MB (1585288) CodeGen:(Total: 239.038ms, non-child: 239.038ms, % non-child: 100.00%) - CodegenTime: 1.419ms - CompileTime: 61.779ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 146.745ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 29.943ms HASH_JOIN_NODE (id=8):(Total: 896.271ms, non-child: 5.141ms, % non-child: 0.57%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.387ms - PeakMemoryUsage: 1.11 MB (1162382) - ProbeRows: 101.38K (101376) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3.254ms - RowsReturned: 100.35K (100352) - RowsReturnedRate: 111.97 K/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 19.822us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 124.587us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 50.603us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=19):(Total: 12.021us, non-child: 12.021us, % non-child: 100.00%) BytesReceived(16s000ms): 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 3.902us - DeserializeRowBatchTimer: 26.077us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 9.98 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=6):(Total: 891.123ms, non-child: 891.123ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:11/2.49 GB 4:23/5.67 GB 2:18/4.22 GB 7:21/4.89 GB 1:17/3.67 GB 6:26/6.22 GB 3:21/4.83 GB 5:19/4.31 GB ExecOption: PARQUET Codegen Enabled Runtime filters: Only following filters arrived: 4, waited 742ms BytesRead(16s000ms): 24.20 MB, 26.68 MB, 26.68 MB, 26.68 MB, 26.68 MB, 26.68 MB, 26.68 MB, 26.68 MB, 26.68 MB, 26.68 MB, 26.68 MB, 26.68 MB, 26.68 MB, 26.68 MB, 26.68 MB, 26.68 MB, 26.68 MB, 26.68 MB, 26.68 MB, 26.68 MB, 26.68 MB, 26.68 MB, 26.68 MB, 26.68 MB, 26.68 MB, 26.68 MB, 26.68 MB, 26.68 MB, 26.68 MB, 26.68 MB, 26.68 MB, 26.68 MB, 26.68 MB, 26.68 MB, 26.68 MB, 26.68 MB, 26.68 MB, 26.68 MB, 26.68 MB - FooterProcessingTime: (Avg: 67.754ms ; Min: 47.071ms ; Max: 110.000ms ; Number of samples: 6) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 12.00 - BytesRead: 26.68 MB (27976440) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 1.780ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 0 (0) - NumRowGroups: 6 (6) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 47.46 MB (49761183) - PerReadThreadRawHdfsThroughput: 47.27 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 220.16K (220160) - RowsReturned: 101.38K (101376) - RowsReturnedRate: 113.76 K/sec - ScanRangesComplete: 150 (150) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 564.480ms - TotalReadThroughput: 42.79 KB/sec Filter 2 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 3 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 4 (1.00 MB): - Files processed: 156 (156) - Files rejected: 150 (150) - Files total: 156 (156) - RowGroups processed: 215 (215) - RowGroups rejected: 0 (0) - RowGroups total: 215 (215) - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) - Splits processed: 6 (6) - Splits rejected: 0 (0) - Splits total: 6 (6) Instance 7f40dcb034de70b7:18b (host=vd1138.foo:22000):(Total: 1s188ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 2:22/5.40 GB 0:15/3.68 GB 1:11/2.67 GB 3:20/4.65 GB 7:21/4.58 GB 5:21/5.18 GB 6:21/4.86 GB 4:23/5.67 GB Filter 4 arrival: 536ms Filter 2 arrival: 6s579ms Filter 3 arrival: 9m23s MemoryUsage(16s000ms): 48.37 MB, 57.30 MB, 57.30 MB, 57.30 MB, 57.30 MB, 57.30 MB, 57.30 MB, 57.30 MB, 57.30 MB, 57.30 MB, 57.30 MB, 57.30 MB, 57.30 MB, 57.30 MB, 57.30 MB, 57.30 MB, 57.30 MB, 57.30 MB, 57.30 MB, 57.30 MB, 57.30 MB, 57.30 MB, 57.30 MB, 57.30 MB, 57.30 MB, 57.30 MB, 57.30 MB, 57.30 MB, 57.30 MB, 57.30 MB, 57.30 MB, 57.30 MB, 57.30 MB, 57.30 MB, 57.30 MB, 57.30 MB, 57.30 MB, 57.30 MB, 57.30 MB ThreadUsage(16s000ms): 6, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7 - AverageThreadTokens: 6.99 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 57.30 MB (60081795) - PerHostPeakMemUsage: 169.55 GB (182058147394) - RowsProduced: 2.55M (2549760) - TotalNetworkReceiveTime: 306.769ms - TotalNetworkSendTime: 919.868us - TotalStorageWaitTime: 1s327ms - TotalThreadsInvoluntaryContextSwitches: 22 (22) - TotalThreadsTotalWallClockTime: 1s442ms - TotalThreadsSysTime: 4.999ms - TotalThreadsUserTime: 180.972ms - TotalThreadsVoluntaryContextSwitches: 49 (49) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 60.779ms - OpenTime: 1s134ms - ExecTreeOpenTime: 953.245ms - PrepareTime: 53.157ms - ExecTreePrepareTime: 567.497us DataStreamSender (dst_id=24):(Total: 348.741ms, non-child: 348.741ms, % non-child: 100.00%) - BytesSent: 22.04 MB (23106352) - NetworkThroughput(*): 99.09 MB/sec - OverallThroughput: 63.19 MB/sec - PeakMemoryUsage: 4.61 MB (4830976) - RowsReturned: 2.55M (2548736) - SerializeBatchTime: 125.188ms - TransmitDataRPCTime: 222.378ms - UncompressedRowBatchSize: 71.61 MB (75089064) CodeGen:(Total: 203.608ms, non-child: 203.608ms, % non-child: 100.00%) - CodegenTime: 1.027ms - CompileTime: 52.178ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 127.672ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 23.323ms HASH_JOIN_NODE (id=8):(Total: 1s014ms, non-child: 53.841ms, % non-child: 5.31%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.058ms - PeakMemoryUsage: 1.11 MB (1162514) - ProbeRows: 2.55M (2549760) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 50.154ms - RowsReturned: 2.55M (2548736) - RowsReturnedRate: 2.51 M/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 26.539us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 119.371us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 37.872us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=19):(Total: 306.774ms, non-child: 11.200us, % non-child: 0.00%) BytesReceived(16s000ms): 963.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 2.627us - DeserializeRowBatchTimer: 21.513us - FirstBatchArrivalWaitTime: 278.283ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 391.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=6):(Total: 653.958ms, non-child: 653.958ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:22/5.40 GB 0:15/3.68 GB 1:11/2.67 GB 3:20/4.65 GB 7:21/4.58 GB 5:21/5.18 GB 6:21/4.86 GB 4:23/5.67 GB ExecOption: PARQUET Codegen Enabled Runtime filters: Only following filters arrived: 4, waited 502ms BytesRead(16s000ms): 22.49 MB, 24.27 MB, 24.27 MB, 24.27 MB, 24.27 MB, 24.27 MB, 24.27 MB, 24.27 MB, 24.27 MB, 24.27 MB, 24.27 MB, 24.27 MB, 24.27 MB, 24.27 MB, 24.27 MB, 24.27 MB, 24.27 MB, 24.27 MB, 24.27 MB, 24.27 MB, 24.27 MB, 24.27 MB, 24.27 MB, 24.27 MB, 24.27 MB, 24.27 MB, 24.27 MB, 24.27 MB, 24.27 MB, 24.27 MB, 24.27 MB, 24.27 MB, 24.27 MB, 24.27 MB, 24.27 MB, 24.27 MB, 24.27 MB, 24.27 MB, 24.27 MB - FooterProcessingTime: (Avg: 93.881ms ; Min: 56.627ms ; Max: 140.712ms ; Number of samples: 6) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 5.99 - BytesRead: 24.27 MB (25444598) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 15.095ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 0 (0) - NumRowGroups: 6 (6) - NumScannerThreadsStarted: 6 (6) - PeakMemoryUsage: 35.60 MB (37333985) - PerReadThreadRawHdfsThroughput: 43.44 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 2.67M (2668544) - RowsReturned: 2.55M (2549760) - RowsReturnedRate: 3.90 M/sec - ScanRangesComplete: 148 (148) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 558.612ms - TotalReadThroughput: 39.07 KB/sec Filter 2 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 3 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 4 (1.00 MB): - Files processed: 154 (154) - Files rejected: 148 (148) - Files total: 154 (154) - RowGroups processed: 2.61K (2606) - RowGroups rejected: 0 (0) - RowGroups total: 2.61K (2606) - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) - Splits processed: 6 (6) - Splits rejected: 0 (0) - Splits total: 6 (6) Instance 7f40dcb034de70b7:193 (host=va1036.foo:22000):(Total: 1s186ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 6:19/4.45 GB 1:17/3.63 GB 3:19/4.68 GB 4:18/3.98 GB 5:18/4.21 GB 7:16/3.49 GB 2:24/5.88 GB 0:27/6.43 GB Filter 4 arrival: 473ms Filter 2 arrival: 6s666ms Filter 3 arrival: 9m23s MemoryUsage(16s000ms): 44.46 MB, 53.10 MB, 53.10 MB, 53.10 MB, 53.10 MB, 53.10 MB, 53.10 MB, 53.10 MB, 53.10 MB, 53.10 MB, 53.10 MB, 53.10 MB, 53.10 MB, 53.10 MB, 53.10 MB, 53.10 MB, 53.10 MB, 53.10 MB, 53.10 MB, 53.10 MB, 53.10 MB, 53.10 MB, 53.10 MB, 53.10 MB, 53.10 MB, 53.10 MB, 53.10 MB, 53.10 MB, 53.10 MB, 53.10 MB, 53.10 MB, 53.10 MB, 53.10 MB, 53.10 MB, 53.10 MB, 53.10 MB, 53.10 MB, 53.10 MB, 53.10 MB ThreadUsage(16s000ms): 12, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.99 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 53.10 MB (55677637) - PerHostPeakMemUsage: 169.56 GB (182059851881) - RowsProduced: 2.02M (2020352) - TotalNetworkReceiveTime: 237.965ms - TotalNetworkSendTime: 1.123ms - TotalStorageWaitTime: 878.688ms - TotalThreadsInvoluntaryContextSwitches: 19 (19) - TotalThreadsTotalWallClockTime: 1s367ms - TotalThreadsSysTime: 3.998ms - TotalThreadsUserTime: 178.973ms - TotalThreadsVoluntaryContextSwitches: 36 (36) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 55.970ms - OpenTime: 1s129ms - ExecTreeOpenTime: 947.413ms - PrepareTime: 56.784ms - ExecTreePrepareTime: 646.047us DataStreamSender (dst_id=24):(Total: 284.869ms, non-child: 284.869ms, % non-child: 100.00%) - BytesSent: 17.52 MB (18369684) - NetworkThroughput(*): 100.31 MB/sec - OverallThroughput: 61.50 MB/sec - PeakMemoryUsage: 4.89 MB (5125888) - RowsReturned: 2.02M (2019328) - SerializeBatchTime: 108.716ms - TransmitDataRPCTime: 174.651ms - UncompressedRowBatchSize: 56.43 MB (59169200) CodeGen:(Total: 202.500ms, non-child: 202.500ms, % non-child: 100.00%) - CodegenTime: 1.438ms - CompileTime: 51.325ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 127.532ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 23.073ms HASH_JOIN_NODE (id=8):(Total: 1s003ms, non-child: 49.188ms, % non-child: 4.90%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.858ms - PeakMemoryUsage: 1.11 MB (1162463) - ProbeRows: 2.02M (2020352) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 45.068ms - RowsReturned: 2.02M (2019328) - RowsReturnedRate: 2.01 M/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 20.848us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 274.619us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 83.445us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=19):(Total: 237.974ms, non-child: 27.507us, % non-child: 0.01%) BytesReceived(16s000ms): 963.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 4.186us - DeserializeRowBatchTimer: 23.842us - FirstBatchArrivalWaitTime: 233.056ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 504.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=6):(Total: 716.847ms, non-child: 716.847ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 6:19/4.45 GB 1:17/3.63 GB 3:19/4.68 GB 4:18/3.98 GB 5:18/4.21 GB 7:16/3.49 GB 2:24/5.88 GB 0:27/6.43 GB ExecOption: PARQUET Codegen Enabled Runtime filters: Only following filters arrived: 4, waited 547ms BytesRead(16s000ms): 19.30 MB, 20.87 MB, 20.87 MB, 20.87 MB, 20.87 MB, 20.87 MB, 20.87 MB, 20.87 MB, 20.87 MB, 20.87 MB, 20.87 MB, 20.87 MB, 20.87 MB, 20.87 MB, 20.87 MB, 20.87 MB, 20.87 MB, 20.87 MB, 20.87 MB, 20.87 MB, 20.87 MB, 20.87 MB, 20.87 MB, 20.87 MB, 20.87 MB, 20.87 MB, 20.87 MB, 20.87 MB, 20.87 MB, 20.87 MB, 20.87 MB, 20.87 MB, 20.87 MB, 20.87 MB, 20.87 MB, 20.87 MB, 20.87 MB, 20.87 MB, 20.87 MB - FooterProcessingTime: (Avg: 83.845ms ; Min: 63.237ms ; Max: 109.237ms ; Number of samples: 5) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 12.00 - BytesRead: 20.87 MB (21880332) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 12.361ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 0 (0) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 31.30 MB (32823184) - PerReadThreadRawHdfsThroughput: 42.60 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 2.14M (2138112) - RowsReturned: 2.02M (2020352) - RowsReturnedRate: 2.82 M/sec - ScanRangesComplete: 153 (153) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 489.865ms - TotalReadThroughput: 33.60 KB/sec Filter 2 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 3 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 4 (1.00 MB): - Files processed: 158 (158) - Files rejected: 153 (153) - Files total: 158 (158) - RowGroups processed: 2.09K (2088) - RowGroups rejected: 0 (0) - RowGroups total: 2.09K (2088) - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) - Splits processed: 5 (5) - Splits rejected: 0 (0) - Splits total: 5 (5) Instance 7f40dcb034de70b7:19a (host=vc1542.foo:22000):(Total: 1s185ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 3:19/4.68 GB 5:19/4.54 GB 0:20/4.93 GB 1:13/3.01 GB 7:20/4.93 GB 6:24/5.12 GB 4:21/5.18 GB 2:18/4.25 GB Filter 4 arrival: 457ms Filter 2 arrival: 6s727ms Filter 3 arrival: 9m23s MemoryUsage(16s000ms): 56.02 MB, 65.46 MB, 65.46 MB, 65.46 MB, 65.46 MB, 65.46 MB, 65.46 MB, 65.46 MB, 65.46 MB, 65.46 MB, 65.46 MB, 65.46 MB, 65.46 MB, 65.46 MB, 65.46 MB, 65.46 MB, 65.46 MB, 65.46 MB, 65.46 MB, 65.46 MB, 65.46 MB, 65.46 MB, 65.46 MB, 65.46 MB, 65.46 MB, 65.46 MB, 65.46 MB, 65.46 MB, 65.46 MB, 65.46 MB, 65.46 MB, 65.46 MB, 65.46 MB, 65.46 MB, 65.46 MB, 65.46 MB, 65.46 MB, 65.46 MB, 65.46 MB ThreadUsage(16s000ms): 6, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7 - AverageThreadTokens: 6.99 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 65.46 MB (68638653) - PerHostPeakMemUsage: 169.57 GB (182073432523) - RowsProduced: 2.15M (2150400) - TotalNetworkReceiveTime: 225.530ms - TotalNetworkSendTime: 755.405us - TotalStorageWaitTime: 1s084ms - TotalThreadsInvoluntaryContextSwitches: 21 (21) - TotalThreadsTotalWallClockTime: 1s361ms - TotalThreadsSysTime: 2.998ms - TotalThreadsUserTime: 182.973ms - TotalThreadsVoluntaryContextSwitches: 66 (66) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 57.639ms - OpenTime: 1s134ms - ExecTreeOpenTime: 951.517ms - PrepareTime: 51.298ms - ExecTreePrepareTime: 651.262us DataStreamSender (dst_id=24):(Total: 280.264ms, non-child: 280.264ms, % non-child: 100.00%) - BytesSent: 18.63 MB (19539647) - NetworkThroughput(*): 103.93 MB/sec - OverallThroughput: 66.49 MB/sec - PeakMemoryUsage: 4.76 MB (4986624) - RowsReturned: 2.15M (2149376) - SerializeBatchTime: 100.275ms - TransmitDataRPCTime: 179.300ms - UncompressedRowBatchSize: 60.11 MB (63031944) CodeGen:(Total: 203.530ms, non-child: 203.530ms, % non-child: 100.00%) - CodegenTime: 1.059ms - CompileTime: 53.247ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 127.900ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 21.921ms HASH_JOIN_NODE (id=8):(Total: 1s009ms, non-child: 53.184ms, % non-child: 5.27%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 2.048ms - PeakMemoryUsage: 1.11 MB (1160258) - ProbeRows: 2.15M (2150400) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 48.859ms - RowsReturned: 2.15M (2149376) - RowsReturnedRate: 2.13 M/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 26.208us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 599.784us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 51.774us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=19):(Total: 225.541ms, non-child: 19.805us, % non-child: 0.01%) BytesReceived(16s000ms): 963.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 4.824us - DeserializeRowBatchTimer: 25.860us - FirstBatchArrivalWaitTime: 222.749ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 532.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=6):(Total: 731.063ms, non-child: 731.063ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:19/4.68 GB 5:19/4.54 GB 0:20/4.93 GB 1:13/3.01 GB 7:20/4.93 GB 6:24/5.12 GB 4:21/5.18 GB 2:18/4.25 GB ExecOption: PARQUET Codegen Enabled Runtime filters: Only following filters arrived: 4, waited 563ms BytesRead(16s000ms): 25.06 MB, 26.88 MB, 26.88 MB, 26.88 MB, 26.88 MB, 26.88 MB, 26.88 MB, 26.88 MB, 26.88 MB, 26.88 MB, 26.88 MB, 26.88 MB, 26.88 MB, 26.88 MB, 26.88 MB, 26.88 MB, 26.88 MB, 26.88 MB, 26.88 MB, 26.88 MB, 26.88 MB, 26.88 MB, 26.88 MB, 26.88 MB, 26.88 MB, 26.88 MB, 26.88 MB, 26.88 MB, 26.88 MB, 26.88 MB, 26.88 MB, 26.88 MB, 26.88 MB, 26.88 MB, 26.88 MB, 26.88 MB, 26.88 MB, 26.88 MB, 26.88 MB - FooterProcessingTime: (Avg: 80.221ms ; Min: 65.785ms ; Max: 121.949ms ; Number of samples: 6) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 5.99 - BytesRead: 26.88 MB (28187848) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 12.579ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 0 (0) - NumRowGroups: 6 (6) - NumScannerThreadsStarted: 6 (6) - PeakMemoryUsage: 43.54 MB (45654579) - PerReadThreadRawHdfsThroughput: 48.90 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 2.27M (2269184) - RowsReturned: 2.15M (2150400) - RowsReturnedRate: 2.94 M/sec - ScanRangesComplete: 148 (148) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 549.747ms - TotalReadThroughput: 43.15 KB/sec Filter 2 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 3 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 4 (1.00 MB): - Files processed: 154 (154) - Files rejected: 148 (148) - Files total: 154 (154) - RowGroups processed: 2.22K (2216) - RowGroups rejected: 0 (0) - RowGroups total: 2.22K (2216) - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) - Splits processed: 6 (6) - Splits rejected: 0 (0) - Splits total: 6 (6) Instance 7f40dcb034de70b7:192 (host=vd1338.foo:22000):(Total: 1s185ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 4:17/3.98 GB 3:16/3.74 GB 2:24/5.53 GB 6:24/5.27 GB 0:18/4.23 GB 5:13/3.00 GB 7:27/6.55 GB 1:18/4.39 GB Filter 4 arrival: 471ms Filter 2 arrival: 6s652ms Filter 3 arrival: 9m23s MemoryUsage(16s000ms): 48.84 MB, 58.36 MB, 58.36 MB, 58.36 MB, 58.36 MB, 58.36 MB, 58.36 MB, 58.36 MB, 58.36 MB, 58.36 MB, 58.36 MB, 58.36 MB, 58.36 MB, 58.36 MB, 58.36 MB, 58.36 MB, 58.36 MB, 58.36 MB, 58.36 MB, 58.36 MB, 58.36 MB, 58.36 MB, 58.36 MB, 58.36 MB, 58.36 MB, 58.36 MB, 58.36 MB, 58.36 MB, 58.36 MB, 58.36 MB, 58.36 MB, 58.36 MB, 58.36 MB, 58.36 MB, 58.36 MB, 58.36 MB, 58.36 MB, 58.36 MB, 58.36 MB ThreadUsage(16s000ms): 12, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.98 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 58.36 MB (61197321) - PerHostPeakMemUsage: 169.56 GB (182065416325) - RowsProduced: 1.88M (1882112) - TotalNetworkReceiveTime: 225.592ms - TotalNetworkSendTime: 534.754us - TotalStorageWaitTime: 1s220ms - TotalThreadsInvoluntaryContextSwitches: 24 (24) - TotalThreadsTotalWallClockTime: 1s353ms - TotalThreadsSysTime: 1.999ms - TotalThreadsUserTime: 189.971ms - TotalThreadsVoluntaryContextSwitches: 47 (47) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 54.473ms - OpenTime: 1s126ms - ExecTreeOpenTime: 936.468ms - PrepareTime: 59.466ms - ExecTreePrepareTime: 571.418us DataStreamSender (dst_id=24):(Total: 271.134ms, non-child: 271.134ms, % non-child: 100.00%) - BytesSent: 16.33 MB (17121468) - NetworkThroughput(*): 98.93 MB/sec - OverallThroughput: 60.22 MB/sec - PeakMemoryUsage: 4.47 MB (4683520) - RowsReturned: 1.88M (1881088) - SerializeBatchTime: 104.917ms - TransmitDataRPCTime: 165.056ms - UncompressedRowBatchSize: 52.45 MB (54993864) CodeGen:(Total: 214.988ms, non-child: 214.988ms, % non-child: 100.00%) - CodegenTime: 1.133ms - CompileTime: 55.076ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 132.845ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 26.594ms HASH_JOIN_NODE (id=8):(Total: 991.323ms, non-child: 46.926ms, % non-child: 4.73%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 2.072ms - PeakMemoryUsage: 1.11 MB (1162482) - ProbeRows: 1.88M (1882112) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 42.085ms - RowsReturned: 1.88M (1881088) - RowsReturnedRate: 1.90 M/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 23.992us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 447.331us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 67.708us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=19):(Total: 225.603ms, non-child: 20.079us, % non-child: 0.01%) BytesReceived(16s000ms): 963.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 4.854us - DeserializeRowBatchTimer: 26.461us - FirstBatchArrivalWaitTime: 216.376ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 531.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=6):(Total: 718.875ms, non-child: 718.875ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:17/3.98 GB 3:16/3.74 GB 2:24/5.53 GB 6:24/5.27 GB 0:18/4.23 GB 5:13/3.00 GB 7:27/6.55 GB 1:18/4.39 GB ExecOption: PARQUET Codegen Enabled Runtime filters: Only following filters arrived: 4, waited 563ms BytesRead(16s000ms): 20.19 MB, 22.26 MB, 22.26 MB, 22.26 MB, 22.26 MB, 22.26 MB, 22.26 MB, 22.26 MB, 22.26 MB, 22.26 MB, 22.26 MB, 22.26 MB, 22.26 MB, 22.26 MB, 22.26 MB, 22.26 MB, 22.26 MB, 22.26 MB, 22.26 MB, 22.26 MB, 22.26 MB, 22.26 MB, 22.26 MB, 22.26 MB, 22.26 MB, 22.26 MB, 22.26 MB, 22.26 MB, 22.26 MB, 22.26 MB, 22.26 MB, 22.26 MB, 22.26 MB, 22.26 MB, 22.26 MB, 22.26 MB, 22.26 MB, 22.26 MB, 22.26 MB - FooterProcessingTime: (Avg: 72.612ms ; Min: 54.758ms ; Max: 112.134ms ; Number of samples: 6) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 11.99 - BytesRead: 22.26 MB (23336145) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 10.441ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 0 (0) - NumRowGroups: 6 (6) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 36.56 MB (38331316) - PerReadThreadRawHdfsThroughput: 51.61 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 2.00M (2000896) - RowsReturned: 1.88M (1882112) - RowsReturnedRate: 2.62 M/sec - ScanRangesComplete: 151 (151) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 431.178ms - TotalReadThroughput: 35.83 KB/sec Filter 2 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 3 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 4 (1.00 MB): - Files processed: 157 (157) - Files rejected: 151 (151) - Files total: 157 (157) - RowGroups processed: 1.95K (1954) - RowGroups rejected: 0 (0) - RowGroups total: 1.95K (1954) - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) - Splits processed: 6 (6) - Splits rejected: 0 (0) - Splits total: 6 (6) Instance 7f40dcb034de70b7:1dc (host=vc1511.foo:22000):(Total: 1s184ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 4:1/193.91 MB 1:3/757.08 MB 6:13/3.21 GB 5:17/3.79 GB 0:5/1.23 GB 2:22/4.92 GB 3:4/1010.00 MB Filter 4 arrival: 246ms Filter 2 arrival: 7s576ms Filter 3 arrival: 9m23s MemoryUsage(16s000ms): 26.77 MB, 36.41 MB, 36.41 MB, 36.41 MB, 36.41 MB, 36.41 MB, 36.41 MB, 36.41 MB, 36.41 MB, 36.41 MB, 36.41 MB, 36.41 MB, 36.41 MB, 36.41 MB, 36.41 MB, 36.41 MB, 36.41 MB, 36.41 MB, 36.41 MB, 36.41 MB, 36.41 MB, 36.41 MB, 36.41 MB, 36.41 MB, 36.41 MB, 36.41 MB, 36.41 MB, 36.41 MB, 36.41 MB, 36.41 MB, 36.41 MB, 36.41 MB, 36.41 MB, 36.41 MB, 36.41 MB, 36.41 MB, 36.41 MB, 36.41 MB, 36.41 MB ThreadUsage(16s000ms): 2, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3 - AverageThreadTokens: 3.00 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 36.41 MB (38175370) - PerHostPeakMemUsage: 169.54 GB (182042906319) - RowsProduced: 507.90K (507904) - TotalNetworkReceiveTime: 13.594us - TotalNetworkSendTime: 154.820us - TotalStorageWaitTime: 368.947ms - TotalThreadsInvoluntaryContextSwitches: 30 (30) - TotalThreadsTotalWallClockTime: 1s122ms - TotalThreadsSysTime: 5.998ms - TotalThreadsUserTime: 182.972ms - TotalThreadsVoluntaryContextSwitches: 55 (55) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 15.093ms - OpenTime: 1s121ms - ExecTreeOpenTime: 934.110ms - PrepareTime: 63.039ms - ExecTreePrepareTime: 397.263us DataStreamSender (dst_id=24):(Total: 67.655ms, non-child: 67.655ms, % non-child: 100.00%) - BytesSent: 3.94 MB (4128828) - NetworkThroughput(*): 94.44 MB/sec - OverallThroughput: 58.20 MB/sec - PeakMemoryUsage: 4.69 MB (4921088) - RowsReturned: 506.88K (506880) - SerializeBatchTime: 24.951ms - TransmitDataRPCTime: 41.693ms - UncompressedRowBatchSize: 13.16 MB (13798704) CodeGen:(Total: 214.078ms, non-child: 214.078ms, % non-child: 100.00%) - CodegenTime: 1.230ms - CompileTime: 55.442ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 130.406ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 27.733ms HASH_JOIN_NODE (id=8):(Total: 949.779ms, non-child: 15.206ms, % non-child: 1.60%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.491ms - PeakMemoryUsage: 1.10 MB (1152434) - ProbeRows: 507.90K (507904) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 12.984ms - RowsReturned: 506.88K (506880) - RowsReturnedRate: 533.68 K/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 19.148us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 248.276us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 46.732us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=19):(Total: 21.435us, non-child: 21.435us, % non-child: 100.00%) BytesReceived(16s000ms): 963.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 3.802us - DeserializeRowBatchTimer: 23.607us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 5.60 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=6):(Total: 934.567ms, non-child: 934.567ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:1/193.91 MB 1:3/757.08 MB 6:13/3.21 GB 5:17/3.79 GB 0:5/1.23 GB 2:22/4.92 GB 3:4/1010.00 MB ExecOption: PARQUET Codegen Enabled Runtime filters: Only following filters arrived: 4, waited 783ms BytesRead(16s000ms): 7.40 MB, 8.17 MB, 8.17 MB, 8.17 MB, 8.17 MB, 8.17 MB, 8.17 MB, 8.17 MB, 8.17 MB, 8.17 MB, 8.17 MB, 8.17 MB, 8.17 MB, 8.17 MB, 8.17 MB, 8.17 MB, 8.17 MB, 8.17 MB, 8.17 MB, 8.17 MB, 8.17 MB, 8.17 MB, 8.17 MB, 8.17 MB, 8.17 MB, 8.17 MB, 8.17 MB, 8.17 MB, 8.17 MB, 8.17 MB, 8.17 MB, 8.17 MB, 8.17 MB, 8.17 MB, 8.17 MB, 8.17 MB, 8.17 MB, 8.17 MB, 8.17 MB - FooterProcessingTime: (Avg: 56.837ms ; Min: 38.827ms ; Max: 74.847ms ; Number of samples: 2) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 2.00 - BytesRead: 8.17 MB (8562246) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 3.772ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 0 (0) - NumRowGroups: 2 (2) - NumScannerThreadsStarted: 2 (2) - PeakMemoryUsage: 14.47 MB (15174155) - PerReadThreadRawHdfsThroughput: 51.42 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 622.59K (622592) - RowsReturned: 507.90K (507904) - RowsReturnedRate: 543.46 K/sec - ScanRangesComplete: 63 (63) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 158.805ms - TotalReadThroughput: 13.09 KB/sec Filter 2 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 3 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 4 (1.00 MB): - Files processed: 65 (65) - Files rejected: 63 (63) - Files total: 65 (65) - RowGroups processed: 608 (608) - RowGroups rejected: 0 (0) - RowGroups total: 608 (608) - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) - Splits processed: 2 (2) - Splits rejected: 0 (0) - Splits total: 2 (2) Instance 7f40dcb034de70b7:185 (host=vc1538.foo:22000):(Total: 1s183ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:15/3.13 GB 7:22/5.16 GB 2:20/4.53 GB 3:27/5.80 GB 1:18/4.42 GB 6:17/4.19 GB 4:17/3.95 GB 5:22/5.04 GB Filter 4 arrival: 541ms Filter 2 arrival: 6s455ms Filter 3 arrival: 9m23s MemoryUsage(16s000ms): 49.46 MB, 59.72 MB, 59.72 MB, 59.72 MB, 59.72 MB, 59.72 MB, 59.72 MB, 59.72 MB, 59.72 MB, 59.72 MB, 59.72 MB, 59.72 MB, 59.72 MB, 59.72 MB, 59.72 MB, 59.72 MB, 59.72 MB, 59.72 MB, 59.72 MB, 59.72 MB, 59.72 MB, 59.72 MB, 59.72 MB, 59.72 MB, 59.72 MB, 59.72 MB, 59.72 MB, 59.72 MB, 59.72 MB, 59.72 MB, 59.72 MB, 59.72 MB, 59.72 MB, 59.72 MB, 59.72 MB, 59.72 MB, 59.72 MB, 59.72 MB, 59.72 MB ThreadUsage(16s000ms): 12, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.99 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 59.72 MB (62618311) - PerHostPeakMemUsage: 169.56 GB (182066816132) - RowsProduced: 2.56M (2558976) - TotalNetworkReceiveTime: 305.072ms - TotalNetworkSendTime: 892.619us - TotalStorageWaitTime: 1s815ms - TotalThreadsInvoluntaryContextSwitches: 21 (21) - TotalThreadsTotalWallClockTime: 1s429ms - TotalThreadsSysTime: 2.000ms - TotalThreadsUserTime: 180.973ms - TotalThreadsVoluntaryContextSwitches: 34 (34) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 67.297ms - OpenTime: 1s124ms - ExecTreeOpenTime: 941.901ms - PrepareTime: 59.445ms - ExecTreePrepareTime: 1.097ms DataStreamSender (dst_id=24):(Total: 356.432ms, non-child: 356.432ms, % non-child: 100.00%) - BytesSent: 22.46 MB (23555750) - NetworkThroughput(*): 100.21 MB/sec - OverallThroughput: 63.03 MB/sec - PeakMemoryUsage: 4.78 MB (5011200) - RowsReturned: 2.56M (2557952) - SerializeBatchTime: 131.020ms - TransmitDataRPCTime: 224.170ms - UncompressedRowBatchSize: 71.82 MB (75312344) CodeGen:(Total: 204.271ms, non-child: 204.271ms, % non-child: 100.00%) - CodegenTime: 1.113ms - CompileTime: 51.789ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 128.632ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 23.352ms HASH_JOIN_NODE (id=8):(Total: 1s010ms, non-child: 60.077ms, % non-child: 5.95%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 843.763us - PeakMemoryUsage: 1.17 MB (1222912) - ProbeRows: 2.56M (2559702) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 55.693ms - RowsReturned: 2.56M (2558678) - RowsReturnedRate: 2.53 M/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 15.875us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 96.743us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 36.835us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=19):(Total: 305.080ms, non-child: 13.530us, % non-child: 0.00%) BytesReceived(16s000ms): 963.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 3.308us - DeserializeRowBatchTimer: 5.340us - FirstBatchArrivalWaitTime: 298.685ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 393.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=6):(Total: 645.383ms, non-child: 645.383ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:15/3.13 GB 7:22/5.16 GB 2:20/4.53 GB 3:27/5.80 GB 1:18/4.42 GB 6:17/4.19 GB 4:17/3.95 GB 5:22/5.04 GB ExecOption: PARQUET Codegen Enabled Runtime filters: Only following filters arrived: 4, waited 482ms BytesRead(16s000ms): 24.08 MB, 26.57 MB, 26.57 MB, 26.57 MB, 26.57 MB, 26.57 MB, 26.57 MB, 26.57 MB, 26.57 MB, 26.57 MB, 26.57 MB, 26.57 MB, 26.57 MB, 26.57 MB, 26.57 MB, 26.57 MB, 26.57 MB, 26.57 MB, 26.57 MB, 26.57 MB, 26.57 MB, 26.57 MB, 26.57 MB, 26.57 MB, 26.57 MB, 26.57 MB, 26.57 MB, 26.57 MB, 26.57 MB, 26.57 MB, 26.57 MB, 26.57 MB, 26.57 MB, 26.57 MB, 26.57 MB, 26.57 MB, 26.57 MB, 26.57 MB, 26.57 MB - FooterProcessingTime: (Avg: 118.219ms ; Min: 70.561ms ; Max: 170.937ms ; Number of samples: 8) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 12.00 - BytesRead: 26.57 MB (27865662) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 15.998ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 0 (0) - NumRowGroups: 8 (8) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 39.99 MB (41931618) - PerReadThreadRawHdfsThroughput: 42.85 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 2.68M (2679510) - RowsReturned: 2.56M (2559702) - RowsReturnedRate: 3.97 M/sec - ScanRangesComplete: 151 (151) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 37.289ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 620.164ms - TotalReadThroughput: 42.79 KB/sec Filter 2 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 590.55K (590550) Filter 3 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 590.55K (590550) Filter 4 (1.00 MB): - Files processed: 158 (158) - Files rejected: 150 (150) - Files total: 158 (158) - RowGroups processed: 2.62K (2617) - RowGroups rejected: 0 (0) - RowGroups total: 2.62K (2617) - Rows processed: 16.38K (16384) - Rows rejected: 0 (0) - Rows total: 590.55K (590550) - Splits processed: 8 (8) - Splits rejected: 0 (0) - Splits total: 8 (8) Instance 7f40dcb034de70b7:18f (host=ve1135.foo:22000):(Total: 1s182ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 1:14/3.41 GB 0:24/5.70 GB 7:15/3.70 GB 2:23/5.26 GB 6:16/3.89 GB 5:21/5.18 GB 3:21/4.57 GB 4:22/5.06 GB Filter 4 arrival: 507ms Filter 2 arrival: 6s606ms Filter 3 arrival: 9m23s MemoryUsage(16s000ms): 47.93 MB, 57.62 MB, 57.62 MB, 57.62 MB, 57.62 MB, 57.62 MB, 57.62 MB, 57.62 MB, 57.62 MB, 57.62 MB, 57.62 MB, 57.62 MB, 57.62 MB, 57.62 MB, 57.62 MB, 57.62 MB, 57.62 MB, 57.62 MB, 57.62 MB, 57.62 MB, 57.62 MB, 57.62 MB, 57.62 MB, 57.62 MB, 57.62 MB, 57.62 MB, 57.62 MB, 57.62 MB, 57.62 MB, 57.62 MB, 57.62 MB, 57.62 MB, 57.62 MB, 57.62 MB, 57.62 MB, 57.62 MB, 57.62 MB, 57.62 MB, 57.62 MB ThreadUsage(16s000ms): 6, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7 - AverageThreadTokens: 6.99 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 57.62 MB (60423084) - PerHostPeakMemUsage: 169.56 GB (182064603624) - RowsProduced: 2.52M (2519040) - TotalNetworkReceiveTime: 273.102ms - TotalNetworkSendTime: 847.903us - TotalStorageWaitTime: 1s112ms - TotalThreadsInvoluntaryContextSwitches: 21 (21) - TotalThreadsTotalWallClockTime: 1s404ms - TotalThreadsSysTime: 2.000ms - TotalThreadsUserTime: 185.971ms - TotalThreadsVoluntaryContextSwitches: 53 (53) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 58.236ms - OpenTime: 1s130ms - ExecTreeOpenTime: 945.628ms - PrepareTime: 52.128ms - ExecTreePrepareTime: 599.861us DataStreamSender (dst_id=24):(Total: 341.700ms, non-child: 341.700ms, % non-child: 100.00%) - BytesSent: 21.90 MB (22964947) - NetworkThroughput(*): 99.69 MB/sec - OverallThroughput: 64.09 MB/sec - PeakMemoryUsage: 4.56 MB (4781824) - RowsReturned: 2.52M (2518016) - SerializeBatchTime: 121.050ms - TransmitDataRPCTime: 219.681ms - UncompressedRowBatchSize: 70.50 MB (73928008) CodeGen:(Total: 203.390ms, non-child: 203.390ms, % non-child: 100.00%) - CodegenTime: 994.588us - CompileTime: 55.064ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 127.978ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 19.903ms HASH_JOIN_NODE (id=8):(Total: 1s004ms, non-child: 51.738ms, % non-child: 5.15%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.279ms - PeakMemoryUsage: 1.11 MB (1163941) - ProbeRows: 2.52M (2519040) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 47.778ms - RowsReturned: 2.52M (2518016) - RowsReturnedRate: 2.51 M/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 23.497us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 106.459us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 49.816us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=19):(Total: 273.111ms, non-child: 18.848us, % non-child: 0.01%) BytesReceived(16s000ms): 963.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 4.026us - DeserializeRowBatchTimer: 9.943us - FirstBatchArrivalWaitTime: 265.399ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 439.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=6):(Total: 679.526ms, non-child: 679.526ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:14/3.41 GB 0:24/5.70 GB 7:15/3.70 GB 2:23/5.26 GB 6:16/3.89 GB 5:21/5.18 GB 3:21/4.57 GB 4:22/5.06 GB ExecOption: PARQUET Codegen Enabled Runtime filters: Only following filters arrived: 4, waited 522ms BytesRead(16s000ms): 22.10 MB, 24.37 MB, 24.37 MB, 24.37 MB, 24.37 MB, 24.37 MB, 24.37 MB, 24.37 MB, 24.37 MB, 24.37 MB, 24.37 MB, 24.37 MB, 24.37 MB, 24.37 MB, 24.37 MB, 24.37 MB, 24.37 MB, 24.37 MB, 24.37 MB, 24.37 MB, 24.37 MB, 24.37 MB, 24.37 MB, 24.37 MB, 24.37 MB, 24.37 MB, 24.37 MB, 24.37 MB, 24.37 MB, 24.37 MB, 24.37 MB, 24.37 MB, 24.37 MB, 24.37 MB, 24.37 MB, 24.37 MB, 24.37 MB, 24.37 MB, 24.37 MB - FooterProcessingTime: (Avg: 83.013ms ; Min: 63.583ms ; Max: 119.407ms ; Number of samples: 6) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 6.00 - BytesRead: 24.37 MB (25552804) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 15.191ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 0 (0) - NumRowGroups: 6 (6) - NumScannerThreadsStarted: 6 (6) - PeakMemoryUsage: 35.58 MB (37313361) - PerReadThreadRawHdfsThroughput: 46.31 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 2.64M (2637824) - RowsReturned: 2.52M (2519040) - RowsReturnedRate: 3.71 M/sec - ScanRangesComplete: 150 (150) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 526.268ms - TotalReadThroughput: 39.20 KB/sec Filter 2 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 3 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 4 (1.00 MB): - Files processed: 156 (156) - Files rejected: 150 (150) - Files total: 156 (156) - RowGroups processed: 2.58K (2576) - RowGroups rejected: 0 (0) - RowGroups total: 2.58K (2576) - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) - Splits processed: 6 (6) - Splits rejected: 0 (0) - Splits total: 6 (6) Instance 7f40dcb034de70b7:1a8 (host=ve1127.foo:22000):(Total: 1s182ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 4:17/4.00 GB 0:21/4.80 GB 2:17/3.87 GB 1:16/3.95 GB 3:24/5.75 GB 5:21/4.61 GB 7:19/4.68 GB 6:22/4.95 GB Filter 4 arrival: 409ms Filter 2 arrival: 6s945ms Filter 3 arrival: 9m23s MemoryUsage(16s000ms): 47.61 MB, 57.15 MB, 57.15 MB, 57.15 MB, 57.15 MB, 57.15 MB, 57.15 MB, 57.15 MB, 57.15 MB, 57.15 MB, 57.15 MB, 57.15 MB, 57.15 MB, 57.15 MB, 57.15 MB, 57.15 MB, 57.15 MB, 57.15 MB, 57.15 MB, 57.15 MB, 57.15 MB, 57.15 MB, 57.15 MB, 57.15 MB, 57.15 MB, 57.15 MB, 57.15 MB, 57.15 MB, 57.15 MB, 57.15 MB, 57.15 MB, 57.15 MB, 57.15 MB, 57.15 MB, 57.15 MB, 57.15 MB, 57.15 MB, 57.15 MB, 57.15 MB ThreadUsage(16s000ms): 12, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.99 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 57.15 MB (59926561) - PerHostPeakMemUsage: 169.56 GB (182064155503) - RowsProduced: 1.56M (1560576) - TotalNetworkReceiveTime: 141.060ms - TotalNetworkSendTime: 571.249us - TotalStorageWaitTime: 1s220ms - TotalThreadsInvoluntaryContextSwitches: 24 (24) - TotalThreadsTotalWallClockTime: 1s262ms - TotalThreadsSysTime: 3.999ms - TotalThreadsUserTime: 210.968ms - TotalThreadsVoluntaryContextSwitches: 40 (40) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 46.175ms - OpenTime: 1s120ms - ExecTreeOpenTime: 907.232ms - PrepareTime: 61.935ms - ExecTreePrepareTime: 682.326us DataStreamSender (dst_id=24):(Total: 238.330ms, non-child: 238.330ms, % non-child: 100.00%) - BytesSent: 13.45 MB (14099513) - NetworkThroughput(*): 91.20 MB/sec - OverallThroughput: 56.42 MB/sec - PeakMemoryUsage: 4.82 MB (5052160) - RowsReturned: 1.56M (1559552) - SerializeBatchTime: 90.328ms - TransmitDataRPCTime: 147.444ms - UncompressedRowBatchSize: 43.29 MB (45392824) CodeGen:(Total: 237.114ms, non-child: 237.114ms, % non-child: 100.00%) - CodegenTime: 1.292ms - CompileTime: 63.477ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 147.885ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 25.191ms HASH_JOIN_NODE (id=8):(Total: 954.221ms, non-child: 41.437ms, % non-child: 4.34%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.478ms - PeakMemoryUsage: 1.11 MB (1162484) - ProbeRows: 1.56M (1560576) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 37.597ms - RowsReturned: 1.56M (1559552) - RowsReturnedRate: 1.63 M/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 40.854us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 139.077us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 94.993us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=19):(Total: 141.074ms, non-child: 24.231us, % non-child: 0.02%) BytesReceived(16s000ms): 963.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 7.654us - DeserializeRowBatchTimer: 9.019us - FirstBatchArrivalWaitTime: 131.336ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 850.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=6):(Total: 771.812ms, non-child: 771.812ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:17/4.00 GB 0:21/4.80 GB 2:17/3.87 GB 1:16/3.95 GB 3:24/5.75 GB 5:21/4.61 GB 7:19/4.68 GB 6:22/4.95 GB ExecOption: PARQUET Codegen Enabled Runtime filters: Only following filters arrived: 4, waited 622ms BytesRead(16s000ms): 23.05 MB, 24.85 MB, 24.85 MB, 24.85 MB, 24.85 MB, 24.85 MB, 24.85 MB, 24.85 MB, 24.85 MB, 24.85 MB, 24.85 MB, 24.85 MB, 24.85 MB, 24.85 MB, 24.85 MB, 24.85 MB, 24.85 MB, 24.85 MB, 24.85 MB, 24.85 MB, 24.85 MB, 24.85 MB, 24.85 MB, 24.85 MB, 24.85 MB, 24.85 MB, 24.85 MB, 24.85 MB, 24.85 MB, 24.85 MB, 24.85 MB, 24.85 MB, 24.85 MB, 24.85 MB, 24.85 MB, 24.85 MB, 24.85 MB, 24.85 MB, 24.85 MB - FooterProcessingTime: (Avg: 72.388ms ; Min: 50.875ms ; Max: 108.137ms ; Number of samples: 6) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 11.99 - BytesRead: 24.85 MB (26054005) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 8.447ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 0 (0) - NumRowGroups: 6 (6) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 35.59 MB (37313588) - PerReadThreadRawHdfsThroughput: 49.00 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 1.68M (1679360) - RowsReturned: 1.56M (1560576) - RowsReturnedRate: 2.02 M/sec - ScanRangesComplete: 151 (151) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 507.039ms - TotalReadThroughput: 39.94 KB/sec Filter 2 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 3 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 4 (1.00 MB): - Files processed: 157 (157) - Files rejected: 151 (151) - Files total: 157 (157) - RowGroups processed: 1.64K (1640) - RowGroups rejected: 0 (0) - RowGroups total: 1.64K (1640) - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) - Splits processed: 6 (6) - Splits rejected: 0 (0) - Splits total: 6 (6) Instance 7f40dcb034de70b7:19b (host=vd1327.foo:22000):(Total: 1s182ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:22/5.23 GB 3:26/6.41 GB 2:16/3.66 GB 4:22/5.21 GB 1:19/4.36 GB 5:17/4.19 GB 6:18/4.40 GB 7:15/3.35 GB Filter 4 arrival: 462ms Filter 2 arrival: 6s749ms Filter 3 arrival: 9m23s MemoryUsage(16s000ms): 48.62 MB, 57.50 MB, 57.50 MB, 57.50 MB, 57.50 MB, 57.50 MB, 57.50 MB, 57.50 MB, 57.50 MB, 57.50 MB, 57.50 MB, 57.50 MB, 57.50 MB, 57.50 MB, 57.50 MB, 57.50 MB, 57.50 MB, 57.50 MB, 57.50 MB, 57.50 MB, 57.50 MB, 57.50 MB, 57.50 MB, 57.50 MB, 57.50 MB, 57.50 MB, 57.50 MB, 57.50 MB, 57.50 MB, 57.50 MB, 57.50 MB, 57.50 MB, 57.50 MB, 57.50 MB, 57.50 MB, 57.50 MB, 57.50 MB, 57.50 MB, 57.50 MB ThreadUsage(16s000ms): 5, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6 - AverageThreadTokens: 5.99 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 57.50 MB (60290894) - PerHostPeakMemUsage: 169.56 GB (182064483430) - RowsProduced: 2.05M (2049024) - TotalNetworkReceiveTime: 219.932ms - TotalNetworkSendTime: 711.646us - TotalStorageWaitTime: 902.775ms - TotalThreadsInvoluntaryContextSwitches: 23 (23) - TotalThreadsTotalWallClockTime: 1s347ms - TotalThreadsSysTime: 3.998ms - TotalThreadsUserTime: 188.971ms - TotalThreadsVoluntaryContextSwitches: 45 (45) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 61.584ms - OpenTime: 1s126ms - ExecTreeOpenTime: 936.215ms - PrepareTime: 56.244ms - ExecTreePrepareTime: 544.052us DataStreamSender (dst_id=24):(Total: 277.270ms, non-child: 277.270ms, % non-child: 100.00%) - BytesSent: 17.71 MB (18568372) - NetworkThroughput(*): 101.71 MB/sec - OverallThroughput: 63.87 MB/sec - PeakMemoryUsage: 4.76 MB (4986624) - RowsReturned: 2.05M (2048000) - SerializeBatchTime: 102.196ms - TransmitDataRPCTime: 174.102ms - UncompressedRowBatchSize: 57.11 MB (59883696) CodeGen:(Total: 211.123ms, non-child: 211.123ms, % non-child: 100.00%) - CodegenTime: 999.597us - CompileTime: 60.201ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 128.050ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 22.434ms HASH_JOIN_NODE (id=8):(Total: 998.131ms, non-child: 56.949ms, % non-child: 5.71%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.332ms - PeakMemoryUsage: 1.11 MB (1162424) - ProbeRows: 2.05M (2049024) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 53.339ms - RowsReturned: 2.05M (2048000) - RowsReturnedRate: 2.05 M/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 23.197us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 118.747us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 49.652us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=19):(Total: 219.940ms, non-child: 15.571us, % non-child: 0.01%) BytesReceived(16s000ms): 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 3.912us - DeserializeRowBatchTimer: 15.612us - FirstBatchArrivalWaitTime: 208.527ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 545.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=6):(Total: 721.363ms, non-child: 721.363ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:22/5.23 GB 3:26/6.41 GB 2:16/3.66 GB 4:22/5.21 GB 1:19/4.36 GB 5:17/4.19 GB 6:18/4.40 GB 7:15/3.35 GB ExecOption: PARQUET Codegen Enabled Runtime filters: Only following filters arrived: 4, waited 562ms BytesRead(16s000ms): 20.09 MB, 21.43 MB, 21.43 MB, 21.43 MB, 21.43 MB, 21.43 MB, 21.43 MB, 21.43 MB, 21.43 MB, 21.43 MB, 21.43 MB, 21.43 MB, 21.43 MB, 21.43 MB, 21.43 MB, 21.43 MB, 21.43 MB, 21.43 MB, 21.43 MB, 21.43 MB, 21.43 MB, 21.43 MB, 21.43 MB, 21.43 MB, 21.43 MB, 21.43 MB, 21.43 MB, 21.43 MB, 21.43 MB, 21.43 MB, 21.43 MB, 21.43 MB, 21.43 MB, 21.43 MB, 21.43 MB, 21.43 MB, 21.43 MB, 21.43 MB, 21.43 MB - FooterProcessingTime: (Avg: 76.385ms ; Min: 50.925ms ; Max: 96.221ms ; Number of samples: 5) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.99 - BytesRead: 21.43 MB (22475706) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 11.852ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 0 (0) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 5 (5) - PeakMemoryUsage: 35.33 MB (37046272) - PerReadThreadRawHdfsThroughput: 45.77 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 2.17M (2166784) - RowsReturned: 2.05M (2049024) - RowsReturnedRate: 2.84 M/sec - ScanRangesComplete: 150 (150) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 468.298ms - TotalReadThroughput: 34.54 KB/sec Filter 2 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 3 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 4 (1.00 MB): - Files processed: 155 (155) - Files rejected: 150 (150) - Files total: 155 (155) - RowGroups processed: 2.12K (2116) - RowGroups rejected: 0 (0) - RowGroups total: 2.12K (2116) - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) - Splits processed: 5 (5) - Splits rejected: 0 (0) - Splits total: 5 (5) Instance 7f40dcb034de70b7:18d (host=vd1330.foo:22000):(Total: 1s181ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 1:13/3.09 GB 2:20/4.93 GB 0:15/3.70 GB 4:23/5.09 GB 7:17/4.19 GB 5:23/5.22 GB 6:22/5.19 GB 3:23/5.07 GB Filter 4 arrival: 519ms Filter 2 arrival: 6s596ms Filter 3 arrival: 9m23s MemoryUsage(16s000ms): 42.93 MB, 53.15 MB, 53.15 MB, 53.15 MB, 53.15 MB, 53.15 MB, 53.15 MB, 53.15 MB, 53.15 MB, 53.15 MB, 53.15 MB, 53.15 MB, 53.15 MB, 53.15 MB, 53.15 MB, 53.15 MB, 53.15 MB, 53.15 MB, 53.15 MB, 53.15 MB, 53.15 MB, 53.15 MB, 53.15 MB, 53.15 MB, 53.15 MB, 53.15 MB, 53.15 MB, 53.15 MB, 53.15 MB, 53.15 MB, 53.15 MB, 53.15 MB, 53.15 MB, 53.15 MB, 53.15 MB, 53.15 MB, 53.15 MB, 53.15 MB, 53.15 MB ThreadUsage(16s000ms): 5, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6 - AverageThreadTokens: 5.99 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 53.15 MB (55734254) - PerHostPeakMemUsage: 169.56 GB (182059948462) - RowsProduced: 2.35M (2351104) - TotalNetworkReceiveTime: 272.790ms - TotalNetworkSendTime: 863.542us - TotalStorageWaitTime: 1s013ms - TotalThreadsInvoluntaryContextSwitches: 39 (39) - TotalThreadsTotalWallClockTime: 1s400ms - TotalThreadsSysTime: 4.998ms - TotalThreadsUserTime: 191.971ms - TotalThreadsVoluntaryContextSwitches: 57 (57) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 65.473ms - OpenTime: 1s125ms - ExecTreeOpenTime: 932.495ms - PrepareTime: 56.234ms - ExecTreePrepareTime: 573.855us DataStreamSender (dst_id=24):(Total: 322.562ms, non-child: 322.562ms, % non-child: 100.00%) - BytesSent: 20.24 MB (21219968) - NetworkThroughput(*): 98.64 MB/sec - OverallThroughput: 62.74 MB/sec - PeakMemoryUsage: 4.70 MB (4929280) - RowsReturned: 2.35M (2350080) - SerializeBatchTime: 116.083ms - TransmitDataRPCTime: 205.166ms - UncompressedRowBatchSize: 65.84 MB (69038176) CodeGen:(Total: 212.577ms, non-child: 212.577ms, % non-child: 100.00%) - CodegenTime: 1.152ms - CompileTime: 56.463ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 134.765ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 20.885ms HASH_JOIN_NODE (id=8):(Total: 998.176ms, non-child: 58.405ms, % non-child: 5.85%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.865ms - PeakMemoryUsage: 1.11 MB (1161478) - ProbeRows: 2.35M (2351104) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 53.746ms - RowsReturned: 2.35M (2350080) - RowsReturnedRate: 2.35 M/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 33.828us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 139.240us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 72.750us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=19):(Total: 272.800ms, non-child: 23.112us, % non-child: 0.01%) BytesReceived(16s000ms): 963.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 4.611us - DeserializeRowBatchTimer: 61.635us - FirstBatchArrivalWaitTime: 254.661ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 439.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=6):(Total: 667.073ms, non-child: 667.073ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:13/3.09 GB 2:20/4.93 GB 0:15/3.70 GB 4:23/5.09 GB 7:17/4.19 GB 5:23/5.22 GB 6:22/5.19 GB 3:23/5.07 GB ExecOption: PARQUET Codegen Enabled Runtime filters: Only following filters arrived: 4, waited 503ms BytesRead(16s000ms): 18.67 MB, 20.60 MB, 20.60 MB, 20.60 MB, 20.60 MB, 20.60 MB, 20.60 MB, 20.60 MB, 20.60 MB, 20.60 MB, 20.60 MB, 20.60 MB, 20.60 MB, 20.60 MB, 20.60 MB, 20.60 MB, 20.60 MB, 20.60 MB, 20.60 MB, 20.60 MB, 20.60 MB, 20.60 MB, 20.60 MB, 20.60 MB, 20.60 MB, 20.60 MB, 20.60 MB, 20.60 MB, 20.60 MB, 20.60 MB, 20.60 MB, 20.60 MB, 20.60 MB, 20.60 MB, 20.60 MB, 20.60 MB, 20.60 MB, 20.60 MB, 20.60 MB - FooterProcessingTime: (Avg: 90.080ms ; Min: 61.520ms ; Max: 129.828ms ; Number of samples: 5) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 5.00 - BytesRead: 20.60 MB (21599994) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 14.777ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 0 (0) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 5 (5) - PeakMemoryUsage: 31.29 MB (32805524) - PerReadThreadRawHdfsThroughput: 43.68 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 2.47M (2468864) - RowsReturned: 2.35M (2351104) - RowsReturnedRate: 3.52 M/sec - ScanRangesComplete: 151 (151) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 471.636ms - TotalReadThroughput: 33.09 KB/sec Filter 2 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 3 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 4 (1.00 MB): - Files processed: 156 (156) - Files rejected: 151 (151) - Files total: 156 (156) - RowGroups processed: 2.41K (2411) - RowGroups rejected: 0 (0) - RowGroups total: 2.41K (2411) - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) - Splits processed: 5 (5) - Splits rejected: 0 (0) - Splits total: 5 (5) Instance 7f40dcb034de70b7:1d7 (host=vd1142.foo:22000):(Total: 1s178ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 5:14/3.34 GB 6:13/3.21 GB 2:19/4.45 GB 7:23/5.45 GB 4:21/4.95 GB 1:23/5.61 GB 3:24/5.45 GB 0:19/4.24 GB Filter 4 arrival: 274ms Filter 2 arrival: 7s534ms Filter 3 arrival: 9m23s MemoryUsage(16s000ms): 51.14 MB, 61.60 MB, 61.60 MB, 61.60 MB, 61.60 MB, 61.60 MB, 61.60 MB, 61.60 MB, 61.60 MB, 61.60 MB, 61.60 MB, 61.60 MB, 61.60 MB, 61.60 MB, 61.60 MB, 61.60 MB, 61.60 MB, 61.60 MB, 61.60 MB, 61.60 MB, 61.60 MB, 61.60 MB, 61.60 MB, 61.60 MB, 61.60 MB, 61.60 MB, 61.60 MB, 61.60 MB, 61.60 MB, 61.60 MB, 61.60 MB, 61.60 MB, 61.60 MB, 61.60 MB, 61.60 MB, 61.60 MB, 61.60 MB, 61.60 MB, 61.60 MB ThreadUsage(16s000ms): 12, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.98 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 61.60 MB (64587322) - PerHostPeakMemUsage: 169.56 GB (182068790410) - RowsProduced: 598.02K (598016) - TotalNetworkReceiveTime: 3.855us - TotalNetworkSendTime: 181.618us - TotalStorageWaitTime: 1s759ms - TotalThreadsInvoluntaryContextSwitches: 37 (37) - TotalThreadsTotalWallClockTime: 1s119ms - TotalThreadsSysTime: 7.998ms - TotalThreadsUserTime: 212.968ms - TotalThreadsVoluntaryContextSwitches: 62 (62) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 18.584ms - OpenTime: 1s118ms - ExecTreeOpenTime: 899.605ms - PrepareTime: 60.098ms - ExecTreePrepareTime: 573.242us DataStreamSender (dst_id=24):(Total: 86.593ms, non-child: 86.593ms, % non-child: 100.00%) - BytesSent: 4.77 MB (4999156) - NetworkThroughput(*): 94.64 MB/sec - OverallThroughput: 55.06 MB/sec - PeakMemoryUsage: 4.66 MB (4888320) - RowsReturned: 596.99K (596992) - SerializeBatchTime: 35.180ms - TransmitDataRPCTime: 50.374ms - UncompressedRowBatchSize: 15.57 MB (16321768) CodeGen:(Total: 241.960ms, non-child: 241.960ms, % non-child: 100.00%) - CodegenTime: 1.143ms - CompileTime: 55.760ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 161.053ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 24.646ms HASH_JOIN_NODE (id=8):(Total: 919.087ms, non-child: 18.044ms, % non-child: 1.96%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.411ms - PeakMemoryUsage: 1.11 MB (1160034) - ProbeRows: 598.02K (598016) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 15.839ms - RowsReturned: 596.99K (596992) - RowsReturnedRate: 649.55 K/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 18.546us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 120.623us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 39.572us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=19):(Total: 12.428us, non-child: 12.428us, % non-child: 100.00%) BytesReceived(16s000ms): 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 4.086us - DeserializeRowBatchTimer: 28.733us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 9.66 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=6):(Total: 901.036ms, non-child: 901.036ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:14/3.34 GB 6:13/3.21 GB 2:19/4.45 GB 7:23/5.45 GB 4:21/4.95 GB 1:23/5.61 GB 3:24/5.45 GB 0:19/4.24 GB ExecOption: PARQUET Codegen Enabled Runtime filters: Only following filters arrived: 4, waited 764ms BytesRead(16s000ms): 25.83 MB, 27.82 MB, 27.82 MB, 27.82 MB, 27.82 MB, 27.82 MB, 27.82 MB, 27.82 MB, 27.82 MB, 27.82 MB, 27.82 MB, 27.82 MB, 27.82 MB, 27.82 MB, 27.82 MB, 27.82 MB, 27.82 MB, 27.82 MB, 27.82 MB, 27.82 MB, 27.82 MB, 27.82 MB, 27.82 MB, 27.82 MB, 27.82 MB, 27.82 MB, 27.82 MB, 27.82 MB, 27.82 MB, 27.82 MB, 27.82 MB, 27.82 MB, 27.82 MB, 27.82 MB, 27.82 MB, 27.82 MB, 27.82 MB, 27.82 MB, 27.82 MB - FooterProcessingTime: (Avg: 73.005ms ; Min: 28.935ms ; Max: 115.990ms ; Number of samples: 9) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 11.99 - BytesRead: 27.82 MB (29168388) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 4.551ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 0 (0) - NumRowGroups: 9 (9) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 39.45 MB (41364923) - PerReadThreadRawHdfsThroughput: 42.03 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 719.87K (719872) - RowsReturned: 598.02K (598016) - RowsReturnedRate: 663.70 K/sec - ScanRangesComplete: 147 (147) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 661.855ms - TotalReadThroughput: 44.61 KB/sec Filter 2 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 3 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 4 (1.00 MB): - Files processed: 156 (156) - Files rejected: 147 (147) - Files total: 156 (156) - RowGroups processed: 703 (703) - RowGroups rejected: 0 (0) - RowGroups total: 703 (703) - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) - Splits processed: 9 (9) - Splits rejected: 0 (0) - Splits total: 9 (9) Instance 7f40dcb034de70b7:18c (host=vc1536.foo:22000):(Total: 1s178ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 7:18/3.80 GB 5:26/6.17 GB 0:15/3.67 GB 3:20/4.93 GB 6:21/4.71 GB 4:18/3.80 GB 1:23/5.67 GB 2:17/3.98 GB Filter 4 arrival: 521ms Filter 2 arrival: 6s558ms Filter 3 arrival: 9m23s MemoryUsage(16s000ms): 64.64 MB, 74.97 MB, 74.97 MB, 74.97 MB, 74.97 MB, 74.97 MB, 74.97 MB, 74.97 MB, 74.97 MB, 74.97 MB, 74.97 MB, 74.97 MB, 74.97 MB, 74.97 MB, 74.97 MB, 74.97 MB, 74.97 MB, 74.97 MB, 74.97 MB, 74.97 MB, 74.97 MB, 74.97 MB, 74.97 MB, 74.97 MB, 74.97 MB, 74.97 MB, 74.97 MB, 74.97 MB, 74.97 MB, 74.97 MB, 74.97 MB, 74.97 MB, 74.97 MB, 74.97 MB, 74.97 MB, 74.97 MB, 74.97 MB, 74.97 MB, 74.97 MB ThreadUsage(16s000ms): 8, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9 - AverageThreadTokens: 8.99 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 74.97 MB (78616316) - PerHostPeakMemUsage: 169.57 GB (182076653643) - RowsProduced: 2.36M (2359296) - TotalNetworkReceiveTime: 278.602ms - TotalNetworkSendTime: 979.671us - TotalStorageWaitTime: 2s123ms - TotalThreadsInvoluntaryContextSwitches: 41 (41) - TotalThreadsTotalWallClockTime: 1s406ms - TotalThreadsSysTime: 4.000ms - TotalThreadsUserTime: 193.969ms - TotalThreadsVoluntaryContextSwitches: 43 (43) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 68.108ms - OpenTime: 1s127ms - ExecTreeOpenTime: 931.315ms - PrepareTime: 51.142ms - ExecTreePrepareTime: 584.780us DataStreamSender (dst_id=24):(Total: 322.619ms, non-child: 322.619ms, % non-child: 100.00%) - BytesSent: 20.85 MB (21864557) - NetworkThroughput(*): 104.40 MB/sec - OverallThroughput: 64.63 MB/sec - PeakMemoryUsage: 4.76 MB (4994816) - RowsReturned: 2.36M (2358272) - SerializeBatchTime: 122.109ms - TransmitDataRPCTime: 199.734ms - UncompressedRowBatchSize: 65.95 MB (69149816) CodeGen:(Total: 217.937ms, non-child: 217.937ms, % non-child: 100.00%) - CodegenTime: 1.118ms - CompileTime: 56.645ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 137.428ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 23.407ms HASH_JOIN_NODE (id=8):(Total: 999.462ms, non-child: 59.726ms, % non-child: 5.98%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.047ms - PeakMemoryUsage: 1.11 MB (1162514) - ProbeRows: 2.36M (2359296) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 55.579ms - RowsReturned: 2.36M (2358272) - RowsReturnedRate: 2.36 M/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 22.642us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 124.953us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 62.594us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=19):(Total: 278.608ms, non-child: 15.612us, % non-child: 0.01%) BytesReceived(16s000ms): 963.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 3.120us - DeserializeRowBatchTimer: 17.380us - FirstBatchArrivalWaitTime: 263.870ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 430.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=6):(Total: 661.226ms, non-child: 661.226ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:18/3.80 GB 5:26/6.17 GB 0:15/3.67 GB 3:20/4.93 GB 6:21/4.71 GB 4:18/3.80 GB 1:23/5.67 GB 2:17/3.98 GB ExecOption: PARQUET Codegen Enabled Runtime filters: Only following filters arrived: 4, waited 502ms BytesRead(16s000ms): 30.43 MB, 32.94 MB, 32.94 MB, 32.94 MB, 32.94 MB, 32.94 MB, 32.94 MB, 32.94 MB, 32.94 MB, 32.94 MB, 32.94 MB, 32.94 MB, 32.94 MB, 32.94 MB, 32.94 MB, 32.94 MB, 32.94 MB, 32.94 MB, 32.94 MB, 32.94 MB, 32.94 MB, 32.94 MB, 32.94 MB, 32.94 MB, 32.94 MB, 32.94 MB, 32.94 MB, 32.94 MB, 32.94 MB, 32.94 MB, 32.94 MB, 32.94 MB, 32.94 MB, 32.94 MB, 32.94 MB, 32.94 MB, 32.94 MB, 32.94 MB, 32.94 MB - FooterProcessingTime: (Avg: 97.610ms ; Min: 56.786ms ; Max: 141.656ms ; Number of samples: 8) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 7.99 - BytesRead: 32.94 MB (34542848) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 14.301ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 0 (0) - NumRowGroups: 8 (8) - NumScannerThreadsStarted: 8 (8) - PeakMemoryUsage: 53.12 MB (55698087) - PerReadThreadRawHdfsThroughput: 51.16 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 2.48M (2480128) - RowsReturned: 2.36M (2359296) - RowsReturnedRate: 3.57 M/sec - ScanRangesComplete: 150 (150) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 643.957ms - TotalReadThroughput: 52.83 KB/sec Filter 2 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 3 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 4 (1.00 MB): - Files processed: 158 (158) - Files rejected: 150 (150) - Files total: 158 (158) - RowGroups processed: 2.42K (2422) - RowGroups rejected: 0 (0) - RowGroups total: 2.42K (2422) - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) - Splits processed: 8 (8) - Splits rejected: 0 (0) - Splits total: 8 (8) Instance 7f40dcb034de70b7:1be (host=vd1129.foo:22000):(Total: 1s178ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 1:16/3.95 GB 4:21/5.13 GB 7:19/4.35 GB 3:17/3.95 GB 5:18/3.94 GB 6:24/5.37 GB 2:22/4.98 GB 0:22/5.01 GB Filter 4 arrival: 322ms Filter 2 arrival: 7s174ms Filter 3 arrival: 9m23s MemoryUsage(16s000ms): 44.06 MB, 53.16 MB, 53.16 MB, 53.16 MB, 53.16 MB, 53.16 MB, 53.16 MB, 53.16 MB, 53.16 MB, 53.16 MB, 53.16 MB, 53.16 MB, 53.16 MB, 53.16 MB, 53.16 MB, 53.16 MB, 53.16 MB, 53.16 MB, 53.16 MB, 53.16 MB, 53.16 MB, 53.16 MB, 53.16 MB, 53.16 MB, 53.16 MB, 53.16 MB, 53.16 MB, 53.16 MB, 53.16 MB, 53.16 MB, 53.16 MB, 53.16 MB, 53.16 MB, 53.16 MB, 53.16 MB, 53.16 MB, 53.16 MB, 53.16 MB, 53.16 MB ThreadUsage(16s000ms): 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 13.00 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 53.16 MB (55742405) - PerHostPeakMemUsage: 169.56 GB (182059979970) - RowsProduced: 1.07M (1069056) - TotalNetworkReceiveTime: 91.759ms - TotalNetworkSendTime: 19.292ms - TotalStorageWaitTime: 1s008ms - TotalThreadsInvoluntaryContextSwitches: 20 (20) - TotalThreadsTotalWallClockTime: 1s216ms - TotalThreadsSysTime: 3.000ms - TotalThreadsUserTime: 177.972ms - TotalThreadsVoluntaryContextSwitches: 48 (48) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 26.888ms - OpenTime: 1s123ms - ExecTreeOpenTime: 944.109ms - PrepareTime: 54.732ms - ExecTreePrepareTime: 490.587us DataStreamSender (dst_id=24):(Total: 152.560ms, non-child: 152.560ms, % non-child: 100.00%) - BytesSent: 9.17 MB (9611707) - NetworkThroughput(*): 100.14 MB/sec - OverallThroughput: 60.08 MB/sec - PeakMemoryUsage: 4.79 MB (5027584) - RowsReturned: 1.07M (1068032) - SerializeBatchTime: 60.075ms - TransmitDataRPCTime: 91.531ms - UncompressedRowBatchSize: 29.07 MB (30477720) CodeGen:(Total: 201.254ms, non-child: 201.254ms, % non-child: 100.00%) - CodegenTime: 1.016ms - CompileTime: 52.610ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 125.059ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 23.163ms HASH_JOIN_NODE (id=8):(Total: 971.514ms, non-child: 24.351ms, % non-child: 2.51%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.607ms - PeakMemoryUsage: 1.11 MB (1162473) - ProbeRows: 1.07M (1069183) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 20.878ms - RowsReturned: 1.07M (1068159) - RowsReturnedRate: 1.10 M/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 15.302us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 133.832us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 22.455us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=19):(Total: 91.770ms, non-child: 17.382us, % non-child: 0.02%) BytesReceived(16s000ms): 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 5.974us - DeserializeRowBatchTimer: 79.036us - FirstBatchArrivalWaitTime: 83.210ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 1.31 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=6):(Total: 855.480ms, non-child: 855.480ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:16/3.95 GB 4:21/5.13 GB 7:19/4.35 GB 3:17/3.95 GB 5:18/3.94 GB 6:24/5.37 GB 2:22/4.98 GB 0:22/5.01 GB ExecOption: PARQUET Codegen Enabled Runtime filters: Only following filters arrived: 4, waited 703ms BytesRead(16s000ms): 16.79 MB, 17.91 MB, 17.91 MB, 17.91 MB, 17.91 MB, 17.91 MB, 17.91 MB, 17.91 MB, 17.91 MB, 17.91 MB, 17.91 MB, 17.91 MB, 17.91 MB, 17.91 MB, 17.91 MB, 17.91 MB, 17.91 MB, 17.91 MB, 17.91 MB, 17.91 MB, 17.91 MB, 17.91 MB, 17.91 MB, 17.91 MB, 17.91 MB, 17.91 MB, 17.91 MB, 17.91 MB, 17.91 MB, 17.91 MB, 17.91 MB, 17.91 MB, 17.91 MB, 17.91 MB, 17.91 MB, 17.91 MB, 17.91 MB, 17.91 MB, 17.91 MB - FooterProcessingTime: (Avg: 67.798ms ; Min: 53.681ms ; Max: 90.091ms ; Number of samples: 5) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 12.00 - BytesRead: 17.91 MB (18781833) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 6.079ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 0 (0) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 31.21 MB (32723020) - PerReadThreadRawHdfsThroughput: 41.74 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 1.19M (1185919) - RowsReturned: 1.07M (1069183) - RowsReturnedRate: 1.25 M/sec - ScanRangesComplete: 155 (155) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 6.808ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 429.078ms - TotalReadThroughput: 28.77 KB/sec Filter 2 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 102.53K (102527) Filter 3 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 102.53K (102527) Filter 4 (1.00 MB): - Files processed: 159 (159) - Files rejected: 154 (154) - Files total: 159 (159) - RowGroups processed: 1.16K (1159) - RowGroups rejected: 0 (0) - RowGroups total: 1.16K (1159) - Rows processed: 16.38K (16384) - Rows rejected: 0 (0) - Rows total: 102.53K (102527) - Splits processed: 5 (5) - Splits rejected: 0 (0) - Splits total: 5 (5) Instance 7f40dcb034de70b7:1b6 (host=vc1529.foo:22000):(Total: 1s178ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:24/5.69 GB 7:18/4.16 GB 2:21/5.12 GB 1:13/2.96 GB 6:17/4.05 GB 3:24/5.71 GB 5:21/5.18 GB 4:15/3.66 GB Filter 4 arrival: 361ms Filter 2 arrival: 7s066ms Filter 3 arrival: 9m23s MemoryUsage(16s000ms): 51.02 MB, 61.32 MB, 61.32 MB, 61.32 MB, 61.32 MB, 61.32 MB, 61.32 MB, 61.32 MB, 61.32 MB, 61.32 MB, 61.32 MB, 61.32 MB, 61.32 MB, 61.32 MB, 61.32 MB, 61.32 MB, 61.32 MB, 61.32 MB, 61.32 MB, 61.32 MB, 61.32 MB, 61.32 MB, 61.32 MB, 61.32 MB, 61.32 MB, 61.32 MB, 61.32 MB, 61.32 MB, 61.32 MB, 61.32 MB, 61.32 MB, 61.32 MB, 61.32 MB, 61.32 MB, 61.32 MB, 61.32 MB, 61.32 MB, 61.32 MB, 61.32 MB ThreadUsage(16s000ms): 12, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.99 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 61.32 MB (64302884) - PerHostPeakMemUsage: 169.56 GB (182068133972) - RowsProduced: 1.42M (1424384) - TotalNetworkReceiveTime: 127.812ms - TotalNetworkSendTime: 454.077us - TotalStorageWaitTime: 995.136ms - TotalThreadsInvoluntaryContextSwitches: 19 (19) - TotalThreadsTotalWallClockTime: 1s252ms - TotalThreadsSysTime: 3.999ms - TotalThreadsUserTime: 179.972ms - TotalThreadsVoluntaryContextSwitches: 43 (43) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 38.607ms - OpenTime: 1s122ms - ExecTreeOpenTime: 941.032ms - PrepareTime: 55.105ms - ExecTreePrepareTime: 642.419us DataStreamSender (dst_id=24):(Total: 190.957ms, non-child: 190.957ms, % non-child: 100.00%) - BytesSent: 12.13 MB (12718316) - NetworkThroughput(*): 104.20 MB/sec - OverallThroughput: 63.52 MB/sec - PeakMemoryUsage: 4.63 MB (4855552) - RowsReturned: 1.42M (1423360) - SerializeBatchTime: 73.475ms - TransmitDataRPCTime: 116.405ms - UncompressedRowBatchSize: 39.37 MB (41284472) CodeGen:(Total: 204.127ms, non-child: 204.127ms, % non-child: 100.00%) - CodegenTime: 1.148ms - CompileTime: 52.091ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 128.042ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 23.560ms HASH_JOIN_NODE (id=8):(Total: 980.435ms, non-child: 35.147ms, % non-child: 3.58%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.606ms - PeakMemoryUsage: 1.11 MB (1159972) - ProbeRows: 1.42M (1424384) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 31.579ms - RowsReturned: 1.42M (1423360) - RowsReturnedRate: 1.45 M/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 28.052us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 104.688us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 65.047us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=19):(Total: 127.822ms, non-child: 19.372us, % non-child: 0.02%) BytesReceived(16s000ms): 963.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 4.651us - DeserializeRowBatchTimer: 18.332us - FirstBatchArrivalWaitTime: 111.976ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 938.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=6):(Total: 817.535ms, non-child: 817.535ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:24/5.69 GB 7:18/4.16 GB 2:21/5.12 GB 1:13/2.96 GB 6:17/4.05 GB 3:24/5.71 GB 5:21/5.18 GB 4:15/3.66 GB ExecOption: PARQUET Codegen Enabled Runtime filters: Only following filters arrived: 4, waited 662ms BytesRead(16s000ms): 20.05 MB, 22.11 MB, 22.11 MB, 22.11 MB, 22.11 MB, 22.11 MB, 22.11 MB, 22.11 MB, 22.11 MB, 22.11 MB, 22.11 MB, 22.11 MB, 22.11 MB, 22.11 MB, 22.11 MB, 22.11 MB, 22.11 MB, 22.11 MB, 22.11 MB, 22.11 MB, 22.11 MB, 22.11 MB, 22.11 MB, 22.11 MB, 22.11 MB, 22.11 MB, 22.11 MB, 22.11 MB, 22.11 MB, 22.11 MB, 22.11 MB, 22.11 MB, 22.11 MB, 22.11 MB, 22.11 MB, 22.11 MB, 22.11 MB, 22.11 MB, 22.11 MB - FooterProcessingTime: (Avg: 73.281ms ; Min: 40.370ms ; Max: 106.233ms ; Number of samples: 5) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 12.00 - BytesRead: 22.11 MB (23186550) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 9.950ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 0 (0) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 39.32 MB (41227941) - PerReadThreadRawHdfsThroughput: 47.12 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 1.54M (1542144) - RowsReturned: 1.42M (1424384) - RowsReturnedRate: 1.74 M/sec - ScanRangesComplete: 148 (148) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 469.272ms - TotalReadThroughput: 35.49 KB/sec Filter 2 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 3 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 4 (1.00 MB): - Files processed: 153 (153) - Files rejected: 148 (148) - Files total: 153 (153) - RowGroups processed: 1.51K (1506) - RowGroups rejected: 0 (0) - RowGroups total: 1.51K (1506) - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) - Splits processed: 5 (5) - Splits rejected: 0 (0) - Splits total: 5 (5) Instance 7f40dcb034de70b7:1f7 (host=vd1118.foo:22000):(Total: 1s177ms, non-child: 294.122ms, % non-child: 24.98%) Hdfs split stats (:<# splits>/): 4:15/3.52 GB 5:17/4.19 GB 1:25/5.98 GB 2:19/4.68 GB 6:21/4.84 GB 3:17/4.05 GB 0:21/4.96 GB 7:15/3.70 GB Filter 4 arrival: 766ms Filter 2 arrival: 9s199ms Filter 3 arrival: 9m23s MemoryUsage(16s000ms): 36.00 MB, 47.03 MB, 47.03 MB, 47.03 MB, 47.03 MB, 47.03 MB, 47.03 MB, 47.03 MB, 47.03 MB, 47.03 MB, 47.03 MB, 47.03 MB, 47.03 MB, 47.03 MB, 47.03 MB, 47.03 MB, 47.03 MB, 47.03 MB, 47.03 MB, 47.03 MB, 47.03 MB, 47.03 MB, 47.03 MB, 47.03 MB, 47.03 MB, 47.03 MB, 47.03 MB, 47.03 MB, 47.03 MB, 47.03 MB, 47.03 MB, 47.03 MB, 47.03 MB, 47.03 MB, 47.03 MB, 47.03 MB, 47.03 MB, 47.03 MB, 47.03 MB ThreadUsage(16s000ms): 5, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6 - AverageThreadTokens: 5.99 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 47.03 MB (49310377) - PerHostPeakMemUsage: 169.55 GB (182053478116) - RowsProduced: 108.54K (108544) - TotalNetworkReceiveTime: 2.660us - TotalNetworkSendTime: 34.468us - TotalStorageWaitTime: 945.855ms - TotalThreadsInvoluntaryContextSwitches: 39 (39) - TotalThreadsTotalWallClockTime: 741.109ms - TotalThreadsSysTime: 25.996ms - TotalThreadsUserTime: 311.953ms - TotalThreadsVoluntaryContextSwitches: 58 (58) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 4.453ms - OpenTime: 742.902ms - ExecTreeOpenTime: 399.213ms - PrepareTime: 434.643ms - ExecTreePrepareTime: 1.288ms DataStreamSender (dst_id=24):(Total: 46.273ms, non-child: 46.273ms, % non-child: 100.00%) - BytesSent: 521.70 KB (534220) - NetworkThroughput(*): 83.86 MB/sec - OverallThroughput: 11.01 MB/sec - PeakMemoryUsage: 4.72 MB (4945664) - RowsReturned: 107.52K (107520) - SerializeBatchTime: 6.049ms - TransmitDataRPCTime: 6.075ms - UncompressedRowBatchSize: 1.70 MB (1786240) CodeGen:(Total: 431.124ms, non-child: 431.124ms, % non-child: 100.00%) - CodegenTime: 2.634ms - CompileTime: 99.907ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 234.684ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 95.513ms HASH_JOIN_NODE (id=8):(Total: 406.052ms, non-child: 5.783ms, % non-child: 1.42%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 948.442us - PeakMemoryUsage: 1.10 MB (1150648) - ProbeRows: 108.54K (108544) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3.964ms - RowsReturned: 107.52K (107520) - RowsReturnedRate: 264.79 K/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 26.754us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 89.589us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 82.397us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=19):(Total: 9.596us, non-child: 9.596us, % non-child: 100.00%) BytesReceived(16s000ms): 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 2.798us - DeserializeRowBatchTimer: 1.143ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 12.51 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=6):(Total: 400.265ms, non-child: 400.265ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:15/3.52 GB 5:17/4.19 GB 1:25/5.98 GB 2:19/4.68 GB 6:21/4.84 GB 3:17/4.05 GB 0:21/4.96 GB 7:15/3.70 GB ExecOption: PARQUET Codegen Enabled Runtime filters: Only following filters arrived: 4, waited 261ms BytesRead(16s000ms): 15.74 MB, 17.02 MB, 17.02 MB, 17.02 MB, 17.02 MB, 17.02 MB, 17.02 MB, 17.02 MB, 17.02 MB, 17.02 MB, 17.02 MB, 17.02 MB, 17.02 MB, 17.02 MB, 17.02 MB, 17.02 MB, 17.02 MB, 17.02 MB, 17.02 MB, 17.02 MB, 17.02 MB, 17.02 MB, 17.02 MB, 17.02 MB, 17.02 MB, 17.02 MB, 17.02 MB, 17.02 MB, 17.02 MB, 17.02 MB, 17.02 MB, 17.02 MB, 17.02 MB, 17.02 MB, 17.02 MB, 17.02 MB, 17.02 MB, 17.02 MB, 17.02 MB - FooterProcessingTime: (Avg: 61.594ms ; Min: 42.514ms ; Max: 78.072ms ; Number of samples: 5) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 5.00 - BytesRead: 17.02 MB (17842171) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 2.170ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 0 (0) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 5 (5) - PeakMemoryUsage: 25.16 MB (26382890) - PerReadThreadRawHdfsThroughput: 44.26 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 226.30K (226304) - RowsReturned: 108.54K (108544) - RowsReturnedRate: 271.18 K/sec - ScanRangesComplete: 145 (145) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 384.490ms - TotalReadThroughput: 27.46 KB/sec Filter 2 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 3 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 4 (1.00 MB): - Files processed: 150 (150) - Files rejected: 145 (145) - Files total: 150 (150) - RowGroups processed: 221 (221) - RowGroups rejected: 0 (0) - RowGroups total: 221 (221) - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) - Splits processed: 5 (5) - Splits rejected: 0 (0) - Splits total: 5 (5) Instance 7f40dcb034de70b7:1fd (host=vd1119.foo:22000):(Total: 1s177ms, non-child: 14.917ms, % non-child: 1.27%) Hdfs split stats (:<# splits>/): 1:16/3.83 GB 3:16/3.65 GB 4:25/6.16 GB 0:17/3.83 GB 6:24/5.44 GB 5:20/4.93 GB 7:22/4.38 GB 2:21/4.52 GB Filter 4 arrival: 245ms Filter 2 arrival: 9s355ms Filter 3 arrival: 9m23s MemoryUsage(16s000ms): 53.35 MB, 65.75 MB, 65.75 MB, 65.75 MB, 65.75 MB, 65.75 MB, 65.75 MB, 65.75 MB, 65.75 MB, 65.75 MB, 65.75 MB, 65.75 MB, 65.75 MB, 65.75 MB, 65.75 MB, 65.75 MB, 65.75 MB, 65.75 MB, 65.75 MB, 65.75 MB, 65.75 MB, 65.75 MB, 65.75 MB, 65.75 MB, 65.75 MB, 65.75 MB, 65.75 MB, 65.75 MB, 65.75 MB, 65.75 MB, 65.75 MB, 65.75 MB, 65.75 MB, 65.75 MB, 65.75 MB, 65.75 MB, 65.75 MB, 65.75 MB, 65.75 MB, 65.75 MB ThreadUsage(16s000ms): 12, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.99 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 65.75 MB (68942037) - PerHostPeakMemUsage: 169.57 GB (182073242429) - RowsProduced: 98.30K (98304) - TotalNetworkReceiveTime: 3.368us - TotalNetworkSendTime: 14.212us - TotalStorageWaitTime: 1s053ms - TotalThreadsInvoluntaryContextSwitches: 28 (28) - TotalThreadsTotalWallClockTime: 1s127ms - TotalThreadsSysTime: 6.999ms - TotalThreadsUserTime: 190.971ms - TotalThreadsVoluntaryContextSwitches: 60 (60) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 3.444ms - OpenTime: 1s125ms - ExecTreeOpenTime: 929.524ms - PrepareTime: 51.519ms - ExecTreePrepareTime: 525.673us DataStreamSender (dst_id=24):(Total: 9.806ms, non-child: 9.806ms, % non-child: 100.00%) - BytesSent: 318.56 KB (326209) - NetworkThroughput(*): 79.76 MB/sec - OverallThroughput: 31.72 MB/sec - PeakMemoryUsage: 4.86 MB (5101312) - RowsReturned: 97.28K (97280) - SerializeBatchTime: 4.310ms - TransmitDataRPCTime: 3.900ms - UncompressedRowBatchSize: 1.04 MB (1094072) CodeGen:(Total: 218.818ms, non-child: 218.818ms, % non-child: 100.00%) - CodegenTime: 1.799ms - CompileTime: 56.240ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 137.614ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 24.232ms HASH_JOIN_NODE (id=8):(Total: 933.935ms, non-child: 4.985ms, % non-child: 0.53%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.629ms - PeakMemoryUsage: 1.10 MB (1152563) - ProbeRows: 98.30K (98304) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3.018ms - RowsReturned: 97.28K (97280) - RowsReturnedRate: 104.16 K/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 34.195us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 117.624us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 65.898us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=19):(Total: 13.021us, non-child: 13.021us, % non-child: 100.00%) BytesReceived(16s000ms): 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 4.858us - DeserializeRowBatchTimer: 29.712us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 9.22 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=6):(Total: 928.942ms, non-child: 928.942ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:16/3.83 GB 3:16/3.65 GB 4:25/6.16 GB 0:17/3.83 GB 6:24/5.44 GB 5:20/4.93 GB 7:22/4.38 GB 2:21/4.52 GB ExecOption: PARQUET Codegen Enabled Runtime filters: Only following filters arrived: 4, waited 784ms BytesRead(16s000ms): 24.54 MB, 26.48 MB, 26.48 MB, 26.48 MB, 26.48 MB, 26.48 MB, 26.48 MB, 26.48 MB, 26.48 MB, 26.48 MB, 26.48 MB, 26.48 MB, 26.48 MB, 26.48 MB, 26.48 MB, 26.48 MB, 26.48 MB, 26.48 MB, 26.48 MB, 26.48 MB, 26.48 MB, 26.48 MB, 26.48 MB, 26.48 MB, 26.48 MB, 26.48 MB, 26.48 MB, 26.48 MB, 26.48 MB, 26.48 MB, 26.48 MB, 26.48 MB, 26.48 MB, 26.48 MB, 26.48 MB, 26.48 MB, 26.48 MB, 26.48 MB, 26.48 MB, 26.48 MB - FooterProcessingTime: (Avg: 66.498ms ; Min: 38.005ms ; Max: 112.913ms ; Number of samples: 6) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 11.99 - BytesRead: 26.48 MB (27764110) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 2.229ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 0 (0) - NumRowGroups: 6 (6) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 43.38 MB (45490262) - PerReadThreadRawHdfsThroughput: 54.64 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 217.09K (217088) - RowsReturned: 98.30K (98304) - RowsReturnedRate: 105.82 K/sec - ScanRangesComplete: 155 (155) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 484.621ms - TotalReadThroughput: 42.30 KB/sec Filter 2 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 3 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 4 (1.00 MB): - Files processed: 161 (161) - Files rejected: 155 (155) - Files total: 161 (161) - RowGroups processed: 212 (212) - RowGroups rejected: 0 (0) - RowGroups total: 212 (212) - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) - Splits processed: 6 (6) - Splits rejected: 0 (0) - Splits total: 6 (6) Instance 7f40dcb034de70b7:195 (host=va1028.foo:22000):(Total: 1s177ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 3:18/4.15 GB 5:23/5.21 GB 4:16/3.94 GB 2:19/4.43 GB 6:25/5.74 GB 7:11/2.71 GB 0:23/5.41 GB 1:22/4.93 GB Filter 4 arrival: 459ms Filter 2 arrival: 6s681ms Filter 3 arrival: 9m23s MemoryUsage(16s000ms): 54.31 MB, 63.61 MB, 63.61 MB, 63.61 MB, 63.61 MB, 63.61 MB, 63.61 MB, 63.61 MB, 63.61 MB, 63.61 MB, 63.61 MB, 63.61 MB, 63.61 MB, 63.61 MB, 63.61 MB, 63.61 MB, 63.61 MB, 63.61 MB, 63.61 MB, 63.61 MB, 63.61 MB, 63.61 MB, 63.61 MB, 63.61 MB, 63.61 MB, 63.61 MB, 63.61 MB, 63.61 MB, 63.61 MB, 63.61 MB, 63.61 MB, 63.61 MB, 63.61 MB, 63.61 MB, 63.61 MB, 63.61 MB, 63.61 MB, 63.61 MB, 63.61 MB ThreadUsage(16s000ms): 12, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.99 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 63.61 MB (66702849) - PerHostPeakMemUsage: 169.57 GB (182070306136) - RowsProduced: 2.16M (2157568) - TotalNetworkReceiveTime: 203.514ms - TotalNetworkSendTime: 5.058ms - TotalStorageWaitTime: 1s532ms - TotalThreadsInvoluntaryContextSwitches: 23 (23) - TotalThreadsTotalWallClockTime: 1s320ms - TotalThreadsSysTime: 4.000ms - TotalThreadsUserTime: 196.969ms - TotalThreadsVoluntaryContextSwitches: 40 (40) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 58.506ms - OpenTime: 1s116ms - ExecTreeOpenTime: 917.236ms - PrepareTime: 61.304ms - ExecTreePrepareTime: 612.531us DataStreamSender (dst_id=24):(Total: 297.078ms, non-child: 297.078ms, % non-child: 100.00%) - BytesSent: 18.88 MB (19792106) - NetworkThroughput(*): 101.62 MB/sec - OverallThroughput: 63.54 MB/sec - PeakMemoryUsage: 4.73 MB (4962048) - RowsReturned: 2.16M (2156544) - SerializeBatchTime: 109.948ms - TransmitDataRPCTime: 185.741ms - UncompressedRowBatchSize: 60.26 MB (63188240) CodeGen:(Total: 220.479ms, non-child: 220.479ms, % non-child: 100.00%) - CodegenTime: 1.141ms - CompileTime: 61.678ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 135.077ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 23.183ms HASH_JOIN_NODE (id=8):(Total: 976.200ms, non-child: 51.129ms, % non-child: 5.24%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.202ms - PeakMemoryUsage: 1.11 MB (1162466) - ProbeRows: 2.16M (2158114) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 46.929ms - RowsReturned: 2.16M (2157090) - RowsReturnedRate: 2.21 M/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 21.566us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 111.003us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 46.533us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=19):(Total: 203.525ms, non-child: 19.727us, % non-child: 0.01%) BytesReceived(16s000ms): 963.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 6.398us - DeserializeRowBatchTimer: 29.468us - FirstBatchArrivalWaitTime: 201.227ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 589.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=6):(Total: 721.661ms, non-child: 721.661ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:18/4.15 GB 5:23/5.21 GB 4:16/3.94 GB 2:19/4.43 GB 6:25/5.74 GB 7:11/2.71 GB 0:23/5.41 GB 1:22/4.93 GB ExecOption: PARQUET Codegen Enabled Runtime filters: Only following filters arrived: 4, waited 562ms BytesRead(16s000ms): 25.09 MB, 26.76 MB, 26.76 MB, 26.76 MB, 26.76 MB, 26.76 MB, 26.76 MB, 26.76 MB, 26.76 MB, 26.76 MB, 26.76 MB, 26.76 MB, 26.76 MB, 26.76 MB, 26.76 MB, 26.76 MB, 26.76 MB, 26.76 MB, 26.76 MB, 26.76 MB, 26.76 MB, 26.76 MB, 26.76 MB, 26.76 MB, 26.76 MB, 26.76 MB, 26.76 MB, 26.76 MB, 26.76 MB, 26.76 MB, 26.76 MB, 26.76 MB, 26.76 MB, 26.76 MB, 26.76 MB, 26.76 MB, 26.76 MB, 26.76 MB, 26.76 MB - FooterProcessingTime: (Avg: 86.447ms ; Min: 58.678ms ; Max: 136.264ms ; Number of samples: 8) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 11.99 - BytesRead: 26.76 MB (28061941) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 13.887ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 0 (0) - NumRowGroups: 8 (8) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 42.14 MB (44188723) - PerReadThreadRawHdfsThroughput: 39.20 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 2.28M (2277922) - RowsReturned: 2.16M (2158114) - RowsReturnedRate: 2.99 M/sec - ScanRangesComplete: 150 (150) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 8.563ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 682.683ms - TotalReadThroughput: 42.92 KB/sec Filter 2 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 115.23K (115234) Filter 3 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 115.23K (115234) Filter 4 (1.00 MB): - Files processed: 157 (157) - Files rejected: 149 (149) - Files total: 157 (157) - RowGroups processed: 2.23K (2225) - RowGroups rejected: 0 (0) - RowGroups total: 2.23K (2225) - Rows processed: 16.38K (16384) - Rows rejected: 0 (0) - Rows total: 115.23K (115234) - Splits processed: 8 (8) - Splits rejected: 0 (0) - Splits total: 8 (8) Instance 7f40dcb034de70b7:1ea (host=vc1523.foo:22000):(Total: 1s176ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 1:18/4.08 GB 6:14/3.39 GB 0:22/4.62 GB 5:24/5.39 GB 3:18/4.20 GB 4:20/4.73 GB 7:22/5.21 GB 2:23/5.13 GB Filter 4 arrival: 232ms Filter 2 arrival: 7s763ms Filter 3 arrival: 9m23s MemoryUsage(16s000ms): 42.47 MB, 52.94 MB, 52.94 MB, 52.94 MB, 52.94 MB, 52.94 MB, 52.94 MB, 52.94 MB, 52.94 MB, 52.94 MB, 52.94 MB, 52.94 MB, 52.94 MB, 52.94 MB, 52.94 MB, 52.94 MB, 52.94 MB, 52.94 MB, 52.94 MB, 52.94 MB, 52.94 MB, 52.94 MB, 52.94 MB, 52.94 MB, 52.94 MB, 52.94 MB, 52.94 MB, 52.94 MB, 52.94 MB, 52.94 MB, 52.94 MB, 52.94 MB, 52.94 MB, 52.94 MB, 52.94 MB, 52.94 MB, 52.94 MB, 52.94 MB, 52.94 MB, 52.94 MB ThreadUsage(16s000ms): 4, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5 - AverageThreadTokens: 4.99 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 52.94 MB (55514726) - PerHostPeakMemUsage: 169.56 GB (182059761730) - RowsProduced: 227.33K (227328) - TotalNetworkReceiveTime: 3.391us - TotalNetworkSendTime: 69.949us - TotalStorageWaitTime: 776.525ms - TotalThreadsInvoluntaryContextSwitches: 28 (28) - TotalThreadsTotalWallClockTime: 1s121ms - TotalThreadsSysTime: 1.999ms - TotalThreadsUserTime: 180.972ms - TotalThreadsVoluntaryContextSwitches: 57 (57) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 6.842ms - OpenTime: 1s120ms - ExecTreeOpenTime: 938.909ms - PrepareTime: 56.292ms - ExecTreePrepareTime: 663.610us DataStreamSender (dst_id=24):(Total: 29.100ms, non-child: 29.100ms, % non-child: 100.00%) - BytesSent: 1.53 MB (1599581) - NetworkThroughput(*): 96.44 MB/sec - OverallThroughput: 52.42 MB/sec - PeakMemoryUsage: 4.79 MB (5019392) - RowsReturned: 226.30K (226304) - SerializeBatchTime: 12.285ms - TransmitDataRPCTime: 15.817ms - UncompressedRowBatchSize: 5.00 MB (5247080) CodeGen:(Total: 203.294ms, non-child: 203.294ms, % non-child: 100.00%) - CodegenTime: 1.010ms - CompileTime: 53.380ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 126.560ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 22.875ms HASH_JOIN_NODE (id=8):(Total: 946.904ms, non-child: 7.592ms, % non-child: 0.80%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.304ms - PeakMemoryUsage: 1.11 MB (1159728) - ProbeRows: 227.33K (227328) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 5.756ms - RowsReturned: 226.30K (226304) - RowsReturnedRate: 238.99 K/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 20.601us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 107.682us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 47.049us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=19):(Total: 11.723us, non-child: 11.723us, % non-child: 100.00%) BytesReceived(16s000ms): 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 3.986us - DeserializeRowBatchTimer: 20.304us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 10.24 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=6):(Total: 939.306ms, non-child: 939.306ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:18/4.08 GB 6:14/3.39 GB 0:22/4.62 GB 5:24/5.39 GB 3:18/4.20 GB 4:20/4.73 GB 7:22/5.21 GB 2:23/5.13 GB ExecOption: PARQUET Codegen Enabled Runtime filters: Only following filters arrived: 4, waited 804ms BytesRead(16s000ms): 16.24 MB, 17.73 MB, 17.73 MB, 17.73 MB, 17.73 MB, 17.73 MB, 17.73 MB, 17.73 MB, 17.73 MB, 17.73 MB, 17.73 MB, 17.73 MB, 17.73 MB, 17.73 MB, 17.73 MB, 17.73 MB, 17.73 MB, 17.73 MB, 17.73 MB, 17.73 MB, 17.73 MB, 17.73 MB, 17.73 MB, 17.73 MB, 17.73 MB, 17.73 MB, 17.73 MB, 17.73 MB, 17.73 MB, 17.73 MB, 17.73 MB, 17.73 MB, 17.73 MB, 17.73 MB, 17.73 MB, 17.73 MB, 17.73 MB, 17.73 MB, 17.73 MB, 17.73 MB - FooterProcessingTime: (Avg: 75.462ms ; Min: 51.374ms ; Max: 120.126ms ; Number of samples: 4) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.00 - BytesRead: 17.73 MB (18595942) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 2.102ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 0 (0) - NumRowGroups: 4 (4) - NumScannerThreadsStarted: 4 (4) - PeakMemoryUsage: 30.97 MB (32472551) - PerReadThreadRawHdfsThroughput: 45.42 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 344.06K (344064) - RowsReturned: 227.33K (227328) - RowsReturnedRate: 242.02 K/sec - ScanRangesComplete: 157 (157) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 390.446ms - TotalReadThroughput: 28.35 KB/sec Filter 2 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 3 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 4 (1.00 MB): - Files processed: 161 (161) - Files rejected: 157 (157) - Files total: 161 (161) - RowGroups processed: 336 (336) - RowGroups rejected: 0 (0) - RowGroups total: 336 (336) - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) - Splits processed: 4 (4) - Splits rejected: 0 (0) - Splits total: 4 (4) Instance 7f40dcb034de70b7:18a (host=vc1534.foo:22000):(Total: 1s176ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 6:16/3.71 GB 7:21/5.02 GB 4:24/5.59 GB 5:18/4.20 GB 2:16/3.80 GB 0:23/5.51 GB 3:18/4.42 GB 1:19/4.35 GB Filter 4 arrival: 520ms Filter 2 arrival: 6s577ms Filter 3 arrival: 9m23s MemoryUsage(16s000ms): 40.56 MB, 49.10 MB, 49.10 MB, 49.10 MB, 49.10 MB, 49.10 MB, 49.10 MB, 49.10 MB, 49.10 MB, 49.10 MB, 49.10 MB, 49.10 MB, 49.10 MB, 49.10 MB, 49.10 MB, 49.10 MB, 49.10 MB, 49.10 MB, 49.10 MB, 49.10 MB, 49.10 MB, 49.10 MB, 49.10 MB, 49.10 MB, 49.10 MB, 49.10 MB, 49.10 MB, 49.10 MB, 49.10 MB, 49.10 MB, 49.10 MB, 49.10 MB, 49.10 MB, 49.10 MB, 49.10 MB, 49.10 MB, 49.10 MB, 49.10 MB, 49.10 MB ThreadUsage(16s000ms): 12, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.99 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 49.10 MB (51485525) - PerHostPeakMemUsage: 169.55 GB (182055654504) - RowsProduced: 2.32M (2315264) - TotalNetworkReceiveTime: 280.234ms - TotalNetworkSendTime: 700.019us - TotalStorageWaitTime: 1s065ms - TotalThreadsInvoluntaryContextSwitches: 20 (20) - TotalThreadsTotalWallClockTime: 1s393ms - TotalThreadsSysTime: 3.999ms - TotalThreadsUserTime: 180.971ms - TotalThreadsVoluntaryContextSwitches: 39 (39) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 65.093ms - OpenTime: 1s112ms - ExecTreeOpenTime: 929.046ms - PrepareTime: 64.551ms - ExecTreePrepareTime: 569.259us DataStreamSender (dst_id=24):(Total: 324.840ms, non-child: 324.840ms, % non-child: 100.00%) - BytesSent: 19.84 MB (20804557) - NetworkThroughput(*): 99.90 MB/sec - OverallThroughput: 61.08 MB/sec - PeakMemoryUsage: 4.65 MB (4871936) - RowsReturned: 2.31M (2314240) - SerializeBatchTime: 125.065ms - TransmitDataRPCTime: 198.609ms - UncompressedRowBatchSize: 64.82 MB (67966432) CodeGen:(Total: 208.021ms, non-child: 208.021ms, % non-child: 100.00%) - CodegenTime: 1.152ms - CompileTime: 52.743ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 128.421ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 26.336ms HASH_JOIN_NODE (id=8):(Total: 994.367ms, non-child: 55.278ms, % non-child: 5.56%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.487ms - PeakMemoryUsage: 1.10 MB (1156261) - ProbeRows: 2.32M (2315264) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 50.491ms - RowsReturned: 2.31M (2314240) - RowsReturnedRate: 2.33 M/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 22.913us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 125.720us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 63.546us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=19):(Total: 280.243ms, non-child: 18.196us, % non-child: 0.01%) BytesReceived(16s000ms): 963.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 4.417us - DeserializeRowBatchTimer: 9.308us - FirstBatchArrivalWaitTime: 265.151ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 428.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=6):(Total: 658.917ms, non-child: 658.917ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 6:16/3.71 GB 7:21/5.02 GB 4:24/5.59 GB 5:18/4.20 GB 2:16/3.80 GB 0:23/5.51 GB 3:18/4.42 GB 1:19/4.35 GB ExecOption: PARQUET Codegen Enabled Runtime filters: Only following filters arrived: 4, waited 502ms BytesRead(16s000ms): 18.19 MB, 19.65 MB, 19.65 MB, 19.65 MB, 19.65 MB, 19.65 MB, 19.65 MB, 19.65 MB, 19.65 MB, 19.65 MB, 19.65 MB, 19.65 MB, 19.65 MB, 19.65 MB, 19.65 MB, 19.65 MB, 19.65 MB, 19.65 MB, 19.65 MB, 19.65 MB, 19.65 MB, 19.65 MB, 19.65 MB, 19.65 MB, 19.65 MB, 19.65 MB, 19.65 MB, 19.65 MB, 19.65 MB, 19.65 MB, 19.65 MB, 19.65 MB, 19.65 MB, 19.65 MB, 19.65 MB, 19.65 MB, 19.65 MB, 19.65 MB, 19.65 MB - FooterProcessingTime: (Avg: 93.588ms ; Min: 58.915ms ; Max: 152.053ms ; Number of samples: 5) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 12.00 - BytesRead: 19.65 MB (20600543) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 14.127ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 0 (0) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 27.29 MB (28611457) - PerReadThreadRawHdfsThroughput: 37.58 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 2.43M (2433024) - RowsReturned: 2.32M (2315264) - RowsReturnedRate: 3.51 M/sec - ScanRangesComplete: 150 (150) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 522.808ms - TotalReadThroughput: 31.61 KB/sec Filter 2 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 3 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 4 (1.00 MB): - Files processed: 155 (155) - Files rejected: 150 (150) - Files total: 155 (155) - RowGroups processed: 2.38K (2376) - RowGroups rejected: 0 (0) - RowGroups total: 2.38K (2376) - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) - Splits processed: 5 (5) - Splits rejected: 0 (0) - Splits total: 5 (5) Instance 7f40dcb034de70b7:1c5 (host=vd1109.foo:22000):(Total: 1s176ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 5:17/3.12 GB 3:17/3.36 GB 1:24/5.80 GB 2:29/6.48 GB 7:18/4.44 GB 4:14/3.03 GB 6:24/5.62 GB 0:20/4.88 GB Filter 4 arrival: 303ms Filter 2 arrival: 7s328ms Filter 3 arrival: 9m23s MemoryUsage(16s000ms): 46.79 MB, 57.21 MB, 57.21 MB, 57.21 MB, 57.21 MB, 57.21 MB, 57.21 MB, 57.21 MB, 57.21 MB, 57.21 MB, 57.21 MB, 57.21 MB, 57.21 MB, 57.21 MB, 57.21 MB, 57.21 MB, 57.21 MB, 57.21 MB, 57.21 MB, 57.21 MB, 57.21 MB, 57.21 MB, 57.21 MB, 57.21 MB, 57.21 MB, 57.21 MB, 57.21 MB, 57.21 MB, 57.21 MB, 57.21 MB, 57.21 MB, 57.21 MB, 57.21 MB, 57.21 MB, 57.21 MB, 57.21 MB, 57.21 MB, 57.21 MB, 57.21 MB ThreadUsage(16s000ms): 12, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.98 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 57.21 MB (59987028) - PerHostPeakMemUsage: 169.55 GB (182058052627) - RowsProduced: 982.02K (982016) - TotalNetworkReceiveTime: 68.263ms - TotalNetworkSendTime: 342.514us - TotalStorageWaitTime: 923.536ms - TotalThreadsInvoluntaryContextSwitches: 26 (26) - TotalThreadsTotalWallClockTime: 1s195ms - TotalThreadsSysTime: 3.999ms - TotalThreadsUserTime: 180.972ms - TotalThreadsVoluntaryContextSwitches: 65 (65) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 28.696ms - OpenTime: 1s126ms - ExecTreeOpenTime: 937.896ms - PrepareTime: 49.856ms - ExecTreePrepareTime: 500.704us DataStreamSender (dst_id=24):(Total: 162.259ms, non-child: 162.259ms, % non-child: 100.00%) - BytesSent: 8.27 MB (8673393) - NetworkThroughput(*): 84.04 MB/sec - OverallThroughput: 50.98 MB/sec - PeakMemoryUsage: 4.61 MB (4839168) - RowsReturned: 980.99K (980992) - SerializeBatchTime: 62.744ms - TransmitDataRPCTime: 98.424ms - UncompressedRowBatchSize: 26.60 MB (27887672) CodeGen:(Total: 210.427ms, non-child: 210.427ms, % non-child: 100.00%) - CodegenTime: 985.386us - CompileTime: 61.262ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 125.550ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 23.207ms HASH_JOIN_NODE (id=8):(Total: 967.218ms, non-child: 26.706ms, % non-child: 2.76%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.635ms - PeakMemoryUsage: 1.11 MB (1162393) - ProbeRows: 982.02K (982016) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 23.727ms - RowsReturned: 980.99K (980992) - RowsReturnedRate: 1.01 M/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 43.578us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 107.549us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 56.993us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=19):(Total: 68.276ms, non-child: 20.803us, % non-child: 0.03%) BytesReceived(16s000ms): 963.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 6.585us - DeserializeRowBatchTimer: 25.218us - FirstBatchArrivalWaitTime: 57.656ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 1.76 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=6):(Total: 872.337ms, non-child: 872.337ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:17/3.12 GB 3:17/3.36 GB 1:24/5.80 GB 2:29/6.48 GB 7:18/4.44 GB 4:14/3.03 GB 6:24/5.62 GB 0:20/4.88 GB ExecOption: PARQUET Codegen Enabled Runtime filters: Only following filters arrived: 4, waited 723ms BytesRead(16s000ms): 18.62 MB, 20.52 MB, 20.52 MB, 20.52 MB, 20.52 MB, 20.52 MB, 20.52 MB, 20.52 MB, 20.52 MB, 20.52 MB, 20.52 MB, 20.52 MB, 20.52 MB, 20.52 MB, 20.52 MB, 20.52 MB, 20.52 MB, 20.52 MB, 20.52 MB, 20.52 MB, 20.52 MB, 20.52 MB, 20.52 MB, 20.52 MB, 20.52 MB, 20.52 MB, 20.52 MB, 20.52 MB, 20.52 MB, 20.52 MB, 20.52 MB, 20.52 MB, 20.52 MB, 20.52 MB, 20.52 MB, 20.52 MB, 20.52 MB, 20.52 MB, 20.52 MB - FooterProcessingTime: (Avg: 57.885ms ; Min: 34.011ms ; Max: 76.943ms ; Number of samples: 5) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 11.99 - BytesRead: 20.52 MB (21521846) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 7.096ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 0 (0) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 35.33 MB (37049514) - PerReadThreadRawHdfsThroughput: 51.85 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 1.10M (1099776) - RowsReturned: 982.02K (982016) - RowsReturnedRate: 1.13 M/sec - ScanRangesComplete: 158 (158) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 395.851ms - TotalReadThroughput: 32.94 KB/sec Filter 2 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 3 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 4 (1.00 MB): - Files processed: 163 (163) - Files rejected: 158 (158) - Files total: 163 (163) - RowGroups processed: 1.07K (1074) - RowGroups rejected: 0 (0) - RowGroups total: 1.07K (1074) - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) - Splits processed: 5 (5) - Splits rejected: 0 (0) - Splits total: 5 (5) Instance 7f40dcb034de70b7:199 (host=vd1339.foo:22000):(Total: 1s176ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 1:18/3.86 GB 7:17/4.18 GB 3:16/3.75 GB 0:23/5.49 GB 4:18/3.95 GB 5:23/4.90 GB 6:27/6.58 GB 2:19/4.06 GB Filter 4 arrival: 463ms Filter 2 arrival: 6s710ms Filter 3 arrival: 9m23s MemoryUsage(16s000ms): 55.63 MB, 66.82 MB, 66.82 MB, 66.82 MB, 66.82 MB, 66.82 MB, 66.82 MB, 66.82 MB, 66.82 MB, 66.82 MB, 66.82 MB, 66.82 MB, 66.82 MB, 66.82 MB, 66.82 MB, 66.82 MB, 66.82 MB, 66.82 MB, 66.82 MB, 66.82 MB, 66.82 MB, 66.82 MB, 66.82 MB, 66.82 MB, 66.82 MB, 66.82 MB, 66.82 MB, 66.82 MB, 66.82 MB, 66.82 MB, 66.82 MB, 66.82 MB, 66.82 MB, 66.82 MB, 66.82 MB, 66.82 MB, 66.82 MB, 66.82 MB, 66.82 MB ThreadUsage(16s000ms): 12, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.99 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 66.82 MB (70069763) - PerHostPeakMemUsage: 169.57 GB (182074265409) - RowsProduced: 1.90M (1895424) - TotalNetworkReceiveTime: 241.749ms - TotalNetworkSendTime: 589.454us - TotalStorageWaitTime: 1s636ms - TotalThreadsInvoluntaryContextSwitches: 20 (20) - TotalThreadsTotalWallClockTime: 1s372ms - TotalThreadsSysTime: 1.999ms - TotalThreadsUserTime: 177.973ms - TotalThreadsVoluntaryContextSwitches: 43 (43) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 55.878ms - OpenTime: 1s129ms - ExecTreeOpenTime: 951.715ms - PrepareTime: 46.859ms - ExecTreePrepareTime: 475.472us DataStreamSender (dst_id=24):(Total: 276.209ms, non-child: 276.209ms, % non-child: 100.00%) - BytesSent: 16.65 MB (17462260) - NetworkThroughput(*): 99.66 MB/sec - OverallThroughput: 60.29 MB/sec - PeakMemoryUsage: 4.67 MB (4896512) - RowsReturned: 1.89M (1894400) - SerializeBatchTime: 108.122ms - TransmitDataRPCTime: 167.099ms - UncompressedRowBatchSize: 52.77 MB (55328784) CodeGen:(Total: 196.629ms, non-child: 196.629ms, % non-child: 100.00%) - CodegenTime: 956.555us - CompileTime: 53.495ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 122.613ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 20.135ms HASH_JOIN_NODE (id=8):(Total: 1s007ms, non-child: 49.443ms, % non-child: 4.91%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.789ms - PeakMemoryUsage: 1.11 MB (1162526) - ProbeRows: 1.90M (1895424) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 44.998ms - RowsReturned: 1.89M (1894400) - RowsReturnedRate: 1.88 M/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 25.461us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 126.870us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 63.634us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=19):(Total: 241.758ms, non-child: 18.633us, % non-child: 0.01%) BytesReceived(16s000ms): 963.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 4.009us - DeserializeRowBatchTimer: 17.530us - FirstBatchArrivalWaitTime: 235.482ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 496.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=6):(Total: 716.711ms, non-child: 716.711ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:18/3.86 GB 7:17/4.18 GB 3:16/3.75 GB 0:23/5.49 GB 4:18/3.95 GB 5:23/4.90 GB 6:27/6.58 GB 2:19/4.06 GB ExecOption: PARQUET Codegen Enabled Runtime filters: Only following filters arrived: 4, waited 562ms BytesRead(16s000ms): 24.12 MB, 26.61 MB, 26.61 MB, 26.61 MB, 26.61 MB, 26.61 MB, 26.61 MB, 26.61 MB, 26.61 MB, 26.61 MB, 26.61 MB, 26.61 MB, 26.61 MB, 26.61 MB, 26.61 MB, 26.61 MB, 26.61 MB, 26.61 MB, 26.61 MB, 26.61 MB, 26.61 MB, 26.61 MB, 26.61 MB, 26.61 MB, 26.61 MB, 26.61 MB, 26.61 MB, 26.61 MB, 26.61 MB, 26.61 MB, 26.61 MB, 26.61 MB, 26.61 MB, 26.61 MB, 26.61 MB, 26.61 MB, 26.61 MB, 26.61 MB, 26.61 MB - FooterProcessingTime: (Avg: 88.595ms ; Min: 54.738ms ; Max: 117.955ms ; Number of samples: 7) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 12.00 - BytesRead: 26.61 MB (27904734) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 10.724ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 0 (0) - NumRowGroups: 7 (7) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 44.85 MB (47025020) - PerReadThreadRawHdfsThroughput: 46.95 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 2.02M (2015232) - RowsReturned: 1.90M (1895424) - RowsReturnedRate: 2.64 M/sec - ScanRangesComplete: 154 (154) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 566.780ms - TotalReadThroughput: 42.81 KB/sec Filter 2 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 3 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 4 (1.00 MB): - Files processed: 161 (161) - Files rejected: 154 (154) - Files total: 161 (161) - RowGroups processed: 1.97K (1968) - RowGroups rejected: 0 (0) - RowGroups total: 1.97K (1968) - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) - Splits processed: 7 (7) - Splits rejected: 0 (0) - Splits total: 7 (7) Instance 7f40dcb034de70b7:1ef (host=vc1513.foo:22000):(Total: 1s175ms, non-child: 12.671ms, % non-child: 1.08%) Hdfs split stats (:<# splits>/): 7:19/4.22 GB 4:19/4.57 GB 0:23/5.45 GB 2:25/5.99 GB 6:19/3.97 GB 1:19/4.47 GB 3:15/3.42 GB 5:20/4.55 GB Filter 4 arrival: 270ms Filter 2 arrival: 7s786ms Filter 3 arrival: 9m23s MemoryUsage(16s000ms): 40.12 MB, 50.73 MB, 50.73 MB, 50.73 MB, 50.73 MB, 50.73 MB, 50.73 MB, 50.73 MB, 50.73 MB, 50.73 MB, 50.73 MB, 50.73 MB, 50.73 MB, 50.73 MB, 50.73 MB, 50.73 MB, 50.73 MB, 50.73 MB, 50.73 MB, 50.73 MB, 50.73 MB, 50.73 MB, 50.73 MB, 50.73 MB, 50.73 MB, 50.73 MB, 50.73 MB, 50.73 MB, 50.73 MB, 50.73 MB, 50.73 MB, 50.73 MB, 50.73 MB, 50.73 MB, 50.73 MB, 50.73 MB, 50.73 MB, 50.73 MB, 50.73 MB ThreadUsage(16s000ms): 12, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.98 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 50.73 MB (53195576) - PerHostPeakMemUsage: 169.55 GB (182057389143) - RowsProduced: 130.05K (130048) - TotalNetworkReceiveTime: 3.756us - TotalNetworkSendTime: 36.068us - TotalStorageWaitTime: 981.310ms - TotalThreadsInvoluntaryContextSwitches: 35 (35) - TotalThreadsTotalWallClockTime: 1s106ms - TotalThreadsSysTime: 7.998ms - TotalThreadsUserTime: 198.969ms - TotalThreadsVoluntaryContextSwitches: 65 (65) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 4.977ms - OpenTime: 1s110ms - ExecTreeOpenTime: 898.961ms - PrepareTime: 64.607ms - ExecTreePrepareTime: 644.453us DataStreamSender (dst_id=24):(Total: 25.176ms, non-child: 25.176ms, % non-child: 100.00%) - BytesSent: 789.92 KB (808873) - NetworkThroughput(*): 97.03 MB/sec - OverallThroughput: 30.64 MB/sec - PeakMemoryUsage: 4.93 MB (5166848) - RowsReturned: 129.02K (129024) - SerializeBatchTime: 16.289ms - TransmitDataRPCTime: 7.950ms - UncompressedRowBatchSize: 2.53 MB (2657032) CodeGen:(Total: 232.313ms, non-child: 232.313ms, % non-child: 100.00%) - CodegenTime: 1.079ms - CompileTime: 54.576ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 149.296ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 27.989ms HASH_JOIN_NODE (id=8):(Total: 905.128ms, non-child: 5.857ms, % non-child: 0.65%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.307ms - PeakMemoryUsage: 1.10 MB (1158557) - ProbeRows: 130.05K (130048) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4.216ms - RowsReturned: 129.02K (129024) - RowsReturnedRate: 142.55 K/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 21.714us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 135.132us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 43.092us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=19):(Total: 13.254us, non-child: 13.254us, % non-child: 100.00%) BytesReceived(16s000ms): 963.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 4.714us - DeserializeRowBatchTimer: 20.320us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 9.05 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=6):(Total: 899.263ms, non-child: 899.263ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:19/4.22 GB 4:19/4.57 GB 0:23/5.45 GB 2:25/5.99 GB 6:19/3.97 GB 1:19/4.47 GB 3:15/3.42 GB 5:20/4.55 GB ExecOption: PARQUET Codegen Enabled Runtime filters: Only following filters arrived: 4, waited 763ms BytesRead(16s000ms): 16.02 MB, 17.67 MB, 17.67 MB, 17.67 MB, 17.67 MB, 17.67 MB, 17.67 MB, 17.67 MB, 17.67 MB, 17.67 MB, 17.67 MB, 17.67 MB, 17.67 MB, 17.67 MB, 17.67 MB, 17.67 MB, 17.67 MB, 17.67 MB, 17.67 MB, 17.67 MB, 17.67 MB, 17.67 MB, 17.67 MB, 17.67 MB, 17.67 MB, 17.67 MB, 17.67 MB, 17.67 MB, 17.67 MB, 17.67 MB, 17.67 MB, 17.67 MB, 17.67 MB, 17.67 MB, 17.67 MB, 17.67 MB, 17.67 MB, 17.67 MB, 17.67 MB - FooterProcessingTime: (Avg: 84.103ms ; Min: 45.976ms ; Max: 138.495ms ; Number of samples: 5) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 11.99 - BytesRead: 17.67 MB (18526136) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 1.986ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 0 (0) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 29.18 MB (30595769) - PerReadThreadRawHdfsThroughput: 35.13 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 247.81K (247808) - RowsReturned: 130.05K (130048) - RowsReturnedRate: 144.62 K/sec - ScanRangesComplete: 154 (154) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 502.920ms - TotalReadThroughput: 28.29 KB/sec Filter 2 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 3 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 4 (1.00 MB): - Files processed: 159 (159) - Files rejected: 154 (154) - Files total: 159 (159) - RowGroups processed: 242 (242) - RowGroups rejected: 0 (0) - RowGroups total: 242 (242) - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) - Splits processed: 5 (5) - Splits rejected: 0 (0) - Splits total: 5 (5) Instance 7f40dcb034de70b7:1d5 (host=vc1515.foo:22000):(Total: 1s173ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 1:20/4.67 GB 4:22/4.93 GB 2:21/4.78 GB 0:16/3.94 GB 6:17/3.82 GB 3:18/4.44 GB 5:19/4.26 GB 7:25/5.94 GB Filter 4 arrival: 273ms Filter 2 arrival: 7s518ms Filter 3 arrival: 9m23s MemoryUsage(16s000ms): 56.94 MB, 67.44 MB, 67.44 MB, 67.44 MB, 67.44 MB, 67.44 MB, 67.44 MB, 67.44 MB, 67.44 MB, 67.44 MB, 67.44 MB, 67.44 MB, 67.44 MB, 67.44 MB, 67.44 MB, 67.44 MB, 67.44 MB, 67.44 MB, 67.44 MB, 67.44 MB, 67.44 MB, 67.44 MB, 67.44 MB, 67.44 MB, 67.44 MB, 67.44 MB, 67.44 MB, 67.44 MB, 67.44 MB, 67.44 MB, 67.44 MB, 67.44 MB, 67.44 MB, 67.44 MB, 67.44 MB, 67.44 MB, 67.44 MB, 67.44 MB, 67.44 MB ThreadUsage(16s000ms): 12, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.99 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 67.44 MB (70717306) - PerHostPeakMemUsage: 169.57 GB (182074877824) - RowsProduced: 579.58K (579584) - TotalNetworkReceiveTime: 3.855us - TotalNetworkSendTime: 237.822us - TotalStorageWaitTime: 1s199ms - TotalThreadsInvoluntaryContextSwitches: 52 (52) - TotalThreadsTotalWallClockTime: 1s111ms - TotalThreadsSysTime: 1.999ms - TotalThreadsUserTime: 211.968ms - TotalThreadsVoluntaryContextSwitches: 77 (77) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 21.174ms - OpenTime: 1s111ms - ExecTreeOpenTime: 896.492ms - PrepareTime: 62.700ms - ExecTreePrepareTime: 620.930us DataStreamSender (dst_id=24):(Total: 93.257ms, non-child: 93.257ms, % non-child: 100.00%) - BytesSent: 4.78 MB (5016091) - NetworkThroughput(*): 94.64 MB/sec - OverallThroughput: 51.30 MB/sec - PeakMemoryUsage: 4.75 MB (4978432) - RowsReturned: 578.56K (578560) - SerializeBatchTime: 41.595ms - TransmitDataRPCTime: 50.546ms - UncompressedRowBatchSize: 15.14 MB (15875208) CodeGen:(Total: 239.304ms, non-child: 239.304ms, % non-child: 100.00%) - CodegenTime: 1.275ms - CompileTime: 58.743ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 153.237ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 26.858ms HASH_JOIN_NODE (id=8):(Total: 918.594ms, non-child: 19.984ms, % non-child: 2.18%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.199ms - PeakMemoryUsage: 1.11 MB (1162449) - ProbeRows: 579.58K (579584) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 17.768ms - RowsReturned: 578.56K (578560) - RowsReturnedRate: 629.83 K/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 20.504us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 106.632us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 48.640us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=19):(Total: 12.662us, non-child: 12.662us, % non-child: 100.00%) BytesReceived(16s000ms): 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 4.675us - DeserializeRowBatchTimer: 15.118us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 9.48 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=6):(Total: 898.602ms, non-child: 898.602ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:20/4.67 GB 4:22/4.93 GB 2:21/4.78 GB 0:16/3.94 GB 6:17/3.82 GB 3:18/4.44 GB 5:19/4.26 GB 7:25/5.94 GB ExecOption: PARQUET Codegen Enabled Runtime filters: Only following filters arrived: 4, waited 763ms BytesRead(16s000ms): 24.48 MB, 26.24 MB, 26.24 MB, 26.24 MB, 26.24 MB, 26.24 MB, 26.24 MB, 26.24 MB, 26.24 MB, 26.24 MB, 26.24 MB, 26.24 MB, 26.24 MB, 26.24 MB, 26.24 MB, 26.24 MB, 26.24 MB, 26.24 MB, 26.24 MB, 26.24 MB, 26.24 MB, 26.24 MB, 26.24 MB, 26.24 MB, 26.24 MB, 26.24 MB, 26.24 MB, 26.24 MB, 26.24 MB, 26.24 MB, 26.24 MB, 26.24 MB, 26.24 MB, 26.24 MB, 26.24 MB, 26.24 MB, 26.24 MB, 26.24 MB, 26.24 MB - FooterProcessingTime: (Avg: 66.037ms ; Min: 42.139ms ; Max: 85.276ms ; Number of samples: 6) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 11.99 - BytesRead: 26.24 MB (27517823) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 3.327ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 0 (0) - NumRowGroups: 6 (6) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 45.42 MB (47625979) - PerReadThreadRawHdfsThroughput: 49.61 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 698.37K (698368) - RowsReturned: 579.58K (579584) - RowsReturnedRate: 644.98 K/sec - ScanRangesComplete: 152 (152) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 529.031ms - TotalReadThroughput: 42.35 KB/sec Filter 2 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 3 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 4 (1.00 MB): - Files processed: 158 (158) - Files rejected: 152 (152) - Files total: 158 (158) - RowGroups processed: 682 (682) - RowGroups rejected: 0 (0) - RowGroups total: 682 (682) - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) - Splits processed: 6 (6) - Splits rejected: 0 (0) - Splits total: 6 (6) Instance 7f40dcb034de70b7:1b2 (host=vd1126.foo:22000):(Total: 1s173ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 2:18/4.44 GB 0:16/3.52 GB 5:21/4.75 GB 3:25/5.83 GB 1:20/4.93 GB 7:23/4.84 GB 6:20/4.37 GB 4:16/3.94 GB Filter 4 arrival: 376ms Filter 2 arrival: 7s065ms Filter 3 arrival: 9m23s MemoryUsage(16s000ms): 50.14 MB, 61.65 MB, 61.65 MB, 61.65 MB, 61.65 MB, 61.65 MB, 61.65 MB, 61.65 MB, 61.65 MB, 61.65 MB, 61.65 MB, 61.65 MB, 61.65 MB, 61.65 MB, 61.65 MB, 61.65 MB, 61.65 MB, 61.65 MB, 61.65 MB, 61.65 MB, 61.65 MB, 61.65 MB, 61.65 MB, 61.65 MB, 61.65 MB, 61.65 MB, 61.65 MB, 61.65 MB, 61.65 MB, 61.65 MB, 61.65 MB, 61.65 MB, 61.65 MB, 61.65 MB, 61.65 MB, 61.65 MB, 61.65 MB, 61.65 MB, 61.65 MB ThreadUsage(16s000ms): 12, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.99 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 61.65 MB (64644727) - PerHostPeakMemUsage: 169.56 GB (182067882047) - RowsProduced: 1.48M (1482752) - TotalNetworkReceiveTime: 159.542ms - TotalNetworkSendTime: 518.922us - TotalStorageWaitTime: 1s031ms - TotalThreadsInvoluntaryContextSwitches: 18 (18) - TotalThreadsTotalWallClockTime: 1s287ms - TotalThreadsSysTime: 999.000us - TotalThreadsUserTime: 173.974ms - TotalThreadsVoluntaryContextSwitches: 42 (42) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 43.821ms - OpenTime: 1s126ms - ExecTreeOpenTime: 953.332ms - PrepareTime: 46.936ms - ExecTreePrepareTime: 477.571us DataStreamSender (dst_id=24):(Total: 207.342ms, non-child: 207.342ms, % non-child: 100.00%) - BytesSent: 12.74 MB (13360499) - NetworkThroughput(*): 101.30 MB/sec - OverallThroughput: 61.45 MB/sec - PeakMemoryUsage: 4.85 MB (5084928) - RowsReturned: 1.48M (1481728) - SerializeBatchTime: 80.739ms - TransmitDataRPCTime: 125.780ms - UncompressedRowBatchSize: 40.97 MB (42959072) CodeGen:(Total: 191.719ms, non-child: 191.719ms, % non-child: 100.00%) - CodegenTime: 906.735us - CompileTime: 51.487ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 120.306ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 19.525ms HASH_JOIN_NODE (id=8):(Total: 997.578ms, non-child: 39.218ms, % non-child: 3.93%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.605ms - PeakMemoryUsage: 1.11 MB (1162462) - ProbeRows: 1.48M (1482752) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 35.695ms - RowsReturned: 1.48M (1481728) - RowsReturnedRate: 1.49 M/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 24.587us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 161.212us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 92.184us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=19):(Total: 159.559ms, non-child: 25.786us, % non-child: 0.02%) BytesReceived(16s000ms): 963.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 11.924us - DeserializeRowBatchTimer: 11.120us - FirstBatchArrivalWaitTime: 146.183ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 752.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=6):(Total: 798.872ms, non-child: 798.872ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:18/4.44 GB 0:16/3.52 GB 5:21/4.75 GB 3:25/5.83 GB 1:20/4.93 GB 7:23/4.84 GB 6:20/4.37 GB 4:16/3.94 GB ExecOption: PARQUET Codegen Enabled Runtime filters: Only following filters arrived: 4, waited 663ms BytesRead(16s000ms): 24.73 MB, 27.29 MB, 27.29 MB, 27.29 MB, 27.29 MB, 27.29 MB, 27.29 MB, 27.29 MB, 27.29 MB, 27.29 MB, 27.29 MB, 27.29 MB, 27.29 MB, 27.29 MB, 27.29 MB, 27.29 MB, 27.29 MB, 27.29 MB, 27.29 MB, 27.29 MB, 27.29 MB, 27.29 MB, 27.29 MB, 27.29 MB, 27.29 MB, 27.29 MB, 27.29 MB, 27.29 MB, 27.29 MB, 27.29 MB, 27.29 MB, 27.29 MB, 27.29 MB, 27.29 MB, 27.29 MB, 27.29 MB, 27.29 MB, 27.29 MB, 27.29 MB - FooterProcessingTime: (Avg: 69.053ms ; Min: 54.430ms ; Max: 111.148ms ; Number of samples: 6) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 12.00 - BytesRead: 27.29 MB (28614597) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 9.945ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 0 (0) - NumRowGroups: 6 (6) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 39.61 MB (41537338) - PerReadThreadRawHdfsThroughput: 47.84 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 1.60M (1601536) - RowsReturned: 1.48M (1482752) - RowsReturnedRate: 1.86 M/sec - ScanRangesComplete: 153 (153) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 570.472ms - TotalReadThroughput: 43.83 KB/sec Filter 2 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 3 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 4 (1.00 MB): - Files processed: 159 (159) - Files rejected: 153 (153) - Files total: 159 (159) - RowGroups processed: 1.56K (1564) - RowGroups rejected: 0 (0) - RowGroups total: 1.56K (1564) - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) - Splits processed: 6 (6) - Splits rejected: 0 (0) - Splits total: 6 (6) Instance 7f40dcb034de70b7:189 (host=vd1141.foo:22000):(Total: 1s173ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 3:17/3.87 GB 7:15/3.45 GB 6:19/4.68 GB 0:18/4.12 GB 1:18/4.15 GB 2:23/5.27 GB 4:23/5.67 GB 5:24/5.42 GB Filter 4 arrival: 519ms Filter 2 arrival: 6s599ms Filter 3 arrival: 9m23s MemoryUsage(16s000ms): 61.31 MB, 73.41 MB, 73.41 MB, 73.41 MB, 73.41 MB, 73.41 MB, 73.41 MB, 73.41 MB, 73.41 MB, 73.41 MB, 73.41 MB, 73.41 MB, 73.41 MB, 73.41 MB, 73.41 MB, 73.41 MB, 73.41 MB, 73.41 MB, 73.41 MB, 73.41 MB, 73.41 MB, 73.41 MB, 73.41 MB, 73.41 MB, 73.41 MB, 73.41 MB, 73.41 MB, 73.41 MB, 73.41 MB, 73.41 MB, 73.41 MB, 73.41 MB, 73.41 MB, 73.41 MB, 73.41 MB, 73.41 MB, 73.41 MB, 73.41 MB, 73.41 MB ThreadUsage(16s000ms): 6, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7 - AverageThreadTokens: 6.99 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 73.41 MB (76976759) - PerHostPeakMemUsage: 169.58 GB (182081720861) - RowsProduced: 1.82M (1816576) - TotalNetworkReceiveTime: 274.892ms - TotalNetworkSendTime: 782.389us - TotalStorageWaitTime: 2s020ms - TotalThreadsInvoluntaryContextSwitches: 21 (21) - TotalThreadsTotalWallClockTime: 1s391ms - TotalThreadsSysTime: 6.998ms - TotalThreadsUserTime: 186.971ms - TotalThreadsVoluntaryContextSwitches: 50 (50) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 83.847ms - OpenTime: 1s116ms - ExecTreeOpenTime: 924.875ms - PrepareTime: 57.233ms - ExecTreePrepareTime: 678.854us DataStreamSender (dst_id=24):(Total: 293.184ms, non-child: 293.184ms, % non-child: 100.00%) - BytesSent: 15.90 MB (16674932) - NetworkThroughput(*): 91.56 MB/sec - OverallThroughput: 54.24 MB/sec - PeakMemoryUsage: 4.61 MB (4839168) - RowsReturned: 1.82M (1815552) - SerializeBatchTime: 118.418ms - TransmitDataRPCTime: 173.691ms - UncompressedRowBatchSize: 50.57 MB (53029000) CodeGen:(Total: 214.600ms, non-child: 214.600ms, % non-child: 100.00%) - CodegenTime: 1.172ms - CompileTime: 55.050ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 134.299ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 24.758ms HASH_JOIN_NODE (id=8):(Total: 1s009ms, non-child: 70.857ms, % non-child: 7.02%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 873.660us - PeakMemoryUsage: 1.11 MB (1164957) - ProbeRows: 1.82M (1816576) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 67.301ms - RowsReturned: 1.82M (1815552) - RowsReturnedRate: 1.80 M/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 15.280us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 111.786us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 24.317us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=19):(Total: 274.898ms, non-child: 11.242us, % non-child: 0.00%) BytesReceived(16s000ms): 963.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 2.498us - DeserializeRowBatchTimer: 16.344us - FirstBatchArrivalWaitTime: 260.902ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 436.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=6):(Total: 663.557ms, non-child: 663.557ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:17/3.87 GB 7:15/3.45 GB 6:19/4.68 GB 0:18/4.12 GB 1:18/4.15 GB 2:23/5.27 GB 4:23/5.67 GB 5:24/5.42 GB ExecOption: PARQUET Codegen Enabled Runtime filters: Only following filters arrived: 4, waited 502ms BytesRead(16s000ms): 24.82 MB, 27.71 MB, 27.71 MB, 27.71 MB, 27.71 MB, 27.71 MB, 27.71 MB, 27.71 MB, 27.71 MB, 27.71 MB, 27.71 MB, 27.71 MB, 27.71 MB, 27.71 MB, 27.71 MB, 27.71 MB, 27.71 MB, 27.71 MB, 27.71 MB, 27.71 MB, 27.71 MB, 27.71 MB, 27.71 MB, 27.71 MB, 27.71 MB, 27.71 MB, 27.71 MB, 27.71 MB, 27.71 MB, 27.71 MB, 27.71 MB, 27.71 MB, 27.71 MB, 27.71 MB, 27.71 MB, 27.71 MB, 27.71 MB, 27.71 MB, 27.71 MB - FooterProcessingTime: (Avg: 88.405ms ; Min: 60.324ms ; Max: 138.556ms ; Number of samples: 6) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 6.00 - BytesRead: 27.71 MB (29054512) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 8.873ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 0 (0) - NumRowGroups: 6 (6) - NumScannerThreadsStarted: 6 (6) - PeakMemoryUsage: 51.40 MB (53893624) - PerReadThreadRawHdfsThroughput: 19.91 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 1.94M (1935360) - RowsReturned: 1.82M (1816576) - RowsReturnedRate: 2.74 M/sec - ScanRangesComplete: 151 (151) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 1s391ms - TotalReadThroughput: 44.51 KB/sec Filter 2 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 3 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 4 (1.00 MB): - Files processed: 157 (157) - Files rejected: 151 (151) - Files total: 157 (157) - RowGroups processed: 1.89K (1890) - RowGroups rejected: 0 (0) - RowGroups total: 1.89K (1890) - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) - Splits processed: 6 (6) - Splits rejected: 0 (0) - Splits total: 6 (6) Instance 7f40dcb034de70b7:1f8 (host=va1031.foo:22000):(Total: 1s172ms, non-child: 12.844ms, % non-child: 1.09%) Hdfs split stats (:<# splits>/): 2:19/4.68 GB 3:21/4.68 GB 4:22/4.72 GB 7:16/3.78 GB 0:20/4.70 GB 1:26/5.78 GB 6:18/4.17 GB 5:21/4.08 GB Filter 4 arrival: 259ms Filter 2 arrival: 9s235ms Filter 3 arrival: 9m23s MemoryUsage(16s000ms): 36.84 MB, 47.59 MB, 47.59 MB, 47.59 MB, 47.59 MB, 47.59 MB, 47.59 MB, 47.59 MB, 47.59 MB, 47.59 MB, 47.59 MB, 47.59 MB, 47.59 MB, 47.59 MB, 47.59 MB, 47.59 MB, 47.59 MB, 47.59 MB, 47.59 MB, 47.59 MB, 47.59 MB, 47.59 MB, 47.59 MB, 47.59 MB, 47.59 MB, 47.59 MB, 47.59 MB, 47.59 MB, 47.59 MB, 47.59 MB, 47.59 MB, 47.59 MB, 47.59 MB, 47.59 MB, 47.59 MB, 47.59 MB, 47.59 MB, 47.59 MB, 47.59 MB ThreadUsage(16s000ms): 12, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.99 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 47.59 MB (49902599) - PerHostPeakMemUsage: 169.55 GB (182054131090) - RowsProduced: 109.57K (109568) - TotalNetworkReceiveTime: 10.000us - TotalNetworkSendTime: 33.610us - TotalStorageWaitTime: 904.462ms - TotalThreadsInvoluntaryContextSwitches: 65 (65) - TotalThreadsTotalWallClockTime: 1s123ms - TotalThreadsSysTime: 4.999ms - TotalThreadsUserTime: 208.969ms - TotalThreadsVoluntaryContextSwitches: 59 (59) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 3.749ms - OpenTime: 1s122ms - ExecTreeOpenTime: 908.584ms - PrepareTime: 50.488ms - ExecTreePrepareTime: 610.392us DataStreamSender (dst_id=24):(Total: 17.323ms, non-child: 17.323ms, % non-child: 100.00%) - BytesSent: 501.10 KB (513131) - NetworkThroughput(*): 74.30 MB/sec - OverallThroughput: 28.25 MB/sec - PeakMemoryUsage: 4.58 MB (4798208) - RowsReturned: 108.54K (108544) - SerializeBatchTime: 10.127ms - TransmitDataRPCTime: 6.586ms - UncompressedRowBatchSize: 1.64 MB (1719256) CodeGen:(Total: 229.368ms, non-child: 229.368ms, % non-child: 100.00%) - CodegenTime: 1.247ms - CompileTime: 66.405ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 145.414ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 16.931ms HASH_JOIN_NODE (id=8):(Total: 913.449ms, non-child: 4.962ms, % non-child: 0.54%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.659ms - PeakMemoryUsage: 1.10 MB (1149685) - ProbeRows: 109.57K (109568) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 2.972ms - RowsReturned: 108.54K (108544) - RowsReturnedRate: 118.83 K/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 20.527us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 102.814us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 59.085us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=19):(Total: 19.857us, non-child: 19.857us, % non-child: 100.00%) BytesReceived(16s000ms): 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 5.195us - DeserializeRowBatchTimer: 13.669us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 6.04 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=6):(Total: 908.472ms, non-child: 908.472ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:19/4.68 GB 3:21/4.68 GB 4:22/4.72 GB 7:16/3.78 GB 0:20/4.70 GB 1:26/5.78 GB 6:18/4.17 GB 5:21/4.08 GB ExecOption: PARQUET Codegen Enabled Runtime filters: Only following filters arrived: 4, waited 763ms BytesRead(16s000ms): 13.18 MB, 14.06 MB, 14.06 MB, 14.06 MB, 14.06 MB, 14.06 MB, 14.06 MB, 14.06 MB, 14.06 MB, 14.06 MB, 14.06 MB, 14.06 MB, 14.06 MB, 14.06 MB, 14.06 MB, 14.06 MB, 14.06 MB, 14.06 MB, 14.06 MB, 14.06 MB, 14.06 MB, 14.06 MB, 14.06 MB, 14.06 MB, 14.06 MB, 14.06 MB, 14.06 MB, 14.06 MB, 14.06 MB, 14.06 MB, 14.06 MB, 14.06 MB, 14.06 MB, 14.06 MB, 14.06 MB, 14.06 MB, 14.06 MB, 14.06 MB, 14.06 MB - FooterProcessingTime: (Avg: 84.818ms ; Min: 66.298ms ; Max: 111.060ms ; Number of samples: 5) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 11.99 - BytesRead: 14.06 MB (14741841) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 1.996ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 0 (0) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 25.49 MB (26729352) - PerReadThreadRawHdfsThroughput: 33.48 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 227.33K (227328) - RowsReturned: 109.57K (109568) - RowsReturnedRate: 120.61 K/sec - ScanRangesComplete: 158 (158) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 419.860ms - TotalReadThroughput: 22.63 KB/sec Filter 2 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 3 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 4 (1.00 MB): - Files processed: 163 (163) - Files rejected: 158 (158) - Files total: 163 (163) - RowGroups processed: 222 (222) - RowGroups rejected: 0 (0) - RowGroups total: 222 (222) - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) - Splits processed: 5 (5) - Splits rejected: 0 (0) - Splits total: 5 (5) Instance 7f40dcb034de70b7:1ae (host=vd1135.foo:22000):(Total: 1s172ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 4:18/3.96 GB 5:16/3.71 GB 0:22/5.19 GB 7:17/3.50 GB 6:22/5.19 GB 3:20/4.85 GB 2:21/4.97 GB 1:22/5.28 GB Filter 4 arrival: 368ms Filter 2 arrival: 6s962ms Filter 3 arrival: 9m23s MemoryUsage(16s000ms): 53.28 MB, 62.46 MB, 62.46 MB, 62.46 MB, 62.46 MB, 62.46 MB, 62.46 MB, 62.46 MB, 62.46 MB, 62.46 MB, 62.46 MB, 62.46 MB, 62.46 MB, 62.46 MB, 62.46 MB, 62.46 MB, 62.46 MB, 62.46 MB, 62.46 MB, 62.46 MB, 62.46 MB, 62.46 MB, 62.46 MB, 62.46 MB, 62.46 MB, 62.46 MB, 62.46 MB, 62.46 MB, 62.46 MB, 62.46 MB, 62.46 MB, 62.46 MB, 62.46 MB, 62.46 MB, 62.46 MB, 62.46 MB, 62.46 MB, 62.46 MB, 62.46 MB ThreadUsage(16s000ms): 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 13.00 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 62.46 MB (65491539) - PerHostPeakMemUsage: 169.57 GB (182069699515) - RowsProduced: 1.43M (1425408) - TotalNetworkReceiveTime: 122.571ms - TotalNetworkSendTime: 455.142us - TotalStorageWaitTime: 1s406ms - TotalThreadsInvoluntaryContextSwitches: 21 (21) - TotalThreadsTotalWallClockTime: 1s241ms - TotalThreadsSysTime: 3.999ms - TotalThreadsUserTime: 193.971ms - TotalThreadsVoluntaryContextSwitches: 42 (42) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 41.322ms - OpenTime: 1s117ms - ExecTreeOpenTime: 921.027ms - PrepareTime: 55.207ms - ExecTreePrepareTime: 615.670us DataStreamSender (dst_id=24):(Total: 213.998ms, non-child: 213.998ms, % non-child: 100.00%) - BytesSent: 12.15 MB (12738666) - NetworkThroughput(*): 93.07 MB/sec - OverallThroughput: 56.77 MB/sec - PeakMemoryUsage: 4.82 MB (5052160) - RowsReturned: 1.42M (1424384) - SerializeBatchTime: 82.505ms - TransmitDataRPCTime: 130.528ms - UncompressedRowBatchSize: 39.50 MB (41418440) CodeGen:(Total: 217.245ms, non-child: 217.245ms, % non-child: 100.00%) - CodegenTime: 1.215ms - CompileTime: 57.780ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 136.820ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 22.168ms HASH_JOIN_NODE (id=8):(Total: 962.957ms, non-child: 36.156ms, % non-child: 3.75%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.336ms - PeakMemoryUsage: 1.11 MB (1161176) - ProbeRows: 1.43M (1425408) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 32.421ms - RowsReturned: 1.42M (1424384) - RowsReturnedRate: 1.48 M/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 21.690us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 122.210us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 48.029us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=19):(Total: 122.581ms, non-child: 16.929us, % non-child: 0.01%) BytesReceived(16s000ms): 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 4.837us - DeserializeRowBatchTimer: 12.742us - FirstBatchArrivalWaitTime: 116.735ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 978.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=6):(Total: 804.373ms, non-child: 804.373ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:18/3.96 GB 5:16/3.71 GB 0:22/5.19 GB 7:17/3.50 GB 6:22/5.19 GB 3:20/4.85 GB 2:21/4.97 GB 1:22/5.28 GB ExecOption: PARQUET Codegen Enabled Runtime filters: Only following filters arrived: 4, waited 662ms BytesRead(16s000ms): 23.96 MB, 25.56 MB, 25.56 MB, 25.56 MB, 25.56 MB, 25.56 MB, 25.56 MB, 25.56 MB, 25.56 MB, 25.56 MB, 25.56 MB, 25.56 MB, 25.56 MB, 25.56 MB, 25.56 MB, 25.56 MB, 25.56 MB, 25.56 MB, 25.56 MB, 25.56 MB, 25.56 MB, 25.56 MB, 25.56 MB, 25.56 MB, 25.56 MB, 25.56 MB, 25.56 MB, 25.56 MB, 25.56 MB, 25.56 MB, 25.56 MB, 25.56 MB, 25.56 MB, 25.56 MB, 25.56 MB, 25.56 MB, 25.56 MB, 25.56 MB, 25.56 MB - FooterProcessingTime: (Avg: 75.912ms ; Min: 49.009ms ; Max: 99.838ms ; Number of samples: 7) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 12.00 - BytesRead: 25.56 MB (26799915) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 8.904ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 0 (0) - NumRowGroups: 7 (7) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 40.68 MB (42654164) - PerReadThreadRawHdfsThroughput: 48.19 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 1.55M (1545216) - RowsReturned: 1.43M (1425408) - RowsReturnedRate: 1.77 M/sec - ScanRangesComplete: 151 (151) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 530.413ms - TotalReadThroughput: 41.25 KB/sec Filter 2 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 3 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 4 (1.00 MB): - Files processed: 158 (158) - Files rejected: 151 (151) - Files total: 158 (158) - RowGroups processed: 1.51K (1509) - RowGroups rejected: 0 (0) - RowGroups total: 1.51K (1509) - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) - Splits processed: 7 (7) - Splits rejected: 0 (0) - Splits total: 7 (7) Instance 7f40dcb034de70b7:1dd (host=ve1131.foo:22000):(Total: 1s172ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 2:20/4.70 GB 4:11/2.01 GB 6:27/6.42 GB 0:19/4.68 GB 7:19/4.55 GB 5:23/5.58 GB 3:22/5.07 GB 1:14/3.45 GB Filter 4 arrival: 265ms Filter 2 arrival: 7s617ms Filter 3 arrival: 9m23s MemoryUsage(16s000ms): 57.59 MB, 68.13 MB, 68.13 MB, 68.13 MB, 68.13 MB, 68.13 MB, 68.13 MB, 68.13 MB, 68.13 MB, 68.13 MB, 68.13 MB, 68.13 MB, 68.13 MB, 68.13 MB, 68.13 MB, 68.13 MB, 68.13 MB, 68.13 MB, 68.13 MB, 68.13 MB, 68.13 MB, 68.13 MB, 68.13 MB, 68.13 MB, 68.13 MB, 68.13 MB, 68.13 MB, 68.13 MB, 68.13 MB, 68.13 MB, 68.13 MB, 68.13 MB, 68.13 MB, 68.13 MB, 68.13 MB, 68.13 MB, 68.13 MB, 68.13 MB, 68.13 MB ThreadUsage(16s000ms): 12, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.98 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 68.13 MB (71442651) - PerHostPeakMemUsage: 169.57 GB (182069508250) - RowsProduced: 490.50K (490496) - TotalNetworkReceiveTime: 4.894us - TotalNetworkSendTime: 189.561us - TotalStorageWaitTime: 1s692ms - TotalThreadsInvoluntaryContextSwitches: 35 (35) - TotalThreadsTotalWallClockTime: 1s117ms - TotalThreadsSysTime: 2.999ms - TotalThreadsUserTime: 212.968ms - TotalThreadsVoluntaryContextSwitches: 61 (61) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 17.101ms - OpenTime: 1s116ms - ExecTreeOpenTime: 901.163ms - PrepareTime: 55.621ms - ExecTreePrepareTime: 596.653us DataStreamSender (dst_id=24):(Total: 77.988ms, non-child: 77.988ms, % non-child: 100.00%) - BytesSent: 3.89 MB (4073829) - NetworkThroughput(*): 86.99 MB/sec - OverallThroughput: 49.82 MB/sec - PeakMemoryUsage: 4.72 MB (4945664) - RowsReturned: 489.47K (489472) - SerializeBatchTime: 32.170ms - TransmitDataRPCTime: 44.660ms - UncompressedRowBatchSize: 12.56 MB (13173520) CodeGen:(Total: 237.838ms, non-child: 237.838ms, % non-child: 100.00%) - CodegenTime: 1.253ms - CompileTime: 63.255ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 150.189ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 23.935ms HASH_JOIN_NODE (id=8):(Total: 919.194ms, non-child: 17.425ms, % non-child: 1.90%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.531ms - PeakMemoryUsage: 1.11 MB (1161303) - ProbeRows: 490.50K (490496) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 14.831ms - RowsReturned: 489.47K (489472) - RowsReturnedRate: 532.50 K/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 21.910us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 181.244us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 51.753us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=19):(Total: 15.289us, non-child: 15.289us, % non-child: 100.00%) BytesReceived(16s000ms): 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 4.567us - DeserializeRowBatchTimer: 18.743us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 7.85 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=6):(Total: 901.763ms, non-child: 901.763ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:20/4.70 GB 4:11/2.01 GB 6:27/6.42 GB 0:19/4.68 GB 7:19/4.55 GB 5:23/5.58 GB 3:22/5.07 GB 1:14/3.45 GB ExecOption: PARQUET Codegen Enabled Runtime filters: Only following filters arrived: 4, waited 763ms BytesRead(16s000ms): 30.19 MB, 32.37 MB, 32.37 MB, 32.37 MB, 32.37 MB, 32.37 MB, 32.37 MB, 32.37 MB, 32.37 MB, 32.37 MB, 32.37 MB, 32.37 MB, 32.37 MB, 32.37 MB, 32.37 MB, 32.37 MB, 32.37 MB, 32.37 MB, 32.37 MB, 32.37 MB, 32.37 MB, 32.37 MB, 32.37 MB, 32.37 MB, 32.37 MB, 32.37 MB, 32.37 MB, 32.37 MB, 32.37 MB, 32.37 MB, 32.37 MB, 32.37 MB, 32.37 MB, 32.37 MB, 32.37 MB, 32.37 MB, 32.37 MB, 32.37 MB, 32.37 MB - FooterProcessingTime: (Avg: 70.482ms ; Min: 44.401ms ; Max: 106.215ms ; Number of samples: 9) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 11.98 - BytesRead: 32.37 MB (33939160) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 4.739ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 0 (0) - NumRowGroups: 9 (9) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 46.13 MB (48367708) - PerReadThreadRawHdfsThroughput: 44.32 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 612.35K (612352) - RowsReturned: 490.50K (490496) - RowsReturnedRate: 543.93 K/sec - ScanRangesComplete: 146 (146) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 730.376ms - TotalReadThroughput: 51.87 KB/sec Filter 2 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 3 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 4 (1.00 MB): - Files processed: 155 (155) - Files rejected: 146 (146) - Files total: 155 (155) - RowGroups processed: 598 (598) - RowGroups rejected: 0 (0) - RowGroups total: 598 (598) - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) - Splits processed: 9 (9) - Splits rejected: 0 (0) - Splits total: 9 (9) Instance 7f40dcb034de70b7:1f1 (host=vc1510.foo:22000):(Total: 1s171ms, non-child: 13.459ms, % non-child: 1.15%) Hdfs split stats (:<# splits>/): 4:23/5.12 GB 1:14/3.41 GB 3:22/5.08 GB 2:24/5.31 GB 6:18/4.44 GB 7:19/4.36 GB 0:17/3.98 GB 5:21/4.82 GB Filter 4 arrival: 257ms Filter 2 arrival: 7s855ms Filter 3 arrival: 9m23s MemoryUsage(16s000ms): 57.06 MB, 67.56 MB, 67.56 MB, 67.56 MB, 67.56 MB, 67.56 MB, 67.56 MB, 67.56 MB, 67.56 MB, 67.56 MB, 67.56 MB, 67.56 MB, 67.56 MB, 67.56 MB, 67.56 MB, 67.56 MB, 67.56 MB, 67.56 MB, 67.56 MB, 67.56 MB, 67.56 MB, 67.56 MB, 67.56 MB, 67.56 MB, 67.56 MB, 67.56 MB, 67.56 MB, 67.56 MB, 67.56 MB, 67.56 MB, 67.56 MB, 67.56 MB, 67.56 MB, 67.56 MB, 67.56 MB, 67.56 MB, 67.56 MB, 67.56 MB, 67.56 MB, 67.56 MB ThreadUsage(16s000ms): 12, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.99 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 67.56 MB (70841967) - PerHostPeakMemUsage: 169.57 GB (182075024276) - RowsProduced: 112.64K (112640) - TotalNetworkReceiveTime: 4.854us - TotalNetworkSendTime: 40.522us - TotalStorageWaitTime: 1s600ms - TotalThreadsInvoluntaryContextSwitches: 31 (31) - TotalThreadsTotalWallClockTime: 1s116ms - TotalThreadsSysTime: 3.999ms - TotalThreadsUserTime: 200.969ms - TotalThreadsVoluntaryContextSwitches: 64 (64) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 3.483ms - OpenTime: 1s115ms - ExecTreeOpenTime: 911.582ms - PrepareTime: 56.568ms - ExecTreePrepareTime: 595.664us DataStreamSender (dst_id=24):(Total: 15.123ms, non-child: 15.123ms, % non-child: 100.00%) - BytesSent: 555.43 KB (568764) - NetworkThroughput(*): 72.24 MB/sec - OverallThroughput: 35.87 MB/sec - PeakMemoryUsage: 4.66 MB (4888320) - RowsReturned: 111.62K (111616) - SerializeBatchTime: 6.938ms - TransmitDataRPCTime: 7.508ms - UncompressedRowBatchSize: 1.79 MB (1875552) CodeGen:(Total: 227.142ms, non-child: 227.142ms, % non-child: 100.00%) - CodegenTime: 1.084ms - CompileTime: 56.432ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 145.410ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 24.832ms HASH_JOIN_NODE (id=8):(Total: 916.171ms, non-child: 5.076ms, % non-child: 0.55%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.578ms - PeakMemoryUsage: 1.11 MB (1159178) - ProbeRows: 112.64K (112640) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3.048ms - RowsReturned: 111.62K (111616) - RowsReturnedRate: 121.83 K/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 21.838us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 279.964us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 55.958us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=19):(Total: 14.804us, non-child: 14.804us, % non-child: 100.00%) BytesReceived(16s000ms): 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 4.975us - DeserializeRowBatchTimer: 30.330us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 8.11 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=6):(Total: 911.086ms, non-child: 911.086ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:23/5.12 GB 1:14/3.41 GB 3:22/5.08 GB 2:24/5.31 GB 6:18/4.44 GB 7:19/4.36 GB 0:17/3.98 GB 5:21/4.82 GB ExecOption: PARQUET Codegen Enabled Runtime filters: Only following filters arrived: 4, waited 763ms BytesRead(16s000ms): 24.25 MB, 25.87 MB, 25.87 MB, 25.87 MB, 25.87 MB, 25.87 MB, 25.87 MB, 25.87 MB, 25.87 MB, 25.87 MB, 25.87 MB, 25.87 MB, 25.87 MB, 25.87 MB, 25.87 MB, 25.87 MB, 25.87 MB, 25.87 MB, 25.87 MB, 25.87 MB, 25.87 MB, 25.87 MB, 25.87 MB, 25.87 MB, 25.87 MB, 25.87 MB, 25.87 MB, 25.87 MB, 25.87 MB, 25.87 MB, 25.87 MB, 25.87 MB, 25.87 MB, 25.87 MB, 25.87 MB, 25.87 MB, 25.87 MB, 25.87 MB, 25.87 MB, 25.87 MB - FooterProcessingTime: (Avg: 80.412ms ; Min: 32.515ms ; Max: 120.771ms ; Number of samples: 7) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 11.99 - BytesRead: 25.87 MB (27124177) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 2.103ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 0 (0) - NumRowGroups: 7 (7) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 45.65 MB (47865328) - PerReadThreadRawHdfsThroughput: 39.29 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 232.45K (232448) - RowsReturned: 112.64K (112640) - RowsReturnedRate: 123.63 K/sec - ScanRangesComplete: 151 (151) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 658.414ms - TotalReadThroughput: 41.26 KB/sec Filter 2 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 3 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 4 (1.00 MB): - Files processed: 158 (158) - Files rejected: 151 (151) - Files total: 158 (158) - RowGroups processed: 227 (227) - RowGroups rejected: 0 (0) - RowGroups total: 227 (227) - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) - Splits processed: 7 (7) - Splits rejected: 0 (0) - Splits total: 7 (7) Instance 7f40dcb034de70b7:1c8 (host=va1037.foo:22000):(Total: 1s170ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 5:19/4.33 GB 2:17/4.03 GB 3:20/4.61 GB 1:21/4.81 GB 6:22/5.20 GB 0:19/4.48 GB 4:13/3.20 GB 7:24/5.88 GB Filter 4 arrival: 298ms Filter 2 arrival: 7s311ms Filter 3 arrival: 9m23s MemoryUsage(16s000ms): 51.49 MB, 61.09 MB, 61.09 MB, 61.09 MB, 61.09 MB, 61.09 MB, 61.09 MB, 61.09 MB, 61.09 MB, 61.09 MB, 61.09 MB, 61.09 MB, 61.09 MB, 61.09 MB, 61.09 MB, 61.09 MB, 61.09 MB, 61.09 MB, 61.09 MB, 61.09 MB, 61.09 MB, 61.09 MB, 61.09 MB, 61.09 MB, 61.09 MB, 61.09 MB, 61.09 MB, 61.09 MB, 61.09 MB, 61.09 MB, 61.09 MB, 61.09 MB, 61.09 MB, 61.09 MB, 61.09 MB, 61.09 MB, 61.09 MB, 61.09 MB, 61.09 MB, 61.09 MB ThreadUsage(16s000ms): 12, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.98 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 61.09 MB (64056094) - PerHostPeakMemUsage: 169.56 GB (182068268006) - RowsProduced: 953.34K (953344) - TotalNetworkReceiveTime: 54.616ms - TotalNetworkSendTime: 313.651us - TotalStorageWaitTime: 806.172ms - TotalThreadsInvoluntaryContextSwitches: 29 (29) - TotalThreadsTotalWallClockTime: 1s174ms - TotalThreadsSysTime: 5.998ms - TotalThreadsUserTime: 184.972ms - TotalThreadsVoluntaryContextSwitches: 108 (108) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 24.917ms - OpenTime: 1s118ms - ExecTreeOpenTime: 924.207ms - PrepareTime: 52.297ms - ExecTreePrepareTime: 597.843us DataStreamSender (dst_id=24):(Total: 140.668ms, non-child: 140.668ms, % non-child: 100.00%) - BytesSent: 8.02 MB (8412042) - NetworkThroughput(*): 97.40 MB/sec - OverallThroughput: 57.03 MB/sec - PeakMemoryUsage: 4.65 MB (4880128) - RowsReturned: 952.32K (952320) - SerializeBatchTime: 57.392ms - TransmitDataRPCTime: 82.368ms - UncompressedRowBatchSize: 25.89 MB (27150848) CodeGen:(Total: 217.217ms, non-child: 217.217ms, % non-child: 100.00%) - CodegenTime: 1.034ms - CompileTime: 63.333ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 129.120ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 24.324ms HASH_JOIN_NODE (id=8):(Total: 949.940ms, non-child: 24.218ms, % non-child: 2.55%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.524ms - PeakMemoryUsage: 1.11 MB (1162265) - ProbeRows: 953.34K (953344) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 20.958ms - RowsReturned: 952.32K (952320) - RowsReturnedRate: 1.00 M/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 29.458us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 121.069us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 117.778us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=19):(Total: 54.624ms, non-child: 18.724us, % non-child: 0.03%) BytesReceived(16s000ms): 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 3.879us - DeserializeRowBatchTimer: 34.593us - FirstBatchArrivalWaitTime: 36.545ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 2.20 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=6):(Total: 871.274ms, non-child: 871.274ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:19/4.33 GB 2:17/4.03 GB 3:20/4.61 GB 1:21/4.81 GB 6:22/5.20 GB 0:19/4.48 GB 4:13/3.20 GB 7:24/5.88 GB ExecOption: PARQUET Codegen Enabled Runtime filters: Only following filters arrived: 4, waited 723ms BytesRead(16s000ms): 20.81 MB, 22.19 MB, 22.19 MB, 22.19 MB, 22.19 MB, 22.19 MB, 22.19 MB, 22.19 MB, 22.19 MB, 22.19 MB, 22.19 MB, 22.19 MB, 22.19 MB, 22.19 MB, 22.19 MB, 22.19 MB, 22.19 MB, 22.19 MB, 22.19 MB, 22.19 MB, 22.19 MB, 22.19 MB, 22.19 MB, 22.19 MB, 22.19 MB, 22.19 MB, 22.19 MB, 22.19 MB, 22.19 MB, 22.19 MB, 22.19 MB, 22.19 MB, 22.19 MB, 22.19 MB, 22.19 MB, 22.19 MB, 22.19 MB, 22.19 MB, 22.19 MB, 22.19 MB - FooterProcessingTime: (Avg: 63.735ms ; Min: 44.566ms ; Max: 86.381ms ; Number of samples: 5) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 11.98 - BytesRead: 22.19 MB (23272215) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 5.983ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 0 (0) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 39.31 MB (41222813) - PerReadThreadRawHdfsThroughput: 49.82 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 1.07M (1071104) - RowsReturned: 953.34K (953344) - RowsReturnedRate: 1.09 M/sec - ScanRangesComplete: 150 (150) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 445.529ms - TotalReadThroughput: 35.51 KB/sec Filter 2 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 3 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 4 (1.00 MB): - Files processed: 155 (155) - Files rejected: 150 (150) - Files total: 155 (155) - RowGroups processed: 1.05K (1046) - RowGroups rejected: 0 (0) - RowGroups total: 1.05K (1046) - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) - Splits processed: 5 (5) - Splits rejected: 0 (0) - Splits total: 5 (5) Instance 7f40dcb034de70b7:1df (host=vd1122.foo:22000):(Total: 1s170ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:17/3.95 GB 1:19/4.69 GB 5:20/4.93 GB 3:15/3.45 GB 7:17/4.19 GB 6:19/4.62 GB 2:23/4.73 GB 4:24/5.87 GB Filter 4 arrival: 255ms Filter 2 arrival: 7s631ms Filter 3 arrival: 9m23s MemoryUsage(16s000ms): 43.40 MB, 52.99 MB, 52.99 MB, 52.99 MB, 52.99 MB, 52.99 MB, 52.99 MB, 52.99 MB, 52.99 MB, 52.99 MB, 52.99 MB, 52.99 MB, 52.99 MB, 52.99 MB, 52.99 MB, 52.99 MB, 52.99 MB, 52.99 MB, 52.99 MB, 52.99 MB, 52.99 MB, 52.99 MB, 52.99 MB, 52.99 MB, 52.99 MB, 52.99 MB, 52.99 MB, 52.99 MB, 52.99 MB, 52.99 MB, 52.99 MB, 52.99 MB, 52.99 MB, 52.99 MB, 52.99 MB, 52.99 MB, 52.99 MB, 52.99 MB, 52.99 MB ThreadUsage(16s000ms): 12, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.99 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 52.99 MB (55563269) - PerHostPeakMemUsage: 169.55 GB (182053628868) - RowsProduced: 501.76K (501760) - TotalNetworkReceiveTime: 5.570us - TotalNetworkSendTime: 180.365us - TotalStorageWaitTime: 889.630ms - TotalThreadsInvoluntaryContextSwitches: 39 (39) - TotalThreadsTotalWallClockTime: 1s120ms - TotalThreadsSysTime: 4.999ms - TotalThreadsUserTime: 202.968ms - TotalThreadsVoluntaryContextSwitches: 62 (62) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 13.233ms - OpenTime: 1s118ms - ExecTreeOpenTime: 912.300ms - PrepareTime: 51.658ms - ExecTreePrepareTime: 525.687us DataStreamSender (dst_id=24):(Total: 73.151ms, non-child: 73.151ms, % non-child: 100.00%) - BytesSent: 3.93 MB (4125670) - NetworkThroughput(*): 93.90 MB/sec - OverallThroughput: 53.79 MB/sec - PeakMemoryUsage: 4.76 MB (4994816) - RowsReturned: 500.74K (500736) - SerializeBatchTime: 30.415ms - TransmitDataRPCTime: 41.902ms - UncompressedRowBatchSize: 12.99 MB (13620080) CodeGen:(Total: 227.736ms, non-child: 227.736ms, % non-child: 100.00%) - CodegenTime: 1.195ms - CompileTime: 60.542ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 143.721ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 23.022ms HASH_JOIN_NODE (id=8):(Total: 926.307ms, non-child: 13.738ms, % non-child: 1.48%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 2.096ms - PeakMemoryUsage: 1.10 MB (1157063) - ProbeRows: 501.76K (501760) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 10.634ms - RowsReturned: 500.74K (500736) - RowsReturnedRate: 540.57 K/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 32.031us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 164.055us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 64.929us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=19):(Total: 16.544us, non-child: 16.544us, % non-child: 100.00%) BytesReceived(16s000ms): 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 4.086us - DeserializeRowBatchTimer: 23.030us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 7.25 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=6):(Total: 912.560ms, non-child: 912.560ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:17/3.95 GB 1:19/4.69 GB 5:20/4.93 GB 3:15/3.45 GB 7:17/4.19 GB 6:19/4.62 GB 2:23/4.73 GB 4:24/5.87 GB ExecOption: PARQUET Codegen Enabled Runtime filters: Only following filters arrived: 4, waited 784ms BytesRead(16s000ms): 18.84 MB, 20.10 MB, 20.10 MB, 20.10 MB, 20.10 MB, 20.10 MB, 20.10 MB, 20.10 MB, 20.10 MB, 20.10 MB, 20.10 MB, 20.10 MB, 20.10 MB, 20.10 MB, 20.10 MB, 20.10 MB, 20.10 MB, 20.10 MB, 20.10 MB, 20.10 MB, 20.10 MB, 20.10 MB, 20.10 MB, 20.10 MB, 20.10 MB, 20.10 MB, 20.10 MB, 20.10 MB, 20.10 MB, 20.10 MB, 20.10 MB, 20.10 MB, 20.10 MB, 20.10 MB, 20.10 MB, 20.10 MB, 20.10 MB, 20.10 MB, 20.10 MB - FooterProcessingTime: (Avg: 73.032ms ; Min: 53.206ms ; Max: 114.704ms ; Number of samples: 5) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 11.99 - BytesRead: 20.10 MB (21073132) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 3.868ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 0 (0) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 31.07 MB (32578438) - PerReadThreadRawHdfsThroughput: 41.92 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 619.52K (619520) - RowsReturned: 501.76K (501760) - RowsReturnedRate: 549.84 K/sec - ScanRangesComplete: 149 (149) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 479.393ms - TotalReadThroughput: 32.25 KB/sec Filter 2 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 3 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 4 (1.00 MB): - Files processed: 154 (154) - Files rejected: 149 (149) - Files total: 154 (154) - RowGroups processed: 605 (605) - RowGroups rejected: 0 (0) - RowGroups total: 605 (605) - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) - Splits processed: 5 (5) - Splits rejected: 0 (0) - Splits total: 5 (5) Instance 7f40dcb034de70b7:1ee (host=vd1110.foo:22000):(Total: 1s170ms, non-child: 4.979ms, % non-child: 0.43%) Hdfs split stats (:<# splits>/): 5:15/3.49 GB 1:26/6.28 GB 4:14/3.18 GB 6:17/4.00 GB 0:20/4.73 GB 3:17/4.19 GB 7:22/5.39 GB 2:23/5.24 GB Filter 4 arrival: 251ms Filter 2 arrival: 7s776ms Filter 3 arrival: 9m23s MemoryUsage(16s000ms): 37.93 MB, 48.66 MB, 48.66 MB, 48.66 MB, 48.66 MB, 48.66 MB, 48.66 MB, 48.66 MB, 48.66 MB, 48.66 MB, 48.66 MB, 48.66 MB, 48.66 MB, 48.66 MB, 48.66 MB, 48.66 MB, 48.66 MB, 48.66 MB, 48.66 MB, 48.66 MB, 48.66 MB, 48.66 MB, 48.66 MB, 48.66 MB, 48.66 MB, 48.66 MB, 48.66 MB, 48.66 MB, 48.66 MB, 48.66 MB, 48.66 MB, 48.66 MB, 48.66 MB, 48.66 MB, 48.66 MB, 48.66 MB, 48.66 MB, 48.66 MB, 48.66 MB ThreadUsage(16s000ms): 12, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.98 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 48.66 MB (51028343) - PerHostPeakMemUsage: 169.55 GB (182054859411) - RowsProduced: 131.07K (131072) - TotalNetworkReceiveTime: 3.315us - TotalNetworkSendTime: 37.424us - TotalStorageWaitTime: 688.435ms - TotalThreadsInvoluntaryContextSwitches: 35 (35) - TotalThreadsTotalWallClockTime: 1s115ms - TotalThreadsSysTime: 4.000ms - TotalThreadsUserTime: 194.971ms - TotalThreadsVoluntaryContextSwitches: 58 (58) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 6.699ms - OpenTime: 1s114ms - ExecTreeOpenTime: 915.134ms - PrepareTime: 55.553ms - ExecTreePrepareTime: 668.756us DataStreamSender (dst_id=24):(Total: 23.769ms, non-child: 23.769ms, % non-child: 100.00%) - BytesSent: 778.35 KB (797033) - NetworkThroughput(*): 70.08 MB/sec - OverallThroughput: 31.98 MB/sec - PeakMemoryUsage: 4.74 MB (4970240) - RowsReturned: 130.05K (130048) - SerializeBatchTime: 12.886ms - TransmitDataRPCTime: 10.846ms - UncompressedRowBatchSize: 2.43 MB (2545392) CodeGen:(Total: 218.624ms, non-child: 218.624ms, % non-child: 100.00%) - CodegenTime: 1.217ms - CompileTime: 52.766ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 144.825ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 20.580ms HASH_JOIN_NODE (id=8):(Total: 923.033ms, non-child: 7.309ms, % non-child: 0.79%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.252ms - PeakMemoryUsage: 1.10 MB (1158168) - ProbeRows: 131.07K (131072) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 5.491ms - RowsReturned: 130.05K (130048) - RowsReturnedRate: 140.89 K/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 23.120us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 109.785us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 63.833us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=19):(Total: 10.191us, non-child: 10.191us, % non-child: 100.00%) BytesReceived(16s000ms): 963.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 3.508us - DeserializeRowBatchTimer: 9.576us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 11.78 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=6):(Total: 915.719ms, non-child: 915.719ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:15/3.49 GB 1:26/6.28 GB 4:14/3.18 GB 6:17/4.00 GB 0:20/4.73 GB 3:17/4.19 GB 7:22/5.39 GB 2:23/5.24 GB ExecOption: PARQUET Codegen Enabled Runtime filters: Only following filters arrived: 4, waited 783ms BytesRead(16s000ms): 15.65 MB, 17.27 MB, 17.27 MB, 17.27 MB, 17.27 MB, 17.27 MB, 17.27 MB, 17.27 MB, 17.27 MB, 17.27 MB, 17.27 MB, 17.27 MB, 17.27 MB, 17.27 MB, 17.27 MB, 17.27 MB, 17.27 MB, 17.27 MB, 17.27 MB, 17.27 MB, 17.27 MB, 17.27 MB, 17.27 MB, 17.27 MB, 17.27 MB, 17.27 MB, 17.27 MB, 17.27 MB, 17.27 MB, 17.27 MB, 17.27 MB, 17.27 MB, 17.27 MB, 17.27 MB, 17.27 MB, 17.27 MB, 17.27 MB, 17.27 MB, 17.27 MB - FooterProcessingTime: (Avg: 65.204ms ; Min: 47.844ms ; Max: 103.448ms ; Number of samples: 4) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 11.99 - BytesRead: 17.27 MB (18113598) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 2.030ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 0 (0) - NumRowGroups: 4 (4) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 26.97 MB (28281080) - PerReadThreadRawHdfsThroughput: 50.90 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 247.81K (247808) - RowsReturned: 131.07K (131072) - RowsReturnedRate: 143.13 K/sec - ScanRangesComplete: 150 (150) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 339.348ms - TotalReadThroughput: 27.79 KB/sec Filter 2 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 3 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 4 (1.00 MB): - Files processed: 154 (154) - Files rejected: 150 (150) - Files total: 154 (154) - RowGroups processed: 242 (242) - RowGroups rejected: 0 (0) - RowGroups total: 242 (242) - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) - Splits processed: 4 (4) - Splits rejected: 0 (0) - Splits total: 4 (4) Instance 7f40dcb034de70b7:1b3 (host=vd1113.foo:22000):(Total: 1s170ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 4:16/3.61 GB 2:22/5.28 GB 1:21/4.84 GB 0:21/4.97 GB 3:23/5.22 GB 6:18/4.25 GB 5:19/4.54 GB 7:17/4.16 GB Filter 4 arrival: 372ms Filter 2 arrival: 7s054ms Filter 3 arrival: 9m23s MemoryUsage(16s000ms): 47.03 MB, 57.32 MB, 57.32 MB, 57.32 MB, 57.32 MB, 57.32 MB, 57.32 MB, 57.32 MB, 57.32 MB, 57.32 MB, 57.32 MB, 57.32 MB, 57.32 MB, 57.32 MB, 57.32 MB, 57.32 MB, 57.32 MB, 57.32 MB, 57.32 MB, 57.32 MB, 57.32 MB, 57.32 MB, 57.32 MB, 57.32 MB, 57.32 MB, 57.32 MB, 57.32 MB, 57.32 MB, 57.32 MB, 57.32 MB, 57.32 MB, 57.32 MB, 57.32 MB, 57.32 MB, 57.32 MB, 57.32 MB, 57.32 MB, 57.32 MB, 57.32 MB ThreadUsage(16s000ms): 5, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6 - AverageThreadTokens: 5.99 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 57.32 MB (60106577) - PerHostPeakMemUsage: 169.56 GB (182064308550) - RowsProduced: 1.04M (1044480) - TotalNetworkReceiveTime: 122.984ms - TotalNetworkSendTime: 477.628us - TotalStorageWaitTime: 1s200ms - TotalThreadsInvoluntaryContextSwitches: 25 (25) - TotalThreadsTotalWallClockTime: 1s242ms - TotalThreadsSysTime: 4.000ms - TotalThreadsUserTime: 199.969ms - TotalThreadsVoluntaryContextSwitches: 62 (62) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 35.942ms - OpenTime: 1s118ms - ExecTreeOpenTime: 916.641ms - PrepareTime: 52.290ms - ExecTreePrepareTime: 738.832us DataStreamSender (dst_id=24):(Total: 165.073ms, non-child: 165.073ms, % non-child: 100.00%) - BytesSent: 8.68 MB (9097925) - NetworkThroughput(*): 98.32 MB/sec - OverallThroughput: 52.56 MB/sec - PeakMemoryUsage: 4.54 MB (4765440) - RowsReturned: 1.04M (1043456) - SerializeBatchTime: 76.219ms - TransmitDataRPCTime: 88.243ms - UncompressedRowBatchSize: 28.34 MB (29718568) CodeGen:(Total: 222.949ms, non-child: 222.949ms, % non-child: 100.00%) - CodegenTime: 1.147ms - CompileTime: 56.804ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 142.997ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 22.687ms HASH_JOIN_NODE (id=8):(Total: 953.488ms, non-child: 32.157ms, % non-child: 3.37%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.311ms - PeakMemoryUsage: 1.11 MB (1162438) - ProbeRows: 1.04M (1044480) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 29.057ms - RowsReturned: 1.04M (1043456) - RowsReturnedRate: 1.09 M/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 16.564us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 127.612us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 30.825us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=19):(Total: 122.993ms, non-child: 16.653us, % non-child: 0.01%) BytesReceived(16s000ms): 963.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 3.982us - DeserializeRowBatchTimer: 16.036us - FirstBatchArrivalWaitTime: 105.857ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 975.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=6):(Total: 798.431ms, non-child: 798.431ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:16/3.61 GB 2:22/5.28 GB 1:21/4.84 GB 0:21/4.97 GB 3:23/5.22 GB 6:18/4.25 GB 5:19/4.54 GB 7:17/4.16 GB ExecOption: PARQUET Codegen Enabled Runtime filters: Only following filters arrived: 4, waited 663ms BytesRead(16s000ms): 18.88 MB, 20.82 MB, 20.82 MB, 20.82 MB, 20.82 MB, 20.82 MB, 20.82 MB, 20.82 MB, 20.82 MB, 20.82 MB, 20.82 MB, 20.82 MB, 20.82 MB, 20.82 MB, 20.82 MB, 20.82 MB, 20.82 MB, 20.82 MB, 20.82 MB, 20.82 MB, 20.82 MB, 20.82 MB, 20.82 MB, 20.82 MB, 20.82 MB, 20.82 MB, 20.82 MB, 20.82 MB, 20.82 MB, 20.82 MB, 20.82 MB, 20.82 MB, 20.82 MB, 20.82 MB, 20.82 MB, 20.82 MB, 20.82 MB, 20.82 MB, 20.82 MB - FooterProcessingTime: (Avg: 77.286ms ; Min: 49.207ms ; Max: 109.822ms ; Number of samples: 5) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 5.00 - BytesRead: 20.82 MB (21834065) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 6.776ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 0 (0) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 5 (5) - PeakMemoryUsage: 35.24 MB (36953390) - PerReadThreadRawHdfsThroughput: 30.64 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 1.16M (1162240) - RowsReturned: 1.04M (1044480) - RowsReturnedRate: 1.31 M/sec - ScanRangesComplete: 152 (152) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 679.624ms - TotalReadThroughput: 33.42 KB/sec Filter 2 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 3 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 4 (1.00 MB): - Files processed: 157 (157) - Files rejected: 152 (152) - Files total: 157 (157) - RowGroups processed: 1.14K (1135) - RowGroups rejected: 0 (0) - RowGroups total: 1.14K (1135) - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) - Splits processed: 5 (5) - Splits rejected: 0 (0) - Splits total: 5 (5) Instance 7f40dcb034de70b7:1aa (host=ve1125.foo:22000):(Total: 1s169ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 3:18/4.27 GB 7:18/4.44 GB 5:18/4.44 GB 2:18/4.00 GB 6:24/5.92 GB 1:19/4.45 GB 4:25/5.93 GB 0:12/2.75 GB Filter 4 arrival: 389ms Filter 2 arrival: 6s942ms Filter 3 arrival: 9m23s MemoryUsage(16s000ms): 58.82 MB, 69.53 MB, 69.53 MB, 69.53 MB, 69.53 MB, 69.53 MB, 69.53 MB, 69.53 MB, 69.53 MB, 69.53 MB, 69.53 MB, 69.53 MB, 69.53 MB, 69.53 MB, 69.53 MB, 69.53 MB, 69.53 MB, 69.53 MB, 69.53 MB, 69.53 MB, 69.53 MB, 69.53 MB, 69.53 MB, 69.53 MB, 69.53 MB, 69.53 MB, 69.53 MB, 69.53 MB, 69.53 MB, 69.53 MB, 69.53 MB, 69.53 MB, 69.53 MB, 69.53 MB, 69.53 MB, 69.53 MB, 69.53 MB, 69.53 MB, 69.53 MB ThreadUsage(16s000ms): 12, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.99 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 69.53 MB (72905266) - PerHostPeakMemUsage: 169.57 GB (182077147455) - RowsProduced: 1.71M (1713152) - TotalNetworkReceiveTime: 134.916ms - TotalNetworkSendTime: 689.984us - TotalStorageWaitTime: 1s291ms - TotalThreadsInvoluntaryContextSwitches: 21 (21) - TotalThreadsTotalWallClockTime: 1s245ms - TotalThreadsSysTime: 2.999ms - TotalThreadsUserTime: 198.969ms - TotalThreadsVoluntaryContextSwitches: 45 (45) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 52.711ms - OpenTime: 1s109ms - ExecTreeOpenTime: 910.449ms - PrepareTime: 59.678ms - ExecTreePrepareTime: 556.676us DataStreamSender (dst_id=24):(Total: 235.230ms, non-child: 235.230ms, % non-child: 100.00%) - BytesSent: 14.49 MB (15197225) - NetworkThroughput(*): 97.47 MB/sec - OverallThroughput: 61.61 MB/sec - PeakMemoryUsage: 4.64 MB (4863744) - RowsReturned: 1.71M (1712128) - SerializeBatchTime: 83.834ms - TransmitDataRPCTime: 148.700ms - UncompressedRowBatchSize: 47.57 MB (49880752) CodeGen:(Total: 223.989ms, non-child: 223.989ms, % non-child: 100.00%) - CodegenTime: 1.126ms - CompileTime: 59.321ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 137.868ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 26.318ms HASH_JOIN_NODE (id=8):(Total: 963.470ms, non-child: 46.245ms, % non-child: 4.80%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.334ms - PeakMemoryUsage: 1.10 MB (1156275) - ProbeRows: 1.71M (1713152) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 41.703ms - RowsReturned: 1.71M (1712128) - RowsReturnedRate: 1.78 M/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 23.721us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 141.937us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 44.504us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=19):(Total: 134.927ms, non-child: 18.915us, % non-child: 0.01%) BytesReceived(16s000ms): 963.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 5.410us - DeserializeRowBatchTimer: 10.982us - FirstBatchArrivalWaitTime: 131.668ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 889.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=6):(Total: 782.466ms, non-child: 782.466ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:18/4.27 GB 7:18/4.44 GB 5:18/4.44 GB 2:18/4.00 GB 6:24/5.92 GB 1:19/4.45 GB 4:25/5.93 GB 0:12/2.75 GB ExecOption: PARQUET Codegen Enabled Runtime filters: Only following filters arrived: 4, waited 642ms BytesRead(16s000ms): 23.15 MB, 25.26 MB, 25.26 MB, 25.26 MB, 25.26 MB, 25.26 MB, 25.26 MB, 25.26 MB, 25.26 MB, 25.26 MB, 25.26 MB, 25.26 MB, 25.26 MB, 25.26 MB, 25.26 MB, 25.26 MB, 25.26 MB, 25.26 MB, 25.26 MB, 25.26 MB, 25.26 MB, 25.26 MB, 25.26 MB, 25.26 MB, 25.26 MB, 25.26 MB, 25.26 MB, 25.26 MB, 25.26 MB, 25.26 MB, 25.26 MB, 25.26 MB, 25.26 MB, 25.26 MB, 25.26 MB, 25.26 MB, 25.26 MB, 25.26 MB, 25.26 MB - FooterProcessingTime: (Avg: 80.962ms ; Min: 55.283ms ; Max: 135.756ms ; Number of samples: 6) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 12.00 - BytesRead: 25.26 MB (26484109) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 9.952ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 0 (0) - NumRowGroups: 6 (6) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 47.54 MB (49849787) - PerReadThreadRawHdfsThroughput: 41.27 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 1.83M (1831936) - RowsReturned: 1.71M (1713152) - RowsReturnedRate: 2.19 M/sec - ScanRangesComplete: 146 (146) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 611.962ms - TotalReadThroughput: 40.60 KB/sec Filter 2 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 3 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 4 (1.00 MB): - Files processed: 152 (152) - Files rejected: 146 (146) - Files total: 152 (152) - RowGroups processed: 1.79K (1789) - RowGroups rejected: 0 (0) - RowGroups total: 1.79K (1789) - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) - Splits processed: 6 (6) - Splits rejected: 0 (0) - Splits total: 6 (6) Instance 7f40dcb034de70b7:1f0 (host=vd1336.foo:22000):(Total: 1s169ms, non-child: 31.390ms, % non-child: 2.68%) Hdfs split stats (:<# splits>/): 0:16/3.79 GB 7:16/3.93 GB 1:26/5.80 GB 2:26/5.71 GB 6:19/4.68 GB 5:14/3.05 GB 3:20/4.51 GB 4:21/5.18 GB Filter 4 arrival: 258ms Filter 2 arrival: 7s801ms Filter 3 arrival: 9m23s MemoryUsage(16s000ms): 61.59 MB, 72.39 MB, 72.39 MB, 72.39 MB, 72.39 MB, 72.39 MB, 72.39 MB, 72.39 MB, 72.39 MB, 72.39 MB, 72.39 MB, 72.39 MB, 72.39 MB, 72.39 MB, 72.39 MB, 72.39 MB, 72.39 MB, 72.39 MB, 72.39 MB, 72.39 MB, 72.39 MB, 72.39 MB, 72.39 MB, 72.39 MB, 72.39 MB, 72.39 MB, 72.39 MB, 72.39 MB, 72.39 MB, 72.39 MB, 72.39 MB, 72.39 MB, 72.39 MB, 72.39 MB, 72.39 MB, 72.39 MB, 72.39 MB, 72.39 MB, 72.39 MB ThreadUsage(16s000ms): 12, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.99 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 72.39 MB (75911347) - PerHostPeakMemUsage: 169.57 GB (182074005218) - RowsProduced: 82.94K (82944) - TotalNetworkReceiveTime: 2.637us - TotalNetworkSendTime: 8.627us - TotalStorageWaitTime: 1s508ms - TotalThreadsInvoluntaryContextSwitches: 26 (26) - TotalThreadsTotalWallClockTime: 1s104ms - TotalThreadsSysTime: 8.998ms - TotalThreadsUserTime: 189.971ms - TotalThreadsVoluntaryContextSwitches: 75 (75) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 2.340ms - OpenTime: 1s103ms - ExecTreeOpenTime: 904.597ms - PrepareTime: 65.708ms - ExecTreePrepareTime: 616.598us DataStreamSender (dst_id=24):(Total: 6.708ms, non-child: 6.708ms, % non-child: 100.00%) - BytesSent: 173.93 KB (178101) - NetworkThroughput(*): 65.51 MB/sec - OverallThroughput: 25.32 MB/sec - PeakMemoryUsage: 4.55 MB (4773632) - RowsReturned: 81.92K (81920) - SerializeBatchTime: 3.440ms - TransmitDataRPCTime: 2.592ms - UncompressedRowBatchSize: 588.73 KB (602856) CodeGen:(Total: 223.230ms, non-child: 223.230ms, % non-child: 100.00%) - CodegenTime: 2.361ms - CompileTime: 57.056ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 139.157ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 26.337ms HASH_JOIN_NODE (id=8):(Total: 908.109ms, non-child: 3.308ms, % non-child: 0.36%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 790.642us - PeakMemoryUsage: 1.09 MB (1143107) - ProbeRows: 82.94K (82944) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 2.091ms - RowsReturned: 81.92K (81920) - RowsReturnedRate: 90.21 K/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 12.166us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 101.384us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 24.892us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=19):(Total: 8.634us, non-child: 8.634us, % non-child: 100.00%) BytesReceived(16s000ms): 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 3.107us - DeserializeRowBatchTimer: 23.561us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 13.90 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=6):(Total: 904.796ms, non-child: 904.796ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:16/3.79 GB 7:16/3.93 GB 1:26/5.80 GB 2:26/5.71 GB 6:19/4.68 GB 5:14/3.05 GB 3:20/4.51 GB 4:21/5.18 GB ExecOption: PARQUET Codegen Enabled Runtime filters: Only following filters arrived: 4, waited 764ms BytesRead(16s000ms): 29.15 MB, 31.09 MB, 31.09 MB, 31.09 MB, 31.09 MB, 31.09 MB, 31.09 MB, 31.09 MB, 31.09 MB, 31.09 MB, 31.09 MB, 31.09 MB, 31.09 MB, 31.09 MB, 31.09 MB, 31.09 MB, 31.09 MB, 31.09 MB, 31.09 MB, 31.09 MB, 31.09 MB, 31.09 MB, 31.09 MB, 31.09 MB, 31.09 MB, 31.09 MB, 31.09 MB, 31.09 MB, 31.09 MB, 31.09 MB, 31.09 MB, 31.09 MB, 31.09 MB, 31.09 MB, 31.09 MB, 31.09 MB, 31.09 MB, 31.09 MB, 31.09 MB - FooterProcessingTime: (Avg: 72.071ms ; Min: 51.034ms ; Max: 100.346ms ; Number of samples: 8) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 11.99 - BytesRead: 31.09 MB (32600749) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 2.279ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 0 (0) - NumRowGroups: 8 (8) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 49.88 MB (52303924) - PerReadThreadRawHdfsThroughput: 44.50 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 203.78K (203776) - RowsReturned: 82.94K (82944) - RowsReturnedRate: 91.67 K/sec - ScanRangesComplete: 150 (150) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 698.640ms - TotalReadThroughput: 50.10 KB/sec Filter 2 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 3 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 4 (1.00 MB): - Files processed: 158 (158) - Files rejected: 150 (150) - Files total: 158 (158) - RowGroups processed: 199 (199) - RowGroups rejected: 0 (0) - RowGroups total: 199 (199) - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) - Splits processed: 8 (8) - Splits rejected: 0 (0) - Splits total: 8 (8) Instance 7f40dcb034de70b7:1e6 (host=ve1137.foo:22000):(Total: 1s167ms, non-child: 2.515ms, % non-child: 0.22%) Hdfs split stats (:<# splits>/): 2:22/5.36 GB 4:18/4.20 GB 7:22/5.16 GB 6:20/4.44 GB 0:22/5.02 GB 1:17/4.19 GB 3:14/3.37 GB 5:20/4.88 GB Filter 4 arrival: 249ms Filter 2 arrival: 7s712ms Filter 3 arrival: 9m23s MemoryUsage(16s000ms): 45.91 MB, 57.51 MB, 57.51 MB, 57.51 MB, 57.51 MB, 57.51 MB, 57.51 MB, 57.51 MB, 57.51 MB, 57.51 MB, 57.51 MB, 57.51 MB, 57.51 MB, 57.51 MB, 57.51 MB, 57.51 MB, 57.51 MB, 57.51 MB, 57.51 MB, 57.51 MB, 57.51 MB, 57.51 MB, 57.51 MB, 57.51 MB, 57.51 MB, 57.51 MB, 57.51 MB, 57.51 MB, 57.51 MB, 57.51 MB, 57.51 MB, 57.51 MB, 57.51 MB, 57.51 MB, 57.51 MB, 57.51 MB, 57.51 MB, 57.51 MB, 57.51 MB ThreadUsage(16s000ms): 12, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.98 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 57.51 MB (60306976) - PerHostPeakMemUsage: 169.56 GB (182058400847) - RowsProduced: 208.90K (208896) - TotalNetworkReceiveTime: 4.105us - TotalNetworkSendTime: 92.579us - TotalStorageWaitTime: 847.244ms - TotalThreadsInvoluntaryContextSwitches: 29 (29) - TotalThreadsTotalWallClockTime: 1s094ms - TotalThreadsSysTime: 4.000ms - TotalThreadsUserTime: 179.973ms - TotalThreadsVoluntaryContextSwitches: 56 (56) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 10.262ms - OpenTime: 1s093ms - ExecTreeOpenTime: 910.320ms - PrepareTime: 73.388ms - ExecTreePrepareTime: 877.007us DataStreamSender (dst_id=24):(Total: 37.559ms, non-child: 37.559ms, % non-child: 100.00%) - BytesSent: 1.28 MB (1339770) - NetworkThroughput(*): 77.03 MB/sec - OverallThroughput: 34.02 MB/sec - PeakMemoryUsage: 4.65 MB (4871936) - RowsReturned: 207.87K (207872) - SerializeBatchTime: 20.283ms - TransmitDataRPCTime: 16.587ms - UncompressedRowBatchSize: 4.26 MB (4465600) CodeGen:(Total: 205.093ms, non-child: 205.093ms, % non-child: 100.00%) - CodegenTime: 1.001ms - CompileTime: 56.352ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 125.354ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 22.898ms HASH_JOIN_NODE (id=8):(Total: 922.080ms, non-child: 10.202ms, % non-child: 1.11%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.258ms - PeakMemoryUsage: 1.10 MB (1150694) - ProbeRows: 208.90K (208896) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 7.952ms - RowsReturned: 207.87K (207872) - RowsReturnedRate: 225.44 K/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 21.583us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 108.942us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 39.661us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=19):(Total: 13.447us, non-child: 13.447us, % non-child: 100.00%) BytesReceived(16s000ms): 963.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 4.714us - DeserializeRowBatchTimer: 18.272us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 8.92 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=6):(Total: 911.870ms, non-child: 911.870ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:22/5.36 GB 4:18/4.20 GB 7:22/5.16 GB 6:20/4.44 GB 0:22/5.02 GB 1:17/4.19 GB 3:14/3.37 GB 5:20/4.88 GB ExecOption: PARQUET Codegen Enabled Runtime filters: Only following filters arrived: 4, waited 784ms BytesRead(16s000ms): 19.83 MB, 21.89 MB, 21.89 MB, 21.89 MB, 21.89 MB, 21.89 MB, 21.89 MB, 21.89 MB, 21.89 MB, 21.89 MB, 21.89 MB, 21.89 MB, 21.89 MB, 21.89 MB, 21.89 MB, 21.89 MB, 21.89 MB, 21.89 MB, 21.89 MB, 21.89 MB, 21.89 MB, 21.89 MB, 21.89 MB, 21.89 MB, 21.89 MB, 21.89 MB, 21.89 MB, 21.89 MB, 21.89 MB, 21.89 MB, 21.89 MB, 21.89 MB, 21.89 MB, 21.89 MB, 21.89 MB, 21.89 MB, 21.89 MB, 21.89 MB, 21.89 MB - FooterProcessingTime: (Avg: 61.869ms ; Min: 47.837ms ; Max: 97.338ms ; Number of samples: 5) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 11.99 - BytesRead: 21.89 MB (22949536) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 2.266ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 0 (0) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 35.18 MB (36887969) - PerReadThreadRawHdfsThroughput: 48.51 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 326.66K (326656) - RowsReturned: 208.90K (208896) - RowsReturnedRate: 229.09 K/sec - ScanRangesComplete: 150 (150) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 451.195ms - TotalReadThroughput: 35.24 KB/sec Filter 2 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 3 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 4 (1.00 MB): - Files processed: 155 (155) - Files rejected: 150 (150) - Files total: 155 (155) - RowGroups processed: 319 (319) - RowGroups rejected: 0 (0) - RowGroups total: 319 (319) - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) - Splits processed: 5 (5) - Splits rejected: 0 (0) - Splits total: 5 (5) Instance 7f40dcb034de70b7:184 (host=va1043.foo:22000):(Total: 1s166ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:22/5.18 GB 5:20/3.96 GB 3:21/4.86 GB 7:20/4.52 GB 6:20/4.43 GB 2:19/4.50 GB 1:23/5.47 GB 4:15/3.70 GB Filter 4 arrival: 581ms Filter 2 arrival: 6s478ms Filter 3 arrival: 9m24s MemoryUsage(16s000ms): 57.07 MB, 67.98 MB, 67.98 MB, 67.98 MB, 67.98 MB, 67.98 MB, 67.98 MB, 67.98 MB, 67.98 MB, 67.98 MB, 67.98 MB, 67.98 MB, 67.98 MB, 67.98 MB, 67.98 MB, 67.98 MB, 67.98 MB, 67.98 MB, 67.98 MB, 67.98 MB, 67.98 MB, 67.98 MB, 67.98 MB, 67.98 MB, 67.98 MB, 67.98 MB, 67.98 MB, 67.98 MB, 67.98 MB, 67.98 MB, 67.98 MB, 67.98 MB, 67.98 MB, 67.98 MB, 67.98 MB, 67.98 MB, 67.98 MB, 67.98 MB, 67.98 MB ThreadUsage(16s000ms): 8, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9 - AverageThreadTokens: 8.99 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 67.98 MB (71280798) - PerHostPeakMemUsage: 169.56 GB (182068554781) - RowsProduced: 3.02M (3017728) - TotalNetworkReceiveTime: 370.507ms - TotalNetworkSendTime: 921.128us - TotalStorageWaitTime: 1s840ms - TotalThreadsInvoluntaryContextSwitches: 19 (19) - TotalThreadsTotalWallClockTime: 1s497ms - TotalThreadsSysTime: 1.000ms - TotalThreadsUserTime: 172.973ms - TotalThreadsVoluntaryContextSwitches: 39 (39) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 74.545ms - OpenTime: 1s126ms - ExecTreeOpenTime: 953.803ms - PrepareTime: 40.725ms - ExecTreePrepareTime: 505.611us DataStreamSender (dst_id=24):(Total: 406.053ms, non-child: 406.053ms, % non-child: 100.00%) - BytesSent: 26.43 MB (27716448) - NetworkThroughput(*): 101.90 MB/sec - OverallThroughput: 65.10 MB/sec - PeakMemoryUsage: 4.58 MB (4806400) - RowsReturned: 3.02M (3016704) - SerializeBatchTime: 145.830ms - TransmitDataRPCTime: 259.390ms - UncompressedRowBatchSize: 84.88 MB (88999408) CodeGen:(Total: 188.580ms, non-child: 188.580ms, % non-child: 100.00%) - CodegenTime: 895.911us - CompileTime: 50.607ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 120.111ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 17.493ms HASH_JOIN_NODE (id=8):(Total: 1s028ms, non-child: 64.655ms, % non-child: 6.29%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.426ms - PeakMemoryUsage: 1.11 MB (1162348) - ProbeRows: 3.02M (3017728) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 60.461ms - RowsReturned: 3.02M (3016704) - RowsReturnedRate: 2.93 M/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 22.108us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 151.129us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 77.609us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=19):(Total: 370.516ms, non-child: 18.125us, % non-child: 0.00%) BytesReceived(16s000ms): 963.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 3.909us - DeserializeRowBatchTimer: 15.335us - FirstBatchArrivalWaitTime: 350.604ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 323.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=6):(Total: 593.261ms, non-child: 593.261ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:22/5.18 GB 5:20/3.96 GB 3:21/4.86 GB 7:20/4.52 GB 6:20/4.43 GB 2:19/4.50 GB 1:23/5.47 GB 4:15/3.70 GB ExecOption: PARQUET Codegen Enabled Runtime filters: Only following filters arrived: 4, waited 442ms BytesRead(16s000ms): 26.55 MB, 29.28 MB, 29.28 MB, 29.28 MB, 29.28 MB, 29.28 MB, 29.28 MB, 29.28 MB, 29.28 MB, 29.28 MB, 29.28 MB, 29.28 MB, 29.28 MB, 29.28 MB, 29.28 MB, 29.28 MB, 29.28 MB, 29.28 MB, 29.28 MB, 29.28 MB, 29.28 MB, 29.28 MB, 29.28 MB, 29.28 MB, 29.28 MB, 29.28 MB, 29.28 MB, 29.28 MB, 29.28 MB, 29.28 MB, 29.28 MB, 29.28 MB, 29.28 MB, 29.28 MB, 29.28 MB, 29.28 MB, 29.28 MB, 29.28 MB, 29.28 MB - FooterProcessingTime: (Avg: 127.871ms ; Min: 81.173ms ; Max: 201.413ms ; Number of samples: 8) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 7.99 - BytesRead: 29.28 MB (30705224) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 19.857ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 0 (0) - NumRowGroups: 8 (8) - NumScannerThreadsStarted: 8 (8) - PeakMemoryUsage: 46.08 MB (48318923) - PerReadThreadRawHdfsThroughput: 49.99 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 3.14M (3138560) - RowsReturned: 3.02M (3017728) - RowsReturnedRate: 5.09 M/sec - ScanRangesComplete: 152 (152) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 585.738ms - TotalReadThroughput: 47.07 KB/sec Filter 2 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 3 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 4 (1.00 MB): - Files processed: 160 (160) - Files rejected: 152 (152) - Files total: 160 (160) - RowGroups processed: 3.06K (3065) - RowGroups rejected: 0 (0) - RowGroups total: 3.06K (3065) - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) - Splits processed: 8 (8) - Splits rejected: 0 (0) - Splits total: 8 (8) Instance 7f40dcb034de70b7:1a3 (host=vd1331.foo:22000):(Total: 1s166ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 2:12/2.96 GB 4:25/5.62 GB 6:20/4.93 GB 3:17/4.19 GB 5:19/4.22 GB 7:18/4.36 GB 0:24/5.71 GB 1:20/4.50 GB Filter 4 arrival: 441ms Filter 2 arrival: 6s833ms Filter 3 arrival: 9m23s MemoryUsage(16s000ms): 52.32 MB, 61.44 MB, 61.44 MB, 61.44 MB, 61.44 MB, 61.44 MB, 61.44 MB, 61.44 MB, 61.44 MB, 61.44 MB, 61.44 MB, 61.44 MB, 61.44 MB, 61.44 MB, 61.44 MB, 61.44 MB, 61.44 MB, 61.44 MB, 61.44 MB, 61.44 MB, 61.44 MB, 61.44 MB, 61.44 MB, 61.44 MB, 61.44 MB, 61.44 MB, 61.44 MB, 61.44 MB, 61.44 MB, 61.44 MB, 61.44 MB, 61.44 MB, 61.44 MB, 61.44 MB, 61.44 MB, 61.44 MB, 61.44 MB, 61.44 MB, 61.44 MB ThreadUsage(16s000ms): 12, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.98 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 61.44 MB (64423276) - PerHostPeakMemUsage: 169.56 GB (182068619987) - RowsProduced: 1.88M (1882112) - TotalNetworkReceiveTime: 159.123ms - TotalNetworkSendTime: 630.730us - TotalStorageWaitTime: 808.677ms - TotalThreadsInvoluntaryContextSwitches: 44 (44) - TotalThreadsTotalWallClockTime: 1s265ms - TotalThreadsSysTime: 6.998ms - TotalThreadsUserTime: 218.967ms - TotalThreadsVoluntaryContextSwitches: 56 (56) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 50.748ms - OpenTime: 1s104ms - ExecTreeOpenTime: 881.266ms - PrepareTime: 61.393ms - ExecTreePrepareTime: 600.840us DataStreamSender (dst_id=24):(Total: 261.682ms, non-child: 261.682ms, % non-child: 100.00%) - BytesSent: 16.22 MB (17009920) - NetworkThroughput(*): 99.83 MB/sec - OverallThroughput: 61.99 MB/sec - PeakMemoryUsage: 4.66 MB (4888320) - RowsReturned: 1.88M (1881088) - SerializeBatchTime: 97.963ms - TransmitDataRPCTime: 162.501ms - UncompressedRowBatchSize: 52.30 MB (54837568) CodeGen:(Total: 247.925ms, non-child: 247.925ms, % non-child: 100.00%) - CodegenTime: 1.261ms - CompileTime: 67.192ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 154.286ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 25.970ms HASH_JOIN_NODE (id=8):(Total: 932.607ms, non-child: 46.002ms, % non-child: 4.93%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 2.071ms - PeakMemoryUsage: 1.11 MB (1162424) - ProbeRows: 1.88M (1882112) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 41.175ms - RowsReturned: 1.88M (1881088) - RowsReturnedRate: 2.02 M/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 23.324us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 218.104us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 59.917us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=19):(Total: 159.147ms, non-child: 43.317us, % non-child: 0.03%) BytesReceived(16s000ms): 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 12.409us - DeserializeRowBatchTimer: 57.432us - FirstBatchArrivalWaitTime: 132.672ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 754.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=6):(Total: 727.678ms, non-child: 727.678ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:12/2.96 GB 4:25/5.62 GB 6:20/4.93 GB 3:17/4.19 GB 5:19/4.22 GB 7:18/4.36 GB 0:24/5.71 GB 1:20/4.50 GB ExecOption: PARQUET Codegen Enabled Runtime filters: Only following filters arrived: 4, waited 582ms BytesRead(16s000ms): 19.89 MB, 21.22 MB, 21.22 MB, 21.22 MB, 21.22 MB, 21.22 MB, 21.22 MB, 21.22 MB, 21.22 MB, 21.22 MB, 21.22 MB, 21.22 MB, 21.22 MB, 21.22 MB, 21.22 MB, 21.22 MB, 21.22 MB, 21.22 MB, 21.22 MB, 21.22 MB, 21.22 MB, 21.22 MB, 21.22 MB, 21.22 MB, 21.22 MB, 21.22 MB, 21.22 MB, 21.22 MB, 21.22 MB, 21.22 MB, 21.22 MB, 21.22 MB, 21.22 MB, 21.22 MB, 21.22 MB, 21.22 MB, 21.22 MB, 21.22 MB, 21.22 MB - FooterProcessingTime: (Avg: 74.886ms ; Min: 54.473ms ; Max: 99.381ms ; Number of samples: 5) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 11.98 - BytesRead: 21.22 MB (22251941) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 11.779ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 0 (0) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 39.31 MB (41215446) - PerReadThreadRawHdfsThroughput: 53.44 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 2.00M (1999872) - RowsReturned: 1.88M (1882112) - RowsReturnedRate: 2.59 M/sec - ScanRangesComplete: 150 (150) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 397.074ms - TotalReadThroughput: 34.19 KB/sec Filter 2 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 3 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 4 (1.00 MB): - Files processed: 155 (155) - Files rejected: 150 (150) - Files total: 155 (155) - RowGroups processed: 1.95K (1953) - RowGroups rejected: 0 (0) - RowGroups total: 1.95K (1953) - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) - Splits processed: 5 (5) - Splits rejected: 0 (0) - Splits total: 5 (5) Instance 7f40dcb034de70b7:1fa (host=va1035.foo:22000):(Total: 1s165ms, non-child: 25.195ms, % non-child: 2.16%) Hdfs split stats (:<# splits>/): 5:21/4.53 GB 3:22/4.96 GB 6:19/4.32 GB 2:21/5.18 GB 4:16/3.95 GB 1:23/5.47 GB 0:18/3.80 GB 7:17/4.12 GB Filter 4 arrival: 271ms Filter 2 arrival: 9s293ms Filter 3 arrival: 9m23s MemoryUsage(16s000ms): 48.00 MB, 61.02 MB, 61.02 MB, 61.02 MB, 61.02 MB, 61.02 MB, 61.02 MB, 61.02 MB, 61.02 MB, 61.02 MB, 61.02 MB, 61.02 MB, 61.02 MB, 61.02 MB, 61.02 MB, 61.02 MB, 61.02 MB, 61.02 MB, 61.02 MB, 61.02 MB, 61.02 MB, 61.02 MB, 61.02 MB, 61.02 MB, 61.02 MB, 61.02 MB, 61.02 MB, 61.02 MB, 61.02 MB, 61.02 MB, 61.02 MB, 61.02 MB, 61.02 MB, 61.02 MB, 61.02 MB, 61.02 MB, 61.02 MB, 61.02 MB, 61.02 MB, 61.02 MB ThreadUsage(16s000ms): 12, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.98 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 61.02 MB (63979385) - PerHostPeakMemUsage: 169.56 GB (182068743403) - RowsProduced: 116.74K (116736) - TotalNetworkReceiveTime: 2.916us - TotalNetworkSendTime: 26.459us - TotalStorageWaitTime: 992.271ms - TotalThreadsInvoluntaryContextSwitches: 23 (23) - TotalThreadsTotalWallClockTime: 1s081ms - TotalThreadsSysTime: 3.000ms - TotalThreadsUserTime: 190.971ms - TotalThreadsVoluntaryContextSwitches: 48 (48) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 4.735ms - OpenTime: 1s081ms - ExecTreeOpenTime: 887.442ms - PrepareTime: 83.901ms - ExecTreePrepareTime: 803.436us DataStreamSender (dst_id=24):(Total: 11.549ms, non-child: 11.549ms, % non-child: 100.00%) - BytesSent: 633.07 KB (648267) - NetworkThroughput(*): 129.57 MB/sec - OverallThroughput: 53.53 MB/sec - PeakMemoryUsage: 4.73 MB (4962048) - RowsReturned: 115.71K (115712) - SerializeBatchTime: 6.136ms - TransmitDataRPCTime: 4.771ms - UncompressedRowBatchSize: 2.02 MB (2121160) CodeGen:(Total: 235.200ms, non-child: 235.200ms, % non-child: 100.00%) - CodegenTime: 2.251ms - CompileTime: 60.544ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 131.392ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 42.212ms HASH_JOIN_NODE (id=8):(Total: 893.691ms, non-child: 5.338ms, % non-child: 0.60%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.084ms - PeakMemoryUsage: 1.11 MB (1161863) - ProbeRows: 116.74K (116736) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3.880ms - RowsReturned: 115.71K (115712) - RowsReturnedRate: 129.48 K/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 20.187us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 95.427us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 55.406us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=19):(Total: 13.535us, non-child: 13.535us, % non-child: 100.00%) BytesReceived(16s000ms): 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 6.388us - DeserializeRowBatchTimer: 17.283us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 8.87 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=6):(Total: 888.343ms, non-child: 888.343ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:21/4.53 GB 3:22/4.96 GB 6:19/4.32 GB 2:21/5.18 GB 4:16/3.95 GB 1:23/5.47 GB 0:18/3.80 GB 7:17/4.12 GB ExecOption: PARQUET Codegen Enabled Runtime filters: Only following filters arrived: 4, waited 763ms BytesRead(16s000ms): 19.48 MB, 21.48 MB, 21.48 MB, 21.48 MB, 21.48 MB, 21.48 MB, 21.48 MB, 21.48 MB, 21.48 MB, 21.48 MB, 21.48 MB, 21.48 MB, 21.48 MB, 21.48 MB, 21.48 MB, 21.48 MB, 21.48 MB, 21.48 MB, 21.48 MB, 21.48 MB, 21.48 MB, 21.48 MB, 21.48 MB, 21.48 MB, 21.48 MB, 21.48 MB, 21.48 MB, 21.48 MB, 21.48 MB, 21.48 MB, 21.48 MB, 21.48 MB, 21.48 MB, 21.48 MB, 21.48 MB, 21.48 MB, 21.48 MB, 21.48 MB, 21.48 MB, 21.48 MB - FooterProcessingTime: (Avg: 72.848ms ; Min: 52.669ms ; Max: 100.744ms ; Number of samples: 5) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 11.99 - BytesRead: 21.48 MB (22525719) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 1.507ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 0 (0) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 39.24 MB (41150202) - PerReadThreadRawHdfsThroughput: 48.94 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 234.50K (234496) - RowsReturned: 116.74K (116736) - RowsReturnedRate: 131.41 K/sec - ScanRangesComplete: 152 (152) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 438.982ms - TotalReadThroughput: 34.24 KB/sec Filter 2 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 3 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 4 (1.00 MB): - Files processed: 157 (157) - Files rejected: 152 (152) - Files total: 157 (157) - RowGroups processed: 229 (229) - RowGroups rejected: 0 (0) - RowGroups total: 229 (229) - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) - Splits processed: 5 (5) - Splits rejected: 0 (0) - Splits total: 5 (5) Instance 7f40dcb034de70b7:1a9 (host=vc1508.foo:22000):(Total: 1s165ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:20/4.67 GB 5:15/3.36 GB 3:24/5.70 GB 1:13/2.92 GB 2:23/5.67 GB 6:19/4.24 GB 7:24/5.47 GB 4:20/4.46 GB Filter 4 arrival: 417ms Filter 2 arrival: 6s937ms Filter 3 arrival: 9m23s MemoryUsage(16s000ms): 54.22 MB, 65.58 MB, 65.58 MB, 65.58 MB, 65.58 MB, 65.58 MB, 65.58 MB, 65.58 MB, 65.58 MB, 65.58 MB, 65.58 MB, 65.58 MB, 65.58 MB, 65.58 MB, 65.58 MB, 65.58 MB, 65.58 MB, 65.58 MB, 65.58 MB, 65.58 MB, 65.58 MB, 65.58 MB, 65.58 MB, 65.58 MB, 65.58 MB, 65.58 MB, 65.58 MB, 65.58 MB, 65.58 MB, 65.58 MB, 65.58 MB, 65.58 MB, 65.58 MB, 65.58 MB, 65.58 MB, 65.58 MB, 65.58 MB, 65.58 MB, 65.58 MB ThreadUsage(16s000ms): 12, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.99 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 65.58 MB (68762089) - PerHostPeakMemUsage: 169.57 GB (182072953359) - RowsProduced: 1.62M (1617920) - TotalNetworkReceiveTime: 186.621ms - TotalNetworkSendTime: 515.735us - TotalStorageWaitTime: 1s010ms - TotalThreadsInvoluntaryContextSwitches: 19 (19) - TotalThreadsTotalWallClockTime: 1s298ms - TotalThreadsSysTime: 2.000ms - TotalThreadsUserTime: 179.971ms - TotalThreadsVoluntaryContextSwitches: 41 (41) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 53.872ms - OpenTime: 1s110ms - ExecTreeOpenTime: 930.294ms - PrepareTime: 54.293ms - ExecTreePrepareTime: 612.824us DataStreamSender (dst_id=24):(Total: 237.532ms, non-child: 237.532ms, % non-child: 100.00%) - BytesSent: 13.92 MB (14599490) - NetworkThroughput(*): 94.77 MB/sec - OverallThroughput: 58.62 MB/sec - PeakMemoryUsage: 4.72 MB (4953856) - RowsReturned: 1.62M (1616896) - SerializeBatchTime: 89.763ms - TransmitDataRPCTime: 146.908ms - UncompressedRowBatchSize: 44.80 MB (46978112) CodeGen:(Total: 201.649ms, non-child: 201.649ms, % non-child: 100.00%) - CodegenTime: 1.063ms - CompileTime: 52.286ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 126.254ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 22.637ms HASH_JOIN_NODE (id=8):(Total: 984.784ms, non-child: 48.747ms, % non-child: 4.95%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.400ms - PeakMemoryUsage: 1.11 MB (1160401) - ProbeRows: 1.62M (1617920) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 45.182ms - RowsReturned: 1.62M (1616896) - RowsReturnedRate: 1.64 M/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 34.850us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 133.346us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 84.117us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=19):(Total: 186.630ms, non-child: 17.186us, % non-child: 0.01%) BytesReceived(16s000ms): 963.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 4.407us - DeserializeRowBatchTimer: 5.635us - FirstBatchArrivalWaitTime: 164.769ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 642.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=6):(Total: 749.490ms, non-child: 749.490ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:20/4.67 GB 5:15/3.36 GB 3:24/5.70 GB 1:13/2.92 GB 2:23/5.67 GB 6:19/4.24 GB 7:24/5.47 GB 4:20/4.46 GB ExecOption: PARQUET Codegen Enabled Runtime filters: Only following filters arrived: 4, waited 603ms BytesRead(16s000ms): 23.77 MB, 26.23 MB, 26.23 MB, 26.23 MB, 26.23 MB, 26.23 MB, 26.23 MB, 26.23 MB, 26.23 MB, 26.23 MB, 26.23 MB, 26.23 MB, 26.23 MB, 26.23 MB, 26.23 MB, 26.23 MB, 26.23 MB, 26.23 MB, 26.23 MB, 26.23 MB, 26.23 MB, 26.23 MB, 26.23 MB, 26.23 MB, 26.23 MB, 26.23 MB, 26.23 MB, 26.23 MB, 26.23 MB, 26.23 MB, 26.23 MB, 26.23 MB, 26.23 MB, 26.23 MB, 26.23 MB, 26.23 MB, 26.23 MB, 26.23 MB, 26.23 MB - FooterProcessingTime: (Avg: 70.008ms ; Min: 50.009ms ; Max: 90.596ms ; Number of samples: 6) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 12.00 - BytesRead: 26.23 MB (27504552) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 11.623ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 0 (0) - NumRowGroups: 6 (6) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 43.56 MB (45671788) - PerReadThreadRawHdfsThroughput: 45.60 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 1.74M (1736704) - RowsReturned: 1.62M (1617920) - RowsReturnedRate: 2.16 M/sec - ScanRangesComplete: 152 (152) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 575.167ms - TotalReadThroughput: 42.37 KB/sec Filter 2 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 3 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 4 (1.00 MB): - Files processed: 158 (158) - Files rejected: 152 (152) - Files total: 158 (158) - RowGroups processed: 1.70K (1696) - RowGroups rejected: 0 (0) - RowGroups total: 1.70K (1696) - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) - Splits processed: 6 (6) - Splits rejected: 0 (0) - Splits total: 6 (6) Instance 7f40dcb034de70b7:1ff (host=vd1120.foo:22000):(Total: 1s164ms, non-child: 29.560ms, % non-child: 2.54%) Hdfs split stats (:<# splits>/): 4:15/3.29 GB 6:16/3.93 GB 3:20/4.93 GB 1:19/4.44 GB 5:22/5.24 GB 2:24/5.54 GB 0:20/4.93 GB 7:18/4.30 GB Filter 4 arrival: 299ms Filter 2 arrival: 9s479ms Filter 3 arrival: 9m23s MemoryUsage(16s000ms): 42.29 MB, 54.89 MB, 54.89 MB, 54.89 MB, 54.89 MB, 54.89 MB, 54.89 MB, 54.89 MB, 54.89 MB, 54.89 MB, 54.89 MB, 54.89 MB, 54.89 MB, 54.89 MB, 54.89 MB, 54.89 MB, 54.89 MB, 54.89 MB, 54.89 MB, 54.89 MB, 54.89 MB, 54.89 MB, 54.89 MB, 54.89 MB, 54.89 MB, 54.89 MB, 54.89 MB, 54.89 MB, 54.89 MB, 54.89 MB, 54.89 MB, 54.89 MB, 54.89 MB, 54.89 MB, 54.89 MB, 54.89 MB, 54.89 MB, 54.89 MB, 54.89 MB ThreadUsage(16s000ms): 12, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.98 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 54.89 MB (57556592) - PerHostPeakMemUsage: 169.56 GB (182061714716) - RowsProduced: 124.93K (124928) - TotalNetworkReceiveTime: 5.690us - TotalNetworkSendTime: 30.269us - TotalStorageWaitTime: 715.653ms - TotalThreadsInvoluntaryContextSwitches: 28 (28) - TotalThreadsTotalWallClockTime: 1s081ms - TotalThreadsSysTime: 3.000ms - TotalThreadsUserTime: 223.965ms - TotalThreadsVoluntaryContextSwitches: 44 (44) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 5.300ms - OpenTime: 1s080ms - ExecTreeOpenTime: 855.222ms - PrepareTime: 84.072ms - ExecTreePrepareTime: 901.007us DataStreamSender (dst_id=24):(Total: 18.683ms, non-child: 18.683ms, % non-child: 100.00%) - BytesSent: 710.51 KB (727560) - NetworkThroughput(*): 104.67 MB/sec - OverallThroughput: 37.14 MB/sec - PeakMemoryUsage: 4.86 MB (5093120) - RowsReturned: 123.90K (123904) - SerializeBatchTime: 8.416ms - TransmitDataRPCTime: 6.628ms - UncompressedRowBatchSize: 2.28 MB (2389096) CodeGen:(Total: 254.036ms, non-child: 254.036ms, % non-child: 100.00%) - CodegenTime: 1.464ms - CompileTime: 72.166ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 151.055ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 30.218ms HASH_JOIN_NODE (id=8):(Total: 862.149ms, non-child: 6.280ms, % non-child: 0.73%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.439ms - PeakMemoryUsage: 1.10 MB (1157273) - ProbeRows: 124.93K (124928) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4.070ms - RowsReturned: 123.90K (123904) - RowsReturnedRate: 143.72 K/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 26.087us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 138.196us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 55.062us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=19):(Total: 27.526us, non-child: 27.526us, % non-child: 100.00%) BytesReceived(16s000ms): 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 5.052us - DeserializeRowBatchTimer: 9.518us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 4.36 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=6):(Total: 855.879ms, non-child: 855.879ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:15/3.29 GB 6:16/3.93 GB 3:20/4.93 GB 1:19/4.44 GB 5:22/5.24 GB 2:24/5.54 GB 0:20/4.93 GB 7:18/4.30 GB ExecOption: PARQUET Codegen Enabled Runtime filters: Only following filters arrived: 4, waited 723ms BytesRead(16s000ms): 16.54 MB, 18.24 MB, 18.24 MB, 18.24 MB, 18.24 MB, 18.24 MB, 18.24 MB, 18.24 MB, 18.24 MB, 18.24 MB, 18.24 MB, 18.24 MB, 18.24 MB, 18.24 MB, 18.24 MB, 18.24 MB, 18.24 MB, 18.24 MB, 18.24 MB, 18.24 MB, 18.24 MB, 18.24 MB, 18.24 MB, 18.24 MB, 18.24 MB, 18.24 MB, 18.24 MB, 18.24 MB, 18.24 MB, 18.24 MB, 18.24 MB, 18.24 MB, 18.24 MB, 18.24 MB, 18.24 MB, 18.24 MB, 18.24 MB, 18.24 MB, 18.24 MB - FooterProcessingTime: (Avg: 64.379ms ; Min: 48.944ms ; Max: 83.009ms ; Number of samples: 5) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 11.99 - BytesRead: 18.24 MB (19130871) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 1.390ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 0 (0) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 33.19 MB (34799068) - PerReadThreadRawHdfsThroughput: 38.87 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 242.69K (242688) - RowsReturned: 124.93K (124928) - RowsReturnedRate: 145.96 K/sec - ScanRangesComplete: 149 (149) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 469.396ms - TotalReadThroughput: 29.42 KB/sec Filter 2 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 3 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 4 (1.00 MB): - Files processed: 154 (154) - Files rejected: 149 (149) - Files total: 154 (154) - RowGroups processed: 237 (237) - RowGroups rejected: 0 (0) - RowGroups total: 237 (237) - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) - Splits processed: 5 (5) - Splits rejected: 0 (0) - Splits total: 5 (5) Instance 7f40dcb034de70b7:1b5 (host=vc1526.foo:22000):(Total: 1s163ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:27/6.47 GB 1:20/4.45 GB 4:20/4.77 GB 7:20/4.38 GB 3:20/4.82 GB 6:18/4.24 GB 2:17/3.91 GB 5:15/3.56 GB Filter 4 arrival: 350ms Filter 2 arrival: 7s064ms Filter 3 arrival: 9m23s MemoryUsage(16s000ms): 44.31 MB, 53.65 MB, 53.65 MB, 53.65 MB, 53.65 MB, 53.65 MB, 53.65 MB, 53.65 MB, 53.65 MB, 53.65 MB, 53.65 MB, 53.65 MB, 53.65 MB, 53.65 MB, 53.65 MB, 53.65 MB, 53.65 MB, 53.65 MB, 53.65 MB, 53.65 MB, 53.65 MB, 53.65 MB, 53.65 MB, 53.65 MB, 53.65 MB, 53.65 MB, 53.65 MB, 53.65 MB, 53.65 MB, 53.65 MB, 53.65 MB, 53.65 MB, 53.65 MB, 53.65 MB, 53.65 MB, 53.65 MB, 53.65 MB, 53.65 MB, 53.65 MB, 53.65 MB ThreadUsage(16s000ms): 12, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.99 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 53.65 MB (56257332) - PerHostPeakMemUsage: 169.56 GB (182060487844) - RowsProduced: 1.50M (1503232) - TotalNetworkReceiveTime: 91.684ms - TotalNetworkSendTime: 546.693us - TotalStorageWaitTime: 1s180ms - TotalThreadsInvoluntaryContextSwitches: 39 (39) - TotalThreadsTotalWallClockTime: 1s206ms - TotalThreadsSysTime: 1.999ms - TotalThreadsUserTime: 212.968ms - TotalThreadsVoluntaryContextSwitches: 55 (55) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 43.545ms - OpenTime: 1s113ms - ExecTreeOpenTime: 900.660ms - PrepareTime: 50.002ms - ExecTreePrepareTime: 557.914us DataStreamSender (dst_id=24):(Total: 212.905ms, non-child: 212.905ms, % non-child: 100.00%) - BytesSent: 12.70 MB (13315087) - NetworkThroughput(*): 95.65 MB/sec - OverallThroughput: 59.64 MB/sec - PeakMemoryUsage: 4.49 MB (4708096) - RowsReturned: 1.50M (1502208) - SerializeBatchTime: 80.036ms - TransmitDataRPCTime: 132.756ms - UncompressedRowBatchSize: 41.48 MB (43494944) CodeGen:(Total: 228.988ms, non-child: 228.988ms, % non-child: 100.00%) - CodegenTime: 1.356ms - CompileTime: 57.787ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 153.260ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 17.451ms HASH_JOIN_NODE (id=8):(Total: 944.781ms, non-child: 38.675ms, % non-child: 4.09%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.100ms - PeakMemoryUsage: 1.11 MB (1159219) - ProbeRows: 1.50M (1503232) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 35.269ms - RowsReturned: 1.50M (1502208) - RowsReturnedRate: 1.59 M/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 36.324us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 190.610us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 26.335us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=19):(Total: 91.690ms, non-child: 11.621us, % non-child: 0.01%) BytesReceived(16s000ms): 963.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 2.744us - DeserializeRowBatchTimer: 17.684us - FirstBatchArrivalWaitTime: 90.462ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 1.31 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=6):(Total: 814.525ms, non-child: 814.525ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:27/6.47 GB 1:20/4.45 GB 4:20/4.77 GB 7:20/4.38 GB 3:20/4.82 GB 6:18/4.24 GB 2:17/3.91 GB 5:15/3.56 GB ExecOption: PARQUET Codegen Enabled Runtime filters: Only following filters arrived: 4, waited 683ms BytesRead(16s000ms): 22.60 MB, 24.52 MB, 24.52 MB, 24.52 MB, 24.52 MB, 24.52 MB, 24.52 MB, 24.52 MB, 24.52 MB, 24.52 MB, 24.52 MB, 24.52 MB, 24.52 MB, 24.52 MB, 24.52 MB, 24.52 MB, 24.52 MB, 24.52 MB, 24.52 MB, 24.52 MB, 24.52 MB, 24.52 MB, 24.52 MB, 24.52 MB, 24.52 MB, 24.52 MB, 24.52 MB, 24.52 MB, 24.52 MB, 24.52 MB, 24.52 MB, 24.52 MB, 24.52 MB, 24.52 MB, 24.52 MB, 24.52 MB, 24.52 MB, 24.52 MB, 24.52 MB, 24.52 MB - FooterProcessingTime: (Avg: 59.496ms ; Min: 43.314ms ; Max: 92.961ms ; Number of samples: 6) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 12.00 - BytesRead: 24.52 MB (25713610) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 9.153ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 0 (0) - NumRowGroups: 6 (6) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 31.53 MB (33064553) - PerReadThreadRawHdfsThroughput: 50.18 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 1.62M (1622016) - RowsReturned: 1.50M (1503232) - RowsReturnedRate: 1.85 M/sec - ScanRangesComplete: 151 (151) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 488.669ms - TotalReadThroughput: 39.24 KB/sec Filter 2 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 3 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 4 (1.00 MB): - Files processed: 157 (157) - Files rejected: 151 (151) - Files total: 157 (157) - RowGroups processed: 1.58K (1584) - RowGroups rejected: 0 (0) - RowGroups total: 1.58K (1584) - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) - Splits processed: 6 (6) - Splits rejected: 0 (0) - Splits total: 6 (6) Instance 7f40dcb034de70b7:1c6 (host=vc1504.foo:22000):(Total: 1s163ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 7:24/5.28 GB 0:13/2.92 GB 5:16/3.77 GB 3:20/4.82 GB 2:20/4.70 GB 6:19/4.68 GB 4:18/4.24 GB 1:24/5.92 GB Filter 4 arrival: 297ms Filter 2 arrival: 7s318ms Filter 3 arrival: 9m23s MemoryUsage(16s000ms): 35.71 MB, 44.99 MB, 44.99 MB, 44.99 MB, 44.99 MB, 44.99 MB, 44.99 MB, 44.99 MB, 44.99 MB, 44.99 MB, 44.99 MB, 44.99 MB, 44.99 MB, 44.99 MB, 44.99 MB, 44.99 MB, 44.99 MB, 44.99 MB, 44.99 MB, 44.99 MB, 44.99 MB, 44.99 MB, 44.99 MB, 44.99 MB, 44.99 MB, 44.99 MB, 44.99 MB, 44.99 MB, 44.99 MB, 44.99 MB, 44.99 MB, 44.99 MB, 44.99 MB, 44.99 MB, 44.99 MB, 44.99 MB, 44.99 MB, 44.99 MB, 44.99 MB ThreadUsage(16s000ms): 12, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.99 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 44.99 MB (47179429) - PerHostPeakMemUsage: 169.55 GB (182051120599) - RowsProduced: 924.67K (924672) - TotalNetworkReceiveTime: 65.703ms - TotalNetworkSendTime: 8.578ms - TotalStorageWaitTime: 1s054ms - TotalThreadsInvoluntaryContextSwitches: 25 (25) - TotalThreadsTotalWallClockTime: 1s176ms - TotalThreadsSysTime: 1.000ms - TotalThreadsUserTime: 179.971ms - TotalThreadsVoluntaryContextSwitches: 62 (62) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 28.315ms - OpenTime: 1s108ms - ExecTreeOpenTime: 928.683ms - PrepareTime: 54.848ms - ExecTreePrepareTime: 471.887us DataStreamSender (dst_id=24):(Total: 143.259ms, non-child: 143.259ms, % non-child: 100.00%) - BytesSent: 7.62 MB (7988640) - NetworkThroughput(*): 94.69 MB/sec - OverallThroughput: 53.18 MB/sec - PeakMemoryUsage: 4.76 MB (4994816) - RowsReturned: 923.65K (923648) - SerializeBatchTime: 61.762ms - TransmitDataRPCTime: 80.456ms - UncompressedRowBatchSize: 25.06 MB (26280056) CodeGen:(Total: 200.859ms, non-child: 200.859ms, % non-child: 100.00%) - CodegenTime: 937.978us - CompileTime: 56.270ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 122.375ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 21.778ms HASH_JOIN_NODE (id=8):(Total: 957.544ms, non-child: 26.602ms, % non-child: 2.78%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.682ms - PeakMemoryUsage: 1.10 MB (1153530) - ProbeRows: 924.67K (924672) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 23.098ms - RowsReturned: 923.65K (923648) - RowsReturnedRate: 964.60 K/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 25.362us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 145.618us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 65.535us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=19):(Total: 65.719ms, non-child: 24.909us, % non-child: 0.04%) BytesReceived(16s000ms): 963.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 8.446us - DeserializeRowBatchTimer: 20.176us - FirstBatchArrivalWaitTime: 54.505ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 1.82 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=6):(Total: 865.326ms, non-child: 865.326ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:24/5.28 GB 0:13/2.92 GB 5:16/3.77 GB 3:20/4.82 GB 2:20/4.70 GB 6:19/4.68 GB 4:18/4.24 GB 1:24/5.92 GB ExecOption: PARQUET Codegen Enabled Runtime filters: Only following filters arrived: 4, waited 723ms BytesRead(16s000ms): 17.34 MB, 18.72 MB, 18.72 MB, 18.72 MB, 18.72 MB, 18.72 MB, 18.72 MB, 18.72 MB, 18.72 MB, 18.72 MB, 18.72 MB, 18.72 MB, 18.72 MB, 18.72 MB, 18.72 MB, 18.72 MB, 18.72 MB, 18.72 MB, 18.72 MB, 18.72 MB, 18.72 MB, 18.72 MB, 18.72 MB, 18.72 MB, 18.72 MB, 18.72 MB, 18.72 MB, 18.72 MB, 18.72 MB, 18.72 MB, 18.72 MB, 18.72 MB, 18.72 MB, 18.72 MB, 18.72 MB, 18.72 MB, 18.72 MB, 18.72 MB, 18.72 MB - FooterProcessingTime: (Avg: 83.651ms ; Min: 55.353ms ; Max: 136.502ms ; Number of samples: 5) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 11.99 - BytesRead: 18.72 MB (19634108) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 5.624ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 0 (0) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 23.11 MB (24227366) - PerReadThreadRawHdfsThroughput: 39.90 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 1.04M (1042432) - RowsReturned: 924.67K (924672) - RowsReturnedRate: 1.07 M/sec - ScanRangesComplete: 149 (149) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 469.275ms - TotalReadThroughput: 30.17 KB/sec Filter 2 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 3 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 4 (1.00 MB): - Files processed: 154 (154) - Files rejected: 149 (149) - Files total: 154 (154) - RowGroups processed: 1.02K (1018) - RowGroups rejected: 0 (0) - RowGroups total: 1.02K (1018) - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) - Splits processed: 5 (5) - Splits rejected: 0 (0) - Splits total: 5 (5) Instance 7f40dcb034de70b7:1ab (host=vd1136.foo:22000):(Total: 1s163ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 2:11/2.71 GB 5:22/5.42 GB 6:16/3.36 GB 0:25/6.07 GB 3:26/6.09 GB 7:17/3.65 GB 1:14/3.43 GB 4:27/6.01 GB Filter 4 arrival: 369ms Filter 2 arrival: 6s922ms Filter 3 arrival: 9m23s MemoryUsage(16s000ms): 51.57 MB, 61.45 MB, 61.45 MB, 61.45 MB, 61.45 MB, 61.45 MB, 61.45 MB, 61.45 MB, 61.45 MB, 61.45 MB, 61.45 MB, 61.45 MB, 61.45 MB, 61.45 MB, 61.45 MB, 61.45 MB, 61.45 MB, 61.45 MB, 61.45 MB, 61.45 MB, 61.45 MB, 61.45 MB, 61.45 MB, 61.45 MB, 61.45 MB, 61.45 MB, 61.45 MB, 61.45 MB, 61.45 MB, 61.45 MB, 61.45 MB, 61.45 MB, 61.45 MB, 61.45 MB, 61.45 MB, 61.45 MB, 61.45 MB, 61.45 MB, 61.45 MB ThreadUsage(16s000ms): 12, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.99 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 61.45 MB (64436218) - PerHostPeakMemUsage: 169.56 GB (182067266632) - RowsProduced: 1.26M (1258496) - TotalNetworkReceiveTime: 51.243ms - TotalNetworkSendTime: 466.193us - TotalStorageWaitTime: 926.635ms - TotalThreadsInvoluntaryContextSwitches: 35 (35) - TotalThreadsTotalWallClockTime: 1s138ms - TotalThreadsSysTime: 3.000ms - TotalThreadsUserTime: 244.962ms - TotalThreadsVoluntaryContextSwitches: 69 (69) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 44.177ms - OpenTime: 1s086ms - ExecTreeOpenTime: 838.784ms - PrepareTime: 77.467ms - ExecTreePrepareTime: 711.907us DataStreamSender (dst_id=24):(Total: 212.248ms, non-child: 212.248ms, % non-child: 100.00%) - BytesSent: 10.66 MB (11177674) - NetworkThroughput(*): 82.69 MB/sec - OverallThroughput: 50.22 MB/sec - PeakMemoryUsage: 4.69 MB (4912896) - RowsReturned: 1.26M (1257472) - SerializeBatchTime: 83.091ms - TransmitDataRPCTime: 128.914ms - UncompressedRowBatchSize: 34.52 MB (36193688) CodeGen:(Total: 272.873ms, non-child: 272.873ms, % non-child: 100.00%) - CodegenTime: 1.296ms - CompileTime: 66.950ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 178.441ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 26.843ms HASH_JOIN_NODE (id=8):(Total: 883.728ms, non-child: 38.634ms, % non-child: 4.37%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 979.521us - PeakMemoryUsage: 1.11 MB (1161020) - ProbeRows: 1.26M (1258496) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 35.550ms - RowsReturned: 1.26M (1257472) - RowsReturnedRate: 1.42 M/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 15.366us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 115.124us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 57.465us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=19):(Total: 51.250ms, non-child: 12.577us, % non-child: 0.02%) BytesReceived(16s000ms): 963.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 3.044us - DeserializeRowBatchTimer: 30.260us - FirstBatchArrivalWaitTime: 50.804ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 2.34 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=6):(Total: 793.988ms, non-child: 793.988ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:11/2.71 GB 5:22/5.42 GB 6:16/3.36 GB 0:25/6.07 GB 3:26/6.09 GB 7:17/3.65 GB 1:14/3.43 GB 4:27/6.01 GB ExecOption: PARQUET Codegen Enabled Runtime filters: Only following filters arrived: 4, waited 663ms BytesRead(16s000ms): 23.11 MB, 25.09 MB, 25.09 MB, 25.09 MB, 25.09 MB, 25.09 MB, 25.09 MB, 25.09 MB, 25.09 MB, 25.09 MB, 25.09 MB, 25.09 MB, 25.09 MB, 25.09 MB, 25.09 MB, 25.09 MB, 25.09 MB, 25.09 MB, 25.09 MB, 25.09 MB, 25.09 MB, 25.09 MB, 25.09 MB, 25.09 MB, 25.09 MB, 25.09 MB, 25.09 MB, 25.09 MB, 25.09 MB, 25.09 MB, 25.09 MB, 25.09 MB, 25.09 MB, 25.09 MB, 25.09 MB, 25.09 MB, 25.09 MB, 25.09 MB, 25.09 MB - FooterProcessingTime: (Avg: 62.743ms ; Min: 46.797ms ; Max: 93.892ms ; Number of samples: 6) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 12.00 - BytesRead: 25.09 MB (26307377) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 10.232ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 0 (0) - NumRowGroups: 6 (6) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 39.54 MB (41465341) - PerReadThreadRawHdfsThroughput: 60.61 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 1.38M (1377280) - RowsReturned: 1.26M (1258496) - RowsReturnedRate: 1.59 M/sec - ScanRangesComplete: 152 (152) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 413.941ms - TotalReadThroughput: 40.52 KB/sec Filter 2 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 3 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 4 (1.00 MB): - Files processed: 158 (158) - Files rejected: 152 (152) - Files total: 158 (158) - RowGroups processed: 1.34K (1345) - RowGroups rejected: 0 (0) - RowGroups total: 1.34K (1345) - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) - Splits processed: 6 (6) - Splits rejected: 0 (0) - Splits total: 6 (6) Instance 7f40dcb034de70b7:1d9 (host=vc1539.foo:22000):(Total: 1s163ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 3:17/4.01 GB 6:18/4.04 GB 0:20/4.73 GB 4:20/4.92 GB 7:23/5.62 GB 2:17/4.07 GB 5:16/3.56 GB 1:21/5.18 GB Filter 4 arrival: 282ms Filter 2 arrival: 7s575ms Filter 3 arrival: 9m23s MemoryUsage(16s000ms): 53.81 MB, 65.63 MB, 65.63 MB, 65.63 MB, 65.63 MB, 65.63 MB, 65.63 MB, 65.63 MB, 65.63 MB, 65.63 MB, 65.63 MB, 65.63 MB, 65.63 MB, 65.63 MB, 65.63 MB, 65.63 MB, 65.63 MB, 65.63 MB, 65.63 MB, 65.63 MB, 65.63 MB, 65.63 MB, 65.63 MB, 65.63 MB, 65.63 MB, 65.63 MB, 65.63 MB, 65.63 MB, 65.63 MB, 65.63 MB, 65.63 MB, 65.63 MB, 65.63 MB, 65.63 MB, 65.63 MB, 65.63 MB, 65.63 MB, 65.63 MB, 65.63 MB ThreadUsage(16s000ms): 12, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.98 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 65.63 MB (68814881) - PerHostPeakMemUsage: 169.57 GB (182073034609) - RowsProduced: 678.91K (678912) - TotalNetworkReceiveTime: 3.907us - TotalNetworkSendTime: 201.247us - TotalStorageWaitTime: 1s432ms - TotalThreadsInvoluntaryContextSwitches: 38 (38) - TotalThreadsTotalWallClockTime: 1s096ms - TotalThreadsSysTime: 1.000ms - TotalThreadsUserTime: 221.965ms - TotalThreadsVoluntaryContextSwitches: 76 (76) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 17.505ms - OpenTime: 1s094ms - ExecTreeOpenTime: 871.763ms - PrepareTime: 68.806ms - ExecTreePrepareTime: 1.089ms DataStreamSender (dst_id=24):(Total: 95.470ms, non-child: 95.470ms, % non-child: 100.00%) - BytesSent: 5.65 MB (5926129) - NetworkThroughput(*): 98.44 MB/sec - OverallThroughput: 59.20 MB/sec - PeakMemoryUsage: 4.73 MB (4962048) - RowsReturned: 677.89K (677888) - SerializeBatchTime: 37.554ms - TransmitDataRPCTime: 57.412ms - UncompressedRowBatchSize: 18.01 MB (18889488) CodeGen:(Total: 241.681ms, non-child: 241.681ms, % non-child: 100.00%) - CodegenTime: 1.241ms - CompileTime: 72.843ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 148.221ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 20.042ms HASH_JOIN_NODE (id=8):(Total: 891.101ms, non-child: 15.865ms, % non-child: 1.78%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.539ms - PeakMemoryUsage: 1.11 MB (1162561) - ProbeRows: 678.91K (678912) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 13.337ms - RowsReturned: 677.89K (677888) - RowsReturnedRate: 760.73 K/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 21.529us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 154.662us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 44.522us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=19):(Total: 13.077us, non-child: 13.077us, % non-child: 100.00%) BytesReceived(16s000ms): 963.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 4.453us - DeserializeRowBatchTimer: 9.218us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 9.18 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=6):(Total: 875.229ms, non-child: 875.229ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:17/4.01 GB 6:18/4.04 GB 0:20/4.73 GB 4:20/4.92 GB 7:23/5.62 GB 2:17/4.07 GB 5:16/3.56 GB 1:21/5.18 GB ExecOption: PARQUET Codegen Enabled Runtime filters: Only following filters arrived: 4, waited 743ms BytesRead(16s000ms): 26.44 MB, 29.18 MB, 29.18 MB, 29.18 MB, 29.18 MB, 29.18 MB, 29.18 MB, 29.18 MB, 29.18 MB, 29.18 MB, 29.18 MB, 29.18 MB, 29.18 MB, 29.18 MB, 29.18 MB, 29.18 MB, 29.18 MB, 29.18 MB, 29.18 MB, 29.18 MB, 29.18 MB, 29.18 MB, 29.18 MB, 29.18 MB, 29.18 MB, 29.18 MB, 29.18 MB, 29.18 MB, 29.18 MB, 29.18 MB, 29.18 MB, 29.18 MB, 29.18 MB, 29.18 MB, 29.18 MB, 29.18 MB, 29.18 MB, 29.18 MB, 29.18 MB - FooterProcessingTime: (Avg: 81.146ms ; Min: 53.922ms ; Max: 137.848ms ; Number of samples: 7) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 11.99 - BytesRead: 29.18 MB (30596362) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 5.213ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 0 (0) - NumRowGroups: 7 (7) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 43.69 MB (45813666) - PerReadThreadRawHdfsThroughput: 40.80 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 798.72K (798720) - RowsReturned: 678.91K (678912) - RowsReturnedRate: 775.70 K/sec - ScanRangesComplete: 145 (145) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 715.186ms - TotalReadThroughput: 46.94 KB/sec Filter 2 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 3 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 4 (1.00 MB): - Files processed: 152 (152) - Files rejected: 145 (145) - Files total: 152 (152) - RowGroups processed: 780 (780) - RowGroups rejected: 0 (0) - RowGroups total: 780 (780) - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) - Splits processed: 7 (7) - Splits rejected: 0 (0) - Splits total: 7 (7) Instance 7f40dcb034de70b7:1ba (host=vd1132.foo:22000):(Total: 1s163ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 7:13/2.97 GB 2:16/3.51 GB 5:25/5.77 GB 4:25/5.75 GB 0:16/3.62 GB 6:26/6.15 GB 1:20/4.45 GB 3:20/4.55 GB Filter 4 arrival: 348ms Filter 2 arrival: 7s202ms Filter 3 arrival: 9m23s MemoryUsage(16s000ms): 55.56 MB, 66.85 MB, 66.85 MB, 66.85 MB, 66.85 MB, 66.85 MB, 66.85 MB, 66.85 MB, 66.85 MB, 66.85 MB, 66.85 MB, 66.85 MB, 66.85 MB, 66.85 MB, 66.85 MB, 66.85 MB, 66.85 MB, 66.85 MB, 66.85 MB, 66.85 MB, 66.85 MB, 66.85 MB, 66.85 MB, 66.85 MB, 66.85 MB, 66.85 MB, 66.85 MB, 66.85 MB, 66.85 MB, 66.85 MB, 66.85 MB, 66.85 MB, 66.85 MB, 66.85 MB, 66.85 MB, 66.85 MB, 66.85 MB, 66.85 MB, 66.85 MB ThreadUsage(16s000ms): 12, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.98 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 66.85 MB (70093010) - PerHostPeakMemUsage: 169.57 GB (182074885619) - RowsProduced: 1.32M (1317888) - TotalNetworkReceiveTime: 83.469ms - TotalNetworkSendTime: 488.050us - TotalStorageWaitTime: 1s333ms - TotalThreadsInvoluntaryContextSwitches: 27 (27) - TotalThreadsTotalWallClockTime: 1s188ms - TotalThreadsSysTime: 1.999ms - TotalThreadsUserTime: 206.969ms - TotalThreadsVoluntaryContextSwitches: 65 (65) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 39.468ms - OpenTime: 1s103ms - ExecTreeOpenTime: 894.714ms - PrepareTime: 59.740ms - ExecTreePrepareTime: 656.295us DataStreamSender (dst_id=24):(Total: 190.209ms, non-child: 190.209ms, % non-child: 100.00%) - BytesSent: 11.32 MB (11872696) - NetworkThroughput(*): 95.81 MB/sec - OverallThroughput: 59.53 MB/sec - PeakMemoryUsage: 4.74 MB (4970240) - RowsReturned: 1.32M (1316864) - SerializeBatchTime: 70.951ms - TransmitDataRPCTime: 118.184ms - UncompressedRowBatchSize: 36.22 MB (37979928) CodeGen:(Total: 234.691ms, non-child: 234.691ms, % non-child: 100.00%) - CodegenTime: 1.357ms - CompileTime: 55.440ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 151.462ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 27.333ms HASH_JOIN_NODE (id=8):(Total: 934.996ms, non-child: 35.754ms, % non-child: 3.82%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.341ms - PeakMemoryUsage: 1.11 MB (1162473) - ProbeRows: 1.32M (1317888) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 32.671ms - RowsReturned: 1.32M (1316864) - RowsReturnedRate: 1.41 M/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 22.452us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 156.051us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 63.339us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=19):(Total: 83.478ms, non-child: 16.081us, % non-child: 0.02%) BytesReceived(16s000ms): 963.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 4.373us - DeserializeRowBatchTimer: 11.741us - FirstBatchArrivalWaitTime: 59.219ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 1.44 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=6):(Total: 816.161ms, non-child: 816.161ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:13/2.97 GB 2:16/3.51 GB 5:25/5.77 GB 4:25/5.75 GB 0:16/3.62 GB 6:26/6.15 GB 1:20/4.45 GB 3:20/4.55 GB ExecOption: PARQUET Codegen Enabled Runtime filters: Only following filters arrived: 4, waited 683ms BytesRead(16s000ms): 24.42 MB, 26.92 MB, 26.92 MB, 26.92 MB, 26.92 MB, 26.92 MB, 26.92 MB, 26.92 MB, 26.92 MB, 26.92 MB, 26.92 MB, 26.92 MB, 26.92 MB, 26.92 MB, 26.92 MB, 26.92 MB, 26.92 MB, 26.92 MB, 26.92 MB, 26.92 MB, 26.92 MB, 26.92 MB, 26.92 MB, 26.92 MB, 26.92 MB, 26.92 MB, 26.92 MB, 26.92 MB, 26.92 MB, 26.92 MB, 26.92 MB, 26.92 MB, 26.92 MB, 26.92 MB, 26.92 MB, 26.92 MB, 26.92 MB, 26.92 MB, 26.92 MB - FooterProcessingTime: (Avg: 75.708ms ; Min: 48.557ms ; Max: 125.376ms ; Number of samples: 7) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 11.99 - BytesRead: 26.92 MB (28229625) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 6.559ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 0 (0) - NumRowGroups: 7 (7) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 44.69 MB (46862419) - PerReadThreadRawHdfsThroughput: 38.82 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 1.44M (1437696) - RowsReturned: 1.32M (1317888) - RowsReturnedRate: 1.61 M/sec - ScanRangesComplete: 154 (154) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 693.498ms - TotalReadThroughput: 43.14 KB/sec Filter 2 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 3 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 4 (1.00 MB): - Files processed: 161 (161) - Files rejected: 154 (154) - Files total: 161 (161) - RowGroups processed: 1.40K (1404) - RowGroups rejected: 0 (0) - RowGroups total: 1.40K (1404) - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) - Splits processed: 7 (7) - Splits rejected: 0 (0) - Splits total: 7 (7) Instance 7f40dcb034de70b7:1af (host=vc1514.foo:22000):(Total: 1s162ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 7:16/3.66 GB 1:18/4.29 GB 4:25/5.86 GB 0:17/4.10 GB 3:19/4.29 GB 2:18/4.10 GB 6:24/5.84 GB 5:19/4.56 GB Filter 4 arrival: 374ms Filter 2 arrival: 6s984ms Filter 3 arrival: 9m23s MemoryUsage(16s000ms): 42.80 MB, 52.93 MB, 52.93 MB, 52.93 MB, 52.93 MB, 52.93 MB, 52.93 MB, 52.93 MB, 52.93 MB, 52.93 MB, 52.93 MB, 52.93 MB, 52.93 MB, 52.93 MB, 52.93 MB, 52.93 MB, 52.93 MB, 52.93 MB, 52.93 MB, 52.93 MB, 52.93 MB, 52.93 MB, 52.93 MB, 52.93 MB, 52.93 MB, 52.93 MB, 52.93 MB, 52.93 MB, 52.93 MB, 52.93 MB, 52.93 MB, 52.93 MB, 52.93 MB, 52.93 MB, 52.93 MB, 52.93 MB, 52.93 MB, 52.93 MB, 52.93 MB ThreadUsage(16s000ms): 12, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.99 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 52.93 MB (55502155) - PerHostPeakMemUsage: 169.56 GB (182059706145) - RowsProduced: 1.46M (1459200) - TotalNetworkReceiveTime: 155.157ms - TotalNetworkSendTime: 494.783us - TotalStorageWaitTime: 679.698ms - TotalThreadsInvoluntaryContextSwitches: 18 (18) - TotalThreadsTotalWallClockTime: 1s270ms - TotalThreadsSysTime: 2.999ms - TotalThreadsUserTime: 172.973ms - TotalThreadsVoluntaryContextSwitches: 42 (42) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 47.724ms - OpenTime: 1s113ms - ExecTreeOpenTime: 939.873ms - PrepareTime: 48.907ms - ExecTreePrepareTime: 513.325us DataStreamSender (dst_id=24):(Total: 217.651ms, non-child: 217.651ms, % non-child: 100.00%) - BytesSent: 12.39 MB (12994994) - NetworkThroughput(*): 91.59 MB/sec - OverallThroughput: 56.94 MB/sec - PeakMemoryUsage: 4.59 MB (4814592) - RowsReturned: 1.46M (1458176) - SerializeBatchTime: 81.399ms - TransmitDataRPCTime: 135.308ms - UncompressedRowBatchSize: 40.27 MB (42222248) CodeGen:(Total: 193.787ms, non-child: 193.787ms, % non-child: 100.00%) - CodegenTime: 928.793us - CompileTime: 51.908ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 120.576ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 20.891ms HASH_JOIN_NODE (id=8):(Total: 988.059ms, non-child: 43.553ms, % non-child: 4.41%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.435ms - PeakMemoryUsage: 1.11 MB (1162473) - ProbeRows: 1.46M (1459200) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 40.077ms - RowsReturned: 1.46M (1458176) - RowsReturnedRate: 1.48 M/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 24.086us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 123.298us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 50.646us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=19):(Total: 155.166ms, non-child: 17.313us, % non-child: 0.01%) BytesReceived(16s000ms): 963.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 4.109us - DeserializeRowBatchTimer: 31.526us - FirstBatchArrivalWaitTime: 148.394ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 773.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=6):(Total: 789.428ms, non-child: 789.428ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:16/3.66 GB 1:18/4.29 GB 4:25/5.86 GB 0:17/4.10 GB 3:19/4.29 GB 2:18/4.10 GB 6:24/5.84 GB 5:19/4.56 GB ExecOption: PARQUET Codegen Enabled Runtime filters: Only following filters arrived: 4, waited 663ms BytesRead(16s000ms): 15.77 MB, 17.40 MB, 17.40 MB, 17.40 MB, 17.40 MB, 17.40 MB, 17.40 MB, 17.40 MB, 17.40 MB, 17.40 MB, 17.40 MB, 17.40 MB, 17.40 MB, 17.40 MB, 17.40 MB, 17.40 MB, 17.40 MB, 17.40 MB, 17.40 MB, 17.40 MB, 17.40 MB, 17.40 MB, 17.40 MB, 17.40 MB, 17.40 MB, 17.40 MB, 17.40 MB, 17.40 MB, 17.40 MB, 17.40 MB, 17.40 MB, 17.40 MB, 17.40 MB, 17.40 MB, 17.40 MB, 17.40 MB, 17.40 MB, 17.40 MB, 17.40 MB - FooterProcessingTime: (Avg: 66.662ms ; Min: 46.321ms ; Max: 94.641ms ; Number of samples: 4) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 12.00 - BytesRead: 17.40 MB (18245656) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 8.771ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 0 (0) - NumRowGroups: 4 (4) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 31.00 MB (32504987) - PerReadThreadRawHdfsThroughput: 66.98 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 1.58M (1575936) - RowsReturned: 1.46M (1459200) - RowsReturnedRate: 1.85 M/sec - ScanRangesComplete: 152 (152) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 259.782ms - TotalReadThroughput: 28.02 KB/sec Filter 2 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 3 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 4 (1.00 MB): - Files processed: 156 (156) - Files rejected: 152 (152) - Files total: 156 (156) - RowGroups processed: 1.54K (1539) - RowGroups rejected: 0 (0) - RowGroups total: 1.54K (1539) - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) - Splits processed: 4 (4) - Splits rejected: 0 (0) - Splits total: 4 (4) Instance 7f40dcb034de70b7:1de (host=vd1140.foo:22000):(Total: 1s162ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 1:19/4.49 GB 3:16/3.85 GB 6:25/5.95 GB 2:19/3.69 GB 0:16/3.78 GB 7:20/4.72 GB 5:20/4.93 GB 4:23/5.35 GB Filter 4 arrival: 281ms Filter 2 arrival: 7s628ms Filter 3 arrival: 9m23s MemoryUsage(16s000ms): 54.91 MB, 65.27 MB, 65.27 MB, 65.27 MB, 65.27 MB, 65.27 MB, 65.27 MB, 65.27 MB, 65.27 MB, 65.27 MB, 65.27 MB, 65.27 MB, 65.27 MB, 65.27 MB, 65.27 MB, 65.27 MB, 65.27 MB, 65.27 MB, 65.27 MB, 65.27 MB, 65.27 MB, 65.27 MB, 65.27 MB, 65.27 MB, 65.27 MB, 65.27 MB, 65.27 MB, 65.27 MB, 65.27 MB, 65.27 MB, 65.27 MB, 65.27 MB, 65.27 MB, 65.27 MB, 65.27 MB, 65.27 MB, 65.27 MB, 65.27 MB, 65.27 MB ThreadUsage(16s000ms): 12, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.99 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 65.27 MB (68439932) - PerHostPeakMemUsage: 169.56 GB (182066533803) - RowsProduced: 538.62K (538624) - TotalNetworkReceiveTime: 3.511us - TotalNetworkSendTime: 174.020us - TotalStorageWaitTime: 1s013ms - TotalThreadsInvoluntaryContextSwitches: 37 (37) - TotalThreadsTotalWallClockTime: 1s103ms - TotalThreadsSysTime: 3.000ms - TotalThreadsUserTime: 222.966ms - TotalThreadsVoluntaryContextSwitches: 66 (66) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 14.806ms - OpenTime: 1s102ms - ExecTreeOpenTime: 876.317ms - PrepareTime: 60.212ms - ExecTreePrepareTime: 695.623us DataStreamSender (dst_id=24):(Total: 78.071ms, non-child: 78.071ms, % non-child: 100.00%) - BytesSent: 4.25 MB (4451333) - NetworkThroughput(*): 100.46 MB/sec - OverallThroughput: 54.37 MB/sec - PeakMemoryUsage: 4.67 MB (4896512) - RowsReturned: 537.60K (537600) - SerializeBatchTime: 35.476ms - TransmitDataRPCTime: 42.255ms - UncompressedRowBatchSize: 13.93 MB (14602512) CodeGen:(Total: 247.087ms, non-child: 247.087ms, % non-child: 100.00%) - CodegenTime: 1.230ms - CompileTime: 57.755ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 166.242ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 22.624ms HASH_JOIN_NODE (id=8):(Total: 892.282ms, non-child: 14.541ms, % non-child: 1.63%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.436ms - PeakMemoryUsage: 1.11 MB (1160952) - ProbeRows: 538.62K (538624) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 12.198ms - RowsReturned: 537.60K (537600) - RowsReturnedRate: 602.50 K/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 41.158us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 116.233us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 75.589us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=19):(Total: 11.873us, non-child: 11.873us, % non-child: 100.00%) BytesReceived(16s000ms): 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 3.866us - DeserializeRowBatchTimer: 13.846us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 10.11 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=6):(Total: 877.734ms, non-child: 877.734ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:19/4.49 GB 3:16/3.85 GB 6:25/5.95 GB 2:19/3.69 GB 0:16/3.78 GB 7:20/4.72 GB 5:20/4.93 GB 4:23/5.35 GB ExecOption: PARQUET Codegen Enabled Runtime filters: Only following filters arrived: 4, waited 743ms BytesRead(16s000ms): 21.14 MB, 22.55 MB, 22.55 MB, 22.55 MB, 22.55 MB, 22.55 MB, 22.55 MB, 22.55 MB, 22.55 MB, 22.55 MB, 22.55 MB, 22.55 MB, 22.55 MB, 22.55 MB, 22.55 MB, 22.55 MB, 22.55 MB, 22.55 MB, 22.55 MB, 22.55 MB, 22.55 MB, 22.55 MB, 22.55 MB, 22.55 MB, 22.55 MB, 22.55 MB, 22.55 MB, 22.55 MB, 22.55 MB, 22.55 MB, 22.55 MB, 22.55 MB, 22.55 MB, 22.55 MB, 22.55 MB, 22.55 MB, 22.55 MB, 22.55 MB, 22.55 MB - FooterProcessingTime: (Avg: 65.894ms ; Min: 44.155ms ; Max: 95.566ms ; Number of samples: 5) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 11.99 - BytesRead: 22.55 MB (23643350) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 3.856ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 0 (0) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 43.22 MB (45315837) - PerReadThreadRawHdfsThroughput: 45.45 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 656.38K (656384) - RowsReturned: 538.62K (538624) - RowsReturnedRate: 613.65 K/sec - ScanRangesComplete: 153 (153) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 496.053ms - TotalReadThroughput: 36.13 KB/sec Filter 2 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 3 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 4 (1.00 MB): - Files processed: 158 (158) - Files rejected: 153 (153) - Files total: 158 (158) - RowGroups processed: 641 (641) - RowGroups rejected: 0 (0) - RowGroups total: 641 (641) - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) - Splits processed: 5 (5) - Splits rejected: 0 (0) - Splits total: 5 (5) Instance 7f40dcb034de70b7:1d3 (host=vd1125.foo:22000):(Total: 1s162ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 6:20/4.64 GB 1:19/4.69 GB 0:22/5.04 GB 7:13/2.96 GB 3:23/5.67 GB 5:17/4.17 GB 4:20/4.77 GB 2:20/4.86 GB Filter 4 arrival: 278ms Filter 2 arrival: 7s466ms Filter 3 arrival: 9m23s MemoryUsage(16s000ms): 48.62 MB, 59.96 MB, 59.96 MB, 59.96 MB, 59.96 MB, 59.96 MB, 59.96 MB, 59.96 MB, 59.96 MB, 59.96 MB, 59.96 MB, 59.96 MB, 59.96 MB, 59.96 MB, 59.96 MB, 59.96 MB, 59.96 MB, 59.96 MB, 59.96 MB, 59.96 MB, 59.96 MB, 59.96 MB, 59.96 MB, 59.96 MB, 59.96 MB, 59.96 MB, 59.96 MB, 59.96 MB, 59.96 MB, 59.96 MB, 59.96 MB, 59.96 MB, 59.96 MB, 59.96 MB, 59.96 MB, 59.96 MB, 59.96 MB, 59.96 MB, 59.96 MB ThreadUsage(16s000ms): 12, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.98 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 59.96 MB (62870459) - PerHostPeakMemUsage: 169.56 GB (182067071571) - RowsProduced: 710.66K (710656) - TotalNetworkReceiveTime: 4.767us - TotalNetworkSendTime: 272.585us - TotalStorageWaitTime: 1s987ms - TotalThreadsInvoluntaryContextSwitches: 34 (34) - TotalThreadsTotalWallClockTime: 1s097ms - TotalThreadsSysTime: 2.000ms - TotalThreadsUserTime: 213.968ms - TotalThreadsVoluntaryContextSwitches: 79 (79) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 20.872ms - OpenTime: 1s096ms - ExecTreeOpenTime: 881.546ms - PrepareTime: 66.041ms - ExecTreePrepareTime: 619.695us DataStreamSender (dst_id=24):(Total: 104.843ms, non-child: 104.843ms, % non-child: 100.00%) - BytesSent: 5.63 MB (5901081) - NetworkThroughput(*): 93.95 MB/sec - OverallThroughput: 53.68 MB/sec - PeakMemoryUsage: 4.67 MB (4896512) - RowsReturned: 709.63K (709632) - SerializeBatchTime: 44.140ms - TransmitDataRPCTime: 59.903ms - UncompressedRowBatchSize: 18.78 MB (19693296) CodeGen:(Total: 246.048ms, non-child: 246.048ms, % non-child: 100.00%) - CodegenTime: 1.247ms - CompileTime: 64.747ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 148.060ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 32.715ms HASH_JOIN_NODE (id=8):(Total: 903.266ms, non-child: 19.229ms, % non-child: 2.13%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.509ms - PeakMemoryUsage: 1.10 MB (1149958) - ProbeRows: 710.66K (710656) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 16.787ms - RowsReturned: 709.63K (709632) - RowsReturnedRate: 785.63 K/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 31.111us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 239.104us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 48.501us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=19):(Total: 14.086us, non-child: 14.086us, % non-child: 100.00%) BytesReceived(16s000ms): 963.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 4.934us - DeserializeRowBatchTimer: 21.035us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 8.52 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=6):(Total: 884.028ms, non-child: 884.028ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 6:20/4.64 GB 1:19/4.69 GB 0:22/5.04 GB 7:13/2.96 GB 3:23/5.67 GB 5:17/4.17 GB 4:20/4.77 GB 2:20/4.86 GB ExecOption: PARQUET Codegen Enabled Runtime filters: Only following filters arrived: 4, waited 743ms BytesRead(16s000ms): 22.33 MB, 24.64 MB, 24.64 MB, 24.64 MB, 24.64 MB, 24.64 MB, 24.64 MB, 24.64 MB, 24.64 MB, 24.64 MB, 24.64 MB, 24.64 MB, 24.64 MB, 24.64 MB, 24.64 MB, 24.64 MB, 24.64 MB, 24.64 MB, 24.64 MB, 24.64 MB, 24.64 MB, 24.64 MB, 24.64 MB, 24.64 MB, 24.64 MB, 24.64 MB, 24.64 MB, 24.64 MB, 24.64 MB, 24.64 MB, 24.64 MB, 24.64 MB, 24.64 MB, 24.64 MB, 24.64 MB, 24.64 MB, 24.64 MB, 24.64 MB, 24.64 MB - FooterProcessingTime: (Avg: 92.072ms ; Min: 46.103ms ; Max: 134.653ms ; Number of samples: 7) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 11.99 - BytesRead: 24.64 MB (25840199) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 6.411ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 0 (0) - NumRowGroups: 7 (7) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 37.76 MB (39590716) - PerReadThreadRawHdfsThroughput: 40.07 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 830.46K (830464) - RowsReturned: 710.66K (710656) - RowsReturnedRate: 803.88 K/sec - ScanRangesComplete: 147 (147) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 615.029ms - TotalReadThroughput: 39.55 KB/sec Filter 2 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 3 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 4 (1.00 MB): - Files processed: 154 (154) - Files rejected: 147 (147) - Files total: 154 (154) - RowGroups processed: 811 (811) - RowGroups rejected: 0 (0) - RowGroups total: 811 (811) - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) - Splits processed: 7 (7) - Splits rejected: 0 (0) - Splits total: 7 (7) Instance 7f40dcb034de70b7:1e8 (host=vd1108.foo:22000):(Total: 1s162ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 1:14/3.21 GB 6:20/4.76 GB 7:27/5.76 GB 2:14/3.22 GB 5:19/4.29 GB 3:21/4.74 GB 0:23/5.67 GB 4:20/4.82 GB Filter 4 arrival: 229ms Filter 2 arrival: 7s745ms Filter 3 arrival: 9m23s MemoryUsage(16s000ms): 47.91 MB, 57.80 MB, 57.80 MB, 57.80 MB, 57.80 MB, 57.80 MB, 57.80 MB, 57.80 MB, 57.80 MB, 57.80 MB, 57.80 MB, 57.80 MB, 57.80 MB, 57.80 MB, 57.80 MB, 57.80 MB, 57.80 MB, 57.80 MB, 57.80 MB, 57.80 MB, 57.80 MB, 57.80 MB, 57.80 MB, 57.80 MB, 57.80 MB, 57.80 MB, 57.80 MB, 57.80 MB, 57.80 MB, 57.80 MB, 57.80 MB, 57.80 MB, 57.80 MB, 57.80 MB, 57.80 MB, 57.80 MB, 57.80 MB, 57.80 MB, 57.80 MB ThreadUsage(16s000ms): 12, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.99 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 57.80 MB (60607326) - PerHostPeakMemUsage: 169.56 GB (182064821899) - RowsProduced: 416.77K (416768) - TotalNetworkReceiveTime: 3.593us - TotalNetworkSendTime: 159.621us - TotalStorageWaitTime: 1s460ms - TotalThreadsInvoluntaryContextSwitches: 32 (32) - TotalThreadsTotalWallClockTime: 1s110ms - TotalThreadsSysTime: 2.999ms - TotalThreadsUserTime: 178.972ms - TotalThreadsVoluntaryContextSwitches: 54 (54) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 11.780ms - OpenTime: 1s109ms - ExecTreeOpenTime: 929.386ms - PrepareTime: 52.893ms - ExecTreePrepareTime: 607.966us DataStreamSender (dst_id=24):(Total: 57.594ms, non-child: 57.594ms, % non-child: 100.00%) - BytesSent: 3.14 MB (3292297) - NetworkThroughput(*): 90.52 MB/sec - OverallThroughput: 54.52 MB/sec - PeakMemoryUsage: 4.85 MB (5084928) - RowsReturned: 415.74K (415744) - SerializeBatchTime: 22.030ms - TransmitDataRPCTime: 34.684ms - UncompressedRowBatchSize: 10.46 MB (10963048) CodeGen:(Total: 200.617ms, non-child: 200.617ms, % non-child: 100.00%) - CodegenTime: 1.001ms - CompileTime: 53.774ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 124.551ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 21.842ms HASH_JOIN_NODE (id=8):(Total: 942.153ms, non-child: 11.801ms, % non-child: 1.25%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.386ms - PeakMemoryUsage: 1.10 MB (1151924) - ProbeRows: 416.77K (416768) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 9.653ms - RowsReturned: 415.74K (415744) - RowsReturnedRate: 441.27 K/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 21.830us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 140.323us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 49.850us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=19):(Total: 12.246us, non-child: 12.246us, % non-child: 100.00%) BytesReceived(16s000ms): 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 4.300us - DeserializeRowBatchTimer: 25.376us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 9.80 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=6):(Total: 930.344ms, non-child: 930.344ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:14/3.21 GB 6:20/4.76 GB 7:27/5.76 GB 2:14/3.22 GB 5:19/4.29 GB 3:21/4.74 GB 0:23/5.67 GB 4:20/4.82 GB ExecOption: PARQUET Codegen Enabled Runtime filters: Only following filters arrived: 4, waited 804ms BytesRead(16s000ms): 21.07 MB, 22.47 MB, 22.47 MB, 22.47 MB, 22.47 MB, 22.47 MB, 22.47 MB, 22.47 MB, 22.47 MB, 22.47 MB, 22.47 MB, 22.47 MB, 22.47 MB, 22.47 MB, 22.47 MB, 22.47 MB, 22.47 MB, 22.47 MB, 22.47 MB, 22.47 MB, 22.47 MB, 22.47 MB, 22.47 MB, 22.47 MB, 22.47 MB, 22.47 MB, 22.47 MB, 22.47 MB, 22.47 MB, 22.47 MB, 22.47 MB, 22.47 MB, 22.47 MB, 22.47 MB, 22.47 MB, 22.47 MB, 22.47 MB, 22.47 MB, 22.47 MB - FooterProcessingTime: (Avg: 85.060ms ; Min: 46.702ms ; Max: 146.356ms ; Number of samples: 6) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 11.99 - BytesRead: 22.47 MB (23565964) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 2.728ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 0 (0) - NumRowGroups: 6 (6) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 35.81 MB (37548767) - PerReadThreadRawHdfsThroughput: 40.46 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 535.55K (535552) - RowsReturned: 416.77K (416768) - RowsReturnedRate: 447.97 K/sec - ScanRangesComplete: 152 (152) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 555.406ms - TotalReadThroughput: 36.27 KB/sec Filter 2 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 3 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 4 (1.00 MB): - Files processed: 158 (158) - Files rejected: 152 (152) - Files total: 158 (158) - RowGroups processed: 523 (523) - RowGroups rejected: 0 (0) - RowGroups total: 523 (523) - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) - Splits processed: 6 (6) - Splits rejected: 0 (0) - Splits total: 6 (6) Instance 7f40dcb034de70b7:197 (host=vc1518.foo:22000):(Total: 1s162ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 1:21/4.58 GB 5:19/4.51 GB 4:15/3.46 GB 3:23/5.41 GB 7:26/6.13 GB 0:16/3.71 GB 6:20/4.66 GB 2:19/3.80 GB Filter 4 arrival: 486ms Filter 2 arrival: 6s699ms Filter 3 arrival: 9m23s MemoryUsage(16s000ms): 57.66 MB, 67.76 MB, 67.76 MB, 67.76 MB, 67.76 MB, 67.76 MB, 67.76 MB, 67.76 MB, 67.76 MB, 67.76 MB, 67.76 MB, 67.76 MB, 67.76 MB, 67.76 MB, 67.76 MB, 67.76 MB, 67.76 MB, 67.76 MB, 67.76 MB, 67.76 MB, 67.76 MB, 67.76 MB, 67.76 MB, 67.76 MB, 67.76 MB, 67.76 MB, 67.76 MB, 67.76 MB, 67.76 MB, 67.76 MB, 67.76 MB, 67.76 MB, 67.76 MB, 67.76 MB, 67.76 MB, 67.76 MB, 67.76 MB, 67.76 MB, 67.76 MB ThreadUsage(16s000ms): 7, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8 - AverageThreadTokens: 7.99 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 67.76 MB (71046608) - PerHostPeakMemUsage: 169.57 GB (182075238879) - RowsProduced: 2.41M (2414592) - TotalNetworkReceiveTime: 230.970ms - TotalNetworkSendTime: 3.757ms - TotalStorageWaitTime: 1s617ms - TotalThreadsInvoluntaryContextSwitches: 22 (22) - TotalThreadsTotalWallClockTime: 1s332ms - TotalThreadsSysTime: 2.999ms - TotalThreadsUserTime: 194.970ms - TotalThreadsVoluntaryContextSwitches: 62 (62) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 60.032ms - OpenTime: 1s100ms - ExecTreeOpenTime: 903.650ms - PrepareTime: 62.023ms - ExecTreePrepareTime: 577.163us DataStreamSender (dst_id=24):(Total: 316.371ms, non-child: 316.371ms, % non-child: 100.00%) - BytesSent: 21.11 MB (22130535) - NetworkThroughput(*): 104.00 MB/sec - OverallThroughput: 66.71 MB/sec - PeakMemoryUsage: 4.55 MB (4773632) - RowsReturned: 2.41M (2413568) - SerializeBatchTime: 111.666ms - TransmitDataRPCTime: 202.932ms - UncompressedRowBatchSize: 67.63 MB (70913728) CodeGen:(Total: 219.540ms, non-child: 219.540ms, % non-child: 100.00%) - CodegenTime: 1.107ms - CompileTime: 60.464ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 134.221ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 24.309ms HASH_JOIN_NODE (id=8):(Total: 964.066ms, non-child: 53.599ms, % non-child: 5.56%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.295ms - PeakMemoryUsage: 1.11 MB (1162517) - ProbeRows: 2.41M (2414592) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 49.735ms - RowsReturned: 2.41M (2413568) - RowsReturnedRate: 2.50 M/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 30.216us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 121.291us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 65.881us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=19):(Total: 230.979ms, non-child: 20.456us, % non-child: 0.01%) BytesReceived(16s000ms): 963.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 4.857us - DeserializeRowBatchTimer: 14.901us - FirstBatchArrivalWaitTime: 206.217ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 519.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=6):(Total: 679.602ms, non-child: 679.602ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:21/4.58 GB 5:19/4.51 GB 4:15/3.46 GB 3:23/5.41 GB 7:26/6.13 GB 0:16/3.71 GB 6:20/4.66 GB 2:19/3.80 GB ExecOption: PARQUET Codegen Enabled Runtime filters: Only following filters arrived: 4, waited 542ms BytesRead(16s000ms): 25.19 MB, 27.28 MB, 27.28 MB, 27.28 MB, 27.28 MB, 27.28 MB, 27.28 MB, 27.28 MB, 27.28 MB, 27.28 MB, 27.28 MB, 27.28 MB, 27.28 MB, 27.28 MB, 27.28 MB, 27.28 MB, 27.28 MB, 27.28 MB, 27.28 MB, 27.28 MB, 27.28 MB, 27.28 MB, 27.28 MB, 27.28 MB, 27.28 MB, 27.28 MB, 27.28 MB, 27.28 MB, 27.28 MB, 27.28 MB, 27.28 MB, 27.28 MB, 27.28 MB, 27.28 MB, 27.28 MB, 27.28 MB, 27.28 MB, 27.28 MB, 27.28 MB - FooterProcessingTime: (Avg: 89.949ms ; Min: 48.571ms ; Max: 149.447ms ; Number of samples: 7) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 6.99 - BytesRead: 27.28 MB (28609323) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 13.693ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 0 (0) - NumRowGroups: 7 (7) - NumScannerThreadsStarted: 7 (7) - PeakMemoryUsage: 45.75 MB (47974229) - PerReadThreadRawHdfsThroughput: 46.02 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 2.53M (2534400) - RowsReturned: 2.41M (2414592) - RowsReturnedRate: 3.55 M/sec - ScanRangesComplete: 152 (152) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 592.902ms - TotalReadThroughput: 43.89 KB/sec Filter 2 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 3 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 4 (1.00 MB): - Files processed: 159 (159) - Files rejected: 152 (152) - Files total: 159 (159) - RowGroups processed: 2.48K (2475) - RowGroups rejected: 0 (0) - RowGroups total: 2.48K (2475) - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) - Splits processed: 7 (7) - Splits rejected: 0 (0) - Splits total: 7 (7) Instance 7f40dcb034de70b7:1c1 (host=vd1103.foo:22000):(Total: 1s161ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:13/3.13 GB 3:24/5.55 GB 6:22/4.98 GB 1:22/4.73 GB 2:21/4.75 GB 4:19/4.47 GB 5:19/4.24 GB 7:20/4.55 GB Filter 4 arrival: 313ms Filter 2 arrival: 7s212ms Filter 3 arrival: 9m23s MemoryUsage(16s000ms): 50.07 MB, 61.54 MB, 61.54 MB, 61.54 MB, 61.54 MB, 61.54 MB, 61.54 MB, 61.54 MB, 61.54 MB, 61.54 MB, 61.54 MB, 61.54 MB, 61.54 MB, 61.54 MB, 61.54 MB, 61.54 MB, 61.54 MB, 61.54 MB, 61.54 MB, 61.54 MB, 61.54 MB, 61.54 MB, 61.54 MB, 61.54 MB, 61.54 MB, 61.54 MB, 61.54 MB, 61.54 MB, 61.54 MB, 61.54 MB, 61.54 MB, 61.54 MB, 61.54 MB, 61.54 MB, 61.54 MB, 61.54 MB, 61.54 MB, 61.54 MB, 61.54 MB, 61.54 MB ThreadUsage(16s000ms): 12, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.99 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 61.54 MB (64525039) - PerHostPeakMemUsage: 169.56 GB (182068719943) - RowsProduced: 1.23M (1228800) - TotalNetworkReceiveTime: 66.919ms - TotalNetworkSendTime: 392.131us - TotalStorageWaitTime: 807.501ms - TotalThreadsInvoluntaryContextSwitches: 26 (26) - TotalThreadsTotalWallClockTime: 1s178ms - TotalThreadsSysTime: 4.999ms - TotalThreadsUserTime: 192.971ms - TotalThreadsVoluntaryContextSwitches: 84 (84) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 39.701ms - OpenTime: 1s110ms - ExecTreeOpenTime: 912.408ms - PrepareTime: 50.890ms - ExecTreePrepareTime: 531.869us DataStreamSender (dst_id=24):(Total: 169.694ms, non-child: 169.694ms, % non-child: 100.00%) - BytesSent: 10.49 MB (11002658) - NetworkThroughput(*): 99.33 MB/sec - OverallThroughput: 61.83 MB/sec - PeakMemoryUsage: 4.59 MB (4814592) - RowsReturned: 1.23M (1227776) - SerializeBatchTime: 63.117ms - TransmitDataRPCTime: 105.638ms - UncompressedRowBatchSize: 33.67 MB (35300568) CodeGen:(Total: 221.495ms, non-child: 221.495ms, % non-child: 100.00%) - CodegenTime: 920.936us - CompileTime: 57.204ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 139.638ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 24.255ms HASH_JOIN_NODE (id=8):(Total: 952.772ms, non-child: 36.025ms, % non-child: 3.78%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 651.112us - PeakMemoryUsage: 1.11 MB (1162440) - ProbeRows: 1.23M (1228800) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 33.708ms - RowsReturned: 1.23M (1227776) - RowsReturnedRate: 1.29 M/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 12.168us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 71.515us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 20.881us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=19):(Total: 66.924ms, non-child: 10.085us, % non-child: 0.02%) BytesReceived(16s000ms): 963.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 2.733us - DeserializeRowBatchTimer: 19.073us - FirstBatchArrivalWaitTime: 65.694ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 1.79 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=6):(Total: 849.946ms, non-child: 849.946ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:13/3.13 GB 3:24/5.55 GB 6:22/4.98 GB 1:22/4.73 GB 2:21/4.75 GB 4:19/4.47 GB 5:19/4.24 GB 7:20/4.55 GB ExecOption: PARQUET Codegen Enabled Runtime filters: Only following filters arrived: 4, waited 723ms BytesRead(16s000ms): 21.42 MB, 23.63 MB, 23.63 MB, 23.63 MB, 23.63 MB, 23.63 MB, 23.63 MB, 23.63 MB, 23.63 MB, 23.63 MB, 23.63 MB, 23.63 MB, 23.63 MB, 23.63 MB, 23.63 MB, 23.63 MB, 23.63 MB, 23.63 MB, 23.63 MB, 23.63 MB, 23.63 MB, 23.63 MB, 23.63 MB, 23.63 MB, 23.63 MB, 23.63 MB, 23.63 MB, 23.63 MB, 23.63 MB, 23.63 MB, 23.63 MB, 23.63 MB, 23.63 MB, 23.63 MB, 23.63 MB, 23.63 MB, 23.63 MB, 23.63 MB, 23.63 MB, 23.63 MB - FooterProcessingTime: (Avg: 62.367ms ; Min: 48.636ms ; Max: 89.480ms ; Number of samples: 6) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 12.00 - BytesRead: 23.63 MB (24782060) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 6.096ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 0 (0) - NumRowGroups: 6 (6) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 39.56 MB (41484387) - PerReadThreadRawHdfsThroughput: 43.84 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 1.35M (1347584) - RowsReturned: 1.23M (1228800) - RowsReturnedRate: 1.45 M/sec - ScanRangesComplete: 154 (154) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 539.129ms - TotalReadThroughput: 37.81 KB/sec Filter 2 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 3 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 4 (1.00 MB): - Files processed: 160 (160) - Files rejected: 154 (154) - Files total: 160 (160) - RowGroups processed: 1.32K (1316) - RowGroups rejected: 0 (0) - RowGroups total: 1.32K (1316) - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) - Splits processed: 6 (6) - Splits rejected: 0 (0) - Splits total: 6 (6) Instance 7f40dcb034de70b7:1bb (host=vd1115.foo:22000):(Total: 1s160ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 5:21/5.18 GB 6:25/5.78 GB 1:23/5.24 GB 4:21/4.85 GB 2:15/3.29 GB 3:19/4.21 GB 0:15/3.47 GB 7:21/4.73 GB Filter 4 arrival: 320ms Filter 2 arrival: 7s194ms Filter 3 arrival: 9m23s MemoryUsage(16s000ms): 58.58 MB, 69.66 MB, 69.66 MB, 69.66 MB, 69.66 MB, 69.66 MB, 69.66 MB, 69.66 MB, 69.66 MB, 69.66 MB, 69.66 MB, 69.66 MB, 69.66 MB, 69.66 MB, 69.66 MB, 69.66 MB, 69.66 MB, 69.66 MB, 69.66 MB, 69.66 MB, 69.66 MB, 69.66 MB, 69.66 MB, 69.66 MB, 69.66 MB, 69.66 MB, 69.66 MB, 69.66 MB, 69.66 MB, 69.66 MB, 69.66 MB, 69.66 MB, 69.66 MB, 69.66 MB, 69.66 MB, 69.66 MB, 69.66 MB, 69.66 MB, 69.66 MB ThreadUsage(16s000ms): 12, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.99 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 69.66 MB (73039069) - PerHostPeakMemUsage: 169.57 GB (182077227576) - RowsProduced: 1.34M (1342464) - TotalNetworkReceiveTime: 62.615ms - TotalNetworkSendTime: 419.748us - TotalStorageWaitTime: 1s177ms - TotalThreadsInvoluntaryContextSwitches: 27 (27) - TotalThreadsTotalWallClockTime: 1s166ms - TotalThreadsSysTime: 5.999ms - TotalThreadsUserTime: 198.969ms - TotalThreadsVoluntaryContextSwitches: 57 (57) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 36.895ms - OpenTime: 1s102ms - ExecTreeOpenTime: 898.839ms - PrepareTime: 57.665ms - ExecTreePrepareTime: 608.993us DataStreamSender (dst_id=24):(Total: 182.868ms, non-child: 182.868ms, % non-child: 100.00%) - BytesSent: 11.84 MB (12419147) - NetworkThroughput(*): 102.81 MB/sec - OverallThroughput: 64.77 MB/sec - PeakMemoryUsage: 4.54 MB (4757248) - RowsReturned: 1.34M (1341440) - SerializeBatchTime: 66.957ms - TransmitDataRPCTime: 115.201ms - UncompressedRowBatchSize: 36.99 MB (38783736) CodeGen:(Total: 224.922ms, non-child: 224.922ms, % non-child: 100.00%) - CodegenTime: 1.200ms - CompileTime: 58.283ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 143.471ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 22.584ms HASH_JOIN_NODE (id=8):(Total: 936.479ms, non-child: 32.312ms, % non-child: 3.45%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.211ms - PeakMemoryUsage: 1.11 MB (1162510) - ProbeRows: 1.34M (1342464) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 29.203ms - RowsReturned: 1.34M (1341440) - RowsReturnedRate: 1.43 M/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 21.784us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 117.884us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 38.963us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=19):(Total: 62.629ms, non-child: 20.786us, % non-child: 0.03%) BytesReceived(16s000ms): 963.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 9.184us - DeserializeRowBatchTimer: 14.904us - FirstBatchArrivalWaitTime: 54.196ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 1.92 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=6):(Total: 841.661ms, non-child: 841.661ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:21/5.18 GB 6:25/5.78 GB 1:23/5.24 GB 4:21/4.85 GB 2:15/3.29 GB 3:19/4.21 GB 0:15/3.47 GB 7:21/4.73 GB ExecOption: PARQUET Codegen Enabled Runtime filters: Only following filters arrived: 4, waited 703ms BytesRead(16s000ms): 28.51 MB, 31.44 MB, 31.44 MB, 31.44 MB, 31.44 MB, 31.44 MB, 31.44 MB, 31.44 MB, 31.44 MB, 31.44 MB, 31.44 MB, 31.44 MB, 31.44 MB, 31.44 MB, 31.44 MB, 31.44 MB, 31.44 MB, 31.44 MB, 31.44 MB, 31.44 MB, 31.44 MB, 31.44 MB, 31.44 MB, 31.44 MB, 31.44 MB, 31.44 MB, 31.44 MB, 31.44 MB, 31.44 MB, 31.44 MB, 31.44 MB, 31.44 MB, 31.44 MB, 31.44 MB, 31.44 MB, 31.44 MB, 31.44 MB, 31.44 MB, 31.44 MB - FooterProcessingTime: (Avg: 65.623ms ; Min: 31.941ms ; Max: 126.138ms ; Number of samples: 7) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 12.00 - BytesRead: 31.44 MB (32971941) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 6.901ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 0 (0) - NumRowGroups: 7 (7) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 47.94 MB (50267903) - PerReadThreadRawHdfsThroughput: 46.16 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 1.46M (1462272) - RowsReturned: 1.34M (1342464) - RowsReturnedRate: 1.60 M/sec - ScanRangesComplete: 153 (153) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 681.232ms - TotalReadThroughput: 50.63 KB/sec Filter 2 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 3 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 4 (1.00 MB): - Files processed: 160 (160) - Files rejected: 153 (153) - Files total: 160 (160) - RowGroups processed: 1.43K (1428) - RowGroups rejected: 0 (0) - RowGroups total: 1.43K (1428) - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) - Splits processed: 7 (7) - Splits rejected: 0 (0) - Splits total: 7 (7) Instance 7f40dcb034de70b7:201 (host=va1045.foo:22000):(Total: 1s160ms, non-child: 16.582ms, % non-child: 1.43%) Hdfs split stats (:<# splits>/): 2:23/4.82 GB 0:21/4.88 GB 4:14/2.96 GB 1:20/4.69 GB 5:19/4.60 GB 3:18/4.44 GB 6:20/4.75 GB 7:23/5.49 GB Filter 4 arrival: 286ms Filter 2 arrival: 9s482ms Filter 3 arrival: 9m23s MemoryUsage(16s000ms): 42.59 MB, 54.26 MB, 54.26 MB, 54.26 MB, 54.26 MB, 54.26 MB, 54.26 MB, 54.26 MB, 54.26 MB, 54.26 MB, 54.26 MB, 54.26 MB, 54.26 MB, 54.26 MB, 54.26 MB, 54.26 MB, 54.26 MB, 54.26 MB, 54.26 MB, 54.26 MB, 54.26 MB, 54.26 MB, 54.26 MB, 54.26 MB, 54.26 MB, 54.26 MB, 54.26 MB, 54.26 MB, 54.26 MB, 54.26 MB, 54.26 MB, 54.26 MB, 54.26 MB, 54.26 MB, 54.26 MB, 54.26 MB, 54.26 MB, 54.26 MB, 54.26 MB ThreadUsage(16s000ms): 6, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7 - AverageThreadTokens: 6.99 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 54.26 MB (56900462) - PerHostPeakMemUsage: 169.56 GB (182061058974) - RowsProduced: 107.52K (107520) - TotalNetworkReceiveTime: 3.880us - TotalNetworkSendTime: 30.035us - TotalStorageWaitTime: 1s113ms - TotalThreadsInvoluntaryContextSwitches: 32 (32) - TotalThreadsTotalWallClockTime: 1s099ms - TotalThreadsSysTime: 3.999ms - TotalThreadsUserTime: 228.966ms - TotalThreadsVoluntaryContextSwitches: 75 (75) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 5.745ms - OpenTime: 1s098ms - ExecTreeOpenTime: 867.101ms - PrepareTime: 61.646ms - ExecTreePrepareTime: 1.085ms DataStreamSender (dst_id=24):(Total: 15.423ms, non-child: 15.423ms, % non-child: 100.00%) - BytesSent: 492.78 KB (504602) - NetworkThroughput(*): 82.64 MB/sec - OverallThroughput: 31.20 MB/sec - PeakMemoryUsage: 4.61 MB (4839168) - RowsReturned: 106.50K (106496) - SerializeBatchTime: 9.009ms - TransmitDataRPCTime: 5.822ms - UncompressedRowBatchSize: 1.62 MB (1696928) CodeGen:(Total: 253.515ms, non-child: 253.515ms, % non-child: 100.00%) - CodegenTime: 1.126ms - CompileTime: 68.932ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 159.999ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 24.022ms HASH_JOIN_NODE (id=8):(Total: 874.809ms, non-child: 6.618ms, % non-child: 0.76%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.435ms - PeakMemoryUsage: 1.09 MB (1144022) - ProbeRows: 107.52K (107520) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4.683ms - RowsReturned: 106.50K (106496) - RowsReturnedRate: 121.74 K/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 22.344us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 120.207us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 55.817us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=19):(Total: 14.451us, non-child: 14.451us, % non-child: 100.00%) BytesReceived(16s000ms): 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 5.372us - DeserializeRowBatchTimer: 117.698us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 8.30 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=6):(Total: 868.183ms, non-child: 868.183ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:23/4.82 GB 0:21/4.88 GB 4:14/2.96 GB 1:20/4.69 GB 5:19/4.60 GB 3:18/4.44 GB 6:20/4.75 GB 7:23/5.49 GB ExecOption: PARQUET Codegen Enabled Runtime filters: Only following filters arrived: 4, waited 742ms BytesRead(16s000ms): 19.50 MB, 20.93 MB, 20.93 MB, 20.93 MB, 20.93 MB, 20.93 MB, 20.93 MB, 20.93 MB, 20.93 MB, 20.93 MB, 20.93 MB, 20.93 MB, 20.93 MB, 20.93 MB, 20.93 MB, 20.93 MB, 20.93 MB, 20.93 MB, 20.93 MB, 20.93 MB, 20.93 MB, 20.93 MB, 20.93 MB, 20.93 MB, 20.93 MB, 20.93 MB, 20.93 MB, 20.93 MB, 20.93 MB, 20.93 MB, 20.93 MB, 20.93 MB, 20.93 MB, 20.93 MB, 20.93 MB, 20.93 MB, 20.93 MB, 20.93 MB, 20.93 MB - FooterProcessingTime: (Avg: 76.721ms ; Min: 41.962ms ; Max: 131.731ms ; Number of samples: 6) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 5.99 - BytesRead: 20.93 MB (21943813) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 2.498ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 0 (0) - NumRowGroups: 6 (6) - NumScannerThreadsStarted: 6 (6) - PeakMemoryUsage: 32.32 MB (33891055) - PerReadThreadRawHdfsThroughput: 41.48 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 226.30K (226304) - RowsReturned: 107.52K (107520) - RowsReturnedRate: 123.84 K/sec - ScanRangesComplete: 152 (152) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 504.573ms - TotalReadThroughput: 33.56 KB/sec Filter 2 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 3 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 4 (1.00 MB): - Files processed: 158 (158) - Files rejected: 152 (152) - Files total: 158 (158) - RowGroups processed: 221 (221) - RowGroups rejected: 0 (0) - RowGroups total: 221 (221) - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) - Splits processed: 6 (6) - Splits rejected: 0 (0) - Splits total: 6 (6) Instance 7f40dcb034de70b7:1d1 (host=ve1132.foo:22000):(Total: 1s160ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 1:16/3.74 GB 0:22/4.76 GB 7:25/5.60 GB 5:14/3.43 GB 3:24/5.85 GB 6:17/4.19 GB 2:16/3.82 GB 4:23/5.42 GB Filter 4 arrival: 342ms Filter 2 arrival: 7s432ms Filter 3 arrival: 9m23s MemoryUsage(16s000ms): 55.36 MB, 65.74 MB, 65.74 MB, 65.74 MB, 65.74 MB, 65.74 MB, 65.74 MB, 65.74 MB, 65.74 MB, 65.74 MB, 65.74 MB, 65.74 MB, 65.74 MB, 65.74 MB, 65.74 MB, 65.74 MB, 65.74 MB, 65.74 MB, 65.74 MB, 65.74 MB, 65.74 MB, 65.74 MB, 65.74 MB, 65.74 MB, 65.74 MB, 65.74 MB, 65.74 MB, 65.74 MB, 65.74 MB, 65.74 MB, 65.74 MB, 65.74 MB, 65.74 MB, 65.74 MB, 65.74 MB, 65.74 MB, 65.74 MB, 65.74 MB, 65.74 MB ThreadUsage(16s000ms): 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 13.00 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 65.74 MB (68937132) - PerHostPeakMemUsage: 169.57 GB (182073146432) - RowsProduced: 627.71K (627712) - TotalNetworkReceiveTime: 4.201us - TotalNetworkSendTime: 5.772ms - TotalStorageWaitTime: 1s080ms - TotalThreadsInvoluntaryContextSwitches: 39 (39) - TotalThreadsTotalWallClockTime: 1s073ms - TotalThreadsSysTime: 5.999ms - TotalThreadsUserTime: 261.959ms - TotalThreadsVoluntaryContextSwitches: 53 (53) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 23.191ms - OpenTime: 1s077ms - ExecTreeOpenTime: 805.993ms - PrepareTime: 82.807ms - ExecTreePrepareTime: 1.033ms DataStreamSender (dst_id=24):(Total: 97.683ms, non-child: 97.683ms, % non-child: 100.00%) - BytesSent: 5.09 MB (5334112) - NetworkThroughput(*): 95.18 MB/sec - OverallThroughput: 52.08 MB/sec - PeakMemoryUsage: 4.72 MB (4953856) - RowsReturned: 626.69K (626688) - SerializeBatchTime: 43.329ms - TransmitDataRPCTime: 53.445ms - UncompressedRowBatchSize: 16.44 MB (17237216) CodeGen:(Total: 294.474ms, non-child: 294.474ms, % non-child: 100.00%) - CodegenTime: 1.133ms - CompileTime: 84.444ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 179.040ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 30.483ms HASH_JOIN_NODE (id=8):(Total: 830.873ms, non-child: 21.996ms, % non-child: 2.65%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.693ms - PeakMemoryUsage: 1.11 MB (1162477) - ProbeRows: 627.71K (627712) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 18.652ms - RowsReturned: 626.69K (626688) - RowsReturnedRate: 754.25 K/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 25.446us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 185.207us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 57.357us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=19):(Total: 15.982us, non-child: 15.982us, % non-child: 100.00%) BytesReceived(16s000ms): 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 7.003us - DeserializeRowBatchTimer: 22.635us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 7.51 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=6):(Total: 808.866ms, non-child: 808.866ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:16/3.74 GB 0:22/4.76 GB 7:25/5.60 GB 5:14/3.43 GB 3:24/5.85 GB 6:17/4.19 GB 2:16/3.82 GB 4:23/5.42 GB ExecOption: PARQUET Codegen Enabled Runtime filters: Only following filters arrived: 4, waited 683ms BytesRead(16s000ms): 27.71 MB, 29.56 MB, 29.56 MB, 29.56 MB, 29.56 MB, 29.56 MB, 29.56 MB, 29.56 MB, 29.56 MB, 29.56 MB, 29.56 MB, 29.56 MB, 29.56 MB, 29.56 MB, 29.56 MB, 29.56 MB, 29.56 MB, 29.56 MB, 29.56 MB, 29.56 MB, 29.56 MB, 29.56 MB, 29.56 MB, 29.56 MB, 29.56 MB, 29.56 MB, 29.56 MB, 29.56 MB, 29.56 MB, 29.56 MB, 29.56 MB, 29.56 MB, 29.56 MB, 29.56 MB, 29.56 MB, 29.56 MB, 29.56 MB, 29.56 MB, 29.56 MB - FooterProcessingTime: (Avg: 59.481ms ; Min: 47.027ms ; Max: 100.982ms ; Number of samples: 7) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 12.00 - BytesRead: 29.56 MB (30990950) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 3.251ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 0 (0) - NumRowGroups: 7 (7) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 43.81 MB (45939815) - PerReadThreadRawHdfsThroughput: 46.20 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 747.52K (747520) - RowsReturned: 627.71K (627712) - RowsReturnedRate: 776.04 K/sec - ScanRangesComplete: 150 (150) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 639.725ms - TotalReadThroughput: 47.51 KB/sec Filter 2 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 3 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 4 (1.00 MB): - Files processed: 157 (157) - Files rejected: 150 (150) - Files total: 157 (157) - RowGroups processed: 730 (730) - RowGroups rejected: 0 (0) - RowGroups total: 730 (730) - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) - Splits processed: 7 (7) - Splits rejected: 0 (0) - Splits total: 7 (7) Instance 7f40dcb034de70b7:1b4 (host=vd1130.foo:22000):(Total: 1s160ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 6:18/4.03 GB 5:16/3.36 GB 1:25/5.95 GB 4:23/4.72 GB 2:14/3.05 GB 0:23/5.54 GB 7:21/5.03 GB 3:21/4.76 GB Filter 4 arrival: 375ms Filter 2 arrival: 7s061ms Filter 3 arrival: 9m23s MemoryUsage(16s000ms): 51.73 MB, 61.34 MB, 61.34 MB, 61.34 MB, 61.34 MB, 61.34 MB, 61.34 MB, 61.34 MB, 61.34 MB, 61.34 MB, 61.34 MB, 61.34 MB, 61.34 MB, 61.34 MB, 61.34 MB, 61.34 MB, 61.34 MB, 61.34 MB, 61.34 MB, 61.34 MB, 61.34 MB, 61.34 MB, 61.34 MB, 61.34 MB, 61.34 MB, 61.34 MB, 61.34 MB, 61.34 MB, 61.34 MB, 61.34 MB, 61.34 MB, 61.34 MB, 61.34 MB, 61.34 MB, 61.34 MB, 61.34 MB, 61.34 MB, 61.34 MB, 61.34 MB ThreadUsage(16s000ms): 6, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7 - AverageThreadTokens: 6.99 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 61.34 MB (64317869) - PerHostPeakMemUsage: 169.56 GB (182062973292) - RowsProduced: 1.74M (1736704) - TotalNetworkReceiveTime: 129.067ms - TotalNetworkSendTime: 574.432us - TotalStorageWaitTime: 1s194ms - TotalThreadsInvoluntaryContextSwitches: 22 (22) - TotalThreadsTotalWallClockTime: 1s237ms - TotalThreadsSysTime: 5.999ms - TotalThreadsUserTime: 193.970ms - TotalThreadsVoluntaryContextSwitches: 52 (52) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 42.743ms - OpenTime: 1s107ms - ExecTreeOpenTime: 909.447ms - PrepareTime: 52.213ms - ExecTreePrepareTime: 616.720us DataStreamSender (dst_id=24):(Total: 227.671ms, non-child: 227.671ms, % non-child: 100.00%) - BytesSent: 14.98 MB (15706584) - NetworkThroughput(*): 102.55 MB/sec - OverallThroughput: 65.79 MB/sec - PeakMemoryUsage: 4.79 MB (5019392) - RowsReturned: 1.74M (1735680) - SerializeBatchTime: 80.686ms - TransmitDataRPCTime: 146.066ms - UncompressedRowBatchSize: 48.21 MB (50550592) CodeGen:(Total: 220.839ms, non-child: 220.839ms, % non-child: 100.00%) - CodegenTime: 1.153ms - CompileTime: 58.034ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 138.290ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 24.058ms HASH_JOIN_NODE (id=8):(Total: 952.851ms, non-child: 38.892ms, % non-child: 4.08%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.305ms - PeakMemoryUsage: 1.11 MB (1162468) - ProbeRows: 1.74M (1736704) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 35.660ms - RowsReturned: 1.74M (1735680) - RowsReturnedRate: 1.82 M/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 23.074us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 133.913us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 51.069us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=19):(Total: 129.077ms, non-child: 17.451us, % non-child: 0.01%) BytesReceived(16s000ms): 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 4.514us - DeserializeRowBatchTimer: 14.798us - FirstBatchArrivalWaitTime: 109.657ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 929.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=6):(Total: 784.983ms, non-child: 784.983ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 6:18/4.03 GB 5:16/3.36 GB 1:25/5.95 GB 4:23/4.72 GB 2:14/3.05 GB 0:23/5.54 GB 7:21/5.03 GB 3:21/4.76 GB ExecOption: PARQUET Codegen Enabled Runtime filters: Only following filters arrived: 4, waited 663ms BytesRead(16s000ms): 24.42 MB, 26.05 MB, 26.05 MB, 26.05 MB, 26.05 MB, 26.05 MB, 26.05 MB, 26.05 MB, 26.05 MB, 26.05 MB, 26.05 MB, 26.05 MB, 26.05 MB, 26.05 MB, 26.05 MB, 26.05 MB, 26.05 MB, 26.05 MB, 26.05 MB, 26.05 MB, 26.05 MB, 26.05 MB, 26.05 MB, 26.05 MB, 26.05 MB, 26.05 MB, 26.05 MB, 26.05 MB, 26.05 MB, 26.05 MB, 26.05 MB, 26.05 MB, 26.05 MB, 26.05 MB, 26.05 MB, 26.05 MB, 26.05 MB, 26.05 MB, 26.05 MB - FooterProcessingTime: (Avg: 57.912ms ; Min: 31.334ms ; Max: 103.008ms ; Number of samples: 6) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 5.99 - BytesRead: 26.05 MB (27316197) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 10.520ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 0 (0) - NumRowGroups: 6 (6) - NumScannerThreadsStarted: 6 (6) - PeakMemoryUsage: 39.53 MB (41453484) - PerReadThreadRawHdfsThroughput: 47.82 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 1.86M (1855488) - RowsReturned: 1.74M (1736704) - RowsReturnedRate: 2.21 M/sec - ScanRangesComplete: 155 (155) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 544.757ms - TotalReadThroughput: 42.04 KB/sec Filter 2 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 3 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 4 (1.00 MB): - Files processed: 161 (161) - Files rejected: 155 (155) - Files total: 161 (161) - RowGroups processed: 1.81K (1812) - RowGroups rejected: 0 (0) - RowGroups total: 1.81K (1812) - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) - Splits processed: 6 (6) - Splits rejected: 0 (0) - Splits total: 6 (6) Instance 7f40dcb034de70b7:1ec (host=ve1140.foo:22000):(Total: 1s159ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 1:14/3.35 GB 3:22/4.80 GB 0:24/5.82 GB 6:20/3.48 GB 2:20/4.52 GB 4:24/5.44 GB 7:20/4.81 GB 5:20/4.30 GB Filter 4 arrival: 261ms Filter 2 arrival: 7s781ms Filter 3 arrival: 9m23s MemoryUsage(16s000ms): 54.43 MB, 64.75 MB, 64.75 MB, 64.75 MB, 64.75 MB, 64.75 MB, 64.75 MB, 64.75 MB, 64.75 MB, 64.75 MB, 64.75 MB, 64.75 MB, 64.75 MB, 64.75 MB, 64.75 MB, 64.75 MB, 64.75 MB, 64.75 MB, 64.75 MB, 64.75 MB, 64.75 MB, 64.75 MB, 64.75 MB, 64.75 MB, 64.75 MB, 64.75 MB, 64.75 MB, 64.75 MB, 64.75 MB, 64.75 MB, 64.75 MB, 64.75 MB, 64.75 MB, 64.75 MB, 64.75 MB, 64.75 MB, 64.75 MB, 64.75 MB, 64.75 MB ThreadUsage(16s000ms): 12, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.99 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 64.75 MB (67897711) - PerHostPeakMemUsage: 169.57 GB (182072110511) - RowsProduced: 277.50K (277504) - TotalNetworkReceiveTime: 4.583us - TotalNetworkSendTime: 105.593us - TotalStorageWaitTime: 1s312ms - TotalThreadsInvoluntaryContextSwitches: 36 (36) - TotalThreadsTotalWallClockTime: 1s098ms - TotalThreadsSysTime: 4.999ms - TotalThreadsUserTime: 196.971ms - TotalThreadsVoluntaryContextSwitches: 66 (66) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 9.904ms - OpenTime: 1s097ms - ExecTreeOpenTime: 894.869ms - PrepareTime: 62.708ms - ExecTreePrepareTime: 718.291us DataStreamSender (dst_id=24):(Total: 39.611ms, non-child: 39.611ms, % non-child: 100.00%) - BytesSent: 2.01 MB (2104809) - NetworkThroughput(*): 96.05 MB/sec - OverallThroughput: 50.68 MB/sec - PeakMemoryUsage: 4.87 MB (5109504) - RowsReturned: 276.48K (276480) - SerializeBatchTime: 17.806ms - TransmitDataRPCTime: 20.898ms - UncompressedRowBatchSize: 6.39 MB (6698400) CodeGen:(Total: 224.747ms, non-child: 224.747ms, % non-child: 100.00%) - CodegenTime: 1.089ms - CompileTime: 61.579ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 138.925ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 23.775ms HASH_JOIN_NODE (id=8):(Total: 906.027ms, non-child: 9.858ms, % non-child: 1.09%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.275ms - PeakMemoryUsage: 1.11 MB (1162288) - ProbeRows: 277.50K (277504) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 7.992ms - RowsReturned: 276.48K (276480) - RowsReturnedRate: 305.16 K/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 22.114us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 107.734us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 41.416us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=19):(Total: 13.372us, non-child: 13.372us, % non-child: 100.00%) BytesReceived(16s000ms): 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 4.477us - DeserializeRowBatchTimer: 18.800us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 8.97 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=6):(Total: 896.162ms, non-child: 896.162ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:14/3.35 GB 3:22/4.80 GB 0:24/5.82 GB 6:20/3.48 GB 2:20/4.52 GB 4:24/5.44 GB 7:20/4.81 GB 5:20/4.30 GB ExecOption: PARQUET Codegen Enabled Runtime filters: Only following filters arrived: 4, waited 763ms BytesRead(16s000ms): 21.97 MB, 23.43 MB, 23.43 MB, 23.43 MB, 23.43 MB, 23.43 MB, 23.43 MB, 23.43 MB, 23.43 MB, 23.43 MB, 23.43 MB, 23.43 MB, 23.43 MB, 23.43 MB, 23.43 MB, 23.43 MB, 23.43 MB, 23.43 MB, 23.43 MB, 23.43 MB, 23.43 MB, 23.43 MB, 23.43 MB, 23.43 MB, 23.43 MB, 23.43 MB, 23.43 MB, 23.43 MB, 23.43 MB, 23.43 MB, 23.43 MB, 23.43 MB, 23.43 MB, 23.43 MB, 23.43 MB, 23.43 MB, 23.43 MB, 23.43 MB, 23.43 MB - FooterProcessingTime: (Avg: 66.982ms ; Min: 45.082ms ; Max: 103.490ms ; Number of samples: 7) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 11.99 - BytesRead: 23.43 MB (24571747) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 2.274ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 0 (0) - NumRowGroups: 7 (7) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 42.54 MB (44601584) - PerReadThreadRawHdfsThroughput: 44.42 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 397.31K (397312) - RowsReturned: 277.50K (277504) - RowsReturnedRate: 309.66 K/sec - ScanRangesComplete: 157 (157) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 527.549ms - TotalReadThroughput: 37.64 KB/sec Filter 2 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 3 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 4 (1.00 MB): - Files processed: 164 (164) - Files rejected: 157 (157) - Files total: 164 (164) - RowGroups processed: 388 (388) - RowGroups rejected: 0 (0) - RowGroups total: 388 (388) - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) - Splits processed: 7 (7) - Splits rejected: 0 (0) - Splits total: 7 (7) Instance 7f40dcb034de70b7:1a2 (host=vc1524.foo:22000):(Total: 1s159ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 2:25/5.94 GB 6:18/4.44 GB 1:21/5.18 GB 5:17/3.79 GB 7:19/4.46 GB 4:13/3.21 GB 3:26/5.91 GB 0:17/3.92 GB Filter 4 arrival: 417ms Filter 2 arrival: 6s830ms Filter 3 arrival: 9m23s MemoryUsage(16s000ms): 59.76 MB, 69.43 MB, 69.43 MB, 69.43 MB, 69.43 MB, 69.43 MB, 69.43 MB, 69.43 MB, 69.43 MB, 69.43 MB, 69.43 MB, 69.43 MB, 69.43 MB, 69.43 MB, 69.43 MB, 69.43 MB, 69.43 MB, 69.43 MB, 69.43 MB, 69.43 MB, 69.43 MB, 69.43 MB, 69.43 MB, 69.43 MB, 69.43 MB, 69.43 MB, 69.43 MB, 69.43 MB, 69.43 MB, 69.43 MB, 69.43 MB, 69.43 MB, 69.43 MB, 69.43 MB, 69.43 MB, 69.43 MB, 69.43 MB, 69.43 MB, 69.43 MB ThreadUsage(16s000ms): 12, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.98 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 69.43 MB (72805601) - PerHostPeakMemUsage: 169.57 GB (182077014146) - RowsProduced: 1.99M (1994752) - TotalNetworkReceiveTime: 185.975ms - TotalNetworkSendTime: 648.432us - TotalStorageWaitTime: 983.608ms - TotalThreadsInvoluntaryContextSwitches: 19 (19) - TotalThreadsTotalWallClockTime: 1s292ms - TotalThreadsSysTime: 3.999ms - TotalThreadsUserTime: 179.973ms - TotalThreadsVoluntaryContextSwitches: 39 (39) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 48.932ms - OpenTime: 1s105ms - ExecTreeOpenTime: 923.404ms - PrepareTime: 53.716ms - ExecTreePrepareTime: 994.523us DataStreamSender (dst_id=24):(Total: 279.591ms, non-child: 279.591ms, % non-child: 100.00%) - BytesSent: 17.42 MB (18266699) - NetworkThroughput(*): 101.29 MB/sec - OverallThroughput: 62.31 MB/sec - PeakMemoryUsage: 4.58 MB (4806400) - RowsReturned: 1.99M (1993728) - SerializeBatchTime: 106.564ms - TransmitDataRPCTime: 171.991ms - UncompressedRowBatchSize: 55.73 MB (58432376) CodeGen:(Total: 200.470ms, non-child: 200.470ms, % non-child: 100.00%) - CodegenTime: 1.110ms - CompileTime: 52.627ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 128.015ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 19.406ms HASH_JOIN_NODE (id=8):(Total: 973.629ms, non-child: 43.417ms, % non-child: 4.46%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.520ms - PeakMemoryUsage: 1.11 MB (1162467) - ProbeRows: 1.99M (1994752) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 39.619ms - RowsReturned: 1.99M (1993728) - RowsReturnedRate: 2.05 M/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 19.061us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 159.872us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 67.504us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=19):(Total: 185.986ms, non-child: 20.046us, % non-child: 0.01%) BytesReceived(16s000ms): 963.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 5.670us - DeserializeRowBatchTimer: 16.403us - FirstBatchArrivalWaitTime: 183.485ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 645.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=6):(Total: 744.300ms, non-child: 744.300ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:25/5.94 GB 6:18/4.44 GB 1:21/5.18 GB 5:17/3.79 GB 7:19/4.46 GB 4:13/3.21 GB 3:26/5.91 GB 0:17/3.92 GB ExecOption: PARQUET Codegen Enabled Runtime filters: Only following filters arrived: 4, waited 602ms BytesRead(16s000ms): 24.80 MB, 26.45 MB, 26.45 MB, 26.45 MB, 26.45 MB, 26.45 MB, 26.45 MB, 26.45 MB, 26.45 MB, 26.45 MB, 26.45 MB, 26.45 MB, 26.45 MB, 26.45 MB, 26.45 MB, 26.45 MB, 26.45 MB, 26.45 MB, 26.45 MB, 26.45 MB, 26.45 MB, 26.45 MB, 26.45 MB, 26.45 MB, 26.45 MB, 26.45 MB, 26.45 MB, 26.45 MB, 26.45 MB, 26.45 MB, 26.45 MB, 26.45 MB, 26.45 MB, 26.45 MB, 26.45 MB, 26.45 MB, 26.45 MB, 26.45 MB, 26.45 MB - FooterProcessingTime: (Avg: 64.958ms ; Min: 40.118ms ; Max: 92.671ms ; Number of samples: 6) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 11.98 - BytesRead: 26.45 MB (27734018) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 12.815ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 0 (0) - NumRowGroups: 6 (6) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 47.56 MB (49874676) - PerReadThreadRawHdfsThroughput: 57.82 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 2.11M (2113536) - RowsReturned: 1.99M (1994752) - RowsReturnedRate: 2.68 M/sec - ScanRangesComplete: 150 (150) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 457.428ms - TotalReadThroughput: 42.69 KB/sec Filter 2 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 3 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 4 (1.00 MB): - Files processed: 156 (156) - Files rejected: 150 (150) - Files total: 156 (156) - RowGroups processed: 2.06K (2064) - RowGroups rejected: 0 (0) - RowGroups total: 2.06K (2064) - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) - Splits processed: 6 (6) - Splits rejected: 0 (0) - Splits total: 6 (6) Instance 7f40dcb034de70b7:1a5 (host=vd1117.foo:22000):(Total: 1s158ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 4:20/4.54 GB 5:17/4.19 GB 7:23/5.43 GB 2:19/4.44 GB 6:20/4.68 GB 3:25/6.16 GB 0:19/4.53 GB 1:11/2.71 GB Filter 4 arrival: 424ms Filter 2 arrival: 6s891ms Filter 3 arrival: 9m23s MemoryUsage(16s000ms): 51.11 MB, 61.02 MB, 61.02 MB, 61.02 MB, 61.02 MB, 61.02 MB, 61.02 MB, 61.02 MB, 61.02 MB, 61.02 MB, 61.02 MB, 61.02 MB, 61.02 MB, 61.02 MB, 61.02 MB, 61.02 MB, 61.02 MB, 61.02 MB, 61.02 MB, 61.02 MB, 61.02 MB, 61.02 MB, 61.02 MB, 61.02 MB, 61.02 MB, 61.02 MB, 61.02 MB, 61.02 MB, 61.02 MB, 61.02 MB, 61.02 MB, 61.02 MB, 61.02 MB, 61.02 MB, 61.02 MB, 61.02 MB, 61.02 MB, 61.02 MB, 61.02 MB ThreadUsage(16s000ms): 12, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.99 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 61.02 MB (63986408) - PerHostPeakMemUsage: 169.56 GB (182068232415) - RowsProduced: 2.03M (2031616) - TotalNetworkReceiveTime: 195.002ms - TotalNetworkSendTime: 639.936us - TotalStorageWaitTime: 925.898ms - TotalThreadsInvoluntaryContextSwitches: 21 (21) - TotalThreadsTotalWallClockTime: 1s309ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 188.970ms - TotalThreadsVoluntaryContextSwitches: 39 (39) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 51.375ms - OpenTime: 1s113ms - ExecTreeOpenTime: 926.480ms - PrepareTime: 45.627ms - ExecTreePrepareTime: 534.661us DataStreamSender (dst_id=24):(Total: 272.080ms, non-child: 272.080ms, % non-child: 100.00%) - BytesSent: 17.51 MB (18357096) - NetworkThroughput(*): 100.92 MB/sec - OverallThroughput: 64.34 MB/sec - PeakMemoryUsage: 4.67 MB (4896512) - RowsReturned: 2.03M (2030592) - SerializeBatchTime: 97.750ms - TransmitDataRPCTime: 173.472ms - UncompressedRowBatchSize: 56.73 MB (59481792) CodeGen:(Total: 202.133ms, non-child: 202.133ms, % non-child: 100.00%) - CodegenTime: 1.059ms - CompileTime: 53.494ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 131.527ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 16.642ms HASH_JOIN_NODE (id=8):(Total: 978.296ms, non-child: 45.450ms, % non-child: 4.65%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.306ms - PeakMemoryUsage: 1.11 MB (1162005) - ProbeRows: 2.03M (2031616) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 41.651ms - RowsReturned: 2.03M (2030592) - RowsReturnedRate: 2.08 M/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 23.487us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 141.540us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 55.633us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=19):(Total: 195.011ms, non-child: 17.493us, % non-child: 0.01%) BytesReceived(16s000ms): 963.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 4.413us - DeserializeRowBatchTimer: 40.289us - FirstBatchArrivalWaitTime: 178.992ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 615.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=6):(Total: 737.908ms, non-child: 737.908ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:20/4.54 GB 5:17/4.19 GB 7:23/5.43 GB 2:19/4.44 GB 6:20/4.68 GB 3:25/6.16 GB 0:19/4.53 GB 1:11/2.71 GB ExecOption: PARQUET Codegen Enabled Runtime filters: Only following filters arrived: 4, waited 602ms BytesRead(16s000ms): 19.50 MB, 21.36 MB, 21.36 MB, 21.36 MB, 21.36 MB, 21.36 MB, 21.36 MB, 21.36 MB, 21.36 MB, 21.36 MB, 21.36 MB, 21.36 MB, 21.36 MB, 21.36 MB, 21.36 MB, 21.36 MB, 21.36 MB, 21.36 MB, 21.36 MB, 21.36 MB, 21.36 MB, 21.36 MB, 21.36 MB, 21.36 MB, 21.36 MB, 21.36 MB, 21.36 MB, 21.36 MB, 21.36 MB, 21.36 MB, 21.36 MB, 21.36 MB, 21.36 MB, 21.36 MB, 21.36 MB, 21.36 MB, 21.36 MB, 21.36 MB, 21.36 MB - FooterProcessingTime: (Avg: 77.502ms ; Min: 42.936ms ; Max: 111.081ms ; Number of samples: 5) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 12.00 - BytesRead: 21.36 MB (22397992) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 12.741ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 0 (0) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 39.33 MB (41240887) - PerReadThreadRawHdfsThroughput: 43.43 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 2.15M (2149376) - RowsReturned: 2.03M (2031616) - RowsReturnedRate: 2.75 M/sec - ScanRangesComplete: 149 (149) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 491.887ms - TotalReadThroughput: 34.34 KB/sec Filter 2 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 3 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 4 (1.00 MB): - Files processed: 154 (154) - Files rejected: 149 (149) - Files total: 154 (154) - RowGroups processed: 2.10K (2099) - RowGroups rejected: 0 (0) - RowGroups total: 2.10K (2099) - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) - Splits processed: 5 (5) - Splits rejected: 0 (0) - Splits total: 5 (5) Instance 7f40dcb034de70b7:202 (host=va1030.foo:22000):(Total: 1s158ms, non-child: 30.171ms, % non-child: 2.60%) Hdfs split stats (:<# splits>/): 1:17/3.87 GB 5:19/4.69 GB 0:20/4.90 GB 6:12/2.96 GB 7:21/5.00 GB 4:21/4.90 GB 2:21/5.12 GB 3:20/4.93 GB Filter 4 arrival: 282ms Filter 2 arrival: 9s494ms Filter 3 arrival: 9m23s MemoryUsage(16s000ms): 57.22 MB, 69.86 MB, 69.86 MB, 69.86 MB, 69.86 MB, 69.86 MB, 69.86 MB, 69.86 MB, 69.86 MB, 69.86 MB, 69.86 MB, 69.86 MB, 69.86 MB, 69.86 MB, 69.86 MB, 69.86 MB, 69.86 MB, 69.86 MB, 69.86 MB, 69.86 MB, 69.86 MB, 69.86 MB, 69.86 MB, 69.86 MB, 69.86 MB, 69.86 MB, 69.86 MB, 69.86 MB, 69.86 MB, 69.86 MB, 69.86 MB, 69.86 MB, 69.86 MB, 69.86 MB, 69.86 MB, 69.86 MB, 69.86 MB, 69.86 MB, 69.86 MB ThreadUsage(16s000ms): 12, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.99 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 69.86 MB (73252891) - PerHostPeakMemUsage: 169.57 GB (182077449644) - RowsProduced: 102.40K (102400) - TotalNetworkReceiveTime: 5.069us - TotalNetworkSendTime: 29.014us - TotalStorageWaitTime: 1s305ms - TotalThreadsInvoluntaryContextSwitches: 28 (28) - TotalThreadsTotalWallClockTime: 1s086ms - TotalThreadsSysTime: 5.999ms - TotalThreadsUserTime: 210.968ms - TotalThreadsVoluntaryContextSwitches: 55 (55) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 3.247ms - OpenTime: 1s085ms - ExecTreeOpenTime: 869.306ms - PrepareTime: 72.967ms - ExecTreePrepareTime: 1.125ms DataStreamSender (dst_id=24):(Total: 14.883ms, non-child: 14.883ms, % non-child: 100.00%) - BytesSent: 405.03 KB (414755) - NetworkThroughput(*): 67.94 MB/sec - OverallThroughput: 26.58 MB/sec - PeakMemoryUsage: 4.69 MB (4921088) - RowsReturned: 101.38K (101376) - SerializeBatchTime: 7.763ms - TransmitDataRPCTime: 5.821ms - UncompressedRowBatchSize: 1.32 MB (1384336) CodeGen:(Total: 238.907ms, non-child: 238.907ms, % non-child: 100.00%) - CodegenTime: 1.343ms - CompileTime: 75.526ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 138.777ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 23.986ms HASH_JOIN_NODE (id=8):(Total: 874.728ms, non-child: 4.679ms, % non-child: 0.53%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.436ms - PeakMemoryUsage: 1.10 MB (1150844) - ProbeRows: 102.40K (102400) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 2.663ms - RowsReturned: 101.38K (101376) - RowsReturnedRate: 115.89 K/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 24.011us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 120.276us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 44.511us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=19):(Total: 16.164us, non-child: 16.164us, % non-child: 100.00%) BytesReceived(16s000ms): 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 5.396us - DeserializeRowBatchTimer: 23.096us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 7.42 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=6):(Total: 870.040ms, non-child: 870.040ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:17/3.87 GB 5:19/4.69 GB 0:20/4.90 GB 6:12/2.96 GB 7:21/5.00 GB 4:21/4.90 GB 2:21/5.12 GB 3:20/4.93 GB ExecOption: PARQUET Codegen Enabled Runtime filters: Only following filters arrived: 4, waited 743ms BytesRead(16s000ms): 28.04 MB, 29.91 MB, 29.91 MB, 29.91 MB, 29.91 MB, 29.91 MB, 29.91 MB, 29.91 MB, 29.91 MB, 29.91 MB, 29.91 MB, 29.91 MB, 29.91 MB, 29.91 MB, 29.91 MB, 29.91 MB, 29.91 MB, 29.91 MB, 29.91 MB, 29.91 MB, 29.91 MB, 29.91 MB, 29.91 MB, 29.91 MB, 29.91 MB, 29.91 MB, 29.91 MB, 29.91 MB, 29.91 MB, 29.91 MB, 29.91 MB, 29.91 MB, 29.91 MB, 29.91 MB, 29.91 MB, 29.91 MB, 29.91 MB, 29.91 MB, 29.91 MB - FooterProcessingTime: (Avg: 65.924ms ; Min: 46.884ms ; Max: 104.115ms ; Number of samples: 7) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 11.99 - BytesRead: 29.91 MB (31360065) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 1.959ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 0 (0) - NumRowGroups: 7 (7) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 47.61 MB (49923996) - PerReadThreadRawHdfsThroughput: 44.93 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 222.21K (222208) - RowsReturned: 102.40K (102400) - RowsReturnedRate: 117.69 K/sec - ScanRangesComplete: 144 (144) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 665.665ms - TotalReadThroughput: 47.96 KB/sec Filter 2 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 3 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 4 (1.00 MB): - Files processed: 151 (151) - Files rejected: 144 (144) - Files total: 151 (151) - RowGroups processed: 217 (217) - RowGroups rejected: 0 (0) - RowGroups total: 217 (217) - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) - Splits processed: 7 (7) - Splits rejected: 0 (0) - Splits total: 7 (7) Instance 7f40dcb034de70b7:1e5 (host=vc1509.foo:22000):(Total: 1s157ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 4:15/3.68 GB 7:22/5.03 GB 2:23/5.14 GB 1:21/4.15 GB 0:13/3.05 GB 3:22/5.28 GB 5:25/5.65 GB 6:19/4.47 GB Filter 4 arrival: 246ms Filter 2 arrival: 7s688ms Filter 3 arrival: 9m23s MemoryUsage(16s000ms): 47.41 MB, 57.26 MB, 57.26 MB, 57.26 MB, 57.26 MB, 57.26 MB, 57.26 MB, 57.26 MB, 57.26 MB, 57.26 MB, 57.26 MB, 57.26 MB, 57.26 MB, 57.26 MB, 57.26 MB, 57.26 MB, 57.26 MB, 57.26 MB, 57.26 MB, 57.26 MB, 57.26 MB, 57.26 MB, 57.26 MB, 57.26 MB, 57.26 MB, 57.26 MB, 57.26 MB, 57.26 MB, 57.26 MB, 57.26 MB, 57.26 MB, 57.26 MB, 57.26 MB, 57.26 MB, 57.26 MB, 57.26 MB, 57.26 MB, 57.26 MB, 57.26 MB ThreadUsage(16s000ms): 12, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.98 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 57.26 MB (60045547) - PerHostPeakMemUsage: 169.56 GB (182064302952) - RowsProduced: 342.02K (342016) - TotalNetworkReceiveTime: 3.388us - TotalNetworkSendTime: 2.523ms - TotalStorageWaitTime: 807.732ms - TotalThreadsInvoluntaryContextSwitches: 32 (32) - TotalThreadsTotalWallClockTime: 1s091ms - TotalThreadsSysTime: 999.000us - TotalThreadsUserTime: 185.971ms - TotalThreadsVoluntaryContextSwitches: 63 (63) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 13.062ms - OpenTime: 1s090ms - ExecTreeOpenTime: 903.728ms - PrepareTime: 67.209ms - ExecTreePrepareTime: 762.268us DataStreamSender (dst_id=24):(Total: 48.295ms, non-child: 48.295ms, % non-child: 100.00%) - BytesSent: 2.53 MB (2651791) - NetworkThroughput(*): 94.32 MB/sec - OverallThroughput: 52.36 MB/sec - PeakMemoryUsage: 4.56 MB (4781824) - RowsReturned: 340.99K (340992) - SerializeBatchTime: 19.865ms - TransmitDataRPCTime: 26.811ms - UncompressedRowBatchSize: 8.37 MB (8774904) CodeGen:(Total: 210.923ms, non-child: 210.923ms, % non-child: 100.00%) - CodegenTime: 1.090ms - CompileTime: 53.844ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 130.813ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 25.790ms HASH_JOIN_NODE (id=8):(Total: 918.105ms, non-child: 13.088ms, % non-child: 1.43%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.221ms - PeakMemoryUsage: 1.10 MB (1152735) - ProbeRows: 342.02K (342016) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 11.100ms - RowsReturned: 340.99K (340992) - RowsReturnedRate: 371.41 K/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 20.136us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 105.506us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 49.133us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=19):(Total: 11.498us, non-child: 11.498us, % non-child: 100.00%) BytesReceived(16s000ms): 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 3.899us - DeserializeRowBatchTimer: 8.828us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 10.44 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=6):(Total: 905.011ms, non-child: 905.011ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:15/3.68 GB 7:22/5.03 GB 2:23/5.14 GB 1:21/4.15 GB 0:13/3.05 GB 3:22/5.28 GB 5:25/5.65 GB 6:19/4.47 GB ExecOption: PARQUET Codegen Enabled Runtime filters: Only following filters arrived: 4, waited 783ms BytesRead(16s000ms): 19.67 MB, 20.98 MB, 20.98 MB, 20.98 MB, 20.98 MB, 20.98 MB, 20.98 MB, 20.98 MB, 20.98 MB, 20.98 MB, 20.98 MB, 20.98 MB, 20.98 MB, 20.98 MB, 20.98 MB, 20.98 MB, 20.98 MB, 20.98 MB, 20.98 MB, 20.98 MB, 20.98 MB, 20.98 MB, 20.98 MB, 20.98 MB, 20.98 MB, 20.98 MB, 20.98 MB, 20.98 MB, 20.98 MB, 20.98 MB, 20.98 MB, 20.98 MB, 20.98 MB, 20.98 MB, 20.98 MB, 20.98 MB, 20.98 MB, 20.98 MB, 20.98 MB - FooterProcessingTime: (Avg: 66.974ms ; Min: 39.496ms ; Max: 88.035ms ; Number of samples: 5) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 11.98 - BytesRead: 20.98 MB (22003337) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 2.638ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 0 (0) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 35.15 MB (36854456) - PerReadThreadRawHdfsThroughput: 56.70 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 459.78K (459776) - RowsReturned: 342.02K (342016) - RowsReturnedRate: 377.91 K/sec - ScanRangesComplete: 155 (155) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 370.068ms - TotalReadThroughput: 33.79 KB/sec Filter 2 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 3 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 4 (1.00 MB): - Files processed: 160 (160) - Files rejected: 155 (155) - Files total: 160 (160) - RowGroups processed: 449 (449) - RowGroups rejected: 0 (0) - RowGroups total: 449 (449) - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) - Splits processed: 5 (5) - Splits rejected: 0 (0) - Splits total: 5 (5) Instance 7f40dcb034de70b7:1cc (host=ve1139.foo:22000):(Total: 1s157ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 2:23/5.46 GB 4:15/3.41 GB 5:18/4.17 GB 0:21/4.84 GB 7:25/5.76 GB 3:19/4.68 GB 1:17/4.19 GB 6:19/4.30 GB Filter 4 arrival: 296ms Filter 2 arrival: 7s413ms Filter 3 arrival: 9m23s MemoryUsage(16s000ms): 57.54 MB, 69.87 MB, 69.87 MB, 69.87 MB, 69.87 MB, 69.87 MB, 69.87 MB, 69.87 MB, 69.87 MB, 69.87 MB, 69.87 MB, 69.87 MB, 69.87 MB, 69.87 MB, 69.87 MB, 69.87 MB, 69.87 MB, 69.87 MB, 69.87 MB, 69.87 MB, 69.87 MB, 69.87 MB, 69.87 MB, 69.87 MB, 69.87 MB, 69.87 MB, 69.87 MB, 69.87 MB, 69.87 MB, 69.87 MB, 69.87 MB, 69.87 MB, 69.87 MB, 69.87 MB, 69.87 MB, 69.87 MB, 69.87 MB, 69.87 MB, 69.87 MB, 69.87 MB ThreadUsage(16s000ms): 12, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.99 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 69.87 MB (73261716) - PerHostPeakMemUsage: 169.57 GB (182077340353) - RowsProduced: 871.42K (871424) - TotalNetworkReceiveTime: 4.834us - TotalNetworkSendTime: 269.365us - TotalStorageWaitTime: 1s251ms - TotalThreadsInvoluntaryContextSwitches: 39 (39) - TotalThreadsTotalWallClockTime: 1s098ms - TotalThreadsSysTime: 5.998ms - TotalThreadsUserTime: 228.966ms - TotalThreadsVoluntaryContextSwitches: 115 (115) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 25.027ms - OpenTime: 1s097ms - ExecTreeOpenTime: 858.365ms - PrepareTime: 59.611ms - ExecTreePrepareTime: 596.750us DataStreamSender (dst_id=24):(Total: 125.966ms, non-child: 125.966ms, % non-child: 100.00%) - BytesSent: 7.24 MB (7591809) - NetworkThroughput(*): 101.55 MB/sec - OverallThroughput: 57.48 MB/sec - PeakMemoryUsage: 4.79 MB (5019392) - RowsReturned: 870.40K (870400) - SerializeBatchTime: 53.853ms - TransmitDataRPCTime: 71.292ms - UncompressedRowBatchSize: 23.49 MB (24627784) CodeGen:(Total: 264.506ms, non-child: 264.506ms, % non-child: 100.00%) - CodegenTime: 1.321ms - CompileTime: 75.865ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 161.367ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 26.652ms HASH_JOIN_NODE (id=8):(Total: 884.166ms, non-child: 23.381ms, % non-child: 2.64%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.454ms - PeakMemoryUsage: 1.11 MB (1162380) - ProbeRows: 871.42K (871424) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 20.224ms - RowsReturned: 870.40K (870400) - RowsReturnedRate: 984.43 K/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 22.087us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 98.787us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 56.222us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=19):(Total: 18.372us, non-child: 18.372us, % non-child: 100.00%) BytesReceived(16s000ms): 963.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 9.121us - DeserializeRowBatchTimer: 11.918us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 6.53 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=6):(Total: 860.772ms, non-child: 860.772ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:23/5.46 GB 4:15/3.41 GB 5:18/4.17 GB 0:21/4.84 GB 7:25/5.76 GB 3:19/4.68 GB 1:17/4.19 GB 6:19/4.30 GB ExecOption: PARQUET Codegen Enabled Runtime filters: Only following filters arrived: 4, waited 743ms BytesRead(16s000ms): 26.22 MB, 28.93 MB, 28.93 MB, 28.93 MB, 28.93 MB, 28.93 MB, 28.93 MB, 28.93 MB, 28.93 MB, 28.93 MB, 28.93 MB, 28.93 MB, 28.93 MB, 28.93 MB, 28.93 MB, 28.93 MB, 28.93 MB, 28.93 MB, 28.93 MB, 28.93 MB, 28.93 MB, 28.93 MB, 28.93 MB, 28.93 MB, 28.93 MB, 28.93 MB, 28.93 MB, 28.93 MB, 28.93 MB, 28.93 MB, 28.93 MB, 28.93 MB, 28.93 MB, 28.93 MB, 28.93 MB, 28.93 MB, 28.93 MB, 28.93 MB, 28.93 MB, 28.93 MB - FooterProcessingTime: (Avg: 62.854ms ; Min: 33.138ms ; Max: 113.567ms ; Number of samples: 7) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 12.00 - BytesRead: 28.93 MB (30339627) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 6.935ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 0 (0) - NumRowGroups: 7 (7) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 47.79 MB (50116171) - PerReadThreadRawHdfsThroughput: 45.27 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 991.23K (991232) - RowsReturned: 871.42K (871424) - RowsReturnedRate: 1.01 M/sec - ScanRangesComplete: 150 (150) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 639.173ms - TotalReadThroughput: 46.26 KB/sec Filter 2 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 3 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 4 (1.00 MB): - Files processed: 157 (157) - Files rejected: 150 (150) - Files total: 157 (157) - RowGroups processed: 968 (968) - RowGroups rejected: 0 (0) - RowGroups total: 968 (968) - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) - Splits processed: 7 (7) - Splits rejected: 0 (0) - Splits total: 7 (7) Instance 7f40dcb034de70b7:1d4 (host=vc1528.foo:22000):(Total: 1s157ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 4:23/5.47 GB 7:14/3.28 GB 1:16/3.95 GB 2:21/5.00 GB 6:16/3.77 GB 5:16/3.89 GB 0:25/5.94 GB 3:23/5.29 GB Filter 4 arrival: 249ms Filter 2 arrival: 7s471ms Filter 3 arrival: 9m23s MemoryUsage(16s000ms): 63.05 MB, 73.95 MB, 73.95 MB, 73.95 MB, 73.95 MB, 73.95 MB, 73.95 MB, 73.95 MB, 73.95 MB, 73.95 MB, 73.95 MB, 73.95 MB, 73.95 MB, 73.95 MB, 73.95 MB, 73.95 MB, 73.95 MB, 73.95 MB, 73.95 MB, 73.95 MB, 73.95 MB, 73.95 MB, 73.95 MB, 73.95 MB, 73.95 MB, 73.95 MB, 73.95 MB, 73.95 MB, 73.95 MB, 73.95 MB, 73.95 MB, 73.95 MB, 73.95 MB, 73.95 MB, 73.95 MB, 73.95 MB, 73.95 MB, 73.95 MB, 73.95 MB ThreadUsage(16s000ms): 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 13.00 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 73.95 MB (77543886) - PerHostPeakMemUsage: 169.58 GB (182081766840) - RowsProduced: 786.43K (786432) - TotalNetworkReceiveTime: 2.782us - TotalNetworkSendTime: 268.223us - TotalStorageWaitTime: 1s360ms - TotalThreadsInvoluntaryContextSwitches: 33 (33) - TotalThreadsTotalWallClockTime: 1s101ms - TotalThreadsSysTime: 2.999ms - TotalThreadsUserTime: 194.970ms - TotalThreadsVoluntaryContextSwitches: 71 (71) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 23.096ms - OpenTime: 1s101ms - ExecTreeOpenTime: 903.392ms - PrepareTime: 55.871ms - ExecTreePrepareTime: 567.951us DataStreamSender (dst_id=24):(Total: 111.841ms, non-child: 111.841ms, % non-child: 100.00%) - BytesSent: 6.42 MB (6736963) - NetworkThroughput(*): 94.85 MB/sec - OverallThroughput: 57.45 MB/sec - PeakMemoryUsage: 4.97 MB (5207808) - RowsReturned: 785.41K (785408) - SerializeBatchTime: 43.701ms - TransmitDataRPCTime: 67.736ms - UncompressedRowBatchSize: 20.95 MB (21970752) CodeGen:(Total: 220.510ms, non-child: 220.510ms, % non-child: 100.00%) - CodegenTime: 1.170ms - CompileTime: 58.776ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 136.859ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 24.410ms HASH_JOIN_NODE (id=8):(Total: 927.305ms, non-child: 21.054ms, % non-child: 2.27%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 950.310us - PeakMemoryUsage: 1.10 MB (1157356) - ProbeRows: 786.43K (786432) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 18.921ms - RowsReturned: 785.41K (785408) - RowsReturnedRate: 846.98 K/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 21.165us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 84.546us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 48.727us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=19):(Total: 11.759us, non-child: 11.759us, % non-child: 100.00%) BytesReceived(16s000ms): 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 4.507us - DeserializeRowBatchTimer: 15.896us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 10.20 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=6):(Total: 906.243ms, non-child: 906.243ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:23/5.47 GB 7:14/3.28 GB 1:16/3.95 GB 2:21/5.00 GB 6:16/3.77 GB 5:16/3.89 GB 0:25/5.94 GB 3:23/5.29 GB ExecOption: PARQUET Codegen Enabled Runtime filters: Only following filters arrived: 4, waited 783ms BytesRead(16s000ms): 31.13 MB, 33.20 MB, 33.20 MB, 33.20 MB, 33.20 MB, 33.20 MB, 33.20 MB, 33.20 MB, 33.20 MB, 33.20 MB, 33.20 MB, 33.20 MB, 33.20 MB, 33.20 MB, 33.20 MB, 33.20 MB, 33.20 MB, 33.20 MB, 33.20 MB, 33.20 MB, 33.20 MB, 33.20 MB, 33.20 MB, 33.20 MB, 33.20 MB, 33.20 MB, 33.20 MB, 33.20 MB, 33.20 MB, 33.20 MB, 33.20 MB, 33.20 MB, 33.20 MB, 33.20 MB, 33.20 MB, 33.20 MB, 33.20 MB, 33.20 MB, 33.20 MB - FooterProcessingTime: (Avg: 58.801ms ; Min: 21.267ms ; Max: 93.782ms ; Number of samples: 8) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 12.00 - BytesRead: 33.20 MB (34813938) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 5.728ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 0 (0) - NumRowGroups: 8 (8) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 52.00 MB (54525286) - PerReadThreadRawHdfsThroughput: 51.02 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 907.26K (907264) - RowsReturned: 786.43K (786432) - RowsReturnedRate: 867.79 K/sec - ScanRangesComplete: 146 (146) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 650.774ms - TotalReadThroughput: 53.25 KB/sec Filter 2 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 3 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 4 (1.00 MB): - Files processed: 154 (154) - Files rejected: 146 (146) - Files total: 154 (154) - RowGroups processed: 886 (886) - RowGroups rejected: 0 (0) - RowGroups total: 886 (886) - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) - Splits processed: 8 (8) - Splits rejected: 0 (0) - Splits total: 8 (8) Instance 7f40dcb034de70b7:1d2 (host=vd1104.foo:22000):(Total: 1s155ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 2:17/4.19 GB 6:13/2.75 GB 5:20/4.71 GB 0:14/3.08 GB 3:22/5.27 GB 1:24/5.13 GB 4:22/5.42 GB 7:26/6.18 GB Filter 4 arrival: 263ms Filter 2 arrival: 7s442ms Filter 3 arrival: 9m23s MemoryUsage(16s000ms): 61.45 MB, 71.71 MB, 71.71 MB, 71.71 MB, 71.71 MB, 71.71 MB, 71.71 MB, 71.71 MB, 71.71 MB, 71.71 MB, 71.71 MB, 71.71 MB, 71.71 MB, 71.71 MB, 71.71 MB, 71.71 MB, 71.71 MB, 71.71 MB, 71.71 MB, 71.71 MB, 71.71 MB, 71.71 MB, 71.71 MB, 71.71 MB, 71.71 MB, 71.71 MB, 71.71 MB, 71.71 MB, 71.71 MB, 71.71 MB, 71.71 MB, 71.71 MB, 71.71 MB, 71.71 MB, 71.71 MB, 71.71 MB, 71.71 MB, 71.71 MB, 71.71 MB ThreadUsage(16s000ms): 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 13.00 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 71.71 MB (75192936) - PerHostPeakMemUsage: 169.57 GB (182079364681) - RowsProduced: 784.38K (784384) - TotalNetworkReceiveTime: 14.462ms - TotalNetworkSendTime: 23.488ms - TotalStorageWaitTime: 1s310ms - TotalThreadsInvoluntaryContextSwitches: 31 (31) - TotalThreadsTotalWallClockTime: 1s103ms - TotalThreadsSysTime: 2.999ms - TotalThreadsUserTime: 186.971ms - TotalThreadsVoluntaryContextSwitches: 81 (81) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 19.753ms - OpenTime: 1s087ms - ExecTreeOpenTime: 898.064ms - PrepareTime: 67.476ms - ExecTreePrepareTime: 1.147ms DataStreamSender (dst_id=24):(Total: 110.539ms, non-child: 110.539ms, % non-child: 100.00%) - BytesSent: 6.45 MB (6765442) - NetworkThroughput(*): 94.76 MB/sec - OverallThroughput: 58.37 MB/sec - PeakMemoryUsage: 4.57 MB (4790016) - RowsReturned: 783.36K (783360) - SerializeBatchTime: 41.136ms - TransmitDataRPCTime: 68.085ms - UncompressedRowBatchSize: 20.93 MB (21948424) CodeGen:(Total: 214.706ms, non-child: 214.706ms, % non-child: 100.00%) - CodegenTime: 1.299ms - CompileTime: 57.412ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 130.371ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 26.388ms HASH_JOIN_NODE (id=8):(Total: 919.782ms, non-child: 18.195ms, % non-child: 1.98%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.259ms - PeakMemoryUsage: 1.11 MB (1162506) - ProbeRows: 784.38K (784384) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 15.638ms - RowsReturned: 783.36K (783360) - RowsReturnedRate: 851.68 K/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 23.507us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 143.997us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 51.229us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=19):(Total: 14.490ms, non-child: 34.466us, % non-child: 0.24%) BytesReceived(16s000ms): 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 5.309us - DeserializeRowBatchTimer: 18.779us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 8.28 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=6):(Total: 887.103ms, non-child: 887.103ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:17/4.19 GB 6:13/2.75 GB 5:20/4.71 GB 0:14/3.08 GB 3:22/5.27 GB 1:24/5.13 GB 4:22/5.42 GB 7:26/6.18 GB ExecOption: PARQUET Codegen Enabled Runtime filters: Only following filters arrived: 4, waited 764ms BytesRead(16s000ms): 26.59 MB, 28.36 MB, 28.36 MB, 28.36 MB, 28.36 MB, 28.36 MB, 28.36 MB, 28.36 MB, 28.36 MB, 28.36 MB, 28.36 MB, 28.36 MB, 28.36 MB, 28.36 MB, 28.36 MB, 28.36 MB, 28.36 MB, 28.36 MB, 28.36 MB, 28.36 MB, 28.36 MB, 28.36 MB, 28.36 MB, 28.36 MB, 28.36 MB, 28.36 MB, 28.36 MB, 28.36 MB, 28.36 MB, 28.36 MB, 28.36 MB, 28.36 MB, 28.36 MB, 28.36 MB, 28.36 MB, 28.36 MB, 28.36 MB, 28.36 MB, 28.36 MB - FooterProcessingTime: (Avg: 59.013ms ; Min: 24.156ms ; Max: 95.267ms ; Number of samples: 7) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 12.00 - BytesRead: 28.36 MB (29740892) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 4.369ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 0 (0) - NumRowGroups: 7 (7) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 49.69 MB (52101609) - PerReadThreadRawHdfsThroughput: 46.84 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 904.19K (904192) - RowsReturned: 784.38K (784384) - RowsReturnedRate: 884.21 K/sec - ScanRangesComplete: 151 (151) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 605.571ms - TotalReadThroughput: 45.59 KB/sec Filter 2 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 3 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 4 (1.00 MB): - Files processed: 158 (158) - Files rejected: 151 (151) - Files total: 158 (158) - RowGroups processed: 883 (883) - RowGroups rejected: 0 (0) - RowGroups total: 883 (883) - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) - Splits processed: 7 (7) - Splits rejected: 0 (0) - Splits total: 7 (7) Instance 7f40dcb034de70b7:1c9 (host=vd1102.foo:22000):(Total: 1s155ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 1:17/4.19 GB 0:22/4.96 GB 3:22/4.79 GB 2:18/4.12 GB 7:22/4.97 GB 6:24/5.67 GB 5:21/4.72 GB 4:16/3.32 GB Filter 4 arrival: 299ms Filter 2 arrival: 7s310ms Filter 3 arrival: 9m23s MemoryUsage(16s000ms): 47.85 MB, 57.20 MB, 57.20 MB, 57.20 MB, 57.20 MB, 57.20 MB, 57.20 MB, 57.20 MB, 57.20 MB, 57.20 MB, 57.20 MB, 57.20 MB, 57.20 MB, 57.20 MB, 57.20 MB, 57.20 MB, 57.20 MB, 57.20 MB, 57.20 MB, 57.20 MB, 57.20 MB, 57.20 MB, 57.20 MB, 57.20 MB, 57.20 MB, 57.20 MB, 57.20 MB, 57.20 MB, 57.20 MB, 57.20 MB, 57.20 MB, 57.20 MB, 57.20 MB, 57.20 MB, 57.20 MB, 57.20 MB, 57.20 MB, 57.20 MB, 57.20 MB ThreadUsage(16s000ms): 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 13.00 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 57.20 MB (59980292) - PerHostPeakMemUsage: 169.56 GB (182064217136) - RowsProduced: 868.35K (868352) - TotalNetworkReceiveTime: 18.089ms - TotalNetworkSendTime: 12.831ms - TotalStorageWaitTime: 839.341ms - TotalThreadsInvoluntaryContextSwitches: 37 (37) - TotalThreadsTotalWallClockTime: 1s117ms - TotalThreadsSysTime: 4.999ms - TotalThreadsUserTime: 221.966ms - TotalThreadsVoluntaryContextSwitches: 87 (87) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 26.446ms - OpenTime: 1s098ms - ExecTreeOpenTime: 870.199ms - PrepareTime: 56.163ms - ExecTreePrepareTime: 634.540us DataStreamSender (dst_id=24):(Total: 129.334ms, non-child: 129.334ms, % non-child: 100.00%) - BytesSent: 7.17 MB (7522439) - NetworkThroughput(*): 96.77 MB/sec - OverallThroughput: 55.47 MB/sec - PeakMemoryUsage: 4.84 MB (5076736) - RowsReturned: 867.33K (867328) - SerializeBatchTime: 54.571ms - TransmitDataRPCTime: 74.137ms - UncompressedRowBatchSize: 23.38 MB (24516144) CodeGen:(Total: 251.497ms, non-child: 251.497ms, % non-child: 100.00%) - CodegenTime: 1.340ms - CompileTime: 70.986ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 155.654ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 24.291ms HASH_JOIN_NODE (id=8):(Total: 897.534ms, non-child: 22.744ms, % non-child: 2.53%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 821.899us - PeakMemoryUsage: 1.10 MB (1154837) - ProbeRows: 868.35K (868352) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 20.519ms - RowsReturned: 867.33K (867328) - RowsReturnedRate: 966.35 K/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 23.869us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 68.830us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 58.230us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=19):(Total: 18.095ms, non-child: 12.771us, % non-child: 0.07%) BytesReceived(16s000ms): 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 3.295us - DeserializeRowBatchTimer: 18.760us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 6.63 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=6):(Total: 856.698ms, non-child: 856.698ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:17/4.19 GB 0:22/4.96 GB 3:22/4.79 GB 2:18/4.12 GB 7:22/4.97 GB 6:24/5.67 GB 5:21/4.72 GB 4:16/3.32 GB ExecOption: PARQUET Codegen Enabled Runtime filters: Only following filters arrived: 4, waited 724ms BytesRead(16s000ms): 19.68 MB, 20.99 MB, 20.99 MB, 20.99 MB, 20.99 MB, 20.99 MB, 20.99 MB, 20.99 MB, 20.99 MB, 20.99 MB, 20.99 MB, 20.99 MB, 20.99 MB, 20.99 MB, 20.99 MB, 20.99 MB, 20.99 MB, 20.99 MB, 20.99 MB, 20.99 MB, 20.99 MB, 20.99 MB, 20.99 MB, 20.99 MB, 20.99 MB, 20.99 MB, 20.99 MB, 20.99 MB, 20.99 MB, 20.99 MB, 20.99 MB, 20.99 MB, 20.99 MB, 20.99 MB, 20.99 MB, 20.99 MB, 20.99 MB, 20.99 MB, 20.99 MB - FooterProcessingTime: (Avg: 64.737ms ; Min: 48.076ms ; Max: 98.777ms ; Number of samples: 5) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 12.00 - BytesRead: 20.99 MB (22009427) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 5.930ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 0 (0) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 35.22 MB (36930832) - PerReadThreadRawHdfsThroughput: 44.57 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 986.11K (986112) - RowsReturned: 868.35K (868352) - RowsReturnedRate: 1.01 M/sec - ScanRangesComplete: 157 (157) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 470.897ms - TotalReadThroughput: 33.74 KB/sec Filter 2 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 3 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 4 (1.00 MB): - Files processed: 162 (162) - Files rejected: 157 (157) - Files total: 162 (162) - RowGroups processed: 963 (963) - RowGroups rejected: 0 (0) - RowGroups total: 963 (963) - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) - Splits processed: 5 (5) - Splits rejected: 0 (0) - Splits total: 5 (5) Instance 7f40dcb034de70b7:1e0 (host=vd1332.foo:22000):(Total: 1s154ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 3:20/4.83 GB 5:22/4.79 GB 4:14/3.11 GB 0:15/3.50 GB 6:29/6.72 GB 2:20/4.90 GB 7:21/4.74 GB 1:16/3.95 GB Filter 4 arrival: 251ms Filter 2 arrival: 7s638ms Filter 3 arrival: 9m23s MemoryUsage(16s000ms): 34.54 MB, 43.54 MB, 43.54 MB, 43.54 MB, 43.54 MB, 43.54 MB, 43.54 MB, 43.54 MB, 43.54 MB, 43.54 MB, 43.54 MB, 43.54 MB, 43.54 MB, 43.54 MB, 43.54 MB, 43.54 MB, 43.54 MB, 43.54 MB, 43.54 MB, 43.54 MB, 43.54 MB, 43.54 MB, 43.54 MB, 43.54 MB, 43.54 MB, 43.54 MB, 43.54 MB, 43.54 MB, 43.54 MB, 43.54 MB, 43.54 MB, 43.54 MB, 43.54 MB, 43.54 MB, 43.54 MB, 43.54 MB, 43.54 MB, 43.54 MB, 43.54 MB, 43.54 MB ThreadUsage(16s000ms): 12, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.99 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 43.54 MB (45652157) - PerHostPeakMemUsage: 169.55 GB (182049888199) - RowsProduced: 463.87K (463872) - TotalNetworkReceiveTime: 2.897us - TotalNetworkSendTime: 163.532us - TotalStorageWaitTime: 660.750ms - TotalThreadsInvoluntaryContextSwitches: 35 (35) - TotalThreadsTotalWallClockTime: 1s097ms - TotalThreadsSysTime: 2.000ms - TotalThreadsUserTime: 196.970ms - TotalThreadsVoluntaryContextSwitches: 53 (53) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 16.046ms - OpenTime: 1s096ms - ExecTreeOpenTime: 898.159ms - PrepareTime: 58.131ms - ExecTreePrepareTime: 611.762us DataStreamSender (dst_id=24):(Total: 69.458ms, non-child: 69.458ms, % non-child: 100.00%) - BytesSent: 3.64 MB (3814744) - NetworkThroughput(*): 94.42 MB/sec - OverallThroughput: 52.38 MB/sec - PeakMemoryUsage: 4.86 MB (5101312) - RowsReturned: 462.85K (462848) - SerializeBatchTime: 29.972ms - TransmitDataRPCTime: 38.530ms - UncompressedRowBatchSize: 11.84 MB (12414368) CodeGen:(Total: 220.390ms, non-child: 220.390ms, % non-child: 100.00%) - CodegenTime: 1.037ms - CompileTime: 56.682ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 139.930ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 23.294ms HASH_JOIN_NODE (id=8):(Total: 915.176ms, non-child: 15.208ms, % non-child: 1.66%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.155ms - PeakMemoryUsage: 1.11 MB (1160544) - ProbeRows: 463.87K (463872) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 13.222ms - RowsReturned: 462.85K (462848) - RowsReturnedRate: 505.75 K/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 20.106us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 104.058us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 47.238us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=19):(Total: 10.421us, non-child: 10.421us, % non-child: 100.00%) BytesReceived(16s000ms): 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 3.738us - DeserializeRowBatchTimer: 25.332us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 11.52 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=6):(Total: 899.963ms, non-child: 899.963ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:20/4.83 GB 5:22/4.79 GB 4:14/3.11 GB 0:15/3.50 GB 6:29/6.72 GB 2:20/4.90 GB 7:21/4.74 GB 1:16/3.95 GB ExecOption: PARQUET Codegen Enabled Runtime filters: Only following filters arrived: 4, waited 783ms BytesRead(16s000ms): 13.31 MB, 14.20 MB, 14.20 MB, 14.20 MB, 14.20 MB, 14.20 MB, 14.20 MB, 14.20 MB, 14.20 MB, 14.20 MB, 14.20 MB, 14.20 MB, 14.20 MB, 14.20 MB, 14.20 MB, 14.20 MB, 14.20 MB, 14.20 MB, 14.20 MB, 14.20 MB, 14.20 MB, 14.20 MB, 14.20 MB, 14.20 MB, 14.20 MB, 14.20 MB, 14.20 MB, 14.20 MB, 14.20 MB, 14.20 MB, 14.20 MB, 14.20 MB, 14.20 MB, 14.20 MB, 14.20 MB, 14.20 MB, 14.20 MB, 14.20 MB, 14.20 MB, 14.20 MB - FooterProcessingTime: (Avg: 55.448ms ; Min: 36.624ms ; Max: 83.518ms ; Number of samples: 5) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 11.99 - BytesRead: 14.20 MB (14890632) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 3.138ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 0 (0) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 21.64 MB (22689817) - PerReadThreadRawHdfsThroughput: 41.01 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 581.63K (581632) - RowsReturned: 463.87K (463872) - RowsReturnedRate: 515.43 K/sec - ScanRangesComplete: 152 (152) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 346.286ms - TotalReadThroughput: 22.72 KB/sec Filter 2 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 3 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 4 (1.00 MB): - Files processed: 157 (157) - Files rejected: 152 (152) - Files total: 157 (157) - RowGroups processed: 568 (568) - RowGroups rejected: 0 (0) - RowGroups total: 568 (568) - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) - Splits processed: 5 (5) - Splits rejected: 0 (0) - Splits total: 5 (5) Instance 7f40dcb034de70b7:194 (host=vc1537.foo:22000):(Total: 1s153ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 4:20/4.47 GB 1:19/4.68 GB 5:16/3.70 GB 6:22/5.34 GB 0:20/4.73 GB 2:25/6.01 GB 3:17/3.61 GB 7:18/4.24 GB Filter 4 arrival: 464ms Filter 2 arrival: 6s702ms Filter 3 arrival: 9m23s MemoryUsage(16s000ms): 58.51 MB, 69.71 MB, 69.71 MB, 69.71 MB, 69.71 MB, 69.71 MB, 69.71 MB, 69.71 MB, 69.71 MB, 69.71 MB, 69.71 MB, 69.71 MB, 69.71 MB, 69.71 MB, 69.71 MB, 69.71 MB, 69.71 MB, 69.71 MB, 69.71 MB, 69.71 MB, 69.71 MB, 69.71 MB, 69.71 MB, 69.71 MB, 69.71 MB, 69.71 MB, 69.71 MB, 69.71 MB, 69.71 MB, 69.71 MB, 69.71 MB, 69.71 MB, 69.71 MB, 69.71 MB, 69.71 MB, 69.71 MB, 69.71 MB, 69.71 MB, 69.71 MB ThreadUsage(16s000ms): 7, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8 - AverageThreadTokens: 7.99 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 69.71 MB (73098094) - PerHostPeakMemUsage: 169.57 GB (182071107149) - RowsProduced: 2.28M (2281472) - TotalNetworkReceiveTime: 229.594ms - TotalNetworkSendTime: 801.150us - TotalStorageWaitTime: 1s233ms - TotalThreadsInvoluntaryContextSwitches: 21 (21) - TotalThreadsTotalWallClockTime: 1s331ms - TotalThreadsSysTime: 2.999ms - TotalThreadsUserTime: 183.972ms - TotalThreadsVoluntaryContextSwitches: 47 (47) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 73.308ms - OpenTime: 1s101ms - ExecTreeOpenTime: 916.157ms - PrepareTime: 52.162ms - ExecTreePrepareTime: 542.353us DataStreamSender (dst_id=24):(Total: 314.003ms, non-child: 314.003ms, % non-child: 100.00%) - BytesSent: 19.77 MB (20727794) - NetworkThroughput(*): 98.23 MB/sec - OverallThroughput: 62.95 MB/sec - PeakMemoryUsage: 4.80 MB (5035776) - RowsReturned: 2.28M (2280448) - SerializeBatchTime: 111.984ms - TransmitDataRPCTime: 201.241ms - UncompressedRowBatchSize: 63.80 MB (66894688) CodeGen:(Total: 207.350ms, non-child: 207.350ms, % non-child: 100.00%) - CodegenTime: 1.147ms - CompileTime: 54.041ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 128.947ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 23.905ms HASH_JOIN_NODE (id=8):(Total: 989.711ms, non-child: 66.178ms, % non-child: 6.69%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.332ms - PeakMemoryUsage: 1.11 MB (1158885) - ProbeRows: 2.28M (2281472) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 62.314ms - RowsReturned: 2.28M (2280448) - RowsReturnedRate: 2.30 M/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 23.087us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 151.568us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 46.756us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=19):(Total: 229.603ms, non-child: 15.804us, % non-child: 0.01%) BytesReceived(16s000ms): 963.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 4.243us - DeserializeRowBatchTimer: 22.187us - FirstBatchArrivalWaitTime: 228.309ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 522.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=6):(Total: 694.021ms, non-child: 694.021ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:20/4.47 GB 1:19/4.68 GB 5:16/3.70 GB 6:22/5.34 GB 0:20/4.73 GB 2:25/6.01 GB 3:17/3.61 GB 7:18/4.24 GB ExecOption: PARQUET Codegen Enabled Runtime filters: Only following filters arrived: 4, waited 562ms BytesRead(16s000ms): 26.89 MB, 29.67 MB, 29.67 MB, 29.67 MB, 29.67 MB, 29.67 MB, 29.67 MB, 29.67 MB, 29.67 MB, 29.67 MB, 29.67 MB, 29.67 MB, 29.67 MB, 29.67 MB, 29.67 MB, 29.67 MB, 29.67 MB, 29.67 MB, 29.67 MB, 29.67 MB, 29.67 MB, 29.67 MB, 29.67 MB, 29.67 MB, 29.67 MB, 29.67 MB, 29.67 MB, 29.67 MB, 29.67 MB, 29.67 MB, 29.67 MB, 29.67 MB, 29.67 MB, 29.67 MB, 29.67 MB, 29.67 MB, 29.67 MB, 29.67 MB, 29.67 MB - FooterProcessingTime: (Avg: 86.208ms ; Min: 56.213ms ; Max: 117.649ms ; Number of samples: 7) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 6.99 - BytesRead: 29.67 MB (31106587) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 14.882ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 0 (0) - NumRowGroups: 7 (7) - NumScannerThreadsStarted: 7 (7) - PeakMemoryUsage: 47.89 MB (50217904) - PerReadThreadRawHdfsThroughput: 50.98 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 2.40M (2401280) - RowsReturned: 2.28M (2281472) - RowsReturnedRate: 3.29 M/sec - ScanRangesComplete: 150 (150) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 581.891ms - TotalReadThroughput: 47.76 KB/sec Filter 2 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 3 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 4 (1.00 MB): - Files processed: 157 (157) - Files rejected: 150 (150) - Files total: 157 (157) - RowGroups processed: 2.35K (2345) - RowGroups rejected: 0 (0) - RowGroups total: 2.35K (2345) - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) - Splits processed: 7 (7) - Splits rejected: 0 (0) - Splits total: 7 (7) Instance 7f40dcb034de70b7:1d6 (host=va1034.foo:22000):(Total: 1s153ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 5:18/4.28 GB 0:21/5.03 GB 2:16/3.94 GB 3:19/4.42 GB 4:27/6.61 GB 1:23/5.49 GB 6:15/3.23 GB 7:15/3.70 GB Filter 4 arrival: 296ms Filter 2 arrival: 7s540ms Filter 3 arrival: 9m23s MemoryUsage(16s000ms): 55.02 MB, 65.56 MB, 65.56 MB, 65.56 MB, 65.56 MB, 65.56 MB, 65.56 MB, 65.56 MB, 65.56 MB, 65.56 MB, 65.56 MB, 65.56 MB, 65.56 MB, 65.56 MB, 65.56 MB, 65.56 MB, 65.56 MB, 65.56 MB, 65.56 MB, 65.56 MB, 65.56 MB, 65.56 MB, 65.56 MB, 65.56 MB, 65.56 MB, 65.56 MB, 65.56 MB, 65.56 MB, 65.56 MB, 65.56 MB, 65.56 MB, 65.56 MB, 65.56 MB, 65.56 MB, 65.56 MB, 65.56 MB, 65.56 MB, 65.56 MB, 65.56 MB ThreadUsage(16s000ms): 6, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7 - AverageThreadTokens: 6.99 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 65.56 MB (68742254) - PerHostPeakMemUsage: 169.57 GB (182072968477) - RowsProduced: 518.14K (518144) - TotalNetworkReceiveTime: 3.561us - TotalNetworkSendTime: 206.111us - TotalStorageWaitTime: 989.304ms - TotalThreadsInvoluntaryContextSwitches: 36 (36) - TotalThreadsTotalWallClockTime: 1s080ms - TotalThreadsSysTime: 6.000ms - TotalThreadsUserTime: 221.966ms - TotalThreadsVoluntaryContextSwitches: 60 (60) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 18.896ms - OpenTime: 1s079ms - ExecTreeOpenTime: 852.340ms - PrepareTime: 73.639ms - ExecTreePrepareTime: 618.238us DataStreamSender (dst_id=24):(Total: 90.071ms, non-child: 90.071ms, % non-child: 100.00%) - BytesSent: 4.14 MB (4339849) - NetworkThroughput(*): 87.22 MB/sec - OverallThroughput: 45.95 MB/sec - PeakMemoryUsage: 4.58 MB (4806400) - RowsReturned: 517.12K (517120) - SerializeBatchTime: 41.677ms - TransmitDataRPCTime: 47.454ms - UncompressedRowBatchSize: 13.29 MB (13932672) CodeGen:(Total: 252.685ms, non-child: 252.685ms, % non-child: 100.00%) - CodegenTime: 1.809ms - CompileTime: 63.104ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 161.393ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 27.535ms HASH_JOIN_NODE (id=8):(Total: 872.142ms, non-child: 17.704ms, % non-child: 2.03%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.283ms - PeakMemoryUsage: 1.11 MB (1162446) - ProbeRows: 518.14K (518144) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 15.569ms - RowsReturned: 517.12K (517120) - RowsReturnedRate: 592.93 K/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 25.329us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 95.392us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 48.137us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=19):(Total: 12.837us, non-child: 12.837us, % non-child: 100.00%) BytesReceived(16s000ms): 963.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 4.664us - DeserializeRowBatchTimer: 13.384us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 9.35 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=6):(Total: 854.431ms, non-child: 854.431ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:18/4.28 GB 0:21/5.03 GB 2:16/3.94 GB 3:19/4.42 GB 4:27/6.61 GB 1:23/5.49 GB 6:15/3.23 GB 7:15/3.70 GB ExecOption: PARQUET Codegen Enabled Runtime filters: Only following filters arrived: 4, waited 742ms BytesRead(16s000ms): 25.15 MB, 27.27 MB, 27.27 MB, 27.27 MB, 27.27 MB, 27.27 MB, 27.27 MB, 27.27 MB, 27.27 MB, 27.27 MB, 27.27 MB, 27.27 MB, 27.27 MB, 27.27 MB, 27.27 MB, 27.27 MB, 27.27 MB, 27.27 MB, 27.27 MB, 27.27 MB, 27.27 MB, 27.27 MB, 27.27 MB, 27.27 MB, 27.27 MB, 27.27 MB, 27.27 MB, 27.27 MB, 27.27 MB, 27.27 MB, 27.27 MB, 27.27 MB, 27.27 MB, 27.27 MB, 27.27 MB, 27.27 MB, 27.27 MB, 27.27 MB, 27.27 MB - FooterProcessingTime: (Avg: 59.289ms ; Min: 28.925ms ; Max: 98.610ms ; Number of samples: 6) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 6.00 - BytesRead: 27.27 MB (28599681) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 4.185ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 0 (0) - NumRowGroups: 6 (6) - NumScannerThreadsStarted: 6 (6) - PeakMemoryUsage: 43.40 MB (45511663) - PerReadThreadRawHdfsThroughput: 44.56 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 636.93K (636928) - RowsReturned: 518.14K (518144) - RowsReturnedRate: 606.42 K/sec - ScanRangesComplete: 148 (148) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 612.038ms - TotalReadThroughput: 43.84 KB/sec Filter 2 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 3 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 4 (1.00 MB): - Files processed: 154 (154) - Files rejected: 148 (148) - Files total: 154 (154) - RowGroups processed: 622 (622) - RowGroups rejected: 0 (0) - RowGroups total: 622 (622) - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) - Splits processed: 6 (6) - Splits rejected: 0 (0) - Splits total: 6 (6) Instance 7f40dcb034de70b7:1e2 (host=vc1532.foo:22000):(Total: 1s153ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 2:19/4.59 GB 3:22/5.18 GB 1:22/4.87 GB 7:18/4.16 GB 6:27/6.52 GB 4:14/2.79 GB 5:20/4.25 GB 0:17/3.93 GB Filter 4 arrival: 247ms Filter 2 arrival: 7s643ms Filter 3 arrival: 9m23s MemoryUsage(16s000ms): 43.53 MB, 53.12 MB, 53.12 MB, 53.12 MB, 53.12 MB, 53.12 MB, 53.12 MB, 53.12 MB, 53.12 MB, 53.12 MB, 53.12 MB, 53.12 MB, 53.12 MB, 53.12 MB, 53.12 MB, 53.12 MB, 53.12 MB, 53.12 MB, 53.12 MB, 53.12 MB, 53.12 MB, 53.12 MB, 53.12 MB, 53.12 MB, 53.12 MB, 53.12 MB, 53.12 MB, 53.12 MB, 53.12 MB, 53.12 MB, 53.12 MB, 53.12 MB, 53.12 MB, 53.12 MB, 53.12 MB, 53.12 MB, 53.12 MB, 53.12 MB, 53.12 MB, 53.12 MB ThreadUsage(16s000ms): 12, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.98 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 53.12 MB (55701907) - PerHostPeakMemUsage: 169.55 GB (182053739234) - RowsProduced: 447.49K (447488) - TotalNetworkReceiveTime: 2.393us - TotalNetworkSendTime: 134.240us - TotalStorageWaitTime: 819.453ms - TotalThreadsInvoluntaryContextSwitches: 33 (33) - TotalThreadsTotalWallClockTime: 1s087ms - TotalThreadsSysTime: 1.999ms - TotalThreadsUserTime: 187.972ms - TotalThreadsVoluntaryContextSwitches: 54 (54) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 11.641ms - OpenTime: 1s087ms - ExecTreeOpenTime: 898.425ms - PrepareTime: 65.655ms - ExecTreePrepareTime: 663.814us DataStreamSender (dst_id=24):(Total: 68.523ms, non-child: 68.523ms, % non-child: 100.00%) - BytesSent: 3.46 MB (3628110) - NetworkThroughput(*): 90.70 MB/sec - OverallThroughput: 50.49 MB/sec - PeakMemoryUsage: 4.85 MB (5084928) - RowsReturned: 446.46K (446464) - SerializeBatchTime: 28.976ms - TransmitDataRPCTime: 38.147ms - UncompressedRowBatchSize: 11.41 MB (11967808) CodeGen:(Total: 213.098ms, non-child: 213.098ms, % non-child: 100.00%) - CodegenTime: 1.374ms - CompileTime: 53.642ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 133.577ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 25.358ms HASH_JOIN_NODE (id=8):(Total: 911.192ms, non-child: 10.946ms, % non-child: 1.20%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 656.590us - PeakMemoryUsage: 1.10 MB (1149740) - ProbeRows: 447.49K (447488) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 9.474ms - RowsReturned: 446.46K (446464) - RowsReturnedRate: 489.98 K/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 11.418us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 79.560us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 17.598us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=19):(Total: 7.724us, non-child: 7.724us, % non-child: 100.00%) BytesReceived(16s000ms): 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 2.423us - DeserializeRowBatchTimer: 24.283us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 15.54 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=6):(Total: 900.242ms, non-child: 900.242ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:19/4.59 GB 3:22/5.18 GB 1:22/4.87 GB 7:18/4.16 GB 6:27/6.52 GB 4:14/2.79 GB 5:20/4.25 GB 0:17/3.93 GB ExecOption: PARQUET Codegen Enabled Runtime filters: Only following filters arrived: 4, waited 783ms BytesRead(16s000ms): 19.33 MB, 20.62 MB, 20.62 MB, 20.62 MB, 20.62 MB, 20.62 MB, 20.62 MB, 20.62 MB, 20.62 MB, 20.62 MB, 20.62 MB, 20.62 MB, 20.62 MB, 20.62 MB, 20.62 MB, 20.62 MB, 20.62 MB, 20.62 MB, 20.62 MB, 20.62 MB, 20.62 MB, 20.62 MB, 20.62 MB, 20.62 MB, 20.62 MB, 20.62 MB, 20.62 MB, 20.62 MB, 20.62 MB, 20.62 MB, 20.62 MB, 20.62 MB, 20.62 MB, 20.62 MB, 20.62 MB, 20.62 MB, 20.62 MB, 20.62 MB, 20.62 MB, 20.62 MB - FooterProcessingTime: (Avg: 61.346ms ; Min: 32.011ms ; Max: 83.624ms ; Number of samples: 5) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 11.98 - BytesRead: 20.62 MB (21622099) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 2.881ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 0 (0) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 31.19 MB (32706188) - PerReadThreadRawHdfsThroughput: 46.46 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 565.25K (565248) - RowsReturned: 447.49K (447488) - RowsReturnedRate: 497.07 K/sec - ScanRangesComplete: 154 (154) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 443.805ms - TotalReadThroughput: 32.97 KB/sec Filter 2 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 3 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 4 (1.00 MB): - Files processed: 159 (159) - Files rejected: 154 (154) - Files total: 159 (159) - RowGroups processed: 552 (552) - RowGroups rejected: 0 (0) - RowGroups total: 552 (552) - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) - Splits processed: 5 (5) - Splits rejected: 0 (0) - Splits total: 5 (5) Instance 7f40dcb034de70b7:1cb (host=vd1340.foo:22000):(Total: 1s153ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 2:18/4.07 GB 1:24/5.85 GB 7:15/3.51 GB 6:21/4.78 GB 0:21/4.78 GB 4:19/4.27 GB 3:24/5.60 GB 5:15/3.39 GB Filter 4 arrival: 267ms Filter 2 arrival: 7s399ms Filter 3 arrival: 9m23s MemoryUsage(16s000ms): 47.17 MB, 57.36 MB, 57.36 MB, 57.36 MB, 57.36 MB, 57.36 MB, 57.36 MB, 57.36 MB, 57.36 MB, 57.36 MB, 57.36 MB, 57.36 MB, 57.36 MB, 57.36 MB, 57.36 MB, 57.36 MB, 57.36 MB, 57.36 MB, 57.36 MB, 57.36 MB, 57.36 MB, 57.36 MB, 57.36 MB, 57.36 MB, 57.36 MB, 57.36 MB, 57.36 MB, 57.36 MB, 57.36 MB, 57.36 MB, 57.36 MB, 57.36 MB, 57.36 MB, 57.36 MB, 57.36 MB, 57.36 MB, 57.36 MB, 57.36 MB, 57.36 MB ThreadUsage(16s000ms): 12, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.98 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 57.36 MB (60142517) - PerHostPeakMemUsage: 169.56 GB (182064352999) - RowsProduced: 998.40K (998400) - TotalNetworkReceiveTime: 6.208ms - TotalNetworkSendTime: 341.588us - TotalStorageWaitTime: 1s020ms - TotalThreadsInvoluntaryContextSwitches: 39 (39) - TotalThreadsTotalWallClockTime: 1s106ms - TotalThreadsSysTime: 2.998ms - TotalThreadsUserTime: 205.969ms - TotalThreadsVoluntaryContextSwitches: 121 (121) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 26.427ms - OpenTime: 1s098ms - ExecTreeOpenTime: 888.908ms - PrepareTime: 54.121ms - ExecTreePrepareTime: 610.591us DataStreamSender (dst_id=24):(Total: 142.935ms, non-child: 142.935ms, % non-child: 100.00%) - BytesSent: 8.30 MB (8701224) - NetworkThroughput(*): 99.92 MB/sec - OverallThroughput: 58.06 MB/sec - PeakMemoryUsage: 4.76 MB (4994816) - RowsReturned: 997.38K (997376) - SerializeBatchTime: 58.759ms - TransmitDataRPCTime: 83.050ms - UncompressedRowBatchSize: 27.13 MB (28445872) CodeGen:(Total: 230.571ms, non-child: 230.571ms, % non-child: 100.00%) - CodegenTime: 1.123ms - CompileTime: 75.191ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 132.890ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 21.940ms HASH_JOIN_NODE (id=8):(Total: 916.187ms, non-child: 25.296ms, % non-child: 2.76%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.837ms - PeakMemoryUsage: 1.10 MB (1156220) - ProbeRows: 998.40K (998400) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 22.081ms - RowsReturned: 997.38K (997376) - RowsReturnedRate: 1.09 M/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 13.628us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 153.370us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 40.073us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=19):(Total: 6.214ms, non-child: 24.799us, % non-child: 0.40%) BytesReceived(16s000ms): 963.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 2.790us - DeserializeRowBatchTimer: 26.342us - FirstBatchArrivalWaitTime: 2.076ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 19.31 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=6):(Total: 884.886ms, non-child: 884.886ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:18/4.07 GB 1:24/5.85 GB 7:15/3.51 GB 6:21/4.78 GB 0:21/4.78 GB 4:19/4.27 GB 3:24/5.60 GB 5:15/3.39 GB ExecOption: PARQUET Codegen Enabled Runtime filters: Only following filters arrived: 4, waited 764ms BytesRead(16s000ms): 22.61 MB, 24.41 MB, 24.41 MB, 24.41 MB, 24.41 MB, 24.41 MB, 24.41 MB, 24.41 MB, 24.41 MB, 24.41 MB, 24.41 MB, 24.41 MB, 24.41 MB, 24.41 MB, 24.41 MB, 24.41 MB, 24.41 MB, 24.41 MB, 24.41 MB, 24.41 MB, 24.41 MB, 24.41 MB, 24.41 MB, 24.41 MB, 24.41 MB, 24.41 MB, 24.41 MB, 24.41 MB, 24.41 MB, 24.41 MB, 24.41 MB, 24.41 MB, 24.41 MB, 24.41 MB, 24.41 MB, 24.41 MB, 24.41 MB, 24.41 MB, 24.41 MB - FooterProcessingTime: (Avg: 68.747ms ; Min: 45.566ms ; Max: 122.891ms ; Number of samples: 6) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 11.99 - BytesRead: 24.41 MB (25592062) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 5.935ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 0 (0) - NumRowGroups: 6 (6) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 35.37 MB (37083958) - PerReadThreadRawHdfsThroughput: 43.05 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 1.12M (1117184) - RowsReturned: 998.40K (998400) - RowsReturnedRate: 1.13 M/sec - ScanRangesComplete: 151 (151) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 566.989ms - TotalReadThroughput: 39.23 KB/sec Filter 2 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 3 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 4 (1.00 MB): - Files processed: 157 (157) - Files rejected: 151 (151) - Files total: 157 (157) - RowGroups processed: 1.09K (1091) - RowGroups rejected: 0 (0) - RowGroups total: 1.09K (1091) - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) - Splits processed: 6 (6) - Splits rejected: 0 (0) - Splits total: 6 (6) Instance 7f40dcb034de70b7:187 (host=vd1105.foo:22000):(Total: 1s152ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 2:15/3.36 GB 7:21/4.73 GB 6:22/5.12 GB 4:17/4.00 GB 5:20/4.69 GB 0:18/4.24 GB 3:27/6.29 GB 1:19/4.27 GB Filter 4 arrival: 531ms Filter 2 arrival: 6s522ms Filter 3 arrival: 9m23s MemoryUsage(16s000ms): 54.25 MB, 63.56 MB, 63.56 MB, 63.56 MB, 63.56 MB, 63.56 MB, 63.56 MB, 63.56 MB, 63.56 MB, 63.56 MB, 63.56 MB, 63.56 MB, 63.56 MB, 63.56 MB, 63.56 MB, 63.56 MB, 63.56 MB, 63.56 MB, 63.56 MB, 63.56 MB, 63.56 MB, 63.56 MB, 63.56 MB, 63.56 MB, 63.56 MB, 63.56 MB, 63.56 MB, 63.56 MB, 63.56 MB, 63.56 MB, 63.56 MB, 63.56 MB, 63.56 MB, 63.56 MB, 63.56 MB, 63.56 MB, 63.56 MB, 63.56 MB, 63.56 MB ThreadUsage(16s000ms): 12, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.99 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 63.56 MB (66648044) - PerHostPeakMemUsage: 169.57 GB (182070840498) - RowsProduced: 2.41M (2405376) - TotalNetworkReceiveTime: 300.213ms - TotalNetworkSendTime: 868.949us - TotalStorageWaitTime: 1s217ms - TotalThreadsInvoluntaryContextSwitches: 20 (20) - TotalThreadsTotalWallClockTime: 1s399ms - TotalThreadsSysTime: 2.000ms - TotalThreadsUserTime: 180.972ms - TotalThreadsVoluntaryContextSwitches: 36 (36) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 90.663ms - OpenTime: 1s097ms - ExecTreeOpenTime: 917.049ms - PrepareTime: 55.204ms - ExecTreePrepareTime: 581.427us DataStreamSender (dst_id=24):(Total: 333.828ms, non-child: 333.828ms, % non-child: 100.00%) - BytesSent: 21.12 MB (22143324) - NetworkThroughput(*): 101.36 MB/sec - OverallThroughput: 63.26 MB/sec - PeakMemoryUsage: 4.91 MB (5150464) - RowsReturned: 2.40M (2404352) - SerializeBatchTime: 124.215ms - TransmitDataRPCTime: 208.349ms - UncompressedRowBatchSize: 67.37 MB (70645792) CodeGen:(Total: 200.722ms, non-child: 200.722ms, % non-child: 100.00%) - CodegenTime: 1.032ms - CompileTime: 51.783ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 126.877ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 21.600ms HASH_JOIN_NODE (id=8):(Total: 1s008ms, non-child: 53.188ms, % non-child: 5.28%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.454ms - PeakMemoryUsage: 1.11 MB (1162434) - ProbeRows: 2.41M (2406373) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 48.285ms - RowsReturned: 2.41M (2405349) - RowsReturnedRate: 2.39 M/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 34.456us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 176.514us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 72.843us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=19):(Total: 300.223ms, non-child: 18.212us, % non-child: 0.01%) BytesReceived(16s000ms): 963.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 4.397us - DeserializeRowBatchTimer: 9.331us - FirstBatchArrivalWaitTime: 282.778ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 399.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=6):(Total: 654.667ms, non-child: 654.667ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:15/3.36 GB 7:21/4.73 GB 6:22/5.12 GB 4:17/4.00 GB 5:20/4.69 GB 0:18/4.24 GB 3:27/6.29 GB 1:19/4.27 GB ExecOption: PARQUET Codegen Enabled Runtime filters: Only following filters arrived: 4, waited 502ms BytesRead(16s000ms): 22.10 MB, 23.57 MB, 23.57 MB, 23.57 MB, 23.57 MB, 23.57 MB, 23.57 MB, 23.57 MB, 23.57 MB, 23.57 MB, 23.57 MB, 23.57 MB, 23.57 MB, 23.57 MB, 23.57 MB, 23.57 MB, 23.57 MB, 23.57 MB, 23.57 MB, 23.57 MB, 23.57 MB, 23.57 MB, 23.57 MB, 23.57 MB, 23.57 MB, 23.57 MB, 23.57 MB, 23.57 MB, 23.57 MB, 23.57 MB, 23.57 MB, 23.57 MB, 23.57 MB, 23.57 MB, 23.57 MB, 23.57 MB, 23.57 MB, 23.57 MB, 23.57 MB - FooterProcessingTime: (Avg: 80.179ms ; Min: 47.455ms ; Max: 113.251ms ; Number of samples: 7) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 11.99 - BytesRead: 23.57 MB (24713719) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 13.456ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 0 (0) - NumRowGroups: 7 (7) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 41.64 MB (43667241) - PerReadThreadRawHdfsThroughput: 43.64 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 2.53M (2525157) - RowsReturned: 2.41M (2406373) - RowsReturnedRate: 3.68 M/sec - ScanRangesComplete: 153 (153) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 2.466ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 540.052ms - TotalReadThroughput: 37.80 KB/sec Filter 2 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 20.45K (20453) Filter 3 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 20.45K (20453) Filter 4 (1.00 MB): - Files processed: 159 (159) - Files rejected: 152 (152) - Files total: 159 (159) - RowGroups processed: 2.47K (2466) - RowGroups rejected: 0 (0) - RowGroups total: 2.47K (2466) - Rows processed: 16.38K (16384) - Rows rejected: 0 (0) - Rows total: 20.45K (20453) - Splits processed: 7 (7) - Splits rejected: 0 (0) - Splits total: 7 (7) Instance 7f40dcb034de70b7:1eb (host=vc1525.foo:22000):(Total: 1s152ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 3:19/4.25 GB 6:16/3.73 GB 0:22/5.43 GB 1:24/5.35 GB 7:21/5.18 GB 5:15/3.52 GB 4:21/4.92 GB 2:18/4.02 GB Filter 4 arrival: 247ms Filter 2 arrival: 7s746ms Filter 3 arrival: 9m23s MemoryUsage(16s000ms): 31.19 MB, 40.51 MB, 40.51 MB, 40.51 MB, 40.51 MB, 40.51 MB, 40.51 MB, 40.51 MB, 40.51 MB, 40.51 MB, 40.51 MB, 40.51 MB, 40.51 MB, 40.51 MB, 40.51 MB, 40.51 MB, 40.51 MB, 40.51 MB, 40.51 MB, 40.51 MB, 40.51 MB, 40.51 MB, 40.51 MB, 40.51 MB, 40.51 MB, 40.51 MB, 40.51 MB, 40.51 MB, 40.51 MB, 40.51 MB, 40.51 MB, 40.51 MB, 40.51 MB, 40.51 MB, 40.51 MB, 40.51 MB, 40.51 MB, 40.51 MB, 40.51 MB ThreadUsage(16s000ms): 12, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.98 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 40.51 MB (42481519) - PerHostPeakMemUsage: 169.54 GB (182040518846) - RowsProduced: 319.49K (319488) - TotalNetworkReceiveTime: 2.168us - TotalNetworkSendTime: 100.646us - TotalStorageWaitTime: 243.342ms - TotalThreadsInvoluntaryContextSwitches: 33 (33) - TotalThreadsTotalWallClockTime: 1s095ms - TotalThreadsSysTime: 2.999ms - TotalThreadsUserTime: 196.970ms - TotalThreadsVoluntaryContextSwitches: 52 (52) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 9.827ms - OpenTime: 1s094ms - ExecTreeOpenTime: 895.827ms - PrepareTime: 57.743ms - ExecTreePrepareTime: 821.623us DataStreamSender (dst_id=24):(Total: 42.227ms, non-child: 42.227ms, % non-child: 100.00%) - BytesSent: 2.34 MB (2454179) - NetworkThroughput(*): 106.18 MB/sec - OverallThroughput: 55.43 MB/sec - PeakMemoryUsage: 4.65 MB (4880128) - RowsReturned: 318.46K (318464) - SerializeBatchTime: 19.271ms - TransmitDataRPCTime: 22.042ms - UncompressedRowBatchSize: 7.71 MB (8082736) CodeGen:(Total: 219.455ms, non-child: 219.455ms, % non-child: 100.00%) - CodegenTime: 1.136ms - CompileTime: 60.088ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 137.087ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 21.804ms HASH_JOIN_NODE (id=8):(Total: 907.040ms, non-child: 8.971ms, % non-child: 0.99%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 660.373us - PeakMemoryUsage: 1.11 MB (1158919) - ProbeRows: 319.49K (319488) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 7.556ms - RowsReturned: 318.46K (318464) - RowsReturnedRate: 351.10 K/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 8.849us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 46.159us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 19.688us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=19):(Total: 8.441us, non-child: 8.441us, % non-child: 100.00%) BytesReceived(16s000ms): 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 3.282us - DeserializeRowBatchTimer: 28.979us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 14.22 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=6):(Total: 898.064ms, non-child: 898.064ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:19/4.25 GB 6:16/3.73 GB 0:22/5.43 GB 1:24/5.35 GB 7:21/5.18 GB 5:15/3.52 GB 4:21/4.92 GB 2:18/4.02 GB ExecOption: PARQUET Codegen Enabled Runtime filters: Only following filters arrived: 4, waited 783ms BytesRead(16s000ms): 9.69 MB, 10.33 MB, 10.33 MB, 10.33 MB, 10.33 MB, 10.33 MB, 10.33 MB, 10.33 MB, 10.33 MB, 10.33 MB, 10.33 MB, 10.33 MB, 10.33 MB, 10.33 MB, 10.33 MB, 10.33 MB, 10.33 MB, 10.33 MB, 10.33 MB, 10.33 MB, 10.33 MB, 10.33 MB, 10.33 MB, 10.33 MB, 10.33 MB, 10.33 MB, 10.33 MB, 10.33 MB, 10.33 MB, 10.33 MB, 10.33 MB, 10.33 MB, 10.33 MB, 10.33 MB, 10.33 MB, 10.33 MB, 10.33 MB, 10.33 MB, 10.33 MB - FooterProcessingTime: (Avg: 52.155ms ; Min: 47.019ms ; Max: 57.292ms ; Number of samples: 2) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 11.99 - BytesRead: 10.33 MB (10832817) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 1.951ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 0 (0) - NumRowGroups: 2 (2) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 18.57 MB (19468535) - PerReadThreadRawHdfsThroughput: 65.55 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 434.18K (434176) - RowsReturned: 319.49K (319488) - RowsReturnedRate: 355.75 K/sec - ScanRangesComplete: 154 (154) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 157.602ms - TotalReadThroughput: 16.59 KB/sec Filter 2 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 3 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 4 (1.00 MB): - Files processed: 156 (156) - Files rejected: 154 (154) - Files total: 156 (156) - RowGroups processed: 424 (424) - RowGroups rejected: 0 (0) - RowGroups total: 424 (424) - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) - Splits processed: 2 (2) - Splits rejected: 0 (0) - Splits total: 2 (2) Instance 7f40dcb034de70b7:1fe (host=ve1142.foo:22000):(Total: 1s152ms, non-child: 17.587ms, % non-child: 1.53%) Hdfs split stats (:<# splits>/): 1:16/3.40 GB 4:17/3.91 GB 2:19/4.68 GB 5:18/4.44 GB 6:13/3.20 GB 7:24/5.78 GB 0:24/5.75 GB 3:24/5.48 GB Filter 4 arrival: 272ms Filter 2 arrival: 9s388ms Filter 3 arrival: 9m23s MemoryUsage(16s000ms): 60.63 MB, 73.50 MB, 73.50 MB, 73.50 MB, 73.50 MB, 73.50 MB, 73.50 MB, 73.50 MB, 73.50 MB, 73.50 MB, 73.50 MB, 73.50 MB, 73.50 MB, 73.50 MB, 73.50 MB, 73.50 MB, 73.50 MB, 73.50 MB, 73.50 MB, 73.50 MB, 73.50 MB, 73.50 MB, 73.50 MB, 73.50 MB, 73.50 MB, 73.50 MB, 73.50 MB, 73.50 MB, 73.50 MB, 73.50 MB, 73.50 MB, 73.50 MB, 73.50 MB, 73.50 MB, 73.50 MB, 73.50 MB, 73.50 MB, 73.50 MB, 73.50 MB ThreadUsage(16s000ms): 12, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.99 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 73.50 MB (77065901) - PerHostPeakMemUsage: 169.58 GB (182081261058) - RowsProduced: 119.81K (119808) - TotalNetworkReceiveTime: 2.751us - TotalNetworkSendTime: 34.889us - TotalStorageWaitTime: 1s348ms - TotalThreadsInvoluntaryContextSwitches: 24 (24) - TotalThreadsTotalWallClockTime: 1s070ms - TotalThreadsSysTime: 2.000ms - TotalThreadsUserTime: 191.971ms - TotalThreadsVoluntaryContextSwitches: 56 (56) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 3.900ms - OpenTime: 1s070ms - ExecTreeOpenTime: 874.905ms - PrepareTime: 81.444ms - ExecTreePrepareTime: 613.226us DataStreamSender (dst_id=24):(Total: 23.128ms, non-child: 23.128ms, % non-child: 100.00%) - BytesSent: 628.64 KB (643727) - NetworkThroughput(*): 82.06 MB/sec - OverallThroughput: 26.54 MB/sec - PeakMemoryUsage: 4.79 MB (5027584) - RowsReturned: 118.78K (118784) - SerializeBatchTime: 8.306ms - TransmitDataRPCTime: 7.481ms - UncompressedRowBatchSize: 2.04 MB (2143488) CodeGen:(Total: 231.386ms, non-child: 231.386ms, % non-child: 100.00%) - CodegenTime: 1.730ms - CompileTime: 61.526ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 131.882ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 37.358ms HASH_JOIN_NODE (id=8):(Total: 879.941ms, non-child: 4.152ms, % non-child: 0.47%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 685.522us - PeakMemoryUsage: 1.10 MB (1153517) - ProbeRows: 119.81K (119808) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3.108ms - RowsReturned: 118.78K (118784) - RowsReturnedRate: 134.99 K/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 12.969us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 65.609us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 18.957us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=19):(Total: 8.691us, non-child: 8.691us, % non-child: 100.00%) BytesReceived(16s000ms): 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 2.428us - DeserializeRowBatchTimer: 15.620us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 13.81 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=6):(Total: 875.784ms, non-child: 875.784ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:16/3.40 GB 4:17/3.91 GB 2:19/4.68 GB 5:18/4.44 GB 6:13/3.20 GB 7:24/5.78 GB 0:24/5.75 GB 3:24/5.48 GB ExecOption: PARQUET Codegen Enabled Runtime filters: Only following filters arrived: 4, waited 764ms BytesRead(16s000ms): 28.88 MB, 30.81 MB, 30.81 MB, 30.81 MB, 30.81 MB, 30.81 MB, 30.81 MB, 30.81 MB, 30.81 MB, 30.81 MB, 30.81 MB, 30.81 MB, 30.81 MB, 30.81 MB, 30.81 MB, 30.81 MB, 30.81 MB, 30.81 MB, 30.81 MB, 30.81 MB, 30.81 MB, 30.81 MB, 30.81 MB, 30.81 MB, 30.81 MB, 30.81 MB, 30.81 MB, 30.81 MB, 30.81 MB, 30.81 MB, 30.81 MB, 30.81 MB, 30.81 MB, 30.81 MB, 30.81 MB, 30.81 MB, 30.81 MB, 30.81 MB, 30.81 MB - FooterProcessingTime: (Avg: 65.730ms ; Min: 37.058ms ; Max: 98.983ms ; Number of samples: 7) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 11.99 - BytesRead: 30.81 MB (32306725) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 2.489ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 0 (0) - NumRowGroups: 7 (7) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 51.69 MB (54195758) - PerReadThreadRawHdfsThroughput: 54.20 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 239.62K (239616) - RowsReturned: 119.81K (119808) - RowsReturnedRate: 136.80 K/sec - ScanRangesComplete: 148 (148) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 568.471ms - TotalReadThroughput: 49.53 KB/sec Filter 2 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 3 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 4 (1.00 MB): - Files processed: 155 (155) - Files rejected: 148 (148) - Files total: 155 (155) - RowGroups processed: 234 (234) - RowGroups rejected: 0 (0) - RowGroups total: 234 (234) - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) - Splits processed: 7 (7) - Splits rejected: 0 (0) - Splits total: 7 (7) Instance 7f40dcb034de70b7:1d8 (host=vc1533.foo:22000):(Total: 1s151ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 1:20/4.82 GB 5:23/5.06 GB 6:21/4.68 GB 0:17/3.97 GB 4:17/3.93 GB 7:23/5.22 GB 2:23/4.98 GB 3:16/3.95 GB Filter 4 arrival: 259ms Filter 2 arrival: 7s525ms Filter 3 arrival: 9m23s MemoryUsage(16s000ms): 59.41 MB, 70.06 MB, 70.06 MB, 70.06 MB, 70.06 MB, 70.06 MB, 70.06 MB, 70.06 MB, 70.06 MB, 70.06 MB, 70.06 MB, 70.06 MB, 70.06 MB, 70.06 MB, 70.06 MB, 70.06 MB, 70.06 MB, 70.06 MB, 70.06 MB, 70.06 MB, 70.06 MB, 70.06 MB, 70.06 MB, 70.06 MB, 70.06 MB, 70.06 MB, 70.06 MB, 70.06 MB, 70.06 MB, 70.06 MB, 70.06 MB, 70.06 MB, 70.06 MB, 70.06 MB, 70.06 MB, 70.06 MB, 70.06 MB, 70.06 MB, 70.06 MB ThreadUsage(16s000ms): 12, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.99 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 70.06 MB (73467701) - PerHostPeakMemUsage: 169.57 GB (182077648486) - RowsProduced: 699.39K (699392) - TotalNetworkReceiveTime: 3.468us - TotalNetworkSendTime: 210.364us - TotalStorageWaitTime: 1s400ms - TotalThreadsInvoluntaryContextSwitches: 35 (35) - TotalThreadsTotalWallClockTime: 1s086ms - TotalThreadsSysTime: 4.000ms - TotalThreadsUserTime: 195.969ms - TotalThreadsVoluntaryContextSwitches: 74 (74) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 20.241ms - OpenTime: 1s084ms - ExecTreeOpenTime: 885.274ms - PrepareTime: 66.762ms - ExecTreePrepareTime: 695.936us DataStreamSender (dst_id=24):(Total: 97.476ms, non-child: 97.476ms, % non-child: 100.00%) - BytesSent: 5.65 MB (5929084) - NetworkThroughput(*): 95.07 MB/sec - OverallThroughput: 58.01 MB/sec - PeakMemoryUsage: 4.69 MB (4921088) - RowsReturned: 698.37K (698368) - SerializeBatchTime: 36.729ms - TransmitDataRPCTime: 59.479ms - UncompressedRowBatchSize: 18.48 MB (19380704) CodeGen:(Total: 224.326ms, non-child: 224.326ms, % non-child: 100.00%) - CodegenTime: 1.168ms - CompileTime: 64.099ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 133.302ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 26.306ms HASH_JOIN_NODE (id=8):(Total: 906.568ms, non-child: 18.428ms, % non-child: 2.03%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 2.227ms - PeakMemoryUsage: 1.10 MB (1154423) - ProbeRows: 699.39K (699392) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 15.534ms - RowsReturned: 698.37K (698368) - RowsReturnedRate: 770.34 K/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 31.136us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 474.703us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 58.910us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=19):(Total: 15.158us, non-child: 15.158us, % non-child: 100.00%) BytesReceived(16s000ms): 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 4.391us - DeserializeRowBatchTimer: 25.703us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 7.92 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=6):(Total: 888.134ms, non-child: 888.134ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:20/4.82 GB 5:23/5.06 GB 6:21/4.68 GB 0:17/3.97 GB 4:17/3.93 GB 7:23/5.22 GB 2:23/4.98 GB 3:16/3.95 GB ExecOption: PARQUET Codegen Enabled Runtime filters: Only following filters arrived: 4, waited 763ms BytesRead(16s000ms): 30.16 MB, 32.17 MB, 32.17 MB, 32.17 MB, 32.17 MB, 32.17 MB, 32.17 MB, 32.17 MB, 32.17 MB, 32.17 MB, 32.17 MB, 32.17 MB, 32.17 MB, 32.17 MB, 32.17 MB, 32.17 MB, 32.17 MB, 32.17 MB, 32.17 MB, 32.17 MB, 32.17 MB, 32.17 MB, 32.17 MB, 32.17 MB, 32.17 MB, 32.17 MB, 32.17 MB, 32.17 MB, 32.17 MB, 32.17 MB, 32.17 MB, 32.17 MB, 32.17 MB, 32.17 MB, 32.17 MB, 32.17 MB, 32.17 MB, 32.17 MB, 32.17 MB - FooterProcessingTime: (Avg: 62.069ms ; Min: 33.581ms ; Max: 100.797ms ; Number of samples: 8) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 11.99 - BytesRead: 32.17 MB (33735611) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 4.541ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 0 (0) - NumRowGroups: 8 (8) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 47.94 MB (50268853) - PerReadThreadRawHdfsThroughput: 43.35 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 820.22K (820224) - RowsReturned: 699.39K (699392) - RowsReturnedRate: 787.48 K/sec - ScanRangesComplete: 152 (152) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 742.196ms - TotalReadThroughput: 51.76 KB/sec Filter 2 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 3 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 4 (1.00 MB): - Files processed: 160 (160) - Files rejected: 152 (152) - Files total: 160 (160) - RowGroups processed: 801 (801) - RowGroups rejected: 0 (0) - RowGroups total: 801 (801) - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) - Splits processed: 8 (8) - Splits rejected: 0 (0) - Splits total: 8 (8) Instance 7f40dcb034de70b7:1c0 (host=va1046.foo:22000):(Total: 1s150ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 4:22/5.14 GB 6:20/4.64 GB 2:20/4.93 GB 5:14/3.45 GB 0:20/4.79 GB 3:22/5.19 GB 7:19/4.68 GB 1:17/3.62 GB Filter 4 arrival: 334ms Filter 2 arrival: 7s188ms Filter 3 arrival: 9m23s MemoryUsage(16s000ms): 42.74 MB, 53.01 MB, 53.01 MB, 53.01 MB, 53.01 MB, 53.01 MB, 53.01 MB, 53.01 MB, 53.01 MB, 53.01 MB, 53.01 MB, 53.01 MB, 53.01 MB, 53.01 MB, 53.01 MB, 53.01 MB, 53.01 MB, 53.01 MB, 53.01 MB, 53.01 MB, 53.01 MB, 53.01 MB, 53.01 MB, 53.01 MB, 53.01 MB, 53.01 MB, 53.01 MB, 53.01 MB, 53.01 MB, 53.01 MB, 53.01 MB, 53.01 MB, 53.01 MB, 53.01 MB, 53.01 MB, 53.01 MB, 53.01 MB, 53.01 MB, 53.01 MB ThreadUsage(16s000ms): 12, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.98 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 53.01 MB (55588590) - PerHostPeakMemUsage: 169.56 GB (182059778211) - RowsProduced: 1.09M (1092608) - TotalNetworkReceiveTime: 49.151ms - TotalNetworkSendTime: 28.522ms - TotalStorageWaitTime: 670.154ms - TotalThreadsInvoluntaryContextSwitches: 37 (37) - TotalThreadsTotalWallClockTime: 1s142ms - TotalThreadsSysTime: 6.998ms - TotalThreadsUserTime: 223.966ms - TotalThreadsVoluntaryContextSwitches: 83 (83) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 31.152ms - OpenTime: 1s092ms - ExecTreeOpenTime: 862.126ms - PrepareTime: 58.537ms - ExecTreePrepareTime: 598.235us DataStreamSender (dst_id=24):(Total: 151.038ms, non-child: 151.038ms, % non-child: 100.00%) - BytesSent: 9.12 MB (9559297) - NetworkThroughput(*): 101.41 MB/sec - OverallThroughput: 60.36 MB/sec - PeakMemoryUsage: 4.55 MB (4773632) - RowsReturned: 1.09M (1091584) - SerializeBatchTime: 60.088ms - TransmitDataRPCTime: 89.894ms - UncompressedRowBatchSize: 29.83 MB (31281528) CodeGen:(Total: 253.170ms, non-child: 253.170ms, % non-child: 100.00%) - CodegenTime: 1.560ms - CompileTime: 60.957ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 167.306ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 24.227ms HASH_JOIN_NODE (id=8):(Total: 894.015ms, non-child: 27.385ms, % non-child: 3.06%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.164ms - PeakMemoryUsage: 1.10 MB (1156329) - ProbeRows: 1.09M (1092608) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 24.180ms - RowsReturned: 1.09M (1091584) - RowsReturnedRate: 1.22 M/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 23.297us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 91.503us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 50.488us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=19):(Total: 49.159ms, non-child: 14.753us, % non-child: 0.03%) BytesReceived(16s000ms): 963.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 4.000us - DeserializeRowBatchTimer: 11.964us - FirstBatchArrivalWaitTime: 27.904ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 2.44 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=6):(Total: 817.602ms, non-child: 817.602ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:22/5.14 GB 6:20/4.64 GB 2:20/4.93 GB 5:14/3.45 GB 0:20/4.79 GB 3:22/5.19 GB 7:19/4.68 GB 1:17/3.62 GB ExecOption: PARQUET Codegen Enabled Runtime filters: Only following filters arrived: 4, waited 703ms BytesRead(16s000ms): 15.63 MB, 17.24 MB, 17.24 MB, 17.24 MB, 17.24 MB, 17.24 MB, 17.24 MB, 17.24 MB, 17.24 MB, 17.24 MB, 17.24 MB, 17.24 MB, 17.24 MB, 17.24 MB, 17.24 MB, 17.24 MB, 17.24 MB, 17.24 MB, 17.24 MB, 17.24 MB, 17.24 MB, 17.24 MB, 17.24 MB, 17.24 MB, 17.24 MB, 17.24 MB, 17.24 MB, 17.24 MB, 17.24 MB, 17.24 MB, 17.24 MB, 17.24 MB, 17.24 MB, 17.24 MB, 17.24 MB, 17.24 MB, 17.24 MB, 17.24 MB, 17.24 MB - FooterProcessingTime: (Avg: 50.179ms ; Min: 30.531ms ; Max: 81.953ms ; Number of samples: 4) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 11.99 - BytesRead: 17.24 MB (18072416) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 5.977ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 0 (0) - NumRowGroups: 4 (4) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 31.01 MB (32514896) - PerReadThreadRawHdfsThroughput: 45.90 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 1.21M (1209344) - RowsReturned: 1.09M (1092608) - RowsReturnedRate: 1.34 M/sec - ScanRangesComplete: 150 (150) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 375.500ms - TotalReadThroughput: 27.66 KB/sec Filter 2 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 3 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 4 (1.00 MB): - Files processed: 154 (154) - Files rejected: 150 (150) - Files total: 154 (154) - RowGroups processed: 1.18K (1181) - RowGroups rejected: 0 (0) - RowGroups total: 1.18K (1181) - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) - Splits processed: 4 (4) - Splits rejected: 0 (0) - Splits total: 4 (4) Instance 7f40dcb034de70b7:1ce (host=va1039.foo:22000):(Total: 1s150ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 5:17/4.01 GB 2:22/4.96 GB 7:24/5.57 GB 1:21/4.78 GB 6:19/4.50 GB 0:18/4.19 GB 4:19/4.27 GB 3:18/4.19 GB Filter 4 arrival: 275ms Filter 2 arrival: 7s450ms Filter 3 arrival: 9m23s MemoryUsage(16s000ms): 51.21 MB, 61.39 MB, 61.39 MB, 61.39 MB, 61.39 MB, 61.39 MB, 61.39 MB, 61.39 MB, 61.39 MB, 61.39 MB, 61.39 MB, 61.39 MB, 61.39 MB, 61.39 MB, 61.39 MB, 61.39 MB, 61.39 MB, 61.39 MB, 61.39 MB, 61.39 MB, 61.39 MB, 61.39 MB, 61.39 MB, 61.39 MB, 61.39 MB, 61.39 MB, 61.39 MB, 61.39 MB, 61.39 MB, 61.39 MB, 61.39 MB, 61.39 MB, 61.39 MB, 61.39 MB, 61.39 MB, 61.39 MB, 61.39 MB, 61.39 MB, 61.39 MB ThreadUsage(16s000ms): 12, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.98 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 61.39 MB (64374161) - PerHostPeakMemUsage: 169.56 GB (182068550938) - RowsProduced: 927.74K (927744) - TotalNetworkReceiveTime: 21.822ms - TotalNetworkSendTime: 305.094us - TotalStorageWaitTime: 752.154ms - TotalThreadsInvoluntaryContextSwitches: 34 (34) - TotalThreadsTotalWallClockTime: 1s116ms - TotalThreadsSysTime: 5.998ms - TotalThreadsUserTime: 192.971ms - TotalThreadsVoluntaryContextSwitches: 105 (105) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 28.390ms - OpenTime: 1s092ms - ExecTreeOpenTime: 892.869ms - PrepareTime: 57.503ms - ExecTreePrepareTime: 553.995us DataStreamSender (dst_id=24):(Total: 136.045ms, non-child: 136.045ms, % non-child: 100.00%) - BytesSent: 7.73 MB (8107215) - NetworkThroughput(*): 97.64 MB/sec - OverallThroughput: 56.83 MB/sec - PeakMemoryUsage: 4.86 MB (5093120) - RowsReturned: 926.72K (926720) - SerializeBatchTime: 55.796ms - TransmitDataRPCTime: 79.187ms - UncompressedRowBatchSize: 25.06 MB (26280056) CodeGen:(Total: 221.494ms, non-child: 221.494ms, % non-child: 100.00%) - CodegenTime: 999.420us - CompileTime: 61.291ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 136.407ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 23.274ms HASH_JOIN_NODE (id=8):(Total: 922.000ms, non-child: 27.465ms, % non-child: 2.98%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 2.390ms - PeakMemoryUsage: 1.11 MB (1159337) - ProbeRows: 927.74K (927744) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 23.806ms - RowsReturned: 926.72K (926720) - RowsReturnedRate: 1.01 M/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 21.139us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 434.434us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 50.380us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=19):(Total: 21.831ms, non-child: 16.322us, % non-child: 0.07%) BytesReceived(16s000ms): 963.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 4.681us - DeserializeRowBatchTimer: 14.099us - FirstBatchArrivalWaitTime: 7.233ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 5.50 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=6):(Total: 872.871ms, non-child: 872.871ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:17/4.01 GB 2:22/4.96 GB 7:24/5.57 GB 1:21/4.78 GB 6:19/4.50 GB 0:18/4.19 GB 4:19/4.27 GB 3:18/4.19 GB ExecOption: PARQUET Codegen Enabled Runtime filters: Only following filters arrived: 4, waited 744ms BytesRead(16s000ms): 20.20 MB, 21.55 MB, 21.55 MB, 21.55 MB, 21.55 MB, 21.55 MB, 21.55 MB, 21.55 MB, 21.55 MB, 21.55 MB, 21.55 MB, 21.55 MB, 21.55 MB, 21.55 MB, 21.55 MB, 21.55 MB, 21.55 MB, 21.55 MB, 21.55 MB, 21.55 MB, 21.55 MB, 21.55 MB, 21.55 MB, 21.55 MB, 21.55 MB, 21.55 MB, 21.55 MB, 21.55 MB, 21.55 MB, 21.55 MB, 21.55 MB, 21.55 MB, 21.55 MB, 21.55 MB, 21.55 MB, 21.55 MB, 21.55 MB, 21.55 MB, 21.55 MB - FooterProcessingTime: (Avg: 56.169ms ; Min: 32.302ms ; Max: 85.848ms ; Number of samples: 5) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 11.99 - BytesRead: 21.55 MB (22597844) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 5.976ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 0 (0) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 39.31 MB (41218730) - PerReadThreadRawHdfsThroughput: 50.51 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 1.05M (1045504) - RowsReturned: 927.74K (927744) - RowsReturnedRate: 1.06 M/sec - ScanRangesComplete: 153 (153) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 426.670ms - TotalReadThroughput: 34.67 KB/sec Filter 2 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 3 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 4 (1.00 MB): - Files processed: 158 (158) - Files rejected: 153 (153) - Files total: 158 (158) - RowGroups processed: 1.02K (1021) - RowGroups rejected: 0 (0) - RowGroups total: 1.02K (1021) - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) - Splits processed: 5 (5) - Splits rejected: 0 (0) - Splits total: 5 (5) Instance 7f40dcb034de70b7:1f6 (host=vd1127.foo:22000):(Total: 1s149ms, non-child: 19.259ms, % non-child: 1.67%) Hdfs split stats (:<# splits>/): 7:20/4.93 GB 4:22/5.02 GB 2:18/4.20 GB 1:21/4.61 GB 3:25/5.43 GB 6:20/4.71 GB 0:17/3.81 GB 5:17/4.19 GB Filter 4 arrival: 267ms Filter 2 arrival: 9s188ms Filter 3 arrival: 9m23s MemoryUsage(16s000ms): 53.74 MB, 67.88 MB, 67.88 MB, 67.88 MB, 67.88 MB, 67.88 MB, 67.88 MB, 67.88 MB, 67.88 MB, 67.88 MB, 67.88 MB, 67.88 MB, 67.88 MB, 67.88 MB, 67.88 MB, 67.88 MB, 67.88 MB, 67.88 MB, 67.88 MB, 67.88 MB, 67.88 MB, 67.88 MB, 67.88 MB, 67.88 MB, 67.88 MB, 67.88 MB, 67.88 MB, 67.88 MB, 67.88 MB, 67.88 MB, 67.88 MB, 67.88 MB, 67.88 MB, 67.88 MB, 67.88 MB, 67.88 MB, 67.88 MB, 67.88 MB, 67.88 MB ThreadUsage(16s000ms): 12, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.98 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 67.88 MB (71178880) - PerHostPeakMemUsage: 169.57 GB (182069272751) - RowsProduced: 97.28K (97280) - TotalNetworkReceiveTime: 3.903us - TotalNetworkSendTime: 15.857us - TotalStorageWaitTime: 1s188ms - TotalThreadsInvoluntaryContextSwitches: 24 (24) - TotalThreadsTotalWallClockTime: 1s091ms - TotalThreadsSysTime: 5.999ms - TotalThreadsUserTime: 205.968ms - TotalThreadsVoluntaryContextSwitches: 96 (96) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 6.441ms - OpenTime: 1s089ms - ExecTreeOpenTime: 876.904ms - PrepareTime: 60.284ms - ExecTreePrepareTime: 795.715us DataStreamSender (dst_id=24):(Total: 9.851ms, non-child: 9.851ms, % non-child: 100.00%) - BytesSent: 371.61 KB (380532) - NetworkThroughput(*): 97.04 MB/sec - OverallThroughput: 36.84 MB/sec - PeakMemoryUsage: 4.57 MB (4790016) - RowsReturned: 96.26K (96256) - SerializeBatchTime: 5.022ms - TransmitDataRPCTime: 3.739ms - UncompressedRowBatchSize: 1.19 MB (1250368) CodeGen:(Total: 235.994ms, non-child: 235.994ms, % non-child: 100.00%) - CodegenTime: 1.314ms - CompileTime: 67.485ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 142.854ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 24.820ms HASH_JOIN_NODE (id=8):(Total: 884.840ms, non-child: 8.291ms, % non-child: 0.94%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.743ms - PeakMemoryUsage: 1.11 MB (1161166) - ProbeRows: 97.28K (97280) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 5.847ms - RowsReturned: 96.26K (96256) - RowsReturnedRate: 108.78 K/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 24.065us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 143.802us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 52.323us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=19):(Total: 13.009us, non-child: 13.009us, % non-child: 100.00%) BytesReceived(16s000ms): 963.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 4.283us - DeserializeRowBatchTimer: 36.090us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 9.22 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=6):(Total: 876.542ms, non-child: 876.542ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:20/4.93 GB 4:22/5.02 GB 2:18/4.20 GB 1:21/4.61 GB 3:25/5.43 GB 6:20/4.71 GB 0:17/3.81 GB 5:17/4.19 GB ExecOption: PARQUET Codegen Enabled Runtime filters: Only following filters arrived: 4, waited 763ms BytesRead(16s000ms): 24.86 MB, 27.43 MB, 27.43 MB, 27.43 MB, 27.43 MB, 27.43 MB, 27.43 MB, 27.43 MB, 27.43 MB, 27.43 MB, 27.43 MB, 27.43 MB, 27.43 MB, 27.43 MB, 27.43 MB, 27.43 MB, 27.43 MB, 27.43 MB, 27.43 MB, 27.43 MB, 27.43 MB, 27.43 MB, 27.43 MB, 27.43 MB, 27.43 MB, 27.43 MB, 27.43 MB, 27.43 MB, 27.43 MB, 27.43 MB, 27.43 MB, 27.43 MB, 27.43 MB, 27.43 MB, 27.43 MB, 27.43 MB, 27.43 MB, 27.43 MB, 27.43 MB - FooterProcessingTime: (Avg: 79.352ms ; Min: 60.547ms ; Max: 107.416ms ; Number of samples: 7) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 11.99 - BytesRead: 27.43 MB (28762513) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 2.909ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 0 (0) - NumRowGroups: 7 (7) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 45.62 MB (47833601) - PerReadThreadRawHdfsThroughput: 45.57 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 217.09K (217088) - RowsReturned: 97.28K (97280) - RowsReturnedRate: 110.98 K/sec - ScanRangesComplete: 153 (153) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 601.875ms - TotalReadThroughput: 44.09 KB/sec Filter 2 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 3 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 4 (1.00 MB): - Files processed: 160 (160) - Files rejected: 153 (153) - Files total: 160 (160) - RowGroups processed: 212 (212) - RowGroups rejected: 0 (0) - RowGroups total: 212 (212) - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) - Splits processed: 7 (7) - Splits rejected: 0 (0) - Splits total: 7 (7) Instance 7f40dcb034de70b7:1d0 (host=vd1139.foo:22000):(Total: 1s149ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 7:18/4.10 GB 1:18/4.04 GB 6:25/5.77 GB 4:18/4.26 GB 2:21/4.94 GB 5:16/3.42 GB 0:20/4.57 GB 3:23/5.60 GB Filter 4 arrival: 252ms Filter 2 arrival: 7s444ms Filter 3 arrival: 9m23s MemoryUsage(16s000ms): 47.90 MB, 57.25 MB, 57.25 MB, 57.25 MB, 57.25 MB, 57.25 MB, 57.25 MB, 57.25 MB, 57.25 MB, 57.25 MB, 57.25 MB, 57.25 MB, 57.25 MB, 57.25 MB, 57.25 MB, 57.25 MB, 57.25 MB, 57.25 MB, 57.25 MB, 57.25 MB, 57.25 MB, 57.25 MB, 57.25 MB, 57.25 MB, 57.25 MB, 57.25 MB, 57.25 MB, 57.25 MB, 57.25 MB, 57.25 MB, 57.25 MB, 57.25 MB, 57.25 MB, 57.25 MB, 57.25 MB, 57.25 MB, 57.25 MB, 57.25 MB, 57.25 MB ThreadUsage(16s000ms): 5, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6 - AverageThreadTokens: 5.99 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 57.25 MB (60030573) - PerHostPeakMemUsage: 169.56 GB (182064187763) - RowsProduced: 1.07M (1071104) - TotalNetworkReceiveTime: 6.625ms - TotalNetworkSendTime: 340.187us - TotalStorageWaitTime: 1s157ms - TotalThreadsInvoluntaryContextSwitches: 28 (28) - TotalThreadsTotalWallClockTime: 1s102ms - TotalThreadsSysTime: 6.998ms - TotalThreadsUserTime: 188.971ms - TotalThreadsVoluntaryContextSwitches: 84 (84) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 23.377ms - OpenTime: 1s095ms - ExecTreeOpenTime: 899.997ms - PrepareTime: 54.143ms - ExecTreePrepareTime: 706.240us DataStreamSender (dst_id=24):(Total: 142.266ms, non-child: 142.266ms, % non-child: 100.00%) - BytesSent: 8.86 MB (9295190) - NetworkThroughput(*): 98.71 MB/sec - OverallThroughput: 62.31 MB/sec - PeakMemoryUsage: 4.72 MB (4945664) - RowsReturned: 1.07M (1070080) - SerializeBatchTime: 51.428ms - TransmitDataRPCTime: 89.805ms - UncompressedRowBatchSize: 29.15 MB (30567032) CodeGen:(Total: 215.548ms, non-child: 215.548ms, % non-child: 100.00%) - CodegenTime: 1.222ms - CompileTime: 56.272ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 136.520ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 22.224ms HASH_JOIN_NODE (id=8):(Total: 924.375ms, non-child: 21.959ms, % non-child: 2.38%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.259ms - PeakMemoryUsage: 1.11 MB (1162379) - ProbeRows: 1.07M (1071104) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 19.486ms - RowsReturned: 1.07M (1070080) - RowsReturnedRate: 1.16 M/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 22.809us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 118.983us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 62.369us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=19):(Total: 6.634ms, non-child: 16.435us, % non-child: 0.25%) BytesReceived(16s000ms): 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 4.206us - DeserializeRowBatchTimer: 10.428us - FirstBatchArrivalWaitTime: 3.581ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 18.09 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=6):(Total: 895.903ms, non-child: 895.903ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:18/4.10 GB 1:18/4.04 GB 6:25/5.77 GB 4:18/4.26 GB 2:21/4.94 GB 5:16/3.42 GB 0:20/4.57 GB 3:23/5.60 GB ExecOption: PARQUET Codegen Enabled Runtime filters: Only following filters arrived: 4, waited 783ms BytesRead(16s000ms): 20.78 MB, 22.16 MB, 22.16 MB, 22.16 MB, 22.16 MB, 22.16 MB, 22.16 MB, 22.16 MB, 22.16 MB, 22.16 MB, 22.16 MB, 22.16 MB, 22.16 MB, 22.16 MB, 22.16 MB, 22.16 MB, 22.16 MB, 22.16 MB, 22.16 MB, 22.16 MB, 22.16 MB, 22.16 MB, 22.16 MB, 22.16 MB, 22.16 MB, 22.16 MB, 22.16 MB, 22.16 MB, 22.16 MB, 22.16 MB, 22.16 MB, 22.16 MB, 22.16 MB, 22.16 MB, 22.16 MB, 22.16 MB, 22.16 MB, 22.16 MB, 22.16 MB - FooterProcessingTime: (Avg: 79.194ms ; Min: 42.829ms ; Max: 114.922ms ; Number of samples: 5) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.99 - BytesRead: 22.16 MB (23241070) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 6.494ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 0 (0) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 5 (5) - PeakMemoryUsage: 35.15 MB (36857326) - PerReadThreadRawHdfsThroughput: 50.20 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 1.19M (1188864) - RowsReturned: 1.07M (1071104) - RowsReturnedRate: 1.20 M/sec - ScanRangesComplete: 154 (154) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 441.486ms - TotalReadThroughput: 35.55 KB/sec Filter 2 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 3 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 4 (1.00 MB): - Files processed: 159 (159) - Files rejected: 154 (154) - Files total: 159 (159) - RowGroups processed: 1.16K (1161) - RowGroups rejected: 0 (0) - RowGroups total: 1.16K (1161) - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) - Splits processed: 5 (5) - Splits rejected: 0 (0) - Splits total: 5 (5) Instance 7f40dcb034de70b7:1b7 (host=ve1134.foo:22000):(Total: 1s148ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:21/4.78 GB 3:18/4.21 GB 7:19/4.64 GB 2:25/5.99 GB 6:18/4.44 GB 1:20/4.64 GB 4:19/4.30 GB 5:16/3.91 GB Filter 4 arrival: 361ms Filter 2 arrival: 7s065ms Filter 3 arrival: 9m23s MemoryUsage(16s000ms): 48.04 MB, 57.40 MB, 57.40 MB, 57.40 MB, 57.40 MB, 57.40 MB, 57.40 MB, 57.40 MB, 57.40 MB, 57.40 MB, 57.40 MB, 57.40 MB, 57.40 MB, 57.40 MB, 57.40 MB, 57.40 MB, 57.40 MB, 57.40 MB, 57.40 MB, 57.40 MB, 57.40 MB, 57.40 MB, 57.40 MB, 57.40 MB, 57.40 MB, 57.40 MB, 57.40 MB, 57.40 MB, 57.40 MB, 57.40 MB, 57.40 MB, 57.40 MB, 57.40 MB, 57.40 MB, 57.40 MB, 57.40 MB, 57.40 MB, 57.40 MB, 57.40 MB ThreadUsage(16s000ms): 12, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.98 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 57.40 MB (60191384) - PerHostPeakMemUsage: 169.56 GB (182064409883) - RowsProduced: 1.51M (1510400) - TotalNetworkReceiveTime: 105.227ms - TotalNetworkSendTime: 494.797us - TotalStorageWaitTime: 968.792ms - TotalThreadsInvoluntaryContextSwitches: 21 (21) - TotalThreadsTotalWallClockTime: 1s202ms - TotalThreadsSysTime: 3.999ms - TotalThreadsUserTime: 205.968ms - TotalThreadsVoluntaryContextSwitches: 43 (43) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 44.841ms - OpenTime: 1s096ms - ExecTreeOpenTime: 887.811ms - PrepareTime: 51.903ms - ExecTreePrepareTime: 535.669us DataStreamSender (dst_id=24):(Total: 207.415ms, non-child: 207.415ms, % non-child: 100.00%) - BytesSent: 12.85 MB (13479097) - NetworkThroughput(*): 97.19 MB/sec - OverallThroughput: 61.98 MB/sec - PeakMemoryUsage: 4.83 MB (5060352) - RowsReturned: 1.51M (1509376) - SerializeBatchTime: 74.914ms - TransmitDataRPCTime: 132.260ms - UncompressedRowBatchSize: 41.78 MB (43807536) CodeGen:(Total: 226.493ms, non-child: 226.493ms, % non-child: 100.00%) - CodegenTime: 1.172ms - CompileTime: 55.180ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 151.427ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 19.436ms HASH_JOIN_NODE (id=8):(Total: 933.177ms, non-child: 39.840ms, % non-child: 4.27%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.291ms - PeakMemoryUsage: 1.10 MB (1156988) - ProbeRows: 1.51M (1510400) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 36.368ms - RowsReturned: 1.51M (1509376) - RowsReturnedRate: 1.62 M/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 27.102us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 130.872us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 59.009us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=19):(Total: 105.236ms, non-child: 16.186us, % non-child: 0.02%) BytesReceived(16s000ms): 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 3.949us - DeserializeRowBatchTimer: 16.676us - FirstBatchArrivalWaitTime: 77.784ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 1.14 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=6):(Total: 788.198ms, non-child: 788.198ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:21/4.78 GB 3:18/4.21 GB 7:19/4.64 GB 2:25/5.99 GB 6:18/4.44 GB 1:20/4.64 GB 4:19/4.30 GB 5:16/3.91 GB ExecOption: PARQUET Codegen Enabled Runtime filters: Only following filters arrived: 4, waited 663ms BytesRead(16s000ms): 22.82 MB, 24.34 MB, 24.34 MB, 24.34 MB, 24.34 MB, 24.34 MB, 24.34 MB, 24.34 MB, 24.34 MB, 24.34 MB, 24.34 MB, 24.34 MB, 24.34 MB, 24.34 MB, 24.34 MB, 24.34 MB, 24.34 MB, 24.34 MB, 24.34 MB, 24.34 MB, 24.34 MB, 24.34 MB, 24.34 MB, 24.34 MB, 24.34 MB, 24.34 MB, 24.34 MB, 24.34 MB, 24.34 MB, 24.34 MB, 24.34 MB, 24.34 MB, 24.34 MB, 24.34 MB, 24.34 MB, 24.34 MB, 24.34 MB, 24.34 MB, 24.34 MB - FooterProcessingTime: (Avg: 62.405ms ; Min: 48.412ms ; Max: 102.596ms ; Number of samples: 6) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 11.98 - BytesRead: 24.34 MB (25524863) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 6.730ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 0 (0) - NumRowGroups: 6 (6) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 35.51 MB (37236139) - PerReadThreadRawHdfsThroughput: 42.12 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 1.63M (1629184) - RowsReturned: 1.51M (1510400) - RowsReturnedRate: 1.92 M/sec - ScanRangesComplete: 150 (150) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 577.985ms - TotalReadThroughput: 39.04 KB/sec Filter 2 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 3 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 4 (1.00 MB): - Files processed: 156 (156) - Files rejected: 150 (150) - Files total: 156 (156) - RowGroups processed: 1.59K (1591) - RowGroups rejected: 0 (0) - RowGroups total: 1.59K (1591) - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) - Splits processed: 6 (6) - Splits rejected: 0 (0) - Splits total: 6 (6) Instance 7f40dcb034de70b7:1ed (host=vd1111.foo:22000):(Total: 1s147ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 2:19/4.66 GB 4:20/4.51 GB 7:17/3.76 GB 0:13/2.90 GB 1:18/4.06 GB 3:25/5.79 GB 5:19/4.64 GB 6:26/5.94 GB Filter 4 arrival: 268ms Filter 2 arrival: 7s762ms Filter 3 arrival: 9m23s MemoryUsage(16s000ms): 35.77 MB, 44.84 MB, 44.84 MB, 44.84 MB, 44.84 MB, 44.84 MB, 44.84 MB, 44.84 MB, 44.84 MB, 44.84 MB, 44.84 MB, 44.84 MB, 44.84 MB, 44.84 MB, 44.84 MB, 44.84 MB, 44.84 MB, 44.84 MB, 44.84 MB, 44.84 MB, 44.84 MB, 44.84 MB, 44.84 MB, 44.84 MB, 44.84 MB, 44.84 MB, 44.84 MB, 44.84 MB, 44.84 MB, 44.84 MB, 44.84 MB, 44.84 MB, 44.84 MB, 44.84 MB, 44.84 MB, 44.84 MB, 44.84 MB, 44.84 MB, 44.84 MB, 44.84 MB ThreadUsage(16s000ms): 12, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.99 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 44.84 MB (47022421) - PerHostPeakMemUsage: 169.55 GB (182051211814) - RowsProduced: 243.71K (243712) - TotalNetworkReceiveTime: 15.415us - TotalNetworkSendTime: 91.237us - TotalStorageWaitTime: 740.310ms - TotalThreadsInvoluntaryContextSwitches: 33 (33) - TotalThreadsTotalWallClockTime: 1s091ms - TotalThreadsSysTime: 2.000ms - TotalThreadsUserTime: 214.967ms - TotalThreadsVoluntaryContextSwitches: 73 (73) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 8.002ms - OpenTime: 1s090ms - ExecTreeOpenTime: 874.405ms - PrepareTime: 56.645ms - ExecTreePrepareTime: 560.864us DataStreamSender (dst_id=24):(Total: 39.938ms, non-child: 39.938ms, % non-child: 100.00%) - BytesSent: 1.76 MB (1840496) - NetworkThroughput(*): 103.51 MB/sec - OverallThroughput: 43.95 MB/sec - PeakMemoryUsage: 4.72 MB (4953856) - RowsReturned: 242.69K (242688) - SerializeBatchTime: 22.425ms - TransmitDataRPCTime: 16.957ms - UncompressedRowBatchSize: 5.58 MB (5849936) CodeGen:(Total: 238.941ms, non-child: 238.941ms, % non-child: 100.00%) - CodegenTime: 1.130ms - CompileTime: 55.915ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 158.288ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 24.297ms HASH_JOIN_NODE (id=8):(Total: 883.386ms, non-child: 8.670ms, % non-child: 0.98%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.352ms - PeakMemoryUsage: 1.11 MB (1162422) - ProbeRows: 243.83K (243830) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 6.795ms - RowsReturned: 242.81K (242806) - RowsReturnedRate: 274.86 K/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 32.691us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 113.532us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 48.049us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=19):(Total: 26.651us, non-child: 26.651us, % non-child: 100.00%) BytesReceived(16s000ms): 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 4.901us - DeserializeRowBatchTimer: 9.176us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 4.50 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=6):(Total: 874.705ms, non-child: 874.705ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:19/4.66 GB 4:20/4.51 GB 7:17/3.76 GB 0:13/2.90 GB 1:18/4.06 GB 3:25/5.79 GB 5:19/4.64 GB 6:26/5.94 GB ExecOption: PARQUET Codegen Enabled Runtime filters: Only following filters arrived: 4, waited 762ms BytesRead(16s000ms): 15.50 MB, 16.53 MB, 16.53 MB, 16.53 MB, 16.53 MB, 16.53 MB, 16.53 MB, 16.53 MB, 16.53 MB, 16.53 MB, 16.53 MB, 16.53 MB, 16.53 MB, 16.53 MB, 16.53 MB, 16.53 MB, 16.53 MB, 16.53 MB, 16.53 MB, 16.53 MB, 16.53 MB, 16.53 MB, 16.53 MB, 16.53 MB, 16.53 MB, 16.53 MB, 16.53 MB, 16.53 MB, 16.53 MB, 16.53 MB, 16.53 MB, 16.53 MB, 16.53 MB, 16.53 MB, 16.53 MB, 16.53 MB, 16.53 MB, 16.53 MB, 16.53 MB, 16.53 MB - FooterProcessingTime: (Avg: 58.482ms ; Min: 40.746ms ; Max: 94.136ms ; Number of samples: 5) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 11.99 - BytesRead: 16.53 MB (17331756) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 1.742ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 0 (0) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 22.93 MB (24045782) - PerReadThreadRawHdfsThroughput: 40.80 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 360.57K (360566) - RowsReturned: 243.83K (243830) - RowsReturnedRate: 278.76 K/sec - ScanRangesComplete: 153 (153) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 12.853ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 405.109ms - TotalReadThroughput: 26.40 KB/sec Filter 2 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 131.19K (131190) Filter 3 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 131.19K (131190) Filter 4 (1.00 MB): - Files processed: 157 (157) - Files rejected: 152 (152) - Files total: 157 (157) - RowGroups processed: 353 (353) - RowGroups rejected: 0 (0) - RowGroups total: 353 (353) - Rows processed: 16.38K (16384) - Rows rejected: 0 (0) - Rows total: 131.19K (131190) - Splits processed: 5 (5) - Splits rejected: 0 (0) - Splits total: 5 (5) Instance 7f40dcb034de70b7:19f (host=va1044.foo:22000):(Total: 1s146ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 1:19/4.50 GB 0:16/3.50 GB 5:17/4.02 GB 6:23/5.52 GB 4:24/5.71 GB 3:22/5.23 GB 7:21/4.63 GB 2:15/3.57 GB Filter 4 arrival: 415ms Filter 2 arrival: 6s784ms Filter 3 arrival: 9m23s MemoryUsage(16s000ms): 55.76 MB, 65.38 MB, 65.38 MB, 65.38 MB, 65.38 MB, 65.38 MB, 65.38 MB, 65.38 MB, 65.38 MB, 65.38 MB, 65.38 MB, 65.38 MB, 65.38 MB, 65.38 MB, 65.38 MB, 65.38 MB, 65.38 MB, 65.38 MB, 65.38 MB, 65.38 MB, 65.38 MB, 65.38 MB, 65.38 MB, 65.38 MB, 65.38 MB, 65.38 MB, 65.38 MB, 65.38 MB, 65.38 MB, 65.38 MB, 65.38 MB, 65.38 MB, 65.38 MB, 65.38 MB, 65.38 MB, 65.38 MB, 65.38 MB, 65.38 MB, 65.38 MB ThreadUsage(16s000ms): 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 13.00 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 65.38 MB (68555996) - PerHostPeakMemUsage: 169.57 GB (182072811520) - RowsProduced: 1.80M (1804288) - TotalNetworkReceiveTime: 163.865ms - TotalNetworkSendTime: 662.136us - TotalStorageWaitTime: 1s615ms - TotalThreadsInvoluntaryContextSwitches: 22 (22) - TotalThreadsTotalWallClockTime: 1s255ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 200.969ms - TotalThreadsVoluntaryContextSwitches: 45 (45) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 62.854ms - OpenTime: 1s090ms - ExecTreeOpenTime: 891.479ms - PrepareTime: 55.897ms - ExecTreePrepareTime: 592.782us DataStreamSender (dst_id=24):(Total: 259.149ms, non-child: 259.149ms, % non-child: 100.00%) - BytesSent: 15.33 MB (16078256) - NetworkThroughput(*): 95.19 MB/sec - OverallThroughput: 59.17 MB/sec - PeakMemoryUsage: 4.60 MB (4822784) - RowsReturned: 1.80M (1803264) - SerializeBatchTime: 97.196ms - TransmitDataRPCTime: 161.076ms - UncompressedRowBatchSize: 50.25 MB (52694080) CodeGen:(Total: 222.810ms, non-child: 222.810ms, % non-child: 100.00%) - CodegenTime: 1.156ms - CompileTime: 59.010ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 138.230ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 25.059ms HASH_JOIN_NODE (id=8):(Total: 954.685ms, non-child: 56.131ms, % non-child: 5.88%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.316ms - PeakMemoryUsage: 1.11 MB (1162523) - ProbeRows: 1.80M (1804288) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 52.234ms - RowsReturned: 1.80M (1803264) - RowsReturnedRate: 1.89 M/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 21.777us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 136.252us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 45.551us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=19):(Total: 163.873ms, non-child: 13.959us, % non-child: 0.01%) BytesReceived(16s000ms): 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 3.993us - DeserializeRowBatchTimer: 14.866us - FirstBatchArrivalWaitTime: 162.935ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 732.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=6):(Total: 734.762ms, non-child: 734.762ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:19/4.50 GB 0:16/3.50 GB 5:17/4.02 GB 6:23/5.52 GB 4:24/5.71 GB 3:22/5.23 GB 7:21/4.63 GB 2:15/3.57 GB ExecOption: PARQUET Codegen Enabled Runtime filters: Only following filters arrived: 4, waited 622ms BytesRead(16s000ms): 26.06 MB, 28.11 MB, 28.11 MB, 28.11 MB, 28.11 MB, 28.11 MB, 28.11 MB, 28.11 MB, 28.11 MB, 28.11 MB, 28.11 MB, 28.11 MB, 28.11 MB, 28.11 MB, 28.11 MB, 28.11 MB, 28.11 MB, 28.11 MB, 28.11 MB, 28.11 MB, 28.11 MB, 28.11 MB, 28.11 MB, 28.11 MB, 28.11 MB, 28.11 MB, 28.11 MB, 28.11 MB, 28.11 MB, 28.11 MB, 28.11 MB, 28.11 MB, 28.11 MB, 28.11 MB, 28.11 MB, 28.11 MB, 28.11 MB, 28.11 MB, 28.11 MB - FooterProcessingTime: (Avg: 90.960ms ; Min: 55.972ms ; Max: 168.100ms ; Number of samples: 6) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 12.00 - BytesRead: 28.11 MB (29480090) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 11.970ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 0 (0) - NumRowGroups: 6 (6) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 43.52 MB (45636701) - PerReadThreadRawHdfsThroughput: 53.47 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 1.92M (1923072) - RowsReturned: 1.80M (1804288) - RowsReturnedRate: 2.46 M/sec - ScanRangesComplete: 151 (151) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 525.796ms - TotalReadThroughput: 45.12 KB/sec Filter 2 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 3 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 4 (1.00 MB): - Files processed: 157 (157) - Files rejected: 151 (151) - Files total: 157 (157) - RowGroups processed: 1.88K (1878) - RowGroups rejected: 0 (0) - RowGroups total: 1.88K (1878) - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) - Splits processed: 6 (6) - Splits rejected: 0 (0) - Splits total: 6 (6) Instance 7f40dcb034de70b7:1f2 (host=vc1535.foo:22000):(Total: 1s146ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 3:25/6.07 GB 2:18/4.26 GB 1:20/4.40 GB 6:19/4.33 GB 0:20/3.83 GB 5:15/3.66 GB 4:21/5.02 GB 7:25/4.88 GB Filter 4 arrival: 259ms Filter 2 arrival: 7s856ms Filter 3 arrival: 9m23s MemoryUsage(16s000ms): 51.85 MB, 62.96 MB, 62.96 MB, 62.96 MB, 62.96 MB, 62.96 MB, 62.96 MB, 62.96 MB, 62.96 MB, 62.96 MB, 62.96 MB, 62.96 MB, 62.96 MB, 62.96 MB, 62.96 MB, 62.96 MB, 62.96 MB, 62.96 MB, 62.96 MB, 62.96 MB, 62.96 MB, 62.96 MB, 62.96 MB, 62.96 MB, 62.96 MB, 62.96 MB, 62.96 MB, 62.96 MB, 62.96 MB, 62.96 MB, 62.96 MB, 62.96 MB, 62.96 MB, 62.96 MB, 62.96 MB, 62.96 MB, 62.96 MB, 62.96 MB, 62.96 MB ThreadUsage(16s000ms): 12, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.99 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 62.96 MB (66019064) - PerHostPeakMemUsage: 169.57 GB (182070261522) - RowsProduced: 166.91K (166912) - TotalNetworkReceiveTime: 3.154us - TotalNetworkSendTime: 45.269us - TotalStorageWaitTime: 1s749ms - TotalThreadsInvoluntaryContextSwitches: 30 (30) - TotalThreadsTotalWallClockTime: 1s090ms - TotalThreadsSysTime: 3.999ms - TotalThreadsUserTime: 202.970ms - TotalThreadsVoluntaryContextSwitches: 66 (66) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 6.644ms - OpenTime: 1s089ms - ExecTreeOpenTime: 883.095ms - PrepareTime: 56.259ms - ExecTreePrepareTime: 629.415us DataStreamSender (dst_id=24):(Total: 28.139ms, non-child: 28.139ms, % non-child: 100.00%) - BytesSent: 1018.51 KB (1042951) - NetworkThroughput(*): 75.65 MB/sec - OverallThroughput: 35.35 MB/sec - PeakMemoryUsage: 4.65 MB (4880128) - RowsReturned: 165.89K (165888) - SerializeBatchTime: 14.239ms - TransmitDataRPCTime: 13.146ms - UncompressedRowBatchSize: 3.26 MB (3416184) CodeGen:(Total: 230.908ms, non-child: 230.908ms, % non-child: 100.00%) - CodegenTime: 1.442ms - CompileTime: 55.384ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 149.185ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 25.735ms HASH_JOIN_NODE (id=8):(Total: 890.871ms, non-child: 7.474ms, % non-child: 0.84%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.210ms - PeakMemoryUsage: 1.11 MB (1161564) - ProbeRows: 166.91K (166912) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 5.769ms - RowsReturned: 165.89K (165888) - RowsReturnedRate: 186.21 K/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 21.319us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 65.509us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 47.096us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=19):(Total: 12.217us, non-child: 12.217us, % non-child: 100.00%) BytesReceived(16s000ms): 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 5.031us - DeserializeRowBatchTimer: 16.488us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 9.82 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=6):(Total: 883.389ms, non-child: 883.389ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:25/6.07 GB 2:18/4.26 GB 1:20/4.40 GB 6:19/4.33 GB 0:20/3.83 GB 5:15/3.66 GB 4:21/5.02 GB 7:25/4.88 GB ExecOption: PARQUET Codegen Enabled Runtime filters: Only following filters arrived: 4, waited 764ms BytesRead(16s000ms): 23.56 MB, 25.48 MB, 25.48 MB, 25.48 MB, 25.48 MB, 25.48 MB, 25.48 MB, 25.48 MB, 25.48 MB, 25.48 MB, 25.48 MB, 25.48 MB, 25.48 MB, 25.48 MB, 25.48 MB, 25.48 MB, 25.48 MB, 25.48 MB, 25.48 MB, 25.48 MB, 25.48 MB, 25.48 MB, 25.48 MB, 25.48 MB, 25.48 MB, 25.48 MB, 25.48 MB, 25.48 MB, 25.48 MB, 25.48 MB, 25.48 MB, 25.48 MB, 25.48 MB, 25.48 MB, 25.48 MB, 25.48 MB, 25.48 MB, 25.48 MB, 25.48 MB - FooterProcessingTime: (Avg: 78.922ms ; Min: 48.335ms ; Max: 117.609ms ; Number of samples: 8) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 12.00 - BytesRead: 25.48 MB (26716843) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 2.825ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 0 (0) - NumRowGroups: 8 (8) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 40.84 MB (42821241) - PerReadThreadRawHdfsThroughput: 40.26 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 287.74K (287744) - RowsReturned: 166.91K (166912) - RowsReturnedRate: 188.94 K/sec - ScanRangesComplete: 155 (155) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 632.858ms - TotalReadThroughput: 40.83 KB/sec Filter 2 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 3 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 4 (1.00 MB): - Files processed: 163 (163) - Files rejected: 155 (155) - Files total: 163 (163) - RowGroups processed: 281 (281) - RowGroups rejected: 0 (0) - RowGroups total: 281 (281) - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) - Splits processed: 8 (8) - Splits rejected: 0 (0) - Splits total: 8 (8) Instance 7f40dcb034de70b7:1f3 (host=vd1101.foo:22000):(Total: 1s145ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 5:19/4.68 GB 2:23/5.32 GB 0:22/5.23 GB 1:19/4.13 GB 3:23/5.06 GB 6:20/4.72 GB 4:32/7.25 GB Filter 4 arrival: 228ms Filter 2 arrival: 7s865ms Filter 3 arrival: 9m23s MemoryUsage(16s000ms): 42.69 MB, 52.77 MB, 52.77 MB, 52.77 MB, 52.77 MB, 52.77 MB, 52.77 MB, 52.77 MB, 52.77 MB, 52.77 MB, 52.77 MB, 52.77 MB, 52.77 MB, 52.77 MB, 52.77 MB, 52.77 MB, 52.77 MB, 52.77 MB, 52.77 MB, 52.77 MB, 52.77 MB, 52.77 MB, 52.77 MB, 52.77 MB, 52.77 MB, 52.77 MB, 52.77 MB, 52.77 MB, 52.77 MB, 52.77 MB, 52.77 MB, 52.77 MB, 52.77 MB, 52.77 MB, 52.77 MB, 52.77 MB, 52.77 MB, 52.77 MB, 52.77 MB, 52.77 MB ThreadUsage(16s000ms): 12, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.99 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 52.77 MB (55331057) - PerHostPeakMemUsage: 169.56 GB (182059540873) - RowsProduced: 194.56K (194560) - TotalNetworkReceiveTime: 3.585us - TotalNetworkSendTime: 52.624us - TotalStorageWaitTime: 700.050ms - TotalThreadsInvoluntaryContextSwitches: 25 (25) - TotalThreadsTotalWallClockTime: 1s094ms - TotalThreadsSysTime: 1.000ms - TotalThreadsUserTime: 180.972ms - TotalThreadsVoluntaryContextSwitches: 58 (58) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 5.536ms - OpenTime: 1s092ms - ExecTreeOpenTime: 912.030ms - PrepareTime: 52.771ms - ExecTreePrepareTime: 521.442us DataStreamSender (dst_id=24):(Total: 28.818ms, non-child: 28.818ms, % non-child: 100.00%) - BytesSent: 1.23 MB (1292311) - NetworkThroughput(*): 77.75 MB/sec - OverallThroughput: 42.77 MB/sec - PeakMemoryUsage: 4.71 MB (4937472) - RowsReturned: 193.54K (193536) - SerializeBatchTime: 12.320ms - TransmitDataRPCTime: 15.852ms - UncompressedRowBatchSize: 4.09 MB (4286976) CodeGen:(Total: 201.727ms, non-child: 201.727ms, % non-child: 100.00%) - CodegenTime: 902.703us - CompileTime: 52.667ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 126.636ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 21.990ms HASH_JOIN_NODE (id=8):(Total: 918.500ms, non-child: 6.453ms, % non-child: 0.70%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.437ms - PeakMemoryUsage: 1.10 MB (1157014) - ProbeRows: 194.56K (194560) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4.506ms - RowsReturned: 193.54K (193536) - RowsReturnedRate: 210.71 K/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 21.687us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 137.433us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 54.220us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=19):(Total: 13.308us, non-child: 13.308us, % non-child: 100.00%) BytesReceived(16s000ms): 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 4.638us - DeserializeRowBatchTimer: 9.518us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 9.02 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=6):(Total: 912.040ms, non-child: 912.040ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:19/4.68 GB 2:23/5.32 GB 0:22/5.23 GB 1:19/4.13 GB 3:23/5.06 GB 6:20/4.72 GB 4:32/7.25 GB ExecOption: PARQUET Codegen Enabled Runtime filters: Only following filters arrived: 4, waited 804ms BytesRead(16s000ms): 16.01 MB, 17.07 MB, 17.07 MB, 17.07 MB, 17.07 MB, 17.07 MB, 17.07 MB, 17.07 MB, 17.07 MB, 17.07 MB, 17.07 MB, 17.07 MB, 17.07 MB, 17.07 MB, 17.07 MB, 17.07 MB, 17.07 MB, 17.07 MB, 17.07 MB, 17.07 MB, 17.07 MB, 17.07 MB, 17.07 MB, 17.07 MB, 17.07 MB, 17.07 MB, 17.07 MB, 17.07 MB, 17.07 MB, 17.07 MB, 17.07 MB, 17.07 MB, 17.07 MB, 17.07 MB, 17.07 MB, 17.07 MB, 17.07 MB, 17.07 MB, 17.07 MB, 17.07 MB - FooterProcessingTime: (Avg: 66.096ms ; Min: 28.857ms ; Max: 108.850ms ; Number of samples: 4) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 11.99 - BytesRead: 17.07 MB (17904215) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 2.448ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 0 (0) - NumRowGroups: 4 (4) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 30.80 MB (32297074) - PerReadThreadRawHdfsThroughput: 47.05 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 301.06K (301056) - RowsReturned: 194.56K (194560) - RowsReturnedRate: 213.32 K/sec - ScanRangesComplete: 154 (154) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 362.877ms - TotalReadThroughput: 27.25 KB/sec Filter 2 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 3 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 4 (1.00 MB): - Files processed: 158 (158) - Files rejected: 154 (154) - Files total: 158 (158) - RowGroups processed: 294 (294) - RowGroups rejected: 0 (0) - RowGroups total: 294 (294) - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) - Splits processed: 4 (4) - Splits rejected: 0 (0) - Splits total: 4 (4) Instance 7f40dcb034de70b7:1a7 (host=vc1527.foo:22000):(Total: 1s144ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 4:21/4.98 GB 1:21/5.00 GB 5:14/3.45 GB 3:20/4.74 GB 6:24/5.92 GB 2:21/4.86 GB 7:18/4.25 GB 0:17/3.33 GB Filter 4 arrival: 417ms Filter 2 arrival: 6s924ms Filter 3 arrival: 9m23s MemoryUsage(16s000ms): 51.58 MB, 61.50 MB, 61.50 MB, 61.50 MB, 61.50 MB, 61.50 MB, 61.50 MB, 61.50 MB, 61.50 MB, 61.50 MB, 61.50 MB, 61.50 MB, 61.50 MB, 61.50 MB, 61.50 MB, 61.50 MB, 61.50 MB, 61.50 MB, 61.50 MB, 61.50 MB, 61.50 MB, 61.50 MB, 61.50 MB, 61.50 MB, 61.50 MB, 61.50 MB, 61.50 MB, 61.50 MB, 61.50 MB, 61.50 MB, 61.50 MB, 61.50 MB, 61.50 MB, 61.50 MB, 61.50 MB, 61.50 MB, 61.50 MB, 61.50 MB, 61.50 MB ThreadUsage(16s000ms): 12, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.99 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 61.50 MB (64485508) - PerHostPeakMemUsage: 169.56 GB (182068626035) - RowsProduced: 1.99M (1989632) - TotalNetworkReceiveTime: 181.160ms - TotalNetworkSendTime: 649.283us - TotalStorageWaitTime: 1s007ms - TotalThreadsInvoluntaryContextSwitches: 19 (19) - TotalThreadsTotalWallClockTime: 1s268ms - TotalThreadsSysTime: 3.999ms - TotalThreadsUserTime: 179.973ms - TotalThreadsVoluntaryContextSwitches: 39 (39) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 53.746ms - OpenTime: 1s086ms - ExecTreeOpenTime: 904.237ms - PrepareTime: 58.039ms - ExecTreePrepareTime: 635.970us DataStreamSender (dst_id=24):(Total: 284.160ms, non-child: 284.160ms, % non-child: 100.00%) - BytesSent: 17.13 MB (17958676) - NetworkThroughput(*): 97.69 MB/sec - OverallThroughput: 60.27 MB/sec - PeakMemoryUsage: 4.79 MB (5027584) - RowsReturned: 1.99M (1988608) - SerializeBatchTime: 107.849ms - TransmitDataRPCTime: 175.318ms - UncompressedRowBatchSize: 55.51 MB (58209096) CodeGen:(Total: 205.424ms, non-child: 205.424ms, % non-child: 100.00%) - CodegenTime: 1.104ms - CompileTime: 52.546ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 127.478ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 24.920ms HASH_JOIN_NODE (id=8):(Total: 958.515ms, non-child: 46.968ms, % non-child: 4.90%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.730ms - PeakMemoryUsage: 1.10 MB (1156765) - ProbeRows: 1.99M (1989632) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 42.642ms - RowsReturned: 1.99M (1988608) - RowsReturnedRate: 2.07 M/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 58.040us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 182.418us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 90.324us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=19):(Total: 181.171ms, non-child: 20.865us, % non-child: 0.01%) BytesReceived(16s000ms): 963.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 4.196us - DeserializeRowBatchTimer: 19.556us - FirstBatchArrivalWaitTime: 170.804ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 662.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=6):(Total: 730.449ms, non-child: 730.449ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:21/4.98 GB 1:21/5.00 GB 5:14/3.45 GB 3:20/4.74 GB 6:24/5.92 GB 2:21/4.86 GB 7:18/4.25 GB 0:17/3.33 GB ExecOption: PARQUET Codegen Enabled Runtime filters: Only following filters arrived: 4, waited 603ms BytesRead(16s000ms): 22.46 MB, 24.37 MB, 24.37 MB, 24.37 MB, 24.37 MB, 24.37 MB, 24.37 MB, 24.37 MB, 24.37 MB, 24.37 MB, 24.37 MB, 24.37 MB, 24.37 MB, 24.37 MB, 24.37 MB, 24.37 MB, 24.37 MB, 24.37 MB, 24.37 MB, 24.37 MB, 24.37 MB, 24.37 MB, 24.37 MB, 24.37 MB, 24.37 MB, 24.37 MB, 24.37 MB, 24.37 MB, 24.37 MB, 24.37 MB, 24.37 MB, 24.37 MB, 24.37 MB, 24.37 MB, 24.37 MB, 24.37 MB, 24.37 MB, 24.37 MB, 24.37 MB - FooterProcessingTime: (Avg: 79.200ms ; Min: 51.009ms ; Max: 123.281ms ; Number of samples: 6) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 12.00 - BytesRead: 24.37 MB (25551758) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 12.096ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 0 (0) - NumRowGroups: 6 (6) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 39.52 MB (41444434) - PerReadThreadRawHdfsThroughput: 49.12 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 2.11M (2108416) - RowsReturned: 1.99M (1989632) - RowsReturnedRate: 2.72 M/sec - ScanRangesComplete: 150 (150) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 496.048ms - TotalReadThroughput: 39.14 KB/sec Filter 2 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 3 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 4 (1.00 MB): - Files processed: 156 (156) - Files rejected: 150 (150) - Files total: 156 (156) - RowGroups processed: 2.06K (2059) - RowGroups rejected: 0 (0) - RowGroups total: 2.06K (2059) - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) - Splits processed: 6 (6) - Splits rejected: 0 (0) - Splits total: 6 (6) Instance 7f40dcb034de70b7:191 (host=vc1522.foo:22000):(Total: 1s143ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 2:17/3.97 GB 1:11/2.71 GB 0:22/5.26 GB 4:16/3.85 GB 6:27/6.09 GB 7:25/5.86 GB 3:17/4.19 GB 5:22/4.82 GB Filter 4 arrival: 502ms Filter 2 arrival: 6s644ms Filter 3 arrival: 9m23s MemoryUsage(16s000ms): 48.37 MB, 57.29 MB, 57.29 MB, 57.29 MB, 57.29 MB, 57.29 MB, 57.29 MB, 57.29 MB, 57.29 MB, 57.29 MB, 57.29 MB, 57.29 MB, 57.29 MB, 57.29 MB, 57.29 MB, 57.29 MB, 57.29 MB, 57.29 MB, 57.29 MB, 57.29 MB, 57.29 MB, 57.29 MB, 57.29 MB, 57.29 MB, 57.29 MB, 57.29 MB, 57.29 MB, 57.29 MB, 57.29 MB, 57.29 MB, 57.29 MB, 57.29 MB, 57.29 MB, 57.29 MB, 57.29 MB, 57.29 MB, 57.29 MB, 57.29 MB, 57.29 MB ThreadUsage(16s000ms): 5, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6 - AverageThreadTokens: 5.99 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 57.29 MB (60077693) - PerHostPeakMemUsage: 169.56 GB (182064280165) - RowsProduced: 2.45M (2451456) - TotalNetworkReceiveTime: 262.382ms - TotalNetworkSendTime: 875.193us - TotalStorageWaitTime: 642.519ms - TotalThreadsInvoluntaryContextSwitches: 19 (19) - TotalThreadsTotalWallClockTime: 1s349ms - TotalThreadsSysTime: 3.000ms - TotalThreadsUserTime: 184.971ms - TotalThreadsVoluntaryContextSwitches: 62 (62) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 67.700ms - OpenTime: 1s085ms - ExecTreeOpenTime: 900.675ms - PrepareTime: 58.645ms - ExecTreePrepareTime: 538.013us DataStreamSender (dst_id=24):(Total: 352.664ms, non-child: 352.664ms, % non-child: 100.00%) - BytesSent: 21.41 MB (22454954) - NetworkThroughput(*): 96.56 MB/sec - OverallThroughput: 60.72 MB/sec - PeakMemoryUsage: 4.47 MB (4683520) - RowsReturned: 2.45M (2450432) - SerializeBatchTime: 129.680ms - TransmitDataRPCTime: 221.776ms - UncompressedRowBatchSize: 68.71 MB (72052456) CodeGen:(Total: 206.582ms, non-child: 206.582ms, % non-child: 100.00%) - CodegenTime: 1.139ms - CompileTime: 53.338ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 129.445ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 23.337ms HASH_JOIN_NODE (id=8):(Total: 968.592ms, non-child: 61.940ms, % non-child: 6.39%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 2.179ms - PeakMemoryUsage: 1.11 MB (1162466) - ProbeRows: 2.45M (2451456) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 57.381ms - RowsReturned: 2.45M (2450432) - RowsReturnedRate: 2.53 M/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 13.902us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 202.353us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 21.556us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=19):(Total: 262.392ms, non-child: 15.863us, % non-child: 0.01%) BytesReceived(16s000ms): 963.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 4.384us - DeserializeRowBatchTimer: 15.128us - FirstBatchArrivalWaitTime: 250.743ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 457.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=6):(Total: 644.329ms, non-child: 644.329ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:17/3.97 GB 1:11/2.71 GB 0:22/5.26 GB 4:16/3.85 GB 6:27/6.09 GB 7:25/5.86 GB 3:17/4.19 GB 5:22/4.82 GB ExecOption: PARQUET Codegen Enabled Runtime filters: Only following filters arrived: 4, waited 522ms BytesRead(16s000ms): 20.54 MB, 21.91 MB, 21.91 MB, 21.91 MB, 21.91 MB, 21.91 MB, 21.91 MB, 21.91 MB, 21.91 MB, 21.91 MB, 21.91 MB, 21.91 MB, 21.91 MB, 21.91 MB, 21.91 MB, 21.91 MB, 21.91 MB, 21.91 MB, 21.91 MB, 21.91 MB, 21.91 MB, 21.91 MB, 21.91 MB, 21.91 MB, 21.91 MB, 21.91 MB, 21.91 MB, 21.91 MB, 21.91 MB, 21.91 MB, 21.91 MB, 21.91 MB, 21.91 MB, 21.91 MB, 21.91 MB, 21.91 MB, 21.91 MB, 21.91 MB, 21.91 MB - FooterProcessingTime: (Avg: 52.901ms ; Min: 34.788ms ; Max: 67.548ms ; Number of samples: 5) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.99 - BytesRead: 21.91 MB (22972755) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 15.037ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 0 (0) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 5 (5) - PeakMemoryUsage: 35.31 MB (37029321) - PerReadThreadRawHdfsThroughput: 77.52 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 2.57M (2569216) - RowsReturned: 2.45M (2451456) - RowsReturnedRate: 3.80 M/sec - ScanRangesComplete: 152 (152) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 282.631ms - TotalReadThroughput: 35.33 KB/sec Filter 2 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 3 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 4 (1.00 MB): - Files processed: 157 (157) - Files rejected: 152 (152) - Files total: 157 (157) - RowGroups processed: 2.51K (2509) - RowGroups rejected: 0 (0) - RowGroups total: 2.51K (2509) - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) - Splits processed: 5 (5) - Splits rejected: 0 (0) - Splits total: 5 (5) Instance 7f40dcb034de70b7:19c (host=va1029.foo:22000):(Total: 1s142ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:18/4.04 GB 2:17/4.04 GB 6:20/4.46 GB 7:17/4.03 GB 3:20/4.61 GB 4:23/5.28 GB 5:23/4.90 GB 1:22/5.19 GB Filter 4 arrival: 473ms Filter 2 arrival: 6s762ms Filter 3 arrival: 9m23s MemoryUsage(16s000ms): 45.23 MB, 55.27 MB, 55.27 MB, 55.27 MB, 55.27 MB, 55.27 MB, 55.27 MB, 55.27 MB, 55.27 MB, 55.27 MB, 55.27 MB, 55.27 MB, 55.27 MB, 55.27 MB, 55.27 MB, 55.27 MB, 55.27 MB, 55.27 MB, 55.27 MB, 55.27 MB, 55.27 MB, 55.27 MB, 55.27 MB, 55.27 MB, 55.27 MB, 55.27 MB, 55.27 MB, 55.27 MB, 55.27 MB, 55.27 MB, 55.27 MB, 55.27 MB, 55.27 MB, 55.27 MB, 55.27 MB, 55.27 MB, 55.27 MB, 55.27 MB, 55.27 MB ThreadUsage(16s000ms): 5, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6 - AverageThreadTokens: 5.99 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 55.27 MB (57959029) - PerHostPeakMemUsage: 169.56 GB (182062110817) - RowsProduced: 2.55M (2550784) - TotalNetworkReceiveTime: 232.520ms - TotalNetworkSendTime: 851.647us - TotalStorageWaitTime: 949.624ms - TotalThreadsInvoluntaryContextSwitches: 22 (22) - TotalThreadsTotalWallClockTime: 1s322ms - TotalThreadsSysTime: 4.999ms - TotalThreadsUserTime: 188.971ms - TotalThreadsVoluntaryContextSwitches: 51 (51) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 57.117ms - OpenTime: 1s088ms - ExecTreeOpenTime: 897.770ms - PrepareTime: 53.878ms - ExecTreePrepareTime: 561.051us DataStreamSender (dst_id=24):(Total: 329.579ms, non-child: 329.579ms, % non-child: 100.00%) - BytesSent: 22.12 MB (23192578) - NetworkThroughput(*): 105.66 MB/sec - OverallThroughput: 67.11 MB/sec - PeakMemoryUsage: 4.65 MB (4880128) - RowsReturned: 2.55M (2549760) - SerializeBatchTime: 119.004ms - TransmitDataRPCTime: 209.335ms - UncompressedRowBatchSize: 71.59 MB (75066736) CodeGen:(Total: 209.482ms, non-child: 209.482ms, % non-child: 100.00%) - CodegenTime: 1.184ms - CompileTime: 59.349ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 129.733ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 19.940ms HASH_JOIN_NODE (id=8):(Total: 955.222ms, non-child: 51.567ms, % non-child: 5.40%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.414ms - PeakMemoryUsage: 1.11 MB (1162523) - ProbeRows: 2.55M (2550784) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 47.358ms - RowsReturned: 2.55M (2549760) - RowsReturnedRate: 2.67 M/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 25.095us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 122.240us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 60.458us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=19):(Total: 232.531ms, non-child: 19.577us, % non-child: 0.01%) BytesReceived(16s000ms): 963.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 5.399us - DeserializeRowBatchTimer: 17.911us - FirstBatchArrivalWaitTime: 208.783ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 516.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=6):(Total: 671.289ms, non-child: 671.289ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:18/4.04 GB 2:17/4.04 GB 6:20/4.46 GB 7:17/4.03 GB 3:20/4.61 GB 4:23/5.28 GB 5:23/4.90 GB 1:22/5.19 GB ExecOption: PARQUET Codegen Enabled Runtime filters: Only following filters arrived: 4, waited 563ms BytesRead(16s000ms): 17.76 MB, 19.59 MB, 19.59 MB, 19.59 MB, 19.59 MB, 19.59 MB, 19.59 MB, 19.59 MB, 19.59 MB, 19.59 MB, 19.59 MB, 19.59 MB, 19.59 MB, 19.59 MB, 19.59 MB, 19.59 MB, 19.59 MB, 19.59 MB, 19.59 MB, 19.59 MB, 19.59 MB, 19.59 MB, 19.59 MB, 19.59 MB, 19.59 MB, 19.59 MB, 19.59 MB, 19.59 MB, 19.59 MB, 19.59 MB, 19.59 MB, 19.59 MB, 19.59 MB, 19.59 MB, 19.59 MB, 19.59 MB, 19.59 MB, 19.59 MB, 19.59 MB - FooterProcessingTime: (Avg: 91.484ms ; Min: 65.614ms ; Max: 148.550ms ; Number of samples: 5) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 5.00 - BytesRead: 19.59 MB (20539953) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 18.151ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 0 (0) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 5 (5) - PeakMemoryUsage: 33.39 MB (35008477) - PerReadThreadRawHdfsThroughput: 43.35 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 2.67M (2668544) - RowsReturned: 2.55M (2550784) - RowsReturnedRate: 3.80 M/sec - ScanRangesComplete: 155 (155) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 451.902ms - TotalReadThroughput: 31.42 KB/sec Filter 2 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 3 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 4 (1.00 MB): - Files processed: 160 (160) - Files rejected: 155 (155) - Files total: 160 (160) - RowGroups processed: 2.61K (2606) - RowGroups rejected: 0 (0) - RowGroups total: 2.61K (2606) - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) - Splits processed: 5 (5) - Splits rejected: 0 (0) - Splits total: 5 (5) Instance 7f40dcb034de70b7:1fc (host=vd1134.foo:22000):(Total: 1s142ms, non-child: 8.630ms, % non-child: 0.76%) Hdfs split stats (:<# splits>/): 5:22/5.43 GB 1:21/5.18 GB 0:16/3.94 GB 3:17/3.81 GB 2:19/3.96 GB 4:15/3.60 GB 6:20/4.77 GB 7:24/5.64 GB Filter 4 arrival: 267ms Filter 2 arrival: 9s352ms Filter 3 arrival: 9m23s MemoryUsage(16s000ms): 44.74 MB, 57.15 MB, 57.15 MB, 57.15 MB, 57.15 MB, 57.15 MB, 57.15 MB, 57.15 MB, 57.15 MB, 57.15 MB, 57.15 MB, 57.15 MB, 57.15 MB, 57.15 MB, 57.15 MB, 57.15 MB, 57.15 MB, 57.15 MB, 57.15 MB, 57.15 MB, 57.15 MB, 57.15 MB, 57.15 MB, 57.15 MB, 57.15 MB, 57.15 MB, 57.15 MB, 57.15 MB, 57.15 MB, 57.15 MB, 57.15 MB, 57.15 MB, 57.15 MB, 57.15 MB, 57.15 MB, 57.15 MB, 57.15 MB, 57.15 MB, 57.15 MB ThreadUsage(16s000ms): 12, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.98 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 57.15 MB (59920917) - PerHostPeakMemUsage: 169.55 GB (182057958244) - RowsProduced: 124.93K (124928) - TotalNetworkReceiveTime: 6.625us - TotalNetworkSendTime: 29.092us - TotalStorageWaitTime: 919.107ms - TotalThreadsInvoluntaryContextSwitches: 29 (29) - TotalThreadsTotalWallClockTime: 1s091ms - TotalThreadsSysTime: 1.999ms - TotalThreadsUserTime: 216.967ms - TotalThreadsVoluntaryContextSwitches: 56 (56) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 4.219ms - OpenTime: 1s089ms - ExecTreeOpenTime: 872.036ms - PrepareTime: 52.764ms - ExecTreePrepareTime: 528.462us DataStreamSender (dst_id=24):(Total: 13.904ms, non-child: 13.904ms, % non-child: 100.00%) - BytesSent: 660.61 KB (676468) - NetworkThroughput(*): 103.82 MB/sec - OverallThroughput: 46.40 MB/sec - PeakMemoryUsage: 4.72 MB (4945664) - RowsReturned: 123.90K (123904) - SerializeBatchTime: 7.200ms - TransmitDataRPCTime: 6.213ms - UncompressedRowBatchSize: 2.13 MB (2232800) CodeGen:(Total: 242.620ms, non-child: 242.620ms, % non-child: 100.00%) - CodegenTime: 2.075ms - CompileTime: 69.816ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 145.566ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 26.336ms HASH_JOIN_NODE (id=8):(Total: 877.209ms, non-child: 5.929ms, % non-child: 0.68%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 2.144ms - PeakMemoryUsage: 1.11 MB (1159046) - ProbeRows: 124.93K (124928) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3.334ms - RowsReturned: 123.90K (123904) - RowsReturnedRate: 141.25 K/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 23.444us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 195.039us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 67.780us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=19):(Total: 19.608us, non-child: 19.608us, % non-child: 100.00%) BytesReceived(16s000ms): 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 6.525us - DeserializeRowBatchTimer: 18.773us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 6.12 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=6):(Total: 871.269ms, non-child: 871.269ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:22/5.43 GB 1:21/5.18 GB 0:16/3.94 GB 3:17/3.81 GB 2:19/3.96 GB 4:15/3.60 GB 6:20/4.77 GB 7:24/5.64 GB ExecOption: PARQUET Codegen Enabled Runtime filters: Only following filters arrived: 4, waited 763ms BytesRead(16s000ms): 20.06 MB, 22.12 MB, 22.12 MB, 22.12 MB, 22.12 MB, 22.12 MB, 22.12 MB, 22.12 MB, 22.12 MB, 22.12 MB, 22.12 MB, 22.12 MB, 22.12 MB, 22.12 MB, 22.12 MB, 22.12 MB, 22.12 MB, 22.12 MB, 22.12 MB, 22.12 MB, 22.12 MB, 22.12 MB, 22.12 MB, 22.12 MB, 22.12 MB, 22.12 MB, 22.12 MB, 22.12 MB, 22.12 MB, 22.12 MB, 22.12 MB, 22.12 MB, 22.12 MB, 22.12 MB, 22.12 MB, 22.12 MB, 22.12 MB, 22.12 MB, 22.12 MB - FooterProcessingTime: (Avg: 74.573ms ; Min: 30.712ms ; Max: 124.358ms ; Number of samples: 5) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 11.99 - BytesRead: 22.12 MB (23191357) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 2.370ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 0 (0) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 35.21 MB (36924042) - PerReadThreadRawHdfsThroughput: 45.97 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 242.69K (242688) - RowsReturned: 124.93K (124928) - RowsReturnedRate: 143.39 K/sec - ScanRangesComplete: 149 (149) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 481.101ms - TotalReadThroughput: 35.47 KB/sec Filter 2 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 3 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 4 (1.00 MB): - Files processed: 154 (154) - Files rejected: 149 (149) - Files total: 154 (154) - RowGroups processed: 237 (237) - RowGroups rejected: 0 (0) - RowGroups total: 237 (237) - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) - Splits processed: 5 (5) - Splits rejected: 0 (0) - Splits total: 5 (5) Instance 7f40dcb034de70b7:1e1 (host=vd1337.foo:22000):(Total: 1s142ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 1:17/3.74 GB 4:18/4.27 GB 2:19/3.95 GB 3:17/4.13 GB 6:16/3.27 GB 5:24/5.71 GB 0:25/5.97 GB 7:24/5.73 GB Filter 4 arrival: 248ms Filter 2 arrival: 7s650ms Filter 3 arrival: 9m23s MemoryUsage(16s000ms): 46.40 MB, 57.19 MB, 57.19 MB, 57.19 MB, 57.19 MB, 57.19 MB, 57.19 MB, 57.19 MB, 57.19 MB, 57.19 MB, 57.19 MB, 57.19 MB, 57.19 MB, 57.19 MB, 57.19 MB, 57.19 MB, 57.19 MB, 57.19 MB, 57.19 MB, 57.19 MB, 57.19 MB, 57.19 MB, 57.19 MB, 57.19 MB, 57.19 MB, 57.19 MB, 57.19 MB, 57.19 MB, 57.19 MB, 57.19 MB, 57.19 MB, 57.19 MB, 57.19 MB, 57.19 MB, 57.19 MB, 57.19 MB, 57.19 MB, 57.19 MB, 57.19 MB ThreadUsage(16s000ms): 12, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.98 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 57.19 MB (59967330) - PerHostPeakMemUsage: 169.56 GB (182064161916) - RowsProduced: 593.92K (593920) - TotalNetworkReceiveTime: 4.242us - TotalNetworkSendTime: 196.929us - TotalStorageWaitTime: 766.050ms - TotalThreadsInvoluntaryContextSwitches: 38 (38) - TotalThreadsTotalWallClockTime: 1s088ms - TotalThreadsSysTime: 4.999ms - TotalThreadsUserTime: 190.971ms - TotalThreadsVoluntaryContextSwitches: 65 (65) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 16.485ms - OpenTime: 1s087ms - ExecTreeOpenTime: 891.011ms - PrepareTime: 54.880ms - ExecTreePrepareTime: 556.813us DataStreamSender (dst_id=24):(Total: 81.419ms, non-child: 81.419ms, % non-child: 100.00%) - BytesSent: 4.75 MB (4975811) - NetworkThroughput(*): 99.15 MB/sec - OverallThroughput: 58.28 MB/sec - PeakMemoryUsage: 4.76 MB (4994816) - RowsReturned: 592.90K (592896) - SerializeBatchTime: 32.848ms - TransmitDataRPCTime: 47.860ms - UncompressedRowBatchSize: 15.57 MB (16321768) CodeGen:(Total: 221.151ms, non-child: 221.151ms, % non-child: 100.00%) - CodegenTime: 1.139ms - CompileTime: 58.244ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 136.609ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 25.815ms HASH_JOIN_NODE (id=8):(Total: 908.346ms, non-child: 15.932ms, % non-child: 1.75%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.283ms - PeakMemoryUsage: 1.10 MB (1158505) - ProbeRows: 593.92K (593920) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 13.755ms - RowsReturned: 592.90K (592896) - RowsReturnedRate: 652.72 K/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 21.396us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 115.199us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 49.831us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=19):(Total: 13.661us, non-child: 13.661us, % non-child: 100.00%) BytesReceived(16s000ms): 963.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 4.424us - DeserializeRowBatchTimer: 17.838us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 8.78 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=6):(Total: 892.406ms, non-child: 892.406ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:17/3.74 GB 4:18/4.27 GB 2:19/3.95 GB 3:17/4.13 GB 6:16/3.27 GB 5:24/5.71 GB 0:25/5.97 GB 7:24/5.73 GB ExecOption: PARQUET Codegen Enabled Runtime filters: Only following filters arrived: 4, waited 783ms BytesRead(16s000ms): 19.44 MB, 21.44 MB, 21.44 MB, 21.44 MB, 21.44 MB, 21.44 MB, 21.44 MB, 21.44 MB, 21.44 MB, 21.44 MB, 21.44 MB, 21.44 MB, 21.44 MB, 21.44 MB, 21.44 MB, 21.44 MB, 21.44 MB, 21.44 MB, 21.44 MB, 21.44 MB, 21.44 MB, 21.44 MB, 21.44 MB, 21.44 MB, 21.44 MB, 21.44 MB, 21.44 MB, 21.44 MB, 21.44 MB, 21.44 MB, 21.44 MB, 21.44 MB, 21.44 MB, 21.44 MB, 21.44 MB, 21.44 MB, 21.44 MB, 21.44 MB, 21.44 MB - FooterProcessingTime: (Avg: 60.854ms ; Min: 49.304ms ; Max: 88.539ms ; Number of samples: 5) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 11.99 - BytesRead: 21.44 MB (22477826) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 3.574ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 0 (0) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 35.19 MB (36900579) - PerReadThreadRawHdfsThroughput: 55.34 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 711.68K (711680) - RowsReturned: 593.92K (593920) - RowsReturnedRate: 665.53 K/sec - ScanRangesComplete: 155 (155) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 387.393ms - TotalReadThroughput: 34.49 KB/sec Filter 2 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 3 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 4 (1.00 MB): - Files processed: 160 (160) - Files rejected: 155 (155) - Files total: 160 (160) - RowGroups processed: 695 (695) - RowGroups rejected: 0 (0) - RowGroups total: 695 (695) - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) - Splits processed: 5 (5) - Splits rejected: 0 (0) - Splits total: 5 (5) Instance 7f40dcb034de70b7:1a4 (host=vd1328.foo:22000):(Total: 1s141ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 2:20/4.49 GB 1:18/4.44 GB 0:13/2.96 GB 4:18/4.08 GB 5:22/5.23 GB 6:25/5.59 GB 7:24/5.24 GB 3:23/4.64 GB Filter 4 arrival: 437ms Filter 2 arrival: 6s832ms Filter 3 arrival: 9m23s MemoryUsage(16s000ms): 56.13 MB, 65.50 MB, 65.50 MB, 65.50 MB, 65.50 MB, 65.50 MB, 65.50 MB, 65.50 MB, 65.50 MB, 65.50 MB, 65.50 MB, 65.50 MB, 65.50 MB, 65.50 MB, 65.50 MB, 65.50 MB, 65.50 MB, 65.50 MB, 65.50 MB, 65.50 MB, 65.50 MB, 65.50 MB, 65.50 MB, 65.50 MB, 65.50 MB, 65.50 MB, 65.50 MB, 65.50 MB, 65.50 MB, 65.50 MB, 65.50 MB, 65.50 MB, 65.50 MB, 65.50 MB, 65.50 MB, 65.50 MB, 65.50 MB, 65.50 MB, 65.50 MB ThreadUsage(16s000ms): 12, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.98 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 65.50 MB (68685063) - PerHostPeakMemUsage: 169.56 GB (182066128678) - RowsProduced: 1.87M (1873920) - TotalNetworkReceiveTime: 186.767ms - TotalNetworkSendTime: 13.319ms - TotalStorageWaitTime: 1s168ms - TotalThreadsInvoluntaryContextSwitches: 21 (21) - TotalThreadsTotalWallClockTime: 1s272ms - TotalThreadsSysTime: 5.999ms - TotalThreadsUserTime: 193.970ms - TotalThreadsVoluntaryContextSwitches: 37 (37) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 48.347ms - OpenTime: 1s085ms - ExecTreeOpenTime: 887.462ms - PrepareTime: 56.258ms - ExecTreePrepareTime: 590.011us DataStreamSender (dst_id=24):(Total: 274.316ms, non-child: 274.316ms, % non-child: 100.00%) - BytesSent: 16.46 MB (17263904) - NetworkThroughput(*): 95.14 MB/sec - OverallThroughput: 60.02 MB/sec - PeakMemoryUsage: 4.65 MB (4880128) - RowsReturned: 1.87M (1872896) - SerializeBatchTime: 99.874ms - TransmitDataRPCTime: 173.046ms - UncompressedRowBatchSize: 52.17 MB (54703600) CodeGen:(Total: 217.492ms, non-child: 217.492ms, % non-child: 100.00%) - CodegenTime: 1.357ms - CompileTime: 60.709ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 134.766ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 21.539ms HASH_JOIN_NODE (id=8):(Total: 936.269ms, non-child: 42.994ms, % non-child: 4.59%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.414ms - PeakMemoryUsage: 1.12 MB (1172152) - ProbeRows: 1.87M (1874019) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 39.171ms - RowsReturned: 1.87M (1872995) - RowsReturnedRate: 2.00 M/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 13.790us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 130.508us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 30.556us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=19):(Total: 186.773ms, non-child: 13.011us, % non-child: 0.01%) BytesReceived(16s000ms): 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 2.941us - DeserializeRowBatchTimer: 10.387us - FirstBatchArrivalWaitTime: 161.200ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 642.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=6):(Total: 706.611ms, non-child: 706.611ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:20/4.49 GB 1:18/4.44 GB 0:13/2.96 GB 4:18/4.08 GB 5:22/5.23 GB 6:25/5.59 GB 7:24/5.24 GB 3:23/4.64 GB ExecOption: PARQUET Codegen Enabled Runtime filters: Only following filters arrived: 4, waited 582ms BytesRead(16s000ms): 25.09 MB, 26.76 MB, 26.76 MB, 26.76 MB, 26.76 MB, 26.76 MB, 26.76 MB, 26.76 MB, 26.76 MB, 26.76 MB, 26.76 MB, 26.76 MB, 26.76 MB, 26.76 MB, 26.76 MB, 26.76 MB, 26.76 MB, 26.76 MB, 26.76 MB, 26.76 MB, 26.76 MB, 26.76 MB, 26.76 MB, 26.76 MB, 26.76 MB, 26.76 MB, 26.76 MB, 26.76 MB, 26.76 MB, 26.76 MB, 26.76 MB, 26.76 MB, 26.76 MB, 26.76 MB, 26.76 MB, 26.76 MB, 26.76 MB, 26.76 MB, 26.76 MB - FooterProcessingTime: (Avg: 74.809ms ; Min: 44.472ms ; Max: 97.815ms ; Number of samples: 7) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 11.98 - BytesRead: 26.76 MB (28062627) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 10.466ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 0 (0) - NumRowGroups: 7 (7) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 44.73 MB (46899338) - PerReadThreadRawHdfsThroughput: 45.13 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 1.99M (1992803) - RowsReturned: 1.87M (1874019) - RowsReturnedRate: 2.65 M/sec - ScanRangesComplete: 157 (157) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 16.704ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 593.059ms - TotalReadThroughput: 43.16 KB/sec Filter 2 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 347.24K (347235) Filter 3 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 347.24K (347235) Filter 4 (1.00 MB): - Files processed: 163 (163) - Files rejected: 156 (156) - Files total: 163 (163) - RowGroups processed: 1.95K (1947) - RowGroups rejected: 0 (0) - RowGroups total: 1.95K (1947) - Rows processed: 16.38K (16384) - Rows rejected: 0 (0) - Rows total: 347.24K (347235) - Splits processed: 7 (7) - Splits rejected: 0 (0) - Splits total: 7 (7) Instance 7f40dcb034de70b7:1ca (host=vd1341.foo:22000):(Total: 1s141ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 5:24/5.68 GB 3:15/3.46 GB 1:16/3.78 GB 7:20/4.70 GB 4:21/5.15 GB 0:18/4.44 GB 2:24/5.92 GB 6:16/3.57 GB Filter 4 arrival: 277ms Filter 2 arrival: 7s340ms Filter 3 arrival: 9m23s MemoryUsage(16s000ms): 51.54 MB, 61.14 MB, 61.14 MB, 61.14 MB, 61.14 MB, 61.14 MB, 61.14 MB, 61.14 MB, 61.14 MB, 61.14 MB, 61.14 MB, 61.14 MB, 61.14 MB, 61.14 MB, 61.14 MB, 61.14 MB, 61.14 MB, 61.14 MB, 61.14 MB, 61.14 MB, 61.14 MB, 61.14 MB, 61.14 MB, 61.14 MB, 61.14 MB, 61.14 MB, 61.14 MB, 61.14 MB, 61.14 MB, 61.14 MB, 61.14 MB, 61.14 MB, 61.14 MB, 61.14 MB, 61.14 MB, 61.14 MB, 61.14 MB, 61.14 MB, 61.14 MB ThreadUsage(16s000ms): 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 13.00 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 61.14 MB (64108190) - PerHostPeakMemUsage: 169.56 GB (182068199748) - RowsProduced: 906.24K (906240) - TotalNetworkReceiveTime: 8.040ms - TotalNetworkSendTime: 24.101ms - TotalStorageWaitTime: 801.790ms - TotalThreadsInvoluntaryContextSwitches: 34 (34) - TotalThreadsTotalWallClockTime: 1s087ms - TotalThreadsSysTime: 3.999ms - TotalThreadsUserTime: 201.968ms - TotalThreadsVoluntaryContextSwitches: 125 (125) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 27.153ms - OpenTime: 1s077ms - ExecTreeOpenTime: 869.833ms - PrepareTime: 63.174ms - ExecTreePrepareTime: 573.568us DataStreamSender (dst_id=24):(Total: 136.063ms, non-child: 136.063ms, % non-child: 100.00%) - BytesSent: 7.59 MB (7954865) - NetworkThroughput(*): 92.71 MB/sec - OverallThroughput: 55.76 MB/sec - PeakMemoryUsage: 4.79 MB (5027584) - RowsReturned: 905.22K (905216) - SerializeBatchTime: 53.129ms - TransmitDataRPCTime: 81.826ms - UncompressedRowBatchSize: 24.51 MB (25699528) CodeGen:(Total: 229.016ms, non-child: 229.016ms, % non-child: 100.00%) - CodegenTime: 1.060ms - CompileTime: 70.979ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 135.099ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 22.442ms HASH_JOIN_NODE (id=8):(Total: 897.692ms, non-child: 25.344ms, % non-child: 2.82%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.899ms - PeakMemoryUsage: 1.11 MB (1161540) - ProbeRows: 906.24K (906240) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 21.812ms - RowsReturned: 905.22K (905216) - RowsReturnedRate: 1.01 M/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 37.309us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 100.262us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 98.865us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=19):(Total: 8.051ms, non-child: 18.301us, % non-child: 0.23%) BytesReceived(16s000ms): 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 6.053us - DeserializeRowBatchTimer: 14.477us - FirstBatchArrivalWaitTime: 1.084ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 14.90 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=6):(Total: 864.408ms, non-child: 864.408ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:24/5.68 GB 3:15/3.46 GB 1:16/3.78 GB 7:20/4.70 GB 4:21/5.15 GB 0:18/4.44 GB 2:24/5.92 GB 6:16/3.57 GB ExecOption: PARQUET Codegen Enabled Runtime filters: Only following filters arrived: 4, waited 745ms BytesRead(16s000ms): 21.57 MB, 23.01 MB, 23.01 MB, 23.01 MB, 23.01 MB, 23.01 MB, 23.01 MB, 23.01 MB, 23.01 MB, 23.01 MB, 23.01 MB, 23.01 MB, 23.01 MB, 23.01 MB, 23.01 MB, 23.01 MB, 23.01 MB, 23.01 MB, 23.01 MB, 23.01 MB, 23.01 MB, 23.01 MB, 23.01 MB, 23.01 MB, 23.01 MB, 23.01 MB, 23.01 MB, 23.01 MB, 23.01 MB, 23.01 MB, 23.01 MB, 23.01 MB, 23.01 MB, 23.01 MB, 23.01 MB, 23.01 MB, 23.01 MB, 23.01 MB, 23.01 MB - FooterProcessingTime: (Avg: 55.904ms ; Min: 33.249ms ; Max: 86.435ms ; Number of samples: 5) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 12.00 - BytesRead: 23.01 MB (24128776) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 6.638ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 0 (0) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 39.29 MB (41193528) - PerReadThreadRawHdfsThroughput: 51.06 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 1.02M (1024000) - RowsReturned: 906.24K (906240) - RowsReturnedRate: 1.05 M/sec - ScanRangesComplete: 149 (149) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 450.701ms - TotalReadThroughput: 36.96 KB/sec Filter 2 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 3 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 4 (1.00 MB): - Files processed: 154 (154) - Files rejected: 149 (149) - Files total: 154 (154) - RowGroups processed: 1.00K (1000) - RowGroups rejected: 0 (0) - RowGroups total: 1.00K (1000) - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) - Splits processed: 5 (5) - Splits rejected: 0 (0) - Splits total: 5 (5) Instance 7f40dcb034de70b7:19d (host=vd1335.foo:22000):(Total: 1s140ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:17/3.91 GB 4:23/5.41 GB 3:22/4.95 GB 2:22/5.04 GB 5:20/4.41 GB 6:16/3.29 GB 1:21/4.24 GB 7:22/5.15 GB Filter 4 arrival: 460ms Filter 2 arrival: 6s811ms Filter 3 arrival: 9m23s MemoryUsage(16s000ms): 32.49 MB, 40.88 MB, 40.88 MB, 40.88 MB, 40.88 MB, 40.88 MB, 40.88 MB, 40.88 MB, 40.88 MB, 40.88 MB, 40.88 MB, 40.88 MB, 40.88 MB, 40.88 MB, 40.88 MB, 40.88 MB, 40.88 MB, 40.88 MB, 40.88 MB, 40.88 MB, 40.88 MB, 40.88 MB, 40.88 MB, 40.88 MB, 40.88 MB, 40.88 MB, 40.88 MB, 40.88 MB, 40.88 MB, 40.88 MB, 40.88 MB, 40.88 MB, 40.88 MB, 40.88 MB, 40.88 MB, 40.88 MB, 40.88 MB, 40.88 MB, 40.88 MB ThreadUsage(16s000ms): 12, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.98 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 40.88 MB (42866722) - PerHostPeakMemUsage: 169.54 GB (182040960593) - RowsProduced: 1.81M (1813504) - TotalNetworkReceiveTime: 231.506ms - TotalNetworkSendTime: 35.218ms - TotalStorageWaitTime: 602.617ms - TotalThreadsInvoluntaryContextSwitches: 23 (23) - TotalThreadsTotalWallClockTime: 1s326ms - TotalThreadsSysTime: 2.000ms - TotalThreadsUserTime: 185.971ms - TotalThreadsVoluntaryContextSwitches: 39 (39) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 56.677ms - OpenTime: 1s093ms - ExecTreeOpenTime: 907.415ms - PrepareTime: 46.872ms - ExecTreePrepareTime: 558.970us DataStreamSender (dst_id=24):(Total: 269.079ms, non-child: 269.079ms, % non-child: 100.00%) - BytesSent: 15.43 MB (16177481) - NetworkThroughput(*): 94.24 MB/sec - OverallThroughput: 57.34 MB/sec - PeakMemoryUsage: 4.73 MB (4962048) - RowsReturned: 1.81M (1812480) - SerializeBatchTime: 104.827ms - TransmitDataRPCTime: 163.710ms - UncompressedRowBatchSize: 50.51 MB (52962016) CodeGen:(Total: 203.056ms, non-child: 203.056ms, % non-child: 100.00%) - CodegenTime: 1.045ms - CompileTime: 56.190ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 128.430ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 18.026ms HASH_JOIN_NODE (id=8):(Total: 964.511ms, non-child: 50.149ms, % non-child: 5.20%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.386ms - PeakMemoryUsage: 1.10 MB (1153468) - ProbeRows: 1.81M (1813504) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 46.276ms - RowsReturned: 1.81M (1812480) - RowsReturnedRate: 1.88 M/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 22.826us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 140.503us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 68.398us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=19):(Total: 231.515ms, non-child: 18.262us, % non-child: 0.01%) BytesReceived(16s000ms): 963.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 4.062us - DeserializeRowBatchTimer: 21.827us - FirstBatchArrivalWaitTime: 213.896ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 518.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=6):(Total: 682.940ms, non-child: 682.940ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:17/3.91 GB 4:23/5.41 GB 3:22/4.95 GB 2:22/5.04 GB 5:20/4.41 GB 6:16/3.29 GB 1:21/4.24 GB 7:22/5.15 GB ExecOption: PARQUET Codegen Enabled Runtime filters: Only following filters arrived: 4, waited 562ms BytesRead(16s000ms): 14.83 MB, 15.82 MB, 15.82 MB, 15.82 MB, 15.82 MB, 15.82 MB, 15.82 MB, 15.82 MB, 15.82 MB, 15.82 MB, 15.82 MB, 15.82 MB, 15.82 MB, 15.82 MB, 15.82 MB, 15.82 MB, 15.82 MB, 15.82 MB, 15.82 MB, 15.82 MB, 15.82 MB, 15.82 MB, 15.82 MB, 15.82 MB, 15.82 MB, 15.82 MB, 15.82 MB, 15.82 MB, 15.82 MB, 15.82 MB, 15.82 MB, 15.82 MB, 15.82 MB, 15.82 MB, 15.82 MB, 15.82 MB, 15.82 MB, 15.82 MB, 15.82 MB - FooterProcessingTime: (Avg: 66.526ms ; Min: 42.399ms ; Max: 76.888ms ; Number of samples: 4) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 11.98 - BytesRead: 15.82 MB (16585791) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 10.587ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 0 (0) - NumRowGroups: 4 (4) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 18.99 MB (19914630) - PerReadThreadRawHdfsThroughput: 42.59 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 1.93M (1930240) - RowsReturned: 1.81M (1813504) - RowsReturnedRate: 2.66 M/sec - ScanRangesComplete: 159 (159) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 371.351ms - TotalReadThroughput: 25.37 KB/sec Filter 2 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 3 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 4 (1.00 MB): - Files processed: 163 (163) - Files rejected: 159 (159) - Files total: 163 (163) - RowGroups processed: 1.89K (1885) - RowGroups rejected: 0 (0) - RowGroups total: 1.89K (1885) - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) - Splits processed: 4 (4) - Splits rejected: 0 (0) - Splits total: 4 (4) Instance 7f40dcb034de70b7:1c2 (host=vd1123.foo:22000):(Total: 1s140ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 5:20/4.75 GB 3:14/3.23 GB 4:22/5.00 GB 7:18/4.44 GB 0:18/4.25 GB 6:23/5.46 GB 1:23/5.61 GB 2:16/3.72 GB Filter 4 arrival: 333ms Filter 2 arrival: 7s295ms Filter 3 arrival: 9m23s MemoryUsage(16s000ms): 65.42 MB, 75.95 MB, 75.95 MB, 75.95 MB, 75.95 MB, 75.95 MB, 75.95 MB, 75.95 MB, 75.95 MB, 75.95 MB, 75.95 MB, 75.95 MB, 75.95 MB, 75.95 MB, 75.95 MB, 75.95 MB, 75.95 MB, 75.95 MB, 75.95 MB, 75.95 MB, 75.95 MB, 75.95 MB, 75.95 MB, 75.95 MB, 75.95 MB, 75.95 MB, 75.95 MB, 75.95 MB, 75.95 MB, 75.95 MB, 75.95 MB, 75.95 MB, 75.95 MB, 75.95 MB, 75.95 MB, 75.95 MB, 75.95 MB, 75.95 MB, 75.95 MB ThreadUsage(16s000ms): 12, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.98 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 75.95 MB (79643094) - PerHostPeakMemUsage: 169.57 GB (182077736965) - RowsProduced: 1.16M (1162240) - TotalNetworkReceiveTime: 68.125ms - TotalNetworkSendTime: 572.601us - TotalStorageWaitTime: 1s393ms - TotalThreadsInvoluntaryContextSwitches: 33 (33) - TotalThreadsTotalWallClockTime: 1s148ms - TotalThreadsSysTime: 5.998ms - TotalThreadsUserTime: 201.969ms - TotalThreadsVoluntaryContextSwitches: 91 (91) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 41.672ms - OpenTime: 1s079ms - ExecTreeOpenTime: 870.300ms - PrepareTime: 60.477ms - ExecTreePrepareTime: 600.798us DataStreamSender (dst_id=24):(Total: 196.739ms, non-child: 196.739ms, % non-child: 100.00%) - BytesSent: 9.97 MB (10453517) - NetworkThroughput(*): 81.85 MB/sec - OverallThroughput: 50.67 MB/sec - PeakMemoryUsage: 4.60 MB (4822784) - RowsReturned: 1.16M (1161216) - SerializeBatchTime: 73.465ms - TransmitDataRPCTime: 121.793ms - UncompressedRowBatchSize: 31.79 MB (33335704) CodeGen:(Total: 234.218ms, non-child: 234.218ms, % non-child: 100.00%) - CodegenTime: 1.629ms - CompileTime: 61.837ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 144.731ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 27.052ms HASH_JOIN_NODE (id=8):(Total: 912.502ms, non-child: 38.718ms, % non-child: 4.24%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.396ms - PeakMemoryUsage: 1.11 MB (1162462) - ProbeRows: 1.16M (1162240) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 35.477ms - RowsReturned: 1.16M (1161216) - RowsReturnedRate: 1.27 M/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 29.611us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 216.602us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 65.081us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=19):(Total: 68.134ms, non-child: 16.937us, % non-child: 0.02%) BytesReceived(16s000ms): 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 4.337us - DeserializeRowBatchTimer: 16.561us - FirstBatchArrivalWaitTime: 42.073ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 1.76 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=6):(Total: 805.841ms, non-child: 805.841ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:20/4.75 GB 3:14/3.23 GB 4:22/5.00 GB 7:18/4.44 GB 0:18/4.25 GB 6:23/5.46 GB 1:23/5.61 GB 2:16/3.72 GB ExecOption: PARQUET Codegen Enabled Runtime filters: Only following filters arrived: 4, waited 703ms BytesRead(16s000ms): 30.82 MB, 33.06 MB, 33.06 MB, 33.06 MB, 33.06 MB, 33.06 MB, 33.06 MB, 33.06 MB, 33.06 MB, 33.06 MB, 33.06 MB, 33.06 MB, 33.06 MB, 33.06 MB, 33.06 MB, 33.06 MB, 33.06 MB, 33.06 MB, 33.06 MB, 33.06 MB, 33.06 MB, 33.06 MB, 33.06 MB, 33.06 MB, 33.06 MB, 33.06 MB, 33.06 MB, 33.06 MB, 33.06 MB, 33.06 MB, 33.06 MB, 33.06 MB, 33.06 MB, 33.06 MB, 33.06 MB, 33.06 MB, 33.06 MB, 33.06 MB, 33.06 MB - FooterProcessingTime: (Avg: 63.765ms ; Min: 41.624ms ; Max: 91.839ms ; Number of samples: 8) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 11.98 - BytesRead: 33.06 MB (34661373) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 8.102ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 0 (0) - NumRowGroups: 8 (8) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 53.91 MB (56524937) - PerReadThreadRawHdfsThroughput: 52.25 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 1.28M (1283072) - RowsReturned: 1.16M (1162240) - RowsReturnedRate: 1.44 M/sec - ScanRangesComplete: 146 (146) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 632.690ms - TotalReadThroughput: 53.18 KB/sec Filter 2 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 3 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 4 (1.00 MB): - Files processed: 154 (154) - Files rejected: 146 (146) - Files total: 154 (154) - RowGroups processed: 1.25K (1253) - RowGroups rejected: 0 (0) - RowGroups total: 1.25K (1253) - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) - Splits processed: 8 (8) - Splits rejected: 0 (0) - Splits total: 8 (8) Instance 7f40dcb034de70b7:1b8 (host=vc1540.foo:22000):(Total: 1s139ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 7:21/4.57 GB 2:19/4.68 GB 4:19/4.68 GB 6:19/4.32 GB 0:16/3.95 GB 5:26/5.76 GB 1:17/4.05 GB 3:19/4.52 GB Filter 4 arrival: 383ms Filter 2 arrival: 7s075ms Filter 3 arrival: 9m23s MemoryUsage(16s000ms): 60.90 MB, 73.58 MB, 73.58 MB, 73.58 MB, 73.58 MB, 73.58 MB, 73.58 MB, 73.58 MB, 73.58 MB, 73.58 MB, 73.58 MB, 73.58 MB, 73.58 MB, 73.58 MB, 73.58 MB, 73.58 MB, 73.58 MB, 73.58 MB, 73.58 MB, 73.58 MB, 73.58 MB, 73.58 MB, 73.58 MB, 73.58 MB, 73.58 MB, 73.58 MB, 73.58 MB, 73.58 MB, 73.58 MB, 73.58 MB, 73.58 MB, 73.58 MB, 73.58 MB, 73.58 MB, 73.58 MB, 73.58 MB, 73.58 MB, 73.58 MB, 73.58 MB ThreadUsage(16s000ms): 12, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.99 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 73.58 MB (77152217) - PerHostPeakMemUsage: 169.58 GB (182081361196) - RowsProduced: 1.42M (1416192) - TotalNetworkReceiveTime: 2.210us - TotalNetworkSendTime: 425.097us - TotalStorageWaitTime: 1s059ms - TotalThreadsInvoluntaryContextSwitches: 41 (41) - TotalThreadsTotalWallClockTime: 994.485ms - TotalThreadsSysTime: 4.000ms - TotalThreadsUserTime: 243.963ms - TotalThreadsVoluntaryContextSwitches: 43 (43) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 40.305ms - OpenTime: 993.998ms - ExecTreeOpenTime: 747.048ms - PrepareTime: 145.878ms - ExecTreePrepareTime: 856.131us DataStreamSender (dst_id=24):(Total: 208.646ms, non-child: 208.646ms, % non-child: 100.00%) - BytesSent: 12.22 MB (12810602) - NetworkThroughput(*): 96.30 MB/sec - OverallThroughput: 58.55 MB/sec - PeakMemoryUsage: 4.71 MB (4937472) - RowsReturned: 1.42M (1415168) - SerializeBatchTime: 81.356ms - TransmitDataRPCTime: 126.862ms - UncompressedRowBatchSize: 39.14 MB (41038864) CodeGen:(Total: 270.837ms, non-child: 270.837ms, % non-child: 100.00%) - CodegenTime: 1.199ms - CompileTime: 75.749ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 169.419ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 25.037ms HASH_JOIN_NODE (id=8):(Total: 788.456ms, non-child: 34.512ms, % non-child: 4.38%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 682.506us - PeakMemoryUsage: 1.11 MB (1162394) - ProbeRows: 1.42M (1416192) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 31.897ms - RowsReturned: 1.42M (1415168) - RowsReturnedRate: 1.79 M/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 12.578us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 59.151us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 23.906us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=19):(Total: 7.005us, non-child: 7.005us, % non-child: 100.00%) BytesReceived(16s000ms): 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 2.429us - DeserializeRowBatchTimer: 15.352us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 17.13 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=6):(Total: 753.940ms, non-child: 753.940ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:21/4.57 GB 2:19/4.68 GB 4:19/4.68 GB 6:19/4.32 GB 0:16/3.95 GB 5:26/5.76 GB 1:17/4.05 GB 3:19/4.52 GB ExecOption: PARQUET Codegen Enabled Runtime filters: Only following filters arrived: 4, waited 643ms BytesRead(16s000ms): 27.91 MB, 29.77 MB, 29.77 MB, 29.77 MB, 29.77 MB, 29.77 MB, 29.77 MB, 29.77 MB, 29.77 MB, 29.77 MB, 29.77 MB, 29.77 MB, 29.77 MB, 29.77 MB, 29.77 MB, 29.77 MB, 29.77 MB, 29.77 MB, 29.77 MB, 29.77 MB, 29.77 MB, 29.77 MB, 29.77 MB, 29.77 MB, 29.77 MB, 29.77 MB, 29.77 MB, 29.77 MB, 29.77 MB, 29.77 MB, 29.77 MB, 29.77 MB, 29.77 MB, 29.77 MB, 29.77 MB, 29.77 MB, 29.77 MB, 29.77 MB, 29.77 MB - FooterProcessingTime: (Avg: 59.588ms ; Min: 39.094ms ; Max: 99.576ms ; Number of samples: 7) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 12.00 - BytesRead: 29.77 MB (31218610) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 9.058ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 0 (0) - NumRowGroups: 7 (7) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 51.85 MB (54363716) - PerReadThreadRawHdfsThroughput: 48.69 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 1.54M (1536000) - RowsReturned: 1.42M (1416192) - RowsReturnedRate: 1.88 M/sec - ScanRangesComplete: 149 (149) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 611.495ms - TotalReadThroughput: 47.78 KB/sec Filter 2 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 3 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 4 (1.00 MB): - Files processed: 156 (156) - Files rejected: 149 (149) - Files total: 156 (156) - RowGroups processed: 1.50K (1500) - RowGroups rejected: 0 (0) - RowGroups total: 1.50K (1500) - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) - Splits processed: 7 (7) - Splits rejected: 0 (0) - Splits total: 7 (7) Instance 7f40dcb034de70b7:1e9 (host=vc1516.foo:22000):(Total: 1s139ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 3:18/4.20 GB 1:21/5.18 GB 5:24/5.49 GB 4:14/3.24 GB 7:17/4.02 GB 6:22/4.96 GB 0:18/4.16 GB 2:25/5.63 GB Filter 4 arrival: 237ms Filter 2 arrival: 7s764ms Filter 3 arrival: 9m23s MemoryUsage(16s000ms): 55.21 MB, 65.59 MB, 65.59 MB, 65.59 MB, 65.59 MB, 65.59 MB, 65.59 MB, 65.59 MB, 65.59 MB, 65.59 MB, 65.59 MB, 65.59 MB, 65.59 MB, 65.59 MB, 65.59 MB, 65.59 MB, 65.59 MB, 65.59 MB, 65.59 MB, 65.59 MB, 65.59 MB, 65.59 MB, 65.59 MB, 65.59 MB, 65.59 MB, 65.59 MB, 65.59 MB, 65.59 MB, 65.59 MB, 65.59 MB, 65.59 MB, 65.59 MB, 65.59 MB, 65.59 MB, 65.59 MB, 65.59 MB, 65.59 MB, 65.59 MB, 65.59 MB ThreadUsage(16s000ms): 12, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.99 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 65.59 MB (68779257) - PerHostPeakMemUsage: 169.57 GB (182072988562) - RowsProduced: 513.02K (513024) - TotalNetworkReceiveTime: 7.012us - TotalNetworkSendTime: 171.505us - TotalStorageWaitTime: 1s315ms - TotalThreadsInvoluntaryContextSwitches: 31 (31) - TotalThreadsTotalWallClockTime: 1s081ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 182.972ms - TotalThreadsVoluntaryContextSwitches: 69 (69) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 13.437ms - OpenTime: 1s080ms - ExecTreeOpenTime: 898.086ms - PrepareTime: 59.292ms - ExecTreePrepareTime: 675.100us DataStreamSender (dst_id=24):(Total: 66.881ms, non-child: 66.881ms, % non-child: 100.00%) - BytesSent: 3.95 MB (4142115) - NetworkThroughput(*): 96.87 MB/sec - OverallThroughput: 59.06 MB/sec - PeakMemoryUsage: 4.61 MB (4830976) - RowsReturned: 512.00K (512000) - SerializeBatchTime: 25.137ms - TransmitDataRPCTime: 40.777ms - UncompressedRowBatchSize: 13.16 MB (13798704) CodeGen:(Total: 203.621ms, non-child: 203.621ms, % non-child: 100.00%) - CodegenTime: 886.138us - CompileTime: 55.193ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 125.352ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 22.674ms HASH_JOIN_NODE (id=8):(Total: 912.615ms, non-child: 13.220ms, % non-child: 1.45%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.413ms - PeakMemoryUsage: 1.10 MB (1151571) - ProbeRows: 513.02K (513024) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 10.913ms - RowsReturned: 512.00K (512000) - RowsReturnedRate: 561.02 K/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 33.056us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 115.174us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 64.223us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=19):(Total: 14.687us, non-child: 14.687us, % non-child: 100.00%) BytesReceived(16s000ms): 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 3.671us - DeserializeRowBatchTimer: 17.044us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 8.17 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=6):(Total: 899.385ms, non-child: 899.385ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:18/4.20 GB 1:21/5.18 GB 5:24/5.49 GB 4:14/3.24 GB 7:17/4.02 GB 6:22/4.96 GB 0:18/4.16 GB 2:25/5.63 GB ExecOption: PARQUET Codegen Enabled Runtime filters: Only following filters arrived: 4, waited 783ms BytesRead(16s000ms): 24.82 MB, 26.63 MB, 26.63 MB, 26.63 MB, 26.63 MB, 26.63 MB, 26.63 MB, 26.63 MB, 26.63 MB, 26.63 MB, 26.63 MB, 26.63 MB, 26.63 MB, 26.63 MB, 26.63 MB, 26.63 MB, 26.63 MB, 26.63 MB, 26.63 MB, 26.63 MB, 26.63 MB, 26.63 MB, 26.63 MB, 26.63 MB, 26.63 MB, 26.63 MB, 26.63 MB, 26.63 MB, 26.63 MB, 26.63 MB, 26.63 MB, 26.63 MB, 26.63 MB, 26.63 MB, 26.63 MB, 26.63 MB, 26.63 MB, 26.63 MB, 26.63 MB - FooterProcessingTime: (Avg: 69.684ms ; Min: 25.444ms ; Max: 106.859ms ; Number of samples: 6) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 11.99 - BytesRead: 26.63 MB (27921339) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 3.279ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 0 (0) - NumRowGroups: 6 (6) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 43.41 MB (45515898) - PerReadThreadRawHdfsThroughput: 47.21 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 631.81K (631808) - RowsReturned: 513.02K (513024) - RowsReturnedRate: 570.42 K/sec - ScanRangesComplete: 153 (153) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 563.972ms - TotalReadThroughput: 42.87 KB/sec Filter 2 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 3 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 4 (1.00 MB): - Files processed: 159 (159) - Files rejected: 153 (153) - Files total: 159 (159) - RowGroups processed: 617 (617) - RowGroups rejected: 0 (0) - RowGroups total: 617 (617) - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) - Splits processed: 6 (6) - Splits rejected: 0 (0) - Splits total: 6 (6) Instance 7f40dcb034de70b7:1da (host=ve1141.foo:22000):(Total: 1s138ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 5:12/2.96 GB 4:25/5.84 GB 0:19/4.20 GB 2:30/7.21 GB 3:18/4.01 GB 1:21/4.70 GB 6:14/3.43 GB 7:18/3.99 GB Filter 4 arrival: 263ms Filter 2 arrival: 7s575ms Filter 3 arrival: 9m23s MemoryUsage(16s000ms): 59.72 MB, 71.87 MB, 71.87 MB, 71.87 MB, 71.87 MB, 71.87 MB, 71.87 MB, 71.87 MB, 71.87 MB, 71.87 MB, 71.87 MB, 71.87 MB, 71.87 MB, 71.87 MB, 71.87 MB, 71.87 MB, 71.87 MB, 71.87 MB, 71.87 MB, 71.87 MB, 71.87 MB, 71.87 MB, 71.87 MB, 71.87 MB, 71.87 MB, 71.87 MB, 71.87 MB, 71.87 MB, 71.87 MB, 71.87 MB, 71.87 MB, 71.87 MB, 71.87 MB, 71.87 MB, 71.87 MB, 71.87 MB, 71.87 MB, 71.87 MB, 71.87 MB ThreadUsage(16s000ms): 12, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.98 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 71.87 MB (75359906) - PerHostPeakMemUsage: 169.58 GB (182080120448) - RowsProduced: 689.15K (689152) - TotalNetworkReceiveTime: 4.565us - TotalNetworkSendTime: 249.297us - TotalStorageWaitTime: 1s869ms - TotalThreadsInvoluntaryContextSwitches: 40 (40) - TotalThreadsTotalWallClockTime: 1s083ms - TotalThreadsSysTime: 5.998ms - TotalThreadsUserTime: 204.969ms - TotalThreadsVoluntaryContextSwitches: 65 (65) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 20.076ms - OpenTime: 1s083ms - ExecTreeOpenTime: 872.076ms - PrepareTime: 55.774ms - ExecTreePrepareTime: 663.372us DataStreamSender (dst_id=24):(Total: 111.560ms, non-child: 111.560ms, % non-child: 100.00%) - BytesSent: 5.76 MB (6042787) - NetworkThroughput(*): 89.00 MB/sec - OverallThroughput: 51.66 MB/sec - PeakMemoryUsage: 4.80 MB (5035776) - RowsReturned: 688.13K (688128) - SerializeBatchTime: 45.899ms - TransmitDataRPCTime: 64.748ms - UncompressedRowBatchSize: 18.33 MB (19224408) CodeGen:(Total: 231.205ms, non-child: 231.205ms, % non-child: 100.00%) - CodegenTime: 1.068ms - CompileTime: 73.422ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 134.986ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 22.276ms HASH_JOIN_NODE (id=8):(Total: 893.146ms, non-child: 18.707ms, % non-child: 2.09%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.481ms - PeakMemoryUsage: 1.11 MB (1162498) - ProbeRows: 689.15K (689152) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 16.023ms - RowsReturned: 688.13K (688128) - RowsReturnedRate: 770.45 K/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 20.277us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 132.335us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 40.888us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=19):(Total: 13.966us, non-child: 13.966us, % non-child: 100.00%) BytesReceived(16s000ms): 963.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 4.794us - DeserializeRowBatchTimer: 21.336us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 8.59 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=6):(Total: 874.431ms, non-child: 874.431ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:12/2.96 GB 4:25/5.84 GB 0:19/4.20 GB 2:30/7.21 GB 3:18/4.01 GB 1:21/4.70 GB 6:14/3.43 GB 7:18/3.99 GB ExecOption: PARQUET Codegen Enabled Runtime filters: Only following filters arrived: 4, waited 763ms BytesRead(16s000ms): 29.68 MB, 32.74 MB, 32.74 MB, 32.74 MB, 32.74 MB, 32.74 MB, 32.74 MB, 32.74 MB, 32.74 MB, 32.74 MB, 32.74 MB, 32.74 MB, 32.74 MB, 32.74 MB, 32.74 MB, 32.74 MB, 32.74 MB, 32.74 MB, 32.74 MB, 32.74 MB, 32.74 MB, 32.74 MB, 32.74 MB, 32.74 MB, 32.74 MB, 32.74 MB, 32.74 MB, 32.74 MB, 32.74 MB, 32.74 MB, 32.74 MB, 32.74 MB, 32.74 MB, 32.74 MB, 32.74 MB, 32.74 MB, 32.74 MB, 32.74 MB, 32.74 MB - FooterProcessingTime: (Avg: 77.948ms ; Min: 33.622ms ; Max: 115.170ms ; Number of samples: 8) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 11.99 - BytesRead: 32.74 MB (34326098) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 5.553ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 0 (0) - NumRowGroups: 8 (8) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 49.93 MB (52358691) - PerReadThreadRawHdfsThroughput: 47.76 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 809.98K (809984) - RowsReturned: 689.15K (689152) - RowsReturnedRate: 788.11 K/sec - ScanRangesComplete: 149 (149) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 685.389ms - TotalReadThroughput: 52.75 KB/sec Filter 2 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 3 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 4 (1.00 MB): - Files processed: 157 (157) - Files rejected: 149 (149) - Files total: 157 (157) - RowGroups processed: 791 (791) - RowGroups rejected: 0 (0) - RowGroups total: 791 (791) - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) - Splits processed: 8 (8) - Splits rejected: 0 (0) - Splits total: 8 (8) Instance 7f40dcb034de70b7:196 (host=ve1128.foo:22000):(Total: 1s138ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 3:15/3.27 GB 6:23/5.25 GB 1:21/4.70 GB 5:16/3.42 GB 2:18/4.14 GB 0:24/5.92 GB 4:15/3.58 GB 7:28/6.51 GB Filter 4 arrival: 489ms Filter 2 arrival: 6s693ms Filter 3 arrival: 9m23s MemoryUsage(16s000ms): 40.50 MB, 48.90 MB, 48.90 MB, 48.90 MB, 48.90 MB, 48.90 MB, 48.90 MB, 48.90 MB, 48.90 MB, 48.90 MB, 48.90 MB, 48.90 MB, 48.90 MB, 48.90 MB, 48.90 MB, 48.90 MB, 48.90 MB, 48.90 MB, 48.90 MB, 48.90 MB, 48.90 MB, 48.90 MB, 48.90 MB, 48.90 MB, 48.90 MB, 48.90 MB, 48.90 MB, 48.90 MB, 48.90 MB, 48.90 MB, 48.90 MB, 48.90 MB, 48.90 MB, 48.90 MB, 48.90 MB, 48.90 MB, 48.90 MB, 48.90 MB, 48.90 MB ThreadUsage(16s000ms): 12, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.99 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 48.90 MB (51275931) - PerHostPeakMemUsage: 169.55 GB (182055458089) - RowsProduced: 1.78M (1782784) - TotalNetworkReceiveTime: 190.265ms - TotalNetworkSendTime: 58.721ms - TotalStorageWaitTime: 526.634ms - TotalThreadsInvoluntaryContextSwitches: 51 (51) - TotalThreadsTotalWallClockTime: 1s266ms - TotalThreadsSysTime: 2.999ms - TotalThreadsUserTime: 238.964ms - TotalThreadsVoluntaryContextSwitches: 38 (38) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 52.741ms - OpenTime: 1s074ms - ExecTreeOpenTime: 835.562ms - PrepareTime: 63.404ms - ExecTreePrepareTime: 835.667us DataStreamSender (dst_id=24):(Total: 257.568ms, non-child: 257.568ms, % non-child: 100.00%) - BytesSent: 15.20 MB (15937094) - NetworkThroughput(*): 98.85 MB/sec - OverallThroughput: 59.01 MB/sec - PeakMemoryUsage: 4.65 MB (4880128) - RowsReturned: 1.78M (1781760) - SerializeBatchTime: 102.466ms - TransmitDataRPCTime: 153.754ms - UncompressedRowBatchSize: 49.51 MB (51912600) CodeGen:(Total: 263.917ms, non-child: 263.917ms, % non-child: 100.00%) - CodegenTime: 1.080ms - CompileTime: 84.568ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 152.978ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 25.865ms HASH_JOIN_NODE (id=8):(Total: 889.264ms, non-child: 44.795ms, % non-child: 5.04%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.296ms - PeakMemoryUsage: 1.11 MB (1162519) - ProbeRows: 1.78M (1782784) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 40.070ms - RowsReturned: 1.78M (1781760) - RowsReturnedRate: 2.00 M/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 24.326us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 133.142us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 56.974us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=19):(Total: 190.274ms, non-child: 17.858us, % non-child: 0.01%) BytesReceived(16s000ms): 963.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 4.470us - DeserializeRowBatchTimer: 8.499us - FirstBatchArrivalWaitTime: 165.124ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 630.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=6):(Total: 654.380ms, non-child: 654.380ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:15/3.27 GB 6:23/5.25 GB 1:21/4.70 GB 5:16/3.42 GB 2:18/4.14 GB 0:24/5.92 GB 4:15/3.58 GB 7:28/6.51 GB ExecOption: PARQUET Codegen Enabled Runtime filters: Only following filters arrived: 4, waited 542ms BytesRead(16s000ms): 13.45 MB, 14.35 MB, 14.35 MB, 14.35 MB, 14.35 MB, 14.35 MB, 14.35 MB, 14.35 MB, 14.35 MB, 14.35 MB, 14.35 MB, 14.35 MB, 14.35 MB, 14.35 MB, 14.35 MB, 14.35 MB, 14.35 MB, 14.35 MB, 14.35 MB, 14.35 MB, 14.35 MB, 14.35 MB, 14.35 MB, 14.35 MB, 14.35 MB, 14.35 MB, 14.35 MB, 14.35 MB, 14.35 MB, 14.35 MB, 14.35 MB, 14.35 MB, 14.35 MB, 14.35 MB, 14.35 MB, 14.35 MB, 14.35 MB, 14.35 MB, 14.35 MB - FooterProcessingTime: (Avg: 66.712ms ; Min: 38.612ms ; Max: 101.176ms ; Number of samples: 3) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 11.99 - BytesRead: 14.35 MB (15047762) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 13.710ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 0 (0) - NumRowGroups: 3 (3) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 26.99 MB (28300593) - PerReadThreadRawHdfsThroughput: 57.59 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 1.90M (1898496) - RowsReturned: 1.78M (1782784) - RowsReturnedRate: 2.72 M/sec - ScanRangesComplete: 157 (157) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 249.176ms - TotalReadThroughput: 23.01 KB/sec Filter 2 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 3 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 4 (1.00 MB): - Files processed: 160 (160) - Files rejected: 157 (157) - Files total: 160 (160) - RowGroups processed: 1.85K (1854) - RowGroups rejected: 0 (0) - RowGroups total: 1.85K (1854) - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) - Splits processed: 3 (3) - Splits rejected: 0 (0) - Splits total: 3 (3) Instance 7f40dcb034de70b7:1db (host=vc1503.foo:22000):(Total: 1s134ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 5:23/5.07 GB 4:17/4.10 GB 2:18/4.21 GB 6:22/5.21 GB 3:19/3.99 GB 7:20/4.93 GB 1:15/3.70 GB 0:20/4.86 GB Filter 4 arrival: 243ms Filter 2 arrival: 7s565ms Filter 3 arrival: 9m23s MemoryUsage(16s000ms): 50.73 MB, 61.52 MB, 61.52 MB, 61.52 MB, 61.52 MB, 61.52 MB, 61.52 MB, 61.52 MB, 61.52 MB, 61.52 MB, 61.52 MB, 61.52 MB, 61.52 MB, 61.52 MB, 61.52 MB, 61.52 MB, 61.52 MB, 61.52 MB, 61.52 MB, 61.52 MB, 61.52 MB, 61.52 MB, 61.52 MB, 61.52 MB, 61.52 MB, 61.52 MB, 61.52 MB, 61.52 MB, 61.52 MB, 61.52 MB, 61.52 MB, 61.52 MB, 61.52 MB, 61.52 MB, 61.52 MB, 61.52 MB, 61.52 MB, 61.52 MB, 61.52 MB ThreadUsage(16s000ms): 12, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.98 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 61.52 MB (64512771) - PerHostPeakMemUsage: 169.56 GB (182068796986) - RowsProduced: 746.50K (746496) - TotalNetworkReceiveTime: 4.006us - TotalNetworkSendTime: 264.193us - TotalStorageWaitTime: 1s241ms - TotalThreadsInvoluntaryContextSwitches: 34 (34) - TotalThreadsTotalWallClockTime: 1s072ms - TotalThreadsSysTime: 5.999ms - TotalThreadsUserTime: 177.973ms - TotalThreadsVoluntaryContextSwitches: 65 (65) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 23.015ms - OpenTime: 1s072ms - ExecTreeOpenTime: 887.428ms - PrepareTime: 62.296ms - ExecTreePrepareTime: 726.398us DataStreamSender (dst_id=24):(Total: 101.991ms, non-child: 101.991ms, % non-child: 100.00%) - BytesSent: 6.02 MB (6316798) - NetworkThroughput(*): 100.27 MB/sec - OverallThroughput: 59.07 MB/sec - PeakMemoryUsage: 4.59 MB (4814592) - RowsReturned: 745.47K (745472) - SerializeBatchTime: 40.730ms - TransmitDataRPCTime: 60.080ms - UncompressedRowBatchSize: 19.85 MB (20809696) CodeGen:(Total: 211.009ms, non-child: 211.009ms, % non-child: 100.00%) - CodegenTime: 1.130ms - CompileTime: 55.483ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 127.139ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 27.889ms HASH_JOIN_NODE (id=8):(Total: 911.598ms, non-child: 21.928ms, % non-child: 2.41%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.311ms - PeakMemoryUsage: 1.11 MB (1159409) - ProbeRows: 746.50K (746496) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 19.621ms - RowsReturned: 745.47K (745472) - RowsReturnedRate: 817.76 K/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 31.539us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 137.689us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 51.124us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=19):(Total: 11.988us, non-child: 11.988us, % non-child: 100.00%) BytesReceived(16s000ms): 963.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 3.842us - DeserializeRowBatchTimer: 10.514us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 10.01 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=6):(Total: 889.663ms, non-child: 889.663ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:23/5.07 GB 4:17/4.10 GB 2:18/4.21 GB 6:22/5.21 GB 3:19/3.99 GB 7:20/4.93 GB 1:15/3.70 GB 0:20/4.86 GB ExecOption: PARQUET Codegen Enabled Runtime filters: Only following filters arrived: 4, waited 784ms BytesRead(16s000ms): 23.81 MB, 25.96 MB, 25.96 MB, 25.96 MB, 25.96 MB, 25.96 MB, 25.96 MB, 25.96 MB, 25.96 MB, 25.96 MB, 25.96 MB, 25.96 MB, 25.96 MB, 25.96 MB, 25.96 MB, 25.96 MB, 25.96 MB, 25.96 MB, 25.96 MB, 25.96 MB, 25.96 MB, 25.96 MB, 25.96 MB, 25.96 MB, 25.96 MB, 25.96 MB, 25.96 MB, 25.96 MB, 25.96 MB, 25.96 MB, 25.96 MB, 25.96 MB, 25.96 MB, 25.96 MB, 25.96 MB, 25.96 MB, 25.96 MB, 25.96 MB, 25.96 MB - FooterProcessingTime: (Avg: 81.138ms ; Min: 50.612ms ; Max: 142.358ms ; Number of samples: 6) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 11.99 - BytesRead: 25.96 MB (27220802) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 5.096ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 0 (0) - NumRowGroups: 6 (6) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 39.42 MB (41339524) - PerReadThreadRawHdfsThroughput: 47.89 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 865.28K (865280) - RowsReturned: 746.50K (746496) - RowsReturnedRate: 839.08 K/sec - ScanRangesComplete: 148 (148) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 542.024ms - TotalReadThroughput: 41.90 KB/sec Filter 2 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 3 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 4 (1.00 MB): - Files processed: 154 (154) - Files rejected: 148 (148) - Files total: 154 (154) - RowGroups processed: 845 (845) - RowGroups rejected: 0 (0) - RowGroups total: 845 (845) - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) - Splits processed: 6 (6) - Splits rejected: 0 (0) - Splits total: 6 (6) Instance 7f40dcb034de70b7:1b9 (host=vd1107.foo:22000):(Total: 1s134ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 4:21/4.72 GB 1:18/4.44 GB 0:26/6.31 GB 3:23/5.48 GB 6:17/4.18 GB 2:16/3.71 GB 5:14/2.88 GB 7:23/4.80 GB Filter 4 arrival: 353ms Filter 2 arrival: 7s128ms Filter 3 arrival: 9m23s MemoryUsage(16s000ms): 38.76 MB, 48.90 MB, 48.90 MB, 48.90 MB, 48.90 MB, 48.90 MB, 48.90 MB, 48.90 MB, 48.90 MB, 48.90 MB, 48.90 MB, 48.90 MB, 48.90 MB, 48.90 MB, 48.90 MB, 48.90 MB, 48.90 MB, 48.90 MB, 48.90 MB, 48.90 MB, 48.90 MB, 48.90 MB, 48.90 MB, 48.90 MB, 48.90 MB, 48.90 MB, 48.90 MB, 48.90 MB, 48.90 MB, 48.90 MB, 48.90 MB, 48.90 MB, 48.90 MB, 48.90 MB, 48.90 MB, 48.90 MB, 48.90 MB, 48.90 MB, 48.90 MB ThreadUsage(16s000ms): 12, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.99 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 48.90 MB (51270717) - PerHostPeakMemUsage: 169.55 GB (182055448413) - RowsProduced: 1.55M (1549312) - TotalNetworkReceiveTime: 67.761ms - TotalNetworkSendTime: 441.081us - TotalStorageWaitTime: 625.343ms - TotalThreadsInvoluntaryContextSwitches: 31 (31) - TotalThreadsTotalWallClockTime: 1s143ms - TotalThreadsSysTime: 5.998ms - TotalThreadsUserTime: 224.966ms - TotalThreadsVoluntaryContextSwitches: 77 (77) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 39.773ms - OpenTime: 1s074ms - ExecTreeOpenTime: 844.391ms - PrepareTime: 60.219ms - ExecTreePrepareTime: 590.522us DataStreamSender (dst_id=24):(Total: 220.851ms, non-child: 220.851ms, % non-child: 100.00%) - BytesSent: 13.27 MB (13909458) - NetworkThroughput(*): 97.80 MB/sec - OverallThroughput: 60.06 MB/sec - PeakMemoryUsage: 4.72 MB (4953856) - RowsReturned: 1.55M (1548288) - SerializeBatchTime: 84.180ms - TransmitDataRPCTime: 135.635ms - UncompressedRowBatchSize: 42.93 MB (45013248) CodeGen:(Total: 255.821ms, non-child: 255.821ms, % non-child: 100.00%) - CodegenTime: 1.397ms - CompileTime: 67.432ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 160.499ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 27.205ms HASH_JOIN_NODE (id=8):(Total: 884.691ms, non-child: 35.837ms, % non-child: 4.05%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.486ms - PeakMemoryUsage: 1.11 MB (1162477) - ProbeRows: 1.55M (1549312) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 32.087ms - RowsReturned: 1.55M (1548288) - RowsReturnedRate: 1.75 M/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 27.481us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 145.559us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 39.446us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=19):(Total: 67.772ms, non-child: 18.597us, % non-child: 0.03%) BytesReceived(16s000ms): 963.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 4.470us - DeserializeRowBatchTimer: 21.069us - FirstBatchArrivalWaitTime: 49.124ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 1.77 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=6):(Total: 781.279ms, non-child: 781.279ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:21/4.72 GB 1:18/4.44 GB 0:26/6.31 GB 3:23/5.48 GB 6:17/4.18 GB 2:16/3.71 GB 5:14/2.88 GB 7:23/4.80 GB ExecOption: PARQUET Codegen Enabled Runtime filters: Only following filters arrived: 4, waited 683ms BytesRead(16s000ms): 15.67 MB, 17.28 MB, 17.28 MB, 17.28 MB, 17.28 MB, 17.28 MB, 17.28 MB, 17.28 MB, 17.28 MB, 17.28 MB, 17.28 MB, 17.28 MB, 17.28 MB, 17.28 MB, 17.28 MB, 17.28 MB, 17.28 MB, 17.28 MB, 17.28 MB, 17.28 MB, 17.28 MB, 17.28 MB, 17.28 MB, 17.28 MB, 17.28 MB, 17.28 MB, 17.28 MB, 17.28 MB, 17.28 MB, 17.28 MB, 17.28 MB, 17.28 MB, 17.28 MB, 17.28 MB, 17.28 MB, 17.28 MB, 17.28 MB, 17.28 MB, 17.28 MB - FooterProcessingTime: (Avg: 56.765ms ; Min: 43.948ms ; Max: 77.942ms ; Number of samples: 4) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 12.00 - BytesRead: 17.28 MB (18124167) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 9.976ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 0 (0) - NumRowGroups: 4 (4) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 27.01 MB (28325975) - PerReadThreadRawHdfsThroughput: 52.38 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 1.67M (1666048) - RowsReturned: 1.55M (1549312) - RowsReturnedRate: 1.98 M/sec - ScanRangesComplete: 154 (154) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 329.979ms - TotalReadThroughput: 27.81 KB/sec Filter 2 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 3 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 4 (1.00 MB): - Files processed: 158 (158) - Files rejected: 154 (154) - Files total: 158 (158) - RowGroups processed: 1.63K (1627) - RowGroups rejected: 0 (0) - RowGroups total: 1.63K (1627) - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) - Splits processed: 4 (4) - Splits rejected: 0 (0) - Splits total: 4 (4) Instance 7f40dcb034de70b7:190 (host=vc1521.foo:22000):(Total: 1s133ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 5:29/6.79 GB 6:16/3.72 GB 2:18/4.44 GB 7:18/4.43 GB 0:14/3.01 GB 4:19/4.21 GB 3:22/5.16 GB 1:21/4.98 GB Filter 4 arrival: 517ms Filter 2 arrival: 6s641ms Filter 3 arrival: 9m23s MemoryUsage(16s000ms): 52.15 MB, 61.31 MB, 61.31 MB, 61.31 MB, 61.31 MB, 61.31 MB, 61.31 MB, 61.31 MB, 61.31 MB, 61.31 MB, 61.31 MB, 61.31 MB, 61.31 MB, 61.31 MB, 61.31 MB, 61.31 MB, 61.31 MB, 61.31 MB, 61.31 MB, 61.31 MB, 61.31 MB, 61.31 MB, 61.31 MB, 61.31 MB, 61.31 MB, 61.31 MB, 61.31 MB, 61.31 MB, 61.31 MB, 61.31 MB, 61.31 MB, 61.31 MB, 61.31 MB, 61.31 MB, 61.31 MB, 61.31 MB, 61.31 MB, 61.31 MB, 61.31 MB ThreadUsage(16s000ms): 7, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8 - AverageThreadTokens: 7.99 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 61.31 MB (64287786) - PerHostPeakMemUsage: 169.57 GB (182069092083) - RowsProduced: 2.57M (2570240) - TotalNetworkReceiveTime: 288.864ms - TotalNetworkSendTime: 1.102ms - TotalStorageWaitTime: 812.043ms - TotalThreadsInvoluntaryContextSwitches: 21 (21) - TotalThreadsTotalWallClockTime: 1s377ms - TotalThreadsSysTime: 3.999ms - TotalThreadsUserTime: 184.971ms - TotalThreadsVoluntaryContextSwitches: 54 (54) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 79.153ms - OpenTime: 1s088ms - ExecTreeOpenTime: 902.759ms - PrepareTime: 45.384ms - ExecTreePrepareTime: 504.391us DataStreamSender (dst_id=24):(Total: 356.268ms, non-child: 356.268ms, % non-child: 100.00%) - BytesSent: 22.62 MB (23714208) - NetworkThroughput(*): 100.49 MB/sec - OverallThroughput: 63.48 MB/sec - PeakMemoryUsage: 4.68 MB (4904704) - RowsReturned: 2.57M (2569216) - SerializeBatchTime: 130.197ms - TransmitDataRPCTime: 225.062ms - UncompressedRowBatchSize: 72.14 MB (75647264) CodeGen:(Total: 200.281ms, non-child: 200.281ms, % non-child: 100.00%) - CodegenTime: 799.085us - CompileTime: 58.238ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 125.559ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 16.079ms HASH_JOIN_NODE (id=8):(Total: 981.650ms, non-child: 68.162ms, % non-child: 6.94%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.310ms - PeakMemoryUsage: 1.11 MB (1162521) - ProbeRows: 2.57M (2570383) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 62.499ms - RowsReturned: 2.57M (2569359) - RowsReturnedRate: 2.62 M/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 28.322us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 133.589us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 46.433us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=19):(Total: 288.873ms, non-child: 18.068us, % non-child: 0.01%) BytesReceived(16s000ms): 963.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 4.290us - DeserializeRowBatchTimer: 15.452us - FirstBatchArrivalWaitTime: 268.225ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 415.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=6):(Total: 624.722ms, non-child: 624.722ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:29/6.79 GB 6:16/3.72 GB 2:18/4.44 GB 7:18/4.43 GB 0:14/3.01 GB 4:19/4.21 GB 3:22/5.16 GB 1:21/4.98 GB ExecOption: PARQUET Codegen Enabled Runtime filters: Only following filters arrived: 4, waited 522ms BytesRead(16s000ms): 24.53 MB, 26.59 MB, 26.59 MB, 26.59 MB, 26.59 MB, 26.59 MB, 26.59 MB, 26.59 MB, 26.59 MB, 26.59 MB, 26.59 MB, 26.59 MB, 26.59 MB, 26.59 MB, 26.59 MB, 26.59 MB, 26.59 MB, 26.59 MB, 26.59 MB, 26.59 MB, 26.59 MB, 26.59 MB, 26.59 MB, 26.59 MB, 26.59 MB, 26.59 MB, 26.59 MB, 26.59 MB, 26.59 MB, 26.59 MB, 26.59 MB, 26.59 MB, 26.59 MB, 26.59 MB, 26.59 MB, 26.59 MB, 26.59 MB, 26.59 MB, 26.59 MB - FooterProcessingTime: (Avg: 49.544ms ; Min: 36.363ms ; Max: 90.009ms ; Number of samples: 7) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 6.99 - BytesRead: 26.59 MB (27880417) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 13.839ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 0 (0) - NumRowGroups: 7 (7) - NumScannerThreadsStarted: 7 (7) - PeakMemoryUsage: 40.43 MB (42394331) - PerReadThreadRawHdfsThroughput: 75.46 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 2.69M (2689167) - RowsReturned: 2.57M (2570383) - RowsReturnedRate: 4.11 M/sec - ScanRangesComplete: 151 (151) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 22.355ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 352.364ms - TotalReadThroughput: 42.61 KB/sec Filter 2 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 336.01K (336015) Filter 3 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 336.01K (336015) Filter 4 (1.00 MB): - Files processed: 157 (157) - Files rejected: 150 (150) - Files total: 157 (157) - RowGroups processed: 2.63K (2627) - RowGroups rejected: 0 (0) - RowGroups total: 2.63K (2627) - Rows processed: 16.38K (16384) - Rows rejected: 0 (0) - Rows total: 336.01K (336015) - Splits processed: 7 (7) - Splits rejected: 0 (0) - Splits total: 7 (7) Instance 7f40dcb034de70b7:1a0 (host=vc1506.foo:22000):(Total: 1s132ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 5:14/3.15 GB 4:24/5.58 GB 7:19/4.49 GB 6:19/4.46 GB 2:27/6.31 GB 0:17/4.19 GB 1:14/3.15 GB 3:22/5.25 GB Filter 4 arrival: 414ms Filter 2 arrival: 6s804ms Filter 3 arrival: 9m23s MemoryUsage(16s000ms): 44.64 MB, 53.25 MB, 53.25 MB, 53.25 MB, 53.25 MB, 53.25 MB, 53.25 MB, 53.25 MB, 53.25 MB, 53.25 MB, 53.25 MB, 53.25 MB, 53.25 MB, 53.25 MB, 53.25 MB, 53.25 MB, 53.25 MB, 53.25 MB, 53.25 MB, 53.25 MB, 53.25 MB, 53.25 MB, 53.25 MB, 53.25 MB, 53.25 MB, 53.25 MB, 53.25 MB, 53.25 MB, 53.25 MB, 53.25 MB, 53.25 MB, 53.25 MB, 53.25 MB, 53.25 MB, 53.25 MB, 53.25 MB, 53.25 MB, 53.25 MB, 53.25 MB ThreadUsage(16s000ms): 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 13.00 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 53.25 MB (55832497) - PerHostPeakMemUsage: 169.56 GB (182060057121) - RowsProduced: 1.41M (1414144) - TotalNetworkReceiveTime: 176.145ms - TotalNetworkSendTime: 81.467ms - TotalStorageWaitTime: 795.983ms - TotalThreadsInvoluntaryContextSwitches: 23 (23) - TotalThreadsTotalWallClockTime: 1s256ms - TotalThreadsSysTime: 2.000ms - TotalThreadsUserTime: 188.972ms - TotalThreadsVoluntaryContextSwitches: 45 (45) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 43.809ms - OpenTime: 1s079ms - ExecTreeOpenTime: 888.376ms - PrepareTime: 52.696ms - ExecTreePrepareTime: 923.394us DataStreamSender (dst_id=24):(Total: 204.615ms, non-child: 204.615ms, % non-child: 100.00%) - BytesSent: 11.98 MB (12563684) - NetworkThroughput(*): 98.65 MB/sec - OverallThroughput: 58.56 MB/sec - PeakMemoryUsage: 4.61 MB (4839168) - RowsReturned: 1.41M (1413120) - SerializeBatchTime: 82.233ms - TransmitDataRPCTime: 121.460ms - UncompressedRowBatchSize: 38.97 MB (40860240) CodeGen:(Total: 210.210ms, non-child: 210.210ms, % non-child: 100.00%) - CodegenTime: 946.366us - CompileTime: 61.871ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 127.435ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 20.496ms HASH_JOIN_NODE (id=8):(Total: 933.361ms, non-child: 37.879ms, % non-child: 4.06%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.292ms - PeakMemoryUsage: 1.11 MB (1161632) - ProbeRows: 1.41M (1414144) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 34.107ms - RowsReturned: 1.41M (1413120) - RowsReturnedRate: 1.51 M/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 21.632us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 126.365us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 55.053us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=19):(Total: 176.154ms, non-child: 13.490us, % non-child: 0.01%) BytesReceived(16s000ms): 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 4.304us - DeserializeRowBatchTimer: 9.669us - FirstBatchArrivalWaitTime: 176.139ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 681.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=6):(Total: 719.449ms, non-child: 719.449ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:14/3.15 GB 4:24/5.58 GB 7:19/4.49 GB 6:19/4.46 GB 2:27/6.31 GB 0:17/4.19 GB 1:14/3.15 GB 3:22/5.25 GB ExecOption: PARQUET Codegen Enabled Runtime filters: Only following filters arrived: 4, waited 622ms BytesRead(16s000ms): 20.05 MB, 21.39 MB, 21.39 MB, 21.39 MB, 21.39 MB, 21.39 MB, 21.39 MB, 21.39 MB, 21.39 MB, 21.39 MB, 21.39 MB, 21.39 MB, 21.39 MB, 21.39 MB, 21.39 MB, 21.39 MB, 21.39 MB, 21.39 MB, 21.39 MB, 21.39 MB, 21.39 MB, 21.39 MB, 21.39 MB, 21.39 MB, 21.39 MB, 21.39 MB, 21.39 MB, 21.39 MB, 21.39 MB, 21.39 MB, 21.39 MB, 21.39 MB, 21.39 MB, 21.39 MB, 21.39 MB, 21.39 MB, 21.39 MB, 21.39 MB, 21.39 MB - FooterProcessingTime: (Avg: 62.101ms ; Min: 39.750ms ; Max: 114.576ms ; Number of samples: 5) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 12.00 - BytesRead: 21.39 MB (22427524) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 8.198ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 0 (0) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 31.30 MB (32820245) - PerReadThreadRawHdfsThroughput: 55.76 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 1.53M (1531904) - RowsReturned: 1.41M (1414144) - RowsReturnedRate: 1.97 M/sec - ScanRangesComplete: 151 (151) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 383.548ms - TotalReadThroughput: 34.44 KB/sec Filter 2 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 3 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 4 (1.00 MB): - Files processed: 156 (156) - Files rejected: 151 (151) - Files total: 156 (156) - RowGroups processed: 1.50K (1496) - RowGroups rejected: 0 (0) - RowGroups total: 1.50K (1496) - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) - Splits processed: 5 (5) - Splits rejected: 0 (0) - Splits total: 5 (5) Instance 7f40dcb034de70b7:186 (host=vc1541.foo:22000):(Total: 1s129ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 5:23/5.25 GB 1:18/4.23 GB 6:20/4.61 GB 7:21/4.55 GB 3:26/6.40 GB 2:23/5.42 GB 4:11/2.55 GB 0:14/3.43 GB Filter 4 arrival: 524ms Filter 2 arrival: 6s449ms Filter 3 arrival: 9m23s MemoryUsage(16s000ms): 38.62 MB, 47.02 MB, 47.02 MB, 47.02 MB, 47.02 MB, 47.02 MB, 47.02 MB, 47.02 MB, 47.02 MB, 47.02 MB, 47.02 MB, 47.02 MB, 47.02 MB, 47.02 MB, 47.02 MB, 47.02 MB, 47.02 MB, 47.02 MB, 47.02 MB, 47.02 MB, 47.02 MB, 47.02 MB, 47.02 MB, 47.02 MB, 47.02 MB, 47.02 MB, 47.02 MB, 47.02 MB, 47.02 MB, 47.02 MB, 47.02 MB, 47.02 MB, 47.02 MB, 47.02 MB, 47.02 MB, 47.02 MB, 47.02 MB, 47.02 MB, 47.02 MB, 47.02 MB ThreadUsage(16s000ms): 12, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.99 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 47.02 MB (49308533) - PerHostPeakMemUsage: 169.55 GB (182053501934) - RowsProduced: 2.56M (2564096) - TotalNetworkReceiveTime: 243.820ms - TotalNetworkSendTime: 896.974us - TotalStorageWaitTime: 850.356ms - TotalThreadsInvoluntaryContextSwitches: 22 (22) - TotalThreadsTotalWallClockTime: 1s297ms - TotalThreadsSysTime: 4.998ms - TotalThreadsUserTime: 204.969ms - TotalThreadsVoluntaryContextSwitches: 36 (36) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 71.435ms - OpenTime: 1s055ms - ExecTreeOpenTime: 844.888ms - PrepareTime: 74.033ms - ExecTreePrepareTime: 662.908us DataStreamSender (dst_id=24):(Total: 367.991ms, non-child: 367.991ms, % non-child: 100.00%) - BytesSent: 22.23 MB (23308178) - NetworkThroughput(*): 98.11 MB/sec - OverallThroughput: 60.40 MB/sec - PeakMemoryUsage: 4.54 MB (4765440) - RowsReturned: 2.56M (2563072) - SerializeBatchTime: 136.017ms - TransmitDataRPCTime: 226.564ms - UncompressedRowBatchSize: 71.93 MB (75423984) CodeGen:(Total: 232.158ms, non-child: 232.158ms, % non-child: 100.00%) - CodegenTime: 1.268ms - CompileTime: 60.892ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 145.057ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 25.643ms HASH_JOIN_NODE (id=8):(Total: 916.736ms, non-child: 62.567ms, % non-child: 6.82%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.303ms - PeakMemoryUsage: 1.14 MB (1198544) - ProbeRows: 2.56M (2564498) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 58.153ms - RowsReturned: 2.56M (2563474) - RowsReturnedRate: 2.80 M/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 22.869us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 140.739us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 44.211us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=19):(Total: 243.830ms, non-child: 21.158us, % non-child: 0.01%) BytesReceived(16s000ms): 963.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 4.674us - DeserializeRowBatchTimer: 13.324us - FirstBatchArrivalWaitTime: 229.415ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 492.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=6):(Total: 610.448ms, non-child: 610.448ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:23/5.25 GB 1:18/4.23 GB 6:20/4.61 GB 7:21/4.55 GB 3:26/6.40 GB 2:23/5.42 GB 4:11/2.55 GB 0:14/3.43 GB ExecOption: PARQUET Codegen Enabled Runtime filters: Only following filters arrived: 4, waited 502ms BytesRead(16s000ms): 13.97 MB, 15.37 MB, 15.37 MB, 15.37 MB, 15.37 MB, 15.37 MB, 15.37 MB, 15.37 MB, 15.37 MB, 15.37 MB, 15.37 MB, 15.37 MB, 15.37 MB, 15.37 MB, 15.37 MB, 15.37 MB, 15.37 MB, 15.37 MB, 15.37 MB, 15.37 MB, 15.37 MB, 15.37 MB, 15.37 MB, 15.37 MB, 15.37 MB, 15.37 MB, 15.37 MB, 15.37 MB, 15.37 MB, 15.37 MB, 15.37 MB, 15.37 MB, 15.37 MB, 15.37 MB, 15.37 MB, 15.37 MB, 15.37 MB, 15.37 MB, 15.37 MB, 15.37 MB - FooterProcessingTime: (Avg: 86.984ms ; Min: 59.008ms ; Max: 136.665ms ; Number of samples: 5) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 12.00 - BytesRead: 15.37 MB (16113111) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 14.384ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 0 (0) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 25.01 MB (26225423) - PerReadThreadRawHdfsThroughput: 45.48 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 2.68M (2681234) - RowsReturned: 2.56M (2564498) - RowsReturnedRate: 4.20 M/sec - ScanRangesComplete: 152 (152) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 35.477ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 337.883ms - TotalReadThroughput: 24.59 KB/sec Filter 2 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 471.44K (471442) Filter 3 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 471.44K (471442) Filter 4 (1.00 MB): - Files processed: 156 (156) - Files rejected: 151 (151) - Files total: 156 (156) - RowGroups processed: 2.62K (2619) - RowGroups rejected: 0 (0) - RowGroups total: 2.62K (2619) - Rows processed: 16.38K (16384) - Rows rejected: 0 (0) - Rows total: 471.44K (471442) - Splits processed: 5 (5) - Splits rejected: 0 (0) - Splits total: 5 (5) Instance 7f40dcb034de70b7:1cf (host=ve1126.foo:22000):(Total: 1s128ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:21/5.01 GB 6:19/4.40 GB 7:22/5.03 GB 4:23/5.67 GB 5:13/2.57 GB 1:18/4.24 GB 2:21/4.95 GB 3:19/4.69 GB Filter 4 arrival: 270ms Filter 2 arrival: 7s442ms Filter 3 arrival: 9m23s MemoryUsage(16s000ms): 49.08 MB, 58.52 MB, 58.52 MB, 58.52 MB, 58.52 MB, 58.52 MB, 58.52 MB, 58.52 MB, 58.52 MB, 58.52 MB, 58.52 MB, 58.52 MB, 58.52 MB, 58.52 MB, 58.52 MB, 58.52 MB, 58.52 MB, 58.52 MB, 58.52 MB, 58.52 MB, 58.52 MB, 58.52 MB, 58.52 MB, 58.52 MB, 58.52 MB, 58.52 MB, 58.52 MB, 58.52 MB, 58.52 MB, 58.52 MB, 58.52 MB, 58.52 MB, 58.52 MB, 58.52 MB, 58.52 MB, 58.52 MB, 58.52 MB, 58.52 MB, 58.52 MB, 58.52 MB ThreadUsage(16s000ms): 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 13.00 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 58.52 MB (61359611) - PerHostPeakMemUsage: 169.56 GB (182065029600) - RowsProduced: 1.14M (1142784) - TotalNetworkReceiveTime: 25.884ms - TotalNetworkSendTime: 361.127us - TotalStorageWaitTime: 1s073ms - TotalThreadsInvoluntaryContextSwitches: 29 (29) - TotalThreadsTotalWallClockTime: 1s103ms - TotalThreadsSysTime: 4.999ms - TotalThreadsUserTime: 190.971ms - TotalThreadsVoluntaryContextSwitches: 61 (61) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 31.960ms - OpenTime: 1s076ms - ExecTreeOpenTime: 880.714ms - PrepareTime: 52.800ms - ExecTreePrepareTime: 552.104us DataStreamSender (dst_id=24):(Total: 165.887ms, non-child: 165.887ms, % non-child: 100.00%) - BytesSent: 9.76 MB (10232934) - NetworkThroughput(*): 94.60 MB/sec - OverallThroughput: 58.83 MB/sec - PeakMemoryUsage: 4.69 MB (4921088) - RowsReturned: 1.14M (1141760) - SerializeBatchTime: 62.136ms - TransmitDataRPCTime: 103.156ms - UncompressedRowBatchSize: 31.30 MB (32822160) CodeGen:(Total: 216.126ms, non-child: 216.126ms, % non-child: 100.00%) - CodegenTime: 1.242ms - CompileTime: 62.364ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 131.288ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 21.970ms HASH_JOIN_NODE (id=8):(Total: 913.329ms, non-child: 28.232ms, % non-child: 3.09%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.391ms - PeakMemoryUsage: 1.11 MB (1162496) - ProbeRows: 1.14M (1142784) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 24.903ms - RowsReturned: 1.14M (1141760) - RowsReturnedRate: 1.25 M/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 22.722us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 108.875us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 51.201us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=19):(Total: 25.893ms, non-child: 17.743us, % non-child: 0.07%) BytesReceived(16s000ms): 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 4.484us - DeserializeRowBatchTimer: 17.132us - FirstBatchArrivalWaitTime: 15.916ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 4.63 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=6):(Total: 859.311ms, non-child: 859.311ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:21/5.01 GB 6:19/4.40 GB 7:22/5.03 GB 4:23/5.67 GB 5:13/2.57 GB 1:18/4.24 GB 2:21/4.95 GB 3:19/4.69 GB ExecOption: PARQUET Codegen Enabled Runtime filters: Only following filters arrived: 4, waited 763ms BytesRead(16s000ms): 22.79 MB, 24.31 MB, 24.31 MB, 24.31 MB, 24.31 MB, 24.31 MB, 24.31 MB, 24.31 MB, 24.31 MB, 24.31 MB, 24.31 MB, 24.31 MB, 24.31 MB, 24.31 MB, 24.31 MB, 24.31 MB, 24.31 MB, 24.31 MB, 24.31 MB, 24.31 MB, 24.31 MB, 24.31 MB, 24.31 MB, 24.31 MB, 24.31 MB, 24.31 MB, 24.31 MB, 24.31 MB, 24.31 MB, 24.31 MB, 24.31 MB, 24.31 MB, 24.31 MB, 24.31 MB, 24.31 MB, 24.31 MB, 24.31 MB, 24.31 MB, 24.31 MB, 24.31 MB - FooterProcessingTime: (Avg: 63.640ms ; Min: 46.316ms ; Max: 92.811ms ; Number of samples: 7) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 12.00 - BytesRead: 24.31 MB (25489962) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 6.779ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 0 (0) - NumRowGroups: 7 (7) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 36.71 MB (38495743) - PerReadThreadRawHdfsThroughput: 50.95 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 1.26M (1262592) - RowsReturned: 1.14M (1142784) - RowsReturnedRate: 1.33 M/sec - ScanRangesComplete: 149 (149) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 477.071ms - TotalReadThroughput: 38.89 KB/sec Filter 2 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 3 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 4 (1.00 MB): - Files processed: 156 (156) - Files rejected: 149 (149) - Files total: 156 (156) - RowGroups processed: 1.23K (1233) - RowGroups rejected: 0 (0) - RowGroups total: 1.23K (1233) - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) - Splits processed: 7 (7) - Splits rejected: 0 (0) - Splits total: 7 (7) Instance 7f40dcb034de70b7:1fb (host=vd1342.foo:22000):(Total: 1s128ms, non-child: 24.561ms, % non-child: 2.18%) Hdfs split stats (:<# splits>/): 3:17/3.56 GB 6:15/3.70 GB 7:25/5.71 GB 1:22/5.29 GB 0:18/4.14 GB 5:18/4.01 GB 4:20/4.67 GB 2:24/5.43 GB Filter 4 arrival: 254ms Filter 2 arrival: 9s351ms Filter 3 arrival: 9m23s MemoryUsage(16s000ms): 40.38 MB, 51.37 MB, 51.37 MB, 51.37 MB, 51.37 MB, 51.37 MB, 51.37 MB, 51.37 MB, 51.37 MB, 51.37 MB, 51.37 MB, 51.37 MB, 51.37 MB, 51.37 MB, 51.37 MB, 51.37 MB, 51.37 MB, 51.37 MB, 51.37 MB, 51.37 MB, 51.37 MB, 51.37 MB, 51.37 MB, 51.37 MB, 51.37 MB, 51.37 MB, 51.37 MB, 51.37 MB, 51.37 MB, 51.37 MB, 51.37 MB, 51.37 MB, 51.37 MB, 51.37 MB, 51.37 MB, 51.37 MB, 51.37 MB, 51.37 MB, 51.37 MB ThreadUsage(16s000ms): 12, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.99 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 51.37 MB (53864544) - PerHostPeakMemUsage: 169.55 GB (182056923792) - RowsProduced: 105.47K (105472) - TotalNetworkReceiveTime: 4.524us - TotalNetworkSendTime: 19.733us - TotalStorageWaitTime: 639.361ms - TotalThreadsInvoluntaryContextSwitches: 25 (25) - TotalThreadsTotalWallClockTime: 1s058ms - TotalThreadsSysTime: 1.000ms - TotalThreadsUserTime: 188.970ms - TotalThreadsVoluntaryContextSwitches: 52 (52) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 3.379ms - OpenTime: 1s062ms - ExecTreeOpenTime: 869.205ms - PrepareTime: 66.429ms - ExecTreePrepareTime: 820.538us DataStreamSender (dst_id=24):(Total: 13.970ms, non-child: 13.970ms, % non-child: 100.00%) - BytesSent: 461.16 KB (472226) - NetworkThroughput(*): 71.30 MB/sec - OverallThroughput: 32.24 MB/sec - PeakMemoryUsage: 4.72 MB (4945664) - RowsReturned: 104.45K (104448) - SerializeBatchTime: 6.792ms - TransmitDataRPCTime: 6.316ms - UncompressedRowBatchSize: 1.45 MB (1518304) CodeGen:(Total: 215.893ms, non-child: 215.893ms, % non-child: 100.00%) - CodegenTime: 1.462ms - CompileTime: 59.061ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 127.764ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 28.411ms HASH_JOIN_NODE (id=8):(Total: 874.119ms, non-child: 4.704ms, % non-child: 0.54%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.311ms - PeakMemoryUsage: 1.11 MB (1162136) - ProbeRows: 105.47K (105472) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 2.775ms - RowsReturned: 104.45K (104448) - RowsReturnedRate: 119.49 K/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 22.104us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 125.512us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 41.240us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=19):(Total: 26.357us, non-child: 26.357us, % non-child: 100.00%) BytesReceived(16s000ms): 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 4.761us - DeserializeRowBatchTimer: 23.698us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 4.55 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=6):(Total: 869.394ms, non-child: 869.394ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:17/3.56 GB 6:15/3.70 GB 7:25/5.71 GB 1:22/5.29 GB 0:18/4.14 GB 5:18/4.01 GB 4:20/4.67 GB 2:24/5.43 GB ExecOption: PARQUET Codegen Enabled Runtime filters: Only following filters arrived: 4, waited 784ms BytesRead(16s000ms): 17.68 MB, 18.86 MB, 18.86 MB, 18.86 MB, 18.86 MB, 18.86 MB, 18.86 MB, 18.86 MB, 18.86 MB, 18.86 MB, 18.86 MB, 18.86 MB, 18.86 MB, 18.86 MB, 18.86 MB, 18.86 MB, 18.86 MB, 18.86 MB, 18.86 MB, 18.86 MB, 18.86 MB, 18.86 MB, 18.86 MB, 18.86 MB, 18.86 MB, 18.86 MB, 18.86 MB, 18.86 MB, 18.86 MB, 18.86 MB, 18.86 MB, 18.86 MB, 18.86 MB, 18.86 MB, 18.86 MB, 18.86 MB, 18.86 MB, 18.86 MB, 18.86 MB - FooterProcessingTime: (Avg: 59.066ms ; Min: 49.022ms ; Max: 74.140ms ; Number of samples: 5) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 11.99 - BytesRead: 18.86 MB (19771418) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 1.753ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 0 (0) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 29.23 MB (30650337) - PerReadThreadRawHdfsThroughput: 48.39 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 223.23K (223232) - RowsReturned: 105.47K (105472) - RowsReturnedRate: 121.32 K/sec - ScanRangesComplete: 154 (154) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 389.638ms - TotalReadThroughput: 30.33 KB/sec Filter 2 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 3 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 4 (1.00 MB): - Files processed: 159 (159) - Files rejected: 154 (154) - Files total: 159 (159) - RowGroups processed: 218 (218) - RowGroups rejected: 0 (0) - RowGroups total: 218 (218) - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) - Splits processed: 5 (5) - Splits rejected: 0 (0) - Splits total: 5 (5) Instance 7f40dcb034de70b7:1bc (host=va1038.foo:22000):(Total: 1s128ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 3:14/3.44 GB 6:24/5.49 GB 5:16/3.77 GB 2:19/4.09 GB 7:24/5.32 GB 4:24/5.62 GB 1:22/4.75 GB 0:19/4.25 GB Filter 4 arrival: 303ms Filter 2 arrival: 7s153ms Filter 3 arrival: 9m23s MemoryUsage(16s000ms): 57.45 MB, 68.03 MB, 68.03 MB, 68.03 MB, 68.03 MB, 68.03 MB, 68.03 MB, 68.03 MB, 68.03 MB, 68.03 MB, 68.03 MB, 68.03 MB, 68.03 MB, 68.03 MB, 68.03 MB, 68.03 MB, 68.03 MB, 68.03 MB, 68.03 MB, 68.03 MB, 68.03 MB, 68.03 MB, 68.03 MB, 68.03 MB, 68.03 MB, 68.03 MB, 68.03 MB, 68.03 MB, 68.03 MB, 68.03 MB, 68.03 MB, 68.03 MB, 68.03 MB, 68.03 MB, 68.03 MB, 68.03 MB, 68.03 MB, 68.03 MB, 68.03 MB ThreadUsage(16s000ms): 12, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.98 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 68.03 MB (71330972) - PerHostPeakMemUsage: 169.57 GB (182069396571) - RowsProduced: 1.38M (1383424) - TotalNetworkReceiveTime: 48.161ms - TotalNetworkSendTime: 446.685us - TotalStorageWaitTime: 1s348ms - TotalThreadsInvoluntaryContextSwitches: 33 (33) - TotalThreadsTotalWallClockTime: 1s119ms - TotalThreadsSysTime: 3.000ms - TotalThreadsUserTime: 199.969ms - TotalThreadsVoluntaryContextSwitches: 96 (96) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 37.221ms - OpenTime: 1s070ms - ExecTreeOpenTime: 866.028ms - PrepareTime: 57.861ms - ExecTreePrepareTime: 1.069ms DataStreamSender (dst_id=24):(Total: 198.139ms, non-child: 198.139ms, % non-child: 100.00%) - BytesSent: 11.91 MB (12491590) - NetworkThroughput(*): 99.36 MB/sec - OverallThroughput: 60.12 MB/sec - PeakMemoryUsage: 4.96 MB (5199616) - RowsReturned: 1.38M (1382400) - SerializeBatchTime: 77.478ms - TransmitDataRPCTime: 119.895ms - UncompressedRowBatchSize: 38.12 MB (39967120) CodeGen:(Total: 224.853ms, non-child: 224.853ms, % non-child: 100.00%) - CodegenTime: 1.408ms - CompileTime: 62.196ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 139.921ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 22.258ms HASH_JOIN_NODE (id=8):(Total: 904.917ms, non-child: 33.226ms, % non-child: 3.67%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 805.347us - PeakMemoryUsage: 1.11 MB (1162482) - ProbeRows: 1.38M (1383424) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 30.868ms - RowsReturned: 1.38M (1382400) - RowsReturnedRate: 1.53 M/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 16.418us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 81.914us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 31.288us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=19):(Total: 48.168ms, non-child: 22.107us, % non-child: 0.05%) BytesReceived(16s000ms): 963.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 3.738us - DeserializeRowBatchTimer: 17.727us - FirstBatchArrivalWaitTime: 43.457ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 2.49 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=6):(Total: 823.780ms, non-child: 823.780ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:14/3.44 GB 6:24/5.49 GB 5:16/3.77 GB 2:19/4.09 GB 7:24/5.32 GB 4:24/5.62 GB 1:22/4.75 GB 0:19/4.25 GB ExecOption: PARQUET Codegen Enabled Runtime filters: Only following filters arrived: 4, waited 723ms BytesRead(16s000ms): 28.14 MB, 30.61 MB, 30.61 MB, 30.61 MB, 30.61 MB, 30.61 MB, 30.61 MB, 30.61 MB, 30.61 MB, 30.61 MB, 30.61 MB, 30.61 MB, 30.61 MB, 30.61 MB, 30.61 MB, 30.61 MB, 30.61 MB, 30.61 MB, 30.61 MB, 30.61 MB, 30.61 MB, 30.61 MB, 30.61 MB, 30.61 MB, 30.61 MB, 30.61 MB, 30.61 MB, 30.61 MB, 30.61 MB, 30.61 MB, 30.61 MB, 30.61 MB, 30.61 MB, 30.61 MB, 30.61 MB, 30.61 MB, 30.61 MB, 30.61 MB, 30.61 MB - FooterProcessingTime: (Avg: 61.528ms ; Min: 30.474ms ; Max: 95.854ms ; Number of samples: 8) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 11.99 - BytesRead: 30.61 MB (32098836) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 9.074ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 0 (0) - NumRowGroups: 8 (8) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 46.08 MB (48315977) - PerReadThreadRawHdfsThroughput: 51.12 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 1.50M (1504256) - RowsReturned: 1.38M (1383424) - RowsReturnedRate: 1.68 M/sec - ScanRangesComplete: 154 (154) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 598.865ms - TotalReadThroughput: 49.21 KB/sec Filter 2 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 3 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 4 (1.00 MB): - Files processed: 162 (162) - Files rejected: 154 (154) - Files total: 162 (162) - RowGroups processed: 1.47K (1469) - RowGroups rejected: 0 (0) - RowGroups total: 1.47K (1469) - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) - Splits processed: 8 (8) - Splits rejected: 0 (0) - Splits total: 8 (8) Instance 7f40dcb034de70b7:1a1 (host=vd1116.foo:22000):(Total: 1s127ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 4:17/4.01 GB 0:20/4.75 GB 6:15/3.53 GB 3:22/5.22 GB 7:18/4.44 GB 1:27/6.42 GB 2:17/4.17 GB 5:17/3.81 GB Filter 4 arrival: 447ms Filter 2 arrival: 6s810ms Filter 3 arrival: 9m23s MemoryUsage(16s000ms): 42.92 MB, 53.07 MB, 53.07 MB, 53.07 MB, 53.07 MB, 53.07 MB, 53.07 MB, 53.07 MB, 53.07 MB, 53.07 MB, 53.07 MB, 53.07 MB, 53.07 MB, 53.07 MB, 53.07 MB, 53.07 MB, 53.07 MB, 53.07 MB, 53.07 MB, 53.07 MB, 53.07 MB, 53.07 MB, 53.07 MB, 53.07 MB, 53.07 MB, 53.07 MB, 53.07 MB, 53.07 MB, 53.07 MB, 53.07 MB, 53.07 MB, 53.07 MB, 53.07 MB, 53.07 MB, 53.07 MB, 53.07 MB, 53.07 MB, 53.07 MB, 53.07 MB ThreadUsage(16s000ms): 5, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6 - AverageThreadTokens: 5.99 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 53.07 MB (55649263) - PerHostPeakMemUsage: 169.56 GB (182059842389) - RowsProduced: 2.18M (2180096) - TotalNetworkReceiveTime: 218.799ms - TotalNetworkSendTime: 24.510ms - TotalStorageWaitTime: 861.388ms - TotalThreadsInvoluntaryContextSwitches: 20 (20) - TotalThreadsTotalWallClockTime: 1s295ms - TotalThreadsSysTime: 999.000us - TotalThreadsUserTime: 183.972ms - TotalThreadsVoluntaryContextSwitches: 45 (45) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 52.007ms - OpenTime: 1s076ms - ExecTreeOpenTime: 892.982ms - PrepareTime: 50.823ms - ExecTreePrepareTime: 463.174us DataStreamSender (dst_id=24):(Total: 291.381ms, non-child: 291.381ms, % non-child: 100.00%) - BytesSent: 18.72 MB (19632313) - NetworkThroughput(*): 101.07 MB/sec - OverallThroughput: 64.26 MB/sec - PeakMemoryUsage: 4.57 MB (4790016) - RowsReturned: 2.18M (2179072) - SerializeBatchTime: 104.977ms - TransmitDataRPCTime: 185.245ms - UncompressedRowBatchSize: 60.88 MB (63835752) CodeGen:(Total: 202.762ms, non-child: 202.762ms, % non-child: 100.00%) - CodegenTime: 920.309us - CompileTime: 58.284ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 123.899ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 20.132ms HASH_JOIN_NODE (id=8):(Total: 945.144ms, non-child: 46.028ms, % non-child: 4.87%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 706.871us - PeakMemoryUsage: 1.19 MB (1247744) - ProbeRows: 2.18M (2180877) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 42.609ms - RowsReturned: 2.18M (2179853) - RowsReturnedRate: 2.31 M/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 13.281us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 67.809us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 27.477us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=19):(Total: 218.806ms, non-child: 26.385us, % non-child: 0.01%) BytesReceived(16s000ms): 963.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 3.449us - DeserializeRowBatchTimer: 11.233us - FirstBatchArrivalWaitTime: 190.184ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 548.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=6):(Total: 680.442ms, non-child: 680.442ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:17/4.01 GB 0:20/4.75 GB 6:15/3.53 GB 3:22/5.22 GB 7:18/4.44 GB 1:27/6.42 GB 2:17/4.17 GB 5:17/3.81 GB ExecOption: PARQUET Codegen Enabled Runtime filters: Only following filters arrived: 4, waited 583ms BytesRead(16s000ms): 16.69 MB, 18.42 MB, 18.42 MB, 18.42 MB, 18.42 MB, 18.42 MB, 18.42 MB, 18.42 MB, 18.42 MB, 18.42 MB, 18.42 MB, 18.42 MB, 18.42 MB, 18.42 MB, 18.42 MB, 18.42 MB, 18.42 MB, 18.42 MB, 18.42 MB, 18.42 MB, 18.42 MB, 18.42 MB, 18.42 MB, 18.42 MB, 18.42 MB, 18.42 MB, 18.42 MB, 18.42 MB, 18.42 MB, 18.42 MB, 18.42 MB, 18.42 MB, 18.42 MB, 18.42 MB, 18.42 MB, 18.42 MB, 18.42 MB, 18.42 MB, 18.42 MB - FooterProcessingTime: (Avg: 74.461ms ; Min: 46.788ms ; Max: 125.435ms ; Number of samples: 5) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 5.00 - BytesRead: 18.42 MB (19312139) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 16.468ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 0 (0) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 5 (5) - PeakMemoryUsage: 33.31 MB (34932966) - PerReadThreadRawHdfsThroughput: 45.88 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 2.30M (2297613) - RowsReturned: 2.18M (2180877) - RowsReturnedRate: 3.21 M/sec - ScanRangesComplete: 149 (149) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 49.917ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 401.401ms - TotalReadThroughput: 29.58 KB/sec Filter 2 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 881.42K (881421) Filter 3 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 881.42K (881421) Filter 4 (1.00 MB): - Files processed: 153 (153) - Files rejected: 148 (148) - Files total: 153 (153) - RowGroups processed: 2.24K (2244) - RowGroups rejected: 0 (0) - RowGroups total: 2.24K (2244) - Rows processed: 16.38K (16384) - Rows rejected: 0 (0) - Rows total: 881.42K (881421) - Splits processed: 5 (5) - Splits rejected: 0 (0) - Splits total: 5 (5) Instance 7f40dcb034de70b7:1e7 (host=vc1502.foo:22000):(Total: 1s127ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 5:20/4.77 GB 0:18/4.22 GB 7:16/3.59 GB 1:14/3.33 GB 4:17/3.95 GB 6:20/4.51 GB 3:24/5.46 GB 2:27/6.66 GB Filter 4 arrival: 239ms Filter 2 arrival: 7s731ms Filter 3 arrival: 9m23s MemoryUsage(16s000ms): 52.27 MB, 62.59 MB, 62.59 MB, 62.59 MB, 62.59 MB, 62.59 MB, 62.59 MB, 62.59 MB, 62.59 MB, 62.59 MB, 62.59 MB, 62.59 MB, 62.59 MB, 62.59 MB, 62.59 MB, 62.59 MB, 62.59 MB, 62.59 MB, 62.59 MB, 62.59 MB, 62.59 MB, 62.59 MB, 62.59 MB, 62.59 MB, 62.59 MB, 62.59 MB, 62.59 MB, 62.59 MB, 62.59 MB, 62.59 MB, 62.59 MB, 62.59 MB, 62.59 MB, 62.59 MB, 62.59 MB, 62.59 MB, 62.59 MB, 62.59 MB, 62.59 MB ThreadUsage(16s000ms): 12, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.99 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 62.59 MB (65634023) - PerHostPeakMemUsage: 169.57 GB (182069848181) - RowsProduced: 514.05K (514048) - TotalNetworkReceiveTime: 2.891us - TotalNetworkSendTime: 195.278us - TotalStorageWaitTime: 1s610ms - TotalThreadsInvoluntaryContextSwitches: 41 (41) - TotalThreadsTotalWallClockTime: 1s080ms - TotalThreadsSysTime: 1.000ms - TotalThreadsUserTime: 193.970ms - TotalThreadsVoluntaryContextSwitches: 76 (76) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 16.967ms - OpenTime: 1s080ms - ExecTreeOpenTime: 884.692ms - PrepareTime: 47.156ms - ExecTreePrepareTime: 568.062us DataStreamSender (dst_id=24):(Total: 74.230ms, non-child: 74.230ms, % non-child: 100.00%) - BytesSent: 3.96 MB (4152899) - NetworkThroughput(*): 90.67 MB/sec - OverallThroughput: 53.35 MB/sec - PeakMemoryUsage: 4.46 MB (4675328) - RowsReturned: 513.02K (513024) - SerializeBatchTime: 29.766ms - TransmitDataRPCTime: 43.679ms - UncompressedRowBatchSize: 13.24 MB (13888016) CodeGen:(Total: 212.295ms, non-child: 212.295ms, % non-child: 100.00%) - CodegenTime: 1.167ms - CompileTime: 60.477ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 133.168ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 18.139ms HASH_JOIN_NODE (id=8):(Total: 902.500ms, non-child: 15.661ms, % non-child: 1.74%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 796.348us - PeakMemoryUsage: 1.10 MB (1148597) - ProbeRows: 514.05K (514048) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 14.044ms - RowsReturned: 513.02K (513024) - RowsReturnedRate: 568.45 K/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 11.800us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 125.293us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 19.629us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=19):(Total: 7.445us, non-child: 7.445us, % non-child: 100.00%) BytesReceived(16s000ms): 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 2.053us - DeserializeRowBatchTimer: 16.886us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 16.12 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=6):(Total: 886.834ms, non-child: 886.834ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:20/4.77 GB 0:18/4.22 GB 7:16/3.59 GB 1:14/3.33 GB 4:17/3.95 GB 6:20/4.51 GB 3:24/5.46 GB 2:27/6.66 GB ExecOption: PARQUET Codegen Enabled Runtime filters: Only following filters arrived: 4, waited 783ms BytesRead(16s000ms): 23.90 MB, 25.73 MB, 25.73 MB, 25.73 MB, 25.73 MB, 25.73 MB, 25.73 MB, 25.73 MB, 25.73 MB, 25.73 MB, 25.73 MB, 25.73 MB, 25.73 MB, 25.73 MB, 25.73 MB, 25.73 MB, 25.73 MB, 25.73 MB, 25.73 MB, 25.73 MB, 25.73 MB, 25.73 MB, 25.73 MB, 25.73 MB, 25.73 MB, 25.73 MB, 25.73 MB, 25.73 MB, 25.73 MB, 25.73 MB, 25.73 MB, 25.73 MB, 25.73 MB, 25.73 MB, 25.73 MB, 25.73 MB, 25.73 MB, 25.73 MB, 25.73 MB - FooterProcessingTime: (Avg: 85.009ms ; Min: 50.913ms ; Max: 126.952ms ; Number of samples: 7) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 11.99 - BytesRead: 25.73 MB (26980395) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 3.839ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 0 (0) - NumRowGroups: 7 (7) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 40.59 MB (42559080) - PerReadThreadRawHdfsThroughput: 43.51 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 633.86K (633856) - RowsReturned: 514.05K (514048) - RowsReturnedRate: 579.64 K/sec - ScanRangesComplete: 149 (149) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 591.342ms - TotalReadThroughput: 41.36 KB/sec Filter 2 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 3 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 4 (1.00 MB): - Files processed: 156 (156) - Files rejected: 149 (149) - Files total: 156 (156) - RowGroups processed: 619 (619) - RowGroups rejected: 0 (0) - RowGroups total: 619 (619) - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) - Splits processed: 7 (7) - Splits rejected: 0 (0) - Splits total: 7 (7) Instance 7f40dcb034de70b7:1c4 (host=vd1133.foo:22000):(Total: 1s124ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 6:24/5.50 GB 2:19/4.19 GB 4:17/3.75 GB 5:20/4.76 GB 7:11/2.71 GB 0:20/4.55 GB 1:24/5.80 GB 3:24/5.52 GB Filter 4 arrival: 303ms Filter 2 arrival: 7s298ms Filter 3 arrival: 9m23s MemoryUsage(16s000ms): 48.24 MB, 57.62 MB, 57.62 MB, 57.62 MB, 57.62 MB, 57.62 MB, 57.62 MB, 57.62 MB, 57.62 MB, 57.62 MB, 57.62 MB, 57.62 MB, 57.62 MB, 57.62 MB, 57.62 MB, 57.62 MB, 57.62 MB, 57.62 MB, 57.62 MB, 57.62 MB, 57.62 MB, 57.62 MB, 57.62 MB, 57.62 MB, 57.62 MB, 57.62 MB, 57.62 MB, 57.62 MB, 57.62 MB, 57.62 MB, 57.62 MB, 57.62 MB, 57.62 MB, 57.62 MB, 57.62 MB, 57.62 MB, 57.62 MB, 57.62 MB, 57.62 MB, 57.62 MB ThreadUsage(16s000ms): 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 13.00 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 57.62 MB (60414786) - PerHostPeakMemUsage: 169.56 GB (182063982385) - RowsProduced: 1.50M (1503232) - TotalNetworkReceiveTime: 31.754ms - TotalNetworkSendTime: 453.018us - TotalStorageWaitTime: 714.780ms - TotalThreadsInvoluntaryContextSwitches: 35 (35) - TotalThreadsTotalWallClockTime: 1s101ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 216.967ms - TotalThreadsVoluntaryContextSwitches: 108 (108) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 38.273ms - OpenTime: 1s068ms - ExecTreeOpenTime: 849.422ms - PrepareTime: 56.035ms - ExecTreePrepareTime: 660.486us DataStreamSender (dst_id=24):(Total: 206.562ms, non-child: 206.562ms, % non-child: 100.00%) - BytesSent: 12.85 MB (13470661) - NetworkThroughput(*): 97.45 MB/sec - OverallThroughput: 62.19 MB/sec - PeakMemoryUsage: 4.63 MB (4855552) - RowsReturned: 1.50M (1502208) - SerializeBatchTime: 73.206ms - TransmitDataRPCTime: 131.827ms - UncompressedRowBatchSize: 41.54 MB (43561928) CodeGen:(Total: 241.103ms, non-child: 241.103ms, % non-child: 100.00%) - CodegenTime: 1.085ms - CompileTime: 61.606ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 156.021ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 22.907ms HASH_JOIN_NODE (id=8):(Total: 888.523ms, non-child: 34.268ms, % non-child: 3.86%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.251ms - PeakMemoryUsage: 1.11 MB (1162417) - ProbeRows: 1.50M (1503232) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 30.713ms - RowsReturned: 1.50M (1502208) - RowsReturnedRate: 1.69 M/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 21.440us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 142.035us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 46.633us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=19):(Total: 31.762ms, non-child: 16.293us, % non-child: 0.05%) BytesReceived(16s000ms): 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 3.806us - DeserializeRowBatchTimer: 20.407us - FirstBatchArrivalWaitTime: 21.157ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 3.78 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=6):(Total: 822.693ms, non-child: 822.693ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 6:24/5.50 GB 2:19/4.19 GB 4:17/3.75 GB 5:20/4.76 GB 7:11/2.71 GB 0:20/4.55 GB 1:24/5.80 GB 3:24/5.52 GB ExecOption: PARQUET Codegen Enabled Runtime filters: Only following filters arrived: 4, waited 724ms BytesRead(16s000ms): 21.36 MB, 22.78 MB, 22.78 MB, 22.78 MB, 22.78 MB, 22.78 MB, 22.78 MB, 22.78 MB, 22.78 MB, 22.78 MB, 22.78 MB, 22.78 MB, 22.78 MB, 22.78 MB, 22.78 MB, 22.78 MB, 22.78 MB, 22.78 MB, 22.78 MB, 22.78 MB, 22.78 MB, 22.78 MB, 22.78 MB, 22.78 MB, 22.78 MB, 22.78 MB, 22.78 MB, 22.78 MB, 22.78 MB, 22.78 MB, 22.78 MB, 22.78 MB, 22.78 MB, 22.78 MB, 22.78 MB, 22.78 MB, 22.78 MB, 22.78 MB, 22.78 MB, 22.78 MB - FooterProcessingTime: (Avg: 50.293ms ; Min: 45.126ms ; Max: 57.502ms ; Number of samples: 6) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 12.00 - BytesRead: 22.78 MB (23890116) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 9.832ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 0 (0) - NumRowGroups: 6 (6) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 35.62 MB (37349257) - PerReadThreadRawHdfsThroughput: 46.12 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 1.62M (1622016) - RowsReturned: 1.50M (1503232) - RowsReturnedRate: 1.83 M/sec - ScanRangesComplete: 153 (153) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 493.993ms - TotalReadThroughput: 36.45 KB/sec Filter 2 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 3 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 4 (1.00 MB): - Files processed: 159 (159) - Files rejected: 153 (153) - Files total: 159 (159) - RowGroups processed: 1.58K (1584) - RowGroups rejected: 0 (0) - RowGroups total: 1.58K (1584) - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) - Splits processed: 6 (6) - Splits rejected: 0 (0) - Splits total: 6 (6) Instance 7f40dcb034de70b7:203 (host=vd1326.foo:22000):(Total: 1s124ms, non-child: 23.064ms, % non-child: 2.05%) Hdfs split stats (:<# splits>/): 1:19/4.45 GB 0:18/4.44 GB 6:20/4.82 GB 4:17/4.05 GB 7:17/3.79 GB 5:18/4.11 GB 2:24/5.66 GB 3:22/5.07 GB Filter 4 arrival: 290ms Filter 2 arrival: 9s591ms Filter 3 arrival: 9m23s MemoryUsage(16s000ms): 41.84 MB, 55.24 MB, 55.24 MB, 55.24 MB, 55.24 MB, 55.24 MB, 55.24 MB, 55.24 MB, 55.24 MB, 55.24 MB, 55.24 MB, 55.24 MB, 55.24 MB, 55.24 MB, 55.24 MB, 55.24 MB, 55.24 MB, 55.24 MB, 55.24 MB, 55.24 MB, 55.24 MB, 55.24 MB, 55.24 MB, 55.24 MB, 55.24 MB, 55.24 MB, 55.24 MB, 55.24 MB, 55.24 MB, 55.24 MB, 55.24 MB, 55.24 MB, 55.24 MB, 55.24 MB, 55.24 MB, 55.24 MB, 55.24 MB, 55.24 MB, 55.24 MB ThreadUsage(16s000ms): 6, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7 - AverageThreadTokens: 6.99 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 55.24 MB (57926424) - PerHostPeakMemUsage: 169.56 GB (182062806114) - RowsProduced: 116.74K (116736) - TotalNetworkReceiveTime: 3.979us - TotalNetworkSendTime: 24.334us - TotalStorageWaitTime: 684.115ms - TotalThreadsInvoluntaryContextSwitches: 27 (27) - TotalThreadsTotalWallClockTime: 1s058ms - TotalThreadsSysTime: 1.999ms - TotalThreadsUserTime: 229.964ms - TotalThreadsVoluntaryContextSwitches: 56 (56) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 3.975ms - OpenTime: 1s057ms - ExecTreeOpenTime: 827.735ms - PrepareTime: 67.750ms - ExecTreePrepareTime: 650.381us DataStreamSender (dst_id=24):(Total: 13.348ms, non-child: 13.348ms, % non-child: 100.00%) - BytesSent: 594.28 KB (608541) - NetworkThroughput(*): 106.99 MB/sec - OverallThroughput: 43.48 MB/sec - PeakMemoryUsage: 4.88 MB (5117696) - RowsReturned: 115.71K (115712) - SerializeBatchTime: 7.001ms - TransmitDataRPCTime: 5.424ms - UncompressedRowBatchSize: 1.94 MB (2031848) CodeGen:(Total: 255.671ms, non-child: 255.671ms, % non-child: 100.00%) - CodegenTime: 1.282ms - CompileTime: 68.337ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 158.783ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 27.952ms HASH_JOIN_NODE (id=8):(Total: 832.881ms, non-child: 5.127ms, % non-child: 0.62%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.502ms - PeakMemoryUsage: 1.10 MB (1151278) - ProbeRows: 116.74K (116736) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3.078ms - RowsReturned: 115.71K (115712) - RowsReturnedRate: 138.93 K/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 29.144us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 124.599us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 68.466us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=19):(Total: 16.595us, non-child: 16.595us, % non-child: 100.00%) BytesReceived(16s000ms): 963.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 6.946us - DeserializeRowBatchTimer: 16.886us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 7.23 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=6):(Total: 827.744ms, non-child: 827.744ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:19/4.45 GB 0:18/4.44 GB 6:20/4.82 GB 4:17/4.05 GB 7:17/3.79 GB 5:18/4.11 GB 2:24/5.66 GB 3:22/5.07 GB ExecOption: PARQUET Codegen Enabled Runtime filters: Only following filters arrived: 4, waited 743ms BytesRead(16s000ms): 19.70 MB, 21.74 MB, 21.74 MB, 21.74 MB, 21.74 MB, 21.74 MB, 21.74 MB, 21.74 MB, 21.74 MB, 21.74 MB, 21.74 MB, 21.74 MB, 21.74 MB, 21.74 MB, 21.74 MB, 21.74 MB, 21.74 MB, 21.74 MB, 21.74 MB, 21.74 MB, 21.74 MB, 21.74 MB, 21.74 MB, 21.74 MB, 21.74 MB, 21.74 MB, 21.74 MB, 21.74 MB, 21.74 MB, 21.74 MB, 21.74 MB, 21.74 MB, 21.74 MB, 21.74 MB, 21.74 MB, 21.74 MB, 21.74 MB, 21.74 MB, 21.74 MB - FooterProcessingTime: (Avg: 47.999ms ; Min: 35.655ms ; Max: 70.466ms ; Number of samples: 6) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 5.99 - BytesRead: 21.74 MB (22791880) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 2.196ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 0 (0) - NumRowGroups: 6 (6) - NumScannerThreadsStarted: 6 (6) - PeakMemoryUsage: 33.42 MB (35039897) - PerReadThreadRawHdfsThroughput: 48.42 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 235.52K (235520) - RowsReturned: 116.74K (116736) - RowsReturnedRate: 141.03 K/sec - ScanRangesComplete: 149 (149) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 448.945ms - TotalReadThroughput: 34.94 KB/sec Filter 2 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 3 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 4 (1.00 MB): - Files processed: 155 (155) - Files rejected: 149 (149) - Files total: 155 (155) - RowGroups processed: 230 (230) - RowGroups rejected: 0 (0) - RowGroups total: 230 (230) - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) - Splits processed: 6 (6) - Splits rejected: 0 (0) - Splits total: 6 (6) Instance 7f40dcb034de70b7:1bf (host=vd1334.foo:22000):(Total: 1s121ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 4:25/5.86 GB 1:14/3.44 GB 5:22/5.31 GB 3:19/4.33 GB 7:16/3.18 GB 0:23/5.11 GB 6:22/4.93 GB 2:19/4.45 GB Filter 4 arrival: 341ms Filter 2 arrival: 7s198ms Filter 3 arrival: 9m23s MemoryUsage(16s000ms): 55.72 MB, 65.60 MB, 65.60 MB, 65.60 MB, 65.60 MB, 65.60 MB, 65.60 MB, 65.60 MB, 65.60 MB, 65.60 MB, 65.60 MB, 65.60 MB, 65.60 MB, 65.60 MB, 65.60 MB, 65.60 MB, 65.60 MB, 65.60 MB, 65.60 MB, 65.60 MB, 65.60 MB, 65.60 MB, 65.60 MB, 65.60 MB, 65.60 MB, 65.60 MB, 65.60 MB, 65.60 MB, 65.60 MB, 65.60 MB, 65.60 MB, 65.60 MB, 65.60 MB, 65.60 MB, 65.60 MB, 65.60 MB, 65.60 MB, 65.60 MB, 65.60 MB ThreadUsage(16s000ms): 12, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.98 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 65.60 MB (68782408) - PerHostPeakMemUsage: 169.57 GB (182073588045) - RowsProduced: 1.53M (1533952) - TotalNetworkReceiveTime: 110.866ms - TotalNetworkSendTime: 493.257us - TotalStorageWaitTime: 1s350ms - TotalThreadsInvoluntaryContextSwitches: 20 (20) - TotalThreadsTotalWallClockTime: 1s182ms - TotalThreadsSysTime: 2.000ms - TotalThreadsUserTime: 182.971ms - TotalThreadsVoluntaryContextSwitches: 44 (44) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 40.118ms - OpenTime: 1s070ms - ExecTreeOpenTime: 888.078ms - PrepareTime: 50.263ms - ExecTreePrepareTime: 497.005us DataStreamSender (dst_id=24):(Total: 223.562ms, non-child: 223.562ms, % non-child: 100.00%) - BytesSent: 13.19 MB (13830801) - NetworkThroughput(*): 95.60 MB/sec - OverallThroughput: 59.00 MB/sec - PeakMemoryUsage: 4.69 MB (4912896) - RowsReturned: 1.53M (1532928) - SerializeBatchTime: 85.114ms - TransmitDataRPCTime: 137.965ms - UncompressedRowBatchSize: 42.46 MB (44522032) CodeGen:(Total: 206.115ms, non-child: 206.115ms, % non-child: 100.00%) - CodegenTime: 878.211us - CompileTime: 54.021ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 127.055ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 24.615ms HASH_JOIN_NODE (id=8):(Total: 928.649ms, non-child: 36.133ms, % non-child: 3.89%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.206ms - PeakMemoryUsage: 1.11 MB (1162458) - ProbeRows: 1.53M (1533952) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 32.849ms - RowsReturned: 1.53M (1532928) - RowsReturnedRate: 1.65 M/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 20.470us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 97.426us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 40.549us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=19):(Total: 110.875ms, non-child: 17.350us, % non-child: 0.02%) BytesReceived(16s000ms): 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 4.116us - DeserializeRowBatchTimer: 17.557us - FirstBatchArrivalWaitTime: 87.203ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 1.08 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=6):(Total: 781.778ms, non-child: 781.778ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:25/5.86 GB 1:14/3.44 GB 5:22/5.31 GB 3:19/4.33 GB 7:16/3.18 GB 0:23/5.11 GB 6:22/4.93 GB 2:19/4.45 GB ExecOption: PARQUET Codegen Enabled Runtime filters: Only following filters arrived: 4, waited 683ms BytesRead(16s000ms): 23.63 MB, 25.21 MB, 25.21 MB, 25.21 MB, 25.21 MB, 25.21 MB, 25.21 MB, 25.21 MB, 25.21 MB, 25.21 MB, 25.21 MB, 25.21 MB, 25.21 MB, 25.21 MB, 25.21 MB, 25.21 MB, 25.21 MB, 25.21 MB, 25.21 MB, 25.21 MB, 25.21 MB, 25.21 MB, 25.21 MB, 25.21 MB, 25.21 MB, 25.21 MB, 25.21 MB, 25.21 MB, 25.21 MB, 25.21 MB, 25.21 MB, 25.21 MB, 25.21 MB, 25.21 MB, 25.21 MB, 25.21 MB, 25.21 MB, 25.21 MB, 25.21 MB - FooterProcessingTime: (Avg: 72.318ms ; Min: 43.786ms ; Max: 120.110ms ; Number of samples: 7) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 11.98 - BytesRead: 25.21 MB (26433176) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 8.675ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 0 (0) - NumRowGroups: 7 (7) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 43.80 MB (45927574) - PerReadThreadRawHdfsThroughput: 41.03 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 1.65M (1653760) - RowsReturned: 1.53M (1533952) - RowsReturnedRate: 1.96 M/sec - ScanRangesComplete: 153 (153) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 614.444ms - TotalReadThroughput: 40.52 KB/sec Filter 2 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 3 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 4 (1.00 MB): - Files processed: 160 (160) - Files rejected: 153 (153) - Files total: 160 (160) - RowGroups processed: 1.61K (1615) - RowGroups rejected: 0 (0) - RowGroups total: 1.61K (1615) - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) - Splits processed: 7 (7) - Splits rejected: 0 (0) - Splits total: 7 (7) Instance 7f40dcb034de70b7:1a6 (host=vc1531.foo:22000):(Total: 1s120ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 5:19/4.52 GB 6:20/4.89 GB 2:21/4.34 GB 3:20/4.73 GB 0:19/4.40 GB 4:23/5.50 GB 7:29/6.81 GB 1:7/1.50 GB Filter 4 arrival: 421ms Filter 2 arrival: 6s894ms Filter 3 arrival: 9m23s MemoryUsage(16s000ms): 47.65 MB, 57.04 MB, 57.04 MB, 57.04 MB, 57.04 MB, 57.04 MB, 57.04 MB, 57.04 MB, 57.04 MB, 57.04 MB, 57.04 MB, 57.04 MB, 57.04 MB, 57.04 MB, 57.04 MB, 57.04 MB, 57.04 MB, 57.04 MB, 57.04 MB, 57.04 MB, 57.04 MB, 57.04 MB, 57.04 MB, 57.04 MB, 57.04 MB, 57.04 MB, 57.04 MB, 57.04 MB, 57.04 MB, 57.04 MB, 57.04 MB, 57.04 MB, 57.04 MB, 57.04 MB, 57.04 MB, 57.04 MB, 57.04 MB, 57.04 MB, 57.04 MB ThreadUsage(16s000ms): 12, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.98 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 57.04 MB (59815549) - PerHostPeakMemUsage: 169.56 GB (182064015224) - RowsProduced: 2.04M (2037760) - TotalNetworkReceiveTime: 147.729ms - TotalNetworkSendTime: 738.087us - TotalStorageWaitTime: 603.230ms - TotalThreadsInvoluntaryContextSwitches: 50 (50) - TotalThreadsTotalWallClockTime: 1s216ms - TotalThreadsSysTime: 7.998ms - TotalThreadsUserTime: 218.967ms - TotalThreadsVoluntaryContextSwitches: 41 (41) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 55.841ms - OpenTime: 1s068ms - ExecTreeOpenTime: 842.823ms - PrepareTime: 52.320ms - ExecTreePrepareTime: 589.028us DataStreamSender (dst_id=24):(Total: 290.482ms, non-child: 290.482ms, % non-child: 100.00%) - BytesSent: 17.82 MB (18689008) - NetworkThroughput(*): 99.46 MB/sec - OverallThroughput: 61.36 MB/sec - PeakMemoryUsage: 4.76 MB (4986624) - RowsReturned: 2.04M (2036736) - SerializeBatchTime: 110.051ms - TransmitDataRPCTime: 179.192ms - UncompressedRowBatchSize: 56.98 MB (59749728) CodeGen:(Total: 245.408ms, non-child: 245.408ms, % non-child: 100.00%) - CodegenTime: 1.041ms - CompileTime: 68.564ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 154.712ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 21.624ms HASH_JOIN_NODE (id=8):(Total: 899.092ms, non-child: 49.917ms, % non-child: 5.55%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.366ms - PeakMemoryUsage: 1.11 MB (1162522) - ProbeRows: 2.04M (2037760) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 45.953ms - RowsReturned: 2.04M (2036736) - RowsReturnedRate: 2.27 M/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 23.277us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 130.769us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 53.700us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=19):(Total: 147.740ms, non-child: 18.432us, % non-child: 0.01%) BytesReceived(16s000ms): 963.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 4.817us - DeserializeRowBatchTimer: 18.586us - FirstBatchArrivalWaitTime: 130.973ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 812.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=6):(Total: 701.613ms, non-child: 701.613ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:19/4.52 GB 6:20/4.89 GB 2:21/4.34 GB 3:20/4.73 GB 0:19/4.40 GB 4:23/5.50 GB 7:29/6.81 GB 1:7/1.50 GB ExecOption: PARQUET Codegen Enabled Runtime filters: Only following filters arrived: 4, waited 603ms BytesRead(16s000ms): 20.41 MB, 21.77 MB, 21.77 MB, 21.77 MB, 21.77 MB, 21.77 MB, 21.77 MB, 21.77 MB, 21.77 MB, 21.77 MB, 21.77 MB, 21.77 MB, 21.77 MB, 21.77 MB, 21.77 MB, 21.77 MB, 21.77 MB, 21.77 MB, 21.77 MB, 21.77 MB, 21.77 MB, 21.77 MB, 21.77 MB, 21.77 MB, 21.77 MB, 21.77 MB, 21.77 MB, 21.77 MB, 21.77 MB, 21.77 MB, 21.77 MB, 21.77 MB, 21.77 MB, 21.77 MB, 21.77 MB, 21.77 MB, 21.77 MB, 21.77 MB, 21.77 MB - FooterProcessingTime: (Avg: 54.352ms ; Min: 42.253ms ; Max: 68.175ms ; Number of samples: 5) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 11.98 - BytesRead: 21.77 MB (22824695) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 11.372ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 0 (0) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 35.31 MB (37029158) - PerReadThreadRawHdfsThroughput: 59.92 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 2.16M (2155520) - RowsReturned: 2.04M (2037760) - RowsReturnedRate: 2.90 M/sec - ScanRangesComplete: 153 (153) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 363.268ms - TotalReadThroughput: 35.13 KB/sec Filter 2 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 3 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 4 (1.00 MB): - Files processed: 158 (158) - Files rejected: 153 (153) - Files total: 158 (158) - RowGroups processed: 2.10K (2105) - RowGroups rejected: 0 (0) - RowGroups total: 2.10K (2105) - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) - Splits processed: 5 (5) - Splits rejected: 0 (0) - Splits total: 5 (5) Instance 7f40dcb034de70b7:1cd (host=vd1124.foo:22000):(Total: 1s117ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 7:18/4.04 GB 3:18/3.98 GB 0:15/3.70 GB 4:21/4.57 GB 1:17/3.82 GB 5:21/5.03 GB 6:30/7.16 GB 2:16/3.72 GB Filter 4 arrival: 294ms Filter 2 arrival: 7s449ms Filter 3 arrival: 9m23s MemoryUsage(16s000ms): 45.12 MB, 55.66 MB, 55.66 MB, 55.66 MB, 55.66 MB, 55.66 MB, 55.66 MB, 55.66 MB, 55.66 MB, 55.66 MB, 55.66 MB, 55.66 MB, 55.66 MB, 55.66 MB, 55.66 MB, 55.66 MB, 55.66 MB, 55.66 MB, 55.66 MB, 55.66 MB, 55.66 MB, 55.66 MB, 55.66 MB, 55.66 MB, 55.66 MB, 55.66 MB, 55.66 MB, 55.66 MB, 55.66 MB, 55.66 MB, 55.66 MB, 55.66 MB, 55.66 MB, 55.66 MB, 55.66 MB, 55.66 MB, 55.66 MB, 55.66 MB, 55.66 MB ThreadUsage(16s000ms): 12, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.98 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 55.66 MB (58366652) - PerHostPeakMemUsage: 169.55 GB (182056460523) - RowsProduced: 989.18K (989184) - TotalNetworkReceiveTime: 28.251ms - TotalNetworkSendTime: 303.880us - TotalStorageWaitTime: 1s253ms - TotalThreadsInvoluntaryContextSwitches: 34 (34) - TotalThreadsTotalWallClockTime: 1s092ms - TotalThreadsSysTime: 4.999ms - TotalThreadsUserTime: 207.968ms - TotalThreadsVoluntaryContextSwitches: 98 (98) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 36.616ms - OpenTime: 1s063ms - ExecTreeOpenTime: 848.942ms - PrepareTime: 54.556ms - ExecTreePrepareTime: 582.402us DataStreamSender (dst_id=24):(Total: 152.299ms, non-child: 152.299ms, % non-child: 100.00%) - BytesSent: 8.35 MB (8754813) - NetworkThroughput(*): 95.31 MB/sec - OverallThroughput: 54.82 MB/sec - PeakMemoryUsage: 4.73 MB (4962048) - RowsReturned: 988.16K (988160) - SerializeBatchTime: 63.652ms - TransmitDataRPCTime: 87.597ms - UncompressedRowBatchSize: 26.85 MB (28155608) CodeGen:(Total: 237.103ms, non-child: 237.103ms, % non-child: 100.00%) - CodegenTime: 1.198ms - CompileTime: 78.270ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 133.792ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 24.555ms HASH_JOIN_NODE (id=8):(Total: 886.170ms, non-child: 32.557ms, % non-child: 3.67%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.623ms - PeakMemoryUsage: 1.11 MB (1162337) - ProbeRows: 989.30K (989296) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 28.982ms - RowsReturned: 988.27K (988272) - RowsReturnedRate: 1.12 M/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 22.235us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 151.802us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 58.056us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=19):(Total: 28.264ms, non-child: 19.685us, % non-child: 0.07%) BytesReceived(16s000ms): 963.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 5.866us - DeserializeRowBatchTimer: 24.580us - FirstBatchArrivalWaitTime: 56.306us - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 4.25 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=6):(Total: 825.410ms, non-child: 825.410ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:18/4.04 GB 3:18/3.98 GB 0:15/3.70 GB 4:21/4.57 GB 1:17/3.82 GB 5:21/5.03 GB 6:30/7.16 GB 2:16/3.72 GB ExecOption: PARQUET Codegen Enabled Runtime filters: Only following filters arrived: 4, waited 743ms BytesRead(16s000ms): 21.09 MB, 23.24 MB, 23.24 MB, 23.24 MB, 23.24 MB, 23.24 MB, 23.24 MB, 23.24 MB, 23.24 MB, 23.24 MB, 23.24 MB, 23.24 MB, 23.24 MB, 23.24 MB, 23.24 MB, 23.24 MB, 23.24 MB, 23.24 MB, 23.24 MB, 23.24 MB, 23.24 MB, 23.24 MB, 23.24 MB, 23.24 MB, 23.24 MB, 23.24 MB, 23.24 MB, 23.24 MB, 23.24 MB, 23.24 MB, 23.24 MB, 23.24 MB, 23.24 MB, 23.24 MB, 23.24 MB, 23.24 MB, 23.24 MB, 23.24 MB, 23.24 MB - FooterProcessingTime: (Avg: 69.563ms ; Min: 49.719ms ; Max: 130.866ms ; Number of samples: 8) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 11.99 - BytesRead: 23.24 MB (24371310) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 7.225ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 0 (0) - NumRowGroups: 8 (8) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 34.57 MB (36251328) - PerReadThreadRawHdfsThroughput: 41.76 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 1.11M (1109104) - RowsReturned: 989.30K (989296) - RowsReturnedRate: 1.20 M/sec - ScanRangesComplete: 149 (149) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 21.487ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 556.543ms - TotalReadThroughput: 37.27 KB/sec Filter 2 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 324.72K (324720) Filter 3 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 324.72K (324720) Filter 4 (1.00 MB): - Files processed: 156 (156) - Files rejected: 148 (148) - Files total: 156 (156) - RowGroups processed: 1.08K (1084) - RowGroups rejected: 0 (0) - RowGroups total: 1.08K (1084) - Rows processed: 16.38K (16384) - Rows rejected: 0 (0) - Rows total: 324.72K (324720) - Splits processed: 8 (8) - Splits rejected: 0 (0) - Splits total: 8 (8) Instance 7f40dcb034de70b7:1b1 (host=vd1131.foo:22000):(Total: 1s117ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 5:15/3.44 GB 1:16/3.95 GB 6:18/4.44 GB 2:22/5.13 GB 0:22/4.99 GB 7:26/5.76 GB 4:19/4.36 GB 3:17/4.15 GB Filter 4 arrival: 376ms Filter 2 arrival: 7s027ms Filter 3 arrival: 9m23s MemoryUsage(16s000ms): 48.14 MB, 57.52 MB, 57.52 MB, 57.52 MB, 57.52 MB, 57.52 MB, 57.52 MB, 57.52 MB, 57.52 MB, 57.52 MB, 57.52 MB, 57.52 MB, 57.52 MB, 57.52 MB, 57.52 MB, 57.52 MB, 57.52 MB, 57.52 MB, 57.52 MB, 57.52 MB, 57.52 MB, 57.52 MB, 57.52 MB, 57.52 MB, 57.52 MB, 57.52 MB, 57.52 MB, 57.52 MB, 57.52 MB, 57.52 MB, 57.52 MB, 57.52 MB, 57.52 MB, 57.52 MB, 57.52 MB, 57.52 MB, 57.52 MB, 57.52 MB, 57.52 MB ThreadUsage(16s000ms): 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 13.00 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 57.52 MB (60311467) - PerHostPeakMemUsage: 169.56 GB (182064558770) - RowsProduced: 1.74M (1736704) - TotalNetworkReceiveTime: 157.103ms - TotalNetworkSendTime: 624.559us - TotalStorageWaitTime: 1s462ms - TotalThreadsInvoluntaryContextSwitches: 19 (19) - TotalThreadsTotalWallClockTime: 1s232ms - TotalThreadsSysTime: 2.000ms - TotalThreadsUserTime: 175.972ms - TotalThreadsVoluntaryContextSwitches: 46 (46) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 54.272ms - OpenTime: 1s073ms - ExecTreeOpenTime: 897.491ms - PrepareTime: 43.839ms - ExecTreePrepareTime: 478.254us DataStreamSender (dst_id=24):(Total: 250.119ms, non-child: 250.119ms, % non-child: 100.00%) - BytesSent: 14.79 MB (15510936) - NetworkThroughput(*): 95.85 MB/sec - OverallThroughput: 59.14 MB/sec - PeakMemoryUsage: 4.83 MB (5060352) - RowsReturned: 1.74M (1735680) - SerializeBatchTime: 95.235ms - TransmitDataRPCTime: 154.333ms - UncompressedRowBatchSize: 48.17 MB (50505936) CodeGen:(Total: 193.767ms, non-child: 193.767ms, % non-child: 100.00%) - CodegenTime: 896.182us - CompileTime: 52.477ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 122.276ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 18.599ms HASH_JOIN_NODE (id=8):(Total: 951.999ms, non-child: 49.492ms, % non-child: 5.20%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.688ms - PeakMemoryUsage: 1.11 MB (1162469) - ProbeRows: 1.74M (1737684) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 44.987ms - RowsReturned: 1.74M (1736660) - RowsReturnedRate: 1.82 M/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 25.579us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 177.953us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 79.625us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=19):(Total: 157.113ms, non-child: 19.665us, % non-child: 0.01%) BytesReceived(16s000ms): 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 4.306us - DeserializeRowBatchTimer: 7.655us - FirstBatchArrivalWaitTime: 142.450ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 763.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=6):(Total: 745.472ms, non-child: 745.472ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:15/3.44 GB 1:16/3.95 GB 6:18/4.44 GB 2:22/5.13 GB 0:22/4.99 GB 7:26/5.76 GB 4:19/4.36 GB 3:17/4.15 GB ExecOption: PARQUET Codegen Enabled Runtime filters: Only following filters arrived: 4, waited 663ms BytesRead(16s000ms): 23.63 MB, 25.32 MB, 25.32 MB, 25.32 MB, 25.32 MB, 25.32 MB, 25.32 MB, 25.32 MB, 25.32 MB, 25.32 MB, 25.32 MB, 25.32 MB, 25.32 MB, 25.32 MB, 25.32 MB, 25.32 MB, 25.32 MB, 25.32 MB, 25.32 MB, 25.32 MB, 25.32 MB, 25.32 MB, 25.32 MB, 25.32 MB, 25.32 MB, 25.32 MB, 25.32 MB, 25.32 MB, 25.32 MB, 25.32 MB, 25.32 MB, 25.32 MB, 25.32 MB, 25.32 MB, 25.32 MB, 25.32 MB, 25.32 MB, 25.32 MB, 25.32 MB - FooterProcessingTime: (Avg: 78.123ms ; Min: 43.669ms ; Max: 146.574ms ; Number of samples: 7) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 12.00 - BytesRead: 25.32 MB (26554966) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 9.495ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 0 (0) - NumRowGroups: 7 (7) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 35.43 MB (37146412) - PerReadThreadRawHdfsThroughput: 43.73 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 1.86M (1856468) - RowsReturned: 1.74M (1737684) - RowsReturnedRate: 2.33 M/sec - ScanRangesComplete: 149 (149) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 19.112ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 579.094ms - TotalReadThroughput: 40.61 KB/sec Filter 2 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 280.53K (280532) Filter 3 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 280.53K (280532) Filter 4 (1.00 MB): - Files processed: 155 (155) - Files rejected: 148 (148) - Files total: 155 (155) - RowGroups processed: 1.81K (1813) - RowGroups rejected: 0 (0) - RowGroups total: 1.81K (1813) - Rows processed: 16.38K (16384) - Rows rejected: 0 (0) - Rows total: 280.53K (280532) - Splits processed: 7 (7) - Splits rejected: 0 (0) - Splits total: 7 (7) Instance 7f40dcb034de70b7:198 (host=va1033.foo:22000):(Total: 1s116ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 4:21/4.81 GB 2:20/4.90 GB 0:23/5.67 GB 3:18/4.24 GB 7:20/4.46 GB 1:20/4.79 GB 6:14/3.34 GB 5:19/4.03 GB Filter 4 arrival: 472ms Filter 2 arrival: 6s722ms Filter 3 arrival: 9m23s MemoryUsage(16s000ms): 55.53 MB, 65.39 MB, 65.39 MB, 65.39 MB, 65.39 MB, 65.39 MB, 65.39 MB, 65.39 MB, 65.39 MB, 65.39 MB, 65.39 MB, 65.39 MB, 65.39 MB, 65.39 MB, 65.39 MB, 65.39 MB, 65.39 MB, 65.39 MB, 65.39 MB, 65.39 MB, 65.39 MB, 65.39 MB, 65.39 MB, 65.39 MB, 65.39 MB, 65.39 MB, 65.39 MB, 65.39 MB, 65.39 MB, 65.39 MB, 65.39 MB, 65.39 MB, 65.39 MB, 65.39 MB, 65.39 MB, 65.39 MB, 65.39 MB, 65.39 MB, 65.39 MB ThreadUsage(16s000ms): 12, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.99 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 65.39 MB (68567627) - PerHostPeakMemUsage: 169.57 GB (182072814812) - RowsProduced: 2.29M (2294784) - TotalNetworkReceiveTime: 227.236ms - TotalNetworkSendTime: 780.920us - TotalStorageWaitTime: 1s290ms - TotalThreadsInvoluntaryContextSwitches: 23 (23) - TotalThreadsTotalWallClockTime: 1s290ms - TotalThreadsSysTime: 3.999ms - TotalThreadsUserTime: 190.970ms - TotalThreadsVoluntaryContextSwitches: 52 (52) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 99.865ms - OpenTime: 1s061ms - ExecTreeOpenTime: 868.758ms - PrepareTime: 54.309ms - ExecTreePrepareTime: 434.639us DataStreamSender (dst_id=24):(Total: 310.400ms, non-child: 310.400ms, % non-child: 100.00%) - BytesSent: 19.92 MB (20891991) - NetworkThroughput(*): 101.39 MB/sec - OverallThroughput: 64.19 MB/sec - PeakMemoryUsage: 4.68 MB (4904704) - RowsReturned: 2.29M (2293760) - SerializeBatchTime: 112.951ms - TransmitDataRPCTime: 196.504ms - UncompressedRowBatchSize: 64.22 MB (67341248) CodeGen:(Total: 217.596ms, non-child: 217.596ms, % non-child: 100.00%) - CodegenTime: 860.615us - CompileTime: 60.544ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 130.745ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 25.902ms HASH_JOIN_NODE (id=8):(Total: 968.643ms, non-child: 51.134ms, % non-child: 5.28%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.859ms - PeakMemoryUsage: 1.11 MB (1162526) - ProbeRows: 2.30M (2295640) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 45.466ms - RowsReturned: 2.29M (2294616) - RowsReturnedRate: 2.37 M/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 22.429us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 221.633us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 61.564us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=19):(Total: 227.247ms, non-child: 17.480us, % non-child: 0.01%) BytesReceived(16s000ms): 963.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 5.352us - DeserializeRowBatchTimer: 19.716us - FirstBatchArrivalWaitTime: 218.361ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 528.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=6):(Total: 690.388ms, non-child: 690.388ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:21/4.81 GB 2:20/4.90 GB 0:23/5.67 GB 3:18/4.24 GB 7:20/4.46 GB 1:20/4.79 GB 6:14/3.34 GB 5:19/4.03 GB ExecOption: PARQUET Codegen Enabled Runtime filters: Only following filters arrived: 4, waited 563ms BytesRead(16s000ms): 24.14 MB, 26.45 MB, 26.45 MB, 26.45 MB, 26.45 MB, 26.45 MB, 26.45 MB, 26.45 MB, 26.45 MB, 26.45 MB, 26.45 MB, 26.45 MB, 26.45 MB, 26.45 MB, 26.45 MB, 26.45 MB, 26.45 MB, 26.45 MB, 26.45 MB, 26.45 MB, 26.45 MB, 26.45 MB, 26.45 MB, 26.45 MB, 26.45 MB, 26.45 MB, 26.45 MB, 26.45 MB, 26.45 MB, 26.45 MB, 26.45 MB, 26.45 MB, 26.45 MB, 26.45 MB, 26.45 MB, 26.45 MB, 26.45 MB, 26.45 MB, 26.45 MB - FooterProcessingTime: (Avg: 84.087ms ; Min: 42.210ms ; Max: 133.151ms ; Number of samples: 7) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 12.00 - BytesRead: 26.45 MB (27732179) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 10.575ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 0 (0) - NumRowGroups: 7 (7) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 43.61 MB (45728493) - PerReadThreadRawHdfsThroughput: 48.37 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 2.41M (2414424) - RowsReturned: 2.30M (2295640) - RowsReturnedRate: 3.33 M/sec - ScanRangesComplete: 149 (149) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 15.631ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 546.801ms - TotalReadThroughput: 42.58 KB/sec Filter 2 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 247.64K (247640) Filter 3 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 247.64K (247640) Filter 4 (1.00 MB): - Files processed: 155 (155) - Files rejected: 148 (148) - Files total: 155 (155) - RowGroups processed: 2.36K (2358) - RowGroups rejected: 0 (0) - RowGroups total: 2.36K (2358) - Rows processed: 16.38K (16384) - Rows rejected: 0 (0) - Rows total: 247.64K (247640) - Splits processed: 7 (7) - Splits rejected: 0 (0) - Splits total: 7 (7) Instance 7f40dcb034de70b7:1ad (host=ve1130.foo:22000):(Total: 1s114ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 6:24/4.93 GB 3:19/3.73 GB 2:20/4.51 GB 5:18/3.74 GB 4:21/4.75 GB 0:24/5.50 GB 1:22/5.20 GB 7:19/4.33 GB Filter 4 arrival: 402ms Filter 2 arrival: 6s967ms Filter 3 arrival: 9m23s MemoryUsage(16s000ms): 47.98 MB, 57.35 MB, 57.35 MB, 57.35 MB, 57.35 MB, 57.35 MB, 57.35 MB, 57.35 MB, 57.35 MB, 57.35 MB, 57.35 MB, 57.35 MB, 57.35 MB, 57.35 MB, 57.35 MB, 57.35 MB, 57.35 MB, 57.35 MB, 57.35 MB, 57.35 MB, 57.35 MB, 57.35 MB, 57.35 MB, 57.35 MB, 57.35 MB, 57.35 MB, 57.35 MB, 57.35 MB, 57.35 MB, 57.35 MB, 57.35 MB, 57.35 MB, 57.35 MB, 57.35 MB, 57.35 MB, 57.35 MB, 57.35 MB, 57.35 MB, 57.35 MB ThreadUsage(16s000ms): 12, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.98 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 57.35 MB (60130658) - PerHostPeakMemUsage: 169.56 GB (182064299158) - RowsProduced: 1.70M (1704960) - TotalNetworkReceiveTime: 140.410ms - TotalNetworkSendTime: 43.097ms - TotalStorageWaitTime: 739.761ms - TotalThreadsInvoluntaryContextSwitches: 23 (23) - TotalThreadsTotalWallClockTime: 1s199ms - TotalThreadsSysTime: 2.999ms - TotalThreadsUserTime: 205.969ms - TotalThreadsVoluntaryContextSwitches: 55 (55) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 45.710ms - OpenTime: 1s057ms - ExecTreeOpenTime: 850.101ms - PrepareTime: 56.925ms - ExecTreePrepareTime: 1.259ms DataStreamSender (dst_id=24):(Total: 241.519ms, non-child: 241.519ms, % non-child: 100.00%) - BytesSent: 14.71 MB (15422843) - NetworkThroughput(*): 98.14 MB/sec - OverallThroughput: 60.90 MB/sec - PeakMemoryUsage: 4.90 MB (5134080) - RowsReturned: 1.70M (1703936) - SerializeBatchTime: 90.532ms - TransmitDataRPCTime: 149.867ms - UncompressedRowBatchSize: 47.38 MB (49679800) CodeGen:(Total: 228.837ms, non-child: 228.837ms, % non-child: 100.00%) - CodegenTime: 1.284ms - CompileTime: 60.609ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 144.553ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 23.183ms HASH_JOIN_NODE (id=8):(Total: 897.733ms, non-child: 41.787ms, % non-child: 4.65%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.912ms - PeakMemoryUsage: 1.11 MB (1162483) - ProbeRows: 1.70M (1704960) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 37.790ms - RowsReturned: 1.70M (1703936) - RowsReturnedRate: 1.90 M/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 23.256us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 204.373us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 55.462us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=19):(Total: 140.420ms, non-child: 19.053us, % non-child: 0.01%) BytesReceived(16s000ms): 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 5.095us - DeserializeRowBatchTimer: 18.997us - FirstBatchArrivalWaitTime: 116.196ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 854.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=6):(Total: 715.677ms, non-child: 715.677ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 6:24/4.93 GB 3:19/3.73 GB 2:20/4.51 GB 5:18/3.74 GB 4:21/4.75 GB 0:24/5.50 GB 1:22/5.20 GB 7:19/4.33 GB ExecOption: PARQUET Codegen Enabled Runtime filters: Only following filters arrived: 4, waited 623ms BytesRead(16s000ms): 22.78 MB, 24.30 MB, 24.30 MB, 24.30 MB, 24.30 MB, 24.30 MB, 24.30 MB, 24.30 MB, 24.30 MB, 24.30 MB, 24.30 MB, 24.30 MB, 24.30 MB, 24.30 MB, 24.30 MB, 24.30 MB, 24.30 MB, 24.30 MB, 24.30 MB, 24.30 MB, 24.30 MB, 24.30 MB, 24.30 MB, 24.30 MB, 24.30 MB, 24.30 MB, 24.30 MB, 24.30 MB, 24.30 MB, 24.30 MB, 24.30 MB, 24.30 MB, 24.30 MB, 24.30 MB, 24.30 MB, 24.30 MB, 24.30 MB, 24.30 MB, 24.30 MB - FooterProcessingTime: (Avg: 44.182ms ; Min: 32.159ms ; Max: 69.123ms ; Number of samples: 6) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 11.98 - BytesRead: 24.30 MB (25479338) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 8.721ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 0 (0) - NumRowGroups: 6 (6) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 35.53 MB (37252252) - PerReadThreadRawHdfsThroughput: 80.42 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 1.82M (1823744) - RowsReturned: 1.70M (1704960) - RowsReturnedRate: 2.38 M/sec - ScanRangesComplete: 161 (161) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 302.164ms - TotalReadThroughput: 38.97 KB/sec Filter 2 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 3 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 4 (1.00 MB): - Files processed: 167 (167) - Files rejected: 161 (161) - Files total: 167 (167) - RowGroups processed: 1.78K (1781) - RowGroups rejected: 0 (0) - RowGroups total: 1.78K (1781) - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) - Splits processed: 6 (6) - Splits rejected: 0 (0) - Splits total: 6 (6) Instance 7f40dcb034de70b7:1f5 (host=vc1520.foo:22000):(Total: 1s113ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 3:18/4.36 GB 5:18/4.44 GB 1:17/3.93 GB 7:21/5.18 GB 4:18/4.44 GB 2:22/5.25 GB 0:26/5.67 GB 6:15/3.49 GB Filter 4 arrival: 257ms Filter 2 arrival: 9s078ms Filter 3 arrival: 9m23s MemoryUsage(16s000ms): 53.61 MB, 65.55 MB, 65.55 MB, 65.55 MB, 65.55 MB, 65.55 MB, 65.55 MB, 65.55 MB, 65.55 MB, 65.55 MB, 65.55 MB, 65.55 MB, 65.55 MB, 65.55 MB, 65.55 MB, 65.55 MB, 65.55 MB, 65.55 MB, 65.55 MB, 65.55 MB, 65.55 MB, 65.55 MB, 65.55 MB, 65.55 MB, 65.55 MB, 65.55 MB, 65.55 MB, 65.55 MB, 65.55 MB, 65.55 MB, 65.55 MB, 65.55 MB, 65.55 MB, 65.55 MB, 65.55 MB, 65.55 MB, 65.55 MB, 65.55 MB, 65.55 MB ThreadUsage(16s000ms): 12, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.99 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 65.55 MB (68736635) - PerHostPeakMemUsage: 169.57 GB (182072367876) - RowsProduced: 231.42K (231424) - TotalNetworkReceiveTime: 14.609us - TotalNetworkSendTime: 67.839us - TotalStorageWaitTime: 840.795ms - TotalThreadsInvoluntaryContextSwitches: 25 (25) - TotalThreadsTotalWallClockTime: 1s046ms - TotalThreadsSysTime: 5.999ms - TotalThreadsUserTime: 188.970ms - TotalThreadsVoluntaryContextSwitches: 68 (68) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 7.485ms - OpenTime: 1s045ms - ExecTreeOpenTime: 852.428ms - PrepareTime: 68.208ms - ExecTreePrepareTime: 631.857us DataStreamSender (dst_id=24):(Total: 33.173ms, non-child: 33.173ms, % non-child: 100.00%) - BytesSent: 1.54 MB (1610130) - NetworkThroughput(*): 84.58 MB/sec - OverallThroughput: 46.29 MB/sec - PeakMemoryUsage: 4.76 MB (4994816) - RowsReturned: 230.40K (230400) - SerializeBatchTime: 12.517ms - TransmitDataRPCTime: 18.154ms - UncompressedRowBatchSize: 5.11 MB (5358720) CodeGen:(Total: 220.097ms, non-child: 220.097ms, % non-child: 100.00%) - CodegenTime: 1.632ms - CompileTime: 58.326ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 132.549ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 28.417ms HASH_JOIN_NODE (id=8):(Total: 861.051ms, non-child: 7.851ms, % non-child: 0.91%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.297ms - PeakMemoryUsage: 1.09 MB (1148124) - ProbeRows: 231.42K (231424) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 5.853ms - RowsReturned: 230.40K (230400) - RowsReturnedRate: 267.58 K/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 21.723us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 110.103us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 42.078us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=19):(Total: 23.658us, non-child: 23.658us, % non-child: 100.00%) BytesReceived(16s000ms): 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 4.705us - DeserializeRowBatchTimer: 19.949us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 5.07 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=6):(Total: 853.192ms, non-child: 853.192ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:18/4.36 GB 5:18/4.44 GB 1:17/3.93 GB 7:21/5.18 GB 4:18/4.44 GB 2:22/5.25 GB 0:26/5.67 GB 6:15/3.49 GB ExecOption: PARQUET Codegen Enabled Runtime filters: Only following filters arrived: 4, waited 763ms BytesRead(16s000ms): 24.58 MB, 26.33 MB, 26.33 MB, 26.33 MB, 26.33 MB, 26.33 MB, 26.33 MB, 26.33 MB, 26.33 MB, 26.33 MB, 26.33 MB, 26.33 MB, 26.33 MB, 26.33 MB, 26.33 MB, 26.33 MB, 26.33 MB, 26.33 MB, 26.33 MB, 26.33 MB, 26.33 MB, 26.33 MB, 26.33 MB, 26.33 MB, 26.33 MB, 26.33 MB, 26.33 MB, 26.33 MB, 26.33 MB, 26.33 MB, 26.33 MB, 26.33 MB, 26.33 MB, 26.33 MB, 26.33 MB, 26.33 MB, 26.33 MB, 26.33 MB, 26.33 MB - FooterProcessingTime: (Avg: 48.307ms ; Min: 35.491ms ; Max: 71.726ms ; Number of samples: 6) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 12.00 - BytesRead: 26.33 MB (27613786) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 2.759ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 0 (0) - NumRowGroups: 6 (6) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 43.41 MB (45522428) - PerReadThreadRawHdfsThroughput: 80.26 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 350.21K (350208) - RowsReturned: 231.42K (231424) - RowsReturnedRate: 271.24 K/sec - ScanRangesComplete: 149 (149) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 328.113ms - TotalReadThroughput: 42.30 KB/sec Filter 2 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 3 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 4 (1.00 MB): - Files processed: 155 (155) - Files rejected: 149 (149) - Files total: 155 (155) - RowGroups processed: 342 (342) - RowGroups rejected: 0 (0) - RowGroups total: 342 (342) - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) - Splits processed: 6 (6) - Splits rejected: 0 (0) - Splits total: 6 (6) Instance 7f40dcb034de70b7:1bd (host=vc1501.foo:22000):(Total: 1s112ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 2:17/3.34 GB 5:18/4.27 GB 4:21/4.55 GB 3:23/5.67 GB 0:25/5.91 GB 1:23/4.81 GB 7:20/4.54 GB 6:15/3.70 GB Filter 4 arrival: 343ms Filter 2 arrival: 7s171ms Filter 3 arrival: 9m23s MemoryUsage(16s000ms): 65.51 MB, 76.13 MB, 76.13 MB, 76.13 MB, 76.13 MB, 76.13 MB, 76.13 MB, 76.13 MB, 76.13 MB, 76.13 MB, 76.13 MB, 76.13 MB, 76.13 MB, 76.13 MB, 76.13 MB, 76.13 MB, 76.13 MB, 76.13 MB, 76.13 MB, 76.13 MB, 76.13 MB, 76.13 MB, 76.13 MB, 76.13 MB, 76.13 MB, 76.13 MB, 76.13 MB, 76.13 MB, 76.13 MB, 76.13 MB, 76.13 MB, 76.13 MB, 76.13 MB, 76.13 MB, 76.13 MB, 76.13 MB, 76.13 MB, 76.13 MB, 76.13 MB ThreadUsage(16s000ms): 12, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.98 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 76.13 MB (79829803) - PerHostPeakMemUsage: 169.58 GB (182084050397) - RowsProduced: 1.72M (1721344) - TotalNetworkReceiveTime: 118.009ms - TotalNetworkSendTime: 548.970us - TotalStorageWaitTime: 2s221ms - TotalThreadsInvoluntaryContextSwitches: 20 (20) - TotalThreadsTotalWallClockTime: 1s183ms - TotalThreadsSysTime: 4.998ms - TotalThreadsUserTime: 176.974ms - TotalThreadsVoluntaryContextSwitches: 43 (43) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 39.734ms - OpenTime: 1s064ms - ExecTreeOpenTime: 883.923ms - PrepareTime: 48.723ms - ExecTreePrepareTime: 512.424us DataStreamSender (dst_id=24):(Total: 232.934ms, non-child: 232.934ms, % non-child: 100.00%) - BytesSent: 14.85 MB (15572720) - NetworkThroughput(*): 104.03 MB/sec - OverallThroughput: 63.76 MB/sec - PeakMemoryUsage: 4.65 MB (4871936) - RowsReturned: 1.72M (1720320) - SerializeBatchTime: 89.273ms - TransmitDataRPCTime: 142.761ms - UncompressedRowBatchSize: 47.76 MB (50081704) CodeGen:(Total: 196.844ms, non-child: 196.844ms, % non-child: 100.00%) - CodegenTime: 970.469us - CompileTime: 52.981ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 125.537ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 17.916ms HASH_JOIN_NODE (id=8):(Total: 924.110ms, non-child: 34.570ms, % non-child: 3.74%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.522ms - PeakMemoryUsage: 1.15 MB (1205072) - ProbeRows: 1.72M (1722201) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 30.608ms - RowsReturned: 1.72M (1721177) - RowsReturnedRate: 1.86 M/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 33.407us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 153.522us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 70.484us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=19):(Total: 118.019ms, non-child: 18.415us, % non-child: 0.02%) BytesReceived(16s000ms): 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 4.156us - DeserializeRowBatchTimer: 20.508us - FirstBatchArrivalWaitTime: 90.563ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 1.02 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=6):(Total: 771.592ms, non-child: 771.592ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:17/3.34 GB 5:18/4.27 GB 4:21/4.55 GB 3:23/5.67 GB 0:25/5.91 GB 1:23/4.81 GB 7:20/4.54 GB 6:15/3.70 GB ExecOption: PARQUET Codegen Enabled Runtime filters: Only following filters arrived: 4, waited 683ms BytesRead(16s000ms): 33.08 MB, 35.58 MB, 35.58 MB, 35.58 MB, 35.58 MB, 35.58 MB, 35.58 MB, 35.58 MB, 35.58 MB, 35.58 MB, 35.58 MB, 35.58 MB, 35.58 MB, 35.58 MB, 35.58 MB, 35.58 MB, 35.58 MB, 35.58 MB, 35.58 MB, 35.58 MB, 35.58 MB, 35.58 MB, 35.58 MB, 35.58 MB, 35.58 MB, 35.58 MB, 35.58 MB, 35.58 MB, 35.58 MB, 35.58 MB, 35.58 MB, 35.58 MB, 35.58 MB, 35.58 MB, 35.58 MB, 35.58 MB, 35.58 MB, 35.58 MB, 35.58 MB - FooterProcessingTime: (Avg: 85.697ms ; Min: 54.351ms ; Max: 149.759ms ; Number of samples: 10) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 11.98 - BytesRead: 35.58 MB (37303742) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 10.317ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 0 (0) - NumRowGroups: 10 (10) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 54.07 MB (56697516) - PerReadThreadRawHdfsThroughput: 41.45 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 1.84M (1844057) - RowsReturned: 1.72M (1722201) - RowsReturnedRate: 2.23 M/sec - ScanRangesComplete: 153 (153) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 36.487ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 858.303ms - TotalReadThroughput: 57.46 KB/sec Filter 2 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 538.46K (538457) Filter 3 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 538.46K (538457) Filter 4 (1.00 MB): - Files processed: 162 (162) - Files rejected: 152 (152) - Files total: 162 (162) - RowGroups processed: 1.80K (1801) - RowGroups rejected: 0 (0) - RowGroups total: 1.80K (1801) - Rows processed: 16.38K (16384) - Rows rejected: 0 (0) - Rows total: 538.46K (538457) - Splits processed: 10 (10) - Splits rejected: 0 (0) - Splits total: 10 (10) Instance 7f40dcb034de70b7:1f4 (host=va1042.foo:22000):(Total: 1s108ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:16/3.63 GB 1:24/5.69 GB 6:23/5.25 GB 3:21/4.77 GB 5:14/2.77 GB 7:26/6.01 GB 2:20/4.12 GB 4:18/4.22 GB Filter 4 arrival: 263ms Filter 2 arrival: 7s884ms Filter 3 arrival: 9m23s MemoryUsage(16s000ms): 69.19 MB, 80.50 MB, 80.50 MB, 80.50 MB, 80.50 MB, 80.50 MB, 80.50 MB, 80.50 MB, 80.50 MB, 80.50 MB, 80.50 MB, 80.50 MB, 80.50 MB, 80.50 MB, 80.50 MB, 80.50 MB, 80.50 MB, 80.50 MB, 80.50 MB, 80.50 MB, 80.50 MB, 80.50 MB, 80.50 MB, 80.50 MB, 80.50 MB, 80.50 MB, 80.50 MB, 80.50 MB, 80.50 MB, 80.50 MB, 80.50 MB, 80.50 MB, 80.50 MB, 80.50 MB, 80.50 MB, 80.50 MB, 80.50 MB, 80.50 MB, 80.50 MB ThreadUsage(16s000ms): 12, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.98 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 80.50 MB (84409057) - PerHostPeakMemUsage: 169.58 GB (182088609238) - RowsProduced: 420.86K (420864) - TotalNetworkReceiveTime: 4.943us - TotalNetworkSendTime: 124.342us - TotalStorageWaitTime: 2s320ms - TotalThreadsInvoluntaryContextSwitches: 29 (29) - TotalThreadsTotalWallClockTime: 1s052ms - TotalThreadsSysTime: 1.999ms - TotalThreadsUserTime: 208.967ms - TotalThreadsVoluntaryContextSwitches: 84 (84) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 9.904ms - OpenTime: 1s050ms - ExecTreeOpenTime: 840.794ms - PrepareTime: 57.619ms - ExecTreePrepareTime: 703.513us DataStreamSender (dst_id=24):(Total: 54.783ms, non-child: 54.783ms, % non-child: 100.00%) - BytesSent: 3.21 MB (3368358) - NetworkThroughput(*): 97.24 MB/sec - OverallThroughput: 58.64 MB/sec - PeakMemoryUsage: 4.57 MB (4790016) - RowsReturned: 419.84K (419840) - SerializeBatchTime: 20.861ms - TransmitDataRPCTime: 33.034ms - UncompressedRowBatchSize: 10.65 MB (11164000) CodeGen:(Total: 232.002ms, non-child: 232.002ms, % non-child: 100.00%) - CodegenTime: 1.445ms - CompileTime: 58.947ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 149.169ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 23.321ms HASH_JOIN_NODE (id=8):(Total: 851.896ms, non-child: 10.874ms, % non-child: 1.28%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.853ms - PeakMemoryUsage: 1.11 MB (1160758) - ProbeRows: 420.86K (420864) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 8.221ms - RowsReturned: 419.84K (419840) - RowsReturnedRate: 492.83 K/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 26.852us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 168.692us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 85.254us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=19):(Total: 15.038us, non-child: 15.038us, % non-child: 100.00%) BytesReceived(16s000ms): 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 5.853us - DeserializeRowBatchTimer: 28.672us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 7.98 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=6):(Total: 841.016ms, non-child: 841.016ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:16/3.63 GB 1:24/5.69 GB 6:23/5.25 GB 3:21/4.77 GB 5:14/2.77 GB 7:26/6.01 GB 2:20/4.12 GB 4:18/4.22 GB ExecOption: PARQUET Codegen Enabled Runtime filters: Only following filters arrived: 4, waited 763ms BytesRead(16s000ms): 32.79 MB, 35.09 MB, 35.09 MB, 35.09 MB, 35.09 MB, 35.09 MB, 35.09 MB, 35.09 MB, 35.09 MB, 35.09 MB, 35.09 MB, 35.09 MB, 35.09 MB, 35.09 MB, 35.09 MB, 35.09 MB, 35.09 MB, 35.09 MB, 35.09 MB, 35.09 MB, 35.09 MB, 35.09 MB, 35.09 MB, 35.09 MB, 35.09 MB, 35.09 MB, 35.09 MB, 35.09 MB, 35.09 MB, 35.09 MB, 35.09 MB, 35.09 MB, 35.09 MB, 35.09 MB, 35.09 MB, 35.09 MB, 35.09 MB, 35.09 MB, 35.09 MB - FooterProcessingTime: (Avg: 77.409ms ; Min: 51.902ms ; Max: 125.305ms ; Number of samples: 12) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 11.98 - BytesRead: 35.09 MB (36797963) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 5.346ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 0 (0) - NumRowGroups: 12 (12) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 58.60 MB (61448802) - PerReadThreadRawHdfsThroughput: 38.90 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 545.79K (545792) - RowsReturned: 420.86K (420864) - RowsReturnedRate: 500.42 K/sec - ScanRangesComplete: 150 (150) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 902.134ms - TotalReadThroughput: 56.37 KB/sec Filter 2 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 3 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 4 (1.00 MB): - Files processed: 162 (162) - Files rejected: 150 (150) - Files total: 162 (162) - RowGroups processed: 533 (533) - RowGroups rejected: 0 (0) - RowGroups total: 533 (533) - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) - Splits processed: 12 (12) - Splits rejected: 0 (0) - Splits total: 12 (12) Instance 7f40dcb034de70b7:1e3 (host=vd1329.foo:22000):(Total: 1s102ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 5:17/3.74 GB 6:24/5.36 GB 0:18/3.79 GB 4:21/4.73 GB 2:16/3.71 GB 7:24/5.68 GB 3:18/3.94 GB 1:24/5.75 GB Filter 4 arrival: 266ms Filter 2 arrival: 7s696ms Filter 3 arrival: 9m23s MemoryUsage(16s000ms): 60.24 MB, 73.40 MB, 73.40 MB, 73.40 MB, 73.40 MB, 73.40 MB, 73.40 MB, 73.40 MB, 73.40 MB, 73.40 MB, 73.40 MB, 73.40 MB, 73.40 MB, 73.40 MB, 73.40 MB, 73.40 MB, 73.40 MB, 73.40 MB, 73.40 MB, 73.40 MB, 73.40 MB, 73.40 MB, 73.40 MB, 73.40 MB, 73.40 MB, 73.40 MB, 73.40 MB, 73.40 MB, 73.40 MB, 73.40 MB, 73.40 MB, 73.40 MB, 73.40 MB, 73.40 MB, 73.40 MB, 73.40 MB, 73.40 MB, 73.40 MB, 73.40 MB ThreadUsage(16s000ms): 12, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.98 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 73.40 MB (76967184) - PerHostPeakMemUsage: 169.58 GB (182081170998) - RowsProduced: 788.48K (788480) - TotalNetworkReceiveTime: 3.532us - TotalNetworkSendTime: 350.944us - TotalStorageWaitTime: 1s000ms - TotalThreadsInvoluntaryContextSwitches: 36 (36) - TotalThreadsTotalWallClockTime: 1s028ms - TotalThreadsSysTime: 1.999ms - TotalThreadsUserTime: 193.971ms - TotalThreadsVoluntaryContextSwitches: 51 (51) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 22.579ms - OpenTime: 1s028ms - ExecTreeOpenTime: 831.892ms - PrepareTime: 74.238ms - ExecTreePrepareTime: 846.683us DataStreamSender (dst_id=24):(Total: 115.259ms, non-child: 115.259ms, % non-child: 100.00%) - BytesSent: 6.65 MB (6971496) - NetworkThroughput(*): 98.41 MB/sec - OverallThroughput: 57.68 MB/sec - PeakMemoryUsage: 4.69 MB (4921088) - RowsReturned: 787.46K (787456) - SerializeBatchTime: 46.441ms - TransmitDataRPCTime: 67.556ms - UncompressedRowBatchSize: 21.10 MB (22127048) CodeGen:(Total: 224.234ms, non-child: 224.234ms, % non-child: 100.00%) - CodegenTime: 1.792ms - CompileTime: 55.424ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 138.203ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 29.834ms HASH_JOIN_NODE (id=8):(Total: 855.738ms, non-child: 20.647ms, % non-child: 2.41%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.188ms - PeakMemoryUsage: 1.11 MB (1162504) - ProbeRows: 788.69K (788688) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 18.143ms - RowsReturned: 787.66K (787664) - RowsReturnedRate: 920.45 K/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 21.770us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 102.670us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 39.816us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=19):(Total: 11.563us, non-child: 11.563us, % non-child: 100.00%) BytesReceived(16s000ms): 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 3.833us - DeserializeRowBatchTimer: 24.098us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 10.38 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=6):(Total: 835.084ms, non-child: 835.084ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:17/3.74 GB 6:24/5.36 GB 0:18/3.79 GB 4:21/4.73 GB 2:16/3.71 GB 7:24/5.68 GB 3:18/3.94 GB 1:24/5.75 GB ExecOption: PARQUET Codegen Enabled Runtime filters: Only following filters arrived: 4, waited 763ms BytesRead(16s000ms): 26.89 MB, 28.69 MB, 28.69 MB, 28.69 MB, 28.69 MB, 28.69 MB, 28.69 MB, 28.69 MB, 28.69 MB, 28.69 MB, 28.69 MB, 28.69 MB, 28.69 MB, 28.69 MB, 28.69 MB, 28.69 MB, 28.69 MB, 28.69 MB, 28.69 MB, 28.69 MB, 28.69 MB, 28.69 MB, 28.69 MB, 28.69 MB, 28.69 MB, 28.69 MB, 28.69 MB, 28.69 MB, 28.69 MB, 28.69 MB, 28.69 MB, 28.69 MB, 28.69 MB, 28.69 MB, 28.69 MB, 28.69 MB, 28.69 MB, 28.69 MB, 28.69 MB - FooterProcessingTime: (Avg: 58.177ms ; Min: 24.565ms ; Max: 104.881ms ; Number of samples: 7) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 11.99 - BytesRead: 28.69 MB (30080682) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 4.121ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 0 (0) - NumRowGroups: 7 (7) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 51.41 MB (53908625) - PerReadThreadRawHdfsThroughput: 52.88 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 907.47K (907472) - RowsReturned: 788.69K (788688) - RowsReturnedRate: 944.44 K/sec - ScanRangesComplete: 156 (156) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 14.430ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 542.544ms - TotalReadThroughput: 46.08 KB/sec Filter 2 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 235.73K (235728) Filter 3 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 235.73K (235728) Filter 4 (1.00 MB): - Files processed: 162 (162) - Files rejected: 155 (155) - Files total: 162 (162) - RowGroups processed: 887 (887) - RowGroups rejected: 0 (0) - RowGroups total: 887 (887) - Rows processed: 16.38K (16384) - Rows rejected: 0 (0) - Rows total: 235.73K (235728) - Splits processed: 7 (7) - Splits rejected: 0 (0) - Splits total: 7 (7) Instance 7f40dcb034de70b7:1e4 (host=vc1517.foo:22000):(Total: 1s098ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 7:19/4.68 GB 1:21/4.68 GB 6:20/4.78 GB 2:22/5.10 GB 3:17/3.60 GB 0:19/4.45 GB 5:22/5.42 GB 4:16/3.84 GB Filter 4 arrival: 236ms Filter 2 arrival: 7s640ms Filter 3 arrival: 9m23s MemoryUsage(16s000ms): 53.63 MB, 65.05 MB, 65.05 MB, 65.05 MB, 65.05 MB, 65.05 MB, 65.05 MB, 65.05 MB, 65.05 MB, 65.05 MB, 65.05 MB, 65.05 MB, 65.05 MB, 65.05 MB, 65.05 MB, 65.05 MB, 65.05 MB, 65.05 MB, 65.05 MB, 65.05 MB, 65.05 MB, 65.05 MB, 65.05 MB, 65.05 MB, 65.05 MB, 65.05 MB, 65.05 MB, 65.05 MB, 65.05 MB, 65.05 MB, 65.05 MB, 65.05 MB, 65.05 MB, 65.05 MB, 65.05 MB, 65.05 MB, 65.05 MB, 65.05 MB, 65.05 MB ThreadUsage(16s000ms): 12, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.98 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 65.05 MB (68206304) - PerHostPeakMemUsage: 169.57 GB (182072460943) - RowsProduced: 740.35K (740352) - TotalNetworkReceiveTime: 3.190us - TotalNetworkSendTime: 242.974us - TotalStorageWaitTime: 1s357ms - TotalThreadsInvoluntaryContextSwitches: 34 (34) - TotalThreadsTotalWallClockTime: 1s041ms - TotalThreadsSysTime: 2.999ms - TotalThreadsUserTime: 180.973ms - TotalThreadsVoluntaryContextSwitches: 64 (64) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 20.184ms - OpenTime: 1s040ms - ExecTreeOpenTime: 857.022ms - PrepareTime: 58.168ms - ExecTreePrepareTime: 685.022us DataStreamSender (dst_id=24):(Total: 106.295ms, non-child: 106.295ms, % non-child: 100.00%) - BytesSent: 6.18 MB (6478176) - NetworkThroughput(*): 96.44 MB/sec - OverallThroughput: 58.12 MB/sec - PeakMemoryUsage: 4.76 MB (4986624) - RowsReturned: 739.33K (739328) - SerializeBatchTime: 41.323ms - TransmitDataRPCTime: 64.058ms - UncompressedRowBatchSize: 19.70 MB (20653400) CodeGen:(Total: 208.484ms, non-child: 208.484ms, % non-child: 100.00%) - CodegenTime: 1.002ms - CompileTime: 54.012ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 127.970ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 26.043ms HASH_JOIN_NODE (id=8):(Total: 878.260ms, non-child: 19.039ms, % non-child: 2.17%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.226ms - PeakMemoryUsage: 1.11 MB (1162460) - ProbeRows: 740.35K (740352) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 16.925ms - RowsReturned: 739.33K (739328) - RowsReturnedRate: 841.81 K/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 31.008us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 107.663us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 58.957us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=19):(Total: 14.076us, non-child: 14.076us, % non-child: 100.00%) BytesReceived(16s000ms): 963.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 6.465us - DeserializeRowBatchTimer: 8.720us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 8.53 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=6):(Total: 859.211ms, non-child: 859.211ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:19/4.68 GB 1:21/4.68 GB 6:20/4.78 GB 2:22/5.10 GB 3:17/3.60 GB 0:19/4.45 GB 5:22/5.42 GB 4:16/3.84 GB ExecOption: PARQUET Codegen Enabled Runtime filters: Only following filters arrived: 4, waited 784ms BytesRead(16s000ms): 25.16 MB, 27.71 MB, 27.71 MB, 27.71 MB, 27.71 MB, 27.71 MB, 27.71 MB, 27.71 MB, 27.71 MB, 27.71 MB, 27.71 MB, 27.71 MB, 27.71 MB, 27.71 MB, 27.71 MB, 27.71 MB, 27.71 MB, 27.71 MB, 27.71 MB, 27.71 MB, 27.71 MB, 27.71 MB, 27.71 MB, 27.71 MB, 27.71 MB, 27.71 MB, 27.71 MB, 27.71 MB, 27.71 MB, 27.71 MB, 27.71 MB, 27.71 MB, 27.71 MB, 27.71 MB, 27.71 MB, 27.71 MB, 27.71 MB, 27.71 MB, 27.71 MB - FooterProcessingTime: (Avg: 61.103ms ; Min: 30.954ms ; Max: 89.447ms ; Number of samples: 8) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 11.99 - BytesRead: 27.71 MB (29059401) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 4.834ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 0 (0) - NumRowGroups: 8 (8) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 42.95 MB (45041249) - PerReadThreadRawHdfsThroughput: 51.16 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 861.18K (861184) - RowsReturned: 740.35K (740352) - RowsReturnedRate: 861.66 K/sec - ScanRangesComplete: 148 (148) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 541.707ms - TotalReadThroughput: 44.48 KB/sec Filter 2 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 3 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 4 (1.00 MB): - Files processed: 156 (156) - Files rejected: 148 (148) - Files total: 156 (156) - RowGroups processed: 841 (841) - RowGroups rejected: 0 (0) - RowGroups total: 841 (841) - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) - Splits processed: 8 (8) - Splits rejected: 0 (0) - Splits total: 8 (8) Instance 7f40dcb034de70b7:1ac (host=vc1505.foo:22000):(Total: 1s088ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 2:14/3.23 GB 6:16/3.95 GB 0:21/5.05 GB 1:19/4.27 GB 5:25/5.93 GB 4:20/4.08 GB 7:20/4.93 GB 3:23/4.82 GB Filter 4 arrival: 378ms Filter 2 arrival: 6s931ms Filter 3 arrival: 9m23s MemoryUsage(16s000ms): 48.91 MB, 58.41 MB, 58.41 MB, 58.41 MB, 58.41 MB, 58.41 MB, 58.41 MB, 58.41 MB, 58.41 MB, 58.41 MB, 58.41 MB, 58.41 MB, 58.41 MB, 58.41 MB, 58.41 MB, 58.41 MB, 58.41 MB, 58.41 MB, 58.41 MB, 58.41 MB, 58.41 MB, 58.41 MB, 58.41 MB, 58.41 MB, 58.41 MB, 58.41 MB, 58.41 MB, 58.41 MB, 58.41 MB, 58.41 MB, 58.41 MB, 58.41 MB, 58.41 MB, 58.41 MB, 58.41 MB, 58.41 MB, 58.41 MB, 58.41 MB, 58.41 MB ThreadUsage(16s000ms): 12, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.99 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 58.41 MB (61243477) - PerHostPeakMemUsage: 169.56 GB (182065446297) - RowsProduced: 2.06M (2064384) - TotalNetworkReceiveTime: 129.498ms - TotalNetworkSendTime: 6.939ms - TotalStorageWaitTime: 781.235ms - TotalThreadsInvoluntaryContextSwitches: 20 (20) - TotalThreadsTotalWallClockTime: 1s161ms - TotalThreadsSysTime: 7.998ms - TotalThreadsUserTime: 189.971ms - TotalThreadsVoluntaryContextSwitches: 44 (44) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 61.840ms - OpenTime: 1s031ms - ExecTreeOpenTime: 835.916ms - PrepareTime: 56.894ms - ExecTreePrepareTime: 571.080us DataStreamSender (dst_id=24):(Total: 284.836ms, non-child: 284.836ms, % non-child: 100.00%) - BytesSent: 17.77 MB (18633092) - NetworkThroughput(*): 99.57 MB/sec - OverallThroughput: 62.39 MB/sec - PeakMemoryUsage: 4.74 MB (4970240) - RowsReturned: 2.06M (2063360) - SerializeBatchTime: 105.233ms - TransmitDataRPCTime: 178.463ms - UncompressedRowBatchSize: 57.60 MB (60397240) CodeGen:(Total: 219.295ms, non-child: 219.295ms, % non-child: 100.00%) - CodegenTime: 1.115ms - CompileTime: 55.453ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 137.821ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 25.549ms HASH_JOIN_NODE (id=8):(Total: 898.157ms, non-child: 54.397ms, % non-child: 6.06%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 838.718us - PeakMemoryUsage: 1.11 MB (1162503) - ProbeRows: 2.07M (2065089) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 50.475ms - RowsReturned: 2.06M (2064065) - RowsReturnedRate: 2.30 M/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 13.400us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 68.512us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 18.461us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=19):(Total: 129.507ms, non-child: 13.912us, % non-child: 0.01%) BytesReceived(16s000ms): 963.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 4.637us - DeserializeRowBatchTimer: 34.385us - FirstBatchArrivalWaitTime: 125.125ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 926.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=6):(Total: 714.361ms, non-child: 714.361ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:14/3.23 GB 6:16/3.95 GB 0:21/5.05 GB 1:19/4.27 GB 5:25/5.93 GB 4:20/4.08 GB 7:20/4.93 GB 3:23/4.82 GB ExecOption: PARQUET Codegen Enabled Runtime filters: Only following filters arrived: 4, waited 643ms BytesRead(16s000ms): 21.84 MB, 23.29 MB, 23.29 MB, 23.29 MB, 23.29 MB, 23.29 MB, 23.29 MB, 23.29 MB, 23.29 MB, 23.29 MB, 23.29 MB, 23.29 MB, 23.29 MB, 23.29 MB, 23.29 MB, 23.29 MB, 23.29 MB, 23.29 MB, 23.29 MB, 23.29 MB, 23.29 MB, 23.29 MB, 23.29 MB, 23.29 MB, 23.29 MB, 23.29 MB, 23.29 MB, 23.29 MB, 23.29 MB, 23.29 MB, 23.29 MB, 23.29 MB, 23.29 MB, 23.29 MB, 23.29 MB, 23.29 MB, 23.29 MB, 23.29 MB, 23.29 MB - FooterProcessingTime: (Avg: 39.316ms ; Min: 25.624ms ; Max: 56.480ms ; Number of samples: 7) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 11.99 - BytesRead: 23.29 MB (24424563) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 13.313ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 0 (0) - NumRowGroups: 7 (7) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 36.46 MB (38235176) - PerReadThreadRawHdfsThroughput: 74.41 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 2.18M (2183873) - RowsReturned: 2.07M (2065089) - RowsReturnedRate: 2.89 M/sec - ScanRangesComplete: 152 (152) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 12.452ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 313.042ms - TotalReadThroughput: 37.39 KB/sec Filter 2 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 217.79K (217793) Filter 3 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 217.79K (217793) Filter 4 (1.00 MB): - Files processed: 158 (158) - Files rejected: 151 (151) - Files total: 158 (158) - RowGroups processed: 2.13K (2133) - RowGroups rejected: 0 (0) - RowGroups total: 2.13K (2133) - Rows processed: 16.38K (16384) - Rows rejected: 0 (0) - Rows total: 217.79K (217793) - Splits processed: 7 (7) - Splits rejected: 0 (0) - Splits total: 7 (7) Instance 7f40dcb034de70b7:1c7 (host=ve1129.foo:22000):(Total: 1s084ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 4:18/4.26 GB 2:20/4.54 GB 0:22/5.42 GB 1:23/4.50 GB 6:14/3.03 GB 3:20/4.60 GB 7:21/5.18 GB 5:20/4.78 GB Filter 4 arrival: 280ms Filter 2 arrival: 7s308ms Filter 3 arrival: 9m23s MemoryUsage(16s000ms): 55.26 MB, 65.11 MB, 65.11 MB, 65.11 MB, 65.11 MB, 65.11 MB, 65.11 MB, 65.11 MB, 65.11 MB, 65.11 MB, 65.11 MB, 65.11 MB, 65.11 MB, 65.11 MB, 65.11 MB, 65.11 MB, 65.11 MB, 65.11 MB, 65.11 MB, 65.11 MB, 65.11 MB, 65.11 MB, 65.11 MB, 65.11 MB, 65.11 MB, 65.11 MB, 65.11 MB, 65.11 MB, 65.11 MB, 65.11 MB, 65.11 MB, 65.11 MB, 65.11 MB, 65.11 MB, 65.11 MB, 65.11 MB, 65.11 MB, 65.11 MB, 65.11 MB ThreadUsage(16s000ms): 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 13.00 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 65.11 MB (68270080) - PerHostPeakMemUsage: 169.57 GB (182072457823) - RowsProduced: 1.46M (1456128) - TotalNetworkReceiveTime: 21.547ms - TotalNetworkSendTime: 6.693ms - TotalStorageWaitTime: 1s220ms - TotalThreadsInvoluntaryContextSwitches: 33 (33) - TotalThreadsTotalWallClockTime: 1s052ms - TotalThreadsSysTime: 2.998ms - TotalThreadsUserTime: 203.969ms - TotalThreadsVoluntaryContextSwitches: 103 (103) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 41.376ms - OpenTime: 1s030ms - ExecTreeOpenTime: 822.761ms - PrepareTime: 54.512ms - ExecTreePrepareTime: 655.219us DataStreamSender (dst_id=24):(Total: 210.322ms, non-child: 210.322ms, % non-child: 100.00%) - BytesSent: 12.75 MB (13364232) - NetworkThroughput(*): 100.59 MB/sec - OverallThroughput: 60.60 MB/sec - PeakMemoryUsage: 4.58 MB (4798208) - RowsReturned: 1.46M (1455104) - SerializeBatchTime: 82.071ms - TransmitDataRPCTime: 126.708ms - UncompressedRowBatchSize: 40.20 MB (42155264) CodeGen:(Total: 231.425ms, non-child: 231.425ms, % non-child: 100.00%) - CodegenTime: 1.110ms - CompileTime: 68.513ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 137.304ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 25.108ms HASH_JOIN_NODE (id=8):(Total: 864.852ms, non-child: 35.946ms, % non-child: 4.16%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.322ms - PeakMemoryUsage: 1.11 MB (1162474) - ProbeRows: 1.46M (1456128) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 32.566ms - RowsReturned: 1.46M (1455104) - RowsReturnedRate: 1.68 M/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 20.557us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 152.880us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 45.978us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=19):(Total: 21.555ms, non-child: 13.284us, % non-child: 0.06%) BytesReceived(16s000ms): 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 4.243us - DeserializeRowBatchTimer: 19.605us - FirstBatchArrivalWaitTime: 16.221ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 5.57 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=6):(Total: 807.486ms, non-child: 807.486ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:18/4.26 GB 2:20/4.54 GB 0:22/5.42 GB 1:23/4.50 GB 6:14/3.03 GB 3:20/4.60 GB 7:21/5.18 GB 5:20/4.78 GB ExecOption: PARQUET Codegen Enabled Runtime filters: Only following filters arrived: 4, waited 744ms BytesRead(16s000ms): 28.00 MB, 29.86 MB, 29.86 MB, 29.86 MB, 29.86 MB, 29.86 MB, 29.86 MB, 29.86 MB, 29.86 MB, 29.86 MB, 29.86 MB, 29.86 MB, 29.86 MB, 29.86 MB, 29.86 MB, 29.86 MB, 29.86 MB, 29.86 MB, 29.86 MB, 29.86 MB, 29.86 MB, 29.86 MB, 29.86 MB, 29.86 MB, 29.86 MB, 29.86 MB, 29.86 MB, 29.86 MB, 29.86 MB, 29.86 MB, 29.86 MB, 29.86 MB, 29.86 MB, 29.86 MB, 29.86 MB, 29.86 MB, 29.86 MB, 29.86 MB, 29.86 MB - FooterProcessingTime: (Avg: 56.305ms ; Min: 26.320ms ; Max: 102.573ms ; Number of samples: 8) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 12.00 - BytesRead: 29.86 MB (31314385) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 8.247ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 0 (0) - NumRowGroups: 8 (8) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 43.06 MB (45154422) - PerReadThreadRawHdfsThroughput: 46.95 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 1.58M (1576960) - RowsReturned: 1.46M (1456128) - RowsReturnedRate: 1.80 M/sec - ScanRangesComplete: 150 (150) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 636.066ms - TotalReadThroughput: 48.01 KB/sec Filter 2 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 3 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 4 (1.00 MB): - Files processed: 158 (158) - Files rejected: 150 (150) - Files total: 158 (158) - RowGroups processed: 1.54K (1540) - RowGroups rejected: 0 (0) - RowGroups total: 1.54K (1540) - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) - Splits processed: 8 (8) - Splits rejected: 0 (0) - Splits total: 8 (8) Instance 7f40dcb034de70b7:1c3 (host=ve1138.foo:22000):(Total: 1s075ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:17/3.95 GB 7:19/4.10 GB 2:18/4.25 GB 5:20/4.93 GB 3:21/5.09 GB 1:23/5.22 GB 4:22/5.18 GB 6:17/3.71 GB Filter 4 arrival: 327ms Filter 2 arrival: 7s305ms Filter 3 arrival: 9m23s MemoryUsage(16s000ms): 30.20 MB, 38.98 MB, 38.98 MB, 38.98 MB, 38.98 MB, 38.98 MB, 38.98 MB, 38.98 MB, 38.98 MB, 38.98 MB, 38.98 MB, 38.98 MB, 38.98 MB, 38.98 MB, 38.98 MB, 38.98 MB, 38.98 MB, 38.98 MB, 38.98 MB, 38.98 MB, 38.98 MB, 38.98 MB, 38.98 MB, 38.98 MB, 38.98 MB, 38.98 MB, 38.98 MB, 38.98 MB, 38.98 MB, 38.98 MB, 38.98 MB, 38.98 MB, 38.98 MB, 38.98 MB, 38.98 MB, 38.98 MB, 38.98 MB, 38.98 MB, 38.98 MB ThreadUsage(16s000ms): 12, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.98 - BloomFilterBytes: 17.00 MB (17825792) - PeakMemoryUsage: 38.98 MB (40875988) - PerHostPeakMemUsage: 169.54 GB (182045058641) - RowsProduced: 1.26M (1261568) - TotalNetworkReceiveTime: 87.127ms - TotalNetworkSendTime: 429.246us - TotalStorageWaitTime: 608.634ms - TotalThreadsInvoluntaryContextSwitches: 31 (31) - TotalThreadsTotalWallClockTime: 1s121ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 201.969ms - TotalThreadsVoluntaryContextSwitches: 60 (60) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 102.839ms - OpenTime: 1s034ms - ExecTreeOpenTime: 832.032ms - PrepareTime: 41.241ms - ExecTreePrepareTime: 477.298us DataStreamSender (dst_id=24):(Total: 183.384ms, non-child: 183.384ms, % non-child: 100.00%) - BytesSent: 10.76 MB (11278538) - NetworkThroughput(*): 94.79 MB/sec - OverallThroughput: 58.65 MB/sec - PeakMemoryUsage: 4.73 MB (4962048) - RowsReturned: 1.26M (1260544) - SerializeBatchTime: 69.216ms - TransmitDataRPCTime: 113.477ms - UncompressedRowBatchSize: 34.64 MB (36327656) CodeGen:(Total: 214.825ms, non-child: 214.825ms, % non-child: 100.00%) - CodegenTime: 921.824us - CompileTime: 56.514ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 143.758ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 14.097ms HASH_JOIN_NODE (id=8):(Total: 935.342ms, non-child: 30.028ms, % non-child: 3.21%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.258ms - PeakMemoryUsage: 1.11 MB (1162474) - ProbeRows: 1.26M (1261585) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 26.958ms - RowsReturned: 1.26M (1260561) - RowsReturnedRate: 1.35 M/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 22.706us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 107.399us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 50.213us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=19):(Total: 87.136ms, non-child: 17.494us, % non-child: 0.02%) BytesReceived(16s000ms): 963.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 4.434us - DeserializeRowBatchTimer: 14.600us - FirstBatchArrivalWaitTime: 61.086ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 1.38 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=6):(Total: 818.406ms, non-child: 818.406ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:17/3.95 GB 7:19/4.10 GB 2:18/4.25 GB 5:20/4.93 GB 3:21/5.09 GB 1:23/5.22 GB 4:22/5.18 GB 6:17/3.71 GB ExecOption: PARQUET Codegen Enabled Runtime filters: Only following filters arrived: 4, waited 704ms BytesRead(16s000ms): 12.16 MB, 13.21 MB, 13.21 MB, 13.21 MB, 13.21 MB, 13.21 MB, 13.21 MB, 13.21 MB, 13.21 MB, 13.21 MB, 13.21 MB, 13.21 MB, 13.21 MB, 13.21 MB, 13.21 MB, 13.21 MB, 13.21 MB, 13.21 MB, 13.21 MB, 13.21 MB, 13.21 MB, 13.21 MB, 13.21 MB, 13.21 MB, 13.21 MB, 13.21 MB, 13.21 MB, 13.21 MB, 13.21 MB, 13.21 MB, 13.21 MB, 13.21 MB, 13.21 MB, 13.21 MB, 13.21 MB, 13.21 MB, 13.21 MB, 13.21 MB, 13.21 MB - FooterProcessingTime: (Avg: 50.565ms ; Min: 34.463ms ; Max: 66.694ms ; Number of samples: 5) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 11.99 - BytesRead: 13.21 MB (13853526) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 8.308ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 0 (0) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 17.00 MB (17826410) - PerReadThreadRawHdfsThroughput: 43.21 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 1.38M (1378321) - RowsReturned: 1.26M (1261585) - RowsReturnedRate: 1.54 M/sec - ScanRangesComplete: 153 (153) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 6.492ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 305.729ms - TotalReadThroughput: 21.25 KB/sec Filter 2 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 89.11K (89105) Filter 3 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 89.11K (89105) Filter 4 (1.00 MB): - Files processed: 157 (157) - Files rejected: 152 (152) - Files total: 157 (157) - RowGroups processed: 1.35K (1347) - RowGroups rejected: 0 (0) - RowGroups total: 1.35K (1347) - Rows processed: 16.38K (16384) - Rows rejected: 0 (0) - Rows total: 89.11K (89105) - Splits processed: 5 (5) - Splits rejected: 0 (0) - Splits total: 5 (5) Instance 7f40dcb034de70b7:17f (host=vd1114.foo:22000):(Total: 1s068ms, non-child: 70.703ms, % non-child: 6.62%) Hdfs split stats (:<# splits>/): 7:2/284.57 MB 5:1/252.52 MB 3:2/504.82 MB 0:1/252.52 MB 6:2/505.13 MB 2:1/252.53 MB 4:1/252.69 MB Filter 4 arrival: 577ms MemoryUsage(500.000ms): 1.58 MB, 3.59 MB ThreadUsage(500.000ms): 2, 1 - AverageThreadTokens: 1.50 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 3.59 MB (3768447) - PerHostPeakMemUsage: 209.60 MB (219778891) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 356.443ms - TotalNetworkSendTime: 66.189us - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 31 (31) - TotalThreadsTotalWallClockTime: 1s381ms - TotalThreadsSysTime: 10.998ms - TotalThreadsUserTime: 185.971ms - TotalThreadsVoluntaryContextSwitches: 293 (293) Fragment Instance Lifecycle Timings: - ExecTime: 43.667ms - ExecTreeExecTime: 43.451us - OpenTime: 980.038ms - ExecTreeOpenTime: 801.222ms - PrepareTime: 45.008ms - ExecTreePrepareTime: 152.550us DataStreamSender (dst_id=24):(Total: 548.913us, non-child: 548.913us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.52 MB (1595136) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 195.976ms, non-child: 195.976ms, % non-child: 100.00%) - CodegenTime: 983.552us - CompileTime: 52.281ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 85 (85) - NumInstructions: 2.89K (2893) - OptimizationTime: 124.873ms - PeakMemoryUsage: 1.41 MB (1481216) - PrepareTime: 18.430ms HASH_JOIN_NODE (id=8):(Total: 801.539ms, non-child: 1.972ms, % non-child: 0.25%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 120 (120) - BuildTime: 1.488ms - PeakMemoryUsage: 1.05 MB (1095936) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1.014us - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 24.226us - BuildRowsPartitioned: 120 (120) - GetNewBlockTime: 147.698us - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 55.129us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1070208) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=19):(Total: 356.453ms, non-child: 18.684us, % non-child: 0.01%) BytesReceived(500.000ms): 0, 995.00 B - BytesReceived: 995.00 B (995) - ConvertRowBatchTime: 4.276us - DeserializeRowBatchTimer: 17.577us - FirstBatchArrivalWaitTime: 341.640ms - PeakMemoryUsage: 0 - RowsReturned: 120 (120) - RowsReturnedRate: 336.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=6):(Total: 443.156ms, non-child: 443.156ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:2/284.57 MB 5:1/252.52 MB 3:2/504.82 MB 0:1/252.52 MB 6:2/505.13 MB 2:1/252.53 MB 4:1/252.69 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 0 out of 0 Runtime filters: Only following filters arrived: 4, waited 442ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:10 BytesRead(500.000ms): 0, 0 - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 0 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 0 (0) - NumScannerThreadsStarted: 0 (0) - PeakMemoryUsage: 4.00 KB (4096) - PerReadThreadRawHdfsThroughput: 0.00 /sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - ScanRangesComplete: 10 (10) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 0.000ns - TotalReadThroughput: 0.00 /sec Filter 2 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 3 (16.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Filter 4 (1.00 MB): - Files processed: 10 (10) - Files rejected: 10 (10) - Files total: 10 (10) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Averaged Fragment F02:(Total: 132.863ms, non-child: 52.128ms, % non-child: 39.23%) split sizes: min: 2.15 MB, max: 2.15 MB, avg: 2.15 MB, stddev: 0 completion times: min:146.521ms max:146.521ms mean: 146.521ms stddev:0.000ns execution rates: min:14.67 MB/sec max:14.67 MB/sec mean:14.67 MB/sec stddev:0.00 /sec num instances: 1 - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.44 MB (3602820) - PerHostPeakMemUsage: 70.13 MB (73540808) - RowsProduced: 120 (120) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 77.591us - TotalStorageWaitTime: 13.300ms - TotalThreadsInvoluntaryContextSwitches: 8 (8) - TotalThreadsTotalWallClockTime: 97.017ms - TotalThreadsSysTime: 7.999ms - TotalThreadsUserTime: 34.995ms - TotalThreadsVoluntaryContextSwitches: 318 (318) Fragment Instance Lifecycle Timings: - ExecTime: 51.335ms - ExecTreeExecTime: 20.778ms - OpenTime: 25.292ms - ExecTreeOpenTime: 61.331us - PrepareTime: 56.190ms - ExecTreePrepareTime: 194.171us DataStreamSender (dst_id=19):(Total: 1.546ms, non-child: 1.546ms, % non-child: 100.00%) - BytesSent: 130.21 KB (133330) - NetworkThroughput(*): 185.21 MB/sec - OverallThroughput: 82.20 MB/sec - PeakMemoryUsage: 1.29 MB (1350720) - RowsReturned: 120 (120) - SerializeBatchTime: 11.374us - TransmitDataRPCTime: 686.540us - UncompressedRowBatchSize: 267.48 KB (273896) CodeGen:(Total: 57.887ms, non-child: 57.887ms, % non-child: 100.00%) - CodegenTime: 1.475ms - CompileTime: 7.741ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 17 (17) - NumInstructions: 310 (310) - OptimizationTime: 16.449ms - PeakMemoryUsage: 155.00 KB (158720) - PrepareTime: 33.137ms HDFS_SCAN_NODE (id=7):(Total: 21.300ms, non-child: 21.300ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 465.57 KB (476741) - BytesReadDataNodeCache: 0 - BytesReadLocal: 465.57 KB (476741) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 465.57 KB (476741) - DecompressionTime: 395.362us - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 2.14 MB (2243261) - PerReadThreadRawHdfsThroughput: 314.51 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 20.177ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 73.05K (73049) - RowsReturned: 120 (120) - RowsReturnedRate: 5.63 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 2 (2) - ScannerThreadsTotalWallClockTime: 20.638ms - MaterializeTupleTime(*): 4.377ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 5.999ms - ScannerThreadsVoluntaryContextSwitches: 11 (11) - TotalRawHdfsReadTime(*): 1.445ms - TotalReadThroughput: 0.00 /sec Fragment F02: Instance 7f40dcb034de70b7:17d (host=va1045.foo:22000):(Total: 132.863ms, non-child: 52.128ms, % non-child: 39.23%) Hdfs split stats (:<# splits>/): 0:1/2.15 MB - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.44 MB (3602820) - PerHostPeakMemUsage: 70.13 MB (73540808) - RowsProduced: 120 (120) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 77.591us - TotalStorageWaitTime: 13.300ms - TotalThreadsInvoluntaryContextSwitches: 8 (8) - TotalThreadsTotalWallClockTime: 97.017ms - TotalThreadsSysTime: 7.999ms - TotalThreadsUserTime: 34.995ms - TotalThreadsVoluntaryContextSwitches: 318 (318) Fragment Instance Lifecycle Timings: - ExecTime: 51.335ms - ExecTreeExecTime: 20.778ms - OpenTime: 25.292ms - ExecTreeOpenTime: 61.331us - PrepareTime: 56.190ms - ExecTreePrepareTime: 194.171us DataStreamSender (dst_id=19):(Total: 1.546ms, non-child: 1.546ms, % non-child: 100.00%) - BytesSent: 130.21 KB (133330) - NetworkThroughput(*): 185.21 MB/sec - OverallThroughput: 82.20 MB/sec - PeakMemoryUsage: 1.29 MB (1350720) - RowsReturned: 120 (120) - SerializeBatchTime: 11.374us - TransmitDataRPCTime: 686.540us - UncompressedRowBatchSize: 267.48 KB (273896) CodeGen:(Total: 57.887ms, non-child: 57.887ms, % non-child: 100.00%) - CodegenTime: 1.475ms - CompileTime: 7.741ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 17 (17) - NumInstructions: 310 (310) - OptimizationTime: 16.449ms - PeakMemoryUsage: 155.00 KB (158720) - PrepareTime: 33.137ms HDFS_SCAN_NODE (id=7):(Total: 21.300ms, non-child: 21.300ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/2.15 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:3 - FooterProcessingTime: (Avg: 3.557ms ; Min: 3.557ms ; Max: 3.557ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 465.57 KB (476741) - BytesReadDataNodeCache: 0 - BytesReadLocal: 465.57 KB (476741) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 465.57 KB (476741) - DecompressionTime: 395.362us - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 2.14 MB (2243261) - PerReadThreadRawHdfsThroughput: 314.51 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 20.177ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 73.05K (73049) - RowsReturned: 120 (120) - RowsReturnedRate: 5.63 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 2 (2) - ScannerThreadsTotalWallClockTime: 20.638ms - MaterializeTupleTime(*): 4.377ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 5.999ms - ScannerThreadsVoluntaryContextSwitches: 11 (11) - TotalRawHdfsReadTime(*): 1.445ms - TotalReadThroughput: 0.00 /sec Averaged Fragment F08:(Total: 2s202ms, non-child: 974.745ms, % non-child: 44.26%) split sizes: min: 36.94 MB, max: 78.98 MB, avg: 45.39 MB, stddev: 14.12 MB completion times: min:1s337ms max:3s305ms mean: 2s204ms stddev:699.879ms execution rates: min:11.49 MB/sec max:53.66 MB/sec mean:22.64 MB/sec stddev:9.14 MB/sec num instances: 113 - AverageThreadTokens: 1.90 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 26.29 MB (27570147) - PerHostPeakMemUsage: 614.09 MB (643917839) - RowsProduced: 544.61K (544608) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 913.650ms - TotalStorageWaitTime: 138.370ms - TotalThreadsInvoluntaryContextSwitches: 48 (48) - TotalThreadsTotalWallClockTime: 4s160ms - TotalThreadsSysTime: 28.260ms - TotalThreadsUserTime: 187.608ms - TotalThreadsVoluntaryContextSwitches: 775 (775) Fragment Instance Lifecycle Timings: - ExecTime: 2s125ms - ExecTreeExecTime: 1s076ms - OpenTime: 23.332ms - ExecTreeOpenTime: 45.143us - PrepareTime: 53.844ms - ExecTreePrepareTime: 92.160us DataStreamSender (dst_id=25):(Total: 103.665ms, non-child: 103.665ms, % non-child: 100.00%) - BytesSent: 8.70 MB (9122313) - NetworkThroughput(*): 168.54 MB/sec - OverallThroughput: 81.50 MB/sec - PeakMemoryUsage: 4.87 MB (5105338) - RowsReturned: 544.61K (544608) - SerializeBatchTime: 52.004ms - TransmitDataRPCTime: 50.332ms - UncompressedRowBatchSize: 8.83 MB (9260258) CodeGen:(Total: 47.530ms, non-child: 47.530ms, % non-child: 100.00%) - CodegenTime: 1.114ms - CompileTime: 5.946ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 15.882ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 25.140ms HDFS_SCAN_NODE (id=0):(Total: 1s076ms, non-child: 1s076ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.05 - AverageScannerThreadConcurrency: 0.99 - BytesRead: 10.46 MB (10966551) - BytesReadDataNodeCache: 0 - BytesReadLocal: 10.46 MB (10966551) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 10.46 MB (10966551) - DecompressionTime: 7.688ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 21.41 MB (22454237) - PerReadThreadRawHdfsThroughput: 105.69 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 141.137ms - RowBatchQueuePutWaitTime: 981.779ms - RowsRead: 884.96K (884955) - RowsReturned: 544.61K (544608) - RowsReturnedRate: 513.40 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 12 (12) - ScannerThreadsTotalWallClockTime: 2s012ms - MaterializeTupleTime(*): 49.490ms - ScannerThreadsSysTime: 9.449ms - ScannerThreadsUserTime: 55.283ms - ScannerThreadsVoluntaryContextSwitches: 325 (325) - TotalRawHdfsReadTime(*): 102.071ms - TotalReadThroughput: 3.57 MB/sec Filter 1 (1.00 MB): - Rows processed: 343.70K (343704) - Rows rejected: 340.35K (340347) - Rows total: 884.96K (884955) Fragment F08: Instance 7f40dcb034de70b7:22e (host=vd1329.foo:22000):(Total: 3s288ms, non-child: 1s979ms, % non-child: 60.20%) Hdfs split stats (:<# splits>/): 1:1/37.96 MB Filter 1 arrival: 1s304ms MemoryUsage(500.000ms): 1.30 MB, 1.30 MB, 16.34 MB, 16.34 MB, 16.34 MB, 16.34 MB ThreadUsage(500.000ms): 2, 2, 1, 1, 1, 1 - AverageThreadTokens: 1.33 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 28.35 MB (29731830) - PerHostPeakMemUsage: 781.93 MB (819914078) - RowsProduced: 331.72K (331719) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1s923ms - TotalStorageWaitTime: 131.292ms - TotalThreadsInvoluntaryContextSwitches: 37 (37) - TotalThreadsTotalWallClockTime: 4s464ms - TotalThreadsSysTime: 26.996ms - TotalThreadsUserTime: 151.976ms - TotalThreadsVoluntaryContextSwitches: 588 (588) Fragment Instance Lifecycle Timings: - ExecTime: 3s206ms - ExecTreeExecTime: 1s172ms - OpenTime: 20.772ms - ExecTreeOpenTime: 36.452us - PrepareTime: 61.625ms - ExecTreePrepareTime: 92.654us DataStreamSender (dst_id=25):(Total: 78.344ms, non-child: 78.344ms, % non-child: 100.00%) - BytesSent: 5.29 MB (5550589) - NetworkThroughput(*): 159.33 MB/sec - OverallThroughput: 67.57 MB/sec - PeakMemoryUsage: 4.95 MB (5192768) - RowsReturned: 331.72K (331719) - SerializeBatchTime: 44.299ms - TransmitDataRPCTime: 33.224ms - UncompressedRowBatchSize: 5.38 MB (5640411) CodeGen:(Total: 57.701ms, non-child: 57.701ms, % non-child: 100.00%) - CodegenTime: 1.364ms - CompileTime: 6.351ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 13.373ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 37.038ms HDFS_SCAN_NODE (id=0):(Total: 1s172ms, non-child: 1s172ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:1/37.96 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: Only following filters arrived: , waited 924ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:3 BytesRead(500.000ms): 0, 0, 8.75 MB, 8.75 MB, 8.75 MB, 8.75 MB - FooterProcessingTime: (Avg: 55.557ms ; Min: 55.557ms ; Max: 55.557ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.33 - BytesRead: 8.75 MB (9177802) - BytesReadDataNodeCache: 0 - BytesReadLocal: 8.75 MB (9177802) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 8.75 MB (9177802) - DecompressionTime: 7.816ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 22.50 MB (23591227) - PerReadThreadRawHdfsThroughput: 127.07 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 247.482ms - RowBatchQueuePutWaitTime: 26.356ms - RowsRead: 740.00K (740000) - RowsReturned: 331.72K (331719) - RowsReturnedRate: 282.85 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 9 (9) - ScannerThreadsTotalWallClockTime: 1s238ms - MaterializeTupleTime(*): 47.342ms - ScannerThreadsSysTime: 10.998ms - ScannerThreadsUserTime: 49.992ms - ScannerThreadsVoluntaryContextSwitches: 144 (144) - TotalRawHdfsReadTime(*): 68.881ms - TotalReadThroughput: 2.92 MB/sec Filter 1 (1.00 MB): - Rows processed: 412.32K (412320) - Rows rejected: 408.28K (408281) - Rows total: 740.00K (740000) Instance 7f40dcb034de70b7:268 (host=vd1140.foo:22000):(Total: 3s279ms, non-child: 1s997ms, % non-child: 60.89%) Hdfs split stats (:<# splits>/): 1:1/38.99 MB Filter 1 arrival: 1s362ms MemoryUsage(500.000ms): 1.30 MB, 1.30 MB, 18.69 MB, 19.69 MB, 19.69 MB, 19.69 MB ThreadUsage(500.000ms): 1, 2, 2, 2, 2, 2 - AverageThreadTokens: 1.83 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 25.75 MB (27004225) - PerHostPeakMemUsage: 783.71 MB (821781237) - RowsProduced: 460.65K (460653) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1s920ms - TotalStorageWaitTime: 92.510ms - TotalThreadsInvoluntaryContextSwitches: 40 (40) - TotalThreadsTotalWallClockTime: 5s711ms - TotalThreadsSysTime: 22.995ms - TotalThreadsUserTime: 179.972ms - TotalThreadsVoluntaryContextSwitches: 708 (708) Fragment Instance Lifecycle Timings: - ExecTime: 3s198ms - ExecTreeExecTime: 1s143ms - OpenTime: 23.689ms - ExecTreeOpenTime: 27.909us - PrepareTime: 57.155ms - ExecTreePrepareTime: 107.795us DataStreamSender (dst_id=25):(Total: 90.945ms, non-child: 90.945ms, % non-child: 100.00%) - BytesSent: 7.36 MB (7714988) - NetworkThroughput(*): 175.63 MB/sec - OverallThroughput: 80.90 MB/sec - PeakMemoryUsage: 4.95 MB (5192768) - RowsReturned: 460.65K (460653) - SerializeBatchTime: 46.966ms - TransmitDataRPCTime: 41.892ms - UncompressedRowBatchSize: 7.47 MB (7832709) CodeGen:(Total: 47.772ms, non-child: 47.772ms, % non-child: 100.00%) - CodegenTime: 1.161ms - CompileTime: 6.367ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 15.879ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 24.979ms HDFS_SCAN_NODE (id=0):(Total: 1s143ms, non-child: 1s143ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:1/38.99 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: Only following filters arrived: , waited 924ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:3 BytesRead(500.000ms): 0, 0, 8.98 MB, 8.98 MB, 8.98 MB, 8.98 MB - FooterProcessingTime: (Avg: 3.236ms ; Min: 3.236ms ; Max: 3.236ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.83 - BytesRead: 8.98 MB (9417408) - BytesReadDataNodeCache: 0 - BytesReadLocal: 8.98 MB (9417408) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 8.98 MB (9417408) - DecompressionTime: 6.428ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 20.20 MB (21183110) - PerReadThreadRawHdfsThroughput: 108.25 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 218.106ms - RowBatchQueuePutWaitTime: 1s897ms - RowsRead: 760.00K (760000) - RowsReturned: 460.65K (460653) - RowsReturnedRate: 402.71 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 10 (10) - ScannerThreadsTotalWallClockTime: 2s489ms - MaterializeTupleTime(*): 38.860ms - ScannerThreadsSysTime: 6.998ms - ScannerThreadsUserTime: 43.993ms - ScannerThreadsVoluntaryContextSwitches: 271 (271) - TotalRawHdfsReadTime(*): 82.964ms - TotalReadThroughput: 2.99 MB/sec Filter 1 (1.00 MB): - Rows processed: 302.27K (302272) - Rows rejected: 299.35K (299347) - Rows total: 760.00K (760000) Instance 7f40dcb034de70b7:263 (host=vc1540.foo:22000):(Total: 3s250ms, non-child: 1s955ms, % non-child: 60.17%) Hdfs split stats (:<# splits>/): 1:1/38.97 MB Filter 1 arrival: 1s361ms MemoryUsage(500.000ms): 1.30 MB, 1.30 MB, 21.07 MB, 19.80 MB, 19.80 MB, 19.80 MB, 2.82 MB ThreadUsage(500.000ms): 2, 2, 2, 2, 2, 2, 1 - AverageThreadTokens: 1.86 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 21.44 MB (22480578) - PerHostPeakMemUsage: 787.09 MB (825327620) - RowsProduced: 627.99K (627985) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1s911ms - TotalStorageWaitTime: 109.170ms - TotalThreadsInvoluntaryContextSwitches: 55 (55) - TotalThreadsTotalWallClockTime: 6s208ms - TotalThreadsSysTime: 24.996ms - TotalThreadsUserTime: 209.968ms - TotalThreadsVoluntaryContextSwitches: 731 (731) Fragment Instance Lifecycle Timings: - ExecTime: 3s189ms - ExecTreeExecTime: 1s131ms - OpenTime: 28.862ms - ExecTreeOpenTime: 35.582us - PrepareTime: 31.872ms - ExecTreePrepareTime: 51.987us DataStreamSender (dst_id=25):(Total: 117.118ms, non-child: 117.118ms, % non-child: 100.00%) - BytesSent: 10.03 MB (10517369) - NetworkThroughput(*): 180.02 MB/sec - OverallThroughput: 85.64 MB/sec - PeakMemoryUsage: 4.95 MB (5192768) - RowsReturned: 627.99K (627985) - SerializeBatchTime: 60.654ms - TransmitDataRPCTime: 55.717ms - UncompressedRowBatchSize: 10.18 MB (10677889) CodeGen:(Total: 46.419ms, non-child: 46.419ms, % non-child: 100.00%) - CodegenTime: 1.441ms - CompileTime: 7.471ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 20.042ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 18.377ms HDFS_SCAN_NODE (id=0):(Total: 1s131ms, non-child: 1s131ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:1/38.97 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: Only following filters arrived: , waited 943ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:3 BytesRead(500.000ms): 0, 0, 8.98 MB, 8.98 MB, 8.98 MB, 8.98 MB - FooterProcessingTime: (Avg: 6.854ms ; Min: 6.854ms ; Max: 6.854ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 8.98 MB (9416469) - BytesReadDataNodeCache: 0 - BytesReadLocal: 8.98 MB (9416469) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 8.98 MB (9416469) - DecompressionTime: 7.677ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 17.09 MB (17918951) - PerReadThreadRawHdfsThroughput: 131.85 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 184.833ms - RowBatchQueuePutWaitTime: 1s901ms - RowsRead: 760.00K (760000) - RowsReturned: 627.99K (627985) - RowsReturnedRate: 555.21 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 18 (18) - ScannerThreadsTotalWallClockTime: 2s990ms - MaterializeTupleTime(*): 49.404ms - ScannerThreadsSysTime: 8.998ms - ScannerThreadsUserTime: 55.991ms - ScannerThreadsVoluntaryContextSwitches: 265 (265) - TotalRawHdfsReadTime(*): 68.108ms - TotalReadThroughput: 2.99 MB/sec Filter 1 (1.00 MB): - Rows processed: 133.31K (133312) - Rows rejected: 132.01K (132015) - Rows total: 760.00K (760000) Instance 7f40dcb034de70b7:26f (host=vc1504.foo:22000):(Total: 3s248ms, non-child: 1s943ms, % non-child: 59.83%) Hdfs split stats (:<# splits>/): 4:1/38.97 MB Filter 1 arrival: 1s372ms MemoryUsage(500.000ms): 0, 1.30 MB, 1.30 MB, 20.60 MB, 20.60 MB, 20.60 MB, 20.60 MB ThreadUsage(500.000ms): 1, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 1.86 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 22.39 MB (23477239) - PerHostPeakMemUsage: 759.21 MB (796087880) - RowsProduced: 455.72K (455724) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1s892ms - TotalStorageWaitTime: 81.148ms - TotalThreadsInvoluntaryContextSwitches: 59 (59) - TotalThreadsTotalWallClockTime: 6s249ms - TotalThreadsSysTime: 32.995ms - TotalThreadsUserTime: 164.975ms - TotalThreadsVoluntaryContextSwitches: 593 (593) Fragment Instance Lifecycle Timings: - ExecTime: 3s174ms - ExecTreeExecTime: 1s169ms - OpenTime: 21.544ms - ExecTreeOpenTime: 29.932us - PrepareTime: 52.992ms - ExecTreePrepareTime: 75.287us DataStreamSender (dst_id=25):(Total: 94.277ms, non-child: 94.277ms, % non-child: 100.00%) - BytesSent: 7.28 MB (7632832) - NetworkThroughput(*): 169.61 MB/sec - OverallThroughput: 77.21 MB/sec - PeakMemoryUsage: 4.95 MB (5192768) - RowsReturned: 455.72K (455724) - SerializeBatchTime: 49.884ms - TransmitDataRPCTime: 42.916ms - UncompressedRowBatchSize: 7.39 MB (7748916) CodeGen:(Total: 41.275ms, non-child: 41.275ms, % non-child: 100.00%) - CodegenTime: 1.056ms - CompileTime: 5.547ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 14.899ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 20.241ms HDFS_SCAN_NODE (id=0):(Total: 1s169ms, non-child: 1s169ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:1/38.97 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: Only following filters arrived: , waited 943ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:3 BytesRead(500.000ms): 0, 0, 0, 8.98 MB, 8.98 MB, 8.98 MB, 8.98 MB - FooterProcessingTime: (Avg: 3.691ms ; Min: 3.691ms ; Max: 3.691ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 8.98 MB (9416309) - BytesReadDataNodeCache: 0 - BytesReadLocal: 8.98 MB (9416309) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 8.98 MB (9416309) - DecompressionTime: 7.333ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 17.44 MB (18290636) - PerReadThreadRawHdfsThroughput: 127.22 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 222.984ms - RowBatchQueuePutWaitTime: 1s843ms - RowsRead: 760.00K (760000) - RowsReturned: 455.72K (455724) - RowsReturnedRate: 389.74 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 11 (11) - ScannerThreadsTotalWallClockTime: 3s053ms - MaterializeTupleTime(*): 55.697ms - ScannerThreadsSysTime: 10.998ms - ScannerThreadsUserTime: 57.991ms - ScannerThreadsVoluntaryContextSwitches: 138 (138) - TotalRawHdfsReadTime(*): 70.586ms - TotalReadThroughput: 2.57 MB/sec Filter 1 (1.00 MB): - Rows processed: 307.39K (307392) - Rows rejected: 304.28K (304276) - Rows total: 760.00K (760000) Instance 7f40dcb034de70b7:239 (host=vd1328.foo:22000):(Total: 3s242ms, non-child: 1s991ms, % non-child: 61.41%) Hdfs split stats (:<# splits>/): 0:1/40.00 MB Filter 1 arrival: 1s316ms MemoryUsage(500.000ms): 1.30 MB, 1.30 MB, 9.54 MB, 19.66 MB, 19.66 MB, 19.66 MB, 19.66 MB ThreadUsage(500.000ms): 1, 1, 2, 2, 2, 2, 2 - AverageThreadTokens: 1.71 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 22.24 MB (23319724) - PerHostPeakMemUsage: 837.61 MB (878293888) - RowsProduced: 631.24K (631239) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1s935ms - TotalStorageWaitTime: 133.378ms - TotalThreadsInvoluntaryContextSwitches: 55 (55) - TotalThreadsTotalWallClockTime: 5s647ms - TotalThreadsSysTime: 15.997ms - TotalThreadsUserTime: 202.968ms - TotalThreadsVoluntaryContextSwitches: 820 (820) Fragment Instance Lifecycle Timings: - ExecTime: 3s168ms - ExecTreeExecTime: 1s082ms - OpenTime: 20.155ms - ExecTreeOpenTime: 26.904us - PrepareTime: 54.143ms - ExecTreePrepareTime: 86.205us DataStreamSender (dst_id=25):(Total: 118.689ms, non-child: 118.689ms, % non-child: 100.00%) - BytesSent: 10.09 MB (10579513) - NetworkThroughput(*): 173.92 MB/sec - OverallThroughput: 85.01 MB/sec - PeakMemoryUsage: 4.95 MB (5192768) - RowsReturned: 631.24K (631239) - SerializeBatchTime: 58.498ms - TransmitDataRPCTime: 58.011ms - UncompressedRowBatchSize: 10.24 MB (10733207) CodeGen:(Total: 50.052ms, non-child: 50.052ms, % non-child: 100.00%) - CodegenTime: 794.468us - CompileTime: 4.818ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 14.111ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 30.691ms HDFS_SCAN_NODE (id=0):(Total: 1s082ms, non-child: 1s082ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/40.00 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: Only following filters arrived: , waited 944ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:3 BytesRead(500.000ms): 0, 0, 3.15 MB, 9.21 MB, 9.21 MB, 9.21 MB, 9.21 MB - FooterProcessingTime: (Avg: 13.596ms ; Min: 13.596ms ; Max: 13.596ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.71 - BytesRead: 9.21 MB (9655986) - BytesReadDataNodeCache: 0 - BytesReadLocal: 9.21 MB (9655986) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 9.21 MB (9655986) - DecompressionTime: 7.295ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 18.38 MB (19268081) - PerReadThreadRawHdfsThroughput: 89.70 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 136.259ms - RowBatchQueuePutWaitTime: 1s934ms - RowsRead: 780.00K (780000) - RowsReturned: 631.24K (631239) - RowsReturnedRate: 583.08 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 13 (13) - ScannerThreadsTotalWallClockTime: 2s459ms - MaterializeTupleTime(*): 41.337ms - ScannerThreadsSysTime: 1.999ms - ScannerThreadsUserTime: 53.991ms - ScannerThreadsVoluntaryContextSwitches: 366 (366) - TotalRawHdfsReadTime(*): 102.666ms - TotalReadThroughput: 2.63 MB/sec Filter 1 (1.00 MB): - Rows processed: 150.24K (150240) - Rows rejected: 148.76K (148761) - Rows total: 780.00K (780000) Instance 7f40dcb034de70b7:23c (host=ve1139.foo:22000):(Total: 3s215ms, non-child: 1s937ms, % non-child: 60.24%) Hdfs split stats (:<# splits>/): 1:1/39.00 MB Filter 1 arrival: 1s320ms MemoryUsage(500.000ms): 1.30 MB, 1.30 MB, 19.66 MB, 19.66 MB, 19.66 MB, 19.66 MB ThreadUsage(500.000ms): 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 25.06 MB (26281128) - PerHostPeakMemUsage: 785.66 MB (823827364) - RowsProduced: 460.72K (460722) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1s872ms - TotalStorageWaitTime: 93.202ms - TotalThreadsInvoluntaryContextSwitches: 39 (39) - TotalThreadsTotalWallClockTime: 6s145ms - TotalThreadsSysTime: 26.995ms - TotalThreadsUserTime: 162.975ms - TotalThreadsVoluntaryContextSwitches: 720 (720) Fragment Instance Lifecycle Timings: - ExecTime: 3s129ms - ExecTreeExecTime: 1s136ms - OpenTime: 27.810ms - ExecTreeOpenTime: 33.096us - PrepareTime: 58.581ms - ExecTreePrepareTime: 85.470us DataStreamSender (dst_id=25):(Total: 85.761ms, non-child: 85.761ms, % non-child: 100.00%) - BytesSent: 7.35 MB (7711092) - NetworkThroughput(*): 174.97 MB/sec - OverallThroughput: 85.75 MB/sec - PeakMemoryUsage: 4.95 MB (5192768) - RowsReturned: 460.72K (460722) - SerializeBatchTime: 42.652ms - TransmitDataRPCTime: 42.030ms - UncompressedRowBatchSize: 7.47 MB (7833882) CodeGen:(Total: 55.887ms, non-child: 55.887ms, % non-child: 100.00%) - CodegenTime: 2.342ms - CompileTime: 5.469ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 19.593ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 29.443ms HDFS_SCAN_NODE (id=0):(Total: 1s136ms, non-child: 1s136ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:1/39.00 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: Only following filters arrived: , waited 925ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:3 BytesRead(500.000ms): 0, 0, 8.98 MB, 8.98 MB, 8.98 MB, 8.98 MB - FooterProcessingTime: (Avg: 4.160ms ; Min: 4.160ms ; Max: 4.160ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 8.98 MB (9416912) - BytesReadDataNodeCache: 0 - BytesReadLocal: 8.98 MB (9416912) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 8.98 MB (9416912) - DecompressionTime: 6.013ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 19.02 MB (19939813) - PerReadThreadRawHdfsThroughput: 109.77 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 209.775ms - RowBatchQueuePutWaitTime: 1s854ms - RowsRead: 760.00K (760000) - RowsReturned: 460.72K (460722) - RowsReturnedRate: 405.24 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 10 (10) - ScannerThreadsTotalWallClockTime: 2s989ms - MaterializeTupleTime(*): 40.824ms - ScannerThreadsSysTime: 6.998ms - ScannerThreadsUserTime: 45.993ms - ScannerThreadsVoluntaryContextSwitches: 257 (257) - TotalRawHdfsReadTime(*): 81.812ms - TotalReadThroughput: 2.99 MB/sec Filter 1 (1.00 MB): - Rows processed: 302.27K (302272) - Rows rejected: 299.28K (299278) - Rows total: 760.00K (760000) Instance 7f40dcb034de70b7:258 (host=vd1133.foo:22000):(Total: 3s173ms, non-child: 1s920ms, % non-child: 60.53%) Hdfs split stats (:<# splits>/): 3:1/39.99 MB Filter 1 arrival: 1s349ms MemoryUsage(500.000ms): 1.30 MB, 1.30 MB, 9.54 MB, 20.34 MB, 20.34 MB, 20.34 MB, 4.34 MB ThreadUsage(500.000ms): 2, 2, 2, 2, 2, 2, 1 - AverageThreadTokens: 1.86 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 26.04 MB (27300890) - PerHostPeakMemUsage: 774.52 MB (812145234) - RowsProduced: 456.84K (456840) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1s853ms - TotalStorageWaitTime: 157.204ms - TotalThreadsInvoluntaryContextSwitches: 71 (71) - TotalThreadsTotalWallClockTime: 6s095ms - TotalThreadsSysTime: 26.996ms - TotalThreadsUserTime: 192.970ms - TotalThreadsVoluntaryContextSwitches: 743 (743) Fragment Instance Lifecycle Timings: - ExecTime: 3s106ms - ExecTreeExecTime: 1s107ms - OpenTime: 21.704ms - ExecTreeOpenTime: 27.441us - PrepareTime: 45.473ms - ExecTreePrepareTime: 88.650us DataStreamSender (dst_id=25):(Total: 100.423ms, non-child: 100.423ms, % non-child: 100.00%) - BytesSent: 7.30 MB (7649499) - NetworkThroughput(*): 169.54 MB/sec - OverallThroughput: 72.64 MB/sec - PeakMemoryUsage: 4.95 MB (5192768) - RowsReturned: 456.84K (456840) - SerializeBatchTime: 56.554ms - TransmitDataRPCTime: 43.028ms - UncompressedRowBatchSize: 7.41 MB (7767888) CodeGen:(Total: 44.776ms, non-child: 44.776ms, % non-child: 100.00%) - CodegenTime: 1.261ms - CompileTime: 5.488ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 15.046ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 23.603ms HDFS_SCAN_NODE (id=0):(Total: 1s107ms, non-child: 1s107ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:1/39.99 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: Only following filters arrived: , waited 944ms Hdfs Read Thread Concurrency Bucket: 0:83.33% 1:16.67% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:3 BytesRead(500.000ms): 0, 0, 3.15 MB, 9.21 MB, 9.21 MB, 9.21 MB - FooterProcessingTime: (Avg: 10.942ms ; Min: 10.942ms ; Max: 10.942ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.17 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 9.21 MB (9655759) - BytesReadDataNodeCache: 0 - BytesReadLocal: 9.21 MB (9655759) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 9.21 MB (9655759) - DecompressionTime: 7.218ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 20.13 MB (21107617) - PerReadThreadRawHdfsThroughput: 69.20 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 160.479ms - RowBatchQueuePutWaitTime: 1s854ms - RowsRead: 780.00K (780000) - RowsReturned: 456.84K (456840) - RowsReturnedRate: 412.56 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 9 (9) - ScannerThreadsTotalWallClockTime: 2s967ms - MaterializeTupleTime(*): 45.137ms - ScannerThreadsSysTime: 8.998ms - ScannerThreadsUserTime: 49.992ms - ScannerThreadsVoluntaryContextSwitches: 304 (304) - TotalRawHdfsReadTime(*): 133.061ms - TotalReadThroughput: 3.07 MB/sec Filter 1 (1.00 MB): - Rows processed: 326.37K (326368) - Rows rejected: 323.16K (323160) - Rows total: 780.00K (780000) Instance 7f40dcb034de70b7:271 (host=vd1109.foo:22000):(Total: 3s161ms, non-child: 1s914ms, % non-child: 60.54%) Hdfs split stats (:<# splits>/): 1:1/38.98 MB Filter 1 arrival: 1s377ms MemoryUsage(500.000ms): 1.30 MB, 1.30 MB, 19.97 MB, 19.97 MB, 19.97 MB, 19.97 MB ThreadUsage(500.000ms): 1, 2, 2, 2, 2, 2 - AverageThreadTokens: 1.83 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 23.67 MB (24823884) - PerHostPeakMemUsage: 764.16 MB (801275591) - RowsProduced: 457.68K (457684) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1s856ms - TotalStorageWaitTime: 92.005ms - TotalThreadsInvoluntaryContextSwitches: 41 (41) - TotalThreadsTotalWallClockTime: 5s482ms - TotalThreadsSysTime: 29.995ms - TotalThreadsUserTime: 187.971ms - TotalThreadsVoluntaryContextSwitches: 578 (578) Fragment Instance Lifecycle Timings: - ExecTime: 3s065ms - ExecTreeExecTime: 1s083ms - OpenTime: 30.546ms - ExecTreeOpenTime: 28.529us - PrepareTime: 65.152ms - ExecTreePrepareTime: 121.126us DataStreamSender (dst_id=25):(Total: 94.994ms, non-child: 94.994ms, % non-child: 100.00%) - BytesSent: 7.31 MB (7663520) - NetworkThroughput(*): 162.54 MB/sec - OverallThroughput: 76.94 MB/sec - PeakMemoryUsage: 4.95 MB (5192768) - RowsReturned: 457.68K (457684) - SerializeBatchTime: 47.906ms - TransmitDataRPCTime: 44.965ms - UncompressedRowBatchSize: 7.42 MB (7782236) CodeGen:(Total: 68.791ms, non-child: 68.791ms, % non-child: 100.00%) - CodegenTime: 1.191ms - CompileTime: 5.090ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 24.003ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 39.048ms HDFS_SCAN_NODE (id=0):(Total: 1s083ms, non-child: 1s083ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:1/38.98 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: Only following filters arrived: , waited 923ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:3 BytesRead(500.000ms): 0, 0, 8.98 MB, 8.98 MB, 8.98 MB, 8.98 MB - FooterProcessingTime: (Avg: 6.401ms ; Min: 6.401ms ; Max: 6.401ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.83 - BytesRead: 8.98 MB (9417079) - BytesReadDataNodeCache: 0 - BytesReadLocal: 8.98 MB (9417079) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 8.98 MB (9417079) - DecompressionTime: 7.341ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 17.75 MB (18608168) - PerReadThreadRawHdfsThroughput: 114.86 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 157.625ms - RowBatchQueuePutWaitTime: 1s830ms - RowsRead: 760.00K (760000) - RowsReturned: 457.68K (457684) - RowsReturnedRate: 422.35 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 8 (8) - ScannerThreadsTotalWallClockTime: 2s386ms - MaterializeTupleTime(*): 52.000ms - ScannerThreadsSysTime: 9.998ms - ScannerThreadsUserTime: 56.991ms - ScannerThreadsVoluntaryContextSwitches: 153 (153) - TotalRawHdfsReadTime(*): 78.186ms - TotalReadThroughput: 2.99 MB/sec Filter 1 (1.00 MB): - Rows processed: 305.34K (305344) - Rows rejected: 302.32K (302316) - Rows total: 760.00K (760000) Instance 7f40dcb034de70b7:262 (host=vc1501.foo:22000):(Total: 3s136ms, non-child: 1s901ms, % non-child: 60.62%) Hdfs split stats (:<# splits>/): 5:1/40.00 MB Filter 1 arrival: 1s359ms MemoryUsage(500.000ms): 1.30 MB, 1.30 MB, 5.32 MB, 20.86 MB, 20.86 MB, 20.86 MB, 4.47 MB ThreadUsage(500.000ms): 1, 2, 2, 2, 2, 2, 1 - AverageThreadTokens: 1.71 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 24.75 MB (25951568) - PerHostPeakMemUsage: 794.88 MB (833491129) - RowsProduced: 453.73K (453729) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1s833ms - TotalStorageWaitTime: 127.221ms - TotalThreadsInvoluntaryContextSwitches: 38 (38) - TotalThreadsTotalWallClockTime: 6s056ms - TotalThreadsSysTime: 23.995ms - TotalThreadsUserTime: 172.973ms - TotalThreadsVoluntaryContextSwitches: 695 (695) Fragment Instance Lifecycle Timings: - ExecTime: 3s066ms - ExecTreeExecTime: 1s114ms - OpenTime: 21.774ms - ExecTreeOpenTime: 23.472us - PrepareTime: 48.788ms - ExecTreePrepareTime: 76.691us DataStreamSender (dst_id=25):(Total: 78.946ms, non-child: 78.946ms, % non-child: 100.00%) - BytesSent: 7.25 MB (7597402) - NetworkThroughput(*): 212.46 MB/sec - OverallThroughput: 91.78 MB/sec - PeakMemoryUsage: 4.95 MB (5192768) - RowsReturned: 453.73K (453729) - SerializeBatchTime: 43.721ms - TransmitDataRPCTime: 34.103ms - UncompressedRowBatchSize: 7.36 MB (7715001) CodeGen:(Total: 41.531ms, non-child: 41.531ms, % non-child: 100.00%) - CodegenTime: 1.324ms - CompileTime: 5.099ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 15.285ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 20.550ms HDFS_SCAN_NODE (id=0):(Total: 1s114ms, non-child: 1s114ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:1/40.00 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: Only following filters arrived: , waited 944ms Hdfs Read Thread Concurrency Bucket: 0:83.33% 1:16.67% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:3 BytesRead(500.000ms): 0, 0, 100.00 KB, 9.21 MB, 9.21 MB, 9.21 MB - FooterProcessingTime: (Avg: 4.134ms ; Min: 4.134ms ; Max: 4.134ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.17 - AverageScannerThreadConcurrency: 0.83 - BytesRead: 9.21 MB (9655610) - BytesReadDataNodeCache: 0 - BytesReadLocal: 9.21 MB (9655610) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 9.21 MB (9655610) - DecompressionTime: 6.415ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 18.99 MB (19908898) - PerReadThreadRawHdfsThroughput: 80.25 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 168.561ms - RowBatchQueuePutWaitTime: 1s810ms - RowsRead: 780.00K (780000) - RowsReturned: 453.73K (453729) - RowsReturnedRate: 406.96 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 9 (9) - ScannerThreadsTotalWallClockTime: 2s969ms - MaterializeTupleTime(*): 52.800ms - ScannerThreadsSysTime: 7.998ms - ScannerThreadsUserTime: 56.991ms - ScannerThreadsVoluntaryContextSwitches: 233 (233) - TotalRawHdfsReadTime(*): 114.746ms - TotalReadThroughput: 3.07 MB/sec Filter 1 (1.00 MB): - Rows processed: 329.44K (329440) - Rows rejected: 326.27K (326271) - Rows total: 780.00K (780000) Instance 7f40dcb034de70b7:22a (host=va1045.foo:22000):(Total: 3s131ms, non-child: 1s893ms, % non-child: 60.45%) Hdfs split stats (:<# splits>/): 6:1/38.97 MB Filter 1 arrival: 1s297ms MemoryUsage(500.000ms): 1.30 MB, 1.30 MB, 7.52 MB, 7.52 MB, 7.52 MB, 7.52 MB ThreadUsage(500.000ms): 2, 2, 1, 1, 1, 1 - AverageThreadTokens: 1.33 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 21.24 MB (22271663) - PerHostPeakMemUsage: 756.95 MB (793720364) - RowsProduced: 760.00K (760000) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1s842ms - TotalStorageWaitTime: 116.853ms - TotalThreadsInvoluntaryContextSwitches: 50 (50) - TotalThreadsTotalWallClockTime: 4s216ms - TotalThreadsSysTime: 33.994ms - TotalThreadsUserTime: 199.970ms - TotalThreadsVoluntaryContextSwitches: 855 (855) Fragment Instance Lifecycle Timings: - ExecTime: 3s054ms - ExecTreeExecTime: 1s047ms - OpenTime: 21.304ms - ExecTreeOpenTime: 29.669us - PrepareTime: 56.233ms - ExecTreePrepareTime: 138.065us DataStreamSender (dst_id=25):(Total: 139.512ms, non-child: 139.512ms, % non-child: 100.00%) - BytesSent: 12.14 MB (12730623) - NetworkThroughput(*): 169.26 MB/sec - OverallThroughput: 87.02 MB/sec - PeakMemoryUsage: 4.95 MB (5192768) - RowsReturned: 760.00K (760000) - SerializeBatchTime: 66.877ms - TransmitDataRPCTime: 71.730ms - UncompressedRowBatchSize: 12.32 MB (12922680) CodeGen:(Total: 51.359ms, non-child: 51.359ms, % non-child: 100.00%) - CodegenTime: 920.093us - CompileTime: 5.005ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 15.135ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 30.795ms HDFS_SCAN_NODE (id=0):(Total: 1s047ms, non-child: 1s047ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 6:1/38.97 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: Only following filters arrived: , waited 924ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:3 BytesRead(500.000ms): 0, 0, 8.98 MB, 8.98 MB, 8.98 MB, 8.98 MB - FooterProcessingTime: (Avg: 6.654ms ; Min: 6.654ms ; Max: 6.654ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.33 - BytesRead: 8.98 MB (9417132) - BytesReadDataNodeCache: 0 - BytesReadLocal: 8.98 MB (9417132) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 8.98 MB (9417132) - DecompressionTime: 7.038ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 16.27 MB (17064943) - PerReadThreadRawHdfsThroughput: 89.84 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 120.332ms - RowBatchQueuePutWaitTime: 60.704ms - RowsRead: 760.00K (760000) - RowsReturned: 760.00K (760000) - RowsReturnedRate: 725.23 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 10 (10) - ScannerThreadsTotalWallClockTime: 1s141ms - MaterializeTupleTime(*): 36.920ms - ScannerThreadsSysTime: 8.998ms - ScannerThreadsUserTime: 44.993ms - ScannerThreadsVoluntaryContextSwitches: 428 (428) - TotalRawHdfsReadTime(*): 99.962ms - TotalReadThroughput: 2.99 MB/sec Filter 1 (1.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 760.00K (760000) Instance 7f40dcb034de70b7:261 (host=vd1129.foo:22000):(Total: 3s124ms, non-child: 1s881ms, % non-child: 60.23%) Hdfs split stats (:<# splits>/): 4:1/39.99 MB Filter 1 arrival: 1s356ms MemoryUsage(500.000ms): 1.30 MB, 1.30 MB, 13.92 MB, 20.51 MB, 20.51 MB, 20.51 MB ThreadUsage(500.000ms): 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 23.02 MB (24142052) - PerHostPeakMemUsage: 764.20 MB (801325793) - RowsProduced: 455.86K (455855) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1s823ms - TotalStorageWaitTime: 157.507ms - TotalThreadsInvoluntaryContextSwitches: 44 (44) - TotalThreadsTotalWallClockTime: 6s002ms - TotalThreadsSysTime: 18.996ms - TotalThreadsUserTime: 172.973ms - TotalThreadsVoluntaryContextSwitches: 689 (689) Fragment Instance Lifecycle Timings: - ExecTime: 3s055ms - ExecTreeExecTime: 1s113ms - OpenTime: 20.585ms - ExecTreeOpenTime: 24.108us - PrepareTime: 48.253ms - ExecTreePrepareTime: 82.908us DataStreamSender (dst_id=25):(Total: 87.485ms, non-child: 87.485ms, % non-child: 100.00%) - BytesSent: 7.28 MB (7635359) - NetworkThroughput(*): 183.28 MB/sec - OverallThroughput: 83.23 MB/sec - PeakMemoryUsage: 4.95 MB (5192768) - RowsReturned: 455.86K (455855) - SerializeBatchTime: 46.934ms - TransmitDataRPCTime: 39.730ms - UncompressedRowBatchSize: 7.39 MB (7751143) CodeGen:(Total: 41.893ms, non-child: 41.893ms, % non-child: 100.00%) - CodegenTime: 1.262ms - CompileTime: 4.834ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 14.633ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 21.823ms HDFS_SCAN_NODE (id=0):(Total: 1s113ms, non-child: 1s113ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:1/39.99 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: Only following filters arrived: , waited 944ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:3 BytesRead(500.000ms): 0, 0, 6.15 MB, 9.21 MB, 9.21 MB, 9.21 MB - FooterProcessingTime: (Avg: 16.882ms ; Min: 16.882ms ; Max: 16.882ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 9.21 MB (9655678) - BytesReadDataNodeCache: 0 - BytesReadLocal: 9.21 MB (9655678) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 9.21 MB (9655678) - DecompressionTime: 6.766ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 17.65 MB (18504663) - PerReadThreadRawHdfsThroughput: 71.04 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 166.099ms - RowBatchQueuePutWaitTime: 1s801ms - RowsRead: 780.00K (780000) - RowsReturned: 455.86K (455855) - RowsReturnedRate: 409.52 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 9 (9) - ScannerThreadsTotalWallClockTime: 2s927ms - MaterializeTupleTime(*): 47.258ms - ScannerThreadsSysTime: 3.999ms - ScannerThreadsUserTime: 56.991ms - ScannerThreadsVoluntaryContextSwitches: 220 (220) - TotalRawHdfsReadTime(*): 129.625ms - TotalReadThroughput: 3.07 MB/sec Filter 1 (1.00 MB): - Rows processed: 327.39K (327392) - Rows rejected: 324.14K (324145) - Rows total: 780.00K (780000) Instance 7f40dcb034de70b7:23f (host=vc1516.foo:22000):(Total: 3s111ms, non-child: 1s859ms, % non-child: 59.76%) Hdfs split stats (:<# splits>/): 0:1/39.98 MB Filter 1 arrival: 1s323ms MemoryUsage(500.000ms): 1.30 MB, 1.30 MB, 20.43 MB, 21.43 MB, 21.43 MB, 21.43 MB ThreadUsage(500.000ms): 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 24.77 MB (25972533) - PerHostPeakMemUsage: 771.58 MB (809062013) - RowsProduced: 450.76K (450760) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1s810ms - TotalStorageWaitTime: 122.597ms - TotalThreadsInvoluntaryContextSwitches: 46 (46) - TotalThreadsTotalWallClockTime: 5s962ms - TotalThreadsSysTime: 26.995ms - TotalThreadsUserTime: 176.973ms - TotalThreadsVoluntaryContextSwitches: 645 (645) Fragment Instance Lifecycle Timings: - ExecTime: 3s031ms - ExecTreeExecTime: 1s097ms - OpenTime: 22.855ms - ExecTreeOpenTime: 28.175us - PrepareTime: 57.406ms - ExecTreePrepareTime: 84.508us DataStreamSender (dst_id=25):(Total: 95.365ms, non-child: 95.365ms, % non-child: 100.00%) - BytesSent: 7.20 MB (7548505) - NetworkThroughput(*): 160.62 MB/sec - OverallThroughput: 75.49 MB/sec - PeakMemoryUsage: 4.95 MB (5192768) - RowsReturned: 450.76K (450760) - SerializeBatchTime: 49.743ms - TransmitDataRPCTime: 44.819ms - UncompressedRowBatchSize: 7.31 MB (7664528) CodeGen:(Total: 59.229ms, non-child: 59.229ms, % non-child: 100.00%) - CodegenTime: 1.023ms - CompileTime: 5.812ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 15.749ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 37.076ms HDFS_SCAN_NODE (id=0):(Total: 1s097ms, non-child: 1s097ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/39.98 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: Only following filters arrived: , waited 924ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:3 BytesRead(500.000ms): 0, 0, 9.21 MB, 9.21 MB, 9.21 MB, 9.21 MB - FooterProcessingTime: (Avg: 8.065ms ; Min: 8.065ms ; Max: 8.065ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 9.21 MB (9655161) - BytesReadDataNodeCache: 0 - BytesReadLocal: 9.21 MB (9655161) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 9.21 MB (9655161) - DecompressionTime: 7.694ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 19.44 MB (20379149) - PerReadThreadRawHdfsThroughput: 85.64 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 171.759ms - RowBatchQueuePutWaitTime: 1s783ms - RowsRead: 780.00K (780000) - RowsReturned: 450.76K (450760) - RowsReturnedRate: 410.64 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 9 (9) - ScannerThreadsTotalWallClockTime: 2s908ms - MaterializeTupleTime(*): 50.182ms - ScannerThreadsSysTime: 13.997ms - ScannerThreadsUserTime: 50.992ms - ScannerThreadsVoluntaryContextSwitches: 212 (212) - TotalRawHdfsReadTime(*): 107.516ms - TotalReadThroughput: 3.07 MB/sec Filter 1 (1.00 MB): - Rows processed: 332.51K (332512) - Rows rejected: 329.24K (329240) - Rows total: 780.00K (780000) Instance 7f40dcb034de70b7:241 (host=vc1541.foo:22000):(Total: 3s070ms, non-child: 1s850ms, % non-child: 60.27%) Hdfs split stats (:<# splits>/): 5:1/37.98 MB Filter 1 arrival: 1s325ms MemoryUsage(500.000ms): 1.30 MB, 1.30 MB, 20.98 MB, 21.89 MB, 21.89 MB, 21.89 MB ThreadUsage(500.000ms): 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 22.75 MB (23855795) - PerHostPeakMemUsage: 741.65 MB (777675958) - RowsProduced: 611.53K (611533) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1s784ms - TotalStorageWaitTime: 108.178ms - TotalThreadsInvoluntaryContextSwitches: 82 (82) - TotalThreadsTotalWallClockTime: 5s872ms - TotalThreadsSysTime: 24.996ms - TotalThreadsUserTime: 192.970ms - TotalThreadsVoluntaryContextSwitches: 862 (862) Fragment Instance Lifecycle Timings: - ExecTime: 3s000ms - ExecTreeExecTime: 1s057ms - OpenTime: 20.307ms - ExecTreeOpenTime: 31.049us - PrepareTime: 49.164ms - ExecTreePrepareTime: 104.865us DataStreamSender (dst_id=25):(Total: 118.681ms, non-child: 118.681ms, % non-child: 100.00%) - BytesSent: 9.77 MB (10243826) - NetworkThroughput(*): 176.58 MB/sec - OverallThroughput: 82.31 MB/sec - PeakMemoryUsage: 4.95 MB (5192768) - RowsReturned: 611.53K (611533) - SerializeBatchTime: 62.292ms - TransmitDataRPCTime: 55.323ms - UncompressedRowBatchSize: 9.92 MB (10398205) CodeGen:(Total: 43.593ms, non-child: 43.593ms, % non-child: 100.00%) - CodegenTime: 983.914us - CompileTime: 5.610ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 13.570ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 23.788ms HDFS_SCAN_NODE (id=0):(Total: 1s057ms, non-child: 1s057ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:1/37.98 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: Only following filters arrived: , waited 944ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:3 BytesRead(500.000ms): 0, 0, 8.75 MB, 8.75 MB, 8.75 MB, 8.75 MB - FooterProcessingTime: (Avg: 8.848ms ; Min: 8.848ms ; Max: 8.848ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 8.75 MB (9178213) - BytesReadDataNodeCache: 0 - BytesReadLocal: 8.75 MB (9178213) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 8.75 MB (9178213) - DecompressionTime: 6.174ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 18.85 MB (19763192) - PerReadThreadRawHdfsThroughput: 109.38 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 111.057ms - RowBatchQueuePutWaitTime: 1s793ms - RowsRead: 740.00K (740000) - RowsReturned: 611.53K (611533) - RowsReturnedRate: 578.25 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 11 (11) - ScannerThreadsTotalWallClockTime: 2s852ms - MaterializeTupleTime(*): 35.384ms - ScannerThreadsSysTime: 5.999ms - ScannerThreadsUserTime: 41.993ms - ScannerThreadsVoluntaryContextSwitches: 430 (430) - TotalRawHdfsReadTime(*): 80.024ms - TotalReadThroughput: 2.92 MB/sec Filter 1 (1.00 MB): - Rows processed: 129.70K (129696) - Rows rejected: 128.47K (128467) - Rows total: 740.00K (740000) Instance 7f40dcb034de70b7:25b (host=vd1120.foo:22000):(Total: 3s065ms, non-child: 1s861ms, % non-child: 60.73%) Hdfs split stats (:<# splits>/): 3:1/39.99 MB Filter 1 arrival: 1s345ms MemoryUsage(500.000ms): 1.52 MB, 1.30 MB, 9.54 MB, 8.58 MB, 8.58 MB, 8.58 MB ThreadUsage(500.000ms): 1, 1, 2, 1, 1, 1 - AverageThreadTokens: 1.17 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 21.25 MB (22279775) - PerHostPeakMemUsage: 750.55 MB (787013172) - RowsProduced: 780.00K (780000) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1s791ms - TotalStorageWaitTime: 83.469ms - TotalThreadsInvoluntaryContextSwitches: 77 (77) - TotalThreadsTotalWallClockTime: 3s545ms - TotalThreadsSysTime: 44.992ms - TotalThreadsUserTime: 200.969ms - TotalThreadsVoluntaryContextSwitches: 785 (785) Fragment Instance Lifecycle Timings: - ExecTime: 2s977ms - ExecTreeExecTime: 1s013ms - OpenTime: 25.811ms - ExecTreeOpenTime: 31.433us - PrepareTime: 61.623ms - ExecTreePrepareTime: 99.330us DataStreamSender (dst_id=25):(Total: 145.262ms, non-child: 145.262ms, % non-child: 100.00%) - BytesSent: 12.46 MB (13068523) - NetworkThroughput(*): 174.90 MB/sec - OverallThroughput: 85.80 MB/sec - PeakMemoryUsage: 4.95 MB (5192768) - RowsReturned: 780.00K (780000) - SerializeBatchTime: 72.200ms - TransmitDataRPCTime: 71.257ms - UncompressedRowBatchSize: 12.65 MB (13262680) CodeGen:(Total: 44.986ms, non-child: 44.986ms, % non-child: 100.00%) - CodegenTime: 1.465ms - CompileTime: 6.235ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 17.001ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 21.168ms HDFS_SCAN_NODE (id=0):(Total: 1s013ms, non-child: 1s013ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:1/39.99 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: Only following filters arrived: , waited 925ms Hdfs Read Thread Concurrency Bucket: 0:80% 1:20% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:3 BytesRead(500.000ms): 0, 0, 3.15 MB, 9.21 MB, 9.21 MB, 9.21 MB - FooterProcessingTime: (Avg: 10.620ms ; Min: 10.620ms ; Max: 10.620ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.20 - AverageScannerThreadConcurrency: 0.20 - BytesRead: 9.21 MB (9655063) - BytesReadDataNodeCache: 0 - BytesReadLocal: 9.21 MB (9655063) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 9.21 MB (9655063) - DecompressionTime: 6.565ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 16.27 MB (17064868) - PerReadThreadRawHdfsThroughput: 147.36 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 86.198ms - RowBatchQueuePutWaitTime: 64.222ms - RowsRead: 780.00K (780000) - RowsReturned: 780.00K (780000) - RowsReturnedRate: 769.63 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 24 (24) - ScannerThreadsTotalWallClockTime: 543.374ms - MaterializeTupleTime(*): 40.210ms - ScannerThreadsSysTime: 8.998ms - ScannerThreadsUserTime: 44.993ms - ScannerThreadsVoluntaryContextSwitches: 338 (338) - TotalRawHdfsReadTime(*): 62.485ms - TotalReadThroughput: 3.07 MB/sec Filter 1 (1.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 780.00K (780000) Instance 7f40dcb034de70b7:244 (host=vd1123.foo:22000):(Total: 3s045ms, non-child: 1s826ms, % non-child: 59.95%) Hdfs split stats (:<# splits>/): 5:1/39.99 MB Filter 1 arrival: 1s327ms MemoryUsage(500.000ms): 1.30 MB, 1.30 MB, 9.54 MB, 27.32 MB, 27.32 MB, 27.32 MB ThreadUsage(500.000ms): 1, 1, 2, 2, 2, 2 - AverageThreadTokens: 1.67 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 27.32 MB (28649386) - PerHostPeakMemUsage: 765.86 MB (803063094) - RowsProduced: 455.76K (455765) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1s762ms - TotalStorageWaitTime: 126.416ms - TotalThreadsInvoluntaryContextSwitches: 53 (53) - TotalThreadsTotalWallClockTime: 5s258ms - TotalThreadsSysTime: 33.994ms - TotalThreadsUserTime: 179.972ms - TotalThreadsVoluntaryContextSwitches: 718 (718) Fragment Instance Lifecycle Timings: - ExecTime: 2s983ms - ExecTreeExecTime: 1s077ms - OpenTime: 18.571ms - ExecTreeOpenTime: 36.334us - PrepareTime: 44.229ms - ExecTreePrepareTime: 83.302us DataStreamSender (dst_id=25):(Total: 101.197ms, non-child: 101.197ms, % non-child: 100.00%) - BytesSent: 7.28 MB (7632593) - NetworkThroughput(*): 162.86 MB/sec - OverallThroughput: 71.93 MB/sec - PeakMemoryUsage: 4.95 MB (5192768) - RowsReturned: 455.76K (455765) - SerializeBatchTime: 55.514ms - TransmitDataRPCTime: 44.694ms - UncompressedRowBatchSize: 7.39 MB (7749613) CodeGen:(Total: 41.333ms, non-child: 41.333ms, % non-child: 100.00%) - CodegenTime: 789.211us - CompileTime: 4.800ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 12.731ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 23.268ms HDFS_SCAN_NODE (id=0):(Total: 1s077ms, non-child: 1s077ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:1/39.99 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: Only following filters arrived: , waited 944ms Hdfs Read Thread Concurrency Bucket: 0:83.33% 1:16.67% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:3 BytesRead(500.000ms): 0, 0, 3.15 MB, 9.21 MB, 9.21 MB, 9.21 MB - FooterProcessingTime: (Avg: 6.729ms ; Min: 6.729ms ; Max: 6.729ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.17 - AverageScannerThreadConcurrency: 0.67 - BytesRead: 9.21 MB (9654878) - BytesReadDataNodeCache: 0 - BytesReadLocal: 9.21 MB (9654878) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 9.21 MB (9654878) - DecompressionTime: 7.931ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 23.86 MB (25015535) - PerReadThreadRawHdfsThroughput: 87.27 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 130.578ms - RowBatchQueuePutWaitTime: 1s744ms - RowsRead: 780.00K (780000) - RowsReturned: 455.76K (455765) - RowsReturnedRate: 423.04 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 12 (12) - ScannerThreadsTotalWallClockTime: 2s256ms - MaterializeTupleTime(*): 42.966ms - ScannerThreadsSysTime: 10.998ms - ScannerThreadsUserTime: 47.992ms - ScannerThreadsVoluntaryContextSwitches: 256 (256) - TotalRawHdfsReadTime(*): 105.509ms - TotalReadThroughput: 3.07 MB/sec Filter 1 (1.00 MB): - Rows processed: 327.39K (327392) - Rows rejected: 324.24K (324235) - Rows total: 780.00K (780000) Instance 7f40dcb034de70b7:25c (host=ve1142.foo:22000):(Total: 3s039ms, non-child: 1s840ms, % non-child: 60.57%) Hdfs split stats (:<# splits>/): 5:1/38.98 MB Filter 1 arrival: 1s351ms MemoryUsage(500.000ms): 1.30 MB, 1.30 MB, 20.48 MB, 20.48 MB, 20.48 MB, 20.48 MB ThreadUsage(500.000ms): 1, 2, 2, 2, 2, 2 - AverageThreadTokens: 1.83 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 21.71 MB (22767769) - PerHostPeakMemUsage: 767.86 MB (805162918) - RowsProduced: 623.89K (623891) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1s770ms - TotalStorageWaitTime: 88.964ms - TotalThreadsInvoluntaryContextSwitches: 77 (77) - TotalThreadsTotalWallClockTime: 5s215ms - TotalThreadsSysTime: 32.995ms - TotalThreadsUserTime: 209.968ms - TotalThreadsVoluntaryContextSwitches: 846 (846) Fragment Instance Lifecycle Timings: - ExecTime: 2s957ms - ExecTreeExecTime: 1s019ms - OpenTime: 28.528ms - ExecTreeOpenTime: 51.167us - PrepareTime: 53.465ms - ExecTreePrepareTime: 199.118us DataStreamSender (dst_id=25):(Total: 131.674ms, non-child: 131.674ms, % non-child: 100.00%) - BytesSent: 9.96 MB (10448676) - NetworkThroughput(*): 163.84 MB/sec - OverallThroughput: 75.68 MB/sec - PeakMemoryUsage: 4.95 MB (5192768) - RowsReturned: 623.89K (623891) - SerializeBatchTime: 68.581ms - TransmitDataRPCTime: 60.817ms - UncompressedRowBatchSize: 10.12 MB (10608291) CodeGen:(Total: 47.057ms, non-child: 47.057ms, % non-child: 100.00%) - CodegenTime: 1.404ms - CompileTime: 6.407ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 20.542ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 19.506ms HDFS_SCAN_NODE (id=0):(Total: 1s019ms, non-child: 1s019ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:1/38.98 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: Only following filters arrived: , waited 924ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:3 BytesRead(500.000ms): 0, 0, 8.98 MB, 8.98 MB, 8.98 MB, 8.98 MB - FooterProcessingTime: (Avg: 10.283ms ; Min: 10.283ms ; Max: 10.283ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.83 - BytesRead: 8.98 MB (9416858) - BytesReadDataNodeCache: 0 - BytesReadLocal: 8.98 MB (9416858) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 8.98 MB (9416858) - DecompressionTime: 7.005ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 18.70 MB (19603934) - PerReadThreadRawHdfsThroughput: 127.63 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 91.414ms - RowBatchQueuePutWaitTime: 1s778ms - RowsRead: 760.00K (760000) - RowsReturned: 623.89K (623891) - RowsReturnedRate: 611.81 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 13 (13) - ScannerThreadsTotalWallClockTime: 2s229ms - MaterializeTupleTime(*): 40.101ms - ScannerThreadsSysTime: 9.998ms - ScannerThreadsUserTime: 44.993ms - ScannerThreadsVoluntaryContextSwitches: 406 (406) - TotalRawHdfsReadTime(*): 70.366ms - TotalReadThroughput: 2.99 MB/sec Filter 1 (1.00 MB): - Rows processed: 137.41K (137408) - Rows rejected: 136.11K (136109) - Rows total: 760.00K (760000) Instance 7f40dcb034de70b7:226 (host=vc1526.foo:22000):(Total: 3s037ms, non-child: 1s812ms, % non-child: 59.66%) Hdfs split stats (:<# splits>/): 1:1/38.98 MB Filter 1 arrival: 1s295ms MemoryUsage(500.000ms): 1.30 MB, 1.30 MB, 27.57 MB, 27.57 MB, 27.57 MB, 4.53 MB ThreadUsage(500.000ms): 2, 2, 2, 2, 2, 1 - AverageThreadTokens: 1.83 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 27.57 MB (28909806) - PerHostPeakMemUsage: 752.88 MB (789450644) - RowsProduced: 453.60K (453595) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1s761ms - TotalStorageWaitTime: 85.194ms - TotalThreadsInvoluntaryContextSwitches: 40 (40) - TotalThreadsTotalWallClockTime: 5s811ms - TotalThreadsSysTime: 24.997ms - TotalThreadsUserTime: 156.976ms - TotalThreadsVoluntaryContextSwitches: 683 (683) Fragment Instance Lifecycle Timings: - ExecTime: 2s976ms - ExecTreeExecTime: 1s096ms - OpenTime: 19.500ms - ExecTreeOpenTime: 22.175us - PrepareTime: 41.703ms - ExecTreePrepareTime: 72.797us DataStreamSender (dst_id=25):(Total: 89.371ms, non-child: 89.371ms, % non-child: 100.00%) - BytesSent: 7.25 MB (7598145) - NetworkThroughput(*): 176.36 MB/sec - OverallThroughput: 81.08 MB/sec - PeakMemoryUsage: 4.95 MB (5192768) - RowsReturned: 453.60K (453595) - SerializeBatchTime: 47.558ms - TransmitDataRPCTime: 41.086ms - UncompressedRowBatchSize: 7.36 MB (7712723) CodeGen:(Total: 39.558ms, non-child: 39.558ms, % non-child: 100.00%) - CodegenTime: 1.030ms - CompileTime: 4.418ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 14.017ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 20.507ms HDFS_SCAN_NODE (id=0):(Total: 1s096ms, non-child: 1s096ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:1/38.98 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: Only following filters arrived: , waited 944ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:3 BytesRead(500.000ms): 0, 0, 8.98 MB, 8.98 MB, 8.98 MB - FooterProcessingTime: (Avg: 4.098ms ; Min: 4.098ms ; Max: 4.098ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 8.98 MB (9416000) - BytesReadDataNodeCache: 0 - BytesReadLocal: 8.98 MB (9416000) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 8.98 MB (9416000) - DecompressionTime: 6.184ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 23.43 MB (24563251) - PerReadThreadRawHdfsThroughput: 125.83 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 150.917ms - RowBatchQueuePutWaitTime: 1s699ms - RowsRead: 760.00K (760000) - RowsReturned: 453.60K (453595) - RowsReturnedRate: 413.67 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 7 (7) - ScannerThreadsTotalWallClockTime: 2s815ms - MaterializeTupleTime(*): 38.788ms - ScannerThreadsSysTime: 5.999ms - ScannerThreadsUserTime: 44.993ms - ScannerThreadsVoluntaryContextSwitches: 244 (244) - TotalRawHdfsReadTime(*): 71.363ms - TotalReadThroughput: 3.59 MB/sec Filter 1 (1.00 MB): - Rows processed: 309.44K (309440) - Rows rejected: 306.40K (306405) - Rows total: 760.00K (760000) Instance 7f40dcb034de70b7:210 (host=vd1112.foo:22000):(Total: 3s036ms, non-child: 1s803ms, % non-child: 59.39%) Hdfs split stats (:<# splits>/): 5:1/40.00 MB Filter 1 arrival: 1s436ms MemoryUsage(500.000ms): 1.30 MB, 1.30 MB, 9.54 MB, 20.08 MB, 20.08 MB, 20.08 MB ThreadUsage(500.000ms): 1, 1, 2, 2, 2, 2 - AverageThreadTokens: 1.67 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 25.35 MB (26576775) - PerHostPeakMemUsage: 738.92 MB (774809503) - RowsProduced: 458.89K (458888) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1s746ms - TotalStorageWaitTime: 139.790ms - TotalThreadsInvoluntaryContextSwitches: 41 (41) - TotalThreadsTotalWallClockTime: 5s151ms - TotalThreadsSysTime: 28.995ms - TotalThreadsUserTime: 169.974ms - TotalThreadsVoluntaryContextSwitches: 698 (698) Fragment Instance Lifecycle Timings: - ExecTime: 2s986ms - ExecTreeExecTime: 1s110ms - OpenTime: 19.063ms - ExecTreeOpenTime: 24.152us - PrepareTime: 31.574ms - ExecTreePrepareTime: 52.378us DataStreamSender (dst_id=25):(Total: 90.787ms, non-child: 90.787ms, % non-child: 100.00%) - BytesSent: 7.33 MB (7685362) - NetworkThroughput(*): 170.20 MB/sec - OverallThroughput: 80.73 MB/sec - PeakMemoryUsage: 4.95 MB (5192768) - RowsReturned: 458.89K (458888) - SerializeBatchTime: 47.174ms - TransmitDataRPCTime: 43.062ms - UncompressedRowBatchSize: 7.44 MB (7802704) CodeGen:(Total: 32.039ms, non-child: 32.039ms, % non-child: 100.00%) - CodegenTime: 860.297us - CompileTime: 5.436ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 12.665ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 13.565ms HDFS_SCAN_NODE (id=0):(Total: 1s110ms, non-child: 1s110ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:1/40.00 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: Only following filters arrived: , waited 964ms Hdfs Read Thread Concurrency Bucket: 0:83.33% 1:16.67% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:3 BytesRead(500.000ms): 0, 0, 3.15 MB, 9.21 MB, 9.21 MB, 9.21 MB - FooterProcessingTime: (Avg: 8.292ms ; Min: 8.292ms ; Max: 8.292ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.17 - AverageScannerThreadConcurrency: 0.67 - BytesRead: 9.21 MB (9655663) - BytesReadDataNodeCache: 0 - BytesReadLocal: 9.21 MB (9655663) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 9.21 MB (9655663) - DecompressionTime: 6.831ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 19.26 MB (20190791) - PerReadThreadRawHdfsThroughput: 78.70 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 143.093ms - RowBatchQueuePutWaitTime: 1s670ms - RowsRead: 780.00K (780000) - RowsReturned: 458.89K (458888) - RowsReturnedRate: 413.32 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 6 (6) - ScannerThreadsTotalWallClockTime: 2s146ms - MaterializeTupleTime(*): 44.037ms - ScannerThreadsSysTime: 8.998ms - ScannerThreadsUserTime: 47.992ms - ScannerThreadsVoluntaryContextSwitches: 258 (258) - TotalRawHdfsReadTime(*): 117.009ms - TotalReadThroughput: 3.07 MB/sec Filter 1 (1.00 MB): - Rows processed: 324.32K (324320) - Rows rejected: 321.11K (321112) - Rows total: 780.00K (780000) Instance 7f40dcb034de70b7:249 (host=vd1124.foo:22000):(Total: 3s024ms, non-child: 1s807ms, % non-child: 59.76%) Hdfs split stats (:<# splits>/): 0:1/39.99 MB Filter 1 arrival: 1s331ms MemoryUsage(500.000ms): 1.30 MB, 1.30 MB, 28.87 MB, 28.87 MB, 28.87 MB, 14.21 MB ThreadUsage(500.000ms): 1, 2, 2, 2, 2, 1 - AverageThreadTokens: 1.67 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 28.87 MB (30275242) - PerHostPeakMemUsage: 745.86 MB (782086271) - RowsProduced: 448.80K (448803) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1s744ms - TotalStorageWaitTime: 133.944ms - TotalThreadsInvoluntaryContextSwitches: 55 (55) - TotalThreadsTotalWallClockTime: 5s179ms - TotalThreadsSysTime: 32.995ms - TotalThreadsUserTime: 169.973ms - TotalThreadsVoluntaryContextSwitches: 689 (689) Fragment Instance Lifecycle Timings: - ExecTime: 2s940ms - ExecTreeExecTime: 1s064ms - OpenTime: 27.031ms - ExecTreeOpenTime: 32.671us - PrepareTime: 56.942ms - ExecTreePrepareTime: 94.942us DataStreamSender (dst_id=25):(Total: 100.082ms, non-child: 100.082ms, % non-child: 100.00%) - BytesSent: 7.17 MB (7517017) - NetworkThroughput(*): 164.22 MB/sec - OverallThroughput: 71.63 MB/sec - PeakMemoryUsage: 4.95 MB (5192768) - RowsReturned: 448.80K (448803) - SerializeBatchTime: 54.156ms - TransmitDataRPCTime: 43.654ms - UncompressedRowBatchSize: 7.28 MB (7631259) CodeGen:(Total: 52.972ms, non-child: 52.972ms, % non-child: 100.00%) - CodegenTime: 1.081ms - CompileTime: 6.153ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 17.691ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 28.580ms HDFS_SCAN_NODE (id=0):(Total: 1s064ms, non-child: 1s064ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/39.99 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: Only following filters arrived: , waited 924ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:3 BytesRead(500.000ms): 0, 0, 9.21 MB, 9.21 MB, 9.21 MB, 9.21 MB - FooterProcessingTime: (Avg: 11.166ms ; Min: 11.166ms ; Max: 11.166ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.67 - BytesRead: 9.21 MB (9655583) - BytesReadDataNodeCache: 0 - BytesReadLocal: 9.21 MB (9655583) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 9.21 MB (9655583) - DecompressionTime: 7.259ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 23.95 MB (25109471) - PerReadThreadRawHdfsThroughput: 85.65 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 137.688ms - RowBatchQueuePutWaitTime: 1s713ms - RowsRead: 780.00K (780000) - RowsReturned: 448.80K (448803) - RowsReturnedRate: 421.78 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 15 (15) - ScannerThreadsTotalWallClockTime: 2s214ms - MaterializeTupleTime(*): 39.681ms - ScannerThreadsSysTime: 11.998ms - ScannerThreadsUserTime: 40.993ms - ScannerThreadsVoluntaryContextSwitches: 246 (246) - TotalRawHdfsReadTime(*): 107.510ms - TotalReadThroughput: 3.07 MB/sec Filter 1 (1.00 MB): - Rows processed: 334.56K (334560) - Rows rejected: 331.20K (331197) - Rows total: 780.00K (780000) Instance 7f40dcb034de70b7:267 (host=ve1131.foo:22000):(Total: 2s990ms, non-child: 1s783ms, % non-child: 59.65%) Hdfs split stats (:<# splits>/): 3:1/40.00 MB Filter 1 arrival: 1s363ms MemoryUsage(500.000ms): 1.30 MB, 1.30 MB, 14.69 MB, 21.66 MB, 21.66 MB, 21.66 MB ThreadUsage(500.000ms): 1, 1, 2, 2, 2, 2 - AverageThreadTokens: 1.67 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 22.97 MB (24081929) - PerHostPeakMemUsage: 747.10 MB (783395346) - RowsProduced: 449.70K (449703) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1s725ms - TotalStorageWaitTime: 135.276ms - TotalThreadsInvoluntaryContextSwitches: 38 (38) - TotalThreadsTotalWallClockTime: 5s108ms - TotalThreadsSysTime: 25.996ms - TotalThreadsUserTime: 171.974ms - TotalThreadsVoluntaryContextSwitches: 539 (539) Fragment Instance Lifecycle Timings: - ExecTime: 2s909ms - ExecTreeExecTime: 1s072ms - OpenTime: 29.462ms - ExecTreeOpenTime: 38.918us - PrepareTime: 51.599ms - ExecTreePrepareTime: 77.822us DataStreamSender (dst_id=25):(Total: 82.864ms, non-child: 82.864ms, % non-child: 100.00%) - BytesSent: 7.18 MB (7532361) - NetworkThroughput(*): 182.95 MB/sec - OverallThroughput: 86.69 MB/sec - PeakMemoryUsage: 4.95 MB (5192768) - RowsReturned: 449.70K (449703) - SerializeBatchTime: 41.832ms - TransmitDataRPCTime: 39.265ms - UncompressedRowBatchSize: 7.29 MB (7646559) CodeGen:(Total: 50.754ms, non-child: 50.754ms, % non-child: 100.00%) - CodegenTime: 1.529ms - CompileTime: 5.030ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 20.636ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 24.528ms HDFS_SCAN_NODE (id=0):(Total: 1s073ms, non-child: 1s073ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:1/40.00 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: Only following filters arrived: , waited 924ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:3 BytesRead(500.000ms): 0, 0, 9.21 MB, 9.21 MB, 9.21 MB, 9.21 MB - FooterProcessingTime: (Avg: 9.347ms ; Min: 9.347ms ; Max: 9.347ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.67 - BytesRead: 9.21 MB (9656440) - BytesReadDataNodeCache: 0 - BytesReadLocal: 9.21 MB (9656440) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 9.21 MB (9656440) - DecompressionTime: 7.225ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 18.18 MB (19064142) - PerReadThreadRawHdfsThroughput: 78.42 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 146.700ms - RowBatchQueuePutWaitTime: 1s673ms - RowsRead: 780.00K (780000) - RowsReturned: 449.70K (449703) - RowsReturnedRate: 419.08 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 14 (14) - ScannerThreadsTotalWallClockTime: 2s171ms - MaterializeTupleTime(*): 53.663ms - ScannerThreadsSysTime: 5.999ms - ScannerThreadsUserTime: 60.990ms - ScannerThreadsVoluntaryContextSwitches: 92 (92) - TotalRawHdfsReadTime(*): 117.430ms - TotalReadThroughput: 3.07 MB/sec Filter 1 (1.00 MB): - Rows processed: 333.54K (333536) - Rows rejected: 330.30K (330297) - Rows total: 780.00K (780000) Instance 7f40dcb034de70b7:270 (host=ve1129.foo:22000):(Total: 2s986ms, non-child: 1s772ms, % non-child: 59.36%) Hdfs split stats (:<# splits>/): 4:1/40.00 MB Filter 1 arrival: 1s374ms MemoryUsage(500.000ms): 1.30 MB, 1.30 MB, 19.39 MB, 20.39 MB, 20.39 MB, 20.39 MB ThreadUsage(500.000ms): 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 23.65 MB (24794554) - PerHostPeakMemUsage: 724.30 MB (759482361) - RowsProduced: 456.84K (456841) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1s715ms - TotalStorageWaitTime: 133.744ms - TotalThreadsInvoluntaryContextSwitches: 37 (37) - TotalThreadsTotalWallClockTime: 5s757ms - TotalThreadsSysTime: 13.997ms - TotalThreadsUserTime: 182.973ms - TotalThreadsVoluntaryContextSwitches: 739 (739) Fragment Instance Lifecycle Timings: - ExecTime: 2s927ms - ExecTreeExecTime: 1s090ms - OpenTime: 21.103ms - ExecTreeOpenTime: 29.423us - PrepareTime: 38.318ms - ExecTreePrepareTime: 41.045us DataStreamSender (dst_id=25):(Total: 84.349ms, non-child: 84.349ms, % non-child: 100.00%) - BytesSent: 7.30 MB (7651937) - NetworkThroughput(*): 188.95 MB/sec - OverallThroughput: 86.51 MB/sec - PeakMemoryUsage: 4.95 MB (5192768) - RowsReturned: 456.84K (456841) - SerializeBatchTime: 45.085ms - TransmitDataRPCTime: 38.622ms - UncompressedRowBatchSize: 7.41 MB (7767905) CodeGen:(Total: 39.148ms, non-child: 39.148ms, % non-child: 100.00%) - CodegenTime: 1.106ms - CompileTime: 5.003ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 14.980ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 18.544ms HDFS_SCAN_NODE (id=0):(Total: 1s090ms, non-child: 1s090ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:1/40.00 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: Only following filters arrived: , waited 944ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:3 BytesRead(500.000ms): 0, 0, 9.21 MB, 9.21 MB, 9.21 MB, 9.21 MB - FooterProcessingTime: (Avg: 12.404ms ; Min: 12.404ms ; Max: 12.404ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 9.21 MB (9655577) - BytesReadDataNodeCache: 0 - BytesReadLocal: 9.21 MB (9655577) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 9.21 MB (9655577) - DecompressionTime: 5.947ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 18.02 MB (18899704) - PerReadThreadRawHdfsThroughput: 87.86 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 144.271ms - RowBatchQueuePutWaitTime: 1s695ms - RowsRead: 780.00K (780000) - RowsReturned: 456.84K (456841) - RowsReturnedRate: 419.00 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 9 (9) - ScannerThreadsTotalWallClockTime: 2s809ms - MaterializeTupleTime(*): 50.995ms - ScannerThreadsSysTime: 3.999ms - ScannerThreadsUserTime: 58.991ms - ScannerThreadsVoluntaryContextSwitches: 285 (285) - TotalRawHdfsReadTime(*): 104.808ms - TotalReadThroughput: 3.07 MB/sec Filter 1 (1.00 MB): - Rows processed: 326.37K (326368) - Rows rejected: 323.16K (323159) - Rows total: 780.00K (780000) Instance 7f40dcb034de70b7:233 (host=vc1506.foo:22000):(Total: 2s950ms, non-child: 1s726ms, % non-child: 58.52%) Hdfs split stats (:<# splits>/): 7:1/39.99 MB Filter 1 arrival: 1s310ms MemoryUsage(500.000ms): 1.30 MB, 1.30 MB, 18.17 MB, 20.53 MB, 20.53 MB, 20.53 MB ThreadUsage(500.000ms): 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 25.58 MB (26824158) - PerHostPeakMemUsage: 642.49 MB (673694408) - RowsProduced: 456.84K (456840) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1s666ms - TotalStorageWaitTime: 139.329ms - TotalThreadsInvoluntaryContextSwitches: 47 (47) - TotalThreadsTotalWallClockTime: 5s625ms - TotalThreadsSysTime: 31.994ms - TotalThreadsUserTime: 169.973ms - TotalThreadsVoluntaryContextSwitches: 744 (744) Fragment Instance Lifecycle Timings: - ExecTime: 2s890ms - ExecTreeExecTime: 1s088ms - OpenTime: 18.378ms - ExecTreeOpenTime: 23.063us - PrepareTime: 42.390ms - ExecTreePrepareTime: 86.816us DataStreamSender (dst_id=25):(Total: 95.834ms, non-child: 95.834ms, % non-child: 100.00%) - BytesSent: 7.30 MB (7651600) - NetworkThroughput(*): 167.71 MB/sec - OverallThroughput: 76.14 MB/sec - PeakMemoryUsage: 4.95 MB (5192768) - RowsReturned: 456.84K (456840) - SerializeBatchTime: 51.574ms - TransmitDataRPCTime: 43.510ms - UncompressedRowBatchSize: 7.41 MB (7767888) CodeGen:(Total: 39.263ms, non-child: 39.263ms, % non-child: 100.00%) - CodegenTime: 1.588ms - CompileTime: 4.233ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 13.191ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 21.326ms HDFS_SCAN_NODE (id=0):(Total: 1s088ms, non-child: 1s088ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:1/39.99 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: Only following filters arrived: , waited 944ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:3 BytesRead(500.000ms): 0, 0, 9.21 MB, 9.21 MB, 9.21 MB, 9.21 MB - FooterProcessingTime: (Avg: 8.426ms ; Min: 8.426ms ; Max: 8.426ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 9.21 MB (9655955) - BytesReadDataNodeCache: 0 - BytesReadLocal: 9.21 MB (9655955) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 9.21 MB (9655955) - DecompressionTime: 7.375ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 21.71 MB (22769443) - PerReadThreadRawHdfsThroughput: 79.08 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 142.612ms - RowBatchQueuePutWaitTime: 1s653ms - RowsRead: 780.00K (780000) - RowsReturned: 456.84K (456840) - RowsReturnedRate: 419.56 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 11 (11) - ScannerThreadsTotalWallClockTime: 2s717ms - MaterializeTupleTime(*): 41.916ms - ScannerThreadsSysTime: 13.997ms - ScannerThreadsUserTime: 41.993ms - ScannerThreadsVoluntaryContextSwitches: 276 (276) - TotalRawHdfsReadTime(*): 116.441ms - TotalReadThroughput: 3.07 MB/sec Filter 1 (1.00 MB): - Rows processed: 326.37K (326368) - Rows rejected: 323.16K (323160) - Rows total: 780.00K (780000) Instance 7f40dcb034de70b7:247 (host=vd1122.foo:22000):(Total: 2s921ms, non-child: 1s702ms, % non-child: 58.28%) Hdfs split stats (:<# splits>/): 6:1/40.00 MB Filter 1 arrival: 1s330ms MemoryUsage(500.000ms): 1.30 MB, 1.30 MB, 22.05 MB, 22.05 MB, 22.05 MB, 4.91 MB ThreadUsage(500.000ms): 1, 2, 2, 2, 2, 1 - AverageThreadTokens: 1.67 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 25.63 MB (26878926) - PerHostPeakMemUsage: 641.07 MB (672210657) - RowsProduced: 444.64K (444644) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1s653ms - TotalStorageWaitTime: 138.170ms - TotalThreadsInvoluntaryContextSwitches: 44 (44) - TotalThreadsTotalWallClockTime: 4s991ms - TotalThreadsSysTime: 29.995ms - TotalThreadsUserTime: 163.975ms - TotalThreadsVoluntaryContextSwitches: 725 (725) Fragment Instance Lifecycle Timings: - ExecTime: 2s839ms - ExecTreeExecTime: 1s067ms - OpenTime: 29.981ms - ExecTreeOpenTime: 44.364us - PrepareTime: 52.871ms - ExecTreePrepareTime: 92.901us DataStreamSender (dst_id=25):(Total: 92.517ms, non-child: 92.517ms, % non-child: 100.00%) - BytesSent: 7.10 MB (7447568) - NetworkThroughput(*): 165.55 MB/sec - OverallThroughput: 76.77 MB/sec - PeakMemoryUsage: 4.95 MB (5192768) - RowsReturned: 444.64K (444644) - SerializeBatchTime: 48.395ms - TransmitDataRPCTime: 42.903ms - UncompressedRowBatchSize: 7.21 MB (7560556) CodeGen:(Total: 59.166ms, non-child: 59.166ms, % non-child: 100.00%) - CodegenTime: 1.567ms - CompileTime: 7.895ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 20.358ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 30.184ms HDFS_SCAN_NODE (id=0):(Total: 1s067ms, non-child: 1s067ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 6:1/40.00 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: Only following filters arrived: , waited 924ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:3 BytesRead(500.000ms): 0, 0, 9.21 MB, 9.21 MB, 9.21 MB - FooterProcessingTime: (Avg: 5.387ms ; Min: 5.387ms ; Max: 5.387ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.80 - BytesRead: 9.21 MB (9655696) - BytesReadDataNodeCache: 0 - BytesReadLocal: 9.21 MB (9655696) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 9.21 MB (9655696) - DecompressionTime: 7.295ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 20.80 MB (21814171) - PerReadThreadRawHdfsThroughput: 73.50 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 141.406ms - RowBatchQueuePutWaitTime: 1s633ms - RowsRead: 780.00K (780000) - RowsReturned: 444.64K (444644) - RowsReturnedRate: 416.59 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 7 (7) - ScannerThreadsTotalWallClockTime: 2s122ms - MaterializeTupleTime(*): 41.422ms - ScannerThreadsSysTime: 6.998ms - ScannerThreadsUserTime: 46.992ms - ScannerThreadsVoluntaryContextSwitches: 254 (254) - TotalRawHdfsReadTime(*): 125.285ms - TotalReadThroughput: 3.68 MB/sec Filter 1 (1.00 MB): - Rows processed: 338.66K (338656) - Rows rejected: 335.36K (335356) - Rows total: 780.00K (780000) Instance 7f40dcb034de70b7:22f (host=vc1517.foo:22000):(Total: 2s913ms, non-child: 1s700ms, % non-child: 58.36%) Hdfs split stats (:<# splits>/): 5:1/38.98 MB Filter 1 arrival: 1s304ms MemoryUsage(500.000ms): 0, 1.30 MB, 1.30 MB, 20.69 MB, 20.69 MB, 20.69 MB ThreadUsage(500.000ms): 1, 2, 2, 2, 2, 2 - AverageThreadTokens: 1.83 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 25.16 MB (26387413) - PerHostPeakMemUsage: 654.04 MB (685807279) - RowsProduced: 454.55K (454549) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1s638ms - TotalStorageWaitTime: 123.272ms - TotalThreadsInvoluntaryContextSwitches: 45 (45) - TotalThreadsTotalWallClockTime: 5s545ms - TotalThreadsSysTime: 35.994ms - TotalThreadsUserTime: 166.974ms - TotalThreadsVoluntaryContextSwitches: 681 (681) Fragment Instance Lifecycle Timings: - ExecTime: 2s842ms - ExecTreeExecTime: 1s073ms - OpenTime: 22.074ms - ExecTreeOpenTime: 27.989us - PrepareTime: 48.752ms - ExecTreePrepareTime: 115.160us DataStreamSender (dst_id=25):(Total: 96.020ms, non-child: 96.020ms, % non-child: 100.00%) - BytesSent: 7.26 MB (7614099) - NetworkThroughput(*): 160.92 MB/sec - OverallThroughput: 75.62 MB/sec - PeakMemoryUsage: 4.95 MB (5192768) - RowsReturned: 454.55K (454549) - SerializeBatchTime: 49.868ms - TransmitDataRPCTime: 45.125ms - UncompressedRowBatchSize: 7.37 MB (7728941) CodeGen:(Total: 43.269ms, non-child: 43.269ms, % non-child: 100.00%) - CodegenTime: 1.448ms - CompileTime: 6.033ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 14.710ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 21.848ms HDFS_SCAN_NODE (id=0):(Total: 1s073ms, non-child: 1s073ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:1/38.98 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: Only following filters arrived: , waited 944ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:3 BytesRead(500.000ms): 0, 0, 0, 8.98 MB, 8.98 MB, 8.98 MB - FooterProcessingTime: (Avg: 13.084ms ; Min: 13.084ms ; Max: 13.084ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 8.98 MB (9416941) - BytesReadDataNodeCache: 0 - BytesReadLocal: 8.98 MB (9416941) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 8.98 MB (9416941) - DecompressionTime: 7.114ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 19.25 MB (20188404) - PerReadThreadRawHdfsThroughput: 99.38 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 127.273ms - RowBatchQueuePutWaitTime: 1s623ms - RowsRead: 760.00K (760000) - RowsReturned: 454.55K (454549) - RowsReturnedRate: 423.29 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 15 (15) - ScannerThreadsTotalWallClockTime: 2s681ms - MaterializeTupleTime(*): 43.561ms - ScannerThreadsSysTime: 15.997ms - ScannerThreadsUserTime: 40.993ms - ScannerThreadsVoluntaryContextSwitches: 246 (246) - TotalRawHdfsReadTime(*): 90.362ms - TotalReadThroughput: 2.99 MB/sec Filter 1 (1.00 MB): - Rows processed: 308.42K (308416) - Rows rejected: 305.45K (305451) - Rows total: 760.00K (760000) Instance 7f40dcb034de70b7:23b (host=vd1340.foo:22000):(Total: 2s896ms, non-child: 1s687ms, % non-child: 58.25%) Hdfs split stats (:<# splits>/): 1:1/39.99 MB Filter 1 arrival: 1s319ms MemoryUsage(500.000ms): 0, 1.30 MB, 1.43 MB, 19.64 MB, 19.64 MB, 19.64 MB ThreadUsage(500.000ms): 1, 1, 2, 2, 2, 2 - AverageThreadTokens: 1.67 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 22.40 MB (23489212) - PerHostPeakMemUsage: 643.11 MB (674352602) - RowsProduced: 461.90K (461896) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1s622ms - TotalStorageWaitTime: 127.944ms - TotalThreadsInvoluntaryContextSwitches: 44 (44) - TotalThreadsTotalWallClockTime: 4s914ms - TotalThreadsSysTime: 30.994ms - TotalThreadsUserTime: 175.973ms - TotalThreadsVoluntaryContextSwitches: 637 (637) Fragment Instance Lifecycle Timings: - ExecTime: 2s795ms - ExecTreeExecTime: 1s044ms - OpenTime: 26.262ms - ExecTreeOpenTime: 34.293us - PrepareTime: 74.573ms - ExecTreePrepareTime: 102.475us DataStreamSender (dst_id=25):(Total: 95.688ms, non-child: 95.688ms, % non-child: 100.00%) - BytesSent: 7.37 MB (7732555) - NetworkThroughput(*): 160.63 MB/sec - OverallThroughput: 77.07 MB/sec - PeakMemoryUsage: 4.95 MB (5192768) - RowsReturned: 461.90K (461896) - SerializeBatchTime: 48.590ms - TransmitDataRPCTime: 45.909ms - UncompressedRowBatchSize: 7.49 MB (7853840) CodeGen:(Total: 69.324ms, non-child: 69.324ms, % non-child: 100.00%) - CodegenTime: 1.245ms - CompileTime: 6.558ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 17.807ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 44.246ms HDFS_SCAN_NODE (id=0):(Total: 1s044ms, non-child: 1s044ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:1/39.99 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: Only following filters arrived: , waited 903ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:3 BytesRead(500.000ms): 0, 0, 0, 9.21 MB, 9.21 MB, 9.21 MB - FooterProcessingTime: (Avg: 8.882ms ; Min: 8.882ms ; Max: 8.882ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.80 - BytesRead: 9.21 MB (9656584) - BytesReadDataNodeCache: 0 - BytesReadLocal: 9.21 MB (9656584) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 9.21 MB (9656584) - DecompressionTime: 6.444ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 17.06 MB (17891863) - PerReadThreadRawHdfsThroughput: 87.99 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 138.404ms - RowBatchQueuePutWaitTime: 1s606ms - RowsRead: 780.00K (780000) - RowsReturned: 461.90K (461896) - RowsReturnedRate: 442.30 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 14 (14) - ScannerThreadsTotalWallClockTime: 2s092ms - MaterializeTupleTime(*): 47.840ms - ScannerThreadsSysTime: 8.998ms - ScannerThreadsUserTime: 49.992ms - ScannerThreadsVoluntaryContextSwitches: 207 (207) - TotalRawHdfsReadTime(*): 104.657ms - TotalReadThroughput: 3.07 MB/sec Filter 1 (1.00 MB): - Rows processed: 321.25K (321248) - Rows rejected: 318.10K (318104) - Rows total: 780.00K (780000) Instance 7f40dcb034de70b7:234 (host=va1044.foo:22000):(Total: 2s873ms, non-child: 1s661ms, % non-child: 57.83%) Hdfs split stats (:<# splits>/): 0:1/38.98 MB Filter 1 arrival: 1s312ms MemoryUsage(500.000ms): 1.30 MB, 1.30 MB, 18.11 MB, 21.21 MB, 21.21 MB, 21.21 MB ThreadUsage(500.000ms): 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 22.63 MB (23726463) - PerHostPeakMemUsage: 650.49 MB (682086795) - RowsProduced: 616.80K (616800) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1s599ms - TotalStorageWaitTime: 94.603ms - TotalThreadsInvoluntaryContextSwitches: 58 (58) - TotalThreadsTotalWallClockTime: 5s475ms - TotalThreadsSysTime: 28.994ms - TotalThreadsUserTime: 207.967ms - TotalThreadsVoluntaryContextSwitches: 858 (858) Fragment Instance Lifecycle Timings: - ExecTime: 2s806ms - ExecTreeExecTime: 1s045ms - OpenTime: 20.880ms - ExecTreeOpenTime: 52.410us - PrepareTime: 45.457ms - ExecTreePrepareTime: 86.706us DataStreamSender (dst_id=25):(Total: 122.402ms, non-child: 122.402ms, % non-child: 100.00%) - BytesSent: 9.85 MB (10329867) - NetworkThroughput(*): 158.26 MB/sec - OverallThroughput: 80.48 MB/sec - PeakMemoryUsage: 4.95 MB (5192768) - RowsReturned: 616.80K (616800) - SerializeBatchTime: 59.343ms - TransmitDataRPCTime: 62.246ms - UncompressedRowBatchSize: 10.00 MB (10487744) CodeGen:(Total: 43.513ms, non-child: 43.513ms, % non-child: 100.00%) - CodegenTime: 960.423us - CompileTime: 5.793ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 13.730ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 23.450ms HDFS_SCAN_NODE (id=0):(Total: 1s045ms, non-child: 1s045ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/38.98 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: Only following filters arrived: , waited 944ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:3 BytesRead(500.000ms): 0, 0, 8.98 MB, 8.98 MB, 8.98 MB, 8.98 MB - FooterProcessingTime: (Avg: 7.665ms ; Min: 7.665ms ; Max: 7.665ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 8.98 MB (9417182) - BytesReadDataNodeCache: 0 - BytesReadLocal: 8.98 MB (9417182) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 8.98 MB (9417182) - DecompressionTime: 9.624ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 19.28 MB (20215492) - PerReadThreadRawHdfsThroughput: 114.40 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 98.835ms - RowBatchQueuePutWaitTime: 1s601ms - RowsRead: 760.00K (760000) - RowsReturned: 616.80K (616800) - RowsReturnedRate: 589.85 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 14 (14) - ScannerThreadsTotalWallClockTime: 2s648ms - MaterializeTupleTime(*): 43.996ms - ScannerThreadsSysTime: 6.998ms - ScannerThreadsUserTime: 52.991ms - ScannerThreadsVoluntaryContextSwitches: 405 (405) - TotalRawHdfsReadTime(*): 78.505ms - TotalReadThroughput: 2.99 MB/sec Filter 1 (1.00 MB): - Rows processed: 144.58K (144576) - Rows rejected: 143.20K (143200) - Rows total: 760.00K (760000) Instance 7f40dcb034de70b7:236 (host=vc1508.foo:22000):(Total: 2s869ms, non-child: 1s664ms, % non-child: 57.99%) Hdfs split stats (:<# splits>/): 3:1/38.97 MB Filter 1 arrival: 1s314ms MemoryUsage(500.000ms): 1.30 MB, 1.30 MB, 20.47 MB, 19.80 MB, 19.80 MB, 19.94 MB ThreadUsage(500.000ms): 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 24.34 MB (25518199) - PerHostPeakMemUsage: 656.07 MB (687935059) - RowsProduced: 459.66K (459662) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1s595ms - TotalStorageWaitTime: 113.344ms - TotalThreadsInvoluntaryContextSwitches: 46 (46) - TotalThreadsTotalWallClockTime: 5s454ms - TotalThreadsSysTime: 29.995ms - TotalThreadsUserTime: 184.971ms - TotalThreadsVoluntaryContextSwitches: 697 (697) Fragment Instance Lifecycle Timings: - ExecTime: 2s794ms - ExecTreeExecTime: 1s065ms - OpenTime: 23.177ms - ExecTreeOpenTime: 48.244us - PrepareTime: 51.724ms - ExecTreePrepareTime: 79.914us DataStreamSender (dst_id=25):(Total: 93.845ms, non-child: 93.845ms, % non-child: 100.00%) - BytesSent: 7.34 MB (7698915) - NetworkThroughput(*): 160.11 MB/sec - OverallThroughput: 78.24 MB/sec - PeakMemoryUsage: 4.95 MB (5192768) - RowsReturned: 459.66K (459662) - SerializeBatchTime: 47.080ms - TransmitDataRPCTime: 45.856ms - UncompressedRowBatchSize: 7.45 MB (7815862) CodeGen:(Total: 46.583ms, non-child: 46.583ms, % non-child: 100.00%) - CodegenTime: 1.135ms - CompileTime: 5.822ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 15.868ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 24.257ms HDFS_SCAN_NODE (id=0):(Total: 1s065ms, non-child: 1s065ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:1/38.97 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: Only following filters arrived: , waited 943ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:3 BytesRead(500.000ms): 0, 0, 8.98 MB, 8.98 MB, 8.98 MB, 8.98 MB - FooterProcessingTime: (Avg: 9.286ms ; Min: 9.286ms ; Max: 9.286ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 8.98 MB (9417080) - BytesReadDataNodeCache: 0 - BytesReadLocal: 8.98 MB (9417080) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 8.98 MB (9417080) - DecompressionTime: 7.160ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 18.26 MB (19144108) - PerReadThreadRawHdfsThroughput: 105.29 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 119.568ms - RowBatchQueuePutWaitTime: 1s556ms - RowsRead: 760.00K (760000) - RowsReturned: 459.66K (459662) - RowsReturnedRate: 431.52 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 14 (14) - ScannerThreadsTotalWallClockTime: 2s636ms - MaterializeTupleTime(*): 49.798ms - ScannerThreadsSysTime: 11.998ms - ScannerThreadsUserTime: 50.992ms - ScannerThreadsVoluntaryContextSwitches: 249 (249) - TotalRawHdfsReadTime(*): 85.297ms - TotalReadThroughput: 2.99 MB/sec Filter 1 (1.00 MB): - Rows processed: 303.30K (303296) - Rows rejected: 300.34K (300338) - Rows total: 760.00K (760000) Instance 7f40dcb034de70b7:264 (host=vc1534.foo:22000):(Total: 2s847ms, non-child: 1s667ms, % non-child: 58.55%) Hdfs split stats (:<# splits>/): 6:1/39.98 MB Filter 1 arrival: 1s359ms MemoryUsage(500.000ms): 1.30 MB, 1.30 MB, 18.85 MB, 19.85 MB, 19.85 MB, 4.46 MB ThreadUsage(500.000ms): 2, 2, 2, 2, 2, 1 - AverageThreadTokens: 1.83 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 24.56 MB (25758050) - PerHostPeakMemUsage: 638.37 MB (669376414) - RowsProduced: 459.86K (459856) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1s588ms - TotalStorageWaitTime: 115.203ms - TotalThreadsInvoluntaryContextSwitches: 39 (39) - TotalThreadsTotalWallClockTime: 5s417ms - TotalThreadsSysTime: 23.996ms - TotalThreadsUserTime: 168.974ms - TotalThreadsVoluntaryContextSwitches: 711 (711) Fragment Instance Lifecycle Timings: - ExecTime: 2s756ms - ExecTreeExecTime: 1s045ms - OpenTime: 19.849ms - ExecTreeOpenTime: 24.951us - PrepareTime: 70.721ms - ExecTreePrepareTime: 124.462us DataStreamSender (dst_id=25):(Total: 89.253ms, non-child: 89.253ms, % non-child: 100.00%) - BytesSent: 7.34 MB (7700364) - NetworkThroughput(*): 174.59 MB/sec - OverallThroughput: 82.28 MB/sec - PeakMemoryUsage: 4.95 MB (5192768) - RowsReturned: 459.86K (459856) - SerializeBatchTime: 45.186ms - TransmitDataRPCTime: 42.061ms - UncompressedRowBatchSize: 7.46 MB (7819160) CodeGen:(Total: 44.986ms, non-child: 44.986ms, % non-child: 100.00%) - CodegenTime: 837.133us - CompileTime: 4.939ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 13.734ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 25.895ms HDFS_SCAN_NODE (id=0):(Total: 1s045ms, non-child: 1s045ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 6:1/39.98 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: Only following filters arrived: , waited 923ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:3 BytesRead(500.000ms): 0, 0, 9.21 MB, 9.21 MB, 9.21 MB - FooterProcessingTime: (Avg: 7.883ms ; Min: 7.883ms ; Max: 7.883ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 9.21 MB (9655828) - BytesReadDataNodeCache: 0 - BytesReadLocal: 9.21 MB (9655828) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 9.21 MB (9655828) - DecompressionTime: 7.206ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 18.62 MB (19528359) - PerReadThreadRawHdfsThroughput: 92.35 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 120.757ms - RowBatchQueuePutWaitTime: 1s566ms - RowsRead: 780.00K (780000) - RowsReturned: 459.86K (459856) - RowsReturnedRate: 439.71 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 7 (7) - ScannerThreadsTotalWallClockTime: 2s641ms - MaterializeTupleTime(*): 45.432ms - ScannerThreadsSysTime: 7.998ms - ScannerThreadsUserTime: 50.992ms - ScannerThreadsVoluntaryContextSwitches: 254 (254) - TotalRawHdfsReadTime(*): 99.714ms - TotalReadThroughput: 3.68 MB/sec Filter 1 (1.00 MB): - Rows processed: 323.30K (323296) - Rows rejected: 320.14K (320144) - Rows total: 780.00K (780000) Instance 7f40dcb034de70b7:255 (host=vd1125.foo:22000):(Total: 2s845ms, non-child: 1s635ms, % non-child: 57.49%) Hdfs split stats (:<# splits>/): 3:1/40.00 MB 2:1/37.96 MB Filter 1 arrival: 1s343ms MemoryUsage(500.000ms): 1.30 MB, 1.30 MB, 34.43 MB, 34.43 MB, 34.43 MB ThreadUsage(500.000ms): 3, 3, 3, 3, 3 - AverageThreadTokens: 3.00 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 45.32 MB (47519344) - PerHostPeakMemUsage: 668.71 MB (701189762) - RowsProduced: 454.88K (454881) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1s562ms - TotalStorageWaitTime: 258.322ms - TotalThreadsInvoluntaryContextSwitches: 55 (55) - TotalThreadsTotalWallClockTime: 8s052ms - TotalThreadsSysTime: 35.994ms - TotalThreadsUserTime: 239.963ms - TotalThreadsVoluntaryContextSwitches: 735 (735) Fragment Instance Lifecycle Timings: - ExecTime: 2s755ms - ExecTreeExecTime: 1s060ms - OpenTime: 27.011ms - ExecTreeOpenTime: 44.305us - PrepareTime: 63.036ms - ExecTreePrepareTime: 132.900us DataStreamSender (dst_id=25):(Total: 93.332ms, non-child: 93.332ms, % non-child: 100.00%) - BytesSent: 7.26 MB (7614485) - NetworkThroughput(*): 159.73 MB/sec - OverallThroughput: 77.81 MB/sec - PeakMemoryUsage: 4.95 MB (5192768) - RowsReturned: 454.88K (454881) - SerializeBatchTime: 46.215ms - TransmitDataRPCTime: 45.462ms - UncompressedRowBatchSize: 7.38 MB (7734585) CodeGen:(Total: 55.361ms, non-child: 55.361ms, % non-child: 100.00%) - CodegenTime: 1.177ms - CompileTime: 5.558ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 20.230ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 29.027ms HDFS_SCAN_NODE (id=0):(Total: 1s060ms, non-child: 1s060ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:1/40.00 MB 2:1/37.96 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 2 out of 2 Runtime filters: Only following filters arrived: , waited 925ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:6 BytesRead(500.000ms): 0, 0, 17.96 MB, 17.96 MB, 17.96 MB - FooterProcessingTime: (Avg: 12.180ms ; Min: 9.634ms ; Max: 14.725ms ; Number of samples: 2) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 2.00 - BytesRead: 17.96 MB (18833149) - BytesReadDataNodeCache: 0 - BytesReadLocal: 17.96 MB (18833149) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 17.96 MB (18833149) - DecompressionTime: 15.447ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 2 (2) - NumRowGroups: 2 (2) - NumScannerThreadsStarted: 2 (2) - PeakMemoryUsage: 40.69 MB (42664885) - PerReadThreadRawHdfsThroughput: 87.47 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 133.481ms - RowBatchQueuePutWaitTime: 3s071ms - RowsRead: 1.52M (1520000) - RowsReturned: 454.88K (454881) - RowsReturnedRate: 428.77 K/sec - ScanRangesComplete: 2 (2) - ScannerThreadsInvoluntaryContextSwitches: 23 (23) - ScannerThreadsTotalWallClockTime: 5s270ms - MaterializeTupleTime(*): 96.344ms - ScannerThreadsSysTime: 13.997ms - ScannerThreadsUserTime: 108.983ms - ScannerThreadsVoluntaryContextSwitches: 287 (287) - TotalRawHdfsReadTime(*): 205.332ms - TotalReadThroughput: 7.18 MB/sec Filter 1 (1.00 MB): - Rows processed: 1.08M (1075584) - Rows rejected: 1.07M (1065119) - Rows total: 1.52M (1520000) Instance 7f40dcb034de70b7:272 (host=vc1513.foo:22000):(Total: 2s791ms, non-child: 1s602ms, % non-child: 57.41%) Hdfs split stats (:<# splits>/): 4:1/39.99 MB Filter 1 arrival: 1s368ms MemoryUsage(500.000ms): 1.29 MB, 1.30 MB, 5.32 MB, 22.03 MB, 22.03 MB, 22.03 MB ThreadUsage(500.000ms): 1, 2, 2, 2, 2, 2 - AverageThreadTokens: 1.83 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 25.34 MB (26569796) - PerHostPeakMemUsage: 639.43 MB (670489415) - RowsProduced: 443.62K (443621) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1s540ms - TotalStorageWaitTime: 120.904ms - TotalThreadsInvoluntaryContextSwitches: 44 (44) - TotalThreadsTotalWallClockTime: 5s319ms - TotalThreadsSysTime: 23.995ms - TotalThreadsUserTime: 176.972ms - TotalThreadsVoluntaryContextSwitches: 611 (611) Fragment Instance Lifecycle Timings: - ExecTime: 2s707ms - ExecTreeExecTime: 1s049ms - OpenTime: 23.606ms - ExecTreeOpenTime: 32.277us - PrepareTime: 59.604ms - ExecTreePrepareTime: 96.171us DataStreamSender (dst_id=25):(Total: 88.104ms, non-child: 88.104ms, % non-child: 100.00%) - BytesSent: 7.09 MB (7433060) - NetworkThroughput(*): 171.46 MB/sec - OverallThroughput: 80.46 MB/sec - PeakMemoryUsage: 4.95 MB (5192768) - RowsReturned: 443.62K (443621) - SerializeBatchTime: 45.043ms - TransmitDataRPCTime: 41.344ms - UncompressedRowBatchSize: 7.19 MB (7543165) CodeGen:(Total: 50.861ms, non-child: 50.861ms, % non-child: 100.00%) - CodegenTime: 914.334us - CompileTime: 5.959ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 16.534ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 27.892ms HDFS_SCAN_NODE (id=0):(Total: 1s049ms, non-child: 1s049ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:1/39.99 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: Only following filters arrived: , waited 923ms Hdfs Read Thread Concurrency Bucket: 0:80% 1:20% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:3 BytesRead(500.000ms): 0, 0, 100.00 KB, 9.21 MB, 9.21 MB, 9.21 MB - FooterProcessingTime: (Avg: 8.713ms ; Min: 8.713ms ; Max: 8.713ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.20 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 9.21 MB (9655464) - BytesReadDataNodeCache: 0 - BytesReadLocal: 9.21 MB (9655464) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 9.21 MB (9655464) - DecompressionTime: 8.034ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 20.35 MB (21343578) - PerReadThreadRawHdfsThroughput: 95.70 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 124.092ms - RowBatchQueuePutWaitTime: 1s504ms - RowsRead: 780.00K (780000) - RowsReturned: 443.62K (443621) - RowsReturnedRate: 422.56 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 17 (17) - ScannerThreadsTotalWallClockTime: 2s588ms - MaterializeTupleTime(*): 53.476ms - ScannerThreadsSysTime: 6.998ms - ScannerThreadsUserTime: 59.990ms - ScannerThreadsVoluntaryContextSwitches: 180 (180) - TotalRawHdfsReadTime(*): 96.221ms - TotalReadThroughput: 3.07 MB/sec Filter 1 (1.00 MB): - Rows processed: 339.68K (339680) - Rows rejected: 336.38K (336379) - Rows total: 780.00K (780000) Instance 7f40dcb034de70b7:26d (host=vd1127.foo:22000):(Total: 2s789ms, non-child: 1s568ms, % non-child: 56.22%) Hdfs split stats (:<# splits>/): 6:1/38.98 MB 0:1/38.98 MB Filter 1 arrival: 1s371ms MemoryUsage(500.000ms): 1.30 MB, 1.30 MB, 33.62 MB, 33.62 MB, 33.62 MB ThreadUsage(500.000ms): 1, 3, 3, 3, 3 - AverageThreadTokens: 2.60 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 44.16 MB (46302838) - PerHostPeakMemUsage: 669.07 MB (701572879) - RowsProduced: 462.12K (462115) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1s503ms - TotalStorageWaitTime: 366.006ms - TotalThreadsInvoluntaryContextSwitches: 54 (54) - TotalThreadsTotalWallClockTime: 6s638ms - TotalThreadsSysTime: 31.994ms - TotalThreadsUserTime: 223.966ms - TotalThreadsVoluntaryContextSwitches: 714 (714) Fragment Instance Lifecycle Timings: - ExecTime: 2s710ms - ExecTreeExecTime: 1s067ms - OpenTime: 20.252ms - ExecTreeOpenTime: 27.397us - PrepareTime: 59.042ms - ExecTreePrepareTime: 129.007us DataStreamSender (dst_id=25):(Total: 102.380ms, non-child: 102.380ms, % non-child: 100.00%) - BytesSent: 7.39 MB (7744213) - NetworkThroughput(*): 159.26 MB/sec - OverallThroughput: 72.14 MB/sec - PeakMemoryUsage: 4.95 MB (5192768) - RowsReturned: 462.12K (462115) - SerializeBatchTime: 53.987ms - TransmitDataRPCTime: 46.374ms - UncompressedRowBatchSize: 7.49 MB (7857563) CodeGen:(Total: 51.533ms, non-child: 51.533ms, % non-child: 100.00%) - CodegenTime: 965.026us - CompileTime: 5.285ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 13.621ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 32.177ms HDFS_SCAN_NODE (id=0):(Total: 1s067ms, non-child: 1s067ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 6:1/38.98 MB 0:1/38.98 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 2 out of 2 Runtime filters: Only following filters arrived: , waited 924ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:6 BytesRead(500.000ms): 0, 0, 17.96 MB, 17.96 MB, 17.96 MB - FooterProcessingTime: (Avg: 98.920ms ; Min: 30.861ms ; Max: 166.979ms ; Number of samples: 2) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.60 - BytesRead: 17.96 MB (18833338) - BytesReadDataNodeCache: 0 - BytesReadLocal: 17.96 MB (18833338) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 17.96 MB (18833338) - DecompressionTime: 12.379ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 2 (2) - NumRowGroups: 2 (2) - NumScannerThreadsStarted: 2 (2) - PeakMemoryUsage: 39.26 MB (41169851) - PerReadThreadRawHdfsThroughput: 119.29 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 141.757ms - RowBatchQueuePutWaitTime: 2s779ms - RowsRead: 1.52M (1520000) - RowsReturned: 462.12K (462115) - RowsReturnedRate: 432.88 K/sec - ScanRangesComplete: 2 (2) - ScannerThreadsInvoluntaryContextSwitches: 17 (17) - ScannerThreadsTotalWallClockTime: 3s908ms - MaterializeTupleTime(*): 80.265ms - ScannerThreadsSysTime: 10.997ms - ScannerThreadsUserTime: 90.986ms - ScannerThreadsVoluntaryContextSwitches: 283 (283) - TotalRawHdfsReadTime(*): 150.564ms - TotalReadThroughput: 7.18 MB/sec Filter 1 (1.00 MB): - Rows processed: 1.07M (1068416) - Rows rejected: 1.06M (1057885) - Rows total: 1.52M (1520000) Instance 7f40dcb034de70b7:21a (host=vc1533.foo:22000):(Total: 2s776ms, non-child: 1s556ms, % non-child: 56.07%) Hdfs split stats (:<# splits>/): 7:1/38.97 MB Filter 1 arrival: 1s281ms MemoryUsage(500.000ms): 1.30 MB, 1.30 MB, 19.38 MB, 19.38 MB, 19.38 MB ThreadUsage(500.000ms): 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 23.69 MB (24838241) - PerHostPeakMemUsage: 657.30 MB (689225912) - RowsProduced: 463.78K (463777) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1s488ms - TotalStorageWaitTime: 104.333ms - TotalThreadsInvoluntaryContextSwitches: 77 (77) - TotalThreadsTotalWallClockTime: 5s294ms - TotalThreadsSysTime: 33.995ms - TotalThreadsUserTime: 183.971ms - TotalThreadsVoluntaryContextSwitches: 696 (696) Fragment Instance Lifecycle Timings: - ExecTime: 2s709ms - ExecTreeExecTime: 1s081ms - OpenTime: 20.771ms - ExecTreeOpenTime: 30.832us - PrepareTime: 46.484ms - ExecTreePrepareTime: 86.856us DataStreamSender (dst_id=25):(Total: 94.923ms, non-child: 94.923ms, % non-child: 100.00%) - BytesSent: 7.40 MB (7764023) - NetworkThroughput(*): 162.31 MB/sec - OverallThroughput: 78.00 MB/sec - PeakMemoryUsage: 4.95 MB (5192768) - RowsReturned: 463.78K (463777) - SerializeBatchTime: 48.483ms - TransmitDataRPCTime: 45.618ms - UncompressedRowBatchSize: 7.52 MB (7885817) CodeGen:(Total: 43.191ms, non-child: 43.191ms, % non-child: 100.00%) - CodegenTime: 1.081ms - CompileTime: 5.572ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 14.142ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 22.763ms HDFS_SCAN_NODE (id=0):(Total: 1s081ms, non-child: 1s081ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:1/38.97 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: Only following filters arrived: , waited 944ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:3 BytesRead(500.000ms): 0, 0, 8.98 MB, 8.98 MB, 8.98 MB - FooterProcessingTime: (Avg: 10.339ms ; Min: 10.339ms ; Max: 10.339ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 8.98 MB (9416392) - BytesReadDataNodeCache: 0 - BytesReadLocal: 8.98 MB (9416392) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 8.98 MB (9416392) - DecompressionTime: 7.542ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 17.64 MB (18492245) - PerReadThreadRawHdfsThroughput: 113.05 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 135.118ms - RowBatchQueuePutWaitTime: 1s471ms - RowsRead: 760.00K (760000) - RowsReturned: 463.78K (463777) - RowsReturnedRate: 428.81 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 29 (29) - ScannerThreadsTotalWallClockTime: 2s564ms - MaterializeTupleTime(*): 50.681ms - ScannerThreadsSysTime: 10.998ms - ScannerThreadsUserTime: 52.991ms - ScannerThreadsVoluntaryContextSwitches: 272 (272) - TotalRawHdfsReadTime(*): 79.437ms - TotalReadThroughput: 3.59 MB/sec Filter 1 (1.00 MB): - Rows processed: 299.20K (299200) - Rows rejected: 296.22K (296223) - Rows total: 760.00K (760000) Instance 7f40dcb034de70b7:20a (host=va1039.foo:22000):(Total: 2s772ms, non-child: 1s548ms, % non-child: 55.87%) Hdfs split stats (:<# splits>/): 2:1/38.98 MB Filter 1 arrival: 1s216ms MemoryUsage(500.000ms): 1.52 MB, 1.30 MB, 1.43 MB, 5.20 MB, 5.20 MB, 5.20 MB ThreadUsage(500.000ms): 1, 2, 2, 1, 1, 1 - AverageThreadTokens: 1.33 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 22.39 MB (23481832) - PerHostPeakMemUsage: 630.19 MB (660802587) - RowsProduced: 293.50K (293497) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1s487ms - TotalStorageWaitTime: 99.010ms - TotalThreadsInvoluntaryContextSwitches: 65 (65) - TotalThreadsTotalWallClockTime: 3s863ms - TotalThreadsSysTime: 21.997ms - TotalThreadsUserTime: 144.978ms - TotalThreadsVoluntaryContextSwitches: 605 (605) Fragment Instance Lifecycle Timings: - ExecTime: 2s697ms - ExecTreeExecTime: 1s101ms - OpenTime: 21.420ms - ExecTreeOpenTime: 33.574us - PrepareTime: 54.083ms - ExecTreePrepareTime: 87.986us DataStreamSender (dst_id=25):(Total: 73.994ms, non-child: 73.994ms, % non-child: 100.00%) - BytesSent: 4.68 MB (4910660) - NetworkThroughput(*): 159.94 MB/sec - OverallThroughput: 63.29 MB/sec - PeakMemoryUsage: 4.95 MB (5192768) - RowsReturned: 293.50K (293497) - SerializeBatchTime: 43.930ms - TransmitDataRPCTime: 29.281ms - UncompressedRowBatchSize: 4.76 MB (4990521) CodeGen:(Total: 48.417ms, non-child: 48.417ms, % non-child: 100.00%) - CodegenTime: 1.980ms - CompileTime: 6.033ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 14.240ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 27.632ms HDFS_SCAN_NODE (id=0):(Total: 1s101ms, non-child: 1s101ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:1/38.98 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: Only following filters arrived: , waited 944ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:3 BytesRead(500.000ms): 0, 0, 0 - FooterProcessingTime: (Avg: 6.304ms ; Min: 6.304ms ; Max: 6.304ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 8.98 MB (9417011) - BytesReadDataNodeCache: 0 - BytesReadLocal: 8.98 MB (9417011) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 8.98 MB (9417011) - DecompressionTime: 4.816ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 16.45 MB (17248498) - PerReadThreadRawHdfsThroughput: 107.20 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 155.569ms - RowBatchQueuePutWaitTime: 37.486ms - RowsRead: 760.00K (760000) - RowsReturned: 293.50K (293497) - RowsReturnedRate: 266.53 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 9 (9) - ScannerThreadsTotalWallClockTime: 1s145ms - MaterializeTupleTime(*): 36.715ms - ScannerThreadsSysTime: 5.999ms - ScannerThreadsUserTime: 38.994ms - ScannerThreadsVoluntaryContextSwitches: 164 (164) - TotalRawHdfsReadTime(*): 83.774ms - TotalReadThroughput: 0.00 /sec Filter 1 (1.00 MB): - Rows processed: 471.23K (471232) - Rows rejected: 466.50K (466503) - Rows total: 760.00K (760000) Instance 7f40dcb034de70b7:265 (host=vd1139.foo:22000):(Total: 2s757ms, non-child: 1s540ms, % non-child: 55.88%) Hdfs split stats (:<# splits>/): 5:1/40.01 MB 6:1/37.97 MB Filter 1 arrival: 1s362ms MemoryUsage(500.000ms): 1.30 MB, 1.30 MB, 23.51 MB, 33.17 MB, 33.17 MB ThreadUsage(500.000ms): 1, 1, 3, 3, 3 - AverageThreadTokens: 2.20 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 44.70 MB (46866688) - PerHostPeakMemUsage: 663.07 MB (695281687) - RowsProduced: 464.05K (464052) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1s490ms - TotalStorageWaitTime: 352.546ms - TotalThreadsInvoluntaryContextSwitches: 50 (50) - TotalThreadsTotalWallClockTime: 5s978ms - TotalThreadsSysTime: 32.994ms - TotalThreadsUserTime: 190.969ms - TotalThreadsVoluntaryContextSwitches: 722 (722) Fragment Instance Lifecycle Timings: - ExecTime: 2s694ms - ExecTreeExecTime: 1s078ms - OpenTime: 18.013ms - ExecTreeOpenTime: 22.554us - PrepareTime: 44.931ms - ExecTreePrepareTime: 149.561us DataStreamSender (dst_id=25):(Total: 97.775ms, non-child: 97.775ms, % non-child: 100.00%) - BytesSent: 7.41 MB (7773841) - NetworkThroughput(*): 151.14 MB/sec - OverallThroughput: 75.82 MB/sec - PeakMemoryUsage: 4.95 MB (5192768) - RowsReturned: 464.05K (464052) - SerializeBatchTime: 47.979ms - TransmitDataRPCTime: 49.050ms - UncompressedRowBatchSize: 7.52 MB (7890492) CodeGen:(Total: 40.218ms, non-child: 40.218ms, % non-child: 100.00%) - CodegenTime: 909.418us - CompileTime: 4.301ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 12.726ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 22.836ms HDFS_SCAN_NODE (id=0):(Total: 1s078ms, non-child: 1s078ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:1/40.01 MB 6:1/37.97 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 2 out of 2 Runtime filters: Only following filters arrived: , waited 945ms Hdfs Read Thread Concurrency Bucket: 0:80% 1:20% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:6 BytesRead(500.000ms): 0, 0, 9.31 MB, 17.96 MB, 17.96 MB - FooterProcessingTime: (Avg: 79.843ms ; Min: 6.904ms ; Max: 152.783ms ; Number of samples: 2) - AverageHdfsReadThreadConcurrency: 0.20 - AverageScannerThreadConcurrency: 1.20 - BytesRead: 17.96 MB (18833801) - BytesReadDataNodeCache: 0 - BytesReadLocal: 17.96 MB (18833801) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 17.96 MB (18833801) - DecompressionTime: 10.486ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 2 (2) - NumRowGroups: 2 (2) - NumScannerThreadsStarted: 2 (2) - PeakMemoryUsage: 38.65 MB (40522666) - PerReadThreadRawHdfsThroughput: 101.62 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 130.928ms - RowBatchQueuePutWaitTime: 2s730ms - RowsRead: 1.52M (1520000) - RowsReturned: 464.05K (464052) - RowsReturnedRate: 430.19 K/sec - ScanRangesComplete: 2 (2) - ScannerThreadsInvoluntaryContextSwitches: 17 (17) - ScannerThreadsTotalWallClockTime: 3s266ms - MaterializeTupleTime(*): 66.007ms - ScannerThreadsSysTime: 7.998ms - ScannerThreadsUserTime: 76.987ms - ScannerThreadsVoluntaryContextSwitches: 273 (273) - TotalRawHdfsReadTime(*): 176.751ms - TotalReadThroughput: 7.18 MB/sec Filter 1 (1.00 MB): - Rows processed: 1.07M (1066368) - Rows rejected: 1.06M (1055948) - Rows total: 1.52M (1520000) Instance 7f40dcb034de70b7:23a (host=vd1332.foo:22000):(Total: 2s729ms, non-child: 1s517ms, % non-child: 55.59%) Hdfs split stats (:<# splits>/): 0:1/38.99 MB Filter 1 arrival: 1s319ms MemoryUsage(500.000ms): 1.30 MB, 1.30 MB, 20.52 MB, 21.52 MB, 21.52 MB, 2.92 MB ThreadUsage(500.000ms): 2, 2, 2, 2, 2, 1 - AverageThreadTokens: 1.83 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 25.56 MB (26798641) - PerHostPeakMemUsage: 632.37 MB (663091628) - RowsProduced: 449.49K (449492) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1s451ms - TotalStorageWaitTime: 96.401ms - TotalThreadsInvoluntaryContextSwitches: 75 (75) - TotalThreadsTotalWallClockTime: 5s196ms - TotalThreadsSysTime: 30.995ms - TotalThreadsUserTime: 188.971ms - TotalThreadsVoluntaryContextSwitches: 860 (860) Fragment Instance Lifecycle Timings: - ExecTime: 2s660ms - ExecTreeExecTime: 1s069ms - OpenTime: 20.753ms - ExecTreeOpenTime: 43.568us - PrepareTime: 48.768ms - ExecTreePrepareTime: 85.657us DataStreamSender (dst_id=25):(Total: 97.309ms, non-child: 97.309ms, % non-child: 100.00%) - BytesSent: 7.18 MB (7529000) - NetworkThroughput(*): 163.62 MB/sec - OverallThroughput: 73.79 MB/sec - PeakMemoryUsage: 4.95 MB (5192768) - RowsReturned: 449.49K (449492) - SerializeBatchTime: 51.752ms - TransmitDataRPCTime: 43.884ms - UncompressedRowBatchSize: 7.29 MB (7642972) CodeGen:(Total: 45.243ms, non-child: 45.243ms, % non-child: 100.00%) - CodegenTime: 946.111us - CompileTime: 5.780ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 13.942ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 24.989ms HDFS_SCAN_NODE (id=0):(Total: 1s069ms, non-child: 1s069ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/38.99 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: Only following filters arrived: , waited 944ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:3 BytesRead(500.000ms): 0, 0, 8.98 MB, 8.98 MB, 8.98 MB - FooterProcessingTime: (Avg: 4.314ms ; Min: 4.314ms ; Max: 4.314ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 8.98 MB (9417814) - BytesReadDataNodeCache: 0 - BytesReadLocal: 8.98 MB (9417814) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 8.98 MB (9417814) - DecompressionTime: 8.085ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 20.23 MB (21211074) - PerReadThreadRawHdfsThroughput: 110.25 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 123.104ms - RowBatchQueuePutWaitTime: 1s432ms - RowsRead: 760.00K (760000) - RowsReturned: 449.49K (449492) - RowsReturnedRate: 420.15 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 17 (17) - ScannerThreadsTotalWallClockTime: 2s515ms - MaterializeTupleTime(*): 54.121ms - ScannerThreadsSysTime: 14.997ms - ScannerThreadsUserTime: 52.991ms - ScannerThreadsVoluntaryContextSwitches: 308 (308) - TotalRawHdfsReadTime(*): 81.461ms - TotalReadThroughput: 3.59 MB/sec Filter 1 (1.00 MB): - Rows processed: 313.54K (313536) - Rows rejected: 310.51K (310508) - Rows total: 760.00K (760000) Instance 7f40dcb034de70b7:227 (host=vc1529.foo:22000):(Total: 2s729ms, non-child: 1s525ms, % non-child: 55.90%) Hdfs split stats (:<# splits>/): 5:1/39.99 MB Filter 1 arrival: 1s295ms MemoryUsage(500.000ms): 1.30 MB, 1.30 MB, 19.52 MB, 19.52 MB, 19.52 MB ThreadUsage(500.000ms): 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 25.34 MB (26573541) - PerHostPeakMemUsage: 648.19 MB (679679839) - RowsProduced: 460.94K (460936) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1s470ms - TotalStorageWaitTime: 126.765ms - TotalThreadsInvoluntaryContextSwitches: 45 (45) - TotalThreadsTotalWallClockTime: 5s194ms - TotalThreadsSysTime: 24.996ms - TotalThreadsUserTime: 160.975ms - TotalThreadsVoluntaryContextSwitches: 696 (696) Fragment Instance Lifecycle Timings: - ExecTime: 2s666ms - ExecTreeExecTime: 1s076ms - OpenTime: 19.434ms - ExecTreeOpenTime: 22.655us - PrepareTime: 42.981ms - ExecTreePrepareTime: 69.964us DataStreamSender (dst_id=25):(Total: 89.590ms, non-child: 89.590ms, % non-child: 100.00%) - BytesSent: 7.36 MB (7717133) - NetworkThroughput(*): 163.36 MB/sec - OverallThroughput: 82.15 MB/sec - PeakMemoryUsage: 4.95 MB (5192768) - RowsReturned: 460.94K (460936) - SerializeBatchTime: 43.723ms - TransmitDataRPCTime: 45.051ms - UncompressedRowBatchSize: 7.47 MB (7837520) CodeGen:(Total: 37.338ms, non-child: 37.338ms, % non-child: 100.00%) - CodegenTime: 703.771us - CompileTime: 4.359ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 13.740ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 18.890ms HDFS_SCAN_NODE (id=0):(Total: 1s076ms, non-child: 1s076ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:1/39.99 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: Only following filters arrived: , waited 944ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:3 BytesRead(500.000ms): 0, 0, 9.21 MB, 9.21 MB, 9.21 MB - FooterProcessingTime: (Avg: 9.102ms ; Min: 9.102ms ; Max: 9.102ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 9.21 MB (9655766) - BytesReadDataNodeCache: 0 - BytesReadLocal: 9.21 MB (9655766) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 9.21 MB (9655766) - DecompressionTime: 6.728ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 19.31 MB (20243862) - PerReadThreadRawHdfsThroughput: 86.73 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 130.785ms - RowBatchQueuePutWaitTime: 1s443ms - RowsRead: 780.00K (780000) - RowsReturned: 460.94K (460936) - RowsReturnedRate: 428.12 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 10 (10) - ScannerThreadsTotalWallClockTime: 2s508ms - MaterializeTupleTime(*): 40.471ms - ScannerThreadsSysTime: 8.998ms - ScannerThreadsUserTime: 44.993ms - ScannerThreadsVoluntaryContextSwitches: 235 (235) - TotalRawHdfsReadTime(*): 106.179ms - TotalReadThroughput: 3.68 MB/sec Filter 1 (1.00 MB): - Rows processed: 322.27K (322272) - Rows rejected: 319.06K (319064) - Rows total: 780.00K (780000) Instance 7f40dcb034de70b7:235 (host=ve1127.foo:22000):(Total: 2s716ms, non-child: 1s515ms, % non-child: 55.79%) Hdfs split stats (:<# splits>/): 1:1/36.96 MB Filter 1 arrival: 1s312ms MemoryUsage(500.000ms): 1.30 MB, 1.30 MB, 20.20 MB, 20.20 MB, 20.20 MB ThreadUsage(500.000ms): 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 22.01 MB (23079138) - PerHostPeakMemUsage: 640.93 MB (672059297) - RowsProduced: 457.30K (457297) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1s456ms - TotalStorageWaitTime: 109.895ms - TotalThreadsInvoluntaryContextSwitches: 38 (38) - TotalThreadsTotalWallClockTime: 5s163ms - TotalThreadsSysTime: 23.995ms - TotalThreadsUserTime: 169.973ms - TotalThreadsVoluntaryContextSwitches: 734 (734) Fragment Instance Lifecycle Timings: - ExecTime: 2s641ms - ExecTreeExecTime: 1s063ms - OpenTime: 24.321ms - ExecTreeOpenTime: 29.101us - PrepareTime: 50.901ms - ExecTreePrepareTime: 87.511us DataStreamSender (dst_id=25):(Total: 89.491ms, non-child: 89.491ms, % non-child: 100.00%) - BytesSent: 7.30 MB (7657497) - NetworkThroughput(*): 167.39 MB/sec - OverallThroughput: 81.60 MB/sec - PeakMemoryUsage: 4.95 MB (5192768) - RowsReturned: 457.30K (457297) - SerializeBatchTime: 44.739ms - TransmitDataRPCTime: 43.628ms - UncompressedRowBatchSize: 7.42 MB (7775657) CodeGen:(Total: 48.167ms, non-child: 48.167ms, % non-child: 100.00%) - CodegenTime: 1.168ms - CompileTime: 5.289ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 17.479ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 24.820ms HDFS_SCAN_NODE (id=0):(Total: 1s063ms, non-child: 1s063ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:1/36.96 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: Only following filters arrived: , waited 944ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:3 BytesRead(500.000ms): 0, 0, 8.53 MB, 8.53 MB, 8.53 MB - FooterProcessingTime: (Avg: 10.722ms ; Min: 10.722ms ; Max: 10.722ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 8.53 MB (8939614) - BytesReadDataNodeCache: 0 - BytesReadLocal: 8.53 MB (8939614) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 8.53 MB (8939614) - DecompressionTime: 5.671ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 17.17 MB (18003022) - PerReadThreadRawHdfsThroughput: 97.14 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 117.447ms - RowBatchQueuePutWaitTime: 1s418ms - RowsRead: 720.00K (720000) - RowsReturned: 457.30K (457297) - RowsReturnedRate: 429.97 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 7 (7) - ScannerThreadsTotalWallClockTime: 2s497ms - MaterializeTupleTime(*): 42.479ms - ScannerThreadsSysTime: 6.998ms - ScannerThreadsUserTime: 46.992ms - ScannerThreadsVoluntaryContextSwitches: 280 (280) - TotalRawHdfsReadTime(*): 87.763ms - TotalReadThroughput: 3.41 MB/sec Filter 1 (1.00 MB): - Rows processed: 265.34K (265344) - Rows rejected: 262.70K (262703) - Rows total: 720.00K (720000) Instance 7f40dcb034de70b7:211 (host=vd1333.foo:22000):(Total: 2s697ms, non-child: 1s480ms, % non-child: 54.90%) Hdfs split stats (:<# splits>/): 5:1/37.97 MB Filter 1 arrival: 1s245ms MemoryUsage(500.000ms): 1.30 MB, 1.30 MB, 20.53 MB, 20.53 MB, 20.53 MB ThreadUsage(500.000ms): 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 21.25 MB (22279410) - PerHostPeakMemUsage: 648.81 MB (680327850) - RowsProduced: 623.71K (623713) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1s436ms - TotalStorageWaitTime: 97.423ms - TotalThreadsInvoluntaryContextSwitches: 47 (47) - TotalThreadsTotalWallClockTime: 5s129ms - TotalThreadsSysTime: 29.995ms - TotalThreadsUserTime: 178.973ms - TotalThreadsVoluntaryContextSwitches: 770 (770) Fragment Instance Lifecycle Timings: - ExecTime: 2s642ms - ExecTreeExecTime: 1s067ms - OpenTime: 20.146ms - ExecTreeOpenTime: 29.535us - PrepareTime: 34.298ms - ExecTreePrepareTime: 131.488us DataStreamSender (dst_id=25):(Total: 115.968ms, non-child: 115.968ms, % non-child: 100.00%) - BytesSent: 9.96 MB (10447857) - NetworkThroughput(*): 168.64 MB/sec - OverallThroughput: 85.92 MB/sec - PeakMemoryUsage: 4.95 MB (5192768) - RowsReturned: 623.71K (623713) - SerializeBatchTime: 56.330ms - TransmitDataRPCTime: 59.082ms - UncompressedRowBatchSize: 10.11 MB (10605265) CodeGen:(Total: 32.690ms, non-child: 32.690ms, % non-child: 100.00%) - CodegenTime: 709.951us - CompileTime: 5.135ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 13.976ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 13.202ms HDFS_SCAN_NODE (id=0):(Total: 1s067ms, non-child: 1s067ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:1/37.97 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: Only following filters arrived: , waited 963ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:3 BytesRead(500.000ms): 0, 0, 8.75 MB, 8.75 MB, 8.75 MB - FooterProcessingTime: (Avg: 10.300ms ; Min: 10.300ms ; Max: 10.300ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 8.75 MB (9178503) - BytesReadDataNodeCache: 0 - BytesReadLocal: 8.75 MB (9178503) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 8.75 MB (9178503) - DecompressionTime: 7.063ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 17.59 MB (18449463) - PerReadThreadRawHdfsThroughput: 122.33 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 100.957ms - RowBatchQueuePutWaitTime: 1s395ms - RowsRead: 740.00K (740000) - RowsReturned: 623.71K (623713) - RowsReturnedRate: 584.08 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 14 (14) - ScannerThreadsTotalWallClockTime: 2s466ms - MaterializeTupleTime(*): 41.827ms - ScannerThreadsSysTime: 9.998ms - ScannerThreadsUserTime: 45.993ms - ScannerThreadsVoluntaryContextSwitches: 334 (334) - TotalRawHdfsReadTime(*): 71.556ms - TotalReadThroughput: 3.50 MB/sec Filter 1 (1.00 MB): - Rows processed: 117.41K (117408) - Rows rejected: 116.29K (116287) - Rows total: 740.00K (740000) Instance 7f40dcb034de70b7:257 (host=ve1138.foo:22000):(Total: 2s692ms, non-child: 1s479ms, % non-child: 54.94%) Hdfs split stats (:<# splits>/): 5:1/38.98 MB 4:1/37.96 MB Filter 1 arrival: 1s349ms MemoryUsage(500.000ms): 1.30 MB, 1.30 MB, 32.37 MB, 32.37 MB, 32.37 MB ThreadUsage(500.000ms): 3, 3, 3, 3, 3 - AverageThreadTokens: 3.00 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 39.39 MB (41308446) - PerHostPeakMemUsage: 639.86 MB (670944698) - RowsProduced: 468.88K (468884) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1s421ms - TotalStorageWaitTime: 214.546ms - TotalThreadsInvoluntaryContextSwitches: 65 (65) - TotalThreadsTotalWallClockTime: 7s627ms - TotalThreadsSysTime: 38.992ms - TotalThreadsUserTime: 217.966ms - TotalThreadsVoluntaryContextSwitches: 864 (864) Fragment Instance Lifecycle Timings: - ExecTime: 2s626ms - ExecTreeExecTime: 1s077ms - OpenTime: 21.386ms - ExecTreeOpenTime: 25.644us - PrepareTime: 44.831ms - ExecTreePrepareTime: 71.776us DataStreamSender (dst_id=25):(Total: 91.999ms, non-child: 91.999ms, % non-child: 100.00%) - BytesSent: 7.48 MB (7845545) - NetworkThroughput(*): 168.74 MB/sec - OverallThroughput: 81.33 MB/sec - PeakMemoryUsage: 4.95 MB (5192768) - RowsReturned: 468.88K (468884) - SerializeBatchTime: 46.982ms - TransmitDataRPCTime: 44.340ms - UncompressedRowBatchSize: 7.60 MB (7972636) CodeGen:(Total: 43.613ms, non-child: 43.613ms, % non-child: 100.00%) - CodegenTime: 1.127ms - CompileTime: 5.324ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 14.750ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 22.931ms HDFS_SCAN_NODE (id=0):(Total: 1s077ms, non-child: 1s077ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:1/38.98 MB 4:1/37.96 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 2 out of 2 Runtime filters: Only following filters arrived: , waited 944ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:6 BytesRead(500.000ms): 0, 0, 17.73 MB, 17.73 MB, 17.73 MB - FooterProcessingTime: (Avg: 14.758ms ; Min: 12.879ms ; Max: 16.636ms ; Number of samples: 2) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 2.00 - BytesRead: 17.73 MB (18594888) - BytesReadDataNodeCache: 0 - BytesReadLocal: 17.73 MB (18594888) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 17.73 MB (18594888) - DecompressionTime: 11.930ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 2 (2) - NumRowGroups: 2 (2) - NumScannerThreadsStarted: 2 (2) - PeakMemoryUsage: 33.38 MB (35006051) - PerReadThreadRawHdfsThroughput: 117.32 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 131.309ms - RowBatchQueuePutWaitTime: 2s816ms - RowsRead: 1.50M (1500000) - RowsReturned: 468.88K (468884) - RowsReturnedRate: 435.01 K/sec - ScanRangesComplete: 2 (2) - ScannerThreadsInvoluntaryContextSwitches: 36 (36) - ScannerThreadsTotalWallClockTime: 4s979ms - MaterializeTupleTime(*): 93.204ms - ScannerThreadsSysTime: 14.996ms - ScannerThreadsUserTime: 100.984ms - ScannerThreadsVoluntaryContextSwitches: 415 (415) - TotalRawHdfsReadTime(*): 151.160ms - TotalReadThroughput: 7.09 MB/sec Filter 1 (1.00 MB): - Rows processed: 1.04M (1041248) - Rows rejected: 1.03M (1031116) - Rows total: 1.50M (1500000) Instance 7f40dcb034de70b7:23e (host=vd1102.foo:22000):(Total: 2s680ms, non-child: 1s482ms, % non-child: 55.32%) Hdfs split stats (:<# splits>/): 4:1/39.99 MB Filter 1 arrival: 1s320ms MemoryUsage(500.000ms): 1.30 MB, 1.30 MB, 20.78 MB, 21.52 MB, 21.52 MB, 2.77 MB ThreadUsage(500.000ms): 2, 2, 2, 2, 2, 1 - AverageThreadTokens: 1.83 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 26.01 MB (27271649) - PerHostPeakMemUsage: 648.43 MB (679927679) - RowsProduced: 449.75K (449748) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1s417ms - TotalStorageWaitTime: 138.667ms - TotalThreadsInvoluntaryContextSwitches: 38 (38) - TotalThreadsTotalWallClockTime: 5s093ms - TotalThreadsSysTime: 22.995ms - TotalThreadsUserTime: 168.974ms - TotalThreadsVoluntaryContextSwitches: 695 (695) Fragment Instance Lifecycle Timings: - ExecTime: 2s602ms - ExecTreeExecTime: 1s068ms - OpenTime: 22.989ms - ExecTreeOpenTime: 40.616us - PrepareTime: 54.689ms - ExecTreePrepareTime: 58.879us DataStreamSender (dst_id=25):(Total: 85.620ms, non-child: 85.620ms, % non-child: 100.00%) - BytesSent: 7.18 MB (7529739) - NetworkThroughput(*): 173.54 MB/sec - OverallThroughput: 83.87 MB/sec - PeakMemoryUsage: 4.95 MB (5192768) - RowsReturned: 449.75K (449748) - SerializeBatchTime: 43.247ms - TransmitDataRPCTime: 41.378ms - UncompressedRowBatchSize: 7.29 MB (7647324) CodeGen:(Total: 43.987ms, non-child: 43.987ms, % non-child: 100.00%) - CodegenTime: 1.904ms - CompileTime: 5.996ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 15.686ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 21.590ms HDFS_SCAN_NODE (id=0):(Total: 1s068ms, non-child: 1s068ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:1/39.99 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: Only following filters arrived: , waited 924ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:3 BytesRead(500.000ms): 0, 0, 9.21 MB, 9.21 MB, 9.21 MB - FooterProcessingTime: (Avg: 5.997ms ; Min: 5.997ms ; Max: 5.997ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 9.21 MB (9655796) - BytesReadDataNodeCache: 0 - BytesReadLocal: 9.21 MB (9655796) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 9.21 MB (9655796) - DecompressionTime: 7.410ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 20.61 MB (21614374) - PerReadThreadRawHdfsThroughput: 78.36 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 142.287ms - RowBatchQueuePutWaitTime: 1s391ms - RowsRead: 780.00K (780000) - RowsReturned: 449.75K (449748) - RowsReturnedRate: 421.09 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 9 (9) - ScannerThreadsTotalWallClockTime: 2s467ms - MaterializeTupleTime(*): 45.177ms - ScannerThreadsSysTime: 8.998ms - ScannerThreadsUserTime: 49.992ms - ScannerThreadsVoluntaryContextSwitches: 255 (255) - TotalRawHdfsReadTime(*): 117.508ms - TotalReadThroughput: 3.68 MB/sec Filter 1 (1.00 MB): - Rows processed: 333.54K (333536) - Rows rejected: 330.25K (330252) - Rows total: 780.00K (780000) Instance 7f40dcb034de70b7:224 (host=ve1136.foo:22000):(Total: 2s635ms, non-child: 1s417ms, % non-child: 53.77%) Hdfs split stats (:<# splits>/): 3:1/40.00 MB Filter 1 arrival: 1s292ms MemoryUsage(500.000ms): 1.30 MB, 1.30 MB, 5.32 MB, 20.25 MB, 20.25 MB, 4.99 MB ThreadUsage(500.000ms): 1, 2, 2, 2, 2, 1 - AverageThreadTokens: 1.67 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 26.09 MB (27356784) - PerHostPeakMemUsage: 646.97 MB (678400104) - RowsProduced: 457.75K (457745) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1s369ms - TotalStorageWaitTime: 136.959ms - TotalThreadsInvoluntaryContextSwitches: 43 (43) - TotalThreadsTotalWallClockTime: 5s048ms - TotalThreadsSysTime: 24.996ms - TotalThreadsUserTime: 154.975ms - TotalThreadsVoluntaryContextSwitches: 625 (625) Fragment Instance Lifecycle Timings: - ExecTime: 2s571ms - ExecTreeExecTime: 1s085ms - OpenTime: 19.218ms - ExecTreeOpenTime: 25.928us - PrepareTime: 44.592ms - ExecTreePrepareTime: 100.201us DataStreamSender (dst_id=25):(Total: 89.465ms, non-child: 89.465ms, % non-child: 100.00%) - BytesSent: 7.31 MB (7666192) - NetworkThroughput(*): 169.62 MB/sec - OverallThroughput: 81.72 MB/sec - PeakMemoryUsage: 4.95 MB (5192768) - RowsReturned: 457.75K (457745) - SerializeBatchTime: 45.565ms - TransmitDataRPCTime: 43.101ms - UncompressedRowBatchSize: 7.42 MB (7783273) CodeGen:(Total: 43.318ms, non-child: 43.318ms, % non-child: 100.00%) - CodegenTime: 1.142ms - CompileTime: 4.816ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 13.247ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 24.715ms HDFS_SCAN_NODE (id=0):(Total: 1s085ms, non-child: 1s085ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:1/40.00 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: Only following filters arrived: , waited 944ms Hdfs Read Thread Concurrency Bucket: 0:75% 1:25% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:3 BytesRead(500.000ms): 0, 0, 100.00 KB, 9.21 MB, 9.21 MB - FooterProcessingTime: (Avg: 7.641ms ; Min: 7.641ms ; Max: 7.641ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.25 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 9.21 MB (9655536) - BytesReadDataNodeCache: 0 - BytesReadLocal: 9.21 MB (9655536) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 9.21 MB (9655536) - DecompressionTime: 6.503ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 20.08 MB (21052707) - PerReadThreadRawHdfsThroughput: 79.63 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 139.958ms - RowBatchQueuePutWaitTime: 1s338ms - RowsRead: 780.00K (780000) - RowsReturned: 457.75K (457745) - RowsReturnedRate: 421.62 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 7 (7) - ScannerThreadsTotalWallClockTime: 2s457ms - MaterializeTupleTime(*): 39.340ms - ScannerThreadsSysTime: 10.998ms - ScannerThreadsUserTime: 40.993ms - ScannerThreadsVoluntaryContextSwitches: 198 (198) - TotalRawHdfsReadTime(*): 115.633ms - TotalReadThroughput: 3.68 MB/sec Filter 1 (1.00 MB): - Rows processed: 325.34K (325344) - Rows rejected: 322.25K (322255) - Rows total: 780.00K (780000) Instance 7f40dcb034de70b7:24f (host=ve1130.foo:22000):(Total: 2s619ms, non-child: 1s415ms, % non-child: 54.03%) Hdfs split stats (:<# splits>/): 2:1/37.97 MB 3:1/38.98 MB Filter 1 arrival: 1s340ms MemoryUsage(500.000ms): 1.30 MB, 1.30 MB, 17.79 MB, 33.74 MB, 33.74 MB, 2.90 MB ThreadUsage(500.000ms): 3, 3, 3, 3, 3, 1 - AverageThreadTokens: 2.67 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 40.31 MB (42272213) - PerHostPeakMemUsage: 660.51 MB (692594292) - RowsProduced: 460.94K (460939) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1s356ms - TotalStorageWaitTime: 217.212ms - TotalThreadsInvoluntaryContextSwitches: 58 (58) - TotalThreadsTotalWallClockTime: 7s436ms - TotalThreadsSysTime: 33.994ms - TotalThreadsUserTime: 228.963ms - TotalThreadsVoluntaryContextSwitches: 863 (863) Fragment Instance Lifecycle Timings: - ExecTime: 2s553ms - ExecTreeExecTime: 1s070ms - OpenTime: 19.678ms - ExecTreeOpenTime: 28.662us - PrepareTime: 45.647ms - ExecTreePrepareTime: 96.760us DataStreamSender (dst_id=25):(Total: 90.473ms, non-child: 90.473ms, % non-child: 100.00%) - BytesSent: 7.36 MB (7716133) - NetworkThroughput(*): 176.49 MB/sec - OverallThroughput: 81.34 MB/sec - PeakMemoryUsage: 4.95 MB (5192768) - RowsReturned: 460.94K (460939) - SerializeBatchTime: 47.982ms - TransmitDataRPCTime: 41.694ms - UncompressedRowBatchSize: 7.47 MB (7837571) CodeGen:(Total: 43.166ms, non-child: 43.166ms, % non-child: 100.00%) - CodegenTime: 1.076ms - CompileTime: 4.618ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 13.991ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 23.941ms HDFS_SCAN_NODE (id=0):(Total: 1s070ms, non-child: 1s070ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:1/37.97 MB 3:1/38.98 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 2 out of 2 Runtime filters: Only following filters arrived: , waited 943ms Hdfs Read Thread Concurrency Bucket: 0:80% 1:0% 2:20% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:6 BytesRead(500.000ms): 0, 0, 6.07 MB, 17.73 MB, 17.73 MB - FooterProcessingTime: (Avg: 9.619ms ; Min: 6.505ms ; Max: 12.733ms ; Number of samples: 2) - AverageHdfsReadThreadConcurrency: 0.40 - AverageScannerThreadConcurrency: 2.00 - BytesRead: 17.73 MB (18595609) - BytesReadDataNodeCache: 0 - BytesReadLocal: 17.73 MB (18595609) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 17.73 MB (18595609) - DecompressionTime: 12.998ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 2 (2) - NumRowGroups: 2 (2) - NumScannerThreadsStarted: 2 (2) - PeakMemoryUsage: 34.28 MB (35949330) - PerReadThreadRawHdfsThroughput: 107.52 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 123.914ms - RowBatchQueuePutWaitTime: 2s655ms - RowsRead: 1.50M (1500000) - RowsReturned: 460.94K (460939) - RowsReturnedRate: 430.67 K/sec - ScanRangesComplete: 2 (2) - ScannerThreadsInvoluntaryContextSwitches: 19 (19) - ScannerThreadsTotalWallClockTime: 4s863ms - MaterializeTupleTime(*): 97.822ms - ScannerThreadsSysTime: 13.997ms - ScannerThreadsUserTime: 108.982ms - ScannerThreadsVoluntaryContextSwitches: 387 (387) - TotalRawHdfsReadTime(*): 164.935ms - TotalReadThroughput: 7.09 MB/sec Filter 1 (1.00 MB): - Rows processed: 1.05M (1049440) - Rows rejected: 1.04M (1039061) - Rows total: 1.50M (1500000) Instance 7f40dcb034de70b7:26e (host=vd1113.foo:22000):(Total: 2s615ms, non-child: 1s416ms, % non-child: 54.17%) Hdfs split stats (:<# splits>/): 2:1/39.99 MB 3:1/38.98 MB Filter 1 arrival: 1s370ms MemoryUsage(500.000ms): 1.30 MB, 1.30 MB, 31.80 MB, 32.80 MB, 32.80 MB ThreadUsage(500.000ms): 3, 3, 3, 3, 3 - AverageThreadTokens: 3.00 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 43.18 MB (45279205) - PerHostPeakMemUsage: 664.58 MB (696867817) - RowsProduced: 466.29K (466286) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1s348ms - TotalStorageWaitTime: 243.261ms - TotalThreadsInvoluntaryContextSwitches: 47 (47) - TotalThreadsTotalWallClockTime: 7s382ms - TotalThreadsSysTime: 36.994ms - TotalThreadsUserTime: 229.965ms - TotalThreadsVoluntaryContextSwitches: 826 (826) Fragment Instance Lifecycle Timings: - ExecTime: 2s544ms - ExecTreeExecTime: 1s061ms - OpenTime: 26.584ms - ExecTreeOpenTime: 128.850us - PrepareTime: 44.264ms - ExecTreePrepareTime: 71.904us DataStreamSender (dst_id=25):(Total: 91.935ms, non-child: 91.935ms, % non-child: 100.00%) - BytesSent: 7.45 MB (7811635) - NetworkThroughput(*): 172.63 MB/sec - OverallThroughput: 81.03 MB/sec - PeakMemoryUsage: 4.95 MB (5192768) - RowsReturned: 466.29K (466286) - SerializeBatchTime: 47.738ms - TransmitDataRPCTime: 43.153ms - UncompressedRowBatchSize: 7.56 MB (7928470) CodeGen:(Total: 44.910ms, non-child: 44.910ms, % non-child: 100.00%) - CodegenTime: 932.895us - CompileTime: 9.419ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 15.726ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 19.324ms HDFS_SCAN_NODE (id=0):(Total: 1s061ms, non-child: 1s061ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:1/39.99 MB 3:1/38.98 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 2 out of 2 Runtime filters: Only following filters arrived: , waited 944ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:6 BytesRead(500.000ms): 0, 0, 18.19 MB, 18.19 MB, 18.19 MB - FooterProcessingTime: (Avg: 12.947ms ; Min: 11.667ms ; Max: 14.227ms ; Number of samples: 2) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 2.00 - BytesRead: 18.19 MB (19072478) - BytesReadDataNodeCache: 0 - BytesReadLocal: 18.19 MB (19072478) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 18.19 MB (19072478) - DecompressionTime: 12.890ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 2 (2) - NumRowGroups: 2 (2) - NumScannerThreadsStarted: 2 (2) - PeakMemoryUsage: 37.01 MB (38811729) - PerReadThreadRawHdfsThroughput: 93.32 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 114.762ms - RowBatchQueuePutWaitTime: 2s578ms - RowsRead: 1.54M (1540000) - RowsReturned: 466.29K (466286) - RowsReturnedRate: 439.08 K/sec - ScanRangesComplete: 2 (2) - ScannerThreadsInvoluntaryContextSwitches: 22 (22) - ScannerThreadsTotalWallClockTime: 4s811ms - MaterializeTupleTime(*): 90.834ms - ScannerThreadsSysTime: 15.997ms - ScannerThreadsUserTime: 96.985ms - ScannerThreadsVoluntaryContextSwitches: 359 (359) - TotalRawHdfsReadTime(*): 194.917ms - TotalReadThroughput: 7.28 MB/sec Filter 1 (1.00 MB): - Rows processed: 1.08M (1084320) - Rows rejected: 1.07M (1073714) - Rows total: 1.54M (1540000) Instance 7f40dcb034de70b7:245 (host=vd1327.foo:22000):(Total: 2s611ms, non-child: 1s410ms, % non-child: 54.02%) Hdfs split stats (:<# splits>/): 7:1/38.99 MB 0:1/36.95 MB Filter 1 arrival: 1s328ms MemoryUsage(500.000ms): 1.30 MB, 1.30 MB, 31.70 MB, 32.89 MB, 32.89 MB ThreadUsage(500.000ms): 1, 1, 3, 3, 3 - AverageThreadTokens: 2.20 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 45.18 MB (47378194) - PerHostPeakMemUsage: 664.10 MB (696357542) - RowsProduced: 632.95K (632953) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1s351ms - TotalStorageWaitTime: 197.798ms - TotalThreadsInvoluntaryContextSwitches: 42 (42) - TotalThreadsTotalWallClockTime: 6s207ms - TotalThreadsSysTime: 45.991ms - TotalThreadsUserTime: 209.968ms - TotalThreadsVoluntaryContextSwitches: 947 (947) Fragment Instance Lifecycle Timings: - ExecTime: 2s543ms - ExecTreeExecTime: 1s047ms - OpenTime: 21.088ms - ExecTreeOpenTime: 29.278us - PrepareTime: 46.211ms - ExecTreePrepareTime: 92.153us DataStreamSender (dst_id=25):(Total: 113.890ms, non-child: 113.890ms, % non-child: 100.00%) - BytesSent: 10.11 MB (10600433) - NetworkThroughput(*): 181.35 MB/sec - OverallThroughput: 88.76 MB/sec - PeakMemoryUsage: 4.95 MB (5192768) - RowsReturned: 632.95K (632953) - SerializeBatchTime: 56.949ms - TransmitDataRPCTime: 55.746ms - UncompressedRowBatchSize: 10.26 MB (10762345) CodeGen:(Total: 39.439ms, non-child: 39.439ms, % non-child: 100.00%) - CodegenTime: 905.612us - CompileTime: 5.501ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 14.268ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 19.167ms HDFS_SCAN_NODE (id=0):(Total: 1s047ms, non-child: 1s047ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:1/38.99 MB 0:1/36.95 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 2 out of 2 Runtime filters: Only following filters arrived: , waited 944ms Hdfs Read Thread Concurrency Bucket: 0:80% 1:20% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:6 BytesRead(500.000ms): 0, 0, 14.68 MB, 17.51 MB, 17.51 MB - FooterProcessingTime: (Avg: 12.940ms ; Min: 9.374ms ; Max: 16.507ms ; Number of samples: 2) - AverageHdfsReadThreadConcurrency: 0.20 - AverageScannerThreadConcurrency: 1.20 - BytesRead: 17.51 MB (18356714) - BytesReadDataNodeCache: 0 - BytesReadLocal: 17.51 MB (18356714) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 17.51 MB (18356714) - DecompressionTime: 11.400ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 2 (2) - NumRowGroups: 2 (2) - NumScannerThreadsStarted: 2 (2) - PeakMemoryUsage: 39.06 MB (40952723) - PerReadThreadRawHdfsThroughput: 123.55 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 100.352ms - RowBatchQueuePutWaitTime: 2s709ms - RowsRead: 1.48M (1480000) - RowsReturned: 632.95K (632953) - RowsReturnedRate: 604.39 K/sec - ScanRangesComplete: 2 (2) - ScannerThreadsInvoluntaryContextSwitches: 18 (18) - ScannerThreadsTotalWallClockTime: 3s642ms - MaterializeTupleTime(*): 73.609ms - ScannerThreadsSysTime: 21.995ms - ScannerThreadsUserTime: 73.988ms - ScannerThreadsVoluntaryContextSwitches: 487 (487) - TotalRawHdfsReadTime(*): 141.698ms - TotalReadThroughput: 7.00 MB/sec Filter 1 (1.00 MB): - Rows processed: 855.36K (855360) - Rows rejected: 847.05K (847047) - Rows total: 1.48M (1480000) Instance 7f40dcb034de70b7:24d (host=va1036.foo:22000):(Total: 2s578ms, non-child: 1s372ms, % non-child: 53.22%) Hdfs split stats (:<# splits>/): 4:1/38.99 MB 6:1/38.97 MB Filter 1 arrival: 1s336ms MemoryUsage(500.000ms): 1.30 MB, 1.30 MB, 31.12 MB, 32.12 MB, 32.12 MB ThreadUsage(500.000ms): 1, 3, 3, 3, 3 - AverageThreadTokens: 2.60 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 37.77 MB (39604822) - PerHostPeakMemUsage: 650.29 MB (681879328) - RowsProduced: 472.15K (472146) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1s306ms - TotalStorageWaitTime: 262.668ms - TotalThreadsInvoluntaryContextSwitches: 67 (67) - TotalThreadsTotalWallClockTime: 6s009ms - TotalThreadsSysTime: 37.993ms - TotalThreadsUserTime: 213.966ms - TotalThreadsVoluntaryContextSwitches: 764 (764) Fragment Instance Lifecycle Timings: - ExecTime: 2s485ms - ExecTreeExecTime: 1s048ms - OpenTime: 29.690ms - ExecTreeOpenTime: 40.263us - PrepareTime: 63.008ms - ExecTreePrepareTime: 101.317us DataStreamSender (dst_id=25):(Total: 102.983ms, non-child: 102.983ms, % non-child: 100.00%) - BytesSent: 7.54 MB (7906399) - NetworkThroughput(*): 155.03 MB/sec - OverallThroughput: 73.22 MB/sec - PeakMemoryUsage: 4.95 MB (5192768) - RowsReturned: 472.15K (472146) - SerializeBatchTime: 52.254ms - TransmitDataRPCTime: 48.636ms - UncompressedRowBatchSize: 7.66 MB (8028090) CodeGen:(Total: 54.502ms, non-child: 54.502ms, % non-child: 100.00%) - CodegenTime: 1.026ms - CompileTime: 8.447ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 19.966ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 25.554ms HDFS_SCAN_NODE (id=0):(Total: 1s048ms, non-child: 1s048ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:1/38.99 MB 6:1/38.97 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 2 out of 2 Runtime filters: Only following filters arrived: , waited 909ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:6 BytesRead(500.000ms): 0, 0, 17.96 MB, 17.96 MB, 17.96 MB - FooterProcessingTime: (Avg: 16.570ms ; Min: 13.779ms ; Max: 19.361ms ; Number of samples: 2) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.60 - BytesRead: 17.96 MB (18834221) - BytesReadDataNodeCache: 0 - BytesReadLocal: 17.96 MB (18834221) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 17.96 MB (18834221) - DecompressionTime: 10.493ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 2 (2) - NumRowGroups: 2 (2) - NumScannerThreadsStarted: 2 (2) - PeakMemoryUsage: 31.57 MB (33104779) - PerReadThreadRawHdfsThroughput: 98.54 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 136.215ms - RowBatchQueuePutWaitTime: 2s566ms - RowsRead: 1.52M (1520000) - RowsReturned: 472.15K (472146) - RowsReturnedRate: 450.22 K/sec - ScanRangesComplete: 2 (2) - ScannerThreadsInvoluntaryContextSwitches: 17 (17) - ScannerThreadsTotalWallClockTime: 3s494ms - MaterializeTupleTime(*): 80.606ms - ScannerThreadsSysTime: 11.997ms - ScannerThreadsUserTime: 86.986ms - ScannerThreadsVoluntaryContextSwitches: 288 (288) - TotalRawHdfsReadTime(*): 182.275ms - TotalReadThroughput: 7.18 MB/sec Filter 1 (1.00 MB): - Rows processed: 1.06M (1058176) - Rows rejected: 1.05M (1047854) - Rows total: 1.52M (1520000) Instance 7f40dcb034de70b7:237 (host=vc1527.foo:22000):(Total: 2s543ms, non-child: 1s348ms, % non-child: 53.00%) Hdfs split stats (:<# splits>/): 0:1/38.97 MB Filter 1 arrival: 1s311ms MemoryUsage(500.000ms): 1.30 MB, 1.30 MB, 21.17 MB, 21.17 MB, 21.17 MB ThreadUsage(500.000ms): 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 22.79 MB (23895557) - PerHostPeakMemUsage: 647.56 MB (679013030) - RowsProduced: 618.84K (618838) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1s292ms - TotalStorageWaitTime: 91.690ms - TotalThreadsInvoluntaryContextSwitches: 42 (42) - TotalThreadsTotalWallClockTime: 4s813ms - TotalThreadsSysTime: 21.996ms - TotalThreadsUserTime: 190.971ms - TotalThreadsVoluntaryContextSwitches: 863 (863) Fragment Instance Lifecycle Timings: - ExecTime: 2s455ms - ExecTreeExecTime: 1s022ms - OpenTime: 29.319ms - ExecTreeOpenTime: 41.568us - PrepareTime: 59.175ms - ExecTreePrepareTime: 101.528us DataStreamSender (dst_id=25):(Total: 113.605ms, non-child: 113.605ms, % non-child: 100.00%) - BytesSent: 9.89 MB (10366648) - NetworkThroughput(*): 178.79 MB/sec - OverallThroughput: 87.02 MB/sec - PeakMemoryUsage: 4.95 MB (5192768) - RowsReturned: 618.84K (618838) - SerializeBatchTime: 57.358ms - TransmitDataRPCTime: 55.297ms - UncompressedRowBatchSize: 10.03 MB (10522390) CodeGen:(Total: 59.359ms, non-child: 59.359ms, % non-child: 100.00%) - CodegenTime: 1.271ms - CompileTime: 7.623ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 19.827ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 31.181ms HDFS_SCAN_NODE (id=0):(Total: 1s022ms, non-child: 1s022ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/38.97 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: Only following filters arrived: , waited 925ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:3 BytesRead(500.000ms): 0, 0, 8.98 MB, 8.98 MB, 8.98 MB - FooterProcessingTime: (Avg: 8.960ms ; Min: 8.960ms ; Max: 8.960ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 8.98 MB (9417355) - BytesReadDataNodeCache: 0 - BytesReadLocal: 8.98 MB (9417355) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 8.98 MB (9417355) - DecompressionTime: 6.117ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 19.32 MB (20261706) - PerReadThreadRawHdfsThroughput: 124.65 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 94.637ms - RowBatchQueuePutWaitTime: 1s283ms - RowsRead: 760.00K (760000) - RowsReturned: 618.84K (618838) - RowsReturnedRate: 605.07 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 12 (12) - ScannerThreadsTotalWallClockTime: 2s329ms - MaterializeTupleTime(*): 36.324ms - ScannerThreadsSysTime: 3.999ms - ScannerThreadsUserTime: 44.993ms - ScannerThreadsVoluntaryContextSwitches: 423 (423) - TotalRawHdfsReadTime(*): 72.049ms - TotalReadThroughput: 3.59 MB/sec Filter 1 (1.00 MB): - Rows processed: 142.53K (142528) - Rows rejected: 141.16K (141162) - Rows total: 760.00K (760000) Instance 7f40dcb034de70b7:256 (host=ve1135.foo:22000):(Total: 2s524ms, non-child: 1s331ms, % non-child: 52.76%) Hdfs split stats (:<# splits>/): 5:1/38.96 MB Filter 1 arrival: 1s346ms MemoryUsage(500.000ms): 1.30 MB, 1.30 MB, 21.03 MB, 22.03 MB, 22.03 MB ThreadUsage(500.000ms): 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 22.99 MB (24110527) - PerHostPeakMemUsage: 644.21 MB (675498414) - RowsProduced: 609.69K (609690) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1s287ms - TotalStorageWaitTime: 94.444ms - TotalThreadsInvoluntaryContextSwitches: 37 (37) - TotalThreadsTotalWallClockTime: 4s825ms - TotalThreadsSysTime: 23.995ms - TotalThreadsUserTime: 175.973ms - TotalThreadsVoluntaryContextSwitches: 802 (802) Fragment Instance Lifecycle Timings: - ExecTime: 2s465ms - ExecTreeExecTime: 1s043ms - OpenTime: 19.578ms - ExecTreeOpenTime: 61.131us - PrepareTime: 38.622ms - ExecTreePrepareTime: 83.662us DataStreamSender (dst_id=25):(Total: 114.251ms, non-child: 114.251ms, % non-child: 100.00%) - BytesSent: 9.74 MB (10213719) - NetworkThroughput(*): 164.40 MB/sec - OverallThroughput: 85.26 MB/sec - PeakMemoryUsage: 4.95 MB (5192768) - RowsReturned: 609.69K (609690) - SerializeBatchTime: 54.139ms - TransmitDataRPCTime: 59.250ms - UncompressedRowBatchSize: 9.89 MB (10366874) CodeGen:(Total: 34.377ms, non-child: 34.377ms, % non-child: 100.00%) - CodegenTime: 826.763us - CompileTime: 5.220ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 13.270ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 15.479ms HDFS_SCAN_NODE (id=0):(Total: 1s043ms, non-child: 1s043ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:1/38.96 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: Only following filters arrived: , waited 944ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:3 BytesRead(500.000ms): 0, 0, 8.98 MB, 8.98 MB, 8.98 MB - FooterProcessingTime: (Avg: 8.537ms ; Min: 8.537ms ; Max: 8.537ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 8.98 MB (9417081) - BytesReadDataNodeCache: 0 - BytesReadLocal: 8.98 MB (9417081) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 8.98 MB (9417081) - DecompressionTime: 6.758ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 19.29 MB (20230916) - PerReadThreadRawHdfsThroughput: 128.10 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 97.454ms - RowBatchQueuePutWaitTime: 1s252ms - RowsRead: 760.00K (760000) - RowsReturned: 609.69K (609690) - RowsReturnedRate: 584.21 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 11 (11) - ScannerThreadsTotalWallClockTime: 2s340ms - MaterializeTupleTime(*): 37.019ms - ScannerThreadsSysTime: 8.998ms - ScannerThreadsUserTime: 41.993ms - ScannerThreadsVoluntaryContextSwitches: 363 (363) - TotalRawHdfsReadTime(*): 70.108ms - TotalReadThroughput: 3.59 MB/sec Filter 1 (1.00 MB): - Rows processed: 151.74K (151744) - Rows rejected: 150.31K (150310) - Rows total: 760.00K (760000) Instance 7f40dcb034de70b7:212 (host=vd1331.foo:22000):(Total: 2s512ms, non-child: 1s294ms, % non-child: 51.54%) Hdfs split stats (:<# splits>/): 5:1/39.99 MB Filter 1 arrival: 1s245ms MemoryUsage(500.000ms): 1.30 MB, 1.30 MB, 17.22 MB, 22.03 MB, 22.03 MB ThreadUsage(500.000ms): 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 26.16 MB (27430399) - PerHostPeakMemUsage: 652.19 MB (683873716) - RowsProduced: 443.63K (443626) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1s241ms - TotalStorageWaitTime: 122.902ms - TotalThreadsInvoluntaryContextSwitches: 39 (39) - TotalThreadsTotalWallClockTime: 4s795ms - TotalThreadsSysTime: 31.995ms - TotalThreadsUserTime: 164.975ms - TotalThreadsVoluntaryContextSwitches: 711 (711) Fragment Instance Lifecycle Timings: - ExecTime: 2s461ms - ExecTreeExecTime: 1s092ms - OpenTime: 18.767ms - ExecTreeOpenTime: 634.521us - PrepareTime: 31.783ms - ExecTreePrepareTime: 52.287us DataStreamSender (dst_id=25):(Total: 93.904ms, non-child: 93.904ms, % non-child: 100.00%) - BytesSent: 7.08 MB (7428621) - NetworkThroughput(*): 154.82 MB/sec - OverallThroughput: 75.44 MB/sec - PeakMemoryUsage: 4.95 MB (5192768) - RowsReturned: 443.63K (443626) - SerializeBatchTime: 47.673ms - TransmitDataRPCTime: 45.759ms - UncompressedRowBatchSize: 7.19 MB (7543250) CodeGen:(Total: 30.211ms, non-child: 30.211ms, % non-child: 100.00%) - CodegenTime: 737.235us - CompileTime: 4.956ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 12.257ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 12.615ms HDFS_SCAN_NODE (id=0):(Total: 1s093ms, non-child: 1s093ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:1/39.99 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: Only following filters arrived: , waited 964ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:3 BytesRead(500.000ms): 0, 0, 9.21 MB, 9.21 MB, 9.21 MB - FooterProcessingTime: (Avg: 7.226ms ; Min: 7.226ms ; Max: 7.226ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 9.21 MB (9656265) - BytesReadDataNodeCache: 0 - BytesReadLocal: 9.21 MB (9656265) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 9.21 MB (9656265) - DecompressionTime: 7.366ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 23.13 MB (24255300) - PerReadThreadRawHdfsThroughput: 87.10 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 126.620ms - RowBatchQueuePutWaitTime: 1s218ms - RowsRead: 780.00K (780000) - RowsReturned: 443.63K (443626) - RowsReturnedRate: 405.77 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 8 (8) - ScannerThreadsTotalWallClockTime: 2s315ms - MaterializeTupleTime(*): 42.417ms - ScannerThreadsSysTime: 11.998ms - ScannerThreadsUserTime: 44.993ms - ScannerThreadsVoluntaryContextSwitches: 272 (272) - TotalRawHdfsReadTime(*): 105.724ms - TotalReadThroughput: 3.68 MB/sec Filter 1 (1.00 MB): - Rows processed: 339.68K (339680) - Rows rejected: 336.37K (336374) - Rows total: 780.00K (780000) Instance 7f40dcb034de70b7:248 (host=va1043.foo:22000):(Total: 2s470ms, non-child: 1s289ms, % non-child: 52.21%) Hdfs split stats (:<# splits>/): 1:1/38.98 MB Filter 1 arrival: 1s332ms MemoryUsage(500.000ms): 1.30 MB, 1.30 MB, 20.40 MB, 21.57 MB, 21.57 MB ThreadUsage(500.000ms): 1, 1, 2, 2, 2 - AverageThreadTokens: 1.60 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 25.07 MB (26284680) - PerHostPeakMemUsage: 649.40 MB (680944054) - RowsProduced: 449.60K (449596) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1s227ms - TotalStorageWaitTime: 99.602ms - TotalThreadsInvoluntaryContextSwitches: 50 (50) - TotalThreadsTotalWallClockTime: 4s092ms - TotalThreadsSysTime: 26.996ms - TotalThreadsUserTime: 167.974ms - TotalThreadsVoluntaryContextSwitches: 637 (637) Fragment Instance Lifecycle Timings: - ExecTime: 2s400ms - ExecTreeExecTime: 1s048ms - OpenTime: 20.752ms - ExecTreeOpenTime: 28.118us - PrepareTime: 49.843ms - ExecTreePrepareTime: 88.651us DataStreamSender (dst_id=25):(Total: 88.410ms, non-child: 88.410ms, % non-child: 100.00%) - BytesSent: 7.18 MB (7527296) - NetworkThroughput(*): 170.05 MB/sec - OverallThroughput: 81.20 MB/sec - PeakMemoryUsage: 4.95 MB (5192768) - RowsReturned: 449.60K (449596) - SerializeBatchTime: 44.320ms - TransmitDataRPCTime: 42.215ms - UncompressedRowBatchSize: 7.29 MB (7644740) CodeGen:(Total: 43.512ms, non-child: 43.512ms, % non-child: 100.00%) - CodegenTime: 954.956us - CompileTime: 6.240ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 13.397ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 23.456ms HDFS_SCAN_NODE (id=0):(Total: 1s048ms, non-child: 1s048ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:1/38.98 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: Only following filters arrived: , waited 944ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:3 BytesRead(500.000ms): 0, 0, 8.98 MB, 8.98 MB, 8.98 MB - FooterProcessingTime: (Avg: 9.932ms ; Min: 9.932ms ; Max: 9.932ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.60 - BytesRead: 8.98 MB (9417002) - BytesReadDataNodeCache: 0 - BytesReadLocal: 8.98 MB (9417002) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 8.98 MB (9417002) - DecompressionTime: 6.940ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 21.25 MB (22283220) - PerReadThreadRawHdfsThroughput: 119.69 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 102.719ms - RowBatchQueuePutWaitTime: 1s202ms - RowsRead: 760.00K (760000) - RowsReturned: 449.60K (449596) - RowsReturnedRate: 428.65 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 11 (11) - ScannerThreadsTotalWallClockTime: 1s671ms - MaterializeTupleTime(*): 47.851ms - ScannerThreadsSysTime: 8.998ms - ScannerThreadsUserTime: 50.992ms - ScannerThreadsVoluntaryContextSwitches: 201 (201) - TotalRawHdfsReadTime(*): 75.035ms - TotalReadThroughput: 3.59 MB/sec Filter 1 (1.00 MB): - Rows processed: 313.54K (313536) - Rows rejected: 310.40K (310404) - Rows total: 760.00K (760000) Instance 7f40dcb034de70b7:26c (host=vc1514.foo:22000):(Total: 2s466ms, non-child: 1s274ms, % non-child: 51.66%) Hdfs split stats (:<# splits>/): 4:1/37.96 MB 2:1/38.98 MB Filter 1 arrival: 1s372ms MemoryUsage(500.000ms): 1.30 MB, 1.30 MB, 33.21 MB, 34.21 MB, 34.21 MB ThreadUsage(500.000ms): 3, 3, 3, 3, 3 - AverageThreadTokens: 3.00 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 48.27 MB (50612956) - PerHostPeakMemUsage: 664.67 MB (696959335) - RowsProduced: 457.79K (457791) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1s211ms - TotalStorageWaitTime: 220.388ms - TotalThreadsInvoluntaryContextSwitches: 49 (49) - TotalThreadsTotalWallClockTime: 6s890ms - TotalThreadsSysTime: 25.995ms - TotalThreadsUserTime: 219.966ms - TotalThreadsVoluntaryContextSwitches: 870 (870) Fragment Instance Lifecycle Timings: - ExecTime: 2s387ms - ExecTreeExecTime: 1s047ms - OpenTime: 21.460ms - ExecTreeOpenTime: 30.152us - PrepareTime: 57.754ms - ExecTreePrepareTime: 95.133us DataStreamSender (dst_id=25):(Total: 98.901ms, non-child: 98.901ms, % non-child: 100.00%) - BytesSent: 7.31 MB (7662851) - NetworkThroughput(*): 161.83 MB/sec - OverallThroughput: 73.89 MB/sec - PeakMemoryUsage: 4.95 MB (5192768) - RowsReturned: 457.79K (457791) - SerializeBatchTime: 51.763ms - TransmitDataRPCTime: 45.156ms - UncompressedRowBatchSize: 7.42 MB (7784055) CodeGen:(Total: 46.401ms, non-child: 46.401ms, % non-child: 100.00%) - CodegenTime: 1.044ms - CompileTime: 5.846ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 14.305ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 25.768ms HDFS_SCAN_NODE (id=0):(Total: 1s047ms, non-child: 1s047ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:1/37.96 MB 2:1/38.98 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 2 out of 2 Runtime filters: Only following filters arrived: , waited 924ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:6 BytesRead(500.000ms): 0, 0, 17.74 MB, 17.74 MB, 17.74 MB - FooterProcessingTime: (Avg: 10.965ms ; Min: 6.829ms ; Max: 15.102ms ; Number of samples: 2) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 2.00 - BytesRead: 17.74 MB (18596598) - BytesReadDataNodeCache: 0 - BytesReadLocal: 17.74 MB (18596598) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 17.74 MB (18596598) - DecompressionTime: 11.854ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 2 (2) - NumRowGroups: 2 (2) - NumScannerThreadsStarted: 2 (2) - PeakMemoryUsage: 42.32 MB (44378890) - PerReadThreadRawHdfsThroughput: 109.11 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 120.623ms - RowBatchQueuePutWaitTime: 2s369ms - RowsRead: 1.50M (1500000) - RowsReturned: 457.79K (457791) - RowsReturnedRate: 437.18 K/sec - ScanRangesComplete: 2 (2) - ScannerThreadsInvoluntaryContextSwitches: 14 (14) - ScannerThreadsTotalWallClockTime: 4s481ms - MaterializeTupleTime(*): 80.871ms - ScannerThreadsSysTime: 10.997ms - ScannerThreadsUserTime: 91.985ms - ScannerThreadsVoluntaryContextSwitches: 399 (399) - TotalRawHdfsReadTime(*): 162.538ms - TotalReadThroughput: 7.09 MB/sec Filter 1 (1.00 MB): - Rows processed: 1.05M (1052512) - Rows rejected: 1.04M (1042209) - Rows total: 1.50M (1500000) Instance 7f40dcb034de70b7:23d (host=vd1341.foo:22000):(Total: 2s462ms, non-child: 1s276ms, % non-child: 51.82%) Hdfs split stats (:<# splits>/): 1:1/38.98 MB Filter 1 arrival: 1s320ms MemoryUsage(500.000ms): 1.30 MB, 1.30 MB, 19.25 MB, 20.25 MB, 20.25 MB ThreadUsage(500.000ms): 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 23.71 MB (24863024) - PerHostPeakMemUsage: 647.14 MB (678571471) - RowsProduced: 457.69K (457692) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1s211ms - TotalStorageWaitTime: 104.523ms - TotalThreadsInvoluntaryContextSwitches: 51 (51) - TotalThreadsTotalWallClockTime: 4s640ms - TotalThreadsSysTime: 30.995ms - TotalThreadsUserTime: 173.973ms - TotalThreadsVoluntaryContextSwitches: 655 (655) Fragment Instance Lifecycle Timings: - ExecTime: 2s372ms - ExecTreeExecTime: 1s037ms - OpenTime: 26.622ms - ExecTreeOpenTime: 34.904us - PrepareTime: 63.662ms - ExecTreePrepareTime: 61.457us DataStreamSender (dst_id=25):(Total: 88.364ms, non-child: 88.364ms, % non-child: 100.00%) - BytesSent: 7.31 MB (7664394) - NetworkThroughput(*): 169.41 MB/sec - OverallThroughput: 82.72 MB/sec - PeakMemoryUsage: 4.95 MB (5192768) - RowsReturned: 457.69K (457692) - SerializeBatchTime: 44.132ms - TransmitDataRPCTime: 43.145ms - UncompressedRowBatchSize: 7.42 MB (7782372) CodeGen:(Total: 60.301ms, non-child: 60.301ms, % non-child: 100.00%) - CodegenTime: 2.174ms - CompileTime: 6.796ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 17.916ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 34.357ms HDFS_SCAN_NODE (id=0):(Total: 1s037ms, non-child: 1s037ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:1/38.98 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: Only following filters arrived: , waited 924ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:3 BytesRead(500.000ms): 0, 0, 8.98 MB, 8.98 MB, 8.98 MB - FooterProcessingTime: (Avg: 11.220ms ; Min: 11.220ms ; Max: 11.220ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 8.98 MB (9416770) - BytesReadDataNodeCache: 0 - BytesReadLocal: 8.98 MB (9416770) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 8.98 MB (9416770) - DecompressionTime: 6.975ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 17.77 MB (18630244) - PerReadThreadRawHdfsThroughput: 115.01 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 111.710ms - RowBatchQueuePutWaitTime: 1s185ms - RowsRead: 760.00K (760000) - RowsReturned: 457.69K (457692) - RowsReturnedRate: 441.02 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 19 (19) - ScannerThreadsTotalWallClockTime: 2s242ms - MaterializeTupleTime(*): 51.201ms - ScannerThreadsSysTime: 9.998ms - ScannerThreadsUserTime: 52.991ms - ScannerThreadsVoluntaryContextSwitches: 197 (197) - TotalRawHdfsReadTime(*): 78.082ms - TotalReadThroughput: 3.59 MB/sec Filter 1 (1.00 MB): - Rows processed: 305.34K (305344) - Rows rejected: 302.31K (302308) - Rows total: 760.00K (760000) Instance 7f40dcb034de70b7:21d (host=vd1335.foo:22000):(Total: 2s438ms, non-child: 1s244ms, % non-child: 51.04%) Hdfs split stats (:<# splits>/): 1:1/38.99 MB Filter 1 arrival: 1s283ms MemoryUsage(500.000ms): 1.30 MB, 1.30 MB, 11.75 MB, 11.75 MB, 3.12 MB ThreadUsage(500.000ms): 1, 2, 1, 1, 1 - AverageThreadTokens: 1.20 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 23.76 MB (24914292) - PerHostPeakMemUsage: 609.70 MB (639316676) - RowsProduced: 610.83K (610832) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1s181ms - TotalStorageWaitTime: 89.498ms - TotalThreadsInvoluntaryContextSwitches: 44 (44) - TotalThreadsTotalWallClockTime: 3s051ms - TotalThreadsSysTime: 32.994ms - TotalThreadsUserTime: 174.973ms - TotalThreadsVoluntaryContextSwitches: 861 (861) Fragment Instance Lifecycle Timings: - ExecTime: 2s353ms - ExecTreeExecTime: 1s019ms - OpenTime: 23.645ms - ExecTreeOpenTime: 29.960us - PrepareTime: 61.254ms - ExecTreePrepareTime: 90.385us DataStreamSender (dst_id=25):(Total: 115.816ms, non-child: 115.816ms, % non-child: 100.00%) - BytesSent: 9.76 MB (10233947) - NetworkThroughput(*): 173.01 MB/sec - OverallThroughput: 84.27 MB/sec - PeakMemoryUsage: 4.95 MB (5192768) - RowsReturned: 610.83K (610832) - SerializeBatchTime: 58.575ms - TransmitDataRPCTime: 56.413ms - UncompressedRowBatchSize: 9.91 MB (10386288) CodeGen:(Total: 58.464ms, non-child: 58.464ms, % non-child: 100.00%) - CodegenTime: 939.669us - CompileTime: 5.106ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 14.183ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 38.434ms HDFS_SCAN_NODE (id=0):(Total: 1s019ms, non-child: 1s019ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:1/38.99 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: Only following filters arrived: , waited 923ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:3 BytesRead(500.000ms): 0, 0, 8.98 MB, 8.98 MB - FooterProcessingTime: (Avg: 5.010ms ; Min: 5.010ms ; Max: 5.010ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.25 - BytesRead: 8.98 MB (9417208) - BytesReadDataNodeCache: 0 - BytesReadLocal: 8.98 MB (9417208) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 8.98 MB (9417208) - DecompressionTime: 5.141ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 19.40 MB (20346553) - PerReadThreadRawHdfsThroughput: 125.48 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 93.300ms - RowBatchQueuePutWaitTime: 155.746ms - RowsRead: 760.00K (760000) - RowsReturned: 610.83K (610832) - RowsReturnedRate: 599.22 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 10 (10) - ScannerThreadsTotalWallClockTime: 678.538ms - MaterializeTupleTime(*): 30.997ms - ScannerThreadsSysTime: 6.998ms - ScannerThreadsUserTime: 34.994ms - ScannerThreadsVoluntaryContextSwitches: 411 (411) - TotalRawHdfsReadTime(*): 71.572ms - TotalReadThroughput: 4.49 MB/sec Filter 1 (1.00 MB): - Rows processed: 150.72K (150720) - Rows rejected: 149.17K (149168) - Rows total: 760.00K (760000) Instance 7f40dcb034de70b7:206 (host=va1041.foo:22000):(Total: 2s424ms, non-child: 1s223ms, % non-child: 50.45%) Hdfs split stats (:<# splits>/): 5:1/38.97 MB Filter 1 arrival: 1s212ms MemoryUsage(500.000ms): 1.30 MB, 1.30 MB, 21.19 MB, 21.19 MB, 21.19 MB ThreadUsage(500.000ms): 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 21.94 MB (23008780) - PerHostPeakMemUsage: 644.11 MB (675398289) - RowsProduced: 617.87K (617866) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1s165ms - TotalStorageWaitTime: 92.179ms - TotalThreadsInvoluntaryContextSwitches: 60 (60) - TotalThreadsTotalWallClockTime: 4s576ms - TotalThreadsSysTime: 32.994ms - TotalThreadsUserTime: 200.969ms - TotalThreadsVoluntaryContextSwitches: 839 (839) Fragment Instance Lifecycle Timings: - ExecTime: 2s366ms - ExecTreeExecTime: 1s043ms - OpenTime: 17.825ms - ExecTreeOpenTime: 25.916us - PrepareTime: 40.911ms - ExecTreePrepareTime: 86.562us DataStreamSender (dst_id=25):(Total: 120.808ms, non-child: 120.808ms, % non-child: 100.00%) - BytesSent: 9.87 MB (10348175) - NetworkThroughput(*): 160.23 MB/sec - OverallThroughput: 81.69 MB/sec - PeakMemoryUsage: 4.95 MB (5192768) - RowsReturned: 617.87K (617866) - SerializeBatchTime: 58.461ms - TransmitDataRPCTime: 61.590ms - UncompressedRowBatchSize: 10.02 MB (10505866) CodeGen:(Total: 37.395ms, non-child: 37.395ms, % non-child: 100.00%) - CodegenTime: 733.401us - CompileTime: 4.720ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 12.200ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 20.088ms HDFS_SCAN_NODE (id=0):(Total: 1s043ms, non-child: 1s043ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:1/38.97 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: Only following filters arrived: , waited 944ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:3 BytesRead(500.000ms): 0, 0, 8.98 MB, 8.98 MB, 8.98 MB - FooterProcessingTime: (Avg: 6.118ms ; Min: 6.118ms ; Max: 6.118ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 8.98 MB (9417261) - BytesReadDataNodeCache: 0 - BytesReadLocal: 8.98 MB (9417261) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 8.98 MB (9417261) - DecompressionTime: 8.316ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 18.21 MB (19099473) - PerReadThreadRawHdfsThroughput: 120.44 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 95.895ms - RowBatchQueuePutWaitTime: 1s165ms - RowsRead: 760.00K (760000) - RowsReturned: 617.87K (617866) - RowsReturnedRate: 592.23 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 20 (20) - ScannerThreadsTotalWallClockTime: 2s192ms - MaterializeTupleTime(*): 47.632ms - ScannerThreadsSysTime: 7.998ms - ScannerThreadsUserTime: 55.991ms - ScannerThreadsVoluntaryContextSwitches: 388 (388) - TotalRawHdfsReadTime(*): 74.566ms - TotalReadThroughput: 3.59 MB/sec Filter 1 (1.00 MB): - Rows processed: 143.55K (143552) - Rows rejected: 142.13K (142134) - Rows total: 760.00K (760000) Instance 7f40dcb034de70b7:222 (host=vc1537.foo:22000):(Total: 2s419ms, non-child: 1s224ms, % non-child: 50.61%) Hdfs split stats (:<# splits>/): 0:1/38.97 MB Filter 1 arrival: 1s290ms MemoryUsage(500.000ms): 1.30 MB, 1.30 MB, 19.74 MB, 20.74 MB, 20.74 MB ThreadUsage(500.000ms): 1, 2, 2, 2, 2 - AverageThreadTokens: 1.80 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 21.73 MB (22780813) - PerHostPeakMemUsage: 649.79 MB (681358738) - RowsProduced: 621.97K (621967) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1s179ms - TotalStorageWaitTime: 98.737ms - TotalThreadsInvoluntaryContextSwitches: 44 (44) - TotalThreadsTotalWallClockTime: 4s010ms - TotalThreadsSysTime: 13.998ms - TotalThreadsUserTime: 186.971ms - TotalThreadsVoluntaryContextSwitches: 808 (808) Fragment Instance Lifecycle Timings: - ExecTime: 2s363ms - ExecTreeExecTime: 1s048ms - OpenTime: 22.626ms - ExecTreeOpenTime: 26.995us - PrepareTime: 34.078ms - ExecTreePrepareTime: 53.995us DataStreamSender (dst_id=25):(Total: 109.648ms, non-child: 109.648ms, % non-child: 100.00%) - BytesSent: 9.94 MB (10418625) - NetworkThroughput(*): 181.44 MB/sec - OverallThroughput: 90.62 MB/sec - PeakMemoryUsage: 4.95 MB (5192768) - RowsReturned: 621.97K (621967) - SerializeBatchTime: 54.295ms - TransmitDataRPCTime: 54.760ms - UncompressedRowBatchSize: 10.09 MB (10575583) CodeGen:(Total: 37.566ms, non-child: 37.566ms, % non-child: 100.00%) - CodegenTime: 1.145ms - CompileTime: 4.937ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 16.325ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 15.705ms HDFS_SCAN_NODE (id=0):(Total: 1s048ms, non-child: 1s048ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/38.97 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: Only following filters arrived: , waited 944ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:3 BytesRead(500.000ms): 0, 0, 8.98 MB, 8.98 MB, 8.98 MB - FooterProcessingTime: (Avg: 6.053ms ; Min: 6.053ms ; Max: 6.053ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.80 - BytesRead: 8.98 MB (9417365) - BytesReadDataNodeCache: 0 - BytesReadLocal: 8.98 MB (9417365) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 8.98 MB (9417365) - DecompressionTime: 6.214ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 18.69 MB (19600594) - PerReadThreadRawHdfsThroughput: 120.90 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 101.837ms - RowBatchQueuePutWaitTime: 1s172ms - RowsRead: 760.00K (760000) - RowsReturned: 621.97K (621967) - RowsReturnedRate: 593.45 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 12 (12) - ScannerThreadsTotalWallClockTime: 1s625ms - MaterializeTupleTime(*): 38.384ms - ScannerThreadsSysTime: 5.999ms - ScannerThreadsUserTime: 45.993ms - ScannerThreadsVoluntaryContextSwitches: 324 (324) - TotalRawHdfsReadTime(*): 74.284ms - TotalReadThroughput: 3.59 MB/sec Filter 1 (1.00 MB): - Rows processed: 139.46K (139456) - Rows rejected: 138.03K (138033) - Rows total: 760.00K (760000) Instance 7f40dcb034de70b7:204 (host=vd1108.foo:22000):(Total: 2s409ms, non-child: 1s185ms, % non-child: 49.19%) Hdfs split stats (:<# splits>/): 7:1/39.98 MB Filter 1 arrival: 1s217ms MemoryUsage(500.000ms): 1.30 MB, 1.30 MB, 20.93 MB, 20.93 MB, 2.36 MB ThreadUsage(500.000ms): 2, 2, 2, 2, 1 - AverageThreadTokens: 1.80 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 23.56 MB (24705892) - PerHostPeakMemUsage: 642.77 MB (673995815) - RowsProduced: 453.73K (453725) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1s133ms - TotalStorageWaitTime: 136.979ms - TotalThreadsInvoluntaryContextSwitches: 47 (47) - TotalThreadsTotalWallClockTime: 4s588ms - TotalThreadsSysTime: 19.997ms - TotalThreadsUserTime: 184.971ms - TotalThreadsVoluntaryContextSwitches: 666 (666) Fragment Instance Lifecycle Timings: - ExecTime: 2s348ms - ExecTreeExecTime: 1s090ms - OpenTime: 22.514ms - ExecTreeOpenTime: 29.094us - PrepareTime: 38.858ms - ExecTreePrepareTime: 92.213us DataStreamSender (dst_id=25):(Total: 93.838ms, non-child: 93.838ms, % non-child: 100.00%) - BytesSent: 7.25 MB (7597010) - NetworkThroughput(*): 173.58 MB/sec - OverallThroughput: 77.21 MB/sec - PeakMemoryUsage: 4.95 MB (5192768) - RowsReturned: 453.73K (453725) - SerializeBatchTime: 51.254ms - TransmitDataRPCTime: 41.739ms - UncompressedRowBatchSize: 7.36 MB (7714933) CodeGen:(Total: 40.502ms, non-child: 40.502ms, % non-child: 100.00%) - CodegenTime: 846.773us - CompileTime: 6.047ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 15.359ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 18.640ms HDFS_SCAN_NODE (id=0):(Total: 1s090ms, non-child: 1s090ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:1/39.98 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: Only following filters arrived: , waited 943ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:3 BytesRead(500.000ms): 0, 0, 9.21 MB, 9.21 MB - FooterProcessingTime: (Avg: 5.081ms ; Min: 5.081ms ; Max: 5.081ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 9.21 MB (9656331) - BytesReadDataNodeCache: 0 - BytesReadLocal: 9.21 MB (9656331) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 9.21 MB (9656331) - DecompressionTime: 7.320ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 18.47 MB (19366606) - PerReadThreadRawHdfsThroughput: 74.22 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 144.533ms - RowBatchQueuePutWaitTime: 1s116ms - RowsRead: 780.00K (780000) - RowsReturned: 453.73K (453725) - RowsReturnedRate: 416.20 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 12 (12) - ScannerThreadsTotalWallClockTime: 2s217ms - MaterializeTupleTime(*): 51.715ms - ScannerThreadsSysTime: 3.999ms - ScannerThreadsUserTime: 61.990ms - ScannerThreadsVoluntaryContextSwitches: 189 (189) - TotalRawHdfsReadTime(*): 124.076ms - TotalReadThroughput: 4.60 MB/sec Filter 1 (1.00 MB): - Rows processed: 329.44K (329440) - Rows rejected: 326.27K (326275) - Rows total: 780.00K (780000) Instance 7f40dcb034de70b7:20b (host=vd1330.foo:22000):(Total: 2s388ms, non-child: 1s171ms, % non-child: 49.05%) Hdfs split stats (:<# splits>/): 2:1/37.97 MB 3:1/38.97 MB Filter 1 arrival: 1s214ms MemoryUsage(500.000ms): 1.30 MB, 1.30 MB, 32.67 MB, 34.79 MB, 34.79 MB ThreadUsage(500.000ms): 3, 3, 3, 3, 3 - AverageThreadTokens: 3.00 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 45.52 MB (47727351) - PerHostPeakMemUsage: 659.74 MB (691789562) - RowsProduced: 780.23K (780229) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1s120ms - TotalStorageWaitTime: 190.201ms - TotalThreadsInvoluntaryContextSwitches: 60 (60) - TotalThreadsTotalWallClockTime: 6s736ms - TotalThreadsSysTime: 40.993ms - TotalThreadsUserTime: 267.958ms - TotalThreadsVoluntaryContextSwitches: 1.12K (1119) Fragment Instance Lifecycle Timings: - ExecTime: 2s328ms - ExecTreeExecTime: 1s045ms - OpenTime: 20.355ms - ExecTreeOpenTime: 25.499us - PrepareTime: 39.419ms - ExecTreePrepareTime: 103.763us DataStreamSender (dst_id=25):(Total: 133.745ms, non-child: 133.745ms, % non-child: 100.00%) - BytesSent: 12.47 MB (13070734) - NetworkThroughput(*): 186.57 MB/sec - OverallThroughput: 93.20 MB/sec - PeakMemoryUsage: 4.95 MB (5192768) - RowsReturned: 780.23K (780229) - SerializeBatchTime: 66.065ms - TransmitDataRPCTime: 66.812ms - UncompressedRowBatchSize: 12.65 MB (13266573) CodeGen:(Total: 38.043ms, non-child: 38.043ms, % non-child: 100.00%) - CodegenTime: 807.049us - CompileTime: 5.708ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 13.675ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 18.260ms HDFS_SCAN_NODE (id=0):(Total: 1s045ms, non-child: 1s045ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:1/37.97 MB 3:1/38.97 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 2 out of 2 Runtime filters: Only following filters arrived: , waited 943ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:6 BytesRead(500.000ms): 0, 0, 17.73 MB, 17.73 MB, 17.73 MB - FooterProcessingTime: (Avg: 4.164ms ; Min: 3.848ms ; Max: 4.479ms ; Number of samples: 2) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 2.00 - BytesRead: 17.73 MB (18594829) - BytesReadDataNodeCache: 0 - BytesReadLocal: 17.73 MB (18594829) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 17.73 MB (18594829) - DecompressionTime: 16.608ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 2 (2) - NumRowGroups: 2 (2) - NumScannerThreadsStarted: 2 (2) - PeakMemoryUsage: 41.64 MB (43667516) - PerReadThreadRawHdfsThroughput: 115.27 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 97.538ms - RowBatchQueuePutWaitTime: 2s263ms - RowsRead: 1.50M (1500000) - RowsReturned: 780.23K (780229) - RowsReturnedRate: 746.52 K/sec - ScanRangesComplete: 2 (2) - ScannerThreadsInvoluntaryContextSwitches: 25 (25) - ScannerThreadsTotalWallClockTime: 4s387ms - MaterializeTupleTime(*): 98.937ms - ScannerThreadsSysTime: 22.996ms - ScannerThreadsUserTime: 107.982ms - ScannerThreadsVoluntaryContextSwitches: 635 (635) - TotalRawHdfsReadTime(*): 153.844ms - TotalReadThroughput: 7.09 MB/sec Filter 1 (1.00 MB): - Rows processed: 726.88K (726880) - Rows rejected: 719.77K (719771) - Rows total: 1.50M (1500000) Instance 7f40dcb034de70b7:22c (host=vc1521.foo:22000):(Total: 2s387ms, non-child: 1s191ms, % non-child: 49.90%) Hdfs split stats (:<# splits>/): 6:1/38.98 MB 5:1/37.96 MB Filter 1 arrival: 1s301ms MemoryUsage(500.000ms): 1.30 MB, 1.30 MB, 31.50 MB, 32.43 MB, 20.47 MB ThreadUsage(500.000ms): 3, 3, 3, 3, 2 - AverageThreadTokens: 2.80 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 40.86 MB (42843897) - PerHostPeakMemUsage: 666.57 MB (698951877) - RowsProduced: 806.60K (806604) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1s138ms - TotalStorageWaitTime: 163.498ms - TotalThreadsInvoluntaryContextSwitches: 66 (66) - TotalThreadsTotalWallClockTime: 6s720ms - TotalThreadsSysTime: 30.995ms - TotalThreadsUserTime: 245.962ms - TotalThreadsVoluntaryContextSwitches: 1.14K (1143) Fragment Instance Lifecycle Timings: - ExecTime: 2s324ms - ExecTreeExecTime: 1s024ms - OpenTime: 18.688ms - ExecTreeOpenTime: 22.200us - PrepareTime: 44.652ms - ExecTreePrepareTime: 89.302us DataStreamSender (dst_id=25):(Total: 130.802ms, non-child: 130.802ms, % non-child: 100.00%) - BytesSent: 12.89 MB (13515411) - NetworkThroughput(*): 193.32 MB/sec - OverallThroughput: 98.54 MB/sec - PeakMemoryUsage: 4.95 MB (5192768) - RowsReturned: 806.60K (806604) - SerializeBatchTime: 63.324ms - TransmitDataRPCTime: 66.671ms - UncompressedRowBatchSize: 13.08 MB (13714948) CodeGen:(Total: 41.288ms, non-child: 41.288ms, % non-child: 100.00%) - CodegenTime: 1.169ms - CompileTime: 4.749ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 12.906ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 23.105ms HDFS_SCAN_NODE (id=0):(Total: 1s024ms, non-child: 1s024ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 6:1/38.98 MB 5:1/37.96 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 2 out of 2 Runtime filters: Only following filters arrived: , waited 943ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:6 BytesRead(500.000ms): 0, 0, 17.73 MB, 17.73 MB, 17.73 MB - FooterProcessingTime: (Avg: 8.376ms ; Min: 6.586ms ; Max: 10.166ms ; Number of samples: 2) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.80 - BytesRead: 17.73 MB (18595632) - BytesReadDataNodeCache: 0 - BytesReadLocal: 17.73 MB (18595632) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 17.73 MB (18595632) - DecompressionTime: 12.553ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 2 (2) - NumRowGroups: 2 (2) - NumScannerThreadsStarted: 2 (2) - PeakMemoryUsage: 35.87 MB (37609534) - PerReadThreadRawHdfsThroughput: 159.37 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 77.183ms - RowBatchQueuePutWaitTime: 2s291ms - RowsRead: 1.50M (1500000) - RowsReturned: 806.60K (806604) - RowsReturnedRate: 787.51 K/sec - ScanRangesComplete: 2 (2) - ScannerThreadsInvoluntaryContextSwitches: 21 (21) - ScannerThreadsTotalWallClockTime: 4s377ms - MaterializeTupleTime(*): 77.031ms - ScannerThreadsSysTime: 14.997ms - ScannerThreadsUserTime: 86.986ms - ScannerThreadsVoluntaryContextSwitches: 700 (700) - TotalRawHdfsReadTime(*): 111.277ms - TotalReadThroughput: 7.09 MB/sec Filter 1 (1.00 MB): - Rows processed: 700.26K (700256) - Rows rejected: 693.40K (693396) - Rows total: 1.50M (1500000) Instance 7f40dcb034de70b7:25a (host=va1034.foo:22000):(Total: 2s370ms, non-child: 1s083ms, % non-child: 45.74%) Hdfs split stats (:<# splits>/): 0:1/40.00 MB 7:1/38.97 MB Filter 1 arrival: 1s347ms MemoryUsage(500.000ms): 1.52 MB, 1.30 MB, 1.30 MB, 32.61 MB, 32.61 MB ThreadUsage(500.000ms): 1, 3, 3, 3, 3 - AverageThreadTokens: 2.60 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 44.49 MB (46648460) - PerHostPeakMemUsage: 674.64 MB (707410196) - RowsProduced: 468.45K (468453) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1s023ms - TotalStorageWaitTime: 207.267ms - TotalThreadsInvoluntaryContextSwitches: 58 (58) - TotalThreadsTotalWallClockTime: 6s707ms - TotalThreadsSysTime: 35.992ms - TotalThreadsUserTime: 215.966ms - TotalThreadsVoluntaryContextSwitches: 832 (832) Fragment Instance Lifecycle Timings: - ExecTime: 2s304ms - ExecTreeExecTime: 1s156ms - OpenTime: 23.615ms - ExecTreeOpenTime: 36.729us - PrepareTime: 42.131ms - ExecTreePrepareTime: 73.333us DataStreamSender (dst_id=25):(Total: 89.215ms, non-child: 89.215ms, % non-child: 100.00%) - BytesSent: 7.48 MB (7839785) - NetworkThroughput(*): 169.78 MB/sec - OverallThroughput: 83.80 MB/sec - PeakMemoryUsage: 4.95 MB (5192768) - RowsReturned: 468.45K (468453) - SerializeBatchTime: 44.459ms - TransmitDataRPCTime: 44.037ms - UncompressedRowBatchSize: 7.60 MB (7965309) CodeGen:(Total: 40.643ms, non-child: 40.643ms, % non-child: 100.00%) - CodegenTime: 885.151us - CompileTime: 6.746ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 15.094ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 18.383ms HDFS_SCAN_NODE (id=0):(Total: 1s156ms, non-child: 1s156ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/40.00 MB 7:1/38.97 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 2 out of 2 Runtime filters: Only following filters arrived: , waited 945ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:6 BytesRead(500.000ms): 0, 0, 0, 18.19 MB, 18.19 MB - FooterProcessingTime: (Avg: 5.119ms ; Min: 3.754ms ; Max: 6.483ms ; Number of samples: 2) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 2.00 - BytesRead: 18.19 MB (19071655) - BytesReadDataNodeCache: 0 - BytesReadLocal: 18.19 MB (19071655) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 18.19 MB (19071655) - DecompressionTime: 13.996ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 2 (2) - NumRowGroups: 2 (2) - NumScannerThreadsStarted: 2 (2) - PeakMemoryUsage: 38.31 MB (40170278) - PerReadThreadRawHdfsThroughput: 99.33 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 209.370ms - RowBatchQueuePutWaitTime: 1s985ms - RowsRead: 1.54M (1540000) - RowsReturned: 468.45K (468453) - RowsReturnedRate: 405.17 K/sec - ScanRangesComplete: 2 (2) - ScannerThreadsInvoluntaryContextSwitches: 17 (17) - ScannerThreadsTotalWallClockTime: 4s380ms - MaterializeTupleTime(*): 86.572ms - ScannerThreadsSysTime: 21.995ms - ScannerThreadsUserTime: 88.985ms - ScannerThreadsVoluntaryContextSwitches: 368 (368) - TotalRawHdfsReadTime(*): 183.106ms - TotalReadThroughput: 7.28 MB/sec Filter 1 (1.00 MB): - Rows processed: 1.08M (1082272) - Rows rejected: 1.07M (1071547) - Rows total: 1.54M (1540000) Instance 7f40dcb034de70b7:21f (host=vc1511.foo:22000):(Total: 2s366ms, non-child: 1s163ms, % non-child: 49.18%) Hdfs split stats (:<# splits>/): 6:1/7.59 MB 1:1/38.97 MB Filter 1 arrival: 1s282ms MemoryUsage(500.000ms): 1.30 MB, 1.30 MB, 24.23 MB, 24.23 MB ThreadUsage(500.000ms): 1, 1, 3, 3 - AverageThreadTokens: 2.00 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 28.82 MB (30217128) - PerHostPeakMemUsage: 621.39 MB (651576170) - RowsProduced: 455.88K (455880) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1s114ms - TotalStorageWaitTime: 145.117ms - TotalThreadsInvoluntaryContextSwitches: 44 (44) - TotalThreadsTotalWallClockTime: 4s775ms - TotalThreadsSysTime: 25.995ms - TotalThreadsUserTime: 187.970ms - TotalThreadsVoluntaryContextSwitches: 728 (728) Fragment Instance Lifecycle Timings: - ExecTime: 2s295ms - ExecTreeExecTime: 1s056ms - OpenTime: 23.582ms - ExecTreeOpenTime: 29.128us - PrepareTime: 46.915ms - ExecTreePrepareTime: 94.818us DataStreamSender (dst_id=25):(Total: 97.131ms, non-child: 97.131ms, % non-child: 100.00%) - BytesSent: 7.28 MB (7632072) - NetworkThroughput(*): 153.09 MB/sec - OverallThroughput: 74.93 MB/sec - PeakMemoryUsage: 4.95 MB (5192768) - RowsReturned: 455.88K (455880) - SerializeBatchTime: 48.831ms - TransmitDataRPCTime: 47.544ms - UncompressedRowBatchSize: 7.39 MB (7751568) CodeGen:(Total: 48.592ms, non-child: 48.592ms, % non-child: 100.00%) - CodegenTime: 719.320us - CompileTime: 7.050ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 15.532ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 25.572ms HDFS_SCAN_NODE (id=0):(Total: 1s056ms, non-child: 1s056ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 6:1/7.59 MB 1:1/38.97 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 2 out of 2 Runtime filters: Only following filters arrived: , waited 944ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:6 BytesRead(500.000ms): 0, 0, 10.90 MB, 10.90 MB - FooterProcessingTime: (Avg: 7.676ms ; Min: 4.447ms ; Max: 10.906ms ; Number of samples: 2) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 10.90 MB (11429605) - BytesReadDataNodeCache: 0 - BytesReadLocal: 10.90 MB (11429605) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 10.90 MB (11429605) - DecompressionTime: 8.874ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 2 (2) - NumRowGroups: 2 (2) - NumScannerThreadsStarted: 2 (2) - PeakMemoryUsage: 24.70 MB (25896376) - PerReadThreadRawHdfsThroughput: 105.81 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 109.401ms - RowBatchQueuePutWaitTime: 2s124ms - RowsRead: 900.00K (900000) - RowsReturned: 455.88K (455880) - RowsReturnedRate: 431.41 K/sec - ScanRangesComplete: 2 (2) - ScannerThreadsInvoluntaryContextSwitches: 13 (13) - ScannerThreadsTotalWallClockTime: 2s456ms - MaterializeTupleTime(*): 54.723ms - ScannerThreadsSysTime: 12.997ms - ScannerThreadsUserTime: 58.990ms - ScannerThreadsVoluntaryContextSwitches: 275 (275) - TotalRawHdfsReadTime(*): 103.012ms - TotalReadThroughput: 5.45 MB/sec Filter 1 (1.00 MB): - Rows processed: 448.42K (448416) - Rows rejected: 444.12K (444120) - Rows total: 900.00K (900000) Instance 7f40dcb034de70b7:24c (host=vd1105.foo:22000):(Total: 2s341ms, non-child: 1s144ms, % non-child: 48.87%) Hdfs split stats (:<# splits>/): 0:1/38.99 MB Filter 1 arrival: 1s336ms MemoryUsage(500.000ms): 1.30 MB, 1.30 MB, 20.29 MB, 20.29 MB ThreadUsage(500.000ms): 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 23.31 MB (24440225) - PerHostPeakMemUsage: 651.99 MB (683665607) - RowsProduced: 456.65K (456648) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1s082ms - TotalStorageWaitTime: 88.979ms - TotalThreadsInvoluntaryContextSwitches: 58 (58) - TotalThreadsTotalWallClockTime: 4s415ms - TotalThreadsSysTime: 26.995ms - TotalThreadsUserTime: 199.969ms - TotalThreadsVoluntaryContextSwitches: 726 (726) Fragment Instance Lifecycle Timings: - ExecTime: 2s249ms - ExecTreeExecTime: 1s021ms - OpenTime: 29.695ms - ExecTreeOpenTime: 44.593us - PrepareTime: 62.539ms - ExecTreePrepareTime: 50.213us DataStreamSender (dst_id=25):(Total: 107.622ms, non-child: 107.622ms, % non-child: 100.00%) - BytesSent: 7.29 MB (7648088) - NetworkThroughput(*): 156.70 MB/sec - OverallThroughput: 67.77 MB/sec - PeakMemoryUsage: 4.95 MB (5192768) - RowsReturned: 456.65K (456648) - SerializeBatchTime: 60.160ms - TransmitDataRPCTime: 46.544ms - UncompressedRowBatchSize: 7.40 MB (7764624) CodeGen:(Total: 68.578ms, non-child: 68.578ms, % non-child: 100.00%) - CodegenTime: 1.957ms - CompileTime: 6.281ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 20.627ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 40.655ms HDFS_SCAN_NODE (id=0):(Total: 1s021ms, non-child: 1s021ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/38.99 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: Only following filters arrived: , waited 923ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:3 BytesRead(500.000ms): 0, 0, 8.98 MB, 8.98 MB - FooterProcessingTime: (Avg: 6.249ms ; Min: 6.249ms ; Max: 6.249ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 8.98 MB (9417421) - BytesReadDataNodeCache: 0 - BytesReadLocal: 8.98 MB (9417421) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 8.98 MB (9417421) - DecompressionTime: 6.796ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 18.13 MB (19013302) - PerReadThreadRawHdfsThroughput: 123.10 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 94.599ms - RowBatchQueuePutWaitTime: 1s086ms - RowsRead: 760.00K (760000) - RowsReturned: 456.65K (456648) - RowsReturnedRate: 447.20 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 10 (10) - ScannerThreadsTotalWallClockTime: 2s137ms - MaterializeTupleTime(*): 45.338ms - ScannerThreadsSysTime: 8.998ms - ScannerThreadsUserTime: 48.992ms - ScannerThreadsVoluntaryContextSwitches: 288 (288) - TotalRawHdfsReadTime(*): 72.958ms - TotalReadThroughput: 4.49 MB/sec Filter 1 (1.00 MB): - Rows processed: 306.37K (306368) - Rows rejected: 303.35K (303352) - Rows total: 760.00K (760000) Instance 7f40dcb034de70b7:250 (host=vd1135.foo:22000):(Total: 2s336ms, non-child: 1s142ms, % non-child: 48.91%) Hdfs split stats (:<# splits>/): 2:1/39.99 MB 4:1/38.98 MB Filter 1 arrival: 1s342ms MemoryUsage(500.000ms): 1.30 MB, 1.30 MB, 33.21 MB, 34.21 MB, 34.25 MB ThreadUsage(500.000ms): 3, 3, 3, 3, 3 - AverageThreadTokens: 3.00 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 45.23 MB (47431427) - PerHostPeakMemUsage: 673.11 MB (705808895) - RowsProduced: 458.13K (458126) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1s087ms - TotalStorageWaitTime: 213.682ms - TotalThreadsInvoluntaryContextSwitches: 48 (48) - TotalThreadsTotalWallClockTime: 6s545ms - TotalThreadsSysTime: 39.993ms - TotalThreadsUserTime: 206.968ms - TotalThreadsVoluntaryContextSwitches: 805 (805) Fragment Instance Lifecycle Timings: - ExecTime: 2s278ms - ExecTreeExecTime: 1s058ms - OpenTime: 17.750ms - ExecTreeOpenTime: 22.156us - PrepareTime: 40.277ms - ExecTreePrepareTime: 45.778us DataStreamSender (dst_id=25):(Total: 96.815ms, non-child: 96.815ms, % non-child: 100.00%) - BytesSent: 7.31 MB (7670172) - NetworkThroughput(*): 151.34 MB/sec - OverallThroughput: 75.55 MB/sec - PeakMemoryUsage: 4.95 MB (5192768) - RowsReturned: 458.13K (458126) - SerializeBatchTime: 47.790ms - TransmitDataRPCTime: 48.334ms - UncompressedRowBatchSize: 7.43 MB (7789750) CodeGen:(Total: 38.354ms, non-child: 38.354ms, % non-child: 100.00%) - CodegenTime: 742.568us - CompileTime: 4.291ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 12.493ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 21.213ms HDFS_SCAN_NODE (id=0):(Total: 1s058ms, non-child: 1s058ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:1/39.99 MB 4:1/38.98 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 2 out of 2 Runtime filters: Only following filters arrived: , waited 944ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:6 BytesRead(500.000ms): 0, 0, 18.19 MB, 18.19 MB, 18.19 MB - FooterProcessingTime: (Avg: 9.119ms ; Min: 6.580ms ; Max: 11.657ms ; Number of samples: 2) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 2.00 - BytesRead: 18.19 MB (19072594) - BytesReadDataNodeCache: 0 - BytesReadLocal: 18.19 MB (19072594) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 18.19 MB (19072594) - DecompressionTime: 12.438ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 2 (2) - NumRowGroups: 2 (2) - NumScannerThreadsStarted: 2 (2) - PeakMemoryUsage: 40.50 MB (42462280) - PerReadThreadRawHdfsThroughput: 114.61 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 112.762ms - RowBatchQueuePutWaitTime: 2s116ms - RowsRead: 1.54M (1540000) - RowsReturned: 458.13K (458126) - RowsReturnedRate: 432.83 K/sec - ScanRangesComplete: 2 (2) - ScannerThreadsInvoluntaryContextSwitches: 13 (13) - ScannerThreadsTotalWallClockTime: 4s250ms - MaterializeTupleTime(*): 83.598ms - ScannerThreadsSysTime: 11.997ms - ScannerThreadsUserTime: 91.985ms - ScannerThreadsVoluntaryContextSwitches: 365 (365) - TotalRawHdfsReadTime(*): 158.709ms - TotalReadThroughput: 7.28 MB/sec Filter 1 (1.00 MB): - Rows processed: 1.09M (1092512) - Rows rejected: 1.08M (1081874) - Rows total: 1.54M (1540000) Instance 7f40dcb034de70b7:208 (host=va1038.foo:22000):(Total: 2s325ms, non-child: 1s128ms, % non-child: 48.52%) Hdfs split stats (:<# splits>/): 0:1/36.96 MB Filter 1 arrival: 1s213ms MemoryUsage(500.000ms): 1.30 MB, 1.30 MB, 19.45 MB, 19.45 MB ThreadUsage(500.000ms): 1, 2, 2, 2 - AverageThreadTokens: 1.75 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 22.21 MB (23287859) - PerHostPeakMemUsage: 650.30 MB (681890823) - RowsProduced: 461.35K (461353) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1s065ms - TotalStorageWaitTime: 102.605ms - TotalThreadsInvoluntaryContextSwitches: 44 (44) - TotalThreadsTotalWallClockTime: 3s823ms - TotalThreadsSysTime: 25.995ms - TotalThreadsUserTime: 177.973ms - TotalThreadsVoluntaryContextSwitches: 644 (644) Fragment Instance Lifecycle Timings: - ExecTime: 2s248ms - ExecTreeExecTime: 1s058ms - OpenTime: 24.495ms - ExecTreeOpenTime: 38.155us - PrepareTime: 52.243ms - ExecTreePrepareTime: 90.940us DataStreamSender (dst_id=25):(Total: 88.834ms, non-child: 88.834ms, % non-child: 100.00%) - BytesSent: 7.37 MB (7726669) - NetworkThroughput(*): 169.05 MB/sec - OverallThroughput: 82.95 MB/sec - PeakMemoryUsage: 4.95 MB (5192768) - RowsReturned: 461.35K (461353) - SerializeBatchTime: 44.326ms - TransmitDataRPCTime: 43.588ms - UncompressedRowBatchSize: 7.48 MB (7844609) CodeGen:(Total: 50.199ms, non-child: 50.199ms, % non-child: 100.00%) - CodegenTime: 1.544ms - CompileTime: 6.112ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 16.746ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 26.777ms HDFS_SCAN_NODE (id=0):(Total: 1s058ms, non-child: 1s058ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/36.96 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: Only following filters arrived: , waited 944ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:3 BytesRead(500.000ms): 0, 0, 8.53 MB, 8.53 MB - FooterProcessingTime: (Avg: 6.346ms ; Min: 6.346ms ; Max: 6.346ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.75 - BytesRead: 8.53 MB (8939920) - BytesReadDataNodeCache: 0 - BytesReadLocal: 8.53 MB (8939920) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 8.53 MB (8939920) - DecompressionTime: 5.838ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 16.81 MB (17630294) - PerReadThreadRawHdfsThroughput: 102.33 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 112.179ms - RowBatchQueuePutWaitTime: 1s042ms - RowsRead: 720.00K (720000) - RowsReturned: 461.35K (461353) - RowsReturnedRate: 435.96 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 17 (17) - ScannerThreadsTotalWallClockTime: 1s550ms - MaterializeTupleTime(*): 48.967ms - ScannerThreadsSysTime: 8.998ms - ScannerThreadsUserTime: 51.992ms - ScannerThreadsVoluntaryContextSwitches: 198 (198) - TotalRawHdfsReadTime(*): 83.319ms - TotalReadThroughput: 4.26 MB/sec Filter 1 (1.00 MB): - Rows processed: 261.25K (261248) - Rows rejected: 258.65K (258647) - Rows total: 720.00K (720000) Instance 7f40dcb034de70b7:25f (host=vc1530.foo:22000):(Total: 2s297ms, non-child: 1s094ms, % non-child: 47.63%) Hdfs split stats (:<# splits>/): 0:1/38.97 MB 1:1/37.96 MB Filter 1 arrival: 1s357ms MemoryUsage(500.000ms): 1.30 MB, 1.30 MB, 33.81 MB, 34.81 MB, 4.83 MB ThreadUsage(500.000ms): 1, 3, 3, 3, 1 - AverageThreadTokens: 2.20 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 44.55 MB (46711068) - PerHostPeakMemUsage: 662.46 MB (694638755) - RowsProduced: 452.52K (452520) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1s050ms - TotalStorageWaitTime: 231.397ms - TotalThreadsInvoluntaryContextSwitches: 52 (52) - TotalThreadsTotalWallClockTime: 5s277ms - TotalThreadsSysTime: 25.994ms - TotalThreadsUserTime: 229.964ms - TotalThreadsVoluntaryContextSwitches: 697 (697) Fragment Instance Lifecycle Timings: - ExecTime: 2s238ms - ExecTreeExecTime: 1s074ms - OpenTime: 23.136ms - ExecTreeOpenTime: 39.451us - PrepareTime: 36.265ms - ExecTreePrepareTime: 65.557us DataStreamSender (dst_id=25):(Total: 90.730ms, non-child: 90.730ms, % non-child: 100.00%) - BytesSent: 7.23 MB (7576961) - NetworkThroughput(*): 162.55 MB/sec - OverallThroughput: 79.64 MB/sec - PeakMemoryUsage: 4.95 MB (5192768) - RowsReturned: 452.52K (452520) - SerializeBatchTime: 45.718ms - TransmitDataRPCTime: 44.452ms - UncompressedRowBatchSize: 7.34 MB (7694448) CodeGen:(Total: 38.258ms, non-child: 38.258ms, % non-child: 100.00%) - CodegenTime: 1.079ms - CompileTime: 6.142ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 15.738ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 15.776ms HDFS_SCAN_NODE (id=0):(Total: 1s074ms, non-child: 1s074ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/38.97 MB 1:1/37.96 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 2 out of 2 Runtime filters: Only following filters arrived: , waited 944ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:6 BytesRead(500.000ms): 0, 0, 17.73 MB, 17.73 MB - FooterProcessingTime: (Avg: 11.631ms ; Min: 7.862ms ; Max: 15.399ms ; Number of samples: 2) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.50 - BytesRead: 17.73 MB (18593962) - BytesReadDataNodeCache: 0 - BytesReadLocal: 17.73 MB (18593962) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 17.73 MB (18593962) - DecompressionTime: 15.621ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 2 (2) - NumRowGroups: 2 (2) - NumScannerThreadsStarted: 2 (2) - PeakMemoryUsage: 39.05 MB (40947659) - PerReadThreadRawHdfsThroughput: 104.31 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 128.086ms - RowBatchQueuePutWaitTime: 2s035ms - RowsRead: 1.50M (1500000) - RowsReturned: 452.52K (452520) - RowsReturnedRate: 421.28 K/sec - ScanRangesComplete: 2 (2) - ScannerThreadsInvoluntaryContextSwitches: 18 (18) - ScannerThreadsTotalWallClockTime: 3s016ms - MaterializeTupleTime(*): 99.496ms - ScannerThreadsSysTime: 13.996ms - ScannerThreadsUserTime: 111.982ms - ScannerThreadsVoluntaryContextSwitches: 235 (235) - TotalRawHdfsReadTime(*): 169.999ms - TotalReadThroughput: 8.87 MB/sec Filter 1 (1.00 MB): - Rows processed: 1.06M (1057632) - Rows rejected: 1.05M (1047480) - Rows total: 1.50M (1500000) Instance 7f40dcb034de70b7:215 (host=ve1140.foo:22000):(Total: 2s273ms, non-child: 1s073ms, % non-child: 47.20%) Hdfs split stats (:<# splits>/): 5:1/37.96 MB Filter 1 arrival: 1s266ms MemoryUsage(500.000ms): 1.30 MB, 1.30 MB, 21.63 MB, 4.03 MB ThreadUsage(500.000ms): 2, 2, 2, 1 - AverageThreadTokens: 1.75 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 23.12 MB (24243630) - PerHostPeakMemUsage: 630.12 MB (660730150) - RowsProduced: 614.55K (614546) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1s026ms - TotalStorageWaitTime: 100.225ms - TotalThreadsInvoluntaryContextSwitches: 51 (51) - TotalThreadsTotalWallClockTime: 3s612ms - TotalThreadsSysTime: 28.996ms - TotalThreadsUserTime: 168.974ms - TotalThreadsVoluntaryContextSwitches: 665 (665) Fragment Instance Lifecycle Timings: - ExecTime: 2s207ms - ExecTreeExecTime: 1s050ms - OpenTime: 22.117ms - ExecTreeOpenTime: 44.828us - PrepareTime: 43.758ms - ExecTreePrepareTime: 79.586us DataStreamSender (dst_id=25):(Total: 108.571ms, non-child: 108.571ms, % non-child: 100.00%) - BytesSent: 9.82 MB (10293350) - NetworkThroughput(*): 187.86 MB/sec - OverallThroughput: 90.42 MB/sec - PeakMemoryUsage: 4.95 MB (5192768) - RowsReturned: 614.55K (614546) - SerializeBatchTime: 55.421ms - TransmitDataRPCTime: 52.253ms - UncompressedRowBatchSize: 9.97 MB (10449426) CodeGen:(Total: 41.587ms, non-child: 41.587ms, % non-child: 100.00%) - CodegenTime: 1.060ms - CompileTime: 6.528ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 14.500ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 20.043ms HDFS_SCAN_NODE (id=0):(Total: 1s050ms, non-child: 1s050ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:1/37.96 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: Only following filters arrived: , waited 944ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:3 BytesRead(500.000ms): 0, 0, 8.75 MB - FooterProcessingTime: (Avg: 7.696ms ; Min: 7.696ms ; Max: 7.696ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 8.75 MB (9178851) - BytesReadDataNodeCache: 0 - BytesReadLocal: 8.75 MB (9178851) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 8.75 MB (9178851) - DecompressionTime: 6.504ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 18.91 MB (19831539) - PerReadThreadRawHdfsThroughput: 113.63 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 103.564ms - RowBatchQueuePutWaitTime: 311.645ms - RowsRead: 740.00K (740000) - RowsReturned: 614.55K (614546) - RowsReturnedRate: 585.02 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 11 (11) - ScannerThreadsTotalWallClockTime: 1s382ms - MaterializeTupleTime(*): 37.162ms - ScannerThreadsSysTime: 12.998ms - ScannerThreadsUserTime: 38.994ms - ScannerThreadsVoluntaryContextSwitches: 228 (228) - TotalRawHdfsReadTime(*): 77.034ms - TotalReadThroughput: 5.84 MB/sec Filter 1 (1.00 MB): - Rows processed: 126.62K (126624) - Rows rejected: 125.45K (125454) - Rows total: 740.00K (740000) Instance 7f40dcb034de70b7:260 (host=vd1334.foo:22000):(Total: 2s222ms, non-child: 1s013ms, % non-child: 45.63%) Hdfs split stats (:<# splits>/): 7:1/38.98 MB Filter 1 arrival: 1s356ms MemoryUsage(500.000ms): 1.30 MB, 1.30 MB, 19.72 MB, 4.48 MB, 4.48 MB ThreadUsage(500.000ms): 1, 1, 2, 1, 1 - AverageThreadTokens: 1.20 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 21.24 MB (22271552) - PerHostPeakMemUsage: 634.22 MB (665027179) - RowsProduced: 628.98K (628976) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 953.985ms - TotalStorageWaitTime: 97.463ms - TotalThreadsInvoluntaryContextSwitches: 70 (70) - TotalThreadsTotalWallClockTime: 2s830ms - TotalThreadsSysTime: 33.994ms - TotalThreadsUserTime: 207.968ms - TotalThreadsVoluntaryContextSwitches: 715 (715) Fragment Instance Lifecycle Timings: - ExecTime: 2s142ms - ExecTreeExecTime: 1s027ms - OpenTime: 23.060ms - ExecTreeOpenTime: 32.412us - PrepareTime: 57.089ms - ExecTreePrepareTime: 88.621us DataStreamSender (dst_id=25):(Total: 130.588ms, non-child: 130.588ms, % non-child: 100.00%) - BytesSent: 10.05 MB (10539036) - NetworkThroughput(*): 166.10 MB/sec - OverallThroughput: 76.97 MB/sec - PeakMemoryUsage: 4.95 MB (5192768) - RowsReturned: 628.98K (628976) - SerializeBatchTime: 68.640ms - TransmitDataRPCTime: 60.511ms - UncompressedRowBatchSize: 10.20 MB (10694736) CodeGen:(Total: 50.420ms, non-child: 50.420ms, % non-child: 100.00%) - CodegenTime: 1.553ms - CompileTime: 6.151ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 15.061ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 28.636ms HDFS_SCAN_NODE (id=0):(Total: 1s027ms, non-child: 1s027ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:1/38.98 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: Only following filters arrived: , waited 924ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:3 BytesRead(500.000ms): 0, 0, 8.98 MB - FooterProcessingTime: (Avg: 7.903ms ; Min: 7.903ms ; Max: 7.903ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.33 - BytesRead: 8.98 MB (9417089) - BytesReadDataNodeCache: 0 - BytesReadLocal: 8.98 MB (9417089) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 8.98 MB (9417089) - DecompressionTime: 7.584ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 17.14 MB (17970152) - PerReadThreadRawHdfsThroughput: 120.99 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 100.723ms - RowBatchQueuePutWaitTime: 206.672ms - RowsRead: 760.00K (760000) - RowsReturned: 628.98K (628976) - RowsReturnedRate: 612.24 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 20 (20) - ScannerThreadsTotalWallClockTime: 665.895ms - MaterializeTupleTime(*): 50.802ms - ScannerThreadsSysTime: 11.998ms - ScannerThreadsUserTime: 53.991ms - ScannerThreadsVoluntaryContextSwitches: 276 (276) - TotalRawHdfsReadTime(*): 74.228ms - TotalReadThroughput: 5.99 MB/sec Filter 1 (1.00 MB): - Rows processed: 132.29K (132288) - Rows rejected: 131.02K (131024) - Rows total: 760.00K (760000) Instance 7f40dcb034de70b7:228 (host=va1037.foo:22000):(Total: 1s562ms, non-child: 350.107ms, % non-child: 22.41%) Hdfs split stats (:<# splits>/): 2:1/39.99 MB 3:1/38.98 MB Filter 1 arrival: 1s297ms MemoryUsage(500.000ms): 1.30 MB, 1.30 MB, 33.91 MB ThreadUsage(500.000ms): 1, 1, 3 - AverageThreadTokens: 1.67 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 43.42 MB (45530675) - PerHostPeakMemUsage: 538.02 MB (564156195) - RowsProduced: 456.19K (456187) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 283.677ms - TotalStorageWaitTime: 245.724ms - TotalThreadsInvoluntaryContextSwitches: 55 (55) - TotalThreadsTotalWallClockTime: 2s956ms - TotalThreadsSysTime: 44.993ms - TotalThreadsUserTime: 234.964ms - TotalThreadsVoluntaryContextSwitches: 773 (773) Fragment Instance Lifecycle Timings: - ExecTime: 1s457ms - ExecTreeExecTime: 1s038ms - OpenTime: 30.248ms - ExecTreeOpenTime: 54.659us - PrepareTime: 74.468ms - ExecTreePrepareTime: 106.933us DataStreamSender (dst_id=25):(Total: 99.798ms, non-child: 99.798ms, % non-child: 100.00%) - BytesSent: 7.29 MB (7640900) - NetworkThroughput(*): 165.35 MB/sec - OverallThroughput: 73.02 MB/sec - PeakMemoryUsage: 4.95 MB (5192768) - RowsReturned: 456.19K (456187) - SerializeBatchTime: 53.130ms - TransmitDataRPCTime: 44.070ms - UncompressedRowBatchSize: 7.40 MB (7756787) CodeGen:(Total: 73.890ms, non-child: 73.890ms, % non-child: 100.00%) - CodegenTime: 1.119ms - CompileTime: 8.020ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 20.601ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 44.663ms HDFS_SCAN_NODE (id=0):(Total: 1s038ms, non-child: 1s038ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:1/39.99 MB 3:1/38.98 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 2 out of 2 Runtime filters: Only following filters arrived: , waited 903ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:6 BytesRead(500.000ms): 0, 0, 18.19 MB - FooterProcessingTime: (Avg: 9.300ms ; Min: 7.608ms ; Max: 10.991ms ; Number of samples: 2) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.67 - BytesRead: 18.19 MB (19072826) - BytesReadDataNodeCache: 0 - BytesReadLocal: 18.19 MB (19072826) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 18.19 MB (19072826) - DecompressionTime: 13.141ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 2 (2) - NumRowGroups: 2 (2) - NumScannerThreadsStarted: 2 (2) - PeakMemoryUsage: 37.74 MB (39572210) - PerReadThreadRawHdfsThroughput: 93.76 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 131.428ms - RowBatchQueuePutWaitTime: 542.811ms - RowsRead: 1.54M (1540000) - RowsReturned: 456.19K (456187) - RowsReturnedRate: 439.28 K/sec - ScanRangesComplete: 2 (2) - ScannerThreadsInvoluntaryContextSwitches: 19 (19) - ScannerThreadsTotalWallClockTime: 1s469ms - MaterializeTupleTime(*): 99.171ms - ScannerThreadsSysTime: 16.997ms - ScannerThreadsUserTime: 104.983ms - ScannerThreadsVoluntaryContextSwitches: 308 (308) - TotalRawHdfsReadTime(*): 194.001ms - TotalReadThroughput: 12.13 MB/sec Filter 1 (1.00 MB): - Rows processed: 1.09M (1094560) - Rows rejected: 1.08M (1083813) - Rows total: 1.54M (1540000) Instance 7f40dcb034de70b7:26b (host=vd1115.foo:22000):(Total: 1s560ms, non-child: 382.332ms, % non-child: 24.50%) Hdfs split stats (:<# splits>/): 1:1/40.00 MB Filter 1 arrival: 1s368ms MemoryUsage(500.000ms): 1.30 MB, 1.30 MB, 19.85 MB ThreadUsage(500.000ms): 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 23.79 MB (24947764) - PerHostPeakMemUsage: 526.83 MB (552418933) - RowsProduced: 458.80K (458798) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 336.388ms - TotalStorageWaitTime: 81.230ms - TotalThreadsInvoluntaryContextSwitches: 43 (43) - TotalThreadsTotalWallClockTime: 2s879ms - TotalThreadsSysTime: 28.995ms - TotalThreadsUserTime: 161.975ms - TotalThreadsVoluntaryContextSwitches: 588 (588) Fragment Instance Lifecycle Timings: - ExecTime: 1s510ms - ExecTreeExecTime: 1s060ms - OpenTime: 17.553ms - ExecTreeOpenTime: 23.514us - PrepareTime: 32.825ms - ExecTreePrepareTime: 74.508us DataStreamSender (dst_id=25):(Total: 88.224ms, non-child: 88.224ms, % non-child: 100.00%) - BytesSent: 7.33 MB (7685529) - NetworkThroughput(*): 166.87 MB/sec - OverallThroughput: 83.08 MB/sec - PeakMemoryUsage: 4.95 MB (5192768) - RowsReturned: 458.80K (458798) - SerializeBatchTime: 43.760ms - TransmitDataRPCTime: 43.922ms - UncompressedRowBatchSize: 7.44 MB (7801174) CodeGen:(Total: 29.663ms, non-child: 29.663ms, % non-child: 100.00%) - CodegenTime: 707.139us - CompileTime: 4.470ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 12.099ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 12.753ms HDFS_SCAN_NODE (id=0):(Total: 1s060ms, non-child: 1s060ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:1/40.00 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: Only following filters arrived: , waited 964ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:3 BytesRead(500.000ms): 0, 0, 9.21 MB - FooterProcessingTime: (Avg: 9.330ms ; Min: 9.330ms ; Max: 9.330ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 9.21 MB (9655673) - BytesReadDataNodeCache: 0 - BytesReadLocal: 9.21 MB (9655673) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 9.21 MB (9655673) - DecompressionTime: 7.430ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 17.85 MB (18715102) - PerReadThreadRawHdfsThroughput: 155.30 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 94.182ms - RowBatchQueuePutWaitTime: 284.936ms - RowsRead: 780.00K (780000) - RowsReturned: 458.80K (458798) - RowsReturnedRate: 432.63 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 12 (12) - ScannerThreadsTotalWallClockTime: 1s351ms - MaterializeTupleTime(*): 52.467ms - ScannerThreadsSysTime: 12.998ms - ScannerThreadsUserTime: 52.991ms - ScannerThreadsVoluntaryContextSwitches: 144 (144) - TotalRawHdfsReadTime(*): 59.294ms - TotalReadThroughput: 6.14 MB/sec Filter 1 (1.00 MB): - Rows processed: 324.32K (324320) - Rows rejected: 321.20K (321202) - Rows total: 780.00K (780000) Instance 7f40dcb034de70b7:24e (host=vd1118.foo:22000):(Total: 1s546ms, non-child: 644.898ms, % non-child: 41.69%) Hdfs split stats (:<# splits>/): 3:1/38.97 MB Filter 1 arrival: 1s332ms MemoryUsage(500.000ms): 0, 1.30 MB, 19.43 MB ThreadUsage(500.000ms): 1, 1, 2 - AverageThreadTokens: 1.33 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 21.25 MB (22279777) - PerHostPeakMemUsage: 504.21 MB (528707492) - RowsProduced: 618.87K (618872) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 273.143ms - TotalStorageWaitTime: 94.979ms - TotalThreadsInvoluntaryContextSwitches: 48 (48) - TotalThreadsTotalWallClockTime: 1s569ms - TotalThreadsSysTime: 31.995ms - TotalThreadsUserTime: 208.968ms - TotalThreadsVoluntaryContextSwitches: 884 (884) Fragment Instance Lifecycle Timings: - ExecTime: 1s089ms - ExecTreeExecTime: 667.119ms - OpenTime: 49.339ms - ExecTreeOpenTime: 428.224us - PrepareTime: 407.766ms - ExecTreePrepareTime: 43.128us DataStreamSender (dst_id=25):(Total: 135.046ms, non-child: 135.046ms, % non-child: 100.00%) - BytesSent: 9.88 MB (10364644) - NetworkThroughput(*): 167.90 MB/sec - OverallThroughput: 73.19 MB/sec - PeakMemoryUsage: 4.95 MB (5192768) - RowsReturned: 618.87K (618872) - SerializeBatchTime: 60.037ms - TransmitDataRPCTime: 58.871ms - UncompressedRowBatchSize: 10.04 MB (10522968) CodeGen:(Total: 99.478ms, non-child: 99.478ms, % non-child: 100.00%) - CodegenTime: 2.292ms - CompileTime: 13.445ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 30.783ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 54.237ms HDFS_SCAN_NODE (id=0):(Total: 667.405ms, non-child: 667.405ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:1/38.97 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: Only following filters arrived: , waited 562ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:3 BytesRead(500.000ms): 0, 0, 8.98 MB - FooterProcessingTime: (Avg: 11.679ms ; Min: 11.679ms ; Max: 11.679ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.50 - BytesRead: 8.98 MB (9416699) - BytesReadDataNodeCache: 0 - BytesReadLocal: 8.98 MB (9416699) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 8.98 MB (9416699) - DecompressionTime: 6.806ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 17.43 MB (18278181) - PerReadThreadRawHdfsThroughput: 130.84 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 101.028ms - RowBatchQueuePutWaitTime: 279.686ms - RowsRead: 760.00K (760000) - RowsReturned: 618.87K (618872) - RowsReturnedRate: 927.28 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 13 (13) - ScannerThreadsTotalWallClockTime: 432.142ms - MaterializeTupleTime(*): 40.556ms - ScannerThreadsSysTime: 4.999ms - ScannerThreadsUserTime: 49.992ms - ScannerThreadsVoluntaryContextSwitches: 445 (445) - TotalRawHdfsReadTime(*): 68.635ms - TotalReadThroughput: 5.99 MB/sec Filter 1 (1.00 MB): - Rows processed: 142.53K (142528) - Rows rejected: 141.13K (141128) - Rows total: 760.00K (760000) Instance 7f40dcb034de70b7:207 (host=vc1518.foo:22000):(Total: 1s530ms, non-child: 329.465ms, % non-child: 21.53%) Hdfs split stats (:<# splits>/): 7:1/38.98 MB Filter 1 arrival: 1s214ms MemoryUsage(500.000ms): 1.30 MB, 1.30 MB, 3.60 MB ThreadUsage(500.000ms): 2, 2, 1 - AverageThreadTokens: 1.67 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 21.24 MB (22271619) - PerHostPeakMemUsage: 509.10 MB (533834874) - RowsProduced: 760.00K (760000) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 284.796ms - TotalStorageWaitTime: 77.990ms - TotalThreadsInvoluntaryContextSwitches: 37 (37) - TotalThreadsTotalWallClockTime: 2s543ms - TotalThreadsSysTime: 26.996ms - TotalThreadsUserTime: 177.972ms - TotalThreadsVoluntaryContextSwitches: 957 (957) Fragment Instance Lifecycle Timings: - ExecTime: 1s464ms - ExecTreeExecTime: 1s027ms - OpenTime: 18.612ms - ExecTreeOpenTime: 23.525us - PrepareTime: 46.974ms - ExecTreePrepareTime: 83.313us DataStreamSender (dst_id=25):(Total: 130.815ms, non-child: 130.815ms, % non-child: 100.00%) - BytesSent: 12.15 MB (12736890) - NetworkThroughput(*): 180.28 MB/sec - OverallThroughput: 92.85 MB/sec - PeakMemoryUsage: 4.95 MB (5192768) - RowsReturned: 760.00K (760000) - SerializeBatchTime: 62.581ms - TransmitDataRPCTime: 67.378ms - UncompressedRowBatchSize: 12.32 MB (12922680) CodeGen:(Total: 42.935ms, non-child: 42.935ms, % non-child: 100.00%) - CodegenTime: 787.762us - CompileTime: 4.747ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 12.831ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 24.953ms HDFS_SCAN_NODE (id=0):(Total: 1s026ms, non-child: 1s026ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:1/38.98 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: Only following filters arrived: , waited 944ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:3 BytesRead(500.000ms): 0, 0 - FooterProcessingTime: (Avg: 3.508ms ; Min: 3.508ms ; Max: 3.508ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 8.98 MB (9416344) - BytesReadDataNodeCache: 0 - BytesReadLocal: 8.98 MB (9416344) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 8.98 MB (9416344) - DecompressionTime: 5.771ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 16.27 MB (17064847) - PerReadThreadRawHdfsThroughput: 143.80 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 80.590ms - RowBatchQueuePutWaitTime: 58.024ms - RowsRead: 760.00K (760000) - RowsReturned: 760.00K (760000) - RowsReturnedRate: 740.04 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 9 (9) - ScannerThreadsTotalWallClockTime: 1s060ms - MaterializeTupleTime(*): 26.422ms - ScannerThreadsSysTime: 5.999ms - ScannerThreadsUserTime: 32.994ms - ScannerThreadsVoluntaryContextSwitches: 521 (521) - TotalRawHdfsReadTime(*): 62.450ms - TotalReadThroughput: 0.00 /sec Filter 1 (1.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 760.00K (760000) Instance 7f40dcb034de70b7:242 (host=vc1522.foo:22000):(Total: 1s513ms, non-child: 332.452ms, % non-child: 21.96%) Hdfs split stats (:<# splits>/): 2:1/36.96 MB Filter 1 arrival: 1s326ms MemoryUsage(500.000ms): 1.30 MB, 1.30 MB, 20.46 MB ThreadUsage(500.000ms): 1, 2, 2 - AverageThreadTokens: 1.67 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 24.70 MB (25897544) - PerHostPeakMemUsage: 515.35 MB (540379882) - RowsProduced: 455.24K (455238) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 281.995ms - TotalStorageWaitTime: 102.819ms - TotalThreadsInvoluntaryContextSwitches: 42 (42) - TotalThreadsTotalWallClockTime: 2s146ms - TotalThreadsSysTime: 31.994ms - TotalThreadsUserTime: 152.976ms - TotalThreadsVoluntaryContextSwitches: 675 (675) Fragment Instance Lifecycle Timings: - ExecTime: 1s426ms - ExecTreeExecTime: 1s031ms - OpenTime: 34.850ms - ExecTreeOpenTime: 243.123us - PrepareTime: 52.290ms - ExecTreePrepareTime: 83.459us DataStreamSender (dst_id=25):(Total: 91.106ms, non-child: 91.106ms, % non-child: 100.00%) - BytesSent: 7.27 MB (7623819) - NetworkThroughput(*): 165.46 MB/sec - OverallThroughput: 79.80 MB/sec - PeakMemoryUsage: 4.95 MB (5192768) - RowsReturned: 455.24K (455238) - SerializeBatchTime: 45.857ms - TransmitDataRPCTime: 43.941ms - UncompressedRowBatchSize: 7.38 MB (7740654) CodeGen:(Total: 58.333ms, non-child: 58.333ms, % non-child: 100.00%) - CodegenTime: 1.876ms - CompileTime: 9.536ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 22.875ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 25.224ms HDFS_SCAN_NODE (id=0):(Total: 1s032ms, non-child: 1s032ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:1/36.96 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: Only following filters arrived: , waited 924ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:3 BytesRead(500.000ms): 0, 0, 8.52 MB - FooterProcessingTime: (Avg: 10.139ms ; Min: 10.139ms ; Max: 10.139ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.67 - BytesRead: 8.52 MB (8939080) - BytesReadDataNodeCache: 0 - BytesReadLocal: 8.52 MB (8939080) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 8.52 MB (8939080) - DecompressionTime: 5.408ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 18.92 MB (19834943) - PerReadThreadRawHdfsThroughput: 113.41 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 105.996ms - RowBatchQueuePutWaitTime: 256.184ms - RowsRead: 720.00K (720000) - RowsReturned: 455.24K (455238) - RowsReturnedRate: 441.09 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 10 (10) - ScannerThreadsTotalWallClockTime: 685.256ms - MaterializeTupleTime(*): 33.685ms - ScannerThreadsSysTime: 9.998ms - ScannerThreadsUserTime: 34.994ms - ScannerThreadsVoluntaryContextSwitches: 238 (238) - TotalRawHdfsReadTime(*): 75.169ms - TotalReadThroughput: 5.68 MB/sec Filter 1 (1.00 MB): - Rows processed: 267.39K (267392) - Rows rejected: 264.76K (264762) - Rows total: 720.00K (720000) Instance 7f40dcb034de70b7:20c (host=vd1342.foo:22000):(Total: 1s507ms, non-child: 320.019ms, % non-child: 21.23%) Hdfs split stats (:<# splits>/): 4:1/38.98 MB Filter 1 arrival: 1s240ms MemoryUsage(500.000ms): 1.30 MB, 1.30 MB, 4.23 MB ThreadUsage(500.000ms): 2, 2, 1 - AverageThreadTokens: 1.67 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 22.97 MB (24084199) - PerHostPeakMemUsage: 505.17 MB (529710189) - RowsProduced: 458.56K (458557) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 254.831ms - TotalStorageWaitTime: 96.687ms - TotalThreadsInvoluntaryContextSwitches: 38 (38) - TotalThreadsTotalWallClockTime: 2s728ms - TotalThreadsSysTime: 24.995ms - TotalThreadsUserTime: 177.973ms - TotalThreadsVoluntaryContextSwitches: 697 (697) Fragment Instance Lifecycle Timings: - ExecTime: 1s412ms - ExecTreeExecTime: 1s031ms - OpenTime: 25.312ms - ExecTreeOpenTime: 49.049us - PrepareTime: 69.643ms - ExecTreePrepareTime: 199.806us DataStreamSender (dst_id=25):(Total: 91.771ms, non-child: 91.771ms, % non-child: 100.00%) - BytesSent: 7.32 MB (7678978) - NetworkThroughput(*): 172.13 MB/sec - OverallThroughput: 79.80 MB/sec - PeakMemoryUsage: 4.95 MB (5192768) - RowsReturned: 458.56K (458557) - SerializeBatchTime: 47.401ms - TransmitDataRPCTime: 42.545ms - UncompressedRowBatchSize: 7.44 MB (7797077) CodeGen:(Total: 63.608ms, non-child: 63.608ms, % non-child: 100.00%) - CodegenTime: 1.019ms - CompileTime: 6.603ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 16.440ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 40.043ms HDFS_SCAN_NODE (id=0):(Total: 1s031ms, non-child: 1s031ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:1/38.98 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: Only following filters arrived: , waited 924ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:3 BytesRead(500.000ms): 0, 0 - FooterProcessingTime: (Avg: 8.498ms ; Min: 8.498ms ; Max: 8.498ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 8.98 MB (9417441) - BytesReadDataNodeCache: 0 - BytesReadLocal: 8.98 MB (9417441) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 8.98 MB (9417441) - DecompressionTime: 6.401ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 17.32 MB (18156778) - PerReadThreadRawHdfsThroughput: 122.75 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 105.562ms - RowBatchQueuePutWaitTime: 220.764ms - RowsRead: 760.00K (760000) - RowsReturned: 458.56K (458557) - RowsReturnedRate: 444.35 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 5 (5) - ScannerThreadsTotalWallClockTime: 1s292ms - MaterializeTupleTime(*): 45.994ms - ScannerThreadsSysTime: 6.998ms - ScannerThreadsUserTime: 51.992ms - ScannerThreadsVoluntaryContextSwitches: 247 (247) - TotalRawHdfsReadTime(*): 73.167ms - TotalReadThroughput: 0.00 /sec Filter 1 (1.00 MB): - Rows processed: 304.32K (304320) - Rows rejected: 301.44K (301443) - Rows total: 760.00K (760000) Instance 7f40dcb034de70b7:21b (host=ve1126.foo:22000):(Total: 1s504ms, non-child: 322.402ms, % non-child: 21.43%) Hdfs split stats (:<# splits>/): 2:1/38.98 MB Filter 1 arrival: 1s282ms MemoryUsage(500.000ms): 1.30 MB, 1.30 MB, 18.36 MB ThreadUsage(500.000ms): 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 22.76 MB (23863499) - PerHostPeakMemUsage: 513.64 MB (538587109) - RowsProduced: 464.69K (464695) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 261.145ms - TotalStorageWaitTime: 95.742ms - TotalThreadsInvoluntaryContextSwitches: 39 (39) - TotalThreadsTotalWallClockTime: 2s718ms - TotalThreadsSysTime: 16.997ms - TotalThreadsUserTime: 185.972ms - TotalThreadsVoluntaryContextSwitches: 751 (751) Fragment Instance Lifecycle Timings: - ExecTime: 1s416ms - ExecTreeExecTime: 1s029ms - OpenTime: 32.851ms - ExecTreeOpenTime: 55.789us - PrepareTime: 54.889ms - ExecTreePrepareTime: 94.053us DataStreamSender (dst_id=25):(Total: 93.328ms, non-child: 93.328ms, % non-child: 100.00%) - BytesSent: 7.42 MB (7782799) - NetworkThroughput(*): 158.35 MB/sec - OverallThroughput: 79.53 MB/sec - PeakMemoryUsage: 4.95 MB (5192768) - RowsReturned: 464.69K (464695) - SerializeBatchTime: 45.382ms - TransmitDataRPCTime: 46.871ms - UncompressedRowBatchSize: 7.54 MB (7901423) CodeGen:(Total: 59.059ms, non-child: 59.059ms, % non-child: 100.00%) - CodegenTime: 1.531ms - CompileTime: 6.633ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 24.509ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 27.270ms HDFS_SCAN_NODE (id=0):(Total: 1s029ms, non-child: 1s029ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:1/38.98 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: Only following filters arrived: , waited 923ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:3 BytesRead(500.000ms): 0, 0, 8.98 MB - FooterProcessingTime: (Avg: 7.260ms ; Min: 7.260ms ; Max: 7.260ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 8.98 MB (9417679) - BytesReadDataNodeCache: 0 - BytesReadLocal: 8.98 MB (9417679) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 8.98 MB (9417679) - DecompressionTime: 6.178ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 16.64 MB (17450496) - PerReadThreadRawHdfsThroughput: 122.60 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 103.417ms - RowBatchQueuePutWaitTime: 240.763ms - RowsRead: 760.00K (760000) - RowsReturned: 464.69K (464695) - RowsReturnedRate: 451.31 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 8 (8) - ScannerThreadsTotalWallClockTime: 1s269ms - MaterializeTupleTime(*): 38.196ms - ScannerThreadsSysTime: 4.999ms - ScannerThreadsUserTime: 45.993ms - ScannerThreadsVoluntaryContextSwitches: 322 (322) - TotalRawHdfsReadTime(*): 73.256ms - TotalReadThroughput: 5.99 MB/sec Filter 1 (1.00 MB): - Rows processed: 298.18K (298176) - Rows rejected: 295.31K (295305) - Rows total: 760.00K (760000) Instance 7f40dcb034de70b7:25d (host=vd1110.foo:22000):(Total: 1s504ms, non-child: 147.077ms, % non-child: 9.78%) Hdfs split stats (:<# splits>/): 3:1/38.98 MB Filter 1 arrival: 1s350ms MemoryUsage(500.000ms): 0, 1.30 MB, 1.30 MB ThreadUsage(500.000ms): 1, 1, 2 - AverageThreadTokens: 1.33 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 23.31 MB (24444890) - PerHostPeakMemUsage: 507.70 MB (532359948) - RowsProduced: 286.31K (286311) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 74.169ms - TotalStorageWaitTime: 238.307ms - TotalThreadsInvoluntaryContextSwitches: 39 (39) - TotalThreadsTotalWallClockTime: 2s103ms - TotalThreadsSysTime: 23.996ms - TotalThreadsUserTime: 140.978ms - TotalThreadsVoluntaryContextSwitches: 556 (556) Fragment Instance Lifecycle Timings: - ExecTime: 1s403ms - ExecTreeExecTime: 1s235ms - OpenTime: 32.960ms - ExecTreeOpenTime: 30.612us - PrepareTime: 67.506ms - ExecTreePrepareTime: 80.388us DataStreamSender (dst_id=25):(Total: 68.939ms, non-child: 68.939ms, % non-child: 100.00%) - BytesSent: 4.57 MB (4789858) - NetworkThroughput(*): 142.90 MB/sec - OverallThroughput: 66.26 MB/sec - PeakMemoryUsage: 4.95 MB (5192768) - RowsReturned: 286.31K (286311) - SerializeBatchTime: 35.205ms - TransmitDataRPCTime: 31.965ms - UncompressedRowBatchSize: 4.64 MB (4868359) CodeGen:(Total: 52.623ms, non-child: 52.623ms, % non-child: 100.00%) - CodegenTime: 928.244us - CompileTime: 5.317ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 20.273ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 26.236ms HDFS_SCAN_NODE (id=0):(Total: 1s235ms, non-child: 1s235ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:1/38.98 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: Only following filters arrived: , waited 904ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:3 BytesRead(500.000ms): 0, 0, 0 - FooterProcessingTime: (Avg: 147.273ms ; Min: 147.273ms ; Max: 147.273ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.50 - BytesRead: 8.98 MB (9417216) - BytesReadDataNodeCache: 0 - BytesReadLocal: 8.98 MB (9417216) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 8.98 MB (9417216) - DecompressionTime: 6.471ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 17.49 MB (18343582) - PerReadThreadRawHdfsThroughput: 108.77 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 329.604ms - RowBatchQueuePutWaitTime: 12.971ms - RowsRead: 760.00K (760000) - RowsReturned: 286.31K (286311) - RowsReturnedRate: 231.70 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 10 (10) - ScannerThreadsTotalWallClockTime: 672.485ms - MaterializeTupleTime(*): 43.821ms - ScannerThreadsSysTime: 5.999ms - ScannerThreadsUserTime: 46.992ms - ScannerThreadsVoluntaryContextSwitches: 112 (112) - TotalRawHdfsReadTime(*): 82.565ms - TotalReadThroughput: 0.00 /sec Filter 1 (1.00 MB): - Rows processed: 478.40K (478400) - Rows rejected: 473.69K (473689) - Rows total: 760.00K (760000) Instance 7f40dcb034de70b7:205 (host=vd1103.foo:22000):(Total: 1s488ms, non-child: 286.105ms, % non-child: 19.22%) Hdfs split stats (:<# splits>/): 3:1/39.99 MB Filter 1 arrival: 1s221ms MemoryUsage(500.000ms): 1.30 MB, 1.30 MB, 27.35 MB ThreadUsage(500.000ms): 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 27.36 MB (28686110) - PerHostPeakMemUsage: 522.41 MB (547783607) - RowsProduced: 456.85K (456846) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 235.002ms - TotalStorageWaitTime: 114.344ms - TotalThreadsInvoluntaryContextSwitches: 60 (60) - TotalThreadsTotalWallClockTime: 2s678ms - TotalThreadsSysTime: 31.995ms - TotalThreadsUserTime: 161.975ms - TotalThreadsVoluntaryContextSwitches: 693 (693) Fragment Instance Lifecycle Timings: - ExecTime: 1s417ms - ExecTreeExecTime: 1s063ms - OpenTime: 25.585ms - ExecTreeOpenTime: 30.079us - PrepareTime: 45.087ms - ExecTreePrepareTime: 101.143us DataStreamSender (dst_id=25):(Total: 91.189ms, non-child: 91.189ms, % non-child: 100.00%) - BytesSent: 7.30 MB (7649524) - NetworkThroughput(*): 169.34 MB/sec - OverallThroughput: 80.00 MB/sec - PeakMemoryUsage: 4.95 MB (5192768) - RowsReturned: 456.85K (456846) - SerializeBatchTime: 47.249ms - TransmitDataRPCTime: 43.080ms - UncompressedRowBatchSize: 7.41 MB (7767990) CodeGen:(Total: 47.843ms, non-child: 47.843ms, % non-child: 100.00%) - CodegenTime: 1.137ms - CompileTime: 6.356ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 17.284ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 23.638ms HDFS_SCAN_NODE (id=0):(Total: 1s063ms, non-child: 1s063ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:1/39.99 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: Only following filters arrived: , waited 943ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:3 BytesRead(500.000ms): 0, 0, 9.21 MB - FooterProcessingTime: (Avg: 5.133ms ; Min: 5.133ms ; Max: 5.133ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 9.21 MB (9655363) - BytesReadDataNodeCache: 0 - BytesReadLocal: 9.21 MB (9655363) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 9.21 MB (9655363) - DecompressionTime: 7.054ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 23.84 MB (25003107) - PerReadThreadRawHdfsThroughput: 91.44 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 117.397ms - RowBatchQueuePutWaitTime: 177.569ms - RowsRead: 780.00K (780000) - RowsReturned: 456.85K (456846) - RowsReturnedRate: 429.61 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 16 (16) - ScannerThreadsTotalWallClockTime: 1s235ms - MaterializeTupleTime(*): 42.343ms - ScannerThreadsSysTime: 6.998ms - ScannerThreadsUserTime: 48.992ms - ScannerThreadsVoluntaryContextSwitches: 248 (248) - TotalRawHdfsReadTime(*): 100.695ms - TotalReadThroughput: 6.14 MB/sec Filter 1 (1.00 MB): - Rows processed: 326.37K (326368) - Rows rejected: 323.15K (323154) - Rows total: 780.00K (780000) Instance 7f40dcb034de70b7:266 (host=va1042.foo:22000):(Total: 1s488ms, non-child: 73.485ms, % non-child: 4.94%) Hdfs split stats (:<# splits>/): 4:1/39.99 MB Filter 1 arrival: 1s363ms MemoryUsage(500.000ms): 1.30 MB, 1.30 MB, 5.32 MB ThreadUsage(500.000ms): 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 18.29 MB (19178983) - PerHostPeakMemUsage: 530.78 MB (556560255) - RowsProduced: 7.55K (7554) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 28.125ms - TotalStorageWaitTime: 289.845ms - TotalThreadsInvoluntaryContextSwitches: 12 (12) - TotalThreadsTotalWallClockTime: 2s767ms - TotalThreadsSysTime: 7.997ms - TotalThreadsUserTime: 70.989ms - TotalThreadsVoluntaryContextSwitches: 492 (492) Fragment Instance Lifecycle Timings: - ExecTime: 1s413ms - ExecTreeExecTime: 1s362ms - OpenTime: 20.350ms - ExecTreeOpenTime: 37.210us - PrepareTime: 54.606ms - ExecTreePrepareTime: 110.612us DataStreamSender (dst_id=25):(Total: 6.461ms, non-child: 6.461ms, % non-child: 100.00%) - BytesSent: 125.93 KB (128954) - NetworkThroughput(*): 35.43 MB/sec - OverallThroughput: 19.03 MB/sec - PeakMemoryUsage: 1.81 MB (1899584) - RowsReturned: 7.55K (7554) - SerializeBatchTime: 2.022ms - TransmitDataRPCTime: 3.470ms - UncompressedRowBatchSize: 125.93 KB (128954) CodeGen:(Total: 45.842ms, non-child: 45.842ms, % non-child: 100.00%) - CodegenTime: 845.457us - CompileTime: 5.552ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 13.644ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 26.223ms HDFS_SCAN_NODE (id=0):(Total: 1s362ms, non-child: 1s362ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:1/39.99 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: Only following filters arrived: , waited 944ms Hdfs Read Thread Concurrency Bucket: 0:66.67% 1:33.33% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:3 BytesRead(500.000ms): 0, 0, 100.00 KB - FooterProcessingTime: (Avg: 170.804ms ; Min: 170.804ms ; Max: 170.804ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.33 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 9.21 MB (9655821) - BytesReadDataNodeCache: 0 - BytesReadLocal: 9.21 MB (9655821) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 9.21 MB (9655821) - DecompressionTime: 3.858ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 15.31 MB (16057241) - PerReadThreadRawHdfsThroughput: 82.31 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 417.429ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 780.00K (780000) - RowsReturned: 7.55K (7554) - RowsReturnedRate: 5.54 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 5 (5) - ScannerThreadsTotalWallClockTime: 1s334ms - MaterializeTupleTime(*): 35.902ms - ScannerThreadsSysTime: 999.000us - ScannerThreadsUserTime: 41.993ms - ScannerThreadsVoluntaryContextSwitches: 54 (54) - TotalRawHdfsReadTime(*): 111.877ms - TotalReadThroughput: 66.67 KB/sec Filter 1 (1.00 MB): - Rows processed: 780.00K (780000) - Rows rejected: 772.45K (772446) - Rows total: 780.00K (780000) Instance 7f40dcb034de70b7:230 (host=vc1509.foo:22000):(Total: 1s487ms, non-child: 281.693ms, % non-child: 18.93%) Hdfs split stats (:<# splits>/): 1:1/37.97 MB Filter 1 arrival: 1s305ms MemoryUsage(500.000ms): 1.30 MB, 1.30 MB, 18.80 MB ThreadUsage(500.000ms): 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 24.34 MB (25524309) - PerHostPeakMemUsage: 514.17 MB (539142258) - RowsProduced: 457.42K (457422) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 213.718ms - TotalStorageWaitTime: 117.161ms - TotalThreadsInvoluntaryContextSwitches: 60 (60) - TotalThreadsTotalWallClockTime: 2s723ms - TotalThreadsSysTime: 30.995ms - TotalThreadsUserTime: 167.974ms - TotalThreadsVoluntaryContextSwitches: 776 (776) Fragment Instance Lifecycle Timings: - ExecTime: 1s415ms - ExecTreeExecTime: 1s066ms - OpenTime: 20.142ms - ExecTreeOpenTime: 27.709us - PrepareTime: 51.709ms - ExecTreePrepareTime: 97.514us DataStreamSender (dst_id=25):(Total: 94.486ms, non-child: 94.486ms, % non-child: 100.00%) - BytesSent: 7.31 MB (7661084) - NetworkThroughput(*): 171.12 MB/sec - OverallThroughput: 77.32 MB/sec - PeakMemoryUsage: 4.95 MB (5192768) - RowsReturned: 457.42K (457422) - SerializeBatchTime: 50.442ms - TransmitDataRPCTime: 42.695ms - UncompressedRowBatchSize: 7.42 MB (7777782) CodeGen:(Total: 45.452ms, non-child: 45.452ms, % non-child: 100.00%) - CodegenTime: 897.986us - CompileTime: 5.398ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 13.651ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 25.922ms HDFS_SCAN_NODE (id=0):(Total: 1s066ms, non-child: 1s066ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:1/37.97 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: Only following filters arrived: , waited 943ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:3 BytesRead(500.000ms): 0, 0, 8.75 MB - FooterProcessingTime: (Avg: 14.690ms ; Min: 14.690ms ; Max: 14.690ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 8.75 MB (9178826) - BytesReadDataNodeCache: 0 - BytesReadLocal: 8.75 MB (9178826) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 8.75 MB (9178826) - DecompressionTime: 6.671ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 20.43 MB (21426470) - PerReadThreadRawHdfsThroughput: 111.98 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 120.283ms - RowBatchQueuePutWaitTime: 190.447ms - RowsRead: 740.00K (740000) - RowsReturned: 457.42K (457422) - RowsReturnedRate: 429.03 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 20 (20) - ScannerThreadsTotalWallClockTime: 1s287ms - MaterializeTupleTime(*): 38.839ms - ScannerThreadsSysTime: 9.998ms - ScannerThreadsUserTime: 41.993ms - ScannerThreadsVoluntaryContextSwitches: 332 (332) - TotalRawHdfsReadTime(*): 78.170ms - TotalReadThroughput: 5.84 MB/sec Filter 1 (1.00 MB): - Rows processed: 285.34K (285344) - Rows rejected: 282.58K (282578) - Rows total: 740.00K (740000) Instance 7f40dcb034de70b7:251 (host=vd1132.foo:22000):(Total: 1s483ms, non-child: 131.794ms, % non-child: 8.88%) Hdfs split stats (:<# splits>/): 6:1/39.99 MB Filter 1 arrival: 1s340ms MemoryUsage(500.000ms): 1.30 MB, 1.30 MB, 4.59 MB ThreadUsage(500.000ms): 2, 2, 1 - AverageThreadTokens: 1.67 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 22.28 MB (23357912) - PerHostPeakMemUsage: 519.55 MB (544790525) - RowsProduced: 294.57K (294567) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 57.771ms - TotalStorageWaitTime: 124.104ms - TotalThreadsInvoluntaryContextSwitches: 36 (36) - TotalThreadsTotalWallClockTime: 2s715ms - TotalThreadsSysTime: 22.996ms - TotalThreadsUserTime: 139.979ms - TotalThreadsVoluntaryContextSwitches: 606 (606) Fragment Instance Lifecycle Timings: - ExecTime: 1s410ms - ExecTreeExecTime: 1s239ms - OpenTime: 20.621ms - ExecTreeOpenTime: 27.441us - PrepareTime: 52.695ms - ExecTreePrepareTime: 90.572us DataStreamSender (dst_id=25):(Total: 68.550ms, non-child: 68.550ms, % non-child: 100.00%) - BytesSent: 4.70 MB (4929288) - NetworkThroughput(*): 148.79 MB/sec - OverallThroughput: 68.58 MB/sec - PeakMemoryUsage: 4.95 MB (5192768) - RowsReturned: 294.57K (294567) - SerializeBatchTime: 35.392ms - TransmitDataRPCTime: 31.594ms - UncompressedRowBatchSize: 4.78 MB (5008711) CodeGen:(Total: 43.933ms, non-child: 43.933ms, % non-child: 100.00%) - CodegenTime: 873.312us - CompileTime: 5.412ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 14.251ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 23.765ms HDFS_SCAN_NODE (id=0):(Total: 1s239ms, non-child: 1s239ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 6:1/39.99 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: Only following filters arrived: , waited 943ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:3 BytesRead(500.000ms): 0, 0 - FooterProcessingTime: (Avg: 4.540ms ; Min: 4.540ms ; Max: 4.540ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 9.21 MB (9656236) - BytesReadDataNodeCache: 0 - BytesReadLocal: 9.21 MB (9656236) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 9.21 MB (9656236) - DecompressionTime: 4.622ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 16.40 MB (17196625) - PerReadThreadRawHdfsThroughput: 82.08 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 293.364ms - RowBatchQueuePutWaitTime: 26.096ms - RowsRead: 780.00K (780000) - RowsReturned: 294.57K (294567) - RowsReturnedRate: 237.71 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 6 (6) - ScannerThreadsTotalWallClockTime: 1s284ms - MaterializeTupleTime(*): 37.369ms - ScannerThreadsSysTime: 4.999ms - ScannerThreadsUserTime: 42.993ms - ScannerThreadsVoluntaryContextSwitches: 161 (161) - TotalRawHdfsReadTime(*): 112.189ms - TotalReadThroughput: 0.00 /sec Filter 1 (1.00 MB): - Rows processed: 490.21K (490208) - Rows rejected: 485.43K (485433) - Rows total: 780.00K (780000) Instance 7f40dcb034de70b7:254 (host=vc1515.foo:22000):(Total: 1s474ms, non-child: 93.621ms, % non-child: 6.35%) Hdfs split stats (:<# splits>/): 4:1/39.99 MB Filter 1 arrival: 1s345ms MemoryUsage(500.000ms): 1.30 MB, 1.30 MB, 1.30 MB ThreadUsage(500.000ms): 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 18.50 MB (19403366) - PerHostPeakMemUsage: 518.53 MB (543713700) - RowsProduced: 7.59K (7594) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 47.490ms - TotalStorageWaitTime: 260.541ms - TotalThreadsInvoluntaryContextSwitches: 21 (21) - TotalThreadsTotalWallClockTime: 2s712ms - TotalThreadsSysTime: 8.998ms - TotalThreadsUserTime: 85.986ms - TotalThreadsVoluntaryContextSwitches: 477 (477) Fragment Instance Lifecycle Timings: - ExecTime: 1s396ms - ExecTreeExecTime: 1s322ms - OpenTime: 25.207ms - ExecTreeOpenTime: 33.036us - PrepareTime: 53.013ms - ExecTreePrepareTime: 61.665us DataStreamSender (dst_id=25):(Total: 6.526ms, non-child: 6.526ms, % non-child: 100.00%) - BytesSent: 126.60 KB (129634) - NetworkThroughput(*): 37.46 MB/sec - OverallThroughput: 18.94 MB/sec - PeakMemoryUsage: 1.81 MB (1899584) - RowsReturned: 7.59K (7594) - SerializeBatchTime: 2.220ms - TransmitDataRPCTime: 3.300ms - UncompressedRowBatchSize: 126.60 KB (129634) CodeGen:(Total: 51.775ms, non-child: 51.775ms, % non-child: 100.00%) - CodegenTime: 1.022ms - CompileTime: 6.867ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 17.121ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 27.182ms HDFS_SCAN_NODE (id=0):(Total: 1s322ms, non-child: 1s322ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:1/39.99 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: Only following filters arrived: , waited 924ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:3 BytesRead(500.000ms): 0, 0, 0 - FooterProcessingTime: (Avg: 151.861ms ; Min: 151.861ms ; Max: 151.861ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 9.21 MB (9655792) - BytesReadDataNodeCache: 0 - BytesReadLocal: 9.21 MB (9655792) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 9.21 MB (9655792) - DecompressionTime: 3.721ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 15.43 MB (16177051) - PerReadThreadRawHdfsThroughput: 90.62 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 397.886ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 780.00K (780000) - RowsReturned: 7.59K (7594) - RowsReturnedRate: 5.74 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 5 (5) - ScannerThreadsTotalWallClockTime: 1s291ms - MaterializeTupleTime(*): 44.099ms - ScannerThreadsSysTime: 3.999ms - ScannerThreadsUserTime: 46.992ms - ScannerThreadsVoluntaryContextSwitches: 50 (50) - TotalRawHdfsReadTime(*): 101.610ms - TotalReadThroughput: 0.00 /sec Filter 1 (1.00 MB): - Rows processed: 780.00K (780000) - Rows rejected: 772.41K (772406) - Rows total: 780.00K (780000) Instance 7f40dcb034de70b7:26a (host=vd1134.foo:22000):(Total: 1s470ms, non-child: 263.642ms, % non-child: 17.93%) Hdfs split stats (:<# splits>/): 4:1/38.98 MB 2:1/38.98 MB Filter 1 arrival: 1s369ms MemoryUsage(500.000ms): 1.30 MB, 1.30 MB, 17.79 MB ThreadUsage(500.000ms): 1, 1, 3 - AverageThreadTokens: 1.67 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 40.20 MB (42154831) - PerHostPeakMemUsage: 529.33 MB (555038167) - RowsProduced: 528.87K (528865) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 210.307ms - TotalStorageWaitTime: 204.245ms - TotalThreadsInvoluntaryContextSwitches: 54 (54) - TotalThreadsTotalWallClockTime: 2s891ms - TotalThreadsSysTime: 38.992ms - TotalThreadsUserTime: 225.965ms - TotalThreadsVoluntaryContextSwitches: 803 (803) Fragment Instance Lifecycle Timings: - ExecTime: 1s397ms - ExecTreeExecTime: 1s062ms - OpenTime: 22.769ms - ExecTreeOpenTime: 48.440us - PrepareTime: 49.702ms - ExecTreePrepareTime: 119.894us DataStreamSender (dst_id=25):(Total: 98.923ms, non-child: 98.923ms, % non-child: 100.00%) - BytesSent: 8.45 MB (8855648) - NetworkThroughput(*): 159.03 MB/sec - OverallThroughput: 85.37 MB/sec - PeakMemoryUsage: 4.95 MB (5192768) - RowsReturned: 528.87K (528865) - SerializeBatchTime: 43.979ms - TransmitDataRPCTime: 53.105ms - UncompressedRowBatchSize: 8.58 MB (8992841) CodeGen:(Total: 45.253ms, non-child: 45.253ms, % non-child: 100.00%) - CodegenTime: 1.045ms - CompileTime: 5.844ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 15.457ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 23.463ms HDFS_SCAN_NODE (id=0):(Total: 1s062ms, non-child: 1s062ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:1/38.98 MB 2:1/38.98 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 2 out of 2 Runtime filters: Only following filters arrived: , waited 944ms Hdfs Read Thread Concurrency Bucket: 0:66.67% 1:0% 2:33.33% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:6 BytesRead(500.000ms): 0, 0, 6.15 MB - FooterProcessingTime: (Avg: 17.548ms ; Min: 16.183ms ; Max: 18.914ms ; Number of samples: 2) - AverageHdfsReadThreadConcurrency: 0.67 - AverageScannerThreadConcurrency: 0.67 - BytesRead: 17.96 MB (18833946) - BytesReadDataNodeCache: 0 - BytesReadLocal: 17.96 MB (18833946) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 17.96 MB (18833946) - DecompressionTime: 14.315ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 2 (2) - NumRowGroups: 2 (2) - NumScannerThreadsStarted: 2 (2) - PeakMemoryUsage: 36.77 MB (38552041) - PerReadThreadRawHdfsThroughput: 118.96 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 114.750ms - RowBatchQueuePutWaitTime: 452.324ms - RowsRead: 1.52M (1520000) - RowsReturned: 528.87K (528865) - RowsReturnedRate: 497.78 K/sec - ScanRangesComplete: 2 (2) - ScannerThreadsInvoluntaryContextSwitches: 19 (19) - ScannerThreadsTotalWallClockTime: 1s471ms - MaterializeTupleTime(*): 97.149ms - ScannerThreadsSysTime: 17.996ms - ScannerThreadsUserTime: 105.983ms - ScannerThreadsVoluntaryContextSwitches: 350 (350) - TotalRawHdfsReadTime(*): 150.990ms - TotalReadThroughput: 4.10 MB/sec Filter 1 (1.00 MB): - Rows processed: 1.00M (1000832) - Rows rejected: 991.13K (991135) - Rows total: 1.52M (1520000) Instance 7f40dcb034de70b7:259 (host=vd1142.foo:22000):(Total: 1s469ms, non-child: 165.703ms, % non-child: 11.27%) Hdfs split stats (:<# splits>/): 3:1/39.99 MB Filter 1 arrival: 1s350ms MemoryUsage(500.000ms): 1.30 MB, 1.30 MB, 5.32 MB ThreadUsage(500.000ms): 1, 1, 2 - AverageThreadTokens: 1.33 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 22.41 MB (23495045) - PerHostPeakMemUsage: 515.12 MB (540139412) - RowsProduced: 628.24K (628239) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 100.620ms - TotalStorageWaitTime: 122.609ms - TotalThreadsInvoluntaryContextSwitches: 48 (48) - TotalThreadsTotalWallClockTime: 2s137ms - TotalThreadsSysTime: 21.997ms - TotalThreadsUserTime: 181.972ms - TotalThreadsVoluntaryContextSwitches: 890 (890) Fragment Instance Lifecycle Timings: - ExecTime: 1s382ms - ExecTreeExecTime: 1s140ms - OpenTime: 25.612ms - ExecTreeOpenTime: 35.372us - PrepareTime: 61.356ms - ExecTreePrepareTime: 98.640us DataStreamSender (dst_id=25):(Total: 112.465ms, non-child: 112.465ms, % non-child: 100.00%) - BytesSent: 10.04 MB (10523579) - NetworkThroughput(*): 183.14 MB/sec - OverallThroughput: 89.24 MB/sec - PeakMemoryUsage: 4.95 MB (5192768) - RowsReturned: 628.24K (628239) - SerializeBatchTime: 55.101ms - TransmitDataRPCTime: 54.800ms - UncompressedRowBatchSize: 10.19 MB (10682207) CodeGen:(Total: 51.564ms, non-child: 51.564ms, % non-child: 100.00%) - CodegenTime: 1.457ms - CompileTime: 6.991ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 17.134ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 26.706ms HDFS_SCAN_NODE (id=0):(Total: 1s140ms, non-child: 1s140ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:1/39.99 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: Only following filters arrived: , waited 924ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:3 BytesRead(500.000ms): 0, 0, 100.00 KB - FooterProcessingTime: (Avg: 4.697ms ; Min: 4.697ms ; Max: 4.697ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.33 - BytesRead: 9.21 MB (9655768) - BytesReadDataNodeCache: 0 - BytesReadLocal: 9.21 MB (9655768) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 9.21 MB (9655768) - DecompressionTime: 5.278ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 18.74 MB (19651088) - PerReadThreadRawHdfsThroughput: 83.61 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 213.580ms - RowBatchQueuePutWaitTime: 108.184ms - RowsRead: 780.00K (780000) - RowsReturned: 628.24K (628239) - RowsReturnedRate: 551.04 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 10 (10) - ScannerThreadsTotalWallClockTime: 729.532ms - MaterializeTupleTime(*): 30.497ms - ScannerThreadsSysTime: 5.999ms - ScannerThreadsUserTime: 36.994ms - ScannerThreadsVoluntaryContextSwitches: 442 (442) - TotalRawHdfsReadTime(*): 110.137ms - TotalReadThroughput: 66.67 KB/sec Filter 1 (1.00 MB): - Rows processed: 153.31K (153312) - Rows rejected: 151.76K (151761) - Rows total: 780.00K (780000) Instance 7f40dcb034de70b7:221 (host=vc1538.foo:22000):(Total: 1s468ms, non-child: 225.943ms, % non-child: 15.38%) Hdfs split stats (:<# splits>/): 6:1/39.99 MB Filter 1 arrival: 1s287ms MemoryUsage(500.000ms): 1.30 MB, 1.30 MB, 9.54 MB ThreadUsage(500.000ms): 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 21.33 MB (22367300) - PerHostPeakMemUsage: 513.61 MB (538557829) - RowsProduced: 628.21K (628208) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 165.153ms - TotalStorageWaitTime: 142.485ms - TotalThreadsInvoluntaryContextSwitches: 55 (55) - TotalThreadsTotalWallClockTime: 2s685ms - TotalThreadsSysTime: 30.994ms - TotalThreadsUserTime: 198.970ms - TotalThreadsVoluntaryContextSwitches: 837 (837) Fragment Instance Lifecycle Timings: - ExecTime: 1s388ms - ExecTreeExecTime: 1s072ms - OpenTime: 26.721ms - ExecTreeOpenTime: 31.825us - PrepareTime: 53.708ms - ExecTreePrepareTime: 89.414us DataStreamSender (dst_id=25):(Total: 118.823ms, non-child: 118.823ms, % non-child: 100.00%) - BytesSent: 10.03 MB (10521037) - NetworkThroughput(*): 177.52 MB/sec - OverallThroughput: 84.44 MB/sec - PeakMemoryUsage: 4.95 MB (5192768) - RowsReturned: 628.21K (628208) - SerializeBatchTime: 61.408ms - TransmitDataRPCTime: 56.520ms - UncompressedRowBatchSize: 10.19 MB (10681680) CodeGen:(Total: 51.128ms, non-child: 51.128ms, % non-child: 100.00%) - CodegenTime: 1.116ms - CompileTime: 6.929ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 18.305ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 25.182ms HDFS_SCAN_NODE (id=0):(Total: 1s072ms, non-child: 1s072ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 6:1/39.99 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: Only following filters arrived: , waited 923ms Hdfs Read Thread Concurrency Bucket: 0:66.67% 1:33.33% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:3 BytesRead(500.000ms): 0, 0, 3.15 MB - FooterProcessingTime: (Avg: 6.535ms ; Min: 6.535ms ; Max: 6.535ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.33 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 9.21 MB (9656234) - BytesReadDataNodeCache: 0 - BytesReadLocal: 9.21 MB (9656234) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 9.21 MB (9656234) - DecompressionTime: 6.994ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 17.31 MB (18150886) - PerReadThreadRawHdfsThroughput: 77.87 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 145.902ms - RowBatchQueuePutWaitTime: 168.935ms - RowsRead: 780.00K (780000) - RowsReturned: 628.21K (628208) - RowsReturnedRate: 585.61 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 11 (11) - ScannerThreadsTotalWallClockTime: 1s270ms - MaterializeTupleTime(*): 44.307ms - ScannerThreadsSysTime: 13.997ms - ScannerThreadsUserTime: 44.993ms - ScannerThreadsVoluntaryContextSwitches: 393 (393) - TotalRawHdfsReadTime(*): 118.264ms - TotalReadThroughput: 2.10 MB/sec Filter 1 (1.00 MB): - Rows processed: 153.31K (153312) - Rows rejected: 151.79K (151792) - Rows total: 780.00K (780000) Instance 7f40dcb034de70b7:22d (host=ve1141.foo:22000):(Total: 1s463ms, non-child: 282.649ms, % non-child: 19.32%) Hdfs split stats (:<# splits>/): 3:1/38.97 MB Filter 1 arrival: 1s302ms MemoryUsage(500.000ms): 1.30 MB, 1.30 MB ThreadUsage(500.000ms): 1, 2 - AverageThreadTokens: 1.50 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 25.93 MB (27184915) - PerHostPeakMemUsage: 530.20 MB (555953810) - RowsProduced: 448.45K (448453) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 222.341ms - TotalStorageWaitTime: 94.059ms - TotalThreadsInvoluntaryContextSwitches: 47 (47) - TotalThreadsTotalWallClockTime: 2s039ms - TotalThreadsSysTime: 20.996ms - TotalThreadsUserTime: 185.971ms - TotalThreadsVoluntaryContextSwitches: 721 (721) Fragment Instance Lifecycle Timings: - ExecTime: 1s374ms - ExecTreeExecTime: 1s023ms - OpenTime: 33.201ms - ExecTreeOpenTime: 32.810us - PrepareTime: 55.402ms - ExecTreePrepareTime: 119.242us DataStreamSender (dst_id=25):(Total: 94.215ms, non-child: 94.215ms, % non-child: 100.00%) - BytesSent: 7.16 MB (7511414) - NetworkThroughput(*): 162.21 MB/sec - OverallThroughput: 76.03 MB/sec - PeakMemoryUsage: 4.95 MB (5192768) - RowsReturned: 448.45K (448453) - SerializeBatchTime: 49.084ms - TransmitDataRPCTime: 44.162ms - UncompressedRowBatchSize: 7.27 MB (7625309) CodeGen:(Total: 62.487ms, non-child: 62.487ms, % non-child: 100.00%) - CodegenTime: 1.474ms - CompileTime: 8.099ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 23.495ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 30.103ms HDFS_SCAN_NODE (id=0):(Total: 1s023ms, non-child: 1s023ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:1/38.97 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: Only following filters arrived: , waited 923ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:3 BytesRead(500.000ms): 0, 0 - FooterProcessingTime: (Avg: 7.589ms ; Min: 7.589ms ; Max: 7.589ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.50 - BytesRead: 8.98 MB (9415841) - BytesReadDataNodeCache: 0 - BytesReadLocal: 8.98 MB (9415841) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 8.98 MB (9415841) - DecompressionTime: 6.355ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 22.95 MB (24067287) - PerReadThreadRawHdfsThroughput: 116.81 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 97.706ms - RowBatchQueuePutWaitTime: 183.361ms - RowsRead: 760.00K (760000) - RowsReturned: 448.45K (448453) - RowsReturnedRate: 437.99 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 12 (12) - ScannerThreadsTotalWallClockTime: 632.351ms - MaterializeTupleTime(*): 40.271ms - ScannerThreadsSysTime: 6.998ms - ScannerThreadsUserTime: 46.992ms - ScannerThreadsVoluntaryContextSwitches: 261 (261) - TotalRawHdfsReadTime(*): 76.873ms - TotalReadThroughput: 0.00 /sec Filter 1 (1.00 MB): - Rows processed: 314.56K (314560) - Rows rejected: 311.55K (311547) - Rows total: 760.00K (760000) Instance 7f40dcb034de70b7:240 (host=vc1523.foo:22000):(Total: 1s462ms, non-child: 68.258ms, % non-child: 4.67%) Hdfs split stats (:<# splits>/): 1:1/39.99 MB Filter 1 arrival: 1s323ms MemoryUsage(500.000ms): 1.30 MB, 1.30 MB, 1.30 MB ThreadUsage(500.000ms): 1, 2, 2 - AverageThreadTokens: 1.67 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 18.28 MB (19165623) - PerHostPeakMemUsage: 508.05 MB (532725885) - RowsProduced: 7.50K (7504) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 26.207ms - TotalStorageWaitTime: 286.510ms - TotalThreadsInvoluntaryContextSwitches: 16 (16) - TotalThreadsTotalWallClockTime: 2s738ms - TotalThreadsSysTime: 8.999ms - TotalThreadsUserTime: 78.988ms - TotalThreadsVoluntaryContextSwitches: 499 (499) Fragment Instance Lifecycle Timings: - ExecTime: 1s397ms - ExecTreeExecTime: 1s347ms - OpenTime: 20.279ms - ExecTreeOpenTime: 40.363us - PrepareTime: 44.179ms - ExecTreePrepareTime: 85.029us DataStreamSender (dst_id=25):(Total: 5.238ms, non-child: 5.238ms, % non-child: 100.00%) - BytesSent: 125.10 KB (128104) - NetworkThroughput(*): 50.51 MB/sec - OverallThroughput: 23.32 MB/sec - PeakMemoryUsage: 1.81 MB (1899584) - RowsReturned: 7.50K (7504) - SerializeBatchTime: 2.076ms - TransmitDataRPCTime: 2.418ms - UncompressedRowBatchSize: 125.10 KB (128104) CodeGen:(Total: 40.739ms, non-child: 40.739ms, % non-child: 100.00%) - CodegenTime: 777.159us - CompileTime: 5.762ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 13.388ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 21.068ms HDFS_SCAN_NODE (id=0):(Total: 1s347ms, non-child: 1s347ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:1/39.99 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: Only following filters arrived: , waited 944ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:3 BytesRead(500.000ms): 0, 0, 0 - FooterProcessingTime: (Avg: 170.654ms ; Min: 170.654ms ; Max: 170.654ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.67 - BytesRead: 9.21 MB (9656361) - BytesReadDataNodeCache: 0 - BytesReadLocal: 9.21 MB (9656361) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 9.21 MB (9656361) - DecompressionTime: 4.431ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 15.38 MB (16123644) - PerReadThreadRawHdfsThroughput: 84.70 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 403.271ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 780.00K (780000) - RowsReturned: 7.50K (7504) - RowsReturnedRate: 5.57 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 5 (5) - ScannerThreadsTotalWallClockTime: 1s320ms - MaterializeTupleTime(*): 43.570ms - ScannerThreadsSysTime: 5.999ms - ScannerThreadsUserTime: 45.993ms - ScannerThreadsVoluntaryContextSwitches: 55 (55) - TotalRawHdfsReadTime(*): 108.718ms - TotalReadThroughput: 0.00 /sec Filter 1 (1.00 MB): - Rows processed: 780.00K (780000) - Rows rejected: 772.50K (772496) - Rows total: 780.00K (780000) Instance 7f40dcb034de70b7:24b (host=vc1520.foo:22000):(Total: 1s460ms, non-child: 178.385ms, % non-child: 12.22%) Hdfs split stats (:<# splits>/): 6:1/37.96 MB Filter 1 arrival: 1s335ms MemoryUsage(500.000ms): 1.30 MB, 1.30 MB, 17.25 MB ThreadUsage(500.000ms): 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 22.24 MB (23319916) - PerHostPeakMemUsage: 520.99 MB (546294655) - RowsProduced: 595.34K (595335) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 123.747ms - TotalStorageWaitTime: 153.192ms - TotalThreadsInvoluntaryContextSwitches: 42 (42) - TotalThreadsTotalWallClockTime: 2s647ms - TotalThreadsSysTime: 28.996ms - TotalThreadsUserTime: 192.970ms - TotalThreadsVoluntaryContextSwitches: 724 (724) Fragment Instance Lifecycle Timings: - ExecTime: 1s386ms - ExecTreeExecTime: 1s119ms - OpenTime: 22.781ms - ExecTreeOpenTime: 46.029us - PrepareTime: 50.959ms - ExecTreePrepareTime: 107.313us DataStreamSender (dst_id=25):(Total: 115.368ms, non-child: 115.368ms, % non-child: 100.00%) - BytesSent: 9.51 MB (9969643) - NetworkThroughput(*): 174.17 MB/sec - OverallThroughput: 82.41 MB/sec - PeakMemoryUsage: 4.95 MB (5192768) - RowsReturned: 595.34K (595335) - SerializeBatchTime: 59.761ms - TransmitDataRPCTime: 54.588ms - UncompressedRowBatchSize: 9.65 MB (10122839) CodeGen:(Total: 47.544ms, non-child: 47.544ms, % non-child: 100.00%) - CodegenTime: 1.207ms - CompileTime: 6.225ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 15.458ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 25.164ms HDFS_SCAN_NODE (id=0):(Total: 1s119ms, non-child: 1s119ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 6:1/37.96 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: Only following filters arrived: , waited 942ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:3 BytesRead(500.000ms): 0, 0, 8.75 MB - FooterProcessingTime: (Avg: 7.710ms ; Min: 7.710ms ; Max: 7.710ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 8.75 MB (9178762) - BytesReadDataNodeCache: 0 - BytesReadLocal: 8.75 MB (9178762) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 8.75 MB (9178762) - DecompressionTime: 7.381ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 18.35 MB (19241185) - PerReadThreadRawHdfsThroughput: 115.01 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 171.775ms - RowBatchQueuePutWaitTime: 104.074ms - RowsRead: 740.00K (740000) - RowsReturned: 595.34K (595335) - RowsReturnedRate: 532.01 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 15 (15) - ScannerThreadsTotalWallClockTime: 1s238ms - MaterializeTupleTime(*): 47.261ms - ScannerThreadsSysTime: 9.998ms - ScannerThreadsUserTime: 51.992ms - ScannerThreadsVoluntaryContextSwitches: 274 (274) - TotalRawHdfsReadTime(*): 76.112ms - TotalReadThroughput: 5.84 MB/sec Filter 1 (1.00 MB): - Rows processed: 146.08K (146080) - Rows rejected: 144.66K (144665) - Rows total: 740.00K (740000) Instance 7f40dcb034de70b7:214 (host=vd1326.foo:22000):(Total: 1s459ms, non-child: 227.442ms, % non-child: 15.58%) Hdfs split stats (:<# splits>/): 3:1/38.98 MB 0:1/38.96 MB Filter 1 arrival: 1s269ms MemoryUsage(500.000ms): 1.30 MB, 1.30 MB, 17.79 MB ThreadUsage(500.000ms): 1, 3, 3 - AverageThreadTokens: 2.33 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 46.33 MB (48579179) - PerHostPeakMemUsage: 533.10 MB (558993623) - RowsProduced: 790.55K (790551) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 160.407ms - TotalStorageWaitTime: 194.139ms - TotalThreadsInvoluntaryContextSwitches: 76 (76) - TotalThreadsTotalWallClockTime: 3s787ms - TotalThreadsSysTime: 39.993ms - TotalThreadsUserTime: 290.956ms - TotalThreadsVoluntaryContextSwitches: 1.19K (1194) Fragment Instance Lifecycle Timings: - ExecTime: 1s380ms - ExecTreeExecTime: 1s025ms - OpenTime: 24.187ms - ExecTreeOpenTime: 30.801us - PrepareTime: 55.082ms - ExecTreePrepareTime: 93.961us DataStreamSender (dst_id=25):(Total: 155.602ms, non-child: 155.602ms, % non-child: 100.00%) - BytesSent: 12.64 MB (13249296) - NetworkThroughput(*): 162.82 MB/sec - OverallThroughput: 81.20 MB/sec - PeakMemoryUsage: 4.95 MB (5192768) - RowsReturned: 790.55K (790551) - SerializeBatchTime: 76.820ms - TransmitDataRPCTime: 77.604ms - UncompressedRowBatchSize: 12.82 MB (13442047) CodeGen:(Total: 51.221ms, non-child: 51.221ms, % non-child: 100.00%) - CodegenTime: 1.401ms - CompileTime: 5.743ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 16.814ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 27.737ms HDFS_SCAN_NODE (id=0):(Total: 1s025ms, non-child: 1s025ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:1/38.98 MB 0:1/38.96 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 2 out of 2 Runtime filters: Only following filters arrived: , waited 924ms Hdfs Read Thread Concurrency Bucket: 0:50% 1:0% 2:50% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:6 BytesRead(500.000ms): 0, 0, 6.15 MB - FooterProcessingTime: (Avg: 4.840ms ; Min: 4.462ms ; Max: 5.219ms ; Number of samples: 2) - AverageHdfsReadThreadConcurrency: 1.00 - AverageScannerThreadConcurrency: 2.00 - BytesRead: 17.96 MB (18834820) - BytesReadDataNodeCache: 0 - BytesReadLocal: 17.96 MB (18834820) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 17.96 MB (18834820) - DecompressionTime: 14.718ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 2 (2) - NumRowGroups: 2 (2) - NumScannerThreadsStarted: 2 (2) - PeakMemoryUsage: 41.45 MB (43462576) - PerReadThreadRawHdfsThroughput: 117.58 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 97.408ms - RowBatchQueuePutWaitTime: 361.822ms - RowsRead: 1.52M (1520000) - RowsReturned: 790.55K (790551) - RowsReturnedRate: 770.74 K/sec - ScanRangesComplete: 2 (2) - ScannerThreadsInvoluntaryContextSwitches: 29 (29) - ScannerThreadsTotalWallClockTime: 2s382ms - MaterializeTupleTime(*): 89.690ms - ScannerThreadsSysTime: 14.997ms - ScannerThreadsUserTime: 102.984ms - ScannerThreadsVoluntaryContextSwitches: 731 (731) - TotalRawHdfsReadTime(*): 152.764ms - TotalReadThroughput: 4.10 MB/sec Filter 1 (1.00 MB): - Rows processed: 736.64K (736640) - Rows rejected: 729.45K (729449) - Rows total: 1.52M (1520000) Instance 7f40dcb034de70b7:252 (host=vd1107.foo:22000):(Total: 1s451ms, non-child: 170.403ms, % non-child: 11.74%) Hdfs split stats (:<# splits>/): 4:1/38.98 MB 7:1/38.97 MB Filter 1 arrival: 1s343ms MemoryUsage(500.000ms): 1.30 MB, 1.30 MB, 31.26 MB ThreadUsage(500.000ms): 3, 3, 3 - AverageThreadTokens: 3.00 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 36.03 MB (37778581) - PerHostPeakMemUsage: 521.65 MB (546992716) - RowsProduced: 1.31M (1305532) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 105.685ms - TotalStorageWaitTime: 225.457ms - TotalThreadsInvoluntaryContextSwitches: 68 (68) - TotalThreadsTotalWallClockTime: 3s879ms - TotalThreadsSysTime: 46.992ms - TotalThreadsUserTime: 315.950ms - TotalThreadsVoluntaryContextSwitches: 1.66K (1664) Fragment Instance Lifecycle Timings: - ExecTime: 1s373ms - ExecTreeExecTime: 1s048ms - OpenTime: 21.454ms - ExecTreeOpenTime: 42.145us - PrepareTime: 55.888ms - ExecTreePrepareTime: 108.364us DataStreamSender (dst_id=25):(Total: 187.484ms, non-child: 187.484ms, % non-child: 100.00%) - BytesSent: 20.89 MB (21899561) - NetworkThroughput(*): 204.56 MB/sec - OverallThroughput: 111.40 MB/sec - PeakMemoryUsage: 4.95 MB (5192768) - RowsReturned: 1.31M (1305532) - SerializeBatchTime: 84.352ms - TransmitDataRPCTime: 102.098ms - UncompressedRowBatchSize: 21.17 MB (22198336) CodeGen:(Total: 45.106ms, non-child: 45.106ms, % non-child: 100.00%) - CodegenTime: 1.087ms - CompileTime: 5.475ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 14.043ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 25.155ms HDFS_SCAN_NODE (id=0):(Total: 1s048ms, non-child: 1s048ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:1/38.98 MB 7:1/38.97 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 2 out of 2 Runtime filters: Only following filters arrived: , waited 924ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:6 BytesRead(500.000ms): 0, 0, 17.96 MB - FooterProcessingTime: (Avg: 14.614ms ; Min: 11.951ms ; Max: 17.277ms ; Number of samples: 2) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 2.00 - BytesRead: 17.96 MB (18833730) - BytesReadDataNodeCache: 0 - BytesReadLocal: 17.96 MB (18833730) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 17.96 MB (18833730) - DecompressionTime: 14.637ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 2 (2) - NumRowGroups: 2 (2) - NumScannerThreadsStarted: 2 (2) - PeakMemoryUsage: 30.27 MB (31741402) - PerReadThreadRawHdfsThroughput: 110.85 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 118.028ms - RowBatchQueuePutWaitTime: 363.051ms - RowsRead: 1.52M (1520000) - RowsReturned: 1.31M (1305532) - RowsReturnedRate: 1.25 M/sec - ScanRangesComplete: 2 (2) - ScannerThreadsInvoluntaryContextSwitches: 27 (27) - ScannerThreadsTotalWallClockTime: 2s485ms - MaterializeTupleTime(*): 90.730ms - ScannerThreadsSysTime: 15.996ms - ScannerThreadsUserTime: 109.982ms - ScannerThreadsVoluntaryContextSwitches: 1.21K (1209) - TotalRawHdfsReadTime(*): 162.033ms - TotalReadThroughput: 11.97 MB/sec Filter 1 (1.00 MB): - Rows processed: 216.45K (216448) - Rows rejected: 214.47K (214468) - Rows total: 1.52M (1520000) Instance 7f40dcb034de70b7:246 (host=vc1535.foo:22000):(Total: 1s444ms, non-child: 122.884ms, % non-child: 8.50%) Hdfs split stats (:<# splits>/): 2:1/38.97 MB Filter 1 arrival: 1s329ms MemoryUsage(500.000ms): 1.30 MB, 1.30 MB, 9.54 MB ThreadUsage(500.000ms): 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 21.24 MB (22271535) - PerHostPeakMemUsage: 518.48 MB (543662043) - RowsProduced: 507.36K (507357) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 76.028ms - TotalStorageWaitTime: 184.495ms - TotalThreadsInvoluntaryContextSwitches: 39 (39) - TotalThreadsTotalWallClockTime: 2s631ms - TotalThreadsSysTime: 26.995ms - TotalThreadsUserTime: 156.976ms - TotalThreadsVoluntaryContextSwitches: 570 (570) Fragment Instance Lifecycle Timings: - ExecTime: 1s362ms - ExecTreeExecTime: 1s177ms - OpenTime: 22.559ms - ExecTreeOpenTime: 33.729us - PrepareTime: 59.828ms - ExecTreePrepareTime: 109.195us DataStreamSender (dst_id=25):(Total: 94.301ms, non-child: 94.301ms, % non-child: 100.00%) - BytesSent: 8.10 MB (8498185) - NetworkThroughput(*): 173.43 MB/sec - OverallThroughput: 85.94 MB/sec - PeakMemoryUsage: 4.95 MB (5192768) - RowsReturned: 507.36K (507357) - SerializeBatchTime: 45.160ms - TransmitDataRPCTime: 46.729ms - UncompressedRowBatchSize: 8.23 MB (8626973) CodeGen:(Total: 49.738ms, non-child: 49.738ms, % non-child: 100.00%) - CodegenTime: 832.373us - CompileTime: 5.591ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 15.741ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 28.011ms HDFS_SCAN_NODE (id=0):(Total: 1s177ms, non-child: 1s177ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:1/38.97 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: Only following filters arrived: , waited 924ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:3 BytesRead(500.000ms): 0, 0, 3.07 MB - FooterProcessingTime: (Avg: 102.529ms ; Min: 102.529ms ; Max: 102.529ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 8.98 MB (9416080) - BytesReadDataNodeCache: 0 - BytesReadLocal: 8.98 MB (9416080) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 8.98 MB (9416080) - DecompressionTime: 6.871ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 16.27 MB (17056748) - PerReadThreadRawHdfsThroughput: 119.75 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 251.082ms - RowBatchQueuePutWaitTime: 38.526ms - RowsRead: 760.00K (760000) - RowsReturned: 507.36K (507357) - RowsReturnedRate: 430.71 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 8 (8) - ScannerThreadsTotalWallClockTime: 1s246ms - MaterializeTupleTime(*): 46.668ms - ScannerThreadsSysTime: 8.998ms - ScannerThreadsUserTime: 50.992ms - ScannerThreadsVoluntaryContextSwitches: 126 (126) - TotalRawHdfsReadTime(*): 74.985ms - TotalReadThroughput: 2.05 MB/sec Filter 1 (1.00 MB): - Rows processed: 255.17K (255168) - Rows rejected: 252.64K (252643) - Rows total: 760.00K (760000) Instance 7f40dcb034de70b7:25e (host=vd1136.foo:22000):(Total: 1s440ms, non-child: 140.816ms, % non-child: 9.78%) Hdfs split stats (:<# splits>/): 6:1/39.99 MB Filter 1 arrival: 1s357ms MemoryUsage(500.000ms): 1.30 MB, 1.30 MB, 3.53 MB ThreadUsage(500.000ms): 2, 2, 1 - AverageThreadTokens: 1.67 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 21.25 MB (22279669) - PerHostPeakMemUsage: 515.38 MB (540420146) - RowsProduced: 780.00K (780000) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 76.666ms - TotalStorageWaitTime: 152.680ms - TotalThreadsInvoluntaryContextSwitches: 65 (65) - TotalThreadsTotalWallClockTime: 2s593ms - TotalThreadsSysTime: 41.993ms - TotalThreadsUserTime: 229.965ms - TotalThreadsVoluntaryContextSwitches: 968 (968) Fragment Instance Lifecycle Timings: - ExecTime: 1s356ms - ExecTreeExecTime: 1s084ms - OpenTime: 22.138ms - ExecTreeOpenTime: 33.604us - PrepareTime: 61.374ms - ExecTreePrepareTime: 113.374us DataStreamSender (dst_id=25):(Total: 155.914ms, non-child: 155.914ms, % non-child: 100.00%) - BytesSent: 12.47 MB (13075919) - NetworkThroughput(*): 157.65 MB/sec - OverallThroughput: 79.98 MB/sec - PeakMemoryUsage: 4.95 MB (5192768) - RowsReturned: 780.00K (780000) - SerializeBatchTime: 75.816ms - TransmitDataRPCTime: 79.099ms - UncompressedRowBatchSize: 12.65 MB (13262680) CodeGen:(Total: 59.263ms, non-child: 59.263ms, % non-child: 100.00%) - CodegenTime: 869.767us - CompileTime: 6.170ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 14.759ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 37.914ms HDFS_SCAN_NODE (id=0):(Total: 1s084ms, non-child: 1s084ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 6:1/39.99 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: Only following filters arrived: , waited 924ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:3 BytesRead(500.000ms): 0, 0 - FooterProcessingTime: (Avg: 14.693ms ; Min: 14.693ms ; Max: 14.693ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 9.21 MB (9656355) - BytesReadDataNodeCache: 0 - BytesReadLocal: 9.21 MB (9656355) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 9.21 MB (9656355) - DecompressionTime: 7.683ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 16.29 MB (17078074) - PerReadThreadRawHdfsThroughput: 74.25 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 156.920ms - RowBatchQueuePutWaitTime: 82.861ms - RowsRead: 780.00K (780000) - RowsReturned: 780.00K (780000) - RowsReturnedRate: 719.54 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 17 (17) - ScannerThreadsTotalWallClockTime: 1s215ms - MaterializeTupleTime(*): 42.016ms - ScannerThreadsSysTime: 9.998ms - ScannerThreadsUserTime: 50.992ms - ScannerThreadsVoluntaryContextSwitches: 529 (529) - TotalRawHdfsReadTime(*): 124.023ms - TotalReadThroughput: 0.00 /sec Filter 1 (1.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 780.00K (780000) Instance 7f40dcb034de70b7:273 (host=vd1337.foo:22000):(Total: 1s434ms, non-child: 129.147ms, % non-child: 9.00%) Hdfs split stats (:<# splits>/): 0:1/39.99 MB Filter 1 arrival: 1s380ms MemoryUsage(500.000ms): 0, 1.30 MB, 1.30 MB ThreadUsage(500.000ms): 1, 1, 2 - AverageThreadTokens: 1.33 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 21.25 MB (22279763) - PerHostPeakMemUsage: 510.23 MB (535017219) - RowsProduced: 780.00K (780000) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 67.874ms - TotalStorageWaitTime: 138.283ms - TotalThreadsInvoluntaryContextSwitches: 55 (55) - TotalThreadsTotalWallClockTime: 2s019ms - TotalThreadsSysTime: 18.996ms - TotalThreadsUserTime: 207.967ms - TotalThreadsVoluntaryContextSwitches: 921 (921) Fragment Instance Lifecycle Timings: - ExecTime: 1s356ms - ExecTreeExecTime: 1s127ms - OpenTime: 20.881ms - ExecTreeOpenTime: 32.650us - PrepareTime: 56.719ms - ExecTreePrepareTime: 36.718us DataStreamSender (dst_id=25):(Total: 134.727ms, non-child: 134.727ms, % non-child: 100.00%) - BytesSent: 12.46 MB (13067712) - NetworkThroughput(*): 189.40 MB/sec - OverallThroughput: 92.50 MB/sec - PeakMemoryUsage: 4.95 MB (5192768) - RowsReturned: 780.00K (780000) - SerializeBatchTime: 66.829ms - TransmitDataRPCTime: 65.800ms - UncompressedRowBatchSize: 12.65 MB (13262680) CodeGen:(Total: 43.569ms, non-child: 43.569ms, % non-child: 100.00%) - CodegenTime: 752.654us - CompileTime: 5.950ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 13.691ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 23.593ms HDFS_SCAN_NODE (id=0):(Total: 1s127ms, non-child: 1s127ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/39.99 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: Only following filters arrived: , waited 924ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:3 BytesRead(500.000ms): 0, 0, 0 - FooterProcessingTime: (Avg: 7.219ms ; Min: 7.219ms ; Max: 7.219ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.50 - BytesRead: 9.21 MB (9655980) - BytesReadDataNodeCache: 0 - BytesReadLocal: 9.21 MB (9655980) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 9.21 MB (9655980) - DecompressionTime: 6.302ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 16.27 MB (17064856) - PerReadThreadRawHdfsThroughput: 75.71 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 200.290ms - RowBatchQueuePutWaitTime: 82.551ms - RowsRead: 780.00K (780000) - RowsReturned: 780.00K (780000) - RowsReturnedRate: 692.07 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 7 (7) - ScannerThreadsTotalWallClockTime: 642.069ms - MaterializeTupleTime(*): 36.825ms - ScannerThreadsSysTime: 3.999ms - ScannerThreadsUserTime: 46.992ms - ScannerThreadsVoluntaryContextSwitches: 463 (463) - TotalRawHdfsReadTime(*): 121.634ms - TotalReadThroughput: 0.00 /sec Filter 1 (1.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 780.00K (780000) Instance 7f40dcb034de70b7:231 (host=vc1532.foo:22000):(Total: 1s427ms, non-child: 117.563ms, % non-child: 8.24%) Hdfs split stats (:<# splits>/): 0:1/37.97 MB Filter 1 arrival: 1s304ms MemoryUsage(500.000ms): 1.30 MB, 1.30 MB, 5.32 MB ThreadUsage(500.000ms): 1, 1, 2 - AverageThreadTokens: 1.33 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 25.07 MB (26286926) - PerHostPeakMemUsage: 508.42 MB (533115945) - RowsProduced: 451.36K (451360) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 66.750ms - TotalStorageWaitTime: 148.358ms - TotalThreadsInvoluntaryContextSwitches: 37 (37) - TotalThreadsTotalWallClockTime: 2s007ms - TotalThreadsSysTime: 24.996ms - TotalThreadsUserTime: 139.977ms - TotalThreadsVoluntaryContextSwitches: 635 (635) Fragment Instance Lifecycle Timings: - ExecTime: 1s365ms - ExecTreeExecTime: 1s192ms - OpenTime: 21.199ms - ExecTreeOpenTime: 38.389us - PrepareTime: 40.184ms - ExecTreePrepareTime: 83.145us DataStreamSender (dst_id=25):(Total: 78.348ms, non-child: 78.348ms, % non-child: 100.00%) - BytesSent: 7.21 MB (7560232) - NetworkThroughput(*): 195.20 MB/sec - OverallThroughput: 92.03 MB/sec - PeakMemoryUsage: 4.95 MB (5192768) - RowsReturned: 451.36K (451360) - SerializeBatchTime: 40.613ms - TransmitDataRPCTime: 36.936ms - UncompressedRowBatchSize: 7.32 MB (7674728) CodeGen:(Total: 38.961ms, non-child: 38.961ms, % non-child: 100.00%) - CodegenTime: 790.539us - CompileTime: 5.391ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 14.406ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 18.809ms HDFS_SCAN_NODE (id=0):(Total: 1s192ms, non-child: 1s192ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/37.97 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: Only following filters arrived: , waited 943ms Hdfs Read Thread Concurrency Bucket: 0:66.67% 1:33.33% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:3 BytesRead(500.000ms): 0, 0, 100.00 KB - FooterProcessingTime: (Avg: 69.151ms ; Min: 69.151ms ; Max: 69.151ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.33 - AverageScannerThreadConcurrency: 0.33 - BytesRead: 8.75 MB (9178114) - BytesReadDataNodeCache: 0 - BytesReadLocal: 8.75 MB (9178114) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 8.75 MB (9178114) - DecompressionTime: 4.942ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 19.74 MB (20698848) - PerReadThreadRawHdfsThroughput: 120.54 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 247.017ms - RowBatchQueuePutWaitTime: 40.443ms - RowsRead: 740.00K (740000) - RowsReturned: 451.36K (451360) - RowsReturnedRate: 378.50 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 6 (6) - ScannerThreadsTotalWallClockTime: 620.706ms - MaterializeTupleTime(*): 34.597ms - ScannerThreadsSysTime: 3.999ms - ScannerThreadsUserTime: 39.993ms - ScannerThreadsVoluntaryContextSwitches: 188 (188) - TotalRawHdfsReadTime(*): 72.613ms - TotalReadThroughput: 66.67 KB/sec Filter 1 (1.00 MB): - Rows processed: 291.49K (291488) - Rows rejected: 288.64K (288640) - Rows total: 740.00K (740000) Instance 7f40dcb034de70b7:225 (host=vd1130.foo:22000):(Total: 1s426ms, non-child: 124.241ms, % non-child: 8.71%) Hdfs split stats (:<# splits>/): 1:1/38.98 MB Filter 1 arrival: 1s290ms MemoryUsage(500.000ms): 1.30 MB, 1.30 MB, 9.54 MB ThreadUsage(500.000ms): 1, 1, 2 - AverageThreadTokens: 1.33 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 21.41 MB (22445395) - PerHostPeakMemUsage: 509.16 MB (533892787) - RowsProduced: 479.93K (479927) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 82.978ms - TotalStorageWaitTime: 81.537ms - TotalThreadsInvoluntaryContextSwitches: 49 (49) - TotalThreadsTotalWallClockTime: 1s683ms - TotalThreadsSysTime: 20.996ms - TotalThreadsUserTime: 157.976ms - TotalThreadsVoluntaryContextSwitches: 616 (616) Fragment Instance Lifecycle Timings: - ExecTime: 1s371ms - ExecTreeExecTime: 1s176ms - OpenTime: 17.423ms - ExecTreeOpenTime: 20.636us - PrepareTime: 37.444ms - ExecTreePrepareTime: 110.191us DataStreamSender (dst_id=25):(Total: 92.239ms, non-child: 92.239ms, % non-child: 100.00%) - BytesSent: 7.66 MB (8034530) - NetworkThroughput(*): 170.81 MB/sec - OverallThroughput: 83.07 MB/sec - PeakMemoryUsage: 4.95 MB (5192768) - RowsReturned: 479.93K (479927) - SerializeBatchTime: 46.655ms - TransmitDataRPCTime: 44.858ms - UncompressedRowBatchSize: 7.78 MB (8160367) CodeGen:(Total: 34.186ms, non-child: 34.186ms, % non-child: 100.00%) - CodegenTime: 702.597us - CompileTime: 4.248ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 11.994ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 17.584ms HDFS_SCAN_NODE (id=0):(Total: 1s176ms, non-child: 1s176ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:1/38.98 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: Only following filters arrived: , waited 964ms Hdfs Read Thread Concurrency Bucket: 0:66.67% 1:33.33% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:3 BytesRead(500.000ms): 0, 0, 3.07 MB - FooterProcessingTime: (Avg: 3.799ms ; Min: 3.799ms ; Max: 3.799ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.33 - AverageScannerThreadConcurrency: 0.33 - BytesRead: 8.98 MB (9416359) - BytesReadDataNodeCache: 0 - BytesReadLocal: 8.98 MB (9416359) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 8.98 MB (9416359) - DecompressionTime: 5.889ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 16.27 MB (17064982) - PerReadThreadRawHdfsThroughput: 125.63 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 209.521ms - RowBatchQueuePutWaitTime: 47.813ms - RowsRead: 760.00K (760000) - RowsReturned: 479.93K (479927) - RowsReturnedRate: 408.06 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 14 (14) - ScannerThreadsTotalWallClockTime: 294.313ms - MaterializeTupleTime(*): 44.666ms - ScannerThreadsSysTime: 5.999ms - ScannerThreadsUserTime: 49.992ms - ScannerThreadsVoluntaryContextSwitches: 160 (160) - TotalRawHdfsReadTime(*): 71.480ms - TotalReadThroughput: 2.05 MB/sec Filter 1 (1.00 MB): - Rows processed: 282.82K (282816) - Rows rejected: 280.07K (280073) - Rows total: 760.00K (760000) Instance 7f40dcb034de70b7:274 (host=vc1539.foo:22000):(Total: 1s424ms, non-child: 151.688ms, % non-child: 10.65%) Hdfs split stats (:<# splits>/): 4:1/39.99 MB Filter 1 arrival: 1s380ms MemoryUsage(500.000ms): 1.30 MB, 1.30 MB ThreadUsage(500.000ms): 1, 2 - AverageThreadTokens: 1.50 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 21.25 MB (22279681) - PerHostPeakMemUsage: 520.48 MB (545760285) - RowsProduced: 780.00K (780000) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 92.211ms - TotalStorageWaitTime: 164.769ms - TotalThreadsInvoluntaryContextSwitches: 54 (54) - TotalThreadsTotalWallClockTime: 1s922ms - TotalThreadsSysTime: 33.995ms - TotalThreadsUserTime: 182.972ms - TotalThreadsVoluntaryContextSwitches: 882 (882) Fragment Instance Lifecycle Timings: - ExecTime: 1s335ms - ExecTreeExecTime: 1s093ms - OpenTime: 23.321ms - ExecTreeOpenTime: 29.937us - PrepareTime: 66.070ms - ExecTreePrepareTime: 104.935us DataStreamSender (dst_id=25):(Total: 128.865ms, non-child: 128.865ms, % non-child: 100.00%) - BytesSent: 12.47 MB (13075919) - NetworkThroughput(*): 186.81 MB/sec - OverallThroughput: 96.77 MB/sec - PeakMemoryUsage: 4.95 MB (5192768) - RowsReturned: 780.00K (780000) - SerializeBatchTime: 60.245ms - TransmitDataRPCTime: 66.751ms - UncompressedRowBatchSize: 12.65 MB (13262680) CodeGen:(Total: 50.674ms, non-child: 50.674ms, % non-child: 100.00%) - CodegenTime: 1.149ms - CompileTime: 6.060ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 15.793ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 28.207ms HDFS_SCAN_NODE (id=0):(Total: 1s093ms, non-child: 1s093ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:1/39.99 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: Only following filters arrived: , waited 924ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:3 BytesRead(500.000ms): 0, 0 - FooterProcessingTime: (Avg: 5.682ms ; Min: 5.682ms ; Max: 5.682ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.50 - BytesRead: 9.21 MB (9655280) - BytesReadDataNodeCache: 0 - BytesReadLocal: 9.21 MB (9655280) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 9.21 MB (9655280) - DecompressionTime: 6.403ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 16.27 MB (17064835) - PerReadThreadRawHdfsThroughput: 63.30 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 166.610ms - RowBatchQueuePutWaitTime: 51.236ms - RowsRead: 780.00K (780000) - RowsReturned: 780.00K (780000) - RowsReturnedRate: 713.25 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 15 (15) - ScannerThreadsTotalWallClockTime: 564.578ms - MaterializeTupleTime(*): 35.154ms - ScannerThreadsSysTime: 12.998ms - ScannerThreadsUserTime: 35.994ms - ScannerThreadsVoluntaryContextSwitches: 449 (449) - TotalRawHdfsReadTime(*): 145.458ms - TotalReadThroughput: 0.00 /sec Filter 1 (1.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 780.00K (780000) Instance 7f40dcb034de70b7:232 (host=vd1116.foo:22000):(Total: 1s423ms, non-child: 227.264ms, % non-child: 15.97%) Hdfs split stats (:<# splits>/): 4:1/38.97 MB Filter 1 arrival: 1s308ms MemoryUsage(500.000ms): 1.30 MB, 1.30 MB, 18.54 MB ThreadUsage(500.000ms): 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 21.34 MB (22374069) - PerHostPeakMemUsage: 510.37 MB (535158785) - RowsProduced: 653.38K (653379) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 172.719ms - TotalStorageWaitTime: 97.419ms - TotalThreadsInvoluntaryContextSwitches: 42 (42) - TotalThreadsTotalWallClockTime: 2s601ms - TotalThreadsSysTime: 21.996ms - TotalThreadsUserTime: 187.971ms - TotalThreadsVoluntaryContextSwitches: 806 (806) Fragment Instance Lifecycle Timings: - ExecTime: 1s358ms - ExecTreeExecTime: 1s048ms - OpenTime: 19.126ms - ExecTreeOpenTime: 26.221us - PrepareTime: 45.340ms - ExecTreePrepareTime: 90.923us DataStreamSender (dst_id=25):(Total: 108.168ms, non-child: 108.168ms, % non-child: 100.00%) - BytesSent: 10.44 MB (10943911) - NetworkThroughput(*): 192.99 MB/sec - OverallThroughput: 96.49 MB/sec - PeakMemoryUsage: 4.95 MB (5192768) - RowsReturned: 653.38K (653379) - SerializeBatchTime: 53.235ms - TransmitDataRPCTime: 54.079ms - UncompressedRowBatchSize: 10.59 MB (11109595) CodeGen:(Total: 39.581ms, non-child: 39.581ms, % non-child: 100.00%) - CodegenTime: 879.742us - CompileTime: 4.445ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 13.465ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 21.033ms HDFS_SCAN_NODE (id=0):(Total: 1s048ms, non-child: 1s048ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:1/38.97 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: Only following filters arrived: , waited 944ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:3 BytesRead(500.000ms): 0, 0, 8.98 MB - FooterProcessingTime: (Avg: 8.492ms ; Min: 8.492ms ; Max: 8.492ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 8.98 MB (9416804) - BytesReadDataNodeCache: 0 - BytesReadLocal: 8.98 MB (9416804) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 8.98 MB (9416804) - DecompressionTime: 7.415ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 16.29 MB (17078067) - PerReadThreadRawHdfsThroughput: 124.07 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 101.147ms - RowBatchQueuePutWaitTime: 155.901ms - RowsRead: 760.00K (760000) - RowsReturned: 653.38K (653379) - RowsReturnedRate: 623.44 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 9 (9) - ScannerThreadsTotalWallClockTime: 1s224ms - MaterializeTupleTime(*): 44.259ms - ScannerThreadsSysTime: 7.998ms - ScannerThreadsUserTime: 51.992ms - ScannerThreadsVoluntaryContextSwitches: 343 (343) - TotalRawHdfsReadTime(*): 72.385ms - TotalReadThroughput: 5.99 MB/sec Filter 1 (1.00 MB): - Rows processed: 107.71K (107712) - Rows rejected: 106.62K (106621) - Rows total: 760.00K (760000) Instance 7f40dcb034de70b7:223 (host=va1028.foo:22000):(Total: 1s417ms, non-child: 210.663ms, % non-child: 14.86%) Hdfs split stats (:<# splits>/): 4:1/37.96 MB Filter 1 arrival: 1s291ms MemoryUsage(500.000ms): 0, 1.30 MB, 5.32 MB ThreadUsage(500.000ms): 1, 2, 2 - AverageThreadTokens: 1.67 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 21.91 MB (22976103) - PerHostPeakMemUsage: 516.68 MB (541773436) - RowsProduced: 617.63K (617631) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 156.475ms - TotalStorageWaitTime: 91.084ms - TotalThreadsInvoluntaryContextSwitches: 43 (43) - TotalThreadsTotalWallClockTime: 2s590ms - TotalThreadsSysTime: 34.995ms - TotalThreadsUserTime: 194.970ms - TotalThreadsVoluntaryContextSwitches: 770 (770) Fragment Instance Lifecycle Timings: - ExecTime: 1s355ms - ExecTreeExecTime: 1s041ms - OpenTime: 19.637ms - ExecTreeOpenTime: 23.012us - PrepareTime: 41.979ms - ExecTreePrepareTime: 81.441us DataStreamSender (dst_id=25):(Total: 125.302ms, non-child: 125.302ms, % non-child: 100.00%) - BytesSent: 9.87 MB (10345075) - NetworkThroughput(*): 176.66 MB/sec - OverallThroughput: 78.74 MB/sec - PeakMemoryUsage: 4.95 MB (5192768) - RowsReturned: 617.63K (617631) - SerializeBatchTime: 68.647ms - TransmitDataRPCTime: 55.844ms - UncompressedRowBatchSize: 10.02 MB (10501871) CodeGen:(Total: 40.461ms, non-child: 40.461ms, % non-child: 100.00%) - CodegenTime: 905.300us - CompileTime: 4.717ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 13.830ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 21.394ms HDFS_SCAN_NODE (id=0):(Total: 1s040ms, non-child: 1s040ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:1/37.96 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: Only following filters arrived: , waited 943ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:3 BytesRead(500.000ms): 0, 0, 100.00 KB - FooterProcessingTime: (Avg: 6.807ms ; Min: 6.807ms ; Max: 6.807ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 8.75 MB (9178471) - BytesReadDataNodeCache: 0 - BytesReadLocal: 8.75 MB (9178471) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 8.75 MB (9178471) - DecompressionTime: 6.948ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 18.63 MB (19530838) - PerReadThreadRawHdfsThroughput: 123.44 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 94.143ms - RowBatchQueuePutWaitTime: 157.420ms - RowsRead: 740.00K (740000) - RowsReturned: 617.63K (617631) - RowsReturnedRate: 593.31 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 11 (11) - ScannerThreadsTotalWallClockTime: 1s215ms - MaterializeTupleTime(*): 44.706ms - ScannerThreadsSysTime: 11.998ms - ScannerThreadsUserTime: 46.992ms - ScannerThreadsVoluntaryContextSwitches: 323 (323) - TotalRawHdfsReadTime(*): 70.908ms - TotalReadThroughput: 66.67 KB/sec Filter 1 (1.00 MB): - Rows processed: 123.55K (123552) - Rows rejected: 122.37K (122369) - Rows total: 740.00K (740000) Instance 7f40dcb034de70b7:238 (host=vd1117.foo:22000):(Total: 1s416ms, non-child: 236.499ms, % non-child: 16.70%) Hdfs split stats (:<# splits>/): 1:1/37.96 MB Filter 1 arrival: 1s317ms MemoryUsage(500.000ms): 1.30 MB, 1.30 MB, 2.80 MB ThreadUsage(500.000ms): 2, 2, 1 - AverageThreadTokens: 1.67 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 21.75 MB (22805759) - PerHostPeakMemUsage: 515.27 MB (540300841) - RowsProduced: 521.29K (521292) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 188.453ms - TotalStorageWaitTime: 97.391ms - TotalThreadsInvoluntaryContextSwitches: 32 (32) - TotalThreadsTotalWallClockTime: 2s577ms - TotalThreadsSysTime: 18.997ms - TotalThreadsUserTime: 163.974ms - TotalThreadsVoluntaryContextSwitches: 749 (749) Fragment Instance Lifecycle Timings: - ExecTime: 1s353ms - ExecTreeExecTime: 1s046ms - OpenTime: 18.039ms - ExecTreeOpenTime: 25.039us - PrepareTime: 45.419ms - ExecTreePrepareTime: 99.058us DataStreamSender (dst_id=25):(Total: 91.292ms, non-child: 91.292ms, % non-child: 100.00%) - BytesSent: 8.33 MB (8730666) - NetworkThroughput(*): 168.00 MB/sec - OverallThroughput: 91.20 MB/sec - PeakMemoryUsage: 4.95 MB (5192768) - RowsReturned: 521.29K (521292) - SerializeBatchTime: 40.683ms - TransmitDataRPCTime: 49.561ms - UncompressedRowBatchSize: 8.45 MB (8864096) CodeGen:(Total: 42.147ms, non-child: 42.147ms, % non-child: 100.00%) - CodegenTime: 727.969us - CompileTime: 4.406ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 12.512ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 24.838ms HDFS_SCAN_NODE (id=0):(Total: 1s046ms, non-child: 1s046ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:1/37.96 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: Only following filters arrived: , waited 944ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:3 BytesRead(500.000ms): 0, 0 - FooterProcessingTime: (Avg: 5.793ms ; Min: 5.793ms ; Max: 5.793ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 8.75 MB (9178437) - BytesReadDataNodeCache: 0 - BytesReadLocal: 8.75 MB (9178437) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 8.75 MB (9178437) - DecompressionTime: 6.246ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 18.12 MB (18999191) - PerReadThreadRawHdfsThroughput: 111.79 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 100.584ms - RowBatchQueuePutWaitTime: 181.962ms - RowsRead: 740.00K (740000) - RowsReturned: 521.29K (521292) - RowsReturnedRate: 498.07 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 10 (10) - ScannerThreadsTotalWallClockTime: 1s207ms - MaterializeTupleTime(*): 39.752ms - ScannerThreadsSysTime: 5.999ms - ScannerThreadsUserTime: 46.992ms - ScannerThreadsVoluntaryContextSwitches: 325 (325) - TotalRawHdfsReadTime(*): 78.299ms - TotalReadThroughput: 0.00 /sec Filter 1 (1.00 MB): - Rows processed: 220.83K (220832) - Rows rejected: 218.71K (218708) - Rows total: 740.00K (740000) Instance 7f40dcb034de70b7:219 (host=ve1128.foo:22000):(Total: 1s411ms, non-child: 197.880ms, % non-child: 14.02%) Hdfs split stats (:<# splits>/): 5:1/36.94 MB Filter 1 arrival: 1s273ms MemoryUsage(500.000ms): 1.30 MB, 1.30 MB ThreadUsage(500.000ms): 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 21.24 MB (22271473) - PerHostPeakMemUsage: 501.66 MB (526026320) - RowsProduced: 720.00K (720000) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 133.387ms - TotalStorageWaitTime: 97.658ms - TotalThreadsInvoluntaryContextSwitches: 39 (39) - TotalThreadsTotalWallClockTime: 2s540ms - TotalThreadsSysTime: 27.996ms - TotalThreadsUserTime: 197.969ms - TotalThreadsVoluntaryContextSwitches: 965 (965) Fragment Instance Lifecycle Timings: - ExecTime: 1s345ms - ExecTreeExecTime: 1s047ms - OpenTime: 19.835ms - ExecTreeOpenTime: 29.239us - PrepareTime: 46.083ms - ExecTreePrepareTime: 85.079us DataStreamSender (dst_id=25):(Total: 122.337ms, non-child: 122.337ms, % non-child: 100.00%) - BytesSent: 11.50 MB (12057750) - NetworkThroughput(*): 194.19 MB/sec - OverallThroughput: 94.00 MB/sec - PeakMemoryUsage: 4.95 MB (5192768) - RowsReturned: 720.00K (720000) - SerializeBatchTime: 62.278ms - TransmitDataRPCTime: 59.215ms - UncompressedRowBatchSize: 11.68 MB (12242680) CodeGen:(Total: 43.633ms, non-child: 43.633ms, % non-child: 100.00%) - CodegenTime: 1.101ms - CompileTime: 5.393ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 13.215ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 24.501ms HDFS_SCAN_NODE (id=0):(Total: 1s047ms, non-child: 1s047ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:1/36.94 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: Only following filters arrived: , waited 944ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:3 BytesRead(500.000ms): 0, 0 - FooterProcessingTime: (Avg: 5.713ms ; Min: 5.713ms ; Max: 5.713ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 8.53 MB (8939377) - BytesReadDataNodeCache: 0 - BytesReadLocal: 8.53 MB (8939377) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 8.53 MB (8939377) - DecompressionTime: 6.495ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 16.27 MB (17064811) - PerReadThreadRawHdfsThroughput: 107.44 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 99.706ms - RowBatchQueuePutWaitTime: 102.476ms - RowsRead: 720.00K (720000) - RowsReturned: 720.00K (720000) - RowsReturnedRate: 687.56 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 9 (9) - ScannerThreadsTotalWallClockTime: 1s175ms - MaterializeTupleTime(*): 32.409ms - ScannerThreadsSysTime: 4.999ms - ScannerThreadsUserTime: 41.993ms - ScannerThreadsVoluntaryContextSwitches: 507 (507) - TotalRawHdfsReadTime(*): 79.346ms - TotalReadThroughput: 0.00 /sec Filter 1 (1.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 720.00K (720000) Instance 7f40dcb034de70b7:20e (host=vd1111.foo:22000):(Total: 1s397ms, non-child: 204.475ms, % non-child: 14.63%) Hdfs split stats (:<# splits>/): 2:1/39.98 MB Filter 1 arrival: 1s240ms MemoryUsage(500.000ms): 1.30 MB, 1.30 MB, 4.59 MB ThreadUsage(500.000ms): 2, 2, 1 - AverageThreadTokens: 1.67 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 24.13 MB (25306818) - PerHostPeakMemUsage: 502.79 MB (527211740) - RowsProduced: 457.80K (457795) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 150.658ms - TotalStorageWaitTime: 122.428ms - TotalThreadsInvoluntaryContextSwitches: 47 (47) - TotalThreadsTotalWallClockTime: 2s505ms - TotalThreadsSysTime: 28.994ms - TotalThreadsUserTime: 152.976ms - TotalThreadsVoluntaryContextSwitches: 708 (708) Fragment Instance Lifecycle Timings: - ExecTime: 1s316ms - ExecTreeExecTime: 1s055ms - OpenTime: 33.710ms - ExecTreeOpenTime: 33.328us - PrepareTime: 48.034ms - ExecTreePrepareTime: 97.551us DataStreamSender (dst_id=25):(Total: 86.068ms, non-child: 86.068ms, % non-child: 100.00%) - BytesSent: 7.31 MB (7667561) - NetworkThroughput(*): 171.88 MB/sec - OverallThroughput: 84.96 MB/sec - PeakMemoryUsage: 4.95 MB (5192768) - RowsReturned: 457.80K (457795) - SerializeBatchTime: 42.454ms - TransmitDataRPCTime: 42.542ms - UncompressedRowBatchSize: 7.42 MB (7784123) CodeGen:(Total: 52.199ms, non-child: 52.199ms, % non-child: 100.00%) - CodegenTime: 1.074ms - CompileTime: 8.270ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 23.388ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 20.069ms HDFS_SCAN_NODE (id=0):(Total: 1s055ms, non-child: 1s055ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:1/39.98 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: Only following filters arrived: , waited 924ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:3 BytesRead(500.000ms): 0, 0 - FooterProcessingTime: (Avg: 4.563ms ; Min: 4.563ms ; Max: 4.563ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 9.21 MB (9655452) - BytesReadDataNodeCache: 0 - BytesReadLocal: 9.21 MB (9655452) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 9.21 MB (9655452) - DecompressionTime: 5.802ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 18.19 MB (19073077) - PerReadThreadRawHdfsThroughput: 87.86 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 128.624ms - RowBatchQueuePutWaitTime: 106.792ms - RowsRead: 780.00K (780000) - RowsReturned: 457.80K (457795) - RowsReturnedRate: 433.83 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 9 (9) - ScannerThreadsTotalWallClockTime: 1s156ms - MaterializeTupleTime(*): 35.346ms - ScannerThreadsSysTime: 6.998ms - ScannerThreadsUserTime: 39.993ms - ScannerThreadsVoluntaryContextSwitches: 239 (239) - TotalRawHdfsReadTime(*): 104.804ms - TotalReadThroughput: 0.00 /sec Filter 1 (1.00 MB): - Rows processed: 325.34K (325344) - Rows rejected: 322.20K (322205) - Rows total: 780.00K (780000) Instance 7f40dcb034de70b7:253 (host=vc1528.foo:22000):(Total: 1s393ms, non-child: 115.313ms, % non-child: 8.28%) Hdfs split stats (:<# splits>/): 4:1/39.99 MB Filter 1 arrival: 1s342ms MemoryUsage(500.000ms): 1.30 MB, 1.30 MB, 19.15 MB ThreadUsage(500.000ms): 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 21.25 MB (22279495) - PerHostPeakMemUsage: 527.47 MB (553093089) - RowsProduced: 780.00K (780000) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 53.679ms - TotalStorageWaitTime: 132.586ms - TotalThreadsInvoluntaryContextSwitches: 65 (65) - TotalThreadsTotalWallClockTime: 2s516ms - TotalThreadsSysTime: 30.995ms - TotalThreadsUserTime: 220.965ms - TotalThreadsVoluntaryContextSwitches: 920 (920) Fragment Instance Lifecycle Timings: - ExecTime: 1s316ms - ExecTreeExecTime: 1s087ms - OpenTime: 24.918ms - ExecTreeOpenTime: 35.853us - PrepareTime: 51.517ms - ExecTreePrepareTime: 89.149us DataStreamSender (dst_id=25):(Total: 140.592ms, non-child: 140.592ms, % non-child: 100.00%) - BytesSent: 12.46 MB (13069631) - NetworkThroughput(*): 181.79 MB/sec - OverallThroughput: 88.65 MB/sec - PeakMemoryUsage: 4.95 MB (5192768) - RowsReturned: 780.00K (780000) - SerializeBatchTime: 71.065ms - TransmitDataRPCTime: 68.564ms - UncompressedRowBatchSize: 12.65 MB (13262680) CodeGen:(Total: 49.866ms, non-child: 49.866ms, % non-child: 100.00%) - CodegenTime: 1.138ms - CompileTime: 6.671ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 17.002ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 25.708ms HDFS_SCAN_NODE (id=0):(Total: 1s087ms, non-child: 1s087ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:1/39.99 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: Only following filters arrived: , waited 944ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:3 BytesRead(500.000ms): 0, 0, 9.21 MB - FooterProcessingTime: (Avg: 8.529ms ; Min: 8.529ms ; Max: 8.529ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 9.21 MB (9656141) - BytesReadDataNodeCache: 0 - BytesReadLocal: 9.21 MB (9656141) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 9.21 MB (9656141) - DecompressionTime: 6.892ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 16.27 MB (17064600) - PerReadThreadRawHdfsThroughput: 83.88 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 140.933ms - RowBatchQueuePutWaitTime: 73.597ms - RowsRead: 780.00K (780000) - RowsReturned: 780.00K (780000) - RowsReturnedRate: 717.27 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 15 (15) - ScannerThreadsTotalWallClockTime: 1s175ms - MaterializeTupleTime(*): 41.137ms - ScannerThreadsSysTime: 10.998ms - ScannerThreadsUserTime: 46.992ms - ScannerThreadsVoluntaryContextSwitches: 481 (481) - TotalRawHdfsReadTime(*): 109.785ms - TotalReadThroughput: 6.14 MB/sec Filter 1 (1.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 780.00K (780000) Instance 7f40dcb034de70b7:218 (host=vd1104.foo:22000):(Total: 1s391ms, non-child: 204.397ms, % non-child: 14.69%) Hdfs split stats (:<# splits>/): 0:1/37.97 MB Filter 1 arrival: 1s274ms MemoryUsage(500.000ms): 1.30 MB, 1.30 MB, 4.96 MB ThreadUsage(500.000ms): 2, 2, 1 - AverageThreadTokens: 1.67 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 25.33 MB (26555529) - PerHostPeakMemUsage: 530.12 MB (555866454) - RowsProduced: 457.42K (457417) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 145.626ms - TotalStorageWaitTime: 97.360ms - TotalThreadsInvoluntaryContextSwitches: 40 (40) - TotalThreadsTotalWallClockTime: 2s488ms - TotalThreadsSysTime: 25.995ms - TotalThreadsUserTime: 163.974ms - TotalThreadsVoluntaryContextSwitches: 720 (720) Fragment Instance Lifecycle Timings: - ExecTime: 1s315ms - ExecTreeExecTime: 1s046ms - OpenTime: 23.569ms - ExecTreeOpenTime: 45.768us - PrepareTime: 52.338ms - ExecTreePrepareTime: 90.599us DataStreamSender (dst_id=25):(Total: 93.275ms, non-child: 93.275ms, % non-child: 100.00%) - BytesSent: 7.31 MB (7660344) - NetworkThroughput(*): 169.79 MB/sec - OverallThroughput: 78.32 MB/sec - PeakMemoryUsage: 4.95 MB (5192768) - RowsReturned: 457.42K (457417) - SerializeBatchTime: 49.434ms - TransmitDataRPCTime: 43.026ms - UncompressedRowBatchSize: 7.42 MB (7777697) CodeGen:(Total: 47.549ms, non-child: 47.549ms, % non-child: 100.00%) - CodegenTime: 1.202ms - CompileTime: 5.983ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 16.320ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 24.424ms HDFS_SCAN_NODE (id=0):(Total: 1s046ms, non-child: 1s046ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/37.97 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: Only following filters arrived: , waited 943ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:3 BytesRead(500.000ms): 0, 0 - FooterProcessingTime: (Avg: 10.557ms ; Min: 10.557ms ; Max: 10.557ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 8.75 MB (9178222) - BytesReadDataNodeCache: 0 - BytesReadLocal: 8.75 MB (9178222) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 8.75 MB (9178222) - DecompressionTime: 5.838ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 19.70 MB (20652494) - PerReadThreadRawHdfsThroughput: 122.20 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 100.237ms - RowBatchQueuePutWaitTime: 126.435ms - RowsRead: 740.00K (740000) - RowsReturned: 457.42K (457417) - RowsReturnedRate: 437.08 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 9 (9) - ScannerThreadsTotalWallClockTime: 1s149ms - MaterializeTupleTime(*): 39.404ms - ScannerThreadsSysTime: 9.998ms - ScannerThreadsUserTime: 40.993ms - ScannerThreadsVoluntaryContextSwitches: 248 (248) - TotalRawHdfsReadTime(*): 71.631ms - TotalReadThroughput: 0.00 /sec Filter 1 (1.00 MB): - Rows processed: 285.34K (285344) - Rows rejected: 282.58K (282583) - Rows total: 740.00K (740000) Instance 7f40dcb034de70b7:217 (host=ve1132.foo:22000):(Total: 1s389ms, non-child: 175.928ms, % non-child: 12.66%) Hdfs split stats (:<# splits>/): 4:1/38.98 MB Filter 1 arrival: 1s271ms MemoryUsage(500.000ms): 1.30 MB, 1.30 MB, 20.75 MB ThreadUsage(500.000ms): 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 21.26 MB (22293204) - PerHostPeakMemUsage: 519.60 MB (544844332) - RowsProduced: 642.15K (642150) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 120.311ms - TotalStorageWaitTime: 91.761ms - TotalThreadsInvoluntaryContextSwitches: 66 (66) - TotalThreadsTotalWallClockTime: 2s403ms - TotalThreadsSysTime: 17.996ms - TotalThreadsUserTime: 215.967ms - TotalThreadsVoluntaryContextSwitches: 892 (892) Fragment Instance Lifecycle Timings: - ExecTime: 1s319ms - ExecTreeExecTime: 1s044ms - OpenTime: 27.912ms - ExecTreeOpenTime: 42.050us - PrepareTime: 41.414ms - ExecTreePrepareTime: 157.478us DataStreamSender (dst_id=25):(Total: 119.454ms, non-child: 119.454ms, % non-child: 100.00%) - BytesSent: 10.26 MB (10756562) - NetworkThroughput(*): 173.60 MB/sec - OverallThroughput: 85.88 MB/sec - PeakMemoryUsage: 4.95 MB (5192768) - RowsReturned: 642.15K (642150) - SerializeBatchTime: 59.628ms - TransmitDataRPCTime: 59.090ms - UncompressedRowBatchSize: 10.41 MB (10918698) CodeGen:(Total: 49.187ms, non-child: 49.187ms, % non-child: 100.00%) - CodegenTime: 1.174ms - CompileTime: 8.071ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 18.688ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 21.825ms HDFS_SCAN_NODE (id=0):(Total: 1s044ms, non-child: 1s044ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:1/38.98 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: Only following filters arrived: , waited 943ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:3 BytesRead(500.000ms): 0, 0, 8.98 MB - FooterProcessingTime: (Avg: 7.602ms ; Min: 7.602ms ; Max: 7.602ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 8.98 MB (9417391) - BytesReadDataNodeCache: 0 - BytesReadLocal: 8.98 MB (9417391) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 8.98 MB (9417391) - DecompressionTime: 5.910ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 16.27 MB (17064766) - PerReadThreadRawHdfsThroughput: 128.81 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 97.592ms - RowBatchQueuePutWaitTime: 121.488ms - RowsRead: 760.00K (760000) - RowsReturned: 642.15K (642150) - RowsReturnedRate: 614.74 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 15 (15) - ScannerThreadsTotalWallClockTime: 1s056ms - MaterializeTupleTime(*): 45.068ms - ScannerThreadsSysTime: 7.998ms - ScannerThreadsUserTime: 51.992ms - ScannerThreadsVoluntaryContextSwitches: 427 (427) - TotalRawHdfsReadTime(*): 69.721ms - TotalReadThroughput: 5.99 MB/sec Filter 1 (1.00 MB): - Rows processed: 118.98K (118976) - Rows rejected: 117.85K (117850) - Rows total: 760.00K (760000) Instance 7f40dcb034de70b7:216 (host=vc1525.foo:22000):(Total: 1s385ms, non-child: 181.301ms, % non-child: 13.09%) Hdfs split stats (:<# splits>/): 7:1/38.99 MB Filter 1 arrival: 1s266ms MemoryUsage(500.000ms): 1.30 MB, 1.30 MB, 13.92 MB ThreadUsage(500.000ms): 1, 1, 2 - AverageThreadTokens: 1.33 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 22.08 MB (23147797) - PerHostPeakMemUsage: 492.58 MB (516506522) - RowsProduced: 613.87K (613871) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 121.852ms - TotalStorageWaitTime: 100.080ms - TotalThreadsInvoluntaryContextSwitches: 46 (46) - TotalThreadsTotalWallClockTime: 1s925ms - TotalThreadsSysTime: 19.997ms - TotalThreadsUserTime: 193.969ms - TotalThreadsVoluntaryContextSwitches: 886 (886) Fragment Instance Lifecycle Timings: - ExecTime: 1s315ms - ExecTreeExecTime: 1s049ms - OpenTime: 25.475ms - ExecTreeOpenTime: 43.610us - PrepareTime: 44.467ms - ExecTreePrepareTime: 88.093us DataStreamSender (dst_id=25):(Total: 105.719ms, non-child: 105.719ms, % non-child: 100.00%) - BytesSent: 9.81 MB (10284640) - NetworkThroughput(*): 179.15 MB/sec - OverallThroughput: 92.78 MB/sec - PeakMemoryUsage: 4.95 MB (5192768) - RowsReturned: 613.87K (613871) - SerializeBatchTime: 50.131ms - TransmitDataRPCTime: 54.749ms - UncompressedRowBatchSize: 9.95 MB (10437951) CodeGen:(Total: 48.166ms, non-child: 48.166ms, % non-child: 100.00%) - CodegenTime: 868.430us - CompileTime: 6.841ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 17.313ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 23.583ms HDFS_SCAN_NODE (id=0):(Total: 1s049ms, non-child: 1s049ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:1/38.99 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: Only following filters arrived: , waited 943ms Hdfs Read Thread Concurrency Bucket: 0:66.67% 1:33.33% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:3 BytesRead(500.000ms): 0, 0, 6.00 MB - FooterProcessingTime: (Avg: 5.923ms ; Min: 5.923ms ; Max: 5.923ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.33 - AverageScannerThreadConcurrency: 0.33 - BytesRead: 8.98 MB (9417160) - BytesReadDataNodeCache: 0 - BytesReadLocal: 8.98 MB (9417160) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 8.98 MB (9417160) - DecompressionTime: 7.210ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 18.73 MB (19643233) - PerReadThreadRawHdfsThroughput: 109.47 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 102.905ms - RowBatchQueuePutWaitTime: 115.280ms - RowsRead: 760.00K (760000) - RowsReturned: 613.87K (613871) - RowsReturnedRate: 584.70 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 14 (14) - ScannerThreadsTotalWallClockTime: 584.737ms - MaterializeTupleTime(*): 38.341ms - ScannerThreadsSysTime: 4.999ms - ScannerThreadsUserTime: 46.992ms - ScannerThreadsVoluntaryContextSwitches: 410 (410) - TotalRawHdfsReadTime(*): 82.036ms - TotalReadThroughput: 4.00 MB/sec Filter 1 (1.00 MB): - Rows processed: 147.65K (147648) - Rows rejected: 146.13K (146129) - Rows total: 760.00K (760000) Instance 7f40dcb034de70b7:220 (host=vc1503.foo:22000):(Total: 1s383ms, non-child: 100.428ms, % non-child: 7.26%) Hdfs split stats (:<# splits>/): 4:1/39.99 MB Filter 1 arrival: 1s288ms MemoryUsage(500.000ms): 1.52 MB, 1.30 MB, 5.32 MB ThreadUsage(500.000ms): 1, 2, 2 - AverageThreadTokens: 1.67 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 21.25 MB (22279655) - PerHostPeakMemUsage: 514.75 MB (539753025) - RowsProduced: 780.00K (780000) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 56.215ms - TotalStorageWaitTime: 149.880ms - TotalThreadsInvoluntaryContextSwitches: 48 (48) - TotalThreadsTotalWallClockTime: 2s532ms - TotalThreadsSysTime: 34.994ms - TotalThreadsUserTime: 188.971ms - TotalThreadsVoluntaryContextSwitches: 831 (831) Fragment Instance Lifecycle Timings: - ExecTime: 1s331ms - ExecTreeExecTime: 1s119ms - OpenTime: 21.373ms - ExecTreeOpenTime: 33.652us - PrepareTime: 30.805ms - ExecTreePrepareTime: 45.428us DataStreamSender (dst_id=25):(Total: 129.771ms, non-child: 129.771ms, % non-child: 100.00%) - BytesSent: 12.47 MB (13073412) - NetworkThroughput(*): 187.18 MB/sec - OverallThroughput: 96.07 MB/sec - PeakMemoryUsage: 4.95 MB (5192768) - RowsReturned: 780.00K (780000) - SerializeBatchTime: 62.603ms - TransmitDataRPCTime: 66.609ms - UncompressedRowBatchSize: 12.65 MB (13262680) CodeGen:(Total: 33.746ms, non-child: 33.746ms, % non-child: 100.00%) - CodegenTime: 680.973us - CompileTime: 6.529ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 13.824ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 13.036ms HDFS_SCAN_NODE (id=0):(Total: 1s119ms, non-child: 1s119ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:1/39.99 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: Only following filters arrived: , waited 963ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:3 BytesRead(500.000ms): 0, 0, 100.00 KB - FooterProcessingTime: (Avg: 10.216ms ; Min: 10.216ms ; Max: 10.216ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 9.21 MB (9655396) - BytesReadDataNodeCache: 0 - BytesReadLocal: 9.21 MB (9655396) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 9.21 MB (9655396) - DecompressionTime: 6.854ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 16.27 MB (17064674) - PerReadThreadRawHdfsThroughput: 75.84 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 153.178ms - RowBatchQueuePutWaitTime: 52.290ms - RowsRead: 780.00K (780000) - RowsReturned: 780.00K (780000) - RowsReturnedRate: 696.89 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 10 (10) - ScannerThreadsTotalWallClockTime: 1s179ms - MaterializeTupleTime(*): 39.106ms - ScannerThreadsSysTime: 8.998ms - ScannerThreadsUserTime: 45.993ms - ScannerThreadsVoluntaryContextSwitches: 374 (374) - TotalRawHdfsReadTime(*): 121.411ms - TotalReadThroughput: 66.67 KB/sec Filter 1 (1.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 780.00K (780000) Instance 7f40dcb034de70b7:21e (host=vd1138.foo:22000):(Total: 1s380ms, non-child: 167.584ms, % non-child: 12.14%) Hdfs split stats (:<# splits>/): 4:1/38.98 MB Filter 1 arrival: 1s283ms MemoryUsage(500.000ms): 1.30 MB, 1.30 MB ThreadUsage(500.000ms): 1, 2 - AverageThreadTokens: 1.50 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 21.24 MB (22271583) - PerHostPeakMemUsage: 505.19 MB (529726919) - RowsProduced: 760.00K (760000) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 109.013ms - TotalStorageWaitTime: 99.086ms - TotalThreadsInvoluntaryContextSwitches: 42 (42) - TotalThreadsTotalWallClockTime: 1s875ms - TotalThreadsSysTime: 26.995ms - TotalThreadsUserTime: 197.969ms - TotalThreadsVoluntaryContextSwitches: 940 (940) Fragment Instance Lifecycle Timings: - ExecTime: 1s301ms - ExecTreeExecTime: 1s029ms - OpenTime: 21.104ms - ExecTreeOpenTime: 27.444us - PrepareTime: 57.722ms - ExecTreePrepareTime: 89.549us DataStreamSender (dst_id=25):(Total: 126.005ms, non-child: 126.005ms, % non-child: 100.00%) - BytesSent: 12.14 MB (12731357) - NetworkThroughput(*): 181.93 MB/sec - OverallThroughput: 96.36 MB/sec - PeakMemoryUsage: 4.95 MB (5192768) - RowsReturned: 760.00K (760000) - SerializeBatchTime: 58.101ms - TransmitDataRPCTime: 66.737ms - UncompressedRowBatchSize: 12.32 MB (12922680) CodeGen:(Total: 57.288ms, non-child: 57.288ms, % non-child: 100.00%) - CodegenTime: 922.017us - CompileTime: 5.664ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 14.181ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 37.027ms HDFS_SCAN_NODE (id=0):(Total: 1s029ms, non-child: 1s029ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:1/38.98 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: Only following filters arrived: , waited 923ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:3 BytesRead(500.000ms): 0, 0 - FooterProcessingTime: (Avg: 5.588ms ; Min: 5.588ms ; Max: 5.588ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.50 - BytesRead: 8.98 MB (9416443) - BytesReadDataNodeCache: 0 - BytesReadLocal: 8.98 MB (9416443) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 8.98 MB (9416443) - DecompressionTime: 6.532ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 16.27 MB (17064836) - PerReadThreadRawHdfsThroughput: 116.60 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 102.655ms - RowBatchQueuePutWaitTime: 128.417ms - RowsRead: 760.00K (760000) - RowsReturned: 760.00K (760000) - RowsReturnedRate: 738.01 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 7 (7) - ScannerThreadsTotalWallClockTime: 553.188ms - MaterializeTupleTime(*): 30.961ms - ScannerThreadsSysTime: 9.998ms - ScannerThreadsUserTime: 35.994ms - ScannerThreadsVoluntaryContextSwitches: 510 (510) - TotalRawHdfsReadTime(*): 77.014ms - TotalReadThroughput: 0.00 /sec Filter 1 (1.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 760.00K (760000) Instance 7f40dcb034de70b7:229 (host=va1046.foo:22000):(Total: 1s376ms, non-child: 117.663ms, % non-child: 8.55%) Hdfs split stats (:<# splits>/): 2:1/39.99 MB Filter 1 arrival: 1s296ms MemoryUsage(500.000ms): 1.30 MB, 1.30 MB ThreadUsage(500.000ms): 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 21.25 MB (22279549) - PerHostPeakMemUsage: 508.95 MB (533675552) - RowsProduced: 780.00K (780000) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 55.128ms - TotalStorageWaitTime: 130.261ms - TotalThreadsInvoluntaryContextSwitches: 45 (45) - TotalThreadsTotalWallClockTime: 2s527ms - TotalThreadsSysTime: 21.996ms - TotalThreadsUserTime: 212.967ms - TotalThreadsVoluntaryContextSwitches: 1.03K (1030) Fragment Instance Lifecycle Timings: - ExecTime: 1s321ms - ExecTreeExecTime: 1s100ms - OpenTime: 20.183ms - ExecTreeOpenTime: 36.211us - PrepareTime: 34.349ms - ExecTreePrepareTime: 87.588us DataStreamSender (dst_id=25):(Total: 122.450ms, non-child: 122.450ms, % non-child: 100.00%) - BytesSent: 12.47 MB (13070601) - NetworkThroughput(*): 195.70 MB/sec - OverallThroughput: 101.80 MB/sec - PeakMemoryUsage: 4.95 MB (5192768) - RowsReturned: 780.00K (780000) - SerializeBatchTime: 58.244ms - TransmitDataRPCTime: 63.694ms - UncompressedRowBatchSize: 12.65 MB (13262680) CodeGen:(Total: 35.418ms, non-child: 35.418ms, % non-child: 100.00%) - CodegenTime: 982.766us - CompileTime: 5.285ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 13.718ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 15.835ms HDFS_SCAN_NODE (id=0):(Total: 1s100ms, non-child: 1s100ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:1/39.99 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: Only following filters arrived: , waited 964ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:3 BytesRead(500.000ms): 0, 0 - FooterProcessingTime: (Avg: 8.861ms ; Min: 8.861ms ; Max: 8.861ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 9.21 MB (9655972) - BytesReadDataNodeCache: 0 - BytesReadLocal: 9.21 MB (9655972) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 9.21 MB (9655972) - DecompressionTime: 5.996ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 16.27 MB (17064642) - PerReadThreadRawHdfsThroughput: 84.15 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 133.103ms - RowBatchQueuePutWaitTime: 65.330ms - RowsRead: 780.00K (780000) - RowsReturned: 780.00K (780000) - RowsReturnedRate: 708.78 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 12 (12) - ScannerThreadsTotalWallClockTime: 1s186ms - MaterializeTupleTime(*): 39.012ms - ScannerThreadsSysTime: 4.999ms - ScannerThreadsUserTime: 49.992ms - ScannerThreadsVoluntaryContextSwitches: 580 (580) - TotalRawHdfsReadTime(*): 109.427ms - TotalReadThroughput: 0.00 /sec Filter 1 (1.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 780.00K (780000) Instance 7f40dcb034de70b7:269 (host=vd1119.foo:22000):(Total: 1s373ms, non-child: 119.906ms, % non-child: 8.73%) Hdfs split stats (:<# splits>/): 7:1/39.99 MB Filter 1 arrival: 1s366ms MemoryUsage(500.000ms): 1.30 MB, 1.30 MB, 19.13 MB ThreadUsage(500.000ms): 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 21.25 MB (22279748) - PerHostPeakMemUsage: 522.74 MB (548133200) - RowsProduced: 780.00K (780000) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 51.994ms - TotalStorageWaitTime: 142.761ms - TotalThreadsInvoluntaryContextSwitches: 49 (49) - TotalThreadsTotalWallClockTime: 2s465ms - TotalThreadsSysTime: 20.996ms - TotalThreadsUserTime: 221.966ms - TotalThreadsVoluntaryContextSwitches: 998 (998) Fragment Instance Lifecycle Timings: - ExecTime: 1s294ms - ExecTreeExecTime: 1s074ms - OpenTime: 25.924ms - ExecTreeOpenTime: 36.070us - PrepareTime: 53.173ms - ExecTreePrepareTime: 63.650us DataStreamSender (dst_id=25):(Total: 129.721ms, non-child: 129.721ms, % non-child: 100.00%) - BytesSent: 12.46 MB (13065134) - NetworkThroughput(*): 185.95 MB/sec - OverallThroughput: 96.05 MB/sec - PeakMemoryUsage: 4.95 MB (5192768) - RowsReturned: 780.00K (780000) - SerializeBatchTime: 60.691ms - TransmitDataRPCTime: 67.008ms - UncompressedRowBatchSize: 12.65 MB (13262680) CodeGen:(Total: 49.465ms, non-child: 49.465ms, % non-child: 100.00%) - CodegenTime: 888.257us - CompileTime: 6.348ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 18.158ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 24.483ms HDFS_SCAN_NODE (id=0):(Total: 1s074ms, non-child: 1s074ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:1/39.99 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: Only following filters arrived: , waited 924ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:3 BytesRead(500.000ms): 0, 0, 9.21 MB - FooterProcessingTime: (Avg: 9.284ms ; Min: 9.284ms ; Max: 9.284ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 9.21 MB (9655768) - BytesReadDataNodeCache: 0 - BytesReadLocal: 9.21 MB (9655768) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 9.21 MB (9655768) - DecompressionTime: 6.563ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 16.27 MB (17064841) - PerReadThreadRawHdfsThroughput: 77.45 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 146.558ms - RowBatchQueuePutWaitTime: 66.766ms - RowsRead: 780.00K (780000) - RowsReturned: 780.00K (780000) - RowsReturnedRate: 725.96 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 11 (11) - ScannerThreadsTotalWallClockTime: 1s145ms - MaterializeTupleTime(*): 39.292ms - ScannerThreadsSysTime: 7.998ms - ScannerThreadsUserTime: 47.992ms - ScannerThreadsVoluntaryContextSwitches: 535 (535) - TotalRawHdfsReadTime(*): 118.888ms - TotalReadThroughput: 6.14 MB/sec Filter 1 (1.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 780.00K (780000) Instance 7f40dcb034de70b7:21c (host=vc1542.foo:22000):(Total: 1s372ms, non-child: 125.017ms, % non-child: 9.11%) Hdfs split stats (:<# splits>/): 3:1/39.99 MB Filter 1 arrival: 1s281ms MemoryUsage(500.000ms): 1.30 MB, 1.30 MB ThreadUsage(500.000ms): 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 21.24 MB (22271657) - PerHostPeakMemUsage: 517.40 MB (542534186) - RowsProduced: 780.00K (780000) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 81.607ms - TotalStorageWaitTime: 136.158ms - TotalThreadsInvoluntaryContextSwitches: 35 (35) - TotalThreadsTotalWallClockTime: 2s505ms - TotalThreadsSysTime: 13.998ms - TotalThreadsUserTime: 193.970ms - TotalThreadsVoluntaryContextSwitches: 830 (830) Fragment Instance Lifecycle Timings: - ExecTime: 1s309ms - ExecTreeExecTime: 1s087ms - OpenTime: 18.052ms - ExecTreeOpenTime: 24.907us - PrepareTime: 44.935ms - ExecTreePrepareTime: 119.536us DataStreamSender (dst_id=25):(Total: 124.281ms, non-child: 124.281ms, % non-child: 100.00%) - BytesSent: 12.46 MB (13069091) - NetworkThroughput(*): 189.28 MB/sec - OverallThroughput: 100.29 MB/sec - PeakMemoryUsage: 4.95 MB (5192768) - RowsReturned: 780.00K (780000) - SerializeBatchTime: 57.640ms - TransmitDataRPCTime: 65.846ms - UncompressedRowBatchSize: 12.65 MB (13262680) CodeGen:(Total: 35.380ms, non-child: 35.380ms, % non-child: 100.00%) - CodegenTime: 774.908us - CompileTime: 4.604ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 12.459ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 17.881ms HDFS_SCAN_NODE (id=0):(Total: 1s087ms, non-child: 1s087ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:1/39.99 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: Only following filters arrived: , waited 944ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:3 BytesRead(500.000ms): 0, 0 - FooterProcessingTime: (Avg: 8.288ms ; Min: 8.288ms ; Max: 8.288ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 9.21 MB (9655223) - BytesReadDataNodeCache: 0 - BytesReadLocal: 9.21 MB (9655223) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 9.21 MB (9655223) - DecompressionTime: 6.767ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 16.27 MB (17064645) - PerReadThreadRawHdfsThroughput: 80.34 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 140.847ms - RowBatchQueuePutWaitTime: 67.421ms - RowsRead: 780.00K (780000) - RowsReturned: 780.00K (780000) - RowsReturnedRate: 717.30 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 10 (10) - ScannerThreadsTotalWallClockTime: 1s178ms - MaterializeTupleTime(*): 40.893ms - ScannerThreadsSysTime: 5.999ms - ScannerThreadsUserTime: 49.992ms - ScannerThreadsVoluntaryContextSwitches: 360 (360) - TotalRawHdfsReadTime(*): 114.613ms - TotalReadThroughput: 0.00 /sec Filter 1 (1.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 780.00K (780000) Instance 7f40dcb034de70b7:22b (host=vd1121.foo:22000):(Total: 1s364ms, non-child: 147.939ms, % non-child: 10.84%) Hdfs split stats (:<# splits>/): 6:1/38.98 MB Filter 1 arrival: 1s298ms MemoryUsage(500.000ms): 1.30 MB, 1.30 MB, 20.38 MB ThreadUsage(500.000ms): 1, 2, 2 - AverageThreadTokens: 1.67 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 21.24 MB (22271440) - PerHostPeakMemUsage: 506.63 MB (531237570) - RowsProduced: 760.00K (760000) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 71.242ms - TotalStorageWaitTime: 100.150ms - TotalThreadsInvoluntaryContextSwitches: 58 (58) - TotalThreadsTotalWallClockTime: 1s815ms - TotalThreadsSysTime: 43.993ms - TotalThreadsUserTime: 217.966ms - TotalThreadsVoluntaryContextSwitches: 915 (915) Fragment Instance Lifecycle Timings: - ExecTime: 1s246ms - ExecTreeExecTime: 990.472ms - OpenTime: 27.010ms - ExecTreeOpenTime: 40.051us - PrepareTime: 91.359ms - ExecTreePrepareTime: 112.185us DataStreamSender (dst_id=25):(Total: 155.010ms, non-child: 155.010ms, % non-child: 100.00%) - BytesSent: 12.14 MB (12732468) - NetworkThroughput(*): 164.82 MB/sec - OverallThroughput: 78.33 MB/sec - PeakMemoryUsage: 4.95 MB (5192768) - RowsReturned: 760.00K (760000) - SerializeBatchTime: 75.366ms - TransmitDataRPCTime: 73.672ms - UncompressedRowBatchSize: 12.32 MB (12922680) CodeGen:(Total: 71.571ms, non-child: 71.571ms, % non-child: 100.00%) - CodegenTime: 1.316ms - CompileTime: 8.140ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 17.516ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 45.085ms HDFS_SCAN_NODE (id=0):(Total: 990.396ms, non-child: 990.396ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 6:1/38.98 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: Only following filters arrived: , waited 884ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:3 BytesRead(500.000ms): 0, 0, 8.98 MB - FooterProcessingTime: (Avg: 7.526ms ; Min: 7.526ms ; Max: 7.526ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.67 - BytesRead: 8.98 MB (9417273) - BytesReadDataNodeCache: 0 - BytesReadLocal: 8.98 MB (9417273) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 8.98 MB (9417273) - DecompressionTime: 6.762ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 16.27 MB (17064799) - PerReadThreadRawHdfsThroughput: 117.48 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 103.125ms - RowBatchQueuePutWaitTime: 78.773ms - RowsRead: 760.00K (760000) - RowsReturned: 760.00K (760000) - RowsReturnedRate: 767.37 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 11 (11) - ScannerThreadsTotalWallClockTime: 542.758ms - MaterializeTupleTime(*): 38.465ms - ScannerThreadsSysTime: 10.998ms - ScannerThreadsUserTime: 43.993ms - ScannerThreadsVoluntaryContextSwitches: 478 (478) - TotalRawHdfsReadTime(*): 76.449ms - TotalReadThroughput: 5.99 MB/sec Filter 1 (1.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 760.00K (760000) Instance 7f40dcb034de70b7:209 (host=vd1131.foo:22000):(Total: 1s356ms, non-child: 143.099ms, % non-child: 10.55%) Hdfs split stats (:<# splits>/): 3:1/38.98 MB Filter 1 arrival: 1s216ms MemoryUsage(500.000ms): 1.30 MB, 1.30 MB, 21.12 MB ThreadUsage(500.000ms): 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 21.25 MB (22279418) - PerHostPeakMemUsage: 512.10 MB (536971596) - RowsProduced: 760.00K (760000) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 84.422ms - TotalStorageWaitTime: 93.713ms - TotalThreadsInvoluntaryContextSwitches: 40 (40) - TotalThreadsTotalWallClockTime: 2s376ms - TotalThreadsSysTime: 19.997ms - TotalThreadsUserTime: 194.970ms - TotalThreadsVoluntaryContextSwitches: 959 (959) Fragment Instance Lifecycle Timings: - ExecTime: 1s283ms - ExecTreeExecTime: 1s043ms - OpenTime: 22.829ms - ExecTreeOpenTime: 40.644us - PrepareTime: 49.759ms - ExecTreePrepareTime: 87.090us DataStreamSender (dst_id=25):(Total: 124.489ms, non-child: 124.489ms, % non-child: 100.00%) - BytesSent: 12.14 MB (12732329) - NetworkThroughput(*): 183.54 MB/sec - OverallThroughput: 97.54 MB/sec - PeakMemoryUsage: 4.95 MB (5192768) - RowsReturned: 760.00K (760000) - SerializeBatchTime: 57.377ms - TransmitDataRPCTime: 66.157ms - UncompressedRowBatchSize: 12.32 MB (12922680) CodeGen:(Total: 44.916ms, non-child: 44.916ms, % non-child: 100.00%) - CodegenTime: 763.516us - CompileTime: 5.741ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 15.957ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 22.849ms HDFS_SCAN_NODE (id=0):(Total: 1s043ms, non-child: 1s043ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:1/38.98 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: Only following filters arrived: , waited 944ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:3 BytesRead(500.000ms): 0, 0, 8.98 MB - FooterProcessingTime: (Avg: 7.618ms ; Min: 7.618ms ; Max: 7.618ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 8.98 MB (9417176) - BytesReadDataNodeCache: 0 - BytesReadLocal: 8.98 MB (9417176) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 8.98 MB (9417176) - DecompressionTime: 5.889ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 16.27 MB (17064533) - PerReadThreadRawHdfsThroughput: 121.54 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 96.876ms - RowBatchQueuePutWaitTime: 55.597ms - RowsRead: 760.00K (760000) - RowsReturned: 760.00K (760000) - RowsReturnedRate: 728.27 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 10 (10) - ScannerThreadsTotalWallClockTime: 1s070ms - MaterializeTupleTime(*): 33.962ms - ScannerThreadsSysTime: 2.999ms - ScannerThreadsUserTime: 44.993ms - ScannerThreadsVoluntaryContextSwitches: 504 (504) - TotalRawHdfsReadTime(*): 73.894ms - TotalReadThroughput: 5.99 MB/sec Filter 1 (1.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 760.00K (760000) Instance 7f40dcb034de70b7:24a (host=va1027.foo:22000):(Total: 1s354ms, non-child: 146.929ms, % non-child: 10.84%) Hdfs split stats (:<# splits>/): 1:1/38.99 MB Filter 1 arrival: 1s333ms MemoryUsage(500.000ms): 1.30 MB, 1.30 MB ThreadUsage(500.000ms): 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 21.24 MB (22272383) - PerHostPeakMemUsage: 480.71 MB (504062866) - RowsProduced: 760.00K (760000) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 90.133ms - TotalStorageWaitTime: 95.243ms - TotalThreadsInvoluntaryContextSwitches: 49 (49) - TotalThreadsTotalWallClockTime: 2s425ms - TotalThreadsSysTime: 27.996ms - TotalThreadsUserTime: 193.970ms - TotalThreadsVoluntaryContextSwitches: 964 (964) Fragment Instance Lifecycle Timings: - ExecTime: 1s296ms - ExecTreeExecTime: 1s044ms - OpenTime: 19.934ms - ExecTreeOpenTime: 23.905us - PrepareTime: 38.650ms - ExecTreePrepareTime: 57.672us DataStreamSender (dst_id=25):(Total: 130.013ms, non-child: 130.013ms, % non-child: 100.00%) - BytesSent: 12.14 MB (12732156) - NetworkThroughput(*): 184.27 MB/sec - OverallThroughput: 93.39 MB/sec - PeakMemoryUsage: 4.95 MB (5192768) - RowsReturned: 760.00K (760000) - SerializeBatchTime: 63.391ms - TransmitDataRPCTime: 65.893ms - UncompressedRowBatchSize: 12.32 MB (12922680) CodeGen:(Total: 33.298ms, non-child: 33.298ms, % non-child: 100.00%) - CodegenTime: 873.519us - CompileTime: 4.689ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 13.904ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 14.269ms HDFS_SCAN_NODE (id=0):(Total: 1s044ms, non-child: 1s044ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:1/38.99 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: Only following filters arrived: , waited 944ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:3 BytesRead(500.000ms): 0, 0 - FooterProcessingTime: (Avg: 8.504ms ; Min: 8.504ms ; Max: 8.504ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 8.98 MB (9416707) - BytesReadDataNodeCache: 0 - BytesReadLocal: 8.98 MB (9416707) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 8.98 MB (9416707) - DecompressionTime: 5.476ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 16.27 MB (17064893) - PerReadThreadRawHdfsThroughput: 121.14 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 97.035ms - RowBatchQueuePutWaitTime: 66.918ms - RowsRead: 760.00K (760000) - RowsReturned: 760.00K (760000) - RowsReturnedRate: 727.45 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 11 (11) - ScannerThreadsTotalWallClockTime: 1s109ms - MaterializeTupleTime(*): 34.155ms - ScannerThreadsSysTime: 4.999ms - ScannerThreadsUserTime: 41.993ms - ScannerThreadsVoluntaryContextSwitches: 515 (515) - TotalRawHdfsReadTime(*): 74.134ms - TotalReadThroughput: 0.00 /sec Filter 1 (1.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 760.00K (760000) Instance 7f40dcb034de70b7:20f (host=vc1502.foo:22000):(Total: 1s351ms, non-child: 125.011ms, % non-child: 9.25%) Hdfs split stats (:<# splits>/): 1:1/37.98 MB Filter 1 arrival: 1s242ms MemoryUsage(500.000ms): 1.30 MB, 1.30 MB, 2.72 MB ThreadUsage(500.000ms): 2, 2, 1 - AverageThreadTokens: 1.67 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 21.25 MB (22279749) - PerHostPeakMemUsage: 508.77 MB (533485101) - RowsProduced: 740.00K (740000) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 74.640ms - TotalStorageWaitTime: 101.413ms - TotalThreadsInvoluntaryContextSwitches: 35 (35) - TotalThreadsTotalWallClockTime: 2s414ms - TotalThreadsSysTime: 20.997ms - TotalThreadsUserTime: 187.971ms - TotalThreadsVoluntaryContextSwitches: 941 (941) Fragment Instance Lifecycle Timings: - ExecTime: 1s284ms - ExecTreeExecTime: 1s049ms - OpenTime: 20.400ms - ExecTreeOpenTime: 32.462us - PrepareTime: 46.073ms - ExecTreePrepareTime: 91.173us DataStreamSender (dst_id=25):(Total: 136.304ms, non-child: 136.304ms, % non-child: 100.00%) - BytesSent: 11.83 MB (12401065) - NetworkThroughput(*): 171.19 MB/sec - OverallThroughput: 86.77 MB/sec - PeakMemoryUsage: 4.95 MB (5192768) - RowsReturned: 740.00K (740000) - SerializeBatchTime: 66.371ms - TransmitDataRPCTime: 69.083ms - UncompressedRowBatchSize: 12.00 MB (12582680) CodeGen:(Total: 40.823ms, non-child: 40.823ms, % non-child: 100.00%) - CodegenTime: 696.274us - CompileTime: 6.167ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 13.195ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 21.108ms HDFS_SCAN_NODE (id=0):(Total: 1s049ms, non-child: 1s049ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:1/37.98 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: Only following filters arrived: , waited 943ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:3 BytesRead(500.000ms): 0, 0 - FooterProcessingTime: (Avg: 7.635ms ; Min: 7.635ms ; Max: 7.635ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 8.75 MB (9178025) - BytesReadDataNodeCache: 0 - BytesReadLocal: 8.75 MB (9178025) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 8.75 MB (9178025) - DecompressionTime: 5.215ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 16.27 MB (17064842) - PerReadThreadRawHdfsThroughput: 116.62 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 103.223ms - RowBatchQueuePutWaitTime: 84.190ms - RowsRead: 740.00K (740000) - RowsReturned: 740.00K (740000) - RowsReturnedRate: 705.21 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 6 (6) - ScannerThreadsTotalWallClockTime: 1s109ms - MaterializeTupleTime(*): 25.373ms - ScannerThreadsSysTime: 5.999ms - ScannerThreadsUserTime: 29.995ms - ScannerThreadsVoluntaryContextSwitches: 502 (502) - TotalRawHdfsReadTime(*): 75.055ms - TotalReadThroughput: 0.00 /sec Filter 1 (1.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 740.00K (740000) Instance 7f40dcb034de70b7:20d (host=va1035.foo:22000):(Total: 1s351ms, non-child: 146.671ms, % non-child: 10.86%) Hdfs split stats (:<# splits>/): 0:1/38.98 MB Filter 1 arrival: 1s326ms MemoryUsage(500.000ms): 1.30 MB, 1.30 MB, 19.93 MB ThreadUsage(500.000ms): 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 21.25 MB (22279807) - PerHostPeakMemUsage: 503.85 MB (528320790) - RowsProduced: 760.00K (760000) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 78.567ms - TotalStorageWaitTime: 99.349ms - TotalThreadsInvoluntaryContextSwitches: 43 (43) - TotalThreadsTotalWallClockTime: 2s395ms - TotalThreadsSysTime: 28.995ms - TotalThreadsUserTime: 203.969ms - TotalThreadsVoluntaryContextSwitches: 953 (953) Fragment Instance Lifecycle Timings: - ExecTime: 1s270ms - ExecTreeExecTime: 1s029ms - OpenTime: 23.677ms - ExecTreeOpenTime: 49.615us - PrepareTime: 56.596ms - ExecTreePrepareTime: 148.776us DataStreamSender (dst_id=25):(Total: 125.518ms, non-child: 125.518ms, % non-child: 100.00%) - BytesSent: 12.14 MB (12732195) - NetworkThroughput(*): 185.70 MB/sec - OverallThroughput: 96.74 MB/sec - PeakMemoryUsage: 4.95 MB (5192768) - RowsReturned: 760.00K (760000) - SerializeBatchTime: 57.798ms - TransmitDataRPCTime: 65.387ms - UncompressedRowBatchSize: 12.32 MB (12922680) CodeGen:(Total: 49.341ms, non-child: 49.341ms, % non-child: 100.00%) - CodegenTime: 1.591ms - CompileTime: 6.009ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 16.038ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 26.696ms HDFS_SCAN_NODE (id=0):(Total: 1s029ms, non-child: 1s029ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/38.98 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: Only following filters arrived: , waited 923ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:3 BytesRead(500.000ms): 0, 0, 8.98 MB - FooterProcessingTime: (Avg: 4.415ms ; Min: 4.415ms ; Max: 4.415ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 8.98 MB (9417501) - BytesReadDataNodeCache: 0 - BytesReadLocal: 8.98 MB (9417501) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 8.98 MB (9417501) - DecompressionTime: 6.778ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 16.27 MB (17064900) - PerReadThreadRawHdfsThroughput: 120.41 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 102.606ms - RowBatchQueuePutWaitTime: 63.611ms - RowsRead: 760.00K (760000) - RowsReturned: 760.00K (760000) - RowsReturnedRate: 738.18 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 14 (14) - ScannerThreadsTotalWallClockTime: 1s101ms - MaterializeTupleTime(*): 37.894ms - ScannerThreadsSysTime: 8.998ms - ScannerThreadsUserTime: 45.993ms - ScannerThreadsVoluntaryContextSwitches: 491 (491) - TotalRawHdfsReadTime(*): 74.589ms - TotalReadThroughput: 5.99 MB/sec Filter 1 (1.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 760.00K (760000) Instance 7f40dcb034de70b7:213 (host=vc1524.foo:22000):(Total: 1s349ms, non-child: 134.994ms, % non-child: 10.00%) Hdfs split stats (:<# splits>/): 7:1/38.98 MB Filter 1 arrival: 1s243ms MemoryUsage(500.000ms): 0, 1.30 MB, 1.30 MB ThreadUsage(500.000ms): 1, 2, 2 - AverageThreadTokens: 1.67 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 21.25 MB (22279658) - PerHostPeakMemUsage: 524.27 MB (549736291) - RowsProduced: 760.00K (760000) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 75.923ms - TotalStorageWaitTime: 93.126ms - TotalThreadsInvoluntaryContextSwitches: 44 (44) - TotalThreadsTotalWallClockTime: 2s427ms - TotalThreadsSysTime: 42.993ms - TotalThreadsUserTime: 188.971ms - TotalThreadsVoluntaryContextSwitches: 819 (819) Fragment Instance Lifecycle Timings: - ExecTime: 1s275ms - ExecTreeExecTime: 1s043ms - OpenTime: 24.255ms - ExecTreeOpenTime: 35.404us - PrepareTime: 49.534ms - ExecTreePrepareTime: 83.265us DataStreamSender (dst_id=25):(Total: 124.589ms, non-child: 124.589ms, % non-child: 100.00%) - BytesSent: 12.14 MB (12729972) - NetworkThroughput(*): 183.29 MB/sec - OverallThroughput: 97.44 MB/sec - PeakMemoryUsage: 4.95 MB (5192768) - RowsReturned: 760.00K (760000) - SerializeBatchTime: 57.313ms - TransmitDataRPCTime: 66.235ms - UncompressedRowBatchSize: 12.32 MB (12922680) CodeGen:(Total: 46.869ms, non-child: 46.869ms, % non-child: 100.00%) - CodegenTime: 1.580ms - CompileTime: 6.460ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 16.346ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 23.343ms HDFS_SCAN_NODE (id=0):(Total: 1s043ms, non-child: 1s043ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:1/38.98 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: Only following filters arrived: , waited 944ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:3 BytesRead(500.000ms): 0, 0, 0 - FooterProcessingTime: (Avg: 7.185ms ; Min: 7.185ms ; Max: 7.185ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 8.98 MB (9417609) - BytesReadDataNodeCache: 0 - BytesReadLocal: 8.98 MB (9417609) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 8.98 MB (9417609) - DecompressionTime: 6.497ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 16.27 MB (17064801) - PerReadThreadRawHdfsThroughput: 123.10 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 96.261ms - RowBatchQueuePutWaitTime: 44.436ms - RowsRead: 760.00K (760000) - RowsReturned: 760.00K (760000) - RowsReturnedRate: 728.52 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 12 (12) - ScannerThreadsTotalWallClockTime: 1s128ms - MaterializeTupleTime(*): 42.550ms - ScannerThreadsSysTime: 15.997ms - ScannerThreadsUserTime: 41.993ms - ScannerThreadsVoluntaryContextSwitches: 343 (343) - TotalRawHdfsReadTime(*): 72.959ms - TotalReadThroughput: 0.00 /sec Filter 1 (1.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 760.00K (760000) Instance 7f40dcb034de70b7:243 (host=vc1519.foo:22000):(Total: 1s335ms, non-child: 122.222ms, % non-child: 9.15%) Hdfs split stats (:<# splits>/): 2:1/38.97 MB Filter 1 arrival: 1s328ms MemoryUsage(500.000ms): 1.29 MB, 1.30 MB, 5.32 MB ThreadUsage(500.000ms): 1, 2, 2 - AverageThreadTokens: 1.67 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 21.24 MB (22271697) - PerHostPeakMemUsage: 519.39 MB (544621966) - RowsProduced: 760.00K (760000) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 69.094ms - TotalStorageWaitTime: 99.537ms - TotalThreadsInvoluntaryContextSwitches: 49 (49) - TotalThreadsTotalWallClockTime: 2s390ms - TotalThreadsSysTime: 22.996ms - TotalThreadsUserTime: 199.969ms - TotalThreadsVoluntaryContextSwitches: 699 (699) Fragment Instance Lifecycle Timings: - ExecTime: 1s249ms - ExecTreeExecTime: 1s030ms - OpenTime: 23.880ms - ExecTreeOpenTime: 39.539us - PrepareTime: 62.059ms - ExecTreePrepareTime: 99.088us DataStreamSender (dst_id=25):(Total: 122.487ms, non-child: 122.487ms, % non-child: 100.00%) - BytesSent: 12.15 MB (12736662) - NetworkThroughput(*): 187.25 MB/sec - OverallThroughput: 99.17 MB/sec - PeakMemoryUsage: 4.95 MB (5192768) - RowsReturned: 760.00K (760000) - SerializeBatchTime: 56.657ms - TransmitDataRPCTime: 64.869ms - UncompressedRowBatchSize: 12.32 MB (12922680) CodeGen:(Total: 59.943ms, non-child: 59.943ms, % non-child: 100.00%) - CodegenTime: 1.035ms - CompileTime: 6.220ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 16.138ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 37.134ms HDFS_SCAN_NODE (id=0):(Total: 1s030ms, non-child: 1s030ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:1/38.97 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: Only following filters arrived: , waited 924ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:3 BytesRead(500.000ms): 0, 0, 100.00 KB - FooterProcessingTime: (Avg: 14.243ms ; Min: 14.243ms ; Max: 14.243ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 8.98 MB (9417459) - BytesReadDataNodeCache: 0 - BytesReadLocal: 8.98 MB (9417459) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 8.98 MB (9417459) - DecompressionTime: 6.905ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 16.27 MB (17064965) - PerReadThreadRawHdfsThroughput: 128.31 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 103.317ms - RowBatchQueuePutWaitTime: 46.185ms - RowsRead: 760.00K (760000) - RowsReturned: 760.00K (760000) - RowsReturnedRate: 737.58 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 18 (18) - ScannerThreadsTotalWallClockTime: 1s117ms - MaterializeTupleTime(*): 40.456ms - ScannerThreadsSysTime: 7.998ms - ScannerThreadsUserTime: 47.992ms - ScannerThreadsVoluntaryContextSwitches: 270 (270) - TotalRawHdfsReadTime(*): 69.995ms - TotalReadThroughput: 66.67 KB/sec Filter 1 (1.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 760.00K (760000) Averaged Fragment F09:(Total: 607.597ms, non-child: 346.137ms, % non-child: 56.97%) split sizes: min: 6.82 MB, max: 14.38 MB, avg: 8.37 MB, stddev: 2.69 MB completion times: min:346.499ms max:1s337ms mean: 644.426ms stddev:85.205ms execution rates: min:5.37 MB/sec max:22.25 MB/sec mean:13.11 MB/sec stddev:4.10 MB/sec num instances: 113 - AverageThreadTokens: 1.41 - BloomFilterBytes: 0 - PeakMemoryUsage: 12.39 MB (12987338) - PerHostPeakMemUsage: 319.79 MB (335326311) - RowsProduced: 4.00K (3999) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 275.924ms - TotalStorageWaitTime: 151.544ms - TotalThreadsInvoluntaryContextSwitches: 30 (30) - TotalThreadsTotalWallClockTime: 779.055ms - TotalThreadsSysTime: 24.393ms - TotalThreadsUserTime: 91.985ms - TotalThreadsVoluntaryContextSwitches: 292 (292) Fragment Instance Lifecycle Timings: - ExecTime: 505.379ms - ExecTreeExecTime: 173.110ms - OpenTime: 50.933ms - ExecTreeOpenTime: 42.810us - PrepareTime: 51.233ms - ExecTreePrepareTime: 141.539us DataStreamSender (dst_id=26):(Total: 15.063ms, non-child: 15.063ms, % non-child: 100.00%) - BytesSent: 7.37 MB (7723615) - NetworkThroughput(*): 581.13 MB/sec - OverallThroughput: 507.97 MB/sec - PeakMemoryUsage: 816.56 KB (836160) - RowsReturned: 4.00K (3999) - SerializeBatchTime: 1.152ms - TransmitDataRPCTime: 13.351ms - UncompressedRowBatchSize: 19.04 MB (19960325) CodeGen:(Total: 72.929ms, non-child: 72.929ms, % non-child: 100.00%) - CodegenTime: 903.165us - CompileTime: 11.488ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 27 (27) - NumInstructions: 373 (373) - OptimizationTime: 37.980ms - PeakMemoryUsage: 186.50 KB (190976) - PrepareTime: 22.990ms HDFS_SCAN_NODE (id=1):(Total: 173.467ms, non-child: 173.467ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.08 - AverageScannerThreadConcurrency: 0.43 - BytesRead: 2.49 MB (2616104) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.49 MB (2616104) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 2.49 MB (2616104) - DecompressionTime: 2.673ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 8.89 MB (9319778) - PerReadThreadRawHdfsThroughput: 53.85 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 172.646ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 442.48K (442477) - RowsReturned: 4.00K (3999) - RowsReturnedRate: 28.00 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 7 (7) - ScannerThreadsTotalWallClockTime: 223.212ms - MaterializeTupleTime(*): 39.834ms - ScannerThreadsSysTime: 7.945ms - ScannerThreadsUserTime: 34.020ms - ScannerThreadsVoluntaryContextSwitches: 11 (11) - TotalRawHdfsReadTime(*): 49.341ms - TotalReadThroughput: 2.99 MB/sec Fragment F09: Instance 7f40dcb034de70b7:27b (host=vd1118.foo:22000):(Total: 1s129ms, non-child: 385.526ms, % non-child: 34.13%) Hdfs split stats (:<# splits>/): 4:1/7.19 MB MemoryUsage(500.000ms): 0, 830.06 KB ThreadUsage(500.000ms): 1, 2 - AverageThreadTokens: 1.50 - BloomFilterBytes: 0 - PeakMemoryUsage: 11.04 MB (11574212) - PerHostPeakMemUsage: 479.96 MB (503272574) - RowsProduced: 3.43K (3427) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 23.870ms - TotalStorageWaitTime: 233.882ms - TotalThreadsInvoluntaryContextSwitches: 45 (45) - TotalThreadsTotalWallClockTime: 1s338ms - TotalThreadsSysTime: 29.994ms - TotalThreadsUserTime: 119.981ms - TotalThreadsVoluntaryContextSwitches: 330 (330) Fragment Instance Lifecycle Timings: - ExecTime: 641.614ms - ExecTreeExecTime: 586.093ms - OpenTime: 95.458ms - ExecTreeOpenTime: 411.641us - PrepareTime: 392.475ms - ExecTreePrepareTime: 552.507us DataStreamSender (dst_id=26):(Total: 20.425ms, non-child: 20.425ms, % non-child: 100.00%) - BytesSent: 6.30 MB (6600840) - NetworkThroughput(*): 776.08 MB/sec - OverallThroughput: 308.19 MB/sec - PeakMemoryUsage: 816.56 KB (836160) - RowsReturned: 3.43K (3427) - SerializeBatchTime: 978.443us - TransmitDataRPCTime: 8.111ms - UncompressedRowBatchSize: 16.30 MB (17095854) CodeGen:(Total: 136.005ms, non-child: 136.005ms, % non-child: 100.00%) - CodegenTime: 1.408ms - CompileTime: 25.335ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 27 (27) - NumInstructions: 373 (373) - OptimizationTime: 65.025ms - PeakMemoryUsage: 186.50 KB (190976) - PrepareTime: 44.917ms HDFS_SCAN_NODE (id=1):(Total: 587.627ms, non-child: 587.627ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:1/7.19 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:2 BytesRead(500.000ms): 0, 0 - FooterProcessingTime: (Avg: 155.563ms ; Min: 155.563ms ; Max: 155.563ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 2.14 MB (2244577) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.14 MB (2244577) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 2.14 MB (2244577) - DecompressionTime: 1.976ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 7.43 MB (7795580) - PerReadThreadRawHdfsThroughput: 41.75 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 584.456ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 380.00K (380000) - RowsReturned: 3.43K (3427) - RowsReturnedRate: 5.83 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 15 (15) - ScannerThreadsTotalWallClockTime: 603.152ms - MaterializeTupleTime(*): 41.021ms - ScannerThreadsSysTime: 8.998ms - ScannerThreadsUserTime: 34.994ms - ScannerThreadsVoluntaryContextSwitches: 12 (12) - TotalRawHdfsReadTime(*): 51.267ms - TotalReadThroughput: 0.00 /sec Instance 7f40dcb034de70b7:278 (host=vc1533.foo:22000):(Total: 715.269ms, non-child: 41.431ms, % non-child: 5.79%) Hdfs split stats (:<# splits>/): 6:1/7.19 MB MemoryUsage(500.000ms): 966.06 KB ThreadUsage(500.000ms): 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 8.03 MB (8422198) - PerHostPeakMemUsage: 374.57 MB (392761846) - RowsProduced: 3.42K (3423) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 391.471us - TotalStorageWaitTime: 569.907ms - TotalThreadsInvoluntaryContextSwitches: 20 (20) - TotalThreadsTotalWallClockTime: 1s278ms - TotalThreadsSysTime: 17.997ms - TotalThreadsUserTime: 78.988ms - TotalThreadsVoluntaryContextSwitches: 288 (288) Fragment Instance Lifecycle Timings: - ExecTime: 627.880ms - ExecTreeExecTime: 600.245ms - OpenTime: 41.844ms - ExecTreeOpenTime: 29.983us - PrepareTime: 45.504ms - ExecTreePrepareTime: 140.754us DataStreamSender (dst_id=26):(Total: 8.505ms, non-child: 8.505ms, % non-child: 100.00%) - BytesSent: 6.33 MB (6637556) - NetworkThroughput(*): 903.58 MB/sec - OverallThroughput: 744.26 MB/sec - PeakMemoryUsage: 816.56 KB (836160) - RowsReturned: 3.42K (3423) - SerializeBatchTime: 1.086ms - TransmitDataRPCTime: 7.005ms - UncompressedRowBatchSize: 16.30 MB (17087144) CodeGen:(Total: 64.714ms, non-child: 64.714ms, % non-child: 100.00%) - CodegenTime: 679.798us - CompileTime: 9.897ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 27 (27) - NumInstructions: 373 (373) - OptimizationTime: 30.762ms - PeakMemoryUsage: 186.50 KB (190976) - PrepareTime: 23.722ms HDFS_SCAN_NODE (id=1):(Total: 600.617ms, non-child: 600.617ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 6:1/7.19 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:2 BytesRead(500.000ms): 0 - FooterProcessingTime: (Avg: 500.790ms ; Min: 500.790ms ; Max: 500.790ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 2.14 MB (2244534) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.14 MB (2244534) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 2.14 MB (2244534) - DecompressionTime: 1.276ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 6.51 MB (6829313) - PerReadThreadRawHdfsThroughput: 61.39 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 599.807ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 380.00K (380000) - RowsReturned: 3.42K (3423) - RowsReturnedRate: 5.70 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 7 (7) - ScannerThreadsTotalWallClockTime: 608.629ms - MaterializeTupleTime(*): 35.444ms - ScannerThreadsSysTime: 5.999ms - ScannerThreadsUserTime: 31.995ms - ScannerThreadsVoluntaryContextSwitches: 10 (10) - TotalRawHdfsReadTime(*): 34.868ms - TotalReadThroughput: 0.00 /sec Instance 7f40dcb034de70b7:2c9 (host=vd1110.foo:22000):(Total: 666.839ms, non-child: 48.657ms, % non-child: 7.30%) Hdfs split stats (:<# splits>/): 0:1/7.37 MB MemoryUsage(500.000ms): 3.07 MB ThreadUsage(500.000ms): 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 8.20 MB (8594230) - PerHostPeakMemUsage: 382.29 MB (400860947) - RowsProduced: 3.56K (3558) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 236.036us - TotalStorageWaitTime: 429.468ms - TotalThreadsInvoluntaryContextSwitches: 24 (24) - TotalThreadsTotalWallClockTime: 1s161ms - TotalThreadsSysTime: 16.997ms - TotalThreadsUserTime: 87.986ms - TotalThreadsVoluntaryContextSwitches: 298 (298) Fragment Instance Lifecycle Timings: - ExecTime: 568.564ms - ExecTreeExecTime: 537.150ms - OpenTime: 46.057ms - ExecTreeOpenTime: 40.866us - PrepareTime: 52.171ms - ExecTreePrepareTime: 148.726us DataStreamSender (dst_id=26):(Total: 11.269ms, non-child: 11.269ms, % non-child: 100.00%) - BytesSent: 6.53 MB (6842844) - NetworkThroughput(*): 705.80 MB/sec - OverallThroughput: 579.05 MB/sec - PeakMemoryUsage: 816.56 KB (836160) - RowsReturned: 3.56K (3558) - SerializeBatchTime: 1.043ms - TransmitDataRPCTime: 9.245ms - UncompressedRowBatchSize: 16.93 MB (17753392) CodeGen:(Total: 69.388ms, non-child: 69.388ms, % non-child: 100.00%) - CodegenTime: 866.559us - CompileTime: 9.520ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 27 (27) - NumInstructions: 373 (373) - OptimizationTime: 35.466ms - PeakMemoryUsage: 186.50 KB (190976) - PrepareTime: 23.980ms HDFS_SCAN_NODE (id=1):(Total: 537.524ms, non-child: 537.524ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/7.37 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:2 BytesRead(500.000ms): 1.66 MB - FooterProcessingTime: (Avg: 144.100ms ; Min: 144.100ms ; Max: 144.100ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 2.19 MB (2298294) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.19 MB (2298294) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 2.19 MB (2298294) - DecompressionTime: 1.137ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 6.51 MB (6829804) - PerReadThreadRawHdfsThroughput: 55.95 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 536.710ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 390.00K (390000) - RowsReturned: 3.56K (3558) - RowsReturnedRate: 6.62 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 11 (11) - ScannerThreadsTotalWallClockTime: 547.453ms - MaterializeTupleTime(*): 37.979ms - ScannerThreadsSysTime: 1.999ms - ScannerThreadsUserTime: 36.994ms - ScannerThreadsVoluntaryContextSwitches: 7 (7) - TotalRawHdfsReadTime(*): 39.174ms - TotalReadThroughput: 3.33 MB/sec Instance 7f40dcb034de70b7:2b6 (host=va1036.foo:22000):(Total: 653.065ms, non-child: 55.537ms, % non-child: 8.50%) Hdfs split stats (:<# splits>/): 7:1/6.82 MB MemoryUsage(500.000ms): 966.06 KB ThreadUsage(500.000ms): 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 8.96 MB (9398795) - PerHostPeakMemUsage: 261.51 MB (274217697) - RowsProduced: 3.29K (3287) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 5.014ms - TotalStorageWaitTime: 365.687ms - TotalThreadsInvoluntaryContextSwitches: 29 (29) - TotalThreadsTotalWallClockTime: 1s114ms - TotalThreadsSysTime: 28.995ms - TotalThreadsUserTime: 101.984ms - TotalThreadsVoluntaryContextSwitches: 315 (315) Fragment Instance Lifecycle Timings: - ExecTime: 539.357ms - ExecTreeExecTime: 496.286ms - OpenTime: 61.071ms - ExecTreeOpenTime: 43.912us - PrepareTime: 52.594ms - ExecTreePrepareTime: 185.180us DataStreamSender (dst_id=26):(Total: 17.459ms, non-child: 17.459ms, % non-child: 100.00%) - BytesSent: 6.07 MB (6362588) - NetworkThroughput(*): 376.77 MB/sec - OverallThroughput: 347.54 MB/sec - PeakMemoryUsage: 816.56 KB (836160) - RowsReturned: 3.29K (3287) - SerializeBatchTime: 904.004us - TransmitDataRPCTime: 16.104ms - UncompressedRowBatchSize: 15.64 MB (16401868) CodeGen:(Total: 83.318ms, non-child: 83.318ms, % non-child: 100.00%) - CodegenTime: 1.162ms - CompileTime: 12.148ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 27 (27) - NumInstructions: 373 (373) - OptimizationTime: 44.064ms - PeakMemoryUsage: 186.50 KB (190976) - PrepareTime: 26.479ms HDFS_SCAN_NODE (id=1):(Total: 496.749ms, non-child: 496.749ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:1/6.82 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:0% 1:100% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:2 BytesRead(500.000ms): 0 - FooterProcessingTime: (Avg: 79.405ms ; Min: 79.405ms ; Max: 79.405ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 1.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 2.04 MB (2136902) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.04 MB (2136902) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 2.04 MB (2136902) - DecompressionTime: 2.405ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 5.97 MB (6262017) - PerReadThreadRawHdfsThroughput: 7.64 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 495.835ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 360.00K (360000) - RowsReturned: 3.29K (3287) - RowsReturnedRate: 6.62 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 6 (6) - ScannerThreadsTotalWallClockTime: 517.378ms - MaterializeTupleTime(*): 43.035ms - ScannerThreadsSysTime: 11.998ms - ScannerThreadsUserTime: 36.994ms - ScannerThreadsVoluntaryContextSwitches: 18 (18) - TotalRawHdfsReadTime(*): 266.655ms - TotalReadThroughput: 0.00 /sec Instance 7f40dcb034de70b7:2c8 (host=vd1111.foo:22000):(Total: 637.022ms, non-child: 51.242ms, % non-child: 8.04%) Hdfs split stats (:<# splits>/): 1:1/7.00 MB MemoryUsage(500.000ms): 966.06 KB ThreadUsage(500.000ms): 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 8.83 MB (9262377) - PerHostPeakMemUsage: 382.23 MB (400801404) - RowsProduced: 3.38K (3378) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 212.862us - TotalStorageWaitTime: 399.391ms - TotalThreadsInvoluntaryContextSwitches: 28 (28) - TotalThreadsTotalWallClockTime: 1s096ms - TotalThreadsSysTime: 13.997ms - TotalThreadsUserTime: 99.984ms - TotalThreadsVoluntaryContextSwitches: 301 (301) Fragment Instance Lifecycle Timings: - ExecTime: 528.530ms - ExecTreeExecTime: 490.235ms - OpenTime: 63.827ms - ExecTreeOpenTime: 50.731us - PrepareTime: 44.628ms - ExecTreePrepareTime: 173.698us DataStreamSender (dst_id=26):(Total: 13.278ms, non-child: 13.278ms, % non-child: 100.00%) - BytesSent: 6.24 MB (6548044) - NetworkThroughput(*): 527.28 MB/sec - OverallThroughput: 470.29 MB/sec - PeakMemoryUsage: 816.56 KB (836160) - RowsReturned: 3.38K (3378) - SerializeBatchTime: 1.085ms - TransmitDataRPCTime: 11.843ms - UncompressedRowBatchSize: 16.08 MB (16864034) CodeGen:(Total: 81.844ms, non-child: 81.844ms, % non-child: 100.00%) - CodegenTime: 952.130us - CompileTime: 13.147ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 27 (27) - NumInstructions: 373 (373) - OptimizationTime: 49.074ms - PeakMemoryUsage: 186.50 KB (190976) - PrepareTime: 19.128ms HDFS_SCAN_NODE (id=1):(Total: 490.656ms, non-child: 490.656ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:1/7.00 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:2 BytesRead(500.000ms): 0 - FooterProcessingTime: (Avg: 121.657ms ; Min: 121.657ms ; Max: 121.657ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 2.09 MB (2190722) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.09 MB (2190722) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 2.09 MB (2190722) - DecompressionTime: 1.844ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 6.51 MB (6829313) - PerReadThreadRawHdfsThroughput: 50.33 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 489.879ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 370.00K (370000) - RowsReturned: 3.38K (3378) - RowsReturnedRate: 6.88 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 6 (6) - ScannerThreadsTotalWallClockTime: 504.272ms - MaterializeTupleTime(*): 29.906ms - ScannerThreadsSysTime: 5.999ms - ScannerThreadsUserTime: 26.995ms - ScannerThreadsVoluntaryContextSwitches: 32 (32) - TotalRawHdfsReadTime(*): 41.512ms - TotalReadThroughput: 0.00 /sec Instance 7f40dcb034de70b7:27e (host=vd1138.foo:22000):(Total: 635.801ms, non-child: 312.351ms, % non-child: 49.13%) Hdfs split stats (:<# splits>/): 3:1/7.19 MB 1:1/7.00 MB MemoryUsage(500.000ms): 16.96 MB ThreadUsage(500.000ms): 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 18.76 MB (19669928) - PerHostPeakMemUsage: 367.76 MB (385622521) - RowsProduced: 6.81K (6813) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 264.309ms - TotalStorageWaitTime: 276.752ms - TotalThreadsInvoluntaryContextSwitches: 52 (52) - TotalThreadsTotalWallClockTime: 1s114ms - TotalThreadsSysTime: 33.993ms - TotalThreadsUserTime: 121.981ms - TotalThreadsVoluntaryContextSwitches: 303 (303) Fragment Instance Lifecycle Timings: - ExecTime: 535.411ms - ExecTreeExecTime: 227.381ms - OpenTime: 52.089ms - ExecTreeOpenTime: 37.401us - PrepareTime: 48.252ms - ExecTreePrepareTime: 138.559us DataStreamSender (dst_id=26):(Total: 19.647ms, non-child: 19.647ms, % non-child: 100.00%) - BytesSent: 12.54 MB (13153306) - NetworkThroughput(*): 730.87 MB/sec - OverallThroughput: 638.47 MB/sec - PeakMemoryUsage: 816.56 KB (836160) - RowsReturned: 6.81K (6813) - SerializeBatchTime: 2.078ms - TransmitDataRPCTime: 17.163ms - UncompressedRowBatchSize: 32.44 MB (34015230) CodeGen:(Total: 76.101ms, non-child: 76.101ms, % non-child: 100.00%) - CodegenTime: 784.283us - CompileTime: 12.453ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 27 (27) - NumInstructions: 373 (373) - OptimizationTime: 38.392ms - PeakMemoryUsage: 186.50 KB (190976) - PrepareTime: 24.737ms HDFS_SCAN_NODE (id=1):(Total: 227.701ms, non-child: 227.701ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:1/7.19 MB 1:1/7.00 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 2 out of 2 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:4 BytesRead(500.000ms): 4.23 MB - FooterProcessingTime: (Avg: 91.511ms ; Min: 89.908ms ; Max: 93.115ms ; Number of samples: 2) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 4.23 MB (4435402) - BytesReadDataNodeCache: 0 - BytesReadLocal: 4.23 MB (4435402) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 4.23 MB (4435402) - DecompressionTime: 2.896ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 2 (2) - NumRowGroups: 2 (2) - NumScannerThreadsStarted: 2 (2) - PeakMemoryUsage: 15.16 MB (15891296) - PerReadThreadRawHdfsThroughput: 55.05 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 226.456ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 750.00K (750000) - RowsReturned: 6.81K (6813) - RowsReturnedRate: 29.92 K/sec - ScanRangesComplete: 2 (2) - ScannerThreadsInvoluntaryContextSwitches: 27 (27) - ScannerThreadsTotalWallClockTime: 527.155ms - MaterializeTupleTime(*): 68.622ms - ScannerThreadsSysTime: 10.997ms - ScannerThreadsUserTime: 61.990ms - ScannerThreadsVoluntaryContextSwitches: 20 (20) - TotalRawHdfsReadTime(*): 76.835ms - TotalReadThroughput: 8.46 MB/sec Instance 7f40dcb034de70b7:297 (host=vc1509.foo:22000):(Total: 634.163ms, non-child: 441.966ms, % non-child: 69.69%) Hdfs split stats (:<# splits>/): 5:1/7.01 MB MemoryUsage(500.000ms): 2.85 MB ThreadUsage(500.000ms): 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 10.84 MB (11369122) - PerHostPeakMemUsage: 372.39 MB (390478107) - RowsProduced: 3.37K (3374) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 365.363ms - TotalStorageWaitTime: 104.221ms - TotalThreadsInvoluntaryContextSwitches: 20 (20) - TotalThreadsTotalWallClockTime: 720.504ms - TotalThreadsSysTime: 22.996ms - TotalThreadsUserTime: 69.989ms - TotalThreadsVoluntaryContextSwitches: 303 (303) Fragment Instance Lifecycle Timings: - ExecTime: 547.812ms - ExecTreeExecTime: 117.281ms - OpenTime: 43.505ms - ExecTreeOpenTime: 34.249us - PrepareTime: 42.803ms - ExecTreePrepareTime: 133.254us DataStreamSender (dst_id=26):(Total: 11.624ms, non-child: 11.624ms, % non-child: 100.00%) - BytesSent: 6.20 MB (6501948) - NetworkThroughput(*): 584.45 MB/sec - OverallThroughput: 533.43 MB/sec - PeakMemoryUsage: 816.56 KB (836160) - RowsReturned: 3.37K (3374) - SerializeBatchTime: 534.761us - TransmitDataRPCTime: 10.609ms - UncompressedRowBatchSize: 16.06 MB (16841522) CodeGen:(Total: 62.945ms, non-child: 62.945ms, % non-child: 100.00%) - CodegenTime: 671.159us - CompileTime: 9.983ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 27 (27) - NumInstructions: 373 (373) - OptimizationTime: 32.465ms - PeakMemoryUsage: 186.50 KB (190976) - PrepareTime: 20.137ms HDFS_SCAN_NODE (id=1):(Total: 117.626ms, non-child: 117.626ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:1/7.01 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:0% 1:100% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:2 BytesRead(500.000ms): 100.00 KB - FooterProcessingTime: (Avg: 44.551ms ; Min: 44.551ms ; Max: 44.551ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 1.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 2.09 MB (2190682) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.09 MB (2190682) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 2.09 MB (2190682) - DecompressionTime: 2.278ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 7.16 MB (7504474) - PerReadThreadRawHdfsThroughput: 54.11 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 116.969ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 370.00K (370000) - RowsReturned: 3.37K (3374) - RowsReturnedRate: 28.68 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 5 (5) - ScannerThreadsTotalWallClockTime: 129.479ms - MaterializeTupleTime(*): 21.436ms - ScannerThreadsSysTime: 2.999ms - ScannerThreadsUserTime: 19.996ms - ScannerThreadsVoluntaryContextSwitches: 9 (9) - TotalRawHdfsReadTime(*): 38.611ms - TotalReadThroughput: 200.00 KB/sec Instance 7f40dcb034de70b7:27d (host=vd1108.foo:22000):(Total: 631.617ms, non-child: 376.687ms, % non-child: 59.64%) Hdfs split stats (:<# splits>/): 4:1/7.19 MB 3:1/7.19 MB MemoryUsage(500.000ms): 15.35 MB ThreadUsage(500.000ms): 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 21.70 MB (22754208) - PerHostPeakMemUsage: 371.90 MB (389962984) - RowsProduced: 6.93K (6927) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 333.403ms - TotalStorageWaitTime: 326.761ms - TotalThreadsInvoluntaryContextSwitches: 27 (27) - TotalThreadsTotalWallClockTime: 1s010ms - TotalThreadsSysTime: 32.993ms - TotalThreadsUserTime: 121.981ms - TotalThreadsVoluntaryContextSwitches: 290 (290) Fragment Instance Lifecycle Timings: - ExecTime: 557.442ms - ExecTreeExecTime: 181.057ms - OpenTime: 42.661ms - ExecTreeOpenTime: 30.729us - PrepareTime: 31.457ms - ExecTreePrepareTime: 74.799us DataStreamSender (dst_id=26):(Total: 18.428ms, non-child: 18.428ms, % non-child: 100.00%) - BytesSent: 12.72 MB (13338628) - NetworkThroughput(*): 785.16 MB/sec - OverallThroughput: 690.26 MB/sec - PeakMemoryUsage: 816.56 KB (836160) - RowsReturned: 6.93K (6927) - SerializeBatchTime: 1.936ms - TransmitDataRPCTime: 16.201ms - UncompressedRowBatchSize: 32.96 MB (34566104) CodeGen:(Total: 55.263ms, non-child: 55.263ms, % non-child: 100.00%) - CodegenTime: 637.278us - CompileTime: 10.762ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 27 (27) - NumInstructions: 373 (373) - OptimizationTime: 30.735ms - PeakMemoryUsage: 186.50 KB (190976) - PrepareTime: 13.405ms HDFS_SCAN_NODE (id=1):(Total: 181.237ms, non-child: 181.237ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:1/7.19 MB 3:1/7.19 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 2 out of 2 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:4 BytesRead(500.000ms): 4.28 MB - FooterProcessingTime: (Avg: 36.187ms ; Min: 34.312ms ; Max: 38.062ms ; Number of samples: 2) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 4.28 MB (4489027) - BytesReadDataNodeCache: 0 - BytesReadLocal: 4.28 MB (4489027) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 4.28 MB (4489027) - DecompressionTime: 5.256ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 2 (2) - NumRowGroups: 2 (2) - NumScannerThreadsStarted: 2 (2) - PeakMemoryUsage: 18.11 MB (18984590) - PerReadThreadRawHdfsThroughput: 47.33 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 180.336ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 760.00K (760000) - RowsReturned: 6.93K (6927) - RowsReturnedRate: 38.22 K/sec - ScanRangesComplete: 2 (2) - ScannerThreadsInvoluntaryContextSwitches: 11 (11) - ScannerThreadsTotalWallClockTime: 410.614ms - MaterializeTupleTime(*): 74.924ms - ScannerThreadsSysTime: 15.996ms - ScannerThreadsUserTime: 64.989ms - ScannerThreadsVoluntaryContextSwitches: 13 (13) - TotalRawHdfsReadTime(*): 90.447ms - TotalReadThroughput: 8.56 MB/sec Instance 7f40dcb034de70b7:282 (host=vd1336.foo:22000):(Total: 628.752ms, non-child: 335.534ms, % non-child: 53.37%) Hdfs split stats (:<# splits>/): 4:1/7.00 MB 1:1/7.00 MB MemoryUsage(500.000ms): 14.64 MB ThreadUsage(500.000ms): 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 20.57 MB (21571042) - PerHostPeakMemUsage: 364.09 MB (381775442) - RowsProduced: 6.66K (6657) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 283.419ms - TotalStorageWaitTime: 304.005ms - TotalThreadsInvoluntaryContextSwitches: 42 (42) - TotalThreadsTotalWallClockTime: 1s034ms - TotalThreadsSysTime: 33.994ms - TotalThreadsUserTime: 122.981ms - TotalThreadsVoluntaryContextSwitches: 291 (291) Fragment Instance Lifecycle Timings: - ExecTime: 526.505ms - ExecTreeExecTime: 197.992ms - OpenTime: 54.735ms - ExecTreeOpenTime: 33.695us - PrepareTime: 47.406ms - ExecTreePrepareTime: 258.661us DataStreamSender (dst_id=26):(Total: 18.574ms, non-child: 18.574ms, % non-child: 100.00%) - BytesSent: 12.31 MB (12907282) - NetworkThroughput(*): 759.93 MB/sec - OverallThroughput: 662.69 MB/sec - PeakMemoryUsage: 816.56 KB (836160) - RowsReturned: 6.66K (6657) - SerializeBatchTime: 1.915ms - TransmitDataRPCTime: 16.198ms - UncompressedRowBatchSize: 31.69 MB (33233742) CodeGen:(Total: 76.067ms, non-child: 76.067ms, % non-child: 100.00%) - CodegenTime: 1.163ms - CompileTime: 12.934ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 27 (27) - NumInstructions: 373 (373) - OptimizationTime: 40.628ms - PeakMemoryUsage: 186.50 KB (190976) - PrepareTime: 21.964ms HDFS_SCAN_NODE (id=1):(Total: 198.575ms, non-child: 198.575ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:1/7.00 MB 1:1/7.00 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 2 out of 2 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:4 BytesRead(500.000ms): 4.18 MB - FooterProcessingTime: (Avg: 65.833ms ; Min: 57.331ms ; Max: 74.334ms ; Number of samples: 2) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 4.18 MB (4381521) - BytesReadDataNodeCache: 0 - BytesReadLocal: 4.18 MB (4381521) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 4.18 MB (4381521) - DecompressionTime: 3.309ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 2 (2) - NumRowGroups: 2 (2) - NumScannerThreadsStarted: 2 (2) - PeakMemoryUsage: 16.85 MB (17663386) - PerReadThreadRawHdfsThroughput: 45.41 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 197.277ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 740.00K (740000) - RowsReturned: 6.66K (6657) - RowsReturnedRate: 33.52 K/sec - ScanRangesComplete: 2 (2) - ScannerThreadsInvoluntaryContextSwitches: 11 (11) - ScannerThreadsTotalWallClockTime: 453.303ms - MaterializeTupleTime(*): 68.319ms - ScannerThreadsSysTime: 11.997ms - ScannerThreadsUserTime: 60.990ms - ScannerThreadsVoluntaryContextSwitches: 11 (11) - TotalRawHdfsReadTime(*): 92.021ms - TotalReadThroughput: 8.36 MB/sec Instance 7f40dcb034de70b7:296 (host=vc1521.foo:22000):(Total: 628.075ms, non-child: 429.188ms, % non-child: 68.33%) Hdfs split stats (:<# splits>/): 6:1/7.00 MB 7:1/7.00 MB MemoryUsage(500.000ms): 14.79 MB ThreadUsage(500.000ms): 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 21.30 MB (22334078) - PerHostPeakMemUsage: 371.40 MB (389438785) - RowsProduced: 6.62K (6615) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 375.551ms - TotalStorageWaitTime: 205.389ms - TotalThreadsInvoluntaryContextSwitches: 41 (41) - TotalThreadsTotalWallClockTime: 870.335ms - TotalThreadsSysTime: 32.993ms - TotalThreadsUserTime: 114.982ms - TotalThreadsVoluntaryContextSwitches: 318 (318) Fragment Instance Lifecycle Timings: - ExecTime: 545.637ms - ExecTreeExecTime: 119.156ms - OpenTime: 49.103ms - ExecTreeOpenTime: 87.055us - PrepareTime: 33.309ms - ExecTreePrepareTime: 96.974us DataStreamSender (dst_id=26):(Total: 16.910ms, non-child: 16.910ms, % non-child: 100.00%) - BytesSent: 12.13 MB (12718744) - NetworkThroughput(*): 830.01 MB/sec - OverallThroughput: 717.30 MB/sec - PeakMemoryUsage: 816.56 KB (836160) - RowsReturned: 6.62K (6615) - SerializeBatchTime: 1.916ms - TransmitDataRPCTime: 14.613ms - UncompressedRowBatchSize: 31.48 MB (33012374) CodeGen:(Total: 62.525ms, non-child: 62.525ms, % non-child: 100.00%) - CodegenTime: 803.544us - CompileTime: 11.489ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 27 (27) - NumInstructions: 373 (373) - OptimizationTime: 36.506ms - PeakMemoryUsage: 186.50 KB (190976) - PrepareTime: 14.043ms HDFS_SCAN_NODE (id=1):(Total: 119.451ms, non-child: 119.451ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 6:1/7.00 MB 7:1/7.00 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 2 out of 2 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:4 BytesRead(500.000ms): 4.18 MB - FooterProcessingTime: (Avg: 45.455ms ; Min: 42.992ms ; Max: 47.918ms ; Number of samples: 2) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 4.18 MB (4381463) - BytesReadDataNodeCache: 0 - BytesReadLocal: 4.18 MB (4381463) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 4.18 MB (4381463) - DecompressionTime: 4.279ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 2 (2) - NumRowGroups: 2 (2) - NumScannerThreadsStarted: 2 (2) - PeakMemoryUsage: 17.70 MB (18564460) - PerReadThreadRawHdfsThroughput: 48.60 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 118.608ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 740.00K (740000) - RowsReturned: 6.62K (6615) - RowsReturnedRate: 55.38 K/sec - ScanRangesComplete: 2 (2) - ScannerThreadsInvoluntaryContextSwitches: 12 (12) - ScannerThreadsTotalWallClockTime: 275.894ms - MaterializeTupleTime(*): 62.533ms - ScannerThreadsSysTime: 11.997ms - ScannerThreadsUserTime: 54.991ms - ScannerThreadsVoluntaryContextSwitches: 21 (21) - TotalRawHdfsReadTime(*): 85.982ms - TotalReadThroughput: 8.36 MB/sec Instance 7f40dcb034de70b7:27a (host=vd1332.foo:22000):(Total: 627.028ms, non-child: 436.334ms, % non-child: 69.59%) Hdfs split stats (:<# splits>/): 5:1/7.00 MB 6:1/6.82 MB MemoryUsage(500.000ms): 12.68 MB ThreadUsage(500.000ms): 3 - AverageThreadTokens: 3.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 17.47 MB (18318275) - PerHostPeakMemUsage: 354.79 MB (372023248) - RowsProduced: 6.62K (6625) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 381.290ms - TotalStorageWaitTime: 161.967ms - TotalThreadsInvoluntaryContextSwitches: 38 (38) - TotalThreadsTotalWallClockTime: 815.833ms - TotalThreadsSysTime: 31.994ms - TotalThreadsUserTime: 115.981ms - TotalThreadsVoluntaryContextSwitches: 312 (312) Fragment Instance Lifecycle Timings: - ExecTime: 529.528ms - ExecTreeExecTime: 98.683ms - OpenTime: 48.863ms - ExecTreeOpenTime: 59.578us - PrepareTime: 48.585ms - ExecTreePrepareTime: 123.943us DataStreamSender (dst_id=26):(Total: 18.225ms, non-child: 18.225ms, % non-child: 100.00%) - BytesSent: 12.23 MB (12824470) - NetworkThroughput(*): 778.30 MB/sec - OverallThroughput: 671.07 MB/sec - PeakMemoryUsage: 816.56 KB (836160) - RowsReturned: 6.62K (6625) - SerializeBatchTime: 2.100ms - TransmitDataRPCTime: 15.714ms - UncompressedRowBatchSize: 31.53 MB (33057666) CodeGen:(Total: 73.465ms, non-child: 73.465ms, % non-child: 100.00%) - CodegenTime: 842.872us - CompileTime: 11.777ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 27 (27) - NumInstructions: 373 (373) - OptimizationTime: 36.052ms - PeakMemoryUsage: 186.50 KB (190976) - PrepareTime: 25.192ms HDFS_SCAN_NODE (id=1):(Total: 99.003ms, non-child: 99.003ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:1/7.00 MB 6:1/6.82 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 2 out of 2 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:4 BytesRead(500.000ms): 4.13 MB - FooterProcessingTime: (Avg: 45.144ms ; Min: 41.514ms ; Max: 48.775ms ; Number of samples: 2) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 2.00 - BytesRead: 4.13 MB (4327818) - BytesReadDataNodeCache: 0 - BytesReadLocal: 4.13 MB (4327818) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 4.13 MB (4327818) - DecompressionTime: 4.377ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 2 (2) - NumRowGroups: 2 (2) - NumScannerThreadsStarted: 2 (2) - PeakMemoryUsage: 14.04 MB (14720689) - PerReadThreadRawHdfsThroughput: 62.16 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 98.035ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 730.00K (730000) - RowsReturned: 6.62K (6625) - RowsReturnedRate: 66.92 K/sec - ScanRangesComplete: 2 (2) - ScannerThreadsInvoluntaryContextSwitches: 13 (13) - ScannerThreadsTotalWallClockTime: 237.661ms - MaterializeTupleTime(*): 67.979ms - ScannerThreadsSysTime: 6.998ms - ScannerThreadsUserTime: 62.989ms - ScannerThreadsVoluntaryContextSwitches: 22 (22) - TotalRawHdfsReadTime(*): 66.398ms - TotalReadThroughput: 8.25 MB/sec Instance 7f40dcb034de70b7:283 (host=va1030.foo:22000):(Total: 626.641ms, non-child: 417.894ms, % non-child: 66.69%) Hdfs split stats (:<# splits>/): 2:1/7.19 MB 6:1/7.19 MB MemoryUsage(500.000ms): 10.81 MB ThreadUsage(500.000ms): 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 17.65 MB (18505616) - PerHostPeakMemUsage: 350.86 MB (367905391) - RowsProduced: 6.89K (6892) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 356.994ms - TotalStorageWaitTime: 250.853ms - TotalThreadsInvoluntaryContextSwitches: 37 (37) - TotalThreadsTotalWallClockTime: 956.304ms - TotalThreadsSysTime: 36.994ms - TotalThreadsUserTime: 112.982ms - TotalThreadsVoluntaryContextSwitches: 299 (299) Fragment Instance Lifecycle Timings: - ExecTime: 512.519ms - ExecTreeExecTime: 108.390ms - OpenTime: 52.780ms - ExecTreeOpenTime: 39.589us - PrepareTime: 61.284ms - ExecTreePrepareTime: 180.068us DataStreamSender (dst_id=26):(Total: 23.127ms, non-child: 23.127ms, % non-child: 100.00%) - BytesSent: 12.77 MB (13389950) - NetworkThroughput(*): 611.61 MB/sec - OverallThroughput: 552.14 MB/sec - PeakMemoryUsage: 816.56 KB (836160) - RowsReturned: 6.89K (6892) - SerializeBatchTime: 1.646ms - TransmitDataRPCTime: 20.878ms - UncompressedRowBatchSize: 32.82 MB (34411200) CodeGen:(Total: 76.797ms, non-child: 76.797ms, % non-child: 100.00%) - CodegenTime: 987.591us - CompileTime: 11.494ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 27 (27) - NumInstructions: 373 (373) - OptimizationTime: 39.843ms - PeakMemoryUsage: 186.50 KB (190976) - PrepareTime: 24.860ms HDFS_SCAN_NODE (id=1):(Total: 108.821ms, non-child: 108.821ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:1/7.19 MB 6:1/7.19 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 2 out of 2 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:4 BytesRead(500.000ms): 4.28 MB - FooterProcessingTime: (Avg: 77.014ms ; Min: 35.423ms ; Max: 118.604ms ; Number of samples: 2) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 4.28 MB (4489122) - BytesReadDataNodeCache: 0 - BytesReadLocal: 4.28 MB (4489122) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 4.28 MB (4489122) - DecompressionTime: 3.775ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 2 (2) - NumRowGroups: 2 (2) - NumScannerThreadsStarted: 2 (2) - PeakMemoryUsage: 13.94 MB (14618973) - PerReadThreadRawHdfsThroughput: 55.55 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 107.677ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 760.00K (760000) - RowsReturned: 6.89K (6892) - RowsReturnedRate: 63.33 K/sec - ScanRangesComplete: 2 (2) - ScannerThreadsInvoluntaryContextSwitches: 11 (11) - ScannerThreadsTotalWallClockTime: 391.422ms - MaterializeTupleTime(*): 61.834ms - ScannerThreadsSysTime: 11.998ms - ScannerThreadsUserTime: 52.991ms - ScannerThreadsVoluntaryContextSwitches: 19 (19) - TotalRawHdfsReadTime(*): 77.071ms - TotalReadThroughput: 8.56 MB/sec Instance 7f40dcb034de70b7:280 (host=va1046.foo:22000):(Total: 626.078ms, non-child: 444.425ms, % non-child: 70.99%) Hdfs split stats (:<# splits>/): 6:1/7.01 MB 0:1/7.19 MB MemoryUsage(500.000ms): 6.53 MB ThreadUsage(500.000ms): 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 15.70 MB (16459524) - PerHostPeakMemUsage: 353.03 MB (370178714) - RowsProduced: 6.79K (6787) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 393.223ms - TotalStorageWaitTime: 180.074ms - TotalThreadsInvoluntaryContextSwitches: 37 (37) - TotalThreadsTotalWallClockTime: 853.139ms - TotalThreadsSysTime: 31.994ms - TotalThreadsUserTime: 119.981ms - TotalThreadsVoluntaryContextSwitches: 276 (276) Fragment Instance Lifecycle Timings: - ExecTime: 549.420ms - ExecTreeExecTime: 108.702ms - OpenTime: 42.921ms - ExecTreeOpenTime: 28.977us - PrepareTime: 33.697ms - ExecTreePrepareTime: 164.695us DataStreamSender (dst_id=26):(Total: 16.677ms, non-child: 16.677ms, % non-child: 100.00%) - BytesSent: 12.45 MB (13057630) - NetworkThroughput(*): 860.44 MB/sec - OverallThroughput: 746.67 MB/sec - PeakMemoryUsage: 816.56 KB (836160) - RowsReturned: 6.79K (6787) - SerializeBatchTime: 1.968ms - TransmitDataRPCTime: 14.472ms - UncompressedRowBatchSize: 32.29 MB (33859388) CodeGen:(Total: 55.889ms, non-child: 55.889ms, % non-child: 100.00%) - CodegenTime: 703.564us - CompileTime: 9.321ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 27 (27) - NumInstructions: 373 (373) - OptimizationTime: 32.579ms - PeakMemoryUsage: 186.50 KB (190976) - PrepareTime: 13.581ms HDFS_SCAN_NODE (id=1):(Total: 109.085ms, non-child: 109.085ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 6:1/7.01 MB 0:1/7.19 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 2 out of 2 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:4 BytesRead(500.000ms): 4.23 MB - FooterProcessingTime: (Avg: 39.023ms ; Min: 38.456ms ; Max: 39.591ms ; Number of samples: 2) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 4.23 MB (4435276) - BytesReadDataNodeCache: 0 - BytesReadLocal: 4.23 MB (4435276) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 4.23 MB (4435276) - DecompressionTime: 3.017ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 2 (2) - NumRowGroups: 2 (2) - NumScannerThreadsStarted: 2 (2) - PeakMemoryUsage: 12.45 MB (13053692) - PerReadThreadRawHdfsThroughput: 57.10 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 108.037ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 750.00K (750000) - RowsReturned: 6.79K (6787) - RowsReturnedRate: 62.22 K/sec - ScanRangesComplete: 2 (2) - ScannerThreadsInvoluntaryContextSwitches: 12 (12) - ScannerThreadsTotalWallClockTime: 261.065ms - MaterializeTupleTime(*): 74.320ms - ScannerThreadsSysTime: 11.997ms - ScannerThreadsUserTime: 63.990ms - ScannerThreadsVoluntaryContextSwitches: 18 (18) - TotalRawHdfsReadTime(*): 74.072ms - TotalReadThroughput: 8.46 MB/sec Instance 7f40dcb034de70b7:279 (host=vc1534.foo:22000):(Total: 625.829ms, non-child: 227.855ms, % non-child: 36.41%) Hdfs split stats (:<# splits>/): 1:1/7.00 MB MemoryUsage(500.000ms): 838.06 KB ThreadUsage(500.000ms): 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 10.84 MB (11369122) - PerHostPeakMemUsage: 373.14 MB (391268397) - RowsProduced: 3.35K (3350) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 160.152ms - TotalStorageWaitTime: 157.179ms - TotalThreadsInvoluntaryContextSwitches: 32 (32) - TotalThreadsTotalWallClockTime: 886.692ms - TotalThreadsSysTime: 19.996ms - TotalThreadsUserTime: 88.985ms - TotalThreadsVoluntaryContextSwitches: 290 (290) Fragment Instance Lifecycle Timings: - ExecTime: 507.325ms - ExecTreeExecTime: 308.960ms - OpenTime: 56.405ms - ExecTreeOpenTime: 66.478us - PrepareTime: 62.062ms - ExecTreePrepareTime: 95.349us DataStreamSender (dst_id=26):(Total: 13.275ms, non-child: 13.275ms, % non-child: 100.00%) - BytesSent: 6.19 MB (6487208) - NetworkThroughput(*): 532.77 MB/sec - OverallThroughput: 466.03 MB/sec - PeakMemoryUsage: 816.56 KB (836160) - RowsReturned: 3.35K (3350) - SerializeBatchTime: 1.189ms - TransmitDataRPCTime: 11.612ms - UncompressedRowBatchSize: 15.95 MB (16722262) CodeGen:(Total: 75.469ms, non-child: 75.469ms, % non-child: 100.00%) - CodegenTime: 992.487us - CompileTime: 13.236ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 27 (27) - NumInstructions: 373 (373) - OptimizationTime: 41.515ms - PeakMemoryUsage: 186.50 KB (190976) - PrepareTime: 20.179ms HDFS_SCAN_NODE (id=1):(Total: 309.228ms, non-child: 309.228ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:1/7.00 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:2 BytesRead(500.000ms): 0 - FooterProcessingTime: (Avg: 114.127ms ; Min: 114.127ms ; Max: 114.127ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 2.09 MB (2190754) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.09 MB (2190754) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 2.09 MB (2190754) - DecompressionTime: 1.335ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 7.28 MB (7633498) - PerReadThreadRawHdfsThroughput: 50.28 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 308.580ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 370.00K (370000) - RowsReturned: 3.35K (3350) - RowsReturnedRate: 10.83 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 7 (7) - ScannerThreadsTotalWallClockTime: 323.755ms - MaterializeTupleTime(*): 32.640ms - ScannerThreadsSysTime: 4.999ms - ScannerThreadsUserTime: 26.995ms - ScannerThreadsVoluntaryContextSwitches: 5 (5) - TotalRawHdfsReadTime(*): 41.554ms - TotalReadThroughput: 0.00 /sec Instance 7f40dcb034de70b7:286 (host=vc1510.foo:22000):(Total: 625.403ms, non-child: 259.406ms, % non-child: 41.48%) Hdfs split stats (:<# splits>/): 6:1/7.19 MB MemoryUsage(500.000ms): 8.13 MB ThreadUsage(500.000ms): 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 10.94 MB (11466692) - PerHostPeakMemUsage: 372.73 MB (390839921) - RowsProduced: 3.31K (3307) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 202.731ms - TotalStorageWaitTime: 176.103ms - TotalThreadsInvoluntaryContextSwitches: 39 (39) - TotalThreadsTotalWallClockTime: 843.708ms - TotalThreadsSysTime: 13.997ms - TotalThreadsUserTime: 105.983ms - TotalThreadsVoluntaryContextSwitches: 291 (291) Fragment Instance Lifecycle Timings: - ExecTime: 501.538ms - ExecTreeExecTime: 260.929ms - OpenTime: 65.650ms - ExecTreeOpenTime: 63.068us - PrepareTime: 58.164ms - ExecTreePrepareTime: 145.693us DataStreamSender (dst_id=26):(Total: 11.949ms, non-child: 11.949ms, % non-child: 100.00%) - BytesSent: 6.05 MB (6347178) - NetworkThroughput(*): 587.42 MB/sec - OverallThroughput: 506.57 MB/sec - PeakMemoryUsage: 816.56 KB (836160) - RowsReturned: 3.31K (3307) - SerializeBatchTime: 1.104ms - TransmitDataRPCTime: 10.304ms - UncompressedRowBatchSize: 15.73 MB (16494462) CodeGen:(Total: 92.728ms, non-child: 92.728ms, % non-child: 100.00%) - CodegenTime: 1.381ms - CompileTime: 16.444ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 27 (27) - NumInstructions: 373 (373) - OptimizationTime: 47.068ms - PeakMemoryUsage: 186.50 KB (190976) - PrepareTime: 28.565ms HDFS_SCAN_NODE (id=1):(Total: 261.319ms, non-child: 261.319ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 6:1/7.19 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:2 BytesRead(500.000ms): 2.14 MB - FooterProcessingTime: (Avg: 116.662ms ; Min: 116.662ms ; Max: 116.662ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 2.14 MB (2244526) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.14 MB (2244526) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 2.14 MB (2244526) - DecompressionTime: 1.916ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 7.06 MB (7406985) - PerReadThreadRawHdfsThroughput: 47.72 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 260.543ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 380.00K (380000) - RowsReturned: 3.31K (3307) - RowsReturnedRate: 12.65 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 4 (4) - ScannerThreadsTotalWallClockTime: 276.933ms - MaterializeTupleTime(*): 32.948ms - ScannerThreadsSysTime: 999.000us - ScannerThreadsUserTime: 33.994ms - ScannerThreadsVoluntaryContextSwitches: 8 (8) - TotalRawHdfsReadTime(*): 44.853ms - TotalReadThroughput: 4.28 MB/sec Instance 7f40dcb034de70b7:2b3 (host=vc1519.foo:22000):(Total: 625.126ms, non-child: 359.009ms, % non-child: 57.43%) Hdfs split stats (:<# splits>/): 5:1/7.00 MB 7:1/7.19 MB MemoryUsage(500.000ms): 0, 14.96 MB ThreadUsage(500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 20.79 MB (21797636) - PerHostPeakMemUsage: 391.24 MB (410243197) - RowsProduced: 6.73K (6734) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 307.816ms - TotalStorageWaitTime: 321.941ms - TotalThreadsInvoluntaryContextSwitches: 47 (47) - TotalThreadsTotalWallClockTime: 979.793ms - TotalThreadsSysTime: 37.993ms - TotalThreadsUserTime: 125.980ms - TotalThreadsVoluntaryContextSwitches: 279 (279) Fragment Instance Lifecycle Timings: - ExecTime: 524.867ms - ExecTreeExecTime: 169.843ms - OpenTime: 55.605ms - ExecTreeOpenTime: 30.976us - PrepareTime: 44.592ms - ExecTreePrepareTime: 160.329us DataStreamSender (dst_id=26):(Total: 19.823ms, non-child: 19.823ms, % non-child: 100.00%) - BytesSent: 12.41 MB (13014482) - NetworkThroughput(*): 732.18 MB/sec - OverallThroughput: 626.11 MB/sec - PeakMemoryUsage: 816.56 KB (836160) - RowsReturned: 6.73K (6734) - SerializeBatchTime: 2.442ms - TransmitDataRPCTime: 16.951ms - UncompressedRowBatchSize: 32.05 MB (33608272) CodeGen:(Total: 76.104ms, non-child: 76.104ms, % non-child: 100.00%) - CodegenTime: 902.242us - CompileTime: 11.596ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 27 (27) - NumInstructions: 373 (373) - OptimizationTime: 42.901ms - PeakMemoryUsage: 186.50 KB (190976) - PrepareTime: 21.133ms HDFS_SCAN_NODE (id=1):(Total: 170.188ms, non-child: 170.188ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:1/7.00 MB 7:1/7.19 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 2 out of 2 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:4 BytesRead(500.000ms): 0, 4.23 MB - FooterProcessingTime: (Avg: 46.637ms ; Min: 44.846ms ; Max: 48.428ms ; Number of samples: 2) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 4.23 MB (4435333) - BytesReadDataNodeCache: 0 - BytesReadLocal: 4.23 MB (4435333) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 4.23 MB (4435333) - DecompressionTime: 4.116ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 2 (2) - NumRowGroups: 2 (2) - NumScannerThreadsStarted: 2 (2) - PeakMemoryUsage: 17.16 MB (17997500) - PerReadThreadRawHdfsThroughput: 47.39 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 169.016ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 750.00K (750000) - RowsReturned: 6.73K (6734) - RowsReturnedRate: 39.57 K/sec - ScanRangesComplete: 2 (2) - ScannerThreadsInvoluntaryContextSwitches: 13 (13) - ScannerThreadsTotalWallClockTime: 399.624ms - MaterializeTupleTime(*): 69.244ms - ScannerThreadsSysTime: 14.997ms - ScannerThreadsUserTime: 60.990ms - ScannerThreadsVoluntaryContextSwitches: 11 (11) - TotalRawHdfsReadTime(*): 89.264ms - TotalReadThroughput: 4.23 MB/sec Instance 7f40dcb034de70b7:275 (host=va1039.foo:22000):(Total: 624.926ms, non-child: 397.597ms, % non-child: 63.62%) Hdfs split stats (:<# splits>/): 4:1/7.19 MB MemoryUsage(500.000ms): 816.56 KB, 2.53 MB ThreadUsage(500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 11.14 MB (11681732) - PerHostPeakMemUsage: 374.74 MB (392945792) - RowsProduced: 3.44K (3435) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 340.207ms - TotalStorageWaitTime: 114.818ms - TotalThreadsInvoluntaryContextSwitches: 34 (34) - TotalThreadsTotalWallClockTime: 730.306ms - TotalThreadsSysTime: 23.996ms - TotalThreadsUserTime: 92.986ms - TotalThreadsVoluntaryContextSwitches: 285 (285) Fragment Instance Lifecycle Timings: - ExecTime: 517.940ms - ExecTreeExecTime: 130.918ms - OpenTime: 55.349ms - ExecTreeOpenTime: 29.369us - PrepareTime: 51.574ms - ExecTreePrepareTime: 190.265us DataStreamSender (dst_id=26):(Total: 17.335ms, non-child: 17.335ms, % non-child: 100.00%) - BytesSent: 6.33 MB (6638896) - NetworkThroughput(*): 405.77 MB/sec - OverallThroughput: 365.22 MB/sec - PeakMemoryUsage: 816.56 KB (836160) - RowsReturned: 3.44K (3435) - SerializeBatchTime: 1.033ms - TransmitDataRPCTime: 15.603ms - UncompressedRowBatchSize: 16.35 MB (17148516) CodeGen:(Total: 78.598ms, non-child: 78.598ms, % non-child: 100.00%) - CodegenTime: 1.084ms - CompileTime: 11.450ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 27 (27) - NumInstructions: 373 (373) - OptimizationTime: 42.456ms - PeakMemoryUsage: 186.50 KB (190976) - PrepareTime: 24.207ms HDFS_SCAN_NODE (id=1):(Total: 131.394ms, non-child: 131.394ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:1/7.19 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:2 BytesRead(500.000ms): 0, 2.14 MB - FooterProcessingTime: (Avg: 54.181ms ; Min: 54.181ms ; Max: 54.181ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 2.14 MB (2244514) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.14 MB (2244514) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 2.14 MB (2244514) - DecompressionTime: 3.531ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 7.52 MB (7881596) - PerReadThreadRawHdfsThroughput: 51.35 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 130.554ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 380.00K (380000) - RowsReturned: 3.44K (3435) - RowsReturnedRate: 26.14 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 7 (7) - ScannerThreadsTotalWallClockTime: 157.351ms - MaterializeTupleTime(*): 37.246ms - ScannerThreadsSysTime: 7.998ms - ScannerThreadsUserTime: 31.995ms - ScannerThreadsVoluntaryContextSwitches: 10 (10) - TotalRawHdfsReadTime(*): 41.686ms - TotalReadThroughput: 2.14 MB/sec Instance 7f40dcb034de70b7:2d2 (host=ve1137.foo:22000):(Total: 624.064ms, non-child: 43.137ms, % non-child: 6.91%) Hdfs split stats (:<# splits>/): 2:1/7.19 MB MemoryUsage(500.000ms): 4.07 MB ThreadUsage(500.000ms): 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 8.48 MB (8887304) - PerHostPeakMemUsage: 372.08 MB (390151123) - RowsProduced: 3.49K (3486) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 215.766us - TotalStorageWaitTime: 325.350ms - TotalThreadsInvoluntaryContextSwitches: 32 (32) - TotalThreadsTotalWallClockTime: 1s085ms - TotalThreadsSysTime: 14.998ms - TotalThreadsUserTime: 92.985ms - TotalThreadsVoluntaryContextSwitches: 288 (288) Fragment Instance Lifecycle Timings: - ExecTime: 528.263ms - ExecTreeExecTime: 492.892ms - OpenTime: 51.493ms - ExecTreeOpenTime: 32.505us - PrepareTime: 44.240ms - ExecTreePrepareTime: 106.228us DataStreamSender (dst_id=26):(Total: 13.748ms, non-child: 13.748ms, % non-child: 100.00%) - BytesSent: 6.40 MB (6708576) - NetworkThroughput(*): 522.22 MB/sec - OverallThroughput: 465.34 MB/sec - PeakMemoryUsage: 816.56 KB (836160) - RowsReturned: 3.49K (3486) - SerializeBatchTime: 1.144ms - TransmitDataRPCTime: 12.251ms - UncompressedRowBatchSize: 16.59 MB (17392798) CodeGen:(Total: 74.021ms, non-child: 74.021ms, % non-child: 100.00%) - CodegenTime: 879.377us - CompileTime: 13.087ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 27 (27) - NumInstructions: 373 (373) - OptimizationTime: 37.384ms - PeakMemoryUsage: 186.50 KB (190976) - PrepareTime: 23.059ms HDFS_SCAN_NODE (id=1):(Total: 493.156ms, non-child: 493.156ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:1/7.19 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:2 BytesRead(500.000ms): 1.62 MB - FooterProcessingTime: (Avg: 129.094ms ; Min: 129.094ms ; Max: 129.094ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 2.14 MB (2244559) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.14 MB (2244559) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 2.14 MB (2244559) - DecompressionTime: 1.653ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 6.53 MB (6851308) - PerReadThreadRawHdfsThroughput: 71.34 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 492.311ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 380.00K (380000) - RowsReturned: 3.49K (3486) - RowsReturnedRate: 7.07 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 7 (7) - ScannerThreadsTotalWallClockTime: 505.969ms - MaterializeTupleTime(*): 35.589ms - ScannerThreadsSysTime: 4.999ms - ScannerThreadsUserTime: 32.994ms - ScannerThreadsVoluntaryContextSwitches: 11 (11) - TotalRawHdfsReadTime(*): 30.007ms - TotalReadThroughput: 3.25 MB/sec Instance 7f40dcb034de70b7:2a0 (host=vc1536.foo:22000):(Total: 623.503ms, non-child: 353.228ms, % non-child: 56.65%) Hdfs split stats (:<# splits>/): 2:1/7.19 MB 0:1/7.01 MB MemoryUsage(500.000ms): 15.06 MB ThreadUsage(500.000ms): 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 20.79 MB (21797636) - PerHostPeakMemUsage: 366.79 MB (384611106) - RowsProduced: 6.79K (6788) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 305.021ms - TotalStorageWaitTime: 279.098ms - TotalThreadsInvoluntaryContextSwitches: 29 (29) - TotalThreadsTotalWallClockTime: 981.473ms - TotalThreadsSysTime: 28.995ms - TotalThreadsUserTime: 110.983ms - TotalThreadsVoluntaryContextSwitches: 291 (291) Fragment Instance Lifecycle Timings: - ExecTime: 525.932ms - ExecTreeExecTime: 178.591ms - OpenTime: 50.927ms - ExecTreeOpenTime: 47.224us - PrepareTime: 46.572ms - ExecTreePrepareTime: 130.334us DataStreamSender (dst_id=26):(Total: 17.420ms, non-child: 17.420ms, % non-child: 100.00%) - BytesSent: 12.53 MB (13135752) - NetworkThroughput(*): 851.40 MB/sec - OverallThroughput: 719.12 MB/sec - PeakMemoryUsage: 816.56 KB (836160) - RowsReturned: 6.79K (6788) - SerializeBatchTime: 2.204ms - TransmitDataRPCTime: 14.713ms - UncompressedRowBatchSize: 32.31 MB (33882704) CodeGen:(Total: 73.947ms, non-child: 73.947ms, % non-child: 100.00%) - CodegenTime: 882.785us - CompileTime: 12.145ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 27 (27) - NumInstructions: 373 (373) - OptimizationTime: 37.208ms - PeakMemoryUsage: 186.50 KB (190976) - PrepareTime: 24.143ms HDFS_SCAN_NODE (id=1):(Total: 178.907ms, non-child: 178.907ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:1/7.19 MB 0:1/7.01 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 2 out of 2 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:4 BytesRead(500.000ms): 4.23 MB - FooterProcessingTime: (Avg: 72.380ms ; Min: 72.330ms ; Max: 72.430ms ; Number of samples: 2) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 4.23 MB (4435243) - BytesReadDataNodeCache: 0 - BytesReadLocal: 4.23 MB (4435243) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 4.23 MB (4435243) - DecompressionTime: 2.829ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 2 (2) - NumRowGroups: 2 (2) - NumScannerThreadsStarted: 2 (2) - PeakMemoryUsage: 17.27 MB (18105020) - PerReadThreadRawHdfsThroughput: 51.24 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 177.778ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 750.00K (750000) - RowsReturned: 6.79K (6788) - RowsReturnedRate: 37.94 K/sec - ScanRangesComplete: 2 (2) - ScannerThreadsInvoluntaryContextSwitches: 10 (10) - ScannerThreadsTotalWallClockTime: 404.974ms - MaterializeTupleTime(*): 54.591ms - ScannerThreadsSysTime: 10.997ms - ScannerThreadsUserTime: 48.992ms - ScannerThreadsVoluntaryContextSwitches: 14 (14) - TotalRawHdfsReadTime(*): 82.545ms - TotalReadThroughput: 8.46 MB/sec Instance 7f40dcb034de70b7:2ac (host=vc1520.foo:22000):(Total: 623.402ms, non-child: 401.000ms, % non-child: 64.32%) Hdfs split stats (:<# splits>/): 1:1/7.19 MB 3:1/7.01 MB MemoryUsage(500.000ms): 7.19 MB ThreadUsage(500.000ms): 3 - AverageThreadTokens: 3.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 21.93 MB (22992275) - PerHostPeakMemUsage: 373.35 MB (391481370) - RowsProduced: 6.88K (6882) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 346.322ms - TotalStorageWaitTime: 229.775ms - TotalThreadsInvoluntaryContextSwitches: 38 (38) - TotalThreadsTotalWallClockTime: 890.909ms - TotalThreadsSysTime: 34.995ms - TotalThreadsUserTime: 129.979ms - TotalThreadsVoluntaryContextSwitches: 315 (315) Fragment Instance Lifecycle Timings: - ExecTime: 524.417ms - ExecTreeExecTime: 132.192ms - OpenTime: 50.347ms - ExecTreeOpenTime: 33.933us - PrepareTime: 48.428ms - ExecTreePrepareTime: 150.146us DataStreamSender (dst_id=26):(Total: 18.539ms, non-child: 18.539ms, % non-child: 100.00%) - BytesSent: 12.66 MB (13278998) - NetworkThroughput(*): 785.04 MB/sec - OverallThroughput: 683.06 MB/sec - PeakMemoryUsage: 816.56 KB (836160) - RowsReturned: 6.88K (6882) - SerializeBatchTime: 1.962ms - TransmitDataRPCTime: 16.131ms - UncompressedRowBatchSize: 32.75 MB (34342190) CodeGen:(Total: 71.309ms, non-child: 71.309ms, % non-child: 100.00%) - CodegenTime: 692.688us - CompileTime: 13.066ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 27 (27) - NumInstructions: 373 (373) - OptimizationTime: 36.141ms - PeakMemoryUsage: 186.50 KB (190976) - PrepareTime: 21.703ms HDFS_SCAN_NODE (id=1):(Total: 132.553ms, non-child: 132.553ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:1/7.19 MB 3:1/7.01 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 2 out of 2 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:4 BytesRead(500.000ms): 3.21 MB - FooterProcessingTime: (Avg: 45.295ms ; Min: 39.730ms ; Max: 50.860ms ; Number of samples: 2) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 2.00 - BytesRead: 4.23 MB (4435326) - BytesReadDataNodeCache: 0 - BytesReadLocal: 4.23 MB (4435326) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 4.23 MB (4435326) - DecompressionTime: 6.577ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 2 (2) - NumRowGroups: 2 (2) - NumScannerThreadsStarted: 2 (2) - PeakMemoryUsage: 18.43 MB (19330177) - PerReadThreadRawHdfsThroughput: 56.17 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 131.524ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 750.00K (750000) - RowsReturned: 6.88K (6882) - RowsReturnedRate: 51.92 K/sec - ScanRangesComplete: 2 (2) - ScannerThreadsInvoluntaryContextSwitches: 21 (21) - ScannerThreadsTotalWallClockTime: 316.384ms - MaterializeTupleTime(*): 76.269ms - ScannerThreadsSysTime: 11.998ms - ScannerThreadsUserTime: 69.988ms - ScannerThreadsVoluntaryContextSwitches: 21 (21) - TotalRawHdfsReadTime(*): 75.310ms - TotalReadThroughput: 6.42 MB/sec Instance 7f40dcb034de70b7:290 (host=vc1539.foo:22000):(Total: 623.229ms, non-child: 298.004ms, % non-child: 47.82%) Hdfs split stats (:<# splits>/): 2:1/7.00 MB MemoryUsage(500.000ms): 7.90 MB ThreadUsage(500.000ms): 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 10.90 MB (11433634) - PerHostPeakMemUsage: 373.66 MB (391807483) - RowsProduced: 3.28K (3280) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 242.191ms - TotalStorageWaitTime: 121.729ms - TotalThreadsInvoluntaryContextSwitches: 19 (19) - TotalThreadsTotalWallClockTime: 813.526ms - TotalThreadsSysTime: 17.997ms - TotalThreadsUserTime: 79.987ms - TotalThreadsVoluntaryContextSwitches: 294 (294) Fragment Instance Lifecycle Timings: - ExecTime: 512.200ms - ExecTreeExecTime: 238.091ms - OpenTime: 51.070ms - ExecTreeOpenTime: 43.036us - PrepareTime: 59.905ms - ExecTreePrepareTime: 133.614us DataStreamSender (dst_id=26):(Total: 11.159ms, non-child: 11.159ms, % non-child: 100.00%) - BytesSent: 6.05 MB (6339004) - NetworkThroughput(*): 616.10 MB/sec - OverallThroughput: 541.71 MB/sec - PeakMemoryUsage: 816.56 KB (836160) - RowsReturned: 3.28K (3280) - SerializeBatchTime: 859.360us - TransmitDataRPCTime: 9.812ms - UncompressedRowBatchSize: 15.62 MB (16382706) CodeGen:(Total: 75.614ms, non-child: 75.614ms, % non-child: 100.00%) - CodegenTime: 1.191ms - CompileTime: 12.069ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 27 (27) - NumInstructions: 373 (373) - OptimizationTime: 37.749ms - PeakMemoryUsage: 186.50 KB (190976) - PrepareTime: 25.225ms HDFS_SCAN_NODE (id=1):(Total: 238.451ms, non-child: 238.451ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:1/7.00 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:2 BytesRead(500.000ms): 2.09 MB - FooterProcessingTime: (Avg: 70.668ms ; Min: 70.668ms ; Max: 70.668ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 2.09 MB (2190736) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.09 MB (2190736) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 2.09 MB (2190736) - DecompressionTime: 1.838ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 7.22 MB (7568986) - PerReadThreadRawHdfsThroughput: 29.36 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 237.671ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 370.00K (370000) - RowsReturned: 3.28K (3280) - RowsReturnedRate: 13.76 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 5 (5) - ScannerThreadsTotalWallClockTime: 250.591ms - MaterializeTupleTime(*): 24.504ms - ScannerThreadsSysTime: 4.999ms - ScannerThreadsUserTime: 21.996ms - ScannerThreadsVoluntaryContextSwitches: 7 (7) - TotalRawHdfsReadTime(*): 71.168ms - TotalReadThroughput: 4.18 MB/sec Instance 7f40dcb034de70b7:29e (host=vd1339.foo:22000):(Total: 622.186ms, non-child: 403.126ms, % non-child: 64.79%) Hdfs split stats (:<# splits>/): 4:1/7.19 MB 6:1/7.18 MB MemoryUsage(500.000ms): 7.32 MB ThreadUsage(500.000ms): 3 - AverageThreadTokens: 3.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 19.75 MB (20706499) - PerHostPeakMemUsage: 362.29 MB (379886381) - RowsProduced: 7.03K (7028) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 355.075ms - TotalStorageWaitTime: 229.977ms - TotalThreadsInvoluntaryContextSwitches: 41 (41) - TotalThreadsTotalWallClockTime: 889.729ms - TotalThreadsSysTime: 35.994ms - TotalThreadsUserTime: 115.982ms - TotalThreadsVoluntaryContextSwitches: 313 (313) Fragment Instance Lifecycle Timings: - ExecTime: 533.218ms - ExecTreeExecTime: 130.409ms - OpenTime: 44.182ms - ExecTreeOpenTime: 29.678us - PrepareTime: 44.712ms - ExecTreePrepareTime: 81.461us DataStreamSender (dst_id=26):(Total: 22.318ms, non-child: 22.318ms, % non-child: 100.00%) - BytesSent: 12.93 MB (13554636) - NetworkThroughput(*): 632.67 MB/sec - OverallThroughput: 579.20 MB/sec - PeakMemoryUsage: 816.56 KB (836160) - RowsReturned: 7.03K (7028) - SerializeBatchTime: 1.569ms - TransmitDataRPCTime: 20.431ms - UncompressedRowBatchSize: 33.43 MB (35058152) CodeGen:(Total: 66.141ms, non-child: 66.141ms, % non-child: 100.00%) - CodegenTime: 813.183us - CompileTime: 9.923ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 27 (27) - NumInstructions: 373 (373) - OptimizationTime: 33.052ms - PeakMemoryUsage: 186.50 KB (190976) - PrepareTime: 22.743ms HDFS_SCAN_NODE (id=1):(Total: 130.600ms, non-child: 130.600ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:1/7.19 MB 6:1/7.18 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 2 out of 2 Hdfs Read Thread Concurrency Bucket: 0:0% 1:100% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:4 BytesRead(500.000ms): 3.25 MB - FooterProcessingTime: (Avg: 54.799ms ; Min: 54.001ms ; Max: 55.597ms ; Number of samples: 2) - AverageHdfsReadThreadConcurrency: 1.00 - AverageScannerThreadConcurrency: 2.00 - BytesRead: 4.28 MB (4489013) - BytesReadDataNodeCache: 0 - BytesReadLocal: 4.28 MB (4489013) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 4.28 MB (4489013) - DecompressionTime: 4.578ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 2 (2) - NumRowGroups: 2 (2) - NumScannerThreadsStarted: 2 (2) - PeakMemoryUsage: 16.14 MB (16927867) - PerReadThreadRawHdfsThroughput: 49.20 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 129.889ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 760.00K (760000) - RowsReturned: 7.03K (7028) - RowsReturnedRate: 53.81 K/sec - ScanRangesComplete: 2 (2) - ScannerThreadsInvoluntaryContextSwitches: 15 (15) - ScannerThreadsTotalWallClockTime: 312.614ms - MaterializeTupleTime(*): 74.066ms - ScannerThreadsSysTime: 17.996ms - ScannerThreadsUserTime: 59.990ms - ScannerThreadsVoluntaryContextSwitches: 31 (31) - TotalRawHdfsReadTime(*): 87.016ms - TotalReadThroughput: 6.50 MB/sec Instance 7f40dcb034de70b7:287 (host=vc1514.foo:22000):(Total: 621.500ms, non-child: 376.505ms, % non-child: 60.58%) Hdfs split stats (:<# splits>/): 1:1/7.19 MB MemoryUsage(500.000ms): 5.54 MB ThreadUsage(500.000ms): 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 11.12 MB (11660228) - PerHostPeakMemUsage: 364.13 MB (381821701) - RowsProduced: 3.44K (3445) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 301.666ms - TotalStorageWaitTime: 116.146ms - TotalThreadsInvoluntaryContextSwitches: 29 (29) - TotalThreadsTotalWallClockTime: 722.230ms - TotalThreadsSysTime: 29.995ms - TotalThreadsUserTime: 98.984ms - TotalThreadsVoluntaryContextSwitches: 280 (280) Fragment Instance Lifecycle Timings: - ExecTime: 498.752ms - ExecTreeExecTime: 141.257ms - OpenTime: 65.830ms - ExecTreeOpenTime: 50.958us - PrepareTime: 56.859ms - ExecTreePrepareTime: 140.203us DataStreamSender (dst_id=26):(Total: 17.246ms, non-child: 17.246ms, % non-child: 100.00%) - BytesSent: 6.37 MB (6683250) - NetworkThroughput(*): 407.06 MB/sec - OverallThroughput: 369.56 MB/sec - PeakMemoryUsage: 816.56 KB (836160) - RowsReturned: 3.44K (3445) - SerializeBatchTime: 994.153us - TransmitDataRPCTime: 15.657ms - UncompressedRowBatchSize: 16.41 MB (17204528) CodeGen:(Total: 86.123ms, non-child: 86.123ms, % non-child: 100.00%) - CodegenTime: 1.064ms - CompileTime: 15.529ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 27 (27) - NumInstructions: 373 (373) - OptimizationTime: 47.625ms - PeakMemoryUsage: 186.50 KB (190976) - PrepareTime: 22.378ms HDFS_SCAN_NODE (id=1):(Total: 141.624ms, non-child: 141.624ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:1/7.19 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:2 BytesRead(500.000ms): 2.14 MB - FooterProcessingTime: (Avg: 39.226ms ; Min: 39.226ms ; Max: 39.226ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 2.14 MB (2244571) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.14 MB (2244571) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 2.14 MB (2244571) - DecompressionTime: 7.314ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 7.39 MB (7752572) - PerReadThreadRawHdfsThroughput: 53.86 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 140.813ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 380.00K (380000) - RowsReturned: 3.44K (3445) - RowsReturnedRate: 24.32 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 5 (5) - ScannerThreadsTotalWallClockTime: 159.304ms - MaterializeTupleTime(*): 33.884ms - ScannerThreadsSysTime: 7.998ms - ScannerThreadsUserTime: 28.995ms - ScannerThreadsVoluntaryContextSwitches: 14 (14) - TotalRawHdfsReadTime(*): 39.745ms - TotalReadThroughput: 4.28 MB/sec Instance 7f40dcb034de70b7:2a2 (host=vd1127.foo:22000):(Total: 620.994ms, non-child: 399.772ms, % non-child: 64.38%) Hdfs split stats (:<# splits>/): 0:1/7.18 MB 7:1/7.00 MB MemoryUsage(500.000ms): 12.55 MB ThreadUsage(500.000ms): 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 21.20 MB (22226558) - PerHostPeakMemUsage: 367.21 MB (385046820) - RowsProduced: 6.92K (6924) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 348.232ms - TotalStorageWaitTime: 225.353ms - TotalThreadsInvoluntaryContextSwitches: 30 (30) - TotalThreadsTotalWallClockTime: 890.430ms - TotalThreadsSysTime: 36.993ms - TotalThreadsUserTime: 129.979ms - TotalThreadsVoluntaryContextSwitches: 332 (332) Fragment Instance Lifecycle Timings: - ExecTime: 528.016ms - ExecTreeExecTime: 131.448ms - OpenTime: 42.597ms - ExecTreeOpenTime: 26.855us - PrepareTime: 50.336ms - ExecTreePrepareTime: 144.209us DataStreamSender (dst_id=26):(Total: 26.174ms, non-child: 26.174ms, % non-child: 100.00%) - BytesSent: 12.67 MB (13289852) - NetworkThroughput(*): 545.88 MB/sec - OverallThroughput: 484.21 MB/sec - PeakMemoryUsage: 816.56 KB (836160) - RowsReturned: 6.92K (6924) - SerializeBatchTime: 2.383ms - TransmitDataRPCTime: 23.217ms - UncompressedRowBatchSize: 32.94 MB (34543324) CodeGen:(Total: 63.252ms, non-child: 63.252ms, % non-child: 100.00%) - CodegenTime: 754.657us - CompileTime: 9.344ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 27 (27) - NumInstructions: 373 (373) - OptimizationTime: 32.360ms - PeakMemoryUsage: 186.50 KB (190976) - PrepareTime: 21.193ms HDFS_SCAN_NODE (id=1):(Total: 131.794ms, non-child: 131.794ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/7.18 MB 7:1/7.00 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 2 out of 2 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:4 BytesRead(500.000ms): 4.23 MB - FooterProcessingTime: (Avg: 59.805ms ; Min: 59.013ms ; Max: 60.596ms ; Number of samples: 2) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 4.23 MB (4435297) - BytesReadDataNodeCache: 0 - BytesReadLocal: 4.23 MB (4435297) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 4.23 MB (4435297) - DecompressionTime: 4.549ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 2 (2) - NumRowGroups: 2 (2) - NumScannerThreadsStarted: 2 (2) - PeakMemoryUsage: 17.62 MB (18478444) - PerReadThreadRawHdfsThroughput: 54.48 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 130.692ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 750.00K (750000) - RowsReturned: 6.92K (6924) - RowsReturnedRate: 52.54 K/sec - ScanRangesComplete: 2 (2) - ScannerThreadsInvoluntaryContextSwitches: 12 (12) - ScannerThreadsTotalWallClockTime: 320.111ms - MaterializeTupleTime(*): 86.466ms - ScannerThreadsSysTime: 15.996ms - ScannerThreadsUserTime: 73.988ms - ScannerThreadsVoluntaryContextSwitches: 39 (39) - TotalRawHdfsReadTime(*): 77.636ms - TotalReadThroughput: 8.46 MB/sec Instance 7f40dcb034de70b7:28d (host=vd1125.foo:22000):(Total: 618.874ms, non-child: 373.191ms, % non-child: 60.30%) Hdfs split stats (:<# splits>/): 3:1/7.00 MB MemoryUsage(500.000ms): 5.01 MB ThreadUsage(500.000ms): 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 10.74 MB (11261602) - PerHostPeakMemUsage: 372.14 MB (390220926) - RowsProduced: 3.42K (3418) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 316.359ms - TotalStorageWaitTime: 112.188ms - TotalThreadsInvoluntaryContextSwitches: 32 (32) - TotalThreadsTotalWallClockTime: 699.679ms - TotalThreadsSysTime: 15.997ms - TotalThreadsUserTime: 98.984ms - TotalThreadsVoluntaryContextSwitches: 290 (290) Fragment Instance Lifecycle Timings: - ExecTime: 488.413ms - ExecTreeExecTime: 137.501ms - OpenTime: 60.854ms - ExecTreeOpenTime: 49.145us - PrepareTime: 69.516ms - ExecTreePrepareTime: 146.271us DataStreamSender (dst_id=26):(Total: 11.956ms, non-child: 11.956ms, % non-child: 100.00%) - BytesSent: 6.29 MB (6598964) - NetworkThroughput(*): 611.79 MB/sec - OverallThroughput: 526.34 MB/sec - PeakMemoryUsage: 816.56 KB (836160) - RowsReturned: 3.42K (3418) - SerializeBatchTime: 1.152ms - TransmitDataRPCTime: 10.286ms - UncompressedRowBatchSize: 16.27 MB (17061684) CodeGen:(Total: 95.849ms, non-child: 95.849ms, % non-child: 100.00%) - CodegenTime: 1.045ms - CompileTime: 12.819ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 27 (27) - NumInstructions: 373 (373) - OptimizationTime: 46.351ms - PeakMemoryUsage: 186.50 KB (190976) - PrepareTime: 36.172ms HDFS_SCAN_NODE (id=1):(Total: 137.876ms, non-child: 137.876ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:1/7.00 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:2 BytesRead(500.000ms): 2.09 MB - FooterProcessingTime: (Avg: 49.655ms ; Min: 49.655ms ; Max: 49.655ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 2.09 MB (2190799) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.09 MB (2190799) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 2.09 MB (2190799) - DecompressionTime: 1.607ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 7.22 MB (7568986) - PerReadThreadRawHdfsThroughput: 48.95 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 137.045ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 370.00K (370000) - RowsReturned: 3.42K (3418) - RowsReturnedRate: 24.79 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 6 (6) - ScannerThreadsTotalWallClockTime: 150.945ms - MaterializeTupleTime(*): 35.925ms - ScannerThreadsSysTime: 6.998ms - ScannerThreadsUserTime: 28.995ms - ScannerThreadsVoluntaryContextSwitches: 9 (9) - TotalRawHdfsReadTime(*): 42.682ms - TotalReadThroughput: 4.18 MB/sec Instance 7f40dcb034de70b7:298 (host=vd1329.foo:22000):(Total: 618.293ms, non-child: 419.735ms, % non-child: 67.89%) Hdfs split stats (:<# splits>/): 4:1/7.18 MB 0:1/7.00 MB MemoryUsage(500.000ms): 12.20 MB ThreadUsage(500.000ms): 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 21.17 MB (22194072) - PerHostPeakMemUsage: 372.13 MB (390208219) - RowsProduced: 6.74K (6742) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 362.156ms - TotalStorageWaitTime: 203.508ms - TotalThreadsInvoluntaryContextSwitches: 27 (27) - TotalThreadsTotalWallClockTime: 850.358ms - TotalThreadsSysTime: 44.992ms - TotalThreadsUserTime: 101.982ms - TotalThreadsVoluntaryContextSwitches: 300 (300) Fragment Instance Lifecycle Timings: - ExecTime: 530.389ms - ExecTreeExecTime: 114.780ms - OpenTime: 44.381ms - ExecTreeOpenTime: 29.004us - PrepareTime: 43.477ms - ExecTreePrepareTime: 155.723us DataStreamSender (dst_id=26):(Total: 19.876ms, non-child: 19.876ms, % non-child: 100.00%) - BytesSent: 12.46 MB (13068886) - NetworkThroughput(*): 744.91 MB/sec - OverallThroughput: 627.05 MB/sec - PeakMemoryUsage: 816.56 KB (836160) - RowsReturned: 6.74K (6742) - SerializeBatchTime: 2.792ms - TransmitDataRPCTime: 16.731ms - UncompressedRowBatchSize: 32.08 MB (33638824) CodeGen:(Total: 63.546ms, non-child: 63.546ms, % non-child: 100.00%) - CodegenTime: 758.646us - CompileTime: 10.224ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 27 (27) - NumInstructions: 373 (373) - OptimizationTime: 32.959ms - PeakMemoryUsage: 186.50 KB (190976) - PrepareTime: 19.858ms HDFS_SCAN_NODE (id=1):(Total: 115.135ms, non-child: 115.135ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:1/7.18 MB 0:1/7.00 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 2 out of 2 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:4 BytesRead(500.000ms): 4.23 MB - FooterProcessingTime: (Avg: 43.081ms ; Min: 40.076ms ; Max: 46.086ms ; Number of samples: 2) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 4.23 MB (4435370) - BytesReadDataNodeCache: 0 - BytesReadLocal: 4.23 MB (4435370) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 4.23 MB (4435370) - DecompressionTime: 3.501ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 2 (2) - NumRowGroups: 2 (2) - NumScannerThreadsStarted: 2 (2) - PeakMemoryUsage: 17.46 MB (18307920) - PerReadThreadRawHdfsThroughput: 47.83 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 114.107ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 750.00K (750000) - RowsReturned: 6.74K (6742) - RowsReturnedRate: 58.56 K/sec - ScanRangesComplete: 2 (2) - ScannerThreadsInvoluntaryContextSwitches: 7 (7) - ScannerThreadsTotalWallClockTime: 276.034ms - MaterializeTupleTime(*): 65.531ms - ScannerThreadsSysTime: 19.996ms - ScannerThreadsUserTime: 48.991ms - ScannerThreadsVoluntaryContextSwitches: 15 (15) - TotalRawHdfsReadTime(*): 88.427ms - TotalReadThroughput: 8.46 MB/sec Instance 7f40dcb034de70b7:2b2 (host=vd1327.foo:22000):(Total: 618.034ms, non-child: 419.373ms, % non-child: 67.86%) Hdfs split stats (:<# splits>/): 3:1/7.00 MB 0:1/7.00 MB MemoryUsage(500.000ms): 824.56 KB, 4.95 MB ThreadUsage(500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 20.43 MB (21420514) - PerHostPeakMemUsage: 370.68 MB (388686105) - RowsProduced: 6.46K (6463) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 369.598ms - TotalStorageWaitTime: 192.242ms - TotalThreadsInvoluntaryContextSwitches: 37 (37) - TotalThreadsTotalWallClockTime: 829.629ms - TotalThreadsSysTime: 34.994ms - TotalThreadsUserTime: 104.983ms - TotalThreadsVoluntaryContextSwitches: 294 (294) Fragment Instance Lifecycle Timings: - ExecTime: 522.799ms - ExecTreeExecTime: 110.572ms - OpenTime: 48.598ms - ExecTreeOpenTime: 28.947us - PrepareTime: 46.588ms - ExecTreePrepareTime: 134.557us DataStreamSender (dst_id=26):(Total: 15.715ms, non-child: 15.715ms, % non-child: 100.00%) - BytesSent: 11.92 MB (12500994) - NetworkThroughput(*): 918.19 MB/sec - OverallThroughput: 758.61 MB/sec - PeakMemoryUsage: 816.56 KB (836160) - RowsReturned: 6.46K (6463) - SerializeBatchTime: 2.302ms - TransmitDataRPCTime: 12.984ms - UncompressedRowBatchSize: 30.76 MB (32254336) CodeGen:(Total: 72.061ms, non-child: 72.061ms, % non-child: 100.00%) - CodegenTime: 762.345us - CompileTime: 11.208ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 27 (27) - NumInstructions: 373 (373) - OptimizationTime: 36.406ms - PeakMemoryUsage: 186.50 KB (190976) - PrepareTime: 23.976ms HDFS_SCAN_NODE (id=1):(Total: 110.884ms, non-child: 110.884ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:1/7.00 MB 0:1/7.00 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 2 out of 2 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:4 BytesRead(500.000ms): 0, 4.18 MB - FooterProcessingTime: (Avg: 39.515ms ; Min: 37.960ms ; Max: 41.069ms ; Number of samples: 2) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 4.18 MB (4381492) - BytesReadDataNodeCache: 0 - BytesReadLocal: 4.18 MB (4381492) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 4.18 MB (4381492) - DecompressionTime: 3.463ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 2 (2) - NumRowGroups: 2 (2) - NumScannerThreadsStarted: 2 (2) - PeakMemoryUsage: 16.56 MB (17360807) - PerReadThreadRawHdfsThroughput: 56.87 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 109.806ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 740.00K (740000) - RowsReturned: 6.46K (6463) - RowsReturnedRate: 58.28 K/sec - ScanRangesComplete: 2 (2) - ScannerThreadsInvoluntaryContextSwitches: 11 (11) - ScannerThreadsTotalWallClockTime: 258.424ms - MaterializeTupleTime(*): 58.931ms - ScannerThreadsSysTime: 13.997ms - ScannerThreadsUserTime: 48.992ms - ScannerThreadsVoluntaryContextSwitches: 18 (18) - TotalRawHdfsReadTime(*): 73.472ms - TotalReadThroughput: 4.18 MB/sec Instance 7f40dcb034de70b7:2a7 (host=vd1116.foo:22000):(Total: 617.631ms, non-child: 412.433ms, % non-child: 66.78%) Hdfs split stats (:<# splits>/): 1:1/7.00 MB 0:1/7.00 MB MemoryUsage(500.000ms): 7.32 MB ThreadUsage(500.000ms): 3 - AverageThreadTokens: 3.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 20.57 MB (21571042) - PerHostPeakMemUsage: 364.11 MB (381794405) - RowsProduced: 6.61K (6609) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 361.047ms - TotalStorageWaitTime: 233.728ms - TotalThreadsInvoluntaryContextSwitches: 35 (35) - TotalThreadsTotalWallClockTime: 877.244ms - TotalThreadsSysTime: 38.993ms - TotalThreadsUserTime: 99.984ms - TotalThreadsVoluntaryContextSwitches: 294 (294) Fragment Instance Lifecycle Timings: - ExecTime: 532.714ms - ExecTreeExecTime: 125.881ms - OpenTime: 43.640ms - ExecTreeOpenTime: 27.385us - PrepareTime: 41.226ms - ExecTreePrepareTime: 145.476us DataStreamSender (dst_id=26):(Total: 19.844ms, non-child: 19.844ms, % non-child: 100.00%) - BytesSent: 12.20 MB (12787486) - NetworkThroughput(*): 702.63 MB/sec - OverallThroughput: 614.53 MB/sec - PeakMemoryUsage: 816.56 KB (836160) - RowsReturned: 6.61K (6609) - SerializeBatchTime: 2.007ms - TransmitDataRPCTime: 17.356ms - UncompressedRowBatchSize: 31.46 MB (32990666) CodeGen:(Total: 59.116ms, non-child: 59.116ms, % non-child: 100.00%) - CodegenTime: 621.610us - CompileTime: 9.399ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 27 (27) - NumInstructions: 373 (373) - OptimizationTime: 31.513ms - PeakMemoryUsage: 186.50 KB (190976) - PrepareTime: 17.867ms HDFS_SCAN_NODE (id=1):(Total: 126.236ms, non-child: 126.236ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:1/7.00 MB 0:1/7.00 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 2 out of 2 Hdfs Read Thread Concurrency Bucket: 0:0% 1:100% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:4 BytesRead(500.000ms): 3.17 MB - FooterProcessingTime: (Avg: 47.038ms ; Min: 46.536ms ; Max: 47.540ms ; Number of samples: 2) - AverageHdfsReadThreadConcurrency: 1.00 - AverageScannerThreadConcurrency: 2.00 - BytesRead: 4.18 MB (4381459) - BytesReadDataNodeCache: 0 - BytesReadLocal: 4.18 MB (4381459) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 4.18 MB (4381459) - DecompressionTime: 2.995ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 2 (2) - NumRowGroups: 2 (2) - NumScannerThreadsStarted: 2 (2) - PeakMemoryUsage: 16.91 MB (17727898) - PerReadThreadRawHdfsThroughput: 52.21 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 125.328ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 740.00K (740000) - RowsReturned: 6.61K (6609) - RowsReturnedRate: 52.35 K/sec - ScanRangesComplete: 2 (2) - ScannerThreadsInvoluntaryContextSwitches: 11 (11) - ScannerThreadsTotalWallClockTime: 302.551ms - MaterializeTupleTime(*): 62.215ms - ScannerThreadsSysTime: 12.997ms - ScannerThreadsUserTime: 50.991ms - ScannerThreadsVoluntaryContextSwitches: 14 (14) - TotalRawHdfsReadTime(*): 80.036ms - TotalReadThroughput: 6.35 MB/sec Instance 7f40dcb034de70b7:295 (host=vd1121.foo:22000):(Total: 617.537ms, non-child: 401.816ms, % non-child: 65.07%) Hdfs split stats (:<# splits>/): 2:1/7.37 MB MemoryUsage(500.000ms): 2.85 MB ThreadUsage(500.000ms): 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 11.38 MB (11928263) - PerHostPeakMemUsage: 373.22 MB (391354701) - RowsProduced: 3.52K (3515) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 324.270ms - TotalStorageWaitTime: 93.713ms - TotalThreadsInvoluntaryContextSwitches: 32 (32) - TotalThreadsTotalWallClockTime: 678.848ms - TotalThreadsSysTime: 21.997ms - TotalThreadsUserTime: 93.985ms - TotalThreadsVoluntaryContextSwitches: 294 (294) Fragment Instance Lifecycle Timings: - ExecTime: 489.398ms - ExecTreeExecTime: 116.008ms - OpenTime: 52.967ms - ExecTreeOpenTime: 38.424us - PrepareTime: 75.105ms - ExecTreePrepareTime: 334.922us DataStreamSender (dst_id=26):(Total: 15.600ms, non-child: 15.600ms, % non-child: 100.00%) - BytesSent: 6.48 MB (6794604) - NetworkThroughput(*): 467.89 MB/sec - OverallThroughput: 415.37 MB/sec - PeakMemoryUsage: 816.56 KB (836160) - RowsReturned: 3.52K (3515) - SerializeBatchTime: 912.229us - TransmitDataRPCTime: 13.849ms - UncompressedRowBatchSize: 16.73 MB (17546898) CodeGen:(Total: 83.243ms, non-child: 83.243ms, % non-child: 100.00%) - CodegenTime: 1.222ms - CompileTime: 11.649ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 27 (27) - NumInstructions: 373 (373) - OptimizationTime: 39.989ms - PeakMemoryUsage: 186.50 KB (190976) - PrepareTime: 31.077ms HDFS_SCAN_NODE (id=1):(Total: 116.876ms, non-child: 116.876ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:1/7.37 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:2 BytesRead(500.000ms): 100.00 KB - FooterProcessingTime: (Avg: 49.137ms ; Min: 49.137ms ; Max: 49.137ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 2.19 MB (2298321) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.19 MB (2298321) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 2.19 MB (2298321) - DecompressionTime: 3.508ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 7.63 MB (7999103) - PerReadThreadRawHdfsThroughput: 47.21 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 115.296ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 390.00K (390000) - RowsReturned: 3.52K (3515) - RowsReturnedRate: 30.07 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 8 (8) - ScannerThreadsTotalWallClockTime: 136.867ms - MaterializeTupleTime(*): 37.143ms - ScannerThreadsSysTime: 5.999ms - ScannerThreadsUserTime: 33.994ms - ScannerThreadsVoluntaryContextSwitches: 18 (18) - TotalRawHdfsReadTime(*): 46.423ms - TotalReadThroughput: 200.00 KB/sec Instance 7f40dcb034de70b7:28a (host=vd1328.foo:22000):(Total: 616.936ms, non-child: 347.243ms, % non-child: 56.29%) Hdfs split stats (:<# splits>/): 5:1/7.19 MB MemoryUsage(500.000ms): 1011.06 KB, 2.34 MB ThreadUsage(500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 11.12 MB (11660228) - PerHostPeakMemUsage: 401.02 MB (420496354) - RowsProduced: 3.45K (3452) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 296.483ms - TotalStorageWaitTime: 158.840ms - TotalThreadsInvoluntaryContextSwitches: 31 (31) - TotalThreadsTotalWallClockTime: 763.343ms - TotalThreadsSysTime: 17.996ms - TotalThreadsUserTime: 83.987ms - TotalThreadsVoluntaryContextSwitches: 272 (272) Fragment Instance Lifecycle Timings: - ExecTime: 517.377ms - ExecTreeExecTime: 180.373ms - OpenTime: 52.086ms - ExecTreeOpenTime: 56.433us - PrepareTime: 47.429ms - ExecTreePrepareTime: 116.161us DataStreamSender (dst_id=26):(Total: 12.124ms, non-child: 12.124ms, % non-child: 100.00%) - BytesSent: 6.36 MB (6669046) - NetworkThroughput(*): 589.34 MB/sec - OverallThroughput: 524.55 MB/sec - PeakMemoryUsage: 816.56 KB (836160) - RowsReturned: 3.45K (3452) - SerializeBatchTime: 958.598us - TransmitDataRPCTime: 10.791ms - UncompressedRowBatchSize: 16.43 MB (17226638) CodeGen:(Total: 76.884ms, non-child: 76.884ms, % non-child: 100.00%) - CodegenTime: 746.009us - CompileTime: 12.446ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 27 (27) - NumInstructions: 373 (373) - OptimizationTime: 38.571ms - PeakMemoryUsage: 186.50 KB (190976) - PrepareTime: 25.427ms HDFS_SCAN_NODE (id=1):(Total: 180.683ms, non-child: 180.683ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:1/7.19 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:2 BytesRead(500.000ms): 0, 2.14 MB - FooterProcessingTime: (Avg: 38.422ms ; Min: 38.422ms ; Max: 38.422ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 2.14 MB (2244527) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.14 MB (2244527) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 2.14 MB (2244527) - DecompressionTime: 1.466ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 7.41 MB (7774076) - PerReadThreadRawHdfsThroughput: 52.39 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 179.971ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 380.00K (380000) - RowsReturned: 3.45K (3452) - RowsReturnedRate: 19.11 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 7 (7) - ScannerThreadsTotalWallClockTime: 194.131ms - MaterializeTupleTime(*): 27.182ms - ScannerThreadsSysTime: 6.998ms - ScannerThreadsUserTime: 22.996ms - ScannerThreadsVoluntaryContextSwitches: 6 (6) - TotalRawHdfsReadTime(*): 40.859ms - TotalReadThroughput: 2.14 MB/sec Instance 7f40dcb034de70b7:2aa (host=ve1131.foo:22000):(Total: 616.636ms, non-child: 375.859ms, % non-child: 60.95%) Hdfs split stats (:<# splits>/): 1:1/7.01 MB MemoryUsage(500.000ms): 966.06 KB ThreadUsage(500.000ms): 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 10.78 MB (11304610) - PerHostPeakMemUsage: 357.08 MB (374420546) - RowsProduced: 3.25K (3249) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 306.969ms - TotalStorageWaitTime: 110.799ms - TotalThreadsInvoluntaryContextSwitches: 30 (30) - TotalThreadsTotalWallClockTime: 708.724ms - TotalThreadsSysTime: 27.995ms - TotalThreadsUserTime: 92.985ms - TotalThreadsVoluntaryContextSwitches: 265 (265) Fragment Instance Lifecycle Timings: - ExecTime: 499.715ms - ExecTreeExecTime: 132.784ms - OpenTime: 60.274ms - ExecTreeOpenTime: 36.074us - PrepareTime: 56.593ms - ExecTreePrepareTime: 124.365us DataStreamSender (dst_id=26):(Total: 20.261ms, non-child: 20.261ms, % non-child: 100.00%) - BytesSent: 5.97 MB (6260078) - NetworkThroughput(*): 314.86 MB/sec - OverallThroughput: 294.65 MB/sec - PeakMemoryUsage: 816.56 KB (836160) - RowsReturned: 3.25K (3249) - SerializeBatchTime: 862.767us - TransmitDataRPCTime: 18.961ms - UncompressedRowBatchSize: 15.47 MB (16216948) CodeGen:(Total: 87.426ms, non-child: 87.426ms, % non-child: 100.00%) - CodegenTime: 1.173ms - CompileTime: 12.711ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 27 (27) - NumInstructions: 373 (373) - OptimizationTime: 45.861ms - PeakMemoryUsage: 186.50 KB (190976) - PrepareTime: 28.308ms HDFS_SCAN_NODE (id=1):(Total: 133.089ms, non-child: 133.089ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:1/7.01 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:2 BytesRead(500.000ms): 0 - FooterProcessingTime: (Avg: 59.908ms ; Min: 59.908ms ; Max: 59.908ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 2.09 MB (2190735) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.09 MB (2190735) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 2.09 MB (2190735) - DecompressionTime: 1.565ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 7.05 MB (7396954) - PerReadThreadRawHdfsThroughput: 48.55 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 132.331ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 370.00K (370000) - RowsReturned: 3.25K (3249) - RowsReturnedRate: 24.41 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 8 (8) - ScannerThreadsTotalWallClockTime: 149.057ms - MaterializeTupleTime(*): 34.982ms - ScannerThreadsSysTime: 8.998ms - ScannerThreadsUserTime: 27.995ms - ScannerThreadsVoluntaryContextSwitches: 6 (6) - TotalRawHdfsReadTime(*): 43.035ms - TotalReadThroughput: 0.00 /sec Instance 7f40dcb034de70b7:2a6 (host=vc1506.foo:22000):(Total: 616.587ms, non-child: 392.690ms, % non-child: 63.69%) Hdfs split stats (:<# splits>/): 6:1/7.37 MB MemoryUsage(500.000ms): 966.06 KB ThreadUsage(500.000ms): 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 11.44 MB (11992775) - PerHostPeakMemUsage: 370.36 MB (388345902) - RowsProduced: 3.51K (3511) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 333.151ms - TotalStorageWaitTime: 114.004ms - TotalThreadsInvoluntaryContextSwitches: 33 (33) - TotalThreadsTotalWallClockTime: 722.325ms - TotalThreadsSysTime: 27.995ms - TotalThreadsUserTime: 78.988ms - TotalThreadsVoluntaryContextSwitches: 282 (282) Fragment Instance Lifecycle Timings: - ExecTime: 520.018ms - ExecTreeExecTime: 135.450ms - OpenTime: 49.457ms - ExecTreeOpenTime: 66.559us - PrepareTime: 47.071ms - ExecTreePrepareTime: 147.552us DataStreamSender (dst_id=26):(Total: 14.616ms, non-child: 14.616ms, % non-child: 100.00%) - BytesSent: 6.45 MB (6765660) - NetworkThroughput(*): 493.54 MB/sec - OverallThroughput: 441.44 MB/sec - PeakMemoryUsage: 816.56 KB (836160) - RowsReturned: 3.51K (3511) - SerializeBatchTime: 1.178ms - TransmitDataRPCTime: 13.073ms - UncompressedRowBatchSize: 16.70 MB (17514470) CodeGen:(Total: 73.416ms, non-child: 73.416ms, % non-child: 100.00%) - CodegenTime: 890.986us - CompileTime: 11.756ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 27 (27) - NumInstructions: 373 (373) - OptimizationTime: 36.239ms - PeakMemoryUsage: 186.50 KB (190976) - PrepareTime: 24.994ms HDFS_SCAN_NODE (id=1):(Total: 135.864ms, non-child: 135.864ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 6:1/7.37 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:2 BytesRead(500.000ms): 0 - FooterProcessingTime: (Avg: 46.150ms ; Min: 46.150ms ; Max: 46.150ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 2.19 MB (2298335) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.19 MB (2298335) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 2.19 MB (2298335) - DecompressionTime: 2.111ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 7.73 MB (8106623) - PerReadThreadRawHdfsThroughput: 50.05 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 135.040ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 390.00K (390000) - RowsReturned: 3.51K (3511) - RowsReturnedRate: 25.84 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 5 (5) - ScannerThreadsTotalWallClockTime: 153.112ms - MaterializeTupleTime(*): 35.068ms - ScannerThreadsSysTime: 14.997ms - ScannerThreadsUserTime: 22.996ms - ScannerThreadsVoluntaryContextSwitches: 7 (7) - TotalRawHdfsReadTime(*): 43.792ms - TotalReadThroughput: 0.00 /sec Instance 7f40dcb034de70b7:2b0 (host=vc1522.foo:22000):(Total: 616.308ms, non-child: 267.959ms, % non-child: 43.48%) Hdfs split stats (:<# splits>/): 6:1/7.19 MB MemoryUsage(500.000ms): 7.20 MB ThreadUsage(500.000ms): 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 11.12 MB (11660228) - PerHostPeakMemUsage: 372.85 MB (390966634) - RowsProduced: 3.52K (3525) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 207.326ms - TotalStorageWaitTime: 171.163ms - TotalThreadsInvoluntaryContextSwitches: 32 (32) - TotalThreadsTotalWallClockTime: 839.330ms - TotalThreadsSysTime: 20.996ms - TotalThreadsUserTime: 96.985ms - TotalThreadsVoluntaryContextSwitches: 310 (310) Fragment Instance Lifecycle Timings: - ExecTime: 509.285ms - ExecTreeExecTime: 259.646ms - OpenTime: 56.707ms - ExecTreeOpenTime: 40.955us - PrepareTime: 50.272ms - ExecTreePrepareTime: 124.654us DataStreamSender (dst_id=26):(Total: 11.354ms, non-child: 11.354ms, % non-child: 100.00%) - BytesSent: 6.50 MB (6818590) - NetworkThroughput(*): 660.91 MB/sec - OverallThroughput: 572.71 MB/sec - PeakMemoryUsage: 816.56 KB (836160) - RowsReturned: 3.52K (3525) - SerializeBatchTime: 961.073us - TransmitDataRPCTime: 9.838ms - UncompressedRowBatchSize: 16.78 MB (17596746) CodeGen:(Total: 77.025ms, non-child: 77.025ms, % non-child: 100.00%) - CodegenTime: 1.429ms - CompileTime: 10.246ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 27 (27) - NumInstructions: 373 (373) - OptimizationTime: 44.721ms - PeakMemoryUsage: 186.50 KB (190976) - PrepareTime: 21.508ms HDFS_SCAN_NODE (id=1):(Total: 259.969ms, non-child: 259.969ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 6:1/7.19 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:2 BytesRead(500.000ms): 2.14 MB - FooterProcessingTime: (Avg: 126.778ms ; Min: 126.778ms ; Max: 126.778ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 2.14 MB (2244494) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.14 MB (2244494) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 2.14 MB (2244494) - DecompressionTime: 1.785ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 7.54 MB (7903100) - PerReadThreadRawHdfsThroughput: 57.29 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 259.382ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 380.00K (380000) - RowsReturned: 3.52K (3525) - RowsReturnedRate: 13.56 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 8 (8) - ScannerThreadsTotalWallClockTime: 273.659ms - MaterializeTupleTime(*): 37.084ms - ScannerThreadsSysTime: 7.998ms - ScannerThreadsUserTime: 30.995ms - ScannerThreadsVoluntaryContextSwitches: 9 (9) - TotalRawHdfsReadTime(*): 37.364ms - TotalReadThroughput: 4.28 MB/sec Instance 7f40dcb034de70b7:2c1 (host=ve1127.foo:22000):(Total: 615.347ms, non-child: 321.999ms, % non-child: 52.33%) Hdfs split stats (:<# splits>/): 7:1/7.00 MB 0:1/7.18 MB MemoryUsage(500.000ms): 12.28 MB ThreadUsage(500.000ms): 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 20.81 MB (21819140) - PerHostPeakMemUsage: 372.05 MB (390119133) - RowsProduced: 6.82K (6824) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 268.654ms - TotalStorageWaitTime: 210.113ms - TotalThreadsInvoluntaryContextSwitches: 47 (47) - TotalThreadsTotalWallClockTime: 1s001ms - TotalThreadsSysTime: 35.993ms - TotalThreadsUserTime: 125.979ms - TotalThreadsVoluntaryContextSwitches: 310 (310) Fragment Instance Lifecycle Timings: - ExecTime: 504.136ms - ExecTreeExecTime: 184.273ms - OpenTime: 58.430ms - ExecTreeOpenTime: 31.570us - PrepareTime: 52.736ms - ExecTreePrepareTime: 158.612us DataStreamSender (dst_id=26):(Total: 23.022ms, non-child: 23.022ms, % non-child: 100.00%) - BytesSent: 12.55 MB (13164160) - NetworkThroughput(*): 618.84 MB/sec - OverallThroughput: 545.30 MB/sec - PeakMemoryUsage: 816.56 KB (836160) - RowsReturned: 6.82K (6824) - SerializeBatchTime: 2.056ms - TransmitDataRPCTime: 20.286ms - UncompressedRowBatchSize: 32.48 MB (34053822) CodeGen:(Total: 85.666ms, non-child: 85.666ms, % non-child: 100.00%) - CodegenTime: 915.146us - CompileTime: 12.381ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 27 (27) - NumInstructions: 373 (373) - OptimizationTime: 44.189ms - PeakMemoryUsage: 186.50 KB (190976) - PrepareTime: 28.477ms HDFS_SCAN_NODE (id=1):(Total: 184.658ms, non-child: 184.658ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:1/7.00 MB 0:1/7.18 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 2 out of 2 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:4 BytesRead(500.000ms): 4.23 MB - FooterProcessingTime: (Avg: 44.306ms ; Min: 41.490ms ; Max: 47.121ms ; Number of samples: 2) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 4.23 MB (4435214) - BytesReadDataNodeCache: 0 - BytesReadLocal: 4.23 MB (4435214) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 4.23 MB (4435214) - DecompressionTime: 4.015ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 2 (2) - NumRowGroups: 2 (2) - NumScannerThreadsStarted: 2 (2) - PeakMemoryUsage: 17.25 MB (18083516) - PerReadThreadRawHdfsThroughput: 61.73 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 183.477ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 750.00K (750000) - RowsReturned: 6.82K (6824) - RowsReturnedRate: 36.95 K/sec - ScanRangesComplete: 2 (2) - ScannerThreadsInvoluntaryContextSwitches: 11 (11) - ScannerThreadsTotalWallClockTime: 438.798ms - MaterializeTupleTime(*): 67.135ms - ScannerThreadsSysTime: 11.997ms - ScannerThreadsUserTime: 60.989ms - ScannerThreadsVoluntaryContextSwitches: 14 (14) - TotalRawHdfsReadTime(*): 68.521ms - TotalReadThroughput: 8.46 MB/sec Instance 7f40dcb034de70b7:284 (host=va1037.foo:22000):(Total: 615.038ms, non-child: 373.097ms, % non-child: 60.66%) Hdfs split stats (:<# splits>/): 2:1/7.01 MB MemoryUsage(500.000ms): 966.06 KB ThreadUsage(500.000ms): 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 10.82 MB (11347618) - PerHostPeakMemUsage: 321.06 MB (336658317) - RowsProduced: 3.38K (3384) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 304.427ms - TotalStorageWaitTime: 114.490ms - TotalThreadsInvoluntaryContextSwitches: 24 (24) - TotalThreadsTotalWallClockTime: 722.710ms - TotalThreadsSysTime: 27.995ms - TotalThreadsUserTime: 87.986ms - TotalThreadsVoluntaryContextSwitches: 284 (284) Fragment Instance Lifecycle Timings: - ExecTime: 503.662ms - ExecTreeExecTime: 152.098ms - OpenTime: 47.773ms - ExecTreeOpenTime: 26.228us - PrepareTime: 63.558ms - ExecTreePrepareTime: 167.657us DataStreamSender (dst_id=26):(Total: 16.451ms, non-child: 16.451ms, % non-child: 100.00%) - BytesSent: 6.22 MB (6519100) - NetworkThroughput(*): 409.53 MB/sec - OverallThroughput: 377.90 MB/sec - PeakMemoryUsage: 816.56 KB (836160) - RowsReturned: 3.38K (3384) - SerializeBatchTime: 792.407us - TransmitDataRPCTime: 15.181ms - UncompressedRowBatchSize: 16.10 MB (16885876) CodeGen:(Total: 72.937ms, non-child: 72.937ms, % non-child: 100.00%) - CodegenTime: 880.904us - CompileTime: 10.258ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 27 (27) - NumInstructions: 373 (373) - OptimizationTime: 35.857ms - PeakMemoryUsage: 186.50 KB (190976) - PrepareTime: 26.361ms HDFS_SCAN_NODE (id=1):(Total: 152.551ms, non-child: 152.551ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:1/7.01 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:2 BytesRead(500.000ms): 0 - FooterProcessingTime: (Avg: 47.363ms ; Min: 47.363ms ; Max: 47.363ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 2.09 MB (2190770) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.09 MB (2190770) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 2.09 MB (2190770) - DecompressionTime: 1.596ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 7.20 MB (7547482) - PerReadThreadRawHdfsThroughput: 49.90 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 151.758ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 370.00K (370000) - RowsReturned: 3.38K (3384) - RowsReturnedRate: 22.18 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 6 (6) - ScannerThreadsTotalWallClockTime: 171.975ms - MaterializeTupleTime(*): 46.979ms - ScannerThreadsSysTime: 7.998ms - ScannerThreadsUserTime: 35.994ms - ScannerThreadsVoluntaryContextSwitches: 9 (9) - TotalRawHdfsReadTime(*): 41.872ms - TotalReadThroughput: 0.00 /sec Instance 7f40dcb034de70b7:293 (host=ve1142.foo:22000):(Total: 614.890ms, non-child: 404.052ms, % non-child: 65.71%) Hdfs split stats (:<# splits>/): 3:1/7.19 MB MemoryUsage(500.000ms): 5.27 MB ThreadUsage(500.000ms): 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 11.14 MB (11681732) - PerHostPeakMemUsage: 352.51 MB (369628408) - RowsProduced: 3.39K (3389) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 328.890ms - TotalStorageWaitTime: 98.471ms - TotalThreadsInvoluntaryContextSwitches: 29 (29) - TotalThreadsTotalWallClockTime: 693.598ms - TotalThreadsSysTime: 22.996ms - TotalThreadsUserTime: 86.986ms - TotalThreadsVoluntaryContextSwitches: 269 (269) Fragment Instance Lifecycle Timings: - ExecTime: 507.585ms - ExecTreeExecTime: 119.610ms - OpenTime: 49.802ms - ExecTreeOpenTime: 63.740us - PrepareTime: 57.444ms - ExecTreePrepareTime: 114.154us DataStreamSender (dst_id=26):(Total: 15.468ms, non-child: 15.468ms, % non-child: 100.00%) - BytesSent: 6.25 MB (6552064) - NetworkThroughput(*): 439.83 MB/sec - OverallThroughput: 403.97 MB/sec - PeakMemoryUsage: 816.56 KB (836160) - RowsReturned: 3.39K (3389) - SerializeBatchTime: 740.397us - TransmitDataRPCTime: 14.206ms - UncompressedRowBatchSize: 16.14 MB (16919510) CodeGen:(Total: 75.447ms, non-child: 75.447ms, % non-child: 100.00%) - CodegenTime: 890.452us - CompileTime: 11.030ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 27 (27) - NumInstructions: 373 (373) - OptimizationTime: 37.398ms - PeakMemoryUsage: 186.50 KB (190976) - PrepareTime: 26.386ms HDFS_SCAN_NODE (id=1):(Total: 119.923ms, non-child: 119.923ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:1/7.19 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:2 BytesRead(500.000ms): 2.14 MB - FooterProcessingTime: (Avg: 40.930ms ; Min: 40.930ms ; Max: 40.930ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 2.14 MB (2244594) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.14 MB (2244594) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 2.14 MB (2244594) - DecompressionTime: 1.716ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 7.48 MB (7838588) - PerReadThreadRawHdfsThroughput: 47.96 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 119.181ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 380.00K (380000) - RowsReturned: 3.39K (3389) - RowsReturnedRate: 28.26 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 6 (6) - ScannerThreadsTotalWallClockTime: 136.441ms - MaterializeTupleTime(*): 34.394ms - ScannerThreadsSysTime: 6.998ms - ScannerThreadsUserTime: 29.995ms - ScannerThreadsVoluntaryContextSwitches: 4 (4) - TotalRawHdfsReadTime(*): 44.628ms - TotalReadThroughput: 4.28 MB/sec Instance 7f40dcb034de70b7:294 (host=va1026.foo:22000):(Total: 614.340ms, non-child: 345.355ms, % non-child: 56.22%) Hdfs split stats (:<# splits>/): 3:1/7.19 MB MemoryUsage(500.000ms): 5.31 MB ThreadUsage(500.000ms): 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 11.14 MB (11681732) - PerHostPeakMemUsage: 240.46 MB (252137337) - RowsProduced: 3.44K (3444) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 283.451ms - TotalStorageWaitTime: 118.673ms - TotalThreadsInvoluntaryContextSwitches: 190 (190) - TotalThreadsTotalWallClockTime: 772.542ms - TotalThreadsSysTime: 17.996ms - TotalThreadsUserTime: 85.986ms - TotalThreadsVoluntaryContextSwitches: 285 (285) Fragment Instance Lifecycle Timings: - ExecTime: 514.614ms - ExecTreeExecTime: 188.786ms - OpenTime: 56.722ms - ExecTreeOpenTime: 54.985us - PrepareTime: 42.951ms - ExecTreePrepareTime: 110.223us DataStreamSender (dst_id=26):(Total: 5.524ms, non-child: 5.524ms, % non-child: 100.00%) - BytesSent: 6.37 MB (6684456) - NetworkThroughput(*): 1.46 GB/sec - OverallThroughput: 1.13 GB/sec - PeakMemoryUsage: 816.56 KB (836160) - RowsReturned: 3.44K (3444) - SerializeBatchTime: 934.517us - TransmitDataRPCTime: 4.260ms - UncompressedRowBatchSize: 16.40 MB (17193674) CodeGen:(Total: 74.383ms, non-child: 74.383ms, % non-child: 100.00%) - CodegenTime: 2.896ms - CompileTime: 13.305ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 27 (27) - NumInstructions: 373 (373) - OptimizationTime: 42.225ms - PeakMemoryUsage: 186.50 KB (190976) - PrepareTime: 18.356ms HDFS_SCAN_NODE (id=1):(Total: 189.077ms, non-child: 189.077ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:1/7.19 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:2 BytesRead(500.000ms): 2.14 MB - FooterProcessingTime: (Avg: 61.519ms ; Min: 61.519ms ; Max: 61.519ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 2.14 MB (2244599) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.14 MB (2244599) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 2.14 MB (2244599) - DecompressionTime: 1.400ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 7.52 MB (7881596) - PerReadThreadRawHdfsThroughput: 46.81 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 188.427ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 380.00K (380000) - RowsReturned: 3.44K (3444) - RowsReturnedRate: 18.21 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 4 (4) - ScannerThreadsTotalWallClockTime: 201.497ms - MaterializeTupleTime(*): 28.045ms - ScannerThreadsSysTime: 7.998ms - ScannerThreadsUserTime: 21.996ms - ScannerThreadsVoluntaryContextSwitches: 11 (11) - TotalRawHdfsReadTime(*): 45.734ms - TotalReadThroughput: 4.28 MB/sec Instance 7f40dcb034de70b7:28f (host=vd1337.foo:22000):(Total: 614.253ms, non-child: 398.136ms, % non-child: 64.82%) Hdfs split stats (:<# splits>/): 1:1/7.19 MB MemoryUsage(500.000ms): 0, 830.06 KB ThreadUsage(500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 11.06 MB (11595716) - PerHostPeakMemUsage: 343.81 MB (360515636) - RowsProduced: 3.45K (3450) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 302.776ms - TotalStorageWaitTime: 86.567ms - TotalThreadsInvoluntaryContextSwitches: 35 (35) - TotalThreadsTotalWallClockTime: 691.672ms - TotalThreadsSysTime: 21.995ms - TotalThreadsUserTime: 107.983ms - TotalThreadsVoluntaryContextSwitches: 290 (290) Fragment Instance Lifecycle Timings: - ExecTime: 493.492ms - ExecTreeExecTime: 115.665ms - OpenTime: 65.671ms - ExecTreeOpenTime: 34.184us - PrepareTime: 55.041ms - ExecTreePrepareTime: 146.647us DataStreamSender (dst_id=26):(Total: 11.654ms, non-child: 11.654ms, % non-child: 100.00%) - BytesSent: 6.34 MB (6643318) - NetworkThroughput(*): 623.90 MB/sec - OverallThroughput: 543.62 MB/sec - PeakMemoryUsage: 816.56 KB (836160) - RowsReturned: 3.45K (3450) - SerializeBatchTime: 980.205us - TransmitDataRPCTime: 10.154ms - UncompressedRowBatchSize: 16.42 MB (17219402) CodeGen:(Total: 88.438ms, non-child: 88.438ms, % non-child: 100.00%) - CodegenTime: 1.061ms - CompileTime: 13.751ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 27 (27) - NumInstructions: 373 (373) - OptimizationTime: 50.563ms - PeakMemoryUsage: 186.50 KB (190976) - PrepareTime: 23.544ms HDFS_SCAN_NODE (id=1):(Total: 116.024ms, non-child: 116.024ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:1/7.19 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:2 BytesRead(500.000ms): 0 - FooterProcessingTime: (Avg: 34.983ms ; Min: 34.983ms ; Max: 34.983ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 2.14 MB (2244559) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.14 MB (2244559) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 2.14 MB (2244559) - DecompressionTime: 2.143ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 7.45 MB (7817084) - PerReadThreadRawHdfsThroughput: 68.81 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 115.188ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 380.00K (380000) - RowsReturned: 3.45K (3450) - RowsReturnedRate: 29.73 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 6 (6) - ScannerThreadsTotalWallClockTime: 132.819ms - MaterializeTupleTime(*): 42.299ms - ScannerThreadsSysTime: 7.998ms - ScannerThreadsUserTime: 35.994ms - ScannerThreadsVoluntaryContextSwitches: 5 (5) - TotalRawHdfsReadTime(*): 31.110ms - TotalReadThroughput: 0.00 /sec Instance 7f40dcb034de70b7:27f (host=vc1526.foo:22000):(Total: 614.198ms, non-child: 396.501ms, % non-child: 64.56%) Hdfs split stats (:<# splits>/): 7:1/7.00 MB MemoryUsage(500.000ms): 2.15 MB ThreadUsage(500.000ms): 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 10.88 MB (11412130) - PerHostPeakMemUsage: 286.46 MB (300370302) - RowsProduced: 3.39K (3390) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 332.874ms - TotalStorageWaitTime: 115.713ms - TotalThreadsInvoluntaryContextSwitches: 33 (33) - TotalThreadsTotalWallClockTime: 716.749ms - TotalThreadsSysTime: 21.997ms - TotalThreadsUserTime: 81.986ms - TotalThreadsVoluntaryContextSwitches: 285 (285) Fragment Instance Lifecycle Timings: - ExecTime: 517.023ms - ExecTreeExecTime: 132.557ms - OpenTime: 52.608ms - ExecTreeOpenTime: 31.704us - PrepareTime: 44.524ms - ExecTreePrepareTime: 123.153us DataStreamSender (dst_id=26):(Total: 12.645ms, non-child: 12.645ms, % non-child: 100.00%) - BytesSent: 6.23 MB (6529686) - NetworkThroughput(*): 552.86 MB/sec - OverallThroughput: 492.43 MB/sec - PeakMemoryUsage: 816.56 KB (836160) - RowsReturned: 3.39K (3390) - SerializeBatchTime: 986.654us - TransmitDataRPCTime: 11.263ms - UncompressedRowBatchSize: 16.13 MB (16916160) CodeGen:(Total: 72.186ms, non-child: 72.186ms, % non-child: 100.00%) - CodegenTime: 922.478us - CompileTime: 11.188ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 27 (27) - NumInstructions: 373 (373) - OptimizationTime: 40.116ms - PeakMemoryUsage: 186.50 KB (190976) - PrepareTime: 20.455ms HDFS_SCAN_NODE (id=1):(Total: 132.865ms, non-child: 132.865ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:1/7.00 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:2 BytesRead(500.000ms): 2.09 MB - FooterProcessingTime: (Avg: 54.447ms ; Min: 54.447ms ; Max: 54.447ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 2.09 MB (2190721) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.09 MB (2190721) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 2.09 MB (2190721) - DecompressionTime: 1.631ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 7.26 MB (7611994) - PerReadThreadRawHdfsThroughput: 45.62 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 132.170ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 370.00K (370000) - RowsReturned: 3.39K (3390) - RowsReturnedRate: 25.51 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 6 (6) - ScannerThreadsTotalWallClockTime: 147.348ms - MaterializeTupleTime(*): 28.339ms - ScannerThreadsSysTime: 10.998ms - ScannerThreadsUserTime: 19.996ms - ScannerThreadsVoluntaryContextSwitches: 4 (4) - TotalRawHdfsReadTime(*): 45.797ms - TotalReadThroughput: 4.18 MB/sec Instance 7f40dcb034de70b7:2a1 (host=vc1503.foo:22000):(Total: 613.665ms, non-child: 231.418ms, % non-child: 37.71%) Hdfs split stats (:<# splits>/): 0:1/7.00 MB MemoryUsage(500.000ms): 0, 7.74 MB ThreadUsage(500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 10.74 MB (11261602) - PerHostPeakMemUsage: 371.83 MB (389891533) - RowsProduced: 3.45K (3453) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 186.415ms - TotalStorageWaitTime: 168.129ms - TotalThreadsInvoluntaryContextSwitches: 26 (26) - TotalThreadsTotalWallClockTime: 877.217ms - TotalThreadsSysTime: 6.998ms - TotalThreadsUserTime: 99.984ms - TotalThreadsVoluntaryContextSwitches: 293 (293) Fragment Instance Lifecycle Timings: - ExecTime: 513.470ms - ExecTreeExecTime: 295.158ms - OpenTime: 55.758ms - ExecTreeOpenTime: 34.619us - PrepareTime: 44.391ms - ExecTreePrepareTime: 118.507us DataStreamSender (dst_id=26):(Total: 8.861ms, non-child: 8.861ms, % non-child: 100.00%) - BytesSent: 6.39 MB (6703618) - NetworkThroughput(*): 844.99 MB/sec - OverallThroughput: 721.45 MB/sec - PeakMemoryUsage: 816.56 KB (836160) - RowsReturned: 3.45K (3453) - SerializeBatchTime: 879.827us - TransmitDataRPCTime: 7.565ms - UncompressedRowBatchSize: 16.44 MB (17241646) CodeGen:(Total: 77.925ms, non-child: 77.925ms, % non-child: 100.00%) - CodegenTime: 778.182us - CompileTime: 12.343ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 27 (27) - NumInstructions: 373 (373) - OptimizationTime: 42.280ms - PeakMemoryUsage: 186.50 KB (190976) - PrepareTime: 22.864ms HDFS_SCAN_NODE (id=1):(Total: 295.460ms, non-child: 295.460ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/7.00 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:2 BytesRead(500.000ms): 0, 2.09 MB - FooterProcessingTime: (Avg: 42.595ms ; Min: 42.595ms ; Max: 42.595ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 2.09 MB (2190744) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.09 MB (2190744) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 2.09 MB (2190744) - DecompressionTime: 1.745ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 7.18 MB (7525978) - PerReadThreadRawHdfsThroughput: 34.92 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 294.803ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 370.00K (370000) - RowsReturned: 3.45K (3453) - RowsReturnedRate: 11.69 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 5 (5) - ScannerThreadsTotalWallClockTime: 308.226ms - MaterializeTupleTime(*): 33.595ms - ScannerThreadsSysTime: 999.000us - ScannerThreadsUserTime: 34.994ms - ScannerThreadsVoluntaryContextSwitches: 9 (9) - TotalRawHdfsReadTime(*): 59.825ms - TotalReadThroughput: 2.09 MB/sec Instance 7f40dcb034de70b7:2d6 (host=ve1130.foo:22000):(Total: 613.183ms, non-child: 361.333ms, % non-child: 58.93%) Hdfs split stats (:<# splits>/): 5:1/7.19 MB 6:1/7.19 MB MemoryUsage(500.000ms): 1011.06 KB, 10.81 MB ThreadUsage(500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 18.28 MB (19169304) - PerHostPeakMemUsage: 372.00 MB (390068421) - RowsProduced: 6.87K (6874) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 309.711ms - TotalStorageWaitTime: 285.338ms - TotalThreadsInvoluntaryContextSwitches: 50 (50) - TotalThreadsTotalWallClockTime: 1s029ms - TotalThreadsSysTime: 35.994ms - TotalThreadsUserTime: 106.982ms - TotalThreadsVoluntaryContextSwitches: 292 (292) Fragment Instance Lifecycle Timings: - ExecTime: 499.652ms - ExecTreeExecTime: 148.114ms - OpenTime: 60.460ms - ExecTreeOpenTime: 43.736us - PrepareTime: 53.009ms - ExecTreePrepareTime: 198.233us DataStreamSender (dst_id=26):(Total: 16.366ms, non-child: 16.366ms, % non-child: 100.00%) - BytesSent: 12.70 MB (13313838) - NetworkThroughput(*): 906.88 MB/sec - OverallThroughput: 775.81 MB/sec - PeakMemoryUsage: 816.56 KB (836160) - RowsReturned: 6.87K (6874) - SerializeBatchTime: 1.939ms - TransmitDataRPCTime: 14.000ms - UncompressedRowBatchSize: 32.72 MB (34314586) CodeGen:(Total: 86.884ms, non-child: 86.884ms, % non-child: 100.00%) - CodegenTime: 970.292us - CompileTime: 13.755ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 27 (27) - NumInstructions: 373 (373) - OptimizationTime: 45.440ms - PeakMemoryUsage: 186.50 KB (190976) - PrepareTime: 27.145ms HDFS_SCAN_NODE (id=1):(Total: 148.598ms, non-child: 148.598ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:1/7.19 MB 6:1/7.19 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 2 out of 2 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:4 BytesRead(500.000ms): 0, 4.28 MB - FooterProcessingTime: (Avg: 88.374ms ; Min: 70.791ms ; Max: 105.956ms ; Number of samples: 2) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 4.28 MB (4489149) - BytesReadDataNodeCache: 0 - BytesReadLocal: 4.28 MB (4489149) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 4.28 MB (4489149) - DecompressionTime: 2.669ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 2 (2) - NumRowGroups: 2 (2) - NumScannerThreadsStarted: 2 (2) - PeakMemoryUsage: 14.72 MB (15434221) - PerReadThreadRawHdfsThroughput: 53.04 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 147.402ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 760.00K (760000) - RowsReturned: 6.87K (6874) - RowsReturnedRate: 46.26 K/sec - ScanRangesComplete: 2 (2) - ScannerThreadsInvoluntaryContextSwitches: 9 (9) - ScannerThreadsTotalWallClockTime: 469.202ms - MaterializeTupleTime(*): 50.448ms - ScannerThreadsSysTime: 16.997ms - ScannerThreadsUserTime: 38.993ms - ScannerThreadsVoluntaryContextSwitches: 11 (11) - TotalRawHdfsReadTime(*): 80.715ms - TotalReadThroughput: 4.28 MB/sec Instance 7f40dcb034de70b7:285 (host=vc1535.foo:22000):(Total: 612.734ms, non-child: 392.338ms, % non-child: 64.03%) Hdfs split stats (:<# splits>/): 7:1/7.19 MB MemoryUsage(500.000ms): 4.07 MB ThreadUsage(500.000ms): 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 11.10 MB (11638724) - PerHostPeakMemUsage: 317.88 MB (333325065) - RowsProduced: 3.44K (3445) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 328.316ms - TotalStorageWaitTime: 114.287ms - TotalThreadsInvoluntaryContextSwitches: 30 (30) - TotalThreadsTotalWallClockTime: 706.525ms - TotalThreadsSysTime: 24.996ms - TotalThreadsUserTime: 76.987ms - TotalThreadsVoluntaryContextSwitches: 297 (297) Fragment Instance Lifecycle Timings: - ExecTime: 507.259ms - ExecTreeExecTime: 128.621ms - OpenTime: 50.699ms - ExecTreeOpenTime: 31.061us - PrepareTime: 54.735ms - ExecTreePrepareTime: 274.052us DataStreamSender (dst_id=26):(Total: 16.782ms, non-child: 16.782ms, % non-child: 100.00%) - BytesSent: 6.33 MB (6641978) - NetworkThroughput(*): 408.56 MB/sec - OverallThroughput: 377.44 MB/sec - PeakMemoryUsage: 816.56 KB (836160) - RowsReturned: 3.44K (3445) - SerializeBatchTime: 692.950us - TransmitDataRPCTime: 15.503ms - UncompressedRowBatchSize: 16.40 MB (17195818) CodeGen:(Total: 74.396ms, non-child: 74.396ms, % non-child: 100.00%) - CodegenTime: 808.124us - CompileTime: 11.178ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 27 (27) - NumInstructions: 373 (373) - OptimizationTime: 38.216ms - PeakMemoryUsage: 186.50 KB (190976) - PrepareTime: 24.521ms HDFS_SCAN_NODE (id=1):(Total: 129.218ms, non-child: 129.218ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:1/7.19 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:2 BytesRead(500.000ms): 1.62 MB - FooterProcessingTime: (Avg: 45.564ms ; Min: 45.564ms ; Max: 45.564ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 2.14 MB (2244518) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.14 MB (2244518) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 2.14 MB (2244518) - DecompressionTime: 5.520ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 7.52 MB (7881596) - PerReadThreadRawHdfsThroughput: 54.59 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 128.302ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 380.00K (380000) - RowsReturned: 3.44K (3445) - RowsReturnedRate: 26.66 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 6 (6) - ScannerThreadsTotalWallClockTime: 148.907ms - MaterializeTupleTime(*): 27.545ms - ScannerThreadsSysTime: 6.998ms - ScannerThreadsUserTime: 21.996ms - ScannerThreadsVoluntaryContextSwitches: 12 (12) - TotalRawHdfsReadTime(*): 39.211ms - TotalReadThroughput: 3.25 MB/sec Instance 7f40dcb034de70b7:2cd (host=vd1341.foo:22000):(Total: 612.605ms, non-child: 444.633ms, % non-child: 72.58%) Hdfs split stats (:<# splits>/): 0:1/7.01 MB 7:1/7.00 MB MemoryUsage(500.000ms): 16.93 MB ThreadUsage(500.000ms): 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 17.95 MB (18817654) - PerHostPeakMemUsage: 372.06 MB (390132079) - RowsProduced: 6.59K (6586) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 386.012ms - TotalStorageWaitTime: 166.326ms - TotalThreadsInvoluntaryContextSwitches: 33 (33) - TotalThreadsTotalWallClockTime: 788.265ms - TotalThreadsSysTime: 32.993ms - TotalThreadsUserTime: 106.983ms - TotalThreadsVoluntaryContextSwitches: 314 (314) Fragment Instance Lifecycle Timings: - ExecTime: 510.519ms - ExecTreeExecTime: 76.923ms - OpenTime: 45.105ms - ExecTreeOpenTime: 30.570us - PrepareTime: 56.939ms - ExecTreePrepareTime: 119.682us DataStreamSender (dst_id=26):(Total: 22.750ms, non-child: 22.750ms, % non-child: 100.00%) - BytesSent: 12.10 MB (12686316) - NetworkThroughput(*): 587.91 MB/sec - OverallThroughput: 531.80 MB/sec - PeakMemoryUsage: 816.56 KB (836160) - RowsReturned: 6.59K (6586) - SerializeBatchTime: 1.648ms - TransmitDataRPCTime: 20.579ms - UncompressedRowBatchSize: 31.34 MB (32861892) CodeGen:(Total: 68.008ms, non-child: 68.008ms, % non-child: 100.00%) - CodegenTime: 855.317us - CompileTime: 10.046ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 27 (27) - NumInstructions: 373 (373) - OptimizationTime: 33.914ms - PeakMemoryUsage: 186.50 KB (190976) - PrepareTime: 23.603ms HDFS_SCAN_NODE (id=1):(Total: 77.212ms, non-child: 77.212ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/7.01 MB 7:1/7.00 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 2 out of 2 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:4 BytesRead(500.000ms): 4.18 MB - FooterProcessingTime: (Avg: 38.641ms ; Min: 23.083ms ; Max: 54.200ms ; Number of samples: 2) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 4.18 MB (4381431) - BytesReadDataNodeCache: 0 - BytesReadLocal: 4.18 MB (4381431) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 4.18 MB (4381431) - DecompressionTime: 4.258ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 2 (2) - NumRowGroups: 2 (2) - NumScannerThreadsStarted: 2 (2) - PeakMemoryUsage: 14.28 MB (14974510) - PerReadThreadRawHdfsThroughput: 97.98 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 76.269ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 740.00K (740000) - RowsReturned: 6.59K (6586) - RowsReturnedRate: 85.30 K/sec - ScanRangesComplete: 2 (2) - ScannerThreadsInvoluntaryContextSwitches: 12 (12) - ScannerThreadsTotalWallClockTime: 232.941ms - MaterializeTupleTime(*): 59.253ms - ScannerThreadsSysTime: 9.997ms - ScannerThreadsUserTime: 50.991ms - ScannerThreadsVoluntaryContextSwitches: 21 (21) - TotalRawHdfsReadTime(*): 42.644ms - TotalReadThroughput: 8.36 MB/sec Instance 7f40dcb034de70b7:2ad (host=vd1105.foo:22000):(Total: 611.715ms, non-child: 324.524ms, % non-child: 53.05%) Hdfs split stats (:<# splits>/): 1:1/7.19 MB MemoryUsage(500.000ms): 8.12 MB ThreadUsage(500.000ms): 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 11.12 MB (11660228) - PerHostPeakMemUsage: 375.67 MB (393914546) - RowsProduced: 3.44K (3445) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 262.815ms - TotalStorageWaitTime: 134.780ms - TotalThreadsInvoluntaryContextSwitches: 19 (19) - TotalThreadsTotalWallClockTime: 783.946ms - TotalThreadsSysTime: 19.996ms - TotalThreadsUserTime: 75.988ms - TotalThreadsVoluntaryContextSwitches: 286 (286) Fragment Instance Lifecycle Timings: - ExecTime: 515.699ms - ExecTreeExecTime: 210.359ms - OpenTime: 46.585ms - ExecTreeOpenTime: 36.364us - PrepareTime: 49.386ms - ExecTreePrepareTime: 135.795us DataStreamSender (dst_id=26):(Total: 9.960ms, non-child: 9.960ms, % non-child: 100.00%) - BytesSent: 6.38 MB (6691558) - NetworkThroughput(*): 743.73 MB/sec - OverallThroughput: 640.68 MB/sec - PeakMemoryUsage: 816.56 KB (836160) - RowsReturned: 3.44K (3445) - SerializeBatchTime: 807.485us - TransmitDataRPCTime: 8.580ms - UncompressedRowBatchSize: 16.40 MB (17199168) CodeGen:(Total: 66.517ms, non-child: 66.517ms, % non-child: 100.00%) - CodegenTime: 699.958us - CompileTime: 10.426ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 27 (27) - NumInstructions: 373 (373) - OptimizationTime: 33.907ms - PeakMemoryUsage: 186.50 KB (190976) - PrepareTime: 21.773ms HDFS_SCAN_NODE (id=1):(Total: 210.712ms, non-child: 210.712ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:1/7.19 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:2 BytesRead(500.000ms): 2.14 MB - FooterProcessingTime: (Avg: 92.241ms ; Min: 92.241ms ; Max: 92.241ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 2.14 MB (2244525) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.14 MB (2244525) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 2.14 MB (2244525) - DecompressionTime: 1.697ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 7.64 MB (8011652) - PerReadThreadRawHdfsThroughput: 52.29 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 209.938ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 380.00K (380000) - RowsReturned: 3.44K (3445) - RowsReturnedRate: 16.35 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 4 (4) - ScannerThreadsTotalWallClockTime: 223.046ms - MaterializeTupleTime(*): 28.100ms - ScannerThreadsSysTime: 6.998ms - ScannerThreadsUserTime: 23.996ms - ScannerThreadsVoluntaryContextSwitches: 8 (8) - TotalRawHdfsReadTime(*): 40.935ms - TotalReadThroughput: 4.28 MB/sec Instance 7f40dcb034de70b7:2e2 (host=vd1122.foo:22000):(Total: 611.559ms, non-child: 362.422ms, % non-child: 59.26%) Hdfs split stats (:<# splits>/): 5:1/7.19 MB 2:1/7.18 MB MemoryUsage(500.000ms): 18.06 MB ThreadUsage(500.000ms): 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 21.07 MB (22088742) - PerHostPeakMemUsage: 365.74 MB (383501543) - RowsProduced: 6.94K (6940) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 319.130ms - TotalStorageWaitTime: 222.185ms - TotalThreadsInvoluntaryContextSwitches: 32 (32) - TotalThreadsTotalWallClockTime: 954.293ms - TotalThreadsSysTime: 37.994ms - TotalThreadsUserTime: 122.980ms - TotalThreadsVoluntaryContextSwitches: 336 (336) Fragment Instance Lifecycle Timings: - ExecTime: 521.248ms - ExecTreeExecTime: 155.061ms - OpenTime: 48.336ms - ExecTreeOpenTime: 64.388us - PrepareTime: 41.893ms - ExecTreePrepareTime: 102.944us DataStreamSender (dst_id=26):(Total: 30.163ms, non-child: 30.163ms, % non-child: 100.00%) - BytesSent: 12.79 MB (13406700) - NetworkThroughput(*): 468.68 MB/sec - OverallThroughput: 423.88 MB/sec - PeakMemoryUsage: 816.56 KB (836160) - RowsReturned: 6.94K (6940) - SerializeBatchTime: 2.510ms - TransmitDataRPCTime: 27.279ms - UncompressedRowBatchSize: 33.04 MB (34648380) CodeGen:(Total: 63.627ms, non-child: 63.627ms, % non-child: 100.00%) - CodegenTime: 759.079us - CompileTime: 11.903ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 27 (27) - NumInstructions: 373 (373) - OptimizationTime: 34.993ms - PeakMemoryUsage: 186.50 KB (190976) - PrepareTime: 16.312ms HDFS_SCAN_NODE (id=1):(Total: 155.346ms, non-child: 155.346ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:1/7.19 MB 2:1/7.18 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 2 out of 2 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:4 BytesRead(500.000ms): 4.28 MB - FooterProcessingTime: (Avg: 59.646ms ; Min: 53.337ms ; Max: 65.954ms ; Number of samples: 2) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 4.28 MB (4489048) - BytesReadDataNodeCache: 0 - BytesReadLocal: 4.28 MB (4489048) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 4.28 MB (4489048) - DecompressionTime: 3.862ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 2 (2) - NumRowGroups: 2 (2) - NumScannerThreadsStarted: 2 (2) - PeakMemoryUsage: 17.40 MB (18245598) - PerReadThreadRawHdfsThroughput: 52.33 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 153.902ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 760.00K (760000) - RowsReturned: 6.94K (6940) - RowsReturnedRate: 44.67 K/sec - ScanRangesComplete: 2 (2) - ScannerThreadsInvoluntaryContextSwitches: 11 (11) - ScannerThreadsTotalWallClockTime: 385.051ms - MaterializeTupleTime(*): 71.943ms - ScannerThreadsSysTime: 10.998ms - ScannerThreadsUserTime: 66.989ms - ScannerThreadsVoluntaryContextSwitches: 45 (45) - TotalRawHdfsReadTime(*): 81.814ms - TotalReadThroughput: 8.56 MB/sec Instance 7f40dcb034de70b7:2b4 (host=vd1330.foo:22000):(Total: 610.603ms, non-child: 354.844ms, % non-child: 58.11%) Hdfs split stats (:<# splits>/): 0:1/6.82 MB MemoryUsage(500.000ms): 1011.06 KB, 1.79 MB ThreadUsage(500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 10.13 MB (10619025) - PerHostPeakMemUsage: 371.70 MB (389759893) - RowsProduced: 3.23K (3228) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 300.768ms - TotalStorageWaitTime: 145.548ms - TotalThreadsInvoluntaryContextSwitches: 36 (36) - TotalThreadsTotalWallClockTime: 746.770ms - TotalThreadsSysTime: 16.997ms - TotalThreadsUserTime: 92.986ms - TotalThreadsVoluntaryContextSwitches: 299 (299) Fragment Instance Lifecycle Timings: - ExecTime: 510.478ms - ExecTreeExecTime: 167.041ms - OpenTime: 55.423ms - ExecTreeOpenTime: 27.673us - PrepareTime: 44.661ms - ExecTreePrepareTime: 126.127us DataStreamSender (dst_id=26):(Total: 9.155ms, non-child: 9.155ms, % non-child: 100.00%) - BytesSent: 5.91 MB (6196830) - NetworkThroughput(*): 757.44 MB/sec - OverallThroughput: 645.51 MB/sec - PeakMemoryUsage: 816.56 KB (836160) - RowsReturned: 3.23K (3228) - SerializeBatchTime: 1.007ms - TransmitDataRPCTime: 7.802ms - UncompressedRowBatchSize: 15.36 MB (16104790) CodeGen:(Total: 79.256ms, non-child: 79.256ms, % non-child: 100.00%) - CodegenTime: 1.217ms - CompileTime: 11.779ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 27 (27) - NumInstructions: 373 (373) - OptimizationTime: 42.231ms - PeakMemoryUsage: 186.50 KB (190976) - PrepareTime: 24.579ms HDFS_SCAN_NODE (id=1):(Total: 167.347ms, non-child: 167.347ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/6.82 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:2 BytesRead(500.000ms): 0, 2.04 MB - FooterProcessingTime: (Avg: 51.117ms ; Min: 51.117ms ; Max: 51.117ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 2.04 MB (2136944) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.04 MB (2136944) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 2.04 MB (2136944) - DecompressionTime: 1.494ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 6.44 MB (6754377) - PerReadThreadRawHdfsThroughput: 48.14 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 166.695ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 360.00K (360000) - RowsReturned: 3.23K (3228) - RowsReturnedRate: 19.29 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 5 (5) - ScannerThreadsTotalWallClockTime: 181.171ms - MaterializeTupleTime(*): 32.188ms - ScannerThreadsSysTime: 3.999ms - ScannerThreadsUserTime: 30.995ms - ScannerThreadsVoluntaryContextSwitches: 3 (3) - TotalRawHdfsReadTime(*): 42.331ms - TotalReadThroughput: 2.04 MB/sec Instance 7f40dcb034de70b7:2c2 (host=vc1508.foo:22000):(Total: 610.564ms, non-child: 284.343ms, % non-child: 46.57%) Hdfs split stats (:<# splits>/): 3:1/7.19 MB MemoryUsage(500.000ms): 966.06 KB ThreadUsage(500.000ms): 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 11.10 MB (11638724) - PerHostPeakMemUsage: 375.32 MB (393552431) - RowsProduced: 3.40K (3398) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 228.141ms - TotalStorageWaitTime: 119.670ms - TotalThreadsInvoluntaryContextSwitches: 25 (25) - TotalThreadsTotalWallClockTime: 802.918ms - TotalThreadsSysTime: 25.996ms - TotalThreadsUserTime: 105.984ms - TotalThreadsVoluntaryContextSwitches: 289 (289) Fragment Instance Lifecycle Timings: - ExecTime: 494.145ms - ExecTreeExecTime: 227.045ms - OpenTime: 64.206ms - ExecTreeOpenTime: 37.696us - PrepareTime: 52.169ms - ExecTreePrepareTime: 142.124us DataStreamSender (dst_id=26):(Total: 16.658ms, non-child: 16.658ms, % non-child: 100.00%) - BytesSent: 6.26 MB (6569082) - NetworkThroughput(*): 420.36 MB/sec - OverallThroughput: 376.06 MB/sec - PeakMemoryUsage: 816.56 KB (836160) - RowsReturned: 3.40K (3398) - SerializeBatchTime: 1.341ms - TransmitDataRPCTime: 14.903ms - UncompressedRowBatchSize: 16.17 MB (16956360) CodeGen:(Total: 82.163ms, non-child: 82.163ms, % non-child: 100.00%) - CodegenTime: 895.281us - CompileTime: 13.545ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 27 (27) - NumInstructions: 373 (373) - OptimizationTime: 45.569ms - PeakMemoryUsage: 186.50 KB (190976) - PrepareTime: 22.493ms HDFS_SCAN_NODE (id=1):(Total: 227.398ms, non-child: 227.398ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:1/7.19 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:2 BytesRead(500.000ms): 0 - FooterProcessingTime: (Avg: 44.226ms ; Min: 44.226ms ; Max: 44.226ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 2.14 MB (2244572) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.14 MB (2244572) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 2.14 MB (2244572) - DecompressionTime: 5.189ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 7.45 MB (7817084) - PerReadThreadRawHdfsThroughput: 54.64 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 226.582ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 380.00K (380000) - RowsReturned: 3.40K (3398) - RowsReturnedRate: 14.94 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 7 (7) - ScannerThreadsTotalWallClockTime: 248.038ms - MaterializeTupleTime(*): 41.882ms - ScannerThreadsSysTime: 6.998ms - ScannerThreadsUserTime: 38.994ms - ScannerThreadsVoluntaryContextSwitches: 11 (11) - TotalRawHdfsReadTime(*): 39.173ms - TotalReadThroughput: 0.00 /sec Instance 7f40dcb034de70b7:2ba (host=vd1112.foo:22000):(Total: 610.533ms, non-child: 393.547ms, % non-child: 64.46%) Hdfs split stats (:<# splits>/): 6:1/7.00 MB MemoryUsage(500.000ms): 1011.06 KB, 830.06 KB ThreadUsage(500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 10.94 MB (11476642) - PerHostPeakMemUsage: 349.76 MB (366753532) - RowsProduced: 3.39K (3389) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 338.757ms - TotalStorageWaitTime: 108.767ms - TotalThreadsInvoluntaryContextSwitches: 28 (28) - TotalThreadsTotalWallClockTime: 719.334ms - TotalThreadsSysTime: 19.996ms - TotalThreadsUserTime: 87.987ms - TotalThreadsVoluntaryContextSwitches: 286 (286) Fragment Instance Lifecycle Timings: - ExecTime: 520.085ms - ExecTreeExecTime: 129.588ms - OpenTime: 51.217ms - ExecTreeOpenTime: 33.858us - PrepareTime: 39.161ms - ExecTreePrepareTime: 130.109us DataStreamSender (dst_id=26):(Total: 14.704ms, non-child: 14.704ms, % non-child: 100.00%) - BytesSent: 6.31 MB (6617188) - NetworkThroughput(*): 468.16 MB/sec - OverallThroughput: 429.16 MB/sec - PeakMemoryUsage: 816.56 KB (836160) - RowsReturned: 3.39K (3389) - SerializeBatchTime: 763.611us - TransmitDataRPCTime: 13.479ms - UncompressedRowBatchSize: 16.14 MB (16920984) CodeGen:(Total: 72.368ms, non-child: 72.368ms, % non-child: 100.00%) - CodegenTime: 885.726us - CompileTime: 11.607ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 27 (27) - NumInstructions: 373 (373) - OptimizationTime: 38.428ms - PeakMemoryUsage: 186.50 KB (190976) - PrepareTime: 21.823ms HDFS_SCAN_NODE (id=1):(Total: 129.912ms, non-child: 129.912ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 6:1/7.00 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:2 BytesRead(500.000ms): 0 - FooterProcessingTime: (Avg: 39.675ms ; Min: 39.675ms ; Max: 39.675ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 2.09 MB (2190723) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.09 MB (2190723) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 2.09 MB (2190723) - DecompressionTime: 1.703ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 7.20 MB (7547482) - PerReadThreadRawHdfsThroughput: 35.40 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 129.264ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 370.00K (370000) - RowsReturned: 3.39K (3389) - RowsReturnedRate: 26.09 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 6 (6) - ScannerThreadsTotalWallClockTime: 148.317ms - MaterializeTupleTime(*): 36.089ms - ScannerThreadsSysTime: 7.998ms - ScannerThreadsUserTime: 25.996ms - ScannerThreadsVoluntaryContextSwitches: 17 (17) - TotalRawHdfsReadTime(*): 59.023ms - TotalReadThroughput: 0.00 /sec Instance 7f40dcb034de70b7:2c0 (host=vc1527.foo:22000):(Total: 610.381ms, non-child: 402.645ms, % non-child: 65.97%) Hdfs split stats (:<# splits>/): 6:1/7.01 MB MemoryUsage(500.000ms): 7.74 MB ThreadUsage(500.000ms): 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 10.74 MB (11261602) - PerHostPeakMemUsage: 374.80 MB (393009831) - RowsProduced: 3.31K (3312) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 347.131ms - TotalStorageWaitTime: 96.446ms - TotalThreadsInvoluntaryContextSwitches: 23 (23) - TotalThreadsTotalWallClockTime: 693.181ms - TotalThreadsSysTime: 26.996ms - TotalThreadsUserTime: 83.987ms - TotalThreadsVoluntaryContextSwitches: 292 (292) Fragment Instance Lifecycle Timings: - ExecTime: 507.724ms - ExecTreeExecTime: 120.058ms - OpenTime: 49.959ms - ExecTreeOpenTime: 31.018us - PrepareTime: 52.643ms - ExecTreePrepareTime: 116.598us DataStreamSender (dst_id=26):(Total: 15.639ms, non-child: 15.639ms, % non-child: 100.00%) - BytesSent: 6.10 MB (6398768) - NetworkThroughput(*): 425.85 MB/sec - OverallThroughput: 390.19 MB/sec - PeakMemoryUsage: 816.56 KB (836160) - RowsReturned: 3.31K (3312) - SerializeBatchTime: 745.119us - TransmitDataRPCTime: 14.329ms - UncompressedRowBatchSize: 15.76 MB (16528230) CodeGen:(Total: 71.738ms, non-child: 71.738ms, % non-child: 100.00%) - CodegenTime: 897.181us - CompileTime: 10.836ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 27 (27) - NumInstructions: 373 (373) - OptimizationTime: 37.457ms - PeakMemoryUsage: 186.50 KB (190976) - PrepareTime: 22.973ms HDFS_SCAN_NODE (id=1):(Total: 120.357ms, non-child: 120.357ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 6:1/7.01 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:2 BytesRead(500.000ms): 2.09 MB - FooterProcessingTime: (Avg: 42.635ms ; Min: 42.635ms ; Max: 42.635ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 2.09 MB (2190772) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.09 MB (2190772) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 2.09 MB (2190772) - DecompressionTime: 3.787ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 7.10 MB (7439962) - PerReadThreadRawHdfsThroughput: 56.87 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 119.815ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 370.00K (370000) - RowsReturned: 3.31K (3312) - RowsReturnedRate: 27.52 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 7 (7) - ScannerThreadsTotalWallClockTime: 135.871ms - MaterializeTupleTime(*): 33.994ms - ScannerThreadsSysTime: 5.999ms - ScannerThreadsUserTime: 29.995ms - ScannerThreadsVoluntaryContextSwitches: 9 (9) - TotalRawHdfsReadTime(*): 36.741ms - TotalReadThroughput: 4.17 MB/sec Instance 7f40dcb034de70b7:2b1 (host=vd1123.foo:22000):(Total: 610.207ms, non-child: 373.768ms, % non-child: 61.25%) Hdfs split stats (:<# splits>/): 4:1/7.37 MB MemoryUsage(500.000ms): 1011.06 KB, 5.44 MB ThreadUsage(500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 11.36 MB (11906759) - PerHostPeakMemUsage: 369.53 MB (387482551) - RowsProduced: 3.54K (3539) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 329.178ms - TotalStorageWaitTime: 127.198ms - TotalThreadsInvoluntaryContextSwitches: 22 (22) - TotalThreadsTotalWallClockTime: 734.211ms - TotalThreadsSysTime: 18.996ms - TotalThreadsUserTime: 86.987ms - TotalThreadsVoluntaryContextSwitches: 340 (340) Fragment Instance Lifecycle Timings: - ExecTime: 517.101ms - ExecTreeExecTime: 151.611ms - OpenTime: 49.055ms - ExecTreeOpenTime: 53.121us - PrepareTime: 43.967ms - ExecTreePrepareTime: 157.048us DataStreamSender (dst_id=26):(Total: 10.800ms, non-child: 10.800ms, % non-child: 100.00%) - BytesSent: 6.52 MB (6838288) - NetworkThroughput(*): 724.64 MB/sec - OverallThroughput: 603.81 MB/sec - PeakMemoryUsage: 816.56 KB (836160) - RowsReturned: 3.54K (3539) - SerializeBatchTime: 1.309ms - TransmitDataRPCTime: 8.999ms - UncompressedRowBatchSize: 16.85 MB (17666560) CodeGen:(Total: 73.630ms, non-child: 73.630ms, % non-child: 100.00%) - CodegenTime: 849.855us - CompileTime: 11.999ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 27 (27) - NumInstructions: 373 (373) - OptimizationTime: 35.922ms - PeakMemoryUsage: 186.50 KB (190976) - PrepareTime: 25.301ms HDFS_SCAN_NODE (id=1):(Total: 152.007ms, non-child: 152.007ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:1/7.37 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:2 BytesRead(500.000ms): 0, 2.19 MB - FooterProcessingTime: (Avg: 31.868ms ; Min: 31.868ms ; Max: 31.868ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 2.19 MB (2298332) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.19 MB (2298332) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 2.19 MB (2298332) - DecompressionTime: 1.438ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 7.65 MB (8020607) - PerReadThreadRawHdfsThroughput: 63.15 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 151.257ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 390.00K (390000) - RowsReturned: 3.54K (3539) - RowsReturnedRate: 23.28 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 4 (4) - ScannerThreadsTotalWallClockTime: 168.322ms - MaterializeTupleTime(*): 38.035ms - ScannerThreadsSysTime: 6.998ms - ScannerThreadsUserTime: 30.995ms - ScannerThreadsVoluntaryContextSwitches: 42 (42) - TotalRawHdfsReadTime(*): 34.707ms - TotalReadThroughput: 2.19 MB/sec Instance 7f40dcb034de70b7:2cf (host=ve1140.foo:22000):(Total: 609.193ms, non-child: 257.722ms, % non-child: 42.31%) Hdfs split stats (:<# splits>/): 1:1/7.00 MB MemoryUsage(500.000ms): 838.06 KB ThreadUsage(500.000ms): 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 10.90 MB (11433634) - PerHostPeakMemUsage: 370.49 MB (388484595) - RowsProduced: 3.40K (3403) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 206.719ms - TotalStorageWaitTime: 128.582ms - TotalThreadsInvoluntaryContextSwitches: 28 (28) - TotalThreadsTotalWallClockTime: 817.333ms - TotalThreadsSysTime: 18.997ms - TotalThreadsUserTime: 89.986ms - TotalThreadsVoluntaryContextSwitches: 293 (293) Fragment Instance Lifecycle Timings: - ExecTime: 496.189ms - ExecTreeExecTime: 248.782ms - OpenTime: 58.577ms - ExecTreeOpenTime: 50.010us - PrepareTime: 54.398ms - ExecTreePrepareTime: 85.406us DataStreamSender (dst_id=26):(Total: 14.533ms, non-child: 14.533ms, % non-child: 100.00%) - BytesSent: 6.27 MB (6577658) - NetworkThroughput(*): 489.86 MB/sec - OverallThroughput: 431.61 MB/sec - PeakMemoryUsage: 816.56 KB (836160) - RowsReturned: 3.40K (3403) - SerializeBatchTime: 1.260ms - TransmitDataRPCTime: 12.805ms - UncompressedRowBatchSize: 16.20 MB (16985304) CodeGen:(Total: 87.917ms, non-child: 87.917ms, % non-child: 100.00%) - CodegenTime: 1.006ms - CompileTime: 14.810ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 27 (27) - NumInstructions: 373 (373) - OptimizationTime: 42.349ms - PeakMemoryUsage: 186.50 KB (190976) - PrepareTime: 30.287ms HDFS_SCAN_NODE (id=1):(Total: 249.019ms, non-child: 249.019ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:1/7.00 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:2 BytesRead(500.000ms): 0 - FooterProcessingTime: (Avg: 77.492ms ; Min: 77.492ms ; Max: 77.492ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 2.09 MB (2190717) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.09 MB (2190717) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 2.09 MB (2190717) - DecompressionTime: 1.508ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 7.20 MB (7547482) - PerReadThreadRawHdfsThroughput: 41.60 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 248.275ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 370.00K (370000) - RowsReturned: 3.40K (3403) - RowsReturnedRate: 13.66 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 4 (4) - ScannerThreadsTotalWallClockTime: 262.851ms - MaterializeTupleTime(*): 26.315ms - ScannerThreadsSysTime: 5.999ms - ScannerThreadsUserTime: 22.996ms - ScannerThreadsVoluntaryContextSwitches: 6 (6) - TotalRawHdfsReadTime(*): 50.216ms - TotalReadThroughput: 0.00 /sec Instance 7f40dcb034de70b7:29b (host=vd1124.foo:22000):(Total: 608.663ms, non-child: 302.332ms, % non-child: 49.67%) Hdfs split stats (:<# splits>/): 6:1/7.19 MB MemoryUsage(500.000ms): 5.17 MB ThreadUsage(500.000ms): 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 11.04 MB (11574212) - PerHostPeakMemUsage: 281.82 MB (295514930) - RowsProduced: 3.38K (3383) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 243.011ms - TotalStorageWaitTime: 131.894ms - TotalThreadsInvoluntaryContextSwitches: 31 (31) - TotalThreadsTotalWallClockTime: 782.629ms - TotalThreadsSysTime: 16.997ms - TotalThreadsUserTime: 80.987ms - TotalThreadsVoluntaryContextSwitches: 284 (284) Fragment Instance Lifecycle Timings: - ExecTime: 502.396ms - ExecTreeExecTime: 214.159ms - OpenTime: 54.147ms - ExecTreeOpenTime: 39.319us - PrepareTime: 52.075ms - ExecTreePrepareTime: 128.919us DataStreamSender (dst_id=26):(Total: 10.823ms, non-child: 10.823ms, % non-child: 100.00%) - BytesSent: 6.25 MB (6555548) - NetworkThroughput(*): 667.34 MB/sec - OverallThroughput: 577.61 MB/sec - PeakMemoryUsage: 816.56 KB (836160) - RowsReturned: 3.38K (3383) - SerializeBatchTime: 964.924us - TransmitDataRPCTime: 9.368ms - UncompressedRowBatchSize: 16.11 MB (16888288) CodeGen:(Total: 81.014ms, non-child: 81.014ms, % non-child: 100.00%) - CodegenTime: 785.122us - CompileTime: 12.045ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 27 (27) - NumInstructions: 373 (373) - OptimizationTime: 40.897ms - PeakMemoryUsage: 186.50 KB (190976) - PrepareTime: 27.573ms HDFS_SCAN_NODE (id=1):(Total: 214.492ms, non-child: 214.492ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 6:1/7.19 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:2 BytesRead(500.000ms): 2.14 MB - FooterProcessingTime: (Avg: 38.060ms ; Min: 38.060ms ; Max: 38.060ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 2.14 MB (2244556) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.14 MB (2244556) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 2.14 MB (2244556) - DecompressionTime: 1.145ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 7.37 MB (7731068) - PerReadThreadRawHdfsThroughput: 54.70 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 213.792ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 380.00K (380000) - RowsReturned: 3.38K (3383) - RowsReturnedRate: 15.77 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 8 (8) - ScannerThreadsTotalWallClockTime: 226.371ms - MaterializeTupleTime(*): 21.134ms - ScannerThreadsSysTime: 5.999ms - ScannerThreadsUserTime: 16.997ms - ScannerThreadsVoluntaryContextSwitches: 8 (8) - TotalRawHdfsReadTime(*): 39.132ms - TotalReadThroughput: 4.28 MB/sec Instance 7f40dcb034de70b7:2cc (host=vd1340.foo:22000):(Total: 608.438ms, non-child: 392.307ms, % non-child: 64.48%) Hdfs split stats (:<# splits>/): 1:1/7.19 MB MemoryUsage(500.000ms): 5.29 MB ThreadUsage(500.000ms): 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 11.08 MB (11617220) - PerHostPeakMemUsage: 367.74 MB (385600029) - RowsProduced: 3.42K (3415) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 327.314ms - TotalStorageWaitTime: 87.269ms - TotalThreadsInvoluntaryContextSwitches: 20 (20) - TotalThreadsTotalWallClockTime: 691.860ms - TotalThreadsSysTime: 29.994ms - TotalThreadsUserTime: 81.987ms - TotalThreadsVoluntaryContextSwitches: 299 (299) Fragment Instance Lifecycle Timings: - ExecTime: 506.415ms - ExecTreeExecTime: 122.618ms - OpenTime: 44.044ms - ExecTreeOpenTime: 49.404us - PrepareTime: 57.936ms - ExecTreePrepareTime: 122.377us DataStreamSender (dst_id=26):(Total: 20.162ms, non-child: 20.162ms, % non-child: 100.00%) - BytesSent: 6.31 MB (6611292) - NetworkThroughput(*): 337.11 MB/sec - OverallThroughput: 312.71 MB/sec - PeakMemoryUsage: 816.56 KB (836160) - RowsReturned: 3.42K (3415) - SerializeBatchTime: 969.992us - TransmitDataRPCTime: 18.702ms - UncompressedRowBatchSize: 16.26 MB (17049222) CodeGen:(Total: 73.045ms, non-child: 73.045ms, % non-child: 100.00%) - CodegenTime: 780.606us - CompileTime: 9.772ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 27 (27) - NumInstructions: 373 (373) - OptimizationTime: 33.010ms - PeakMemoryUsage: 186.50 KB (190976) - PrepareTime: 29.839ms HDFS_SCAN_NODE (id=1):(Total: 122.922ms, non-child: 122.922ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:1/7.19 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:2 BytesRead(500.000ms): 2.14 MB - FooterProcessingTime: (Avg: 43.784ms ; Min: 43.784ms ; Max: 43.784ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 2.14 MB (2244560) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.14 MB (2244560) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 2.14 MB (2244560) - DecompressionTime: 5.954ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 7.50 MB (7860092) - PerReadThreadRawHdfsThroughput: 74.44 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 122.167ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 380.00K (380000) - RowsReturned: 3.42K (3415) - RowsReturnedRate: 27.78 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 6 (6) - ScannerThreadsTotalWallClockTime: 141.774ms - MaterializeTupleTime(*): 33.639ms - ScannerThreadsSysTime: 7.998ms - ScannerThreadsUserTime: 28.995ms - ScannerThreadsVoluntaryContextSwitches: 12 (12) - TotalRawHdfsReadTime(*): 28.756ms - TotalReadThroughput: 4.28 MB/sec Instance 7f40dcb034de70b7:29a (host=va1043.foo:22000):(Total: 608.374ms, non-child: 399.964ms, % non-child: 65.74%) Hdfs split stats (:<# splits>/): 5:1/7.19 MB MemoryUsage(500.000ms): 966.06 KB ThreadUsage(500.000ms): 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 11.10 MB (11638724) - PerHostPeakMemUsage: 306.10 MB (320971986) - RowsProduced: 3.46K (3457) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 339.391ms - TotalStorageWaitTime: 95.122ms - TotalThreadsInvoluntaryContextSwitches: 30 (30) - TotalThreadsTotalWallClockTime: 691.681ms - TotalThreadsSysTime: 16.997ms - TotalThreadsUserTime: 85.986ms - TotalThreadsVoluntaryContextSwitches: 308 (308) Fragment Instance Lifecycle Timings: - ExecTime: 511.922ms - ExecTreeExecTime: 114.161ms - OpenTime: 49.635ms - ExecTreeOpenTime: 30.439us - PrepareTime: 46.789ms - ExecTreePrepareTime: 123.610us DataStreamSender (dst_id=26):(Total: 22.670ms, non-child: 22.670ms, % non-child: 100.00%) - BytesSent: 6.34 MB (6652564) - NetworkThroughput(*): 296.50 MB/sec - OverallThroughput: 279.85 MB/sec - PeakMemoryUsage: 816.56 KB (836160) - RowsReturned: 3.46K (3457) - SerializeBatchTime: 858.179us - TransmitDataRPCTime: 21.397ms - UncompressedRowBatchSize: 16.45 MB (17244862) CodeGen:(Total: 71.299ms, non-child: 71.299ms, % non-child: 100.00%) - CodegenTime: 1.122ms - CompileTime: 10.929ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 27 (27) - NumInstructions: 373 (373) - OptimizationTime: 37.269ms - PeakMemoryUsage: 186.50 KB (190976) - PrepareTime: 22.574ms HDFS_SCAN_NODE (id=1):(Total: 114.440ms, non-child: 114.440ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:1/7.19 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:2 BytesRead(500.000ms): 0 - FooterProcessingTime: (Avg: 44.329ms ; Min: 44.329ms ; Max: 44.329ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 2.14 MB (2244598) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.14 MB (2244598) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 2.14 MB (2244598) - DecompressionTime: 1.700ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 7.50 MB (7860092) - PerReadThreadRawHdfsThroughput: 56.65 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 113.813ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 380.00K (380000) - RowsReturned: 3.46K (3457) - RowsReturnedRate: 30.21 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 9 (9) - ScannerThreadsTotalWallClockTime: 130.387ms - MaterializeTupleTime(*): 31.841ms - ScannerThreadsSysTime: 3.999ms - ScannerThreadsUserTime: 28.995ms - ScannerThreadsVoluntaryContextSwitches: 21 (21) - TotalRawHdfsReadTime(*): 37.787ms - TotalReadThroughput: 0.00 /sec Instance 7f40dcb034de70b7:292 (host=vd1120.foo:22000):(Total: 607.948ms, non-child: 409.968ms, % non-child: 67.43%) Hdfs split stats (:<# splits>/): 5:1/7.19 MB MemoryUsage(500.000ms): 816.56 KB, 830.06 KB ThreadUsage(500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 11.06 MB (11595716) - PerHostPeakMemUsage: 264.02 MB (276848255) - RowsProduced: 3.36K (3359) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 321.810ms - TotalStorageWaitTime: 79.666ms - TotalThreadsInvoluntaryContextSwitches: 23 (23) - TotalThreadsTotalWallClockTime: 642.177ms - TotalThreadsSysTime: 17.997ms - TotalThreadsUserTime: 84.986ms - TotalThreadsVoluntaryContextSwitches: 268 (268) Fragment Instance Lifecycle Timings: - ExecTime: 479.666ms - ExecTreeExecTime: 94.986ms - OpenTime: 53.101ms - ExecTreeOpenTime: 34.479us - PrepareTime: 75.140ms - ExecTreePrepareTime: 143.080us DataStreamSender (dst_id=26):(Total: 12.207ms, non-child: 12.207ms, % non-child: 100.00%) - BytesSent: 6.17 MB (6473808) - NetworkThroughput(*): 575.63 MB/sec - OverallThroughput: 505.75 MB/sec - PeakMemoryUsage: 816.56 KB (836160) - RowsReturned: 3.36K (3359) - SerializeBatchTime: 855.535us - TransmitDataRPCTime: 10.725ms - UncompressedRowBatchSize: 16.00 MB (16773584) CodeGen:(Total: 90.434ms, non-child: 90.434ms, % non-child: 100.00%) - CodegenTime: 861.825us - CompileTime: 12.460ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 27 (27) - NumInstructions: 373 (373) - OptimizationTime: 39.348ms - PeakMemoryUsage: 186.50 KB (190976) - PrepareTime: 38.218ms HDFS_SCAN_NODE (id=1):(Total: 95.337ms, non-child: 95.337ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:1/7.19 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:2 BytesRead(500.000ms): 0 - FooterProcessingTime: (Avg: 42.977ms ; Min: 42.977ms ; Max: 42.977ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 2.14 MB (2244536) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.14 MB (2244536) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 2.14 MB (2244536) - DecompressionTime: 1.914ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 7.37 MB (7731068) - PerReadThreadRawHdfsThroughput: 55.70 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 94.581ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 380.00K (380000) - RowsReturned: 3.36K (3359) - RowsReturnedRate: 35.23 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 5 (5) - ScannerThreadsTotalWallClockTime: 109.673ms - MaterializeTupleTime(*): 26.169ms - ScannerThreadsSysTime: 4.999ms - ScannerThreadsUserTime: 22.996ms - ScannerThreadsVoluntaryContextSwitches: 9 (9) - TotalRawHdfsReadTime(*): 38.429ms - TotalReadThroughput: 0.00 /sec Instance 7f40dcb034de70b7:2b5 (host=vc1541.foo:22000):(Total: 607.858ms, non-child: 353.623ms, % non-child: 58.18%) Hdfs split stats (:<# splits>/): 4:1/7.00 MB MemoryUsage(500.000ms): 4.00 MB ThreadUsage(500.000ms): 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 10.76 MB (11283106) - PerHostPeakMemUsage: 373.53 MB (391674212) - RowsProduced: 3.31K (3313) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 288.638ms - TotalStorageWaitTime: 155.486ms - TotalThreadsInvoluntaryContextSwitches: 24 (24) - TotalThreadsTotalWallClockTime: 747.764ms - TotalThreadsSysTime: 16.996ms - TotalThreadsUserTime: 80.987ms - TotalThreadsVoluntaryContextSwitches: 292 (292) Fragment Instance Lifecycle Timings: - ExecTime: 513.264ms - ExecTreeExecTime: 173.830ms - OpenTime: 47.879ms - ExecTreeOpenTime: 29.527us - PrepareTime: 46.676ms - ExecTreePrepareTime: 112.643us DataStreamSender (dst_id=26):(Total: 8.659ms, non-child: 8.659ms, % non-child: 100.00%) - BytesSent: 6.15 MB (6452502) - NetworkThroughput(*): 855.27 MB/sec - OverallThroughput: 710.61 MB/sec - PeakMemoryUsage: 816.56 KB (836160) - RowsReturned: 3.31K (3313) - SerializeBatchTime: 925.630us - TransmitDataRPCTime: 7.194ms - UncompressedRowBatchSize: 15.78 MB (16542032) CodeGen:(Total: 71.472ms, non-child: 71.472ms, % non-child: 100.00%) - CodegenTime: 681.557us - CompileTime: 10.678ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 27 (27) - NumInstructions: 373 (373) - OptimizationTime: 35.882ms - PeakMemoryUsage: 186.50 KB (190976) - PrepareTime: 24.540ms HDFS_SCAN_NODE (id=1):(Total: 174.103ms, non-child: 174.103ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:1/7.00 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:2 BytesRead(500.000ms): 1.59 MB - FooterProcessingTime: (Avg: 37.095ms ; Min: 37.095ms ; Max: 37.095ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 2.09 MB (2190751) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.09 MB (2190751) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 2.09 MB (2190751) - DecompressionTime: 1.312ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 7.10 MB (7439962) - PerReadThreadRawHdfsThroughput: 46.99 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 173.487ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 370.00K (370000) - RowsReturned: 3.31K (3313) - RowsReturnedRate: 19.03 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 5 (5) - ScannerThreadsTotalWallClockTime: 186.899ms - MaterializeTupleTime(*): 28.392ms - ScannerThreadsSysTime: 8.998ms - ScannerThreadsUserTime: 20.996ms - ScannerThreadsVoluntaryContextSwitches: 8 (8) - TotalRawHdfsReadTime(*): 44.463ms - TotalReadThroughput: 3.17 MB/sec Instance 7f40dcb034de70b7:2d1 (host=vc1502.foo:22000):(Total: 607.739ms, non-child: 212.073ms, % non-child: 34.90%) Hdfs split stats (:<# splits>/): 5:1/7.00 MB MemoryUsage(500.000ms): 838.06 KB ThreadUsage(500.000ms): 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 10.84 MB (11369122) - PerHostPeakMemUsage: 372.49 MB (390586387) - RowsProduced: 3.27K (3269) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 162.463ms - TotalStorageWaitTime: 160.369ms - TotalThreadsInvoluntaryContextSwitches: 28 (28) - TotalThreadsTotalWallClockTime: 873.861ms - TotalThreadsSysTime: 19.996ms - TotalThreadsUserTime: 104.984ms - TotalThreadsVoluntaryContextSwitches: 277 (277) Fragment Instance Lifecycle Timings: - ExecTime: 497.668ms - ExecTreeExecTime: 297.172ms - OpenTime: 60.859ms - ExecTreeOpenTime: 31.085us - PrepareTime: 49.159ms - ExecTreePrepareTime: 160.236us DataStreamSender (dst_id=26):(Total: 12.572ms, non-child: 12.572ms, % non-child: 100.00%) - BytesSent: 6.04 MB (6330294) - NetworkThroughput(*): 536.54 MB/sec - OverallThroughput: 480.16 MB/sec - PeakMemoryUsage: 816.56 KB (836160) - RowsReturned: 3.27K (3269) - SerializeBatchTime: 868.621us - TransmitDataRPCTime: 11.251ms - UncompressedRowBatchSize: 15.57 MB (16321200) CodeGen:(Total: 85.554ms, non-child: 85.554ms, % non-child: 100.00%) - CodegenTime: 940.919us - CompileTime: 13.569ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 27 (27) - NumInstructions: 373 (373) - OptimizationTime: 45.932ms - PeakMemoryUsage: 186.50 KB (190976) - PrepareTime: 25.568ms HDFS_SCAN_NODE (id=1):(Total: 297.538ms, non-child: 297.538ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:1/7.00 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:2 BytesRead(500.000ms): 0 - FooterProcessingTime: (Avg: 117.668ms ; Min: 117.668ms ; Max: 117.668ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 2.09 MB (2190681) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.09 MB (2190681) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 2.09 MB (2190681) - DecompressionTime: 2.093ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 7.12 MB (7461466) - PerReadThreadRawHdfsThroughput: 49.89 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 296.809ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 370.00K (370000) - RowsReturned: 3.27K (3269) - RowsReturnedRate: 10.99 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 7 (7) - ScannerThreadsTotalWallClockTime: 315.627ms - MaterializeTupleTime(*): 41.499ms - ScannerThreadsSysTime: 6.998ms - ScannerThreadsUserTime: 35.994ms - ScannerThreadsVoluntaryContextSwitches: 5 (5) - TotalRawHdfsReadTime(*): 41.875ms - TotalReadThroughput: 0.00 /sec Instance 7f40dcb034de70b7:29f (host=vc1516.foo:22000):(Total: 607.292ms, non-child: 392.439ms, % non-child: 64.62%) Hdfs split stats (:<# splits>/): 1:1/7.01 MB MemoryUsage(500.000ms): 7.76 MB ThreadUsage(500.000ms): 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 10.76 MB (11283106) - PerHostPeakMemUsage: 247.44 MB (259458126) - RowsProduced: 3.34K (3341) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 330.171ms - TotalStorageWaitTime: 115.799ms - TotalThreadsInvoluntaryContextSwitches: 20 (20) - TotalThreadsTotalWallClockTime: 720.854ms - TotalThreadsSysTime: 21.996ms - TotalThreadsUserTime: 77.988ms - TotalThreadsVoluntaryContextSwitches: 272 (272) Fragment Instance Lifecycle Timings: - ExecTime: 524.246ms - ExecTreeExecTime: 138.865ms - OpenTime: 41.765ms - ExecTreeOpenTime: 34.977us - PrepareTime: 41.240ms - ExecTreePrepareTime: 60.678us DataStreamSender (dst_id=26):(Total: 14.540ms, non-child: 14.540ms, % non-child: 100.00%) - BytesSent: 6.14 MB (6440174) - NetworkThroughput(*): 463.57 MB/sec - OverallThroughput: 422.38 MB/sec - PeakMemoryUsage: 816.56 KB (836160) - RowsReturned: 3.34K (3341) - SerializeBatchTime: 878.915us - TransmitDataRPCTime: 13.249ms - UncompressedRowBatchSize: 15.91 MB (16680186) CodeGen:(Total: 61.275ms, non-child: 61.275ms, % non-child: 100.00%) - CodegenTime: 738.842us - CompileTime: 9.783ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 27 (27) - NumInstructions: 373 (373) - OptimizationTime: 30.979ms - PeakMemoryUsage: 186.50 KB (190976) - PrepareTime: 20.092ms HDFS_SCAN_NODE (id=1):(Total: 139.035ms, non-child: 139.035ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:1/7.01 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:2 BytesRead(500.000ms): 2.09 MB - FooterProcessingTime: (Avg: 54.674ms ; Min: 54.674ms ; Max: 54.674ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 2.09 MB (2190705) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.09 MB (2190705) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 2.09 MB (2190705) - DecompressionTime: 1.782ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 7.12 MB (7461466) - PerReadThreadRawHdfsThroughput: 57.94 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 138.356ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 370.00K (370000) - RowsReturned: 3.34K (3341) - RowsReturnedRate: 24.03 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 8 (8) - ScannerThreadsTotalWallClockTime: 155.144ms - MaterializeTupleTime(*): 35.721ms - ScannerThreadsSysTime: 8.998ms - ScannerThreadsUserTime: 26.995ms - ScannerThreadsVoluntaryContextSwitches: 6 (6) - TotalRawHdfsReadTime(*): 36.060ms - TotalReadThroughput: 4.18 MB/sec Instance 7f40dcb034de70b7:2d0 (host=vc1525.foo:22000):(Total: 607.239ms, non-child: 293.750ms, % non-child: 48.37%) Hdfs split stats (:<# splits>/): 0:1/7.19 MB MemoryUsage(500.000ms): 1011.06 KB, 5.23 MB ThreadUsage(500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 11.04 MB (11574212) - PerHostPeakMemUsage: 369.98 MB (387950596) - RowsProduced: 3.45K (3449) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 246.445ms - TotalStorageWaitTime: 155.826ms - TotalThreadsInvoluntaryContextSwitches: 19 (19) - TotalThreadsTotalWallClockTime: 811.648ms - TotalThreadsSysTime: 19.997ms - TotalThreadsUserTime: 79.987ms - TotalThreadsVoluntaryContextSwitches: 291 (291) Fragment Instance Lifecycle Timings: - ExecTime: 517.427ms - ExecTreeExecTime: 235.766ms - OpenTime: 43.907ms - ExecTreeOpenTime: 30.659us - PrepareTime: 45.857ms - ExecTreePrepareTime: 112.970us DataStreamSender (dst_id=26):(Total: 10.892ms, non-child: 10.892ms, % non-child: 100.00%) - BytesSent: 6.33 MB (6639298) - NetworkThroughput(*): 679.88 MB/sec - OverallThroughput: 581.28 MB/sec - PeakMemoryUsage: 816.56 KB (836160) - RowsReturned: 3.45K (3449) - SerializeBatchTime: 1.068ms - TransmitDataRPCTime: 9.313ms - UncompressedRowBatchSize: 16.41 MB (17211094) CodeGen:(Total: 66.539ms, non-child: 66.539ms, % non-child: 100.00%) - CodegenTime: 676.639us - CompileTime: 10.027ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 27 (27) - NumInstructions: 373 (373) - OptimizationTime: 32.651ms - PeakMemoryUsage: 186.50 KB (190976) - PrepareTime: 23.487ms HDFS_SCAN_NODE (id=1):(Total: 236.056ms, non-child: 236.056ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/7.19 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:2 BytesRead(500.000ms): 0, 2.14 MB - FooterProcessingTime: (Avg: 94.484ms ; Min: 94.484ms ; Max: 94.484ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 2.14 MB (2244566) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.14 MB (2244566) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 2.14 MB (2244566) - DecompressionTime: 1.399ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 7.43 MB (7795580) - PerReadThreadRawHdfsThroughput: 36.26 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 235.320ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 380.00K (380000) - RowsReturned: 3.45K (3449) - RowsReturnedRate: 14.61 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 6 (6) - ScannerThreadsTotalWallClockTime: 250.618ms - MaterializeTupleTime(*): 33.721ms - ScannerThreadsSysTime: 4.999ms - ScannerThreadsUserTime: 29.995ms - ScannerThreadsVoluntaryContextSwitches: 7 (7) - TotalRawHdfsReadTime(*): 59.038ms - TotalReadThroughput: 2.14 MB/sec Instance 7f40dcb034de70b7:2be (host=vc1528.foo:22000):(Total: 606.925ms, non-child: 342.050ms, % non-child: 56.36%) Hdfs split stats (:<# splits>/): 2:1/7.19 MB MemoryUsage(500.000ms): 4.58 MB ThreadUsage(500.000ms): 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 10.94 MB (11466692) - PerHostPeakMemUsage: 371.49 MB (389538969) - RowsProduced: 3.23K (3232) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 284.587ms - TotalStorageWaitTime: 153.618ms - TotalThreadsInvoluntaryContextSwitches: 23 (23) - TotalThreadsTotalWallClockTime: 758.001ms - TotalThreadsSysTime: 29.994ms - TotalThreadsUserTime: 76.988ms - TotalThreadsVoluntaryContextSwitches: 288 (288) Fragment Instance Lifecycle Timings: - ExecTime: 514.810ms - ExecTreeExecTime: 182.422ms - OpenTime: 43.561ms - ExecTreeOpenTime: 27.962us - PrepareTime: 48.510ms - ExecTreePrepareTime: 111.470us DataStreamSender (dst_id=26):(Total: 14.108ms, non-child: 14.108ms, % non-child: 100.00%) - BytesSent: 5.95 MB (6241988) - NetworkThroughput(*): 463.84 MB/sec - OverallThroughput: 421.92 MB/sec - PeakMemoryUsage: 816.56 KB (836160) - RowsReturned: 3.23K (3232) - SerializeBatchTime: 862.673us - TransmitDataRPCTime: 12.833ms - UncompressedRowBatchSize: 15.38 MB (16132126) CodeGen:(Total: 68.065ms, non-child: 68.065ms, % non-child: 100.00%) - CodegenTime: 748.449us - CompileTime: 10.676ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 27 (27) - NumInstructions: 373 (373) - OptimizationTime: 31.730ms - PeakMemoryUsage: 186.50 KB (190976) - PrepareTime: 25.303ms HDFS_SCAN_NODE (id=1):(Total: 182.701ms, non-child: 182.701ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:1/7.19 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:2 BytesRead(500.000ms): 2.14 MB - FooterProcessingTime: (Avg: 42.584ms ; Min: 42.584ms ; Max: 42.584ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 2.14 MB (2244529) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.14 MB (2244529) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 2.14 MB (2244529) - DecompressionTime: 6.686ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 7.10 MB (7449993) - PerReadThreadRawHdfsThroughput: 61.38 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 182.015ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 380.00K (380000) - RowsReturned: 3.23K (3232) - RowsReturnedRate: 17.69 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 6 (6) - ScannerThreadsTotalWallClockTime: 199.922ms - MaterializeTupleTime(*): 34.538ms - ScannerThreadsSysTime: 8.998ms - ScannerThreadsUserTime: 28.995ms - ScannerThreadsVoluntaryContextSwitches: 8 (8) - TotalRawHdfsReadTime(*): 34.874ms - TotalReadThroughput: 4.28 MB/sec Instance 7f40dcb034de70b7:2b9 (host=vd1134.foo:22000):(Total: 606.712ms, non-child: 370.160ms, % non-child: 61.01%) Hdfs split stats (:<# splits>/): 3:1/7.19 MB MemoryUsage(500.000ms): 1011.06 KB, 2.55 MB ThreadUsage(500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 11.10 MB (11638724) - PerHostPeakMemUsage: 372.19 MB (390273011) - RowsProduced: 3.49K (3487) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 316.829ms - TotalStorageWaitTime: 133.295ms - TotalThreadsInvoluntaryContextSwitches: 32 (32) - TotalThreadsTotalWallClockTime: 740.307ms - TotalThreadsSysTime: 26.996ms - TotalThreadsUserTime: 86.986ms - TotalThreadsVoluntaryContextSwitches: 280 (280) Fragment Instance Lifecycle Timings: - ExecTime: 513.618ms - ExecTreeExecTime: 157.455ms - OpenTime: 48.148ms - ExecTreeOpenTime: 31.129us - PrepareTime: 44.877ms - ExecTreePrepareTime: 119.916us DataStreamSender (dst_id=26):(Total: 11.382ms, non-child: 11.382ms, % non-child: 100.00%) - BytesSent: 6.40 MB (6713132) - NetworkThroughput(*): 648.94 MB/sec - OverallThroughput: 562.47 MB/sec - PeakMemoryUsage: 816.56 KB (836160) - RowsReturned: 3.49K (3487) - SerializeBatchTime: 1.051ms - TransmitDataRPCTime: 9.865ms - UncompressedRowBatchSize: 16.59 MB (17397890) CodeGen:(Total: 67.406ms, non-child: 67.406ms, % non-child: 100.00%) - CodegenTime: 961.075us - CompileTime: 10.296ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 27 (27) - NumInstructions: 373 (373) - OptimizationTime: 36.533ms - PeakMemoryUsage: 186.50 KB (190976) - PrepareTime: 20.170ms HDFS_SCAN_NODE (id=1):(Total: 157.762ms, non-child: 157.762ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:1/7.19 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:2 BytesRead(500.000ms): 0, 2.14 MB - FooterProcessingTime: (Avg: 34.539ms ; Min: 34.539ms ; Max: 34.539ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 2.14 MB (2244545) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.14 MB (2244545) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 2.14 MB (2244545) - DecompressionTime: 2.283ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 7.45 MB (7817084) - PerReadThreadRawHdfsThroughput: 39.68 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 157.019ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 380.00K (380000) - RowsReturned: 3.49K (3487) - RowsReturnedRate: 22.10 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 6 (6) - ScannerThreadsTotalWallClockTime: 178.864ms - MaterializeTupleTime(*): 41.378ms - ScannerThreadsSysTime: 8.998ms - ScannerThreadsUserTime: 34.994ms - ScannerThreadsVoluntaryContextSwitches: 14 (14) - TotalRawHdfsReadTime(*): 53.949ms - TotalReadThroughput: 2.14 MB/sec Instance 7f40dcb034de70b7:2a8 (host=va1044.foo:22000):(Total: 606.361ms, non-child: 330.585ms, % non-child: 54.52%) Hdfs split stats (:<# splits>/): 5:1/7.19 MB MemoryUsage(500.000ms): 824.56 KB, 830.06 KB ThreadUsage(500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 11.08 MB (11617220) - PerHostPeakMemUsage: 284.56 MB (298377862) - RowsProduced: 3.44K (3439) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 267.828ms - TotalStorageWaitTime: 162.757ms - TotalThreadsInvoluntaryContextSwitches: 22 (22) - TotalThreadsTotalWallClockTime: 759.249ms - TotalThreadsSysTime: 16.997ms - TotalThreadsUserTime: 93.984ms - TotalThreadsVoluntaryContextSwitches: 300 (300) Fragment Instance Lifecycle Timings: - ExecTime: 502.037ms - ExecTreeExecTime: 185.592ms - OpenTime: 56.678ms - ExecTreeOpenTime: 57.952us - PrepareTime: 47.603ms - ExecTreePrepareTime: 121.817us DataStreamSender (dst_id=26):(Total: 9.425ms, non-child: 9.425ms, % non-child: 100.00%) - BytesSent: 6.34 MB (6651760) - NetworkThroughput(*): 788.86 MB/sec - OverallThroughput: 673.03 MB/sec - PeakMemoryUsage: 816.56 KB (836160) - RowsReturned: 3.44K (3439) - SerializeBatchTime: 984.722us - TransmitDataRPCTime: 8.041ms - UncompressedRowBatchSize: 16.38 MB (17174512) CodeGen:(Total: 80.424ms, non-child: 80.424ms, % non-child: 100.00%) - CodegenTime: 873.547us - CompileTime: 13.492ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 27 (27) - NumInstructions: 373 (373) - OptimizationTime: 41.620ms - PeakMemoryUsage: 186.50 KB (190976) - PrepareTime: 24.843ms HDFS_SCAN_NODE (id=1):(Total: 185.925ms, non-child: 185.925ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:1/7.19 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:2 BytesRead(500.000ms): 0 - FooterProcessingTime: (Avg: 68.027ms ; Min: 68.027ms ; Max: 68.027ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 2.14 MB (2244512) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.14 MB (2244512) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 2.14 MB (2244512) - DecompressionTime: 1.627ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 7.41 MB (7774076) - PerReadThreadRawHdfsThroughput: 44.31 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 185.228ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 380.00K (380000) - RowsReturned: 3.44K (3439) - RowsReturnedRate: 18.50 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 4 (4) - ScannerThreadsTotalWallClockTime: 200.808ms - MaterializeTupleTime(*): 34.664ms - ScannerThreadsSysTime: 3.999ms - ScannerThreadsUserTime: 32.994ms - ScannerThreadsVoluntaryContextSwitches: 8 (8) - TotalRawHdfsReadTime(*): 48.306ms - TotalReadThroughput: 0.00 /sec Instance 7f40dcb034de70b7:2e0 (host=ve1132.foo:22000):(Total: 606.145ms, non-child: 339.854ms, % non-child: 56.07%) Hdfs split stats (:<# splits>/): 2:1/7.00 MB MemoryUsage(500.000ms): 966.06 KB ThreadUsage(500.000ms): 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 10.84 MB (11369122) - PerHostPeakMemUsage: 352.19 MB (369301342) - RowsProduced: 3.36K (3361) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 277.984ms - TotalStorageWaitTime: 90.942ms - TotalThreadsInvoluntaryContextSwitches: 22 (22) - TotalThreadsTotalWallClockTime: 739.995ms - TotalThreadsSysTime: 16.997ms - TotalThreadsUserTime: 87.987ms - TotalThreadsVoluntaryContextSwitches: 290 (290) Fragment Instance Lifecycle Timings: - ExecTime: 497.874ms - ExecTreeExecTime: 174.628ms - OpenTime: 54.673ms - ExecTreeOpenTime: 39.624us - PrepareTime: 53.569ms - ExecTreePrepareTime: 69.938us DataStreamSender (dst_id=26):(Total: 13.736ms, non-child: 13.736ms, % non-child: 100.00%) - BytesSent: 6.17 MB (6466572) - NetworkThroughput(*): 510.58 MB/sec - OverallThroughput: 448.95 MB/sec - PeakMemoryUsage: 816.56 KB (836160) - RowsReturned: 3.36K (3361) - SerializeBatchTime: 953.657us - TransmitDataRPCTime: 12.078ms - UncompressedRowBatchSize: 15.99 MB (16768894) CodeGen:(Total: 77.729ms, non-child: 77.729ms, % non-child: 100.00%) - CodegenTime: 790.029us - CompileTime: 12.535ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 27 (27) - NumInstructions: 373 (373) - OptimizationTime: 39.739ms - PeakMemoryUsage: 186.50 KB (190976) - PrepareTime: 24.983ms HDFS_SCAN_NODE (id=1):(Total: 174.825ms, non-child: 174.825ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:1/7.00 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:2 BytesRead(500.000ms): 0 - FooterProcessingTime: (Avg: 48.320ms ; Min: 48.320ms ; Max: 48.320ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 2.09 MB (2190833) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.09 MB (2190833) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 2.09 MB (2190833) - DecompressionTime: 2.407ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 7.28 MB (7633498) - PerReadThreadRawHdfsThroughput: 62.84 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 174.135ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 370.00K (370000) - RowsReturned: 3.36K (3361) - RowsReturnedRate: 19.22 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 4 (4) - ScannerThreadsTotalWallClockTime: 189.063ms - MaterializeTupleTime(*): 26.484ms - ScannerThreadsSysTime: 3.999ms - ScannerThreadsUserTime: 24.996ms - ScannerThreadsVoluntaryContextSwitches: 14 (14) - TotalRawHdfsReadTime(*): 33.247ms - TotalReadThroughput: 0.00 /sec Instance 7f40dcb034de70b7:29c (host=vd1342.foo:22000):(Total: 606.130ms, non-child: 408.386ms, % non-child: 67.38%) Hdfs split stats (:<# splits>/): 2:1/7.19 MB MemoryUsage(500.000ms): 830.06 KB ThreadUsage(500.000ms): 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 11.18 MB (11724740) - PerHostPeakMemUsage: 232.40 MB (243684585) - RowsProduced: 3.42K (3422) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 334.028ms - TotalStorageWaitTime: 93.559ms - TotalThreadsInvoluntaryContextSwitches: 22 (22) - TotalThreadsTotalWallClockTime: 692.122ms - TotalThreadsSysTime: 18.996ms - TotalThreadsUserTime: 85.987ms - TotalThreadsVoluntaryContextSwitches: 293 (293) Fragment Instance Lifecycle Timings: - ExecTime: 512.296ms - ExecTreeExecTime: 118.987ms - OpenTime: 46.438ms - ExecTreeOpenTime: 33.526us - PrepareTime: 47.353ms - ExecTreePrepareTime: 131.967us DataStreamSender (dst_id=26):(Total: 13.042ms, non-child: 13.042ms, % non-child: 100.00%) - BytesSent: 6.32 MB (6625630) - NetworkThroughput(*): 525.61 MB/sec - OverallThroughput: 484.48 MB/sec - PeakMemoryUsage: 816.56 KB (836160) - RowsReturned: 3.42K (3422) - SerializeBatchTime: 598.023us - TransmitDataRPCTime: 12.021ms - UncompressedRowBatchSize: 16.30 MB (17087278) CodeGen:(Total: 65.368ms, non-child: 65.368ms, % non-child: 100.00%) - CodegenTime: 773.953us - CompileTime: 10.522ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 27 (27) - NumInstructions: 373 (373) - OptimizationTime: 34.746ms - PeakMemoryUsage: 186.50 KB (190976) - PrepareTime: 19.707ms HDFS_SCAN_NODE (id=1):(Total: 119.333ms, non-child: 119.333ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:1/7.19 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:2 - FooterProcessingTime: (Avg: 41.293ms ; Min: 41.293ms ; Max: 41.293ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 2.14 MB (2244630) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.14 MB (2244630) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 2.14 MB (2244630) - DecompressionTime: 3.449ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 7.50 MB (7860092) - PerReadThreadRawHdfsThroughput: 67.43 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 118.669ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 380.00K (380000) - RowsReturned: 3.42K (3422) - RowsReturnedRate: 28.68 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 6 (6) - ScannerThreadsTotalWallClockTime: 133.666ms - MaterializeTupleTime(*): 35.016ms - ScannerThreadsSysTime: 4.999ms - ScannerThreadsUserTime: 30.995ms - ScannerThreadsVoluntaryContextSwitches: 18 (18) - TotalRawHdfsReadTime(*): 31.747ms - TotalReadThroughput: 0.00 /sec Instance 7f40dcb034de70b7:2d4 (host=vd1109.foo:22000):(Total: 606.119ms, non-child: 268.485ms, % non-child: 44.30%) Hdfs split stats (:<# splits>/): 4:1/7.19 MB MemoryUsage(500.000ms): 8.10 MB ThreadUsage(500.000ms): 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 11.10 MB (11638724) - PerHostPeakMemUsage: 348.03 MB (364938922) - RowsProduced: 3.54K (3539) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 228.534ms - TotalStorageWaitTime: 116.349ms - TotalThreadsInvoluntaryContextSwitches: 19 (19) - TotalThreadsTotalWallClockTime: 819.510ms - TotalThreadsSysTime: 24.995ms - TotalThreadsUserTime: 79.988ms - TotalThreadsVoluntaryContextSwitches: 301 (301) Fragment Instance Lifecycle Timings: - ExecTime: 510.215ms - ExecTreeExecTime: 242.323ms - OpenTime: 45.056ms - ExecTreeOpenTime: 39.323us - PrepareTime: 50.733ms - ExecTreePrepareTime: 230.595us DataStreamSender (dst_id=26):(Total: 24.514ms, non-child: 24.514ms, % non-child: 100.00%) - BytesSent: 6.52 MB (6840164) - NetworkThroughput(*): 284.27 MB/sec - OverallThroughput: 266.10 MB/sec - PeakMemoryUsage: 816.56 KB (836160) - RowsReturned: 3.54K (3539) - SerializeBatchTime: 966.341us - TransmitDataRPCTime: 22.947ms - UncompressedRowBatchSize: 16.85 MB (17666292) CodeGen:(Total: 70.162ms, non-child: 70.162ms, % non-child: 100.00%) - CodegenTime: 686.008us - CompileTime: 10.320ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 27 (27) - NumInstructions: 373 (373) - OptimizationTime: 33.829ms - PeakMemoryUsage: 186.50 KB (190976) - PrepareTime: 25.596ms HDFS_SCAN_NODE (id=1):(Total: 242.957ms, non-child: 242.957ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:1/7.19 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:2 BytesRead(500.000ms): 2.14 MB - FooterProcessingTime: (Avg: 71.167ms ; Min: 71.167ms ; Max: 71.167ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 2.14 MB (2244628) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.14 MB (2244628) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 2.14 MB (2244628) - DecompressionTime: 2.250ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 7.68 MB (8054660) - PerReadThreadRawHdfsThroughput: 58.35 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 241.894ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 380.00K (380000) - RowsReturned: 3.54K (3539) - RowsReturnedRate: 14.57 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 6 (6) - ScannerThreadsTotalWallClockTime: 264.521ms - MaterializeTupleTime(*): 37.640ms - ScannerThreadsSysTime: 7.998ms - ScannerThreadsUserTime: 30.995ms - ScannerThreadsVoluntaryContextSwitches: 18 (18) - TotalRawHdfsReadTime(*): 36.684ms - TotalReadThroughput: 4.28 MB/sec Instance 7f40dcb034de70b7:29d (host=va1035.foo:22000):(Total: 605.961ms, non-child: 404.219ms, % non-child: 66.71%) Hdfs split stats (:<# splits>/): 1:1/7.19 MB MemoryUsage(500.000ms): 966.06 KB, 830.06 KB ThreadUsage(500.000ms): 2, 1 - AverageThreadTokens: 1.50 - BloomFilterBytes: 0 - PeakMemoryUsage: 10.98 MB (11509700) - PerHostPeakMemUsage: 230.63 MB (241831916) - RowsProduced: 3.46K (3459) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 338.201ms - TotalStorageWaitTime: 92.823ms - TotalThreadsInvoluntaryContextSwitches: 21 (21) - TotalThreadsTotalWallClockTime: 686.686ms - TotalThreadsSysTime: 27.994ms - TotalThreadsUserTime: 80.987ms - TotalThreadsVoluntaryContextSwitches: 278 (278) Fragment Instance Lifecycle Timings: - ExecTime: 508.922ms - ExecTreeExecTime: 117.469ms - OpenTime: 47.517ms - ExecTreeOpenTime: 30.903us - PrepareTime: 49.481ms - ExecTreePrepareTime: 150.704us DataStreamSender (dst_id=26):(Total: 14.275ms, non-child: 14.275ms, % non-child: 100.00%) - BytesSent: 6.35 MB (6662748) - NetworkThroughput(*): 487.54 MB/sec - OverallThroughput: 445.11 MB/sec - PeakMemoryUsage: 816.56 KB (836160) - RowsReturned: 3.46K (3459) - SerializeBatchTime: 754.084us - TransmitDataRPCTime: 13.032ms - UncompressedRowBatchSize: 16.46 MB (17254778) CodeGen:(Total: 69.617ms, non-child: 69.617ms, % non-child: 100.00%) - CodegenTime: 738.803us - CompileTime: 10.454ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 27 (27) - NumInstructions: 373 (373) - OptimizationTime: 35.855ms - PeakMemoryUsage: 186.50 KB (190976) - PrepareTime: 22.884ms HDFS_SCAN_NODE (id=1):(Total: 117.848ms, non-child: 117.848ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:1/7.19 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:2 BytesRead(500.000ms): 0 - FooterProcessingTime: (Avg: 39.295ms ; Min: 39.295ms ; Max: 39.295ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 2.14 MB (2244504) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.14 MB (2244504) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 2.14 MB (2244504) - DecompressionTime: 1.304ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 7.45 MB (7817084) - PerReadThreadRawHdfsThroughput: 54.20 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 117.161ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 380.00K (380000) - RowsReturned: 3.46K (3459) - RowsReturnedRate: 29.35 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 6 (6) - ScannerThreadsTotalWallClockTime: 130.553ms - MaterializeTupleTime(*): 34.954ms - ScannerThreadsSysTime: 7.998ms - ScannerThreadsUserTime: 26.995ms - ScannerThreadsVoluntaryContextSwitches: 8 (8) - TotalRawHdfsReadTime(*): 39.495ms - TotalReadThroughput: 0.00 /sec Instance 7f40dcb034de70b7:2e4 (host=vc1532.foo:22000):(Total: 605.524ms, non-child: 404.485ms, % non-child: 66.80%) Hdfs split stats (:<# splits>/): 1:1/7.00 MB 7:1/7.01 MB MemoryUsage(500.000ms): 6.10 MB ThreadUsage(500.000ms): 3 - AverageThreadTokens: 3.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 21.71 MB (22765681) - PerHostPeakMemUsage: 370.79 MB (388805310) - RowsProduced: 6.54K (6540) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 363.533ms - TotalStorageWaitTime: 196.534ms - TotalThreadsInvoluntaryContextSwitches: 59 (59) - TotalThreadsTotalWallClockTime: 852.872ms - TotalThreadsSysTime: 36.993ms - TotalThreadsUserTime: 121.980ms - TotalThreadsVoluntaryContextSwitches: 340 (340) Fragment Instance Lifecycle Timings: - ExecTime: 527.025ms - ExecTreeExecTime: 112.142ms - OpenTime: 45.657ms - ExecTreeOpenTime: 68.718us - PrepareTime: 32.816ms - ExecTreePrepareTime: 137.057us DataStreamSender (dst_id=26):(Total: 27.278ms, non-child: 27.278ms, % non-child: 100.00%) - BytesSent: 12.00 MB (12581260) - NetworkThroughput(*): 509.87 MB/sec - OverallThroughput: 439.85 MB/sec - PeakMemoryUsage: 816.56 KB (836160) - RowsReturned: 6.54K (6540) - SerializeBatchTime: 3.435ms - TransmitDataRPCTime: 23.532ms - UncompressedRowBatchSize: 31.12 MB (32633958) CodeGen:(Total: 61.276ms, non-child: 61.276ms, % non-child: 100.00%) - CodegenTime: 812.495us - CompileTime: 10.714ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 27 (27) - NumInstructions: 373 (373) - OptimizationTime: 33.810ms - PeakMemoryUsage: 186.50 KB (190976) - PrepareTime: 16.266ms HDFS_SCAN_NODE (id=1):(Total: 112.484ms, non-child: 112.484ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:1/7.00 MB 7:1/7.01 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 2 out of 2 Hdfs Read Thread Concurrency Bucket: 0:0% 1:100% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:4 BytesRead(500.000ms): 1.68 MB - FooterProcessingTime: (Avg: 49.824ms ; Min: 42.946ms ; Max: 56.701ms ; Number of samples: 2) - AverageHdfsReadThreadConcurrency: 1.00 - AverageScannerThreadConcurrency: 2.00 - BytesRead: 4.18 MB (4381467) - BytesReadDataNodeCache: 0 - BytesReadLocal: 4.18 MB (4381467) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 4.18 MB (4381467) - DecompressionTime: 4.479ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 2 (2) - NumRowGroups: 2 (2) - NumScannerThreadsStarted: 2 (2) - PeakMemoryUsage: 18.20 MB (19082079) - PerReadThreadRawHdfsThroughput: 55.83 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 111.315ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 740.00K (740000) - RowsReturned: 6.54K (6540) - RowsReturnedRate: 58.14 K/sec - ScanRangesComplete: 2 (2) - ScannerThreadsInvoluntaryContextSwitches: 15 (15) - ScannerThreadsTotalWallClockTime: 280.437ms - MaterializeTupleTime(*): 75.896ms - ScannerThreadsSysTime: 13.997ms - ScannerThreadsUserTime: 65.989ms - ScannerThreadsVoluntaryContextSwitches: 25 (25) - TotalRawHdfsReadTime(*): 74.845ms - TotalReadThroughput: 3.37 MB/sec Instance 7f40dcb034de70b7:28c (host=vc1537.foo:22000):(Total: 605.338ms, non-child: 401.574ms, % non-child: 66.34%) Hdfs split stats (:<# splits>/): 0:1/7.19 MB MemoryUsage(500.000ms): 4.07 MB ThreadUsage(500.000ms): 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 11.02 MB (11552708) - PerHostPeakMemUsage: 240.52 MB (252201156) - RowsProduced: 3.42K (3419) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 327.768ms - TotalStorageWaitTime: 94.570ms - TotalThreadsInvoluntaryContextSwitches: 28 (28) - TotalThreadsTotalWallClockTime: 693.721ms - TotalThreadsSysTime: 22.997ms - TotalThreadsUserTime: 85.986ms - TotalThreadsVoluntaryContextSwitches: 290 (290) Fragment Instance Lifecycle Timings: - ExecTime: 511.062ms - ExecTreeExecTime: 116.929ms - OpenTime: 45.368ms - ExecTreeOpenTime: 46.543us - PrepareTime: 48.867ms - ExecTreePrepareTime: 120.274us DataStreamSender (dst_id=26):(Total: 19.621ms, non-child: 19.621ms, % non-child: 100.00%) - BytesSent: 6.29 MB (6592934) - NetworkThroughput(*): 352.44 MB/sec - OverallThroughput: 320.44 MB/sec - PeakMemoryUsage: 816.56 KB (836160) - RowsReturned: 3.42K (3419) - SerializeBatchTime: 1.370ms - TransmitDataRPCTime: 17.840ms - UncompressedRowBatchSize: 16.28 MB (17066106) CodeGen:(Total: 66.924ms, non-child: 66.924ms, % non-child: 100.00%) - CodegenTime: 765.866us - CompileTime: 10.115ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 27 (27) - NumInstructions: 373 (373) - OptimizationTime: 34.045ms - PeakMemoryUsage: 186.50 KB (190976) - PrepareTime: 22.373ms HDFS_SCAN_NODE (id=1):(Total: 117.217ms, non-child: 117.217ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/7.19 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:0% 1:100% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:2 BytesRead(500.000ms): 1.62 MB - FooterProcessingTime: (Avg: 40.675ms ; Min: 40.675ms ; Max: 40.675ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 1.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 2.14 MB (2244524) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.14 MB (2244524) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 2.14 MB (2244524) - DecompressionTime: 2.261ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 7.41 MB (7774076) - PerReadThreadRawHdfsThroughput: 58.81 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 116.553ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 380.00K (380000) - RowsReturned: 3.42K (3419) - RowsReturnedRate: 29.17 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 6 (6) - ScannerThreadsTotalWallClockTime: 137.531ms - MaterializeTupleTime(*): 38.994ms - ScannerThreadsSysTime: 11.998ms - ScannerThreadsUserTime: 29.995ms - ScannerThreadsVoluntaryContextSwitches: 8 (8) - TotalRawHdfsReadTime(*): 36.397ms - TotalReadThroughput: 3.25 MB/sec Instance 7f40dcb034de70b7:2de (host=vc1501.foo:22000):(Total: 604.988ms, non-child: 385.106ms, % non-child: 63.66%) Hdfs split stats (:<# splits>/): 4:1/7.19 MB MemoryUsage(500.000ms): 824.56 KB, 5.31 MB ThreadUsage(500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 11.12 MB (11660228) - PerHostPeakMemUsage: 353.28 MB (370438156) - RowsProduced: 3.47K (3470) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 330.074ms - TotalStorageWaitTime: 102.873ms - TotalThreadsInvoluntaryContextSwitches: 26 (26) - TotalThreadsTotalWallClockTime: 688.128ms - TotalThreadsSysTime: 18.997ms - TotalThreadsUserTime: 98.985ms - TotalThreadsVoluntaryContextSwitches: 285 (285) Fragment Instance Lifecycle Timings: - ExecTime: 489.341ms - ExecTreeExecTime: 115.367ms - OpenTime: 67.001ms - ExecTreeOpenTime: 28.832us - PrepareTime: 48.598ms - ExecTreePrepareTime: 146.382us DataStreamSender (dst_id=26):(Total: 19.170ms, non-child: 19.170ms, % non-child: 100.00%) - BytesSent: 6.38 MB (6693166) - NetworkThroughput(*): 360.45 MB/sec - OverallThroughput: 332.96 MB/sec - PeakMemoryUsage: 816.56 KB (836160) - RowsReturned: 3.47K (3470) - SerializeBatchTime: 1.015ms - TransmitDataRPCTime: 17.708ms - UncompressedRowBatchSize: 16.52 MB (17318830) CodeGen:(Total: 84.971ms, non-child: 84.971ms, % non-child: 100.00%) - CodegenTime: 1.219ms - CompileTime: 12.752ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 27 (27) - NumInstructions: 373 (373) - OptimizationTime: 52.884ms - PeakMemoryUsage: 186.50 KB (190976) - PrepareTime: 18.707ms HDFS_SCAN_NODE (id=1):(Total: 115.740ms, non-child: 115.740ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:1/7.19 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:2 BytesRead(500.000ms): 0, 2.14 MB - FooterProcessingTime: (Avg: 43.324ms ; Min: 43.324ms ; Max: 43.324ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 2.14 MB (2244631) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.14 MB (2244631) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 2.14 MB (2244631) - DecompressionTime: 2.040ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 7.52 MB (7881596) - PerReadThreadRawHdfsThroughput: 51.78 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 114.956ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 380.00K (380000) - RowsReturned: 3.47K (3470) - RowsReturnedRate: 29.98 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 5 (5) - ScannerThreadsTotalWallClockTime: 132.071ms - MaterializeTupleTime(*): 25.471ms - ScannerThreadsSysTime: 5.999ms - ScannerThreadsUserTime: 21.996ms - ScannerThreadsVoluntaryContextSwitches: 8 (8) - TotalRawHdfsReadTime(*): 41.342ms - TotalReadThroughput: 2.14 MB/sec Instance 7f40dcb034de70b7:2c4 (host=vc1513.foo:22000):(Total: 604.828ms, non-child: 379.735ms, % non-child: 62.78%) Hdfs split stats (:<# splits>/): 3:1/7.19 MB MemoryUsage(500.000ms): 816.56 KB, 2.59 MB ThreadUsage(500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 11.14 MB (11681732) - PerHostPeakMemUsage: 346.92 MB (363776372) - RowsProduced: 3.52K (3524) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 307.983ms - TotalStorageWaitTime: 102.580ms - TotalThreadsInvoluntaryContextSwitches: 18 (18) - TotalThreadsTotalWallClockTime: 703.770ms - TotalThreadsSysTime: 29.995ms - TotalThreadsUserTime: 89.986ms - TotalThreadsVoluntaryContextSwitches: 283 (283) Fragment Instance Lifecycle Timings: - ExecTime: 502.942ms - ExecTreeExecTime: 136.276ms - OpenTime: 47.430ms - ExecTreeOpenTime: 41.774us - PrepareTime: 54.375ms - ExecTreePrepareTime: 123.307us DataStreamSender (dst_id=26):(Total: 17.244ms, non-child: 17.244ms, % non-child: 100.00%) - BytesSent: 6.51 MB (6823414) - NetworkThroughput(*): 404.81 MB/sec - OverallThroughput: 377.36 MB/sec - PeakMemoryUsage: 816.56 KB (836160) - RowsReturned: 3.52K (3524) - SerializeBatchTime: 678.278us - TransmitDataRPCTime: 16.075ms - UncompressedRowBatchSize: 16.78 MB (17590314) CodeGen:(Total: 71.248ms, non-child: 71.248ms, % non-child: 100.00%) - CodegenTime: 796.076us - CompileTime: 11.395ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 27 (27) - NumInstructions: 373 (373) - OptimizationTime: 34.569ms - PeakMemoryUsage: 186.50 KB (190976) - PrepareTime: 24.850ms HDFS_SCAN_NODE (id=1):(Total: 136.599ms, non-child: 136.599ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:1/7.19 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:2 BytesRead(500.000ms): 0, 2.14 MB - FooterProcessingTime: (Avg: 42.109ms ; Min: 42.109ms ; Max: 42.109ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 2.14 MB (2244544) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.14 MB (2244544) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 2.14 MB (2244544) - DecompressionTime: 5.098ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 7.52 MB (7881596) - PerReadThreadRawHdfsThroughput: 65.42 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 135.918ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 380.00K (380000) - RowsReturned: 3.52K (3524) - RowsReturnedRate: 25.80 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 4 (4) - ScannerThreadsTotalWallClockTime: 153.916ms - MaterializeTupleTime(*): 44.473ms - ScannerThreadsSysTime: 9.998ms - ScannerThreadsUserTime: 36.994ms - ScannerThreadsVoluntaryContextSwitches: 6 (6) - TotalRawHdfsReadTime(*): 32.720ms - TotalReadThroughput: 2.14 MB/sec Instance 7f40dcb034de70b7:291 (host=vd1101.foo:22000):(Total: 604.117ms, non-child: 403.951ms, % non-child: 66.87%) Hdfs split stats (:<# splits>/): 2:1/7.19 MB MemoryUsage(500.000ms): 5.29 MB ThreadUsage(500.000ms): 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 11.22 MB (11767748) - PerHostPeakMemUsage: 224.90 MB (235819831) - RowsProduced: 3.47K (3471) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 343.398ms - TotalStorageWaitTime: 89.484ms - TotalThreadsInvoluntaryContextSwitches: 25 (25) - TotalThreadsTotalWallClockTime: 697.021ms - TotalThreadsSysTime: 23.996ms - TotalThreadsUserTime: 90.985ms - TotalThreadsVoluntaryContextSwitches: 269 (269) Fragment Instance Lifecycle Timings: - ExecTime: 516.444ms - ExecTreeExecTime: 120.740ms - OpenTime: 43.936ms - ExecTreeOpenTime: 26.663us - PrepareTime: 43.702ms - ExecTreePrepareTime: 98.223us DataStreamSender (dst_id=26):(Total: 14.283ms, non-child: 14.283ms, % non-child: 100.00%) - BytesSent: 6.39 MB (6704690) - NetworkThroughput(*): 496.04 MB/sec - OverallThroughput: 447.64 MB/sec - PeakMemoryUsage: 816.56 KB (836160) - RowsReturned: 3.47K (3471) - SerializeBatchTime: 1.041ms - TransmitDataRPCTime: 12.890ms - UncompressedRowBatchSize: 16.52 MB (17324190) CodeGen:(Total: 64.902ms, non-child: 64.902ms, % non-child: 100.00%) - CodegenTime: 1.009ms - CompileTime: 10.214ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 27 (27) - NumInstructions: 373 (373) - OptimizationTime: 32.625ms - PeakMemoryUsage: 186.50 KB (190976) - PrepareTime: 21.578ms HDFS_SCAN_NODE (id=1):(Total: 120.980ms, non-child: 120.980ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:1/7.19 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% File Formats: PARQUET/SNAPPY:2 BytesRead(500.000ms): 2.14 MB - FooterProcessingTime: (Avg: 37.068ms ; Min: 37.068ms ; Max: 37.068ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 2.14 MB (2244552) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.14 MB (2244552) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 2.14 MB (2244552) - DecompressionTime: 3.547ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 7.50 MB (7860092) - PerReadThreadRawHdfsThroughput: 53.07 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 120.415ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 380.00K (380000) - RowsReturned: 3.47K (3471) - RowsReturnedRate: 28.69 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 9 (9) - ScannerThreadsTotalWallClockTime: 136.956ms - MaterializeTupleTime(*): 42.071ms - ScannerThreadsSysTime: 7.998ms - ScannerThreadsUserTime: 35.994ms - ScannerThreadsVoluntaryContextSwitches: 6 (6) - TotalRawHdfsReadTime(*): 40.333ms - TotalReadThroughput: 4.28 MB/sec Instance 7f40dcb034de70b7:2ce (host=vd1102.foo:22000):(Total: 603.899ms, non-child: 357.579ms, % non-child: 59.21%) Hdfs split stats (:<# splits>/): 5:1/7.00 MB MemoryUsage(500.000ms): 966.06 KB ThreadUsage(500.000ms): 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 10.90 MB (11433634) - PerHostPeakMemUsage: 369.93 MB (387902484) - RowsProduced: 3.44K (3436) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 299.806ms - TotalStorageWaitTime: 109.019ms - TotalThreadsInvoluntaryContextSwitches: 24 (24) - TotalThreadsTotalWallClockTime: 727.831ms - TotalThreadsSysTime: 19.997ms - TotalThreadsUserTime: 81.987ms - TotalThreadsVoluntaryContextSwitches: 312 (312) Fragment Instance Lifecycle Timings: - ExecTime: 504.207ms - ExecTreeExecTime: 154.105ms - OpenTime: 52.626ms - ExecTreeOpenTime: 81.632us - PrepareTime: 47.021ms - ExecTreePrepareTime: 153.670us DataStreamSender (dst_id=26):(Total: 15.926ms, non-child: 15.926ms, % non-child: 100.00%) - BytesSent: 6.31 MB (6618394) - NetworkThroughput(*): 435.76 MB/sec - OverallThroughput: 396.31 MB/sec - PeakMemoryUsage: 816.56 KB (836160) - RowsReturned: 3.44K (3436) - SerializeBatchTime: 918.938us - TransmitDataRPCTime: 14.484ms - UncompressedRowBatchSize: 16.35 MB (17146104) CodeGen:(Total: 75.852ms, non-child: 75.852ms, % non-child: 100.00%) - CodegenTime: 783.001us - CompileTime: 13.195ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 27 (27) - NumInstructions: 373 (373) - OptimizationTime: 38.086ms - PeakMemoryUsage: 186.50 KB (190976) - PrepareTime: 24.139ms HDFS_SCAN_NODE (id=1):(Total: 154.541ms, non-child: 154.541ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:1/7.00 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:2 BytesRead(500.000ms): 0 - FooterProcessingTime: (Avg: 63.254ms ; Min: 63.254ms ; Max: 63.254ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 2.09 MB (2190737) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.09 MB (2190737) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 2.09 MB (2190737) - DecompressionTime: 4.362ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 7.40 MB (7763554) - PerReadThreadRawHdfsThroughput: 60.10 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 153.735ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 370.00K (370000) - RowsReturned: 3.44K (3436) - RowsReturnedRate: 22.23 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 4 (4) - ScannerThreadsTotalWallClockTime: 171.292ms - MaterializeTupleTime(*): 25.537ms - ScannerThreadsSysTime: 3.999ms - ScannerThreadsUserTime: 23.996ms - ScannerThreadsVoluntaryContextSwitches: 8 (8) - TotalRawHdfsReadTime(*): 34.760ms - TotalReadThroughput: 0.00 /sec Instance 7f40dcb034de70b7:2bc (host=vc1524.foo:22000):(Total: 603.806ms, non-child: 243.756ms, % non-child: 40.37%) Hdfs split stats (:<# splits>/): 2:1/7.19 MB MemoryUsage(500.000ms): 8.14 MB ThreadUsage(500.000ms): 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 11.14 MB (11681732) - PerHostPeakMemUsage: 333.86 MB (350081434) - RowsProduced: 3.44K (3441) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 188.727ms - TotalStorageWaitTime: 236.096ms - TotalThreadsInvoluntaryContextSwitches: 29 (29) - TotalThreadsTotalWallClockTime: 818.272ms - TotalThreadsSysTime: 15.997ms - TotalThreadsUserTime: 97.985ms - TotalThreadsVoluntaryContextSwitches: 282 (282) Fragment Instance Lifecycle Timings: - ExecTime: 486.850ms - ExecTreeExecTime: 261.992ms - OpenTime: 55.566ms - ExecTreeOpenTime: 34.658us - PrepareTime: 61.333ms - ExecTreePrepareTime: 171.672us DataStreamSender (dst_id=26):(Total: 10.954ms, non-child: 10.954ms, % non-child: 100.00%) - BytesSent: 6.36 MB (6666500) - NetworkThroughput(*): 712.91 MB/sec - OverallThroughput: 580.39 MB/sec - PeakMemoryUsage: 816.56 KB (836160) - RowsReturned: 3.44K (3441) - SerializeBatchTime: 912.925us - TransmitDataRPCTime: 8.917ms - UncompressedRowBatchSize: 16.38 MB (17171832) CodeGen:(Total: 86.702ms, non-child: 86.702ms, % non-child: 100.00%) - CodegenTime: 938.296us - CompileTime: 13.453ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 27 (27) - NumInstructions: 373 (373) - OptimizationTime: 40.928ms - PeakMemoryUsage: 186.50 KB (190976) - PrepareTime: 31.877ms HDFS_SCAN_NODE (id=1):(Total: 262.392ms, non-child: 262.392ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:1/7.19 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:2 BytesRead(500.000ms): 2.14 MB - FooterProcessingTime: (Avg: 40.625ms ; Min: 40.625ms ; Max: 40.625ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 2.14 MB (2244601) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.14 MB (2244601) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 2.14 MB (2244601) - DecompressionTime: 1.793ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 7.39 MB (7752572) - PerReadThreadRawHdfsThroughput: 49.58 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 261.564ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 380.00K (380000) - RowsReturned: 3.44K (3441) - RowsReturnedRate: 13.11 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 6 (6) - ScannerThreadsTotalWallClockTime: 276.101ms - MaterializeTupleTime(*): 36.514ms - ScannerThreadsSysTime: 2.999ms - ScannerThreadsUserTime: 35.994ms - ScannerThreadsVoluntaryContextSwitches: 9 (9) - TotalRawHdfsReadTime(*): 43.170ms - TotalReadThroughput: 4.28 MB/sec Instance 7f40dcb034de70b7:2e3 (host=ve1141.foo:22000):(Total: 603.650ms, non-child: 198.961ms, % non-child: 32.96%) Hdfs split stats (:<# splits>/): 0:1/7.01 MB MemoryUsage(500.000ms): 7.74 MB ThreadUsage(500.000ms): 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 10.74 MB (11261602) - PerHostPeakMemUsage: 372.46 MB (390552052) - RowsProduced: 3.27K (3271) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 150.381ms - TotalStorageWaitTime: 224.840ms - TotalThreadsInvoluntaryContextSwitches: 22 (22) - TotalThreadsTotalWallClockTime: 892.880ms - TotalThreadsSysTime: 18.997ms - TotalThreadsUserTime: 80.987ms - TotalThreadsVoluntaryContextSwitches: 289 (289) Fragment Instance Lifecycle Timings: - ExecTime: 509.199ms - ExecTreeExecTime: 324.520ms - OpenTime: 46.133ms - ExecTreeOpenTime: 45.387us - PrepareTime: 48.255ms - ExecTreePrepareTime: 128.020us DataStreamSender (dst_id=26):(Total: 11.582ms, non-child: 11.582ms, % non-child: 100.00%) - BytesSent: 6.04 MB (6335252) - NetworkThroughput(*): 595.69 MB/sec - OverallThroughput: 521.65 MB/sec - PeakMemoryUsage: 816.56 KB (836160) - RowsReturned: 3.27K (3271) - SerializeBatchTime: 890.242us - TransmitDataRPCTime: 10.142ms - UncompressedRowBatchSize: 15.57 MB (16325890) CodeGen:(Total: 68.262ms, non-child: 68.262ms, % non-child: 100.00%) - CodegenTime: 779.157us - CompileTime: 10.218ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 27 (27) - NumInstructions: 373 (373) - OptimizationTime: 34.692ms - PeakMemoryUsage: 186.50 KB (190976) - PrepareTime: 23.001ms HDFS_SCAN_NODE (id=1):(Total: 324.844ms, non-child: 324.844ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/7.01 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:2 BytesRead(500.000ms): 2.09 MB - FooterProcessingTime: (Avg: 162.985ms ; Min: 162.985ms ; Max: 162.985ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 2.09 MB (2190786) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.09 MB (2190786) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 2.09 MB (2190786) - DecompressionTime: 1.833ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 7.01 MB (7353946) - PerReadThreadRawHdfsThroughput: 58.93 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 324.211ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 370.00K (370000) - RowsReturned: 3.27K (3271) - RowsReturnedRate: 10.07 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 3 (3) - ScannerThreadsTotalWallClockTime: 337.881ms - MaterializeTupleTime(*): 33.340ms - ScannerThreadsSysTime: 8.998ms - ScannerThreadsUserTime: 26.995ms - ScannerThreadsVoluntaryContextSwitches: 10 (10) - TotalRawHdfsReadTime(*): 35.450ms - TotalReadThroughput: 4.18 MB/sec Instance 7f40dcb034de70b7:2ab (host=vd1140.foo:22000):(Total: 603.541ms, non-child: 395.982ms, % non-child: 65.61%) Hdfs split stats (:<# splits>/): 6:1/7.01 MB MemoryUsage(500.000ms): 7.94 MB ThreadUsage(500.000ms): 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 10.94 MB (11476642) - PerHostPeakMemUsage: 284.79 MB (298626490) - RowsProduced: 3.37K (3366) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 322.615ms - TotalStorageWaitTime: 83.643ms - TotalThreadsInvoluntaryContextSwitches: 29 (29) - TotalThreadsTotalWallClockTime: 657.842ms - TotalThreadsSysTime: 20.996ms - TotalThreadsUserTime: 93.985ms - TotalThreadsVoluntaryContextSwitches: 294 (294) Fragment Instance Lifecycle Timings: - ExecTime: 481.006ms - ExecTreeExecTime: 103.249ms - OpenTime: 60.246ms - ExecTreeOpenTime: 79.545us - PrepareTime: 62.243ms - ExecTreePrepareTime: 138.947us DataStreamSender (dst_id=26):(Total: 19.004ms, non-child: 19.004ms, % non-child: 100.00%) - BytesSent: 6.23 MB (6532232) - NetworkThroughput(*): 356.86 MB/sec - OverallThroughput: 327.79 MB/sec - PeakMemoryUsage: 816.56 KB (836160) - RowsReturned: 3.37K (3366) - SerializeBatchTime: 882.488us - TransmitDataRPCTime: 17.456ms - UncompressedRowBatchSize: 16.03 MB (16808424) CodeGen:(Total: 84.930ms, non-child: 84.930ms, % non-child: 100.00%) - CodegenTime: 1.055ms - CompileTime: 13.238ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 27 (27) - NumInstructions: 373 (373) - OptimizationTime: 42.112ms - PeakMemoryUsage: 186.50 KB (190976) - PrepareTime: 28.850ms HDFS_SCAN_NODE (id=1):(Total: 103.624ms, non-child: 103.624ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 6:1/7.01 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:2 BytesRead(500.000ms): 2.09 MB - FooterProcessingTime: (Avg: 31.349ms ; Min: 31.349ms ; Max: 31.349ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 2.09 MB (2190678) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.09 MB (2190678) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 2.09 MB (2190678) - DecompressionTime: 1.621ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 7.28 MB (7633498) - PerReadThreadRawHdfsThroughput: 59.83 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 102.511ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 370.00K (370000) - RowsReturned: 3.37K (3366) - RowsReturnedRate: 32.48 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 5 (5) - ScannerThreadsTotalWallClockTime: 120.027ms - MaterializeTupleTime(*): 33.058ms - ScannerThreadsSysTime: 4.999ms - ScannerThreadsUserTime: 29.995ms - ScannerThreadsVoluntaryContextSwitches: 6 (6) - TotalRawHdfsReadTime(*): 34.918ms - TotalReadThroughput: 4.18 MB/sec Instance 7f40dcb034de70b7:2bd (host=vc1515.foo:22000):(Total: 602.537ms, non-child: 349.412ms, % non-child: 57.99%) Hdfs split stats (:<# splits>/): 0:1/7.19 MB MemoryUsage(500.000ms): 4.07 MB ThreadUsage(500.000ms): 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 11.12 MB (11660228) - PerHostPeakMemUsage: 371.89 MB (389956250) - RowsProduced: 3.47K (3470) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 296.513ms - TotalStorageWaitTime: 144.989ms - TotalThreadsInvoluntaryContextSwitches: 32 (32) - TotalThreadsTotalWallClockTime: 741.771ms - TotalThreadsSysTime: 26.996ms - TotalThreadsUserTime: 84.987ms - TotalThreadsVoluntaryContextSwitches: 283 (283) Fragment Instance Lifecycle Timings: - ExecTime: 505.431ms - ExecTreeExecTime: 163.002ms - OpenTime: 54.312ms - ExecTreeOpenTime: 37.625us - PrepareTime: 42.727ms - ExecTreePrepareTime: 117.615us DataStreamSender (dst_id=26):(Total: 13.949ms, non-child: 13.949ms, % non-child: 100.00%) - BytesSent: 6.41 MB (6722378) - NetworkThroughput(*): 517.95 MB/sec - OverallThroughput: 459.59 MB/sec - PeakMemoryUsage: 816.56 KB (836160) - RowsReturned: 3.47K (3470) - SerializeBatchTime: 1.019ms - TransmitDataRPCTime: 12.377ms - UncompressedRowBatchSize: 16.52 MB (17322582) CodeGen:(Total: 75.869ms, non-child: 75.869ms, % non-child: 100.00%) - CodegenTime: 904.001us - CompileTime: 13.650ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 27 (27) - NumInstructions: 373 (373) - OptimizationTime: 39.578ms - PeakMemoryUsage: 186.50 KB (190976) - PrepareTime: 22.145ms HDFS_SCAN_NODE (id=1):(Total: 163.306ms, non-child: 163.306ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/7.19 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:2 BytesRead(500.000ms): 1.62 MB - FooterProcessingTime: (Avg: 42.712ms ; Min: 42.712ms ; Max: 42.712ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 2.14 MB (2244523) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.14 MB (2244523) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 2.14 MB (2244523) - DecompressionTime: 1.843ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 7.56 MB (7924604) - PerReadThreadRawHdfsThroughput: 54.80 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 162.761ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 380.00K (380000) - RowsReturned: 3.47K (3470) - RowsReturnedRate: 21.25 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 8 (8) - ScannerThreadsTotalWallClockTime: 182.279ms - MaterializeTupleTime(*): 33.362ms - ScannerThreadsSysTime: 12.998ms - ScannerThreadsUserTime: 21.996ms - ScannerThreadsVoluntaryContextSwitches: 5 (5) - TotalRawHdfsReadTime(*): 39.058ms - TotalReadThroughput: 3.25 MB/sec Instance 7f40dcb034de70b7:2c7 (host=vd1131.foo:22000):(Total: 602.383ms, non-child: 341.662ms, % non-child: 56.72%) Hdfs split stats (:<# splits>/): 7:1/7.00 MB MemoryUsage(500.000ms): 824.56 KB ThreadUsage(500.000ms): 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 10.86 MB (11390626) - PerHostPeakMemUsage: 348.63 MB (365560802) - RowsProduced: 3.38K (3380) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 273.684ms - TotalStorageWaitTime: 81.896ms - TotalThreadsInvoluntaryContextSwitches: 41 (41) - TotalThreadsTotalWallClockTime: 720.599ms - TotalThreadsSysTime: 21.997ms - TotalThreadsUserTime: 96.985ms - TotalThreadsVoluntaryContextSwitches: 287 (287) Fragment Instance Lifecycle Timings: - ExecTime: 484.293ms - ExecTreeExecTime: 153.630ms - OpenTime: 62.601ms - ExecTreeOpenTime: 50.680us - PrepareTime: 55.438ms - ExecTreePrepareTime: 238.858us DataStreamSender (dst_id=26):(Total: 19.627ms, non-child: 19.627ms, % non-child: 100.00%) - BytesSent: 6.23 MB (6534242) - NetworkThroughput(*): 342.14 MB/sec - OverallThroughput: 317.48 MB/sec - PeakMemoryUsage: 816.56 KB (836160) - RowsReturned: 3.38K (3380) - SerializeBatchTime: 880.545us - TransmitDataRPCTime: 18.213ms - UncompressedRowBatchSize: 16.09 MB (16870734) CodeGen:(Total: 86.896ms, non-child: 86.896ms, % non-child: 100.00%) - CodegenTime: 1.105ms - CompileTime: 14.307ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 27 (27) - NumInstructions: 373 (373) - OptimizationTime: 46.845ms - PeakMemoryUsage: 186.50 KB (190976) - PrepareTime: 24.959ms HDFS_SCAN_NODE (id=1):(Total: 154.196ms, non-child: 154.196ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:1/7.00 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:2 BytesRead(500.000ms): 0 - FooterProcessingTime: (Avg: 29.878ms ; Min: 29.878ms ; Max: 29.878ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 2.09 MB (2190682) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.09 MB (2190682) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 2.09 MB (2190682) - DecompressionTime: 2.558ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 7.24 MB (7590490) - PerReadThreadRawHdfsThroughput: 55.24 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 153.335ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 370.00K (370000) - RowsReturned: 3.38K (3380) - RowsReturnedRate: 21.92 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 9 (9) - ScannerThreadsTotalWallClockTime: 173.990ms - MaterializeTupleTime(*): 35.304ms - ScannerThreadsSysTime: 9.998ms - ScannerThreadsUserTime: 25.996ms - ScannerThreadsVoluntaryContextSwitches: 7 (7) - TotalRawHdfsReadTime(*): 37.817ms - TotalReadThroughput: 0.00 /sec Instance 7f40dcb034de70b7:2b8 (host=vd1119.foo:22000):(Total: 602.071ms, non-child: 351.125ms, % non-child: 58.32%) Hdfs split stats (:<# splits>/): 3:1/7.19 MB MemoryUsage(500.000ms): 4.07 MB ThreadUsage(500.000ms): 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 11.06 MB (11595716) - PerHostPeakMemUsage: 295.69 MB (310053343) - RowsProduced: 3.46K (3455) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 296.154ms - TotalStorageWaitTime: 159.277ms - TotalThreadsInvoluntaryContextSwitches: 33 (33) - TotalThreadsTotalWallClockTime: 761.354ms - TotalThreadsSysTime: 22.996ms - TotalThreadsUserTime: 78.987ms - TotalThreadsVoluntaryContextSwitches: 288 (288) Fragment Instance Lifecycle Timings: - ExecTime: 518.763ms - ExecTreeExecTime: 180.294ms - OpenTime: 44.589ms - ExecTreeOpenTime: 33.385us - PrepareTime: 38.653ms - ExecTreePrepareTime: 112.152us DataStreamSender (dst_id=26):(Total: 12.496ms, non-child: 12.496ms, % non-child: 100.00%) - BytesSent: 6.34 MB (6644390) - NetworkThroughput(*): 574.15 MB/sec - OverallThroughput: 507.08 MB/sec - PeakMemoryUsage: 816.56 KB (836160) - RowsReturned: 3.46K (3455) - SerializeBatchTime: 1.122ms - TransmitDataRPCTime: 11.036ms - UncompressedRowBatchSize: 16.44 MB (17239904) CodeGen:(Total: 57.870ms, non-child: 57.870ms, % non-child: 100.00%) - CodegenTime: 867.150us - CompileTime: 10.090ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 27 (27) - NumInstructions: 373 (373) - OptimizationTime: 33.447ms - PeakMemoryUsage: 186.50 KB (190976) - PrepareTime: 13.957ms HDFS_SCAN_NODE (id=1):(Total: 180.579ms, non-child: 180.579ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:1/7.19 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:0% 1:100% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:2 BytesRead(500.000ms): 1.62 MB - FooterProcessingTime: (Avg: 48.807ms ; Min: 48.807ms ; Max: 48.807ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 1.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 2.14 MB (2244554) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.14 MB (2244554) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 2.14 MB (2244554) - DecompressionTime: 2.923ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 7.39 MB (7752572) - PerReadThreadRawHdfsThroughput: 58.51 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 179.684ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 380.00K (380000) - RowsReturned: 3.46K (3455) - RowsReturnedRate: 19.13 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 9 (9) - ScannerThreadsTotalWallClockTime: 198.315ms - MaterializeTupleTime(*): 34.096ms - ScannerThreadsSysTime: 7.998ms - ScannerThreadsUserTime: 26.995ms - ScannerThreadsVoluntaryContextSwitches: 12 (12) - TotalRawHdfsReadTime(*): 36.586ms - TotalReadThroughput: 3.25 MB/sec Instance 7f40dcb034de70b7:2a5 (host=vc1540.foo:22000):(Total: 601.460ms, non-child: 403.592ms, % non-child: 67.10%) Hdfs split stats (:<# splits>/): 7:1/7.00 MB MemoryUsage(500.000ms): 7.62 MB ThreadUsage(500.000ms): 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 10.78 MB (11304610) - PerHostPeakMemUsage: 235.71 MB (247158335) - RowsProduced: 3.23K (3230) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 341.184ms - TotalStorageWaitTime: 105.797ms - TotalThreadsInvoluntaryContextSwitches: 25 (25) - TotalThreadsTotalWallClockTime: 689.889ms - TotalThreadsSysTime: 25.996ms - TotalThreadsUserTime: 67.989ms - TotalThreadsVoluntaryContextSwitches: 275 (275) Fragment Instance Lifecycle Timings: - ExecTime: 512.192ms - ExecTreeExecTime: 120.308ms - OpenTime: 45.195ms - ExecTreeOpenTime: 46.441us - PrepareTime: 44.024ms - ExecTreePrepareTime: 124.918us DataStreamSender (dst_id=26):(Total: 12.945ms, non-child: 12.945ms, % non-child: 100.00%) - BytesSent: 5.93 MB (6215590) - NetworkThroughput(*): 492.65 MB/sec - OverallThroughput: 457.89 MB/sec - PeakMemoryUsage: 816.56 KB (836160) - RowsReturned: 3.23K (3230) - SerializeBatchTime: 601.232us - TransmitDataRPCTime: 12.032ms - UncompressedRowBatchSize: 15.38 MB (16127436) CodeGen:(Total: 64.288ms, non-child: 64.288ms, % non-child: 100.00%) - CodegenTime: 742.438us - CompileTime: 10.131ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 27 (27) - NumInstructions: 373 (373) - OptimizationTime: 33.851ms - PeakMemoryUsage: 186.50 KB (190976) - PrepareTime: 19.868ms HDFS_SCAN_NODE (id=1):(Total: 120.633ms, non-child: 120.633ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:1/7.00 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:2 BytesRead(500.000ms): 2.09 MB - FooterProcessingTime: (Avg: 41.271ms ; Min: 41.271ms ; Max: 41.271ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 2.09 MB (2190785) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.09 MB (2190785) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 2.09 MB (2190785) - DecompressionTime: 2.563ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 7.14 MB (7482970) - PerReadThreadRawHdfsThroughput: 44.15 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 119.980ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 370.00K (370000) - RowsReturned: 3.23K (3230) - RowsReturnedRate: 26.77 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 5 (5) - ScannerThreadsTotalWallClockTime: 132.766ms - MaterializeTupleTime(*): 22.906ms - ScannerThreadsSysTime: 4.999ms - ScannerThreadsUserTime: 19.996ms - ScannerThreadsVoluntaryContextSwitches: 7 (7) - TotalRawHdfsReadTime(*): 47.325ms - TotalReadThroughput: 4.18 MB/sec Instance 7f40dcb034de70b7:2c6 (host=vd1126.foo:22000):(Total: 600.569ms, non-child: 342.954ms, % non-child: 57.10%) Hdfs split stats (:<# splits>/): 2:1/7.19 MB MemoryUsage(500.000ms): 4.07 MB ThreadUsage(500.000ms): 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 11.12 MB (11660228) - PerHostPeakMemUsage: 347.39 MB (364266668) - RowsProduced: 3.36K (3359) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 279.286ms - TotalStorageWaitTime: 120.048ms - TotalThreadsInvoluntaryContextSwitches: 22 (22) - TotalThreadsTotalWallClockTime: 740.704ms - TotalThreadsSysTime: 29.995ms - TotalThreadsUserTime: 76.987ms - TotalThreadsVoluntaryContextSwitches: 272 (272) Fragment Instance Lifecycle Timings: - ExecTime: 502.819ms - ExecTreeExecTime: 170.728ms - OpenTime: 47.246ms - ExecTreeOpenTime: 41.023us - PrepareTime: 50.453ms - ExecTreePrepareTime: 138.049us DataStreamSender (dst_id=26):(Total: 19.440ms, non-child: 19.440ms, % non-child: 100.00%) - BytesSent: 6.19 MB (6487610) - NetworkThroughput(*): 346.56 MB/sec - OverallThroughput: 318.26 MB/sec - PeakMemoryUsage: 816.56 KB (836160) - RowsReturned: 3.36K (3359) - SerializeBatchTime: 977.279us - TransmitDataRPCTime: 17.852ms - UncompressedRowBatchSize: 15.99 MB (16771306) CodeGen:(Total: 67.107ms, non-child: 67.107ms, % non-child: 100.00%) - CodegenTime: 784.003us - CompileTime: 9.990ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 27 (27) - NumInstructions: 373 (373) - OptimizationTime: 34.157ms - PeakMemoryUsage: 186.50 KB (190976) - PrepareTime: 22.479ms HDFS_SCAN_NODE (id=1):(Total: 171.067ms, non-child: 171.067ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:1/7.19 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:2 BytesRead(500.000ms): 1.62 MB - FooterProcessingTime: (Avg: 64.610ms ; Min: 64.610ms ; Max: 64.610ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 2.14 MB (2244510) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.14 MB (2244510) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 2.14 MB (2244510) - DecompressionTime: 4.985ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 7.45 MB (7817084) - PerReadThreadRawHdfsThroughput: 41.26 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 170.380ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 380.00K (380000) - RowsReturned: 3.36K (3359) - RowsReturnedRate: 19.64 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 8 (8) - ScannerThreadsTotalWallClockTime: 192.826ms - MaterializeTupleTime(*): 37.464ms - ScannerThreadsSysTime: 8.998ms - ScannerThreadsUserTime: 28.995ms - ScannerThreadsVoluntaryContextSwitches: 5 (5) - TotalRawHdfsReadTime(*): 51.880ms - TotalReadThroughput: 3.25 MB/sec Instance 7f40dcb034de70b7:2cb (host=ve1139.foo:22000):(Total: 600.508ms, non-child: 375.787ms, % non-child: 62.58%) Hdfs split stats (:<# splits>/): 0:1/7.19 MB MemoryUsage(500.000ms): 8.10 MB ThreadUsage(500.000ms): 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 11.10 MB (11638724) - PerHostPeakMemUsage: 336.29 MB (352624693) - RowsProduced: 3.46K (3461) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 303.369ms - TotalStorageWaitTime: 119.864ms - TotalThreadsInvoluntaryContextSwitches: 28 (28) - TotalThreadsTotalWallClockTime: 696.062ms - TotalThreadsSysTime: 28.994ms - TotalThreadsUserTime: 79.987ms - TotalThreadsVoluntaryContextSwitches: 296 (296) Fragment Instance Lifecycle Timings: - ExecTime: 489.099ms - ExecTreeExecTime: 140.181ms - OpenTime: 47.524ms - ExecTreeOpenTime: 29.308us - PrepareTime: 63.830ms - ExecTreePrepareTime: 133.751us DataStreamSender (dst_id=26):(Total: 17.116ms, non-child: 17.116ms, % non-child: 100.00%) - BytesSent: 6.35 MB (6656450) - NetworkThroughput(*): 399.34 MB/sec - OverallThroughput: 370.87 MB/sec - PeakMemoryUsage: 816.56 KB (836160) - RowsReturned: 3.46K (3461) - SerializeBatchTime: 809.138us - TransmitDataRPCTime: 15.896ms - UncompressedRowBatchSize: 16.47 MB (17269116) CodeGen:(Total: 67.084ms, non-child: 67.084ms, % non-child: 100.00%) - CodegenTime: 792.961us - CompileTime: 10.020ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 27 (27) - NumInstructions: 373 (373) - OptimizationTime: 36.135ms - PeakMemoryUsage: 186.50 KB (190976) - PrepareTime: 20.539ms HDFS_SCAN_NODE (id=1):(Total: 140.520ms, non-child: 140.520ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/7.19 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:2 BytesRead(500.000ms): 2.14 MB - FooterProcessingTime: (Avg: 60.968ms ; Min: 60.968ms ; Max: 60.968ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 2.14 MB (2244589) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.14 MB (2244589) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 2.14 MB (2244589) - DecompressionTime: 4.317ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 7.64 MB (8011652) - PerReadThreadRawHdfsThroughput: 40.22 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 139.850ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 380.00K (380000) - RowsReturned: 3.46K (3461) - RowsReturnedRate: 24.63 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 6 (6) - ScannerThreadsTotalWallClockTime: 159.719ms - MaterializeTupleTime(*): 33.842ms - ScannerThreadsSysTime: 6.998ms - ScannerThreadsUserTime: 26.995ms - ScannerThreadsVoluntaryContextSwitches: 14 (14) - TotalRawHdfsReadTime(*): 53.225ms - TotalReadThroughput: 4.28 MB/sec Instance 7f40dcb034de70b7:28e (host=vd1142.foo:22000):(Total: 600.406ms, non-child: 418.312ms, % non-child: 69.67%) Hdfs split stats (:<# splits>/): 0:1/7.00 MB MemoryUsage(500.000ms): 824.56 KB, 830.06 KB ThreadUsage(500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 10.84 MB (11369122) - PerHostPeakMemUsage: 244.58 MB (256461422) - RowsProduced: 3.31K (3311) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 344.259ms - TotalStorageWaitTime: 80.156ms - TotalThreadsInvoluntaryContextSwitches: 24 (24) - TotalThreadsTotalWallClockTime: 675.448ms - TotalThreadsSysTime: 26.995ms - TotalThreadsUserTime: 80.987ms - TotalThreadsVoluntaryContextSwitches: 298 (298) Fragment Instance Lifecycle Timings: - ExecTime: 507.354ms - ExecTreeExecTime: 105.179ms - OpenTime: 44.574ms - ExecTreeOpenTime: 36.978us - PrepareTime: 48.437ms - ExecTreePrepareTime: 125.161us DataStreamSender (dst_id=26):(Total: 15.387ms, non-child: 15.387ms, % non-child: 100.00%) - BytesSent: 6.10 MB (6395820) - NetworkThroughput(*): 426.65 MB/sec - OverallThroughput: 396.41 MB/sec - PeakMemoryUsage: 816.56 KB (836160) - RowsReturned: 3.31K (3311) - SerializeBatchTime: 735.169us - TransmitDataRPCTime: 14.296ms - UncompressedRowBatchSize: 15.76 MB (16523406) CodeGen:(Total: 61.204ms, non-child: 61.204ms, % non-child: 100.00%) - CodegenTime: 883.596us - CompileTime: 9.327ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 27 (27) - NumInstructions: 373 (373) - OptimizationTime: 34.232ms - PeakMemoryUsage: 186.50 KB (190976) - PrepareTime: 17.007ms HDFS_SCAN_NODE (id=1):(Total: 105.501ms, non-child: 105.501ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/7.00 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:2 BytesRead(500.000ms): 0 - FooterProcessingTime: (Avg: 34.833ms ; Min: 34.833ms ; Max: 34.833ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 2.09 MB (2190730) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.09 MB (2190730) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 2.09 MB (2190730) - DecompressionTime: 1.468ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 7.24 MB (7590490) - PerReadThreadRawHdfsThroughput: 61.55 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 104.697ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 370.00K (370000) - RowsReturned: 3.31K (3311) - RowsReturnedRate: 31.38 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 8 (8) - ScannerThreadsTotalWallClockTime: 123.771ms - MaterializeTupleTime(*): 40.498ms - ScannerThreadsSysTime: 9.998ms - ScannerThreadsUserTime: 28.995ms - ScannerThreadsVoluntaryContextSwitches: 10 (10) - TotalRawHdfsReadTime(*): 33.944ms - TotalReadThroughput: 0.00 /sec Instance 7f40dcb034de70b7:2db (host=va1031.foo:22000):(Total: 599.481ms, non-child: 215.376ms, % non-child: 35.93%) Hdfs split stats (:<# splits>/): 4:1/7.19 MB MemoryUsage(500.000ms): 966.06 KB ThreadUsage(500.000ms): 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 11.08 MB (11617220) - PerHostPeakMemUsage: 364.02 MB (381705407) - RowsProduced: 3.50K (3498) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 166.215ms - TotalStorageWaitTime: 173.970ms - TotalThreadsInvoluntaryContextSwitches: 22 (22) - TotalThreadsTotalWallClockTime: 890.433ms - TotalThreadsSysTime: 16.996ms - TotalThreadsUserTime: 93.986ms - TotalThreadsVoluntaryContextSwitches: 308 (308) Fragment Instance Lifecycle Timings: - ExecTime: 515.390ms - ExecTreeExecTime: 310.928ms - OpenTime: 47.618ms - ExecTreeOpenTime: 47.432us - PrepareTime: 36.432ms - ExecTreePrepareTime: 98.874us DataStreamSender (dst_id=26):(Total: 12.073ms, non-child: 12.073ms, % non-child: 100.00%) - BytesSent: 6.42 MB (6736716) - NetworkThroughput(*): 603.23 MB/sec - OverallThroughput: 532.13 MB/sec - PeakMemoryUsage: 816.56 KB (836160) - RowsReturned: 3.50K (3498) - SerializeBatchTime: 1.073ms - TransmitDataRPCTime: 10.650ms - UncompressedRowBatchSize: 16.65 MB (17455376) CodeGen:(Total: 60.840ms, non-child: 60.840ms, % non-child: 100.00%) - CodegenTime: 798.609us - CompileTime: 12.433ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 27 (27) - NumInstructions: 373 (373) - OptimizationTime: 33.992ms - PeakMemoryUsage: 186.50 KB (190976) - PrepareTime: 14.010ms HDFS_SCAN_NODE (id=1):(Total: 311.191ms, non-child: 311.191ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:1/7.19 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:2 BytesRead(500.000ms): 0 - FooterProcessingTime: (Avg: 129.832ms ; Min: 129.832ms ; Max: 129.832ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 2.14 MB (2244567) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.14 MB (2244567) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 2.14 MB (2244567) - DecompressionTime: 1.343ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 7.52 MB (7881596) - PerReadThreadRawHdfsThroughput: 62.67 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 310.602ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 380.00K (380000) - RowsReturned: 3.50K (3498) - RowsReturnedRate: 11.24 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 8 (8) - ScannerThreadsTotalWallClockTime: 327.738ms - MaterializeTupleTime(*): 42.697ms - ScannerThreadsSysTime: 2.999ms - ScannerThreadsUserTime: 38.994ms - ScannerThreadsVoluntaryContextSwitches: 10 (10) - TotalRawHdfsReadTime(*): 34.158ms - TotalReadThroughput: 0.00 /sec Instance 7f40dcb034de70b7:2ae (host=vd1132.foo:22000):(Total: 599.368ms, non-child: 418.323ms, % non-child: 69.79%) Hdfs split stats (:<# splits>/): 2:1/7.19 MB MemoryUsage(500.000ms): 830.06 KB ThreadUsage(500.000ms): 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 11.06 MB (11595716) - PerHostPeakMemUsage: 234.49 MB (245883960) - RowsProduced: 3.41K (3411) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 346.664ms - TotalStorageWaitTime: 79.774ms - TotalThreadsInvoluntaryContextSwitches: 23 (23) - TotalThreadsTotalWallClockTime: 676.987ms - TotalThreadsSysTime: 16.996ms - TotalThreadsUserTime: 89.986ms - TotalThreadsVoluntaryContextSwitches: 290 (290) Fragment Instance Lifecycle Timings: - ExecTime: 509.415ms - ExecTreeExecTime: 102.564ms - OpenTime: 50.068ms - ExecTreeOpenTime: 29.172us - PrepareTime: 39.845ms - ExecTreePrepareTime: 410.284us DataStreamSender (dst_id=26):(Total: 10.547ms, non-child: 10.547ms, % non-child: 100.00%) - BytesSent: 6.27 MB (6576050) - NetworkThroughput(*): 674.94 MB/sec - OverallThroughput: 594.61 MB/sec - PeakMemoryUsage: 816.56 KB (836160) - RowsReturned: 3.41K (3411) - SerializeBatchTime: 838.619us - TransmitDataRPCTime: 9.291ms - UncompressedRowBatchSize: 16.24 MB (17024164) CodeGen:(Total: 67.047ms, non-child: 67.047ms, % non-child: 100.00%) - CodegenTime: 927.893us - CompileTime: 10.102ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 27 (27) - NumInstructions: 373 (373) - OptimizationTime: 39.125ms - PeakMemoryUsage: 186.50 KB (190976) - PrepareTime: 17.301ms HDFS_SCAN_NODE (id=1):(Total: 103.449ms, non-child: 103.449ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:1/7.19 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:2 - FooterProcessingTime: (Avg: 25.703ms ; Min: 25.703ms ; Max: 25.703ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 2.14 MB (2244578) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.14 MB (2244578) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 2.14 MB (2244578) - DecompressionTime: 1.569ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 7.54 MB (7903100) - PerReadThreadRawHdfsThroughput: 52.43 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 102.200ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 380.00K (380000) - RowsReturned: 3.41K (3411) - RowsReturnedRate: 32.97 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 5 (5) - ScannerThreadsTotalWallClockTime: 117.720ms - MaterializeTupleTime(*): 34.568ms - ScannerThreadsSysTime: 6.998ms - ScannerThreadsUserTime: 29.995ms - ScannerThreadsVoluntaryContextSwitches: 8 (8) - TotalRawHdfsReadTime(*): 40.830ms - TotalReadThroughput: 0.00 /sec Instance 7f40dcb034de70b7:2b7 (host=va1038.foo:22000):(Total: 599.107ms, non-child: 354.046ms, % non-child: 59.10%) Hdfs split stats (:<# splits>/): 0:1/7.19 MB MemoryUsage(500.000ms): 5.29 MB ThreadUsage(500.000ms): 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 11.18 MB (11724740) - PerHostPeakMemUsage: 244.84 MB (256730447) - RowsProduced: 3.46K (3460) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 311.410ms - TotalStorageWaitTime: 152.914ms - TotalThreadsInvoluntaryContextSwitches: 21 (21) - TotalThreadsTotalWallClockTime: 752.974ms - TotalThreadsSysTime: 17.997ms - TotalThreadsUserTime: 76.988ms - TotalThreadsVoluntaryContextSwitches: 279 (279) Fragment Instance Lifecycle Timings: - ExecTime: 525.787ms - ExecTreeExecTime: 171.810ms - OpenTime: 40.622ms - ExecTreeOpenTime: 26.198us - PrepareTime: 32.657ms - ExecTreePrepareTime: 127.754us DataStreamSender (dst_id=26):(Total: 17.820ms, non-child: 17.820ms, % non-child: 100.00%) - BytesSent: 6.38 MB (6694640) - NetworkThroughput(*): 377.91 MB/sec - OverallThroughput: 358.26 MB/sec - PeakMemoryUsage: 816.56 KB (836160) - RowsReturned: 3.46K (3460) - SerializeBatchTime: 647.648us - TransmitDataRPCTime: 16.894ms - UncompressedRowBatchSize: 16.47 MB (17264828) CodeGen:(Total: 55.118ms, non-child: 55.118ms, % non-child: 100.00%) - CodegenTime: 697.232us - CompileTime: 8.930ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 27 (27) - NumInstructions: 373 (373) - OptimizationTime: 30.491ms - PeakMemoryUsage: 186.50 KB (190976) - PrepareTime: 15.307ms HDFS_SCAN_NODE (id=1):(Total: 172.122ms, non-child: 172.122ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/7.19 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:2 BytesRead(500.000ms): 2.14 MB - FooterProcessingTime: (Avg: 49.680ms ; Min: 49.680ms ; Max: 49.680ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 2.14 MB (2244532) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.14 MB (2244532) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 2.14 MB (2244532) - DecompressionTime: 1.795ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 7.50 MB (7860092) - PerReadThreadRawHdfsThroughput: 56.79 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 171.512ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 380.00K (380000) - RowsReturned: 3.46K (3460) - RowsReturnedRate: 20.10 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 5 (5) - ScannerThreadsTotalWallClockTime: 186.882ms - MaterializeTupleTime(*): 30.559ms - ScannerThreadsSysTime: 4.999ms - ScannerThreadsUserTime: 27.995ms - ScannerThreadsVoluntaryContextSwitches: 6 (6) - TotalRawHdfsReadTime(*): 37.689ms - TotalReadThroughput: 4.28 MB/sec Instance 7f40dcb034de70b7:2d3 (host=vc1504.foo:22000):(Total: 598.978ms, non-child: 383.120ms, % non-child: 63.96%) Hdfs split stats (:<# splits>/): 1:1/7.19 MB MemoryUsage(500.000ms): 5.44 MB ThreadUsage(500.000ms): 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 11.18 MB (11724740) - PerHostPeakMemUsage: 344.56 MB (361293317) - RowsProduced: 3.42K (3425) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 321.977ms - TotalStorageWaitTime: 88.192ms - TotalThreadsInvoluntaryContextSwitches: 23 (23) - TotalThreadsTotalWallClockTime: 714.507ms - TotalThreadsSysTime: 24.996ms - TotalThreadsUserTime: 71.989ms - TotalThreadsVoluntaryContextSwitches: 285 (285) Fragment Instance Lifecycle Timings: - ExecTime: 511.198ms - ExecTreeExecTime: 143.640ms - OpenTime: 45.086ms - ExecTreeOpenTime: 29.082us - PrepareTime: 42.643ms - ExecTreePrepareTime: 106.322us DataStreamSender (dst_id=26):(Total: 13.757ms, non-child: 13.757ms, % non-child: 100.00%) - BytesSent: 6.25 MB (6554744) - NetworkThroughput(*): 495.14 MB/sec - OverallThroughput: 454.37 MB/sec - PeakMemoryUsage: 816.56 KB (836160) - RowsReturned: 3.42K (3425) - SerializeBatchTime: 791.285us - TransmitDataRPCTime: 12.624ms - UncompressedRowBatchSize: 16.29 MB (17082990) CodeGen:(Total: 58.195ms, non-child: 58.195ms, % non-child: 100.00%) - CodegenTime: 945.362us - CompileTime: 9.982ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 27 (27) - NumInstructions: 373 (373) - OptimizationTime: 33.741ms - PeakMemoryUsage: 186.50 KB (190976) - PrepareTime: 14.042ms HDFS_SCAN_NODE (id=1):(Total: 143.904ms, non-child: 143.904ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:1/7.19 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:2 BytesRead(500.000ms): 2.14 MB - FooterProcessingTime: (Avg: 37.144ms ; Min: 37.144ms ; Max: 37.144ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 2.14 MB (2244573) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.14 MB (2244573) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 2.14 MB (2244573) - DecompressionTime: 1.668ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 7.64 MB (8011652) - PerReadThreadRawHdfsThroughput: 60.50 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 143.384ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 380.00K (380000) - RowsReturned: 3.42K (3425) - RowsReturnedRate: 23.80 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 5 (5) - ScannerThreadsTotalWallClockTime: 158.858ms - MaterializeTupleTime(*): 27.482ms - ScannerThreadsSysTime: 5.999ms - ScannerThreadsUserTime: 22.996ms - ScannerThreadsVoluntaryContextSwitches: 6 (6) - TotalRawHdfsReadTime(*): 35.383ms - TotalReadThroughput: 4.28 MB/sec Instance 7f40dcb034de70b7:2a9 (host=vc1507.foo:22000):(Total: 598.260ms, non-child: 404.950ms, % non-child: 67.69%) Hdfs split stats (:<# splits>/): 7:1/7.01 MB MemoryUsage(500.000ms): 2.17 MB ThreadUsage(500.000ms): 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 10.86 MB (11390626) - PerHostPeakMemUsage: 230.68 MB (241882176) - RowsProduced: 3.35K (3350) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 331.910ms - TotalStorageWaitTime: 78.656ms - TotalThreadsInvoluntaryContextSwitches: 18 (18) - TotalThreadsTotalWallClockTime: 684.520ms - TotalThreadsSysTime: 29.994ms - TotalThreadsUserTime: 88.985ms - TotalThreadsVoluntaryContextSwitches: 289 (289) Fragment Instance Lifecycle Timings: - ExecTime: 509.458ms - ExecTreeExecTime: 107.520ms - OpenTime: 46.524ms - ExecTreeOpenTime: 32.268us - PrepareTime: 42.202ms - ExecTreePrepareTime: 117.273us DataStreamSender (dst_id=26):(Total: 19.645ms, non-child: 19.645ms, % non-child: 100.00%) - BytesSent: 6.19 MB (6486538) - NetworkThroughput(*): 338.78 MB/sec - OverallThroughput: 314.89 MB/sec - PeakMemoryUsage: 816.56 KB (836160) - RowsReturned: 3.35K (3350) - SerializeBatchTime: 988.839us - TransmitDataRPCTime: 18.260ms - UncompressedRowBatchSize: 15.95 MB (16726550) CodeGen:(Total: 65.858ms, non-child: 65.858ms, % non-child: 100.00%) - CodegenTime: 887.505us - CompileTime: 9.897ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 27 (27) - NumInstructions: 373 (373) - OptimizationTime: 35.370ms - PeakMemoryUsage: 186.50 KB (190976) - PrepareTime: 20.177ms HDFS_SCAN_NODE (id=1):(Total: 107.807ms, non-child: 107.807ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:1/7.01 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:2 BytesRead(500.000ms): 2.09 MB - FooterProcessingTime: (Avg: 34.515ms ; Min: 34.515ms ; Max: 34.515ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 2.09 MB (2190795) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.09 MB (2190795) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 2.09 MB (2190795) - DecompressionTime: 1.979ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 7.26 MB (7611994) - PerReadThreadRawHdfsThroughput: 55.69 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 107.179ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 370.00K (370000) - RowsReturned: 3.35K (3350) - RowsReturnedRate: 31.07 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 6 (6) - ScannerThreadsTotalWallClockTime: 128.830ms - MaterializeTupleTime(*): 46.327ms - ScannerThreadsSysTime: 7.998ms - ScannerThreadsUserTime: 32.994ms - ScannerThreadsVoluntaryContextSwitches: 11 (11) - TotalRawHdfsReadTime(*): 37.519ms - TotalReadThroughput: 4.18 MB/sec Instance 7f40dcb034de70b7:2c5 (host=vc1538.foo:22000):(Total: 598.040ms, non-child: 307.977ms, % non-child: 51.50%) Hdfs split stats (:<# splits>/): 2:1/7.19 MB MemoryUsage(500.000ms): 1011.06 KB, 830.06 KB ThreadUsage(500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 11.10 MB (11638724) - PerHostPeakMemUsage: 250.83 MB (263015514) - RowsProduced: 3.48K (3476) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 241.499ms - TotalStorageWaitTime: 111.924ms - TotalThreadsInvoluntaryContextSwitches: 24 (24) - TotalThreadsTotalWallClockTime: 752.862ms - TotalThreadsSysTime: 19.996ms - TotalThreadsUserTime: 97.984ms - TotalThreadsVoluntaryContextSwitches: 301 (301) Fragment Instance Lifecycle Timings: - ExecTime: 483.560ms - ExecTreeExecTime: 190.794ms - OpenTime: 65.319ms - ExecTreeOpenTime: 40.109us - PrepareTime: 49.107ms - ExecTreePrepareTime: 172.759us DataStreamSender (dst_id=26):(Total: 10.335ms, non-child: 10.335ms, % non-child: 100.00%) - BytesSent: 6.39 MB (6700670) - NetworkThroughput(*): 718.02 MB/sec - OverallThroughput: 618.29 MB/sec - PeakMemoryUsage: 816.56 KB (836160) - RowsReturned: 3.48K (3476) - SerializeBatchTime: 1.001ms - TransmitDataRPCTime: 8.899ms - UncompressedRowBatchSize: 16.54 MB (17344424) CodeGen:(Total: 88.491ms, non-child: 88.491ms, % non-child: 100.00%) - CodegenTime: 1.016ms - CompileTime: 13.585ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 27 (27) - NumInstructions: 373 (373) - OptimizationTime: 50.021ms - PeakMemoryUsage: 186.50 KB (190976) - PrepareTime: 24.460ms HDFS_SCAN_NODE (id=1):(Total: 191.235ms, non-child: 191.235ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:1/7.19 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:2 BytesRead(500.000ms): 0 - FooterProcessingTime: (Avg: 52.633ms ; Min: 52.633ms ; Max: 52.633ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 2.14 MB (2244539) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.14 MB (2244539) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 2.14 MB (2244539) - DecompressionTime: 2.017ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 7.41 MB (7774076) - PerReadThreadRawHdfsThroughput: 39.42 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 190.476ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 380.00K (380000) - RowsReturned: 3.48K (3476) - RowsReturnedRate: 18.18 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 5 (5) - ScannerThreadsTotalWallClockTime: 204.302ms - MaterializeTupleTime(*): 32.014ms - ScannerThreadsSysTime: 6.998ms - ScannerThreadsUserTime: 26.995ms - ScannerThreadsVoluntaryContextSwitches: 10 (10) - TotalRawHdfsReadTime(*): 54.303ms - TotalReadThroughput: 0.00 /sec Instance 7f40dcb034de70b7:2e5 (host=va1032.foo:22000):(Total: 596.940ms, non-child: 367.021ms, % non-child: 61.48%) Hdfs split stats (:<# splits>/): 6:1/7.19 MB MemoryUsage(500.000ms): 5.35 MB ThreadUsage(500.000ms): 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 11.12 MB (11660228) - PerHostPeakMemUsage: 346.39 MB (363218034) - RowsProduced: 3.51K (3508) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 304.729ms - TotalStorageWaitTime: 113.433ms - TotalThreadsInvoluntaryContextSwitches: 17 (17) - TotalThreadsTotalWallClockTime: 694.864ms - TotalThreadsSysTime: 28.995ms - TotalThreadsUserTime: 79.988ms - TotalThreadsVoluntaryContextSwitches: 291 (291) Fragment Instance Lifecycle Timings: - ExecTime: 497.033ms - ExecTreeExecTime: 132.669ms - OpenTime: 48.636ms - ExecTreeOpenTime: 31.773us - PrepareTime: 51.218ms - ExecTreePrepareTime: 119.880us DataStreamSender (dst_id=26):(Total: 24.450ms, non-child: 24.450ms, % non-child: 100.00%) - BytesSent: 6.50 MB (6811086) - NetworkThroughput(*): 284.09 MB/sec - OverallThroughput: 265.66 MB/sec - PeakMemoryUsage: 816.56 KB (836160) - RowsReturned: 3.51K (3508) - SerializeBatchTime: 954.620us - TransmitDataRPCTime: 22.864ms - UncompressedRowBatchSize: 16.70 MB (17510852) CodeGen:(Total: 72.500ms, non-child: 72.500ms, % non-child: 100.00%) - CodegenTime: 907.504us - CompileTime: 10.800ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 27 (27) - NumInstructions: 373 (373) - OptimizationTime: 36.409ms - PeakMemoryUsage: 186.50 KB (190976) - PrepareTime: 24.815ms HDFS_SCAN_NODE (id=1):(Total: 132.968ms, non-child: 132.968ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 6:1/7.19 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:2 BytesRead(500.000ms): 2.14 MB - FooterProcessingTime: (Avg: 52.826ms ; Min: 52.826ms ; Max: 52.826ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 2.14 MB (2244546) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.14 MB (2244546) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 2.14 MB (2244546) - DecompressionTime: 2.580ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 7.56 MB (7924604) - PerReadThreadRawHdfsThroughput: 44.07 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 132.243ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 380.00K (380000) - RowsReturned: 3.51K (3508) - RowsReturnedRate: 26.38 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 6 (6) - ScannerThreadsTotalWallClockTime: 149.559ms - MaterializeTupleTime(*): 29.339ms - ScannerThreadsSysTime: 6.998ms - ScannerThreadsUserTime: 25.996ms - ScannerThreadsVoluntaryContextSwitches: 13 (13) - TotalRawHdfsReadTime(*): 48.577ms - TotalReadThroughput: 4.28 MB/sec Instance 7f40dcb034de70b7:2ca (host=vd1141.foo:22000):(Total: 596.708ms, non-child: 347.740ms, % non-child: 58.28%) Hdfs split stats (:<# splits>/): 1:1/7.18 MB MemoryUsage(500.000ms): 1011.06 KB, 830.06 KB ThreadUsage(500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 11.12 MB (11660228) - PerHostPeakMemUsage: 246.45 MB (258425951) - RowsProduced: 3.37K (3373) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 282.804ms - TotalStorageWaitTime: 138.476ms - TotalThreadsInvoluntaryContextSwitches: 19 (19) - TotalThreadsTotalWallClockTime: 723.916ms - TotalThreadsSysTime: 18.997ms - TotalThreadsUserTime: 86.986ms - TotalThreadsVoluntaryContextSwitches: 322 (322) Fragment Instance Lifecycle Timings: - ExecTime: 494.743ms - ExecTreeExecTime: 158.848ms - OpenTime: 49.372ms - ExecTreeOpenTime: 42.258us - PrepareTime: 52.530ms - ExecTreePrepareTime: 134.908us DataStreamSender (dst_id=26):(Total: 10.018ms, non-child: 10.018ms, % non-child: 100.00%) - BytesSent: 6.19 MB (6489754) - NetworkThroughput(*): 734.43 MB/sec - OverallThroughput: 617.79 MB/sec - PeakMemoryUsage: 816.56 KB (836160) - RowsReturned: 3.37K (3373) - SerializeBatchTime: 911.939us - TransmitDataRPCTime: 8.427ms - UncompressedRowBatchSize: 16.05 MB (16827184) CodeGen:(Total: 79.741ms, non-child: 79.741ms, % non-child: 100.00%) - CodegenTime: 856.585us - CompileTime: 12.154ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 27 (27) - NumInstructions: 373 (373) - OptimizationTime: 35.873ms - PeakMemoryUsage: 186.50 KB (190976) - PrepareTime: 31.308ms HDFS_SCAN_NODE (id=1):(Total: 159.208ms, non-child: 159.208ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:1/7.18 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:2 BytesRead(500.000ms): 0 - FooterProcessingTime: (Avg: 77.282ms ; Min: 77.282ms ; Max: 77.282ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 2.14 MB (2244566) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.14 MB (2244566) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 2.14 MB (2244566) - DecompressionTime: 1.499ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 7.39 MB (7752572) - PerReadThreadRawHdfsThroughput: 55.56 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 158.202ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 380.00K (380000) - RowsReturned: 3.37K (3373) - RowsReturnedRate: 21.19 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 4 (4) - ScannerThreadsTotalWallClockTime: 180.244ms - MaterializeTupleTime(*): 38.139ms - ScannerThreadsSysTime: 5.999ms - ScannerThreadsUserTime: 31.995ms - ScannerThreadsVoluntaryContextSwitches: 19 (19) - TotalRawHdfsReadTime(*): 38.528ms - TotalReadThroughput: 0.00 /sec Instance 7f40dcb034de70b7:2df (host=vc1530.foo:22000):(Total: 596.371ms, non-child: 370.930ms, % non-child: 62.20%) Hdfs split stats (:<# splits>/): 5:1/7.19 MB MemoryUsage(500.000ms): 4.07 MB ThreadUsage(500.000ms): 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 11.10 MB (11638724) - PerHostPeakMemUsage: 300.61 MB (315210370) - RowsProduced: 3.40K (3400) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 308.641ms - TotalStorageWaitTime: 109.235ms - TotalThreadsInvoluntaryContextSwitches: 31 (31) - TotalThreadsTotalWallClockTime: 696.340ms - TotalThreadsSysTime: 26.995ms - TotalThreadsUserTime: 84.986ms - TotalThreadsVoluntaryContextSwitches: 274 (274) Fragment Instance Lifecycle Timings: - ExecTime: 495.778ms - ExecTreeExecTime: 129.132ms - OpenTime: 51.460ms - ExecTreeOpenTime: 36.387us - PrepareTime: 49.086ms - ExecTreePrepareTime: 130.116us DataStreamSender (dst_id=26):(Total: 19.290ms, non-child: 19.290ms, % non-child: 100.00%) - BytesSent: 6.27 MB (6572432) - NetworkThroughput(*): 356.51 MB/sec - OverallThroughput: 324.93 MB/sec - PeakMemoryUsage: 816.56 KB (836160) - RowsReturned: 3.40K (3400) - SerializeBatchTime: 1.164ms - TransmitDataRPCTime: 17.581ms - UncompressedRowBatchSize: 16.19 MB (16975656) CodeGen:(Total: 76.686ms, non-child: 76.686ms, % non-child: 100.00%) - CodegenTime: 1.139ms - CompileTime: 11.125ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 27 (27) - NumInstructions: 373 (373) - OptimizationTime: 38.854ms - PeakMemoryUsage: 186.50 KB (190976) - PrepareTime: 26.249ms HDFS_SCAN_NODE (id=1):(Total: 129.465ms, non-child: 129.465ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:1/7.19 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:0% 1:100% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:2 BytesRead(500.000ms): 1.62 MB - FooterProcessingTime: (Avg: 50.058ms ; Min: 50.058ms ; Max: 50.058ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 1.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 2.14 MB (2244533) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.14 MB (2244533) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 2.14 MB (2244533) - DecompressionTime: 7.106ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 7.48 MB (7838588) - PerReadThreadRawHdfsThroughput: 40.07 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 128.723ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 380.00K (380000) - RowsReturned: 3.40K (3400) - RowsReturnedRate: 26.26 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 9 (9) - ScannerThreadsTotalWallClockTime: 149.445ms - MaterializeTupleTime(*): 31.224ms - ScannerThreadsSysTime: 3.999ms - ScannerThreadsUserTime: 28.995ms - ScannerThreadsVoluntaryContextSwitches: 8 (8) - TotalRawHdfsReadTime(*): 53.414ms - TotalReadThroughput: 3.25 MB/sec Instance 7f40dcb034de70b7:2dc (host=vd1334.foo:22000):(Total: 595.956ms, non-child: 380.450ms, % non-child: 63.84%) Hdfs split stats (:<# splits>/): 0:1/7.01 MB MemoryUsage(500.000ms): 966.06 KB ThreadUsage(500.000ms): 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 10.84 MB (11369122) - PerHostPeakMemUsage: 351.75 MB (368835926) - RowsProduced: 3.41K (3407) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 329.825ms - TotalStorageWaitTime: 112.094ms - TotalThreadsInvoluntaryContextSwitches: 22 (22) - TotalThreadsTotalWallClockTime: 696.088ms - TotalThreadsSysTime: 26.995ms - TotalThreadsUserTime: 73.988ms - TotalThreadsVoluntaryContextSwitches: 279 (279) Fragment Instance Lifecycle Timings: - ExecTime: 505.694ms - ExecTreeExecTime: 130.074ms - OpenTime: 42.794ms - ExecTreeOpenTime: 22.341us - PrepareTime: 47.411ms - ExecTreePrepareTime: 146.614us DataStreamSender (dst_id=26):(Total: 17.584ms, non-child: 17.584ms, % non-child: 100.00%) - BytesSent: 6.28 MB (6588110) - NetworkThroughput(*): 394.46 MB/sec - OverallThroughput: 357.30 MB/sec - PeakMemoryUsage: 816.56 KB (836160) - RowsReturned: 3.41K (3407) - SerializeBatchTime: 1.044ms - TransmitDataRPCTime: 15.928ms - UncompressedRowBatchSize: 16.22 MB (17005672) CodeGen:(Total: 67.495ms, non-child: 67.495ms, % non-child: 100.00%) - CodegenTime: 683.575us - CompileTime: 9.459ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 27 (27) - NumInstructions: 373 (373) - OptimizationTime: 32.293ms - PeakMemoryUsage: 186.50 KB (190976) - PrepareTime: 25.311ms HDFS_SCAN_NODE (id=1):(Total: 130.426ms, non-child: 130.426ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/7.01 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:2 BytesRead(500.000ms): 0 - FooterProcessingTime: (Avg: 58.711ms ; Min: 58.711ms ; Max: 58.711ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 2.09 MB (2190789) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.09 MB (2190789) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 2.09 MB (2190789) - DecompressionTime: 3.641ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 7.18 MB (7525978) - PerReadThreadRawHdfsThroughput: 54.17 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 129.738ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 370.00K (370000) - RowsReturned: 3.41K (3407) - RowsReturnedRate: 26.12 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 9 (9) - ScannerThreadsTotalWallClockTime: 147.954ms - MaterializeTupleTime(*): 30.310ms - ScannerThreadsSysTime: 8.998ms - ScannerThreadsUserTime: 22.996ms - ScannerThreadsVoluntaryContextSwitches: 6 (6) - TotalRawHdfsReadTime(*): 38.570ms - TotalReadThroughput: 0.00 /sec Instance 7f40dcb034de70b7:2d5 (host=ve1129.foo:22000):(Total: 595.791ms, non-child: 382.423ms, % non-child: 64.19%) Hdfs split stats (:<# splits>/): 3:1/7.19 MB MemoryUsage(500.000ms): 7.97 MB ThreadUsage(500.000ms): 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 10.98 MB (11509700) - PerHostPeakMemUsage: 281.37 MB (295034494) - RowsProduced: 3.37K (3374) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 309.795ms - TotalStorageWaitTime: 93.093ms - TotalThreadsInvoluntaryContextSwitches: 37 (37) - TotalThreadsTotalWallClockTime: 670.945ms - TotalThreadsSysTime: 23.996ms - TotalThreadsUserTime: 93.985ms - TotalThreadsVoluntaryContextSwitches: 301 (301) Fragment Instance Lifecycle Timings: - ExecTime: 480.764ms - ExecTreeExecTime: 111.357ms - OpenTime: 61.275ms - ExecTreeOpenTime: 88.592us - PrepareTime: 53.705ms - ExecTreePrepareTime: 183.200us DataStreamSender (dst_id=26):(Total: 15.842ms, non-child: 15.842ms, % non-child: 100.00%) - BytesSent: 6.19 MB (6490826) - NetworkThroughput(*): 432.83 MB/sec - OverallThroughput: 390.73 MB/sec - PeakMemoryUsage: 816.56 KB (836160) - RowsReturned: 3.37K (3374) - SerializeBatchTime: 892.861us - TransmitDataRPCTime: 14.301ms - UncompressedRowBatchSize: 16.07 MB (16845408) CodeGen:(Total: 85.665ms, non-child: 85.665ms, % non-child: 100.00%) - CodegenTime: 1.222ms - CompileTime: 13.300ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 27 (27) - NumInstructions: 373 (373) - OptimizationTime: 46.773ms - PeakMemoryUsage: 186.50 KB (190976) - PrepareTime: 24.956ms HDFS_SCAN_NODE (id=1):(Total: 111.860ms, non-child: 111.860ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:1/7.19 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:2 BytesRead(500.000ms): 2.14 MB - FooterProcessingTime: (Avg: 41.675ms ; Min: 41.675ms ; Max: 41.675ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 2.14 MB (2244519) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.14 MB (2244519) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 2.14 MB (2244519) - DecompressionTime: 2.113ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 7.33 MB (7688060) - PerReadThreadRawHdfsThroughput: 71.05 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 110.985ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 380.00K (380000) - RowsReturned: 3.37K (3374) - RowsReturnedRate: 30.16 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 14 (14) - ScannerThreadsTotalWallClockTime: 129.181ms - MaterializeTupleTime(*): 32.277ms - ScannerThreadsSysTime: 5.999ms - ScannerThreadsUserTime: 27.995ms - ScannerThreadsVoluntaryContextSwitches: 14 (14) - TotalRawHdfsReadTime(*): 30.129ms - TotalReadThroughput: 4.28 MB/sec Instance 7f40dcb034de70b7:2dd (host=vd1129.foo:22000):(Total: 594.552ms, non-child: 366.847ms, % non-child: 61.70%) Hdfs split stats (:<# splits>/): 1:1/7.00 MB MemoryUsage(500.000ms): 966.06 KB ThreadUsage(500.000ms): 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 10.88 MB (11412130) - PerHostPeakMemUsage: 288.49 MB (302505064) - RowsProduced: 3.33K (3333) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 291.002ms - TotalStorageWaitTime: 127.510ms - TotalThreadsInvoluntaryContextSwitches: 44 (44) - TotalThreadsTotalWallClockTime: 699.519ms - TotalThreadsSysTime: 21.997ms - TotalThreadsUserTime: 76.988ms - TotalThreadsVoluntaryContextSwitches: 278 (278) Fragment Instance Lifecycle Timings: - ExecTime: 494.470ms - ExecTreeExecTime: 143.865ms - OpenTime: 47.720ms - ExecTreeOpenTime: 26.852us - PrepareTime: 52.318ms - ExecTreePrepareTime: 113.381us DataStreamSender (dst_id=26):(Total: 13.837ms, non-child: 13.837ms, % non-child: 100.00%) - BytesSent: 6.19 MB (6488012) - NetworkThroughput(*): 504.03 MB/sec - OverallThroughput: 447.16 MB/sec - PeakMemoryUsage: 816.56 KB (836160) - RowsReturned: 3.33K (3333) - SerializeBatchTime: 1.078ms - TransmitDataRPCTime: 12.276ms - UncompressedRowBatchSize: 15.87 MB (16637172) CodeGen:(Total: 69.721ms, non-child: 69.721ms, % non-child: 100.00%) - CodegenTime: 669.405us - CompileTime: 9.833ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 27 (27) - NumInstructions: 373 (373) - OptimizationTime: 36.802ms - PeakMemoryUsage: 186.50 KB (190976) - PrepareTime: 22.723ms HDFS_SCAN_NODE (id=1):(Total: 144.145ms, non-child: 144.145ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:1/7.00 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:2 BytesRead(500.000ms): 0 - FooterProcessingTime: (Avg: 62.092ms ; Min: 62.092ms ; Max: 62.092ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 2.09 MB (2190768) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.09 MB (2190768) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 2.09 MB (2190768) - DecompressionTime: 1.881ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 7.16 MB (7504474) - PerReadThreadRawHdfsThroughput: 36.55 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 143.514ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 370.00K (370000) - RowsReturned: 3.33K (3333) - RowsReturnedRate: 23.12 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 8 (8) - ScannerThreadsTotalWallClockTime: 157.608ms - MaterializeTupleTime(*): 26.571ms - ScannerThreadsSysTime: 4.999ms - ScannerThreadsUserTime: 23.996ms - ScannerThreadsVoluntaryContextSwitches: 6 (6) - TotalRawHdfsReadTime(*): 57.159ms - TotalReadThroughput: 0.00 /sec Instance 7f40dcb034de70b7:2d7 (host=vd1136.foo:22000):(Total: 594.439ms, non-child: 374.145ms, % non-child: 62.94%) Hdfs split stats (:<# splits>/): 0:1/7.19 MB MemoryUsage(500.000ms): 5.21 MB ThreadUsage(500.000ms): 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 11.06 MB (11595716) - PerHostPeakMemUsage: 251.97 MB (264207919) - RowsProduced: 3.34K (3344) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 309.884ms - TotalStorageWaitTime: 111.719ms - TotalThreadsInvoluntaryContextSwitches: 26 (26) - TotalThreadsTotalWallClockTime: 718.040ms - TotalThreadsSysTime: 23.996ms - TotalThreadsUserTime: 95.985ms - TotalThreadsVoluntaryContextSwitches: 313 (313) Fragment Instance Lifecycle Timings: - ExecTime: 503.669ms - ExecTreeExecTime: 141.244ms - OpenTime: 46.301ms - ExecTreeOpenTime: 63.332us - PrepareTime: 44.399ms - ExecTreePrepareTime: 145.836us DataStreamSender (dst_id=26):(Total: 12.816ms, non-child: 12.816ms, % non-child: 100.00%) - BytesSent: 6.19 MB (6490022) - NetworkThroughput(*): 551.25 MB/sec - OverallThroughput: 482.93 MB/sec - PeakMemoryUsage: 816.56 KB (836160) - RowsReturned: 3.34K (3344) - SerializeBatchTime: 1.047ms - TransmitDataRPCTime: 11.227ms - UncompressedRowBatchSize: 15.91 MB (16682732) CodeGen:(Total: 65.821ms, non-child: 65.821ms, % non-child: 100.00%) - CodegenTime: 933.468us - CompileTime: 10.351ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 27 (27) - NumInstructions: 373 (373) - OptimizationTime: 35.025ms - PeakMemoryUsage: 186.50 KB (190976) - PrepareTime: 20.073ms HDFS_SCAN_NODE (id=1):(Total: 141.656ms, non-child: 141.656ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/7.19 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:2 BytesRead(500.000ms): 2.14 MB - FooterProcessingTime: (Avg: 50.440ms ; Min: 50.440ms ; Max: 50.440ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 2.14 MB (2244526) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.14 MB (2244526) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 2.14 MB (2244526) - DecompressionTime: 2.898ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 7.41 MB (7774076) - PerReadThreadRawHdfsThroughput: 63.04 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 140.863ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 380.00K (380000) - RowsReturned: 3.34K (3344) - RowsReturnedRate: 23.61 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 11 (11) - ScannerThreadsTotalWallClockTime: 168.346ms - MaterializeTupleTime(*): 51.710ms - ScannerThreadsSysTime: 9.998ms - ScannerThreadsUserTime: 40.993ms - ScannerThreadsVoluntaryContextSwitches: 22 (22) - TotalRawHdfsReadTime(*): 33.954ms - TotalReadThroughput: 4.28 MB/sec Instance 7f40dcb034de70b7:2c3 (host=ve1125.foo:22000):(Total: 593.703ms, non-child: 398.403ms, % non-child: 67.10%) Hdfs split stats (:<# splits>/): 3:1/7.19 MB MemoryUsage(500.000ms): 2.36 MB ThreadUsage(500.000ms): 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 11.14 MB (11681732) - PerHostPeakMemUsage: 244.51 MB (256390841) - RowsProduced: 3.44K (3439) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 324.036ms - TotalStorageWaitTime: 92.762ms - TotalThreadsInvoluntaryContextSwitches: 19 (19) - TotalThreadsTotalWallClockTime: 691.843ms - TotalThreadsSysTime: 26.996ms - TotalThreadsUserTime: 80.988ms - TotalThreadsVoluntaryContextSwitches: 289 (289) Fragment Instance Lifecycle Timings: - ExecTime: 509.048ms - ExecTreeExecTime: 121.501ms - OpenTime: 43.992ms - ExecTreeOpenTime: 28.710us - PrepareTime: 40.632ms - ExecTreePrepareTime: 121.052us DataStreamSender (dst_id=26):(Total: 10.506ms, non-child: 10.506ms, % non-child: 100.00%) - BytesSent: 6.33 MB (6636886) - NetworkThroughput(*): 679.67 MB/sec - OverallThroughput: 602.42 MB/sec - PeakMemoryUsage: 816.56 KB (836160) - RowsReturned: 3.44K (3439) - SerializeBatchTime: 830.339us - TransmitDataRPCTime: 9.312ms - UncompressedRowBatchSize: 16.37 MB (17168080) CodeGen:(Total: 62.992ms, non-child: 62.992ms, % non-child: 100.00%) - CodegenTime: 739.803us - CompileTime: 9.970ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 27 (27) - NumInstructions: 373 (373) - OptimizationTime: 32.944ms - PeakMemoryUsage: 186.50 KB (190976) - PrepareTime: 19.672ms HDFS_SCAN_NODE (id=1):(Total: 121.801ms, non-child: 121.801ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:1/7.19 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:2 BytesRead(500.000ms): 2.14 MB - FooterProcessingTime: (Avg: 40.836ms ; Min: 40.836ms ; Max: 40.836ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 2.14 MB (2244575) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.14 MB (2244575) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 2.14 MB (2244575) - DecompressionTime: 1.943ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 7.50 MB (7860092) - PerReadThreadRawHdfsThroughput: 56.21 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 121.147ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 380.00K (380000) - RowsReturned: 3.44K (3439) - RowsReturnedRate: 28.23 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 6 (6) - ScannerThreadsTotalWallClockTime: 139.080ms - MaterializeTupleTime(*): 42.609ms - ScannerThreadsSysTime: 10.998ms - ScannerThreadsUserTime: 31.995ms - ScannerThreadsVoluntaryContextSwitches: 9 (9) - TotalRawHdfsReadTime(*): 38.082ms - TotalReadThroughput: 4.28 MB/sec Instance 7f40dcb034de70b7:2a3 (host=va1033.foo:22000):(Total: 593.219ms, non-child: 395.038ms, % non-child: 66.59%) Hdfs split stats (:<# splits>/): 6:1/7.19 MB MemoryUsage(500.000ms): 5.29 MB ThreadUsage(500.000ms): 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 11.02 MB (11552708) - PerHostPeakMemUsage: 235.88 MB (247333051) - RowsProduced: 3.44K (3438) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 339.342ms - TotalStorageWaitTime: 98.423ms - TotalThreadsInvoluntaryContextSwitches: 22 (22) - TotalThreadsTotalWallClockTime: 677.172ms - TotalThreadsSysTime: 23.995ms - TotalThreadsUserTime: 75.988ms - TotalThreadsVoluntaryContextSwitches: 292 (292) Fragment Instance Lifecycle Timings: - ExecTime: 499.945ms - ExecTreeExecTime: 115.447ms - OpenTime: 47.188ms - ExecTreeOpenTime: 38.157us - PrepareTime: 46.044ms - ExecTreePrepareTime: 108.516us DataStreamSender (dst_id=26):(Total: 12.650ms, non-child: 12.650ms, % non-child: 100.00%) - BytesSent: 6.32 MB (6625496) - NetworkThroughput(*): 547.24 MB/sec - OverallThroughput: 499.46 MB/sec - PeakMemoryUsage: 816.56 KB (836160) - RowsReturned: 3.44K (3438) - SerializeBatchTime: 779.665us - TransmitDataRPCTime: 11.546ms - UncompressedRowBatchSize: 16.37 MB (17161514) CodeGen:(Total: 69.808ms, non-child: 69.808ms, % non-child: 100.00%) - CodegenTime: 728.129us - CompileTime: 10.063ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 27 (27) - NumInstructions: 373 (373) - OptimizationTime: 35.887ms - PeakMemoryUsage: 186.50 KB (190976) - PrepareTime: 23.460ms HDFS_SCAN_NODE (id=1):(Total: 115.721ms, non-child: 115.721ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 6:1/7.19 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:2 BytesRead(500.000ms): 2.14 MB - FooterProcessingTime: (Avg: 46.486ms ; Min: 46.486ms ; Max: 46.486ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 2.14 MB (2244607) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.14 MB (2244607) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 2.14 MB (2244607) - DecompressionTime: 1.615ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 7.50 MB (7860092) - PerReadThreadRawHdfsThroughput: 53.48 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 115.093ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 380.00K (380000) - RowsReturned: 3.44K (3438) - RowsReturnedRate: 29.71 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 5 (5) - ScannerThreadsTotalWallClockTime: 130.315ms - MaterializeTupleTime(*): 28.585ms - ScannerThreadsSysTime: 6.998ms - ScannerThreadsUserTime: 20.996ms - ScannerThreadsVoluntaryContextSwitches: 13 (13) - TotalRawHdfsReadTime(*): 40.025ms - TotalReadThroughput: 4.28 MB/sec Instance 7f40dcb034de70b7:2bf (host=vd1331.foo:22000):(Total: 591.571ms, non-child: 311.639ms, % non-child: 52.68%) Hdfs split stats (:<# splits>/): 0:1/7.00 MB MemoryUsage(500.000ms): 824.56 KB ThreadUsage(500.000ms): 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 8.24 MB (8637238) - PerHostPeakMemUsage: 245.98 MB (257924866) - RowsProduced: 3.34K (3344) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 251.090ms - TotalStorageWaitTime: 154.342ms - TotalThreadsInvoluntaryContextSwitches: 29 (29) - TotalThreadsTotalWallClockTime: 739.942ms - TotalThreadsSysTime: 22.996ms - TotalThreadsUserTime: 94.985ms - TotalThreadsVoluntaryContextSwitches: 282 (282) Fragment Instance Lifecycle Timings: - ExecTime: 485.184ms - ExecTreeExecTime: 184.010ms - OpenTime: 57.920ms - ExecTreeOpenTime: 37.255us - PrepareTime: 48.423ms - ExecTreePrepareTime: 161.201us DataStreamSender (dst_id=26):(Total: 12.553ms, non-child: 12.553ms, % non-child: 100.00%) - BytesSent: 6.15 MB (6448348) - NetworkThroughput(*): 554.90 MB/sec - OverallThroughput: 489.86 MB/sec - PeakMemoryUsage: 816.56 KB (836160) - RowsReturned: 3.34K (3344) - SerializeBatchTime: 1.124ms - TransmitDataRPCTime: 11.082ms - UncompressedRowBatchSize: 15.91 MB (16685278) CodeGen:(Total: 82.969ms, non-child: 82.969ms, % non-child: 100.00%) - CodegenTime: 1.435ms - CompileTime: 12.518ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 27 (27) - NumInstructions: 373 (373) - OptimizationTime: 43.760ms - PeakMemoryUsage: 186.50 KB (190976) - PrepareTime: 25.990ms HDFS_SCAN_NODE (id=1):(Total: 184.408ms, non-child: 184.408ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/7.00 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:2 BytesRead(500.000ms): 0 - FooterProcessingTime: (Avg: 52.698ms ; Min: 52.698ms ; Max: 52.698ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 2.09 MB (2190726) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.09 MB (2190726) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 2.09 MB (2190726) - DecompressionTime: 2.568ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 6.59 MB (6905355) - PerReadThreadRawHdfsThroughput: 56.58 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 183.573ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 370.00K (370000) - RowsReturned: 3.34K (3344) - RowsReturnedRate: 18.13 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 7 (7) - ScannerThreadsTotalWallClockTime: 197.168ms - MaterializeTupleTime(*): 37.900ms - ScannerThreadsSysTime: 6.998ms - ScannerThreadsUserTime: 32.994ms - ScannerThreadsVoluntaryContextSwitches: 13 (13) - TotalRawHdfsReadTime(*): 36.926ms - TotalReadThroughput: 0.00 /sec Instance 7f40dcb034de70b7:2e1 (host=vd1104.foo:22000):(Total: 590.971ms, non-child: 401.454ms, % non-child: 67.93%) Hdfs split stats (:<# splits>/): 3:1/7.19 MB MemoryUsage(500.000ms): 5.19 MB ThreadUsage(500.000ms): 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 11.12 MB (11660228) - PerHostPeakMemUsage: 232.74 MB (244042568) - RowsProduced: 3.36K (3363) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 341.027ms - TotalStorageWaitTime: 99.298ms - TotalThreadsInvoluntaryContextSwitches: 15 (15) - TotalThreadsTotalWallClockTime: 695.710ms - TotalThreadsSysTime: 25.996ms - TotalThreadsUserTime: 73.989ms - TotalThreadsVoluntaryContextSwitches: 282 (282) Fragment Instance Lifecycle Timings: - ExecTime: 517.517ms - ExecTreeExecTime: 124.850ms - OpenTime: 40.413ms - ExecTreeOpenTime: 22.526us - PrepareTime: 33.002ms - ExecTreePrepareTime: 75.491us DataStreamSender (dst_id=26):(Total: 11.472ms, non-child: 11.472ms, % non-child: 100.00%) - BytesSent: 6.15 MB (6448750) - NetworkThroughput(*): 585.56 MB/sec - OverallThroughput: 536.04 MB/sec - PeakMemoryUsage: 816.56 KB (836160) - RowsReturned: 3.36K (3363) - SerializeBatchTime: 684.672us - TransmitDataRPCTime: 10.502ms - UncompressedRowBatchSize: 16.00 MB (16774522) CodeGen:(Total: 53.007ms, non-child: 53.007ms, % non-child: 100.00%) - CodegenTime: 670.001us - CompileTime: 8.719ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 27 (27) - NumInstructions: 373 (373) - OptimizationTime: 30.522ms - PeakMemoryUsage: 186.50 KB (190976) - PrepareTime: 13.424ms HDFS_SCAN_NODE (id=1):(Total: 125.036ms, non-child: 125.036ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:1/7.19 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:2 BytesRead(500.000ms): 2.14 MB - FooterProcessingTime: (Avg: 39.637ms ; Min: 39.637ms ; Max: 39.637ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 2.14 MB (2244514) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.14 MB (2244514) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 2.14 MB (2244514) - DecompressionTime: 2.937ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 7.39 MB (7752572) - PerReadThreadRawHdfsThroughput: 60.60 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 124.473ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 380.00K (380000) - RowsReturned: 3.36K (3363) - RowsReturnedRate: 26.90 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 6 (6) - ScannerThreadsTotalWallClockTime: 138.040ms - MaterializeTupleTime(*): 34.221ms - ScannerThreadsSysTime: 5.999ms - ScannerThreadsUserTime: 29.995ms - ScannerThreadsVoluntaryContextSwitches: 8 (8) - TotalRawHdfsReadTime(*): 35.323ms - TotalReadThroughput: 4.28 MB/sec Instance 7f40dcb034de70b7:276 (host=vc1531.foo:22000):(Total: 590.956ms, non-child: 410.677ms, % non-child: 69.49%) Hdfs split stats (:<# splits>/): 2:1/7.19 MB MemoryUsage(500.000ms): 816.56 KB, 830.06 KB ThreadUsage(500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 11.02 MB (11552708) - PerHostPeakMemUsage: 242.25 MB (254015701) - RowsProduced: 3.46K (3459) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 159.335ms - TotalStorageWaitTime: 86.479ms - TotalThreadsInvoluntaryContextSwitches: 22 (22) - TotalThreadsTotalWallClockTime: 659.662ms - TotalThreadsSysTime: 21.996ms - TotalThreadsUserTime: 69.988ms - TotalThreadsVoluntaryContextSwitches: 280 (280) Fragment Instance Lifecycle Timings: - ExecTime: 501.872ms - ExecTreeExecTime: 99.986ms - OpenTime: 44.167ms - ExecTreeOpenTime: 27.283us - PrepareTime: 44.874ms - ExecTreePrepareTime: 107.456us DataStreamSender (dst_id=26):(Total: 11.934ms, non-child: 11.934ms, % non-child: 100.00%) - BytesSent: 6.36 MB (6671592) - NetworkThroughput(*): 587.47 MB/sec - OverallThroughput: 533.11 MB/sec - PeakMemoryUsage: 816.56 KB (836160) - RowsReturned: 3.46K (3459) - SerializeBatchTime: 770.917us - TransmitDataRPCTime: 10.830ms - UncompressedRowBatchSize: 16.46 MB (17263488) CodeGen:(Total: 68.101ms, non-child: 68.101ms, % non-child: 100.00%) - CodegenTime: 704.558us - CompileTime: 9.579ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 27 (27) - NumInstructions: 373 (373) - OptimizationTime: 33.495ms - PeakMemoryUsage: 186.50 KB (190976) - PrepareTime: 24.626ms HDFS_SCAN_NODE (id=1):(Total: 100.242ms, non-child: 100.242ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:1/7.19 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:2 BytesRead(500.000ms): 0 - FooterProcessingTime: (Avg: 37.330ms ; Min: 37.330ms ; Max: 37.330ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 2.14 MB (2244591) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.14 MB (2244591) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 2.14 MB (2244591) - DecompressionTime: 2.492ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 7.45 MB (7817084) - PerReadThreadRawHdfsThroughput: 42.78 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 99.621ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 380.00K (380000) - RowsReturned: 3.46K (3459) - RowsReturnedRate: 34.51 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 6 (6) - ScannerThreadsTotalWallClockTime: 113.870ms - MaterializeTupleTime(*): 23.344ms - ScannerThreadsSysTime: 3.999ms - ScannerThreadsUserTime: 20.996ms - ScannerThreadsVoluntaryContextSwitches: 8 (8) - TotalRawHdfsReadTime(*): 50.032ms - TotalReadThroughput: 0.00 /sec Instance 7f40dcb034de70b7:2d8 (host=vc1505.foo:22000):(Total: 590.923ms, non-child: 399.408ms, % non-child: 67.59%) Hdfs split stats (:<# splits>/): 5:1/7.01 MB MemoryUsage(500.000ms): 2.27 MB ThreadUsage(500.000ms): 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 10.90 MB (11433634) - PerHostPeakMemUsage: 242.98 MB (254780981) - RowsProduced: 3.39K (3394) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 334.078ms - TotalStorageWaitTime: 99.058ms - TotalThreadsInvoluntaryContextSwitches: 21 (21) - TotalThreadsTotalWallClockTime: 675.019ms - TotalThreadsSysTime: 19.996ms - TotalThreadsUserTime: 73.987ms - TotalThreadsVoluntaryContextSwitches: 305 (305) Fragment Instance Lifecycle Timings: - ExecTime: 502.743ms - ExecTreeExecTime: 114.745ms - OpenTime: 43.037ms - ExecTreeOpenTime: 32.261us - PrepareTime: 45.119ms - ExecTreePrepareTime: 99.139us DataStreamSender (dst_id=26):(Total: 13.195ms, non-child: 13.195ms, % non-child: 100.00%) - BytesSent: 6.24 MB (6538128) - NetworkThroughput(*): 514.11 MB/sec - OverallThroughput: 472.53 MB/sec - PeakMemoryUsage: 816.56 KB (836160) - RowsReturned: 3.39K (3394) - SerializeBatchTime: 748.693us - TransmitDataRPCTime: 12.128ms - UncompressedRowBatchSize: 16.15 MB (16936260) CodeGen:(Total: 63.326ms, non-child: 63.326ms, % non-child: 100.00%) - CodegenTime: 646.156us - CompileTime: 9.911ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 27 (27) - NumInstructions: 373 (373) - OptimizationTime: 32.097ms - PeakMemoryUsage: 186.50 KB (190976) - PrepareTime: 20.949ms HDFS_SCAN_NODE (id=1):(Total: 114.992ms, non-child: 114.992ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:1/7.01 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:2 BytesRead(500.000ms): 2.09 MB - FooterProcessingTime: (Avg: 45.470ms ; Min: 45.470ms ; Max: 45.470ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 2.09 MB (2190790) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.09 MB (2190790) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 2.09 MB (2190790) - DecompressionTime: 1.394ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 7.30 MB (7655002) - PerReadThreadRawHdfsThroughput: 53.45 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 114.511ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 370.00K (370000) - RowsReturned: 3.39K (3394) - RowsReturnedRate: 29.51 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 5 (5) - ScannerThreadsTotalWallClockTime: 129.495ms - MaterializeTupleTime(*): 27.616ms - ScannerThreadsSysTime: 4.999ms - ScannerThreadsUserTime: 20.996ms - ScannerThreadsVoluntaryContextSwitches: 12 (12) - TotalRawHdfsReadTime(*): 39.091ms - TotalReadThroughput: 4.18 MB/sec Instance 7f40dcb034de70b7:289 (host=vd1117.foo:22000):(Total: 590.677ms, non-child: 387.747ms, % non-child: 65.64%) Hdfs split stats (:<# splits>/): 2:1/7.19 MB MemoryUsage(500.000ms): 5.17 MB ThreadUsage(500.000ms): 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 11.02 MB (11552708) - PerHostPeakMemUsage: 245.90 MB (257842081) - RowsProduced: 3.36K (3361) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 332.637ms - TotalStorageWaitTime: 102.781ms - TotalThreadsInvoluntaryContextSwitches: 30 (30) - TotalThreadsTotalWallClockTime: 686.354ms - TotalThreadsSysTime: 18.996ms - TotalThreadsUserTime: 82.987ms - TotalThreadsVoluntaryContextSwitches: 282 (282) Fragment Instance Lifecycle Timings: - ExecTime: 500.465ms - ExecTreeExecTime: 122.740ms - OpenTime: 46.866ms - ExecTreeOpenTime: 30.936us - PrepareTime: 43.300ms - ExecTreePrepareTime: 135.713us DataStreamSender (dst_id=26):(Total: 12.556ms, non-child: 12.556ms, % non-child: 100.00%) - BytesSent: 6.22 MB (6518162) - NetworkThroughput(*): 551.79 MB/sec - OverallThroughput: 495.06 MB/sec - PeakMemoryUsage: 816.56 KB (836160) - RowsReturned: 3.36K (3361) - SerializeBatchTime: 839.836us - TransmitDataRPCTime: 11.265ms - UncompressedRowBatchSize: 16.00 MB (16778810) CodeGen:(Total: 67.285ms, non-child: 67.285ms, % non-child: 100.00%) - CodegenTime: 744.364us - CompileTime: 10.758ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 27 (27) - NumInstructions: 373 (373) - OptimizationTime: 34.834ms - PeakMemoryUsage: 186.50 KB (190976) - PrepareTime: 21.286ms HDFS_SCAN_NODE (id=1):(Total: 123.087ms, non-child: 123.087ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:1/7.19 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:2 BytesRead(500.000ms): 2.14 MB - FooterProcessingTime: (Avg: 49.641ms ; Min: 49.641ms ; Max: 49.641ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 2.14 MB (2244597) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.14 MB (2244597) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 2.14 MB (2244597) - DecompressionTime: 1.994ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 7.37 MB (7731068) - PerReadThreadRawHdfsThroughput: 56.13 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 122.280ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 380.00K (380000) - RowsReturned: 3.36K (3361) - RowsReturnedRate: 27.30 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 6 (6) - ScannerThreadsTotalWallClockTime: 139.304ms - MaterializeTupleTime(*): 32.874ms - ScannerThreadsSysTime: 2.999ms - ScannerThreadsUserTime: 30.995ms - ScannerThreadsVoluntaryContextSwitches: 8 (8) - TotalRawHdfsReadTime(*): 38.134ms - TotalReadThroughput: 4.28 MB/sec Instance 7f40dcb034de70b7:2bb (host=vd1333.foo:22000):(Total: 590.247ms, non-child: 372.660ms, % non-child: 63.14%) Hdfs split stats (:<# splits>/): 5:1/7.19 MB MemoryUsage(500.000ms): 4.07 MB ThreadUsage(500.000ms): 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 11.12 MB (11660228) - PerHostPeakMemUsage: 226.80 MB (237820210) - RowsProduced: 3.45K (3454) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 310.086ms - TotalStorageWaitTime: 107.533ms - TotalThreadsInvoluntaryContextSwitches: 30 (30) - TotalThreadsTotalWallClockTime: 695.059ms - TotalThreadsSysTime: 23.996ms - TotalThreadsUserTime: 91.986ms - TotalThreadsVoluntaryContextSwitches: 280 (280) Fragment Instance Lifecycle Timings: - ExecTime: 492.696ms - ExecTreeExecTime: 129.072ms - OpenTime: 54.424ms - ExecTreeOpenTime: 34.106us - PrepareTime: 43.081ms - ExecTreePrepareTime: 121.416us DataStreamSender (dst_id=26):(Total: 12.794ms, non-child: 12.794ms, % non-child: 100.00%) - BytesSent: 6.40 MB (6712596) - NetworkThroughput(*): 555.99 MB/sec - OverallThroughput: 500.34 MB/sec - PeakMemoryUsage: 816.56 KB (836160) - RowsReturned: 3.45K (3454) - SerializeBatchTime: 941.764us - TransmitDataRPCTime: 11.513ms - UncompressedRowBatchSize: 16.46 MB (17256252) CodeGen:(Total: 75.414ms, non-child: 75.414ms, % non-child: 100.00%) - CodegenTime: 769.417us - CompileTime: 12.309ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 27 (27) - NumInstructions: 373 (373) - OptimizationTime: 40.861ms - PeakMemoryUsage: 186.50 KB (190976) - PrepareTime: 21.765ms HDFS_SCAN_NODE (id=1):(Total: 129.378ms, non-child: 129.378ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:1/7.19 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:0% 1:100% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:2 BytesRead(500.000ms): 1.62 MB - FooterProcessingTime: (Avg: 55.414ms ; Min: 55.414ms ; Max: 55.414ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 1.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 2.14 MB (2244550) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.14 MB (2244550) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 2.14 MB (2244550) - DecompressionTime: 1.965ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 7.66 MB (8033156) - PerReadThreadRawHdfsThroughput: 58.23 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 128.690ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 380.00K (380000) - RowsReturned: 3.45K (3454) - RowsReturnedRate: 26.70 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 5 (5) - ScannerThreadsTotalWallClockTime: 148.171ms - MaterializeTupleTime(*): 36.835ms - ScannerThreadsSysTime: 8.998ms - ScannerThreadsUserTime: 30.995ms - ScannerThreadsVoluntaryContextSwitches: 4 (4) - TotalRawHdfsReadTime(*): 36.761ms - TotalReadThroughput: 3.25 MB/sec Instance 7f40dcb034de70b7:2d9 (host=vd1133.foo:22000):(Total: 586.498ms, non-child: 395.220ms, % non-child: 67.39%) Hdfs split stats (:<# splits>/): 1:1/7.19 MB MemoryUsage(500.000ms): 966.06 KB ThreadUsage(500.000ms): 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 11.12 MB (11660228) - PerHostPeakMemUsage: 226.57 MB (237575812) - RowsProduced: 3.43K (3431) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 331.903ms - TotalStorageWaitTime: 92.253ms - TotalThreadsInvoluntaryContextSwitches: 22 (22) - TotalThreadsTotalWallClockTime: 667.008ms - TotalThreadsSysTime: 22.996ms - TotalThreadsUserTime: 76.988ms - TotalThreadsVoluntaryContextSwitches: 288 (288) Fragment Instance Lifecycle Timings: - ExecTime: 495.357ms - ExecTreeExecTime: 110.768ms - OpenTime: 43.857ms - ExecTreeOpenTime: 28.058us - PrepareTime: 47.242ms - ExecTreePrepareTime: 140.386us DataStreamSender (dst_id=26):(Total: 12.481ms, non-child: 12.481ms, % non-child: 100.00%) - BytesSent: 6.29 MB (6591862) - NetworkThroughput(*): 566.25 MB/sec - OverallThroughput: 503.68 MB/sec - PeakMemoryUsage: 816.56 KB (836160) - RowsReturned: 3.43K (3431) - SerializeBatchTime: 936.992us - TransmitDataRPCTime: 11.102ms - UncompressedRowBatchSize: 16.33 MB (17120778) CodeGen:(Total: 67.685ms, non-child: 67.685ms, % non-child: 100.00%) - CodegenTime: 692.636us - CompileTime: 10.762ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 27 (27) - NumInstructions: 373 (373) - OptimizationTime: 31.854ms - PeakMemoryUsage: 186.50 KB (190976) - PrepareTime: 24.648ms HDFS_SCAN_NODE (id=1):(Total: 111.111ms, non-child: 111.111ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:1/7.19 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:2 BytesRead(500.000ms): 0 - FooterProcessingTime: (Avg: 31.861ms ; Min: 31.861ms ; Max: 31.861ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 2.14 MB (2244565) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.14 MB (2244565) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 2.14 MB (2244565) - DecompressionTime: 2.007ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 7.45 MB (7817084) - PerReadThreadRawHdfsThroughput: 53.22 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 110.338ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 380.00K (380000) - RowsReturned: 3.43K (3431) - RowsReturnedRate: 30.88 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 7 (7) - ScannerThreadsTotalWallClockTime: 128.077ms - MaterializeTupleTime(*): 32.178ms - ScannerThreadsSysTime: 3.999ms - ScannerThreadsUserTime: 28.995ms - ScannerThreadsVoluntaryContextSwitches: 4 (4) - TotalRawHdfsReadTime(*): 40.217ms - TotalReadThroughput: 0.00 /sec Instance 7f40dcb034de70b7:2af (host=vd1338.foo:22000):(Total: 583.653ms, non-child: 318.988ms, % non-child: 54.65%) Hdfs split stats (:<# splits>/): 5:1/7.19 MB MemoryUsage(500.000ms): 4.62 MB ThreadUsage(500.000ms): 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 11.14 MB (11681732) - PerHostPeakMemUsage: 250.26 MB (262421046) - RowsProduced: 3.54K (3545) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 256.256ms - TotalStorageWaitTime: 141.841ms - TotalThreadsInvoluntaryContextSwitches: 28 (28) - TotalThreadsTotalWallClockTime: 720.633ms - TotalThreadsSysTime: 20.996ms - TotalThreadsUserTime: 106.983ms - TotalThreadsVoluntaryContextSwitches: 293 (293) Fragment Instance Lifecycle Timings: - ExecTime: 470.402ms - ExecTreeExecTime: 170.079ms - OpenTime: 57.392ms - ExecTreeOpenTime: 39.535us - PrepareTime: 55.814ms - ExecTreePrepareTime: 174.097us DataStreamSender (dst_id=26):(Total: 10.494ms, non-child: 10.494ms, % non-child: 100.00%) - BytesSent: 6.52 MB (6837618) - NetworkThroughput(*): 712.21 MB/sec - OverallThroughput: 621.35 MB/sec - PeakMemoryUsage: 816.56 KB (836160) - RowsReturned: 3.54K (3545) - SerializeBatchTime: 969.183us - TransmitDataRPCTime: 9.155ms - UncompressedRowBatchSize: 16.88 MB (17696174) CodeGen:(Total: 83.671ms, non-child: 83.671ms, % non-child: 100.00%) - CodegenTime: 1.227ms - CompileTime: 11.974ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 27 (27) - NumInstructions: 373 (373) - OptimizationTime: 43.812ms - PeakMemoryUsage: 186.50 KB (190976) - PrepareTime: 27.309ms HDFS_SCAN_NODE (id=1):(Total: 170.498ms, non-child: 170.498ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:1/7.19 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:2 BytesRead(500.000ms): 2.14 MB - FooterProcessingTime: (Avg: 64.399ms ; Min: 64.399ms ; Max: 64.399ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 2.14 MB (2244532) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.14 MB (2244532) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 2.14 MB (2244532) - DecompressionTime: 1.938ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 7.64 MB (8011652) - PerReadThreadRawHdfsThroughput: 62.29 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 169.738ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 380.00K (380000) - RowsReturned: 3.54K (3545) - RowsReturnedRate: 20.79 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 6 (6) - ScannerThreadsTotalWallClockTime: 193.252ms - MaterializeTupleTime(*): 46.963ms - ScannerThreadsSysTime: 10.998ms - ScannerThreadsUserTime: 39.993ms - ScannerThreadsVoluntaryContextSwitches: 8 (8) - TotalRawHdfsReadTime(*): 34.362ms - TotalReadThroughput: 4.28 MB/sec Instance 7f40dcb034de70b7:277 (host=ve1136.foo:22000):(Total: 581.611ms, non-child: 398.016ms, % non-child: 68.43%) Hdfs split stats (:<# splits>/): 0:1/7.18 MB MemoryUsage(500.000ms): 816.56 KB, 830.06 KB ThreadUsage(500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 11.08 MB (11617220) - PerHostPeakMemUsage: 244.57 MB (256449991) - RowsProduced: 3.43K (3429) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 160.577ms - TotalStorageWaitTime: 77.843ms - TotalThreadsInvoluntaryContextSwitches: 31 (31) - TotalThreadsTotalWallClockTime: 644.269ms - TotalThreadsSysTime: 22.996ms - TotalThreadsUserTime: 81.987ms - TotalThreadsVoluntaryContextSwitches: 298 (298) Fragment Instance Lifecycle Timings: - ExecTime: 480.803ms - ExecTreeExecTime: 96.257ms - OpenTime: 52.534ms - ExecTreeOpenTime: 30.311us - PrepareTime: 48.232ms - ExecTreePrepareTime: 135.044us DataStreamSender (dst_id=26):(Total: 10.033ms, non-child: 10.033ms, % non-child: 100.00%) - BytesSent: 6.33 MB (6638360) - NetworkThroughput(*): 737.47 MB/sec - OverallThroughput: 631.00 MB/sec - PeakMemoryUsage: 816.56 KB (836160) - RowsReturned: 3.43K (3429) - SerializeBatchTime: 1.048ms - TransmitDataRPCTime: 8.584ms - UncompressedRowBatchSize: 16.33 MB (17118232) CodeGen:(Total: 76.960ms, non-child: 76.960ms, % non-child: 100.00%) - CodegenTime: 1.234ms - CompileTime: 11.679ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 27 (27) - NumInstructions: 373 (373) - OptimizationTime: 39.588ms - PeakMemoryUsage: 186.50 KB (190976) - PrepareTime: 25.108ms HDFS_SCAN_NODE (id=1):(Total: 96.601ms, non-child: 96.601ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/7.18 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:2 BytesRead(500.000ms): 0 - FooterProcessingTime: (Avg: 34.222ms ; Min: 34.222ms ; Max: 34.222ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 2.14 MB (2244571) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.14 MB (2244571) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 2.14 MB (2244571) - DecompressionTime: 1.803ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 7.43 MB (7795580) - PerReadThreadRawHdfsThroughput: 64.39 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 95.840ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 380.00K (380000) - RowsReturned: 3.43K (3429) - RowsReturnedRate: 35.50 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 5 (5) - ScannerThreadsTotalWallClockTime: 111.200ms - MaterializeTupleTime(*): 29.838ms - ScannerThreadsSysTime: 10.998ms - ScannerThreadsUserTime: 21.996ms - ScannerThreadsVoluntaryContextSwitches: 5 (5) - TotalRawHdfsReadTime(*): 33.245ms - TotalReadThroughput: 0.00 /sec Instance 7f40dcb034de70b7:2a4 (host=ve1134.foo:22000):(Total: 579.825ms, non-child: 400.274ms, % non-child: 69.03%) Hdfs split stats (:<# splits>/): 7:1/7.19 MB MemoryUsage(500.000ms): 824.56 KB, 830.06 KB ThreadUsage(500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 11.08 MB (11617220) - PerHostPeakMemUsage: 227.18 MB (238211212) - RowsProduced: 3.47K (3466) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 313.022ms - TotalStorageWaitTime: 90.563ms - TotalThreadsInvoluntaryContextSwitches: 22 (22) - TotalThreadsTotalWallClockTime: 663.402ms - TotalThreadsSysTime: 22.996ms - TotalThreadsUserTime: 71.988ms - TotalThreadsVoluntaryContextSwitches: 284 (284) Fragment Instance Lifecycle Timings: - ExecTime: 499.564ms - ExecTreeExecTime: 106.900ms - OpenTime: 42.059ms - ExecTreeOpenTime: 29.232us - PrepareTime: 38.165ms - ExecTreePrepareTime: 93.381us DataStreamSender (dst_id=26):(Total: 12.813ms, non-child: 12.813ms, % non-child: 100.00%) - BytesSent: 6.37 MB (6678158) - NetworkThroughput(*): 547.13 MB/sec - OverallThroughput: 497.04 MB/sec - PeakMemoryUsage: 816.56 KB (836160) - RowsReturned: 3.47K (3466) - SerializeBatchTime: 886.480us - TransmitDataRPCTime: 11.640ms - UncompressedRowBatchSize: 16.49 MB (17295782) CodeGen:(Total: 59.612ms, non-child: 59.612ms, % non-child: 100.00%) - CodegenTime: 629.504us - CompileTime: 9.992ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 27 (27) - NumInstructions: 373 (373) - OptimizationTime: 30.984ms - PeakMemoryUsage: 186.50 KB (190976) - PrepareTime: 18.272ms HDFS_SCAN_NODE (id=1):(Total: 107.124ms, non-child: 107.124ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:1/7.19 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:2 BytesRead(500.000ms): 0 - FooterProcessingTime: (Avg: 37.449ms ; Min: 37.449ms ; Max: 37.449ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 2.14 MB (2244524) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.14 MB (2244524) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 2.14 MB (2244524) - DecompressionTime: 3.125ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 7.52 MB (7881596) - PerReadThreadRawHdfsThroughput: 63.46 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 106.475ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 380.00K (380000) - RowsReturned: 3.47K (3466) - RowsReturnedRate: 32.35 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 5 (5) - ScannerThreadsTotalWallClockTime: 122.066ms - MaterializeTupleTime(*): 26.753ms - ScannerThreadsSysTime: 8.998ms - ScannerThreadsUserTime: 19.996ms - ScannerThreadsVoluntaryContextSwitches: 11 (11) - TotalRawHdfsReadTime(*): 33.731ms - TotalReadThroughput: 0.00 /sec Instance 7f40dcb034de70b7:288 (host=vd1335.foo:22000):(Total: 570.692ms, non-child: 397.192ms, % non-child: 69.60%) Hdfs split stats (:<# splits>/): 3:1/6.82 MB MemoryUsage(500.000ms): 830.06 KB ThreadUsage(500.000ms): 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 10.02 MB (10511505) - PerHostPeakMemUsage: 236.73 MB (248232302) - RowsProduced: 3.21K (3214) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 168.937ms - TotalStorageWaitTime: 75.175ms - TotalThreadsInvoluntaryContextSwitches: 29 (29) - TotalThreadsTotalWallClockTime: 629.717ms - TotalThreadsSysTime: 17.996ms - TotalThreadsUserTime: 76.988ms - TotalThreadsVoluntaryContextSwitches: 280 (280) Fragment Instance Lifecycle Timings: - ExecTime: 478.639ms - ExecTreeExecTime: 89.354ms - OpenTime: 49.834ms - ExecTreeOpenTime: 46.182us - PrepareTime: 42.168ms - ExecTreePrepareTime: 118.176us DataStreamSender (dst_id=26):(Total: 11.039ms, non-child: 11.039ms, % non-child: 100.00%) - BytesSent: 5.93 MB (6219208) - NetworkThroughput(*): 614.10 MB/sec - OverallThroughput: 537.24 MB/sec - PeakMemoryUsage: 816.56 KB (836160) - RowsReturned: 3.21K (3214) - SerializeBatchTime: 953.521us - TransmitDataRPCTime: 9.658ms - UncompressedRowBatchSize: 15.31 MB (16053468) CodeGen:(Total: 72.798ms, non-child: 72.798ms, % non-child: 100.00%) - CodegenTime: 970.061us - CompileTime: 11.760ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 27 (27) - NumInstructions: 373 (373) - OptimizationTime: 36.978ms - PeakMemoryUsage: 186.50 KB (190976) - PrepareTime: 23.558ms HDFS_SCAN_NODE (id=1):(Total: 89.661ms, non-child: 89.661ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:1/6.82 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:2 - FooterProcessingTime: (Avg: 30.575ms ; Min: 30.575ms ; Max: 30.575ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 2.04 MB (2136911) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.04 MB (2136911) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 2.04 MB (2136911) - DecompressionTime: 1.505ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 6.36 MB (6668361) - PerReadThreadRawHdfsThroughput: 53.93 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 88.988ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 360.00K (360000) - RowsReturned: 3.21K (3214) - RowsReturnedRate: 35.85 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 5 (5) - ScannerThreadsTotalWallClockTime: 101.518ms - MaterializeTupleTime(*): 22.899ms - ScannerThreadsSysTime: 7.998ms - ScannerThreadsUserTime: 17.997ms - ScannerThreadsVoluntaryContextSwitches: 4 (4) - TotalRawHdfsReadTime(*): 37.786ms - TotalReadThroughput: 0.00 /sec Instance 7f40dcb034de70b7:2da (host=ve1138.foo:22000):(Total: 569.418ms, non-child: 395.282ms, % non-child: 69.42%) Hdfs split stats (:<# splits>/): 0:1/7.01 MB MemoryUsage(500.000ms): 830.06 KB ThreadUsage(500.000ms): 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 10.74 MB (11261602) - PerHostPeakMemUsage: 225.15 MB (236089338) - RowsProduced: 3.29K (3293) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 305.055ms - TotalStorageWaitTime: 66.785ms - TotalThreadsInvoluntaryContextSwitches: 19 (19) - TotalThreadsTotalWallClockTime: 636.711ms - TotalThreadsSysTime: 21.997ms - TotalThreadsUserTime: 91.986ms - TotalThreadsVoluntaryContextSwitches: 279 (279) Fragment Instance Lifecycle Timings: - ExecTime: 480.344ms - ExecTreeExecTime: 96.174ms - OpenTime: 44.279ms - ExecTreeOpenTime: 27.342us - PrepareTime: 44.755ms - ExecTreePrepareTime: 127.440us DataStreamSender (dst_id=26):(Total: 11.255ms, non-child: 11.255ms, % non-child: 100.00%) - BytesSent: 6.07 MB (6360310) - NetworkThroughput(*): 616.54 MB/sec - OverallThroughput: 538.92 MB/sec - PeakMemoryUsage: 816.56 KB (836160) - RowsReturned: 3.29K (3293) - SerializeBatchTime: 1.074ms - TransmitDataRPCTime: 9.838ms - UncompressedRowBatchSize: 15.67 MB (16431214) CodeGen:(Total: 66.385ms, non-child: 66.385ms, % non-child: 100.00%) - CodegenTime: 743.917us - CompileTime: 9.890ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 27 (27) - NumInstructions: 373 (373) - OptimizationTime: 32.783ms - PeakMemoryUsage: 186.50 KB (190976) - PrepareTime: 23.305ms HDFS_SCAN_NODE (id=1):(Total: 96.494ms, non-child: 96.494ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/7.01 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:2 - FooterProcessingTime: (Avg: 18.928ms ; Min: 18.928ms ; Max: 18.928ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 2.09 MB (2190762) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.09 MB (2190762) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 2.09 MB (2190762) - DecompressionTime: 1.762ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 7.16 MB (7504474) - PerReadThreadRawHdfsThroughput: 98.37 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 95.727ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 370.00K (370000) - RowsReturned: 3.29K (3293) - RowsReturnedRate: 34.13 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 6 (6) - ScannerThreadsTotalWallClockTime: 112.366ms - MaterializeTupleTime(*): 42.121ms - ScannerThreadsSysTime: 5.999ms - ScannerThreadsUserTime: 38.994ms - ScannerThreadsVoluntaryContextSwitches: 5 (5) - TotalRawHdfsReadTime(*): 21.238ms - TotalReadThroughput: 0.00 /sec Instance 7f40dcb034de70b7:299 (host=vc1517.foo:22000):(Total: 552.774ms, non-child: 369.290ms, % non-child: 66.81%) Hdfs split stats (:<# splits>/): 4:1/7.19 MB MemoryUsage(500.000ms): 830.06 KB ThreadUsage(500.000ms): 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 11.04 MB (11574212) - PerHostPeakMemUsage: 238.63 MB (250226576) - RowsProduced: 3.37K (3366) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 181.759ms - TotalStorageWaitTime: 86.812ms - TotalThreadsInvoluntaryContextSwitches: 18 (18) - TotalThreadsTotalWallClockTime: 634.882ms - TotalThreadsSysTime: 24.996ms - TotalThreadsUserTime: 75.989ms - TotalThreadsVoluntaryContextSwitches: 279 (279) Fragment Instance Lifecycle Timings: - ExecTime: 467.892ms - ExecTreeExecTime: 109.103ms - OpenTime: 41.103ms - ExecTreeOpenTime: 28.398us - PrepareTime: 43.731ms - ExecTreePrepareTime: 116.275us DataStreamSender (dst_id=26):(Total: 13.100ms, non-child: 13.100ms, % non-child: 100.00%) - BytesSent: 6.22 MB (6524460) - NetworkThroughput(*): 535.67 MB/sec - OverallThroughput: 474.97 MB/sec - PeakMemoryUsage: 816.56 KB (836160) - RowsReturned: 3.37K (3366) - SerializeBatchTime: 999.151us - TransmitDataRPCTime: 11.615ms - UncompressedRowBatchSize: 16.02 MB (16799982) CodeGen:(Total: 60.980ms, non-child: 60.980ms, % non-child: 100.00%) - CodegenTime: 783.431us - CompileTime: 9.151ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 27 (27) - NumInstructions: 373 (373) - OptimizationTime: 30.614ms - PeakMemoryUsage: 186.50 KB (190976) - PrepareTime: 20.822ms HDFS_SCAN_NODE (id=1):(Total: 109.403ms, non-child: 109.403ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:1/7.19 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:2 - FooterProcessingTime: (Avg: 41.767ms ; Min: 41.767ms ; Max: 41.767ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 2.14 MB (2244561) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.14 MB (2244561) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 2.14 MB (2244561) - DecompressionTime: 2.009ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 7.45 MB (7817084) - PerReadThreadRawHdfsThroughput: 58.47 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 108.636ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 380.00K (380000) - RowsReturned: 3.37K (3366) - RowsReturnedRate: 30.77 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 7 (7) - ScannerThreadsTotalWallClockTime: 126.162ms - MaterializeTupleTime(*): 35.613ms - ScannerThreadsSysTime: 3.999ms - ScannerThreadsUserTime: 31.995ms - ScannerThreadsVoluntaryContextSwitches: 8 (8) - TotalRawHdfsReadTime(*): 36.607ms - TotalReadThroughput: 0.00 /sec Instance 7f40dcb034de70b7:281 (host=vd1103.foo:22000):(Total: 386.442ms, non-child: 211.546ms, % non-child: 54.74%) Hdfs split stats (:<# splits>/): 3:1/7.19 MB MemoryUsage(500.000ms): 830.06 KB ThreadUsage(500.000ms): 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 8.90 MB (9327921) - PerHostPeakMemUsage: 222.69 MB (233511144) - RowsProduced: 3.46K (3456) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 103.968ms - TotalStorageWaitTime: 86.756ms - TotalThreadsInvoluntaryContextSwitches: 30 (30) - TotalThreadsTotalWallClockTime: 478.517ms - TotalThreadsSysTime: 19.996ms - TotalThreadsUserTime: 72.988ms - TotalThreadsVoluntaryContextSwitches: 289 (289) Fragment Instance Lifecycle Timings: - ExecTime: 318.215ms - ExecTreeExecTime: 108.241ms - OpenTime: 41.751ms - ExecTreeOpenTime: 44.537us - PrepareTime: 26.430ms - ExecTreePrepareTime: 68.906us DataStreamSender (dst_id=26):(Total: 11.146ms, non-child: 11.146ms, % non-child: 100.00%) - BytesSent: 6.37 MB (6674540) - NetworkThroughput(*): 637.57 MB/sec - OverallThroughput: 571.04 MB/sec - PeakMemoryUsage: 816.56 KB (836160) - RowsReturned: 3.46K (3456) - SerializeBatchTime: 908.608us - TransmitDataRPCTime: 9.983ms - UncompressedRowBatchSize: 16.46 MB (17254510) CodeGen:(Total: 55.313ms, non-child: 55.313ms, % non-child: 100.00%) - CodegenTime: 786.909us - CompileTime: 9.521ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 27 (27) - NumInstructions: 373 (373) - OptimizationTime: 31.164ms - PeakMemoryUsage: 186.50 KB (190976) - PrepareTime: 14.199ms HDFS_SCAN_NODE (id=1):(Total: 108.434ms, non-child: 108.434ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:1/7.19 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:2 - FooterProcessingTime: (Avg: 34.168ms ; Min: 34.168ms ; Max: 34.168ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 2.14 MB (2244574) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.14 MB (2244574) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 2.14 MB (2244574) - DecompressionTime: 3.388ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 6.51 MB (6829313) - PerReadThreadRawHdfsThroughput: 50.19 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 107.893ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 380.00K (380000) - RowsReturned: 3.46K (3456) - RowsReturnedRate: 31.87 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 11 (11) - ScannerThreadsTotalWallClockTime: 118.864ms - MaterializeTupleTime(*): 27.144ms - ScannerThreadsSysTime: 1.999ms - ScannerThreadsUserTime: 26.995ms - ScannerThreadsVoluntaryContextSwitches: 8 (8) - TotalRawHdfsReadTime(*): 42.648ms - TotalReadThroughput: 0.00 /sec Instance 7f40dcb034de70b7:27c (host=ve1128.foo:22000):(Total: 366.272ms, non-child: 198.837ms, % non-child: 54.29%) Hdfs split stats (:<# splits>/): 4:1/7.19 MB - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 8.61 MB (9025342) - PerHostPeakMemUsage: 114.90 MB (120485483) - RowsProduced: 3.46K (3455) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 65.022ms - TotalStorageWaitTime: 70.370ms - TotalThreadsInvoluntaryContextSwitches: 32 (32) - TotalThreadsTotalWallClockTime: 437.427ms - TotalThreadsSysTime: 11.998ms - TotalThreadsUserTime: 89.986ms - TotalThreadsVoluntaryContextSwitches: 273 (273) Fragment Instance Lifecycle Timings: - ExecTime: 281.427ms - ExecTreeExecTime: 93.043ms - OpenTime: 50.998ms - ExecTreeOpenTime: 26.920us - PrepareTime: 33.809ms - ExecTreePrepareTime: 70.440us DataStreamSender (dst_id=26):(Total: 9.176ms, non-child: 9.176ms, % non-child: 100.00%) - BytesSent: 6.33 MB (6637422) - NetworkThroughput(*): 795.16 MB/sec - OverallThroughput: 689.82 MB/sec - PeakMemoryUsage: 816.56 KB (836160) - RowsReturned: 3.46K (3455) - SerializeBatchTime: 950.060us - TransmitDataRPCTime: 7.960ms - UncompressedRowBatchSize: 16.44 MB (17234812) CodeGen:(Total: 65.034ms, non-child: 65.034ms, % non-child: 100.00%) - CodegenTime: 673.496us - CompileTime: 10.549ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 27 (27) - NumInstructions: 373 (373) - OptimizationTime: 39.478ms - PeakMemoryUsage: 186.50 KB (190976) - PrepareTime: 14.583ms HDFS_SCAN_NODE (id=1):(Total: 93.223ms, non-child: 93.223ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:1/7.19 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:2 - FooterProcessingTime: (Avg: 28.349ms ; Min: 28.349ms ; Max: 28.349ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 2.14 MB (2244551) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.14 MB (2244551) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 2.14 MB (2244551) - DecompressionTime: 1.839ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 6.47 MB (6785764) - PerReadThreadRawHdfsThroughput: 56.18 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 92.750ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 380.00K (380000) - RowsReturned: 3.46K (3455) - RowsReturnedRate: 37.06 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 5 (5) - ScannerThreadsTotalWallClockTime: 105.218ms - MaterializeTupleTime(*): 31.279ms - ScannerThreadsSysTime: 1.999ms - ScannerThreadsUserTime: 31.995ms - ScannerThreadsVoluntaryContextSwitches: 5 (5) - TotalRawHdfsReadTime(*): 38.099ms - TotalReadThroughput: 0.00 /sec Instance 7f40dcb034de70b7:28b (host=va1028.foo:22000):(Total: 345.506ms, non-child: 175.866ms, % non-child: 50.90%) Hdfs split stats (:<# splits>/): 4:1/7.00 MB - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 8.07 MB (8465206) - PerHostPeakMemUsage: 109.23 MB (114533641) - RowsProduced: 3.32K (3321) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 34.491ms - TotalStorageWaitTime: 70.710ms - TotalThreadsInvoluntaryContextSwitches: 22 (22) - TotalThreadsTotalWallClockTime: 412.168ms - TotalThreadsSysTime: 18.997ms - TotalThreadsUserTime: 79.988ms - TotalThreadsVoluntaryContextSwitches: 277 (277) Fragment Instance Lifecycle Timings: - ExecTime: 261.024ms - ExecTreeExecTime: 97.138ms - OpenTime: 43.736ms - ExecTreeOpenTime: 28.633us - PrepareTime: 40.706ms - ExecTreePrepareTime: 97.208us DataStreamSender (dst_id=26):(Total: 10.239ms, non-child: 10.239ms, % non-child: 100.00%) - BytesSent: 6.11 MB (6404664) - NetworkThroughput(*): 676.44 MB/sec - OverallThroughput: 596.53 MB/sec - PeakMemoryUsage: 816.56 KB (836160) - RowsReturned: 3.32K (3321) - SerializeBatchTime: 845.022us - TransmitDataRPCTime: 9.029ms - UncompressedRowBatchSize: 15.80 MB (16563472) CodeGen:(Total: 62.016ms, non-child: 62.016ms, % non-child: 100.00%) - CodegenTime: 650.177us - CompileTime: 10.010ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (1997620) - NumFunctions: 27 (27) - NumInstructions: 373 (373) - OptimizationTime: 32.534ms - PeakMemoryUsage: 186.50 KB (190976) - PrepareTime: 19.082ms HDFS_SCAN_NODE (id=1):(Total: 97.385ms, non-child: 97.385ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:1/7.00 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:2 - FooterProcessingTime: (Avg: 34.692ms ; Min: 34.692ms ; Max: 34.692ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 2.09 MB (2190803) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.09 MB (2190803) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 2.09 MB (2190803) - DecompressionTime: 1.247ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 6.53 MB (6850817) - PerReadThreadRawHdfsThroughput: 72.96 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 96.888ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 370.00K (370000) - RowsReturned: 3.32K (3321) - RowsReturnedRate: 34.10 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 9 (9) - ScannerThreadsTotalWallClockTime: 107.681ms - MaterializeTupleTime(*): 34.143ms - ScannerThreadsSysTime: 4.999ms - ScannerThreadsUserTime: 29.995ms - ScannerThreadsVoluntaryContextSwitches: 7 (7) - TotalRawHdfsReadTime(*): 28.636ms - TotalReadThroughput: 0.00 /sec