Query (id=6c4f4a739317c843:d78929db00000000) DEBUG MODE WARNING: Query profile created while running a DEBUG build of Impala. Use RELEASE builds to measure query performance. Summary Session ID: c64002f98b4f8358:c2f8563116655b86 Session Type: HIVESERVER2 HiveServer2 Protocol Version: V6 Start Time: 2017-05-31 14:46:20.783844000 End Time: 2017-05-31 14:49:45.203014000 Query Type: QUERY Query State: FINISHED Query Status: OK Impala Version: impalad version 2.9.0-SNAPSHOT DEBUG (build 470e6de60c3171e58c4ffeea48d456945ab6dd22) User: redacted Connected User: redacted Delegated User: Network Address: redacted Default Db: tpcds_300_decimal_parquet Sql Statement: /* Mem: 300 MB. Coordinator: redacted-host6. */ select c_last_name, c_first_name, ca_city, bought_city, ss_ticket_number, extended_price, extended_tax, list_price from (select ss_ticket_number, ss_customer_sk, ca_city bought_city, sum(ss_ext_sales_price) extended_price, sum(ss_ext_list_price) list_price, sum(ss_ext_tax) extended_tax from store_sales, date_dim, store, household_demographics, customer_address where store_sales.ss_sold_date_sk = date_dim.d_date_sk and store_sales.ss_store_sk = store.s_store_sk and store_sales.ss_hdemo_sk = household_demographics.hd_demo_sk and store_sales.ss_addr_sk = customer_address.ca_address_sk -- and date_dim.d_dom between 1 and 2 and (household_demographics.hd_dep_count = 5 or household_demographics.hd_vehicle_count = 3) -- and date_dim.d_year in (1999, 1999 + 1, 1999 + 2) and store.s_city in ('Midway', 'Fairview') -- partition key filter -- and ss_sold_date_sk in (2451180, 2451181, 2451211, 2451212, 2451239, 2451240, 2451270, 2451271, 2451300, 2451301, 2451331, -- 2451332, 2451361, 2451362, 2451392, 2451393, 2451423, 2451424, 2451453, 2451454, 2451484, 2451485, -- 2451514, 2451515, 2451545, 2451546, 2451576, 2451577, 2451605, 2451606, 2451636, 2451637, 2451666, -- 2451667, 2451697, 2451698, 2451727, 2451728, 2451758, 2451759, 2451789, 2451790, 2451819, 2451820, -- 2451850, 2451851, 2451880, 2451881, 2451911, 2451912, 2451942, 2451943, 2451970, 2451971, 2452001, -- 2452002, 2452031, 2452032, 2452062, 2452063, 2452092, 2452093, 2452123, 2452124, 2452154, 2452155, -- 2452184, 2452185, 2452215, 2452216, 2452245, 2452246) and ss_sold_date_sk between 2451180 and 2451269 -- partition key filter (3 months) and d_date between '1999-01-01' and '1999-03-31' group by ss_ticket_number, ss_customer_sk, ss_addr_sk, ca_city ) dn, customer, customer_address current_addr where ss_customer_sk = c_customer_sk and customer.c_current_addr_sk = current_addr.ca_address_sk and current_addr.ca_city <> bought_city order by c_last_name, ss_ticket_number limit 100; Coordinator: redacted-host6:22000 Query Options (non default): ABORT_ON_ERROR=1,MEM_LIMIT=314572800,RUNTIME_FILTER_MODE=0 Plan: ---------------- Per-Host Resource Reservation: Memory=808.00MB Per-Host Resource Estimates: Memory=365.72MB F10:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1 PLAN-ROOT SINK | mem-estimate=0B mem-reservation=0B | 25:MERGING-EXCHANGE [UNPARTITIONED] | order by: c_last_name ASC, ss_ticket_number ASC | limit: 100 | mem-estimate=0B mem-reservation=0B | tuple-ids=9 row-size=149B cardinality=100 | F00:PLAN FRAGMENT [RANDOM] hosts=8 instances=8 14:TOP-N [LIMIT=100] | order by: c_last_name ASC, ss_ticket_number ASC | mem-estimate=14.54KB mem-reservation=0B | tuple-ids=9 row-size=149B cardinality=100 | 13:HASH JOIN [INNER JOIN, BROADCAST] | hash predicates: current_addr.ca_address_sk = customer.c_current_addr_sk | other predicates: current_addr.ca_city != ca_city | mem-estimate=779.23KB mem-reservation=136.00MB | tuple-ids=8,7,5 row-size=189B cardinality=4643 | |--24:EXCHANGE [BROADCAST] | | mem-estimate=0B mem-reservation=0B | | tuple-ids=7,5 row-size=156B cardinality=4643 | | | F09:PLAN FRAGMENT [HASH(c_customer_sk)] hosts=8 instances=8 | 12:HASH JOIN [INNER JOIN, PARTITIONED] | | hash predicates: c_customer_sk = ss_customer_sk | | mem-estimate=10.17MB mem-reservation=136.00MB | | tuple-ids=7,5 row-size=156B cardinality=4643 | | | |--23:EXCHANGE [HASH(ss_customer_sk)] | | | mem-estimate=0B mem-reservation=0B | | | tuple-ids=5 row-size=97B cardinality=802159 | | | | | F08:PLAN FRAGMENT [HASH(ss_ticket_number,ss_customer_sk,ss_addr_sk,ca_city)] hosts=8 instances=8 | | 21:AGGREGATE [FINALIZE] | | | output: sum:merge(ss_ext_sales_price), sum:merge(ss_ext_list_price), sum:merge(ss_ext_tax) | | | group by: ss_ticket_number, ss_customer_sk, ss_addr_sk, ca_city | | | mem-estimate=81.36MB mem-reservation=264.00MB | | | tuple-ids=5 row-size=97B cardinality=802159 | | | | | 20:EXCHANGE [HASH(ss_ticket_number,ss_customer_sk,ss_addr_sk,ca_city)] | | | mem-estimate=0B mem-reservation=0B | | | tuple-ids=5 row-size=97B cardinality=802159 | | | | | F07:PLAN FRAGMENT [HASH(store_sales.ss_addr_sk)] hosts=8 instances=8 | | 09:AGGREGATE [STREAMING] | | | output: sum(ss_ext_sales_price), sum(ss_ext_list_price), sum(ss_ext_tax) | | | group by: ss_ticket_number, ss_customer_sk, ss_addr_sk, ca_city | | | mem-estimate=81.36MB mem-reservation=0B | | | tuple-ids=5 row-size=97B cardinality=802159 | | | | | 08:HASH JOIN [INNER JOIN, PARTITIONED] | | | hash predicates: store_sales.ss_addr_sk = customer_address.ca_address_sk | | | mem-estimate=10.71MB mem-reservation=136.00MB | | | tuple-ids=0,2,3,1,4 row-size=176B cardinality=802159 | | | | | |--19:EXCHANGE [HASH(customer_address.ca_address_sk)] | | | | mem-estimate=0B mem-reservation=0B | | | | tuple-ids=4 row-size=33B cardinality=2500000 | | | | | | | F06:PLAN FRAGMENT [RANDOM] hosts=8 instances=8 | | | 04:SCAN HDFS [tpcds_300_decimal_parquet.customer_address, RANDOM] | | | partitions=1/1 files=8 size=47.70MB | | | table stats: 2500000 rows total | | | column stats: all | | | mem-estimate=32.00MB mem-reservation=0B | | | tuple-ids=4 row-size=33B cardinality=2500000 | | | | | 18:EXCHANGE [HASH(store_sales.ss_addr_sk)] | | | mem-estimate=0B mem-reservation=0B | | | tuple-ids=0,2,3,1 row-size=143B cardinality=802159 | | | | | F02:PLAN FRAGMENT [RANDOM] hosts=8 instances=8 | | 07:HASH JOIN [INNER JOIN, BROADCAST] | | | hash predicates: store_sales.ss_sold_date_sk = date_dim.d_date_sk | | | mem-estimate=266.80KB mem-reservation=136.00MB | | | tuple-ids=0,2,3,1 row-size=143B cardinality=802159 | | | | | |--17:EXCHANGE [BROADCAST] | | | | mem-estimate=0B mem-reservation=0B | | | | tuple-ids=1 row-size=34B cardinality=7305 | | | | | | | F05:PLAN FRAGMENT [RANDOM] hosts=1 instances=1 | | | 01:SCAN HDFS [tpcds_300_decimal_parquet.date_dim, RANDOM] | | | partitions=1/1 files=1 size=2.15MB | | | predicates: tpcds_300_decimal_parquet.date_dim.d_date_sk <= 2451269, tpcds_300_decimal_parquet.date_dim.d_date_sk >= 2451180, d_date <= '1999-03-31', d_date >= '1999-01-01' | | | table stats: 73049 rows total | | | column stats: all | | | parquet statistics predicates: tpcds_300_decimal_parquet.date_dim.d_date_sk <= 2451269, tpcds_300_decimal_parquet.date_dim.d_date_sk >= 2451180, d_date <= '1999-03-31', d_date >= '1999-01-01' | | | parquet dictionary predicates: tpcds_300_decimal_parquet.date_dim.d_date_sk <= 2451269, tpcds_300_decimal_parquet.date_dim.d_date_sk >= 2451180, d_date <= '1999-03-31', d_date >= '1999-01-01' | | | mem-estimate=32.00MB mem-reservation=0B | | | tuple-ids=1 row-size=34B cardinality=7305 | | | | | 06:HASH JOIN [INNER JOIN, BROADCAST] | | | hash predicates: store_sales.ss_hdemo_sk = household_demographics.hd_demo_sk | | | mem-estimate=30.94KB mem-reservation=136.00MB | | | tuple-ids=0,2,3 row-size=109B cardinality=802159 | | | | | |--16:EXCHANGE [BROADCAST] | | | | mem-estimate=0B mem-reservation=0B | | | | tuple-ids=3 row-size=16B cardinality=1800 | | | | | | | F04:PLAN FRAGMENT [RANDOM] hosts=1 instances=1 | | | 03:SCAN HDFS [tpcds_300_decimal_parquet.household_demographics, RANDOM] | | | partitions=1/1 files=1 size=41.55KB | | | predicates: (household_demographics.hd_dep_count = 5 OR household_demographics.hd_vehicle_count = 3) | | | table stats: 7200 rows total | | | column stats: all | | | mem-estimate=48.00MB mem-reservation=0B | | | tuple-ids=3 row-size=16B cardinality=1800 | | | | | 05:HASH JOIN [INNER JOIN, BROADCAST] | | | hash predicates: store_sales.ss_store_sk = store.s_store_sk | | | mem-estimate=1.84KB mem-reservation=136.00MB | | | tuple-ids=0,2 row-size=93B cardinality=3208636 | | | | | |--15:EXCHANGE [BROADCAST] | | | | mem-estimate=0B mem-reservation=0B | | | | tuple-ids=2 row-size=33B cardinality=52 | | | | | | | F03:PLAN FRAGMENT [RANDOM] hosts=1 instances=1 | | | 02:SCAN HDFS [tpcds_300_decimal_parquet.store, RANDOM] | | | partitions=1/1 files=1 size=73.73KB | | | predicates: store.s_city IN ('Midway', 'Fairview') | | | table stats: 804 rows total | | | column stats: all | | | parquet statistics predicates: store.s_city IN ('Midway', 'Fairview') | | | parquet dictionary predicates: store.s_city IN ('Midway', 'Fairview') | | | mem-estimate=32.00MB mem-reservation=0B | | | tuple-ids=2 row-size=33B cardinality=52 | | | | | 00:SCAN HDFS [tpcds_300_decimal_parquet.store_sales, RANDOM] | | partitions=89/1824 files=89 size=1.14GB | | table stats: 864001869 rows total | | column stats: all | | mem-estimate=192.00MB mem-reservation=0B | | tuple-ids=0 row-size=60B cardinality=24805221 | | | 22:EXCHANGE [HASH(c_customer_sk)] | | mem-estimate=0B mem-reservation=0B | | tuple-ids=7 row-size=60B cardinality=5000000 | | | F01:PLAN FRAGMENT [RANDOM] hosts=8 instances=8 | 10:SCAN HDFS [tpcds_300_decimal_parquet.customer, RANDOM] | partitions=1/1 files=8 size=266.73MB | table stats: 5000000 rows total | column stats: all | mem-estimate=192.00MB mem-reservation=0B | tuple-ids=7 row-size=60B cardinality=5000000 | 11:SCAN HDFS [tpcds_300_decimal_parquet.customer_address current_addr, RANDOM] partitions=1/1 files=8 size=47.70MB table stats: 2500000 rows total column stats: all mem-estimate=32.00MB mem-reservation=0B tuple-ids=8 row-size=33B cardinality=2500000 ---------------- Estimated Per-Host Mem: 383489020 Per-Host Memory Reservation: 847249408 Request Pool: redacted Admission result: Admitted immediately ExecSummary: Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail ------------------------------------------------------------------------------------------------------------------------------------ 25:MERGING-EXCHANGE 1 1.031ms 1.031ms 100 100 0 0 UNPARTITIONED 14:TOP-N 7 346.526ms 874.015ms 700 100 2.69 MB 14.54 KB 13:HASH JOIN 7 575.519ms 1s111ms 27.78K 4.64K 11.37 MB 779.23 KB INNER JOIN, BROADCAST |--24:EXCHANGE 7 25.093ms 53.915ms 28.00K 4.64K 0 0 BROADCAST | 12:HASH JOIN 6 561.014ms 1s141ms 28.00K 4.64K 2.06 MB 10.17 MB INNER JOIN, PARTITIONED | |--23:EXCHANGE 6 8.743ms 30.378ms 28.94K 802.16K 0 0 HASH(ss_customer_sk) | | 21:AGGREGATE 8 577.102ms 1s463ms 28.94K 802.16K 2.66 MB 81.36 MB FINALIZE | | 20:EXCHANGE 8 16.131ms 118.413ms 28.94K 802.16K 0 0 HASH(ss_ticket_number,ss_cu... | | 09:AGGREGATE 8 466.634ms 885.280ms 28.94K 802.16K 1.89 MB 81.36 MB STREAMING | | 08:HASH JOIN 8 1s431ms 3s038ms 307.58K 802.16K 145.22 MB 10.71 MB INNER JOIN, PARTITIONED | | |--19:EXCHANGE 8 453.969ms 607.706ms 2.50M 2.50M 0 0 HASH(customer_address.ca_ad... | | | 04:SCAN HDFS 7 8s342ms 33s506ms 2.50M 2.50M 8.12 MB 32.00 MB tpcds_300_decimal_parquet.c... | | 18:EXCHANGE 8 198.362ms 1s276ms 309.42K 802.16K 0 0 HASH(store_sales.ss_addr_sk) | | 07:HASH JOIN 8 171.452ms 604.979ms 309.42K 802.16K 8.69 MB 266.80 KB INNER JOIN, BROADCAST | | |--17:EXCHANGE 8 66.057us 114.890us 90 7.30K 0 0 BROADCAST | | | 01:SCAN HDFS 1 57s534ms 57s534ms 90 7.30K 4.22 MB 32.00 MB tpcds_300_decimal_parquet.d... | | 06:HASH JOIN 8 232.565ms 855.837ms 309.42K 802.16K 4.18 MB 30.94 KB INNER JOIN, BROADCAST | | |--16:EXCHANGE 8 426.293us 478.405us 1.80K 1.80K 0 0 BROADCAST | | | 03:SCAN HDFS 1 3s253ms 3s253ms 1.80K 1.80K 379.21 KB 48.00 MB tpcds_300_decimal_parquet.h... | | 05:HASH JOIN 8 437.219ms 521.337ms 1.26M 3.21M 2.96 MB 1.84 KB INNER JOIN, BROADCAST | | |--15:EXCHANGE 8 40.420us 68.013us 49 52 0 0 BROADCAST | | | 02:SCAN HDFS 1 37s011ms 37s011ms 49 52 148.03 KB 32.00 MB tpcds_300_decimal_parquet.s... | | 00:SCAN HDFS 8 49s469ms 1m28s 24.81M 24.81M 39.26 MB 192.00 MB tpcds_300_decimal_parquet.s... | 22:EXCHANGE 6 826.042ms 1s173ms 5.00M 5.00M 0 0 HASH(c_customer_sk) | 10:SCAN HDFS 6 10s910ms 34s730ms 5.00M 5.00M 21.79 MB 192.00 MB tpcds_300_decimal_parquet.c... 11:SCAN HDFS 7 4s101ms 8s546ms 2.50M 2.50M 3.95 MB 32.00 MB tpcds_300_decimal_parquet.c... Errors: - ComputeScanRangeAssignmentTimer: 199938717 - InactiveTotalTime: 0 - TotalTime: 0 Planner Timeline Analysis finished: 798255992 Equivalence classes computed: 798755819 Single node plan created: 3177067240 Distributed plan created: 3394025948 Lineage info computed: 3394252450 Planning finished: 3401371633 Query Timeline Query submitted: 432720824 Planning finished: 4030205331 Submit for admission: 4672698052 Completed admission: 4899850956 Ready to start on 8 backends: 5692773449 All 8 execution backends (54 fragment instances) started: 20457505663 Rows available: 203323243434 First row fetched: 203462197424 Unregister query: 204418612178 ImpalaServer - ClientFetchWaitTimer: 694518788 - InactiveTotalTime: 0 - RowMaterializationTimer: 384390530 - TotalTime: 0 Execution Profile 6c4f4a739317c843:d78929db00000000 Backend startup latencies: Count: 8, min / max: 86ms / 14s446ms, 25th %-ile: 119ms, 50th %-ile: 264ms, 75th %-ile: 2s354ms, 90th %-ile: 3s516ms, 95th %-ile: 14s440ms, 99.9th %-ile: 14s440ms Per Node Peak Memory Usage: redacted-host1:22000(241.28 MB) redacted-host2:22000(219.59 MB) redacted-host3:22000(215.23 MB) redacted-host4:22000(179.91 MB) redacted-host5:22000(183.04 MB) redacted-host6:22000(214.86 MB) redacted-host7:22000(225.56 MB) redacted-host8:22000(222.34 MB) - FiltersReceived: 0 - FinalizationTimer: 0 - InactiveTotalTime: 0 - TotalTime: 198390132329 Averaged Fragment F10 split sizes: min: 0, max: 0, avg: 0, stddev: 0 completion times: min:3m17s max:3m17s mean: 3m17s stddev:0.000ns execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec num instances: 1 - AverageThreadTokens: 0.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 294400 - PerHostPeakMemUsage: 225294975 - RowsProduced: 100 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 20 - TotalThreadsTotalWallClockTime: 196554567741 - TotalThreadsSysTime: 2000000 - TotalThreadsUserTime: 86986000 - TotalThreadsVoluntaryContextSwitches: 48 - TotalTime: 197103424243 Fragment Instance Lifecycle Timings - ExecTime: 200859215 - ExecTreeExecTime: 887648 - InactiveTotalTime: 0 - OpenTime: 196353723142 - ExecTreeOpenTime: 196025804291 - PrepareTime: 548729433 - ExecTreePrepareTime: 109691 - TotalTime: 0 PLAN_ROOT_SINK - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - TotalTime: 0 CodeGen - CodegenTime: 1577909 - CompileTime: 20675018 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076168 - NumFunctions: 28 - NumInstructions: 559 - OptimizationTime: 274453747 - PeakMemoryUsage: 286208 - PrepareTime: 549345553 - TotalTime: 861653422 EXCHANGE_NODE (id=25) - BytesReceived: 49160 - ConvertRowBatchTime: 0 - DeserializeRowBatchTimer: 11540672 - FirstBatchArrivalWaitTime: 196025650326 - InactiveTotalTime: 0 - MergeGetNext: 880211 - MergeGetNextBatch: 43364 - PeakMemoryUsage: 0 - RowsReturned: 100 - RowsReturnedRate: 0 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 196026685650 Coordinator Fragment F10 Instance 6c4f4a739317c843:d78929db00000000 (host=redacted-host6:22000) - AverageThreadTokens: 0.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 294400 - PerHostPeakMemUsage: 225294975 - RowsProduced: 100 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 20 - TotalThreadsTotalWallClockTime: 196554567741 - TotalThreadsSysTime: 2000000 - TotalThreadsUserTime: 86986000 - TotalThreadsVoluntaryContextSwitches: 48 - TotalTime: 197103424243 Fragment Instance Lifecycle Timings - ExecTime: 200859215 - ExecTreeExecTime: 887648 - InactiveTotalTime: 0 - OpenTime: 196353723142 - ExecTreeOpenTime: 196025804291 - PrepareTime: 548729433 - ExecTreePrepareTime: 109691 - TotalTime: 0 PLAN_ROOT_SINK - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - TotalTime: 0 CodeGen - CodegenTime: 1577909 - CompileTime: 20675018 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076168 - NumFunctions: 28 - NumInstructions: 559 - OptimizationTime: 274453747 - PeakMemoryUsage: 286208 - PrepareTime: 549345553 - TotalTime: 861653422 EXCHANGE_NODE (id=25) ExecOption: Codegen Enabled - BytesReceived: 49160 - ConvertRowBatchTime: 0 - DeserializeRowBatchTimer: 11540672 - FirstBatchArrivalWaitTime: 196025650326 - InactiveTotalTime: 196025654527 - MergeGetNext: 880211 - MergeGetNextBatch: 43364 - PeakMemoryUsage: 0 - RowsReturned: 100 - RowsReturnedRate: 0 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 196026685650 Averaged Fragment F00 split sizes: min: 5.88 MB, max: 11.77 MB, avg: 6.81 MB, stddev: 2.02 MB completion times: min:3m2s max:3m12s mean: 3m9s stddev:2s960ms execution rates: min:31.53 KB/sec max:63.12 KB/sec mean:36.74 KB/sec stddev:10.78 KB/sec num instances: 7 - AverageThreadTokens: 1.021828299604596 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 17810414 - PerHostPeakMemUsage: 227507189 - RowsProduced: 100 - TotalNetworkReceiveTime: 176712303770 - TotalNetworkSendTime: 23181930 - TotalStorageWaitTime: 2588216555 - TotalThreadsInvoluntaryContextSwitches: 962 - TotalThreadsTotalWallClockTime: 192607769128 - TotalThreadsSysTime: 47563857 - TotalThreadsUserTime: 1125828142 - TotalThreadsVoluntaryContextSwitches: 1111 - TotalTime: 189592718480 Fragment Instance Lifecycle Timings - ExecTime: 27184373 - ExecTreeExecTime: 65165 - InactiveTotalTime: 0 - OpenTime: 188441500698 - ExecTreeOpenTime: 181666357606 - PrepareTime: 1123878509 - ExecTreePrepareTime: 76494142 - TotalTime: 0 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 140 - BlocksRecycled: 74 - BufferedPins: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 209715200 - PeakMemoryUsage: 143479312 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 - ScratchWrites: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 DataStreamSender (dst_id=25) - BytesSent: 7022 - InactiveTotalTime: 0 - NetworkThroughput(*): 133713039 - OverallThroughput: 12244408 - PeakMemoryUsage: 1080 - RowsReturned: 100 - SerializeBatchTime: 1391424 - TotalTime: 1491514 - TransmitDataRPCTime: 53125 - UncompressedRowBatchSize: 14556 CodeGen - CodegenTime: 6421690 - CompileTime: 2133702770 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076168 - NumFunctions: 145 - NumInstructions: 4511 - OptimizationTime: 4558573382 - PeakMemoryUsage: 2309632 - PrepareTime: 871954044 - TotalTime: 7613783120 SORT_NODE (id=14) - InactiveTotalTime: 0 - InsertBatchTime: 4896251 - PeakMemoryUsage: 2481891 - RowsReturned: 100 - RowsReturnedRate: 0 - TotalTime: 181742908246 HASH_JOIN_NODE (id=13) - BuildRows: 27999 - BuildTime: 236996408 - InactiveTotalTime: 0 - LocalTime: 575519214 - NumHashTableBuildsSkipped: 0 - PeakMemoryUsage: 11917618 - ProbeRows: 357142 - ProbeRowsPartitioned: 0 - ProbeTime: 47950777 - RowsReturned: 3968 - RowsReturnedRate: 21 - TotalTime: 181396381571 Hash Join Builder (join_node_id=13) - BuildRowsPartitionTime: 59916240 - BuildRowsPartitioned: 27999 - GetNewBlockTime: 21050509 - HashBuckets: 65536 - HashCollisions: 0 - HashTablesBuildTime: 169424285 - InactiveTotalTime: 0 - LargestPartitionPercent: 6 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 11564160 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=24) - BytesReceived: 2521779 - ConvertRowBatchTime: 6100062 - DeserializeRowBatchTimer: 179694310 - FirstBatchArrivalWaitTime: 159389595297 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 27999 - RowsReturnedRate: 158 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 176719057792 HDFS_SCAN_NODE (id=11) - AverageHdfsReadThreadConcurrency: 0.01098901098901099 - AverageScannerThreadConcurrency: 1.0 - BytesRead: 2098519 - BytesReadDataNodeCache: 0 - BytesReadLocal: 2098519 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 2098519 - DecompressionTime: 26316370 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 1 - NumRowGroups: 1 - NumScannerThreadsStarted: 1 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 3765672 - PerReadThreadRawHdfsThroughput: 871275996 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 4051076469 - RowBatchQueuePutWaitTime: 0 - RowsRead: 357142 - RowsReturned: 357142 - RowsReturnedRate: 109846 - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 371 - ScannerThreadsTotalWallClockTime: 4139157768 - MaterializeTupleTime(*): 295323593 - ScannerThreadsSysTime: 7569714 - ScannerThreadsUserTime: 180257857 - ScannerThreadsVoluntaryContextSwitches: 50 - TotalRawHdfsReadTime(*): 8562492 - TotalReadThroughput: 9218 - TotalTime: 4101804564 Fragment F00 Instance 6c4f4a739317c843:d78929db00000031 (host=redacted-host3:22000) Hdfs split stats (:<# splits>/): 9:1/6.04 MB - AverageThreadTokens: 1.0211640211640212 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 18063394 - PerHostPeakMemUsage: 225689324 - RowsProduced: 100 - TotalNetworkReceiveTime: 182542540664 - TotalNetworkSendTime: 6363836 - TotalStorageWaitTime: 2751743055 - TotalThreadsInvoluntaryContextSwitches: 713 - TotalThreadsTotalWallClockTime: 195768828218 - TotalThreadsSysTime: 34994000 - TotalThreadsUserTime: 1064837000 - TotalThreadsVoluntaryContextSwitches: 837 - TotalTime: 192656546144 Fragment Instance Lifecycle Timings - ExecTime: 6995269 - ExecTreeExecTime: 52262 - InactiveTotalTime: 0 - OpenTime: 191712433136 - ExecTreeOpenTime: 187675067104 - PrepareTime: 937007963 - ExecTreePrepareTime: 14376046 - TotalTime: 0 DataStreamSender (dst_id=25) - BytesSent: 7024 - InactiveTotalTime: 0 - NetworkThroughput(*): 152483501 - OverallThroughput: 19182766 - PeakMemoryUsage: 1080 - RowsReturned: 100 - SerializeBatchTime: 246418 - TotalTime: 366162 - TransmitDataRPCTime: 46064 - UncompressedRowBatchSize: 14609 CodeGen - CodegenTime: 3635644 - CompileTime: 954720776 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076168 - NumFunctions: 145 - NumInstructions: 4511 - OptimizationTime: 2985669964 - PeakMemoryUsage: 2309632 - PrepareTime: 845714999 - TotalTime: 4787487406 SORT_NODE (id=14) ExecOption: Codegen Enabled - InactiveTotalTime: 0 - InsertBatchTime: 15718605 - PeakMemoryUsage: 2459648 - RowsReturned: 100 - RowsReturnedRate: 0 - TotalTime: 187689488226 HASH_JOIN_NODE (id=13) ExecOption: Probe Side Codegen Enabled - BuildRows: 27999 - BuildTime: 123347727 - InactiveTotalTime: 0 - LocalTime: 251574557 - NumHashTableBuildsSkipped: 0 - PeakMemoryUsage: 11917577 - ProbeRows: 316667 - ProbeRowsPartitioned: 0 - ProbeTime: 42218107 - RowsReturned: 3442 - RowsReturnedRate: 18 - TotalTime: 186815472713 Hash Join Builder (join_node_id=13) ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 60646813 - BuildRowsPartitioned: 27999 - GetNewBlockTime: 7604190 - HashBuckets: 65536 - HashCollisions: 0 - HashTablesBuildTime: 61279579 - InactiveTotalTime: 0 - LargestPartitionPercent: 6 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 11564160 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=24) - BytesReceived: 2521779 - ConvertRowBatchTime: 5970604 - DeserializeRowBatchTimer: 171576576 - FirstBatchArrivalWaitTime: 165178822720 - InactiveTotalTime: 182513466284 - PeakMemoryUsage: 0 - RowsReturned: 27999 - RowsReturnedRate: 153 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 182549123227 HDFS_SCAN_NODE (id=11) Hdfs split stats (:<# splits>/): 9:1/6.04 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:2 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 1.0 - BytesRead: 1857941 - BytesReadDataNodeCache: 0 - BytesReadLocal: 1857941 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1857941 - DecompressionTime: 38896030 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 1 - NumRowGroups: 1 - NumScannerThreadsStarted: 1 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 3975167 - PerReadThreadRawHdfsThroughput: 1720377865 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 3955976266 - RowBatchQueuePutWaitTime: 0 - RowsRead: 316667 - RowsReturned: 316667 - RowsReturnedRate: 78875 - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 252 - ScannerThreadsTotalWallClockTime: 4049440188 - MaterializeTupleTime(*): 321012962 - ScannerThreadsSysTime: 1999000 - ScannerThreadsUserTime: 165974000 - ScannerThreadsVoluntaryContextSwitches: 79 - TotalRawHdfsReadTime(*): 1079961 - TotalReadThroughput: 9879 - TotalTime: 4014774929 Instance 6c4f4a739317c843:d78929db00000032 (host=redacted-host7:22000) Hdfs split stats (:<# splits>/): 9:1/5.89 MB - AverageThreadTokens: 1.0293333333333334 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 18155943 - PerHostPeakMemUsage: 236515429 - RowsProduced: 100 - TotalNetworkReceiveTime: 180565943620 - TotalNetworkSendTime: 360458 - TotalStorageWaitTime: 3090335957 - TotalThreadsInvoluntaryContextSwitches: 808 - TotalThreadsTotalWallClockTime: 195519336155 - TotalThreadsSysTime: 36994000 - TotalThreadsUserTime: 1048840000 - TotalThreadsVoluntaryContextSwitches: 927 - TotalTime: 191256855245 Fragment Instance Lifecycle Timings - ExecTime: 1719403 - ExecTreeExecTime: 56655 - InactiveTotalTime: 0 - OpenTime: 190441690527 - ExecTreeOpenTime: 186266587540 - PrepareTime: 813340106 - ExecTreePrepareTime: 73369153 - TotalTime: 0 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 140 - BlocksRecycled: 81 - BufferedPins: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 209715200 - PeakMemoryUsage: 143479312 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 - ScratchWrites: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 DataStreamSender (dst_id=25) - BytesSent: 7011 - InactiveTotalTime: 0 - NetworkThroughput(*): 126582049 - OverallThroughput: 6349151 - PeakMemoryUsage: 1080 - RowsReturned: 100 - SerializeBatchTime: 1017278 - TotalTime: 1104242 - TransmitDataRPCTime: 55387 - UncompressedRowBatchSize: 14545 CodeGen - CodegenTime: 17622987 - CompileTime: 785281100 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076168 - NumFunctions: 145 - NumInstructions: 4511 - OptimizationTime: 3331479764 - PeakMemoryUsage: 2309632 - PrepareTime: 700548342 - TotalTime: 4827150031 SORT_NODE (id=14) ExecOption: Codegen Enabled - InactiveTotalTime: 0 - InsertBatchTime: 1867585 - PeakMemoryUsage: 2415616 - RowsReturned: 100 - RowsReturnedRate: 0 - TotalTime: 186340004745 HASH_JOIN_NODE (id=13) ExecOption: Probe Side Codegen Enabled - BuildRows: 27999 - BuildTime: 150102260 - InactiveTotalTime: 0 - LocalTime: 378449854 - NumHashTableBuildsSkipped: 0 - PeakMemoryUsage: 11917639 - ProbeRows: 308333 - ProbeRowsPartitioned: 0 - ProbeTime: 40439386 - RowsReturned: 3476 - RowsReturnedRate: 18 - TotalTime: 185969840539 Hash Join Builder (join_node_id=13) ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 46139455 - BuildRowsPartitioned: 27999 - GetNewBlockTime: 6875797 - HashBuckets: 65536 - HashCollisions: 0 - HashTablesBuildTime: 103091319 - InactiveTotalTime: 0 - LargestPartitionPercent: 6 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 11564160 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=24) - BytesReceived: 2521779 - ConvertRowBatchTime: 6080026 - DeserializeRowBatchTimer: 114399358 - FirstBatchArrivalWaitTime: 163109979798 - InactiveTotalTime: 180518720876 - PeakMemoryUsage: 0 - RowsReturned: 27999 - RowsReturnedRate: 155 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 180572636364 HDFS_SCAN_NODE (id=11) Hdfs split stats (:<# splits>/): 9:1/5.89 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:2 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 1.0 - BytesRead: 1814616 - BytesReadDataNodeCache: 0 - BytesReadLocal: 1814616 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1814616 - DecompressionTime: 15178585 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 1 - NumRowGroups: 1 - NumScannerThreadsStarted: 1 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 4137348 - PerReadThreadRawHdfsThroughput: 710586414 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 4985651282 - RowBatchQueuePutWaitTime: 0 - RowsRead: 308333 - RowsReturned: 308333 - RowsReturnedRate: 61436 - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 296 - ScannerThreadsTotalWallClockTime: 5075970292 - MaterializeTupleTime(*): 210134800 - ScannerThreadsSysTime: 999000 - ScannerThreadsUserTime: 160975000 - ScannerThreadsVoluntaryContextSwitches: 50 - TotalRawHdfsReadTime(*): 2553688 - TotalReadThroughput: 9675 - TotalTime: 5018754321 Instance 6c4f4a739317c843:d78929db00000035 (host=redacted-host4:22000) Hdfs split stats (:<# splits>/): 7:1/5.89 MB 6:1/5.89 MB - AverageThreadTokens: 1.016 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 17710205 - PerHostPeakMemUsage: 188649285 - RowsProduced: 100 - TotalNetworkReceiveTime: 184374223590 - TotalNetworkSendTime: 415470 - TotalStorageWaitTime: 891415080 - TotalThreadsInvoluntaryContextSwitches: 1549 - TotalThreadsTotalWallClockTime: 193045032334 - TotalThreadsSysTime: 44993000 - TotalThreadsUserTime: 1231812000 - TotalThreadsVoluntaryContextSwitches: 1122 - TotalTime: 190824295005 Fragment Instance Lifecycle Timings - ExecTime: 988755 - ExecTreeExecTime: 52456 - InactiveTotalTime: 0 - OpenTime: 190410377079 - ExecTreeOpenTime: 187450787484 - PrepareTime: 412778149 - ExecTreePrepareTime: 12572542 - TotalTime: 0 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 140 - BlocksRecycled: 52 - BufferedPins: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 209715200 - PeakMemoryUsage: 143479312 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 - ScratchWrites: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 DataStreamSender (dst_id=25) - BytesSent: 6950 - InactiveTotalTime: 0 - NetworkThroughput(*): 119817257 - OverallThroughput: 19816773 - PeakMemoryUsage: 1080 - RowsReturned: 100 - SerializeBatchTime: 260095 - TotalTime: 350713 - TransmitDataRPCTime: 58005 - UncompressedRowBatchSize: 14584 CodeGen - CodegenTime: 8892762 - CompileTime: 429414072 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076168 - NumFunctions: 145 - NumInstructions: 4511 - OptimizationTime: 2493935839 - PeakMemoryUsage: 2309632 - PrepareTime: 261498719 - TotalTime: 3199859350 SORT_NODE (id=14) ExecOption: Codegen Enabled - InactiveTotalTime: 0 - InsertBatchTime: 2944566 - PeakMemoryUsage: 2824249 - RowsReturned: 100 - RowsReturnedRate: 0 - TotalTime: 187463405312 HASH_JOIN_NODE (id=13) ExecOption: Probe Side Codegen Enabled - BuildRows: 27999 - BuildTime: 200342615 - InactiveTotalTime: 0 - LocalTime: 390259931 - NumHashTableBuildsSkipped: 0 - PeakMemoryUsage: 11917625 - ProbeRows: 616667 - ProbeRowsPartitioned: 0 - ProbeTime: 82780623 - RowsReturned: 6721 - RowsReturnedRate: 35 - TotalTime: 187346490948 Hash Join Builder (join_node_id=13) ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 24672780 - BuildRowsPartitioned: 27999 - GetNewBlockTime: 6522359 - HashBuckets: 65536 - HashCollisions: 0 - HashTablesBuildTime: 168933769 - InactiveTotalTime: 0 - LargestPartitionPercent: 6 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 11564160 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=24) - BytesReceived: 2521779 - ConvertRowBatchTime: 6055073 - DeserializeRowBatchTimer: 68157575 - FirstBatchArrivalWaitTime: 166960238332 - InactiveTotalTime: 184371959691 - PeakMemoryUsage: 0 - RowsReturned: 27999 - RowsReturnedRate: 151 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 184380926415 HDFS_SCAN_NODE (id=11) Hdfs split stats (:<# splits>/): 7:1/5.89 MB 6:1/5.89 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 2 out of 2 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:4 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 1.0 - BytesRead: 3628278 - BytesReadDataNodeCache: 0 - BytesReadLocal: 3628278 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 3628278 - DecompressionTime: 80232140 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 2 - NumRowGroups: 2 - NumScannerThreadsStarted: 1 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 3562856 - PerReadThreadRawHdfsThroughput: 124221114 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 2505358978 - RowBatchQueuePutWaitTime: 0 - RowsRead: 616667 - RowsReturned: 616667 - RowsReturnedRate: 239454 - ScanRangesComplete: 2 - ScannerThreadsInvoluntaryContextSwitches: 946 - ScannerThreadsTotalWallClockTime: 2633715574 - MaterializeTupleTime(*): 720318903 - ScannerThreadsSysTime: 10998000 - ScannerThreadsUserTime: 313952000 - ScannerThreadsVoluntaryContextSwitches: 83 - TotalRawHdfsReadTime(*): 29208223 - TotalReadThroughput: 19343 - TotalTime: 2575304602 Instance 6c4f4a739317c843:d78929db00000034 (host=redacted-host2:22000) Hdfs split stats (:<# splits>/): 3:1/6.04 MB - AverageThreadTokens: 1.013262599469496 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 17285200 - PerHostPeakMemUsage: 230260997 - RowsProduced: 100 - TotalNetworkReceiveTime: 182333935003 - TotalNetworkSendTime: 358854 - TotalStorageWaitTime: 276807437 - TotalThreadsInvoluntaryContextSwitches: 748 - TotalThreadsTotalWallClockTime: 192156922724 - TotalThreadsSysTime: 41994000 - TotalThreadsUserTime: 1051839000 - TotalThreadsVoluntaryContextSwitches: 960 - TotalTime: 190661460765 Fragment Instance Lifecycle Timings - ExecTime: 1075410 - ExecTreeExecTime: 48038 - InactiveTotalTime: 0 - OpenTime: 189824455558 - ExecTreeOpenTime: 185504704587 - PrepareTime: 835823625 - ExecTreePrepareTime: 3944928 - TotalTime: 0 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 140 - BlocksRecycled: 76 - BufferedPins: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 209715200 - PeakMemoryUsage: 143479312 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 - ScratchWrites: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 DataStreamSender (dst_id=25) - BytesSent: 7072 - InactiveTotalTime: 0 - NetworkThroughput(*): 146837755 - OverallThroughput: 18408612 - PeakMemoryUsage: 1080 - RowsReturned: 100 - SerializeBatchTime: 308301 - TotalTime: 384168 - TransmitDataRPCTime: 48162 - UncompressedRowBatchSize: 14544 CodeGen - CodegenTime: 3562399 - CompileTime: 792667707 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076168 - NumFunctions: 145 - NumInstructions: 4511 - OptimizationTime: 3453608218 - PeakMemoryUsage: 2309632 - PrepareTime: 650862833 - TotalTime: 4977896888 SORT_NODE (id=14) ExecOption: Codegen Enabled - InactiveTotalTime: 0 - InsertBatchTime: 1983389 - PeakMemoryUsage: 2466816 - RowsReturned: 100 - RowsReturnedRate: 0 - TotalTime: 185508688956 HASH_JOIN_NODE (id=13) ExecOption: Probe Side Codegen Enabled - BuildRows: 27999 - BuildTime: 494503658 - InactiveTotalTime: 0 - LocalTime: 788015435 - NumHashTableBuildsSkipped: 0 - PeakMemoryUsage: 11917623 - ProbeRows: 316666 - ProbeRowsPartitioned: 0 - ProbeTime: 39147470 - RowsReturned: 3491 - RowsReturnedRate: 18 - TotalTime: 185451238153 Hash Join Builder (join_node_id=13) ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 56386583 - BuildRowsPartitioned: 27999 - GetNewBlockTime: 26901306 - HashBuckets: 65536 - HashCollisions: 0 - HashTablesBuildTime: 435514427 - InactiveTotalTime: 0 - LargestPartitionPercent: 6 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 11564160 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=24) - BytesReceived: 2521779 - ConvertRowBatchTime: 6302467 - DeserializeRowBatchTimer: 388825253 - FirstBatchArrivalWaitTime: 165002231639 - InactiveTotalTime: 182310069393 - PeakMemoryUsage: 0 - RowsReturned: 27999 - RowsReturnedRate: 153 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 182340906182 HDFS_SCAN_NODE (id=11) Hdfs split stats (:<# splits>/): 3:1/6.04 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:2 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 1.0 - BytesRead: 1858729 - BytesReadDataNodeCache: 0 - BytesReadLocal: 1858729 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1858729 - DecompressionTime: 3937733 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 1 - NumRowGroups: 1 - NumScannerThreadsStarted: 1 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 3197997 - PerReadThreadRawHdfsThroughput: 909744940 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 2280556158 - RowBatchQueuePutWaitTime: 0 - RowsRead: 316666 - RowsReturned: 316666 - RowsReturnedRate: 136357 - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 124 - ScannerThreadsTotalWallClockTime: 2331443119 - MaterializeTupleTime(*): 125404993 - ScannerThreadsSysTime: 3999000 - ScannerThreadsUserTime: 135979000 - ScannerThreadsVoluntaryContextSwitches: 15 - TotalRawHdfsReadTime(*): 2043132 - TotalReadThroughput: 2690 - TotalTime: 2322316536 Instance 6c4f4a739317c843:d78929db0000002f (host=redacted-host6:22000) Hdfs split stats (:<# splits>/): 6:1/6.04 MB - AverageThreadTokens: 1.0134048257372654 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 18069597 - PerHostPeakMemUsage: 225294975 - RowsProduced: 100 - TotalNetworkReceiveTime: 181480294155 - TotalNetworkSendTime: 22833559 - TotalStorageWaitTime: 1130301892 - TotalThreadsInvoluntaryContextSwitches: 1275 - TotalThreadsTotalWallClockTime: 191800531018 - TotalThreadsSysTime: 43993000 - TotalThreadsUserTime: 1137827000 - TotalThreadsVoluntaryContextSwitches: 940 - TotalTime: 190313781661 Fragment Instance Lifecycle Timings - ExecTime: 38499634 - ExecTreeExecTime: 52648 - InactiveTotalTime: 0 - OpenTime: 189415851592 - ExecTreeOpenTime: 184431709501 - PrepareTime: 859338814 - ExecTreePrepareTime: 39471656 - TotalTime: 0 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 140 - BlocksRecycled: 81 - BufferedPins: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 209715200 - PeakMemoryUsage: 143479312 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 - ScratchWrites: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 DataStreamSender (dst_id=25) - BytesSent: 7080 - InactiveTotalTime: 0 - NetworkThroughput(*): 127987273 - OverallThroughput: 1030696 - PeakMemoryUsage: 1080 - RowsReturned: 100 - SerializeBatchTime: 6776154 - TotalTime: 6869143 - TransmitDataRPCTime: 55318 - UncompressedRowBatchSize: 14558 CodeGen - CodegenTime: 3676436 - CompileTime: 634939045 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076168 - NumFunctions: 145 - NumInstructions: 4511 - OptimizationTime: 4285858752 - PeakMemoryUsage: 2309632 - PrepareTime: 746031224 - TotalTime: 5700729475 SORT_NODE (id=14) ExecOption: Codegen Enabled - InactiveTotalTime: 0 - InsertBatchTime: 1868116 - PeakMemoryUsage: 2434048 - RowsReturned: 100 - RowsReturnedRate: 0 - TotalTime: 184471226045 HASH_JOIN_NODE (id=13) ExecOption: Probe Side Codegen Enabled - BuildRows: 27999 - BuildTime: 205701623 - InactiveTotalTime: 0 - LocalTime: 481196149 - NumHashTableBuildsSkipped: 0 - PeakMemoryUsage: 11917636 - ProbeRows: 316666 - ProbeRowsPartitioned: 0 - ProbeTime: 44942449 - RowsReturned: 3604 - RowsReturnedRate: 19 - TotalTime: 184305507770 Hash Join Builder (join_node_id=13) ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 39057196 - BuildRowsPartitioned: 27999 - GetNewBlockTime: 1009526 - HashBuckets: 65536 - HashCollisions: 0 - HashTablesBuildTime: 166162183 - InactiveTotalTime: 0 - LargestPartitionPercent: 6 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 11564160 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=24) - BytesReceived: 2521779 - ConvertRowBatchTime: 5915009 - DeserializeRowBatchTimer: 203802463 - FirstBatchArrivalWaitTime: 164180205518 - InactiveTotalTime: 181472839778 - PeakMemoryUsage: 0 - RowsReturned: 27999 - RowsReturnedRate: 154 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 181486816839 HDFS_SCAN_NODE (id=11) Hdfs split stats (:<# splits>/): 6:1/6.04 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:2 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 1.0 - BytesRead: 1857986 - BytesReadDataNodeCache: 0 - BytesReadLocal: 1857986 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1857986 - DecompressionTime: 12459969 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 1 - NumRowGroups: 1 - NumScannerThreadsStarted: 1 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 4076602 - PerReadThreadRawHdfsThroughput: 905497600 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 2254516602 - RowBatchQueuePutWaitTime: 0 - RowsRead: 316666 - RowsReturned: 316666 - RowsReturnedRate: 135472 - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 464 - ScannerThreadsTotalWallClockTime: 2346219614 - MaterializeTupleTime(*): 328667850 - ScannerThreadsSysTime: 5999000 - ScannerThreadsUserTime: 154976000 - ScannerThreadsVoluntaryContextSwitches: 30 - TotalRawHdfsReadTime(*): 2051895 - TotalReadThroughput: 9957 - TotalTime: 2337494782 Instance 6c4f4a739317c843:d78929db00000030 (host=redacted-host1:22000) Hdfs split stats (:<# splits>/): 8:1/6.04 MB - AverageThreadTokens: 1.0216216216216216 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 17596480 - PerHostPeakMemUsage: 253001132 - RowsProduced: 100 - TotalNetworkReceiveTime: 178481975463 - TotalNetworkSendTime: 5650374 - TotalStorageWaitTime: 2518447768 - TotalThreadsInvoluntaryContextSwitches: 860 - TotalThreadsTotalWallClockTime: 192010577968 - TotalThreadsSysTime: 36994000 - TotalThreadsUserTime: 1076836000 - TotalThreadsVoluntaryContextSwitches: 1060 - TotalTime: 188904867412 Fragment Instance Lifecycle Timings - ExecTime: 6793554 - ExecTreeExecTime: 125098 - InactiveTotalTime: 0 - OpenTime: 188063966543 - ExecTreeOpenTime: 183730444276 - PrepareTime: 833894889 - ExecTreePrepareTime: 179743194 - TotalTime: 0 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 140 - BlocksRecycled: 76 - BufferedPins: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 209715200 - PeakMemoryUsage: 143479312 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 - ScratchWrites: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 DataStreamSender (dst_id=25) - BytesSent: 7015 - InactiveTotalTime: 0 - NetworkThroughput(*): 148995369 - OverallThroughput: 9028523 - PeakMemoryUsage: 1080 - RowsReturned: 100 - SerializeBatchTime: 683936 - TotalTime: 776982 - TransmitDataRPCTime: 47082 - UncompressedRowBatchSize: 14529 CodeGen - CodegenTime: 3491451 - CompileTime: 728272959 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076168 - NumFunctions: 145 - NumInstructions: 4511 - OptimizationTime: 3563483205 - PeakMemoryUsage: 2309632 - PrepareTime: 360133701 - TotalTime: 4691610672 SORT_NODE (id=14) ExecOption: Codegen Enabled - InactiveTotalTime: 0 - InsertBatchTime: 6515504 - PeakMemoryUsage: 2338816 - RowsReturned: 100 - RowsReturnedRate: 0 - TotalTime: 183910298630 HASH_JOIN_NODE (id=13) ExecOption: Probe Side Codegen Enabled - BuildRows: 27999 - BuildTime: 306567933 - InactiveTotalTime: 0 - LocalTime: 1111708614 - NumHashTableBuildsSkipped: 0 - PeakMemoryUsage: 11917607 - ProbeRows: 316667 - ProbeRowsPartitioned: 0 - ProbeTime: 40851821 - RowsReturned: 3618 - RowsReturnedRate: 19 - TotalTime: 183498012692 Hash Join Builder (join_node_id=13) ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 127310644 - BuildRowsPartitioned: 27999 - GetNewBlockTime: 83637759 - HashBuckets: 65536 - HashCollisions: 0 - HashTablesBuildTime: 143322404 - InactiveTotalTime: 0 - LargestPartitionPercent: 6 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 11564160 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=24) - BytesReceived: 2521779 - ConvertRowBatchTime: 6481505 - DeserializeRowBatchTimer: 206147173 - FirstBatchArrivalWaitTime: 161484909745 - InactiveTotalTime: 178465325277 - PeakMemoryUsage: 0 - RowsReturned: 27999 - RowsReturnedRate: 156 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 178489288411 HDFS_SCAN_NODE (id=11) Hdfs split stats (:<# splits>/): 8:1/6.04 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:2 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 1.0 - BytesRead: 1858062 - BytesReadDataNodeCache: 0 - BytesReadLocal: 1858062 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1858062 - DecompressionTime: 12357954 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 1 - NumRowGroups: 1 - NumScannerThreadsStarted: 1 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 3603485 - PerReadThreadRawHdfsThroughput: 1645563768 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 3870292897 - RowBatchQueuePutWaitTime: 0 - RowsRead: 316667 - RowsReturned: 316667 - RowsReturnedRate: 81258 - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 369 - ScannerThreadsTotalWallClockTime: 3939896100 - MaterializeTupleTime(*): 170443559 - ScannerThreadsSysTime: 1999000 - ScannerThreadsUserTime: 164975000 - ScannerThreadsVoluntaryContextSwitches: 45 - TotalRawHdfsReadTime(*): 1129134 - TotalReadThroughput: 10067 - TotalTime: 3897015667 Instance 6c4f4a739317c843:d78929db00000033 (host=redacted-host8:22000) Hdfs split stats (:<# splits>/): 10:1/5.88 MB - AverageThreadTokens: 1.0380116959064327 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 17792081 - PerHostPeakMemUsage: 233139186 - RowsProduced: 100 - TotalNetworkReceiveTime: 147207213896 - TotalNetworkSendTime: 126290965 - TotalStorageWaitTime: 7458464697 - TotalThreadsInvoluntaryContextSwitches: 786 - TotalThreadsTotalWallClockTime: 187953155485 - TotalThreadsSysTime: 92985000 - TotalThreadsUserTime: 1268806000 - TotalThreadsVoluntaryContextSwitches: 1936 - TotalTime: 182531223128 Fragment Instance Lifecycle Timings - ExecTime: 134218587 - ExecTreeExecTime: 68999 - InactiveTotalTime: 0 - OpenTime: 179221730452 - ExecTreeOpenTime: 156605202750 - PrepareTime: 3174966017 - ExecTreePrepareTime: 211981480 - TotalTime: 0 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 140 - BlocksRecycled: 78 - BufferedPins: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 209715200 - PeakMemoryUsage: 143479312 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 - ScratchWrites: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 DataStreamSender (dst_id=25) - BytesSent: 7008 - InactiveTotalTime: 0 - NetworkThroughput(*): 113288069 - OverallThroughput: 11894335 - PeakMemoryUsage: 1080 - RowsReturned: 100 - SerializeBatchTime: 447792 - TotalTime: 589188 - TransmitDataRPCTime: 61860 - UncompressedRowBatchSize: 14529 CodeGen - CodegenTime: 4070157 - CompileTime: 10610623735 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076168 - NumFunctions: 145 - NumInstructions: 4511 - OptimizationTime: 11795977936 - PeakMemoryUsage: 2309632 - PrepareTime: 2538888493 - TotalTime: 25111748024 SORT_NODE (id=14) ExecOption: Codegen Enabled - InactiveTotalTime: 0 - InsertBatchTime: 3375996 - PeakMemoryUsage: 2434048 - RowsReturned: 100 - RowsReturnedRate: 0 - TotalTime: 156817245811 HASH_JOIN_NODE (id=13) ExecOption: Probe Side Codegen Enabled - BuildRows: 27999 - BuildTime: 178409042 - InactiveTotalTime: 0 - LocalTime: 627429963 - NumHashTableBuildsSkipped: 0 - PeakMemoryUsage: 11917624 - ProbeRows: 308334 - ProbeRowsPartitioned: 0 - ProbeTime: 45275583 - RowsReturned: 3427 - RowsReturnedRate: 21 - TotalTime: 156388108188 Hash Join Builder (join_node_id=13) ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 65200212 - BuildRowsPartitioned: 27999 - GetNewBlockTime: 14802630 - HashBuckets: 65536 - HashCollisions: 0 - HashTablesBuildTime: 107666316 - InactiveTotalTime: 0 - LargestPartitionPercent: 6 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 11564160 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=24) - BytesReceived: 2521779 - ConvertRowBatchTime: 5895753 - DeserializeRowBatchTimer: 104951776 - FirstBatchArrivalWaitTime: 129810779331 - InactiveTotalTime: 147205367887 - PeakMemoryUsage: 0 - RowsReturned: 27999 - RowsReturnedRate: 190 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 147213707112 HDFS_SCAN_NODE (id=11) Hdfs split stats (:<# splits>/): 10:1/5.88 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:2 - AverageHdfsReadThreadConcurrency: 0.07692307692307693 - AverageScannerThreadConcurrency: 1.0 - BytesRead: 1814021 - BytesReadDataNodeCache: 0 - BytesReadLocal: 1814021 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1814021 - DecompressionTime: 21152184 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 1 - NumRowGroups: 1 - NumScannerThreadsStarted: 1 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 3806254 - PerReadThreadRawHdfsThroughput: 82940274 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 8505183103 - RowBatchQueuePutWaitTime: 0 - RowsRead: 308334 - RowsReturned: 308334 - RowsReturnedRate: 36075 - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 146 - ScannerThreadsTotalWallClockTime: 8597419490 - MaterializeTupleTime(*): 191282085 - ScannerThreadsSysTime: 26995000 - ScannerThreadsUserTime: 164974000 - ScannerThreadsVoluntaryContextSwitches: 53 - TotalRawHdfsReadTime(*): 21871413 - TotalReadThroughput: 2921 - TotalTime: 8546971113 Averaged Fragment F09 split sizes: min: 0, max: 0, avg: 0, stddev: 0 completion times: min:2m53s max:3m7s mean: 3m4s stddev:5s078ms execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec num instances: 6 - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 22259580 - PerHostPeakMemUsage: 233983507 - RowsProduced: 4666 - TotalNetworkReceiveTime: 178603282680 - TotalNetworkSendTime: 457956053 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 547 - TotalThreadsTotalWallClockTime: 182834846148 - TotalThreadsSysTime: 48992333 - TotalThreadsUserTime: 779881166 - TotalThreadsVoluntaryContextSwitches: 1867 - TotalTime: 184168719958 Fragment Instance Lifecycle Timings - ExecTime: 17668679729 - ExecTreeExecTime: 16815057761 - InactiveTotalTime: 0 - OpenTime: 165166199716 - ExecTreeOpenTime: 162526304816 - PrepareTime: 1333736454 - ExecTreePrepareTime: 111288398 - TotalTime: 0 DataStreamSender (dst_id=24) - BytesSent: 2942075 - InactiveTotalTime: 0 - NetworkThroughput(*): 428465926 - OverallThroughput: 53205077 - PeakMemoryUsage: 13216 - RowsReturned: 4666 - SerializeBatchTime: 57705047 - TotalTime: 67199691 - TransmitDataRPCTime: 9414895 - UncompressedRowBatchSize: 5424681 CodeGen - CodegenTime: 0 - CompileTime: 708875916 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076168 - NumFunctions: 54 - NumInstructions: 2406 - OptimizationTime: 1798328036 - PeakMemoryUsage: 1231872 - PrepareTime: 909827179 - TotalTime: 3444422864 HASH_JOIN_NODE (id=12) - BuildRows: 4823 - BuildTime: 44024521 - InactiveTotalTime: 0 - LocalTime: 561014957 - NumHashTableBuildsSkipped: 0 - PeakMemoryUsage: 1981219 - ProbeRows: 833333 - ProbeRowsPartitioned: 0 - ProbeTime: 187052502 - RowsReturned: 4666 - RowsReturnedRate: 25 - TotalTime: 179531450186 Hash Join Builder (join_node_id=12) - BuildRowsPartitionTime: 10589027 - BuildRowsPartitioned: 4823 - GetNewBlockTime: 19752349 - HashBuckets: 8192 - HashCollisions: 0 - HashTablesBuildTime: 10015067 - InactiveTotalTime: 0 - LargestPartitionPercent: 6 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 1878485 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=23) - BytesReceived: 259355 - ConvertRowBatchTime: 1137557 - DeserializeRowBatchTimer: 52641845 - FirstBatchArrivalWaitTime: 162195342991 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 4823 - RowsReturnedRate: 29 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 162478733122 EXCHANGE_NODE (id=22) - BytesReceived: 30512525 - ConvertRowBatchTime: 308845763 - DeserializeRowBatchTimer: 4812432916 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 833333 - RowsReturnedRate: 50531 - SendersBlockedTimer: 129766260132 - SendersBlockedTotalTimer(*): 658955234867 - TotalTime: 16491702105 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 140 - BlocksRecycled: 62 - BufferedPins: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 209715200 - PeakMemoryUsage: 143479312 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 - ScratchWrites: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 Fragment F09 Instance 6c4f4a739317c843:d78929db0000002c (host=redacted-host2:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 21916260 - PerHostPeakMemUsage: 230260997 - RowsProduced: 4630 - TotalNetworkReceiveTime: 182754875739 - TotalNetworkSendTime: 223748941 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 549 - TotalThreadsTotalWallClockTime: 186382110800 - TotalThreadsSysTime: 43993000 - TotalThreadsUserTime: 746886000 - TotalThreadsVoluntaryContextSwitches: 1853 - TotalTime: 187669363518 Fragment Instance Lifecycle Timings - ExecTime: 17785828151 - ExecTreeExecTime: 16888669728 - InactiveTotalTime: 0 - OpenTime: 168596298568 - ExecTreeOpenTime: 166572528084 - PrepareTime: 1287136713 - ExecTreePrepareTime: 480065 - TotalTime: 0 DataStreamSender (dst_id=24) - BytesSent: 2920512 - InactiveTotalTime: 0 - NetworkThroughput(*): 150170130 - OverallThroughput: 25346339 - PeakMemoryUsage: 13216 - RowsReturned: 4630 - SerializeBatchTime: 95682326 - TotalTime: 115224213 - TransmitDataRPCTime: 19448022 - UncompressedRowBatchSize: 5382580 CodeGen - CodegenTime: 0 - CompileTime: 482607769 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076168 - NumFunctions: 54 - NumInstructions: 2406 - OptimizationTime: 1377437190 - PeakMemoryUsage: 1231872 - PrepareTime: 975603649 - TotalTime: 2885144759 HASH_JOIN_NODE (id=12) ExecOption: Probe Side Codegen Enabled - BuildRows: 4630 - BuildTime: 52569439 - InactiveTotalTime: 0 - LocalTime: 419595669 - NumHashTableBuildsSkipped: 0 - PeakMemoryUsage: 1828263 - ProbeRows: 834734 - ProbeRowsPartitioned: 0 - ProbeTime: 173824223 - RowsReturned: 4630 - RowsReturnedRate: 25 - TotalTime: 183461902249 Hash Join Builder (join_node_id=12) ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 2407316 - BuildRowsPartitioned: 4630 - GetNewBlockTime: 44812261 - HashBuckets: 8192 - HashCollisions: 0 - HashTablesBuildTime: 4996013 - InactiveTotalTime: 0 - LargestPartitionPercent: 6 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 1725568 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=23) - BytesReceived: 250347 - ConvertRowBatchTime: 1032650 - DeserializeRowBatchTimer: 8068834 - FirstBatchArrivalWaitTime: 166266917614 - InactiveTotalTime: 166514109568 - PeakMemoryUsage: 0 - RowsReturned: 4630 - RowsReturnedRate: 27 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 166519585979 EXCHANGE_NODE (id=22) - BytesReceived: 30559350 - ConvertRowBatchTime: 255151636 - DeserializeRowBatchTimer: 3522850564 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 15942550102 - PeakMemoryUsage: 0 - RowsReturned: 834734 - RowsReturnedRate: 50520 - SendersBlockedTimer: 129789621175 - SendersBlockedTotalTimer(*): 767089990837 - TotalTime: 16522720601 Instance 6c4f4a739317c843:d78929db0000002e (host=redacted-host3:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 22318738 - PerHostPeakMemUsage: 225689324 - RowsProduced: 4732 - TotalNetworkReceiveTime: 183560610128 - TotalNetworkSendTime: 471155875 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 548 - TotalThreadsTotalWallClockTime: 186394660706 - TotalThreadsSysTime: 39994000 - TotalThreadsUserTime: 767883000 - TotalThreadsVoluntaryContextSwitches: 1726 - TotalTime: 187591547407 Fragment Instance Lifecycle Timings - ExecTime: 17622962230 - ExecTreeExecTime: 16835764311 - InactiveTotalTime: 0 - OpenTime: 168771713752 - ExecTreeOpenTime: 167340262631 - PrepareTime: 1196786405 - ExecTreePrepareTime: 681852 - TotalTime: 0 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 140 - BlocksRecycled: 62 - BufferedPins: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 209715200 - PeakMemoryUsage: 143479312 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 - ScratchWrites: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 DataStreamSender (dst_id=24) - BytesSent: 2985969 - InactiveTotalTime: 0 - NetworkThroughput(*): 503917637 - OverallThroughput: 101125847 - PeakMemoryUsage: 13216 - RowsReturned: 4732 - SerializeBatchTime: 23504486 - TotalTime: 29527258 - TransmitDataRPCTime: 5925510 - UncompressedRowBatchSize: 5501440 CodeGen - CodegenTime: 0 - CompileTime: 449480331 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076168 - NumFunctions: 54 - NumInstructions: 2406 - OptimizationTime: 967627179 - PeakMemoryUsage: 1231872 - PrepareTime: 795354002 - TotalTime: 2235297977 HASH_JOIN_NODE (id=12) ExecOption: Probe Side Codegen Enabled - BuildRows: 4732 - BuildTime: 33545706 - InactiveTotalTime: 0 - LocalTime: 290565522 - NumHashTableBuildsSkipped: 0 - PeakMemoryUsage: 1959488 - ProbeRows: 832824 - ProbeRowsPartitioned: 0 - ProbeTime: 181465480 - RowsReturned: 4732 - RowsReturnedRate: 25 - TotalTime: 184176652351 Hash Join Builder (join_node_id=12) ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 10590956 - BuildRowsPartitioned: 4732 - GetNewBlockTime: 20202688 - HashBuckets: 8192 - HashCollisions: 0 - HashTablesBuildTime: 2448886 - InactiveTotalTime: 0 - LargestPartitionPercent: 7 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 1856640 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=23) - BytesReceived: 256559 - ConvertRowBatchTime: 1081398 - DeserializeRowBatchTimer: 55250026 - FirstBatchArrivalWaitTime: 166965803452 - InactiveTotalTime: 167294046679 - PeakMemoryUsage: 0 - RowsReturned: 4732 - RowsReturnedRate: 28 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 167296024873 EXCHANGE_NODE (id=22) - BytesReceived: 30494862 - ConvertRowBatchTime: 247723307 - DeserializeRowBatchTimer: 2908516171 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 15791227533 - PeakMemoryUsage: 0 - RowsReturned: 832824 - RowsReturnedRate: 50200 - SendersBlockedTimer: 129820632865 - SendersBlockedTotalTimer(*): 767322145834 - TotalTime: 16590061956 Instance 6c4f4a739317c843:d78929db0000002a (host=redacted-host6:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 22513631 - PerHostPeakMemUsage: 225294975 - RowsProduced: 4657 - TotalNetworkReceiveTime: 182694910519 - TotalNetworkSendTime: 488576127 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 497 - TotalThreadsTotalWallClockTime: 186571706220 - TotalThreadsSysTime: 45993000 - TotalThreadsUserTime: 786880000 - TotalThreadsVoluntaryContextSwitches: 1834 - TotalTime: 187344179090 Fragment Instance Lifecycle Timings - ExecTime: 17704126617 - ExecTreeExecTime: 16937584790 - InactiveTotalTime: 0 - OpenTime: 168867597320 - ExecTreeOpenTime: 166653120253 - PrepareTime: 772308587 - ExecTreePrepareTime: 21797504 - TotalTime: 0 DataStreamSender (dst_id=24) - BytesSent: 2933315 - InactiveTotalTime: 0 - NetworkThroughput(*): 501881382 - OverallThroughput: 66099085 - PeakMemoryUsage: 13216 - RowsReturned: 4657 - SerializeBatchTime: 38457970 - TotalTime: 44377543 - TransmitDataRPCTime: 5844638 - UncompressedRowBatchSize: 5410097 CodeGen - CodegenTime: 0 - CompileTime: 560582243 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076168 - NumFunctions: 54 - NumInstructions: 2406 - OptimizationTime: 1592038748 - PeakMemoryUsage: 1231872 - PrepareTime: 513195081 - TotalTime: 2678921414 HASH_JOIN_NODE (id=12) ExecOption: Probe Side Codegen Enabled - BuildRows: 4657 - BuildTime: 17186453 - InactiveTotalTime: 0 - LocalTime: 531413956 - NumHashTableBuildsSkipped: 0 - PeakMemoryUsage: 2155982 - ProbeRows: 832457 - ProbeRowsPartitioned: 0 - ProbeTime: 190305746 - RowsReturned: 4657 - RowsReturnedRate: 25 - TotalTime: 183612716536 Hash Join Builder (join_node_id=12) ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 6020512 - BuildRowsPartitioned: 4657 - GetNewBlockTime: 1359298 - HashBuckets: 8192 - HashCollisions: 0 - HashTablesBuildTime: 9488980 - InactiveTotalTime: 0 - LargestPartitionPercent: 6 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 2053248 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=23) - BytesReceived: 251977 - ConvertRowBatchTime: 1077803 - DeserializeRowBatchTimer: 19185070 - FirstBatchArrivalWaitTime: 166327475783 - InactiveTotalTime: 166633442822 - PeakMemoryUsage: 0 - RowsReturned: 4657 - RowsReturnedRate: 27 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 166635500295 EXCHANGE_NODE (id=22) - BytesReceived: 30477210 - ConvertRowBatchTime: 326518045 - DeserializeRowBatchTimer: 7324706117 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 15678285112 - PeakMemoryUsage: 0 - RowsReturned: 832457 - RowsReturnedRate: 50618 - SendersBlockedTimer: 129687809477 - SendersBlockedTotalTimer(*): 377681890158 - TotalTime: 16445802285 Instance 6c4f4a739317c843:d78929db00000029 (host=redacted-host7:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 22467312 - PerHostPeakMemUsage: 236515429 - RowsProduced: 4643 - TotalNetworkReceiveTime: 181070509858 - TotalNetworkSendTime: 454713483 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 639 - TotalThreadsTotalWallClockTime: 183941945292 - TotalThreadsSysTime: 36994000 - TotalThreadsUserTime: 748886000 - TotalThreadsVoluntaryContextSwitches: 1723 - TotalTime: 185232415572 Fragment Instance Lifecycle Timings - ExecTime: 17446960778 - ExecTreeExecTime: 16672241024 - InactiveTotalTime: 0 - OpenTime: 166494999295 - ExecTreeOpenTime: 165154100659 - PrepareTime: 1290358108 - ExecTreePrepareTime: 328360 - TotalTime: 0 DataStreamSender (dst_id=24) - BytesSent: 2925370 - InactiveTotalTime: 0 - NetworkThroughput(*): 627429911 - OverallThroughput: 52068610 - PeakMemoryUsage: 13216 - RowsReturned: 4643 - SerializeBatchTime: 51455546 - TotalTime: 56182986 - TransmitDataRPCTime: 4662465 - UncompressedRowBatchSize: 5394781 CodeGen - CodegenTime: 0 - CompileTime: 271640775 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076168 - NumFunctions: 54 - NumInstructions: 2406 - OptimizationTime: 1034850264 - PeakMemoryUsage: 1231872 - PrepareTime: 728924364 - TotalTime: 2070102421 HASH_JOIN_NODE (id=12) ExecOption: Probe Side Codegen Enabled - BuildRows: 4643 - BuildTime: 32039542 - InactiveTotalTime: 0 - LocalTime: 338968967 - NumHashTableBuildsSkipped: 0 - PeakMemoryUsage: 2155977 - ProbeRows: 833445 - ProbeRowsPartitioned: 0 - ProbeTime: 192787374 - RowsReturned: 4643 - RowsReturnedRate: 25 - TotalTime: 181826813883 Hash Join Builder (join_node_id=12) ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 2476529 - BuildRowsPartitioned: 4643 - GetNewBlockTime: 12404265 - HashBuckets: 8192 - HashCollisions: 0 - HashTablesBuildTime: 16765595 - InactiveTotalTime: 0 - LargestPartitionPercent: 6 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 2053248 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=23) - BytesReceived: 252005 - ConvertRowBatchTime: 1123910 - DeserializeRowBatchTimer: 47023790 - FirstBatchArrivalWaitTime: 164843667372 - InactiveTotalTime: 165118067527 - PeakMemoryUsage: 0 - RowsReturned: 4643 - RowsReturnedRate: 28 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 165120095659 EXCHANGE_NODE (id=22) - BytesReceived: 30519700 - ConvertRowBatchTime: 353110026 - DeserializeRowBatchTimer: 2448114420 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 15427203236 - PeakMemoryUsage: 0 - RowsReturned: 833445 - RowsReturnedRate: 50919 - SendersBlockedTimer: 129781979715 - SendersBlockedTotalTimer(*): 637289312111 - TotalTime: 16367749257 Instance 6c4f4a739317c843:d78929db0000002d (host=redacted-host1:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 22596373 - PerHostPeakMemUsage: 253001132 - RowsProduced: 4617 - TotalNetworkReceiveTime: 179541050566 - TotalNetworkSendTime: 467588645 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 614 - TotalThreadsTotalWallClockTime: 183394340410 - TotalThreadsSysTime: 89986000 - TotalThreadsUserTime: 805877000 - TotalThreadsVoluntaryContextSwitches: 1865 - TotalTime: 184135660861 Fragment Instance Lifecycle Timings - ExecTime: 17764463531 - ExecTreeExecTime: 16762178065 - InactiveTotalTime: 0 - OpenTime: 165629997957 - ExecTreeOpenTime: 163515386235 - PrepareTime: 741086218 - ExecTreePrepareTime: 144604507 - TotalTime: 0 DataStreamSender (dst_id=24) - BytesSent: 2910376 - InactiveTotalTime: 0 - NetworkThroughput(*): 185847824 - OverallThroughput: 36528052 - PeakMemoryUsage: 13216 - RowsReturned: 4617 - SerializeBatchTime: 63952053 - TotalTime: 79675093 - TransmitDataRPCTime: 15659995 - UncompressedRowBatchSize: 5371247 CodeGen - CodegenTime: 0 - CompileTime: 499110684 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076168 - NumFunctions: 54 - NumInstructions: 2406 - OptimizationTime: 1567255455 - PeakMemoryUsage: 1231872 - PrepareTime: 436446063 - TotalTime: 2503685134 HASH_JOIN_NODE (id=12) ExecOption: Probe Side Codegen Enabled - BuildRows: 4617 - BuildTime: 78030646 - InactiveTotalTime: 0 - LocalTime: 644043482 - NumHashTableBuildsSkipped: 0 - PeakMemoryUsage: 1828297 - ProbeRows: 834188 - ProbeRowsPartitioned: 0 - ProbeTime: 247020338 - RowsReturned: 4617 - RowsReturnedRate: 25 - TotalTime: 180564099858 Hash Join Builder (join_node_id=12) ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 8459291 - BuildRowsPartitioned: 4617 - GetNewBlockTime: 35359258 - HashBuckets: 8192 - HashCollisions: 0 - HashTablesBuildTime: 13922679 - InactiveTotalTime: 0 - LargestPartitionPercent: 6 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 1725568 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=23) - BytesReceived: 250138 - ConvertRowBatchTime: 1273846 - DeserializeRowBatchTimer: 152089689 - FirstBatchArrivalWaitTime: 163171884542 - InactiveTotalTime: 163401040046 - PeakMemoryUsage: 0 - RowsReturned: 4617 - RowsReturnedRate: 28 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 163431418707 EXCHANGE_NODE (id=22) - BytesReceived: 30545400 - ConvertRowBatchTime: 300353878 - DeserializeRowBatchTimer: 2578861830 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 15315254317 - PeakMemoryUsage: 0 - RowsReturned: 834188 - RowsReturnedRate: 50591 - SendersBlockedTimer: 129800228813 - SendersBlockedTotalTimer(*): 767139000871 - TotalTime: 16488637669 Instance 6c4f4a739317c843:d78929db0000002b (host=redacted-host8:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 21745170 - PerHostPeakMemUsage: 233139186 - RowsProduced: 4720 - TotalNetworkReceiveTime: 161997739271 - TotalNetworkSendTime: 641953252 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 435 - TotalThreadsTotalWallClockTime: 170324313465 - TotalThreadsSysTime: 36994000 - TotalThreadsUserTime: 822875000 - TotalThreadsVoluntaryContextSwitches: 2206 - TotalTime: 173039153300 Fragment Instance Lifecycle Timings - ExecTime: 17687737069 - ExecTreeExecTime: 16793908653 - InactiveTotalTime: 0 - OpenTime: 152636591405 - ExecTreeOpenTime: 145922431035 - PrepareTime: 2714742693 - ExecTreePrepareTime: 499838101 - TotalTime: 0 DataStreamSender (dst_id=24) - BytesSent: 2976911 - InactiveTotalTime: 0 - NetworkThroughput(*): 601548675 - OverallThroughput: 38062534 - PeakMemoryUsage: 13216 - RowsReturned: 4720 - SerializeBatchTime: 73177901 - TotalTime: 78211055 - TransmitDataRPCTime: 4948745 - UncompressedRowBatchSize: 5487944 CodeGen - CodegenTime: 0 - CompileTime: 1989833699 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076168 - NumFunctions: 54 - NumInstructions: 2406 - OptimizationTime: 4250759384 - PeakMemoryUsage: 1231872 - PrepareTime: 2009439917 - TotalTime: 8293385481 HASH_JOIN_NODE (id=12) ExecOption: Probe Side Codegen Enabled - BuildRows: 5660 - BuildTime: 50775344 - InactiveTotalTime: 0 - LocalTime: 1141502150 - NumHashTableBuildsSkipped: 0 - PeakMemoryUsage: 1959312 - ProbeRows: 832352 - ProbeRowsPartitioned: 0 - ProbeTime: 136911854 - RowsReturned: 4720 - RowsReturnedRate: 28 - TotalTime: 163546516239 Hash Join Builder (join_node_id=12) ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 33579558 - BuildRowsPartitioned: 5660 - GetNewBlockTime: 4376328 - HashBuckets: 8192 - HashCollisions: 0 - HashTablesBuildTime: 12468251 - InactiveTotalTime: 0 - LargestPartitionPercent: 6 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 1856640 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=23) - BytesReceived: 295107 - ConvertRowBatchTime: 1235739 - DeserializeRowBatchTimer: 34233661 - FirstBatchArrivalWaitTime: 145596309188 - InactiveTotalTime: 145859229496 - PeakMemoryUsage: 0 - RowsReturned: 5660 - RowsReturnedRate: 38 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 145869773223 EXCHANGE_NODE (id=22) - BytesReceived: 30478632 - ConvertRowBatchTime: 370217690 - DeserializeRowBatchTimer: 10091548395 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 15839434925 - PeakMemoryUsage: 0 - RowsReturned: 832352 - RowsReturnedRate: 50338 - SendersBlockedTimer: 129717288752 - SendersBlockedTotalTimer(*): 637209069395 - TotalTime: 16535240866 Averaged Fragment F01 split sizes: min: 32.91 MB, max: 66.68 MB, avg: 44.45 MB, stddev: 15.72 MB completion times: min:2m46s max:3m4s mean: 2m55s stddev:6s535ms execution rates: min:192.75 KB/sec max:372.79 KB/sec mean:256.36 KB/sec stddev:81.19 KB/sec num instances: 6 - AverageThreadTokens: 1.976915311953193 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 22345560 - PerHostPeakMemUsage: 233983507 - RowsProduced: 833333 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 156518299704 - TotalStorageWaitTime: 4802131025 - TotalThreadsInvoluntaryContextSwitches: 4614 - TotalThreadsTotalWallClockTime: 345860104526 - TotalThreadsSysTime: 97317833 - TotalThreadsUserTime: 3051036166 - TotalThreadsVoluntaryContextSwitches: 1565 - TotalTime: 175502458703 Fragment Instance Lifecycle Timings - ExecTime: 173985498024 - ExecTreeExecTime: 10916836266 - InactiveTotalTime: 0 - OpenTime: 333479334 - ExecTreeOpenTime: 156185 - PrepareTime: 1179096218 - ExecTreePrepareTime: 563970 - TotalTime: 0 DataStreamSender (dst_id=22) - BytesSent: 30512525 - InactiveTotalTime: 0 - NetworkThroughput(*): 165270706 - OverallThroughput: 13400595 - PeakMemoryUsage: 188064 - RowsReturned: 833333 - SerializeBatchTime: 2123639769 - TotalTime: 2308279348 - TransmitDataRPCTime: 183323966 - UncompressedRowBatchSize: 53801824 CodeGen - CodegenTime: 6462464 - CompileTime: 78661200 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076168 - NumFunctions: 5 - NumInstructions: 98 - OptimizationTime: 197543669 - PeakMemoryUsage: 50176 - PrepareTime: 812966603 - TotalTime: 1137610614 HDFS_SCAN_NODE (id=10) - AverageHdfsReadThreadConcurrency: 4.6425255338904364E-4 - AverageScannerThreadConcurrency: 0.9867079935183902 - BytesRead: 10648538 - BytesReadDataNodeCache: 0 - BytesReadLocal: 10648538 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 10648538 - DecompressionTime: 138453510 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 4 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 1 - NumRowGroups: 1 - NumScannerThreadsStarted: 1 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 22151612 - PerReadThreadRawHdfsThroughput: 489182566 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 9758085081 - RowBatchQueuePutWaitTime: 158066934019 - RowsRead: 833333 - RowsReturned: 833333 - RowsReturnedRate: 174463 - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 232 - ScannerThreadsTotalWallClockTime: 171541148038 - MaterializeTupleTime(*): 3050084142 - ScannerThreadsSysTime: 39993333 - ScannerThreadsUserTime: 862202166 - ScannerThreadsVoluntaryContextSwitches: 1019 - TotalRawHdfsReadTime(*): 26850170 - TotalReadThroughput: 61519 - TotalTime: 10910174776 Fragment F01 Instance 6c4f4a739317c843:d78929db00000001 (host=redacted-host7:22000) Hdfs split stats (:<# splits>/): 5:1/32.90 MB 2:1/33.78 MB - AverageThreadTokens: 1.975206611570248 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 23039150 - PerHostPeakMemUsage: 236515429 - RowsProduced: 1250000 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 162606837245 - TotalStorageWaitTime: 9719160747 - TotalThreadsInvoluntaryContextSwitches: 7206 - TotalThreadsTotalWallClockTime: 364381929936 - TotalThreadsSysTime: 91985000 - TotalThreadsUserTime: 4462321000 - TotalThreadsVoluntaryContextSwitches: 1821 - TotalTime: 184864030347 Fragment Instance Lifecycle Timings - ExecTime: 183488760773 - ExecTreeExecTime: 10769998049 - InactiveTotalTime: 0 - OpenTime: 265133707 - ExecTreeOpenTime: 223967 - PrepareTime: 1088131532 - ExecTreePrepareTime: 282902 - TotalTime: 0 DataStreamSender (dst_id=22) - BytesSent: 45530844 - InactiveTotalTime: 0 - NetworkThroughput(*): 169282208 - OverallThroughput: 13681146 - PeakMemoryUsage: 188064 - RowsReturned: 1250000 - SerializeBatchTime: 3057314629 - TotalTime: 3327999034 - TransmitDataRPCTime: 268964143 - UncompressedRowBatchSize: 80707107 CodeGen - CodegenTime: 5541106 - CompileTime: 55730235 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076168 - NumFunctions: 5 - NumInstructions: 98 - OptimizationTime: 206352777 - PeakMemoryUsage: 50176 - PrepareTime: 877932949 - TotalTime: 1141145324 HDFS_SCAN_NODE (id=10) Hdfs split stats (:<# splits>/): 5:1/32.90 MB 2:1/33.78 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 2 out of 2 Hdfs Read Thread Concurrency Bucket: 0:99.72% 1:0.2786% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:8 - AverageHdfsReadThreadConcurrency: 0.002785515320334262 - AverageScannerThreadConcurrency: 0.9860724233983287 - BytesRead: 15972767 - BytesReadDataNodeCache: 0 - BytesReadLocal: 15972767 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 15972767 - DecompressionTime: 124388690 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 4 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 2 - NumRowGroups: 2 - NumScannerThreadsStarted: 1 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 22850663 - PerReadThreadRawHdfsThroughput: 329535079 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 9323918300 - RowBatchQueuePutWaitTime: 164871305133 - RowsRead: 1250000 - RowsReturned: 1250000 - RowsReturnedRate: 116108 - ScanRangesComplete: 2 - ScannerThreadsInvoluntaryContextSwitches: 546 - ScannerThreadsTotalWallClockTime: 180628066904 - MaterializeTupleTime(*): 3910409133 - ScannerThreadsSysTime: 33994000 - ScannerThreadsUserTime: 1258808000 - ScannerThreadsVoluntaryContextSwitches: 1159 - TotalRawHdfsReadTime(*): 48470612 - TotalReadThroughput: 88222 - TotalTime: 10765805873 Instance 6c4f4a739317c843:d78929db00000004 (host=redacted-host2:22000) Hdfs split stats (:<# splits>/): 0:1/33.77 MB 1:1/32.90 MB - AverageThreadTokens: 1.9834254143646408 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 23047342 - PerHostPeakMemUsage: 230260997 - RowsProduced: 1249999 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 170037642368 - TotalStorageWaitTime: 484529649 - TotalThreadsInvoluntaryContextSwitches: 7342 - TotalThreadsTotalWallClockTime: 361763365578 - TotalThreadsSysTime: 102984000 - TotalThreadsUserTime: 4456323000 - TotalThreadsVoluntaryContextSwitches: 2023 - TotalTime: 183007084012 Fragment Instance Lifecycle Timings - ExecTime: 181804758822 - ExecTreeExecTime: 2205127437 - InactiveTotalTime: 0 - OpenTime: 256660917 - ExecTreeOpenTime: 139675 - PrepareTime: 945555923 - ExecTreePrepareTime: 1522991 - TotalTime: 0 DataStreamSender (dst_id=22) - BytesSent: 45750777 - InactiveTotalTime: 0 - NetworkThroughput(*): 173098939 - OverallThroughput: 13054154 - PeakMemoryUsage: 188064 - RowsReturned: 1249999 - SerializeBatchTime: 3238113234 - TotalTime: 3504691053 - TransmitDataRPCTime: 264304201 - UncompressedRowBatchSize: 80701624 CodeGen - CodegenTime: 24269740 - CompileTime: 29239199 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076168 - NumFunctions: 5 - NumInstructions: 98 - OptimizationTime: 64740340 - PeakMemoryUsage: 50176 - PrepareTime: 853733929 - TotalTime: 965906656 HDFS_SCAN_NODE (id=10) Hdfs split stats (:<# splits>/): 0:1/33.77 MB 1:1/32.90 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 2 out of 2 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:8 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.9888888888888889 - BytesRead: 15972798 - BytesReadDataNodeCache: 0 - BytesReadLocal: 15972798 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 15972798 - DecompressionTime: 246861685 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 4 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 2 - NumRowGroups: 2 - NumScannerThreadsStarted: 1 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 22850663 - PerReadThreadRawHdfsThroughput: 589405315 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 845234853 - RowBatchQueuePutWaitTime: 174115698186 - RowsRead: 1249999 - RowsReturned: 1249999 - RowsReturnedRate: 567343 - ScanRangesComplete: 2 - ScannerThreadsInvoluntaryContextSwitches: 299 - ScannerThreadsTotalWallClockTime: 179701963883 - MaterializeTupleTime(*): 4135011173 - ScannerThreadsSysTime: 37994000 - ScannerThreadsUserTime: 1256809000 - ScannerThreadsVoluntaryContextSwitches: 1456 - TotalRawHdfsReadTime(*): 27099854 - TotalReadThroughput: 88226 - TotalTime: 2203247106 Instance 6c4f4a739317c843:d78929db00000002 (host=redacted-host6:22000) Hdfs split stats (:<# splits>/): 9:1/32.91 MB - AverageThreadTokens: 1.976608187134503 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 20950190 - PerHostPeakMemUsage: 225294975 - RowsProduced: 616667 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 160022323412 - TotalStorageWaitTime: 4204662259 - TotalThreadsInvoluntaryContextSwitches: 3123 - TotalThreadsTotalWallClockTime: 344522730051 - TotalThreadsSysTime: 151976000 - TotalThreadsUserTime: 2462626000 - TotalThreadsVoluntaryContextSwitches: 1898 - TotalTime: 174374709183 Fragment Instance Lifecycle Timings - ExecTime: 173526906101 - ExecTreeExecTime: 8519432144 - InactiveTotalTime: 0 - OpenTime: 210016445 - ExecTreeOpenTime: 132780 - PrepareTime: 633902449 - ExecTreePrepareTime: 466573 - TotalTime: 0 DataStreamSender (dst_id=22) - BytesSent: 22586666 - InactiveTotalTime: 0 - NetworkThroughput(*): 149239682 - OverallThroughput: 10665135 - PeakMemoryUsage: 188064 - RowsReturned: 616667 - SerializeBatchTime: 1965353718 - TotalTime: 2117803998 - TransmitDataRPCTime: 151344908 - UncompressedRowBatchSize: 39813010 CodeGen - CodegenTime: 797483 - CompileTime: 8510164 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076168 - NumFunctions: 5 - NumInstructions: 98 - OptimizationTime: 198245773 - PeakMemoryUsage: 50176 - PrepareTime: 335329152 - TotalTime: 543455810 HDFS_SCAN_NODE (id=10) Hdfs split stats (:<# splits>/): 9:1/32.91 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:4 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.9852507374631269 - BytesRead: 7884069 - BytesReadDataNodeCache: 0 - BytesReadLocal: 7884069 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 7884069 - DecompressionTime: 223227411 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 4 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 1 - NumRowGroups: 1 - NumScannerThreadsStarted: 1 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 20753511 - PerReadThreadRawHdfsThroughput: 242117366 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 6780362472 - RowBatchQueuePutWaitTime: 159845043912 - RowsRead: 616667 - RowsReturned: 616667 - RowsReturnedRate: 72584 - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 141 - ScannerThreadsTotalWallClockTime: 170785825167 - MaterializeTupleTime(*): 3829063714 - ScannerThreadsSysTime: 78987000 - ScannerThreadsUserTime: 705893000 - ScannerThreadsVoluntaryContextSwitches: 1175 - TotalRawHdfsReadTime(*): 32563005 - TotalReadThroughput: 46218 - TotalTime: 8495896777 Instance 6c4f4a739317c843:d78929db00000006 (host=redacted-host3:22000) Hdfs split stats (:<# splits>/): 2:1/33.78 MB - AverageThreadTokens: 1.9794721407624634 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 23039150 - PerHostPeakMemUsage: 225689324 - RowsProduced: 633333 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 163416944100 - TotalStorageWaitTime: 2557824577 - TotalThreadsInvoluntaryContextSwitches: 2840 - TotalThreadsTotalWallClockTime: 343677408430 - TotalThreadsSysTime: 72988000 - TotalThreadsUserTime: 2309648000 - TotalThreadsVoluntaryContextSwitches: 1389 - TotalTime: 174361219326 Fragment Instance Lifecycle Timings - ExecTime: 172950002574 - ExecTreeExecTime: 5126114922 - InactiveTotalTime: 0 - OpenTime: 197962154 - ExecTreeOpenTime: 127749 - PrepareTime: 1213170460 - ExecTreePrepareTime: 724334 - TotalTime: 0 DataStreamSender (dst_id=22) - BytesSent: 23176532 - InactiveTotalTime: 0 - NetworkThroughput(*): 168727911 - OverallThroughput: 15460520 - PeakMemoryUsage: 188064 - RowsReturned: 633333 - SerializeBatchTime: 1360758337 - TotalTime: 1499078348 - TransmitDataRPCTime: 137360392 - UncompressedRowBatchSize: 40889759 CodeGen - CodegenTime: 711430 - CompileTime: 63366734 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076168 - NumFunctions: 5 - NumInstructions: 98 - OptimizationTime: 87297917 - PeakMemoryUsage: 50176 - PrepareTime: 1008042911 - TotalTime: 1159629764 HDFS_SCAN_NODE (id=10) Hdfs split stats (:<# splits>/): 2:1/33.78 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:4 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.9881656804733728 - BytesRead: 8088862 - BytesReadDataNodeCache: 0 - BytesReadLocal: 8088862 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 8088862 - DecompressionTime: 48657896 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 4 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 1 - NumRowGroups: 1 - NumScannerThreadsStarted: 1 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 22850663 - PerReadThreadRawHdfsThroughput: 367728548 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 4550429034 - RowBatchQueuePutWaitTime: 163329548830 - RowsRead: 633333 - RowsReturned: 633333 - RowsReturnedRate: 123580 - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 54 - ScannerThreadsTotalWallClockTime: 170529462121 - MaterializeTupleTime(*): 2519794958 - ScannerThreadsSysTime: 27995000 - ScannerThreadsUserTime: 660899000 - ScannerThreadsVoluntaryContextSwitches: 883 - TotalRawHdfsReadTime(*): 21996829 - TotalReadThroughput: 47425 - TotalTime: 5124867743 Instance 6c4f4a739317c843:d78929db00000005 (host=redacted-host1:22000) Hdfs split stats (:<# splits>/): 1:1/32.91 MB - AverageThreadTokens: 1.9820359281437125 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 20950190 - PerHostPeakMemUsage: 253001132 - RowsProduced: 616666 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 161469577298 - TotalStorageWaitTime: 2720970660 - TotalThreadsInvoluntaryContextSwitches: 2867 - TotalThreadsTotalWallClockTime: 337953492542 - TotalThreadsSysTime: 95985000 - TotalThreadsUserTime: 2319647000 - TotalThreadsVoluntaryContextSwitches: 1283 - TotalTime: 170772104669 Fragment Instance Lifecycle Timings - ExecTime: 170096189407 - ExecTreeExecTime: 4144021804 - InactiveTotalTime: 0 - OpenTime: 179397001 - ExecTreeOpenTime: 141544 - PrepareTime: 496387432 - ExecTreePrepareTime: 214388 - TotalTime: 0 DataStreamSender (dst_id=22) - BytesSent: 22510012 - InactiveTotalTime: 0 - NetworkThroughput(*): 160585923 - OverallThroughput: 15421671 - PeakMemoryUsage: 188064 - RowsReturned: 616666 - SerializeBatchTime: 1318491901 - TotalTime: 1459634989 - TransmitDataRPCTime: 140174254 - UncompressedRowBatchSize: 39811680 CodeGen - CodegenTime: 6440672 - CompileTime: 10721635 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076168 - NumFunctions: 5 - NumInstructions: 98 - OptimizationTime: 142691666 - PeakMemoryUsage: 50176 - PrepareTime: 306995742 - TotalTime: 484936055 HDFS_SCAN_NODE (id=10) Hdfs split stats (:<# splits>/): 1:1/32.91 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:4 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.984984984984985 - BytesRead: 7884146 - BytesReadDataNodeCache: 0 - BytesReadLocal: 7884146 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 7884146 - DecompressionTime: 67490786 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 4 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 1 - NumRowGroups: 1 - NumScannerThreadsStarted: 1 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 20753511 - PerReadThreadRawHdfsThroughput: 336818540 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 3690886034 - RowBatchQueuePutWaitTime: 161507672530 - RowsRead: 616666 - RowsReturned: 616666 - RowsReturnedRate: 148933 - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 123 - ScannerThreadsTotalWallClockTime: 167677924264 - MaterializeTupleTime(*): 2258614227 - ScannerThreadsSysTime: 47992000 - ScannerThreadsUserTime: 656900000 - ScannerThreadsVoluntaryContextSwitches: 781 - TotalRawHdfsReadTime(*): 23407696 - TotalReadThroughput: 47194 - TotalTime: 4140552536 Instance 6c4f4a739317c843:d78929db00000003 (host=redacted-host8:22000) Hdfs split stats (:<# splits>/): 1:1/33.78 MB - AverageThreadTokens: 1.9647435897435896 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 23047342 - PerHostPeakMemUsage: 233139186 - RowsProduced: 633335 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 121556473804 - TotalStorageWaitTime: 9125638262 - TotalThreadsInvoluntaryContextSwitches: 4306 - TotalThreadsTotalWallClockTime: 322861700623 - TotalThreadsSysTime: 67989000 - TotalThreadsUserTime: 2295652000 - TotalThreadsVoluntaryContextSwitches: 979 - TotalTime: 165635604684 Fragment Instance Lifecycle Timings - ExecTime: 162046370469 - ExecTreeExecTime: 34736323242 - InactiveTotalTime: 0 - OpenTime: 891705780 - ExecTreeOpenTime: 171400 - PrepareTime: 2697429514 - ExecTreePrepareTime: 172635 - TotalTime: 0 DataStreamSender (dst_id=22) - BytesSent: 23520323 - InactiveTotalTime: 0 - NetworkThroughput(*): 170689573 - OverallThroughput: 12120949 - PeakMemoryUsage: 188064 - RowsReturned: 633335 - SerializeBatchTime: 1801806797 - TotalTime: 1940468670 - TransmitDataRPCTime: 137795898 - UncompressedRowBatchSize: 40887769 CodeGen - CodegenTime: 1014356 - CompileTime: 304399237 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076168 - NumFunctions: 5 - NumInstructions: 98 - OptimizationTime: 485933545 - PeakMemoryUsage: 50176 - PrepareTime: 1495764938 - TotalTime: 2530590075 HDFS_SCAN_NODE (id=10) Hdfs split stats (:<# splits>/): 1:1/33.78 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:4 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.9868852459016394 - BytesRead: 8088587 - BytesReadDataNodeCache: 0 - BytesReadLocal: 8088587 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 8088587 - DecompressionTime: 120094593 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 4 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 1 - NumRowGroups: 1 - NumScannerThreadsStarted: 1 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 22850663 - PerReadThreadRawHdfsThroughput: 1069490553 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 33357679795 - RowBatchQueuePutWaitTime: 124732335524 - RowsRead: 633335 - RowsReturned: 633335 - RowsReturnedRate: 18235 - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 230 - ScannerThreadsTotalWallClockTime: 159923645891 - MaterializeTupleTime(*): 1647611649 - ScannerThreadsSysTime: 12998000 - ScannerThreadsUserTime: 633904000 - ScannerThreadsVoluntaryContextSwitches: 664 - TotalRawHdfsReadTime(*): 7563028 - TotalReadThroughput: 51834 - TotalTime: 34730678621 Averaged Fragment F08 split sizes: min: 0, max: 0, avg: 0, stddev: 0 completion times: min:2m35s max:2m50s mean: 2m47s stddev:4s603ms execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec num instances: 8 - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 2990333 - PerHostPeakMemUsage: 223060690 - RowsProduced: 3617 - TotalNetworkReceiveTime: 163661869093 - TotalNetworkSendTime: 86633426 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 149 - TotalThreadsTotalWallClockTime: 165609395257 - TotalThreadsSysTime: 10498625 - TotalThreadsUserTime: 213842500 - TotalThreadsVoluntaryContextSwitches: 252 - TotalTime: 167176241581 Fragment Instance Lifecycle Timings - ExecTime: 229389870 - ExecTreeExecTime: 72028304 - InactiveTotalTime: 0 - OpenTime: 165380033448 - ExecTreeOpenTime: 163720090881 - PrepareTime: 1559177514 - ExecTreePrepareTime: 448293705 - TotalTime: 0 DataStreamSender (dst_id=23) - BytesSent: 194516 - InactiveTotalTime: 0 - NetworkThroughput(*): 145396037 - OverallThroughput: 23098535 - PeakMemoryUsage: 178816 - RowsReturned: 3617 - SerializeBatchTime: 8592245 - TotalTime: 31373630 - TransmitDataRPCTime: 1345882 - UncompressedRowBatchSize: 368002 CodeGen - CodegenTime: 118118887 - CompileTime: 413023672 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076168 - NumFunctions: 54 - NumInstructions: 1085 - OptimizationTime: 1119110937 - PeakMemoryUsage: 555520 - PrepareTime: 931208666 - TotalTime: 2511585517 AGGREGATION_NODE (id=21) - BuildTime: 35976111 - GetNewBlockTime: 320194322 - GetResultsTime: 4678540 - HTResizeTime: 18365430 - HashBuckets: 32768 - InactiveTotalTime: 0 - LargestPartitionPercent: 6 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 2790614 - PinTime: 0 - RowsRepartitioned: 0 - RowsReturned: 3617 - RowsReturnedRate: 21 - SpilledPartitions: 0 - TotalTime: 164240340899 - UnpinTime: 4108 EXCHANGE_NODE (id=20) - BytesReceived: 195005 - ConvertRowBatchTime: 1007186 - DeserializeRowBatchTimer: 122363677 - FirstBatchArrivalWaitTime: 162909190093 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 3617 - RowsReturnedRate: 21 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 163663238866 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 140 - BlocksRecycled: 4 - BufferedPins: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 209715200 - PeakMemoryUsage: 143479312 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 - ScratchWrites: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 Fragment F08 Instance 6c4f4a739317c843:d78929db00000022 (host=redacted-host4:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 2985216 - PerHostPeakMemUsage: 188649285 - RowsProduced: 3532 - TotalNetworkReceiveTime: 168465499183 - TotalNetworkSendTime: 73496804 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 116 - TotalThreadsTotalWallClockTime: 169423143749 - TotalThreadsSysTime: 7999000 - TotalThreadsUserTime: 198970000 - TotalThreadsVoluntaryContextSwitches: 164 - TotalTime: 169904603615 Fragment Instance Lifecycle Timings - ExecTime: 205619200 - ExecTreeExecTime: 103569440 - InactiveTotalTime: 0 - OpenTime: 169217546903 - ExecTreeOpenTime: 168493164780 - PrepareTime: 464144594 - ExecTreePrepareTime: 123987120 - TotalTime: 0 DataStreamSender (dst_id=23) - BytesSent: 189915 - InactiveTotalTime: 0 - NetworkThroughput(*): 147209632 - OverallThroughput: 34632082 - PeakMemoryUsage: 164480 - RowsReturned: 3532 - SerializeBatchTime: 4111923 - TotalTime: 5483788 - TransmitDataRPCTime: 1290099 - UncompressedRowBatchSize: 359153 CodeGen - CodegenTime: 182943952 - CompileTime: 212365282 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076168 - NumFunctions: 54 - NumInstructions: 1085 - OptimizationTime: 484317096 - PeakMemoryUsage: 555520 - PrepareTime: 124903231 - TotalTime: 831979676 AGGREGATION_NODE (id=21) ExecOption: Codegen Enabled - BuildTime: 12118807 - GetNewBlockTime: 106751033 - GetResultsTime: 13048205 - HTResizeTime: 1748536 - HashBuckets: 32768 - InactiveTotalTime: 0 - LargestPartitionPercent: 6 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 2789228 - PinTime: 0 - RowsRepartitioned: 0 - RowsReturned: 3532 - RowsReturnedRate: 20 - SpilledPartitions: 0 - TotalTime: 168720647401 - UnpinTime: 4230 EXCHANGE_NODE (id=20) - BytesReceived: 190750 - ConvertRowBatchTime: 843680 - DeserializeRowBatchTimer: 13092943 - FirstBatchArrivalWaitTime: 167649429435 - InactiveTotalTime: 168465235608 - PeakMemoryUsage: 0 - RowsReturned: 3532 - RowsReturnedRate: 20 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 168466699087 Instance 6c4f4a739317c843:d78929db00000024 (host=redacted-host3:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 2985216 - PerHostPeakMemUsage: 225689324 - RowsProduced: 3622 - TotalNetworkReceiveTime: 167330626298 - TotalNetworkSendTime: 69063915 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 119 - TotalThreadsTotalWallClockTime: 168567529554 - TotalThreadsSysTime: 8999000 - TotalThreadsUserTime: 210968000 - TotalThreadsVoluntaryContextSwitches: 218 - TotalTime: 169895228010 Fragment Instance Lifecycle Timings - ExecTime: 396076951 - ExecTreeExecTime: 197279171 - InactiveTotalTime: 0 - OpenTime: 168171467515 - ExecTreeOpenTime: 167355439277 - PrepareTime: 1317327023 - ExecTreePrepareTime: 299697035 - TotalTime: 0 DataStreamSender (dst_id=23) - BytesSent: 194626 - InactiveTotalTime: 0 - NetworkThroughput(*): 154873527 - OverallThroughput: 2525097 - PeakMemoryUsage: 180864 - RowsReturned: 3622 - SerializeBatchTime: 33922661 - TotalTime: 77076627 - TransmitDataRPCTime: 1256677 - UncompressedRowBatchSize: 368204 CodeGen - CodegenTime: 9944429 - CompileTime: 153490250 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076168 - NumFunctions: 54 - NumInstructions: 1085 - OptimizationTime: 629846574 - PeakMemoryUsage: 555520 - PrepareTime: 530580427 - TotalTime: 1330327156 AGGREGATION_NODE (id=21) ExecOption: Codegen Enabled - BuildTime: 11499714 - GetNewBlockTime: 287096816 - GetResultsTime: 4858965 - HTResizeTime: 3936395 - HashBuckets: 32768 - InactiveTotalTime: 0 - LargestPartitionPercent: 6 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 2790764 - PinTime: 0 - RowsRepartitioned: 0 - RowsReturned: 3622 - RowsReturnedRate: 21 - SpilledPartitions: 0 - TotalTime: 167852346362 - UnpinTime: 5429 EXCHANGE_NODE (id=20) - BytesReceived: 194929 - ConvertRowBatchTime: 854922 - DeserializeRowBatchTimer: 90638213 - FirstBatchArrivalWaitTime: 166505921657 - InactiveTotalTime: 167330225199 - PeakMemoryUsage: 0 - RowsReturned: 3622 - RowsReturnedRate: 21 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 167331845318 Instance 6c4f4a739317c843:d78929db00000026 (host=redacted-host2:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 2985216 - PerHostPeakMemUsage: 230260997 - RowsProduced: 3585 - TotalNetworkReceiveTime: 166949342574 - TotalNetworkSendTime: 153157732 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 98 - TotalThreadsTotalWallClockTime: 168024214677 - TotalThreadsSysTime: 11998000 - TotalThreadsUserTime: 184972000 - TotalThreadsVoluntaryContextSwitches: 163 - TotalTime: 169804475396 Fragment Instance Lifecycle Timings - ExecTime: 219791088 - ExecTreeExecTime: 12861673 - InactiveTotalTime: 0 - OpenTime: 167804437520 - ExecTreeOpenTime: 167035031129 - PrepareTime: 1780143529 - ExecTreePrepareTime: 727423142 - TotalTime: 0 DataStreamSender (dst_id=23) - BytesSent: 193095 - InactiveTotalTime: 0 - NetworkThroughput(*): 151703944 - OverallThroughput: 29013125 - PeakMemoryUsage: 180864 - RowsReturned: 3585 - SerializeBatchTime: 5216632 - TotalTime: 6655436 - TransmitDataRPCTime: 1272841 - UncompressedRowBatchSize: 364829 CodeGen - CodegenTime: 61380129 - CompileTime: 278364823 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076168 - NumFunctions: 54 - NumInstructions: 1085 - OptimizationTime: 480524791 - PeakMemoryUsage: 555520 - PrepareTime: 888558477 - TotalTime: 1661616325 AGGREGATION_NODE (id=21) ExecOption: Codegen Enabled - BuildTime: 6601145 - GetNewBlockTime: 679638490 - GetResultsTime: 2123667 - HTResizeTime: 737791 - HashBuckets: 32768 - InactiveTotalTime: 0 - LargestPartitionPercent: 6 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 2790807 - PinTime: 0 - RowsRepartitioned: 0 - RowsReturned: 3585 - RowsReturnedRate: 21 - SpilledPartitions: 0 - TotalTime: 167775254623 - UnpinTime: 5100 EXCHANGE_NODE (id=20) - BytesReceived: 193819 - ConvertRowBatchTime: 784156 - DeserializeRowBatchTimer: 53363538 - FirstBatchArrivalWaitTime: 166116825928 - InactiveTotalTime: 166948856711 - PeakMemoryUsage: 0 - RowsReturned: 3585 - RowsReturnedRate: 21 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 166950448431 Instance 6c4f4a739317c843:d78929db00000025 (host=redacted-host6:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 2985216 - PerHostPeakMemUsage: 225294975 - RowsProduced: 3755 - TotalNetworkReceiveTime: 167223239078 - TotalNetworkSendTime: 93226781 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 151 - TotalThreadsTotalWallClockTime: 168693075087 - TotalThreadsSysTime: 7999000 - TotalThreadsUserTime: 211968000 - TotalThreadsVoluntaryContextSwitches: 212 - TotalTime: 169543372303 Fragment Instance Lifecycle Timings - ExecTime: 182521373 - ExecTreeExecTime: 10697105 - InactiveTotalTime: 0 - OpenTime: 168510572187 - ExecTreeOpenTime: 167242394468 - PrepareTime: 850130509 - ExecTreePrepareTime: 297622173 - TotalTime: 0 DataStreamSender (dst_id=23) - BytesSent: 202475 - InactiveTotalTime: 0 - NetworkThroughput(*): 150783089 - OverallThroughput: 29536666 - PeakMemoryUsage: 180864 - RowsReturned: 3755 - SerializeBatchTime: 5438106 - TotalTime: 6855039 - TransmitDataRPCTime: 1342823 - UncompressedRowBatchSize: 382039 CodeGen - CodegenTime: 37703551 - CompileTime: 85335298 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076168 - NumFunctions: 54 - NumInstructions: 1085 - OptimizationTime: 1140146086 - PeakMemoryUsage: 555520 - PrepareTime: 445697639 - TotalTime: 1683942785 AGGREGATION_NODE (id=21) ExecOption: Codegen Enabled - BuildTime: 15050665 - GetNewBlockTime: 220465474 - GetResultsTime: 2560246 - HTResizeTime: 6097823 - HashBuckets: 32768 - InactiveTotalTime: 0 - LargestPartitionPercent: 7 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 2790810 - PinTime: 0 - RowsRepartitioned: 0 - RowsReturned: 3755 - RowsReturnedRate: 22 - SpilledPartitions: 0 - TotalTime: 167550648252 - UnpinTime: 3886 EXCHANGE_NODE (id=20) - BytesReceived: 202351 - ConvertRowBatchTime: 899554 - DeserializeRowBatchTimer: 39335720 - FirstBatchArrivalWaitTime: 166395649340 - InactiveTotalTime: 167222966526 - PeakMemoryUsage: 0 - RowsReturned: 3755 - RowsReturnedRate: 22 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 167224481683 Instance 6c4f4a739317c843:d78929db00000028 (host=redacted-host5:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 2985216 - PerHostPeakMemUsage: 191935198 - RowsProduced: 3636 - TotalNetworkReceiveTime: 167458467244 - TotalNetworkSendTime: 97451826 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 176 - TotalThreadsTotalWallClockTime: 168394902708 - TotalThreadsSysTime: 10999000 - TotalThreadsUserTime: 203969000 - TotalThreadsVoluntaryContextSwitches: 177 - TotalTime: 169253875530 Fragment Instance Lifecycle Timings - ExecTime: 195051414 - ExecTreeExecTime: 19724467 - InactiveTotalTime: 0 - OpenTime: 168199867031 - ExecTreeOpenTime: 167489447457 - PrepareTime: 858844728 - ExecTreePrepareTime: 288120737 - TotalTime: 0 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 140 - BlocksRecycled: 4 - BufferedPins: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 209715200 - PeakMemoryUsage: 143479312 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 - ScratchWrites: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 DataStreamSender (dst_id=23) - BytesSent: 195444 - InactiveTotalTime: 0 - NetworkThroughput(*): 144545807 - OverallThroughput: 31191275 - PeakMemoryUsage: 180864 - RowsReturned: 3636 - SerializeBatchTime: 4833758 - TotalTime: 6265983 - TransmitDataRPCTime: 1352125 - UncompressedRowBatchSize: 370077 CodeGen - CodegenTime: 19673447 - CompileTime: 188043401 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076168 - NumFunctions: 54 - NumInstructions: 1085 - OptimizationTime: 497333170 - PeakMemoryUsage: 555520 - PrepareTime: 457636609 - TotalTime: 1188080576 AGGREGATION_NODE (id=21) ExecOption: Codegen Enabled - BuildTime: 25851906 - GetNewBlockTime: 223785424 - GetResultsTime: 5299220 - HTResizeTime: 3339340 - HashBuckets: 32768 - InactiveTotalTime: 0 - LargestPartitionPercent: 6 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 2790808 - PinTime: 0 - RowsRepartitioned: 0 - RowsReturned: 3636 - RowsReturnedRate: 21 - SpilledPartitions: 0 - TotalTime: 167797224806 - UnpinTime: 3561 EXCHANGE_NODE (id=20) - BytesReceived: 195821 - ConvertRowBatchTime: 863232 - DeserializeRowBatchTimer: 46347668 - FirstBatchArrivalWaitTime: 166584256048 - InactiveTotalTime: 167458064797 - PeakMemoryUsage: 0 - RowsReturned: 3636 - RowsReturnedRate: 21 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 167459693172 Instance 6c4f4a739317c843:d78929db00000021 (host=redacted-host7:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 2985216 - PerHostPeakMemUsage: 236515429 - RowsProduced: 3711 - TotalNetworkReceiveTime: 165000553874 - TotalNetworkSendTime: 71548162 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 130 - TotalThreadsTotalWallClockTime: 166286807320 - TotalThreadsSysTime: 6999000 - TotalThreadsUserTime: 209968000 - TotalThreadsVoluntaryContextSwitches: 207 - TotalTime: 167503211565 Fragment Instance Lifecycle Timings - ExecTime: 150314174 - ExecTreeExecTime: 65643374 - InactiveTotalTime: 0 - OpenTime: 166136514389 - ExecTreeOpenTime: 165047780590 - PrepareTime: 1216272432 - ExecTreePrepareTime: 153535813 - TotalTime: 0 DataStreamSender (dst_id=23) - BytesSent: 199448 - InactiveTotalTime: 0 - NetworkThroughput(*): 143919424 - OverallThroughput: 34909079 - PeakMemoryUsage: 180864 - RowsReturned: 3711 - SerializeBatchTime: 4255869 - TotalTime: 5713356 - TransmitDataRPCTime: 1385831 - UncompressedRowBatchSize: 377358 CodeGen - CodegenTime: 321282506 - CompileTime: 211776110 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076168 - NumFunctions: 54 - NumInstructions: 1085 - OptimizationTime: 864109176 - PeakMemoryUsage: 555520 - PrepareTime: 784194029 - TotalTime: 1899852219 AGGREGATION_NODE (id=21) ExecOption: Codegen Enabled - BuildTime: 38819696 - GetNewBlockTime: 109239345 - GetResultsTime: 3277315 - HTResizeTime: 1892324 - HashBuckets: 32768 - InactiveTotalTime: 0 - LargestPartitionPercent: 6 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 2790698 - PinTime: 0 - RowsRepartitioned: 0 - RowsReturned: 3711 - RowsReturnedRate: 22 - SpilledPartitions: 0 - TotalTime: 165266896039 - UnpinTime: 4304 EXCHANGE_NODE (id=20) - BytesReceived: 199718 - ConvertRowBatchTime: 848528 - DeserializeRowBatchTimer: 3808770 - FirstBatchArrivalWaitTime: 164198819163 - InactiveTotalTime: 165000243579 - PeakMemoryUsage: 0 - RowsReturned: 3711 - RowsReturnedRate: 22 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 165001742615 Instance 6c4f4a739317c843:d78929db00000023 (host=redacted-host1:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 3026157 - PerHostPeakMemUsage: 253001132 - RowsProduced: 3575 - TotalNetworkReceiveTime: 164056539273 - TotalNetworkSendTime: 22382819 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 202 - TotalThreadsTotalWallClockTime: 165393955704 - TotalThreadsSysTime: 21997000 - TotalThreadsUserTime: 222966000 - TotalThreadsVoluntaryContextSwitches: 220 - TotalTime: 166259692931 Fragment Instance Lifecycle Timings - ExecTime: 278569228 - ExecTreeExecTime: 152933821 - InactiveTotalTime: 0 - OpenTime: 165115486236 - ExecTreeOpenTime: 164244390021 - PrepareTime: 852073365 - ExecTreePrepareTime: 287298410 - TotalTime: 0 DataStreamSender (dst_id=23) - BytesSent: 192068 - InactiveTotalTime: 0 - NetworkThroughput(*): 118685186 - OverallThroughput: 21570412 - PeakMemoryUsage: 180864 - RowsReturned: 3575 - SerializeBatchTime: 6799746 - TotalTime: 8904234 - TransmitDataRPCTime: 1618298 - UncompressedRowBatchSize: 363883 CodeGen - CodegenTime: 26052674 - CompileTime: 242207620 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076168 - NumFunctions: 54 - NumInstructions: 1085 - OptimizationTime: 625522455 - PeakMemoryUsage: 555520 - PrepareTime: 371630043 - TotalTime: 1240336308 AGGREGATION_NODE (id=21) ExecOption: Codegen Enabled - BuildTime: 145425473 - GetNewBlockTime: 112931143 - GetResultsTime: 3183984 - HTResizeTime: 102344513 - HashBuckets: 32768 - InactiveTotalTime: 0 - LargestPartitionPercent: 6 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 2790929 - PinTime: 0 - RowsRepartitioned: 0 - RowsReturned: 3575 - RowsReturnedRate: 21 - SpilledPartitions: 0 - TotalTime: 164684512080 - UnpinTime: 3062 EXCHANGE_NODE (id=20) - BytesReceived: 192701 - ConvertRowBatchTime: 2178937 - DeserializeRowBatchTimer: 661902708 - FirstBatchArrivalWaitTime: 163855326816 - InactiveTotalTime: 163940812962 - PeakMemoryUsage: 0 - RowsReturned: 3575 - RowsReturnedRate: 21 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 164059226621 Instance 6c4f4a739317c843:d78929db00000027 (host=redacted-host8:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 2985216 - PerHostPeakMemUsage: 233139186 - RowsProduced: 3523 - TotalNetworkReceiveTime: 142810685227 - TotalNetworkSendTime: 112739372 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 204 - TotalThreadsTotalWallClockTime: 150091533264 - TotalThreadsSysTime: 6999000 - TotalThreadsUserTime: 266959000 - TotalThreadsVoluntaryContextSwitches: 662 - TotalTime: 155245473298 Fragment Instance Lifecycle Timings - ExecTime: 207175539 - ExecTreeExecTime: 13517388 - InactiveTotalTime: 0 - OpenTime: 149884375807 - ExecTreeOpenTime: 142853079333 - PrepareTime: 5134483939 - ExecTreePrepareTime: 1408665210 - TotalTime: 0 DataStreamSender (dst_id=23) - BytesSent: 189062 - InactiveTotalTime: 0 - NetworkThroughput(*): 151447693 - OverallThroughput: 1410546 - PeakMemoryUsage: 180864 - RowsReturned: 3523 - SerializeBatchTime: 4159267 - TotalTime: 134034579 - TransmitDataRPCTime: 1248365 - UncompressedRowBatchSize: 358474 CodeGen - CodegenTime: 285970414 - CompileTime: 1932606597 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076168 - NumFunctions: 54 - NumInstructions: 1085 - OptimizationTime: 4231088148 - PeakMemoryUsage: 555520 - PrepareTime: 3846468880 - TotalTime: 10256549095 AGGREGATION_NODE (id=21) ExecOption: Codegen Enabled - BuildTime: 32441482 - GetNewBlockTime: 821646852 - GetResultsTime: 3076723 - HTResizeTime: 26826723 - HashBuckets: 32768 - InactiveTotalTime: 0 - LargestPartitionPercent: 7 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 2790871 - PinTime: 0 - RowsRepartitioned: 0 - RowsReturned: 3523 - RowsReturnedRate: 24 - SpilledPartitions: 0 - TotalTime: 144275197636 - UnpinTime: 3299 EXCHANGE_NODE (id=20) - BytesReceived: 189958 - ConvertRowBatchTime: 784486 - DeserializeRowBatchTimer: 70419859 - FirstBatchArrivalWaitTime: 141967292362 - InactiveTotalTime: 142810453226 - PeakMemoryUsage: 0 - RowsReturned: 3523 - RowsReturnedRate: 24 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 142811774002 Averaged Fragment F07 split sizes: min: 0, max: 0, avg: 0, stddev: 0 completion times: min:2m35s max:2m49s mean: 2m47s stddev:4s608ms execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec num instances: 8 - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 154221326 - PerHostPeakMemUsage: 223060690 - RowsProduced: 3617 - TotalNetworkReceiveTime: 159339953299 - TotalNetworkSendTime: 603205240 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 591 - TotalThreadsTotalWallClockTime: 165415477236 - TotalThreadsSysTime: 59865875 - TotalThreadsUserTime: 989724250 - TotalThreadsVoluntaryContextSwitches: 1419 - TotalTime: 166864065307 Fragment Instance Lifecycle Timings - ExecTime: 91211790248 - ExecTreeExecTime: 90533522474 - InactiveTotalTime: 0 - OpenTime: 74203712641 - ExecTreeOpenTime: 70415921214 - PrepareTime: 1446667352 - ExecTreePrepareTime: 394186359 - TotalTime: 0 DataStreamSender (dst_id=20) - BytesSent: 195005 - InactiveTotalTime: 0 - NetworkThroughput(*): 146244813 - OverallThroughput: 29242232 - PeakMemoryUsage: 241152 - RowsReturned: 3617 - SerializeBatchTime: 5125384 - TotalTime: 11717661 - TransmitDataRPCTime: 1342318 - UncompressedRowBatchSize: 368003 CodeGen - CodegenTime: 21852692 - CompileTime: 893131623 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076168 - NumFunctions: 93 - NumInstructions: 3597 - OptimizationTime: 2817156932 - PeakMemoryUsage: 1841664 - PrepareTime: 802087401 - TotalTime: 4523352382 AGGREGATION_NODE (id=9) - GetNewBlockTime: 115321474 - GetResultsTime: 1768445 - HTResizeTime: 19815876 - HashBuckets: 32768 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 1919486 - PinTime: 0 - ReductionFactorEstimate: 0.0 - ReductionFactorThresholdToExpand: 0.0 - RowsPassedThrough: 0 - RowsReturned: 3617 - RowsReturnedRate: 22 - StreamingTime: 150686314 - TotalTime: 161343568217 - UnpinTime: 0 HASH_JOIN_NODE (id=8) - BuildRows: 312500 - BuildTime: 1223123242 - InactiveTotalTime: 0 - LocalTime: 1431979596 - NumHashTableBuildsSkipped: 0 - PeakMemoryUsage: 152278364 - ProbeRows: 38677 - ProbeRowsPartitioned: 0 - ProbeTime: 9098381 - RowsReturned: 38447 - RowsReturnedRate: 239 - TotalTime: 160876933459 Hash Join Builder (join_node_id=8) - BuildRowsPartitionTime: 575490717 - BuildRowsPartitioned: 312500 - GetNewBlockTime: 220556951 - HashBuckets: 524288 - HashCollisions: 0 - HashTablesBuildTime: 593005619 - InactiveTotalTime: 0 - LargestPartitionPercent: 6 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 152065152 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=19) - BytesReceived: 6083038 - ConvertRowBatchTime: 75867225 - DeserializeRowBatchTimer: 3404174981 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 312500 - RowsReturnedRate: 7400 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 44935271120 EXCHANGE_NODE (id=18) - BytesReceived: 1946832 - ConvertRowBatchTime: 12843493 - DeserializeRowBatchTimer: 397495317 - FirstBatchArrivalWaitTime: 23077954510 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 38677 - RowsReturnedRate: 337 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 114509682743 Fragment F07 Instance 6c4f4a739317c843:d78929db0000001a (host=redacted-host4:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 154171708 - PerHostPeakMemUsage: 188649285 - RowsProduced: 3748 - TotalNetworkReceiveTime: 164812063776 - TotalNetworkSendTime: 670513983 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 627 - TotalThreadsTotalWallClockTime: 169100711930 - TotalThreadsSysTime: 70989000 - TotalThreadsUserTime: 963853000 - TotalThreadsVoluntaryContextSwitches: 1253 - TotalTime: 169692760173 Fragment Instance Lifecycle Timings - ExecTime: 91193814517 - ExecTreeExecTime: 90385919169 - InactiveTotalTime: 0 - OpenTime: 77906912099 - ExecTreeOpenTime: 75745812492 - PrepareTime: 591923997 - ExecTreePrepareTime: 162109214 - TotalTime: 0 DataStreamSender (dst_id=20) - BytesSent: 201918 - InactiveTotalTime: 0 - NetworkThroughput(*): 150237501 - OverallThroughput: 34112230 - PeakMemoryUsage: 241152 - RowsReturned: 3748 - SerializeBatchTime: 4487760 - TotalTime: 5919226 - TransmitDataRPCTime: 1343992 - UncompressedRowBatchSize: 381419 CodeGen - CodegenTime: 15524598 - CompileTime: 353239647 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076168 - NumFunctions: 93 - NumInstructions: 3597 - OptimizationTime: 1739248330 - PeakMemoryUsage: 1841664 - PrepareTime: 329439421 - TotalTime: 2425778029 AGGREGATION_NODE (id=9) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 6000829 - GetResultsTime: 1643684 - HTResizeTime: 8133624 - HashBuckets: 32768 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 1895038 - PinTime: 0 - ReductionFactorEstimate: 0.0 - ReductionFactorThresholdToExpand: 0.0 - RowsPassedThrough: 0 - RowsReturned: 3748 - RowsReturnedRate: 22 - StreamingTime: 58870978 - TotalTime: 166293781724 - UnpinTime: 0 HASH_JOIN_NODE (id=8) ExecOption: Probe Side Codegen Enabled - BuildRows: 312385 - BuildTime: 1095194600 - InactiveTotalTime: 0 - LocalTime: 1135831205 - NumHashTableBuildsSkipped: 0 - PeakMemoryUsage: 152278223 - ProbeRows: 39436 - ProbeRowsPartitioned: 0 - ProbeTime: 8944801 - RowsReturned: 39436 - RowsReturnedRate: 237 - TotalTime: 166041906149 Hash Join Builder (join_node_id=8) ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 358132436 - BuildRowsPartitioned: 312385 - GetNewBlockTime: 36996743 - HashBuckets: 524288 - HashCollisions: 0 - HashTablesBuildTime: 725354211 - InactiveTotalTime: 0 - LargestPartitionPercent: 6 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 152065152 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=19) - BytesReceived: 6082880 - ConvertRowBatchTime: 69999471 - DeserializeRowBatchTimer: 1262641579 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 50135028981 - PeakMemoryUsage: 0 - RowsReturned: 312385 - RowsReturnedRate: 6189 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 50467460418 EXCHANGE_NODE (id=18) - BytesReceived: 1980535 - ConvertRowBatchTime: 10078341 - DeserializeRowBatchTimer: 321415649 - FirstBatchArrivalWaitTime: 22847789097 - InactiveTotalTime: 114409819122 - PeakMemoryUsage: 0 - RowsReturned: 39436 - RowsReturnedRate: 344 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 114438614526 Instance 6c4f4a739317c843:d78929db0000001e (host=redacted-host2:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 154171580 - PerHostPeakMemUsage: 230260997 - RowsProduced: 3676 - TotalNetworkReceiveTime: 162876724032 - TotalNetworkSendTime: 742441483 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 472 - TotalThreadsTotalWallClockTime: 167644886374 - TotalThreadsSysTime: 45993000 - TotalThreadsUserTime: 954854000 - TotalThreadsVoluntaryContextSwitches: 1322 - TotalTime: 169388137465 Fragment Instance Lifecycle Timings - ExecTime: 91207268977 - ExecTreeExecTime: 90405816331 - InactiveTotalTime: 0 - OpenTime: 76437632746 - ExecTreeOpenTime: 73761010885 - PrepareTime: 1743131385 - ExecTreePrepareTime: 662058341 - TotalTime: 0 DataStreamSender (dst_id=20) - BytesSent: 198357 - InactiveTotalTime: 0 - NetworkThroughput(*): 155222159 - OverallThroughput: 36088602 - PeakMemoryUsage: 241152 - RowsReturned: 3676 - SerializeBatchTime: 4129127 - TotalTime: 5496389 - TransmitDataRPCTime: 1277891 - UncompressedRowBatchSize: 374018 CodeGen - CodegenTime: 11012600 - CompileTime: 598392317 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076168 - NumFunctions: 93 - NumInstructions: 3597 - OptimizationTime: 2047544290 - PeakMemoryUsage: 1841664 - PrepareTime: 885184377 - TotalTime: 3532769861 AGGREGATION_NODE (id=9) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 262761567 - GetResultsTime: 1712968 - HTResizeTime: 2021632 - HashBuckets: 32768 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 1838201 - PinTime: 0 - ReductionFactorEstimate: 0.0 - ReductionFactorThresholdToExpand: 0.0 - RowsPassedThrough: 0 - RowsReturned: 3676 - RowsReturnedRate: 22 - StreamingTime: 25771794 - TotalTime: 164828828757 - UnpinTime: 0 HASH_JOIN_NODE (id=8) ExecOption: Probe Side Codegen Enabled - BuildRows: 312586 - BuildTime: 1097342552 - InactiveTotalTime: 0 - LocalTime: 1164189821 - NumHashTableBuildsSkipped: 0 - PeakMemoryUsage: 152278403 - ProbeRows: 39053 - ProbeRowsPartitioned: 0 - ProbeTime: 8417434 - RowsReturned: 39053 - RowsReturnedRate: 237 - TotalTime: 164139014584 Hash Join Builder (join_node_id=8) ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 482966324 - BuildRowsPartitioned: 312586 - GetNewBlockTime: 94379343 - HashBuckets: 524288 - HashCollisions: 0 - HashTablesBuildTime: 593612030 - InactiveTotalTime: 0 - LargestPartitionPercent: 6 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 152065152 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=19) - BytesReceived: 6084794 - ConvertRowBatchTime: 70038783 - DeserializeRowBatchTimer: 1971470519 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 47969024820 - PeakMemoryUsage: 0 - RowsReturned: 312586 - RowsReturnedRate: 6456 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 48412089606 EXCHANGE_NODE (id=18) - BytesReceived: 1960908 - ConvertRowBatchTime: 13582309 - DeserializeRowBatchTimer: 276652431 - FirstBatchArrivalWaitTime: 23110352713 - InactiveTotalTime: 114509808423 - PeakMemoryUsage: 0 - RowsReturned: 39053 - RowsReturnedRate: 340 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 114562735157 Instance 6c4f4a739317c843:d78929db0000001c (host=redacted-host3:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 154235623 - PerHostPeakMemUsage: 225689324 - RowsProduced: 3540 - TotalNetworkReceiveTime: 163213401406 - TotalNetworkSendTime: 652664388 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 670 - TotalThreadsTotalWallClockTime: 167897145981 - TotalThreadsSysTime: 53992000 - TotalThreadsUserTime: 997848000 - TotalThreadsVoluntaryContextSwitches: 1297 - TotalTime: 169343770681 Fragment Instance Lifecycle Timings - ExecTime: 91086378131 - ExecTreeExecTime: 90385334046 - InactiveTotalTime: 0 - OpenTime: 76810784188 - ExecTreeOpenTime: 74013064080 - PrepareTime: 1446503024 - ExecTreePrepareTime: 465020268 - TotalTime: 0 DataStreamSender (dst_id=20) - BytesSent: 190798 - InactiveTotalTime: 0 - NetworkThroughput(*): 158830237 - OverallThroughput: 35336738 - PeakMemoryUsage: 241152 - RowsReturned: 3540 - SerializeBatchTime: 4105271 - TotalTime: 5399423 - TransmitDataRPCTime: 1201270 - UncompressedRowBatchSize: 360243 CodeGen - CodegenTime: 9629630 - CompileTime: 396126086 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076168 - NumFunctions: 93 - NumInstructions: 3597 - OptimizationTime: 2362214758 - PeakMemoryUsage: 1841664 - PrepareTime: 635273970 - TotalTime: 3394530574 AGGREGATION_NODE (id=9) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 220915054 - GetResultsTime: 1672412 - HTResizeTime: 890553 - HashBuckets: 32768 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 1977616 - PinTime: 0 - ReductionFactorEstimate: 0.0 - ReductionFactorThresholdToExpand: 0.0 - RowsPassedThrough: 0 - RowsReturned: 3540 - RowsReturnedRate: 21 - StreamingTime: 89829873 - TotalTime: 164863362779 - UnpinTime: 0 HASH_JOIN_NODE (id=8) ExecOption: Probe Side Codegen Enabled - BuildRows: 312530 - BuildTime: 939511509 - InactiveTotalTime: 0 - LocalTime: 1013782708 - NumHashTableBuildsSkipped: 0 - PeakMemoryUsage: 152278411 - ProbeRows: 37861 - ProbeRowsPartitioned: 0 - ProbeTime: 10839620 - RowsReturned: 37861 - RowsReturnedRate: 230 - TotalTime: 164321591979 Hash Join Builder (join_node_id=8) ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 469844654 - BuildRowsPartitioned: 312530 - GetNewBlockTime: 45873547 - HashBuckets: 524288 - HashCollisions: 0 - HashTablesBuildTime: 449009577 - InactiveTotalTime: 0 - LargestPartitionPercent: 6 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 152065152 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=19) - BytesReceived: 6084061 - ConvertRowBatchTime: 69103082 - DeserializeRowBatchTimer: 1970764929 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 48048084334 - PeakMemoryUsage: 0 - RowsReturned: 312530 - RowsReturnedRate: 6423 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 48655790786 EXCHANGE_NODE (id=18) - BytesReceived: 1900598 - ConvertRowBatchTime: 11169664 - DeserializeRowBatchTimer: 379324412 - FirstBatchArrivalWaitTime: 23273201180 - InactiveTotalTime: 114563121971 - PeakMemoryUsage: 0 - RowsReturned: 37861 - RowsReturnedRate: 330 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 114652018485 Instance 6c4f4a739317c843:d78929db0000001d (host=redacted-host6:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 154297431 - PerHostPeakMemUsage: 225294975 - RowsProduced: 3571 - TotalNetworkReceiveTime: 162545116249 - TotalNetworkSendTime: 683348552 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 656 - TotalThreadsTotalWallClockTime: 168404736610 - TotalThreadsSysTime: 57991000 - TotalThreadsUserTime: 1032843000 - TotalThreadsVoluntaryContextSwitches: 1479 - TotalTime: 169257160383 Fragment Instance Lifecycle Timings - ExecTime: 91399337069 - ExecTreeExecTime: 90674568374 - InactiveTotalTime: 0 - OpenTime: 77005424552 - ExecTreeOpenTime: 73481541112 - PrepareTime: 837993493 - ExecTreePrepareTime: 13095338 - TotalTime: 0 DataStreamSender (dst_id=20) - BytesSent: 192271 - InactiveTotalTime: 0 - NetworkThroughput(*): 148883284 - OverallThroughput: 35020419 - PeakMemoryUsage: 241152 - RowsReturned: 3571 - SerializeBatchTime: 4048176 - TotalTime: 5490254 - TransmitDataRPCTime: 1291421 - UncompressedRowBatchSize: 362857 CodeGen - CodegenTime: 67334802 - CompileTime: 728849146 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076168 - NumFunctions: 93 - NumInstructions: 3597 - OptimizationTime: 2776481405 - PeakMemoryUsage: 1841664 - PrepareTime: 478844784 - TotalTime: 3985139952 AGGREGATION_NODE (id=9) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 135333 - GetResultsTime: 1654654 - HTResizeTime: 1933428 - HashBuckets: 32768 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 1964172 - PinTime: 0 - ReductionFactorEstimate: 0.0 - ReductionFactorThresholdToExpand: 0.0 - RowsPassedThrough: 0 - RowsReturned: 3571 - RowsReturnedRate: 21 - StreamingTime: 72569983 - TotalTime: 164169153901 - UnpinTime: 0 HASH_JOIN_NODE (id=8) ExecOption: Probe Side Codegen Enabled - BuildRows: 312529 - BuildTime: 1296405585 - InactiveTotalTime: 0 - LocalTime: 1419848468 - NumHashTableBuildsSkipped: 0 - PeakMemoryUsage: 152278253 - ProbeRows: 39920 - ProbeRowsPartitioned: 0 - ProbeTime: 8380056 - RowsReturned: 38083 - RowsReturnedRate: 232 - TotalTime: 164072943326 Hash Join Builder (join_node_id=8) ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 520951287 - BuildRowsPartitioned: 312529 - GetNewBlockTime: 134295167 - HashBuckets: 524288 - HashCollisions: 0 - HashTablesBuildTime: 757606778 - InactiveTotalTime: 0 - LargestPartitionPercent: 6 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 152065152 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=19) - BytesReceived: 6083970 - ConvertRowBatchTime: 82228687 - DeserializeRowBatchTimer: 3329671581 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 47679824324 - PeakMemoryUsage: 0 - RowsReturned: 312529 - RowsReturnedRate: 6472 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 48286541917 EXCHANGE_NODE (id=18) - BytesReceived: 2047674 - ConvertRowBatchTime: 10316240 - DeserializeRowBatchTimer: 285180923 - FirstBatchArrivalWaitTime: 22956848133 - InactiveTotalTime: 114336298030 - PeakMemoryUsage: 0 - RowsReturned: 39920 - RowsReturnedRate: 349 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 114366552941 Instance 6c4f4a739317c843:d78929db00000020 (host=redacted-host5:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 154171966 - PerHostPeakMemUsage: 191935198 - RowsProduced: 3669 - TotalNetworkReceiveTime: 163790863164 - TotalNetworkSendTime: 715999518 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 562 - TotalThreadsTotalWallClockTime: 168135304694 - TotalThreadsSysTime: 39994000 - TotalThreadsUserTime: 969852000 - TotalThreadsVoluntaryContextSwitches: 1245 - TotalTime: 168963192216 Fragment Instance Lifecycle Timings - ExecTime: 91213100389 - ExecTreeExecTime: 90420088878 - InactiveTotalTime: 0 - OpenTime: 76922246024 - ExecTreeOpenTime: 74649939284 - PrepareTime: 827718216 - ExecTreePrepareTime: 220490213 - TotalTime: 0 DataStreamSender (dst_id=20) - BytesSent: 197580 - InactiveTotalTime: 0 - NetworkThroughput(*): 144435842 - OverallThroughput: 25881687 - PeakMemoryUsage: 241152 - RowsReturned: 3669 - SerializeBatchTime: 6161421 - TotalTime: 7633969 - TransmitDataRPCTime: 1367943 - UncompressedRowBatchSize: 373192 CodeGen - CodegenTime: 11590336 - CompileTime: 555128206 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076168 - NumFunctions: 93 - NumInstructions: 3597 - OptimizationTime: 1652782062 - PeakMemoryUsage: 1841664 - PrepareTime: 536211817 - TotalTime: 2753191525 AGGREGATION_NODE (id=9) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 98966397 - GetResultsTime: 1844974 - HTResizeTime: 1246621 - HashBuckets: 32768 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 1974878 - PinTime: 0 - ReductionFactorEstimate: 0.0 - ReductionFactorThresholdToExpand: 0.0 - RowsPassedThrough: 0 - RowsReturned: 3669 - RowsReturnedRate: 22 - StreamingTime: 33906795 - TotalTime: 165290455355 - UnpinTime: 0 HASH_JOIN_NODE (id=8) ExecOption: Probe Side Codegen Enabled - BuildRows: 312493 - BuildTime: 1096758544 - InactiveTotalTime: 0 - LocalTime: 1138802919 - NumHashTableBuildsSkipped: 0 - PeakMemoryUsage: 152278409 - ProbeRows: 38881 - ProbeRowsPartitioned: 0 - ProbeTime: 8792472 - RowsReturned: 38881 - RowsReturnedRate: 235 - TotalTime: 165022976289 Hash Join Builder (join_node_id=8) ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 447995874 - BuildRowsPartitioned: 312493 - GetNewBlockTime: 111593554 - HashBuckets: 524288 - HashCollisions: 0 - HashTablesBuildTime: 635332320 - InactiveTotalTime: 0 - LargestPartitionPercent: 6 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 152065152 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=19) - BytesReceived: 6082911 - ConvertRowBatchTime: 68465278 - DeserializeRowBatchTimer: 1487052176 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 48857905872 - PeakMemoryUsage: 0 - RowsReturned: 312493 - RowsReturnedRate: 6325 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 49398934991 EXCHANGE_NODE (id=18) - BytesReceived: 1950859 - ConvertRowBatchTime: 10145142 - DeserializeRowBatchTimer: 196850161 - FirstBatchArrivalWaitTime: 22853156555 - InactiveTotalTime: 114451909581 - PeakMemoryUsage: 0 - RowsReturned: 38881 - RowsReturnedRate: 339 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 114485238379 Instance 6c4f4a739317c843:d78929db00000019 (host=redacted-host7:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 154367087 - PerHostPeakMemUsage: 236515429 - RowsProduced: 3532 - TotalNetworkReceiveTime: 160883792009 - TotalNetworkSendTime: 752022195 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 524 - TotalThreadsTotalWallClockTime: 166327328559 - TotalThreadsSysTime: 67989000 - TotalThreadsUserTime: 937858000 - TotalThreadsVoluntaryContextSwitches: 1406 - TotalTime: 167352390999 Fragment Instance Lifecycle Timings - ExecTime: 91186321744 - ExecTreeExecTime: 90399055370 - InactiveTotalTime: 0 - OpenTime: 75141022280 - ExecTreeOpenTime: 71723304722 - PrepareTime: 1024942253 - ExecTreePrepareTime: 215713162 - TotalTime: 0 DataStreamSender (dst_id=20) - BytesSent: 190507 - InactiveTotalTime: 0 - NetworkThroughput(*): 141782780 - OverallThroughput: 29105283 - PeakMemoryUsage: 241152 - RowsReturned: 3532 - SerializeBatchTime: 5109772 - TotalTime: 6545444 - TransmitDataRPCTime: 1343654 - UncompressedRowBatchSize: 359440 CodeGen - CodegenTime: 18020420 - CompileTime: 687948813 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076168 - NumFunctions: 93 - NumInstructions: 3597 - OptimizationTime: 2691329978 - PeakMemoryUsage: 1841664 - PrepareTime: 529221261 - TotalTime: 3914222056 AGGREGATION_NODE (id=9) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 134764774 - GetResultsTime: 1607255 - HTResizeTime: 10807396 - HashBuckets: 32768 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 1934313 - PinTime: 0 - ReductionFactorEstimate: 0.0 - ReductionFactorThresholdToExpand: 0.0 - RowsPassedThrough: 0 - RowsReturned: 3532 - RowsReturnedRate: 21 - StreamingTime: 65463277 - TotalTime: 162338024338 - UnpinTime: 0 HASH_JOIN_NODE (id=8) ExecOption: Probe Side Codegen Enabled - BuildRows: 312531 - BuildTime: 961899862 - InactiveTotalTime: 0 - LocalTime: 1017419792 - NumHashTableBuildsSkipped: 0 - PeakMemoryUsage: 152278327 - ProbeRows: 37584 - ProbeRowsPartitioned: 0 - ProbeTime: 9652032 - RowsReturned: 37584 - RowsReturnedRate: 231 - TotalTime: 162007784014 Hash Join Builder (join_node_id=8) ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 426297473 - BuildRowsPartitioned: 312531 - GetNewBlockTime: 112793438 - HashBuckets: 524288 - HashCollisions: 0 - HashTablesBuildTime: 468244387 - InactiveTotalTime: 0 - LargestPartitionPercent: 6 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 152065152 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=19) - BytesReceived: 6083212 - ConvertRowBatchTime: 66401373 - DeserializeRowBatchTimer: 1780500996 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 45947543951 - PeakMemoryUsage: 0 - RowsReturned: 312531 - RowsReturnedRate: 6749 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 46303662581 EXCHANGE_NODE (id=18) - BytesReceived: 1886767 - ConvertRowBatchTime: 10278249 - DeserializeRowBatchTimer: 1018784160 - FirstBatchArrivalWaitTime: 23113205894 - InactiveTotalTime: 113410046302 - PeakMemoryUsage: 0 - RowsReturned: 37584 - RowsReturnedRate: 327 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 114686701641 Instance 6c4f4a739317c843:d78929db0000001b (host=redacted-host1:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 154183372 - PerHostPeakMemUsage: 253001132 - RowsProduced: 3584 - TotalNetworkReceiveTime: 159485543240 - TotalNetworkSendTime: 42014372 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 536 - TotalThreadsTotalWallClockTime: 164925930701 - TotalThreadsSysTime: 78988000 - TotalThreadsUserTime: 958854000 - TotalThreadsVoluntaryContextSwitches: 1464 - TotalTime: 166018994434 Fragment Instance Lifecycle Timings - ExecTime: 91278844237 - ExecTreeExecTime: 91154109632 - InactiveTotalTime: 0 - OpenTime: 73647146432 - ExecTreeOpenTime: 70536441054 - PrepareTime: 1092907538 - ExecTreePrepareTime: 297576622 - TotalTime: 0 DataStreamSender (dst_id=20) - BytesSent: 193265 - InactiveTotalTime: 0 - NetworkThroughput(*): 119112332 - OverallThroughput: 3744099 - PeakMemoryUsage: 241152 - RowsReturned: 3584 - SerializeBatchTime: 8801070 - TotalTime: 51618560 - TransmitDataRPCTime: 1622544 - UncompressedRowBatchSize: 364655 CodeGen - CodegenTime: 24334566 - CompileTime: 822365355 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076168 - NumFunctions: 93 - NumInstructions: 3597 - OptimizationTime: 2191299452 - PeakMemoryUsage: 1841664 - PrepareTime: 520113196 - TotalTime: 3561617650 AGGREGATION_NODE (id=9) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 81433882 - GetResultsTime: 2060766 - HTResizeTime: 879873 - HashBuckets: 32768 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 1850415 - PinTime: 0 - ReductionFactorEstimate: 0.0 - ReductionFactorThresholdToExpand: 0.0 - RowsPassedThrough: 0 - RowsReturned: 3584 - RowsReturnedRate: 22 - StreamingTime: 546628644 - TotalTime: 161988026534 - UnpinTime: 0 HASH_JOIN_NODE (id=8) ExecOption: Probe Side Codegen Enabled - BuildRows: 312485 - BuildTime: 1196299196 - InactiveTotalTime: 0 - LocalTime: 1526981205 - NumHashTableBuildsSkipped: 0 - PeakMemoryUsage: 152278383 - ProbeRows: 38110 - ProbeRowsPartitioned: 0 - ProbeTime: 9315745 - RowsReturned: 38110 - RowsReturnedRate: 236 - TotalTime: 161102746503 Hash Join Builder (join_node_id=8) ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 413945353 - BuildRowsPartitioned: 312485 - GetNewBlockTime: 203208612 - HashBuckets: 524288 - HashCollisions: 0 - HashTablesBuildTime: 646235539 - InactiveTotalTime: 0 - LargestPartitionPercent: 6 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 152065152 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=19) - BytesReceived: 6081177 - ConvertRowBatchTime: 66578581 - DeserializeRowBatchTimer: 1323250123 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 44797648154 - PeakMemoryUsage: 0 - RowsReturned: 312485 - RowsReturnedRate: 6931 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 45079838267 EXCHANGE_NODE (id=18) - BytesReceived: 1911868 - ConvertRowBatchTime: 10293657 - DeserializeRowBatchTimer: 215769547 - FirstBatchArrivalWaitTime: 22923718019 - InactiveTotalTime: 114459008614 - PeakMemoryUsage: 0 - RowsReturned: 38110 - RowsReturnedRate: 332 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 114495927031 Instance 6c4f4a739317c843:d78929db0000001f (host=redacted-host8:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 154171848 - PerHostPeakMemUsage: 233139186 - RowsProduced: 3619 - TotalNetworkReceiveTime: 137112122518 - TotalNetworkSendTime: 566637432 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 686 - TotalThreadsTotalWallClockTime: 150887773041 - TotalThreadsSysTime: 62991000 - TotalThreadsUserTime: 1101832000 - TotalThreadsVoluntaryContextSwitches: 1889 - TotalTime: 154896116109 Fragment Instance Lifecycle Timings - ExecTime: 91129256924 - ExecTreeExecTime: 90443287993 - InactiveTotalTime: 0 - OpenTime: 59758532813 - ExecTreeOpenTime: 49416256087 - PrepareTime: 4008218913 - ExecTreePrepareTime: 1117427720 - TotalTime: 0 DataStreamSender (dst_id=20) - BytesSent: 195351 - InactiveTotalTime: 0 - NetworkThroughput(*): 151454373 - OverallThroughput: 34648804 - PeakMemoryUsage: 241152 - RowsReturned: 3619 - SerializeBatchTime: 4160479 - TotalTime: 5638030 - TransmitDataRPCTime: 1289834 - UncompressedRowBatchSize: 368205 CodeGen - CodegenTime: 17374591 - CompileTime: 3003003418 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076168 - NumFunctions: 93 - NumInstructions: 3597 - OptimizationTime: 7076355181 - PeakMemoryUsage: 1841664 - PrepareTime: 2502410384 - TotalTime: 12619569415 AGGREGATION_NODE (id=9) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 117593962 - GetResultsTime: 1950847 - HTResizeTime: 132613885 - HashBuckets: 32768 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 1921261 - PinTime: 0 - ReductionFactorEstimate: 0.0 - ReductionFactorThresholdToExpand: 0.0 - RowsPassedThrough: 0 - RowsReturned: 3619 - RowsReturnedRate: 25 - StreamingTime: 312449175 - TotalTime: 140976912348 - UnpinTime: 0 HASH_JOIN_NODE (id=8) ExecOption: Probe Side Codegen Enabled - BuildRows: 312461 - BuildTime: 2101574094 - InactiveTotalTime: 0 - LocalTime: 3038980651 - NumHashTableBuildsSkipped: 0 - PeakMemoryUsage: 152278507 - ProbeRows: 38571 - ProbeRowsPartitioned: 0 - ProbeTime: 8444889 - RowsReturned: 38571 - RowsReturnedRate: 274 - TotalTime: 140306504835 Hash Join Builder (join_node_id=8) ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 1483792335 - BuildRowsPartitioned: 312461 - GetNewBlockTime: 1025315208 - HashBuckets: 524288 - HashCollisions: 0 - HashTablesBuildTime: 468650115 - InactiveTotalTime: 0 - LargestPartitionPercent: 6 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 152065152 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=19) - BytesReceived: 6081300 - ConvertRowBatchTime: 114122549 - DeserializeRowBatchTimer: 14108047951 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 22415348558 - PeakMemoryUsage: 0 - RowsReturned: 312461 - RowsReturnedRate: 13657 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 22877850395 EXCHANGE_NODE (id=18) - BytesReceived: 1935448 - ConvertRowBatchTime: 26884346 - DeserializeRowBatchTimer: 485985255 - FirstBatchArrivalWaitTime: 23545364489 - InactiveTotalTime: 114350548056 - PeakMemoryUsage: 0 - RowsReturned: 38571 - RowsReturnedRate: 337 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 114389673789 Averaged Fragment F02 split sizes: min: 135.75 MB, max: 160.05 MB, avg: 145.82 MB, stddev: 7.08 MB completion times: min:1m46s max:2m34s mean: 2m6s stddev:13s274ms execution rates: min:980.59 KB/sec max:1.31 MB/sec mean:1.17 MB/sec stddev:116.28 KB/sec num instances: 8 - AverageThreadTokens: 1.4106959476035814 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 34890805 - PerHostPeakMemUsage: 223060690 - RowsProduced: 38677 - TotalNetworkReceiveTime: 63988940277 - TotalNetworkSendTime: 1478899175 - TotalStorageWaitTime: 14194060259 - TotalThreadsInvoluntaryContextSwitches: 10475 - TotalThreadsTotalWallClockTime: 176993038657 - TotalThreadsSysTime: 307827750 - TotalThreadsUserTime: 7872303250 - TotalThreadsVoluntaryContextSwitches: 6009 - TotalTime: 125957895280 Fragment Instance Lifecycle Timings - ExecTime: 51120118153 - ExecTreeExecTime: 48350793639 - InactiveTotalTime: 0 - OpenTime: 73469234809 - ExecTreeOpenTime: 65499497854 - PrepareTime: 1366625047 - ExecTreePrepareTime: 238987876 - TotalTime: 0 DataStreamSender (dst_id=18) - BytesSent: 1946832 - InactiveTotalTime: 0 - NetworkThroughput(*): 83791898 - OverallThroughput: 12909638 - PeakMemoryUsage: 255744 - RowsReturned: 38677 - SerializeBatchTime: 129991133 - TotalTime: 153535121 - TransmitDataRPCTime: 23325994 - UncompressedRowBatchSize: 6272489 CodeGen - CodegenTime: 3052604 - CompileTime: 2941513207 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076168 - NumFunctions: 105 - NumInstructions: 6894 - OptimizationTime: 4934502615 - PeakMemoryUsage: 3529728 - PrepareTime: 762588682 - TotalTime: 8670022776 HASH_JOIN_NODE (id=7) - BuildRows: 90 - BuildTime: 15001725 - InactiveTotalTime: 0 - LocalTime: 171452758 - NumHashTableBuildsSkipped: 0 - PeakMemoryUsage: 8623272 - ProbeRows: 38677 - ProbeRowsPartitioned: 0 - ProbeTime: 7809341 - RowsReturned: 38677 - RowsReturnedRate: 339 - TotalTime: 114300059515 Hash Join Builder (join_node_id=7) - BuildRowsPartitionTime: 286883 - BuildRowsPartitioned: 90 - GetNewBlockTime: 5191978 - HashBuckets: 202 - HashCollisions: 0 - HashTablesBuildTime: 305163 - InactiveTotalTime: 0 - LargestPartitionPercent: 14 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 1062016 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=17) - BytesReceived: 1257 - ConvertRowBatchTime: 30121 - DeserializeRowBatchTimer: 125346 - FirstBatchArrivalWaitTime: 63909225386 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 90 - RowsReturnedRate: 1 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 63988951894 HASH_JOIN_NODE (id=6) - BuildRows: 1800 - BuildTime: 5975363 - InactiveTotalTime: 0 - LocalTime: 232565038 - NumHashTableBuildsSkipped: 0 - PeakMemoryUsage: 4094175 - ProbeRows: 157890 - ProbeRowsPartitioned: 0 - ProbeTime: 29986437 - RowsReturned: 38677 - RowsReturnedRate: 836 - TotalTime: 50139654862 Hash Join Builder (join_node_id=6) - BuildRowsPartitionTime: 370467 - BuildRowsPartitioned: 1800 - GetNewBlockTime: 4715612 - HashBuckets: 4096 - HashCollisions: 0 - HashTablesBuildTime: 658856 - InactiveTotalTime: 0 - LargestPartitionPercent: 7 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 1135744 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=16) - BytesReceived: 14556 - ConvertRowBatchTime: 381086 - DeserializeRowBatchTimer: 1146789 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 1800 - RowsReturnedRate: 4242046 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 426293 HASH_JOIN_NODE (id=5) - BuildRows: 49 - BuildTime: 5989423 - InactiveTotalTime: 0 - LocalTime: 437219708 - NumHashTableBuildsSkipped: 0 - PeakMemoryUsage: 2564477 - ProbeRows: 3100652 - ProbeRowsPartitioned: 0 - ProbeTime: 267733605 - RowsReturned: 157890 - RowsReturnedRate: 3429 - TotalTime: 49906663530 Hash Join Builder (join_node_id=5) - BuildRowsPartitionTime: 38232 - BuildRowsPartitioned: 49 - GetNewBlockTime: 5462189 - HashBuckets: 87 - HashCollisions: 0 - HashTablesBuildTime: 219956 - InactiveTotalTime: 0 - LargestPartitionPercent: 12 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 1071600 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=15) - BytesReceived: 827 - ConvertRowBatchTime: 18645 - DeserializeRowBatchTimer: 74093 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 49 - RowsReturnedRate: 1324179 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 40420 HDFS_SCAN_NODE (id=0) - AverageHdfsReadThreadConcurrency: 0.0016666666666666668 - AverageScannerThreadConcurrency: 1.0 - BytesRead: 46291627 - BytesReadDataNodeCache: 0 - BytesReadLocal: 46291627 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 46291627 - DecompressionTime: 240096847 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 8 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 6 - NumRowGroups: 11 - NumScannerThreadsStarted: 1 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 18623233 - PerReadThreadRawHdfsThroughput: 294596898 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 49048039220 - RowBatchQueuePutWaitTime: 14270132 - RowsRead: 3100652 - RowsReturned: 3100652 - RowsReturnedRate: 67972 - ScanRangesComplete: 11 - ScannerThreadsInvoluntaryContextSwitches: 9510 - ScannerThreadsTotalWallClockTime: 52403711305 - MaterializeTupleTime(*): 29039813362 - ScannerThreadsSysTime: 210217625 - ScannerThreadsUserTime: 6152439750 - ScannerThreadsVoluntaryContextSwitches: 2195 - TotalRawHdfsReadTime(*): 197783956 - TotalReadThroughput: 380735 - TotalTime: 49469403402 Fragment F02 Instance 6c4f4a739317c843:d78929db00000010 (host=redacted-host8:22000) Hdfs split stats (:<# splits>/): 9:1/12.33 MB 1:2/24.56 MB 5:2/24.69 MB 2:3/36.96 MB 7:2/24.86 MB 11:1/12.26 MB 4:1/12.31 MB - AverageThreadTokens: 1.6310344827586207 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 33764163 - PerHostPeakMemUsage: 233139186 - RowsProduced: 38868 - TotalNetworkReceiveTime: 33472706999 - TotalNetworkSendTime: 2273398518 - TotalStorageWaitTime: 52881762621 - TotalThreadsInvoluntaryContextSwitches: 9890 - TotalThreadsTotalWallClockTime: 242637247832 - TotalThreadsSysTime: 282956000 - TotalThreadsUserTime: 8143762000 - TotalThreadsVoluntaryContextSwitches: 7809 - TotalTime: 154131257812 Fragment Instance Lifecycle Timings - ExecTime: 89945912404 - ExecTreeExecTime: 85708069880 - InactiveTotalTime: 0 - OpenTime: 60367676849 - ExecTreeOpenTime: 36256494133 - PrepareTime: 3817576937 - ExecTreePrepareTime: 778275743 - TotalTime: 0 DataStreamSender (dst_id=18) - BytesSent: 1956996 - InactiveTotalTime: 0 - NetworkThroughput(*): 87306765 - OverallThroughput: 13592512 - PeakMemoryUsage: 261888 - RowsReturned: 38868 - SerializeBatchTime: 121347428 - TotalTime: 143976029 - TransmitDataRPCTime: 22415170 - UncompressedRowBatchSize: 6304400 CodeGen - CodegenTime: 1322684 - CompileTime: 12124307711 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076168 - NumFunctions: 105 - NumInstructions: 6894 - OptimizationTime: 11886407537 - PeakMemoryUsage: 3529728 - PrepareTime: 2089666838 - TotalTime: 26280415804 HASH_JOIN_NODE (id=7) ExecOption: Probe Side Codegen Enabled - BuildRows: 90 - BuildTime: 60788629 - InactiveTotalTime: 0 - LocalTime: 604979040 - NumHashTableBuildsSkipped: 0 - PeakMemoryUsage: 9110864 - ProbeRows: 38868 - ProbeRowsPartitioned: 0 - ProbeTime: 7524718 - RowsReturned: 38868 - RowsReturnedRate: 314 - TotalTime: 123478069937 Hash Join Builder (join_node_id=7) ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 56164 - BuildRowsPartitioned: 90 - GetNewBlockTime: 32735979 - HashBuckets: 202 - HashCollisions: 0 - HashTablesBuildTime: 202401 - InactiveTotalTime: 0 - LargestPartitionPercent: 14 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 1062016 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=17) - BytesReceived: 1257 - ConvertRowBatchTime: 38136 - DeserializeRowBatchTimer: 56607 - FirstBatchArrivalWaitTime: 33432356352 - InactiveTotalTime: 33472664027 - PeakMemoryUsage: 0 - RowsReturned: 90 - RowsReturnedRate: 2 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 33472729865 HASH_JOIN_NODE (id=6) ExecOption: Probe Side Codegen Enabled - BuildRows: 1800 - BuildTime: 36602614 - InactiveTotalTime: 0 - LocalTime: 855837532 - NumHashTableBuildsSkipped: 0 - PeakMemoryUsage: 4234376 - ProbeRows: 158136 - ProbeRowsPartitioned: 0 - ProbeTime: 32330285 - RowsReturned: 38868 - RowsReturnedRate: 434 - TotalTime: 89400361032 Hash Join Builder (join_node_id=6) ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 388862 - BuildRowsPartitioned: 1800 - GetNewBlockTime: 35348304 - HashBuckets: 4096 - HashCollisions: 0 - HashTablesBuildTime: 612941 - InactiveTotalTime: 0 - LargestPartitionPercent: 7 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 1135744 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=16) - BytesReceived: 14556 - ConvertRowBatchTime: 380315 - DeserializeRowBatchTimer: 182571 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 1800 - RowsReturnedRate: 4311284 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 417509 HASH_JOIN_NODE (id=5) ExecOption: Probe Side Codegen Enabled - BuildRows: 49 - BuildTime: 9277390 - InactiveTotalTime: 0 - LocalTime: 521337412 - NumHashTableBuildsSkipped: 0 - PeakMemoryUsage: 2384368 - ProbeRows: 3139761 - ProbeRowsPartitioned: 0 - ProbeTime: 275459768 - RowsReturned: 158136 - RowsReturnedRate: 1785 - TotalTime: 88544105991 Hash Join Builder (join_node_id=5) ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 37733 - BuildRowsPartitioned: 49 - GetNewBlockTime: 8759806 - HashBuckets: 87 - HashCollisions: 0 - HashTablesBuildTime: 257235 - InactiveTotalTime: 0 - LargestPartitionPercent: 12 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 1071600 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=15) - BytesReceived: 827 - ConvertRowBatchTime: 13003 - DeserializeRowBatchTimer: 38266 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 49 - RowsReturnedRate: 1343422 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 36474 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 9:1/12.33 MB 1:2/24.56 MB 5:2/24.69 MB 2:3/36.96 MB 7:2/24.86 MB 11:1/12.26 MB 4:1/12.31 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 12 out of 12 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:96 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 1.0 - BytesRead: 46778260 - BytesReadDataNodeCache: 0 - BytesReadLocal: 46778260 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 46778260 - DecompressionTime: 316035842 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 8 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 7 - NumRowGroups: 12 - NumScannerThreadsStarted: 1 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 16591812 - PerReadThreadRawHdfsThroughput: 213144849 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 87849357027 - RowBatchQueuePutWaitTime: 0 - RowsRead: 3139761 - RowsReturned: 3139761 - RowsReturnedRate: 35669 - ScanRangesComplete: 12 - ScannerThreadsInvoluntaryContextSwitches: 8736 - ScannerThreadsTotalWallClockTime: 92323678259 - MaterializeTupleTime(*): 31493632628 - ScannerThreadsSysTime: 190970000 - ScannerThreadsUserTime: 6258049000 - ScannerThreadsVoluntaryContextSwitches: 3085 - TotalRawHdfsReadTime(*): 219466997 - TotalReadThroughput: 323624 - TotalTime: 88022732105 Instance 6c4f4a739317c843:d78929db0000000e (host=redacted-host6:22000) Hdfs split stats (:<# splits>/): 5:1/12.23 MB 3:1/12.28 MB 6:1/12.36 MB 8:1/12.29 MB 11:1/12.56 MB 9:4/49.14 MB 7:2/24.80 MB 0:1/12.39 MB - AverageThreadTokens: 1.42578125 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 27963437 - PerHostPeakMemUsage: 225294975 - RowsProduced: 38729 - TotalNetworkReceiveTime: 68450570502 - TotalNetworkSendTime: 1301322039 - TotalStorageWaitTime: 15218477047 - TotalThreadsInvoluntaryContextSwitches: 10462 - TotalThreadsTotalWallClockTime: 185391881545 - TotalThreadsSysTime: 264959000 - TotalThreadsUserTime: 8110766000 - TotalThreadsVoluntaryContextSwitches: 6022 - TotalTime: 131055142866 Fragment Instance Lifecycle Timings - ExecTime: 53747986171 - ExecTreeExecTime: 51189867243 - InactiveTotalTime: 0 - OpenTime: 76485841024 - ExecTreeOpenTime: 70073007799 - PrepareTime: 820298095 - ExecTreePrepareTime: 178423275 - TotalTime: 0 DataStreamSender (dst_id=18) - BytesSent: 1950194 - InactiveTotalTime: 0 - NetworkThroughput(*): 85728084 - OverallThroughput: 13730350 - PeakMemoryUsage: 261888 - RowsReturned: 38729 - SerializeBatchTime: 119049462 - TotalTime: 142035268 - TransmitDataRPCTime: 22748601 - UncompressedRowBatchSize: 6280621 CodeGen - CodegenTime: 701388 - CompileTime: 1801579006 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076168 - NumFunctions: 105 - NumInstructions: 6894 - OptimizationTime: 4418827592 - PeakMemoryUsage: 3529728 - PrepareTime: 505706909 - TotalTime: 6739062742 HASH_JOIN_NODE (id=7) ExecOption: Probe Side Codegen Enabled - BuildRows: 90 - BuildTime: 1754220 - InactiveTotalTime: 0 - LocalTime: 142021549 - NumHashTableBuildsSkipped: 0 - PeakMemoryUsage: 8697920 - ProbeRows: 38729 - ProbeRowsPartitioned: 0 - ProbeTime: 7653356 - RowsReturned: 38729 - RowsReturnedRate: 318 - TotalTime: 121619330714 Hash Join Builder (join_node_id=7) ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 82894 - BuildRowsPartitioned: 90 - GetNewBlockTime: 154213 - HashBuckets: 202 - HashCollisions: 0 - HashTablesBuildTime: 692754 - InactiveTotalTime: 0 - LargestPartitionPercent: 14 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 1062016 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=17) - BytesReceived: 1257 - ConvertRowBatchTime: 44505 - DeserializeRowBatchTimer: 89949 - FirstBatchArrivalWaitTime: 68363139569 - InactiveTotalTime: 68450499200 - PeakMemoryUsage: 0 - RowsReturned: 90 - RowsReturnedRate: 1 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 68450578957 HASH_JOIN_NODE (id=6) ExecOption: Probe Side Codegen Enabled - BuildRows: 1800 - BuildTime: 1301497 - InactiveTotalTime: 0 - LocalTime: 145351364 - NumHashTableBuildsSkipped: 0 - PeakMemoryUsage: 3998624 - ProbeRows: 159760 - ProbeRowsPartitioned: 0 - ProbeTime: 27626501 - RowsReturned: 38729 - RowsReturnedRate: 730 - TotalTime: 53026730208 Hash Join Builder (join_node_id=6) ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 358660 - BuildRowsPartitioned: 1800 - GetNewBlockTime: 89934 - HashBuckets: 4096 - HashCollisions: 0 - HashTablesBuildTime: 660232 - InactiveTotalTime: 0 - LargestPartitionPercent: 7 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 1135744 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=16) - BytesReceived: 14556 - ConvertRowBatchTime: 397661 - DeserializeRowBatchTimer: 160233 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 1800 - RowsReturnedRate: 4065059 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 442798 HASH_JOIN_NODE (id=5) ExecOption: Probe Side Codegen Enabled - BuildRows: 49 - BuildTime: 548248 - InactiveTotalTime: 0 - LocalTime: 416332403 - NumHashTableBuildsSkipped: 0 - PeakMemoryUsage: 2398480 - ProbeRows: 3141263 - ProbeRowsPartitioned: 0 - ProbeTime: 269258033 - RowsReturned: 159760 - RowsReturnedRate: 3021 - TotalTime: 52880936046 Hash Join Builder (join_node_id=5) ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 45785 - BuildRowsPartitioned: 49 - GetNewBlockTime: 117296 - HashBuckets: 87 - HashCollisions: 0 - HashTablesBuildTime: 186505 - InactiveTotalTime: 0 - LargestPartitionPercent: 12 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 1071600 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=15) - BytesReceived: 827 - ConvertRowBatchTime: 26942 - DeserializeRowBatchTimer: 82941 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 49 - RowsReturnedRate: 720450 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 68013 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 5:1/12.23 MB 3:1/12.28 MB 6:1/12.36 MB 8:1/12.29 MB 11:1/12.56 MB 9:4/49.14 MB 7:2/24.80 MB 0:1/12.39 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 12 out of 12 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:96 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 1.0 - BytesRead: 46846571 - BytesReadDataNodeCache: 0 - BytesReadLocal: 46846571 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 46846571 - DecompressionTime: 124872200 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 8 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 8 - NumRowGroups: 12 - NumScannerThreadsStarted: 1 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 11701086 - PerReadThreadRawHdfsThroughput: 371998521 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 52229923083 - RowBatchQueuePutWaitTime: 0 - RowsRead: 3141263 - RowsReturned: 3141263 - RowsReturnedRate: 59874 - ScanRangesComplete: 12 - ScannerThreadsInvoluntaryContextSwitches: 9482 - ScannerThreadsTotalWallClockTime: 55158074728 - MaterializeTupleTime(*): 30419688202 - ScannerThreadsSysTime: 179972000 - ScannerThreadsUserTime: 6356033000 - ScannerThreadsVoluntaryContextSwitches: 2216 - TotalRawHdfsReadTime(*): 125932143 - TotalReadThroughput: 365811 - TotalTime: 52464535630 Instance 6c4f4a739317c843:d78929db0000000d (host=redacted-host3:22000) Hdfs split stats (:<# splits>/): 5:2/24.81 MB 1:3/37.04 MB 9:1/12.36 MB 11:2/24.61 MB 3:1/12.22 MB 8:2/24.70 MB - AverageThreadTokens: 1.4007936507936507 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 26287521 - PerHostPeakMemUsage: 225689324 - RowsProduced: 35967 - TotalNetworkReceiveTime: 68156623887 - TotalNetworkSendTime: 421874527 - TotalStorageWaitTime: 13001246331 - TotalThreadsInvoluntaryContextSwitches: 10806 - TotalThreadsTotalWallClockTime: 180695325740 - TotalThreadsSysTime: 401938000 - TotalThreadsUserTime: 7647837000 - TotalThreadsVoluntaryContextSwitches: 6089 - TotalTime: 129173802205 Fragment Instance Lifecycle Timings - ExecTime: 52057886059 - ExecTreeExecTime: 50306189009 - InactiveTotalTime: 0 - OpenTime: 75605537772 - ExecTreeOpenTime: 69342484803 - PrepareTime: 1510228726 - ExecTreePrepareTime: 209117473 - TotalTime: 0 DataStreamSender (dst_id=18) - BytesSent: 1810393 - InactiveTotalTime: 0 - NetworkThroughput(*): 71864875 - OverallThroughput: 11594834 - PeakMemoryUsage: 245504 - RowsReturned: 35967 - SerializeBatchTime: 130748169 - TotalTime: 156137884 - TransmitDataRPCTime: 25191625 - UncompressedRowBatchSize: 5832591 CodeGen - CodegenTime: 1453545 - CompileTime: 2298580545 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076168 - NumFunctions: 105 - NumInstructions: 6894 - OptimizationTime: 3841739531 - PeakMemoryUsage: 3529728 - PrepareTime: 1088514914 - TotalTime: 7240721188 HASH_JOIN_NODE (id=7) ExecOption: Probe Side Codegen Enabled - BuildRows: 90 - BuildTime: 16457982 - InactiveTotalTime: 0 - LocalTime: 204395005 - NumHashTableBuildsSkipped: 0 - PeakMemoryUsage: 8739680 - ProbeRows: 35967 - ProbeRowsPartitioned: 0 - ProbeTime: 8220975 - RowsReturned: 35967 - RowsReturnedRate: 299 - TotalTime: 119976478085 Hash Join Builder (join_node_id=7) ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 51063 - BuildRowsPartitioned: 90 - GetNewBlockTime: 166955 - HashBuckets: 202 - HashCollisions: 0 - HashTablesBuildTime: 249735 - InactiveTotalTime: 0 - LargestPartitionPercent: 14 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 1062016 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=17) - BytesReceived: 1257 - ConvertRowBatchTime: 19290 - DeserializeRowBatchTimer: 132627 - FirstBatchArrivalWaitTime: 68063711111 - InactiveTotalTime: 68156586375 - PeakMemoryUsage: 0 - RowsReturned: 90 - RowsReturnedRate: 1 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 68156629046 HASH_JOIN_NODE (id=6) ExecOption: Probe Side Codegen Enabled - BuildRows: 1800 - BuildTime: 1238968 - InactiveTotalTime: 0 - LocalTime: 85858231 - NumHashTableBuildsSkipped: 0 - PeakMemoryUsage: 3981488 - ProbeRows: 146162 - ProbeRowsPartitioned: 0 - ProbeTime: 27995663 - RowsReturned: 35967 - RowsReturnedRate: 696 - TotalTime: 51615454034 Hash Join Builder (join_node_id=6) ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 345864 - BuildRowsPartitioned: 1800 - GetNewBlockTime: 88448 - HashBuckets: 4096 - HashCollisions: 0 - HashTablesBuildTime: 603776 - InactiveTotalTime: 0 - LargestPartitionPercent: 7 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 1135744 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=16) - BytesReceived: 14556 - ConvertRowBatchTime: 380805 - DeserializeRowBatchTimer: 105151 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 1800 - RowsReturnedRate: 4313795 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 417266 HASH_JOIN_NODE (id=5) ExecOption: Probe Side Codegen Enabled - BuildRows: 49 - BuildTime: 17925736 - InactiveTotalTime: 0 - LocalTime: 484250774 - NumHashTableBuildsSkipped: 0 - PeakMemoryUsage: 2387448 - ProbeRows: 2880689 - ProbeRowsPartitioned: 0 - ProbeTime: 251505449 - RowsReturned: 146162 - RowsReturnedRate: 2836 - TotalTime: 51529178537 Hash Join Builder (join_node_id=5) ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 35646 - BuildRowsPartitioned: 49 - GetNewBlockTime: 17264551 - HashBuckets: 87 - HashCollisions: 0 - HashTablesBuildTime: 208812 - InactiveTotalTime: 0 - LargestPartitionPercent: 12 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 1071600 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=15) - BytesReceived: 827 - ConvertRowBatchTime: 13007 - DeserializeRowBatchTimer: 47818 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 49 - RowsReturnedRate: 1535280 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 31916 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 5:2/24.81 MB 1:3/37.04 MB 9:1/12.36 MB 11:2/24.61 MB 3:1/12.22 MB 8:2/24.70 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 11 out of 11 Hdfs Read Thread Concurrency Bucket: 0:99.01% 1:0.9901% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:88 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 1.0 - BytesRead: 42936754 - BytesReadDataNodeCache: 0 - BytesReadLocal: 42936754 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 42936754 - DecompressionTime: 169623285 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 8 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 6 - NumRowGroups: 11 - NumScannerThreadsStarted: 1 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 9201404 - PerReadThreadRawHdfsThroughput: 241010991 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 49732449467 - RowBatchQueuePutWaitTime: 0 - RowsRead: 2880689 - RowsReturned: 2880689 - RowsReturnedRate: 56434 - ScanRangesComplete: 11 - ScannerThreadsInvoluntaryContextSwitches: 9902 - ScannerThreadsTotalWallClockTime: 53031924169 - MaterializeTupleTime(*): 29968407660 - ScannerThreadsSysTime: 252961000 - ScannerThreadsUserTime: 5932098000 - ScannerThreadsVoluntaryContextSwitches: 2443 - TotalRawHdfsReadTime(*): 178152680 - TotalReadThroughput: 340659 - TotalTime: 51044895847 Instance 6c4f4a739317c843:d78929db00000011 (host=redacted-host5:22000) Hdfs split stats (:<# splits>/): 2:1/12.41 MB 11:1/12.37 MB 6:1/12.37 MB 4:3/36.91 MB 3:1/12.39 MB 10:2/24.40 MB 5:3/37.10 MB - AverageThreadTokens: 1.4206349206349207 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 35409006 - PerHostPeakMemUsage: 191935198 - RowsProduced: 39967 - TotalNetworkReceiveTime: 69677054253 - TotalNetworkSendTime: 1659315673 - TotalStorageWaitTime: 13290182956 - TotalThreadsInvoluntaryContextSwitches: 10796 - TotalThreadsTotalWallClockTime: 181060565309 - TotalThreadsSysTime: 306953000 - TotalThreadsUserTime: 8069774000 - TotalThreadsVoluntaryContextSwitches: 5717 - TotalTime: 128763786045 Fragment Instance Lifecycle Timings - ExecTime: 51839645178 - ExecTreeExecTime: 49000088933 - InactiveTotalTime: 0 - OpenTime: 75996009870 - ExecTreeOpenTime: 71186837924 - PrepareTime: 928025235 - ExecTreePrepareTime: 168419043 - TotalTime: 0 DataStreamSender (dst_id=18) - BytesSent: 2011819 - InactiveTotalTime: 0 - NetworkThroughput(*): 85098712 - OverallThroughput: 12000162 - PeakMemoryUsage: 261888 - RowsReturned: 39967 - SerializeBatchTime: 143788874 - TotalTime: 167649307 - TransmitDataRPCTime: 23641004 - UncompressedRowBatchSize: 6482123 CodeGen - CodegenTime: 753977 - CompileTime: 1567527850 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076168 - NumFunctions: 105 - NumInstructions: 6894 - OptimizationTime: 3153343749 - PeakMemoryUsage: 3529728 - PrepareTime: 572513672 - TotalTime: 5294319062 HASH_JOIN_NODE (id=7) ExecOption: Probe Side Codegen Enabled - BuildRows: 90 - BuildTime: 7193873 - InactiveTotalTime: 0 - LocalTime: 17866478 - NumHashTableBuildsSkipped: 0 - PeakMemoryUsage: 8233400 - ProbeRows: 39967 - ProbeRowsPartitioned: 0 - ProbeTime: 8166033 - RowsReturned: 39967 - RowsReturnedRate: 331 - TotalTime: 120523179759 Hash Join Builder (join_node_id=7) ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 1856698 - BuildRowsPartitioned: 90 - GetNewBlockTime: 290274 - HashBuckets: 202 - HashCollisions: 0 - HashTablesBuildTime: 248311 - InactiveTotalTime: 0 - LargestPartitionPercent: 14 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 1062016 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=17) - BytesReceived: 1257 - ConvertRowBatchTime: 45062 - DeserializeRowBatchTimer: 40642 - FirstBatchArrivalWaitTime: 69602643923 - InactiveTotalTime: 69676981520 - PeakMemoryUsage: 0 - RowsReturned: 90 - RowsReturnedRate: 1 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 69677096410 HASH_JOIN_NODE (id=6) ExecOption: Probe Side Codegen Enabled - BuildRows: 1800 - BuildTime: 3127008 - InactiveTotalTime: 0 - LocalTime: 229124811 - NumHashTableBuildsSkipped: 0 - PeakMemoryUsage: 3788056 - ProbeRows: 161244 - ProbeRowsPartitioned: 0 - ProbeTime: 37798897 - RowsReturned: 39967 - RowsReturnedRate: 786 - TotalTime: 50828216871 Hash Join Builder (join_node_id=6) ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 425960 - BuildRowsPartitioned: 1800 - GetNewBlockTime: 1567251 - HashBuckets: 4096 - HashCollisions: 0 - HashTablesBuildTime: 851639 - InactiveTotalTime: 0 - LargestPartitionPercent: 7 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 1135744 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=16) - BytesReceived: 14556 - ConvertRowBatchTime: 412685 - DeserializeRowBatchTimer: 131105 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 1800 - RowsReturnedRate: 3762502 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 478405 HASH_JOIN_NODE (id=5) ExecOption: Probe Side Codegen Enabled - BuildRows: 49 - BuildTime: 708486 - InactiveTotalTime: 0 - LocalTime: 511715968 - NumHashTableBuildsSkipped: 0 - PeakMemoryUsage: 2381456 - ProbeRows: 3139404 - ProbeRowsPartitioned: 0 - ProbeTime: 292854107 - RowsReturned: 161244 - RowsReturnedRate: 3186 - TotalTime: 50598613655 Hash Join Builder (join_node_id=5) ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 60099 - BuildRowsPartitioned: 49 - GetNewBlockTime: 145208 - HashBuckets: 87 - HashCollisions: 0 - HashTablesBuildTime: 228172 - InactiveTotalTime: 0 - LargestPartitionPercent: 12 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 1071600 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=15) - BytesReceived: 827 - ConvertRowBatchTime: 25938 - DeserializeRowBatchTimer: 253560 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 49 - RowsReturnedRate: 1092603 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 44847 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 2:1/12.41 MB 11:1/12.37 MB 6:1/12.37 MB 4:3/36.91 MB 3:1/12.39 MB 10:2/24.40 MB 5:3/37.10 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 12 out of 12 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:96 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 1.0 - BytesRead: 46814167 - BytesReadDataNodeCache: 0 - BytesReadLocal: 46814167 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 46814167 - DecompressionTime: 247904005 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 8 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 7 - NumRowGroups: 12 - NumScannerThreadsStarted: 1 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 20018801 - PerReadThreadRawHdfsThroughput: 260342603 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 49831120096 - RowBatchQueuePutWaitTime: 114161058 - RowsRead: 3139404 - RowsReturned: 3139404 - RowsReturnedRate: 62679 - ScanRangesComplete: 12 - ScannerThreadsInvoluntaryContextSwitches: 9818 - ScannerThreadsTotalWallClockTime: 53224957504 - MaterializeTupleTime(*): 31346526070 - ScannerThreadsSysTime: 220966000 - ScannerThreadsUserTime: 6378031000 - ScannerThreadsVoluntaryContextSwitches: 2126 - TotalRawHdfsReadTime(*): 179817542 - TotalReadThroughput: 372914 - TotalTime: 50086852840 Instance 6c4f4a739317c843:d78929db0000000b (host=redacted-host4:22000) Hdfs split stats (:<# splits>/): 8:1/12.26 MB 6:2/24.68 MB 5:2/24.74 MB 9:1/12.24 MB 11:1/12.34 MB 0:2/24.74 MB 4:3/36.79 MB 7:1/12.26 MB - AverageThreadTokens: 1.3791666666666667 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 32080597 - PerHostPeakMemUsage: 188649285 - RowsProduced: 42085 - TotalNetworkReceiveTime: 71448674869 - TotalNetworkSendTime: 2494734989 - TotalStorageWaitTime: 7497327366 - TotalThreadsInvoluntaryContextSwitches: 11695 - TotalThreadsTotalWallClockTime: 168010028130 - TotalThreadsSysTime: 310953000 - TotalThreadsUserTime: 8481710000 - TotalThreadsVoluntaryContextSwitches: 5735 - TotalTime: 122570677818 Fragment Instance Lifecycle Timings - ExecTime: 45249644381 - ExecTreeExecTime: 41781028377 - InactiveTotalTime: 0 - OpenTime: 76536545938 - ExecTreeOpenTime: 72640360350 - PrepareTime: 784378905 - ExecTreePrepareTime: 77984035 - TotalTime: 0 DataStreamSender (dst_id=18) - BytesSent: 2118733 - InactiveTotalTime: 0 - NetworkThroughput(*): 86590539 - OverallThroughput: 12132188 - PeakMemoryUsage: 245504 - RowsReturned: 42085 - SerializeBatchTime: 149952728 - TotalTime: 174637336 - TransmitDataRPCTime: 24468412 - UncompressedRowBatchSize: 6825935 CodeGen - CodegenTime: 676908 - CompileTime: 755536358 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076168 - NumFunctions: 105 - NumInstructions: 6894 - OptimizationTime: 3115225607 - PeakMemoryUsage: 3529728 - PrepareTime: 249682793 - TotalTime: 4121385762 HASH_JOIN_NODE (id=7) ExecOption: Probe Side Codegen Enabled - BuildRows: 90 - BuildTime: 2850265 - InactiveTotalTime: 0 - LocalTime: 68803901 - NumHashTableBuildsSkipped: 0 - PeakMemoryUsage: 8546976 - ProbeRows: 42085 - ProbeRowsPartitioned: 0 - ProbeTime: 8328542 - RowsReturned: 42085 - RowsReturnedRate: 367 - TotalTime: 114558525065 Hash Join Builder (join_node_id=7) ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 77005 - BuildRowsPartitioned: 90 - GetNewBlockTime: 644818 - HashBuckets: 202 - HashCollisions: 0 - HashTablesBuildTime: 229611 - InactiveTotalTime: 0 - LargestPartitionPercent: 14 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 1062016 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=17) - BytesReceived: 1257 - ConvertRowBatchTime: 31593 - DeserializeRowBatchTimer: 40049 - FirstBatchArrivalWaitTime: 71371785316 - InactiveTotalTime: 71448591363 - PeakMemoryUsage: 0 - RowsReturned: 90 - RowsReturnedRate: 1 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 71448678662 HASH_JOIN_NODE (id=6) ExecOption: Probe Side Codegen Enabled - BuildRows: 1800 - BuildTime: 1585108 - InactiveTotalTime: 0 - LocalTime: 87521796 - NumHashTableBuildsSkipped: 0 - PeakMemoryUsage: 4026720 - ProbeRows: 171975 - ProbeRowsPartitioned: 0 - ProbeTime: 31104338 - RowsReturned: 42085 - RowsReturnedRate: 977 - TotalTime: 43041042502 Hash Join Builder (join_node_id=6) ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 388625 - BuildRowsPartitioned: 1800 - GetNewBlockTime: 207775 - HashBuckets: 4096 - HashCollisions: 0 - HashTablesBuildTime: 778369 - InactiveTotalTime: 0 - LargestPartitionPercent: 7 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 1135744 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=16) - BytesReceived: 14556 - ConvertRowBatchTime: 390865 - DeserializeRowBatchTimer: 8257599 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 1800 - RowsReturnedRate: 3970407 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 453354 HASH_JOIN_NODE (id=5) ExecOption: Probe Side Codegen Enabled - BuildRows: 49 - BuildTime: 7825734 - InactiveTotalTime: 0 - LocalTime: 365999115 - NumHashTableBuildsSkipped: 0 - PeakMemoryUsage: 2379944 - ProbeRows: 3395027 - ProbeRowsPartitioned: 0 - ProbeTime: 283079074 - RowsReturned: 171975 - RowsReturnedRate: 4003 - TotalTime: 42953067352 Hash Join Builder (join_node_id=5) ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 57489 - BuildRowsPartitioned: 49 - GetNewBlockTime: 7183907 - HashBuckets: 87 - HashCollisions: 0 - HashTablesBuildTime: 271531 - InactiveTotalTime: 0 - LargestPartitionPercent: 12 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 1071600 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=15) - BytesReceived: 827 - ConvertRowBatchTime: 32149 - DeserializeRowBatchTimer: 45680 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 49 - RowsReturnedRate: 913838 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 53620 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 8:1/12.26 MB 6:2/24.68 MB 5:2/24.74 MB 9:1/12.24 MB 11:1/12.34 MB 0:2/24.74 MB 4:3/36.79 MB 7:1/12.26 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 13 out of 13 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:104 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 1.0 - BytesRead: 50631712 - BytesReadDataNodeCache: 0 - BytesReadLocal: 50631712 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 50631712 - DecompressionTime: 326921017 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 8 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 8 - NumRowGroups: 13 - NumScannerThreadsStarted: 1 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 15844558 - PerReadThreadRawHdfsThroughput: 284529600 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 42341761012 - RowBatchQueuePutWaitTime: 0 - RowsRead: 3395027 - RowsReturned: 3395027 - RowsReturnedRate: 79719 - ScanRangesComplete: 13 - ScannerThreadsInvoluntaryContextSwitches: 10622 - ScannerThreadsTotalWallClockTime: 46223872444 - MaterializeTupleTime(*): 29478557171 - ScannerThreadsSysTime: 221966000 - ScannerThreadsUserTime: 6774970000 - ScannerThreadsVoluntaryContextSwitches: 2140 - TotalRawHdfsReadTime(*): 177948839 - TotalReadThroughput: 423533 - TotalTime: 42587014617 Instance 6c4f4a739317c843:d78929db0000000f (host=redacted-host2:22000) Hdfs split stats (:<# splits>/): 7:1/12.37 MB 4:1/12.28 MB 0:1/12.34 MB 9:3/36.78 MB 6:1/12.32 MB 1:1/12.39 MB 10:4/49.18 MB - AverageThreadTokens: 1.3760330578512396 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 30919373 - PerHostPeakMemUsage: 230260997 - RowsProduced: 39474 - TotalNetworkReceiveTime: 66716609483 - TotalNetworkSendTime: 1348126810 - TotalStorageWaitTime: 8213429036 - TotalThreadsInvoluntaryContextSwitches: 11045 - TotalThreadsTotalWallClockTime: 166575127849 - TotalThreadsSysTime: 294955000 - TotalThreadsUserTime: 7869804000 - TotalThreadsVoluntaryContextSwitches: 5978 - TotalTime: 121945467709 Fragment Instance Lifecycle Timings - ExecTime: 44544747009 - ExecTreeExecTime: 42074775035 - InactiveTotalTime: 0 - OpenTime: 76128385404 - ExecTreeOpenTime: 68299835219 - PrepareTime: 1272201103 - ExecTreePrepareTime: 186101509 - TotalTime: 0 DataStreamSender (dst_id=18) - BytesSent: 1987559 - InactiveTotalTime: 0 - NetworkThroughput(*): 89968141 - OverallThroughput: 14704548 - PeakMemoryUsage: 261888 - RowsReturned: 39474 - SerializeBatchTime: 112873927 - TotalTime: 135166275 - TransmitDataRPCTime: 22091809 - UncompressedRowBatchSize: 6400960 CodeGen - CodegenTime: 817250 - CompileTime: 3086355709 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076168 - NumFunctions: 105 - NumInstructions: 6894 - OptimizationTime: 4713863947 - PeakMemoryUsage: 3529728 - PrepareTime: 465770541 - TotalTime: 8293193288 HASH_JOIN_NODE (id=7) ExecOption: Probe Side Codegen Enabled - BuildRows: 90 - BuildTime: 21228408 - InactiveTotalTime: 0 - LocalTime: 149895369 - NumHashTableBuildsSkipped: 0 - PeakMemoryUsage: 8486344 - ProbeRows: 39474 - ProbeRowsPartitioned: 0 - ProbeTime: 7413061 - RowsReturned: 39474 - RowsReturnedRate: 356 - TotalTime: 110707832177 Hash Join Builder (join_node_id=7) ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 63748 - BuildRowsPartitioned: 90 - GetNewBlockTime: 130017 - HashBuckets: 202 - HashCollisions: 0 - HashTablesBuildTime: 213660 - InactiveTotalTime: 0 - LargestPartitionPercent: 14 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 1062016 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=17) - BytesReceived: 1257 - ConvertRowBatchTime: 20286 - DeserializeRowBatchTimer: 210876 - FirstBatchArrivalWaitTime: 66624822122 - InactiveTotalTime: 66716553982 - PeakMemoryUsage: 0 - RowsReturned: 90 - RowsReturnedRate: 1 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 66716598943 HASH_JOIN_NODE (id=6) ExecOption: Probe Side Codegen Enabled - BuildRows: 1800 - BuildTime: 1248919 - InactiveTotalTime: 0 - LocalTime: 171661896 - NumHashTableBuildsSkipped: 0 - PeakMemoryUsage: 3955112 - ProbeRows: 161085 - ProbeRowsPartitioned: 0 - ProbeTime: 26957769 - RowsReturned: 39474 - RowsReturnedRate: 900 - TotalTime: 43841337865 Hash Join Builder (join_node_id=6) ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 364331 - BuildRowsPartitioned: 1800 - GetNewBlockTime: 70451 - HashBuckets: 4096 - HashCollisions: 0 - HashTablesBuildTime: 611064 - InactiveTotalTime: 0 - LargestPartitionPercent: 7 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 1135744 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=16) - BytesReceived: 14556 - ConvertRowBatchTime: 353913 - DeserializeRowBatchTimer: 102715 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 1800 - RowsReturnedRate: 4442108 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 405213 HASH_JOIN_NODE (id=5) ExecOption: Probe Side Codegen Enabled - BuildRows: 49 - BuildTime: 10195683 - InactiveTotalTime: 0 - LocalTime: 386283517 - NumHashTableBuildsSkipped: 0 - PeakMemoryUsage: 2380504 - ProbeRows: 3132497 - ProbeRowsPartitioned: 0 - ProbeTime: 262422656 - RowsReturned: 161085 - RowsReturnedRate: 3688 - TotalTime: 43669270756 Hash Join Builder (join_node_id=5) ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 25330 - BuildRowsPartitioned: 49 - GetNewBlockTime: 9661538 - HashBuckets: 87 - HashCollisions: 0 - HashTablesBuildTime: 232381 - InactiveTotalTime: 0 - LargestPartitionPercent: 12 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 1071600 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=15) - BytesReceived: 827 - ConvertRowBatchTime: 13443 - DeserializeRowBatchTimer: 31407 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 49 - RowsReturnedRate: 1602773 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 30572 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 7:1/12.37 MB 4:1/12.28 MB 0:1/12.34 MB 9:3/36.78 MB 6:1/12.32 MB 1:1/12.39 MB 10:4/49.18 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 12 out of 12 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:96 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 1.0 - BytesRead: 46729915 - BytesReadDataNodeCache: 0 - BytesReadLocal: 46729915 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 46729915 - DecompressionTime: 152806916 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 8 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 7 - NumRowGroups: 12 - NumScannerThreadsStarted: 1 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 14604510 - PerReadThreadRawHdfsThroughput: 272965481 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 43079016921 - RowBatchQueuePutWaitTime: 0 - RowsRead: 3132497 - RowsReturned: 3132497 - RowsReturnedRate: 72372 - ScanRangesComplete: 12 - ScannerThreadsInvoluntaryContextSwitches: 10109 - ScannerThreadsTotalWallClockTime: 45902013995 - MaterializeTupleTime(*): 27375317484 - ScannerThreadsSysTime: 201969000 - ScannerThreadsUserTime: 6138067000 - ScannerThreadsVoluntaryContextSwitches: 1910 - TotalRawHdfsReadTime(*): 171193496 - TotalReadThroughput: 389347 - TotalTime: 43282956667 Instance 6c4f4a739317c843:d78929db0000000a (host=redacted-host7:22000) Hdfs split stats (:<# splits>/): 3:1/12.36 MB 6:1/12.41 MB 4:2/24.62 MB 8:2/53.69 MB 0:2/24.55 MB 2:1/12.24 MB - AverageThreadTokens: 1.337837837837838 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 37053280 - PerHostPeakMemUsage: 236515429 - RowsProduced: 37165 - TotalNetworkReceiveTime: 67668768877 - TotalNetworkSendTime: 640471165 - TotalStorageWaitTime: 2899291589 - TotalThreadsInvoluntaryContextSwitches: 9637 - TotalThreadsTotalWallClockTime: 153090979157 - TotalThreadsSysTime: 354946000 - TotalThreadsUserTime: 7532855000 - TotalThreadsVoluntaryContextSwitches: 5741 - TotalTime: 113907260499 Fragment Instance Lifecycle Timings - ExecTime: 39075469473 - ExecTreeExecTime: 37083335102 - InactiveTotalTime: 0 - OpenTime: 74060586220 - ExecTreeOpenTime: 68663066850 - PrepareTime: 771062488 - ExecTreePrepareTime: 138978329 - TotalTime: 0 DataStreamSender (dst_id=18) - BytesSent: 1868724 - InactiveTotalTime: 0 - NetworkThroughput(*): 74313113 - OverallThroughput: 9882131 - PeakMemoryUsage: 245504 - RowsReturned: 37165 - SerializeBatchTime: 163701842 - TotalTime: 189101318 - TransmitDataRPCTime: 25146625 - UncompressedRowBatchSize: 6026723 CodeGen - CodegenTime: 1011080 - CompileTime: 1129157075 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076168 - NumFunctions: 105 - NumInstructions: 6894 - OptimizationTime: 4093733387 - PeakMemoryUsage: 3529728 - PrepareTime: 554096078 - TotalTime: 5777830777 HASH_JOIN_NODE (id=7) ExecOption: Probe Side Codegen Enabled - BuildRows: 90 - BuildTime: 1165236 - InactiveTotalTime: 0 - LocalTime: 38636859 - NumHashTableBuildsSkipped: 0 - PeakMemoryUsage: 8681344 - ProbeRows: 37165 - ProbeRowsPartitioned: 0 - ProbeTime: 8219036 - RowsReturned: 37165 - RowsReturnedRate: 350 - TotalTime: 106021080723 Hash Join Builder (join_node_id=7) ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 54697 - BuildRowsPartitioned: 90 - GetNewBlockTime: 246344 - HashBuckets: 202 - HashCollisions: 0 - HashTablesBuildTime: 207335 - InactiveTotalTime: 0 - LargestPartitionPercent: 14 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 1062016 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=17) - BytesReceived: 1257 - ConvertRowBatchTime: 20931 - DeserializeRowBatchTimer: 376847 - FirstBatchArrivalWaitTime: 67572459064 - InactiveTotalTime: 67668733668 - PeakMemoryUsage: 0 - RowsReturned: 90 - RowsReturnedRate: 1 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 67668778656 HASH_JOIN_NODE (id=6) ExecOption: Probe Side Codegen Enabled - BuildRows: 1800 - BuildTime: 1510131 - InactiveTotalTime: 0 - LocalTime: 129459184 - NumHashTableBuildsSkipped: 0 - PeakMemoryUsage: 4384512 - ProbeRows: 153798 - ProbeRowsPartitioned: 0 - ProbeTime: 29368552 - RowsReturned: 37165 - RowsReturnedRate: 970 - TotalTime: 38313665208 Hash Join Builder (join_node_id=6) ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 334245 - BuildRowsPartitioned: 1800 - GetNewBlockTime: 310985 - HashBuckets: 4096 - HashCollisions: 0 - HashTablesBuildTime: 581880 - InactiveTotalTime: 0 - LargestPartitionPercent: 7 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 1135744 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=16) - BytesReceived: 14556 - ConvertRowBatchTime: 385270 - DeserializeRowBatchTimer: 103474 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 1800 - RowsReturnedRate: 4303625 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 418252 HASH_JOIN_NODE (id=5) ExecOption: Probe Side Codegen Enabled - BuildRows: 49 - BuildTime: 698329 - InactiveTotalTime: 0 - LocalTime: 463181790 - NumHashTableBuildsSkipped: 0 - PeakMemoryUsage: 3101808 - ProbeRows: 2990636 - ProbeRowsPartitioned: 0 - ProbeTime: 269221521 - RowsReturned: 153798 - RowsReturnedRate: 4027 - TotalTime: 38183787772 Hash Join Builder (join_node_id=5) ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 23380 - BuildRowsPartitioned: 49 - GetNewBlockTime: 273065 - HashBuckets: 87 - HashCollisions: 0 - HashTablesBuildTime: 184123 - InactiveTotalTime: 0 - LargestPartitionPercent: 12 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 1071600 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=15) - BytesReceived: 827 - ConvertRowBatchTime: 12169 - DeserializeRowBatchTimer: 46979 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 49 - RowsReturnedRate: 1721291 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 28467 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 3:1/12.36 MB 6:1/12.41 MB 4:2/24.62 MB 8:2/53.69 MB 0:2/24.55 MB 2:1/12.24 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 9 out of 9 Hdfs Read Thread Concurrency Bucket: 0:98.67% 1:1.333% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:72 - AverageHdfsReadThreadConcurrency: 0.013333333333333334 - AverageScannerThreadConcurrency: 1.0 - BytesRead: 44777256 - BytesReadDataNodeCache: 0 - BytesReadLocal: 44777256 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 44777256 - DecompressionTime: 291063198 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 8 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 6 - NumRowGroups: 9 - NumScannerThreadsStarted: 1 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 19852458 - PerReadThreadRawHdfsThroughput: 98011435 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 37186330639 - RowBatchQueuePutWaitTime: 0 - RowsRead: 2990636 - RowsReturned: 2990636 - RowsReturnedRate: 79283 - ScanRangesComplete: 9 - ScannerThreadsInvoluntaryContextSwitches: 8797 - ScannerThreadsTotalWallClockTime: 39954942541 - MaterializeTupleTime(*): 28205520439 - ScannerThreadsSysTime: 242963000 - ScannerThreadsUserTime: 5881106000 - ScannerThreadsVoluntaryContextSwitches: 2156 - TotalRawHdfsReadTime(*): 456857466 - TotalReadThroughput: 403271 - TotalTime: 37720577515 Instance 6c4f4a739317c843:d78929db0000000c (host=redacted-host1:22000) Hdfs split stats (:<# splits>/): 10:1/12.30 MB 3:1/12.38 MB 11:3/36.98 MB 2:1/52.90 MB 8:2/24.66 MB - AverageThreadTokens: 1.3142857142857143 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 55649064 - PerHostPeakMemUsage: 253001132 - RowsProduced: 37161 - TotalNetworkReceiveTime: 66320513350 - TotalNetworkSendTime: 1691949680 - TotalStorageWaitTime: 550765133 - TotalThreadsInvoluntaryContextSwitches: 9470 - TotalThreadsTotalWallClockTime: 138483153695 - TotalThreadsSysTime: 244962000 - TotalThreadsUserTime: 7121918000 - TotalThreadsVoluntaryContextSwitches: 4988 - TotalTime: 106115767288 Fragment Instance Lifecycle Timings - ExecTime: 32499654550 - ExecTreeExecTime: 29662995537 - InactiveTotalTime: 0 - OpenTime: 72573295402 - ExecTreeOpenTime: 67533895761 - PrepareTime: 1029228890 - ExecTreePrepareTime: 174603608 - TotalTime: 0 DataStreamSender (dst_id=18) - BytesSent: 1870239 - InactiveTotalTime: 0 - NetworkThroughput(*): 89464962 - OverallThroughput: 15640385 - PeakMemoryUsage: 261888 - RowsReturned: 37161 - SerializeBatchTime: 98466640 - TotalTime: 119577552 - TransmitDataRPCTime: 20904709 - UncompressedRowBatchSize: 6026565 CodeGen - CodegenTime: 17684001 - CompileTime: 769061402 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076168 - NumFunctions: 105 - NumInstructions: 6894 - OptimizationTime: 4252879570 - PeakMemoryUsage: 3529728 - PrepareTime: 574757714 - TotalTime: 5613253585 HASH_JOIN_NODE (id=7) ExecOption: Probe Side Codegen Enabled - BuildRows: 90 - BuildTime: 8575189 - InactiveTotalTime: 0 - LocalTime: 145023869 - NumHashTableBuildsSkipped: 0 - PeakMemoryUsage: 8489648 - ProbeRows: 37161 - ProbeRowsPartitioned: 0 - ProbeTime: 6949008 - RowsReturned: 37161 - RowsReturnedRate: 381 - TotalTime: 97515979660 Hash Join Builder (join_node_id=7) ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 52797 - BuildRowsPartitioned: 90 - GetNewBlockTime: 7167229 - HashBuckets: 202 - HashCollisions: 0 - HashTablesBuildTime: 397503 - InactiveTotalTime: 0 - LargestPartitionPercent: 14 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 1062016 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=17) - BytesReceived: 1257 - ConvertRowBatchTime: 21172 - DeserializeRowBatchTimer: 55177 - FirstBatchArrivalWaitTime: 66242885633 - InactiveTotalTime: 66320476561 - PeakMemoryUsage: 0 - RowsReturned: 90 - RowsReturnedRate: 1 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 66320524613 HASH_JOIN_NODE (id=6) ExecOption: Probe Side Codegen Enabled - BuildRows: 1800 - BuildTime: 1188664 - InactiveTotalTime: 0 - LocalTime: 155705492 - NumHashTableBuildsSkipped: 0 - PeakMemoryUsage: 4384512 - ProbeRows: 150960 - ProbeRowsPartitioned: 0 - ProbeTime: 26709492 - RowsReturned: 37161 - RowsReturnedRate: 1196 - TotalTime: 31050431178 Hash Join Builder (join_node_id=6) ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 357190 - BuildRowsPartitioned: 1800 - GetNewBlockTime: 41755 - HashBuckets: 4096 - HashCollisions: 0 - HashTablesBuildTime: 570951 - InactiveTotalTime: 0 - LargestPartitionPercent: 7 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 1135744 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=16) - BytesReceived: 14556 - ConvertRowBatchTime: 347178 - DeserializeRowBatchTimer: 131471 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 1800 - RowsReturnedRate: 4767593 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 377549 HASH_JOIN_NODE (id=5) ExecOption: Probe Side Codegen Enabled - BuildRows: 49 - BuildTime: 735779 - InactiveTotalTime: 0 - LocalTime: 348656689 - NumHashTableBuildsSkipped: 0 - PeakMemoryUsage: 3101808 - ProbeRows: 2985944 - ProbeRowsPartitioned: 0 - ProbeTime: 238068238 - RowsReturned: 150960 - RowsReturnedRate: 4886 - TotalTime: 30894348137 Hash Join Builder (join_node_id=5) ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 20396 - BuildRowsPartitioned: 49 - GetNewBlockTime: 292144 - HashBuckets: 87 - HashCollisions: 0 - HashTablesBuildTime: 190891 - InactiveTotalTime: 0 - LargestPartitionPercent: 12 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 1071600 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=15) - BytesReceived: 827 - ConvertRowBatchTime: 12511 - DeserializeRowBatchTimer: 46097 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 49 - RowsReturnedRate: 1663780 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 29451 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 10:1/12.30 MB 3:1/12.38 MB 11:3/36.98 MB 2:1/52.90 MB 8:2/24.66 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 8 out of 8 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:64 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 1.0 - BytesRead: 44818386 - BytesReadDataNodeCache: 0 - BytesReadLocal: 44818386 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 44818386 - DecompressionTime: 291548318 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 8 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 5 - NumRowGroups: 8 - NumScannerThreadsStarted: 1 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 41171241 - PerReadThreadRawHdfsThroughput: 614771710 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 30134355519 - RowBatchQueuePutWaitTime: 0 - RowsRead: 2985944 - RowsReturned: 2985944 - RowsReturnedRate: 97753 - ScanRangesComplete: 8 - ScannerThreadsInvoluntaryContextSwitches: 8615 - ScannerThreadsTotalWallClockTime: 33410226806 - MaterializeTupleTime(*): 24030857246 - ScannerThreadsSysTime: 169974000 - ScannerThreadsUserTime: 5501164000 - ScannerThreadsVoluntaryContextSwitches: 1486 - TotalRawHdfsReadTime(*): 72902486 - TotalReadThroughput: 426727 - TotalTime: 30545661997 Averaged Fragment F03 split sizes: min: 73.73 KB, max: 73.73 KB, avg: 73.73 KB, stddev: 0 completion times: min:40s794ms max:40s794ms mean: 40s794ms stddev:0.000ns execution rates: min:1.81 KB/sec max:1.81 KB/sec mean:1.81 KB/sec stddev:0.80 B/sec num instances: 1 - AverageThreadTokens: 1.9076923076923078 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 329152 - PerHostPeakMemUsage: 199450303 - RowsProduced: 49 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 5140 - TotalStorageWaitTime: 11611145710 - TotalThreadsInvoluntaryContextSwitches: 32 - TotalThreadsTotalWallClockTime: 75206104562 - TotalThreadsSysTime: 4998000 - TotalThreadsUserTime: 95984000 - TotalThreadsVoluntaryContextSwitches: 168 - TotalTime: 40370317533 Fragment Instance Lifecycle Timings - ExecTime: 37095983270 - ExecTreeExecTime: 37010285581 - InactiveTotalTime: 0 - OpenTime: 1139487835 - ExecTreeOpenTime: 189239 - PrepareTime: 2118281411 - ExecTreePrepareTime: 310858 - TotalTime: 0 DataStreamSender (dst_id=15) - BytesSent: 6616 - InactiveTotalTime: 0 - NetworkThroughput(*): 38904373 - OverallThroughput: 6618475 - PeakMemoryUsage: 41920 - RowsReturned: 49 - SerializeBatchTime: 50426 - TotalTime: 999626 - TransmitDataRPCTime: 170058 - UncompressedRowBatchSize: 14136 CodeGen - CodegenTime: 2971490 - CompileTime: 374174702 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076168 - NumFunctions: 36 - NumInstructions: 545 - OptimizationTime: 635949329 - PeakMemoryUsage: 279040 - PrepareTime: 1222714808 - TotalTime: 2420013058 HDFS_SCAN_NODE (id=2) - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 1.0 - BytesRead: 80719 - BytesReadDataNodeCache: 0 - BytesReadLocal: 80719 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 80719 - DecompressionTime: 11030 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 1 - NumRowGroups: 1 - NumScannerThreadsStarted: 1 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 151585 - PerReadThreadRawHdfsThroughput: 2050891813 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 36970059516 - RowBatchQueuePutWaitTime: 0 - RowsRead: 804 - RowsReturned: 49 - RowsReturnedRate: 1 - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 36970652810 - MaterializeTupleTime(*): 42093798 - ScannerThreadsSysTime: 1999000 - ScannerThreadsUserTime: 1999000 - ScannerThreadsVoluntaryContextSwitches: 25 - TotalRawHdfsReadTime(*): 39358 - TotalReadThroughput: 2482 - TotalTime: 37011177144 Fragment F03 Instance 6c4f4a739317c843:d78929db00000007 (host=redacted-host8:22000) Hdfs split stats (:<# splits>/): 8:1/73.73 KB - AverageThreadTokens: 1.9076923076923078 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 329152 - PerHostPeakMemUsage: 199450303 - RowsProduced: 49 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 5140 - TotalStorageWaitTime: 11611145710 - TotalThreadsInvoluntaryContextSwitches: 32 - TotalThreadsTotalWallClockTime: 75206104562 - TotalThreadsSysTime: 4998000 - TotalThreadsUserTime: 95984000 - TotalThreadsVoluntaryContextSwitches: 168 - TotalTime: 40370317533 Fragment Instance Lifecycle Timings - ExecTime: 37095983270 - ExecTreeExecTime: 37010285581 - InactiveTotalTime: 0 - OpenTime: 1139487835 - ExecTreeOpenTime: 189239 - PrepareTime: 2118281411 - ExecTreePrepareTime: 310858 - TotalTime: 0 DataStreamSender (dst_id=15) - BytesSent: 6616 - InactiveTotalTime: 0 - NetworkThroughput(*): 38904373 - OverallThroughput: 6618475 - PeakMemoryUsage: 41920 - RowsReturned: 49 - SerializeBatchTime: 50426 - TotalTime: 999626 - TransmitDataRPCTime: 170058 - UncompressedRowBatchSize: 14136 CodeGen - CodegenTime: 2971490 - CompileTime: 374174702 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076168 - NumFunctions: 36 - NumInstructions: 545 - OptimizationTime: 635949329 - PeakMemoryUsage: 279040 - PrepareTime: 1222714808 - TotalTime: 2420013058 HDFS_SCAN_NODE (id=2) Hdfs split stats (:<# splits>/): 8:1/73.73 KB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:2 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 1.0 - BytesRead: 80719 - BytesReadDataNodeCache: 0 - BytesReadLocal: 80719 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 80719 - DecompressionTime: 11030 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 1 - NumRowGroups: 1 - NumScannerThreadsStarted: 1 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 151585 - PerReadThreadRawHdfsThroughput: 2050891813 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 36970059516 - RowBatchQueuePutWaitTime: 0 - RowsRead: 804 - RowsReturned: 49 - RowsReturnedRate: 1 - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 36970652810 - MaterializeTupleTime(*): 42093798 - ScannerThreadsSysTime: 1999000 - ScannerThreadsUserTime: 1999000 - ScannerThreadsVoluntaryContextSwitches: 25 - TotalRawHdfsReadTime(*): 39358 - TotalReadThroughput: 2482 - TotalTime: 37011177144 Averaged Fragment F04 split sizes: min: 41.55 KB, max: 41.55 KB, avg: 41.55 KB, stddev: 0 completion times: min:15s634ms max:15s634ms mean: 15s634ms stddev:0.000ns execution rates: min:2.66 KB/sec max:2.66 KB/sec mean:2.66 KB/sec stddev:0.61 B/sec num instances: 1 - AverageThreadTokens: 1.206896551724138 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 468670 - PerHostPeakMemUsage: 27249008 - RowsProduced: 1800 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 10418198417 - TotalStorageWaitTime: 1972224079 - TotalThreadsInvoluntaryContextSwitches: 27 - TotalThreadsTotalWallClockTime: 17451091059 - TotalThreadsSysTime: 17998000 - TotalThreadsUserTime: 70990000 - TotalThreadsVoluntaryContextSwitches: 123 - TotalTime: 14952138248 Fragment Instance Lifecycle Timings - ExecTime: 13712868838 - ExecTreeExecTime: 3252502100 - InactiveTotalTime: 0 - OpenTime: 502989866 - ExecTreeOpenTime: 122563 - PrepareTime: 736210333 - ExecTreePrepareTime: 196471 - TotalTime: 0 DataStreamSender (dst_id=16) - BytesSent: 116448 - InactiveTotalTime: 0 - NetworkThroughput(*): 99119105 - OverallThroughput: 6974366 - PeakMemoryUsage: 61632 - RowsReturned: 1800 - SerializeBatchTime: 1013597 - TotalTime: 16696571 - TransmitDataRPCTime: 1174829 - UncompressedRowBatchSize: 302464 CodeGen - CodegenTime: 5652704 - CompileTime: 157700786 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076168 - NumFunctions: 15 - NumInstructions: 279 - OptimizationTime: 312879699 - PeakMemoryUsage: 142848 - PrepareTime: 467051618 - TotalTime: 978417527 HDFS_SCAN_NODE (id=3) - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.2222222222222222 - BytesRead: 83413 - BytesReadDataNodeCache: 0 - BytesReadLocal: 83413 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 83413 - DecompressionTime: 493827 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 3 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 1 - NumRowGroups: 1 - NumScannerThreadsStarted: 1 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 388316 - PerReadThreadRawHdfsThroughput: 1594224226 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 3211068990 - RowBatchQueuePutWaitTime: 0 - RowsRead: 7200 - RowsReturned: 1800 - RowsReturnedRate: 553 - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 2 - ScannerThreadsTotalWallClockTime: 3235248452 - MaterializeTupleTime(*): 5932459 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 7999000 - ScannerThreadsVoluntaryContextSwitches: 40 - TotalRawHdfsReadTime(*): 52322 - TotalReadThroughput: 5751 - TotalTime: 3253054600 Fragment F04 Instance 6c4f4a739317c843:d78929db00000008 (host=redacted-host6:22000) Hdfs split stats (:<# splits>/): 7:1/41.55 KB - AverageThreadTokens: 1.206896551724138 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 468670 - PerHostPeakMemUsage: 27249008 - RowsProduced: 1800 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 10418198417 - TotalStorageWaitTime: 1972224079 - TotalThreadsInvoluntaryContextSwitches: 27 - TotalThreadsTotalWallClockTime: 17451091059 - TotalThreadsSysTime: 17998000 - TotalThreadsUserTime: 70990000 - TotalThreadsVoluntaryContextSwitches: 123 - TotalTime: 14952138248 Fragment Instance Lifecycle Timings - ExecTime: 13712868838 - ExecTreeExecTime: 3252502100 - InactiveTotalTime: 0 - OpenTime: 502989866 - ExecTreeOpenTime: 122563 - PrepareTime: 736210333 - ExecTreePrepareTime: 196471 - TotalTime: 0 DataStreamSender (dst_id=16) - BytesSent: 116448 - InactiveTotalTime: 0 - NetworkThroughput(*): 99119105 - OverallThroughput: 6974366 - PeakMemoryUsage: 61632 - RowsReturned: 1800 - SerializeBatchTime: 1013597 - TotalTime: 16696571 - TransmitDataRPCTime: 1174829 - UncompressedRowBatchSize: 302464 CodeGen - CodegenTime: 5652704 - CompileTime: 157700786 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076168 - NumFunctions: 15 - NumInstructions: 279 - OptimizationTime: 312879699 - PeakMemoryUsage: 142848 - PrepareTime: 467051618 - TotalTime: 978417527 HDFS_SCAN_NODE (id=3) Hdfs split stats (:<# splits>/): 7:1/41.55 KB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:3 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.2222222222222222 - BytesRead: 83413 - BytesReadDataNodeCache: 0 - BytesReadLocal: 83413 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 83413 - DecompressionTime: 493827 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 3 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 1 - NumRowGroups: 1 - NumScannerThreadsStarted: 1 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 388316 - PerReadThreadRawHdfsThroughput: 1594224226 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 3211068990 - RowBatchQueuePutWaitTime: 0 - RowsRead: 7200 - RowsReturned: 1800 - RowsReturnedRate: 553 - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 2 - ScannerThreadsTotalWallClockTime: 3235248452 - MaterializeTupleTime(*): 5932459 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 7999000 - ScannerThreadsVoluntaryContextSwitches: 40 - TotalRawHdfsReadTime(*): 52322 - TotalReadThroughput: 5751 - TotalTime: 3253054600 Averaged Fragment F05 split sizes: min: 2.15 MB, max: 2.15 MB, avg: 2.15 MB, stddev: 0 completion times: min:1m1s max:1m1s mean: 1m1s stddev:0.000ns execution rates: min:35.63 KB/sec max:35.63 KB/sec mean:35.63 KB/sec stddev:0.21 B/sec num instances: 1 - AverageThreadTokens: 1.9339622641509433 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 4482459 - PerHostPeakMemUsage: 204686637 - RowsProduced: 90 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 5535 - TotalStorageWaitTime: 26943877858 - TotalThreadsInvoluntaryContextSwitches: 164 - TotalThreadsTotalWallClockTime: 117108396707 - TotalThreadsSysTime: 9998000 - TotalThreadsUserTime: 183972000 - TotalThreadsVoluntaryContextSwitches: 274 - TotalTime: 61423451721 Fragment Instance Lifecycle Timings - ExecTime: 57601026524 - ExecTreeExecTime: 57533699939 - InactiveTotalTime: 0 - OpenTime: 1974939501 - ExecTreeOpenTime: 205839 - PrepareTime: 1847382413 - ExecTreePrepareTime: 433329 - TotalTime: 0 DataStreamSender (dst_id=17) - BytesSent: 10056 - InactiveTotalTime: 0 - NetworkThroughput(*): 39313960 - OverallThroughput: 22072380 - PeakMemoryUsage: 41920 - RowsReturned: 90 - SerializeBatchTime: 88542 - TotalTime: 455592 - TransmitDataRPCTime: 255787 - UncompressedRowBatchSize: 28112 CodeGen - CodegenTime: 4773709 - CompileTime: 352773474 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076168 - NumFunctions: 46 - NumInstructions: 773 - OptimizationTime: 1217025218 - PeakMemoryUsage: 395776 - PrepareTime: 1357647005 - TotalTime: 3012957262 HDFS_SCAN_NODE (id=1) - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 1.0 - BytesRead: 835696 - BytesReadDataNodeCache: 0 - BytesReadLocal: 835696 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 835696 - DecompressionTime: 41284803 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 1 - NumRowGroups: 1 - NumScannerThreadsStarted: 1 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 4429429 - PerReadThreadRawHdfsThroughput: 163863310 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 57473336779 - RowBatchQueuePutWaitTime: 0 - RowsRead: 73049 - RowsReturned: 90 - RowsReturnedRate: 1 - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 95 - ScannerThreadsTotalWallClockTime: 57532448794 - MaterializeTupleTime(*): 103593364 - ScannerThreadsSysTime: 3999000 - ScannerThreadsUserTime: 51992000 - ScannerThreadsVoluntaryContextSwitches: 63 - TotalRawHdfsReadTime(*): 5099958 - TotalReadThroughput: 8965 - TotalTime: 57534931664 Fragment F05 Instance 6c4f4a739317c843:d78929db00000009 (host=redacted-host8:22000) Hdfs split stats (:<# splits>/): 11:1/2.15 MB - AverageThreadTokens: 1.9339622641509433 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 4482459 - PerHostPeakMemUsage: 204686637 - RowsProduced: 90 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 5535 - TotalStorageWaitTime: 26943877858 - TotalThreadsInvoluntaryContextSwitches: 164 - TotalThreadsTotalWallClockTime: 117108396707 - TotalThreadsSysTime: 9998000 - TotalThreadsUserTime: 183972000 - TotalThreadsVoluntaryContextSwitches: 274 - TotalTime: 61423451721 Fragment Instance Lifecycle Timings - ExecTime: 57601026524 - ExecTreeExecTime: 57533699939 - InactiveTotalTime: 0 - OpenTime: 1974939501 - ExecTreeOpenTime: 205839 - PrepareTime: 1847382413 - ExecTreePrepareTime: 433329 - TotalTime: 0 DataStreamSender (dst_id=17) - BytesSent: 10056 - InactiveTotalTime: 0 - NetworkThroughput(*): 39313960 - OverallThroughput: 22072380 - PeakMemoryUsage: 41920 - RowsReturned: 90 - SerializeBatchTime: 88542 - TotalTime: 455592 - TransmitDataRPCTime: 255787 - UncompressedRowBatchSize: 28112 CodeGen - CodegenTime: 4773709 - CompileTime: 352773474 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076168 - NumFunctions: 46 - NumInstructions: 773 - OptimizationTime: 1217025218 - PeakMemoryUsage: 395776 - PrepareTime: 1357647005 - TotalTime: 3012957262 HDFS_SCAN_NODE (id=1) Hdfs split stats (:<# splits>/): 11:1/2.15 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:2 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 1.0 - BytesRead: 835696 - BytesReadDataNodeCache: 0 - BytesReadLocal: 835696 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 835696 - DecompressionTime: 41284803 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 1 - NumRowGroups: 1 - NumScannerThreadsStarted: 1 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 4429429 - PerReadThreadRawHdfsThroughput: 163863310 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 57473336779 - RowBatchQueuePutWaitTime: 0 - RowsRead: 73049 - RowsReturned: 90 - RowsReturnedRate: 1 - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 95 - ScannerThreadsTotalWallClockTime: 57532448794 - MaterializeTupleTime(*): 103593364 - ScannerThreadsSysTime: 3999000 - ScannerThreadsUserTime: 51992000 - ScannerThreadsVoluntaryContextSwitches: 63 - TotalRawHdfsReadTime(*): 5099958 - TotalReadThroughput: 8965 - TotalTime: 57534931664 Averaged Fragment F06 split sizes: min: 5.88 MB, max: 11.77 MB, avg: 6.81 MB, stddev: 2.02 MB completion times: min:26s738ms max:51s667ms mean: 37s710ms stddev:8s566ms execution rates: min:119.68 KB/sec max:289.57 KB/sec mean:191.60 KB/sec stddev:54.96 KB/sec num instances: 7 - AverageThreadTokens: 1.7682555648369893 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 8607026 - PerHostPeakMemUsage: 72658856 - RowsProduced: 357142 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 25958426139 - TotalStorageWaitTime: 4064332199 - TotalThreadsInvoluntaryContextSwitches: 926 - TotalThreadsTotalWallClockTime: 64550596020 - TotalThreadsSysTime: 23853285 - TotalThreadsUserTime: 895435000 - TotalThreadsVoluntaryContextSwitches: 450 - TotalTime: 37156459087 Fragment Instance Lifecycle Timings - ExecTime: 35748044290 - ExecTreeExecTime: 8341933286 - InactiveTotalTime: 0 - OpenTime: 365215155 - ExecTreeOpenTime: 162868 - PrepareTime: 1042953893 - ExecTreePrepareTime: 1120853 - TotalTime: 0 DataStreamSender (dst_id=19) - BytesSent: 6952043 - InactiveTotalTime: 0 - NetworkThroughput(*): 126941739 - OverallThroughput: 13025089 - PeakMemoryUsage: 339172 - RowsReturned: 357142 - SerializeBatchTime: 493397998 - TotalTime: 549531919 - TransmitDataRPCTime: 55609393 - UncompressedRowBatchSize: 13460325 CodeGen - CodegenTime: 10396756 - CompileTime: 63653184 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076168 - NumFunctions: 5 - NumInstructions: 98 - OptimizationTime: 252252959 - PeakMemoryUsage: 50176 - PrepareTime: 703412299 - TotalTime: 1064617445 HDFS_SCAN_NODE (id=4) - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.8095177822051705 - BytesRead: 2098519 - BytesReadDataNodeCache: 0 - BytesReadLocal: 2098519 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 2098519 - DecompressionTime: 34121836 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 1 - NumRowGroups: 1 - NumScannerThreadsStarted: 1 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 8268473 - PerReadThreadRawHdfsThroughput: 450239675 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 8221913860 - RowBatchQueuePutWaitTime: 19358347638 - RowsRead: 357142 - RowsReturned: 357142 - RowsReturnedRate: 324261 - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 90 - ScannerThreadsTotalWallClockTime: 28437356920 - MaterializeTupleTime(*): 530622303 - ScannerThreadsSysTime: 6141571 - ScannerThreadsUserTime: 193827428 - ScannerThreadsVoluntaryContextSwitches: 260 - TotalRawHdfsReadTime(*): 6550164 - TotalReadThroughput: 61949 - TotalTime: 8342116706 Fragment F06 Instance 6c4f4a739317c843:d78929db00000017 (host=redacted-host2:22000) Hdfs split stats (:<# splits>/): 3:1/6.04 MB - AverageThreadTokens: 1.4158415841584158 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 8545684 - PerHostPeakMemUsage: 60000094 - RowsProduced: 316666 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 46972679285 - TotalStorageWaitTime: 657713271 - TotalThreadsInvoluntaryContextSwitches: 680 - TotalThreadsTotalWallClockTime: 71785260613 - TotalThreadsSysTime: 18997000 - TotalThreadsUserTime: 802877000 - TotalThreadsVoluntaryContextSwitches: 418 - TotalTime: 51328934125 Fragment Instance Lifecycle Timings - ExecTime: 49787793806 - ExecTreeExecTime: 1599868185 - InactiveTotalTime: 0 - OpenTime: 346105770 - ExecTreeOpenTime: 144465 - PrepareTime: 1194943495 - ExecTreePrepareTime: 231022 - TotalTime: 0 DataStreamSender (dst_id=19) - BytesSent: 6153460 - InactiveTotalTime: 0 - NetworkThroughput(*): 132687736 - OverallThroughput: 13033649 - PeakMemoryUsage: 312256 - RowsReturned: 316666 - SerializeBatchTime: 424196322 - TotalTime: 472121020 - TransmitDataRPCTime: 46375499 - UncompressedRowBatchSize: 11935494 CodeGen - CodegenTime: 662983 - CompileTime: 56387264 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076168 - NumFunctions: 5 - NumInstructions: 98 - OptimizationTime: 221183919 - PeakMemoryUsage: 50176 - PrepareTime: 1044214121 - TotalTime: 1337256714 HDFS_SCAN_NODE (id=4) Hdfs split stats (:<# splits>/): 3:1/6.04 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:2 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.42857142857142855 - BytesRead: 1858729 - BytesReadDataNodeCache: 0 - BytesReadLocal: 1858729 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1858729 - DecompressionTime: 37336634 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 1 - NumRowGroups: 1 - NumScannerThreadsStarted: 1 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 8233005 - PerReadThreadRawHdfsThroughput: 979036401 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 1517805383 - RowBatchQueuePutWaitTime: 19433059005 - RowsRead: 316666 - RowsReturned: 316666 - RowsReturnedRate: 197988 - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 62 - ScannerThreadsTotalWallClockTime: 21651378832 - MaterializeTupleTime(*): 509627148 - ScannerThreadsSysTime: 5999000 - ScannerThreadsUserTime: 177972000 - ScannerThreadsVoluntaryContextSwitches: 255 - TotalRawHdfsReadTime(*): 1898529 - TotalReadThroughput: 36799 - TotalTime: 1599418042 Instance 6c4f4a739317c843:d78929db00000012 (host=redacted-host6:22000) Hdfs split stats (:<# splits>/): 6:1/6.04 MB - AverageThreadTokens: 1.9523809523809523 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 8570273 - PerHostPeakMemUsage: 63079921 - RowsProduced: 316666 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 23304447892 - TotalStorageWaitTime: 14910456756 - TotalThreadsInvoluntaryContextSwitches: 925 - TotalThreadsTotalWallClockTime: 85562306752 - TotalThreadsSysTime: 72989000 - TotalThreadsUserTime: 818876000 - TotalThreadsVoluntaryContextSwitches: 548 - TotalTime: 44438474852 Fragment Instance Lifecycle Timings - ExecTime: 43443462595 - ExecTreeExecTime: 18194851862 - InactiveTotalTime: 0 - OpenTime: 293861166 - ExecTreeOpenTime: 213232 - PrepareTime: 701020982 - ExecTreePrepareTime: 235171 - TotalTime: 0 DataStreamSender (dst_id=19) - BytesSent: 6152661 - InactiveTotalTime: 0 - NetworkThroughput(*): 86184110 - OverallThroughput: 8569164 - PeakMemoryUsage: 336832 - RowsReturned: 316666 - SerializeBatchTime: 646166590 - TotalTime: 718000135 - TransmitDataRPCTime: 71389737 - UncompressedRowBatchSize: 11933566 CodeGen - CodegenTime: 857754 - CompileTime: 7126951 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076168 - NumFunctions: 5 - NumInstructions: 98 - OptimizationTime: 283319778 - PeakMemoryUsage: 50176 - PrepareTime: 337176218 - TotalTime: 712216502 HDFS_SCAN_NODE (id=4) Hdfs split stats (:<# splits>/): 6:1/6.04 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:2 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.963855421686747 - BytesRead: 1857986 - BytesReadDataNodeCache: 0 - BytesReadLocal: 1857986 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1857986 - DecompressionTime: 29345307 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 1 - NumRowGroups: 1 - NumScannerThreadsStarted: 1 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 8233018 - PerReadThreadRawHdfsThroughput: 709008830 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 18015603220 - RowBatchQueuePutWaitTime: 22850269913 - RowsRead: 316666 - RowsReturned: 316666 - RowsReturnedRate: 17405 - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 63 - ScannerThreadsTotalWallClockTime: 41825008142 - MaterializeTupleTime(*): 447633827 - ScannerThreadsSysTime: 18997000 - ScannerThreadsUserTime: 180973000 - ScannerThreadsVoluntaryContextSwitches: 282 - TotalRawHdfsReadTime(*): 2620540 - TotalReadThroughput: 44228 - TotalTime: 18193836404 Instance 6c4f4a739317c843:d78929db00000018 (host=redacted-host4:22000) Hdfs split stats (:<# splits>/): 7:1/5.89 MB 6:1/5.89 MB - AverageThreadTokens: 1.9390243902439024 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 8867265 - PerHostPeakMemUsage: 22720870 - RowsProduced: 616667 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 38388596527 - TotalStorageWaitTime: 234282018 - TotalThreadsInvoluntaryContextSwitches: 1925 - TotalThreadsTotalWallClockTime: 80174691585 - TotalThreadsSysTime: 24996000 - TotalThreadsUserTime: 1525767000 - TotalThreadsVoluntaryContextSwitches: 671 - TotalTime: 41537134549 Fragment Instance Lifecycle Timings - ExecTime: 41063984788 - ExecTreeExecTime: 576813900 - InactiveTotalTime: 0 - OpenTime: 65214861 - ExecTreeOpenTime: 133731 - PrepareTime: 407165399 - ExecTreePrepareTime: 3399066 - TotalTime: 0 DataStreamSender (dst_id=19) - BytesSent: 12002775 - InactiveTotalTime: 0 - NetworkThroughput(*): 133751649 - OverallThroughput: 13286205 - PeakMemoryUsage: 353216 - RowsReturned: 616667 - SerializeBatchTime: 813170183 - TotalTime: 903401255 - TransmitDataRPCTime: 89739267 - UncompressedRowBatchSize: 23241438 CodeGen - CodegenTime: 740051 - CompileTime: 15282939 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076168 - NumFunctions: 5 - NumInstructions: 98 - OptimizationTime: 43141091 - PeakMemoryUsage: 50176 - PrepareTime: 176968838 - TotalTime: 284478210 HDFS_SCAN_NODE (id=4) Hdfs split stats (:<# splits>/): 7:1/5.89 MB 6:1/5.89 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 2 out of 2 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:4 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.9506172839506173 - BytesRead: 3628278 - BytesReadDataNodeCache: 0 - BytesReadLocal: 3628278 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 3628278 - DecompressionTime: 62433299 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 2 - NumRowGroups: 2 - NumScannerThreadsStarted: 1 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 8513757 - PerReadThreadRawHdfsThroughput: 265061893 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 313764628 - RowBatchQueuePutWaitTime: 37730821454 - RowsRead: 616667 - RowsReturned: 616667 - RowsReturnedRate: 1068373 - ScanRangesComplete: 2 - ScannerThreadsInvoluntaryContextSwitches: 80 - ScannerThreadsTotalWallClockTime: 39045513778 - MaterializeTupleTime(*): 491981249 - ScannerThreadsSysTime: 3999000 - ScannerThreadsUserTime: 329949000 - ScannerThreadsVoluntaryContextSwitches: 484 - TotalRawHdfsReadTime(*): 13688418 - TotalReadThroughput: 88455 - TotalTime: 577201887 Instance 6c4f4a739317c843:d78929db00000016 (host=redacted-host8:22000) Hdfs split stats (:<# splits>/): 10:1/5.88 MB - AverageThreadTokens: 1.8548387096774193 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 8538844 - PerHostPeakMemUsage: 198964755 - RowsProduced: 308334 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 581561126 - TotalStorageWaitTime: 10025786760 - TotalThreadsInvoluntaryContextSwitches: 1239 - TotalThreadsTotalWallClockTime: 70950123266 - TotalThreadsSysTime: 16997000 - TotalThreadsUserTime: 770883000 - TotalThreadsVoluntaryContextSwitches: 301 - TotalTime: 38936303038 Fragment Instance Lifecycle Timings - ExecTime: 35389195131 - ExecTreeExecTime: 33500335257 - InactiveTotalTime: 0 - OpenTime: 1105582411 - ExecTreeOpenTime: 231665 - PrepareTime: 2441423568 - ExecTreePrepareTime: 3372986 - TotalTime: 0 DataStreamSender (dst_id=19) - BytesSent: 6004425 - InactiveTotalTime: 0 - NetworkThroughput(*): 132436871 - OverallThroughput: 11777867 - PeakMemoryUsage: 345024 - RowsReturned: 308334 - SerializeBatchTime: 464179121 - TotalTime: 509805772 - TransmitDataRPCTime: 45338016 - UncompressedRowBatchSize: 11622932 CodeGen - CodegenTime: 68114041 - CompileTime: 293246628 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076168 - NumFunctions: 5 - NumInstructions: 98 - OptimizationTime: 754645231 - PeakMemoryUsage: 50176 - PrepareTime: 1508804306 - TotalTime: 2629316556 HDFS_SCAN_NODE (id=4) Hdfs split stats (:<# splits>/): 10:1/5.88 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:2 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.9636363636363636 - BytesRead: 1814021 - BytesReadDataNodeCache: 0 - BytesReadLocal: 1814021 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1814021 - DecompressionTime: 13023047 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 1 - NumRowGroups: 1 - NumScannerThreadsStarted: 1 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 8200565 - PerReadThreadRawHdfsThroughput: 407281909 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 33379451959 - RowBatchQueuePutWaitTime: 35022370 - RowsRead: 308334 - RowsReturned: 308334 - RowsReturnedRate: 9202 - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 239 - ScannerThreadsTotalWallClockTime: 34455371713 - MaterializeTupleTime(*): 861926858 - ScannerThreadsSysTime: 4999000 - ScannerThreadsUserTime: 160976000 - ScannerThreadsVoluntaryContextSwitches: 127 - TotalRawHdfsReadTime(*): 4453969 - TotalReadThroughput: 58496 - TotalTime: 33506520109 Instance 6c4f4a739317c843:d78929db00000014 (host=redacted-host3:22000) Hdfs split stats (:<# splits>/): 9:1/6.04 MB - AverageThreadTokens: 1.7627118644067796 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 8586598 - PerHostPeakMemUsage: 56067305 - RowsProduced: 316667 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 25195743124 - TotalStorageWaitTime: 1733643904 - TotalThreadsInvoluntaryContextSwitches: 530 - TotalThreadsTotalWallClockTime: 51826566081 - TotalThreadsSysTime: 12997000 - TotalThreadsUserTime: 782881000 - TotalThreadsVoluntaryContextSwitches: 448 - TotalTime: 29838915845 Fragment Instance Lifecycle Timings - ExecTime: 28678011031 - ExecTreeExecTime: 2311276616 - InactiveTotalTime: 0 - OpenTime: 241052563 - ExecTreeOpenTime: 154556 - PrepareTime: 919458221 - ExecTreePrepareTime: 224328 - TotalTime: 0 DataStreamSender (dst_id=19) - BytesSent: 6159622 - InactiveTotalTime: 0 - NetworkThroughput(*): 134376716 - OverallThroughput: 13409120 - PeakMemoryUsage: 353216 - RowsReturned: 316667 - SerializeBatchTime: 413225339 - TotalTime: 459360636 - TransmitDataRPCTime: 45838462 - UncompressedRowBatchSize: 11934522 CodeGen - CodegenTime: 797619 - CompileTime: 11764880 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076168 - NumFunctions: 5 - NumInstructions: 98 - OptimizationTime: 197522489 - PeakMemoryUsage: 50176 - PrepareTime: 657835021 - TotalTime: 928467758 HDFS_SCAN_NODE (id=4) Hdfs split stats (:<# splits>/): 9:1/6.04 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:2 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.8035714285714286 - BytesRead: 1857941 - BytesReadDataNodeCache: 0 - BytesReadLocal: 1857941 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1857941 - DecompressionTime: 43223435 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 1 - NumRowGroups: 1 - NumScannerThreadsStarted: 1 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 8232959 - PerReadThreadRawHdfsThroughput: 276162591 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 2258110839 - RowBatchQueuePutWaitTime: 19835894202 - RowsRead: 316667 - RowsReturned: 316667 - RowsReturnedRate: 137019 - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 87 - ScannerThreadsTotalWallClockTime: 22907519279 - MaterializeTupleTime(*): 754683123 - ScannerThreadsSysTime: 2999000 - ScannerThreadsUserTime: 177973000 - ScannerThreadsVoluntaryContextSwitches: 254 - TotalRawHdfsReadTime(*): 6727707 - TotalReadThroughput: 62940 - TotalTime: 2311108220 Instance 6c4f4a739317c843:d78929db00000015 (host=redacted-host7:22000) Hdfs split stats (:<# splits>/): 9:1/5.89 MB - AverageThreadTokens: 1.7222222222222223 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 8570276 - PerHostPeakMemUsage: 54789825 - RowsProduced: 308333 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 24713686530 - TotalStorageWaitTime: 130737801 - TotalThreadsInvoluntaryContextSwitches: 579 - TotalThreadsTotalWallClockTime: 46639836157 - TotalThreadsSysTime: 8999000 - TotalThreadsUserTime: 763883000 - TotalThreadsVoluntaryContextSwitches: 398 - TotalTime: 27722002267 Fragment Instance Lifecycle Timings - ExecTime: 26467497353 - ExecTreeExecTime: 472168421 - InactiveTotalTime: 0 - OpenTime: 258261058 - ExecTreeOpenTime: 146031 - PrepareTime: 996154723 - ExecTreePrepareTime: 205549 - TotalTime: 0 DataStreamSender (dst_id=19) - BytesSent: 5999981 - InactiveTotalTime: 0 - NetworkThroughput(*): 133832946 - OverallThroughput: 15567071 - PeakMemoryUsage: 336832 - RowsReturned: 308333 - SerializeBatchTime: 340328255 - TotalTime: 385427728 - TransmitDataRPCTime: 44831868 - UncompressedRowBatchSize: 11619756 CodeGen - CodegenTime: 703007 - CompileTime: 30643429 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076168 - NumFunctions: 5 - NumInstructions: 98 - OptimizationTime: 134349285 - PeakMemoryUsage: 50176 - PrepareTime: 741767923 - TotalTime: 938712016 HDFS_SCAN_NODE (id=4) Hdfs split stats (:<# splits>/): 9:1/5.89 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:2 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.7647058823529411 - BytesRead: 1814616 - BytesReadDataNodeCache: 0 - BytesReadLocal: 1814616 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1814616 - DecompressionTime: 49159394 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 1 - NumRowGroups: 1 - NumScannerThreadsStarted: 1 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 8233021 - PerReadThreadRawHdfsThroughput: 350466702 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 415717253 - RowBatchQueuePutWaitTime: 18520443336 - RowsRead: 308333 - RowsReturned: 308333 - RowsReturnedRate: 657625 - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 66 - ScannerThreadsTotalWallClockTime: 19914097524 - MaterializeTupleTime(*): 447924787 - ScannerThreadsSysTime: 3999000 - ScannerThreadsUserTime: 161975000 - ScannerThreadsVoluntaryContextSwitches: 219 - TotalRawHdfsReadTime(*): 5177713 - TotalReadThroughput: 68445 - TotalTime: 468858042 Instance 6c4f4a739317c843:d78929db00000013 (host=redacted-host1:22000) Hdfs split stats (:<# splits>/): 8:1/6.04 MB - AverageThreadTokens: 1.7307692307692308 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 8570244 - PerHostPeakMemUsage: 52989225 - RowsProduced: 316667 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 22552268491 - TotalStorageWaitTime: 757704885 - TotalThreadsInvoluntaryContextSwitches: 608 - TotalThreadsTotalWallClockTime: 44915387686 - TotalThreadsSysTime: 10998000 - TotalThreadsUserTime: 802878000 - TotalThreadsVoluntaryContextSwitches: 370 - TotalTime: 26293448936 Fragment Instance Lifecycle Timings - ExecTime: 25406365328 - ExecTreeExecTime: 1738218763 - InactiveTotalTime: 0 - OpenTime: 246428256 - ExecTreeOpenTime: 116398 - PrepareTime: 640510864 - ExecTreePrepareTime: 177854 - TotalTime: 0 DataStreamSender (dst_id=19) - BytesSent: 6191381 - InactiveTotalTime: 0 - NetworkThroughput(*): 135322148 - OverallThroughput: 15532548 - PeakMemoryUsage: 336832 - RowsReturned: 316667 - SerializeBatchTime: 352520179 - TotalTime: 398606888 - TransmitDataRPCTime: 45752902 - UncompressedRowBatchSize: 11934572 CodeGen - CodegenTime: 901842 - CompileTime: 31120200 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076168 - NumFunctions: 5 - NumInstructions: 98 - OptimizationTime: 131608922 - PeakMemoryUsage: 50176 - PrepareTime: 457119670 - TotalTime: 621874360 HDFS_SCAN_NODE (id=4) Hdfs split stats (:<# splits>/): 8:1/6.04 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:2 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.7916666666666666 - BytesRead: 1858062 - BytesReadDataNodeCache: 0 - BytesReadLocal: 1858062 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1858062 - DecompressionTime: 4331739 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 1 - NumRowGroups: 1 - NumScannerThreadsStarted: 1 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 8232989 - PerReadThreadRawHdfsThroughput: 164659404 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 1652943742 - RowBatchQueuePutWaitTime: 17102923188 - RowsRead: 316667 - RowsReturned: 316667 - RowsReturnedRate: 182215 - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 39 - ScannerThreadsTotalWallClockTime: 19262609173 - MaterializeTupleTime(*): 200579131 - ScannerThreadsSysTime: 1999000 - ScannerThreadsUserTime: 166974000 - ScannerThreadsVoluntaryContextSwitches: 199 - TotalRawHdfsReadTime(*): 11284275 - TotalReadThroughput: 74283 - TotalTime: 1737874238