Query (id=d94aa36d3a2b7f12:72bd82a400000000) DEBUG MODE WARNING: Query profile created while running a DEBUG build of Impala. Use RELEASE builds to measure query performance. Summary Session ID: 34bf7d41257a82a:edc053ff45ed49ac Session Type: HIVESERVER2 HiveServer2 Protocol Version: V6 Start Time: 2017-05-31 10:08:06.280859000 End Time: 2017-05-31 10:11:16.087966000 Query Type: QUERY Query State: FINISHED Query Status: OK Impala Version: impalad version 2.9.0-SNAPSHOT DEBUG (build 470e6de60c3171e58c4ffeea48d456945ab6dd22) User: redacted Connected User: redacted Delegated User: Network Address: redacted Default Db: tpcds_300_decimal_parquet Sql Statement: /* Mem: 300 MB. Coordinator: redacted-host5. */ select c_last_name, c_first_name, ca_city, bought_city, ss_ticket_number, extended_price, extended_tax, list_price from (select ss_ticket_number, ss_customer_sk, ca_city bought_city, sum(ss_ext_sales_price) extended_price, sum(ss_ext_list_price) list_price, sum(ss_ext_tax) extended_tax from store_sales, date_dim, store, household_demographics, customer_address where store_sales.ss_sold_date_sk = date_dim.d_date_sk and store_sales.ss_store_sk = store.s_store_sk and store_sales.ss_hdemo_sk = household_demographics.hd_demo_sk and store_sales.ss_addr_sk = customer_address.ca_address_sk -- and date_dim.d_dom between 1 and 2 and (household_demographics.hd_dep_count = 5 or household_demographics.hd_vehicle_count = 3) -- and date_dim.d_year in (1999, 1999 + 1, 1999 + 2) and store.s_city in ('Midway', 'Fairview') -- partition key filter -- and ss_sold_date_sk in (2451180, 2451181, 2451211, 2451212, 2451239, 2451240, 2451270, 2451271, 2451300, 2451301, 2451331, -- 2451332, 2451361, 2451362, 2451392, 2451393, 2451423, 2451424, 2451453, 2451454, 2451484, 2451485, -- 2451514, 2451515, 2451545, 2451546, 2451576, 2451577, 2451605, 2451606, 2451636, 2451637, 2451666, -- 2451667, 2451697, 2451698, 2451727, 2451728, 2451758, 2451759, 2451789, 2451790, 2451819, 2451820, -- 2451850, 2451851, 2451880, 2451881, 2451911, 2451912, 2451942, 2451943, 2451970, 2451971, 2452001, -- 2452002, 2452031, 2452032, 2452062, 2452063, 2452092, 2452093, 2452123, 2452124, 2452154, 2452155, -- 2452184, 2452185, 2452215, 2452216, 2452245, 2452246) and ss_sold_date_sk between 2451180 and 2451269 -- partition key filter (3 months) and d_date between '1999-01-01' and '1999-03-31' group by ss_ticket_number, ss_customer_sk, ss_addr_sk, ca_city ) dn, customer, customer_address current_addr where ss_customer_sk = c_customer_sk and customer.c_current_addr_sk = current_addr.ca_address_sk and current_addr.ca_city <> bought_city order by c_last_name, ss_ticket_number limit 100; Coordinator: redacted-host5:22000 Query Options (non default): ABORT_ON_ERROR=1,MEM_LIMIT=314572800,RUNTIME_FILTER_MODE=0 Plan: ---------------- Per-Host Resource Reservation: Memory=808.00MB Per-Host Resource Estimates: Memory=365.72MB F10:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1 PLAN-ROOT SINK | mem-estimate=0B mem-reservation=0B | 25:MERGING-EXCHANGE [UNPARTITIONED] | order by: c_last_name ASC, ss_ticket_number ASC | limit: 100 | mem-estimate=0B mem-reservation=0B | tuple-ids=9 row-size=149B cardinality=100 | F00:PLAN FRAGMENT [RANDOM] hosts=8 instances=8 14:TOP-N [LIMIT=100] | order by: c_last_name ASC, ss_ticket_number ASC | mem-estimate=14.54KB mem-reservation=0B | tuple-ids=9 row-size=149B cardinality=100 | 13:HASH JOIN [INNER JOIN, BROADCAST] | hash predicates: current_addr.ca_address_sk = customer.c_current_addr_sk | other predicates: current_addr.ca_city != ca_city | mem-estimate=779.23KB mem-reservation=136.00MB | tuple-ids=8,7,5 row-size=189B cardinality=4643 | |--24:EXCHANGE [BROADCAST] | | mem-estimate=0B mem-reservation=0B | | tuple-ids=7,5 row-size=156B cardinality=4643 | | | F09:PLAN FRAGMENT [HASH(c_customer_sk)] hosts=8 instances=8 | 12:HASH JOIN [INNER JOIN, PARTITIONED] | | hash predicates: c_customer_sk = ss_customer_sk | | mem-estimate=10.17MB mem-reservation=136.00MB | | tuple-ids=7,5 row-size=156B cardinality=4643 | | | |--23:EXCHANGE [HASH(ss_customer_sk)] | | | mem-estimate=0B mem-reservation=0B | | | tuple-ids=5 row-size=97B cardinality=802159 | | | | | F08:PLAN FRAGMENT [HASH(ss_ticket_number,ss_customer_sk,ss_addr_sk,ca_city)] hosts=8 instances=8 | | 21:AGGREGATE [FINALIZE] | | | output: sum:merge(ss_ext_sales_price), sum:merge(ss_ext_list_price), sum:merge(ss_ext_tax) | | | group by: ss_ticket_number, ss_customer_sk, ss_addr_sk, ca_city | | | mem-estimate=81.36MB mem-reservation=264.00MB | | | tuple-ids=5 row-size=97B cardinality=802159 | | | | | 20:EXCHANGE [HASH(ss_ticket_number,ss_customer_sk,ss_addr_sk,ca_city)] | | | mem-estimate=0B mem-reservation=0B | | | tuple-ids=5 row-size=97B cardinality=802159 | | | | | F07:PLAN FRAGMENT [HASH(store_sales.ss_addr_sk)] hosts=8 instances=8 | | 09:AGGREGATE [STREAMING] | | | output: sum(ss_ext_sales_price), sum(ss_ext_list_price), sum(ss_ext_tax) | | | group by: ss_ticket_number, ss_customer_sk, ss_addr_sk, ca_city | | | mem-estimate=81.36MB mem-reservation=0B | | | tuple-ids=5 row-size=97B cardinality=802159 | | | | | 08:HASH JOIN [INNER JOIN, PARTITIONED] | | | hash predicates: store_sales.ss_addr_sk = customer_address.ca_address_sk | | | mem-estimate=10.71MB mem-reservation=136.00MB | | | tuple-ids=0,2,3,1,4 row-size=176B cardinality=802159 | | | | | |--19:EXCHANGE [HASH(customer_address.ca_address_sk)] | | | | mem-estimate=0B mem-reservation=0B | | | | tuple-ids=4 row-size=33B cardinality=2500000 | | | | | | | F06:PLAN FRAGMENT [RANDOM] hosts=8 instances=8 | | | 04:SCAN HDFS [tpcds_300_decimal_parquet.customer_address, RANDOM] | | | partitions=1/1 files=8 size=47.70MB | | | table stats: 2500000 rows total | | | column stats: all | | | mem-estimate=32.00MB mem-reservation=0B | | | tuple-ids=4 row-size=33B cardinality=2500000 | | | | | 18:EXCHANGE [HASH(store_sales.ss_addr_sk)] | | | mem-estimate=0B mem-reservation=0B | | | tuple-ids=0,2,3,1 row-size=143B cardinality=802159 | | | | | F02:PLAN FRAGMENT [RANDOM] hosts=8 instances=8 | | 07:HASH JOIN [INNER JOIN, BROADCAST] | | | hash predicates: store_sales.ss_sold_date_sk = date_dim.d_date_sk | | | mem-estimate=266.80KB mem-reservation=136.00MB | | | tuple-ids=0,2,3,1 row-size=143B cardinality=802159 | | | | | |--17:EXCHANGE [BROADCAST] | | | | mem-estimate=0B mem-reservation=0B | | | | tuple-ids=1 row-size=34B cardinality=7305 | | | | | | | F05:PLAN FRAGMENT [RANDOM] hosts=1 instances=1 | | | 01:SCAN HDFS [tpcds_300_decimal_parquet.date_dim, RANDOM] | | | partitions=1/1 files=1 size=2.15MB | | | predicates: tpcds_300_decimal_parquet.date_dim.d_date_sk <= 2451269, tpcds_300_decimal_parquet.date_dim.d_date_sk >= 2451180, d_date <= '1999-03-31', d_date >= '1999-01-01' | | | table stats: 73049 rows total | | | column stats: all | | | parquet statistics predicates: tpcds_300_decimal_parquet.date_dim.d_date_sk <= 2451269, tpcds_300_decimal_parquet.date_dim.d_date_sk >= 2451180, d_date <= '1999-03-31', d_date >= '1999-01-01' | | | parquet dictionary predicates: tpcds_300_decimal_parquet.date_dim.d_date_sk <= 2451269, tpcds_300_decimal_parquet.date_dim.d_date_sk >= 2451180, d_date <= '1999-03-31', d_date >= '1999-01-01' | | | mem-estimate=32.00MB mem-reservation=0B | | | tuple-ids=1 row-size=34B cardinality=7305 | | | | | 06:HASH JOIN [INNER JOIN, BROADCAST] | | | hash predicates: store_sales.ss_hdemo_sk = household_demographics.hd_demo_sk | | | mem-estimate=30.94KB mem-reservation=136.00MB | | | tuple-ids=0,2,3 row-size=109B cardinality=802159 | | | | | |--16:EXCHANGE [BROADCAST] | | | | mem-estimate=0B mem-reservation=0B | | | | tuple-ids=3 row-size=16B cardinality=1800 | | | | | | | F04:PLAN FRAGMENT [RANDOM] hosts=1 instances=1 | | | 03:SCAN HDFS [tpcds_300_decimal_parquet.household_demographics, RANDOM] | | | partitions=1/1 files=1 size=41.55KB | | | predicates: (household_demographics.hd_dep_count = 5 OR household_demographics.hd_vehicle_count = 3) | | | table stats: 7200 rows total | | | column stats: all | | | mem-estimate=48.00MB mem-reservation=0B | | | tuple-ids=3 row-size=16B cardinality=1800 | | | | | 05:HASH JOIN [INNER JOIN, BROADCAST] | | | hash predicates: store_sales.ss_store_sk = store.s_store_sk | | | mem-estimate=1.84KB mem-reservation=136.00MB | | | tuple-ids=0,2 row-size=93B cardinality=3208636 | | | | | |--15:EXCHANGE [BROADCAST] | | | | mem-estimate=0B mem-reservation=0B | | | | tuple-ids=2 row-size=33B cardinality=52 | | | | | | | F03:PLAN FRAGMENT [RANDOM] hosts=1 instances=1 | | | 02:SCAN HDFS [tpcds_300_decimal_parquet.store, RANDOM] | | | partitions=1/1 files=1 size=73.73KB | | | predicates: store.s_city IN ('Midway', 'Fairview') | | | table stats: 804 rows total | | | column stats: all | | | parquet statistics predicates: store.s_city IN ('Midway', 'Fairview') | | | parquet dictionary predicates: store.s_city IN ('Midway', 'Fairview') | | | mem-estimate=32.00MB mem-reservation=0B | | | tuple-ids=2 row-size=33B cardinality=52 | | | | | 00:SCAN HDFS [tpcds_300_decimal_parquet.store_sales, RANDOM] | | partitions=89/1824 files=89 size=1.14GB | | table stats: 864001869 rows total | | column stats: all | | mem-estimate=192.00MB mem-reservation=0B | | tuple-ids=0 row-size=60B cardinality=24805221 | | | 22:EXCHANGE [HASH(c_customer_sk)] | | mem-estimate=0B mem-reservation=0B | | tuple-ids=7 row-size=60B cardinality=5000000 | | | F01:PLAN FRAGMENT [RANDOM] hosts=8 instances=8 | 10:SCAN HDFS [tpcds_300_decimal_parquet.customer, RANDOM] | partitions=1/1 files=8 size=266.73MB | table stats: 5000000 rows total | column stats: all | mem-estimate=192.00MB mem-reservation=0B | tuple-ids=7 row-size=60B cardinality=5000000 | 11:SCAN HDFS [tpcds_300_decimal_parquet.customer_address current_addr, RANDOM] partitions=1/1 files=8 size=47.70MB table stats: 2500000 rows total column stats: all mem-estimate=32.00MB mem-reservation=0B tuple-ids=8 row-size=33B cardinality=2500000 ---------------- Estimated Per-Host Mem: 383489020 Per-Host Memory Reservation: 847249408 Request Pool: redacted Admission result: Admitted immediately ExecSummary: Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail ------------------------------------------------------------------------------------------------------------------------------------ 25:MERGING-EXCHANGE 1 893.145us 893.145us 100 100 0 0 UNPARTITIONED 14:TOP-N 7 194.693ms 434.773ms 700 100 2.64 MB 14.54 KB 13:HASH JOIN 7 543.257ms 807.976ms 27.78K 4.64K 11.37 MB 779.23 KB INNER JOIN, BROADCAST |--24:EXCHANGE 7 25.744ms 101.806ms 28.00K 4.64K 0 0 BROADCAST | 12:HASH JOIN 6 368.666ms 424.172ms 28.00K 4.64K 2.06 MB 10.17 MB INNER JOIN, PARTITIONED | |--23:EXCHANGE 6 9.773ms 33.039ms 28.94K 802.16K 0 0 HASH(ss_customer_sk) | | 21:AGGREGATE 8 364.394ms 890.913ms 28.94K 802.16K 2.67 MB 81.36 MB FINALIZE | | 20:EXCHANGE 8 5.247ms 28.668ms 28.94K 802.16K 0 0 HASH(ss_ticket_number,ss_cu... | | 09:AGGREGATE 8 365.471ms 1s020ms 28.94K 802.16K 1.88 MB 81.36 MB STREAMING | | 08:HASH JOIN 8 1s705ms 2s080ms 307.58K 802.16K 145.22 MB 10.71 MB INNER JOIN, PARTITIONED | | |--19:EXCHANGE 8 899.617ms 1s252ms 2.50M 2.50M 0 0 HASH(customer_address.ca_ad... | | | 04:SCAN HDFS 7 3s904ms 13s096ms 2.50M 2.50M 8.12 MB 32.00 MB tpcds_300_decimal_parquet.c... | | 18:EXCHANGE 8 55.988ms 162.593ms 309.42K 802.16K 0 0 HASH(store_sales.ss_addr_sk) | | 07:HASH JOIN 8 173.736ms 516.461ms 309.42K 802.16K 8.60 MB 266.80 KB INNER JOIN, BROADCAST | | |--17:EXCHANGE 8 47.999us 53.952us 90 7.30K 0 0 BROADCAST | | | 01:SCAN HDFS 1 34s010ms 34s010ms 90 7.30K 4.22 MB 32.00 MB tpcds_300_decimal_parquet.d... | | 06:HASH JOIN 8 199.490ms 443.448ms 309.42K 802.16K 4.42 MB 30.94 KB INNER JOIN, BROADCAST | | |--16:EXCHANGE 8 1.726ms 10.860ms 1.80K 1.80K 0 0 BROADCAST | | | 03:SCAN HDFS 1 10s369ms 10s369ms 1.80K 1.80K 379.21 KB 48.00 MB tpcds_300_decimal_parquet.h... | | 05:HASH JOIN 8 392.606ms 470.851ms 1.26M 3.21M 2.96 MB 1.84 KB INNER JOIN, BROADCAST | | |--15:EXCHANGE 8 29.577us 31.445us 49 52 0 0 BROADCAST | | | 02:SCAN HDFS 1 32s131ms 32s131ms 49 52 148.03 KB 32.00 MB tpcds_300_decimal_parquet.s... | | 00:SCAN HDFS 8 1m7s 1m48s 24.81M 24.81M 30.91 MB 192.00 MB tpcds_300_decimal_parquet.s... | 22:EXCHANGE 6 736.759ms 886.591ms 5.00M 5.00M 0 0 HASH(c_customer_sk) | 10:SCAN HDFS 6 6s403ms 20s219ms 5.00M 5.00M 21.79 MB 192.00 MB tpcds_300_decimal_parquet.c... 11:SCAN HDFS 7 3s022ms 6s232ms 2.50M 2.50M 6.08 MB 32.00 MB tpcds_300_decimal_parquet.c... Errors: - ComputeScanRangeAssignmentTimer: 110879487 - InactiveTotalTime: 0 - TotalTime: 0 Planner Timeline Analysis finished: 476498038 Equivalence classes computed: 477003113 Single node plan created: 1364778160 Distributed plan created: 1425050420 Lineage info computed: 1425289818 Planning finished: 1430428409 Query Timeline Query submitted: 40170613 Planning finished: 1621213576 Submit for admission: 2255196015 Completed admission: 2297463968 Ready to start on 8 backends: 4046342708 All 8 execution backends (54 fragment instances) started: 9568710475 Rows available: 188852527367 First row fetched: 189232307613 Unregister query: 189808375344 ImpalaServer - ClientFetchWaitTimer: 627131138 - InactiveTotalTime: 0 - RowMaterializationTimer: 276574894 - TotalTime: 0 Execution Profile d94aa36d3a2b7f12:72bd82a400000000 Backend startup latencies: Count: 8, min / max: 168ms / 4s817ms, 25th %-ile: 213ms, 50th %-ile: 268ms, 75th %-ile: 804ms, 90th %-ile: 936ms, 95th %-ile: 4s816ms, 99.9th %-ile: 4s816ms Per Node Peak Memory Usage: redacted-host1:22000(214.57 MB) redacted-host2:22000(214.24 MB) redacted-host3:22000(235.51 MB) redacted-host4:22000(184.37 MB) redacted-host5:22000(174.23 MB) redacted-host6:22000(213.57 MB) redacted-host7:22000(214.53 MB) redacted-host8:22000(215.15 MB) - FiltersReceived: 0 - FinalizationTimer: 0 - InactiveTotalTime: 0 - TotalTime: 186654372388 Averaged Fragment F10 split sizes: min: 0, max: 0, avg: 0, stddev: 0 completion times: min:3m4s max:3m4s mean: 3m4s stddev:0.000ns execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec num instances: 1 - AverageThreadTokens: 0.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 294400 - PerHostPeakMemUsage: 182694027 - RowsProduced: 100 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 63 - TotalThreadsTotalWallClockTime: 184027625347 - TotalThreadsSysTime: 2000000 - TotalThreadsUserTime: 83987000 - TotalThreadsVoluntaryContextSwitches: 69 - TotalTime: 184537064149 Fragment Instance Lifecycle Timings - ExecTime: 442058875 - ExecTreeExecTime: 816246 - InactiveTotalTime: 0 - OpenTime: 183585586212 - ExecTreeOpenTime: 183042503477 - PrepareTime: 509331667 - ExecTreePrepareTime: 81774 - TotalTime: 0 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 140 - BlocksRecycled: 4 - BufferedPins: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 209715200 - PeakMemoryUsage: 143479312 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 - ScratchWrites: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 PLAN_ROOT_SINK - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - TotalTime: 0 CodeGen - CodegenTime: 1413031 - CompileTime: 33709561 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076168 - NumFunctions: 28 - NumInstructions: 559 - OptimizationTime: 475950524 - PeakMemoryUsage: 286208 - PrepareTime: 465045352 - TotalTime: 1004056700 EXCHANGE_NODE (id=25) - BytesReceived: 49160 - ConvertRowBatchTime: 0 - DeserializeRowBatchTimer: 150269762 - FirstBatchArrivalWaitTime: 183042420530 - InactiveTotalTime: 0 - MergeGetNext: 809031 - MergeGetNextBatch: 33053 - PeakMemoryUsage: 0 - RowsReturned: 100 - RowsReturnedRate: 0 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 183043315411 Coordinator Fragment F10 Instance d94aa36d3a2b7f12:72bd82a400000000 (host=redacted-host5:22000) - AverageThreadTokens: 0.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 294400 - PerHostPeakMemUsage: 182694027 - RowsProduced: 100 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 63 - TotalThreadsTotalWallClockTime: 184027625347 - TotalThreadsSysTime: 2000000 - TotalThreadsUserTime: 83987000 - TotalThreadsVoluntaryContextSwitches: 69 - TotalTime: 184537064149 Fragment Instance Lifecycle Timings - ExecTime: 442058875 - ExecTreeExecTime: 816246 - InactiveTotalTime: 0 - OpenTime: 183585586212 - ExecTreeOpenTime: 183042503477 - PrepareTime: 509331667 - ExecTreePrepareTime: 81774 - TotalTime: 0 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 140 - BlocksRecycled: 4 - BufferedPins: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 209715200 - PeakMemoryUsage: 143479312 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 - ScratchWrites: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 PLAN_ROOT_SINK - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - TotalTime: 0 CodeGen - CodegenTime: 1413031 - CompileTime: 33709561 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076168 - NumFunctions: 28 - NumInstructions: 559 - OptimizationTime: 475950524 - PeakMemoryUsage: 286208 - PrepareTime: 465045352 - TotalTime: 1004056700 EXCHANGE_NODE (id=25) ExecOption: Codegen Enabled - BytesReceived: 49160 - ConvertRowBatchTime: 0 - DeserializeRowBatchTimer: 150269762 - FirstBatchArrivalWaitTime: 183042420530 - InactiveTotalTime: 183042422266 - MergeGetNext: 809031 - MergeGetNextBatch: 33053 - PeakMemoryUsage: 0 - RowsReturned: 100 - RowsReturnedRate: 0 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 183043315411 Averaged Fragment F00 split sizes: min: 5.88 MB, max: 11.77 MB, avg: 6.81 MB, stddev: 2.02 MB completion times: min:2m54s max:3m3s mean: 2m59s stddev:2s776ms execution rates: min:33.61 KB/sec max:66.93 KB/sec mean:38.79 KB/sec stddev:11.50 KB/sec num instances: 7 - AverageThreadTokens: 1.0173023379258839 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 18284040 - PerHostPeakMemUsage: 223486464 - RowsProduced: 100 - TotalNetworkReceiveTime: 170054113581 - TotalNetworkSendTime: 43141052 - TotalStorageWaitTime: 1448067212 - TotalThreadsInvoluntaryContextSwitches: 871 - TotalThreadsTotalWallClockTime: 181979570948 - TotalThreadsSysTime: 30423285 - TotalThreadsUserTime: 1110545285 - TotalThreadsVoluntaryContextSwitches: 1058 - TotalTime: 179660302377 Fragment Instance Lifecycle Timings - ExecTime: 52895647 - ExecTreeExecTime: 40723 - InactiveTotalTime: 0 - OpenTime: 178797319022 - ExecTreeOpenTime: 173782456339 - PrepareTime: 809724535 - ExecTreePrepareTime: 38422012 - TotalTime: 0 DataStreamSender (dst_id=25) - BytesSent: 7022 - InactiveTotalTime: 0 - NetworkThroughput(*): 144946141 - OverallThroughput: 12973507 - PeakMemoryUsage: 1080 - RowsReturned: 100 - SerializeBatchTime: 5661821 - TotalTime: 5762493 - TransmitDataRPCTime: 49162 - UncompressedRowBatchSize: 14556 CodeGen - CodegenTime: 46138422 - CompileTime: 1102248178 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076168 - NumFunctions: 145 - NumInstructions: 4511 - OptimizationTime: 3833734143 - PeakMemoryUsage: 2309632 - PrepareTime: 602488115 - TotalTime: 5558220998 SORT_NODE (id=14) - InactiveTotalTime: 0 - InsertBatchTime: 41350356 - PeakMemoryUsage: 2474575 - RowsReturned: 100 - RowsReturnedRate: 0 - TotalTime: 173820911419 HASH_JOIN_NODE (id=13) - BuildRows: 27999 - BuildTime: 286409238 - InactiveTotalTime: 0 - LocalTime: 543257619 - NumHashTableBuildsSkipped: 0 - PeakMemoryUsage: 11917618 - ProbeRows: 357142 - ProbeRowsPartitioned: 0 - ProbeTime: 54093419 - RowsReturned: 3968 - RowsReturnedRate: 22 - TotalTime: 173626444292 Hash Join Builder (join_node_id=13) - BuildRowsPartitionTime: 54857941 - BuildRowsPartitioned: 27999 - GetNewBlockTime: 3852343 - HashBuckets: 65536 - HashCollisions: 0 - HashTablesBuildTime: 228784630 - InactiveTotalTime: 0 - LargestPartitionPercent: 6 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 11564160 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=24) - BytesReceived: 2539830 - ConvertRowBatchTime: 6051506 - DeserializeRowBatchTimer: 75235026 - FirstBatchArrivalWaitTime: 147867131264 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 27999 - RowsReturnedRate: 164 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 170060808754 HDFS_SCAN_NODE (id=11) - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 1.0 - BytesRead: 2098519 - BytesReadDataNodeCache: 0 - BytesReadLocal: 2098519 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 2098519 - DecompressionTime: 75732863 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 1 - NumRowGroups: 1 - NumScannerThreadsStarted: 1 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 4502568 - PerReadThreadRawHdfsThroughput: 935151804 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 2952425690 - RowBatchQueuePutWaitTime: 0 - RowsRead: 357142 - RowsReturned: 357142 - RowsReturnedRate: 150560 - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 297 - ScannerThreadsTotalWallClockTime: 3129407487 - MaterializeTupleTime(*): 495152001 - ScannerThreadsSysTime: 5141571 - ScannerThreadsUserTime: 179686857 - ScannerThreadsVoluntaryContextSwitches: 75 - TotalRawHdfsReadTime(*): 3932706 - TotalReadThroughput: 11876 - TotalTime: 3022377917 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 140 - BlocksRecycled: 72 - BufferedPins: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 209715200 - PeakMemoryUsage: 143479312 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 - ScratchWrites: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 Fragment F00 Instance d94aa36d3a2b7f12:72bd82a400000030 (host=redacted-host1:22000) Hdfs split stats (:<# splits>/): 8:1/6.04 MB - AverageThreadTokens: 1.0364145658263306 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 19193920 - PerHostPeakMemUsage: 224989726 - RowsProduced: 100 - TotalNetworkReceiveTime: 171882375961 - TotalNetworkSendTime: 92600862 - TotalStorageWaitTime: 3405178241 - TotalThreadsInvoluntaryContextSwitches: 714 - TotalThreadsTotalWallClockTime: 189396955227 - TotalThreadsSysTime: 20997000 - TotalThreadsUserTime: 999848000 - TotalThreadsVoluntaryContextSwitches: 882 - TotalTime: 183712686617 Fragment Instance Lifecycle Timings - ExecTime: 93125971 - ExecTreeExecTime: 51198 - InactiveTotalTime: 0 - OpenTime: 183023656968 - ExecTreeOpenTime: 179067541540 - PrepareTime: 594027550 - ExecTreePrepareTime: 13515928 - TotalTime: 0 DataStreamSender (dst_id=25) - BytesSent: 7015 - InactiveTotalTime: 0 - NetworkThroughput(*): 135736537 - OverallThroughput: 20692543 - PeakMemoryUsage: 1080 - RowsReturned: 100 - SerializeBatchTime: 250432 - TotalTime: 339011 - TransmitDataRPCTime: 51681 - UncompressedRowBatchSize: 14529 CodeGen - CodegenTime: 107413987 - CompileTime: 882627394 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076168 - NumFunctions: 145 - NumInstructions: 4511 - OptimizationTime: 3040895992 - PeakMemoryUsage: 2309632 - PrepareTime: 489522620 - TotalTime: 4414555765 SORT_NODE (id=14) ExecOption: Codegen Enabled - InactiveTotalTime: 0 - InsertBatchTime: 15710309 - PeakMemoryUsage: 2338816 - RowsReturned: 100 - RowsReturnedRate: 0 - TotalTime: 179081100339 HASH_JOIN_NODE (id=13) ExecOption: Probe Side Codegen Enabled - BuildRows: 27999 - BuildTime: 660877228 - InactiveTotalTime: 0 - LocalTime: 807976565 - NumHashTableBuildsSkipped: 0 - PeakMemoryUsage: 11917607 - ProbeRows: 316667 - ProbeRowsPartitioned: 0 - ProbeTime: 41218092 - RowsReturned: 3618 - RowsReturnedRate: 20 - TotalTime: 178929276325 Hash Join Builder (join_node_id=13) ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 48846952 - BuildRowsPartitioned: 27999 - GetNewBlockTime: 551061 - HashBuckets: 65536 - HashCollisions: 0 - HashTablesBuildTime: 611458806 - InactiveTotalTime: 0 - LargestPartitionPercent: 6 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 11564160 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=24) - BytesReceived: 2539830 - ConvertRowBatchTime: 6020651 - DeserializeRowBatchTimer: 33111882 - FirstBatchArrivalWaitTime: 149577798673 - InactiveTotalTime: 171878763394 - PeakMemoryUsage: 0 - RowsReturned: 27999 - RowsReturnedRate: 162 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 171889029099 HDFS_SCAN_NODE (id=11) Hdfs split stats (:<# splits>/): 8:1/6.04 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:2 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 1.0 - BytesRead: 1858062 - BytesReadDataNodeCache: 0 - BytesReadLocal: 1858062 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1858062 - DecompressionTime: 16042139 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 1 - NumRowGroups: 1 - NumScannerThreadsStarted: 1 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 5259293 - PerReadThreadRawHdfsThroughput: 807681674 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 6167295551 - RowBatchQueuePutWaitTime: 0 - RowsRead: 316667 - RowsReturned: 316667 - RowsReturnedRate: 50810 - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 185 - ScannerThreadsTotalWallClockTime: 6280224037 - MaterializeTupleTime(*): 256810695 - ScannerThreadsSysTime: 2999000 - ScannerThreadsUserTime: 155977000 - ScannerThreadsVoluntaryContextSwitches: 63 - TotalRawHdfsReadTime(*): 2300488 - TotalReadThroughput: 10403 - TotalTime: 6232270661 Instance d94aa36d3a2b7f12:72bd82a400000034 (host=redacted-host2:22000) Hdfs split stats (:<# splits>/): 3:1/6.04 MB - AverageThreadTokens: 1.0224719101123596 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 18238544 - PerHostPeakMemUsage: 224646707 - RowsProduced: 100 - TotalNetworkReceiveTime: 171969325178 - TotalNetworkSendTime: 4481379 - TotalStorageWaitTime: 2180988890 - TotalThreadsInvoluntaryContextSwitches: 794 - TotalThreadsTotalWallClockTime: 184029683379 - TotalThreadsSysTime: 29995000 - TotalThreadsUserTime: 1071837000 - TotalThreadsVoluntaryContextSwitches: 978 - TotalTime: 180722506231 Fragment Instance Lifecycle Timings - ExecTime: 7052850 - ExecTreeExecTime: 35819 - InactiveTotalTime: 0 - OpenTime: 180161715379 - ExecTreeOpenTime: 176392812089 - PrepareTime: 553669058 - ExecTreePrepareTime: 59027945 - TotalTime: 0 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 140 - BlocksRecycled: 76 - BufferedPins: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 209715200 - PeakMemoryUsage: 143479312 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 - ScratchWrites: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 DataStreamSender (dst_id=25) - BytesSent: 7072 - InactiveTotalTime: 0 - NetworkThroughput(*): 158256316 - OverallThroughput: 18160760 - PeakMemoryUsage: 1080 - RowsReturned: 100 - SerializeBatchTime: 308405 - TotalTime: 389411 - TransmitDataRPCTime: 44687 - UncompressedRowBatchSize: 14544 CodeGen - CodegenTime: 85072038 - CompileTime: 663245175 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076168 - NumFunctions: 145 - NumInstructions: 4511 - OptimizationTime: 3094933457 - PeakMemoryUsage: 2309632 - PrepareTime: 350256463 - TotalTime: 4110085459 SORT_NODE (id=14) ExecOption: Codegen Enabled - InactiveTotalTime: 0 - InsertBatchTime: 2086427 - PeakMemoryUsage: 2466816 - RowsReturned: 100 - RowsReturnedRate: 0 - TotalTime: 176451868999 HASH_JOIN_NODE (id=13) ExecOption: Probe Side Codegen Enabled - BuildRows: 27999 - BuildTime: 243693975 - InactiveTotalTime: 0 - LocalTime: 539767750 - NumHashTableBuildsSkipped: 0 - PeakMemoryUsage: 11917623 - ProbeRows: 316666 - ProbeRowsPartitioned: 0 - ProbeTime: 43546050 - RowsReturned: 3491 - RowsReturnedRate: 19 - TotalTime: 176254331274 Hash Join Builder (join_node_id=13) ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 47812334 - BuildRowsPartitioned: 27999 - GetNewBlockTime: 155043 - HashBuckets: 65536 - HashCollisions: 0 - HashTablesBuildTime: 195453286 - InactiveTotalTime: 0 - LargestPartitionPercent: 6 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 11564160 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=24) - BytesReceived: 2539830 - ConvertRowBatchTime: 6139708 - DeserializeRowBatchTimer: 96970519 - FirstBatchArrivalWaitTime: 149820543522 - InactiveTotalTime: 171968144229 - PeakMemoryUsage: 0 - RowsReturned: 27999 - RowsReturnedRate: 162 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 171976076900 HDFS_SCAN_NODE (id=11) Hdfs split stats (:<# splits>/): 3:1/6.04 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:2 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 1.0 - BytesRead: 1858729 - BytesReadDataNodeCache: 0 - BytesReadLocal: 1858729 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1858729 - DecompressionTime: 94445817 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 1 - NumRowGroups: 1 - NumScannerThreadsStarted: 1 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 4245549 - PerReadThreadRawHdfsThroughput: 182552740 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 3611396022 - RowBatchQueuePutWaitTime: 0 - RowsRead: 316666 - RowsReturned: 316666 - RowsReturnedRate: 84704 - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 259 - ScannerThreadsTotalWallClockTime: 3860945707 - MaterializeTupleTime(*): 805724766 - ScannerThreadsSysTime: 8998000 - ScannerThreadsUserTime: 154976000 - ScannerThreadsVoluntaryContextSwitches: 133 - TotalRawHdfsReadTime(*): 10181874 - TotalReadThroughput: 10435 - TotalTime: 3738486624 Instance d94aa36d3a2b7f12:72bd82a400000031 (host=redacted-host3:22000) Hdfs split stats (:<# splits>/): 9:1/6.04 MB - AverageThreadTokens: 1.0196629213483146 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 18019362 - PerHostPeakMemUsage: 246953154 - RowsProduced: 100 - TotalNetworkReceiveTime: 170022533518 - TotalNetworkSendTime: 631259 - TotalStorageWaitTime: 2890233815 - TotalThreadsInvoluntaryContextSwitches: 810 - TotalThreadsTotalWallClockTime: 183509681720 - TotalThreadsSysTime: 23996000 - TotalThreadsUserTime: 1088834000 - TotalThreadsVoluntaryContextSwitches: 1058 - TotalTime: 180680320749 Fragment Instance Lifecycle Timings - ExecTime: 1270912 - ExecTreeExecTime: 41655 - InactiveTotalTime: 0 - OpenTime: 179797465062 - ExecTreeOpenTime: 174054196642 - PrepareTime: 881476878 - ExecTreePrepareTime: 32264952 - TotalTime: 0 DataStreamSender (dst_id=25) - BytesSent: 7024 - InactiveTotalTime: 0 - NetworkThroughput(*): 112618245 - OverallThroughput: 19474488 - PeakMemoryUsage: 1080 - RowsReturned: 100 - SerializeBatchTime: 228587 - TotalTime: 360677 - TransmitDataRPCTime: 62370 - UncompressedRowBatchSize: 14609 CodeGen - CodegenTime: 19543018 - CompileTime: 1301740629 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076168 - NumFunctions: 145 - NumInstructions: 4511 - OptimizationTime: 4309053346 - PeakMemoryUsage: 2309632 - PrepareTime: 738161512 - TotalTime: 6389194193 SORT_NODE (id=14) ExecOption: Codegen Enabled - InactiveTotalTime: 0 - InsertBatchTime: 1827096 - PeakMemoryUsage: 2459648 - RowsReturned: 100 - RowsReturnedRate: 0 - TotalTime: 174086495614 HASH_JOIN_NODE (id=13) ExecOption: Probe Side Codegen Enabled - BuildRows: 27999 - BuildTime: 114311385 - InactiveTotalTime: 0 - LocalTime: 321470019 - NumHashTableBuildsSkipped: 0 - PeakMemoryUsage: 11917577 - ProbeRows: 316667 - ProbeRowsPartitioned: 0 - ProbeTime: 74762884 - RowsReturned: 3442 - RowsReturnedRate: 19 - TotalTime: 173970155052 Hash Join Builder (join_node_id=13) ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 55797634 - BuildRowsPartitioned: 27999 - GetNewBlockTime: 2418110 - HashBuckets: 65536 - HashCollisions: 0 - HashTablesBuildTime: 57994941 - InactiveTotalTime: 0 - LargestPartitionPercent: 6 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 11564160 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=24) - BytesReceived: 2539830 - ConvertRowBatchTime: 6080040 - DeserializeRowBatchTimer: 98023158 - FirstBatchArrivalWaitTime: 147833309350 - InactiveTotalTime: 169993342064 - PeakMemoryUsage: 0 - RowsReturned: 27999 - RowsReturnedRate: 164 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 170029270762 HDFS_SCAN_NODE (id=11) Hdfs split stats (:<# splits>/): 9:1/6.04 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:2 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 1.0 - BytesRead: 1857941 - BytesReadDataNodeCache: 0 - BytesReadLocal: 1857941 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1857941 - DecompressionTime: 65366804 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 1 - NumRowGroups: 1 - NumScannerThreadsStarted: 1 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 3975167 - PerReadThreadRawHdfsThroughput: 1449725768 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 3568450979 - RowBatchQueuePutWaitTime: 0 - RowsRead: 316667 - RowsReturned: 316667 - RowsReturnedRate: 87491 - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 249 - ScannerThreadsTotalWallClockTime: 3711019617 - MaterializeTupleTime(*): 238314534 - ScannerThreadsSysTime: 2000000 - ScannerThreadsUserTime: 165974000 - ScannerThreadsVoluntaryContextSwitches: 51 - TotalRawHdfsReadTime(*): 1281581 - TotalReadThroughput: 10462 - TotalTime: 3619414271 Instance d94aa36d3a2b7f12:72bd82a400000035 (host=redacted-host4:22000) Hdfs split stats (:<# splits>/): 7:1/5.89 MB 6:1/5.89 MB - AverageThreadTokens: 1.0112359550561798 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 18064509 - PerHostPeakMemUsage: 193321646 - RowsProduced: 100 - TotalNetworkReceiveTime: 172529921564 - TotalNetworkSendTime: 67033610 - TotalStorageWaitTime: 207238683 - TotalThreadsInvoluntaryContextSwitches: 1229 - TotalThreadsTotalWallClockTime: 181456037059 - TotalThreadsSysTime: 27995000 - TotalThreadsUserTime: 1256809000 - TotalThreadsVoluntaryContextSwitches: 1256 - TotalTime: 179883110891 Fragment Instance Lifecycle Timings - ExecTime: 94211483 - ExecTreeExecTime: 39197 - InactiveTotalTime: 0 - OpenTime: 179348903076 - ExecTreeOpenTime: 175268888902 - PrepareTime: 439895084 - ExecTreePrepareTime: 8055199 - TotalTime: 0 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 140 - BlocksRecycled: 52 - BufferedPins: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 209715200 - PeakMemoryUsage: 143479312 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 - ScratchWrites: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 DataStreamSender (dst_id=25) - BytesSent: 6950 - InactiveTotalTime: 0 - NetworkThroughput(*): 134533488 - OverallThroughput: 443527 - PeakMemoryUsage: 1080 - RowsReturned: 100 - SerializeBatchTime: 15585371 - TotalTime: 15669815 - TransmitDataRPCTime: 51660 - UncompressedRowBatchSize: 14584 CodeGen - CodegenTime: 8963022 - CompileTime: 1171941591 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076168 - NumFunctions: 145 - NumInstructions: 4511 - OptimizationTime: 2886427280 - PeakMemoryUsage: 2309632 - PrepareTime: 326556455 - TotalTime: 4385759729 SORT_NODE (id=14) ExecOption: Codegen Enabled - InactiveTotalTime: 0 - InsertBatchTime: 10416231 - PeakMemoryUsage: 2773035 - RowsReturned: 100 - RowsReturnedRate: 0 - TotalTime: 175276976225 HASH_JOIN_NODE (id=13) ExecOption: Probe Side Codegen Enabled - BuildRows: 27999 - BuildTime: 122841962 - InactiveTotalTime: 0 - LocalTime: 346563728 - NumHashTableBuildsSkipped: 0 - PeakMemoryUsage: 11917625 - ProbeRows: 616667 - ProbeRowsPartitioned: 0 - ProbeTime: 82193054 - RowsReturned: 6721 - RowsReturnedRate: 38 - TotalTime: 174842203028 Hash Join Builder (join_node_id=13) ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 33413659 - BuildRowsPartitioned: 27999 - GetNewBlockTime: 172593 - HashBuckets: 65536 - HashCollisions: 0 - HashTablesBuildTime: 88963157 - InactiveTotalTime: 0 - LargestPartitionPercent: 6 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 11564160 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=24) - BytesReceived: 2539830 - ConvertRowBatchTime: 5925153 - DeserializeRowBatchTimer: 36105169 - FirstBatchArrivalWaitTime: 150328719471 - InactiveTotalTime: 172528944149 - PeakMemoryUsage: 0 - RowsReturned: 27999 - RowsReturnedRate: 162 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 172536496338 HDFS_SCAN_NODE (id=11) Hdfs split stats (:<# splits>/): 7:1/5.89 MB 6:1/5.89 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 2 out of 2 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:4 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 1.0 - BytesRead: 3628278 - BytesReadDataNodeCache: 0 - BytesReadLocal: 3628278 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 3628278 - DecompressionTime: 109398738 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 2 - NumRowGroups: 2 - NumScannerThreadsStarted: 1 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 3671087 - PerReadThreadRawHdfsThroughput: 740040356 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 1864001962 - RowBatchQueuePutWaitTime: 0 - RowsRead: 616667 - RowsReturned: 616667 - RowsReturnedRate: 314763 - ScanRangesComplete: 2 - ScannerThreadsInvoluntaryContextSwitches: 694 - ScannerThreadsTotalWallClockTime: 2012983205 - MaterializeTupleTime(*): 761911141 - ScannerThreadsSysTime: 7998000 - ScannerThreadsUserTime: 321951000 - ScannerThreadsVoluntaryContextSwitches: 84 - TotalRawHdfsReadTime(*): 4902811 - TotalReadThroughput: 20492 - TotalTime: 1959142962 Instance d94aa36d3a2b7f12:72bd82a40000002f (host=redacted-host6:22000) Hdfs split stats (:<# splits>/): 6:1/6.04 MB - AverageThreadTokens: 1.0140845070422535 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 19682397 - PerHostPeakMemUsage: 223945936 - RowsProduced: 100 - TotalNetworkReceiveTime: 170118244783 - TotalNetworkSendTime: 2331997 - TotalStorageWaitTime: 493283548 - TotalThreadsInvoluntaryContextSwitches: 849 - TotalThreadsTotalWallClockTime: 181724172758 - TotalThreadsSysTime: 31994000 - TotalThreadsUserTime: 1152824000 - TotalThreadsVoluntaryContextSwitches: 918 - TotalTime: 179872655811 Fragment Instance Lifecycle Timings - ExecTime: 7548150 - ExecTreeExecTime: 43938 - InactiveTotalTime: 0 - OpenTime: 179044122593 - ExecTreeOpenTime: 173289457429 - PrepareTime: 820863339 - ExecTreePrepareTime: 30134621 - TotalTime: 0 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 140 - BlocksRecycled: 81 - BufferedPins: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 209715200 - PeakMemoryUsage: 143479312 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 - ScratchWrites: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 DataStreamSender (dst_id=25) - BytesSent: 7080 - InactiveTotalTime: 0 - NetworkThroughput(*): 162882186 - OverallThroughput: 10365865 - PeakMemoryUsage: 1080 - RowsReturned: 100 - SerializeBatchTime: 563110 - TotalTime: 683011 - TransmitDataRPCTime: 43467 - UncompressedRowBatchSize: 14558 CodeGen - CodegenTime: 13661853 - CompileTime: 1924685897 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076168 - NumFunctions: 145 - NumInstructions: 4511 - OptimizationTime: 3741170640 - PeakMemoryUsage: 2309632 - PrepareTime: 635566732 - TotalTime: 6347788044 SORT_NODE (id=14) ExecOption: Codegen Enabled - InactiveTotalTime: 0 - InsertBatchTime: 232181232 - PeakMemoryUsage: 2434048 - RowsReturned: 100 - RowsReturnedRate: 0 - TotalTime: 173319628745 HASH_JOIN_NODE (id=13) ExecOption: Probe Side Codegen Enabled - BuildRows: 27999 - BuildTime: 221445730 - InactiveTotalTime: 0 - LocalTime: 546049463 - NumHashTableBuildsSkipped: 0 - PeakMemoryUsage: 11917636 - ProbeRows: 316666 - ProbeRowsPartitioned: 0 - ProbeTime: 46810712 - RowsReturned: 3604 - RowsReturnedRate: 20 - TotalTime: 173021605365 Hash Join Builder (join_node_id=13) ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 69329588 - BuildRowsPartitioned: 27999 - GetNewBlockTime: 10214911 - HashBuckets: 65536 - HashCollisions: 0 - HashTablesBuildTime: 149458601 - InactiveTotalTime: 0 - LargestPartitionPercent: 6 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 11564160 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=24) - BytesReceived: 2539830 - ConvertRowBatchTime: 6022162 - DeserializeRowBatchTimer: 187690013 - FirstBatchArrivalWaitTime: 147997573835 - InactiveTotalTime: 170023144483 - PeakMemoryUsage: 0 - RowsReturned: 27999 - RowsReturnedRate: 164 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 170124950954 HDFS_SCAN_NODE (id=11) Hdfs split stats (:<# splits>/): 6:1/6.04 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:2 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 1.0 - BytesRead: 1857986 - BytesReadDataNodeCache: 0 - BytesReadLocal: 1857986 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1857986 - DecompressionTime: 180001581 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 1 - NumRowGroups: 1 - NumScannerThreadsStarted: 1 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 6374458 - PerReadThreadRawHdfsThroughput: 1578840656 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 2267632131 - RowBatchQueuePutWaitTime: 0 - RowsRead: 316666 - RowsReturned: 316666 - RowsReturnedRate: 134716 - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 203 - ScannerThreadsTotalWallClockTime: 2672555856 - MaterializeTupleTime(*): 324636638 - ScannerThreadsSysTime: 1999000 - ScannerThreadsUserTime: 150977000 - ScannerThreadsVoluntaryContextSwitches: 47 - TotalRawHdfsReadTime(*): 1176804 - TotalReadThroughput: 10462 - TotalTime: 2350604948 Instance d94aa36d3a2b7f12:72bd82a400000032 (host=redacted-host7:22000) Hdfs split stats (:<# splits>/): 9:1/5.89 MB - AverageThreadTokens: 1.0084745762711864 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 17369184 - PerHostPeakMemUsage: 224948278 - RowsProduced: 100 - TotalNetworkReceiveTime: 171189016161 - TotalNetworkSendTime: 133930420 - TotalStorageWaitTime: 405163240 - TotalThreadsInvoluntaryContextSwitches: 733 - TotalThreadsTotalWallClockTime: 180168695454 - TotalThreadsSysTime: 29994000 - TotalThreadsUserTime: 1018845000 - TotalThreadsVoluntaryContextSwitches: 1035 - TotalTime: 179057816194 Fragment Instance Lifecycle Timings - ExecTime: 165038025 - ExecTreeExecTime: 37169 - InactiveTotalTime: 0 - OpenTime: 178160872583 - ExecTreeOpenTime: 173829391908 - PrepareTime: 731739586 - ExecTreePrepareTime: 10554071 - TotalTime: 0 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 140 - BlocksRecycled: 81 - BufferedPins: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 209715200 - PeakMemoryUsage: 143479312 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 - ScratchWrites: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 DataStreamSender (dst_id=25) - BytesSent: 7011 - InactiveTotalTime: 0 - NetworkThroughput(*): 156275772 - OverallThroughput: 310667 - PeakMemoryUsage: 1080 - RowsReturned: 100 - SerializeBatchTime: 22480715 - TotalTime: 22567543 - TransmitDataRPCTime: 44863 - UncompressedRowBatchSize: 14545 CodeGen - CodegenTime: 84200609 - CompileTime: 856784462 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076168 - NumFunctions: 145 - NumInstructions: 4511 - OptimizationTime: 3390615991 - PeakMemoryUsage: 2309632 - PrepareTime: 513910784 - TotalTime: 4787252277 SORT_NODE (id=14) ExecOption: Codegen Enabled - InactiveTotalTime: 0 - InsertBatchTime: 25420239 - PeakMemoryUsage: 2415616 - RowsReturned: 100 - RowsReturnedRate: 0 - TotalTime: 173839976151 HASH_JOIN_NODE (id=13) ExecOption: Probe Side Codegen Enabled - BuildRows: 27999 - BuildTime: 435747608 - InactiveTotalTime: 0 - LocalTime: 713480440 - NumHashTableBuildsSkipped: 0 - PeakMemoryUsage: 11917639 - ProbeRows: 308333 - ProbeRowsPartitioned: 0 - ProbeTime: 47967993 - RowsReturned: 3476 - RowsReturnedRate: 20 - TotalTime: 173675619863 Hash Join Builder (join_node_id=13) ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 71259881 - BuildRowsPartitioned: 27999 - GetNewBlockTime: 205667 - HashBuckets: 65536 - HashCollisions: 0 - HashTablesBuildTime: 363987567 - InactiveTotalTime: 0 - LargestPartitionPercent: 6 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 11564160 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=24) - BytesReceived: 2539830 - ConvertRowBatchTime: 6172588 - DeserializeRowBatchTimer: 44338727 - FirstBatchArrivalWaitTime: 149093147740 - InactiveTotalTime: 171187482738 - PeakMemoryUsage: 0 - RowsReturned: 27999 - RowsReturnedRate: 163 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 171195810928 HDFS_SCAN_NODE (id=11) Hdfs split stats (:<# splits>/): 9:1/5.89 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:2 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 1.0 - BytesRead: 1814616 - BytesReadDataNodeCache: 0 - BytesReadLocal: 1814616 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1814616 - DecompressionTime: 4042839 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 1 - NumRowGroups: 1 - NumScannerThreadsStarted: 1 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 4524093 - PerReadThreadRawHdfsThroughput: 1507346442 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 1733039775 - RowBatchQueuePutWaitTime: 0 - RowsRead: 308333 - RowsReturned: 308333 - RowsReturnedRate: 174561 - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 240 - ScannerThreadsTotalWallClockTime: 1842824013 - MaterializeTupleTime(*): 497838443 - ScannerThreadsSysTime: 6998000 - ScannerThreadsUserTime: 147978000 - ScannerThreadsVoluntaryContextSwitches: 84 - TotalRawHdfsReadTime(*): 1203848 - TotalReadThroughput: 10277 - TotalTime: 1766328495 Instance d94aa36d3a2b7f12:72bd82a400000033 (host=redacted-host8:22000) Hdfs split stats (:<# splits>/): 10:1/5.88 MB - AverageThreadTokens: 1.0087719298245614 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 17420369 - PerHostPeakMemUsage: 225599805 - RowsProduced: 100 - TotalNetworkReceiveTime: 162667377905 - TotalNetworkSendTime: 977838 - TotalStorageWaitTime: 554384068 - TotalThreadsInvoluntaryContextSwitches: 972 - TotalThreadsTotalWallClockTime: 173571771042 - TotalThreadsSysTime: 47992000 - TotalThreadsUserTime: 1184820000 - TotalThreadsVoluntaryContextSwitches: 1281 - TotalTime: 173693020152 Fragment Instance Lifecycle Timings - ExecTime: 2022139 - ExecTreeExecTime: 36090 - InactiveTotalTime: 0 - OpenTime: 172044497499 - ExecTreeOpenTime: 164574905864 - PrepareTime: 1646400251 - ExecTreePrepareTime: 115401372 - TotalTime: 0 DataStreamSender (dst_id=25) - BytesSent: 7008 - InactiveTotalTime: 0 - NetworkThroughput(*): 154320443 - OverallThroughput: 21366700 - PeakMemoryUsage: 1080 - RowsReturned: 100 - SerializeBatchTime: 216128 - TotalTime: 327987 - TransmitDataRPCTime: 45412 - UncompressedRowBatchSize: 14529 CodeGen - CodegenTime: 4114428 - CompileTime: 914712103 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076168 - NumFunctions: 145 - NumInstructions: 4511 - OptimizationTime: 6373042296 - PeakMemoryUsage: 2309632 - PrepareTime: 1163442243 - TotalTime: 8472911525 SORT_NODE (id=14) ExecOption: Codegen Enabled - InactiveTotalTime: 0 - InsertBatchTime: 1810959 - PeakMemoryUsage: 2434048 - RowsReturned: 100 - RowsReturnedRate: 0 - TotalTime: 164690333860 HASH_JOIN_NODE (id=13) ExecOption: Probe Side Codegen Enabled - BuildRows: 27999 - BuildTime: 205946783 - InactiveTotalTime: 0 - LocalTime: 527495373 - NumHashTableBuildsSkipped: 0 - PeakMemoryUsage: 11917624 - ProbeRows: 308334 - ProbeRowsPartitioned: 0 - ProbeTime: 42155154 - RowsReturned: 3427 - RowsReturnedRate: 20 - TotalTime: 164691919137 Hash Join Builder (join_node_id=13) ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 57545544 - BuildRowsPartitioned: 27999 - GetNewBlockTime: 13249019 - HashBuckets: 65536 - HashCollisions: 0 - HashTablesBuildTime: 134176055 - InactiveTotalTime: 0 - LargestPartitionPercent: 6 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 11564160 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=24) - BytesReceived: 2539830 - ConvertRowBatchTime: 6000242 - DeserializeRowBatchTimer: 30405720 - FirstBatchArrivalWaitTime: 140418826261 - InactiveTotalTime: 162665630801 - PeakMemoryUsage: 0 - RowsReturned: 27999 - RowsReturnedRate: 172 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 162674026300 HDFS_SCAN_NODE (id=11) Hdfs split stats (:<# splits>/): 10:1/5.88 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:2 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 1.0 - BytesRead: 1814021 - BytesReadDataNodeCache: 0 - BytesReadLocal: 1814021 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1814021 - DecompressionTime: 60832124 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 1 - NumRowGroups: 1 - NumScannerThreadsStarted: 1 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 3468334 - PerReadThreadRawHdfsThroughput: 279874998 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 1455163411 - RowBatchQueuePutWaitTime: 0 - RowsRead: 308334 - RowsReturned: 308334 - RowsReturnedRate: 206880 - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 255 - ScannerThreadsTotalWallClockTime: 1525299978 - MaterializeTupleTime(*): 580827794 - ScannerThreadsSysTime: 4999000 - ScannerThreadsUserTime: 159975000 - ScannerThreadsVoluntaryContextSwitches: 66 - TotalRawHdfsReadTime(*): 6481540 - TotalReadThroughput: 10601 - TotalTime: 1490397464 Averaged Fragment F09 split sizes: min: 0, max: 0, avg: 0, stddev: 0 completion times: min:2m52s max:2m57s mean: 2m56s stddev:1s752ms execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec num instances: 6 - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 21914922 - PerHostPeakMemUsage: 228513934 - RowsProduced: 4666 - TotalNetworkReceiveTime: 171350617810 - TotalNetworkSendTime: 35710495 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 425 - TotalThreadsTotalWallClockTime: 174726213362 - TotalThreadsSysTime: 24829833 - TotalThreadsUserTime: 757718500 - TotalThreadsVoluntaryContextSwitches: 1833 - TotalTime: 175759497005 Fragment Instance Lifecycle Timings - ExecTime: 22582488443 - ExecTreeExecTime: 22208076849 - InactiveTotalTime: 0 - OpenTime: 152143742760 - ExecTreeOpenTime: 149848721114 - PrepareTime: 1030043395 - ExecTreePrepareTime: 20235869 - TotalTime: 0 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 140 - BlocksRecycled: 60 - BufferedPins: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 209715200 - PeakMemoryUsage: 143479312 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 - ScratchWrites: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 DataStreamSender (dst_id=24) - BytesSent: 2963135 - InactiveTotalTime: 0 - NetworkThroughput(*): 329899805 - OverallThroughput: 46761287 - PeakMemoryUsage: 13216 - RowsReturned: 4666 - SerializeBatchTime: 56867253 - TotalTime: 68245084 - TransmitDataRPCTime: 11287479 - UncompressedRowBatchSize: 5424681 CodeGen - CodegenTime: 0 - CompileTime: 782570179 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076168 - NumFunctions: 54 - NumInstructions: 2406 - OptimizationTime: 1441882459 - PeakMemoryUsage: 1231872 - PrepareTime: 709604583 - TotalTime: 2985148095 HASH_JOIN_NODE (id=12) - BuildRows: 4823 - BuildTime: 41017783 - InactiveTotalTime: 0 - LocalTime: 368666612 - NumHashTableBuildsSkipped: 0 - PeakMemoryUsage: 1981238 - ProbeRows: 833333 - ProbeRowsPartitioned: 0 - ProbeTime: 207176400 - RowsReturned: 4666 - RowsReturnedRate: 26 - TotalTime: 172093637772 Hash Join Builder (join_node_id=12) - BuildRowsPartitionTime: 11434272 - BuildRowsPartitioned: 4823 - GetNewBlockTime: 5798385 - HashBuckets: 8192 - HashCollisions: 0 - HashTablesBuildTime: 23061446 - InactiveTotalTime: 0 - LargestPartitionPercent: 6 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 1878485 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=23) - BytesReceived: 259360 - ConvertRowBatchTime: 1065572 - DeserializeRowBatchTimer: 40991994 - FirstBatchArrivalWaitTime: 149625481535 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 4823 - RowsReturnedRate: 31 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 149804771602 EXCHANGE_NODE (id=22) - BytesReceived: 31057531 - ConvertRowBatchTime: 323436053 - DeserializeRowBatchTimer: 5179099024 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 833333 - RowsReturnedRate: 38018 - SendersBlockedTimer: 135348327757 - SendersBlockedTotalTimer(*): 511378794857 - TotalTime: 21920199558 Fragment F09 Instance d94aa36d3a2b7f12:72bd82a40000002a (host=redacted-host6:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 22490559 - PerHostPeakMemUsage: 223945936 - RowsProduced: 4657 - TotalNetworkReceiveTime: 172298386953 - TotalNetworkSendTime: 111353410 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 382 - TotalThreadsTotalWallClockTime: 175909628647 - TotalThreadsSysTime: 24996000 - TotalThreadsUserTime: 773883000 - TotalThreadsVoluntaryContextSwitches: 1767 - TotalTime: 176833058539 Fragment Instance Lifecycle Timings - ExecTime: 22630096536 - ExecTreeExecTime: 21927132306 - InactiveTotalTime: 0 - OpenTime: 153279550191 - ExecTreeOpenTime: 151171193615 - PrepareTime: 923300740 - ExecTreePrepareTime: 406385 - TotalTime: 0 DataStreamSender (dst_id=24) - BytesSent: 2954217 - InactiveTotalTime: 0 - NetworkThroughput(*): 501310625 - OverallThroughput: 52184131 - PeakMemoryUsage: 13216 - RowsReturned: 4657 - SerializeBatchTime: 50641174 - TotalTime: 56611405 - TransmitDataRPCTime: 5892987 - UncompressedRowBatchSize: 5410097 CodeGen - CodegenTime: 0 - CompileTime: 694337839 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076168 - NumFunctions: 54 - NumInstructions: 2406 - OptimizationTime: 1363571686 - PeakMemoryUsage: 1231872 - PrepareTime: 489908997 - TotalTime: 2561627537 HASH_JOIN_NODE (id=12) ExecOption: Probe Side Codegen Enabled - BuildRows: 4657 - BuildTime: 40529576 - InactiveTotalTime: 0 - LocalTime: 421545652 - NumHashTableBuildsSkipped: 0 - PeakMemoryUsage: 2155911 - ProbeRows: 832457 - ProbeRowsPartitioned: 0 - ProbeTime: 198637128 - RowsReturned: 4657 - RowsReturnedRate: 26 - TotalTime: 173098914547 Hash Join Builder (join_node_id=12) ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 17587521 - BuildRowsPartitioned: 4657 - GetNewBlockTime: 20214613 - HashBuckets: 8192 - HashCollisions: 0 - HashTablesBuildTime: 2419943 - InactiveTotalTime: 0 - LargestPartitionPercent: 6 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 2053248 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=23) - BytesReceived: 251983 - ConvertRowBatchTime: 1056670 - DeserializeRowBatchTimer: 28571221 - FirstBatchArrivalWaitTime: 150972540139 - InactiveTotalTime: 151125744900 - PeakMemoryUsage: 0 - RowsReturned: 4657 - RowsReturnedRate: 30 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 151128070862 EXCHANGE_NODE (id=22) - BytesReceived: 31023478 - ConvertRowBatchTime: 317965415 - DeserializeRowBatchTimer: 5305883734 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 20795072946 - PeakMemoryUsage: 0 - RowsReturned: 832457 - RowsReturnedRate: 38630 - SendersBlockedTimer: 135201178849 - SendersBlockedTotalTimer(*): 398282681344 - TotalTime: 21549298033 Instance d94aa36d3a2b7f12:72bd82a40000002e (host=redacted-host3:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 21677943 - PerHostPeakMemUsage: 246953154 - RowsProduced: 4732 - TotalNetworkReceiveTime: 172595861319 - TotalNetworkSendTime: 3475183 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 417 - TotalThreadsTotalWallClockTime: 175843740773 - TotalThreadsSysTime: 23997000 - TotalThreadsUserTime: 762884000 - TotalThreadsVoluntaryContextSwitches: 1904 - TotalTime: 176821095113 Fragment Instance Lifecycle Timings - ExecTime: 22657246612 - ExecTreeExecTime: 22264865444 - InactiveTotalTime: 0 - OpenTime: 153186519247 - ExecTreeOpenTime: 150966297355 - PrepareTime: 977200602 - ExecTreePrepareTime: 483858 - TotalTime: 0 DataStreamSender (dst_id=24) - BytesSent: 3009139 - InactiveTotalTime: 0 - NetworkThroughput(*): 136297821 - OverallThroughput: 30840941 - PeakMemoryUsage: 13216 - RowsReturned: 4732 - SerializeBatchTime: 75422802 - TotalTime: 97569623 - TransmitDataRPCTime: 22077675 - UncompressedRowBatchSize: 5501440 CodeGen - CodegenTime: 0 - CompileTime: 736431954 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076168 - NumFunctions: 54 - NumInstructions: 2406 - OptimizationTime: 1419831150 - PeakMemoryUsage: 1231872 - PrepareTime: 674004167 - TotalTime: 2927266536 HASH_JOIN_NODE (id=12) ExecOption: Probe Side Codegen Enabled - BuildRows: 4732 - BuildTime: 27093396 - InactiveTotalTime: 0 - LocalTime: 303591599 - NumHashTableBuildsSkipped: 0 - PeakMemoryUsage: 1959485 - ProbeRows: 832824 - ProbeRowsPartitioned: 0 - ProbeTime: 200477170 - RowsReturned: 4732 - RowsReturnedRate: 27 - TotalTime: 173231864409 Hash Join Builder (join_node_id=12) ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 12136099 - BuildRowsPartitioned: 4732 - GetNewBlockTime: 5023044 - HashBuckets: 8192 - HashCollisions: 0 - HashTablesBuildTime: 9681692 - InactiveTotalTime: 0 - LargestPartitionPercent: 7 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 1856640 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=23) - BytesReceived: 256554 - ConvertRowBatchTime: 1031263 - DeserializeRowBatchTimer: 43114774 - FirstBatchArrivalWaitTime: 150749808081 - InactiveTotalTime: 150928637244 - PeakMemoryUsage: 0 - RowsReturned: 4732 - RowsReturnedRate: 31 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 150932248414 EXCHANGE_NODE (id=22) - BytesReceived: 31040596 - ConvertRowBatchTime: 300827240 - DeserializeRowBatchTimer: 4602658525 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 21459146270 - PeakMemoryUsage: 0 - RowsReturned: 832824 - RowsReturnedRate: 37862 - SendersBlockedTimer: 135337641431 - SendersBlockedTotalTimer(*): 533887388981 - TotalTime: 21996024396 Instance d94aa36d3a2b7f12:72bd82a400000029 (host=redacted-host7:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 21895133 - PerHostPeakMemUsage: 224948278 - RowsProduced: 4643 - TotalNetworkReceiveTime: 172749394552 - TotalNetworkSendTime: 677517 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 391 - TotalThreadsTotalWallClockTime: 175615841753 - TotalThreadsSysTime: 25996000 - TotalThreadsUserTime: 727890000 - TotalThreadsVoluntaryContextSwitches: 1797 - TotalTime: 176430192311 Fragment Instance Lifecycle Timings - ExecTime: 22593563012 - ExecTreeExecTime: 22226701104 - InactiveTotalTime: 0 - OpenTime: 153022295245 - ExecTreeOpenTime: 151250694171 - PrepareTime: 814217107 - ExecTreePrepareTime: 27306391 - TotalTime: 0 DataStreamSender (dst_id=24) - BytesSent: 2946531 - InactiveTotalTime: 0 - NetworkThroughput(*): 181984541 - OverallThroughput: 34043764 - PeakMemoryUsage: 13216 - RowsReturned: 4643 - SerializeBatchTime: 70298992 - TotalTime: 86551268 - TransmitDataRPCTime: 16191106 - UncompressedRowBatchSize: 5394781 CodeGen - CodegenTime: 0 - CompileTime: 761208215 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076168 - NumFunctions: 54 - NumInstructions: 2406 - OptimizationTime: 983111036 - PeakMemoryUsage: 1231872 - PrepareTime: 635782457 - TotalTime: 2411507716 HASH_JOIN_NODE (id=12) ExecOption: Probe Side Codegen Enabled - BuildRows: 4643 - BuildTime: 43752003 - InactiveTotalTime: 0 - LocalTime: 424172404 - NumHashTableBuildsSkipped: 0 - PeakMemoryUsage: 2156041 - ProbeRows: 833445 - ProbeRowsPartitioned: 0 - ProbeTime: 201547043 - RowsReturned: 4643 - RowsReturnedRate: 26 - TotalTime: 173531752639 Hash Join Builder (join_node_id=12) ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 10599704 - BuildRowsPartitioned: 4643 - GetNewBlockTime: 4474976 - HashBuckets: 8192 - HashCollisions: 0 - HashTablesBuildTime: 28397183 - InactiveTotalTime: 0 - LargestPartitionPercent: 6 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 2053248 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=23) - BytesReceived: 252015 - ConvertRowBatchTime: 1060258 - DeserializeRowBatchTimer: 24221946 - FirstBatchArrivalWaitTime: 151034431038 - InactiveTotalTime: 151199947051 - PeakMemoryUsage: 0 - RowsReturned: 4643 - RowsReturnedRate: 30 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 151205686297 EXCHANGE_NODE (id=22) - BytesReceived: 31062725 - ConvertRowBatchTime: 327929525 - DeserializeRowBatchTimer: 4397034561 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 21226552267 - PeakMemoryUsage: 0 - RowsReturned: 833445 - RowsReturnedRate: 38053 - SendersBlockedTimer: 135532350305 - SendersBlockedTotalTimer(*): 669612839210 - TotalTime: 21901893938 Instance d94aa36d3a2b7f12:72bd82a40000002d (host=redacted-host1:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 21817979 - PerHostPeakMemUsage: 224989726 - RowsProduced: 4617 - TotalNetworkReceiveTime: 172095587812 - TotalNetworkSendTime: 9942686 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 552 - TotalThreadsTotalWallClockTime: 175530868902 - TotalThreadsSysTime: 36995000 - TotalThreadsUserTime: 763884000 - TotalThreadsVoluntaryContextSwitches: 1876 - TotalTime: 176385157407 Fragment Instance Lifecycle Timings - ExecTime: 22511901281 - ExecTreeExecTime: 22322162793 - InactiveTotalTime: 0 - OpenTime: 153018984992 - ExecTreeOpenTime: 150461332388 - PrepareTime: 854150708 - ExecTreePrepareTime: 38678332 - TotalTime: 0 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 140 - BlocksRecycled: 60 - BufferedPins: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 209715200 - PeakMemoryUsage: 143479312 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 - ScratchWrites: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 DataStreamSender (dst_id=24) - BytesSent: 2932202 - InactiveTotalTime: 0 - NetworkThroughput(*): 435913076 - OverallThroughput: 67707354 - PeakMemoryUsage: 13216 - RowsReturned: 4617 - SerializeBatchTime: 36436955 - TotalTime: 43306994 - TransmitDataRPCTime: 6726575 - UncompressedRowBatchSize: 5371247 CodeGen - CodegenTime: 0 - CompileTime: 884958110 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076168 - NumFunctions: 54 - NumInstructions: 2406 - OptimizationTime: 1605101377 - PeakMemoryUsage: 1231872 - PrepareTime: 549183509 - TotalTime: 3109287173 HASH_JOIN_NODE (id=12) ExecOption: Probe Side Codegen Enabled - BuildRows: 4617 - BuildTime: 39554892 - InactiveTotalTime: 0 - LocalTime: 377954311 - NumHashTableBuildsSkipped: 0 - PeakMemoryUsage: 1828327 - ProbeRows: 834188 - ProbeRowsPartitioned: 0 - ProbeTime: 240536187 - RowsReturned: 4617 - RowsReturnedRate: 26 - TotalTime: 172860595140 Hash Join Builder (join_node_id=12) ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 11616886 - BuildRowsPartitioned: 4617 - GetNewBlockTime: 1298903 - HashBuckets: 8192 - HashCollisions: 0 - HashTablesBuildTime: 23755156 - InactiveTotalTime: 0 - LargestPartitionPercent: 6 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 1725568 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=23) - BytesReceived: 250127 - ConvertRowBatchTime: 1024425 - DeserializeRowBatchTimer: 45652555 - FirstBatchArrivalWaitTime: 150234659565 - InactiveTotalTime: 150387619239 - PeakMemoryUsage: 0 - RowsReturned: 4617 - RowsReturnedRate: 30 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 150420659189 EXCHANGE_NODE (id=22) - BytesReceived: 31088298 - ConvertRowBatchTime: 277585826 - DeserializeRowBatchTimer: 5168811947 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 21175390584 - PeakMemoryUsage: 0 - RowsReturned: 834188 - RowsReturnedRate: 37811 - SendersBlockedTimer: 135382127884 - SendersBlockedTotalTimer(*): 533928479635 - TotalTime: 22061981640 Instance d94aa36d3a2b7f12:72bd82a40000002c (host=redacted-host2:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 21679352 - PerHostPeakMemUsage: 224646707 - RowsProduced: 4630 - TotalNetworkReceiveTime: 172384164830 - TotalNetworkSendTime: 18657852 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 413 - TotalThreadsTotalWallClockTime: 175555356967 - TotalThreadsSysTime: 13998000 - TotalThreadsUserTime: 755886000 - TotalThreadsVoluntaryContextSwitches: 1779 - TotalTime: 176359507119 Fragment Instance Lifecycle Timings - ExecTime: 22528814774 - ExecTreeExecTime: 22331714973 - InactiveTotalTime: 0 - OpenTime: 153026555757 - ExecTreeOpenTime: 150727937314 - PrepareTime: 804024422 - ExecTreePrepareTime: 53597120 - TotalTime: 0 DataStreamSender (dst_id=24) - BytesSent: 2938824 - InactiveTotalTime: 0 - NetworkThroughput(*): 418351811 - OverallThroughput: 42451658 - PeakMemoryUsage: 13216 - RowsReturned: 4630 - SerializeBatchTime: 62125327 - TotalTime: 69227543 - TransmitDataRPCTime: 7024767 - UncompressedRowBatchSize: 5382580 CodeGen - CodegenTime: 0 - CompileTime: 762084616 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076168 - NumFunctions: 54 - NumInstructions: 2406 - OptimizationTime: 1501920323 - PeakMemoryUsage: 1231872 - PrepareTime: 484482658 - TotalTime: 2761620763 HASH_JOIN_NODE (id=12) ExecOption: Probe Side Codegen Enabled - BuildRows: 4630 - BuildTime: 37463236 - InactiveTotalTime: 0 - LocalTime: 371227069 - NumHashTableBuildsSkipped: 0 - PeakMemoryUsage: 1828303 - ProbeRows: 834734 - ProbeRowsPartitioned: 0 - ProbeTime: 227358113 - RowsReturned: 4630 - RowsReturnedRate: 26 - TotalTime: 173146536798 Hash Join Builder (join_node_id=12) ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 2281740 - BuildRowsPartitioned: 4630 - GetNewBlockTime: 3619119 - HashBuckets: 8192 - HashCollisions: 0 - HashTablesBuildTime: 31233385 - InactiveTotalTime: 0 - LargestPartitionPercent: 6 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 1725568 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=23) - BytesReceived: 250348 - ConvertRowBatchTime: 988116 - DeserializeRowBatchTimer: 45024988 - FirstBatchArrivalWaitTime: 150495532940 - InactiveTotalTime: 150685696041 - PeakMemoryUsage: 0 - RowsReturned: 4630 - RowsReturnedRate: 30 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 150689938324 EXCHANGE_NODE (id=22) - BytesReceived: 31106638 - ConvertRowBatchTime: 348621442 - DeserializeRowBatchTimer: 5075958081 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 21350204738 - PeakMemoryUsage: 0 - RowsReturned: 834734 - RowsReturnedRate: 37795 - SendersBlockedTimer: 135473132548 - SendersBlockedTotalTimer(*): 669404519571 - TotalTime: 22085371405 Instance d94aa36d3a2b7f12:72bd82a40000002b (host=redacted-host8:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 21928566 - PerHostPeakMemUsage: 225599805 - RowsProduced: 4720 - TotalNetworkReceiveTime: 165980311398 - TotalNetworkSendTime: 70156323 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 400 - TotalThreadsTotalWallClockTime: 169901843134 - TotalThreadsSysTime: 22997000 - TotalThreadsUserTime: 761884000 - TotalThreadsVoluntaryContextSwitches: 1879 - TotalTime: 171727971543 Fragment Instance Lifecycle Timings - ExecTime: 22573308444 - ExecTreeExecTime: 22175884477 - InactiveTotalTime: 0 - OpenTime: 147328551129 - ExecTreeOpenTime: 144514871846 - PrepareTime: 1807366791 - ExecTreePrepareTime: 943129 - TotalTime: 0 DataStreamSender (dst_id=24) - BytesSent: 2997897 - InactiveTotalTime: 0 - NetworkThroughput(*): 305540958 - OverallThroughput: 53339877 - PeakMemoryUsage: 13216 - RowsReturned: 4720 - SerializeBatchTime: 46278268 - TotalTime: 56203672 - TransmitDataRPCTime: 9811768 - UncompressedRowBatchSize: 5487944 CodeGen - CodegenTime: 0 - CompileTime: 856400340 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076168 - NumFunctions: 54 - NumInstructions: 2406 - OptimizationTime: 1777759185 - PeakMemoryUsage: 1231872 - PrepareTime: 1424265715 - TotalTime: 4139578847 HASH_JOIN_NODE (id=12) ExecOption: Probe Side Codegen Enabled - BuildRows: 5660 - BuildTime: 57713597 - InactiveTotalTime: 0 - LocalTime: 313508640 - NumHashTableBuildsSkipped: 0 - PeakMemoryUsage: 1959364 - ProbeRows: 832352 - ProbeRowsPartitioned: 0 - ProbeTime: 174502760 - RowsReturned: 4720 - RowsReturnedRate: 28 - TotalTime: 166692163104 Hash Join Builder (join_node_id=12) ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 14383683 - BuildRowsPartitioned: 5660 - GetNewBlockTime: 159657 - HashBuckets: 8192 - HashCollisions: 0 - HashTablesBuildTime: 42881317 - InactiveTotalTime: 0 - LargestPartitionPercent: 6 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 1856640 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=23) - BytesReceived: 295136 - ConvertRowBatchTime: 1232701 - DeserializeRowBatchTimer: 59366484 - FirstBatchArrivalWaitTime: 144265917450 - InactiveTotalTime: 144442346696 - PeakMemoryUsage: 0 - RowsReturned: 5660 - RowsReturnedRate: 39 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 144452026527 EXCHANGE_NODE (id=22) - BytesReceived: 31023452 - ConvertRowBatchTime: 367686871 - DeserializeRowBatchTimer: 6524247301 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 21094273663 - PeakMemoryUsage: 0 - RowsReturned: 832352 - RowsReturnedRate: 37960 - SendersBlockedTimer: 135163535529 - SendersBlockedTotalTimer(*): 263156860404 - TotalTime: 21926627937 Averaged Fragment F01 split sizes: min: 32.91 MB, max: 66.68 MB, avg: 44.45 MB, stddev: 15.72 MB completion times: min:2m38s max:2m56s mean: 2m44s stddev:6s668ms execution rates: min:210.32 KB/sec max:398.73 KB/sec mean:272.84 KB/sec stddev:84.93 KB/sec num instances: 6 - AverageThreadTokens: 1.975625691993564 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 22346926 - PerHostPeakMemUsage: 228513934 - RowsProduced: 833333 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 151050421000 - TotalStorageWaitTime: 5307838950 - TotalThreadsInvoluntaryContextSwitches: 3611 - TotalThreadsTotalWallClockTime: 324651228942 - TotalThreadsSysTime: 64989333 - TotalThreadsUserTime: 3040370666 - TotalThreadsVoluntaryContextSwitches: 1721 - TotalTime: 164672598775 Fragment Instance Lifecycle Timings - ExecTime: 163506643284 - ExecTreeExecTime: 6406061795 - InactiveTotalTime: 0 - OpenTime: 256795374 - ExecTreeOpenTime: 136768 - PrepareTime: 905946198 - ExecTreePrepareTime: 537659 - TotalTime: 0 DataStreamSender (dst_id=22) - BytesSent: 31057531 - InactiveTotalTime: 0 - NetworkThroughput(*): 166336656 - OverallThroughput: 14622105 - PeakMemoryUsage: 188064 - RowsReturned: 833333 - SerializeBatchTime: 1906849044 - TotalTime: 2097199460 - TransmitDataRPCTime: 186288843 - UncompressedRowBatchSize: 53801824 CodeGen - CodegenTime: 19989247 - CompileTime: 36505770 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076168 - NumFunctions: 5 - NumInstructions: 98 - OptimizationTime: 188088164 - PeakMemoryUsage: 50176 - PrepareTime: 682981159 - TotalTime: 960350189 HDFS_SCAN_NODE (id=10) - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.9842496806452462 - BytesRead: 10648538 - BytesReadDataNodeCache: 0 - BytesReadLocal: 10648538 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 10648538 - DecompressionTime: 143249796 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 4 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 1 - NumRowGroups: 1 - NumScannerThreadsStarted: 1 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 22151612 - PerReadThreadRawHdfsThroughput: 337379422 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 5623630595 - RowBatchQueuePutWaitTime: 150273849222 - RowsRead: 833333 - RowsReturned: 833333 - RowsReturnedRate: 345451 - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 214 - ScannerThreadsTotalWallClockTime: 160887810881 - MaterializeTupleTime(*): 3756166158 - ScannerThreadsSysTime: 21496000 - ScannerThreadsUserTime: 861701833 - ScannerThreadsVoluntaryContextSwitches: 1123 - TotalRawHdfsReadTime(*): 31026223 - TotalReadThroughput: 64880 - TotalTime: 6403569677 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 140 - BlocksRecycled: 62 - BufferedPins: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 209715200 - PeakMemoryUsage: 143479312 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 - ScratchWrites: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 Fragment F01 Instance d94aa36d3a2b7f12:72bd82a400000001 (host=redacted-host7:22000) Hdfs split stats (:<# splits>/): 5:1/32.90 MB 2:1/33.78 MB - AverageThreadTokens: 1.9828080229226361 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 23047342 - PerHostPeakMemUsage: 224948278 - RowsProduced: 1250000 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 155547292613 - TotalStorageWaitTime: 12433278140 - TotalThreadsInvoluntaryContextSwitches: 5556 - TotalThreadsTotalWallClockTime: 349377208214 - TotalThreadsSysTime: 78988000 - TotalThreadsUserTime: 4385332000 - TotalThreadsVoluntaryContextSwitches: 2221 - TotalTime: 176326678002 Fragment Instance Lifecycle Timings - ExecTime: 175229595203 - ExecTreeExecTime: 11720788863 - InactiveTotalTime: 0 - OpenTime: 239004586 - ExecTreeOpenTime: 148909 - PrepareTime: 857987725 - ExecTreePrepareTime: 1687928 - TotalTime: 0 DataStreamSender (dst_id=22) - BytesSent: 45549306 - InactiveTotalTime: 0 - NetworkThroughput(*): 168918538 - OverallThroughput: 16833787 - PeakMemoryUsage: 188064 - RowsReturned: 1250000 - SerializeBatchTime: 2434541929 - TotalTime: 2705826376 - TransmitDataRPCTime: 269652499 - UncompressedRowBatchSize: 80707107 CodeGen - CodegenTime: 65094891 - CompileTime: 41438145 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076168 - NumFunctions: 5 - NumInstructions: 98 - OptimizationTime: 185577605 - PeakMemoryUsage: 50176 - PrepareTime: 770008105 - TotalTime: 1021365070 HDFS_SCAN_NODE (id=10) Hdfs split stats (:<# splits>/): 5:1/32.90 MB 2:1/33.78 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 2 out of 2 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:8 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.9913294797687862 - BytesRead: 15972767 - BytesReadDataNodeCache: 0 - BytesReadLocal: 15972767 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 15972767 - DecompressionTime: 220658202 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 4 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 2 - NumRowGroups: 2 - NumScannerThreadsStarted: 1 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 22850663 - PerReadThreadRawHdfsThroughput: 370595064 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 10561763572 - RowBatchQueuePutWaitTime: 154797191685 - RowsRead: 1250000 - RowsReturned: 1250000 - RowsReturnedRate: 106653 - ScanRangesComplete: 2 - ScannerThreadsInvoluntaryContextSwitches: 482 - ScannerThreadsTotalWallClockTime: 173908640318 - MaterializeTupleTime(*): 5059583696 - ScannerThreadsSysTime: 21996000 - ScannerThreadsUserTime: 1264807000 - ScannerThreadsVoluntaryContextSwitches: 1468 - TotalRawHdfsReadTime(*): 43100323 - TotalReadThroughput: 91498 - TotalTime: 11720177709 Instance d94aa36d3a2b7f12:72bd82a400000004 (host=redacted-host2:22000) Hdfs split stats (:<# splits>/): 0:1/33.77 MB 1:1/32.90 MB - AverageThreadTokens: 1.9881305637982196 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 23047342 - PerHostPeakMemUsage: 224646707 - RowsProduced: 1249999 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 160002553441 - TotalStorageWaitTime: 1002743126 - TotalThreadsInvoluntaryContextSwitches: 4992 - TotalThreadsTotalWallClockTime: 338959372003 - TotalThreadsSysTime: 74987000 - TotalThreadsUserTime: 4564306000 - TotalThreadsVoluntaryContextSwitches: 2537 - TotalTime: 170955438387 Fragment Instance Lifecycle Timings - ExecTime: 170262312355 - ExecTreeExecTime: 1658001679 - InactiveTotalTime: 0 - OpenTime: 130952963 - ExecTreeOpenTime: 147044 - PrepareTime: 543522500 - ExecTreePrepareTime: 241472 - TotalTime: 0 DataStreamSender (dst_id=22) - BytesSent: 46523992 - InactiveTotalTime: 0 - NetworkThroughput(*): 167196304 - OverallThroughput: 14845599 - PeakMemoryUsage: 188064 - RowsReturned: 1249999 - SerializeBatchTime: 2853782134 - TotalTime: 3133857494 - TransmitDataRPCTime: 278259691 - UncompressedRowBatchSize: 80701624 CodeGen - CodegenTime: 738243 - CompileTime: 28759120 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076168 - NumFunctions: 5 - NumInstructions: 98 - OptimizationTime: 54420660 - PeakMemoryUsage: 50176 - PrepareTime: 406874916 - TotalTime: 512085878 HDFS_SCAN_NODE (id=10) Hdfs split stats (:<# splits>/): 0:1/33.77 MB 1:1/32.90 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 2 out of 2 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:8 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.9910714285714286 - BytesRead: 15972798 - BytesReadDataNodeCache: 0 - BytesReadLocal: 15972798 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 15972798 - DecompressionTime: 246401007 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 4 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 2 - NumRowGroups: 2 - NumScannerThreadsStarted: 1 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 22850663 - PerReadThreadRawHdfsThroughput: 430099574 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 792961379 - RowBatchQueuePutWaitTime: 160181997279 - RowsRead: 1249999 - RowsReturned: 1249999 - RowsReturnedRate: 755578 - ScanRangesComplete: 2 - ScannerThreadsInvoluntaryContextSwitches: 314 - ScannerThreadsTotalWallClockTime: 168566124502 - MaterializeTupleTime(*): 5917876950 - ScannerThreadsSysTime: 19996000 - ScannerThreadsUserTime: 1309800000 - ScannerThreadsVoluntaryContextSwitches: 1713 - TotalRawHdfsReadTime(*): 37137442 - TotalReadThroughput: 94727 - TotalTime: 1654360938 Instance d94aa36d3a2b7f12:72bd82a400000003 (host=redacted-host8:22000) Hdfs split stats (:<# splits>/): 1:1/33.78 MB - AverageThreadTokens: 1.9595015576323989 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 23047342 - PerHostPeakMemUsage: 225599805 - RowsProduced: 633335 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 135259594582 - TotalStorageWaitTime: 17043612715 - TotalThreadsInvoluntaryContextSwitches: 3082 - TotalThreadsTotalWallClockTime: 318141186144 - TotalThreadsSysTime: 55991000 - TotalThreadsUserTime: 2335644000 - TotalThreadsVoluntaryContextSwitches: 1123 - TotalTime: 163111521185 Fragment Instance Lifecycle Timings - ExecTime: 161089393312 - ExecTreeExecTime: 20220894626 - InactiveTotalTime: 0 - OpenTime: 482492107 - ExecTreeOpenTime: 136839 - PrepareTime: 1539528272 - ExecTreePrepareTime: 366556 - TotalTime: 0 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 140 - BlocksRecycled: 62 - BufferedPins: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 209715200 - PeakMemoryUsage: 143479312 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 - ScratchWrites: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 DataStreamSender (dst_id=22) - BytesSent: 24036775 - InactiveTotalTime: 0 - NetworkThroughput(*): 165319295 - OverallThroughput: 14706777 - PeakMemoryUsage: 188064 - RowsReturned: 633335 - SerializeBatchTime: 1471678094 - TotalTime: 1634401193 - TransmitDataRPCTime: 145396065 - UncompressedRowBatchSize: 40887769 CodeGen - CodegenTime: 21142686 - CompileTime: 71603061 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076168 - NumFunctions: 5 - NumInstructions: 98 - OptimizationTime: 315991051 - PeakMemoryUsage: 50176 - PrepareTime: 1055486935 - TotalTime: 1607896458 HDFS_SCAN_NODE (id=10) Hdfs split stats (:<# splits>/): 1:1/33.78 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:4 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.9746835443037974 - BytesRead: 8088587 - BytesReadDataNodeCache: 0 - BytesReadLocal: 8088587 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 8088587 - DecompressionTime: 63746117 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 4 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 1 - NumRowGroups: 1 - NumScannerThreadsStarted: 1 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 22850663 - PerReadThreadRawHdfsThroughput: 370890534 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 19130456425 - RowBatchQueuePutWaitTime: 135583145512 - RowsRead: 633335 - RowsReturned: 633335 - RowsReturnedRate: 31323 - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 167 - ScannerThreadsTotalWallClockTime: 156569320522 - MaterializeTupleTime(*): 1613902850 - ScannerThreadsSysTime: 16997000 - ScannerThreadsUserTime: 628904000 - ScannerThreadsVoluntaryContextSwitches: 626 - TotalRawHdfsReadTime(*): 21808556 - TotalReadThroughput: 50522 - TotalTime: 20219394161 Instance d94aa36d3a2b7f12:72bd82a400000002 (host=redacted-host6:22000) Hdfs split stats (:<# splits>/): 9:1/32.91 MB - AverageThreadTokens: 1.9715189873417722 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 20950190 - PerHostPeakMemUsage: 223945936 - RowsProduced: 616667 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 152258565579 - TotalStorageWaitTime: 630210054 - TotalThreadsInvoluntaryContextSwitches: 2521 - TotalThreadsTotalWallClockTime: 314937250975 - TotalThreadsSysTime: 43993000 - TotalThreadsUserTime: 2352642000 - TotalThreadsVoluntaryContextSwitches: 1326 - TotalTime: 159982001675 Fragment Instance Lifecycle Timings - ExecTime: 158853098285 - ExecTreeExecTime: 1637680654 - InactiveTotalTime: 0 - OpenTime: 209528425 - ExecTreeOpenTime: 128397 - PrepareTime: 919200530 - ExecTreePrepareTime: 364598 - TotalTime: 0 DataStreamSender (dst_id=22) - BytesSent: 23697941 - InactiveTotalTime: 0 - NetworkThroughput(*): 162626736 - OverallThroughput: 13843808 - PeakMemoryUsage: 188064 - RowsReturned: 616667 - SerializeBatchTime: 1564324417 - TotalTime: 1711807909 - TransmitDataRPCTime: 145719834 - UncompressedRowBatchSize: 39813010 CodeGen - CodegenTime: 4883081 - CompileTime: 8020260 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076168 - NumFunctions: 5 - NumInstructions: 98 - OptimizationTime: 169975273 - PeakMemoryUsage: 50176 - PrepareTime: 761429763 - TotalTime: 940256628 HDFS_SCAN_NODE (id=10) Hdfs split stats (:<# splits>/): 9:1/32.91 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:4 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.9808306709265175 - BytesRead: 7884069 - BytesReadDataNodeCache: 0 - BytesReadLocal: 7884069 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 7884069 - DecompressionTime: 54927871 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 4 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 1 - NumRowGroups: 1 - NumScannerThreadsStarted: 1 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 20753511 - PerReadThreadRawHdfsThroughput: 299151069 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 1135627592 - RowBatchQueuePutWaitTime: 151473969892 - RowsRead: 616667 - RowsReturned: 616667 - RowsReturnedRate: 376852 - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 127 - ScannerThreadsTotalWallClockTime: 155874641979 - MaterializeTupleTime(*): 2513000555 - ScannerThreadsSysTime: 9998000 - ScannerThreadsUserTime: 670898000 - ScannerThreadsVoluntaryContextSwitches: 806 - TotalRawHdfsReadTime(*): 26354808 - TotalReadThroughput: 49877 - TotalTime: 1636362318 Instance d94aa36d3a2b7f12:72bd82a400000006 (host=redacted-host3:22000) Hdfs split stats (:<# splits>/): 2:1/33.78 MB - AverageThreadTokens: 1.9745222929936306 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 23039150 - PerHostPeakMemUsage: 246953154 - RowsProduced: 633333 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 151315987581 - TotalStorageWaitTime: 623946494 - TotalThreadsInvoluntaryContextSwitches: 2851 - TotalThreadsTotalWallClockTime: 313154654407 - TotalThreadsSysTime: 48991000 - TotalThreadsUserTime: 2368639000 - TotalThreadsVoluntaryContextSwitches: 1638 - TotalTime: 158853013077 Fragment Instance Lifecycle Timings - ExecTime: 157712592546 - ExecTreeExecTime: 1857362826 - InactiveTotalTime: 0 - OpenTime: 306088033 - ExecTreeOpenTime: 174296 - PrepareTime: 834223478 - ExecTreePrepareTime: 217537 - TotalTime: 0 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 140 - BlocksRecycled: 62 - BufferedPins: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 209715200 - PeakMemoryUsage: 143479312 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 - ScratchWrites: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 DataStreamSender (dst_id=22) - BytesSent: 23576260 - InactiveTotalTime: 0 - NetworkThroughput(*): 166768109 - OverallThroughput: 12982874 - PeakMemoryUsage: 188064 - RowsReturned: 633333 - SerializeBatchTime: 1673657340 - TotalTime: 1815950748 - TransmitDataRPCTime: 141371513 - UncompressedRowBatchSize: 40889759 CodeGen - CodegenTime: 25185522 - CompileTime: 25555894 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076168 - NumFunctions: 5 - NumInstructions: 98 - OptimizationTime: 276881780 - PeakMemoryUsage: 50176 - PrepareTime: 629767767 - TotalTime: 945540979 HDFS_SCAN_NODE (id=10) Hdfs split stats (:<# splits>/): 2:1/33.78 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:4 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.9839228295819936 - BytesRead: 8088862 - BytesReadDataNodeCache: 0 - BytesReadLocal: 8088862 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 8088862 - DecompressionTime: 154510447 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 4 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 1 - NumRowGroups: 1 - NumScannerThreadsStarted: 1 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 22850663 - PerReadThreadRawHdfsThroughput: 286387489 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 1329605623 - RowBatchQueuePutWaitTime: 148957242858 - RowsRead: 633333 - RowsReturned: 633333 - RowsReturnedRate: 342172 - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 119 - ScannerThreadsTotalWallClockTime: 155135995156 - MaterializeTupleTime(*): 4075604102 - ScannerThreadsSysTime: 19996000 - ScannerThreadsUserTime: 664898000 - ScannerThreadsVoluntaryContextSwitches: 1112 - TotalRawHdfsReadTime(*): 28244467 - TotalReadThroughput: 51499 - TotalTime: 1850918354 Instance d94aa36d3a2b7f12:72bd82a400000005 (host=redacted-host1:22000) Hdfs split stats (:<# splits>/): 1:1/32.91 MB - AverageThreadTokens: 1.9772727272727273 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 20950190 - PerHostPeakMemUsage: 224989726 - RowsProduced: 616666 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 151918532209 - TotalStorageWaitTime: 113243171 - TotalThreadsInvoluntaryContextSwitches: 2665 - TotalThreadsTotalWallClockTime: 313337701909 - TotalThreadsSysTime: 86986000 - TotalThreadsUserTime: 2235661000 - TotalThreadsVoluntaryContextSwitches: 1483 - TotalTime: 158806940327 Fragment Instance Lifecycle Timings - ExecTime: 157892868004 - ExecTreeExecTime: 1341642127 - InactiveTotalTime: 0 - OpenTime: 172706135 - ExecTreeOpenTime: 85123 - PrepareTime: 741214688 - ExecTreePrepareTime: 347866 - TotalTime: 0 DataStreamSender (dst_id=22) - BytesSent: 22960913 - InactiveTotalTime: 0 - NetworkThroughput(*): 167190959 - OverallThroughput: 14519789 - PeakMemoryUsage: 188064 - RowsReturned: 616666 - SerializeBatchTime: 1443110350 - TotalTime: 1581353043 - TransmitDataRPCTime: 137333460 - UncompressedRowBatchSize: 39811680 CodeGen - CodegenTime: 2891063 - CompileTime: 43658144 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076168 - NumFunctions: 5 - NumInstructions: 98 - OptimizationTime: 125682620 - PeakMemoryUsage: 50176 - PrepareTime: 474319470 - TotalTime: 734956124 HDFS_SCAN_NODE (id=10) Hdfs split stats (:<# splits>/): 1:1/32.91 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:4 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.9836601307189542 - BytesRead: 7884146 - BytesReadDataNodeCache: 0 - BytesReadLocal: 7884146 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 7884146 - DecompressionTime: 119255134 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 4 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 1 - NumRowGroups: 1 - NumScannerThreadsStarted: 1 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 20753511 - PerReadThreadRawHdfsThroughput: 267152805 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 791368980 - RowBatchQueuePutWaitTime: 150649548106 - RowsRead: 616666 - RowsReturned: 616666 - RowsReturnedRate: 460128 - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 77 - ScannerThreadsTotalWallClockTime: 155272142813 - MaterializeTupleTime(*): 3357028797 - ScannerThreadsSysTime: 39993000 - ScannerThreadsUserTime: 630904000 - ScannerThreadsVoluntaryContextSwitches: 1015 - TotalRawHdfsReadTime(*): 29511747 - TotalReadThroughput: 51162 - TotalTime: 1340204585 Averaged Fragment F08 split sizes: min: 0, max: 0, avg: 0, stddev: 0 completion times: min:2m29s max:2m34s mean: 2m33s stddev:1s593ms execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec num instances: 8 - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 2985216 - PerHostPeakMemUsage: 218387409 - RowsProduced: 3617 - TotalNetworkReceiveTime: 150714419321 - TotalNetworkSendTime: 74572290 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 115 - TotalThreadsTotalWallClockTime: 152235014077 - TotalThreadsSysTime: 4999125 - TotalThreadsUserTime: 214592500 - TotalThreadsVoluntaryContextSwitches: 244 - TotalTime: 153388142724 Fragment Instance Lifecycle Timings - ExecTime: 165211281 - ExecTreeExecTime: 59662353 - InactiveTotalTime: 0 - OpenTime: 152069820740 - ExecTreeOpenTime: 150762739699 - PrepareTime: 1152978062 - ExecTreePrepareTime: 257588549 - TotalTime: 0 DataStreamSender (dst_id=23) - BytesSent: 194520 - InactiveTotalTime: 0 - NetworkThroughput(*): 157161854 - OverallThroughput: 22627175 - PeakMemoryUsage: 178816 - RowsReturned: 3617 - SerializeBatchTime: 5477350 - TotalTime: 13988987 - TransmitDataRPCTime: 1237992 - UncompressedRowBatchSize: 368002 CodeGen - CodegenTime: 103876821 - CompileTime: 435469210 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076168 - NumFunctions: 54 - NumInstructions: 1085 - OptimizationTime: 829236449 - PeakMemoryUsage: 555520 - PrepareTime: 685322096 - TotalTime: 1988539776 AGGREGATION_NODE (id=21) - BuildTime: 30107737 - GetNewBlockTime: 182825220 - GetResultsTime: 2667876 - HTResizeTime: 15490920 - HashBuckets: 32768 - InactiveTotalTime: 0 - LargestPartitionPercent: 6 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 2791786 - PinTime: 0 - RowsRepartitioned: 0 - RowsReturned: 3617 - RowsReturnedRate: 23 - SpilledPartitions: 0 - TotalTime: 151079925906 - UnpinTime: 3931 EXCHANGE_NODE (id=20) - BytesReceived: 195014 - ConvertRowBatchTime: 799356 - DeserializeRowBatchTimer: 27544877 - FirstBatchArrivalWaitTime: 150469746640 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 3617 - RowsReturnedRate: 23 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 150715531453 Fragment F08 Instance d94aa36d3a2b7f12:72bd82a400000021 (host=redacted-host4:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 2985216 - PerHostPeakMemUsage: 193321646 - RowsProduced: 3711 - TotalNetworkReceiveTime: 152753816031 - TotalNetworkSendTime: 94615548 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 107 - TotalThreadsTotalWallClockTime: 153787538362 - TotalThreadsSysTime: 4999000 - TotalThreadsUserTime: 205968000 - TotalThreadsVoluntaryContextSwitches: 177 - TotalTime: 154480785260 Fragment Instance Lifecycle Timings - ExecTime: 150063400 - ExecTreeExecTime: 28357014 - InactiveTotalTime: 0 - OpenTime: 153637489826 - ExecTreeOpenTime: 152813417188 - PrepareTime: 693104964 - ExecTreePrepareTime: 63188899 - TotalTime: 0 DataStreamSender (dst_id=23) - BytesSent: 199451 - InactiveTotalTime: 0 - NetworkThroughput(*): 161380918 - OverallThroughput: 5471758 - PeakMemoryUsage: 180864 - RowsReturned: 3711 - SerializeBatchTime: 4607671 - TotalTime: 36450988 - TransmitDataRPCTime: 1235902 - UncompressedRowBatchSize: 377358 CodeGen - CodegenTime: 48689337 - CompileTime: 275551291 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076168 - NumFunctions: 54 - NumInstructions: 1085 - OptimizationTime: 524879300 - PeakMemoryUsage: 555520 - PrepareTime: 498566921 - TotalTime: 1318792757 AGGREGATION_NODE (id=21) ExecOption: Codegen Enabled - BuildTime: 23275028 - GetNewBlockTime: 47119683 - GetResultsTime: 8370750 - HTResizeTime: 8898001 - HashBuckets: 32768 - InactiveTotalTime: 0 - LargestPartitionPercent: 6 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 2790374 - PinTime: 0 - RowsRepartitioned: 0 - RowsReturned: 3711 - RowsReturnedRate: 24 - SpilledPartitions: 0 - TotalTime: 152904901316 - UnpinTime: 3920 EXCHANGE_NODE (id=20) - BytesReceived: 199726 - ConvertRowBatchTime: 822174 - DeserializeRowBatchTimer: 9079134 - FirstBatchArrivalWaitTime: 152510556592 - InactiveTotalTime: 152753560537 - PeakMemoryUsage: 0 - RowsReturned: 3711 - RowsReturnedRate: 24 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 152754953582 Instance d94aa36d3a2b7f12:72bd82a400000022 (host=redacted-host5:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 2985216 - PerHostPeakMemUsage: 182694027 - RowsProduced: 3532 - TotalNetworkReceiveTime: 151584119960 - TotalNetworkSendTime: 19043889 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 116 - TotalThreadsTotalWallClockTime: 153437961449 - TotalThreadsSysTime: 7998000 - TotalThreadsUserTime: 221967000 - TotalThreadsVoluntaryContextSwitches: 288 - TotalTime: 154184855321 Fragment Instance Lifecycle Timings - ExecTime: 228759952 - ExecTreeExecTime: 189918568 - InactiveTotalTime: 0 - OpenTime: 153209217689 - ExecTreeOpenTime: 151634566597 - PrepareTime: 746690642 - ExecTreePrepareTime: 336651746 - TotalTime: 0 DataStreamSender (dst_id=23) - BytesSent: 189919 - InactiveTotalTime: 0 - NetworkThroughput(*): 158977788 - OverallThroughput: 35424995 - PeakMemoryUsage: 164480 - RowsReturned: 3532 - SerializeBatchTime: 4084217 - TotalTime: 5361158 - TransmitDataRPCTime: 1194626 - UncompressedRowBatchSize: 359153 CodeGen - CodegenTime: 28895582 - CompileTime: 551516902 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076168 - NumFunctions: 54 - NumInstructions: 1085 - OptimizationTime: 939496258 - PeakMemoryUsage: 555520 - PrepareTime: 413081183 - TotalTime: 1904938146 AGGREGATION_NODE (id=21) ExecOption: Codegen Enabled - BuildTime: 43792655 - GetNewBlockTime: 102013984 - GetResultsTime: 1812792 - HTResizeTime: 18556433 - HashBuckets: 32768 - InactiveTotalTime: 0 - LargestPartitionPercent: 6 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 2789901 - PinTime: 0 - RowsRepartitioned: 0 - RowsReturned: 3532 - RowsReturnedRate: 23 - SpilledPartitions: 0 - TotalTime: 152161068857 - UnpinTime: 3368 EXCHANGE_NODE (id=20) - BytesReceived: 190753 - ConvertRowBatchTime: 793941 - DeserializeRowBatchTimer: 10955163 - FirstBatchArrivalWaitTime: 151363799720 - InactiveTotalTime: 151583898187 - PeakMemoryUsage: 0 - RowsReturned: 3532 - RowsReturnedRate: 23 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 151585238846 Instance d94aa36d3a2b7f12:72bd82a400000023 (host=redacted-host6:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 2985216 - PerHostPeakMemUsage: 223945936 - RowsProduced: 3575 - TotalNetworkReceiveTime: 151344404108 - TotalNetworkSendTime: 137318712 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 98 - TotalThreadsTotalWallClockTime: 152770705265 - TotalThreadsSysTime: 4999000 - TotalThreadsUserTime: 215967000 - TotalThreadsVoluntaryContextSwitches: 194 - TotalTime: 154164553552 Fragment Instance Lifecycle Timings - ExecTime: 226632613 - ExecTreeExecTime: 76294425 - InactiveTotalTime: 0 - OpenTime: 152544087734 - ExecTreeOpenTime: 151371208047 - PrepareTime: 1393629478 - ExecTreePrepareTime: 445635546 - TotalTime: 0 DataStreamSender (dst_id=23) - BytesSent: 192078 - InactiveTotalTime: 0 - NetworkThroughput(*): 155625774 - OverallThroughput: 35794864 - PeakMemoryUsage: 180864 - RowsReturned: 3575 - SerializeBatchTime: 4005255 - TotalTime: 5366077 - TransmitDataRPCTime: 1234230 - UncompressedRowBatchSize: 363883 CodeGen - CodegenTime: 119206848 - CompileTime: 260406053 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076168 - NumFunctions: 54 - NumInstructions: 1085 - OptimizationTime: 866354445 - PeakMemoryUsage: 555520 - PrepareTime: 660267358 - TotalTime: 1789244044 AGGREGATION_NODE (id=21) ExecOption: Codegen Enabled - BuildTime: 19426535 - GetNewBlockTime: 395193117 - GetResultsTime: 2604788 - HTResizeTime: 765120 - HashBuckets: 32768 - InactiveTotalTime: 0 - LargestPartitionPercent: 6 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 2797188 - PinTime: 0 - RowsRepartitioned: 0 - RowsReturned: 3575 - RowsReturnedRate: 23 - SpilledPartitions: 0 - TotalTime: 151893069027 - UnpinTime: 5340 EXCHANGE_NODE (id=20) - BytesReceived: 192724 - ConvertRowBatchTime: 809422 - DeserializeRowBatchTimer: 2989223 - FirstBatchArrivalWaitTime: 151088900606 - InactiveTotalTime: 151343724652 - PeakMemoryUsage: 0 - RowsReturned: 3575 - RowsReturnedRate: 23 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 151345549494 Instance d94aa36d3a2b7f12:72bd82a400000024 (host=redacted-host3:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 2985216 - PerHostPeakMemUsage: 246953154 - RowsProduced: 3622 - TotalNetworkReceiveTime: 151303530948 - TotalNetworkSendTime: 56987971 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 112 - TotalThreadsTotalWallClockTime: 152878709783 - TotalThreadsSysTime: 3000000 - TotalThreadsUserTime: 199970000 - TotalThreadsVoluntaryContextSwitches: 271 - TotalTime: 154017680642 Fragment Instance Lifecycle Timings - ExecTime: 126485576 - ExecTreeExecTime: 35832069 - InactiveTotalTime: 0 - OpenTime: 152752239541 - ExecTreeOpenTime: 151353393160 - PrepareTime: 1138840342 - ExecTreePrepareTime: 269329762 - TotalTime: 0 DataStreamSender (dst_id=23) - BytesSent: 194630 - InactiveTotalTime: 0 - NetworkThroughput(*): 159118426 - OverallThroughput: 29649365 - PeakMemoryUsage: 180864 - RowsReturned: 3622 - SerializeBatchTime: 5250858 - TotalTime: 6564390 - TransmitDataRPCTime: 1223177 - UncompressedRowBatchSize: 368204 CodeGen - CodegenTime: 142716249 - CompileTime: 500578572 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076168 - NumFunctions: 54 - NumInstructions: 1085 - OptimizationTime: 852844165 - PeakMemoryUsage: 555520 - PrepareTime: 504406390 - TotalTime: 1943263461 AGGREGATION_NODE (id=21) ExecOption: Codegen Enabled - BuildTime: 6677817 - GetNewBlockTime: 267562947 - GetResultsTime: 1706148 - HTResizeTime: 642052 - HashBuckets: 32768 - InactiveTotalTime: 0 - LargestPartitionPercent: 6 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 2794688 - PinTime: 0 - RowsRepartitioned: 0 - RowsReturned: 3622 - RowsReturnedRate: 23 - SpilledPartitions: 0 - TotalTime: 151658492481 - UnpinTime: 3817 EXCHANGE_NODE (id=20) - BytesReceived: 194954 - ConvertRowBatchTime: 779776 - DeserializeRowBatchTimer: 22891788 - FirstBatchArrivalWaitTime: 151043827756 - InactiveTotalTime: 151299954258 - PeakMemoryUsage: 0 - RowsReturned: 3622 - RowsReturnedRate: 23 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 151304627166 Instance d94aa36d3a2b7f12:72bd82a400000025 (host=redacted-host1:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 2985216 - PerHostPeakMemUsage: 224989726 - RowsProduced: 3755 - TotalNetworkReceiveTime: 151587545610 - TotalNetworkSendTime: 37452804 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 88 - TotalThreadsTotalWallClockTime: 153015233013 - TotalThreadsSysTime: 5999000 - TotalThreadsUserTime: 204969000 - TotalThreadsVoluntaryContextSwitches: 235 - TotalTime: 153768435139 Fragment Instance Lifecycle Timings - ExecTime: 168265460 - ExecTreeExecTime: 52897893 - InactiveTotalTime: 0 - OpenTime: 152847001324 - ExecTreeOpenTime: 151628926410 - PrepareTime: 753051739 - ExecTreePrepareTime: 43942647 - TotalTime: 0 DataStreamSender (dst_id=23) - BytesSent: 202478 - InactiveTotalTime: 0 - NetworkThroughput(*): 157163393 - OverallThroughput: 24877925 - PeakMemoryUsage: 180864 - RowsReturned: 3755 - SerializeBatchTime: 6793222 - TotalTime: 8138862 - TransmitDataRPCTime: 1288328 - UncompressedRowBatchSize: 382039 CodeGen - CodegenTime: 22697425 - CompileTime: 469998625 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076168 - NumFunctions: 54 - NumInstructions: 1085 - OptimizationTime: 733522101 - PeakMemoryUsage: 555520 - PrepareTime: 529814750 - TotalTime: 1734118192 AGGREGATION_NODE (id=21) ExecOption: Codegen Enabled - BuildTime: 20356588 - GetNewBlockTime: 34226575 - GetResultsTime: 1807030 - HTResizeTime: 1142175 - HashBuckets: 32768 - InactiveTotalTime: 0 - LargestPartitionPercent: 7 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 2789201 - PinTime: 0 - RowsRepartitioned: 0 - RowsReturned: 3755 - RowsReturnedRate: 24 - SpilledPartitions: 0 - TotalTime: 151725701695 - UnpinTime: 3266 EXCHANGE_NODE (id=20) - BytesReceived: 202351 - ConvertRowBatchTime: 827496 - DeserializeRowBatchTimer: 28287667 - FirstBatchArrivalWaitTime: 151313684504 - InactiveTotalTime: 151587304383 - PeakMemoryUsage: 0 - RowsReturned: 3755 - RowsReturnedRate: 24 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 151588680471 Instance d94aa36d3a2b7f12:72bd82a400000026 (host=redacted-host7:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 2985216 - PerHostPeakMemUsage: 224948278 - RowsProduced: 3585 - TotalNetworkReceiveTime: 151318807315 - TotalNetworkSendTime: 78329348 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 107 - TotalThreadsTotalWallClockTime: 152600123309 - TotalThreadsSysTime: 5000000 - TotalThreadsUserTime: 208969000 - TotalThreadsVoluntaryContextSwitches: 233 - TotalTime: 153697013274 Fragment Instance Lifecycle Timings - ExecTime: 133123777 - ExecTreeExecTime: 34215956 - InactiveTotalTime: 0 - OpenTime: 152467016208 - ExecTreeOpenTime: 151340876632 - PrepareTime: 1096767504 - ExecTreePrepareTime: 64209023 - TotalTime: 0 DataStreamSender (dst_id=23) - BytesSent: 193098 - InactiveTotalTime: 0 - NetworkThroughput(*): 152088301 - OverallThroughput: 27557383 - PeakMemoryUsage: 180864 - RowsReturned: 3585 - SerializeBatchTime: 4248978 - TotalTime: 7007124 - TransmitDataRPCTime: 1269644 - UncompressedRowBatchSize: 364829 CodeGen - CodegenTime: 119728430 - CompileTime: 317496791 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076168 - NumFunctions: 54 - NumInstructions: 1085 - OptimizationTime: 782291617 - PeakMemoryUsage: 555520 - PrepareTime: 757128633 - TotalTime: 1924268156 AGGREGATION_NODE (id=21) ExecOption: Codegen Enabled - BuildTime: 13560038 - GetNewBlockTime: 13497492 - GetResultsTime: 1742133 - HTResizeTime: 836599 - HashBuckets: 32768 - InactiveTotalTime: 0 - LargestPartitionPercent: 6 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 2791093 - PinTime: 0 - RowsRepartitioned: 0 - RowsReturned: 3585 - RowsReturnedRate: 23 - SpilledPartitions: 0 - TotalTime: 151439235629 - UnpinTime: 4034 EXCHANGE_NODE (id=20) - BytesReceived: 193822 - ConvertRowBatchTime: 790896 - DeserializeRowBatchTimer: 2443395 - FirstBatchArrivalWaitTime: 151044749735 - InactiveTotalTime: 151318604203 - PeakMemoryUsage: 0 - RowsReturned: 3585 - RowsReturnedRate: 23 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 151319904123 Instance d94aa36d3a2b7f12:72bd82a400000028 (host=redacted-host2:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 2985216 - PerHostPeakMemUsage: 224646707 - RowsProduced: 3636 - TotalNetworkReceiveTime: 151129222259 - TotalNetworkSendTime: 85447158 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 160 - TotalThreadsTotalWallClockTime: 152859791747 - TotalThreadsSysTime: 2999000 - TotalThreadsUserTime: 219967000 - TotalThreadsVoluntaryContextSwitches: 299 - TotalTime: 153655565444 Fragment Instance Lifecycle Timings - ExecTime: 162077426 - ExecTreeExecTime: 47207832 - InactiveTotalTime: 0 - OpenTime: 152697729635 - ExecTreeOpenTime: 151169877008 - PrepareTime: 795665791 - ExecTreePrepareTime: 54063828 - TotalTime: 0 DataStreamSender (dst_id=23) - BytesSent: 195455 - InactiveTotalTime: 0 - NetworkThroughput(*): 160601172 - OverallThroughput: 16122967 - PeakMemoryUsage: 180864 - RowsReturned: 3636 - SerializeBatchTime: 10827556 - TotalTime: 12122768 - TransmitDataRPCTime: 1217021 - UncompressedRowBatchSize: 370077 CodeGen - CodegenTime: 78900299 - CompileTime: 645410928 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076168 - NumFunctions: 54 - NumInstructions: 1085 - OptimizationTime: 879145561 - PeakMemoryUsage: 555520 - PrepareTime: 616119375 - TotalTime: 2141465249 AGGREGATION_NODE (id=21) ExecOption: Codegen Enabled - BuildTime: 23336649 - GetNewBlockTime: 52480824 - GetResultsTime: 1672841 - HTResizeTime: 17269523 - HashBuckets: 32768 - InactiveTotalTime: 0 - LargestPartitionPercent: 6 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 2790938 - PinTime: 0 - RowsRepartitioned: 0 - RowsReturned: 3636 - RowsReturnedRate: 24 - SpilledPartitions: 0 - TotalTime: 151271087825 - UnpinTime: 3502 EXCHANGE_NODE (id=20) - BytesReceived: 195821 - ConvertRowBatchTime: 811989 - DeserializeRowBatchTimer: 13410227 - FirstBatchArrivalWaitTime: 150851782704 - InactiveTotalTime: 151128957697 - PeakMemoryUsage: 0 - RowsReturned: 3636 - RowsReturnedRate: 24 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 151130360643 Instance d94aa36d3a2b7f12:72bd82a400000027 (host=redacted-host8:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 2985216 - PerHostPeakMemUsage: 225599805 - RowsProduced: 3523 - TotalNetworkReceiveTime: 144693908339 - TotalNetworkSendTime: 87382894 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 137 - TotalThreadsTotalWallClockTime: 146530049692 - TotalThreadsSysTime: 4999000 - TotalThreadsUserTime: 238963000 - TotalThreadsVoluntaryContextSwitches: 262 - TotalTime: 149136253161 Fragment Instance Lifecycle Timings - ExecTime: 126282045 - ExecTreeExecTime: 12575068 - InactiveTotalTime: 0 - OpenTime: 146403783968 - ExecTreeOpenTime: 144789652552 - PrepareTime: 2606074037 - ExecTreePrepareTime: 783686947 - TotalTime: 0 DataStreamSender (dst_id=23) - BytesSent: 189054 - InactiveTotalTime: 0 - NetworkThroughput(*): 152339066 - OverallThroughput: 6118146 - PeakMemoryUsage: 180864 - RowsReturned: 3523 - SerializeBatchTime: 4001047 - TotalTime: 30900534 - TransmitDataRPCTime: 1241008 - UncompressedRowBatchSize: 358474 CodeGen - CodegenTime: 270180405 - CompileTime: 462794525 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076168 - NumFunctions: 54 - NumInstructions: 1085 - OptimizationTime: 1055358151 - PeakMemoryUsage: 555520 - PrepareTime: 1503192161 - TotalTime: 3152228209 AGGREGATION_NODE (id=21) ExecOption: Codegen Enabled - BuildTime: 90436588 - GetNewBlockTime: 550507139 - GetResultsTime: 1626526 - HTResizeTime: 75817460 - HashBuckets: 32768 - InactiveTotalTime: 0 - LargestPartitionPercent: 7 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 2790906 - PinTime: 0 - RowsRepartitioned: 0 - RowsReturned: 3523 - RowsReturnedRate: 24 - SpilledPartitions: 0 - TotalTime: 145585850424 - UnpinTime: 4207 EXCHANGE_NODE (id=20) - BytesReceived: 189967 - ConvertRowBatchTime: 759155 - DeserializeRowBatchTimer: 130302425 - FirstBatchArrivalWaitTime: 144540671503 - InactiveTotalTime: 144666269160 - PeakMemoryUsage: 0 - RowsReturned: 3523 - RowsReturnedRate: 24 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 144694937301 Averaged Fragment F07 split sizes: min: 0, max: 0, avg: 0, stddev: 0 completion times: min:2m29s max:2m34s mean: 2m33s stddev:1s554ms execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec num instances: 8 - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 154187366 - PerHostPeakMemUsage: 218387409 - RowsProduced: 3617 - TotalNetworkReceiveTime: 146148409281 - TotalNetworkSendTime: 69477389 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 548 - TotalThreadsTotalWallClockTime: 151714266438 - TotalThreadsSysTime: 40618750 - TotalThreadsUserTime: 982725625 - TotalThreadsVoluntaryContextSwitches: 1457 - TotalTime: 153115227931 Fragment Instance Lifecycle Timings - ExecTime: 108858771123 - ExecTreeExecTime: 108701097418 - InactiveTotalTime: 0 - OpenTime: 42855510801 - ExecTreeOpenTime: 39385658523 - PrepareTime: 1399332478 - ExecTreePrepareTime: 237535511 - TotalTime: 0 DataStreamSender (dst_id=20) - BytesSent: 195014 - InactiveTotalTime: 0 - NetworkThroughput(*): 157732796 - OverallThroughput: 21292566 - PeakMemoryUsage: 241152 - RowsReturned: 3617 - SerializeBatchTime: 10478029 - TotalTime: 31053931 - TransmitDataRPCTime: 1237442 - UncompressedRowBatchSize: 368003 CodeGen - CodegenTime: 42319795 - CompileTime: 997232843 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076168 - NumFunctions: 93 - NumInstructions: 3597 - OptimizationTime: 2385156337 - PeakMemoryUsage: 1841664 - PrepareTime: 772313909 - TotalTime: 4220719489 AGGREGATION_NODE (id=9) - GetNewBlockTime: 100021528 - GetResultsTime: 1815720 - HTResizeTime: 20463683 - HashBuckets: 32768 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 1922084 - PinTime: 0 - ReductionFactorEstimate: 0.0 - ReductionFactorThresholdToExpand: 0.0 - RowsPassedThrough: 0 - RowsReturned: 3617 - RowsReturnedRate: 23 - StreamingTime: 126097762 - TotalTime: 148324229834 - UnpinTime: 0 HASH_JOIN_NODE (id=8) - BuildRows: 312500 - BuildTime: 1561151866 - InactiveTotalTime: 0 - LocalTime: 1705712658 - NumHashTableBuildsSkipped: 0 - PeakMemoryUsage: 152278292 - ProbeRows: 38677 - ProbeRowsPartitioned: 0 - ProbeTime: 8772542 - RowsReturned: 38447 - RowsReturnedRate: 259 - TotalTime: 147958758063 Hash Join Builder (join_node_id=8) - BuildRowsPartitionTime: 736274716 - BuildRowsPartitioned: 312500 - GetNewBlockTime: 242822139 - HashBuckets: 524288 - HashCollisions: 0 - HashTablesBuildTime: 749526017 - InactiveTotalTime: 0 - LargestPartitionPercent: 6 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 152065152 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=19) - BytesReceived: 6123905 - ConvertRowBatchTime: 74381994 - DeserializeRowBatchTimer: 4179014831 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 312500 - RowsReturnedRate: 16933 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 18980689406 EXCHANGE_NODE (id=18) - BytesReceived: 1946937 - ConvertRowBatchTime: 16009515 - DeserializeRowBatchTimer: 525194265 - FirstBatchArrivalWaitTime: 17028563394 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 38677 - RowsReturnedRate: 303 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 127272355998 Fragment F07 Instance d94aa36d3a2b7f12:72bd82a400000019 (host=redacted-host4:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 154167906 - PerHostPeakMemUsage: 193321646 - RowsProduced: 3532 - TotalNetworkReceiveTime: 148097712432 - TotalNetworkSendTime: 102403072 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 496 - TotalThreadsTotalWallClockTime: 153481660992 - TotalThreadsSysTime: 31995000 - TotalThreadsUserTime: 944857000 - TotalThreadsVoluntaryContextSwitches: 1505 - TotalTime: 154218725025 Fragment Instance Lifecycle Timings - ExecTime: 108861305041 - ExecTreeExecTime: 108668902198 - InactiveTotalTime: 0 - OpenTime: 44620371542 - ExecTreeOpenTime: 41078712073 - PrepareTime: 736902405 - ExecTreePrepareTime: 33658179 - TotalTime: 0 DataStreamSender (dst_id=20) - BytesSent: 190518 - InactiveTotalTime: 0 - NetworkThroughput(*): 151414218 - OverallThroughput: 2644957 - PeakMemoryUsage: 241152 - RowsReturned: 3532 - SerializeBatchTime: 49448593 - TotalTime: 72030652 - TransmitDataRPCTime: 1258257 - UncompressedRowBatchSize: 359440 CodeGen - CodegenTime: 8538758 - CompileTime: 1478905041 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076168 - NumFunctions: 93 - NumInstructions: 3597 - OptimizationTime: 1973012968 - PeakMemoryUsage: 1841664 - PrepareTime: 454267061 - TotalTime: 3906919131 AGGREGATION_NODE (id=9) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 15153545 - GetResultsTime: 1549702 - HTResizeTime: 339684 - HashBuckets: 32768 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 1926357 - PinTime: 0 - ReductionFactorEstimate: 0.0 - ReductionFactorThresholdToExpand: 0.0 - RowsPassedThrough: 0 - RowsReturned: 3532 - RowsReturnedRate: 23 - StreamingTime: 71190731 - TotalTime: 149781220488 - UnpinTime: 0 HASH_JOIN_NODE (id=8) ExecOption: Probe Side Codegen Enabled - BuildRows: 312531 - BuildTime: 1436727168 - InactiveTotalTime: 0 - LocalTime: 1461919420 - NumHashTableBuildsSkipped: 0 - PeakMemoryUsage: 152278411 - ProbeRows: 37584 - ProbeRowsPartitioned: 0 - ProbeTime: 8351167 - RowsReturned: 37584 - RowsReturnedRate: 251 - TotalTime: 149655551667 Hash Join Builder (join_node_id=8) ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 576053990 - BuildRowsPartitioned: 312531 - GetNewBlockTime: 308032178 - HashBuckets: 524288 - HashCollisions: 0 - HashTablesBuildTime: 667088356 - InactiveTotalTime: 0 - LargestPartitionPercent: 6 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 152065152 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=19) - BytesReceived: 6124330 - ConvertRowBatchTime: 69432818 - DeserializeRowBatchTimer: 2989085824 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 19994510125 - PeakMemoryUsage: 0 - RowsReturned: 312531 - RowsReturnedRate: 15101 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 20695765123 EXCHANGE_NODE (id=18) - BytesReceived: 1885798 - ConvertRowBatchTime: 13186517 - DeserializeRowBatchTimer: 452741741 - FirstBatchArrivalWaitTime: 17511780752 - InactiveTotalTime: 127454287400 - PeakMemoryUsage: 0 - RowsReturned: 37584 - RowsReturnedRate: 294 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 127497867124 Instance d94aa36d3a2b7f12:72bd82a40000001b (host=redacted-host6:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 154171910 - PerHostPeakMemUsage: 223945936 - RowsProduced: 3584 - TotalNetworkReceiveTime: 146657596018 - TotalNetworkSendTime: 139629393 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 501 - TotalThreadsTotalWallClockTime: 152328580757 - TotalThreadsSysTime: 44993000 - TotalThreadsUserTime: 1029843000 - TotalThreadsVoluntaryContextSwitches: 1471 - TotalTime: 153850620498 Fragment Instance Lifecycle Timings - ExecTime: 108866418118 - ExecTreeExecTime: 108659682267 - InactiveTotalTime: 0 - OpenTime: 43462178123 - ExecTreeOpenTime: 40075002815 - PrepareTime: 1521897385 - ExecTreePrepareTime: 340588846 - TotalTime: 0 DataStreamSender (dst_id=20) - BytesSent: 193264 - InactiveTotalTime: 0 - NetworkThroughput(*): 161554556 - OverallThroughput: 3275010 - PeakMemoryUsage: 241152 - RowsReturned: 3584 - SerializeBatchTime: 4624164 - TotalTime: 59011722 - TransmitDataRPCTime: 1196277 - UncompressedRowBatchSize: 364655 CodeGen - CodegenTime: 11825396 - CompileTime: 1190451358 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076168 - NumFunctions: 93 - NumInstructions: 3597 - OptimizationTime: 2144021293 - PeakMemoryUsage: 1841664 - PrepareTime: 670437943 - TotalTime: 4062514382 AGGREGATION_NODE (id=9) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 320209495 - GetResultsTime: 1912292 - HTResizeTime: 557882 - HashBuckets: 32768 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 1867682 - PinTime: 0 - ReductionFactorEstimate: 0.0 - ReductionFactorThresholdToExpand: 0.0 - RowsPassedThrough: 0 - RowsReturned: 3584 - RowsReturnedRate: 24 - StreamingTime: 82641887 - TotalTime: 149075213107 - UnpinTime: 0 HASH_JOIN_NODE (id=8) ExecOption: Probe Side Codegen Enabled - BuildRows: 312485 - BuildTime: 1698096359 - InactiveTotalTime: 0 - LocalTime: 1895103538 - NumHashTableBuildsSkipped: 0 - PeakMemoryUsage: 152278429 - ProbeRows: 38110 - ProbeRowsPartitioned: 0 - ProbeTime: 8662090 - RowsReturned: 38110 - RowsReturnedRate: 256 - TotalTime: 148651078970 Hash Join Builder (join_node_id=8) ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 915327422 - BuildRowsPartitioned: 312485 - GetNewBlockTime: 473716045 - HashBuckets: 524288 - HashCollisions: 0 - HashTablesBuildTime: 660028076 - InactiveTotalTime: 0 - LargestPartitionPercent: 6 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 152065152 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=19) - BytesReceived: 6121617 - ConvertRowBatchTime: 74264037 - DeserializeRowBatchTimer: 4121940742 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 18113538108 - PeakMemoryUsage: 0 - RowsReturned: 312485 - RowsReturnedRate: 16152 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 19346247719 EXCHANGE_NODE (id=18) - BytesReceived: 1912536 - ConvertRowBatchTime: 9904084 - DeserializeRowBatchTimer: 822378017 - FirstBatchArrivalWaitTime: 16992933871 - InactiveTotalTime: 127368806743 - PeakMemoryUsage: 0 - RowsReturned: 38110 - RowsReturnedRate: 299 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 127409727713 Instance d94aa36d3a2b7f12:72bd82a40000001a (host=redacted-host5:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 154167474 - PerHostPeakMemUsage: 182694027 - RowsProduced: 3748 - TotalNetworkReceiveTime: 147355847857 - TotalNetworkSendTime: 28534380 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 503 - TotalThreadsTotalWallClockTime: 152561519140 - TotalThreadsSysTime: 37994000 - TotalThreadsUserTime: 963854000 - TotalThreadsVoluntaryContextSwitches: 1541 - TotalTime: 153848883055 Fragment Instance Lifecycle Timings - ExecTime: 108831454399 - ExecTreeExecTime: 108668628910 - InactiveTotalTime: 0 - OpenTime: 43730079930 - ExecTreeOpenTime: 40414210688 - PrepareTime: 1275313096 - ExecTreePrepareTime: 238418329 - TotalTime: 0 DataStreamSender (dst_id=20) - BytesSent: 201947 - InactiveTotalTime: 0 - NetworkThroughput(*): 154261523 - OverallThroughput: 35004169 - PeakMemoryUsage: 241152 - RowsReturned: 3748 - SerializeBatchTime: 4374163 - TotalTime: 5769227 - TransmitDataRPCTime: 1309121 - UncompressedRowBatchSize: 381419 CodeGen - CodegenTime: 100899591 - CompileTime: 899078875 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076168 - NumFunctions: 93 - NumInstructions: 3597 - OptimizationTime: 2287738194 - PeakMemoryUsage: 1841664 - PrepareTime: 683870539 - TotalTime: 3985148093 AGGREGATION_NODE (id=9) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 172519624 - GetResultsTime: 1738341 - HTResizeTime: 3263658 - HashBuckets: 32768 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 1911071 - PinTime: 0 - ReductionFactorEstimate: 0.0 - ReductionFactorThresholdToExpand: 0.0 - RowsPassedThrough: 0 - RowsReturned: 3748 - RowsReturnedRate: 25 - StreamingTime: 71011882 - TotalTime: 149321199879 - UnpinTime: 0 HASH_JOIN_NODE (id=8) ExecOption: Probe Side Codegen Enabled - BuildRows: 312385 - BuildTime: 1502917009 - InactiveTotalTime: 0 - LocalTime: 1584177509 - NumHashTableBuildsSkipped: 0 - PeakMemoryUsage: 152278115 - ProbeRows: 39436 - ProbeRowsPartitioned: 0 - ProbeTime: 8984980 - RowsReturned: 39436 - RowsReturnedRate: 264 - TotalTime: 149034076170 Hash Join Builder (join_node_id=8) ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 842054216 - BuildRowsPartitioned: 312385 - GetNewBlockTime: 180841652 - HashBuckets: 524288 - HashCollisions: 0 - HashTablesBuildTime: 608576245 - InactiveTotalTime: 0 - LargestPartitionPercent: 6 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 152065152 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=19) - BytesReceived: 6124561 - ConvertRowBatchTime: 66489753 - DeserializeRowBatchTimer: 2915849963 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 19333239278 - PeakMemoryUsage: 0 - RowsReturned: 312385 - RowsReturnedRate: 15672 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 19931862306 EXCHANGE_NODE (id=18) - BytesReceived: 1980899 - ConvertRowBatchTime: 13201263 - DeserializeRowBatchTimer: 421062518 - FirstBatchArrivalWaitTime: 17495526772 - InactiveTotalTime: 127485247211 - PeakMemoryUsage: 0 - RowsReturned: 39436 - RowsReturnedRate: 309 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 127518036355 Instance d94aa36d3a2b7f12:72bd82a40000001c (host=redacted-host3:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 154167888 - PerHostPeakMemUsage: 246953154 - RowsProduced: 3540 - TotalNetworkReceiveTime: 145773158547 - TotalNetworkSendTime: 56273620 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 588 - TotalThreadsTotalWallClockTime: 151652637692 - TotalThreadsSysTime: 34995000 - TotalThreadsUserTime: 961854000 - TotalThreadsVoluntaryContextSwitches: 1482 - TotalTime: 153768129376 Fragment Instance Lifecycle Timings - ExecTime: 108853100887 - ExecTreeExecTime: 108671914979 - InactiveTotalTime: 0 - OpenTime: 42799552284 - ExecTreeOpenTime: 38899475144 - PrepareTime: 2115344925 - ExecTreePrepareTime: 382212107 - TotalTime: 0 DataStreamSender (dst_id=20) - BytesSent: 190794 - InactiveTotalTime: 0 - NetworkThroughput(*): 158295465 - OverallThroughput: 28966439 - PeakMemoryUsage: 241152 - RowsReturned: 3540 - SerializeBatchTime: 5156407 - TotalTime: 6586726 - TransmitDataRPCTime: 1205303 - UncompressedRowBatchSize: 360243 CodeGen - CodegenTime: 7513157 - CompileTime: 985430191 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076168 - NumFunctions: 93 - NumInstructions: 3597 - OptimizationTime: 2873208688 - PeakMemoryUsage: 1841664 - PrepareTime: 1184608874 - TotalTime: 5110752027 AGGREGATION_NODE (id=9) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 105494385 - GetResultsTime: 1792983 - HTResizeTime: 1645455 - HashBuckets: 32768 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 1967972 - PinTime: 0 - ReductionFactorEstimate: 0.0 - ReductionFactorThresholdToExpand: 0.0 - RowsPassedThrough: 0 - RowsReturned: 3540 - RowsReturnedRate: 23 - StreamingTime: 76444917 - TotalTime: 147953508327 - UnpinTime: 0 HASH_JOIN_NODE (id=8) ExecOption: Probe Side Codegen Enabled - BuildRows: 312530 - BuildTime: 1399912107 - InactiveTotalTime: 0 - LocalTime: 1718438458 - NumHashTableBuildsSkipped: 0 - PeakMemoryUsage: 152278515 - ProbeRows: 37861 - ProbeRowsPartitioned: 0 - ProbeTime: 8401877 - RowsReturned: 37861 - RowsReturnedRate: 256 - TotalTime: 147609754217 Hash Join Builder (join_node_id=8) ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 685814302 - BuildRowsPartitioned: 312530 - GetNewBlockTime: 177930609 - HashBuckets: 524288 - HashCollisions: 0 - HashTablesBuildTime: 706047746 - InactiveTotalTime: 0 - LargestPartitionPercent: 6 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 152065152 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=19) - BytesReceived: 6124875 - ConvertRowBatchTime: 78007176 - DeserializeRowBatchTimer: 4064994421 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 17280076434 - PeakMemoryUsage: 0 - RowsReturned: 312530 - RowsReturnedRate: 16866 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 18529771428 EXCHANGE_NODE (id=18) - BytesReceived: 1900368 - ConvertRowBatchTime: 26718232 - DeserializeRowBatchTimer: 444758739 - FirstBatchArrivalWaitTime: 16911461374 - InactiveTotalTime: 127322931876 - PeakMemoryUsage: 0 - RowsReturned: 37861 - RowsReturnedRate: 297 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 127361544331 Instance d94aa36d3a2b7f12:72bd82a40000001e (host=redacted-host7:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 154186323 - PerHostPeakMemUsage: 224948278 - RowsProduced: 3676 - TotalNetworkReceiveTime: 147181250433 - TotalNetworkSendTime: 65104640 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 561 - TotalThreadsTotalWallClockTime: 152053537637 - TotalThreadsSysTime: 31995000 - TotalThreadsUserTime: 965853000 - TotalThreadsVoluntaryContextSwitches: 1432 - TotalTime: 153478125493 Fragment Instance Lifecycle Timings - ExecTime: 108845345747 - ExecTreeExecTime: 108703120351 - InactiveTotalTime: 0 - OpenTime: 43208207723 - ExecTreeOpenTime: 40381590471 - PrepareTime: 1424459320 - ExecTreePrepareTime: 81366754 - TotalTime: 0 DataStreamSender (dst_id=20) - BytesSent: 198357 - InactiveTotalTime: 0 - NetworkThroughput(*): 164148189 - OverallThroughput: 34973019 - PeakMemoryUsage: 241152 - RowsReturned: 3676 - SerializeBatchTime: 4399367 - TotalTime: 5671715 - TransmitDataRPCTime: 1208402 - UncompressedRowBatchSize: 374018 CodeGen - CodegenTime: 170041913 - CompileTime: 794123733 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076168 - NumFunctions: 93 - NumInstructions: 3597 - OptimizationTime: 1983253988 - PeakMemoryUsage: 1841664 - PrepareTime: 811798471 - TotalTime: 3716686039 AGGREGATION_NODE (id=9) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 27280147 - GetResultsTime: 1932761 - HTResizeTime: 13109631 - HashBuckets: 32768 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 1847654 - PinTime: 0 - ReductionFactorEstimate: 0.0 - ReductionFactorThresholdToExpand: 0.0 - RowsPassedThrough: 0 - RowsReturned: 3676 - RowsReturnedRate: 24 - StreamingTime: 102608107 - TotalTime: 149166018542 - UnpinTime: 0 HASH_JOIN_NODE (id=8) ExecOption: Probe Side Codegen Enabled - BuildRows: 312586 - BuildTime: 1632025689 - InactiveTotalTime: 0 - LocalTime: 1735132156 - NumHashTableBuildsSkipped: 0 - PeakMemoryUsage: 152278393 - ProbeRows: 39053 - ProbeRowsPartitioned: 0 - ProbeTime: 8617557 - RowsReturned: 39053 - RowsReturnedRate: 262 - TotalTime: 149012410651 Hash Join Builder (join_node_id=8) ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 842072012 - BuildRowsPartitioned: 312586 - GetNewBlockTime: 232584499 - HashBuckets: 524288 - HashCollisions: 0 - HashTablesBuildTime: 789199237 - InactiveTotalTime: 0 - LargestPartitionPercent: 6 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 152065152 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=19) - BytesReceived: 6125442 - ConvertRowBatchTime: 67861477 - DeserializeRowBatchTimer: 3201877351 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 19487531946 - PeakMemoryUsage: 0 - RowsReturned: 312586 - RowsReturnedRate: 15591 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 20047940222 EXCHANGE_NODE (id=18) - BytesReceived: 1960483 - ConvertRowBatchTime: 14478236 - DeserializeRowBatchTimer: 625228628 - FirstBatchArrivalWaitTime: 16782493219 - InactiveTotalTime: 127187430983 - PeakMemoryUsage: 0 - RowsReturned: 39053 - RowsReturnedRate: 306 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 127229338273 Instance d94aa36d3a2b7f12:72bd82a40000001d (host=redacted-host1:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 154297585 - PerHostPeakMemUsage: 224989726 - RowsProduced: 3571 - TotalNetworkReceiveTime: 147560580994 - TotalNetworkSendTime: 59907517 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 559 - TotalThreadsTotalWallClockTime: 152666171103 - TotalThreadsSysTime: 64990000 - TotalThreadsUserTime: 959854000 - TotalThreadsVoluntaryContextSwitches: 1434 - TotalTime: 153468291869 Fragment Instance Lifecycle Timings - ExecTime: 108863782106 - ExecTreeExecTime: 108711352015 - InactiveTotalTime: 0 - OpenTime: 43802403189 - ExecTreeOpenTime: 40853835468 - PrepareTime: 802022361 - ExecTreePrepareTime: 102827063 - TotalTime: 0 DataStreamSender (dst_id=20) - BytesSent: 192289 - InactiveTotalTime: 0 - NetworkThroughput(*): 156544045 - OverallThroughput: 26141975 - PeakMemoryUsage: 241152 - RowsReturned: 3571 - SerializeBatchTime: 6058177 - TotalTime: 7355565 - TransmitDataRPCTime: 1228338 - UncompressedRowBatchSize: 362857 CodeGen - CodegenTime: 15912914 - CompileTime: 1012982045 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076168 - NumFunctions: 93 - NumInstructions: 3597 - OptimizationTime: 1815839447 - PeakMemoryUsage: 1841664 - PrepareTime: 523356299 - TotalTime: 3364335189 AGGREGATION_NODE (id=9) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 32683591 - GetResultsTime: 2389818 - HTResizeTime: 850849 - HashBuckets: 32768 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 1964078 - PinTime: 0 - ReductionFactorEstimate: 0.0 - ReductionFactorThresholdToExpand: 0.0 - RowsPassedThrough: 0 - RowsReturned: 3571 - RowsReturnedRate: 23 - StreamingTime: 231916914 - TotalTime: 149667964755 - UnpinTime: 0 HASH_JOIN_NODE (id=8) ExecOption: Probe Side Codegen Enabled - BuildRows: 312529 - BuildTime: 1604595126 - InactiveTotalTime: 0 - LocalTime: 1641880625 - NumHashTableBuildsSkipped: 0 - PeakMemoryUsage: 152278097 - ProbeRows: 39920 - ProbeRowsPartitioned: 0 - ProbeTime: 10426361 - RowsReturned: 38083 - RowsReturnedRate: 255 - TotalTime: 149309065555 Hash Join Builder (join_node_id=8) ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 798693091 - BuildRowsPartitioned: 312529 - GetNewBlockTime: 231644047 - HashBuckets: 524288 - HashCollisions: 0 - HashTablesBuildTime: 741242864 - InactiveTotalTime: 0 - LargestPartitionPercent: 6 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 152065152 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=19) - BytesReceived: 6124659 - ConvertRowBatchTime: 68834685 - DeserializeRowBatchTimer: 3675315549 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 19232582900 - PeakMemoryUsage: 0 - RowsReturned: 312529 - RowsReturnedRate: 15256 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 20484800266 EXCHANGE_NODE (id=18) - BytesReceived: 2048102 - ConvertRowBatchTime: 20590494 - DeserializeRowBatchTimer: 505750318 - FirstBatchArrivalWaitTime: 16871010660 - InactiveTotalTime: 127019791109 - PeakMemoryUsage: 0 - RowsReturned: 39920 - RowsReturnedRate: 313 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 127182384664 Instance d94aa36d3a2b7f12:72bd82a400000020 (host=redacted-host2:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 154171976 - PerHostPeakMemUsage: 224646707 - RowsProduced: 3669 - TotalNetworkReceiveTime: 147842538739 - TotalNetworkSendTime: 82679462 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 502 - TotalThreadsTotalWallClockTime: 152508609157 - TotalThreadsSysTime: 36994000 - TotalThreadsUserTime: 980851000 - TotalThreadsVoluntaryContextSwitches: 1393 - TotalTime: 153331001843 Fragment Instance Lifecycle Timings - ExecTime: 109024455217 - ExecTreeExecTime: 108917189397 - InactiveTotalTime: 0 - OpenTime: 43484170558 - ExecTreeOpenTime: 40682342932 - PrepareTime: 822271125 - ExecTreePrepareTime: 85159731 - TotalTime: 0 DataStreamSender (dst_id=20) - BytesSent: 197591 - InactiveTotalTime: 0 - NetworkThroughput(*): 164625281 - OverallThroughput: 37081110 - PeakMemoryUsage: 241152 - RowsReturned: 3669 - SerializeBatchTime: 4063745 - TotalTime: 5328616 - TransmitDataRPCTime: 1200247 - UncompressedRowBatchSize: 373192 CodeGen - CodegenTime: 13410813 - CompileTime: 818084976 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076168 - NumFunctions: 93 - NumInstructions: 3597 - OptimizationTime: 1971902543 - PeakMemoryUsage: 1841664 - PrepareTime: 438679996 - TotalTime: 3259029302 AGGREGATION_NODE (id=9) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 251106 - GetResultsTime: 1641108 - HTResizeTime: 9900260 - HashBuckets: 32768 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 1970185 - PinTime: 0 - ReductionFactorEstimate: 0.0 - ReductionFactorThresholdToExpand: 0.0 - RowsPassedThrough: 0 - RowsReturned: 3669 - RowsReturnedRate: 24 - StreamingTime: 100707678 - TotalTime: 149684638983 - UnpinTime: 0 HASH_JOIN_NODE (id=8) ExecOption: Probe Side Codegen Enabled - BuildRows: 312493 - BuildTime: 1470269881 - InactiveTotalTime: 0 - LocalTime: 1528290284 - NumHashTableBuildsSkipped: 0 - PeakMemoryUsage: 152278003 - ProbeRows: 38881 - ProbeRowsPartitioned: 0 - ProbeTime: 8167683 - RowsReturned: 38881 - RowsReturnedRate: 260 - TotalTime: 149474169576 Hash Join Builder (join_node_id=8) ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 629164602 - BuildRowsPartitioned: 312493 - GetNewBlockTime: 165112017 - HashBuckets: 524288 - HashCollisions: 0 - HashTablesBuildTime: 703413559 - InactiveTotalTime: 0 - LargestPartitionPercent: 6 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 152065152 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=19) - BytesReceived: 6123807 - ConvertRowBatchTime: 69780837 - DeserializeRowBatchTimer: 3947194424 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 19422083753 - PeakMemoryUsage: 0 - RowsReturned: 312493 - RowsReturnedRate: 15133 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 20649644342 EXCHANGE_NODE (id=18) - BytesReceived: 1951165 - ConvertRowBatchTime: 20025732 - DeserializeRowBatchTimer: 390743638 - FirstBatchArrivalWaitTime: 17267353920 - InactiveTotalTime: 127258423994 - PeakMemoryUsage: 0 - RowsReturned: 38881 - RowsReturnedRate: 305 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 127296234950 Instance d94aa36d3a2b7f12:72bd82a40000001f (host=redacted-host8:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 154167866 - PerHostPeakMemUsage: 225599805 - RowsProduced: 3619 - TotalNetworkReceiveTime: 138718589231 - TotalNetworkSendTime: 21287030 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 676 - TotalThreadsTotalWallClockTime: 146461415029 - TotalThreadsSysTime: 40994000 - TotalThreadsUserTime: 1054839000 - TotalThreadsVoluntaryContextSwitches: 1399 - TotalTime: 148958046290 Fragment Instance Lifecycle Timings - ExecTime: 108724307473 - ExecTreeExecTime: 108607989228 - InactiveTotalTime: 0 - OpenTime: 37737123062 - ExecTreeOpenTime: 32700098595 - PrepareTime: 2496449208 - ExecTreePrepareTime: 636053081 - TotalTime: 0 DataStreamSender (dst_id=20) - BytesSent: 195358 - InactiveTotalTime: 0 - NetworkThroughput(*): 151019095 - OverallThroughput: 2253856 - PeakMemoryUsage: 241152 - RowsReturned: 3619 - SerializeBatchTime: 5699622 - TotalTime: 86677232 - TransmitDataRPCTime: 1293598 - UncompressedRowBatchSize: 368205 CodeGen - CodegenTime: 10415818 - CompileTime: 798806525 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076168 - NumFunctions: 93 - NumInstructions: 3597 - OptimizationTime: 4032273575 - PeakMemoryUsage: 1841664 - PrepareTime: 1411492092 - TotalTime: 6360371754 AGGREGATION_NODE (id=9) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 126580338 - GetResultsTime: 1568759 - HTResizeTime: 134042051 - HashBuckets: 32768 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 1921677 - PinTime: 0 - ReductionFactorEstimate: 0.0 - ReductionFactorThresholdToExpand: 0.0 - RowsPassedThrough: 0 - RowsReturned: 3619 - RowsReturnedRate: 25 - StreamingTime: 272259982 - TotalTime: 141944074596 - UnpinTime: 0 HASH_JOIN_NODE (id=8) ExecOption: Probe Side Codegen Enabled - BuildRows: 312461 - BuildTime: 1744671593 - InactiveTotalTime: 0 - LocalTime: 2080759275 - NumHashTableBuildsSkipped: 0 - PeakMemoryUsage: 152278377 - ProbeRows: 38571 - ProbeRowsPartitioned: 0 - ProbeTime: 8568625 - RowsReturned: 38571 - RowsReturnedRate: 273 - TotalTime: 140923957699 Hash Join Builder (join_node_id=8) ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 601018098 - BuildRowsPartitioned: 312461 - GetNewBlockTime: 172716069 - HashBuckets: 524288 - HashCollisions: 0 - HashTablesBuildTime: 1120612055 - InactiveTotalTime: 0 - LargestPartitionPercent: 6 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 152065152 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=19) - BytesReceived: 6121950 - ConvertRowBatchTime: 100385172 - DeserializeRowBatchTimer: 8515860377 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 11785011635 - PeakMemoryUsage: 0 - RowsReturned: 312461 - RowsReturnedRate: 25696 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 12159483844 EXCHANGE_NODE (id=18) - BytesReceived: 1936150 - ConvertRowBatchTime: 9971565 - DeserializeRowBatchTimer: 538890526 - FirstBatchArrivalWaitTime: 16395946589 - InactiveTotalTime: 126634024144 - PeakMemoryUsage: 0 - RowsReturned: 38571 - RowsReturnedRate: 304 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 126683714580 Averaged Fragment F02 split sizes: min: 123.03 MB, max: 163.70 MB, avg: 145.82 MB, stddev: 11.21 MB completion times: min:1m34s max:2m29s mean: 1m51s stddev:16s770ms execution rates: min:845.25 KB/sec max:1.62 MB/sec mean:1.34 MB/sec stddev:234.21 KB/sec num instances: 8 - AverageThreadTokens: 1.617235037813507 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 30544358 - PerHostPeakMemUsage: 218387409 - RowsProduced: 38677 - TotalNetworkReceiveTime: 33156945781 - TotalNetworkSendTime: 388663313 - TotalStorageWaitTime: 22321634326 - TotalThreadsInvoluntaryContextSwitches: 9772 - TotalThreadsTotalWallClockTime: 179119216522 - TotalThreadsSysTime: 264959500 - TotalThreadsUserTime: 7811937375 - TotalThreadsVoluntaryContextSwitches: 7162 - TotalTime: 110992364752 Fragment Instance Lifecycle Timings - ExecTime: 68027802705 - ExecTreeExecTime: 65644897567 - InactiveTotalTime: 0 - OpenTime: 41481576721 - ExecTreeOpenTime: 35033668724 - PrepareTime: 1482748329 - ExecTreePrepareTime: 187716883 - TotalTime: 0 DataStreamSender (dst_id=18) - BytesSent: 1946937 - InactiveTotalTime: 0 - NetworkThroughput(*): 87746141 - OverallThroughput: 11867702 - PeakMemoryUsage: 253696 - RowsReturned: 38677 - SerializeBatchTime: 137316035 - TotalTime: 165835693 - TransmitDataRPCTime: 22180806 - UncompressedRowBatchSize: 6272477 CodeGen - CodegenTime: 990430 - CompileTime: 1880377115 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076168 - NumFunctions: 105 - NumInstructions: 6894 - OptimizationTime: 4494120518 - PeakMemoryUsage: 3529728 - PrepareTime: 813806699 - TotalTime: 7224287734 HASH_JOIN_NODE (id=7) - BuildRows: 90 - BuildTime: 27308150 - InactiveTotalTime: 0 - LocalTime: 173736021 - NumHashTableBuildsSkipped: 0 - PeakMemoryUsage: 8599997 - ProbeRows: 38677 - ProbeRowsPartitioned: 0 - ProbeTime: 7603218 - RowsReturned: 38677 - RowsReturnedRate: 392 - TotalTime: 101042202833 Hash Join Builder (join_node_id=7) - BuildRowsPartitionTime: 55596 - BuildRowsPartitioned: 90 - GetNewBlockTime: 14658807 - HashBuckets: 202 - HashCollisions: 0 - HashTablesBuildTime: 324673 - InactiveTotalTime: 0 - LargestPartitionPercent: 14 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 1062016 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=17) - BytesReceived: 1257 - ConvertRowBatchTime: 22805 - DeserializeRowBatchTimer: 2588944 - FirstBatchArrivalWaitTime: 33086027801 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 90 - RowsReturnedRate: 2 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 33156957023 HASH_JOIN_NODE (id=6) - BuildRows: 1800 - BuildTime: 14544282 - InactiveTotalTime: 0 - LocalTime: 199490356 - NumHashTableBuildsSkipped: 0 - PeakMemoryUsage: 4077890 - ProbeRows: 157890 - ProbeRowsPartitioned: 0 - ProbeTime: 36755937 - RowsReturned: 38677 - RowsReturnedRate: 608 - TotalTime: 67711509788 Hash Join Builder (join_node_id=6) - BuildRowsPartitionTime: 365387 - BuildRowsPartitioned: 1800 - GetNewBlockTime: 13311892 - HashBuckets: 4096 - HashCollisions: 0 - HashTablesBuildTime: 603758 - InactiveTotalTime: 0 - LargestPartitionPercent: 7 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 1135744 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=16) - BytesReceived: 14556 - ConvertRowBatchTime: 1690967 - DeserializeRowBatchTimer: 117682 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 1800 - RowsReturnedRate: 3764152 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 1726718 HASH_JOIN_NODE (id=5) - BuildRows: 49 - BuildTime: 16013415 - InactiveTotalTime: 0 - LocalTime: 392606226 - NumHashTableBuildsSkipped: 0 - PeakMemoryUsage: 2563931 - ProbeRows: 3100652 - ProbeRowsPartitioned: 0 - ProbeTime: 256430040 - RowsReturned: 157890 - RowsReturnedRate: 2490 - TotalTime: 67510292714 Hash Join Builder (join_node_id=5) - BuildRowsPartitionTime: 27564 - BuildRowsPartitioned: 49 - GetNewBlockTime: 15481269 - HashBuckets: 87 - HashCollisions: 0 - HashTablesBuildTime: 224774 - InactiveTotalTime: 0 - LargestPartitionPercent: 12 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 1071600 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=15) - BytesReceived: 827 - ConvertRowBatchTime: 12001 - DeserializeRowBatchTimer: 49298 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 49 - RowsReturnedRate: 1660600 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 29577 HDFS_SCAN_NODE (id=0) - AverageHdfsReadThreadConcurrency: 0.005382446745667062 - AverageScannerThreadConcurrency: 1.0 - BytesRead: 46291627 - BytesReadDataNodeCache: 0 - BytesReadLocal: 46291627 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 46291627 - DecompressionTime: 370503730 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 8 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 8 - NumRowGroups: 11 - NumScannerThreadsStarted: 1 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 13815368 - PerReadThreadRawHdfsThroughput: 239110278 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 66838460492 - RowBatchQueuePutWaitTime: 0 - RowsRead: 3100652 - RowsReturned: 3100652 - RowsReturnedRate: 49256 - ScanRangesComplete: 11 - ScannerThreadsInvoluntaryContextSwitches: 8830 - ScannerThreadsTotalWallClockTime: 69609910732 - MaterializeTupleTime(*): 38133560027 - ScannerThreadsSysTime: 180847500 - ScannerThreadsUserTime: 6095573375 - ScannerThreadsVoluntaryContextSwitches: 3226 - TotalRawHdfsReadTime(*): 211191426 - TotalReadThroughput: 435743 - TotalTime: 67117656910 Fragment F02 Instance d94aa36d3a2b7f12:72bd82a400000010 (host=redacted-host8:22000) Hdfs split stats (:<# splits>/): 2:1/12.24 MB 0:1/12.34 MB 10:1/12.20 MB 7:1/12.31 MB 1:2/24.57 MB 11:2/24.68 MB 5:2/24.68 MB - AverageThreadTokens: 1.7508532423208192 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 26531192 - PerHostPeakMemUsage: 225599805 - RowsProduced: 32962 - TotalNetworkReceiveTime: 25868813595 - TotalNetworkSendTime: 257290588 - TotalStorageWaitTime: 73694349619 - TotalThreadsInvoluntaryContextSwitches: 7546 - TotalThreadsTotalWallClockTime: 257216005915 - TotalThreadsSysTime: 246962000 - TotalThreadsUserTime: 6881954000 - TotalThreadsVoluntaryContextSwitches: 6739 - TotalTime: 148572756181 Fragment Instance Lifecycle Timings - ExecTime: 109270044947 - ExecTreeExecTime: 106758660781 - InactiveTotalTime: 0 - OpenTime: 36393668344 - ExecTreeOpenTime: 28361561398 - PrepareTime: 2908885188 - ExecTreePrepareTime: 442860934 - TotalTime: 0 DataStreamSender (dst_id=18) - BytesSent: 1659323 - InactiveTotalTime: 0 - NetworkThroughput(*): 87330987 - OverallThroughput: 10137224 - PeakMemoryUsage: 245504 - RowsReturned: 32962 - SerializeBatchTime: 124015988 - TotalTime: 163686122 - TransmitDataRPCTime: 19000392 - UncompressedRowBatchSize: 5345136 CodeGen - CodegenTime: 837836 - CompileTime: 1734137761 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076168 - NumFunctions: 105 - NumInstructions: 6894 - OptimizationTime: 6231136266 - PeakMemoryUsage: 3529728 - PrepareTime: 1572514061 - TotalTime: 9556597421 HASH_JOIN_NODE (id=7) ExecOption: Probe Side Codegen Enabled - BuildRows: 90 - BuildTime: 22029819 - InactiveTotalTime: 0 - LocalTime: 516461025 - NumHashTableBuildsSkipped: 0 - PeakMemoryUsage: 8602960 - ProbeRows: 32962 - ProbeRowsPartitioned: 0 - ProbeTime: 6495959 - RowsReturned: 32962 - RowsReturnedRate: 242 - TotalTime: 136005333718 Hash Join Builder (join_node_id=7) ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 60252 - BuildRowsPartitioned: 90 - GetNewBlockTime: 10741521 - HashBuckets: 202 - HashCollisions: 0 - HashTablesBuildTime: 269840 - InactiveTotalTime: 0 - LargestPartitionPercent: 14 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 1062016 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=17) - BytesReceived: 1257 - ConvertRowBatchTime: 23053 - DeserializeRowBatchTimer: 41810 - FirstBatchArrivalWaitTime: 25753503180 - InactiveTotalTime: 25868777086 - PeakMemoryUsage: 0 - RowsReturned: 90 - RowsReturnedRate: 3 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 25868823872 HASH_JOIN_NODE (id=6) ExecOption: Probe Side Codegen Enabled - BuildRows: 1800 - BuildTime: 69043564 - InactiveTotalTime: 0 - LocalTime: 443448251 - NumHashTableBuildsSkipped: 0 - PeakMemoryUsage: 3902432 - ProbeRows: 133457 - ProbeRowsPartitioned: 0 - ProbeTime: 27652835 - RowsReturned: 32962 - RowsReturnedRate: 300 - TotalTime: 109620048821 Hash Join Builder (join_node_id=6) ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 426737 - BuildRowsPartitioned: 1800 - GetNewBlockTime: 67639017 - HashBuckets: 4096 - HashCollisions: 0 - HashTablesBuildTime: 636406 - InactiveTotalTime: 0 - LargestPartitionPercent: 7 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 1135744 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=16) - BytesReceived: 14556 - ConvertRowBatchTime: 430436 - DeserializeRowBatchTimer: 234912 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 1800 - RowsReturnedRate: 3850300 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 467496 HASH_JOIN_NODE (id=5) ExecOption: Probe Side Codegen Enabled - BuildRows: 49 - BuildTime: 15871063 - InactiveTotalTime: 0 - LocalTime: 322321148 - NumHashTableBuildsSkipped: 0 - PeakMemoryUsage: 2380784 - ProbeRows: 2611325 - ProbeRowsPartitioned: 0 - ProbeTime: 219295218 - RowsReturned: 133457 - RowsReturnedRate: 1222 - TotalTime: 109176133074 Hash Join Builder (join_node_id=5) ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 39998 - BuildRowsPartitioned: 49 - GetNewBlockTime: 15300322 - HashBuckets: 87 - HashCollisions: 0 - HashTablesBuildTime: 227463 - InactiveTotalTime: 0 - LargestPartitionPercent: 12 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 1071600 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=15) - BytesReceived: 827 - ConvertRowBatchTime: 12548 - DeserializeRowBatchTimer: 62011 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 49 - RowsReturnedRate: 1663611 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 29454 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 2:1/12.24 MB 0:1/12.34 MB 10:1/12.20 MB 7:1/12.31 MB 1:2/24.57 MB 11:2/24.68 MB 5:2/24.68 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 10 out of 10 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:80 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 1.0 - BytesRead: 38877053 - BytesReadDataNodeCache: 0 - BytesReadLocal: 38877053 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 38877053 - DecompressionTime: 276591535 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 8 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 7 - NumRowGroups: 10 - NumScannerThreadsStarted: 1 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 9840179 - PerReadThreadRawHdfsThroughput: 189763898 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 108653499874 - RowBatchQueuePutWaitTime: 0 - RowsRead: 2611325 - RowsReturned: 2611325 - RowsReturnedRate: 23989 - ScanRangesComplete: 10 - ScannerThreadsInvoluntaryContextSwitches: 6540 - ScannerThreadsTotalWallClockTime: 111552334420 - MaterializeTupleTime(*): 31116425450 - ScannerThreadsSysTime: 168974000 - ScannerThreadsUserTime: 5153217000 - ScannerThreadsVoluntaryContextSwitches: 3175 - TotalRawHdfsReadTime(*): 204870649 - TotalReadThroughput: 265214 - TotalTime: 108853782472 Instance d94aa36d3a2b7f12:72bd82a40000000c (host=redacted-host6:22000) Hdfs split stats (:<# splits>/): 3:1/12.22 MB 0:1/12.39 MB 5:2/24.64 MB 11:2/24.88 MB 8:1/12.48 MB 4:1/12.24 MB 10:1/12.27 MB 6:1/12.36 MB 7:2/24.78 MB - AverageThreadTokens: 1.6693548387096775 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 27069716 - PerHostPeakMemUsage: 223945936 - RowsProduced: 38451 - TotalNetworkReceiveTime: 31890842943 - TotalNetworkSendTime: 357847775 - TotalStorageWaitTime: 33400706667 - TotalThreadsInvoluntaryContextSwitches: 9598 - TotalThreadsTotalWallClockTime: 208450790049 - TotalThreadsSysTime: 253961000 - TotalThreadsUserTime: 8117766000 - TotalThreadsVoluntaryContextSwitches: 7658 - TotalTime: 126161992994 Fragment Instance Lifecycle Timings - ExecTime: 82095666881 - ExecTreeExecTime: 79546811133 - InactiveTotalTime: 0 - OpenTime: 42354995863 - ExecTreeOpenTime: 34128461692 - PrepareTime: 1710985872 - ExecTreePrepareTime: 297408651 - TotalTime: 0 DataStreamSender (dst_id=18) - BytesSent: 1936472 - InactiveTotalTime: 0 - NetworkThroughput(*): 85811302 - OverallThroughput: 11532126 - PeakMemoryUsage: 261888 - RowsReturned: 38451 - SerializeBatchTime: 131667717 - TotalTime: 167919762 - TransmitDataRPCTime: 22566631 - UncompressedRowBatchSize: 6235317 CodeGen - CodegenTime: 861383 - CompileTime: 3291424687 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076168 - NumFunctions: 105 - NumInstructions: 6894 - OptimizationTime: 4854581843 - PeakMemoryUsage: 3529728 - PrepareTime: 791210939 - TotalTime: 8983575635 HASH_JOIN_NODE (id=7) ExecOption: Probe Side Codegen Enabled - BuildRows: 90 - BuildTime: 65683004 - InactiveTotalTime: 0 - LocalTime: 341484665 - NumHashTableBuildsSkipped: 0 - PeakMemoryUsage: 8864920 - ProbeRows: 38451 - ProbeRowsPartitioned: 0 - ProbeTime: 7704134 - RowsReturned: 38451 - RowsReturnedRate: 336 - TotalTime: 114247798218 Hash Join Builder (join_node_id=7) ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 51316 - BuildRowsPartitioned: 90 - GetNewBlockTime: 38468416 - HashBuckets: 202 - HashCollisions: 0 - HashTablesBuildTime: 412638 - InactiveTotalTime: 0 - LargestPartitionPercent: 14 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 1062016 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=17) - BytesReceived: 1257 - ConvertRowBatchTime: 20867 - DeserializeRowBatchTimer: 50512 - FirstBatchArrivalWaitTime: 31824905378 - InactiveTotalTime: 31890802842 - PeakMemoryUsage: 0 - RowsReturned: 90 - RowsReturnedRate: 2 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 31890849690 HASH_JOIN_NODE (id=6) ExecOption: Probe Side Codegen Enabled - BuildRows: 1800 - BuildTime: 29672433 - InactiveTotalTime: 0 - LocalTime: 243342068 - NumHashTableBuildsSkipped: 0 - PeakMemoryUsage: 4062112 - ProbeRows: 160258 - ProbeRowsPartitioned: 0 - ProbeTime: 54792296 - RowsReturned: 38451 - RowsReturnedRate: 468 - TotalTime: 82015463863 Hash Join Builder (join_node_id=6) ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 402942 - BuildRowsPartitioned: 1800 - GetNewBlockTime: 28192182 - HashBuckets: 4096 - HashCollisions: 0 - HashTablesBuildTime: 611948 - InactiveTotalTime: 0 - LargestPartitionPercent: 7 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 1135744 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=16) - BytesReceived: 14556 - ConvertRowBatchTime: 357869 - DeserializeRowBatchTimer: 94881 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 1800 - RowsReturnedRate: 4571370 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 393755 HASH_JOIN_NODE (id=5) ExecOption: Probe Side Codegen Enabled - BuildRows: 49 - BuildTime: 13475796 - InactiveTotalTime: 0 - LocalTime: 458033156 - NumHashTableBuildsSkipped: 0 - PeakMemoryUsage: 2398480 - ProbeRows: 3146621 - ProbeRowsPartitioned: 0 - ProbeTime: 254491614 - RowsReturned: 160258 - RowsReturnedRate: 1959 - TotalTime: 81771728040 Hash Join Builder (join_node_id=5) ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 35777 - BuildRowsPartitioned: 49 - GetNewBlockTime: 12896979 - HashBuckets: 87 - HashCollisions: 0 - HashTablesBuildTime: 219107 - InactiveTotalTime: 0 - LargestPartitionPercent: 12 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 1071600 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=15) - BytesReceived: 827 - ConvertRowBatchTime: 13234 - DeserializeRowBatchTimer: 43659 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 49 - RowsReturnedRate: 1564395 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 31322 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 3:1/12.22 MB 0:1/12.39 MB 5:2/24.64 MB 11:2/24.88 MB 8:1/12.48 MB 4:1/12.24 MB 10:1/12.27 MB 6:1/12.36 MB 7:2/24.78 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 12 out of 12 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:96 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 1.0 - BytesRead: 46914805 - BytesReadDataNodeCache: 0 - BytesReadLocal: 46914805 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 46914805 - DecompressionTime: 354544990 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 8 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 9 - NumRowGroups: 12 - NumScannerThreadsStarted: 1 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 9624142 - PerReadThreadRawHdfsThroughput: 123040930 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 81161687714 - RowBatchQueuePutWaitTime: 0 - RowsRead: 3146621 - RowsReturned: 3146621 - RowsReturnedRate: 38697 - ScanRangesComplete: 12 - ScannerThreadsInvoluntaryContextSwitches: 8596 - ScannerThreadsTotalWallClockTime: 84000147283 - MaterializeTupleTime(*): 40316046097 - ScannerThreadsSysTime: 168974000 - ScannerThreadsUserTime: 6303042000 - ScannerThreadsVoluntaryContextSwitches: 3569 - TotalRawHdfsReadTime(*): 381294297 - TotalReadThroughput: 378177 - TotalTime: 81313663562 Instance d94aa36d3a2b7f12:72bd82a40000000d (host=redacted-host3:22000) Hdfs split stats (:<# splits>/): 2:1/52.90 MB 4:1/12.31 MB 5:1/12.26 MB 9:1/12.28 MB 10:1/12.32 MB 11:1/12.36 MB 1:1/12.29 MB 0:1/12.36 MB 8:2/24.63 MB - AverageThreadTokens: 1.6113744075829384 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 47988526 - PerHostPeakMemUsage: 246953154 - RowsProduced: 43739 - TotalNetworkReceiveTime: 32304429985 - TotalNetworkSendTime: 593506359 - TotalStorageWaitTime: 11098559956 - TotalThreadsInvoluntaryContextSwitches: 10613 - TotalThreadsTotalWallClockTime: 171005105803 - TotalThreadsSysTime: 299954000 - TotalThreadsUserTime: 8394724000 - TotalThreadsVoluntaryContextSwitches: 8288 - TotalTime: 107303198030 Fragment Instance Lifecycle Timings - ExecTime: 63908743630 - ExecTreeExecTime: 61053839692 - InactiveTotalTime: 0 - OpenTime: 41907007762 - ExecTreeOpenTime: 33991988653 - PrepareTime: 1486660651 - ExecTreePrepareTime: 248099117 - TotalTime: 0 DataStreamSender (dst_id=18) - BytesSent: 2201361 - InactiveTotalTime: 0 - NetworkThroughput(*): 89088367 - OverallThroughput: 15134477 - PeakMemoryUsage: 245504 - RowsReturned: 43739 - SerializeBatchTime: 120495198 - TotalTime: 145453382 - TransmitDataRPCTime: 24709859 - UncompressedRowBatchSize: 7092851 CodeGen - CodegenTime: 756024 - CompileTime: 2791410405 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076168 - NumFunctions: 105 - NumInstructions: 6894 - OptimizationTime: 5053919716 - PeakMemoryUsage: 3529728 - PrepareTime: 671253313 - TotalTime: 8623727603 HASH_JOIN_NODE (id=7) ExecOption: Probe Side Codegen Enabled - BuildRows: 90 - BuildTime: 28875637 - InactiveTotalTime: 0 - LocalTime: 192550025 - NumHashTableBuildsSkipped: 0 - PeakMemoryUsage: 8702880 - ProbeRows: 43739 - ProbeRowsPartitioned: 0 - ProbeTime: 8695497 - RowsReturned: 43739 - RowsReturnedRate: 458 - TotalTime: 95482706775 Hash Join Builder (join_node_id=7) ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 51030 - BuildRowsPartitioned: 90 - GetNewBlockTime: 18602860 - HashBuckets: 202 - HashCollisions: 0 - HashTablesBuildTime: 243548 - InactiveTotalTime: 0 - LargestPartitionPercent: 14 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 1062016 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=17) - BytesReceived: 1257 - ConvertRowBatchTime: 20020 - DeserializeRowBatchTimer: 53164 - FirstBatchArrivalWaitTime: 32304396699 - InactiveTotalTime: 32304397426 - PeakMemoryUsage: 0 - RowsReturned: 90 - RowsReturnedRate: 2 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 32304439585 HASH_JOIN_NODE (id=6) ExecOption: Probe Side Codegen Enabled - BuildRows: 1800 - BuildTime: 1628585 - InactiveTotalTime: 0 - LocalTime: 259968092 - NumHashTableBuildsSkipped: 0 - PeakMemoryUsage: 4194048 - ProbeRows: 178931 - ProbeRowsPartitioned: 0 - ProbeTime: 40588238 - RowsReturned: 43739 - RowsReturnedRate: 694 - TotalTime: 62985717165 Hash Join Builder (join_node_id=6) ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 342321 - BuildRowsPartitioned: 1800 - GetNewBlockTime: 486777 - HashBuckets: 4096 - HashCollisions: 0 - HashTablesBuildTime: 586178 - InactiveTotalTime: 0 - LargestPartitionPercent: 7 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 1135744 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=16) - BytesReceived: 14556 - ConvertRowBatchTime: 386731 - DeserializeRowBatchTimer: 115026 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 1800 - RowsReturnedRate: 4289973 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 419583 HASH_JOIN_NODE (id=5) ExecOption: Probe Side Codegen Enabled - BuildRows: 49 - BuildTime: 1833810 - InactiveTotalTime: 0 - LocalTime: 409904745 - NumHashTableBuildsSkipped: 0 - PeakMemoryUsage: 3101808 - ProbeRows: 3504801 - ProbeRowsPartitioned: 0 - ProbeTime: 292358946 - RowsReturned: 178931 - RowsReturnedRate: 2852 - TotalTime: 62725329490 Hash Join Builder (join_node_id=5) ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 22420 - BuildRowsPartitioned: 49 - GetNewBlockTime: 1333270 - HashBuckets: 87 - HashCollisions: 0 - HashTablesBuildTime: 212053 - InactiveTotalTime: 0 - LargestPartitionPercent: 12 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 1071600 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=15) - BytesReceived: 827 - ConvertRowBatchTime: 12793 - DeserializeRowBatchTimer: 37025 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 49 - RowsReturnedRate: 1572932 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 31152 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 2:1/52.90 MB 4:1/12.31 MB 5:1/12.26 MB 9:1/12.28 MB 10:1/12.32 MB 11:1/12.36 MB 1:1/12.29 MB 0:1/12.36 MB 8:2/24.63 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 10 out of 10 Hdfs Read Thread Concurrency Bucket: 0:99.22% 1:0.7752% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:80 - AverageHdfsReadThreadConcurrency: 0.007751937984496124 - AverageScannerThreadConcurrency: 1.0 - BytesRead: 52564704 - BytesReadDataNodeCache: 0 - BytesReadLocal: 52564704 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 52564704 - DecompressionTime: 472707769 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 8 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 9 - NumRowGroups: 10 - NumScannerThreadsStarted: 1 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 32412049 - PerReadThreadRawHdfsThroughput: 262702483 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 61739310040 - RowBatchQueuePutWaitTime: 0 - RowsRead: 3504801 - RowsReturned: 3504801 - RowsReturnedRate: 56242 - ScanRangesComplete: 10 - ScannerThreadsInvoluntaryContextSwitches: 9671 - ScannerThreadsTotalWallClockTime: 65189375762 - MaterializeTupleTime(*): 45114910346 - ScannerThreadsSysTime: 196970000 - ScannerThreadsUserTime: 6620994000 - ScannerThreadsVoluntaryContextSwitches: 3746 - TotalRawHdfsReadTime(*): 200092147 - TotalReadThroughput: 497974 - TotalTime: 62315393593 Instance d94aa36d3a2b7f12:72bd82a40000000f (host=redacted-host7:22000) Hdfs split stats (:<# splits>/): 4:1/12.28 MB 1:1/12.25 MB 11:1/12.39 MB 8:3/36.92 MB 0:2/24.76 MB 9:2/24.58 MB 7:2/24.66 MB - AverageThreadTokens: 1.6047619047619048 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 25985171 - PerHostPeakMemUsage: 224948278 - RowsProduced: 40081 - TotalNetworkReceiveTime: 33777088560 - TotalNetworkSendTime: 391678769 - TotalStorageWaitTime: 15937968273 - TotalThreadsInvoluntaryContextSwitches: 9928 - TotalThreadsTotalWallClockTime: 169392272571 - TotalThreadsSysTime: 266959000 - TotalThreadsUserTime: 7925796000 - TotalThreadsVoluntaryContextSwitches: 7206 - TotalTime: 106328454729 Fragment Instance Lifecycle Timings - ExecTime: 62563540263 - ExecTreeExecTime: 60612717754 - InactiveTotalTime: 0 - OpenTime: 42199582084 - ExecTreeOpenTime: 36036960093 - PrepareTime: 1565159550 - ExecTreePrepareTime: 1350432 - TotalTime: 0 DataStreamSender (dst_id=18) - BytesSent: 2018333 - InactiveTotalTime: 0 - NetworkThroughput(*): 87664309 - OverallThroughput: 13346292 - PeakMemoryUsage: 261888 - RowsReturned: 40081 - SerializeBatchTime: 128018327 - TotalTime: 151227995 - TransmitDataRPCTime: 23023429 - UncompressedRowBatchSize: 6500519 CodeGen - CodegenTime: 715455 - CompileTime: 1795934328 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076168 - NumFunctions: 105 - NumInstructions: 6894 - OptimizationTime: 4231128795 - PeakMemoryUsage: 3529728 - PrepareTime: 1234655812 - TotalTime: 7321908360 HASH_JOIN_NODE (id=7) ExecOption: Probe Side Codegen Enabled - BuildRows: 90 - BuildTime: 19409435 - InactiveTotalTime: 0 - LocalTime: 29665168 - NumHashTableBuildsSkipped: 0 - PeakMemoryUsage: 8410984 - ProbeRows: 40081 - ProbeRowsPartitioned: 0 - ProbeTime: 7915771 - RowsReturned: 40081 - RowsReturnedRate: 414 - TotalTime: 96652045790 Hash Join Builder (join_node_id=7) ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 60285 - BuildRowsPartitioned: 90 - GetNewBlockTime: 18458834 - HashBuckets: 202 - HashCollisions: 0 - HashTablesBuildTime: 243752 - InactiveTotalTime: 0 - LargestPartitionPercent: 14 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 1062016 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=17) - BytesReceived: 1257 - ConvertRowBatchTime: 24249 - DeserializeRowBatchTimer: 42183 - FirstBatchArrivalWaitTime: 33698033120 - InactiveTotalTime: 33777050857 - PeakMemoryUsage: 0 - RowsReturned: 90 - RowsReturnedRate: 2 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 33777101641 HASH_JOIN_NODE (id=6) ExecOption: Probe Side Codegen Enabled - BuildRows: 1800 - BuildTime: 3310361 - InactiveTotalTime: 0 - LocalTime: 54583051 - NumHashTableBuildsSkipped: 0 - PeakMemoryUsage: 3909208 - ProbeRows: 160116 - ProbeRowsPartitioned: 0 - ProbeTime: 47272820 - RowsReturned: 40081 - RowsReturnedRate: 637 - TotalTime: 62845278981 Hash Join Builder (join_node_id=6) ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 309288 - BuildRowsPartitioned: 1800 - GetNewBlockTime: 2191905 - HashBuckets: 4096 - HashCollisions: 0 - HashTablesBuildTime: 586276 - InactiveTotalTime: 0 - LargestPartitionPercent: 7 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 1135744 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=16) - BytesReceived: 14556 - ConvertRowBatchTime: 368002 - DeserializeRowBatchTimer: 103735 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 1800 - RowsReturnedRate: 4465780 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 403065 HASH_JOIN_NODE (id=5) ExecOption: Probe Side Codegen Enabled - BuildRows: 49 - BuildTime: 1233411 - InactiveTotalTime: 0 - LocalTime: 306111876 - NumHashTableBuildsSkipped: 0 - PeakMemoryUsage: 2380504 - ProbeRows: 3134300 - ProbeRowsPartitioned: 0 - ProbeTime: 262187731 - RowsReturned: 160116 - RowsReturnedRate: 2550 - TotalTime: 62790292865 Hash Join Builder (join_node_id=5) ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 19979 - BuildRowsPartitioned: 49 - GetNewBlockTime: 736749 - HashBuckets: 87 - HashCollisions: 0 - HashTablesBuildTime: 211117 - InactiveTotalTime: 0 - LargestPartitionPercent: 12 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 1071600 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=15) - BytesReceived: 827 - ConvertRowBatchTime: 11797 - DeserializeRowBatchTimer: 35295 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 49 - RowsReturnedRate: 1683906 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 29099 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 4:1/12.28 MB 1:1/12.25 MB 11:1/12.39 MB 8:3/36.92 MB 0:2/24.76 MB 9:2/24.58 MB 7:2/24.66 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 12 out of 12 Hdfs Read Thread Concurrency Bucket: 0:99.21% 1:0.7874% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:96 - AverageHdfsReadThreadConcurrency: 0.007874015748031496 - AverageScannerThreadConcurrency: 1.0 - BytesRead: 46798167 - BytesReadDataNodeCache: 0 - BytesReadLocal: 46798167 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 46798167 - DecompressionTime: 176056654 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 8 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 7 - NumRowGroups: 12 - NumScannerThreadsStarted: 1 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 9265081 - PerReadThreadRawHdfsThroughput: 201168171 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 62253211930 - RowBatchQueuePutWaitTime: 0 - RowsRead: 3134300 - RowsReturned: 3134300 - RowsReturnedRate: 50161 - ScanRangesComplete: 12 - ScannerThreadsInvoluntaryContextSwitches: 8833 - ScannerThreadsTotalWallClockTime: 64629574047 - MaterializeTupleTime(*): 39633916938 - ScannerThreadsSysTime: 189971000 - ScannerThreadsUserTime: 6226054000 - ScannerThreadsVoluntaryContextSwitches: 3274 - TotalRawHdfsReadTime(*): 232632064 - TotalReadThroughput: 445488 - TotalTime: 62484151890 Instance d94aa36d3a2b7f12:72bd82a400000011 (host=redacted-host2:22000) Hdfs split stats (:<# splits>/): 10:2/24.42 MB 3:1/12.34 MB 6:1/12.41 MB 4:1/12.35 MB 7:1/12.37 MB 2:1/12.32 MB 11:1/12.28 MB 9:2/24.40 MB 8:2/24.75 MB - AverageThreadTokens: 1.5980392156862746 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 25650688 - PerHostPeakMemUsage: 224646707 - RowsProduced: 38712 - TotalNetworkReceiveTime: 35361728286 - TotalNetworkSendTime: 426997232 - TotalStorageWaitTime: 13309866106 - TotalThreadsInvoluntaryContextSwitches: 10599 - TotalThreadsTotalWallClockTime: 164660573916 - TotalThreadsSysTime: 286957000 - TotalThreadsUserTime: 7891800000 - TotalThreadsVoluntaryContextSwitches: 7053 - TotalTime: 103634611265 Fragment Instance Lifecycle Timings - ExecTime: 60563798791 - ExecTreeExecTime: 58319403137 - InactiveTotalTime: 0 - OpenTime: 42067660402 - ExecTreeOpenTime: 37048260461 - PrepareTime: 1003054934 - ExecTreePrepareTime: 104870599 - TotalTime: 0 DataStreamSender (dst_id=18) - BytesSent: 1948412 - InactiveTotalTime: 0 - NetworkThroughput(*): 89234082 - OverallThroughput: 11924141 - PeakMemoryUsage: 261888 - RowsReturned: 38712 - SerializeBatchTime: 141338510 - TotalTime: 163400606 - TransmitDataRPCTime: 21834841 - UncompressedRowBatchSize: 6277568 CodeGen - CodegenTime: 2504065 - CompileTime: 1287435438 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076168 - NumFunctions: 105 - NumInstructions: 6894 - OptimizationTime: 3650633284 - PeakMemoryUsage: 3529728 - PrepareTime: 588804096 - TotalTime: 5527845235 HASH_JOIN_NODE (id=7) ExecOption: Probe Side Codegen Enabled - BuildRows: 90 - BuildTime: 5170238 - InactiveTotalTime: 0 - LocalTime: 55495257 - NumHashTableBuildsSkipped: 0 - PeakMemoryUsage: 8549832 - ProbeRows: 38712 - ProbeRowsPartitioned: 0 - ProbeTime: 7370323 - RowsReturned: 38712 - RowsReturnedRate: 405 - TotalTime: 95577025673 Hash Join Builder (join_node_id=7) ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 54802 - BuildRowsPartitioned: 90 - GetNewBlockTime: 124489 - HashBuckets: 202 - HashCollisions: 0 - HashTablesBuildTime: 772238 - InactiveTotalTime: 0 - LargestPartitionPercent: 14 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 1062016 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=17) - BytesReceived: 1257 - ConvertRowBatchTime: 29604 - DeserializeRowBatchTimer: 11191905 - FirstBatchArrivalWaitTime: 35284445221 - InactiveTotalTime: 35361690621 - PeakMemoryUsage: 0 - RowsReturned: 90 - RowsReturnedRate: 2 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 35361744573 HASH_JOIN_NODE (id=6) ExecOption: Probe Side Codegen Enabled - BuildRows: 1800 - BuildTime: 1289192 - InactiveTotalTime: 0 - LocalTime: 133675928 - NumHashTableBuildsSkipped: 0 - PeakMemoryUsage: 3972024 - ProbeRows: 159547 - ProbeRowsPartitioned: 0 - ProbeTime: 30009575 - RowsReturned: 38712 - RowsReturnedRate: 643 - TotalTime: 60159785843 Hash Join Builder (join_node_id=6) ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 374569 - BuildRowsPartitioned: 1800 - GetNewBlockTime: 93012 - HashBuckets: 4096 - HashCollisions: 0 - HashTablesBuildTime: 574709 - InactiveTotalTime: 0 - LargestPartitionPercent: 7 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 1135744 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=16) - BytesReceived: 14556 - ConvertRowBatchTime: 10818055 - DeserializeRowBatchTimer: 81749 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 1800 - RowsReturnedRate: 165735 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 10860665 HASH_JOIN_NODE (id=5) ExecOption: Probe Side Codegen Enabled - BuildRows: 49 - BuildTime: 79394221 - InactiveTotalTime: 0 - LocalTime: 446144204 - NumHashTableBuildsSkipped: 0 - PeakMemoryUsage: 2384368 - ProbeRows: 3132347 - ProbeRowsPartitioned: 0 - ProbeTime: 262525037 - RowsReturned: 159547 - RowsReturnedRate: 2658 - TotalTime: 60015249250 Hash Join Builder (join_node_id=5) ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 38998 - BuildRowsPartitioned: 49 - GetNewBlockTime: 78761417 - HashBuckets: 87 - HashCollisions: 0 - HashTablesBuildTime: 235107 - InactiveTotalTime: 0 - LargestPartitionPercent: 12 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 1071600 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=15) - BytesReceived: 827 - ConvertRowBatchTime: 12351 - DeserializeRowBatchTimer: 48776 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 49 - RowsReturnedRate: 1558276 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 31445 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 10:2/24.42 MB 3:1/12.34 MB 6:1/12.41 MB 4:1/12.35 MB 7:1/12.37 MB 2:1/12.32 MB 11:1/12.28 MB 9:2/24.40 MB 8:2/24.75 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 12 out of 12 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:96 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 1.0 - BytesRead: 46714976 - BytesReadDataNodeCache: 0 - BytesReadLocal: 46714976 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 46714976 - DecompressionTime: 341013540 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 8 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 9 - NumRowGroups: 12 - NumScannerThreadsStarted: 1 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 9126612 - PerReadThreadRawHdfsThroughput: 279993538 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 59447516011 - RowBatchQueuePutWaitTime: 0 - RowsRead: 3132347 - RowsReturned: 3132347 - RowsReturnedRate: 52583 - ScanRangesComplete: 12 - ScannerThreadsInvoluntaryContextSwitches: 9652 - ScannerThreadsTotalWallClockTime: 62029134195 - MaterializeTupleTime(*): 39119370827 - ScannerThreadsSysTime: 201970000 - ScannerThreadsUserTime: 6189059000 - ScannerThreadsVoluntaryContextSwitches: 3233 - TotalRawHdfsReadTime(*): 166843050 - TotalReadThroughput: 457734 - TotalTime: 59569073601 Instance d94aa36d3a2b7f12:72bd82a40000000e (host=redacted-host1:22000) Hdfs split stats (:<# splits>/): 7:1/12.38 MB 5:1/12.38 MB 4:1/12.28 MB 0:1/12.39 MB 9:1/12.36 MB 11:4/49.31 MB 8:1/12.39 MB 10:2/24.56 MB - AverageThreadTokens: 1.5829145728643217 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 28124845 - PerHostPeakMemUsage: 224989726 - RowsProduced: 39442 - TotalNetworkReceiveTime: 34196507290 - TotalNetworkSendTime: 473540358 - TotalStorageWaitTime: 11359918174 - TotalThreadsInvoluntaryContextSwitches: 10548 - TotalThreadsTotalWallClockTime: 163495484676 - TotalThreadsSysTime: 255960000 - TotalThreadsUserTime: 7903798000 - TotalThreadsVoluntaryContextSwitches: 7240 - TotalTime: 103452406879 Fragment Instance Lifecycle Timings - ExecTime: 60806403326 - ExecTreeExecTime: 57933143881 - InactiveTotalTime: 0 - OpenTime: 41309022130 - ExecTreeOpenTime: 35440465516 - PrepareTime: 1336821459 - ExecTreePrepareTime: 106135866 - TotalTime: 0 DataStreamSender (dst_id=18) - BytesSent: 1985442 - InactiveTotalTime: 0 - NetworkThroughput(*): 88851232 - OverallThroughput: 9957095 - PeakMemoryUsage: 245504 - RowsReturned: 39442 - SerializeBatchTime: 161774109 - TotalTime: 199399721 - TransmitDataRPCTime: 22345689 - UncompressedRowBatchSize: 6398352 CodeGen - CodegenTime: 548150 - CompileTime: 1896652451 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076168 - NumFunctions: 105 - NumInstructions: 6894 - OptimizationTime: 3940320049 - PeakMemoryUsage: 3529728 - PrepareTime: 740130600 - TotalTime: 6616133820 HASH_JOIN_NODE (id=7) ExecOption: Probe Side Codegen Enabled - BuildRows: 90 - BuildTime: 37097640 - InactiveTotalTime: 0 - LocalTime: 81937904 - NumHashTableBuildsSkipped: 0 - PeakMemoryUsage: 7976704 - ProbeRows: 39442 - ProbeRowsPartitioned: 0 - ProbeTime: 7805910 - RowsReturned: 39442 - RowsReturnedRate: 421 - TotalTime: 93585383969 Hash Join Builder (join_node_id=7) ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 60455 - BuildRowsPartitioned: 90 - GetNewBlockTime: 18638214 - HashBuckets: 202 - HashCollisions: 0 - HashTablesBuildTime: 216674 - InactiveTotalTime: 0 - LargestPartitionPercent: 14 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 1062016 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=17) - BytesReceived: 1257 - ConvertRowBatchTime: 21174 - DeserializeRowBatchTimer: 48349 - FirstBatchArrivalWaitTime: 34130495551 - InactiveTotalTime: 34196468781 - PeakMemoryUsage: 0 - RowsReturned: 90 - RowsReturnedRate: 2 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 34196516230 HASH_JOIN_NODE (id=6) ExecOption: Probe Side Codegen Enabled - BuildRows: 1800 - BuildTime: 6769299 - InactiveTotalTime: 0 - LocalTime: 163975600 - NumHashTableBuildsSkipped: 0 - PeakMemoryUsage: 3918112 - ProbeRows: 159554 - ProbeRowsPartitioned: 0 - ProbeTime: 34342893 - RowsReturned: 39442 - RowsReturnedRate: 665 - TotalTime: 59306929835 Hash Join Builder (join_node_id=6) ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 383469 - BuildRowsPartitioned: 1800 - GetNewBlockTime: 5525663 - HashBuckets: 4096 - HashCollisions: 0 - HashTablesBuildTime: 622728 - InactiveTotalTime: 0 - LargestPartitionPercent: 7 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 1135744 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=16) - BytesReceived: 14556 - ConvertRowBatchTime: 377473 - DeserializeRowBatchTimer: 110568 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 1800 - RowsReturnedRate: 4341230 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 414629 HASH_JOIN_NODE (id=5) ExecOption: Probe Side Codegen Enabled - BuildRows: 49 - BuildTime: 9653843 - InactiveTotalTime: 0 - LocalTime: 367605725 - NumHashTableBuildsSkipped: 0 - PeakMemoryUsage: 2381456 - ProbeRows: 3141321 - ProbeRowsPartitioned: 0 - ProbeTime: 257150953 - RowsReturned: 159554 - RowsReturnedRate: 2697 - TotalTime: 59142539606 Hash Join Builder (join_node_id=5) ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 23775 - BuildRowsPartitioned: 49 - GetNewBlockTime: 9115864 - HashBuckets: 87 - HashCollisions: 0 - HashTablesBuildTime: 235956 - InactiveTotalTime: 0 - LargestPartitionPercent: 12 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 1071600 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=15) - BytesReceived: 827 - ConvertRowBatchTime: 11671 - DeserializeRowBatchTimer: 35771 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 49 - RowsReturnedRate: 1750812 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 27987 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 7:1/12.38 MB 5:1/12.38 MB 4:1/12.28 MB 0:1/12.39 MB 9:1/12.36 MB 11:4/49.31 MB 8:1/12.39 MB 10:2/24.56 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 12 out of 12 Hdfs Read Thread Concurrency Bucket: 0:99.14% 1:0.8621% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:96 - AverageHdfsReadThreadConcurrency: 0.008620689655172414 - AverageScannerThreadConcurrency: 1.0 - BytesRead: 46826596 - BytesReadDataNodeCache: 0 - BytesReadLocal: 46826596 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 46826596 - DecompressionTime: 608220873 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 8 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 8 - NumRowGroups: 12 - NumScannerThreadsStarted: 1 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 10486806 - PerReadThreadRawHdfsThroughput: 329144300 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 58264052610 - RowBatchQueuePutWaitTime: 0 - RowsRead: 3141321 - RowsReturned: 3141321 - RowsReturnedRate: 53446 - ScanRangesComplete: 12 - ScannerThreadsInvoluntaryContextSwitches: 9697 - ScannerThreadsTotalWallClockTime: 61380083192 - MaterializeTupleTime(*): 39215555089 - ScannerThreadsSysTime: 172973000 - ScannerThreadsUserTime: 6226053000 - ScannerThreadsVoluntaryContextSwitches: 3229 - TotalRawHdfsReadTime(*): 142267680 - TotalReadThroughput: 472723 - TotalTime: 58774905894 Instance d94aa36d3a2b7f12:72bd82a40000000b (host=redacted-host5:22000) Hdfs split stats (:<# splits>/): 4:1/12.40 MB 5:1/12.39 MB 3:1/12.30 MB 11:1/12.31 MB 0:1/12.25 MB 8:1/12.26 MB 9:2/24.69 MB 7:2/24.78 MB 10:1/12.24 MB - AverageThreadTokens: 1.5692307692307692 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 26251701 - PerHostPeakMemUsage: 182694027 - RowsProduced: 35779 - TotalNetworkReceiveTime: 35278318239 - TotalNetworkSendTime: 320868845 - TotalStorageWaitTime: 12381661904 - TotalThreadsInvoluntaryContextSwitches: 9886 - TotalThreadsTotalWallClockTime: 153823685951 - TotalThreadsSysTime: 237964000 - TotalThreadsUserTime: 7496860000 - TotalThreadsVoluntaryContextSwitches: 6372 - TotalTime: 98455288288 Fragment Instance Lifecycle Timings - ExecTime: 54822091402 - ExecTreeExecTime: 52684666579 - InactiveTotalTime: 0 - OpenTime: 42684675846 - ExecTreeOpenTime: 37020261106 - PrepareTime: 948412474 - ExecTreePrepareTime: 241625124 - TotalTime: 0 DataStreamSender (dst_id=18) - BytesSent: 1800623 - InactiveTotalTime: 0 - NetworkThroughput(*): 86381418 - OverallThroughput: 10264355 - PeakMemoryUsage: 261888 - RowsReturned: 35779 - SerializeBatchTime: 154357637 - TotalTime: 175424856 - TransmitDataRPCTime: 20845027 - UncompressedRowBatchSize: 5802129 CodeGen - CodegenTime: 1002530 - CompileTime: 1187603677 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076168 - NumFunctions: 105 - NumInstructions: 6894 - OptimizationTime: 4393505608 - PeakMemoryUsage: 3529728 - PrepareTime: 425609122 - TotalTime: 6020987755 HASH_JOIN_NODE (id=7) ExecOption: Probe Side Codegen Enabled - BuildRows: 90 - BuildTime: 33349392 - InactiveTotalTime: 0 - LocalTime: 134009058 - NumHashTableBuildsSkipped: 0 - PeakMemoryUsage: 8671376 - ProbeRows: 35779 - ProbeRowsPartitioned: 0 - ProbeTime: 7083252 - RowsReturned: 35779 - RowsReturnedRate: 396 - TotalTime: 90177615001 Hash Join Builder (join_node_id=7) ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 56359 - BuildRowsPartitioned: 90 - GetNewBlockTime: 8752943 - HashBuckets: 202 - HashCollisions: 0 - HashTablesBuildTime: 219159 - InactiveTotalTime: 0 - LargestPartitionPercent: 14 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 1062016 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=17) - BytesReceived: 1257 - ConvertRowBatchTime: 21682 - DeserializeRowBatchTimer: 505969 - FirstBatchArrivalWaitTime: 35189215531 - InactiveTotalTime: 35278281269 - PeakMemoryUsage: 0 - RowsReturned: 90 - RowsReturnedRate: 2 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 35278329617 HASH_JOIN_NODE (id=6) ExecOption: Probe Side Codegen Enabled - BuildRows: 1800 - BuildTime: 3442309 - InactiveTotalTime: 0 - LocalTime: 229154399 - NumHashTableBuildsSkipped: 0 - PeakMemoryUsage: 4026720 - ProbeRows: 145786 - ProbeRowsPartitioned: 0 - ProbeTime: 30142293 - RowsReturned: 35779 - RowsReturnedRate: 653 - TotalTime: 54765276326 Hash Join Builder (join_node_id=6) ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 344180 - BuildRowsPartitioned: 1800 - GetNewBlockTime: 2282398 - HashBuckets: 4096 - HashCollisions: 0 - HashTablesBuildTime: 625905 - InactiveTotalTime: 0 - LargestPartitionPercent: 7 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 1135744 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=16) - BytesReceived: 14556 - ConvertRowBatchTime: 383160 - DeserializeRowBatchTimer: 96344 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 1800 - RowsReturnedRate: 4298835 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 418718 HASH_JOIN_NODE (id=5) ExecOption: Probe Side Codegen Enabled - BuildRows: 49 - BuildTime: 6026085 - InactiveTotalTime: 0 - LocalTime: 470851751 - NumHashTableBuildsSkipped: 0 - PeakMemoryUsage: 2382240 - ProbeRows: 2876953 - ProbeRowsPartitioned: 0 - ProbeTime: 237686241 - RowsReturned: 145786 - RowsReturnedRate: 2673 - TotalTime: 54535703209 Hash Join Builder (join_node_id=5) ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 18259 - BuildRowsPartitioned: 49 - GetNewBlockTime: 5584730 - HashBuckets: 87 - HashCollisions: 0 - HashTablesBuildTime: 194478 - InactiveTotalTime: 0 - LargestPartitionPercent: 12 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 1071600 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=15) - BytesReceived: 827 - ConvertRowBatchTime: 10056 - DeserializeRowBatchTimer: 32707 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 49 - RowsReturnedRate: 1770487 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 27676 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 4:1/12.40 MB 5:1/12.39 MB 3:1/12.30 MB 11:1/12.31 MB 0:1/12.25 MB 8:1/12.26 MB 9:2/24.69 MB 7:2/24.78 MB 10:1/12.24 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 11 out of 11 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:88 - AverageHdfsReadThreadConcurrency: 0.009009009009009009 - AverageScannerThreadConcurrency: 1.0 - BytesRead: 42904753 - BytesReadDataNodeCache: 0 - BytesReadLocal: 42904753 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 42904753 - DecompressionTime: 524095060 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 8 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 9 - NumRowGroups: 11 - NumScannerThreadsStarted: 1 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 9341445 - PerReadThreadRawHdfsThroughput: 307607645 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 53790681167 - RowBatchQueuePutWaitTime: 0 - RowsRead: 2876953 - RowsReturned: 2876953 - RowsReturnedRate: 53213 - ScanRangesComplete: 11 - ScannerThreadsInvoluntaryContextSwitches: 8971 - ScannerThreadsTotalWallClockTime: 56316938127 - MaterializeTupleTime(*): 34779250316 - ScannerThreadsSysTime: 162976000 - ScannerThreadsUserTime: 5830113000 - ScannerThreadsVoluntaryContextSwitches: 2727 - TotalRawHdfsReadTime(*): 139478825 - TotalReadThroughput: 442007 - TotalTime: 54064823782 Instance d94aa36d3a2b7f12:72bd82a40000000a (host=redacted-host4:22000) Hdfs split stats (:<# splits>/): 10:2/24.56 MB 2:1/12.35 MB 11:1/12.34 MB 4:1/12.31 MB 5:1/12.36 MB 6:1/12.37 MB 7:2/53.72 MB 9:1/12.39 MB - AverageThreadTokens: 1.5513513513513513 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 36753032 - PerHostPeakMemUsage: 193321646 - RowsProduced: 40250 - TotalNetworkReceiveTime: 36577837351 - TotalNetworkSendTime: 287576584 - TotalStorageWaitTime: 7390043909 - TotalThreadsInvoluntaryContextSwitches: 9461 - TotalThreadsTotalWallClockTime: 144909813297 - TotalThreadsSysTime: 270959000 - TotalThreadsUserTime: 7882801000 - TotalThreadsVoluntaryContextSwitches: 6746 - TotalTime: 94030209655 Fragment Instance Lifecycle Timings - ExecTime: 50192132406 - ExecTreeExecTime: 48249937582 - InactiveTotalTime: 0 - OpenTime: 42936001337 - ExecTreeOpenTime: 38241390876 - PrepareTime: 902006506 - ExecTreePrepareTime: 59384342 - TotalTime: 0 DataStreamSender (dst_id=18) - BytesSent: 2025535 - InactiveTotalTime: 0 - NetworkThroughput(*): 87607436 - OverallThroughput: 12645912 - PeakMemoryUsage: 245504 - RowsReturned: 40250 - SerializeBatchTime: 136860796 - TotalTime: 160173105 - TransmitDataRPCTime: 23120583 - UncompressedRowBatchSize: 6527950 CodeGen - CodegenTime: 698001 - CompileTime: 1058418173 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076168 - NumFunctions: 105 - NumInstructions: 6894 - OptimizationTime: 3597738588 - PeakMemoryUsage: 3529728 - PrepareTime: 486275654 - TotalTime: 5143526044 HASH_JOIN_NODE (id=7) ExecOption: Probe Side Codegen Enabled - BuildRows: 90 - BuildTime: 6850035 - InactiveTotalTime: 0 - LocalTime: 38285070 - NumHashTableBuildsSkipped: 0 - PeakMemoryUsage: 9020320 - ProbeRows: 40250 - ProbeRowsPartitioned: 0 - ProbeTime: 7754899 - RowsReturned: 40250 - RowsReturnedRate: 464 - TotalTime: 86609713523 Hash Join Builder (join_node_id=7) ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 50275 - BuildRowsPartitioned: 90 - GetNewBlockTime: 3483181 - HashBuckets: 202 - HashCollisions: 0 - HashTablesBuildTime: 219537 - InactiveTotalTime: 0 - LargestPartitionPercent: 14 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 1062016 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=17) - BytesReceived: 1257 - ConvertRowBatchTime: 21795 - DeserializeRowBatchTimer: 8777667 - FirstBatchArrivalWaitTime: 36503227730 - InactiveTotalTime: 36577803304 - PeakMemoryUsage: 0 - RowsReturned: 90 - RowsReturnedRate: 2 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 36577850977 HASH_JOIN_NODE (id=6) ExecOption: Probe Side Codegen Enabled - BuildRows: 1800 - BuildTime: 1198513 - InactiveTotalTime: 0 - LocalTime: 67775460 - NumHashTableBuildsSkipped: 0 - PeakMemoryUsage: 4638464 - ProbeRows: 165471 - ProbeRowsPartitioned: 0 - ProbeTime: 29246546 - RowsReturned: 40250 - RowsReturnedRate: 805 - TotalTime: 49993577476 Hash Join Builder (join_node_id=6) ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 339594 - BuildRowsPartitioned: 1800 - GetNewBlockTime: 84182 - HashBuckets: 4096 - HashCollisions: 0 - HashTablesBuildTime: 585916 - InactiveTotalTime: 0 - LargestPartitionPercent: 7 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 1135744 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=16) - BytesReceived: 14556 - ConvertRowBatchTime: 406015 - DeserializeRowBatchTimer: 104246 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 1800 - RowsReturnedRate: 4129993 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 435836 HASH_JOIN_NODE (id=5) ExecOption: Probe Side Codegen Enabled - BuildRows: 49 - BuildTime: 619096 - InactiveTotalTime: 0 - LocalTime: 359877207 - NumHashTableBuildsSkipped: 0 - PeakMemoryUsage: 3101808 - ProbeRows: 3257553 - ProbeRowsPartitioned: 0 - ProbeTime: 265744582 - RowsReturned: 165471 - RowsReturnedRate: 3314 - TotalTime: 49925366180 Hash Join Builder (join_node_id=5) ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 21312 - BuildRowsPartitioned: 49 - GetNewBlockTime: 120826 - HashBuckets: 87 - HashCollisions: 0 - HashTablesBuildTime: 262916 - InactiveTotalTime: 0 - LargestPartitionPercent: 12 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 1071600 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=15) - BytesReceived: 827 - ConvertRowBatchTime: 11561 - DeserializeRowBatchTimer: 99140 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 49 - RowsReturnedRate: 1720384 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 28482 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 10:2/24.56 MB 2:1/12.35 MB 11:1/12.34 MB 4:1/12.31 MB 5:1/12.36 MB 6:1/12.37 MB 7:2/53.72 MB 9:1/12.39 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 10 out of 10 Hdfs Read Thread Concurrency Bucket: 0:99.02% 1:0.9804% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:80 - AverageHdfsReadThreadConcurrency: 0.00980392156862745 - AverageScannerThreadConcurrency: 1.0 - BytesRead: 48731967 - BytesReadDataNodeCache: 0 - BytesReadLocal: 48731967 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 48731967 - DecompressionTime: 210799420 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 8 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 8 - NumRowGroups: 10 - NumScannerThreadsStarted: 1 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 20426633 - PerReadThreadRawHdfsThroughput: 219461265 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 49397724595 - RowBatchQueuePutWaitTime: 0 - RowsRead: 3257553 - RowsReturned: 3257553 - RowsReturnedRate: 65722 - ScanRangesComplete: 10 - ScannerThreadsInvoluntaryContextSwitches: 8685 - ScannerThreadsTotalWallClockTime: 51781698837 - MaterializeTupleTime(*): 35773005156 - ScannerThreadsSysTime: 183972000 - ScannerThreadsUserTime: 6216055000 - ScannerThreadsVoluntaryContextSwitches: 2857 - TotalRawHdfsReadTime(*): 222052702 - TotalReadThroughput: 526632 - TotalTime: 49565460491 Averaged Fragment F03 split sizes: min: 73.73 KB, max: 73.73 KB, avg: 73.73 KB, stddev: 0 completion times: min:35s187ms max:35s187ms mean: 35s187ms stddev:0.000ns execution rates: min:2.09 KB/sec max:2.09 KB/sec mean:2.09 KB/sec stddev:0.73 B/sec num instances: 1 - AverageThreadTokens: 1.9275362318840579 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 329152 - PerHostPeakMemUsage: 199951247 - RowsProduced: 49 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 5748 - TotalStorageWaitTime: 25252349882 - TotalThreadsInvoluntaryContextSwitches: 48 - TotalThreadsTotalWallClockTime: 64865123783 - TotalThreadsSysTime: 2000000 - TotalThreadsUserTime: 91985000 - TotalThreadsVoluntaryContextSwitches: 119 - TotalTime: 34724567288 Fragment Instance Lifecycle Timings - ExecTime: 32156453322 - ExecTreeExecTime: 32130216739 - InactiveTotalTime: 0 - OpenTime: 669440313 - ExecTreeOpenTime: 317997 - PrepareTime: 1898478440 - ExecTreePrepareTime: 381831 - TotalTime: 0 DataStreamSender (dst_id=15) - BytesSent: 6616 - InactiveTotalTime: 0 - NetworkThroughput(*): 31396965 - OverallThroughput: 59665 - PeakMemoryUsage: 41920 - RowsReturned: 49 - SerializeBatchTime: 61898 - TotalTime: 110884720 - TransmitDataRPCTime: 210721 - UncompressedRowBatchSize: 14136 CodeGen - CodegenTime: 37099815 - CompileTime: 108983030 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076168 - NumFunctions: 36 - NumInstructions: 545 - OptimizationTime: 519525181 - PeakMemoryUsage: 279040 - PrepareTime: 1282969381 - TotalTime: 1969709931 HDFS_SCAN_NODE (id=2) - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 1.0 - BytesRead: 80719 - BytesReadDataNodeCache: 0 - BytesReadLocal: 80719 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 80719 - DecompressionTime: 7559 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 1 - NumRowGroups: 1 - NumScannerThreadsStarted: 1 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 151585 - PerReadThreadRawHdfsThroughput: 978637504 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 32037775132 - RowBatchQueuePutWaitTime: 0 - RowsRead: 804 - RowsReturned: 49 - RowsReturnedRate: 1 - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 32039255415 - MaterializeTupleTime(*): 612319 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 2999000 - ScannerThreadsVoluntaryContextSwitches: 15 - TotalRawHdfsReadTime(*): 82481 - TotalReadThroughput: 2214 - TotalTime: 32131402544 Fragment F03 Instance d94aa36d3a2b7f12:72bd82a400000007 (host=redacted-host8:22000) Hdfs split stats (:<# splits>/): 8:1/73.73 KB - AverageThreadTokens: 1.9275362318840579 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 329152 - PerHostPeakMemUsage: 199951247 - RowsProduced: 49 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 5748 - TotalStorageWaitTime: 25252349882 - TotalThreadsInvoluntaryContextSwitches: 48 - TotalThreadsTotalWallClockTime: 64865123783 - TotalThreadsSysTime: 2000000 - TotalThreadsUserTime: 91985000 - TotalThreadsVoluntaryContextSwitches: 119 - TotalTime: 34724567288 Fragment Instance Lifecycle Timings - ExecTime: 32156453322 - ExecTreeExecTime: 32130216739 - InactiveTotalTime: 0 - OpenTime: 669440313 - ExecTreeOpenTime: 317997 - PrepareTime: 1898478440 - ExecTreePrepareTime: 381831 - TotalTime: 0 DataStreamSender (dst_id=15) - BytesSent: 6616 - InactiveTotalTime: 0 - NetworkThroughput(*): 31396965 - OverallThroughput: 59665 - PeakMemoryUsage: 41920 - RowsReturned: 49 - SerializeBatchTime: 61898 - TotalTime: 110884720 - TransmitDataRPCTime: 210721 - UncompressedRowBatchSize: 14136 CodeGen - CodegenTime: 37099815 - CompileTime: 108983030 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076168 - NumFunctions: 36 - NumInstructions: 545 - OptimizationTime: 519525181 - PeakMemoryUsage: 279040 - PrepareTime: 1282969381 - TotalTime: 1969709931 HDFS_SCAN_NODE (id=2) Hdfs split stats (:<# splits>/): 8:1/73.73 KB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:2 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 1.0 - BytesRead: 80719 - BytesReadDataNodeCache: 0 - BytesReadLocal: 80719 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 80719 - DecompressionTime: 7559 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 1 - NumRowGroups: 1 - NumScannerThreadsStarted: 1 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 151585 - PerReadThreadRawHdfsThroughput: 978637504 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 32037775132 - RowBatchQueuePutWaitTime: 0 - RowsRead: 804 - RowsReturned: 49 - RowsReturnedRate: 1 - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 32039255415 - MaterializeTupleTime(*): 612319 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 2999000 - ScannerThreadsVoluntaryContextSwitches: 15 - TotalRawHdfsReadTime(*): 82481 - TotalReadThroughput: 2214 - TotalTime: 32131402544 Averaged Fragment F04 split sizes: min: 41.55 KB, max: 41.55 KB, avg: 41.55 KB, stddev: 0 completion times: min:12s449ms max:12s449ms mean: 12s449ms stddev:0.000ns execution rates: min:3.34 KB/sec max:3.34 KB/sec mean:3.34 KB/sec stddev:0.94 B/sec num instances: 1 - AverageThreadTokens: 1.875 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 486078 - PerHostPeakMemUsage: 55204843 - RowsProduced: 1800 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 68938124 - TotalStorageWaitTime: 8245340083 - TotalThreadsInvoluntaryContextSwitches: 35 - TotalThreadsTotalWallClockTime: 21445251781 - TotalThreadsSysTime: 3999000 - TotalThreadsUserTime: 64989000 - TotalThreadsVoluntaryContextSwitches: 113 - TotalTime: 12183510019 Fragment Instance Lifecycle Timings - ExecTime: 10741978357 - ExecTreeExecTime: 10368252128 - InactiveTotalTime: 0 - OpenTime: 328272449 - ExecTreeOpenTime: 186814 - PrepareTime: 1113135169 - ExecTreePrepareTime: 334194 - TotalTime: 0 DataStreamSender (dst_id=16) - BytesSent: 116448 - InactiveTotalTime: 0 - NetworkThroughput(*): 133316694 - OverallThroughput: 2193715 - PeakMemoryUsage: 61632 - RowsReturned: 1800 - SerializeBatchTime: 35995331 - TotalTime: 53082547 - TransmitDataRPCTime: 873469 - UncompressedRowBatchSize: 302464 CodeGen - CodegenTime: 1875746 - CompileTime: 118481953 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076168 - NumFunctions: 15 - NumInstructions: 279 - OptimizationTime: 205718584 - PeakMemoryUsage: 142848 - PrepareTime: 620868051 - TotalTime: 946373055 HDFS_SCAN_NODE (id=3) - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 1.0 - BytesRead: 83413 - BytesReadDataNodeCache: 0 - BytesReadLocal: 83413 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 83413 - DecompressionTime: 15528789 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 3 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 1 - NumRowGroups: 1 - NumScannerThreadsStarted: 1 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 388316 - PerReadThreadRawHdfsThroughput: 125927323 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 10327493633 - RowBatchQueuePutWaitTime: 0 - RowsRead: 7200 - RowsReturned: 1800 - RowsReturnedRate: 173 - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 10375019811 - MaterializeTupleTime(*): 5899968 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 8998000 - ScannerThreadsVoluntaryContextSwitches: 34 - TotalRawHdfsReadTime(*): 662390 - TotalReadThroughput: 7242 - TotalTime: 10369159713 Fragment F04 Instance d94aa36d3a2b7f12:72bd82a400000008 (host=redacted-host6:22000) Hdfs split stats (:<# splits>/): 7:1/41.55 KB - AverageThreadTokens: 1.875 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 486078 - PerHostPeakMemUsage: 55204843 - RowsProduced: 1800 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 68938124 - TotalStorageWaitTime: 8245340083 - TotalThreadsInvoluntaryContextSwitches: 35 - TotalThreadsTotalWallClockTime: 21445251781 - TotalThreadsSysTime: 3999000 - TotalThreadsUserTime: 64989000 - TotalThreadsVoluntaryContextSwitches: 113 - TotalTime: 12183510019 Fragment Instance Lifecycle Timings - ExecTime: 10741978357 - ExecTreeExecTime: 10368252128 - InactiveTotalTime: 0 - OpenTime: 328272449 - ExecTreeOpenTime: 186814 - PrepareTime: 1113135169 - ExecTreePrepareTime: 334194 - TotalTime: 0 DataStreamSender (dst_id=16) - BytesSent: 116448 - InactiveTotalTime: 0 - NetworkThroughput(*): 133316694 - OverallThroughput: 2193715 - PeakMemoryUsage: 61632 - RowsReturned: 1800 - SerializeBatchTime: 35995331 - TotalTime: 53082547 - TransmitDataRPCTime: 873469 - UncompressedRowBatchSize: 302464 CodeGen - CodegenTime: 1875746 - CompileTime: 118481953 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076168 - NumFunctions: 15 - NumInstructions: 279 - OptimizationTime: 205718584 - PeakMemoryUsage: 142848 - PrepareTime: 620868051 - TotalTime: 946373055 HDFS_SCAN_NODE (id=3) Hdfs split stats (:<# splits>/): 7:1/41.55 KB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:3 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 1.0 - BytesRead: 83413 - BytesReadDataNodeCache: 0 - BytesReadLocal: 83413 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 83413 - DecompressionTime: 15528789 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 3 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 1 - NumRowGroups: 1 - NumScannerThreadsStarted: 1 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 388316 - PerReadThreadRawHdfsThroughput: 125927323 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 10327493633 - RowBatchQueuePutWaitTime: 0 - RowsRead: 7200 - RowsReturned: 1800 - RowsReturnedRate: 173 - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 10375019811 - MaterializeTupleTime(*): 5899968 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 8998000 - ScannerThreadsVoluntaryContextSwitches: 34 - TotalRawHdfsReadTime(*): 662390 - TotalReadThroughput: 7242 - TotalTime: 10369159713 Averaged Fragment F05 split sizes: min: 2.15 MB, max: 2.15 MB, avg: 2.15 MB, stddev: 0 completion times: min:37s312ms max:37s312ms mean: 37s312ms stddev:0.000ns execution rates: min:59.09 KB/sec max:59.09 KB/sec mean:59.09 KB/sec stddev:0.31 B/sec num instances: 1 - AverageThreadTokens: 1.917808219178082 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 4482459 - PerHostPeakMemUsage: 204357648 - RowsProduced: 90 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 6081 - TotalStorageWaitTime: 26585622205 - TotalThreadsInvoluntaryContextSwitches: 121 - TotalThreadsTotalWallClockTime: 68787325130 - TotalThreadsSysTime: 18996000 - TotalThreadsUserTime: 167975000 - TotalThreadsVoluntaryContextSwitches: 214 - TotalTime: 36783391755 Fragment Instance Lifecycle Timings - ExecTime: 34061842099 - ExecTreeExecTime: 34009492526 - InactiveTotalTime: 0 - OpenTime: 874120664 - ExecTreeOpenTime: 154070 - PrepareTime: 1847306168 - ExecTreePrepareTime: 403126 - TotalTime: 0 DataStreamSender (dst_id=17) - BytesSent: 10056 - InactiveTotalTime: 0 - NetworkThroughput(*): 40324003 - OverallThroughput: 554050 - PeakMemoryUsage: 41920 - RowsReturned: 90 - SerializeBatchTime: 88848 - TotalTime: 18149968 - TransmitDataRPCTime: 249380 - UncompressedRowBatchSize: 28112 CodeGen - CodegenTime: 4208645 - CompileTime: 416500205 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076168 - NumFunctions: 46 - NumInstructions: 773 - OptimizationTime: 403397250 - PeakMemoryUsage: 395776 - PrepareTime: 1176866973 - TotalTime: 2044116150 HDFS_SCAN_NODE (id=1) - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 1.0 - BytesRead: 835696 - BytesReadDataNodeCache: 0 - BytesReadLocal: 835696 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 835696 - DecompressionTime: 67958463 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 1 - NumRowGroups: 1 - NumScannerThreadsStarted: 1 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 4429429 - PerReadThreadRawHdfsThroughput: 1299773701 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 33837192048 - RowBatchQueuePutWaitTime: 0 - RowsRead: 73049 - RowsReturned: 90 - RowsReturnedRate: 2 - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 64 - ScannerThreadsTotalWallClockTime: 33851379844 - MaterializeTupleTime(*): 93686068 - ScannerThreadsSysTime: 7998000 - ScannerThreadsUserTime: 48993000 - ScannerThreadsVoluntaryContextSwitches: 79 - TotalRawHdfsReadTime(*): 642955 - TotalReadThroughput: 23211 - TotalTime: 34010582031 Fragment F05 Instance d94aa36d3a2b7f12:72bd82a400000009 (host=redacted-host8:22000) Hdfs split stats (:<# splits>/): 11:1/2.15 MB - AverageThreadTokens: 1.917808219178082 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 4482459 - PerHostPeakMemUsage: 204357648 - RowsProduced: 90 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 6081 - TotalStorageWaitTime: 26585622205 - TotalThreadsInvoluntaryContextSwitches: 121 - TotalThreadsTotalWallClockTime: 68787325130 - TotalThreadsSysTime: 18996000 - TotalThreadsUserTime: 167975000 - TotalThreadsVoluntaryContextSwitches: 214 - TotalTime: 36783391755 Fragment Instance Lifecycle Timings - ExecTime: 34061842099 - ExecTreeExecTime: 34009492526 - InactiveTotalTime: 0 - OpenTime: 874120664 - ExecTreeOpenTime: 154070 - PrepareTime: 1847306168 - ExecTreePrepareTime: 403126 - TotalTime: 0 DataStreamSender (dst_id=17) - BytesSent: 10056 - InactiveTotalTime: 0 - NetworkThroughput(*): 40324003 - OverallThroughput: 554050 - PeakMemoryUsage: 41920 - RowsReturned: 90 - SerializeBatchTime: 88848 - TotalTime: 18149968 - TransmitDataRPCTime: 249380 - UncompressedRowBatchSize: 28112 CodeGen - CodegenTime: 4208645 - CompileTime: 416500205 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076168 - NumFunctions: 46 - NumInstructions: 773 - OptimizationTime: 403397250 - PeakMemoryUsage: 395776 - PrepareTime: 1176866973 - TotalTime: 2044116150 HDFS_SCAN_NODE (id=1) Hdfs split stats (:<# splits>/): 11:1/2.15 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:2 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 1.0 - BytesRead: 835696 - BytesReadDataNodeCache: 0 - BytesReadLocal: 835696 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 835696 - DecompressionTime: 67958463 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 1 - NumRowGroups: 1 - NumScannerThreadsStarted: 1 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 4429429 - PerReadThreadRawHdfsThroughput: 1299773701 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 33837192048 - RowBatchQueuePutWaitTime: 0 - RowsRead: 73049 - RowsReturned: 90 - RowsReturnedRate: 2 - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 64 - ScannerThreadsTotalWallClockTime: 33851379844 - MaterializeTupleTime(*): 93686068 - ScannerThreadsSysTime: 7998000 - ScannerThreadsUserTime: 48993000 - ScannerThreadsVoluntaryContextSwitches: 79 - TotalRawHdfsReadTime(*): 642955 - TotalReadThroughput: 23211 - TotalTime: 34010582031 Averaged Fragment F06 split sizes: min: 5.88 MB, max: 11.77 MB, avg: 6.81 MB, stddev: 2.02 MB completion times: min:11s570ms max:21s002ms mean: 15s506ms stddev:3s714ms execution rates: min:286.91 KB/sec max:599.63 KB/sec mean:459.97 KB/sec stddev:99.98 KB/sec num instances: 7 - AverageThreadTokens: 1.6760203982074107 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 8612684 - PerHostPeakMemUsage: 66561260 - RowsProduced: 357142 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 8519883969 - TotalStorageWaitTime: 2620695747 - TotalThreadsInvoluntaryContextSwitches: 676 - TotalThreadsTotalWallClockTime: 24515229371 - TotalThreadsSysTime: 18567714 - TotalThreadsUserTime: 923716000 - TotalThreadsVoluntaryContextSwitches: 573 - TotalTime: 15185906464 Fragment Instance Lifecycle Timings - ExecTime: 13860216866 - ExecTreeExecTime: 3903538546 - InactiveTotalTime: 0 - OpenTime: 281337867 - ExecTreeOpenTime: 135840 - PrepareTime: 1044245860 - ExecTreePrepareTime: 1158770 - TotalTime: 0 DataStreamSender (dst_id=19) - BytesSent: 6998748 - InactiveTotalTime: 0 - NetworkThroughput(*): 126705117 - OverallThroughput: 12215619 - PeakMemoryUsage: 339172 - RowsReturned: 357142 - SerializeBatchTime: 496470182 - TotalTime: 574128039 - TransmitDataRPCTime: 54975427 - UncompressedRowBatchSize: 13460325 CodeGen - CodegenTime: 859838 - CompileTime: 29458608 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076168 - NumFunctions: 5 - NumInstructions: 98 - OptimizationTime: 204407402 - PeakMemoryUsage: 50176 - PrepareTime: 750533452 - TotalTime: 1030095140 HDFS_SCAN_NODE (id=4) - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.7741895982497485 - BytesRead: 2098519 - BytesReadDataNodeCache: 0 - BytesReadLocal: 2098519 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 2098519 - DecompressionTime: 73111563 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 1 - NumRowGroups: 1 - NumScannerThreadsStarted: 1 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 8273089 - PerReadThreadRawHdfsThroughput: 622479977 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 3827177084 - RowBatchQueuePutWaitTime: 4829169142 - RowsRead: 357142 - RowsReturned: 357142 - RowsReturnedRate: 410533 - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 67 - ScannerThreadsTotalWallClockTime: 10373692440 - MaterializeTupleTime(*): 684949242 - ScannerThreadsSysTime: 6427000 - ScannerThreadsUserTime: 199397857 - ScannerThreadsVoluntaryContextSwitches: 345 - TotalRawHdfsReadTime(*): 7599268 - TotalReadThroughput: 147671 - TotalTime: 3904635279 Fragment F06 Instance d94aa36d3a2b7f12:72bd82a400000016 (host=redacted-host8:22000) Hdfs split stats (:<# splits>/): 10:1/5.88 MB - AverageThreadTokens: 1.8048780487804879 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 8578453 - PerHostPeakMemUsage: 185180139 - RowsProduced: 308334 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 3370856487 - TotalStorageWaitTime: 7496999668 - TotalThreadsInvoluntaryContextSwitches: 904 - TotalThreadsTotalWallClockTime: 34707326686 - TotalThreadsSysTime: 15996000 - TotalThreadsUserTime: 843871000 - TotalThreadsVoluntaryContextSwitches: 553 - TotalTime: 20507531395 Fragment Instance Lifecycle Timings - ExecTime: 17971079891 - ExecTreeExecTime: 13097093445 - InactiveTotalTime: 0 - OpenTime: 339827327 - ExecTreeOpenTime: 150200 - PrepareTime: 2196438403 - ExecTreePrepareTime: 412111 - TotalTime: 0 DataStreamSender (dst_id=19) - BytesSent: 6052110 - InactiveTotalTime: 0 - NetworkThroughput(*): 116107750 - OverallThroughput: 9967812 - PeakMemoryUsage: 345024 - RowsReturned: 308334 - SerializeBatchTime: 517793102 - TotalTime: 607165343 - TransmitDataRPCTime: 52124944 - UncompressedRowBatchSize: 11622932 CodeGen - CodegenTime: 962241 - CompileTime: 80690502 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076168 - NumFunctions: 5 - NumInstructions: 98 - OptimizationTime: 243095423 - PeakMemoryUsage: 50176 - PrepareTime: 1433518972 - TotalTime: 1838260012 HDFS_SCAN_NODE (id=4) Hdfs split stats (:<# splits>/): 10:1/5.88 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:2 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.9428571428571428 - BytesRead: 1814021 - BytesReadDataNodeCache: 0 - BytesReadLocal: 1814021 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1814021 - DecompressionTime: 48179682 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 1 - NumRowGroups: 1 - NumScannerThreadsStarted: 1 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 8233006 - PerReadThreadRawHdfsThroughput: 324495785 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 13044838899 - RowBatchQueuePutWaitTime: 1133856504 - RowsRead: 308334 - RowsReturned: 308334 - RowsReturnedRate: 23543 - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 100 - ScannerThreadsTotalWallClockTime: 16396442161 - MaterializeTupleTime(*): 1458530505 - ScannerThreadsSysTime: 6998000 - ScannerThreadsUserTime: 192971000 - ScannerThreadsVoluntaryContextSwitches: 327 - TotalRawHdfsReadTime(*): 5590276 - TotalReadThroughput: 90701 - TotalTime: 13096345469 Instance d94aa36d3a2b7f12:72bd82a400000018 (host=redacted-host4:22000) Hdfs split stats (:<# splits>/): 7:1/5.89 MB 6:1/5.89 MB - AverageThreadTokens: 1.7435897435897436 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 8867265 - PerHostPeakMemUsage: 22719425 - RowsProduced: 616667 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 16401226748 - TotalStorageWaitTime: 784366708 - TotalThreadsInvoluntaryContextSwitches: 998 - TotalThreadsTotalWallClockTime: 33541211807 - TotalThreadsSysTime: 26996000 - TotalThreadsUserTime: 1491772000 - TotalThreadsVoluntaryContextSwitches: 890 - TotalTime: 19891351260 Fragment Instance Lifecycle Timings - ExecTime: 19030255761 - ExecTreeExecTime: 564757379 - InactiveTotalTime: 0 - OpenTime: 168591613 - ExecTreeOpenTime: 120047 - PrepareTime: 692429759 - ExecTreePrepareTime: 5090680 - TotalTime: 0 DataStreamSender (dst_id=19) - BytesSent: 12055428 - InactiveTotalTime: 0 - NetworkThroughput(*): 133791482 - OverallThroughput: 13457629 - PeakMemoryUsage: 353216 - RowsReturned: 616667 - SerializeBatchTime: 805180107 - TotalTime: 895806235 - TransmitDataRPCTime: 90106095 - UncompressedRowBatchSize: 23241438 CodeGen - CodegenTime: 1006402 - CompileTime: 19639861 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076168 - NumFunctions: 5 - NumInstructions: 98 - OptimizationTime: 141354857 - PeakMemoryUsage: 50176 - PrepareTime: 490740753 - TotalTime: 658072113 HDFS_SCAN_NODE (id=4) Hdfs split stats (:<# splits>/): 7:1/5.89 MB 6:1/5.89 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 2 out of 2 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:4 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.7837837837837838 - BytesRead: 3628278 - BytesReadDataNodeCache: 0 - BytesReadLocal: 3628278 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 3628278 - DecompressionTime: 61851977 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 2 - NumRowGroups: 2 - NumScannerThreadsStarted: 1 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 8513626 - PerReadThreadRawHdfsThroughput: 280358865 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 447643622 - RowBatchQueuePutWaitTime: 11426113587 - RowsRead: 616667 - RowsReturned: 616667 - RowsReturnedRate: 1075469 - ScanRangesComplete: 2 - ScannerThreadsInvoluntaryContextSwitches: 75 - ScannerThreadsTotalWallClockTime: 14342379996 - MaterializeTupleTime(*): 1178994407 - ScannerThreadsSysTime: 10998000 - ScannerThreadsUserTime: 322950000 - ScannerThreadsVoluntaryContextSwitches: 602 - TotalRawHdfsReadTime(*): 12941549 - TotalReadThroughput: 190921 - TotalTime: 573393459 Instance d94aa36d3a2b7f12:72bd82a400000012 (host=redacted-host6:22000) Hdfs split stats (:<# splits>/): 6:1/6.04 MB - AverageThreadTokens: 1.7058823529411764 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 8570273 - PerHostPeakMemUsage: 56515708 - RowsProduced: 316666 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 6358990995 - TotalStorageWaitTime: 6476798239 - TotalThreadsInvoluntaryContextSwitches: 580 - TotalThreadsTotalWallClockTime: 28155337174 - TotalThreadsSysTime: 20996000 - TotalThreadsUserTime: 861868000 - TotalThreadsVoluntaryContextSwitches: 453 - TotalTime: 17406168116 Fragment Instance Lifecycle Timings - ExecTime: 16003556403 - ExecTreeExecTime: 8240126736 - InactiveTotalTime: 0 - OpenTime: 331917418 - ExecTreeOpenTime: 146028 - PrepareTime: 1070570754 - ExecTreePrepareTime: 800050 - TotalTime: 0 DataStreamSender (dst_id=19) - BytesSent: 6188118 - InactiveTotalTime: 0 - NetworkThroughput(*): 121484746 - OverallThroughput: 13894432 - PeakMemoryUsage: 336832 - RowsReturned: 316666 - SerializeBatchTime: 330266378 - TotalTime: 445366735 - TransmitDataRPCTime: 50937407 - UncompressedRowBatchSize: 11933566 CodeGen - CodegenTime: 866019 - CompileTime: 4423521 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076168 - NumFunctions: 5 - NumInstructions: 98 - OptimizationTime: 274831838 - PeakMemoryUsage: 50176 - PrepareTime: 782087665 - TotalTime: 1062410778 HDFS_SCAN_NODE (id=4) Hdfs split stats (:<# splits>/): 6:1/6.04 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:2 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.8 - BytesRead: 1857986 - BytesReadDataNodeCache: 0 - BytesReadLocal: 1857986 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1857986 - DecompressionTime: 48502074 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 1 - NumRowGroups: 1 - NumScannerThreadsStarted: 1 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 8233018 - PerReadThreadRawHdfsThroughput: 669050973 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 8149759924 - RowBatchQueuePutWaitTime: 2915602748 - RowsRead: 316666 - RowsReturned: 316666 - RowsReturnedRate: 38425 - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 57 - ScannerThreadsTotalWallClockTime: 11819882208 - MaterializeTupleTime(*): 237807123 - ScannerThreadsSysTime: 5999000 - ScannerThreadsUserTime: 180972000 - ScannerThreadsVoluntaryContextSwitches: 240 - TotalRawHdfsReadTime(*): 2777047 - TotalReadThroughput: 116102 - TotalTime: 8240984505 Instance d94aa36d3a2b7f12:72bd82a400000014 (host=redacted-host3:22000) Hdfs split stats (:<# splits>/): 9:1/6.04 MB - AverageThreadTokens: 1.5769230769230769 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 8586598 - PerHostPeakMemUsage: 51730527 - RowsProduced: 316667 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 9107628198 - TotalStorageWaitTime: 843540204 - TotalThreadsInvoluntaryContextSwitches: 695 - TotalThreadsTotalWallClockTime: 19897579675 - TotalThreadsSysTime: 23995000 - TotalThreadsUserTime: 849870000 - TotalThreadsVoluntaryContextSwitches: 511 - TotalTime: 12994660712 Fragment Instance Lifecycle Timings - ExecTime: 11632558205 - ExecTreeExecTime: 1132185544 - InactiveTotalTime: 0 - OpenTime: 416808573 - ExecTreeOpenTime: 133268 - PrepareTime: 945204692 - ExecTreePrepareTime: 772549 - TotalTime: 0 DataStreamSender (dst_id=19) - BytesSent: 6239052 - InactiveTotalTime: 0 - NetworkThroughput(*): 128114115 - OverallThroughput: 12444680 - PeakMemoryUsage: 353216 - RowsReturned: 316667 - SerializeBatchTime: 452321848 - TotalTime: 501342898 - TransmitDataRPCTime: 48699177 - UncompressedRowBatchSize: 11934522 CodeGen - CodegenTime: 796599 - CompileTime: 67318819 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076168 - NumFunctions: 5 - NumInstructions: 98 - OptimizationTime: 241827384 - PeakMemoryUsage: 50176 - PrepareTime: 657383010 - TotalTime: 1058474232 HDFS_SCAN_NODE (id=4) Hdfs split stats (:<# splits>/): 9:1/6.04 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:2 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.7142857142857143 - BytesRead: 1857941 - BytesReadDataNodeCache: 0 - BytesReadLocal: 1857941 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1857941 - DecompressionTime: 99485673 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 1 - NumRowGroups: 1 - NumScannerThreadsStarted: 1 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 8232959 - PerReadThreadRawHdfsThroughput: 1586031721 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 1060968005 - RowBatchQueuePutWaitTime: 5218919470 - RowsRead: 316667 - RowsReturned: 316667 - RowsReturnedRate: 279506 - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 75 - ScannerThreadsTotalWallClockTime: 7848228919 - MaterializeTupleTime(*): 234166100 - ScannerThreadsSysTime: 7998000 - ScannerThreadsUserTime: 178972000 - ScannerThreadsVoluntaryContextSwitches: 287 - TotalRawHdfsReadTime(*): 1171440 - TotalReadThroughput: 154751 - TotalTime: 1132952051 Instance d94aa36d3a2b7f12:72bd82a400000017 (host=redacted-host2:22000) Hdfs split stats (:<# splits>/): 3:1/6.04 MB - AverageThreadTokens: 1.64 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 8545684 - PerHostPeakMemUsage: 50770197 - RowsProduced: 316666 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 7014949371 - TotalStorageWaitTime: 2402246022 - TotalThreadsInvoluntaryContextSwitches: 482 - TotalThreadsTotalWallClockTime: 19712514308 - TotalThreadsSysTime: 16997000 - TotalThreadsUserTime: 810876000 - TotalThreadsVoluntaryContextSwitches: 466 - TotalTime: 12388032956 Fragment Instance Lifecycle Timings - ExecTime: 11441695021 - ExecTreeExecTime: 3336156487 - InactiveTotalTime: 0 - OpenTime: 277061071 - ExecTreeOpenTime: 142376 - PrepareTime: 669178599 - ExecTreePrepareTime: 225352 - TotalTime: 0 DataStreamSender (dst_id=19) - BytesSent: 6219178 - InactiveTotalTime: 0 - NetworkThroughput(*): 128577926 - OverallThroughput: 13944526 - PeakMemoryUsage: 312256 - RowsReturned: 316666 - SerializeBatchTime: 387877305 - TotalTime: 445994194 - TransmitDataRPCTime: 48368940 - UncompressedRowBatchSize: 11935494 CodeGen - CodegenTime: 668937 - CompileTime: 3964859 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076168 - NumFunctions: 5 - NumInstructions: 98 - OptimizationTime: 244244105 - PeakMemoryUsage: 50176 - PrepareTime: 534753582 - TotalTime: 822496805 HDFS_SCAN_NODE (id=4) Hdfs split stats (:<# splits>/): 3:1/6.04 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:2 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.7272727272727273 - BytesRead: 1858729 - BytesReadDataNodeCache: 0 - BytesReadLocal: 1858729 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1858729 - DecompressionTime: 117471163 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 1 - NumRowGroups: 1 - NumScannerThreadsStarted: 1 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 8233005 - PerReadThreadRawHdfsThroughput: 315283826 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 3287234055 - RowBatchQueuePutWaitTime: 2950626891 - RowsRead: 316666 - RowsReturned: 316666 - RowsReturnedRate: 94925 - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 78 - ScannerThreadsTotalWallClockTime: 7993773971 - MaterializeTupleTime(*): 476542130 - ScannerThreadsSysTime: 4999000 - ScannerThreadsUserTime: 175973000 - ScannerThreadsVoluntaryContextSwitches: 261 - TotalRawHdfsReadTime(*): 5895415 - TotalReadThroughput: 154881 - TotalTime: 3335944829 Instance d94aa36d3a2b7f12:72bd82a400000013 (host=redacted-host1:22000) Hdfs split stats (:<# splits>/): 8:1/6.04 MB - AverageThreadTokens: 1.6521739130434783 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 8570244 - PerHostPeakMemUsage: 48094206 - RowsProduced: 316667 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 9141232075 - TotalStorageWaitTime: 125443981 - TotalThreadsInvoluntaryContextSwitches: 553 - TotalThreadsTotalWallClockTime: 18290227120 - TotalThreadsSysTime: 11997000 - TotalThreadsUserTime: 818875000 - TotalThreadsVoluntaryContextSwitches: 604 - TotalTime: 11697045478 Fragment Instance Lifecycle Timings - ExecTime: 10794166253 - ExecTreeExecTime: 390083547 - InactiveTotalTime: 0 - OpenTime: 177081542 - ExecTreeOpenTime: 112388 - PrepareTime: 725718207 - ExecTreePrepareTime: 319350 - TotalTime: 0 DataStreamSender (dst_id=19) - BytesSent: 6188753 - InactiveTotalTime: 0 - NetworkThroughput(*): 127304176 - OverallThroughput: 10715270 - PeakMemoryUsage: 336832 - RowsReturned: 316667 - SerializeBatchTime: 482511621 - TotalTime: 577563878 - TransmitDataRPCTime: 48613904 - UncompressedRowBatchSize: 11934572 CodeGen - CodegenTime: 686071 - CompileTime: 19671818 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076168 - NumFunctions: 5 - NumInstructions: 98 - OptimizationTime: 122667010 - PeakMemoryUsage: 50176 - PrepareTime: 466911290 - TotalTime: 675096278 HDFS_SCAN_NODE (id=4) Hdfs split stats (:<# splits>/): 8:1/6.04 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:2 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.7142857142857143 - BytesRead: 1858062 - BytesReadDataNodeCache: 0 - BytesReadLocal: 1858062 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1858062 - DecompressionTime: 28869418 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 1 - NumRowGroups: 1 - NumScannerThreadsStarted: 1 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 8232989 - PerReadThreadRawHdfsThroughput: 80184187 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 342684297 - RowBatchQueuePutWaitTime: 5152122569 - RowsRead: 316667 - RowsReturned: 316667 - RowsReturnedRate: 815822 - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 48 - ScannerThreadsTotalWallClockTime: 7318994357 - MaterializeTupleTime(*): 745714545 - ScannerThreadsSysTime: 6998000 - ScannerThreadsUserTime: 181972000 - ScannerThreadsVoluntaryContextSwitches: 395 - TotalRawHdfsReadTime(*): 23172424 - TotalReadThroughput: 161486 - TotalTime: 388156944 Instance d94aa36d3a2b7f12:72bd82a400000015 (host=redacted-host7:22000) Hdfs split stats (:<# splits>/): 9:1/5.89 MB - AverageThreadTokens: 1.608695652173913 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 8570276 - PerHostPeakMemUsage: 50918621 - RowsProduced: 308333 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 8244303911 - TotalStorageWaitTime: 215475407 - TotalThreadsInvoluntaryContextSwitches: 526 - TotalThreadsTotalWallClockTime: 17302408827 - TotalThreadsSysTime: 12997000 - TotalThreadsUserTime: 788880000 - TotalThreadsVoluntaryContextSwitches: 534 - TotalTime: 11416555333 Fragment Instance Lifecycle Timings - ExecTime: 10148206530 - ExecTreeExecTime: 564366690 - InactiveTotalTime: 0 - OpenTime: 258077526 - ExecTreeOpenTime: 146578 - PrepareTime: 1010180612 - ExecTreePrepareTime: 491300 - TotalTime: 0 DataStreamSender (dst_id=19) - BytesSent: 6048602 - InactiveTotalTime: 0 - NetworkThroughput(*): 131555629 - OverallThroughput: 11084989 - PeakMemoryUsage: 336832 - RowsReturned: 308333 - SerializeBatchTime: 499340915 - TotalTime: 545656992 - TransmitDataRPCTime: 45977523 - UncompressedRowBatchSize: 11619756 CodeGen - CodegenTime: 1032597 - CompileTime: 10500878 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076168 - NumFunctions: 5 - NumInstructions: 98 - OptimizationTime: 162831199 - PeakMemoryUsage: 50176 - PrepareTime: 888338892 - TotalTime: 1095855767 HDFS_SCAN_NODE (id=4) Hdfs split stats (:<# splits>/): 9:1/5.89 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:2 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.7368421052631579 - BytesRead: 1814616 - BytesReadDataNodeCache: 0 - BytesReadLocal: 1814616 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1814616 - DecompressionTime: 107420954 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 1 - NumRowGroups: 1 - NumScannerThreadsStarted: 1 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 8233021 - PerReadThreadRawHdfsThroughput: 1101954485 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 457110791 - RowBatchQueuePutWaitTime: 5006942225 - RowsRead: 308333 - RowsReturned: 308333 - RowsReturnedRate: 546041 - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 40 - ScannerThreadsTotalWallClockTime: 6896145473 - MaterializeTupleTime(*): 462889888 - ScannerThreadsSysTime: 999000 - ScannerThreadsUserTime: 161975000 - ScannerThreadsVoluntaryContextSwitches: 304 - TotalRawHdfsReadTime(*): 1646725 - TotalReadThroughput: 164860 - TotalTime: 564669700