Query (id=b4afd338536090b:47bd038400000000) DEBUG MODE WARNING: Query profile created while running a DEBUG build of Impala. Use RELEASE builds to measure query performance. Summary Session ID: ee4c15838306dfe2:12321895dca86ca9 Session Type: HIVESERVER2 HiveServer2 Protocol Version: V6 Start Time: 2017-05-31 10:11:45.613527000 End Time: 2017-05-31 10:17:35.143507000 Query Type: QUERY Query State: FINISHED Query Status: OK Impala Version: impalad version 2.9.0-SNAPSHOT DEBUG (build 470e6de60c3171e58c4ffeea48d456945ab6dd22) User: redacted Connected User: redacted Delegated User: Network Address: redacted Default Db: tpcds_300_decimal_parquet Sql Statement: /* Mem: 300 MB. Coordinator: redacted-host6. */ select c_last_name, c_first_name, ca_city, bought_city, ss_ticket_number, extended_price, extended_tax, list_price from (select ss_ticket_number, ss_customer_sk, ca_city bought_city, sum(ss_ext_sales_price) extended_price, sum(ss_ext_list_price) list_price, sum(ss_ext_tax) extended_tax from store_sales, date_dim, store, household_demographics, customer_address where store_sales.ss_sold_date_sk = date_dim.d_date_sk and store_sales.ss_store_sk = store.s_store_sk and store_sales.ss_hdemo_sk = household_demographics.hd_demo_sk and store_sales.ss_addr_sk = customer_address.ca_address_sk -- and date_dim.d_dom between 1 and 2 and (household_demographics.hd_dep_count = 5 or household_demographics.hd_vehicle_count = 3) -- and date_dim.d_year in (1999, 1999 + 1, 1999 + 2) and store.s_city in ('Midway', 'Fairview') -- partition key filter -- and ss_sold_date_sk in (2451180, 2451181, 2451211, 2451212, 2451239, 2451240, 2451270, 2451271, 2451300, 2451301, 2451331, -- 2451332, 2451361, 2451362, 2451392, 2451393, 2451423, 2451424, 2451453, 2451454, 2451484, 2451485, -- 2451514, 2451515, 2451545, 2451546, 2451576, 2451577, 2451605, 2451606, 2451636, 2451637, 2451666, -- 2451667, 2451697, 2451698, 2451727, 2451728, 2451758, 2451759, 2451789, 2451790, 2451819, 2451820, -- 2451850, 2451851, 2451880, 2451881, 2451911, 2451912, 2451942, 2451943, 2451970, 2451971, 2452001, -- 2452002, 2452031, 2452032, 2452062, 2452063, 2452092, 2452093, 2452123, 2452124, 2452154, 2452155, -- 2452184, 2452185, 2452215, 2452216, 2452245, 2452246) and ss_sold_date_sk between 2451180 and 2451269 -- partition key filter (3 months) and d_date between '1999-01-01' and '1999-03-31' group by ss_ticket_number, ss_customer_sk, ss_addr_sk, ca_city ) dn, customer, customer_address current_addr where ss_customer_sk = c_customer_sk and customer.c_current_addr_sk = current_addr.ca_address_sk and current_addr.ca_city <> bought_city order by c_last_name, ss_ticket_number limit 100; Coordinator: redacted-host6:22000 Query Options (non default): ABORT_ON_ERROR=1,MEM_LIMIT=314572800,RUNTIME_FILTER_MODE=0 Plan: ---------------- Per-Host Resource Reservation: Memory=808.00MB Per-Host Resource Estimates: Memory=365.72MB F10:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1 PLAN-ROOT SINK | mem-estimate=0B mem-reservation=0B | 25:MERGING-EXCHANGE [UNPARTITIONED] | order by: c_last_name ASC, ss_ticket_number ASC | limit: 100 | mem-estimate=0B mem-reservation=0B | tuple-ids=9 row-size=149B cardinality=100 | F00:PLAN FRAGMENT [RANDOM] hosts=8 instances=8 14:TOP-N [LIMIT=100] | order by: c_last_name ASC, ss_ticket_number ASC | mem-estimate=14.54KB mem-reservation=0B | tuple-ids=9 row-size=149B cardinality=100 | 13:HASH JOIN [INNER JOIN, BROADCAST] | hash predicates: current_addr.ca_address_sk = customer.c_current_addr_sk | other predicates: current_addr.ca_city != ca_city | mem-estimate=779.23KB mem-reservation=136.00MB | tuple-ids=8,7,5 row-size=189B cardinality=4643 | |--24:EXCHANGE [BROADCAST] | | mem-estimate=0B mem-reservation=0B | | tuple-ids=7,5 row-size=156B cardinality=4643 | | | F09:PLAN FRAGMENT [HASH(c_customer_sk)] hosts=8 instances=8 | 12:HASH JOIN [INNER JOIN, PARTITIONED] | | hash predicates: c_customer_sk = ss_customer_sk | | mem-estimate=10.17MB mem-reservation=136.00MB | | tuple-ids=7,5 row-size=156B cardinality=4643 | | | |--23:EXCHANGE [HASH(ss_customer_sk)] | | | mem-estimate=0B mem-reservation=0B | | | tuple-ids=5 row-size=97B cardinality=802159 | | | | | F08:PLAN FRAGMENT [HASH(ss_ticket_number,ss_customer_sk,ss_addr_sk,ca_city)] hosts=8 instances=8 | | 21:AGGREGATE [FINALIZE] | | | output: sum:merge(ss_ext_sales_price), sum:merge(ss_ext_list_price), sum:merge(ss_ext_tax) | | | group by: ss_ticket_number, ss_customer_sk, ss_addr_sk, ca_city | | | mem-estimate=81.36MB mem-reservation=264.00MB | | | tuple-ids=5 row-size=97B cardinality=802159 | | | | | 20:EXCHANGE [HASH(ss_ticket_number,ss_customer_sk,ss_addr_sk,ca_city)] | | | mem-estimate=0B mem-reservation=0B | | | tuple-ids=5 row-size=97B cardinality=802159 | | | | | F07:PLAN FRAGMENT [HASH(store_sales.ss_addr_sk)] hosts=8 instances=8 | | 09:AGGREGATE [STREAMING] | | | output: sum(ss_ext_sales_price), sum(ss_ext_list_price), sum(ss_ext_tax) | | | group by: ss_ticket_number, ss_customer_sk, ss_addr_sk, ca_city | | | mem-estimate=81.36MB mem-reservation=0B | | | tuple-ids=5 row-size=97B cardinality=802159 | | | | | 08:HASH JOIN [INNER JOIN, PARTITIONED] | | | hash predicates: store_sales.ss_addr_sk = customer_address.ca_address_sk | | | mem-estimate=10.71MB mem-reservation=136.00MB | | | tuple-ids=0,2,3,1,4 row-size=176B cardinality=802159 | | | | | |--19:EXCHANGE [HASH(customer_address.ca_address_sk)] | | | | mem-estimate=0B mem-reservation=0B | | | | tuple-ids=4 row-size=33B cardinality=2500000 | | | | | | | F06:PLAN FRAGMENT [RANDOM] hosts=8 instances=8 | | | 04:SCAN HDFS [tpcds_300_decimal_parquet.customer_address, RANDOM] | | | partitions=1/1 files=8 size=47.70MB | | | table stats: 2500000 rows total | | | column stats: all | | | mem-estimate=32.00MB mem-reservation=0B | | | tuple-ids=4 row-size=33B cardinality=2500000 | | | | | 18:EXCHANGE [HASH(store_sales.ss_addr_sk)] | | | mem-estimate=0B mem-reservation=0B | | | tuple-ids=0,2,3,1 row-size=143B cardinality=802159 | | | | | F02:PLAN FRAGMENT [RANDOM] hosts=8 instances=8 | | 07:HASH JOIN [INNER JOIN, BROADCAST] | | | hash predicates: store_sales.ss_sold_date_sk = date_dim.d_date_sk | | | mem-estimate=266.80KB mem-reservation=136.00MB | | | tuple-ids=0,2,3,1 row-size=143B cardinality=802159 | | | | | |--17:EXCHANGE [BROADCAST] | | | | mem-estimate=0B mem-reservation=0B | | | | tuple-ids=1 row-size=34B cardinality=7305 | | | | | | | F05:PLAN FRAGMENT [RANDOM] hosts=1 instances=1 | | | 01:SCAN HDFS [tpcds_300_decimal_parquet.date_dim, RANDOM] | | | partitions=1/1 files=1 size=2.15MB | | | predicates: tpcds_300_decimal_parquet.date_dim.d_date_sk <= 2451269, tpcds_300_decimal_parquet.date_dim.d_date_sk >= 2451180, d_date <= '1999-03-31', d_date >= '1999-01-01' | | | table stats: 73049 rows total | | | column stats: all | | | parquet statistics predicates: tpcds_300_decimal_parquet.date_dim.d_date_sk <= 2451269, tpcds_300_decimal_parquet.date_dim.d_date_sk >= 2451180, d_date <= '1999-03-31', d_date >= '1999-01-01' | | | parquet dictionary predicates: tpcds_300_decimal_parquet.date_dim.d_date_sk <= 2451269, tpcds_300_decimal_parquet.date_dim.d_date_sk >= 2451180, d_date <= '1999-03-31', d_date >= '1999-01-01' | | | mem-estimate=32.00MB mem-reservation=0B | | | tuple-ids=1 row-size=34B cardinality=7305 | | | | | 06:HASH JOIN [INNER JOIN, BROADCAST] | | | hash predicates: store_sales.ss_hdemo_sk = household_demographics.hd_demo_sk | | | mem-estimate=30.94KB mem-reservation=136.00MB | | | tuple-ids=0,2,3 row-size=109B cardinality=802159 | | | | | |--16:EXCHANGE [BROADCAST] | | | | mem-estimate=0B mem-reservation=0B | | | | tuple-ids=3 row-size=16B cardinality=1800 | | | | | | | F04:PLAN FRAGMENT [RANDOM] hosts=1 instances=1 | | | 03:SCAN HDFS [tpcds_300_decimal_parquet.household_demographics, RANDOM] | | | partitions=1/1 files=1 size=41.55KB | | | predicates: (household_demographics.hd_dep_count = 5 OR household_demographics.hd_vehicle_count = 3) | | | table stats: 7200 rows total | | | column stats: all | | | mem-estimate=48.00MB mem-reservation=0B | | | tuple-ids=3 row-size=16B cardinality=1800 | | | | | 05:HASH JOIN [INNER JOIN, BROADCAST] | | | hash predicates: store_sales.ss_store_sk = store.s_store_sk | | | mem-estimate=1.84KB mem-reservation=136.00MB | | | tuple-ids=0,2 row-size=93B cardinality=3208636 | | | | | |--15:EXCHANGE [BROADCAST] | | | | mem-estimate=0B mem-reservation=0B | | | | tuple-ids=2 row-size=33B cardinality=52 | | | | | | | F03:PLAN FRAGMENT [RANDOM] hosts=1 instances=1 | | | 02:SCAN HDFS [tpcds_300_decimal_parquet.store, RANDOM] | | | partitions=1/1 files=1 size=73.73KB | | | predicates: store.s_city IN ('Midway', 'Fairview') | | | table stats: 804 rows total | | | column stats: all | | | parquet statistics predicates: store.s_city IN ('Midway', 'Fairview') | | | parquet dictionary predicates: store.s_city IN ('Midway', 'Fairview') | | | mem-estimate=32.00MB mem-reservation=0B | | | tuple-ids=2 row-size=33B cardinality=52 | | | | | 00:SCAN HDFS [tpcds_300_decimal_parquet.store_sales, RANDOM] | | partitions=89/1824 files=89 size=1.14GB | | table stats: 864001869 rows total | | column stats: all | | mem-estimate=192.00MB mem-reservation=0B | | tuple-ids=0 row-size=60B cardinality=24805221 | | | 22:EXCHANGE [HASH(c_customer_sk)] | | mem-estimate=0B mem-reservation=0B | | tuple-ids=7 row-size=60B cardinality=5000000 | | | F01:PLAN FRAGMENT [RANDOM] hosts=8 instances=8 | 10:SCAN HDFS [tpcds_300_decimal_parquet.customer, RANDOM] | partitions=1/1 files=8 size=266.73MB | table stats: 5000000 rows total | column stats: all | mem-estimate=192.00MB mem-reservation=0B | tuple-ids=7 row-size=60B cardinality=5000000 | 11:SCAN HDFS [tpcds_300_decimal_parquet.customer_address current_addr, RANDOM] partitions=1/1 files=8 size=47.70MB table stats: 2500000 rows total column stats: all mem-estimate=32.00MB mem-reservation=0B tuple-ids=8 row-size=33B cardinality=2500000 ---------------- Estimated Per-Host Mem: 383489020 Per-Host Memory Reservation: 847249408 Request Pool: redacted Admission result: Admitted immediately ExecSummary: Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail ------------------------------------------------------------------------------------------------------------------------------------ 25:MERGING-EXCHANGE 1 1.267ms 1.267ms 100 100 0 0 UNPARTITIONED 14:TOP-N 7 276.408ms 516.676ms 700 100 2.62 MB 14.54 KB 13:HASH JOIN 7 727.081ms 1s544ms 27.83K 4.64K 11.37 MB 779.23 KB INNER JOIN, BROADCAST |--24:EXCHANGE 7 42.220ms 78.747ms 28.05K 4.64K 0 0 BROADCAST | 12:HASH JOIN 6 371.353ms 765.500ms 28.05K 4.64K 2.06 MB 10.17 MB INNER JOIN, PARTITIONED | |--23:EXCHANGE 6 14.994ms 70.869ms 28.94K 802.16K 0 0 HASH(ss_customer_sk) | | 21:AGGREGATE 8 571.141ms 2s047ms 28.94K 802.16K 2.67 MB 81.36 MB FINALIZE | | 20:EXCHANGE 8 2.351ms 8.942ms 28.94K 802.16K 0 0 HASH(ss_ticket_number,ss_cu... | | 09:AGGREGATE 8 445.488ms 1s488ms 28.94K 802.16K 1.89 MB 81.36 MB STREAMING | | 08:HASH JOIN 8 2s503ms 4s987ms 307.58K 802.16K 145.22 MB 10.71 MB INNER JOIN, PARTITIONED | | |--19:EXCHANGE 8 1s584ms 3s210ms 2.50M 2.50M 0 0 HASH(customer_address.ca_ad... | | | 04:SCAN HDFS 7 3s397ms 20s090ms 2.50M 2.50M 8.12 MB 32.00 MB tpcds_300_decimal_parquet.c... | | 18:EXCHANGE 8 450.027ms 2s398ms 309.42K 802.16K 0 0 HASH(store_sales.ss_addr_sk) | | 07:HASH JOIN 8 190.655ms 896.168ms 309.42K 802.16K 8.33 MB 266.80 KB INNER JOIN, BROADCAST | | |--17:EXCHANGE 8 2.694ms 21.113ms 90 7.30K 0 0 BROADCAST | | | 01:SCAN HDFS 1 2m36s 2m36s 90 7.30K 4.22 MB 32.00 MB tpcds_300_decimal_parquet.d... | | 06:HASH JOIN 8 120.423ms 340.642ms 309.42K 802.16K 4.36 MB 30.94 KB INNER JOIN, BROADCAST | | |--16:EXCHANGE 8 697.420us 2.455ms 1.80K 1.80K 0 0 BROADCAST | | | 03:SCAN HDFS 1 3s134ms 3s134ms 1.80K 1.80K 379.21 KB 48.00 MB tpcds_300_decimal_parquet.h... | | 05:HASH JOIN 8 377.919ms 480.362ms 1.26M 3.21M 2.96 MB 1.84 KB INNER JOIN, BROADCAST | | |--15:EXCHANGE 8 43.272us 59.414us 49 52 0 0 BROADCAST | | | 02:SCAN HDFS 1 2m14s 2m14s 49 52 148.03 KB 32.00 MB tpcds_300_decimal_parquet.s... | | 00:SCAN HDFS 8 34s359ms 2m29s 24.81M 24.81M 40.21 MB 192.00 MB tpcds_300_decimal_parquet.s... | 22:EXCHANGE 6 860.720ms 1s281ms 5.01M 5.00M 0 0 HASH(c_customer_sk) | 10:SCAN HDFS 6 7s881ms 41s393ms 5.00M 5.00M 22.76 MB 192.00 MB tpcds_300_decimal_parquet.c... 11:SCAN HDFS 7 3s153ms 5s670ms 2.50M 2.50M 3.95 MB 32.00 MB tpcds_300_decimal_parquet.c... Errors: - ComputeScanRangeAssignmentTimer: 429336499 - InactiveTotalTime: 0 - TotalTime: 0 Planner Timeline Analysis finished: 1028156172 Equivalence classes computed: 1028968482 Single node plan created: 3069088646 Distributed plan created: 3168508727 Lineage info computed: 3168765011 Planning finished: 3180230497 Query Timeline Query submitted: 122628898 Planning finished: 3561603310 Submit for admission: 4627764395 Completed admission: 4764469866 Ready to start on 8 backends: 6256257533 All 8 execution backends (54 fragment instances) started: 8427522624 Rows available: 348767868558 First row fetched: 348873214470 Unregister query: 349505052951 ImpalaServer - ClientFetchWaitTimer: 356414652 - InactiveTotalTime: 0 - RowMaterializationTimer: 343677481 - TotalTime: 0 Execution Profile b4afd338536090b:47bd038400000000 Backend startup latencies: Count: 8, min / max: 83ms / 1s968ms, 25th %-ile: 94ms, 50th %-ile: 204ms, 75th %-ile: 393ms, 90th %-ile: 490ms, 95th %-ile: 1s968ms, 99.9th %-ile: 1s968ms Per Node Peak Memory Usage: redacted-host1:22000(222.40 MB) redacted-host2:22000(222.29 MB) redacted-host3:22000(243.38 MB) redacted-host4:22000(183.95 MB) redacted-host5:22000(180.75 MB) redacted-host6:22000(222.27 MB) redacted-host7:22000(223.91 MB) redacted-host8:22000(215.29 MB) - FiltersReceived: 0 - FinalizationTimer: 0 - InactiveTotalTime: 0 - TotalTime: 344179536066 Averaged Fragment F10 split sizes: min: 0, max: 0, avg: 0, stddev: 0 completion times: min:5m42s max:5m42s mean: 5m42s stddev:0.000ns execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec num instances: 1 - AverageThreadTokens: 0.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 294400 - PerHostPeakMemUsage: 233069701 - RowsProduced: 100 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 105 - TotalThreadsTotalWallClockTime: 341719217096 - TotalThreadsSysTime: 1000000 - TotalThreadsUserTime: 97985000 - TotalThreadsVoluntaryContextSwitches: 79 - TotalTime: 342363639300 Fragment Instance Lifecycle Timings - ExecTime: 155254696 - ExecTreeExecTime: 1173489 - InactiveTotalTime: 0 - OpenTime: 341563977100 - ExecTreeOpenTime: 341054996390 - PrepareTime: 644295129 - ExecTreePrepareTime: 116100 - TotalTime: 0 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 140 - BlocksRecycled: 81 - BufferedPins: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 209715200 - PeakMemoryUsage: 143479312 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 - ScratchWrites: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 PLAN_ROOT_SINK - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - TotalTime: 0 CodeGen - CodegenTime: 1548260 - CompileTime: 161463194 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076168 - NumFunctions: 28 - NumInstructions: 559 - OptimizationTime: 288325838 - PeakMemoryUsage: 286208 - PrepareTime: 627419485 - TotalTime: 1078721515 EXCHANGE_NODE (id=25) - BytesReceived: 49158 - ConvertRowBatchTime: 0 - DeserializeRowBatchTimer: 600354 - FirstBatchArrivalWaitTime: 341054894698 - InactiveTotalTime: 0 - MergeGetNext: 1165959 - MergeGetNextBatch: 39607 - PeakMemoryUsage: 0 - RowsReturned: 100 - RowsReturnedRate: 0 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 341056162776 Coordinator Fragment F10 Instance b4afd338536090b:47bd038400000000 (host=redacted-host6:22000) - AverageThreadTokens: 0.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 294400 - PerHostPeakMemUsage: 233069701 - RowsProduced: 100 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 105 - TotalThreadsTotalWallClockTime: 341719217096 - TotalThreadsSysTime: 1000000 - TotalThreadsUserTime: 97985000 - TotalThreadsVoluntaryContextSwitches: 79 - TotalTime: 342363639300 Fragment Instance Lifecycle Timings - ExecTime: 155254696 - ExecTreeExecTime: 1173489 - InactiveTotalTime: 0 - OpenTime: 341563977100 - ExecTreeOpenTime: 341054996390 - PrepareTime: 644295129 - ExecTreePrepareTime: 116100 - TotalTime: 0 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 140 - BlocksRecycled: 81 - BufferedPins: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 209715200 - PeakMemoryUsage: 143479312 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 - ScratchWrites: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 PLAN_ROOT_SINK - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - TotalTime: 0 CodeGen - CodegenTime: 1548260 - CompileTime: 161463194 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076168 - NumFunctions: 28 - NumInstructions: 559 - OptimizationTime: 288325838 - PeakMemoryUsage: 286208 - PrepareTime: 627419485 - TotalTime: 1078721515 EXCHANGE_NODE (id=25) ExecOption: Codegen Enabled - BytesReceived: 49158 - ConvertRowBatchTime: 0 - DeserializeRowBatchTimer: 600354 - FirstBatchArrivalWaitTime: 341054894698 - InactiveTotalTime: 341054895542 - MergeGetNext: 1165959 - MergeGetNextBatch: 39607 - PeakMemoryUsage: 0 - RowsReturned: 100 - RowsReturnedRate: 0 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 341056162776 Averaged Fragment F00 split sizes: min: 5.88 MB, max: 11.77 MB, avg: 6.81 MB, stddev: 2.02 MB completion times: min:5m37s max:5m42s mean: 5m39s stddev:1s591ms execution rates: min:17.74 KB/sec max:35.40 KB/sec mean:20.55 KB/sec stddev:6.06 KB/sec num instances: 7 - AverageThreadTokens: 1.009560559996767 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 17449618 - PerHostPeakMemUsage: 229711588 - RowsProduced: 100 - TotalNetworkReceiveTime: 329934239755 - TotalNetworkSendTime: 1573728 - TotalStorageWaitTime: 1972502790 - TotalThreadsInvoluntaryContextSwitches: 1130 - TotalThreadsTotalWallClockTime: 341777557928 - TotalThreadsSysTime: 40421714 - TotalThreadsUserTime: 1117687000 - TotalThreadsVoluntaryContextSwitches: 1034 - TotalTime: 339235718411 Fragment Instance Lifecycle Timings - ExecTime: 5505622 - ExecTreeExecTime: 63486 - InactiveTotalTime: 0 - OpenTime: 338561825666 - ExecTreeOpenTime: 334009650072 - PrepareTime: 654127245 - ExecTreePrepareTime: 89815356 - TotalTime: 0 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 140 - BlocksRecycled: 72 - BufferedPins: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 209715200 - PeakMemoryUsage: 143479312 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 - ScratchWrites: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 DataStreamSender (dst_id=25) - BytesSent: 7022 - InactiveTotalTime: 0 - NetworkThroughput(*): 142754088 - OverallThroughput: 9669241 - PeakMemoryUsage: 1080 - RowsReturned: 100 - SerializeBatchTime: 3106867 - TotalTime: 3214040 - TransmitDataRPCTime: 50012 - UncompressedRowBatchSize: 14556 CodeGen - CodegenTime: 9143362 - CompileTime: 1158260822 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076168 - NumFunctions: 145 - NumInstructions: 4511 - OptimizationTime: 3332694129 - PeakMemoryUsage: 2309632 - PrepareTime: 446653524 - TotalTime: 4953442280 SORT_NODE (id=14) - InactiveTotalTime: 0 - InsertBatchTime: 4266557 - PeakMemoryUsage: 2467261 - RowsReturned: 100 - RowsReturnedRate: 0 - TotalTime: 334099521173 HASH_JOIN_NODE (id=13) - BuildRows: 28052 - BuildTime: 359418968 - InactiveTotalTime: 0 - LocalTime: 727081573 - NumHashTableBuildsSkipped: 0 - PeakMemoryUsage: 11917618 - ProbeRows: 357142 - ProbeRowsPartitioned: 0 - ProbeTime: 48477913 - RowsReturned: 3976 - RowsReturnedRate: 11 - TotalTime: 333823112174 Hash Join Builder (join_node_id=13) - BuildRowsPartitionTime: 161734234 - BuildRowsPartitioned: 28052 - GetNewBlockTime: 164575588 - HashBuckets: 65536 - HashCollisions: 0 - HashTablesBuildTime: 135629123 - InactiveTotalTime: 0 - LargestPartitionPercent: 6 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 11564160 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=24) - BytesReceived: 2516566 - ConvertRowBatchTime: 7874102 - DeserializeRowBatchTimer: 240961853 - FirstBatchArrivalWaitTime: 310430833018 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 28052 - RowsReturnedRate: 84 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 329942873504 HDFS_SCAN_NODE (id=11) - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 1.0 - BytesRead: 2098519 - BytesReadDataNodeCache: 0 - BytesReadLocal: 2098519 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 2098519 - DecompressionTime: 33232346 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 1 - NumRowGroups: 1 - NumScannerThreadsStarted: 1 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 3556274 - PerReadThreadRawHdfsThroughput: 1025945468 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 3120975768 - RowBatchQueuePutWaitTime: 0 - RowsRead: 357142 - RowsReturned: 357142 - RowsReturnedRate: 140523 - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 473 - ScannerThreadsTotalWallClockTime: 3210502528 - MaterializeTupleTime(*): 360921485 - ScannerThreadsSysTime: 7426857 - ScannerThreadsUserTime: 182686285 - ScannerThreadsVoluntaryContextSwitches: 42 - TotalRawHdfsReadTime(*): 3628663 - TotalReadThroughput: 6374 - TotalTime: 3153157096 Fragment F00 Instance b4afd338536090b:47bd03840000002f (host=redacted-host6:22000) Hdfs split stats (:<# splits>/): 6:1/6.04 MB - AverageThreadTokens: 1.0163204747774481 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 17193053 - PerHostPeakMemUsage: 233069701 - RowsProduced: 100 - TotalNetworkReceiveTime: 331593095678 - TotalNetworkSendTime: 949252 - TotalStorageWaitTime: 4358179344 - TotalThreadsInvoluntaryContextSwitches: 1065 - TotalThreadsTotalWallClockTime: 347215260671 - TotalThreadsSysTime: 31994000 - TotalThreadsUserTime: 1108832000 - TotalThreadsVoluntaryContextSwitches: 853 - TotalTime: 342176683783 Fragment Instance Lifecycle Timings - ExecTime: 10386634 - ExecTreeExecTime: 56738 - InactiveTotalTime: 0 - OpenTime: 341501702326 - ExecTreeOpenTime: 338191551833 - PrepareTime: 664472859 - ExecTreePrepareTime: 19628190 - TotalTime: 0 DataStreamSender (dst_id=25) - BytesSent: 7080 - InactiveTotalTime: 0 - NetworkThroughput(*): 136682175 - OverallThroughput: 768433 - PeakMemoryUsage: 1080 - RowsReturned: 100 - SerializeBatchTime: 9132611 - TotalTime: 9213548 - TransmitDataRPCTime: 51799 - UncompressedRowBatchSize: 14558 CodeGen - CodegenTime: 5150246 - CompileTime: 768679774 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076168 - NumFunctions: 145 - NumInstructions: 4511 - OptimizationTime: 2429041434 - PeakMemoryUsage: 2309632 - PrepareTime: 490258783 - TotalTime: 3714659402 SORT_NODE (id=14) ExecOption: Codegen Enabled - InactiveTotalTime: 0 - InsertBatchTime: 1949814 - PeakMemoryUsage: 2434048 - RowsReturned: 100 - RowsReturnedRate: 0 - TotalTime: 338211228640 HASH_JOIN_NODE (id=13) ExecOption: Probe Side Codegen Enabled - BuildRows: 28052 - BuildTime: 233519663 - InactiveTotalTime: 0 - LocalTime: 476132886 - NumHashTableBuildsSkipped: 0 - PeakMemoryUsage: 11917636 - ProbeRows: 316666 - ProbeRowsPartitioned: 0 - ProbeTime: 40911246 - RowsReturned: 3613 - RowsReturnedRate: 10 - TotalTime: 337746844633 Hash Join Builder (join_node_id=13) ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 57416825 - BuildRowsPartitioned: 28052 - GetNewBlockTime: 117420583 - HashBuckets: 65536 - HashCollisions: 0 - HashTablesBuildTime: 58165413 - InactiveTotalTime: 0 - LargestPartitionPercent: 6 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 11564160 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=24) - BytesReceived: 2516566 - ConvertRowBatchTime: 6696053 - DeserializeRowBatchTimer: 226194557 - FirstBatchArrivalWaitTime: 312004231266 - InactiveTotalTime: 331591365513 - PeakMemoryUsage: 0 - RowsReturned: 28052 - RowsReturnedRate: 84 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 331600517035 HDFS_SCAN_NODE (id=11) Hdfs split stats (:<# splits>/): 6:1/6.04 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:2 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 1.0 - BytesRead: 1857986 - BytesReadDataNodeCache: 0 - BytesReadLocal: 1857986 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1857986 - DecompressionTime: 35756980 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 1 - NumRowGroups: 1 - NumScannerThreadsStarted: 1 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 3366970 - PerReadThreadRawHdfsThroughput: 160738044 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 5646668364 - RowBatchQueuePutWaitTime: 0 - RowsRead: 316666 - RowsReturned: 316666 - RowsReturnedRate: 55847 - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 411 - ScannerThreadsTotalWallClockTime: 5703222073 - MaterializeTupleTime(*): 303178984 - ScannerThreadsSysTime: 2999000 - ScannerThreadsUserTime: 160976000 - ScannerThreadsVoluntaryContextSwitches: 26 - TotalRawHdfsReadTime(*): 11559093 - TotalReadThroughput: 5520 - TotalTime: 5670194712 Instance b4afd338536090b:47bd038400000035 (host=redacted-host4:22000) Hdfs split stats (:<# splits>/): 7:1/5.89 MB 6:1/5.89 MB - AverageThreadTokens: 1.0119047619047619 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 18206788 - PerHostPeakMemUsage: 192884167 - RowsProduced: 100 - TotalNetworkReceiveTime: 331619185989 - TotalNetworkSendTime: 2299584 - TotalStorageWaitTime: 2434681104 - TotalThreadsInvoluntaryContextSwitches: 1492 - TotalThreadsTotalWallClockTime: 344010079664 - TotalThreadsSysTime: 29994000 - TotalThreadsUserTime: 1260807000 - TotalThreadsVoluntaryContextSwitches: 1202 - TotalTime: 340474340094 Fragment Instance Lifecycle Timings - ExecTime: 2906660 - ExecTreeExecTime: 51066 - InactiveTotalTime: 0 - OpenTime: 340121116881 - ExecTreeOpenTime: 336293811502 - PrepareTime: 350210589 - ExecTreePrepareTime: 829441 - TotalTime: 0 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 140 - BlocksRecycled: 52 - BufferedPins: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 209715200 - PeakMemoryUsage: 143479312 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 - ScratchWrites: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 DataStreamSender (dst_id=25) - BytesSent: 6950 - InactiveTotalTime: 0 - NetworkThroughput(*): 139236702 - OverallThroughput: 19688608 - PeakMemoryUsage: 1080 - RowsReturned: 100 - SerializeBatchTime: 270346 - TotalTime: 352996 - TransmitDataRPCTime: 49915 - UncompressedRowBatchSize: 14584 CodeGen - CodegenTime: 5841074 - CompileTime: 1209512846 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076168 - NumFunctions: 145 - NumInstructions: 4511 - OptimizationTime: 2601192180 - PeakMemoryUsage: 2309632 - PrepareTime: 209840441 - TotalTime: 4030893732 SORT_NODE (id=14) ExecOption: Codegen Enabled - InactiveTotalTime: 0 - InsertBatchTime: 3224596 - PeakMemoryUsage: 2747435 - RowsReturned: 100 - RowsReturnedRate: 0 - TotalTime: 336294684443 HASH_JOIN_NODE (id=13) ExecOption: Probe Side Codegen Enabled - BuildRows: 28052 - BuildTime: 218779248 - InactiveTotalTime: 0 - LocalTime: 403484930 - NumHashTableBuildsSkipped: 0 - PeakMemoryUsage: 11917625 - ProbeRows: 616667 - ProbeRowsPartitioned: 0 - ProbeTime: 89662447 - RowsReturned: 6731 - RowsReturnedRate: 20 - TotalTime: 335778008381 Hash Join Builder (join_node_id=13) ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 56689444 - BuildRowsPartitioned: 28052 - GetNewBlockTime: 871353 - HashBuckets: 65536 - HashCollisions: 0 - HashTablesBuildTime: 161093324 - InactiveTotalTime: 0 - LargestPartitionPercent: 6 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 11564160 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=24) - BytesReceived: 2516566 - ConvertRowBatchTime: 6332187 - DeserializeRowBatchTimer: 214384059 - FirstBatchArrivalWaitTime: 311820282344 - InactiveTotalTime: 331547456367 - PeakMemoryUsage: 0 - RowsReturned: 28052 - RowsReturnedRate: 84 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 331626203810 HDFS_SCAN_NODE (id=11) Hdfs split stats (:<# splits>/): 7:1/5.89 MB 6:1/5.89 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 2 out of 2 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:4 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 1.0 - BytesRead: 3628278 - BytesReadDataNodeCache: 0 - BytesReadLocal: 3628278 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 3628278 - DecompressionTime: 32381801 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 2 - NumRowGroups: 2 - NumScannerThreadsStarted: 1 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 4144161 - PerReadThreadRawHdfsThroughput: 1393039788 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 3727222321 - RowBatchQueuePutWaitTime: 0 - RowsRead: 616667 - RowsReturned: 616667 - RowsReturnedRate: 164518 - ScanRangesComplete: 2 - ScannerThreadsInvoluntaryContextSwitches: 807 - ScannerThreadsTotalWallClockTime: 3886102619 - MaterializeTupleTime(*): 591328693 - ScannerThreadsSysTime: 7998000 - ScannerThreadsUserTime: 322950000 - ScannerThreadsVoluntaryContextSwitches: 49 - TotalRawHdfsReadTime(*): 2604576 - TotalReadThroughput: 10812 - TotalTime: 3748319641 Instance b4afd338536090b:47bd038400000032 (host=redacted-host7:22000) Hdfs split stats (:<# splits>/): 9:1/5.89 MB - AverageThreadTokens: 1.0119581464872944 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 17166432 - PerHostPeakMemUsage: 234788716 - RowsProduced: 100 - TotalNetworkReceiveTime: 331507201833 - TotalNetworkSendTime: 375561 - TotalStorageWaitTime: 2549639577 - TotalThreadsInvoluntaryContextSwitches: 1058 - TotalThreadsTotalWallClockTime: 343037353939 - TotalThreadsSysTime: 27995000 - TotalThreadsUserTime: 1048840000 - TotalThreadsVoluntaryContextSwitches: 866 - TotalTime: 339732465056 Fragment Instance Lifecycle Timings - ExecTime: 963008 - ExecTreeExecTime: 77093 - InactiveTotalTime: 0 - OpenTime: 339219039693 - ExecTreeOpenTime: 335786051308 - PrepareTime: 510910580 - ExecTreePrepareTime: 16208439 - TotalTime: 0 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 140 - BlocksRecycled: 81 - BufferedPins: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 209715200 - PeakMemoryUsage: 143479312 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 - ScratchWrites: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 DataStreamSender (dst_id=25) - BytesSent: 7011 - InactiveTotalTime: 0 - NetworkThroughput(*): 119175916 - OverallThroughput: 20907762 - PeakMemoryUsage: 1080 - RowsReturned: 100 - SerializeBatchTime: 235851 - TotalTime: 335330 - TransmitDataRPCTime: 58829 - UncompressedRowBatchSize: 14545 CodeGen - CodegenTime: 8702281 - CompileTime: 597303844 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076168 - NumFunctions: 145 - NumInstructions: 4511 - OptimizationTime: 2776275732 - PeakMemoryUsage: 2309632 - PrepareTime: 391728907 - TotalTime: 3802963272 SORT_NODE (id=14) ExecOption: Codegen Enabled - InactiveTotalTime: 0 - InsertBatchTime: 1868393 - PeakMemoryUsage: 2415616 - RowsReturned: 100 - RowsReturnedRate: 0 - TotalTime: 335802328686 HASH_JOIN_NODE (id=13) ExecOption: Probe Side Codegen Enabled - BuildRows: 28052 - BuildTime: 231527047 - InactiveTotalTime: 0 - LocalTime: 352772800 - NumHashTableBuildsSkipped: 0 - PeakMemoryUsage: 11917639 - ProbeRows: 308333 - ProbeRowsPartitioned: 0 - ProbeTime: 40215781 - RowsReturned: 3481 - RowsReturnedRate: 10 - TotalTime: 335650637650 Hash Join Builder (join_node_id=13) ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 80297268 - BuildRowsPartitioned: 28052 - GetNewBlockTime: 55786124 - HashBuckets: 65536 - HashCollisions: 0 - HashTablesBuildTime: 119614725 - InactiveTotalTime: 0 - LargestPartitionPercent: 6 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 11564160 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=24) - BytesReceived: 2516566 - ConvertRowBatchTime: 13873435 - DeserializeRowBatchTimer: 226611740 - FirstBatchArrivalWaitTime: 311801034106 - InactiveTotalTime: 331471526332 - PeakMemoryUsage: 0 - RowsReturned: 28052 - RowsReturnedRate: 84 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 331521837646 HDFS_SCAN_NODE (id=11) Hdfs split stats (:<# splits>/): 9:1/5.89 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:2 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 1.0 - BytesRead: 1814616 - BytesReadDataNodeCache: 0 - BytesReadLocal: 1814616 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1814616 - DecompressionTime: 3579667 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 1 - NumRowGroups: 1 - NumScannerThreadsStarted: 1 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 3273789 - PerReadThreadRawHdfsThroughput: 1357254997 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 3759794352 - RowBatchQueuePutWaitTime: 0 - RowsRead: 308333 - RowsReturned: 308333 - RowsReturnedRate: 81655 - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 417 - ScannerThreadsTotalWallClockTime: 3817413596 - MaterializeTupleTime(*): 225002130 - ScannerThreadsSysTime: 999000 - ScannerThreadsUserTime: 159975000 - ScannerThreadsVoluntaryContextSwitches: 26 - TotalRawHdfsReadTime(*): 1336975 - TotalReadThroughput: 5423 - TotalTime: 3776027204 Instance b4afd338536090b:47bd038400000031 (host=redacted-host3:22000) Hdfs split stats (:<# splits>/): 9:1/6.04 MB - AverageThreadTokens: 1.0060331825037707 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 17657890 - PerHostPeakMemUsage: 255202640 - RowsProduced: 100 - TotalNetworkReceiveTime: 330944972703 - TotalNetworkSendTime: 1825126 - TotalStorageWaitTime: 1337762847 - TotalThreadsInvoluntaryContextSwitches: 1034 - TotalThreadsTotalWallClockTime: 340540075850 - TotalThreadsSysTime: 59990000 - TotalThreadsUserTime: 1043841000 - TotalThreadsVoluntaryContextSwitches: 922 - TotalTime: 338752012413 Fragment Instance Lifecycle Timings - ExecTime: 5386371 - ExecTreeExecTime: 60570 - InactiveTotalTime: 0 - OpenTime: 338117701211 - ExecTreeOpenTime: 334071235572 - PrepareTime: 628809258 - ExecTreePrepareTime: 640048 - TotalTime: 0 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 140 - BlocksRecycled: 78 - BufferedPins: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 209715200 - PeakMemoryUsage: 143479312 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 - ScratchWrites: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 DataStreamSender (dst_id=25) - BytesSent: 7022 - InactiveTotalTime: 0 - NetworkThroughput(*): 121933008 - OverallThroughput: 2138666 - PeakMemoryUsage: 1080 - RowsReturned: 100 - SerializeBatchTime: 3187264 - TotalTime: 3283354 - TransmitDataRPCTime: 57589 - UncompressedRowBatchSize: 14609 CodeGen - CodegenTime: 6783110 - CompileTime: 1043721223 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076168 - NumFunctions: 145 - NumInstructions: 4511 - OptimizationTime: 2980062639 - PeakMemoryUsage: 2309632 - PrepareTime: 434544146 - TotalTime: 4478649394 SORT_NODE (id=14) ExecOption: Codegen Enabled - InactiveTotalTime: 0 - InsertBatchTime: 15864891 - PeakMemoryUsage: 2459648 - RowsReturned: 100 - RowsReturnedRate: 0 - TotalTime: 334071929425 HASH_JOIN_NODE (id=13) ExecOption: Probe Side Codegen Enabled - BuildRows: 28052 - BuildTime: 227462106 - InactiveTotalTime: 0 - LocalTime: 458805198 - NumHashTableBuildsSkipped: 0 - PeakMemoryUsage: 11917577 - ProbeRows: 316667 - ProbeRowsPartitioned: 0 - ProbeTime: 46939741 - RowsReturned: 3454 - RowsReturnedRate: 10 - TotalTime: 333737148759 Hash Join Builder (join_node_id=13) ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 86380733 - BuildRowsPartitioned: 28052 - GetNewBlockTime: 43349733 - HashBuckets: 65536 - HashCollisions: 0 - HashTablesBuildTime: 119655820 - InactiveTotalTime: 0 - LargestPartitionPercent: 6 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 11564160 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=24) - BytesReceived: 2516566 - ConvertRowBatchTime: 6883873 - DeserializeRowBatchTimer: 276698858 - FirstBatchArrivalWaitTime: 311321410770 - InactiveTotalTime: 330901995609 - PeakMemoryUsage: 0 - RowsReturned: 28052 - RowsReturnedRate: 84 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 330952677996 HDFS_SCAN_NODE (id=11) Hdfs split stats (:<# splits>/): 9:1/6.04 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:2 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 1.0 - BytesRead: 1857941 - BytesReadDataNodeCache: 0 - BytesReadLocal: 1857941 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1857941 - DecompressionTime: 4670750 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 1 - NumRowGroups: 1 - NumScannerThreadsStarted: 1 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 3569663 - PerReadThreadRawHdfsThroughput: 331486134 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 2291118842 - RowBatchQueuePutWaitTime: 0 - RowsRead: 316667 - RowsReturned: 316667 - RowsReturnedRate: 136161 - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 423 - ScannerThreadsTotalWallClockTime: 2417102065 - MaterializeTupleTime(*): 546981179 - ScannerThreadsSysTime: 13997000 - ScannerThreadsUserTime: 167974000 - ScannerThreadsVoluntaryContextSwitches: 69 - TotalRawHdfsReadTime(*): 5604883 - TotalReadThroughput: 5612 - TotalTime: 2325665565 Instance b4afd338536090b:47bd038400000033 (host=redacted-host8:22000) Hdfs split stats (:<# splits>/): 10:1/5.88 MB - AverageThreadTokens: 1.0116666666666667 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 17193041 - PerHostPeakMemUsage: 225744219 - RowsProduced: 100 - TotalNetworkReceiveTime: 322228225717 - TotalNetworkSendTime: 1152097 - TotalStorageWaitTime: 2022067729 - TotalThreadsInvoluntaryContextSwitches: 1007 - TotalThreadsTotalWallClockTime: 340797492401 - TotalThreadsSysTime: 40994000 - TotalThreadsUserTime: 1269807000 - TotalThreadsVoluntaryContextSwitches: 1571 - TotalTime: 338422441628 Fragment Instance Lifecycle Timings - ExecTime: 6153703 - ExecTreeExecTime: 55688 - InactiveTotalTime: 0 - OpenTime: 337080627056 - ExecTreeOpenTime: 326910095729 - PrepareTime: 1238134489 - ExecTreePrepareTime: 496716985 - TotalTime: 0 DataStreamSender (dst_id=25) - BytesSent: 7008 - InactiveTotalTime: 0 - NetworkThroughput(*): 151115902 - OverallThroughput: 1445532 - PeakMemoryUsage: 1080 - RowsReturned: 100 - SerializeBatchTime: 4621161 - TotalTime: 4848040 - TransmitDataRPCTime: 46375 - UncompressedRowBatchSize: 14529 CodeGen - CodegenTime: 5823874 - CompileTime: 2624624418 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076168 - NumFunctions: 145 - NumInstructions: 4511 - OptimizationTime: 7384944086 - PeakMemoryUsage: 2309632 - PrepareTime: 700499240 - TotalTime: 10711287419 SORT_NODE (id=14) ExecOption: Codegen Enabled - InactiveTotalTime: 0 - InsertBatchTime: 1847091 - PeakMemoryUsage: 2434048 - RowsReturned: 100 - RowsReturnedRate: 0 - TotalTime: 327406860118 HASH_JOIN_NODE (id=13) ExecOption: Probe Side Codegen Enabled - BuildRows: 28052 - BuildTime: 356011742 - InactiveTotalTime: 0 - LocalTime: 1237223513 - NumHashTableBuildsSkipped: 0 - PeakMemoryUsage: 11917624 - ProbeRows: 308334 - ProbeRowsPartitioned: 0 - ProbeTime: 40848643 - RowsReturned: 3428 - RowsReturnedRate: 10 - TotalTime: 327171043715 Hash Join Builder (join_node_id=13) ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 102166754 - BuildRowsPartitioned: 28052 - GetNewBlockTime: 57239968 - HashBuckets: 65536 - HashCollisions: 0 - HashTablesBuildTime: 235215578 - InactiveTotalTime: 0 - LargestPartitionPercent: 6 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 11564160 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=24) - BytesReceived: 2516566 - ConvertRowBatchTime: 6432313 - DeserializeRowBatchTimer: 148377220 - FirstBatchArrivalWaitTime: 302478132726 - InactiveTotalTime: 322203252776 - PeakMemoryUsage: 0 - RowsReturned: 28052 - RowsReturnedRate: 87 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 322235405806 HDFS_SCAN_NODE (id=11) Hdfs split stats (:<# splits>/): 10:1/5.88 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:2 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 1.0 - BytesRead: 1814021 - BytesReadDataNodeCache: 0 - BytesReadLocal: 1814021 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1814021 - DecompressionTime: 10003578 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 1 - NumRowGroups: 1 - NumScannerThreadsStarted: 1 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 3315837 - PerReadThreadRawHdfsThroughput: 1496246641 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 3646879378 - RowBatchQueuePutWaitTime: 0 - RowsRead: 308334 - RowsReturned: 308334 - RowsReturnedRate: 83369 - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 435 - ScannerThreadsTotalWallClockTime: 3710790829 - MaterializeTupleTime(*): 319839272 - ScannerThreadsSysTime: 5999000 - ScannerThreadsUserTime: 157976000 - ScannerThreadsVoluntaryContextSwitches: 40 - TotalRawHdfsReadTime(*): 1212381 - TotalReadThroughput: 6054 - TotalTime: 3698414396 Instance b4afd338536090b:47bd038400000030 (host=redacted-host1:22000) Hdfs split stats (:<# splits>/): 8:1/6.04 MB - AverageThreadTokens: 1.0060240963855422 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 17233984 - PerHostPeakMemUsage: 233205973 - RowsProduced: 100 - TotalNetworkReceiveTime: 331111313081 - TotalNetworkSendTime: 577538 - TotalStorageWaitTime: 688601296 - TotalThreadsInvoluntaryContextSwitches: 1154 - TotalThreadsTotalWallClockTime: 339047585828 - TotalThreadsSysTime: 43993000 - TotalThreadsUserTime: 1055839000 - TotalThreadsVoluntaryContextSwitches: 909 - TotalTime: 337931244210 Fragment Instance Lifecycle Timings - ExecTime: 6410880 - ExecTreeExecTime: 94273 - InactiveTotalTime: 0 - OpenTime: 337301620331 - ExecTreeOpenTime: 333442540327 - PrepareTime: 623100858 - ExecTreePrepareTime: 50069688 - TotalTime: 0 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 140 - BlocksRecycled: 76 - BufferedPins: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 209715200 - PeakMemoryUsage: 143479312 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 - ScratchWrites: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 DataStreamSender (dst_id=25) - BytesSent: 7015 - InactiveTotalTime: 0 - NetworkThroughput(*): 177829040 - OverallThroughput: 1699024 - PeakMemoryUsage: 1080 - RowsReturned: 100 - SerializeBatchTime: 4048477 - TotalTime: 4128839 - TransmitDataRPCTime: 39448 - UncompressedRowBatchSize: 14529 CodeGen - CodegenTime: 28058266 - CompileTime: 1262481031 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076168 - NumFunctions: 145 - NumInstructions: 4511 - OptimizationTime: 2555542311 - PeakMemoryUsage: 2309632 - PrepareTime: 517177812 - TotalTime: 4348729302 SORT_NODE (id=14) ExecOption: Codegen Enabled - InactiveTotalTime: 0 - InsertBatchTime: 1893911 - PeakMemoryUsage: 2313216 - RowsReturned: 100 - RowsReturnedRate: 0 - TotalTime: 333492696472 HASH_JOIN_NODE (id=13) ExecOption: Probe Side Codegen Enabled - BuildRows: 28052 - BuildTime: 249385220 - InactiveTotalTime: 0 - LocalTime: 616435816 - NumHashTableBuildsSkipped: 0 - PeakMemoryUsage: 11917607 - ProbeRows: 316667 - ProbeRowsPartitioned: 0 - ProbeTime: 40956285 - RowsReturned: 3625 - RowsReturnedRate: 10 - TotalTime: 333445631929 Hash Join Builder (join_node_id=13) ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 59742937 - BuildRowsPartitioned: 28052 - GetNewBlockTime: 788394 - HashBuckets: 65536 - HashCollisions: 0 - HashTablesBuildTime: 188475573 - InactiveTotalTime: 0 - LargestPartitionPercent: 6 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 11564160 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=24) - BytesReceived: 2516566 - ConvertRowBatchTime: 7135184 - DeserializeRowBatchTimer: 161733131 - FirstBatchArrivalWaitTime: 311506582495 - InactiveTotalTime: 331077734846 - PeakMemoryUsage: 0 - RowsReturned: 28052 - RowsReturnedRate: 84 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 331119240736 HDFS_SCAN_NODE (id=11) Hdfs split stats (:<# splits>/): 8:1/6.04 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:2 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 1.0 - BytesRead: 1858062 - BytesReadDataNodeCache: 0 - BytesReadLocal: 1858062 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1858062 - DecompressionTime: 13654741 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 1 - NumRowGroups: 1 - NumScannerThreadsStarted: 1 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 3307680 - PerReadThreadRawHdfsThroughput: 1360006031 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 1680495107 - RowBatchQueuePutWaitTime: 0 - RowsRead: 316667 - RowsReturned: 316667 - RowsReturnedRate: 185190 - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 459 - ScannerThreadsTotalWallClockTime: 1741094515 - MaterializeTupleTime(*): 289362712 - ScannerThreadsSysTime: 12998000 - ScannerThreadsUserTime: 156976000 - ScannerThreadsVoluntaryContextSwitches: 40 - TotalRawHdfsReadTime(*): 1366216 - TotalReadThroughput: 5595 - TotalTime: 1709955377 Instance b4afd338536090b:47bd038400000034 (host=redacted-host2:22000) Hdfs split stats (:<# splits>/): 3:1/6.04 MB - AverageThreadTokens: 1.0030165912518854 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 17496144 - PerHostPeakMemUsage: 233085705 - RowsProduced: 100 - TotalNetworkReceiveTime: 330535683289 - TotalNetworkSendTime: 3836943 - TotalStorageWaitTime: 416587636 - TotalThreadsInvoluntaryContextSwitches: 1103 - TotalThreadsTotalWallClockTime: 337795057149 - TotalThreadsSysTime: 47992000 - TotalThreadsUserTime: 1035843000 - TotalThreadsVoluntaryContextSwitches: 919 - TotalTime: 337160841694 Fragment Instance Lifecycle Timings - ExecTime: 6332103 - ExecTreeExecTime: 48977 - InactiveTotalTime: 0 - OpenTime: 336590972164 - ExecTreeOpenTime: 333372264239 - PrepareTime: 563252088 - ExecTreePrepareTime: 44614705 - TotalTime: 0 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 140 - BlocksRecycled: 76 - BufferedPins: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 209715200 - PeakMemoryUsage: 143479312 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 - ScratchWrites: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 DataStreamSender (dst_id=25) - BytesSent: 7072 - InactiveTotalTime: 0 - NetworkThroughput(*): 153305874 - OverallThroughput: 21036662 - PeakMemoryUsage: 1080 - RowsReturned: 100 - SerializeBatchTime: 252364 - TotalTime: 336175 - TransmitDataRPCTime: 46130 - UncompressedRowBatchSize: 14544 CodeGen - CodegenTime: 3644686 - CompileTime: 601502621 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076168 - NumFunctions: 145 - NumInstructions: 4511 - OptimizationTime: 2601800527 - PeakMemoryUsage: 2309632 - PrepareTime: 382525342 - TotalTime: 3586913442 SORT_NODE (id=14) ExecOption: Codegen Enabled - InactiveTotalTime: 0 - InsertBatchTime: 3217209 - PeakMemoryUsage: 2466816 - RowsReturned: 100 - RowsReturnedRate: 0 - TotalTime: 333416920433 HASH_JOIN_NODE (id=13) ExecOption: Probe Side Codegen Enabled - BuildRows: 28052 - BuildTime: 999247751 - InactiveTotalTime: 0 - LocalTime: 1544715871 - NumHashTableBuildsSkipped: 0 - PeakMemoryUsage: 11917623 - ProbeRows: 316666 - ProbeRowsPartitioned: 0 - ProbeTime: 39811250 - RowsReturned: 3500 - RowsReturnedRate: 10 - TotalTime: 333232470152 Hash Join Builder (join_node_id=13) ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 689445679 - BuildRowsPartitioned: 28052 - GetNewBlockTime: 876572961 - HashBuckets: 65536 - HashCollisions: 0 - HashTablesBuildTime: 67183428 - InactiveTotalTime: 0 - LargestPartitionPercent: 6 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 11564160 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=24) - BytesReceived: 2516566 - ConvertRowBatchTime: 7765675 - DeserializeRowBatchTimer: 432733411 - FirstBatchArrivalWaitTime: 312084157422 - InactiveTotalTime: 330511241132 - PeakMemoryUsage: 0 - RowsReturned: 28052 - RowsReturnedRate: 84 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 330544231499 HDFS_SCAN_NODE (id=11) Hdfs split stats (:<# splits>/): 3:1/6.04 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:2 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 1.0 - BytesRead: 1858729 - BytesReadDataNodeCache: 0 - BytesReadLocal: 1858729 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1858729 - DecompressionTime: 132578906 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 1 - NumRowGroups: 1 - NumScannerThreadsStarted: 1 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 3915821 - PerReadThreadRawHdfsThroughput: 1082846641 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 1094652018 - RowBatchQueuePutWaitTime: 0 - RowsRead: 316666 - RowsReturned: 316666 - RowsReturnedRate: 276921 - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 362 - ScannerThreadsTotalWallClockTime: 1197792004 - MaterializeTupleTime(*): 250757426 - ScannerThreadsSysTime: 6998000 - ScannerThreadsUserTime: 151977000 - ScannerThreadsVoluntaryContextSwitches: 48 - TotalRawHdfsReadTime(*): 1716521 - TotalReadThroughput: 5605 - TotalTime: 1143522782 Averaged Fragment F09 split sizes: min: 0, max: 0, avg: 0, stddev: 0 completion times: min:5m34s max:5m36s mean: 5m35s stddev:608.858ms execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec num instances: 6 - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 21785726 - PerHostPeakMemUsage: 235849492 - RowsProduced: 4675 - TotalNetworkReceiveTime: 331107983693 - TotalNetworkSendTime: 85462260 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 473 - TotalThreadsTotalWallClockTime: 334519710243 - TotalThreadsSysTime: 90652833 - TotalThreadsUserTime: 778048500 - TotalThreadsVoluntaryContextSwitches: 1911 - TotalTime: 335402159050 Fragment Instance Lifecycle Timings - ExecTime: 19976698770 - ExecTreeExecTime: 19084749695 - InactiveTotalTime: 0 - OpenTime: 314543033556 - ExecTreeOpenTime: 312604190655 - PrepareTime: 882294911 - ExecTreePrepareTime: 53303246 - TotalTime: 0 DataStreamSender (dst_id=24) - BytesSent: 2935993 - InactiveTotalTime: 0 - NetworkThroughput(*): 201615734 - OverallThroughput: 30847776 - PeakMemoryUsage: 13216 - RowsReturned: 4675 - SerializeBatchTime: 165366128 - TotalTime: 185553136 - TransmitDataRPCTime: 20042648 - UncompressedRowBatchSize: 5434978 CodeGen - CodegenTime: 0 - CompileTime: 589874229 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076168 - NumFunctions: 54 - NumInstructions: 2406 - OptimizationTime: 1283024343 - PeakMemoryUsage: 1231872 - PrepareTime: 448836945 - TotalTime: 2352040962 HASH_JOIN_NODE (id=12) - BuildRows: 4823 - BuildTime: 70158637 - InactiveTotalTime: 0 - LocalTime: 371353507 - NumHashTableBuildsSkipped: 0 - PeakMemoryUsage: 1981242 - ProbeRows: 834892 - ProbeRowsPartitioned: 0 - ProbeTime: 173335608 - RowsReturned: 4675 - RowsReturnedRate: 13 - TotalTime: 331755407776 Hash Join Builder (join_node_id=12) - BuildRowsPartitionTime: 18249579 - BuildRowsPartitioned: 4823 - GetNewBlockTime: 19402821 - HashBuckets: 8192 - HashCollisions: 0 - HashTablesBuildTime: 30909237 - InactiveTotalTime: 0 - LargestPartitionPercent: 6 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 1878485 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=23) - BytesReceived: 259364 - ConvertRowBatchTime: 1244326 - DeserializeRowBatchTimer: 92528899 - FirstBatchArrivalWaitTime: 311960446875 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 4823 - RowsReturnedRate: 14 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 312523086174 EXCHANGE_NODE (id=22) - BytesReceived: 30365221 - ConvertRowBatchTime: 227659670 - DeserializeRowBatchTimer: 5080531802 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 834892 - RowsReturnedRate: 44328 - SendersBlockedTimer: 300209431438 - SendersBlockedTotalTimer(*): 1670817490111 - TotalTime: 18860968094 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 140 - BlocksRecycled: 70 - BufferedPins: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 209715200 - PeakMemoryUsage: 143479312 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 - ScratchWrites: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 Fragment F09 Instance b4afd338536090b:47bd03840000002a (host=redacted-host6:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 21923725 - PerHostPeakMemUsage: 233069701 - RowsProduced: 4663 - TotalNetworkReceiveTime: 332383072746 - TotalNetworkSendTime: 228503816 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 584 - TotalThreadsTotalWallClockTime: 335196755409 - TotalThreadsSysTime: 82987000 - TotalThreadsUserTime: 784881000 - TotalThreadsVoluntaryContextSwitches: 1863 - TotalTime: 335895412762 Fragment Instance Lifecycle Timings - ExecTime: 19992823165 - ExecTreeExecTime: 19235732940 - InactiveTotalTime: 0 - OpenTime: 315203949714 - ExecTreeOpenTime: 313752440915 - PrepareTime: 698463243 - ExecTreePrepareTime: 2402526 - TotalTime: 0 DataStreamSender (dst_id=24) - BytesSent: 2927890 - InactiveTotalTime: 0 - NetworkThroughput(*): 59115830 - OverallThroughput: 19086366 - PeakMemoryUsage: 13216 - RowsReturned: 4663 - SerializeBatchTime: 103805965 - TotalTime: 153402164 - TransmitDataRPCTime: 49528019 - UncompressedRowBatchSize: 5417069 CodeGen - CodegenTime: 0 - CompileTime: 318916944 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076168 - NumFunctions: 54 - NumInstructions: 2406 - OptimizationTime: 1035200209 - PeakMemoryUsage: 1231872 - PrepareTime: 424456092 - TotalTime: 1797500137 HASH_JOIN_NODE (id=12) ExecOption: Probe Side Codegen Enabled - BuildRows: 4657 - BuildTime: 131400847 - InactiveTotalTime: 0 - LocalTime: 314883461 - NumHashTableBuildsSkipped: 0 - PeakMemoryUsage: 2156032 - ProbeRows: 833793 - ProbeRowsPartitioned: 0 - ProbeTime: 155767064 - RowsReturned: 4663 - RowsReturnedRate: 14 - TotalTime: 332992656555 Hash Join Builder (join_node_id=12) ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 2513926 - BuildRowsPartitioned: 4657 - GetNewBlockTime: 32955828 - HashBuckets: 8192 - HashCollisions: 0 - HashTablesBuildTime: 95585786 - InactiveTotalTime: 0 - LargestPartitionPercent: 6 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 2053248 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=23) - BytesReceived: 251990 - ConvertRowBatchTime: 1104241 - DeserializeRowBatchTimer: 37687730 - FirstBatchArrivalWaitTime: 313050116498 - InactiveTotalTime: 313614899587 - PeakMemoryUsage: 0 - RowsReturned: 4657 - RowsReturnedRate: 14 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 313617064127 EXCHANGE_NODE (id=22) - BytesReceived: 30323755 - ConvertRowBatchTime: 250343015 - DeserializeRowBatchTimer: 4612294582 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 18321095109 - PeakMemoryUsage: 0 - RowsReturned: 833793 - RowsReturnedRate: 43744 - SendersBlockedTimer: 300219180858 - SendersBlockedTotalTimer(*): 1470678649918 - TotalTime: 19060708967 Instance b4afd338536090b:47bd03840000002d (host=redacted-host1:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 21647684 - PerHostPeakMemUsage: 233205973 - RowsProduced: 4632 - TotalNetworkReceiveTime: 332743612489 - TotalNetworkSendTime: 100271 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 430 - TotalThreadsTotalWallClockTime: 335293915084 - TotalThreadsSysTime: 37995000 - TotalThreadsUserTime: 792879000 - TotalThreadsVoluntaryContextSwitches: 1772 - TotalTime: 335885889031 Fragment Instance Lifecycle Timings - ExecTime: 20067213129 - ExecTreeExecTime: 19641559669 - InactiveTotalTime: 0 - OpenTime: 315226729312 - ExecTreeOpenTime: 313673798156 - PrepareTime: 591859434 - ExecTreePrepareTime: 374758 - TotalTime: 0 DataStreamSender (dst_id=24) - BytesSent: 2909837 - InactiveTotalTime: 0 - NetworkThroughput(*): 152372839 - OverallThroughput: 28079112 - PeakMemoryUsage: 13216 - RowsReturned: 4632 - SerializeBatchTime: 84470101 - TotalTime: 103629948 - TransmitDataRPCTime: 19096822 - UncompressedRowBatchSize: 5388747 CodeGen - CodegenTime: 0 - CompileTime: 490018136 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076168 - NumFunctions: 54 - NumInstructions: 2406 - OptimizationTime: 1011968414 - PeakMemoryUsage: 1231872 - PrepareTime: 387961072 - TotalTime: 1890812427 HASH_JOIN_NODE (id=12) ExecOption: Probe Side Codegen Enabled - BuildRows: 4617 - BuildTime: 60972532 - InactiveTotalTime: 0 - LocalTime: 318572835 - NumHashTableBuildsSkipped: 0 - PeakMemoryUsage: 1828295 - ProbeRows: 835858 - ProbeRowsPartitioned: 0 - ProbeTime: 173793611 - RowsReturned: 4632 - RowsReturnedRate: 13 - TotalTime: 333315909967 Hash Join Builder (join_node_id=12) ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 58193480 - BuildRowsPartitioned: 4617 - GetNewBlockTime: 133570 - HashBuckets: 8192 - HashCollisions: 0 - HashTablesBuildTime: 2397831 - InactiveTotalTime: 0 - LargestPartitionPercent: 6 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 1725568 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=23) - BytesReceived: 250136 - ConvertRowBatchTime: 1025181 - DeserializeRowBatchTimer: 71519275 - FirstBatchArrivalWaitTime: 313040972329 - InactiveTotalTime: 313603204877 - PeakMemoryUsage: 0 - RowsReturned: 4617 - RowsReturnedRate: 14 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 313611546029 EXCHANGE_NODE (id=22) - BytesReceived: 30400003 - ConvertRowBatchTime: 220998780 - DeserializeRowBatchTimer: 5456290467 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 18533683499 - PeakMemoryUsage: 0 - RowsReturned: 835858 - RowsReturnedRate: 43117 - SendersBlockedTimer: 300206150965 - SendersBlockedTotalTimer(*): 1770795686034 - TotalTime: 19385791103 Instance b4afd338536090b:47bd03840000002e (host=redacted-host3:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 21773853 - PerHostPeakMemUsage: 255202640 - RowsProduced: 4739 - TotalNetworkReceiveTime: 332193803643 - TotalNetworkSendTime: 85379278 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 546 - TotalThreadsTotalWallClockTime: 335113030204 - TotalThreadsSysTime: 65990000 - TotalThreadsUserTime: 763884000 - TotalThreadsVoluntaryContextSwitches: 1842 - TotalTime: 335859766617 Fragment Instance Lifecycle Timings - ExecTime: 20044220214 - ExecTreeExecTime: 19544589934 - InactiveTotalTime: 0 - OpenTime: 315068847301 - ExecTreeOpenTime: 313260871632 - PrepareTime: 746582276 - ExecTreePrepareTime: 10233830 - TotalTime: 0 DataStreamSender (dst_id=24) - BytesSent: 2977380 - InactiveTotalTime: 0 - NetworkThroughput(*): 212929789 - OverallThroughput: 41936084 - PeakMemoryUsage: 13216 - RowsReturned: 4739 - SerializeBatchTime: 56954004 - TotalTime: 70998045 - TransmitDataRPCTime: 13982919 - UncompressedRowBatchSize: 5509595 CodeGen - CodegenTime: 0 - CompileTime: 322202163 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076168 - NumFunctions: 54 - NumInstructions: 2406 - OptimizationTime: 1476336030 - PeakMemoryUsage: 1231872 - PrepareTime: 337285603 - TotalTime: 2141132240 HASH_JOIN_NODE (id=12) ExecOption: Probe Side Codegen Enabled - BuildRows: 4732 - BuildTime: 85506575 - InactiveTotalTime: 0 - LocalTime: 334857583 - NumHashTableBuildsSkipped: 0 - PeakMemoryUsage: 1959403 - ProbeRows: 834494 - ProbeRowsPartitioned: 0 - ProbeTime: 163776163 - RowsReturned: 4739 - RowsReturnedRate: 14 - TotalTime: 332825686109 Hash Join Builder (join_node_id=12) ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 11649992 - BuildRowsPartitioned: 4732 - GetNewBlockTime: 51848803 - HashBuckets: 8192 - HashCollisions: 0 - HashTablesBuildTime: 13987938 - InactiveTotalTime: 0 - LargestPartitionPercent: 7 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 1856640 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=23) - BytesReceived: 256549 - ConvertRowBatchTime: 1862796 - DeserializeRowBatchTimer: 229362334 - FirstBatchArrivalWaitTime: 312605542474 - InactiveTotalTime: 313103370599 - PeakMemoryUsage: 0 - RowsReturned: 4732 - RowsReturnedRate: 15 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 313174240016 EXCHANGE_NODE (id=22) - BytesReceived: 30352708 - ConvertRowBatchTime: 234098062 - DeserializeRowBatchTimer: 4228603450 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 18439781336 - PeakMemoryUsage: 0 - RowsReturned: 834494 - RowsReturnedRate: 43200 - SendersBlockedTimer: 300219800710 - SendersBlockedTotalTimer(*): 1770670314362 - TotalTime: 19316588510 Instance b4afd338536090b:47bd03840000002c (host=redacted-host2:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 21637391 - PerHostPeakMemUsage: 233085705 - RowsProduced: 4634 - TotalNetworkReceiveTime: 330147164487 - TotalNetworkSendTime: 25684876 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 524 - TotalThreadsTotalWallClockTime: 334677081643 - TotalThreadsSysTime: 279957000 - TotalThreadsUserTime: 766884000 - TotalThreadsVoluntaryContextSwitches: 1975 - TotalTime: 335452176114 Fragment Instance Lifecycle Timings - ExecTime: 19856658638 - ExecTreeExecTime: 17539828474 - InactiveTotalTime: 0 - OpenTime: 314820438797 - ExecTreeOpenTime: 313081424782 - PrepareTime: 774959369 - ExecTreePrepareTime: 4276174 - TotalTime: 0 DataStreamSender (dst_id=24) - BytesSent: 2912770 - InactiveTotalTime: 0 - NetworkThroughput(*): 236516788 - OverallThroughput: 4812055 - PeakMemoryUsage: 13216 - RowsReturned: 4634 - SerializeBatchTime: 592904100 - TotalTime: 605306849 - TransmitDataRPCTime: 12315278 - UncompressedRowBatchSize: 5387333 CodeGen - CodegenTime: 0 - CompileTime: 355233759 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076168 - NumFunctions: 54 - NumInstructions: 2406 - OptimizationTime: 1371245631 - PeakMemoryUsage: 1231872 - PrepareTime: 211319461 - TotalTime: 1981343441 HASH_JOIN_NODE (id=12) ExecOption: Probe Side Codegen Enabled - BuildRows: 4630 - BuildTime: 33018455 - InactiveTotalTime: 0 - LocalTime: 217138410 - NumHashTableBuildsSkipped: 0 - PeakMemoryUsage: 1828297 - ProbeRows: 836404 - ProbeRowsPartitioned: 0 - ProbeTime: 145361152 - RowsReturned: 4634 - RowsReturnedRate: 14 - TotalTime: 330625681342 Hash Join Builder (join_node_id=12) ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 19212609 - BuildRowsPartitioned: 4630 - GetNewBlockTime: 3888158 - HashBuckets: 8192 - HashCollisions: 0 - HashTablesBuildTime: 9639870 - InactiveTotalTime: 0 - LargestPartitionPercent: 6 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 1725568 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=23) - BytesReceived: 250348 - ConvertRowBatchTime: 1104446 - DeserializeRowBatchTimer: 69567230 - FirstBatchArrivalWaitTime: 312441408236 - InactiveTotalTime: 313044560830 - PeakMemoryUsage: 0 - RowsReturned: 4630 - RowsReturnedRate: 14 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 313046586402 EXCHANGE_NODE (id=22) - BytesReceived: 30416345 - ConvertRowBatchTime: 204243394 - DeserializeRowBatchTimer: 4946645937 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 16080031545 - PeakMemoryUsage: 0 - RowsReturned: 836404 - RowsReturnedRate: 48174 - SendersBlockedTimer: 300220685512 - SendersBlockedTotalTimer(*): 1770806505327 - TotalTime: 17361956530 Instance b4afd338536090b:47bd038400000029 (host=redacted-host7:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 21983030 - PerHostPeakMemUsage: 234788716 - RowsProduced: 4658 - TotalNetworkReceiveTime: 332060404552 - TotalNetworkSendTime: 6128441 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 421 - TotalThreadsTotalWallClockTime: 334640378367 - TotalThreadsSysTime: 35994000 - TotalThreadsUserTime: 755886000 - TotalThreadsVoluntaryContextSwitches: 1873 - TotalTime: 335368886293 Fragment Instance Lifecycle Timings - ExecTime: 19844155149 - ExecTreeExecTime: 19294391224 - InactiveTotalTime: 0 - OpenTime: 314796240569 - ExecTreeOpenTime: 313302305577 - PrepareTime: 728332551 - ExecTreePrepareTime: 422943 - TotalTime: 0 DataStreamSender (dst_id=24) - BytesSent: 2919028 - InactiveTotalTime: 0 - NetworkThroughput(*): 380683379 - OverallThroughput: 21223742 - PeakMemoryUsage: 13216 - RowsReturned: 4658 - SerializeBatchTime: 129373872 - TotalTime: 137535968 - TransmitDataRPCTime: 7667863 - UncompressedRowBatchSize: 5412302 CodeGen - CodegenTime: 0 - CompileTime: 355233559 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076168 - NumFunctions: 54 - NumInstructions: 2406 - OptimizationTime: 1088550518 - PeakMemoryUsage: 1231872 - PrepareTime: 308555951 - TotalTime: 1789670236 HASH_JOIN_NODE (id=12) ExecOption: Probe Side Codegen Enabled - BuildRows: 4643 - BuildTime: 45227333 - InactiveTotalTime: 0 - LocalTime: 277168390 - NumHashTableBuildsSkipped: 0 - PeakMemoryUsage: 2156019 - ProbeRows: 835115 - ProbeRowsPartitioned: 0 - ProbeTime: 164321582 - RowsReturned: 4658 - RowsReturnedRate: 14 - TotalTime: 332597282297 Hash Join Builder (join_node_id=12) ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 15145193 - BuildRowsPartitioned: 4643 - GetNewBlockTime: 153132 - HashBuckets: 8192 - HashCollisions: 0 - HashTablesBuildTime: 29649708 - InactiveTotalTime: 0 - LargestPartitionPercent: 6 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 2053248 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=23) - BytesReceived: 252030 - ConvertRowBatchTime: 1076395 - DeserializeRowBatchTimer: 57295805 - FirstBatchArrivalWaitTime: 312647897925 - InactiveTotalTime: 313242811192 - PeakMemoryUsage: 0 - RowsReturned: 4643 - RowsReturnedRate: 14 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 313246076784 EXCHANGE_NODE (id=22) - BytesReceived: 30375325 - ConvertRowBatchTime: 212574668 - DeserializeRowBatchTimer: 3814913138 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 18261893765 - PeakMemoryUsage: 0 - RowsReturned: 835115 - RowsReturnedRate: 43782 - SendersBlockedTimer: 300222120893 - SendersBlockedTotalTimer(*): 1770907042358 - TotalTime: 19074037123 Instance b4afd338536090b:47bd03840000002b (host=redacted-host8:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 21748675 - PerHostPeakMemUsage: 225744219 - RowsProduced: 4726 - TotalNetworkReceiveTime: 327119844246 - TotalNetworkSendTime: 166976882 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 336 - TotalThreadsTotalWallClockTime: 332197100752 - TotalThreadsSysTime: 40994000 - TotalThreadsUserTime: 803877000 - TotalThreadsVoluntaryContextSwitches: 2144 - TotalTime: 333950823485 Fragment Instance Lifecycle Timings - ExecTime: 20055122327 - ExecTreeExecTime: 19252395934 - InactiveTotalTime: 0 - OpenTime: 312141995643 - ExecTreeOpenTime: 308554302873 - PrepareTime: 1753572595 - ExecTreePrepareTime: 302109246 - TotalTime: 0 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 140 - BlocksRecycled: 70 - BufferedPins: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 209715200 - PeakMemoryUsage: 143479312 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 - ScratchWrites: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 DataStreamSender (dst_id=24) - BytesSent: 2969057 - InactiveTotalTime: 0 - NetworkThroughput(*): 168075781 - OverallThroughput: 69949299 - PeakMemoryUsage: 13216 - RowsReturned: 4726 - SerializeBatchTime: 24688730 - TotalTime: 42445843 - TransmitDataRPCTime: 17664990 - UncompressedRowBatchSize: 5494825 CodeGen - CodegenTime: 0 - CompileTime: 1697640817 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076168 - NumFunctions: 54 - NumInstructions: 2406 - OptimizationTime: 1714845258 - PeakMemoryUsage: 1231872 - PrepareTime: 1023443492 - TotalTime: 4511787291 HASH_JOIN_NODE (id=12) ExecOption: Probe Side Codegen Enabled - BuildRows: 5660 - BuildTime: 64826083 - InactiveTotalTime: 0 - LocalTime: 765500366 - NumHashTableBuildsSkipped: 0 - PeakMemoryUsage: 1959411 - ProbeRows: 833688 - ProbeRowsPartitioned: 0 - ProbeTime: 236994076 - RowsReturned: 4726 - RowsReturnedRate: 14 - TotalTime: 328175230387 Hash Join Builder (join_node_id=12) ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 2782278 - BuildRowsPartitioned: 5660 - GetNewBlockTime: 27437440 - HashBuckets: 8192 - HashCollisions: 0 - HashTablesBuildTime: 34194293 - InactiveTotalTime: 0 - LargestPartitionPercent: 6 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 1856640 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=23) - BytesReceived: 295136 - ConvertRowBatchTime: 1292900 - DeserializeRowBatchTimer: 89741021 - FirstBatchArrivalWaitTime: 307976743788 - InactiveTotalTime: 308439704283 - PeakMemoryUsage: 0 - RowsReturned: 5660 - RowsReturnedRate: 18 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 308443003688 EXCHANGE_NODE (id=22) - BytesReceived: 30323193 - ConvertRowBatchTime: 243700103 - DeserializeRowBatchTimer: 7424443239 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 18364998841 - PeakMemoryUsage: 0 - RowsReturned: 833688 - RowsReturnedRate: 43955 - SendersBlockedTimer: 300168649691 - SendersBlockedTotalTimer(*): 1471046742670 - TotalTime: 18966726333 Averaged Fragment F01 split sizes: min: 32.91 MB, max: 66.68 MB, avg: 44.45 MB, stddev: 15.72 MB completion times: min:5m24s max:5m35s mean: 5m29s stddev:4s334ms execution rates: min:103.59 KB/sec max:204.23 KB/sec mean:137.76 KB/sec stddev:46.74 KB/sec num instances: 6 - AverageThreadTokens: 1.9865782059763883 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 22514573 - PerHostPeakMemUsage: 235849492 - RowsProduced: 833333 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 314867412627 - TotalStorageWaitTime: 6403844030 - TotalThreadsInvoluntaryContextSwitches: 3238 - TotalThreadsTotalWallClockTime: 652803746255 - TotalThreadsSysTime: 105316666 - TotalThreadsUserTime: 3263503500 - TotalThreadsVoluntaryContextSwitches: 1788 - TotalTime: 328814877809 Fragment Instance Lifecycle Timings - ExecTime: 327834177666 - ExecTreeExecTime: 7881197005 - InactiveTotalTime: 0 - OpenTime: 247815477 - ExecTreeOpenTime: 1113258 - PrepareTime: 732716772 - ExecTreePrepareTime: 1613503 - TotalTime: 0 DataStreamSender (dst_id=22) - BytesSent: 30307686 - InactiveTotalTime: 0 - NetworkThroughput(*): 144476234 - OverallThroughput: 16335557 - PeakMemoryUsage: 188064 - RowsReturned: 833333 - SerializeBatchTime: 1653715919 - TotalTime: 1865421891 - TransmitDataRPCTime: 209513155 - UncompressedRowBatchSize: 53801824 CodeGen - CodegenTime: 1725595 - CompileTime: 30824907 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076168 - NumFunctions: 5 - NumInstructions: 98 - OptimizationTime: 131704194 - PeakMemoryUsage: 50176 - PrepareTime: 494324601 - TotalTime: 720420451 HDFS_SCAN_NODE (id=10) - AverageHdfsReadThreadConcurrency: 2.5290844714213456E-4 - AverageScannerThreadConcurrency: 0.9910697955813615 - BytesRead: 10648538 - BytesReadDataNodeCache: 0 - BytesReadLocal: 10648538 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 10648538 - DecompressionTime: 122972301 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 4 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 1 - NumRowGroups: 1 - NumScannerThreadsStarted: 1 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 22320735 - PerReadThreadRawHdfsThroughput: 613714338 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 7184287448 - RowBatchQueuePutWaitTime: 311705060700 - RowsRead: 833333 - RowsReturned: 833333 - RowsReturnedRate: 671305 - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 239 - ScannerThreadsTotalWallClockTime: 324721775100 - MaterializeTupleTime(*): 5170738686 - ScannerThreadsSysTime: 43492833 - ScannerThreadsUserTime: 938190333 - ScannerThreadsVoluntaryContextSwitches: 1219 - TotalRawHdfsReadTime(*): 21713145 - TotalReadThroughput: 33276 - TotalTime: 7881406304 Fragment F01 Instance b4afd338536090b:47bd038400000001 (host=redacted-host7:22000) Hdfs split stats (:<# splits>/): 5:1/32.90 MB 2:1/33.78 MB - AverageThreadTokens: 1.993939393939394 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 23047342 - PerHostPeakMemUsage: 234788716 - RowsProduced: 1250000 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 325427045493 - TotalStorageWaitTime: 1469078976 - TotalThreadsInvoluntaryContextSwitches: 4915 - TotalThreadsTotalWallClockTime: 668100602350 - TotalThreadsSysTime: 84987000 - TotalThreadsUserTime: 4803269000 - TotalThreadsVoluntaryContextSwitches: 2477 - TotalTime: 335356491439 Fragment Instance Lifecycle Timings - ExecTime: 334734884905 - ExecTreeExecTime: 2177400944 - InactiveTotalTime: 0 - OpenTime: 183205551 - ExecTreeOpenTime: 2188889 - PrepareTime: 438265811 - ExecTreePrepareTime: 2888409 - TotalTime: 0 DataStreamSender (dst_id=22) - BytesSent: 45353382 - InactiveTotalTime: 0 - NetworkThroughput(*): 151983001 - OverallThroughput: 16915902 - PeakMemoryUsage: 188064 - RowsReturned: 1250000 - SerializeBatchTime: 2379513346 - TotalTime: 2681109147 - TransmitDataRPCTime: 298410885 - UncompressedRowBatchSize: 80707107 CodeGen - CodegenTime: 748966 - CompileTime: 40650157 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076168 - NumFunctions: 5 - NumInstructions: 98 - OptimizationTime: 58918028 - PeakMemoryUsage: 50176 - PrepareTime: 298716506 - TotalTime: 416674983 HDFS_SCAN_NODE (id=10) Hdfs split stats (:<# splits>/): 5:1/32.90 MB 2:1/33.78 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 2 out of 2 Hdfs Read Thread Concurrency Bucket: 0:99.85% 1:0.1517% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:8 - AverageHdfsReadThreadConcurrency: 0.0015174506828528073 - AverageScannerThreadConcurrency: 0.9954476479514416 - BytesRead: 15972767 - BytesReadDataNodeCache: 0 - BytesReadLocal: 15972767 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 15972767 - DecompressionTime: 94172727 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 4 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 2 - NumRowGroups: 2 - NumScannerThreadsStarted: 1 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 22850663 - PerReadThreadRawHdfsThroughput: 699782185 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 723264873 - RowBatchQueuePutWaitTime: 324550828309 - RowsRead: 1250000 - RowsReturned: 1250000 - RowsReturnedRate: 574306 - ScanRangesComplete: 2 - ScannerThreadsInvoluntaryContextSwitches: 231 - ScannerThreadsTotalWallClockTime: 333182541977 - MaterializeTupleTime(*): 6176525288 - ScannerThreadsSysTime: 29995000 - ScannerThreadsUserTime: 1435781000 - ScannerThreadsVoluntaryContextSwitches: 1768 - TotalRawHdfsReadTime(*): 22825341 - TotalReadThroughput: 48392 - TotalTime: 2176539536 Instance b4afd338536090b:47bd038400000004 (host=redacted-host2:22000) Hdfs split stats (:<# splits>/): 0:1/33.77 MB 1:1/32.90 MB - AverageThreadTokens: 1.9848024316109423 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 24053225 - PerHostPeakMemUsage: 233085705 - RowsProduced: 1249999 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 325785180179 - TotalStorageWaitTime: 154175300 - TotalThreadsInvoluntaryContextSwitches: 4943 - TotalThreadsTotalWallClockTime: 663294090719 - TotalThreadsSysTime: 154976000 - TotalThreadsUserTime: 4875259000 - TotalThreadsVoluntaryContextSwitches: 2097 - TotalTime: 334254704756 Fragment Instance Lifecycle Timings - ExecTime: 333527239555 - ExecTreeExecTime: 924893849 - InactiveTotalTime: 0 - OpenTime: 156771423 - ExecTreeOpenTime: 1410031 - PrepareTime: 570586898 - ExecTreePrepareTime: 5602793 - TotalTime: 0 DataStreamSender (dst_id=22) - BytesSent: 45441900 - InactiveTotalTime: 0 - NetworkThroughput(*): 140931255 - OverallThroughput: 15689916 - PeakMemoryUsage: 188064 - RowsReturned: 1249999 - SerializeBatchTime: 2572031467 - TotalTime: 2896248697 - TransmitDataRPCTime: 322440184 - UncompressedRowBatchSize: 80701624 CodeGen - CodegenTime: 653497 - CompileTime: 30465673 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076168 - NumFunctions: 5 - NumInstructions: 98 - OptimizationTime: 101332815 - PeakMemoryUsage: 50176 - PrepareTime: 325502035 - TotalTime: 458029966 HDFS_SCAN_NODE (id=10) Hdfs split stats (:<# splits>/): 0:1/33.77 MB 1:1/32.90 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 2 out of 2 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:8 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.9893129770992366 - BytesRead: 15972798 - BytesReadDataNodeCache: 0 - BytesReadLocal: 15972798 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 15972798 - DecompressionTime: 107606507 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 4 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 2 - NumRowGroups: 2 - NumScannerThreadsStarted: 1 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 23865400 - PerReadThreadRawHdfsThroughput: 480853188 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 378848683 - RowBatchQueuePutWaitTime: 323224390891 - RowsRead: 1249999 - RowsReturned: 1249999 - RowsReturnedRate: 1338493 - ScanRangesComplete: 2 - ScannerThreadsInvoluntaryContextSwitches: 637 - ScannerThreadsTotalWallClockTime: 329610101419 - MaterializeTupleTime(*): 5534877122 - ScannerThreadsSysTime: 63990000 - ScannerThreadsUserTime: 1365792000 - ScannerThreadsVoluntaryContextSwitches: 1411 - TotalRawHdfsReadTime(*): 33217619 - TotalReadThroughput: 48688 - TotalTime: 933885339 Instance b4afd338536090b:47bd038400000003 (host=redacted-host8:22000) Hdfs split stats (:<# splits>/): 1:1/33.78 MB - AverageThreadTokens: 1.9845094664371772 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 23047342 - PerHostPeakMemUsage: 225744219 - RowsProduced: 633335 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 279056129299 - TotalStorageWaitTime: 36258903454 - TotalThreadsInvoluntaryContextSwitches: 3161 - TotalThreadsTotalWallClockTime: 650204054774 - TotalThreadsSysTime: 80987000 - TotalThreadsUserTime: 2541613000 - TotalThreadsVoluntaryContextSwitches: 2135 - TotalTime: 328004620315 Fragment Instance Lifecycle Timings - ExecTime: 325822756695 - ExecTreeExecTime: 41397554931 - InactiveTotalTime: 0 - OpenTime: 596954600 - ExecTreeOpenTime: 178007 - PrepareTime: 1584762978 - ExecTreePrepareTime: 394917 - TotalTime: 0 DataStreamSender (dst_id=22) - BytesSent: 23072617 - InactiveTotalTime: 0 - NetworkThroughput(*): 152487486 - OverallThroughput: 14148641 - PeakMemoryUsage: 188064 - RowsReturned: 633335 - SerializeBatchTime: 1478513949 - TotalTime: 1630730164 - TransmitDataRPCTime: 151308265 - UncompressedRowBatchSize: 40887769 CodeGen - CodegenTime: 1127394 - CompileTime: 22387551 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076168 - NumFunctions: 5 - NumInstructions: 98 - OptimizationTime: 327363107 - PeakMemoryUsage: 50176 - PrepareTime: 982996984 - TotalTime: 1660870908 HDFS_SCAN_NODE (id=10) Hdfs split stats (:<# splits>/): 1:1/33.78 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:4 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.9930555555555556 - BytesRead: 8088587 - BytesReadDataNodeCache: 0 - BytesReadLocal: 8088587 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 8088587 - DecompressionTime: 309181402 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 4 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 1 - NumRowGroups: 1 - NumScannerThreadsStarted: 1 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 22850663 - PerReadThreadRawHdfsThroughput: 418235772 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 40598841439 - RowBatchQueuePutWaitTime: 272189346123 - RowsRead: 633335 - RowsReturned: 633335 - RowsReturnedRate: 15300 - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 104 - ScannerThreadsTotalWallClockTime: 323784365096 - MaterializeTupleTime(*): 10083162593 - ScannerThreadsSysTime: 27995000 - ScannerThreadsUserTime: 770882000 - ScannerThreadsVoluntaryContextSwitches: 1622 - TotalRawHdfsReadTime(*): 19339778 - TotalReadThroughput: 27883 - TotalTime: 41393367269 Instance b4afd338536090b:47bd038400000006 (host=redacted-host3:22000) Hdfs split stats (:<# splits>/): 2:1/33.78 MB - AverageThreadTokens: 1.9828393135725428 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 23039150 - PerHostPeakMemUsage: 255202640 - RowsProduced: 633333 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 319977706522 - TotalStorageWaitTime: 87849493 - TotalThreadsInvoluntaryContextSwitches: 2004 - TotalThreadsTotalWallClockTime: 645457864749 - TotalThreadsSysTime: 71988000 - TotalThreadsUserTime: 2403634000 - TotalThreadsVoluntaryContextSwitches: 1328 - TotalTime: 325663401030 Fragment Instance Lifecycle Timings - ExecTime: 324767229592 - ExecTreeExecTime: 760286749 - InactiveTotalTime: 0 - OpenTime: 175457638 - ExecTreeOpenTime: 124419 - PrepareTime: 720611039 - ExecTreePrepareTime: 273798 - TotalTime: 0 DataStreamSender (dst_id=22) - BytesSent: 23094586 - InactiveTotalTime: 0 - NetworkThroughput(*): 149229609 - OverallThroughput: 16715959 - PeakMemoryUsage: 188064 - RowsReturned: 633333 - SerializeBatchTime: 1225886179 - TotalTime: 1381589025 - TransmitDataRPCTime: 154758738 - UncompressedRowBatchSize: 40889759 CodeGen - CodegenTime: 682721 - CompileTime: 30011518 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076168 - NumFunctions: 5 - NumInstructions: 98 - OptimizationTime: 92177306 - PeakMemoryUsage: 50176 - PrepareTime: 502918858 - TotalTime: 638841046 HDFS_SCAN_NODE (id=10) Hdfs split stats (:<# splits>/): 2:1/33.78 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:4 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.987460815047022 - BytesRead: 8088862 - BytesReadDataNodeCache: 0 - BytesReadLocal: 8088862 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 8088862 - DecompressionTime: 85913355 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 4 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 1 - NumRowGroups: 1 - NumScannerThreadsStarted: 1 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 22850663 - PerReadThreadRawHdfsThroughput: 1425920751 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 231898893 - RowBatchQueuePutWaitTime: 317064090876 - RowsRead: 633333 - RowsReturned: 633333 - RowsReturnedRate: 834557 - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 147 - ScannerThreadsTotalWallClockTime: 320515197171 - MaterializeTupleTime(*): 2928230769 - ScannerThreadsSysTime: 19996000 - ScannerThreadsUserTime: 666898000 - ScannerThreadsVoluntaryContextSwitches: 798 - TotalRawHdfsReadTime(*): 5672729 - TotalReadThroughput: 25273 - TotalTime: 758885002 Instance b4afd338536090b:47bd038400000002 (host=redacted-host6:22000) Hdfs split stats (:<# splits>/): 9:1/32.91 MB - AverageThreadTokens: 1.9859375 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 20950190 - PerHostPeakMemUsage: 233069701 - RowsProduced: 616667 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 319416257176 - TotalStorageWaitTime: 252058497 - TotalThreadsInvoluntaryContextSwitches: 2303 - TotalThreadsTotalWallClockTime: 645156307304 - TotalThreadsSysTime: 110982000 - TotalThreadsUserTime: 2521617000 - TotalThreadsVoluntaryContextSwitches: 1368 - TotalTime: 325050785066 Fragment Instance Lifecycle Timings - ExecTime: 324273463953 - ExecTreeExecTime: 1208936226 - InactiveTotalTime: 0 - OpenTime: 234634199 - ExecTreeOpenTime: 2660109 - PrepareTime: 542288074 - ExecTreePrepareTime: 202455 - TotalTime: 0 DataStreamSender (dst_id=22) - BytesSent: 22487119 - InactiveTotalTime: 0 - NetworkThroughput(*): 141038103 - OverallThroughput: 16599986 - PeakMemoryUsage: 188064 - RowsReturned: 616667 - SerializeBatchTime: 1189816657 - TotalTime: 1354646799 - TransmitDataRPCTime: 159440027 - UncompressedRowBatchSize: 39813010 CodeGen - CodegenTime: 809770 - CompileTime: 17663083 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076168 - NumFunctions: 5 - NumInstructions: 98 - OptimizationTime: 122438627 - PeakMemoryUsage: 50176 - PrepareTime: 531899761 - TotalTime: 673164242 HDFS_SCAN_NODE (id=10) Hdfs split stats (:<# splits>/): 9:1/32.91 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:4 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.9890282131661442 - BytesRead: 7884069 - BytesReadDataNodeCache: 0 - BytesReadLocal: 7884069 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 7884069 - DecompressionTime: 39586933 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 4 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 1 - NumRowGroups: 1 - NumScannerThreadsStarted: 1 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 20753511 - PerReadThreadRawHdfsThroughput: 276173787 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 762637110 - RowBatchQueuePutWaitTime: 316431721840 - RowsRead: 616667 - RowsReturned: 616667 - RowsReturnedRate: 509980 - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 211 - ScannerThreadsTotalWallClockTime: 320648229383 - MaterializeTupleTime(*): 3296534091 - ScannerThreadsSysTime: 53991000 - ScannerThreadsUserTime: 708893000 - ScannerThreadsVoluntaryContextSwitches: 866 - TotalRawHdfsReadTime(*): 28547492 - TotalReadThroughput: 24632 - TotalTime: 1209197830 Instance b4afd338536090b:47bd038400000005 (host=redacted-host1:22000) Hdfs split stats (:<# splits>/): 1:1/32.91 MB - AverageThreadTokens: 1.987441130298273 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 20950190 - PerHostPeakMemUsage: 233205973 - RowsProduced: 616666 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 319542157098 - TotalStorageWaitTime: 200998464 - TotalThreadsInvoluntaryContextSwitches: 2107 - TotalThreadsTotalWallClockTime: 644609557636 - TotalThreadsSysTime: 127980000 - TotalThreadsUserTime: 2435629000 - TotalThreadsVoluntaryContextSwitches: 1326 - TotalTime: 324559264251 Fragment Instance Lifecycle Timings - ExecTime: 323879491299 - ExecTreeExecTime: 818109335 - InactiveTotalTime: 0 - OpenTime: 139869456 - ExecTreeOpenTime: 118094 - PrepareTime: 539785832 - ExecTreePrepareTime: 318649 - TotalTime: 0 DataStreamSender (dst_id=22) - BytesSent: 22396517 - InactiveTotalTime: 0 - NetworkThroughput(*): 131187955 - OverallThroughput: 17942943 - PeakMemoryUsage: 188064 - RowsReturned: 616666 - SerializeBatchTime: 1076533918 - TotalTime: 1248207514 - TransmitDataRPCTime: 170720833 - UncompressedRowBatchSize: 39811680 CodeGen - CodegenTime: 6331227 - CompileTime: 43771462 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076168 - NumFunctions: 5 - NumInstructions: 98 - OptimizationTime: 87995283 - PeakMemoryUsage: 50176 - PrepareTime: 323913464 - TotalTime: 474941563 HDFS_SCAN_NODE (id=10) Hdfs split stats (:<# splits>/): 1:1/32.91 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:4 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.9921135646687698 - BytesRead: 7884146 - BytesReadDataNodeCache: 0 - BytesReadLocal: 7884146 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 7884146 - DecompressionTime: 101372883 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 4 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 1 - NumRowGroups: 1 - NumScannerThreadsStarted: 1 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 20753511 - PerReadThreadRawHdfsThroughput: 381320349 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 410233690 - RowBatchQueuePutWaitTime: 316769986166 - RowsRead: 616666 - RowsReturned: 616666 - RowsReturnedRate: 755197 - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 105 - ScannerThreadsTotalWallClockTime: 320590215558 - MaterializeTupleTime(*): 3005102253 - ScannerThreadsSysTime: 64990000 - ScannerThreadsUserTime: 680896000 - ScannerThreadsVoluntaryContextSwitches: 852 - TotalRawHdfsReadTime(*): 20675912 - TotalReadThroughput: 24788 - TotalTime: 816562853 Averaged Fragment F08 split sizes: min: 0, max: 0, avg: 0, stddev: 0 completion times: min:5m13s max:5m15s mean: 5m15s stddev:599.682ms execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec num instances: 8 - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 2985216 - PerHostPeakMemUsage: 224688800 - RowsProduced: 3617 - TotalNetworkReceiveTime: 312793680867 - TotalNetworkSendTime: 108942534 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 186 - TotalThreadsTotalWallClockTime: 314105699928 - TotalThreadsSysTime: 7249000 - TotalThreadsUserTime: 212467625 - TotalThreadsVoluntaryContextSwitches: 191 - TotalTime: 315180747357 Fragment Instance Lifecycle Timings - ExecTime: 341651234 - ExecTreeExecTime: 141046866 - InactiveTotalTime: 0 - OpenTime: 313764066838 - ExecTreeOpenTime: 312851471253 - PrepareTime: 1065431454 - ExecTreePrepareTime: 373522829 - TotalTime: 0 DataStreamSender (dst_id=23) - BytesSent: 194523 - InactiveTotalTime: 0 - NetworkThroughput(*): 153213790 - OverallThroughput: 31428844 - PeakMemoryUsage: 178816 - RowsReturned: 3617 - SerializeBatchTime: 4205803 - TotalTime: 8948607 - TransmitDataRPCTime: 1270828 - UncompressedRowBatchSize: 368002 CodeGen - CodegenTime: 46315853 - CompileTime: 194704265 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076168 - NumFunctions: 54 - NumInstructions: 1085 - OptimizationTime: 671197619 - PeakMemoryUsage: 555520 - PrepareTime: 517037066 - TotalTime: 1394220754 AGGREGATION_NODE (id=21) - BuildTime: 31310273 - GetNewBlockTime: 200967204 - GetResultsTime: 2613459 - HTResizeTime: 22022880 - HashBuckets: 32768 - InactiveTotalTime: 0 - LargestPartitionPercent: 6 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 2791395 - PinTime: 0 - RowsRepartitioned: 0 - RowsReturned: 3617 - RowsReturnedRate: 11 - SpilledPartitions: 0 - TotalTime: 313365973396 - UnpinTime: 3712 EXCHANGE_NODE (id=20) - BytesReceived: 195008 - ConvertRowBatchTime: 818968 - DeserializeRowBatchTimer: 21600918 - FirstBatchArrivalWaitTime: 312597929797 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 3617 - RowsReturnedRate: 11 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 312794832180 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 140 - BlocksRecycled: 4 - BufferedPins: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 209715200 - PeakMemoryUsage: 143479312 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 - ScratchWrites: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 Fragment F08 Instance b4afd338536090b:47bd038400000024 (host=redacted-host3:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 2985216 - PerHostPeakMemUsage: 255202640 - RowsProduced: 3622 - TotalNetworkReceiveTime: 313325070940 - TotalNetworkSendTime: 115861738 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 177 - TotalThreadsTotalWallClockTime: 314790860892 - TotalThreadsSysTime: 4000000 - TotalThreadsUserTime: 205968000 - TotalThreadsVoluntaryContextSwitches: 222 - TotalTime: 315725007109 Fragment Instance Lifecycle Timings - ExecTime: 584846391 - ExecTreeExecTime: 249680672 - InactiveTotalTime: 0 - OpenTime: 314206043183 - ExecTreeOpenTime: 313358656250 - PrepareTime: 933987119 - ExecTreePrepareTime: 214975100 - TotalTime: 0 DataStreamSender (dst_id=23) - BytesSent: 194631 - InactiveTotalTime: 0 - NetworkThroughput(*): 150933841 - OverallThroughput: 35485549 - PeakMemoryUsage: 180864 - RowsReturned: 3622 - SerializeBatchTime: 4109072 - TotalTime: 5484796 - TransmitDataRPCTime: 1289512 - UncompressedRowBatchSize: 368204 CodeGen - CodegenTime: 122451779 - CompileTime: 222602909 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076168 - NumFunctions: 54 - NumInstructions: 1085 - OptimizationTime: 591195318 - PeakMemoryUsage: 555520 - PrepareTime: 505939016 - TotalTime: 1326303796 AGGREGATION_NODE (id=21) ExecOption: Codegen Enabled - BuildTime: 15340859 - GetNewBlockTime: 120729570 - GetResultsTime: 2803145 - HTResizeTime: 9029676 - HashBuckets: 32768 - InactiveTotalTime: 0 - LargestPartitionPercent: 6 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 2789121 - PinTime: 0 - RowsRepartitioned: 0 - RowsReturned: 3622 - RowsReturnedRate: 11 - SpilledPartitions: 0 - TotalTime: 313823232222 - UnpinTime: 3761 EXCHANGE_NODE (id=20) - BytesReceived: 194927 - ConvertRowBatchTime: 792126 - DeserializeRowBatchTimer: 10043991 - FirstBatchArrivalWaitTime: 313140435029 - InactiveTotalTime: 313324675662 - PeakMemoryUsage: 0 - RowsReturned: 3622 - RowsReturnedRate: 11 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 313326209376 Instance b4afd338536090b:47bd038400000028 (host=redacted-host2:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 2985216 - PerHostPeakMemUsage: 233085705 - RowsProduced: 3636 - TotalNetworkReceiveTime: 313261952733 - TotalNetworkSendTime: 44147928 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 162 - TotalThreadsTotalWallClockTime: 314813436980 - TotalThreadsSysTime: 7999000 - TotalThreadsUserTime: 218967000 - TotalThreadsVoluntaryContextSwitches: 234 - TotalTime: 315538584719 Fragment Instance Lifecycle Timings - ExecTime: 469988900 - ExecTreeExecTime: 303247275 - InactiveTotalTime: 0 - OpenTime: 314343462231 - ExecTreeOpenTime: 313342122237 - PrepareTime: 707983218 - ExecTreePrepareTime: 92377053 - TotalTime: 0 DataStreamSender (dst_id=23) - BytesSent: 195460 - InactiveTotalTime: 0 - NetworkThroughput(*): 152965317 - OverallThroughput: 35641899 - PeakMemoryUsage: 180864 - RowsReturned: 3636 - SerializeBatchTime: 4096112 - TotalTime: 5483995 - TransmitDataRPCTime: 1277806 - UncompressedRowBatchSize: 370077 CodeGen - CodegenTime: 25813250 - CompileTime: 164274865 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076168 - NumFunctions: 54 - NumInstructions: 1085 - OptimizationTime: 717757334 - PeakMemoryUsage: 555520 - PrepareTime: 387490355 - TotalTime: 1294693478 AGGREGATION_NODE (id=21) ExecOption: Codegen Enabled - BuildTime: 18933170 - GetNewBlockTime: 52921869 - GetResultsTime: 4334240 - HTResizeTime: 6570446 - HashBuckets: 32768 - InactiveTotalTime: 0 - LargestPartitionPercent: 6 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 2791038 - PinTime: 0 - RowsRepartitioned: 0 - RowsReturned: 3636 - RowsReturnedRate: 11 - SpilledPartitions: 0 - TotalTime: 313737665842 - UnpinTime: 3209 EXCHANGE_NODE (id=20) - BytesReceived: 195829 - ConvertRowBatchTime: 814880 - DeserializeRowBatchTimer: 24155288 - FirstBatchArrivalWaitTime: 312978891757 - InactiveTotalTime: 313261725977 - PeakMemoryUsage: 0 - RowsReturned: 3636 - RowsReturnedRate: 11 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 313263089780 Instance b4afd338536090b:47bd038400000025 (host=redacted-host1:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 2985216 - PerHostPeakMemUsage: 233205973 - RowsProduced: 3755 - TotalNetworkReceiveTime: 313469073827 - TotalNetworkSendTime: 68512258 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 194 - TotalThreadsTotalWallClockTime: 314887913709 - TotalThreadsSysTime: 5999000 - TotalThreadsUserTime: 209968000 - TotalThreadsVoluntaryContextSwitches: 200 - TotalTime: 315534886027 Fragment Instance Lifecycle Timings - ExecTime: 346797578 - ExecTreeExecTime: 194300657 - InactiveTotalTime: 0 - OpenTime: 314541131586 - ExecTreeOpenTime: 313569061534 - PrepareTime: 646822337 - ExecTreePrepareTime: 258665295 - TotalTime: 0 DataStreamSender (dst_id=23) - BytesSent: 202488 - InactiveTotalTime: 0 - NetworkThroughput(*): 160395681 - OverallThroughput: 36297051 - PeakMemoryUsage: 180864 - RowsReturned: 3755 - SerializeBatchTime: 4235258 - TotalTime: 5578635 - TransmitDataRPCTime: 1262428 - UncompressedRowBatchSize: 382039 CodeGen - CodegenTime: 25213881 - CompileTime: 207048692 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076168 - NumFunctions: 54 - NumInstructions: 1085 - OptimizationTime: 738359594 - PeakMemoryUsage: 555520 - PrepareTime: 202597313 - TotalTime: 1148953442 AGGREGATION_NODE (id=21) ExecOption: Codegen Enabled - BuildTime: 64699303 - GetNewBlockTime: 45047132 - GetResultsTime: 1777463 - HTResizeTime: 50162231 - HashBuckets: 32768 - InactiveTotalTime: 0 - LargestPartitionPercent: 7 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 2792436 - PinTime: 0 - RowsRepartitioned: 0 - RowsReturned: 3755 - RowsReturnedRate: 11 - SpilledPartitions: 0 - TotalTime: 314021963496 - UnpinTime: 2911 EXCHANGE_NODE (id=20) - BytesReceived: 202352 - ConvertRowBatchTime: 794060 - DeserializeRowBatchTimer: 31078313 - FirstBatchArrivalWaitTime: 313310400109 - InactiveTotalTime: 313468872651 - PeakMemoryUsage: 0 - RowsReturned: 3755 - RowsReturnedRate: 11 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 313470169345 Instance b4afd338536090b:47bd038400000021 (host=redacted-host4:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 2985216 - PerHostPeakMemUsage: 192884167 - RowsProduced: 3711 - TotalNetworkReceiveTime: 314134511951 - TotalNetworkSendTime: 142606549 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 201 - TotalThreadsTotalWallClockTime: 315016732817 - TotalThreadsSysTime: 6999000 - TotalThreadsUserTime: 208969000 - TotalThreadsVoluntaryContextSwitches: 136 - TotalTime: 315478167008 Fragment Instance Lifecycle Timings - ExecTime: 273641394 - ExecTreeExecTime: 39125675 - InactiveTotalTime: 0 - OpenTime: 314743108167 - ExecTreeOpenTime: 314175812545 - PrepareTime: 461284341 - ExecTreePrepareTime: 114374545 - TotalTime: 0 DataStreamSender (dst_id=23) - BytesSent: 199457 - InactiveTotalTime: 0 - NetworkThroughput(*): 154130585 - OverallThroughput: 35484324 - PeakMemoryUsage: 180864 - RowsReturned: 3711 - SerializeBatchTime: 4248222 - TotalTime: 5620989 - TransmitDataRPCTime: 1294078 - UncompressedRowBatchSize: 377358 CodeGen - CodegenTime: 43778091 - CompileTime: 67718010 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076168 - NumFunctions: 54 - NumInstructions: 1085 - OptimizationTime: 472212396 - PeakMemoryUsage: 555520 - PrepareTime: 150387366 - TotalTime: 694330186 AGGREGATION_NODE (id=21) ExecOption: Codegen Enabled - BuildTime: 28312084 - GetNewBlockTime: 79912029 - GetResultsTime: 1743836 - HTResizeTime: 21577227 - HashBuckets: 32768 - InactiveTotalTime: 0 - LargestPartitionPercent: 6 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 2789207 - PinTime: 0 - RowsRepartitioned: 0 - RowsReturned: 3711 - RowsReturnedRate: 11 - SpilledPartitions: 0 - TotalTime: 314329251799 - UnpinTime: 3187 EXCHANGE_NODE (id=20) - BytesReceived: 199733 - ConvertRowBatchTime: 838898 - DeserializeRowBatchTimer: 5624911 - FirstBatchArrivalWaitTime: 313985394209 - InactiveTotalTime: 314134297578 - PeakMemoryUsage: 0 - RowsReturned: 3711 - RowsReturnedRate: 11 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 314135700999 Instance b4afd338536090b:47bd038400000023 (host=redacted-host6:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 2985216 - PerHostPeakMemUsage: 233069701 - RowsProduced: 3575 - TotalNetworkReceiveTime: 313699508211 - TotalNetworkSendTime: 248832580 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 201 - TotalThreadsTotalWallClockTime: 314823283123 - TotalThreadsSysTime: 5999000 - TotalThreadsUserTime: 213967000 - TotalThreadsVoluntaryContextSwitches: 153 - TotalTime: 315454921067 Fragment Instance Lifecycle Timings - ExecTime: 341054723 - ExecTreeExecTime: 49256502 - InactiveTotalTime: 0 - OpenTime: 314482242314 - ExecTreeOpenTime: 313740437240 - PrepareTime: 631467039 - ExecTreePrepareTime: 174336956 - TotalTime: 0 DataStreamSender (dst_id=23) - BytesSent: 192070 - InactiveTotalTime: 0 - NetworkThroughput(*): 142833239 - OverallThroughput: 35084713 - PeakMemoryUsage: 180864 - RowsReturned: 3575 - SerializeBatchTime: 4043732 - TotalTime: 5474464 - TransmitDataRPCTime: 1344715 - UncompressedRowBatchSize: 363883 CodeGen - CodegenTime: 22916729 - CompileTime: 183810456 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076168 - NumFunctions: 54 - NumInstructions: 1085 - OptimizationTime: 553364301 - PeakMemoryUsage: 555520 - PrepareTime: 335361087 - TotalTime: 1094392852 AGGREGATION_NODE (id=21) ExecOption: Codegen Enabled - BuildTime: 21020110 - GetNewBlockTime: 172236264 - GetResultsTime: 5217858 - HTResizeTime: 6448533 - HashBuckets: 32768 - InactiveTotalTime: 0 - LargestPartitionPercent: 6 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 2789296 - PinTime: 0 - RowsRepartitioned: 0 - RowsReturned: 3575 - RowsReturnedRate: 11 - SpilledPartitions: 0 - TotalTime: 313963971072 - UnpinTime: 3753 EXCHANGE_NODE (id=20) - BytesReceived: 192704 - ConvertRowBatchTime: 818839 - DeserializeRowBatchTimer: 31693305 - FirstBatchArrivalWaitTime: 313530585277 - InactiveTotalTime: 313699282991 - PeakMemoryUsage: 0 - RowsReturned: 3575 - RowsReturnedRate: 11 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 313700673405 Instance b4afd338536090b:47bd038400000022 (host=redacted-host5:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 2985216 - PerHostPeakMemUsage: 189529285 - RowsProduced: 3532 - TotalNetworkReceiveTime: 313664029974 - TotalNetworkSendTime: 120535217 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 252 - TotalThreadsTotalWallClockTime: 314720038845 - TotalThreadsSysTime: 4999000 - TotalThreadsUserTime: 205969000 - TotalThreadsVoluntaryContextSwitches: 138 - TotalTime: 315232326883 Fragment Instance Lifecycle Timings - ExecTime: 347781698 - ExecTreeExecTime: 107571105 - InactiveTotalTime: 0 - OpenTime: 314372273207 - ExecTreeOpenTime: 313691782017 - PrepareTime: 512010914 - ExecTreePrepareTime: 191954117 - TotalTime: 0 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 140 - BlocksRecycled: 4 - BufferedPins: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 209715200 - PeakMemoryUsage: 143479312 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 - ScratchWrites: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 DataStreamSender (dst_id=23) - BytesSent: 189916 - InactiveTotalTime: 0 - NetworkThroughput(*): 155467000 - OverallThroughput: 32857507 - PeakMemoryUsage: 164480 - RowsReturned: 3532 - SerializeBatchTime: 4482461 - TotalTime: 5779988 - TransmitDataRPCTime: 1221584 - UncompressedRowBatchSize: 359153 CodeGen - CodegenTime: 61799310 - CompileTime: 95785197 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076168 - NumFunctions: 54 - NumInstructions: 1085 - OptimizationTime: 565323751 - PeakMemoryUsage: 555520 - PrepareTime: 183869382 - TotalTime: 852317458 AGGREGATION_NODE (id=21) ExecOption: Codegen Enabled - BuildTime: 13405234 - GetNewBlockTime: 57238146 - GetResultsTime: 1637017 - HTResizeTime: 6577109 - HashBuckets: 32768 - InactiveTotalTime: 0 - LargestPartitionPercent: 6 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 2792299 - PinTime: 0 - RowsRepartitioned: 0 - RowsReturned: 3532 - RowsReturnedRate: 11 - SpilledPartitions: 0 - TotalTime: 313991248860 - UnpinTime: 3922 EXCHANGE_NODE (id=20) - BytesReceived: 190747 - ConvertRowBatchTime: 828503 - DeserializeRowBatchTimer: 19216863 - FirstBatchArrivalWaitTime: 313489058486 - InactiveTotalTime: 313663722823 - PeakMemoryUsage: 0 - RowsReturned: 3532 - RowsReturnedRate: 11 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 313665204230 Instance b4afd338536090b:47bd038400000026 (host=redacted-host7:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 2985216 - PerHostPeakMemUsage: 234788716 - RowsProduced: 3585 - TotalNetworkReceiveTime: 313534403873 - TotalNetworkSendTime: 33863293 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 182 - TotalThreadsTotalWallClockTime: 314393469240 - TotalThreadsSysTime: 7999000 - TotalThreadsUserTime: 196970000 - TotalThreadsVoluntaryContextSwitches: 151 - TotalTime: 314967331144 Fragment Instance Lifecycle Timings - ExecTime: 144957540 - ExecTreeExecTime: 85913137 - InactiveTotalTime: 0 - OpenTime: 314248527800 - ExecTreeOpenTime: 313574295626 - PrepareTime: 573686783 - ExecTreePrepareTime: 90961243 - TotalTime: 0 DataStreamSender (dst_id=23) - BytesSent: 193100 - InactiveTotalTime: 0 - NetworkThroughput(*): 150039782 - OverallThroughput: 34782671 - PeakMemoryUsage: 180864 - RowsReturned: 3585 - SerializeBatchTime: 4191297 - TotalTime: 5551615 - TransmitDataRPCTime: 1286992 - UncompressedRowBatchSize: 364829 CodeGen - CodegenTime: 8076781 - CompileTime: 97150200 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076168 - NumFunctions: 54 - NumInstructions: 1085 - OptimizationTime: 573338593 - PeakMemoryUsage: 555520 - PrepareTime: 277045659 - TotalTime: 948325753 AGGREGATION_NODE (id=21) ExecOption: Codegen Enabled - BuildTime: 26358591 - GetNewBlockTime: 30819756 - GetResultsTime: 1699622 - HTResizeTime: 20312894 - HashBuckets: 32768 - InactiveTotalTime: 0 - LargestPartitionPercent: 6 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 2790781 - PinTime: 0 - RowsRepartitioned: 0 - RowsReturned: 3585 - RowsReturnedRate: 11 - SpilledPartitions: 0 - TotalTime: 313751105240 - UnpinTime: 2765 EXCHANGE_NODE (id=20) - BytesReceived: 193818 - ConvertRowBatchTime: 836696 - DeserializeRowBatchTimer: 29161939 - FirstBatchArrivalWaitTime: 313313191798 - InactiveTotalTime: 313534184429 - PeakMemoryUsage: 0 - RowsReturned: 3585 - RowsReturnedRate: 11 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 313535587183 Instance b4afd338536090b:47bd038400000027 (host=redacted-host8:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 2985216 - PerHostPeakMemUsage: 225744219 - RowsProduced: 3523 - TotalNetworkReceiveTime: 307260895430 - TotalNetworkSendTime: 97180716 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 125 - TotalThreadsTotalWallClockTime: 309399863822 - TotalThreadsSysTime: 13998000 - TotalThreadsUserTime: 238963000 - TotalThreadsVoluntaryContextSwitches: 298 - TotalTime: 313514754906 Fragment Instance Lifecycle Timings - ExecTime: 224141650 - ExecTreeExecTime: 99279906 - InactiveTotalTime: 0 - OpenTime: 309175746217 - ExecTreeOpenTime: 307359602582 - PrepareTime: 4056209882 - ExecTreePrepareTime: 1850538323 - TotalTime: 0 DataStreamSender (dst_id=23) - BytesSent: 189067 - InactiveTotalTime: 0 - NetworkThroughput(*): 158944879 - OverallThroughput: 5797044 - PeakMemoryUsage: 180864 - RowsReturned: 3523 - SerializeBatchTime: 4240276 - TotalTime: 32614378 - TransmitDataRPCTime: 1189513 - UncompressedRowBatchSize: 358474 CodeGen - CodegenTime: 60477006 - CompileTime: 519243792 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076168 - NumFunctions: 54 - NumInstructions: 1085 - OptimizationTime: 1158029668 - PeakMemoryUsage: 555520 - PrepareTime: 2093606355 - TotalTime: 3794449067 AGGREGATION_NODE (id=21) ExecOption: Codegen Enabled - BuildTime: 62412836 - GetNewBlockTime: 1048832870 - GetResultsTime: 1694497 - HTResizeTime: 55504929 - HashBuckets: 32768 - InactiveTotalTime: 0 - LargestPartitionPercent: 7 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 2796984 - PinTime: 0 - RowsRepartitioned: 0 - RowsReturned: 3523 - RowsReturnedRate: 11 - SpilledPartitions: 0 - TotalTime: 309309348644 - UnpinTime: 6188 EXCHANGE_NODE (id=20) - BytesReceived: 189959 - ConvertRowBatchTime: 827749 - DeserializeRowBatchTimer: 21832734 - FirstBatchArrivalWaitTime: 307035481714 - InactiveTotalTime: 307253080649 - PeakMemoryUsage: 0 - RowsReturned: 3523 - RowsReturnedRate: 11 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 307262023129 Averaged Fragment F07 split sizes: min: 0, max: 0, avg: 0, stddev: 0 completion times: min:5m13s max:5m15s mean: 5m14s stddev:587.083ms execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec num instances: 8 - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 154266878 - PerHostPeakMemUsage: 224688800 - RowsProduced: 3617 - TotalNetworkReceiveTime: 307857967073 - TotalNetworkSendTime: 49709639 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 588 - TotalThreadsTotalWallClockTime: 313503782839 - TotalThreadsSysTime: 60865875 - TotalThreadsUserTime: 1044591125 - TotalThreadsVoluntaryContextSwitches: 1492 - TotalTime: 314724127381 Fragment Instance Lifecycle Timings - ExecTime: 151121907653 - ExecTreeExecTime: 151017704801 - InactiveTotalTime: 0 - OpenTime: 162381897484 - ExecTreeOpenTime: 159625826373 - PrepareTime: 1217138352 - ExecTreePrepareTime: 297386875 - TotalTime: 0 DataStreamSender (dst_id=20) - BytesSent: 195008 - InactiveTotalTime: 0 - NetworkThroughput(*): 151707085 - OverallThroughput: 22313908 - PeakMemoryUsage: 241152 - RowsReturned: 3617 - SerializeBatchTime: 7539941 - TotalTime: 15986001 - TransmitDataRPCTime: 1286287 - UncompressedRowBatchSize: 368003 CodeGen - CodegenTime: 28258060 - CompileTime: 705054027 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076168 - NumFunctions: 93 - NumInstructions: 3597 - OptimizationTime: 2007780251 - PeakMemoryUsage: 1841664 - PrepareTime: 486047986 - TotalTime: 3276224621 AGGREGATION_NODE (id=9) - GetNewBlockTime: 129318612 - GetResultsTime: 4999537 - HTResizeTime: 61575300 - HashBuckets: 32768 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 1921723 - PinTime: 0 - ReductionFactorEstimate: 0.0 - ReductionFactorThresholdToExpand: 0.0 - RowsPassedThrough: 0 - RowsReturned: 3617 - RowsReturnedRate: 11 - StreamingTime: 140960164 - TotalTime: 310940832331 - UnpinTime: 0 HASH_JOIN_NODE (id=8) - BuildRows: 312500 - BuildTime: 2088820905 - InactiveTotalTime: 0 - LocalTime: 2503653708 - NumHashTableBuildsSkipped: 0 - PeakMemoryUsage: 152278339 - ProbeRows: 38677 - ProbeRowsPartitioned: 0 - ProbeTime: 9797291 - RowsReturned: 38447 - RowsReturnedRate: 123 - TotalTime: 310495343465 Hash Join Builder (join_node_id=8) - BuildRowsPartitionTime: 1015070164 - BuildRowsPartitioned: 312500 - GetNewBlockTime: 602060112 - HashBuckets: 524288 - HashCollisions: 0 - HashTablesBuildTime: 1009333900 - InactiveTotalTime: 0 - LargestPartitionPercent: 6 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 152065152 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=19) - BytesReceived: 6085104 - ConvertRowBatchTime: 86226163 - DeserializeRowBatchTimer: 6544027807 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 312500 - RowsReturnedRate: 8269 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 38015780907 EXCHANGE_NODE (id=18) - BytesReceived: 1946935 - ConvertRowBatchTime: 15189726 - DeserializeRowBatchTimer: 807883915 - FirstBatchArrivalWaitTime: 117729074652 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 38677 - RowsReturnedRate: 142 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 269975908848 Fragment F07 Instance b4afd338536090b:47bd038400000019 (host=redacted-host4:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 154171892 - PerHostPeakMemUsage: 192884167 - RowsProduced: 3532 - TotalNetworkReceiveTime: 311146832678 - TotalNetworkSendTime: 55673979 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 619 - TotalThreadsTotalWallClockTime: 314533623546 - TotalThreadsSysTime: 40994000 - TotalThreadsUserTime: 992849000 - TotalThreadsVoluntaryContextSwitches: 1305 - TotalTime: 315087017992 Fragment Instance Lifecycle Timings - ExecTime: 150963835623 - ExecTreeExecTime: 150873155981 - InactiveTotalTime: 0 - OpenTime: 163569817026 - ExecTreeOpenTime: 161456857851 - PrepareTime: 553109934 - ExecTreePrepareTime: 111937671 - TotalTime: 0 DataStreamSender (dst_id=20) - BytesSent: 190499 - InactiveTotalTime: 0 - NetworkThroughput(*): 144041998 - OverallThroughput: 8480487 - PeakMemoryUsage: 241152 - RowsReturned: 3532 - SerializeBatchTime: 21054998 - TotalTime: 22463213 - TransmitDataRPCTime: 1322524 - UncompressedRowBatchSize: 359440 CodeGen - CodegenTime: 21919170 - CompileTime: 390071412 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076168 - NumFunctions: 93 - NumInstructions: 3597 - OptimizationTime: 1715411899 - PeakMemoryUsage: 1841664 - PrepareTime: 198117657 - TotalTime: 2317657929 AGGREGATION_NODE (id=9) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 55982936 - GetResultsTime: 1600241 - HTResizeTime: 1203130 - HashBuckets: 32768 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 1922263 - PinTime: 0 - ReductionFactorEstimate: 0.0 - ReductionFactorThresholdToExpand: 0.0 - RowsPassedThrough: 0 - RowsReturned: 3532 - RowsReturnedRate: 11 - StreamingTime: 30356602 - TotalTime: 312441891810 - UnpinTime: 0 HASH_JOIN_NODE (id=8) ExecOption: Probe Side Codegen Enabled - BuildRows: 312531 - BuildTime: 944030422 - InactiveTotalTime: 0 - LocalTime: 1024630795 - NumHashTableBuildsSkipped: 0 - PeakMemoryUsage: 152278445 - ProbeRows: 37584 - ProbeRowsPartitioned: 0 - ProbeTime: 8603203 - RowsReturned: 37584 - RowsReturnedRate: 120 - TotalTime: 312274694675 Hash Join Builder (join_node_id=8) ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 571410508 - BuildRowsPartitioned: 312531 - GetNewBlockTime: 143895676 - HashBuckets: 524288 - HashCollisions: 0 - HashTablesBuildTime: 360915543 - InactiveTotalTime: 0 - LargestPartitionPercent: 6 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 152065152 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=19) - BytesReceived: 6085253 - ConvertRowBatchTime: 79480418 - DeserializeRowBatchTimer: 4205800335 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 38962214962 - PeakMemoryUsage: 0 - RowsReturned: 312531 - RowsReturnedRate: 7849 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 39815979332 EXCHANGE_NODE (id=18) - BytesReceived: 1886595 - ConvertRowBatchTime: 9554663 - DeserializeRowBatchTimer: 41237266 - FirstBatchArrivalWaitTime: 119600485496 - InactiveTotalTime: 271402733386 - PeakMemoryUsage: 0 - RowsReturned: 37584 - RowsReturnedRate: 138 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 271434084548 Instance b4afd338536090b:47bd03840000001c (host=redacted-host3:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 154167730 - PerHostPeakMemUsage: 255202640 - RowsProduced: 3540 - TotalNetworkReceiveTime: 307687110082 - TotalNetworkSendTime: 37451921 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 616 - TotalThreadsTotalWallClockTime: 313949524939 - TotalThreadsSysTime: 96986000 - TotalThreadsUserTime: 1031843000 - TotalThreadsVoluntaryContextSwitches: 1593 - TotalTime: 315063799984 Fragment Instance Lifecycle Timings - ExecTime: 151361876881 - ExecTreeExecTime: 151268493944 - InactiveTotalTime: 0 - OpenTime: 162587662318 - ExecTreeOpenTime: 159963748491 - PrepareTime: 1114165428 - ExecTreePrepareTime: 226401710 - TotalTime: 0 DataStreamSender (dst_id=20) - BytesSent: 190790 - InactiveTotalTime: 0 - NetworkThroughput(*): 151936495 - OverallThroughput: 30179982 - PeakMemoryUsage: 241152 - RowsReturned: 3540 - SerializeBatchTime: 4975887 - TotalTime: 6321740 - TransmitDataRPCTime: 1255722 - UncompressedRowBatchSize: 360243 CodeGen - CodegenTime: 56278803 - CompileTime: 656262244 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076168 - NumFunctions: 93 - NumInstructions: 3597 - OptimizationTime: 1937552170 - PeakMemoryUsage: 1841664 - PrepareTime: 538113609 - TotalTime: 3133211858 AGGREGATION_NODE (id=9) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 64263676 - GetResultsTime: 1626066 - HTResizeTime: 52409420 - HashBuckets: 32768 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 1978923 - PinTime: 0 - ReductionFactorEstimate: 0.0 - ReductionFactorThresholdToExpand: 0.0 - RowsPassedThrough: 0 - RowsReturned: 3540 - RowsReturnedRate: 11 - StreamingTime: 129630109 - TotalTime: 311458590393 - UnpinTime: 0 HASH_JOIN_NODE (id=8) ExecOption: Probe Side Codegen Enabled - BuildRows: 312530 - BuildTime: 2711292477 - InactiveTotalTime: 0 - LocalTime: 3160808595 - NumHashTableBuildsSkipped: 0 - PeakMemoryUsage: 152278211 - ProbeRows: 37861 - ProbeRowsPartitioned: 0 - ProbeTime: 9262429 - RowsReturned: 37861 - RowsReturnedRate: 121 - TotalTime: 310959218817 Hash Join Builder (join_node_id=8) ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 1120779427 - BuildRowsPartitioned: 312530 - GetNewBlockTime: 716689504 - HashBuckets: 524288 - HashCollisions: 0 - HashTablesBuildTime: 1512549695 - InactiveTotalTime: 0 - LargestPartitionPercent: 6 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 152065152 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=19) - BytesReceived: 6086608 - ConvertRowBatchTime: 85979163 - DeserializeRowBatchTimer: 7018907894 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 36834876917 - PeakMemoryUsage: 0 - RowsReturned: 312530 - RowsReturnedRate: 8114 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 38513306298 EXCHANGE_NODE (id=18) - BytesReceived: 1901043 - ConvertRowBatchTime: 10632303 - DeserializeRowBatchTimer: 106396555 - FirstBatchArrivalWaitTime: 116865527232 - InactiveTotalTime: 269257517367 - PeakMemoryUsage: 0 - RowsReturned: 37861 - RowsReturnedRate: 140 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 269285103924 Instance b4afd338536090b:47bd03840000001b (host=redacted-host6:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 154214831 - PerHostPeakMemUsage: 233069701 - RowsProduced: 3584 - TotalNetworkReceiveTime: 308914882991 - TotalNetworkSendTime: 32743603 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 577 - TotalThreadsTotalWallClockTime: 313958383049 - TotalThreadsSysTime: 81987000 - TotalThreadsUserTime: 1090834000 - TotalThreadsVoluntaryContextSwitches: 1501 - TotalTime: 315047674907 Fragment Instance Lifecycle Timings - ExecTime: 151141386949 - ExecTreeExecTime: 151015395473 - InactiveTotalTime: 0 - OpenTime: 162817011623 - ExecTreeOpenTime: 160513153777 - PrepareTime: 1089157230 - ExecTreePrepareTime: 237834795 - TotalTime: 0 DataStreamSender (dst_id=20) - BytesSent: 193257 - InactiveTotalTime: 0 - NetworkThroughput(*): 143341694 - OverallThroughput: 19408475 - PeakMemoryUsage: 241152 - RowsReturned: 3584 - SerializeBatchTime: 8513122 - TotalTime: 9957351 - TransmitDataRPCTime: 1348226 - UncompressedRowBatchSize: 364655 CodeGen - CodegenTime: 16257608 - CompileTime: 612803917 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076168 - NumFunctions: 93 - NumInstructions: 3597 - OptimizationTime: 1669010538 - PeakMemoryUsage: 1841664 - PrepareTime: 340643315 - TotalTime: 2680880131 AGGREGATION_NODE (id=9) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 82738829 - GetResultsTime: 2239798 - HTResizeTime: 26256822 - HashBuckets: 32768 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 1867446 - PinTime: 0 - ReductionFactorEstimate: 0.0 - ReductionFactorThresholdToExpand: 0.0 - RowsPassedThrough: 0 - RowsReturned: 3584 - RowsReturnedRate: 11 - StreamingTime: 164358262 - TotalTime: 311766316964 - UnpinTime: 0 HASH_JOIN_NODE (id=8) ExecOption: Probe Side Codegen Enabled - BuildRows: 312485 - BuildTime: 1913225531 - InactiveTotalTime: 0 - LocalTime: 2289697080 - NumHashTableBuildsSkipped: 0 - PeakMemoryUsage: 152278337 - ProbeRows: 38110 - ProbeRowsPartitioned: 0 - ProbeTime: 16603108 - RowsReturned: 38110 - RowsReturnedRate: 122 - TotalTime: 311470771619 Hash Join Builder (join_node_id=8) ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 741202986 - BuildRowsPartitioned: 312485 - GetNewBlockTime: 317409507 - HashBuckets: 524288 - HashCollisions: 0 - HashTablesBuildTime: 1098208321 - InactiveTotalTime: 0 - LargestPartitionPercent: 6 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 152065152 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=19) - BytesReceived: 6083428 - ConvertRowBatchTime: 88008802 - DeserializeRowBatchTimer: 6129310191 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 35478046571 - PeakMemoryUsage: 0 - RowsReturned: 312485 - RowsReturnedRate: 8077 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 38688143064 EXCHANGE_NODE (id=18) - BytesReceived: 1912382 - ConvertRowBatchTime: 21078789 - DeserializeRowBatchTimer: 482449243 - FirstBatchArrivalWaitTime: 118159285252 - InactiveTotalTime: 269532857889 - PeakMemoryUsage: 0 - RowsReturned: 38110 - RowsReturnedRate: 140 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 270492931475 Instance b4afd338536090b:47bd03840000001d (host=redacted-host1:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 154297685 - PerHostPeakMemUsage: 233205973 - RowsProduced: 3571 - TotalNetworkReceiveTime: 308823107462 - TotalNetworkSendTime: 18226865 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 590 - TotalThreadsTotalWallClockTime: 314433810651 - TotalThreadsSysTime: 43993000 - TotalThreadsUserTime: 1033843000 - TotalThreadsVoluntaryContextSwitches: 1532 - TotalTime: 315035608944 Fragment Instance Lifecycle Timings - ExecTime: 151059160049 - ExecTreeExecTime: 150965301658 - InactiveTotalTime: 0 - OpenTime: 163374668070 - ExecTreeOpenTime: 160555319244 - PrepareTime: 601660647 - ExecTreePrepareTime: 22488938 - TotalTime: 0 DataStreamSender (dst_id=20) - BytesSent: 192281 - InactiveTotalTime: 0 - NetworkThroughput(*): 154665561 - OverallThroughput: 25990564 - PeakMemoryUsage: 241152 - RowsReturned: 3571 - SerializeBatchTime: 6038429 - TotalTime: 7398108 - TransmitDataRPCTime: 1243205 - UncompressedRowBatchSize: 362857 CodeGen - CodegenTime: 49079292 - CompileTime: 838554755 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076168 - NumFunctions: 93 - NumInstructions: 3597 - OptimizationTime: 1928950360 - PeakMemoryUsage: 1841664 - PrepareTime: 267485505 - TotalTime: 3075692481 AGGREGATION_NODE (id=9) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 8824933 - GetResultsTime: 1572661 - HTResizeTime: 2111902 - HashBuckets: 32768 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 1963958 - PinTime: 0 - ReductionFactorEstimate: 0.0 - ReductionFactorThresholdToExpand: 0.0 - RowsPassedThrough: 0 - RowsReturned: 3571 - RowsReturnedRate: 11 - StreamingTime: 31274433 - TotalTime: 311543054412 - UnpinTime: 0 HASH_JOIN_NODE (id=8) ExecOption: Probe Side Codegen Enabled - BuildRows: 312529 - BuildTime: 2362412714 - InactiveTotalTime: 0 - LocalTime: 2468374152 - NumHashTableBuildsSkipped: 0 - PeakMemoryUsage: 152278355 - ProbeRows: 39920 - ProbeRowsPartitioned: 0 - ProbeTime: 7942598 - RowsReturned: 38083 - RowsReturnedRate: 122 - TotalTime: 311402169612 Hash Join Builder (join_node_id=8) ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 1385143378 - BuildRowsPartitioned: 312529 - GetNewBlockTime: 1017865282 - HashBuckets: 524288 - HashCollisions: 0 - HashTablesBuildTime: 880728979 - InactiveTotalTime: 0 - LargestPartitionPercent: 6 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 152065152 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=19) - BytesReceived: 6086289 - ConvertRowBatchTime: 85857867 - DeserializeRowBatchTimer: 5709437857 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 37118099385 - PeakMemoryUsage: 0 - RowsReturned: 312529 - RowsReturnedRate: 8026 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 38936801353 EXCHANGE_NODE (id=18) - BytesReceived: 2048356 - ConvertRowBatchTime: 10854763 - DeserializeRowBatchTimer: 65466031 - FirstBatchArrivalWaitTime: 117874425996 - InactiveTotalTime: 269927366041 - PeakMemoryUsage: 0 - RowsReturned: 39920 - RowsReturnedRate: 147 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 269996994107 Instance b4afd338536090b:47bd038400000020 (host=redacted-host2:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 154168096 - PerHostPeakMemUsage: 233085705 - RowsProduced: 3669 - TotalNetworkReceiveTime: 309182299246 - TotalNetworkSendTime: 102542242 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 600 - TotalThreadsTotalWallClockTime: 314080328410 - TotalThreadsSysTime: 48993000 - TotalThreadsUserTime: 1042841000 - TotalThreadsVoluntaryContextSwitches: 1408 - TotalTime: 314972297783 Fragment Instance Lifecycle Timings - ExecTime: 151275050458 - ExecTreeExecTime: 151095515571 - InactiveTotalTime: 0 - OpenTime: 162805316026 - ExecTreeOpenTime: 160653466975 - PrepareTime: 891798586 - ExecTreePrepareTime: 132470945 - TotalTime: 0 DataStreamSender (dst_id=20) - BytesSent: 197593 - InactiveTotalTime: 0 - NetworkThroughput(*): 156599483 - OverallThroughput: 27734141 - PeakMemoryUsage: 241152 - RowsReturned: 3669 - SerializeBatchTime: 5750186 - TotalTime: 7124540 - TransmitDataRPCTime: 1261773 - UncompressedRowBatchSize: 373192 CodeGen - CodegenTime: 37131922 - CompileTime: 303004438 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076168 - NumFunctions: 93 - NumInstructions: 3597 - OptimizationTime: 1783583920 - PeakMemoryUsage: 1841664 - PrepareTime: 409016610 - TotalTime: 2538304568 AGGREGATION_NODE (id=9) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 24861837 - GetResultsTime: 2427033 - HTResizeTime: 64346428 - HashBuckets: 32768 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 1972930 - PinTime: 0 - ReductionFactorEstimate: 0.0 - ReductionFactorThresholdToExpand: 0.0 - RowsPassedThrough: 0 - RowsReturned: 3669 - RowsReturnedRate: 11 - StreamingTime: 103643688 - TotalTime: 311881396039 - UnpinTime: 0 HASH_JOIN_NODE (id=8) ExecOption: Probe Side Codegen Enabled - BuildRows: 312493 - BuildTime: 1905412550 - InactiveTotalTime: 0 - LocalTime: 2275191919 - NumHashTableBuildsSkipped: 0 - PeakMemoryUsage: 152278307 - ProbeRows: 38881 - ProbeRowsPartitioned: 0 - ProbeTime: 8570369 - RowsReturned: 38881 - RowsReturnedRate: 124 - TotalTime: 311580785761 Hash Join Builder (join_node_id=8) ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 820285553 - BuildRowsPartitioned: 312493 - GetNewBlockTime: 382296020 - HashBuckets: 524288 - HashCollisions: 0 - HashTablesBuildTime: 1069120278 - InactiveTotalTime: 0 - LargestPartitionPercent: 6 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 152065152 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=19) - BytesReceived: 6084544 - ConvertRowBatchTime: 91047829 - DeserializeRowBatchTimer: 5110796642 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 37688781683 - PeakMemoryUsage: 0 - RowsReturned: 312493 - RowsReturnedRate: 7810 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 40010840588 EXCHANGE_NODE (id=18) - BytesReceived: 1950736 - ConvertRowBatchTime: 17566585 - DeserializeRowBatchTimer: 108910444 - FirstBatchArrivalWaitTime: 116760146845 - InactiveTotalTime: 269259364016 - PeakMemoryUsage: 0 - RowsReturned: 38881 - RowsReturnedRate: 144 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 269294753254 Instance b4afd338536090b:47bd03840000001e (host=redacted-host7:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 154168000 - PerHostPeakMemUsage: 234788716 - RowsProduced: 3676 - TotalNetworkReceiveTime: 309658225847 - TotalNetworkSendTime: 79472455 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 604 - TotalThreadsTotalWallClockTime: 313862966028 - TotalThreadsSysTime: 40994000 - TotalThreadsUserTime: 1011846000 - TotalThreadsVoluntaryContextSwitches: 1363 - TotalTime: 314726760165 Fragment Instance Lifecycle Timings - ExecTime: 151163013374 - ExecTreeExecTime: 151058325215 - InactiveTotalTime: 0 - OpenTime: 162699966294 - ExecTreeOpenTime: 160215510524 - PrepareTime: 863667801 - ExecTreePrepareTime: 84053739 - TotalTime: 0 DataStreamSender (dst_id=20) - BytesSent: 198353 - InactiveTotalTime: 0 - NetworkThroughput(*): 153545266 - OverallThroughput: 29454343 - PeakMemoryUsage: 241152 - RowsReturned: 3676 - SerializeBatchTime: 5336966 - TotalTime: 6734253 - TransmitDataRPCTime: 1291821 - UncompressedRowBatchSize: 374018 CodeGen - CodegenTime: 20202094 - CompileTime: 613157360 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076168 - NumFunctions: 93 - NumInstructions: 3597 - OptimizationTime: 1828692689 - PeakMemoryUsage: 1841664 - PrepareTime: 459757549 - TotalTime: 2995259005 AGGREGATION_NODE (id=9) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 22101145 - GetResultsTime: 26881264 - HTResizeTime: 138091673 - HashBuckets: 32768 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 1847600 - PinTime: 0 - ReductionFactorEstimate: 0.0 - ReductionFactorThresholdToExpand: 0.0 - RowsPassedThrough: 0 - RowsReturned: 3676 - RowsReturnedRate: 11 - StreamingTime: 163162430 - TotalTime: 311357623345 - UnpinTime: 0 HASH_JOIN_NODE (id=8) ExecOption: Probe Side Codegen Enabled - BuildRows: 312586 - BuildTime: 995251409 - InactiveTotalTime: 0 - LocalTime: 1231277995 - NumHashTableBuildsSkipped: 0 - PeakMemoryUsage: 152278469 - ProbeRows: 39053 - ProbeRowsPartitioned: 0 - ProbeTime: 8391696 - RowsReturned: 39053 - RowsReturnedRate: 125 - TotalTime: 311018360323 Hash Join Builder (join_node_id=8) ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 694048573 - BuildRowsPartitioned: 312586 - GetNewBlockTime: 161538503 - HashBuckets: 524288 - HashCollisions: 0 - HashTablesBuildTime: 290458260 - InactiveTotalTime: 0 - LargestPartitionPercent: 6 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 152065152 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=19) - BytesReceived: 6086416 - ConvertRowBatchTime: 91759786 - DeserializeRowBatchTimer: 4418555565 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 38078800656 - PeakMemoryUsage: 0 - RowsReturned: 312586 - RowsReturnedRate: 7943 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 39352072726 EXCHANGE_NODE (id=18) - BytesReceived: 1960646 - ConvertRowBatchTime: 23476113 - DeserializeRowBatchTimer: 95793157 - FirstBatchArrivalWaitTime: 118100606272 - InactiveTotalTime: 270380632921 - PeakMemoryUsage: 0 - RowsReturned: 39053 - RowsReturnedRate: 144 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 270435009602 Instance b4afd338536090b:47bd03840000001a (host=redacted-host5:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 154167892 - PerHostPeakMemUsage: 189529285 - RowsProduced: 3748 - TotalNetworkReceiveTime: 308280965257 - TotalNetworkSendTime: 16771838 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 542 - TotalThreadsTotalWallClockTime: 314002230945 - TotalThreadsSysTime: 75989000 - TotalThreadsUserTime: 1046841000 - TotalThreadsVoluntaryContextSwitches: 1681 - TotalTime: 314687294392 Fragment Instance Lifecycle Timings - ExecTime: 150902894704 - ExecTreeExecTime: 150840387531 - InactiveTotalTime: 0 - OpenTime: 163099358846 - ExecTreeOpenTime: 160373556352 - PrepareTime: 660530672 - ExecTreePrepareTime: 96048575 - TotalTime: 0 DataStreamSender (dst_id=20) - BytesSent: 201943 - InactiveTotalTime: 0 - NetworkThroughput(*): 156904869 - OverallThroughput: 34110823 - PeakMemoryUsage: 241152 - RowsReturned: 3748 - SerializeBatchTime: 4544185 - TotalTime: 5920203 - TransmitDataRPCTime: 1287041 - UncompressedRowBatchSize: 381419 CodeGen - CodegenTime: 11943986 - CompileTime: 1039576041 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076168 - NumFunctions: 93 - NumInstructions: 3597 - OptimizationTime: 1641732976 - PeakMemoryUsage: 1841664 - PrepareTime: 268797742 - TotalTime: 3048274646 AGGREGATION_NODE (id=9) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 36221054 - GetResultsTime: 1792925 - HTResizeTime: 152425387 - HashBuckets: 32768 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 1903935 - PinTime: 0 - ReductionFactorEstimate: 0.0 - ReductionFactorThresholdToExpand: 0.0 - RowsPassedThrough: 0 - RowsReturned: 3748 - RowsReturnedRate: 12 - StreamingTime: 226662148 - TotalTime: 311309933669 - UnpinTime: 0 HASH_JOIN_NODE (id=8) ExecOption: Probe Side Codegen Enabled - BuildRows: 312385 - BuildTime: 2272018624 - InactiveTotalTime: 0 - LocalTime: 2591321930 - NumHashTableBuildsSkipped: 0 - PeakMemoryUsage: 152278337 - ProbeRows: 39436 - ProbeRowsPartitioned: 0 - ProbeTime: 8947480 - RowsReturned: 39436 - RowsReturnedRate: 126 - TotalTime: 310977044786 Hash Join Builder (join_node_id=8) ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 1354544146 - BuildRowsPartitioned: 312385 - GetNewBlockTime: 869169854 - HashBuckets: 524288 - HashCollisions: 0 - HashTablesBuildTime: 901607950 - InactiveTotalTime: 0 - LargestPartitionPercent: 6 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 152065152 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=19) - BytesReceived: 6085185 - ConvertRowBatchTime: 79553978 - DeserializeRowBatchTimer: 5511528939 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 36482500866 - PeakMemoryUsage: 0 - RowsReturned: 312385 - RowsReturnedRate: 8278 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 37734377462 EXCHANGE_NODE (id=18) - BytesReceived: 1980386 - ConvertRowBatchTime: 11549054 - DeserializeRowBatchTimer: 266292827 - FirstBatchArrivalWaitTime: 118535719948 - InactiveTotalTime: 270628404006 - PeakMemoryUsage: 0 - RowsReturned: 39436 - RowsReturnedRate: 145 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 270651345394 Instance b4afd338536090b:47bd03840000001f (host=redacted-host8:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 154778905 - PerHostPeakMemUsage: 225744219 - RowsProduced: 3619 - TotalNetworkReceiveTime: 299170313025 - TotalNetworkSendTime: 54794209 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 556 - TotalThreadsTotalWallClockTime: 309209395147 - TotalThreadsSysTime: 56991000 - TotalThreadsUserTime: 1105832000 - TotalThreadsVoluntaryContextSwitches: 1557 - TotalTime: 313172564881 Fragment Instance Lifecycle Timings - ExecTime: 151108043190 - ExecTreeExecTime: 151025063037 - InactiveTotalTime: 0 - OpenTime: 158101379675 - ExecTreeOpenTime: 153274997776 - PrepareTime: 3963016524 - ExecTreePrepareTime: 1467858633 - TotalTime: 0 DataStreamSender (dst_id=20) - BytesSent: 195353 - InactiveTotalTime: 0 - NetworkThroughput(*): 152621319 - OverallThroughput: 3152451 - PeakMemoryUsage: 241152 - RowsReturned: 3619 - SerializeBatchTime: 4105762 - TotalTime: 61968600 - TransmitDataRPCTime: 1279985 - UncompressedRowBatchSize: 368205 CodeGen - CodegenTime: 13251610 - CompileTime: 1187002051 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076168 - NumFunctions: 93 - NumInstructions: 3597 - OptimizationTime: 3557307460 - PeakMemoryUsage: 1841664 - PrepareTime: 1406451902 - TotalTime: 6420516351 AGGREGATION_NODE (id=9) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 739554490 - GetResultsTime: 1856309 - HTResizeTime: 55757642 - HashBuckets: 32768 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 1916732 - PinTime: 0 - ReductionFactorEstimate: 0.0 - ReductionFactorThresholdToExpand: 0.0 - RowsPassedThrough: 0 - RowsReturned: 3619 - RowsReturnedRate: 11 - StreamingTime: 278593645 - TotalTime: 305767852019 - UnpinTime: 0 HASH_JOIN_NODE (id=8) ExecOption: Probe Side Codegen Enabled - BuildRows: 312461 - BuildTime: 3606923519 - InactiveTotalTime: 0 - LocalTime: 4987927205 - NumHashTableBuildsSkipped: 0 - PeakMemoryUsage: 152278251 - ProbeRows: 38571 - ProbeRowsPartitioned: 0 - ProbeTime: 10057446 - RowsReturned: 38571 - RowsReturnedRate: 126 - TotalTime: 304279702128 Hash Join Builder (join_node_id=8) ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 1433146747 - BuildRowsPartitioned: 312461 - GetNewBlockTime: 1207616555 - HashBuckets: 524288 - HashCollisions: 0 - HashTablesBuildTime: 1961082176 - InactiveTotalTime: 0 - LargestPartitionPercent: 6 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 152065152 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=19) - BytesReceived: 6083114 - ConvertRowBatchTime: 88121464 - DeserializeRowBatchTimer: 14247885039 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 30807335774 - PeakMemoryUsage: 0 - RowsReturned: 312461 - RowsReturnedRate: 10055 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 31074726439 EXCHANGE_NODE (id=18) - BytesReceived: 1935336 - ConvertRowBatchTime: 16805541 - DeserializeRowBatchTimer: 5296525802 - FirstBatchArrivalWaitTime: 115936400180 - InactiveTotalTime: 265818178598 - PeakMemoryUsage: 0 - RowsReturned: 38571 - RowsReturnedRate: 143 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 268217048484 Averaged Fragment F02 split sizes: min: 123.03 MB, max: 163.70 MB, avg: 145.82 MB, stddev: 11.21 MB completion times: min:2m57s max:5m13s mean: 3m21s stddev:42s361ms execution rates: min:402.13 KB/sec max:899.28 KB/sec mean:769.81 KB/sec stddev:145.77 KB/sec num instances: 8 - AverageThreadTokens: 1.1736078503147167 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 36990601 - PerHostPeakMemUsage: 224688800 - RowsProduced: 38677 - TotalNetworkReceiveTime: 153807048965 - TotalNetworkSendTime: 4576924908 - TotalStorageWaitTime: 13779264225 - TotalThreadsInvoluntaryContextSwitches: 8978 - TotalThreadsTotalWallClockTime: 240173132877 - TotalThreadsSysTime: 271708000 - TotalThreadsUserTime: 7834058875 - TotalThreadsVoluntaryContextSwitches: 5661 - TotalTime: 201454960088 Fragment Instance Lifecycle Timings - ExecTime: 38929975313 - ExecTreeExecTime: 33354337595 - InactiveTotalTime: 0 - OpenTime: 161495284900 - ExecTreeOpenTime: 155326638903 - PrepareTime: 1028993429 - ExecTreePrepareTime: 92470800 - TotalTime: 0 DataStreamSender (dst_id=18) - BytesSent: 1946935 - InactiveTotalTime: 0 - NetworkThroughput(*): 86767701 - OverallThroughput: 13885681 - PeakMemoryUsage: 257792 - RowsReturned: 38677 - SerializeBatchTime: 118347820 - TotalTime: 141000763 - TransmitDataRPCTime: 22416975 - UncompressedRowBatchSize: 6272477 CodeGen - CodegenTime: 4300940 - CompileTime: 2200999894 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076168 - NumFunctions: 105 - NumInstructions: 6894 - OptimizationTime: 3914361624 - PeakMemoryUsage: 3529728 - PrepareTime: 497285533 - TotalTime: 6646897466 HASH_JOIN_NODE (id=7) - BuildRows: 90 - BuildTime: 90590876 - InactiveTotalTime: 0 - LocalTime: 190655986 - NumHashTableBuildsSkipped: 0 - PeakMemoryUsage: 8511837 - ProbeRows: 38677 - ProbeRowsPartitioned: 0 - ProbeTime: 11022979 - RowsReturned: 38677 - RowsReturnedRate: 212 - TotalTime: 188855825219 Hash Join Builder (join_node_id=7) - BuildRowsPartitionTime: 497389 - BuildRowsPartitioned: 90 - GetNewBlockTime: 77603040 - HashBuckets: 202 - HashCollisions: 0 - HashTablesBuildTime: 299412 - InactiveTotalTime: 0 - LargestPartitionPercent: 14 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 1062016 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=17) - BytesReceived: 1257 - ConvertRowBatchTime: 34291 - DeserializeRowBatchTimer: 62355 - FirstBatchArrivalWaitTime: 153343238013 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 90 - RowsReturnedRate: 0 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 153806963814 HASH_JOIN_NODE (id=6) - BuildRows: 1800 - BuildTime: 34266668 - InactiveTotalTime: 0 - LocalTime: 120423053 - NumHashTableBuildsSkipped: 0 - PeakMemoryUsage: 4068193 - ProbeRows: 157890 - ProbeRowsPartitioned: 0 - ProbeTime: 27908184 - RowsReturned: 38677 - RowsReturnedRate: 2013 - TotalTime: 34858205418 Hash Join Builder (join_node_id=6) - BuildRowsPartitionTime: 512931 - BuildRowsPartitioned: 1800 - GetNewBlockTime: 30880056 - HashBuckets: 4096 - HashCollisions: 0 - HashTablesBuildTime: 2501753 - InactiveTotalTime: 0 - LargestPartitionPercent: 7 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 1135744 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=16) - BytesReceived: 14556 - ConvertRowBatchTime: 545586 - DeserializeRowBatchTimer: 1843001 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 1800 - RowsReturnedRate: 3682206 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 697420 HASH_JOIN_NODE (id=5) - BuildRows: 49 - BuildTime: 26527633 - InactiveTotalTime: 0 - LocalTime: 377919090 - NumHashTableBuildsSkipped: 0 - PeakMemoryUsage: 2563931 - ProbeRows: 3100652 - ProbeRowsPartitioned: 0 - ProbeTime: 282267343 - RowsReturned: 157890 - RowsReturnedRate: 8266 - TotalTime: 34737084944 Hash Join Builder (join_node_id=5) - BuildRowsPartitionTime: 59856 - BuildRowsPartitioned: 49 - GetNewBlockTime: 25927153 - HashBuckets: 87 - HashCollisions: 0 - HashTablesBuildTime: 231866 - InactiveTotalTime: 0 - LargestPartitionPercent: 12 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 1071600 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=15) - BytesReceived: 827 - ConvertRowBatchTime: 21721 - DeserializeRowBatchTimer: 44107 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 49 - RowsReturnedRate: 1216743 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 43272 HDFS_SCAN_NODE (id=0) - AverageHdfsReadThreadConcurrency: 4.512635379061372E-4 - AverageScannerThreadConcurrency: 0.9805555555555555 - BytesRead: 46291627 - BytesReadDataNodeCache: 0 - BytesReadLocal: 46291627 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 46291627 - DecompressionTime: 216714817 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 8 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 8 - NumRowGroups: 11 - NumScannerThreadsStarted: 1 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 21316080 - PerReadThreadRawHdfsThroughput: 680907262 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 34173465483 - RowBatchQueuePutWaitTime: 2119934451 - RowsRead: 3100652 - RowsReturned: 3100652 - RowsReturnedRate: 166270 - ScanRangesComplete: 11 - ScannerThreadsInvoluntaryContextSwitches: 7998 - ScannerThreadsTotalWallClockTime: 39747897535 - MaterializeTupleTime(*): 19083840901 - ScannerThreadsSysTime: 184096500 - ScannerThreadsUserTime: 6134192500 - ScannerThreadsVoluntaryContextSwitches: 2160 - TotalRawHdfsReadTime(*): 79887876 - TotalReadThroughput: 245189 - TotalTime: 34359122581 Fragment F02 Instance b4afd338536090b:47bd038400000010 (host=redacted-host8:22000) Hdfs split stats (:<# splits>/): 2:1/12.24 MB 0:1/12.34 MB 10:1/12.20 MB 7:1/12.31 MB 1:2/24.57 MB 11:2/24.68 MB 5:2/24.68 MB - AverageThreadTokens: 1.5027223230490019 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 26263809 - PerHostPeakMemUsage: 225744219 - RowsProduced: 32962 - TotalNetworkReceiveTime: 141050371806 - TotalNetworkSendTime: 114431428 - TotalStorageWaitTime: 105132746316 - TotalThreadsInvoluntaryContextSwitches: 6552 - TotalThreadsTotalWallClockTime: 463541745018 - TotalThreadsSysTime: 273958000 - TotalThreadsUserTime: 7390876000 - TotalThreadsVoluntaryContextSwitches: 9273 - TotalTime: 313028970284 Fragment Instance Lifecycle Timings - ExecTime: 151327866838 - ExecTreeExecTime: 147864778702 - InactiveTotalTime: 0 - OpenTime: 159190114307 - ExecTreeOpenTime: 143688571546 - PrepareTime: 2510882822 - ExecTreePrepareTime: 302808610 - TotalTime: 0 DataStreamSender (dst_id=18) - BytesSent: 1658691 - InactiveTotalTime: 0 - NetworkThroughput(*): 81779952 - OverallThroughput: 14805413 - PeakMemoryUsage: 245504 - RowsReturned: 32962 - SerializeBatchTime: 91363843 - TotalTime: 112032734 - TransmitDataRPCTime: 20282367 - UncompressedRowBatchSize: 5345136 CodeGen - CodegenTime: 893790 - CompileTime: 8045040348 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076168 - NumFunctions: 105 - NumInstructions: 6894 - OptimizationTime: 7318317473 - PeakMemoryUsage: 3529728 - PrepareTime: 1595499035 - TotalTime: 17038200515 HASH_JOIN_NODE (id=7) ExecOption: Probe Side Codegen Enabled - BuildRows: 90 - BuildTime: 537417103 - InactiveTotalTime: 0 - LocalTime: 896168216 - NumHashTableBuildsSkipped: 0 - PeakMemoryUsage: 8729936 - ProbeRows: 32962 - ProbeRowsPartitioned: 0 - ProbeTime: 7059022 - RowsReturned: 32962 - RowsReturnedRate: 112 - TotalTime: 292086853855 Hash Join Builder (join_node_id=7) ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 100676 - BuildRowsPartitioned: 90 - GetNewBlockTime: 500584111 - HashBuckets: 202 - HashCollisions: 0 - HashTablesBuildTime: 231044 - InactiveTotalTime: 0 - LargestPartitionPercent: 14 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 1062016 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=17) - BytesReceived: 1257 - ConvertRowBatchTime: 71641 - DeserializeRowBatchTimer: 99412 - FirstBatchArrivalWaitTime: 140986651821 - InactiveTotalTime: 141029299247 - PeakMemoryUsage: 0 - RowsReturned: 90 - RowsReturnedRate: 0 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 141050412974 HASH_JOIN_NODE (id=6) ExecOption: Probe Side Codegen Enabled - BuildRows: 1800 - BuildTime: 139228395 - InactiveTotalTime: 0 - LocalTime: 340642844 - NumHashTableBuildsSkipped: 0 - PeakMemoryUsage: 3967152 - ProbeRows: 133457 - ProbeRowsPartitioned: 0 - ProbeTime: 24460962 - RowsReturned: 32962 - RowsReturnedRate: 219 - TotalTime: 150140272665 Hash Join Builder (join_node_id=6) ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 511548 - BuildRowsPartitioned: 1800 - GetNewBlockTime: 123471559 - HashBuckets: 4096 - HashCollisions: 0 - HashTablesBuildTime: 14765347 - InactiveTotalTime: 0 - LargestPartitionPercent: 7 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 1135744 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=16) - BytesReceived: 14556 - ConvertRowBatchTime: 468988 - DeserializeRowBatchTimer: 14020428 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 1800 - RowsReturnedRate: 3310862 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 543665 HASH_JOIN_NODE (id=5) ExecOption: Probe Side Codegen Enabled - BuildRows: 49 - BuildTime: 80821826 - InactiveTotalTime: 0 - LocalTime: 359972690 - NumHashTableBuildsSkipped: 0 - PeakMemoryUsage: 2380784 - ProbeRows: 2611325 - ProbeRowsPartitioned: 0 - ProbeTime: 233104167 - RowsReturned: 133457 - RowsReturnedRate: 890 - TotalTime: 149799086156 Hash Join Builder (join_node_id=5) ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 96331 - BuildRowsPartitioned: 49 - GetNewBlockTime: 80013986 - HashBuckets: 87 - HashCollisions: 0 - HashTablesBuildTime: 245382 - InactiveTotalTime: 0 - LargestPartitionPercent: 12 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 1071600 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=15) - BytesReceived: 827 - ConvertRowBatchTime: 29401 - DeserializeRowBatchTimer: 68384 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 49 - RowsReturnedRate: 824721 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 59414 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 2:1/12.24 MB 0:1/12.34 MB 10:1/12.20 MB 7:1/12.31 MB 1:2/24.57 MB 11:2/24.68 MB 5:2/24.68 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 10 out of 10 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:80 - AverageHdfsReadThreadConcurrency: 0.0036101083032490976 - AverageScannerThreadConcurrency: 1.0 - BytesRead: 38877053 - BytesReadDataNodeCache: 0 - BytesReadLocal: 38877053 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 38877053 - DecompressionTime: 719691901 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 8 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 7 - NumRowGroups: 10 - NumScannerThreadsStarted: 1 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 9548875 - PerReadThreadRawHdfsThroughput: 231620326 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 149104482305 - RowBatchQueuePutWaitTime: 0 - RowsRead: 2611325 - RowsReturned: 2611325 - RowsReturnedRate: 17474 - ScanRangesComplete: 10 - ScannerThreadsInvoluntaryContextSwitches: 5716 - ScannerThreadsTotalWallClockTime: 153023788351 - MaterializeTupleTime(*): 39241861342 - ScannerThreadsSysTime: 183972000 - ScannerThreadsUserTime: 5532159000 - ScannerThreadsVoluntaryContextSwitches: 4765 - TotalRawHdfsReadTime(*): 167848192 - TotalReadThroughput: 141329 - TotalTime: 149439054052 Instance b4afd338536090b:47bd03840000000c (host=redacted-host6:22000) Hdfs split stats (:<# splits>/): 3:1/12.22 MB 0:1/12.39 MB 5:2/24.64 MB 11:2/24.88 MB 8:1/12.48 MB 4:1/12.24 MB 10:1/12.27 MB 6:1/12.36 MB 7:2/24.78 MB - AverageThreadTokens: 1.1497326203208555 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 35671679 - PerHostPeakMemUsage: 233069701 - RowsProduced: 38451 - TotalNetworkReceiveTime: 155362386374 - TotalNetworkSendTime: 3353516151 - TotalStorageWaitTime: 1955336127 - TotalThreadsInvoluntaryContextSwitches: 9717 - TotalThreadsTotalWallClockTime: 219457302301 - TotalThreadsSysTime: 344947000 - TotalThreadsUserTime: 8138763000 - TotalThreadsVoluntaryContextSwitches: 5642 - TotalTime: 190913376165 Fragment Instance Lifecycle Timings - ExecTime: 28216479508 - ExecTreeExecTime: 24043792178 - InactiveTotalTime: 0 - OpenTime: 161818732476 - ExecTreeOpenTime: 156669749126 - PrepareTime: 877969136 - ExecTreePrepareTime: 100818512 - TotalTime: 0 DataStreamSender (dst_id=18) - BytesSent: 1935898 - InactiveTotalTime: 0 - NetworkThroughput(*): 84261246 - OverallThroughput: 14702603 - PeakMemoryUsage: 261888 - RowsReturned: 38451 - SerializeBatchTime: 108421856 - TotalTime: 131670423 - TransmitDataRPCTime: 22974951 - UncompressedRowBatchSize: 6235317 CodeGen - CodegenTime: 1624846 - CompileTime: 1914405546 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076168 - NumFunctions: 105 - NumInstructions: 6894 - OptimizationTime: 3172298730 - PeakMemoryUsage: 3529728 - PrepareTime: 284085335 - TotalTime: 5377375702 HASH_JOIN_NODE (id=7) ExecOption: Probe Side Codegen Enabled - BuildRows: 90 - BuildTime: 1101032 - InactiveTotalTime: 0 - LocalTime: 176292373 - NumHashTableBuildsSkipped: 0 - PeakMemoryUsage: 8483992 - ProbeRows: 38451 - ProbeRowsPartitioned: 0 - ProbeTime: 7769085 - RowsReturned: 38451 - RowsReturnedRate: 212 - TotalTime: 180910610243 Hash Join Builder (join_node_id=7) ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 53267 - BuildRowsPartitioned: 90 - GetNewBlockTime: 137339 - HashBuckets: 202 - HashCollisions: 0 - HashTablesBuildTime: 198164 - InactiveTotalTime: 0 - LargestPartitionPercent: 14 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 1062016 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=17) - BytesReceived: 1257 - ConvertRowBatchTime: 21489 - DeserializeRowBatchTimer: 41819 - FirstBatchArrivalWaitTime: 154817635697 - InactiveTotalTime: 155362350395 - PeakMemoryUsage: 0 - RowsReturned: 90 - RowsReturnedRate: 0 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 155362396183 HASH_JOIN_NODE (id=6) ExecOption: Probe Side Codegen Enabled - BuildRows: 1800 - BuildTime: 4381675 - InactiveTotalTime: 0 - LocalTime: 66702439 - NumHashTableBuildsSkipped: 0 - PeakMemoryUsage: 4125600 - ProbeRows: 160258 - ProbeRowsPartitioned: 0 - ProbeTime: 29966003 - RowsReturned: 38451 - RowsReturnedRate: 1515 - TotalTime: 25371921687 Hash Join Builder (join_node_id=6) ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 344548 - BuildRowsPartitioned: 1800 - GetNewBlockTime: 3097279 - HashBuckets: 4096 - HashCollisions: 0 - HashTablesBuildTime: 579647 - InactiveTotalTime: 0 - LargestPartitionPercent: 7 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 1135744 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=16) - BytesReceived: 14556 - ConvertRowBatchTime: 372004 - DeserializeRowBatchTimer: 99575 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 1800 - RowsReturnedRate: 4423430 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 406924 HASH_JOIN_NODE (id=5) ExecOption: Probe Side Codegen Enabled - BuildRows: 49 - BuildTime: 541740 - InactiveTotalTime: 0 - LocalTime: 379001164 - NumHashTableBuildsSkipped: 0 - PeakMemoryUsage: 2398480 - ProbeRows: 3146621 - ProbeRowsPartitioned: 0 - ProbeTime: 328978070 - RowsReturned: 160258 - RowsReturnedRate: 6333 - TotalTime: 25304812324 Hash Join Builder (join_node_id=5) ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 20186 - BuildRowsPartitioned: 49 - GetNewBlockTime: 117219 - HashBuckets: 87 - HashCollisions: 0 - HashTablesBuildTime: 194604 - InactiveTotalTime: 0 - LargestPartitionPercent: 12 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 1071600 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=15) - BytesReceived: 827 - ConvertRowBatchTime: 12823 - DeserializeRowBatchTimer: 42118 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 49 - RowsReturnedRate: 1639673 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 29884 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 3:1/12.22 MB 0:1/12.39 MB 5:2/24.64 MB 11:2/24.88 MB 8:1/12.48 MB 4:1/12.24 MB 10:1/12.27 MB 6:1/12.36 MB 7:2/24.78 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 12 out of 12 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:96 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 1.0 - BytesRead: 46914805 - BytesReadDataNodeCache: 0 - BytesReadLocal: 46914805 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 46914805 - DecompressionTime: 269284594 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 8 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 9 - NumRowGroups: 12 - NumScannerThreadsStarted: 1 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 20020352 - PerReadThreadRawHdfsThroughput: 697804774 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 24621934399 - RowBatchQueuePutWaitTime: 1301909384 - RowsRead: 3146621 - RowsReturned: 3146621 - RowsReturnedRate: 126239 - ScanRangesComplete: 12 - ScannerThreadsInvoluntaryContextSwitches: 8760 - ScannerThreadsTotalWallClockTime: 29422117320 - MaterializeTupleTime(*): 21224015583 - ScannerThreadsSysTime: 233964000 - ScannerThreadsUserTime: 6432023000 - ScannerThreadsVoluntaryContextSwitches: 2034 - TotalRawHdfsReadTime(*): 67231992 - TotalReadThroughput: 250833 - TotalTime: 24925781276 Instance b4afd338536090b:47bd038400000011 (host=redacted-host2:22000) Hdfs split stats (:<# splits>/): 10:2/24.42 MB 3:1/12.34 MB 6:1/12.41 MB 4:1/12.35 MB 7:1/12.37 MB 2:1/12.32 MB 11:1/12.28 MB 9:2/24.40 MB 8:2/24.75 MB - AverageThreadTokens: 1.146341463414634 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 35646342 - PerHostPeakMemUsage: 233085705 - RowsProduced: 38712 - TotalNetworkReceiveTime: 155832784848 - TotalNetworkSendTime: 5744644731 - TotalStorageWaitTime: 1003131543 - TotalThreadsInvoluntaryContextSwitches: 10561 - TotalThreadsTotalWallClockTime: 214920417161 - TotalThreadsSysTime: 284956000 - TotalThreadsUserTime: 7906799000 - TotalThreadsVoluntaryContextSwitches: 5111 - TotalTime: 188723139141 Fragment Instance Lifecycle Timings - ExecTime: 24948479113 - ExecTreeExecTime: 18632213343 - InactiveTotalTime: 0 - OpenTime: 162794244944 - ExecTreeOpenTime: 158554380722 - PrepareTime: 977338650 - ExecTreePrepareTime: 106298301 - TotalTime: 0 DataStreamSender (dst_id=18) - BytesSent: 1949301 - InactiveTotalTime: 0 - NetworkThroughput(*): 88538625 - OverallThroughput: 12815907 - PeakMemoryUsage: 261888 - RowsReturned: 38712 - SerializeBatchTime: 129869734 - TotalTime: 152100119 - TransmitDataRPCTime: 22016391 - UncompressedRowBatchSize: 6277568 CodeGen - CodegenTime: 692862 - CompileTime: 946065477 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076168 - NumFunctions: 105 - NumInstructions: 6894 - OptimizationTime: 3277986329 - PeakMemoryUsage: 3529728 - PrepareTime: 416456853 - TotalTime: 4707813273 HASH_JOIN_NODE (id=7) ExecOption: Probe Side Codegen Enabled - BuildRows: 90 - BuildTime: 155397412 - InactiveTotalTime: 0 - LocalTime: 274634396 - NumHashTableBuildsSkipped: 0 - PeakMemoryUsage: 8722264 - ProbeRows: 38712 - ProbeRowsPartitioned: 0 - ProbeTime: 7949527 - RowsReturned: 38712 - RowsReturnedRate: 218 - TotalTime: 177398823715 Hash Join Builder (join_node_id=7) ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 3405291 - BuildRowsPartitioned: 90 - GetNewBlockTime: 118917842 - HashBuckets: 202 - HashCollisions: 0 - HashTablesBuildTime: 304156 - InactiveTotalTime: 0 - LargestPartitionPercent: 14 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 1062016 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=17) - BytesReceived: 1257 - ConvertRowBatchTime: 32589 - DeserializeRowBatchTimer: 45803 - FirstBatchArrivalWaitTime: 155408247760 - InactiveTotalTime: 155831937876 - PeakMemoryUsage: 0 - RowsReturned: 90 - RowsReturnedRate: 0 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 155832011717 HASH_JOIN_NODE (id=6) ExecOption: Probe Side Codegen Enabled - BuildRows: 1800 - BuildTime: 121117101 - InactiveTotalTime: 0 - LocalTime: 244141353 - NumHashTableBuildsSkipped: 0 - PeakMemoryUsage: 4023248 - ProbeRows: 159547 - ProbeRowsPartitioned: 0 - ProbeTime: 30961952 - RowsReturned: 38712 - RowsReturnedRate: 1818 - TotalTime: 21292177602 Hash Join Builder (join_node_id=6) ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 1434884 - BuildRowsPartitioned: 1800 - GetNewBlockTime: 117459764 - HashBuckets: 4096 - HashCollisions: 0 - HashTablesBuildTime: 1268020 - InactiveTotalTime: 0 - LargestPartitionPercent: 7 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 1135744 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=16) - BytesReceived: 14556 - ConvertRowBatchTime: 1605955 - DeserializeRowBatchTimer: 101194 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 1800 - RowsReturnedRate: 732961 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 2455792 HASH_JOIN_NODE (id=5) ExecOption: Probe Side Codegen Enabled - BuildRows: 49 - BuildTime: 118089940 - InactiveTotalTime: 0 - LocalTime: 480362617 - NumHashTableBuildsSkipped: 0 - PeakMemoryUsage: 2384368 - ProbeRows: 3132347 - ProbeRowsPartitioned: 0 - ProbeTime: 274194580 - RowsReturned: 159547 - RowsReturnedRate: 7581 - TotalTime: 21045580457 Hash Join Builder (join_node_id=5) ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 119973 - BuildRowsPartitioned: 49 - GetNewBlockTime: 117269758 - HashBuckets: 87 - HashCollisions: 0 - HashTablesBuildTime: 218793 - InactiveTotalTime: 0 - LargestPartitionPercent: 12 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 1071600 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=15) - BytesReceived: 827 - ConvertRowBatchTime: 26194 - DeserializeRowBatchTimer: 54831 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 49 - RowsReturnedRate: 1020620 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 48010 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 10:2/24.42 MB 3:1/12.34 MB 6:1/12.41 MB 4:1/12.35 MB 7:1/12.37 MB 2:1/12.32 MB 11:1/12.28 MB 9:2/24.40 MB 8:2/24.75 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 12 out of 12 Hdfs Read Thread Concurrency Bucket: 0:98.15% 1:1.852% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:96 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 1.0 - BytesRead: 46714976 - BytesReadDataNodeCache: 0 - BytesReadLocal: 46714976 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 46714976 - DecompressionTime: 120110299 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 8 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 9 - NumRowGroups: 12 - NumScannerThreadsStarted: 1 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 20021863 - PerReadThreadRawHdfsThroughput: 420515923 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 20441682270 - RowBatchQueuePutWaitTime: 3376665337 - RowsRead: 3132347 - RowsReturned: 3132347 - RowsReturnedRate: 152313 - ScanRangesComplete: 12 - ScannerThreadsInvoluntaryContextSwitches: 9422 - ScannerThreadsTotalWallClockTime: 27177718643 - MaterializeTupleTime(*): 17942007369 - ScannerThreadsSysTime: 200969000 - ScannerThreadsUserTime: 6261049000 - ScannerThreadsVoluntaryContextSwitches: 1802 - TotalRawHdfsReadTime(*): 111089672 - TotalReadThroughput: 253156 - TotalTime: 20565169830 Instance b4afd338536090b:47bd03840000000f (host=redacted-host7:22000) Hdfs split stats (:<# splits>/): 4:1/12.28 MB 1:1/12.25 MB 11:1/12.39 MB 8:3/36.92 MB 0:2/24.76 MB 9:2/24.58 MB 7:2/24.66 MB - AverageThreadTokens: 1.133879781420765 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 37418843 - PerHostPeakMemUsage: 234788716 - RowsProduced: 40081 - TotalNetworkReceiveTime: 155379431847 - TotalNetworkSendTime: 6085792146 - TotalStorageWaitTime: 923373128 - TotalThreadsInvoluntaryContextSwitches: 8730 - TotalThreadsTotalWallClockTime: 210671179929 - TotalThreadsSysTime: 281956000 - TotalThreadsUserTime: 7923795000 - TotalThreadsVoluntaryContextSwitches: 5105 - TotalTime: 186399380653 Fragment Instance Lifecycle Timings - ExecTime: 23926102116 - ExecTreeExecTime: 17133501290 - InactiveTotalTime: 0 - OpenTime: 161580013611 - ExecTreeOpenTime: 156779392911 - PrepareTime: 892608310 - ExecTreePrepareTime: 48799141 - TotalTime: 0 DataStreamSender (dst_id=18) - BytesSent: 2017215 - InactiveTotalTime: 0 - NetworkThroughput(*): 87179018 - OverallThroughput: 14083439 - PeakMemoryUsage: 261888 - RowsReturned: 40081 - SerializeBatchTime: 119895771 - TotalTime: 143233118 - TransmitDataRPCTime: 23138767 - UncompressedRowBatchSize: 6500519 CodeGen - CodegenTime: 1615385 - CompileTime: 1198449384 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076168 - NumFunctions: 105 - NumInstructions: 6894 - OptimizationTime: 3572966894 - PeakMemoryUsage: 3529728 - PrepareTime: 394978879 - TotalTime: 5167323712 HASH_JOIN_NODE (id=7) ExecOption: Probe Side Codegen Enabled - BuildRows: 90 - BuildTime: 2903205 - InactiveTotalTime: 0 - LocalTime: 18416521 - NumHashTableBuildsSkipped: 0 - PeakMemoryUsage: 8676304 - ProbeRows: 40081 - ProbeRowsPartitioned: 0 - ProbeTime: 9079250 - RowsReturned: 40081 - RowsReturnedRate: 230 - TotalTime: 174010152925 Hash Join Builder (join_node_id=7) ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 107457 - BuildRowsPartitioned: 90 - GetNewBlockTime: 322796 - HashBuckets: 202 - HashCollisions: 0 - HashTablesBuildTime: 379908 - InactiveTotalTime: 0 - LargestPartitionPercent: 14 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 1062016 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=17) - BytesReceived: 1257 - ConvertRowBatchTime: 36034 - DeserializeRowBatchTimer: 52403 - FirstBatchArrivalWaitTime: 154836855273 - InactiveTotalTime: 155379351251 - PeakMemoryUsage: 0 - RowsReturned: 90 - RowsReturnedRate: 0 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 155379430678 HASH_JOIN_NODE (id=6) ExecOption: Probe Side Codegen Enabled - BuildRows: 1800 - BuildTime: 1672714 - InactiveTotalTime: 0 - LocalTime: 77377444 - NumHashTableBuildsSkipped: 0 - PeakMemoryUsage: 3916600 - ProbeRows: 160116 - ProbeRowsPartitioned: 0 - ProbeTime: 26679399 - RowsReturned: 40081 - RowsReturnedRate: 2153 - TotalTime: 18612305726 Hash Join Builder (join_node_id=6) ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 415655 - BuildRowsPartitioned: 1800 - GetNewBlockTime: 129556 - HashBuckets: 4096 - HashCollisions: 0 - HashTablesBuildTime: 798320 - InactiveTotalTime: 0 - LargestPartitionPercent: 7 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 1135744 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=16) - BytesReceived: 14556 - ConvertRowBatchTime: 456993 - DeserializeRowBatchTimer: 96771 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 1800 - RowsReturnedRate: 3442005 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 522951 HASH_JOIN_NODE (id=5) ExecOption: Probe Side Codegen Enabled - BuildRows: 49 - BuildTime: 900725 - InactiveTotalTime: 0 - LocalTime: 354872644 - NumHashTableBuildsSkipped: 0 - PeakMemoryUsage: 2380504 - ProbeRows: 3134300 - ProbeRowsPartitioned: 0 - ProbeTime: 271494437 - RowsReturned: 160116 - RowsReturnedRate: 8638 - TotalTime: 18534405331 Hash Join Builder (join_node_id=5) ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 58756 - BuildRowsPartitioned: 49 - GetNewBlockTime: 203659 - HashBuckets: 87 - HashCollisions: 0 - HashTablesBuildTime: 301909 - InactiveTotalTime: 0 - LargestPartitionPercent: 12 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 1071600 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=15) - BytesReceived: 827 - ConvertRowBatchTime: 24516 - DeserializeRowBatchTimer: 38767 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 49 - RowsReturnedRate: 872615 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 56153 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 4:1/12.28 MB 1:1/12.25 MB 11:1/12.39 MB 8:3/36.92 MB 0:2/24.76 MB 9:2/24.58 MB 7:2/24.66 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 12 out of 12 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:96 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 1.0 - BytesRead: 46798167 - BytesReadDataNodeCache: 0 - BytesReadLocal: 46798167 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 46798167 - DecompressionTime: 218933320 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 8 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 7 - NumRowGroups: 12 - NumScannerThreadsStarted: 1 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 20098860 - PerReadThreadRawHdfsThroughput: 812057946 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 18027001610 - RowBatchQueuePutWaitTime: 3389086907 - RowsRead: 3134300 - RowsReturned: 3134300 - RowsReturnedRate: 172408 - ScanRangesComplete: 12 - ScannerThreadsInvoluntaryContextSwitches: 7741 - ScannerThreadsTotalWallClockTime: 25165085165 - MaterializeTupleTime(*): 16334432722 - ScannerThreadsSysTime: 192970000 - ScannerThreadsUserTime: 6220054000 - ScannerThreadsVoluntaryContextSwitches: 1837 - TotalRawHdfsReadTime(*): 57629098 - TotalReadThroughput: 256395 - TotalTime: 18179476534 Instance b4afd338536090b:47bd03840000000d (host=redacted-host3:22000) Hdfs split stats (:<# splits>/): 2:1/52.90 MB 4:1/12.31 MB 5:1/12.26 MB 9:1/12.28 MB 10:1/12.32 MB 11:1/12.36 MB 1:1/12.29 MB 0:1/12.36 MB 8:2/24.63 MB - AverageThreadTokens: 1.1342465753424658 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 55860569 - PerHostPeakMemUsage: 255202640 - RowsProduced: 43739 - TotalNetworkReceiveTime: 155241286786 - TotalNetworkSendTime: 4828440448 - TotalStorageWaitTime: 170861912 - TotalThreadsInvoluntaryContextSwitches: 9836 - TotalThreadsTotalWallClockTime: 210160841287 - TotalThreadsSysTime: 247962000 - TotalThreadsUserTime: 8253745000 - TotalThreadsVoluntaryContextSwitches: 5223 - TotalTime: 186235216046 Fragment Instance Lifecycle Timings - ExecTime: 23776251499 - ExecTreeExecTime: 18184246578 - InactiveTotalTime: 0 - OpenTime: 161615756206 - ExecTreeOpenTime: 156302464412 - PrepareTime: 842834663 - ExecTreePrepareTime: 1803603 - TotalTime: 0 DataStreamSender (dst_id=18) - BytesSent: 2201171 - InactiveTotalTime: 0 - NetworkThroughput(*): 88441042 - OverallThroughput: 12870549 - PeakMemoryUsage: 261888 - RowsReturned: 43739 - SerializeBatchTime: 145919991 - TotalTime: 171023862 - TransmitDataRPCTime: 24888569 - UncompressedRowBatchSize: 7092851 CodeGen - CodegenTime: 22454789 - CompileTime: 1898183986 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076168 - NumFunctions: 105 - NumInstructions: 6894 - OptimizationTime: 3392100809 - PeakMemoryUsage: 3529728 - PrepareTime: 446423938 - TotalTime: 5788195763 HASH_JOIN_NODE (id=7) ExecOption: Probe Side Codegen Enabled - BuildRows: 90 - BuildTime: 1423435 - InactiveTotalTime: 0 - LocalTime: 21871654 - NumHashTableBuildsSkipped: 0 - PeakMemoryUsage: 8419384 - ProbeRows: 43739 - ProbeRowsPartitioned: 0 - ProbeTime: 18450434 - RowsReturned: 43739 - RowsReturnedRate: 250 - TotalTime: 174489964394 Hash Join Builder (join_node_id=7) ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 87747 - BuildRowsPartitioned: 90 - GetNewBlockTime: 123436 - HashBuckets: 202 - HashCollisions: 0 - HashTablesBuildTime: 494668 - InactiveTotalTime: 0 - LargestPartitionPercent: 14 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 1062016 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=17) - BytesReceived: 1257 - ConvertRowBatchTime: 31871 - DeserializeRowBatchTimer: 102902 - FirstBatchArrivalWaitTime: 154705164992 - InactiveTotalTime: 155241227691 - PeakMemoryUsage: 0 - RowsReturned: 90 - RowsReturnedRate: 0 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 155241299778 HASH_JOIN_NODE (id=6) ExecOption: Probe Side Codegen Enabled - BuildRows: 1800 - BuildTime: 1413149 - InactiveTotalTime: 0 - LocalTime: 36073885 - NumHashTableBuildsSkipped: 0 - PeakMemoryUsage: 4574976 - ProbeRows: 178931 - ProbeRowsPartitioned: 0 - ProbeTime: 30624078 - RowsReturned: 43739 - RowsReturnedRate: 2274 - TotalTime: 19226792962 Hash Join Builder (join_node_id=6) ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 344205 - BuildRowsPartitioned: 1800 - GetNewBlockTime: 126104 - HashBuckets: 4096 - HashCollisions: 0 - HashTablesBuildTime: 713289 - InactiveTotalTime: 0 - LargestPartitionPercent: 7 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 1135744 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=16) - BytesReceived: 14556 - ConvertRowBatchTime: 382827 - DeserializeRowBatchTimer: 120949 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 1800 - RowsReturnedRate: 4102564 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 438750 HASH_JOIN_NODE (id=5) ExecOption: Probe Side Codegen Enabled - BuildRows: 49 - BuildTime: 605951 - InactiveTotalTime: 0 - LocalTime: 396058796 - NumHashTableBuildsSkipped: 0 - PeakMemoryUsage: 3101808 - ProbeRows: 3504801 - ProbeRowsPartitioned: 0 - ProbeTime: 334411831 - RowsReturned: 178931 - RowsReturnedRate: 9324 - TotalTime: 19190280327 Hash Join Builder (join_node_id=5) ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 69994 - BuildRowsPartitioned: 49 - GetNewBlockTime: 117701 - HashBuckets: 87 - HashCollisions: 0 - HashTablesBuildTime: 211543 - InactiveTotalTime: 0 - LargestPartitionPercent: 12 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 1071600 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=15) - BytesReceived: 827 - ConvertRowBatchTime: 29109 - DeserializeRowBatchTimer: 46026 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 49 - RowsReturnedRate: 1070383 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 45778 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 2:1/52.90 MB 4:1/12.31 MB 5:1/12.26 MB 9:1/12.28 MB 10:1/12.32 MB 11:1/12.36 MB 1:1/12.29 MB 0:1/12.36 MB 8:2/24.63 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 10 out of 10 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:80 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 1.0 - BytesRead: 52564704 - BytesReadDataNodeCache: 0 - BytesReadLocal: 52564704 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 52564704 - DecompressionTime: 153725835 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 8 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 9 - NumRowGroups: 10 - NumScannerThreadsStarted: 1 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 42160986 - PerReadThreadRawHdfsThroughput: 753566767 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 18666655067 - RowBatchQueuePutWaitTime: 2189203093 - RowsRead: 3504801 - RowsReturned: 3504801 - RowsReturnedRate: 186483 - ScanRangesComplete: 10 - ScannerThreadsInvoluntaryContextSwitches: 8892 - ScannerThreadsTotalWallClockTime: 24768853227 - MaterializeTupleTime(*): 17288819525 - ScannerThreadsSysTime: 166974000 - ScannerThreadsUserTime: 6545005000 - ScannerThreadsVoluntaryContextSwitches: 1625 - TotalRawHdfsReadTime(*): 69754541 - TotalReadThroughput: 287983 - TotalTime: 18794175753 Instance b4afd338536090b:47bd03840000000e (host=redacted-host1:22000) Hdfs split stats (:<# splits>/): 7:1/12.38 MB 5:1/12.38 MB 4:1/12.28 MB 0:1/12.39 MB 9:1/12.36 MB 11:4/49.31 MB 8:1/12.39 MB 10:2/24.56 MB - AverageThreadTokens: 1.1280653950953679 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 35837667 - PerHostPeakMemUsage: 233205973 - RowsProduced: 39442 - TotalNetworkReceiveTime: 154703003256 - TotalNetworkSendTime: 7062632082 - TotalStorageWaitTime: 471434731 - TotalThreadsInvoluntaryContextSwitches: 9040 - TotalThreadsTotalWallClockTime: 208159309612 - TotalThreadsSysTime: 249961000 - TotalThreadsUserTime: 7847806000 - TotalThreadsVoluntaryContextSwitches: 5051 - TotalTime: 185223754586 Fragment Instance Lifecycle Timings - ExecTime: 22589411272 - ExecTreeExecTime: 14836360305 - InactiveTotalTime: 0 - OpenTime: 161836206480 - ExecTreeOpenTime: 155959767904 - PrepareTime: 797139103 - ExecTreePrepareTime: 39017846 - TotalTime: 0 DataStreamSender (dst_id=18) - BytesSent: 1985754 - InactiveTotalTime: 0 - NetworkThroughput(*): 89729433 - OverallThroughput: 14778325 - PeakMemoryUsage: 261888 - RowsReturned: 39442 - SerializeBatchTime: 112053350 - TotalTime: 134369355 - TransmitDataRPCTime: 22130464 - UncompressedRowBatchSize: 6398352 CodeGen - CodegenTime: 5636554 - CompileTime: 1632972776 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076168 - NumFunctions: 105 - NumInstructions: 6894 - OptimizationTime: 4170233178 - PeakMemoryUsage: 3529728 - PrepareTime: 276278567 - TotalTime: 6132589144 HASH_JOIN_NODE (id=7) ExecOption: Probe Side Codegen Enabled - BuildRows: 90 - BuildTime: 23369254 - InactiveTotalTime: 0 - LocalTime: 107548679 - NumHashTableBuildsSkipped: 0 - PeakMemoryUsage: 8102952 - ProbeRows: 39442 - ProbeRowsPartitioned: 0 - ProbeTime: 17376837 - RowsReturned: 39442 - RowsReturnedRate: 230 - TotalTime: 170871874503 Hash Join Builder (join_node_id=7) ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 62411 - BuildRowsPartitioned: 90 - GetNewBlockTime: 163998 - HashBuckets: 202 - HashCollisions: 0 - HashTablesBuildTime: 348703 - InactiveTotalTime: 0 - LargestPartitionPercent: 14 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 1062016 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=17) - BytesReceived: 1257 - ConvertRowBatchTime: 24344 - DeserializeRowBatchTimer: 55051 - FirstBatchArrivalWaitTime: 154169082642 - InactiveTotalTime: 154702964136 - PeakMemoryUsage: 0 - RowsReturned: 90 - RowsReturnedRate: 0 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 154703015136 HASH_JOIN_NODE (id=6) ExecOption: Probe Side Codegen Enabled - BuildRows: 1800 - BuildTime: 3368712 - InactiveTotalTime: 0 - LocalTime: 39806642 - NumHashTableBuildsSkipped: 0 - PeakMemoryUsage: 4038256 - ProbeRows: 159554 - ProbeRowsPartitioned: 0 - ProbeTime: 28398116 - RowsReturned: 39442 - RowsReturnedRate: 2455 - TotalTime: 16061310688 Hash Join Builder (join_node_id=6) ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 336924 - BuildRowsPartitioned: 1800 - GetNewBlockTime: 2122459 - HashBuckets: 4096 - HashCollisions: 0 - HashTablesBuildTime: 666097 - InactiveTotalTime: 0 - LargestPartitionPercent: 7 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 1135744 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=16) - BytesReceived: 14556 - ConvertRowBatchTime: 336912 - DeserializeRowBatchTimer: 109786 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 1800 - RowsReturnedRate: 4831631 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 372545 HASH_JOIN_NODE (id=5) ExecOption: Probe Side Codegen Enabled - BuildRows: 49 - BuildTime: 9095109 - InactiveTotalTime: 0 - LocalTime: 364583792 - NumHashTableBuildsSkipped: 0 - PeakMemoryUsage: 2381456 - ProbeRows: 3141321 - ProbeRowsPartitioned: 0 - ProbeTime: 292912615 - RowsReturned: 159554 - RowsReturnedRate: 9958 - TotalTime: 16021131501 Hash Join Builder (join_node_id=5) ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 41648 - BuildRowsPartitioned: 49 - GetNewBlockTime: 8523101 - HashBuckets: 87 - HashCollisions: 0 - HashTablesBuildTime: 239748 - InactiveTotalTime: 0 - LargestPartitionPercent: 12 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 1071600 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=15) - BytesReceived: 827 - ConvertRowBatchTime: 12595 - DeserializeRowBatchTimer: 33954 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 49 - RowsReturnedRate: 1510294 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 32444 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 7:1/12.38 MB 5:1/12.38 MB 4:1/12.28 MB 0:1/12.39 MB 9:1/12.36 MB 11:4/49.31 MB 8:1/12.39 MB 10:2/24.56 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 12 out of 12 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:96 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 1.0 - BytesRead: 46826596 - BytesReadDataNodeCache: 0 - BytesReadLocal: 46826596 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 46826596 - DecompressionTime: 106733077 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 8 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 8 - NumRowGroups: 12 - NumScannerThreadsStarted: 1 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 20035148 - PerReadThreadRawHdfsThroughput: 873238168 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 15514604338 - RowBatchQueuePutWaitTime: 4393387705 - RowsRead: 3141321 - RowsReturned: 3141321 - RowsReturnedRate: 200639 - ScanRangesComplete: 12 - ScannerThreadsInvoluntaryContextSwitches: 7947 - ScannerThreadsTotalWallClockTime: 23733714172 - MaterializeTupleTime(*): 14914215556 - ScannerThreadsSysTime: 177972000 - ScannerThreadsUserTime: 6156064000 - ScannerThreadsVoluntaryContextSwitches: 1677 - TotalRawHdfsReadTime(*): 53624083 - TotalReadThroughput: 255848 - TotalTime: 15656515265 Instance b4afd338536090b:47bd03840000000b (host=redacted-host5:22000) Hdfs split stats (:<# splits>/): 4:1/12.40 MB 5:1/12.39 MB 3:1/12.30 MB 11:1/12.31 MB 0:1/12.25 MB 8:1/12.26 MB 9:2/24.69 MB 7:2/24.78 MB 10:1/12.24 MB - AverageThreadTokens: 1.1055555555555556 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 32966171 - PerHostPeakMemUsage: 189529285 - RowsProduced: 35779 - TotalNetworkReceiveTime: 156162004003 - TotalNetworkSendTime: 5584323351 - TotalStorageWaitTime: 424040838 - TotalThreadsInvoluntaryContextSwitches: 8438 - TotalThreadsTotalWallClockTime: 202589471043 - TotalThreadsSysTime: 239962000 - TotalThreadsUserTime: 7479863000 - TotalThreadsVoluntaryContextSwitches: 4811 - TotalTime: 184059233335 Fragment Instance Lifecycle Timings - ExecTime: 21959317695 - ExecTreeExecTime: 15765778746 - InactiveTotalTime: 0 - OpenTime: 161408420544 - ExecTreeOpenTime: 157081030564 - PrepareTime: 691366535 - ExecTreePrepareTime: 63362589 - TotalTime: 0 DataStreamSender (dst_id=18) - BytesSent: 1802082 - InactiveTotalTime: 0 - NetworkThroughput(*): 85096948 - OverallThroughput: 13747097 - PeakMemoryUsage: 261888 - RowsReturned: 35779 - SerializeBatchTime: 109696869 - TotalTime: 131088184 - TransmitDataRPCTime: 21176811 - UncompressedRowBatchSize: 5802129 CodeGen - CodegenTime: 834235 - CompileTime: 801284836 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076168 - NumFunctions: 105 - NumInstructions: 6894 - OptimizationTime: 3446021257 - PeakMemoryUsage: 3529728 - PrepareTime: 314477973 - TotalTime: 4562736472 HASH_JOIN_NODE (id=7) ExecOption: Probe Side Codegen Enabled - BuildRows: 90 - BuildTime: 2224017 - InactiveTotalTime: 0 - LocalTime: 17572613 - NumHashTableBuildsSkipped: 0 - PeakMemoryUsage: 8476376 - ProbeRows: 35779 - ProbeRowsPartitioned: 0 - ProbeTime: 12960070 - RowsReturned: 35779 - RowsReturnedRate: 206 - TotalTime: 172973187074 Hash Join Builder (join_node_id=7) ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 113163 - BuildRowsPartitioned: 90 - GetNewBlockTime: 470211 - HashBuckets: 202 - HashCollisions: 0 - HashTablesBuildTime: 235623 - InactiveTotalTime: 0 - LargestPartitionPercent: 14 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 1062016 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=17) - BytesReceived: 1257 - ConvertRowBatchTime: 36282 - DeserializeRowBatchTimer: 57344 - FirstBatchArrivalWaitTime: 155629714032 - InactiveTotalTime: 156161937460 - PeakMemoryUsage: 0 - RowsReturned: 90 - RowsReturnedRate: 0 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 156162013058 HASH_JOIN_NODE (id=6) ExecOption: Probe Side Codegen Enabled - BuildRows: 1800 - BuildTime: 1774886 - InactiveTotalTime: 0 - LocalTime: 47150345 - NumHashTableBuildsSkipped: 0 - PeakMemoryUsage: 3982384 - ProbeRows: 145786 - ProbeRowsPartitioned: 0 - ProbeTime: 24929152 - RowsReturned: 35779 - RowsReturnedRate: 2130 - TotalTime: 16793601403 Hash Join Builder (join_node_id=6) ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 375642 - BuildRowsPartitioned: 1800 - GetNewBlockTime: 518688 - HashBuckets: 4096 - HashCollisions: 0 - HashTablesBuildTime: 661318 - InactiveTotalTime: 0 - LargestPartitionPercent: 7 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 1135744 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=16) - BytesReceived: 14556 - ConvertRowBatchTime: 380101 - DeserializeRowBatchTimer: 105693 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 1800 - RowsReturnedRate: 4053533 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 444057 HASH_JOIN_NODE (id=5) ExecOption: Probe Side Codegen Enabled - BuildRows: 49 - BuildTime: 1691527 - InactiveTotalTime: 0 - LocalTime: 305586528 - NumHashTableBuildsSkipped: 0 - PeakMemoryUsage: 2382240 - ProbeRows: 2876953 - ProbeRowsPartitioned: 0 - ProbeTime: 247175845 - RowsReturned: 145786 - RowsReturnedRate: 8705 - TotalTime: 16746007001 Hash Join Builder (join_node_id=5) ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 50054 - BuildRowsPartitioned: 49 - GetNewBlockTime: 1099626 - HashBuckets: 87 - HashCollisions: 0 - HashTablesBuildTime: 240913 - InactiveTotalTime: 0 - LargestPartitionPercent: 12 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 1071600 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=15) - BytesReceived: 827 - ConvertRowBatchTime: 26997 - DeserializeRowBatchTimer: 34812 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 49 - RowsReturnedRate: 1058543 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 46290 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 4:1/12.40 MB 5:1/12.39 MB 3:1/12.30 MB 11:1/12.31 MB 0:1/12.25 MB 8:1/12.26 MB 9:2/24.69 MB 7:2/24.78 MB 10:1/12.24 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 11 out of 11 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:88 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.8444444444444444 - BytesRead: 42904753 - BytesReadDataNodeCache: 0 - BytesReadLocal: 42904753 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 42904753 - DecompressionTime: 74919177 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 8 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 9 - NumRowGroups: 11 - NumScannerThreadsStarted: 1 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 18359982 - PerReadThreadRawHdfsThroughput: 706334489 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 16225353142 - RowBatchQueuePutWaitTime: 0 - RowsRead: 2876953 - RowsReturned: 2876953 - RowsReturnedRate: 174993 - ScanRangesComplete: 11 - ScannerThreadsInvoluntaryContextSwitches: 7549 - ScannerThreadsTotalWallClockTime: 19221763277 - MaterializeTupleTime(*): 14835014274 - ScannerThreadsSysTime: 151976000 - ScannerThreadsUserTime: 5822115000 - ScannerThreadsVoluntaryContextSwitches: 1710 - TotalRawHdfsReadTime(*): 60742826 - TotalReadThroughput: 238323 - TotalTime: 16440374183 Instance b4afd338536090b:47bd03840000000a (host=redacted-host4:22000) Hdfs split stats (:<# splits>/): 10:2/24.56 MB 2:1/12.35 MB 11:1/12.34 MB 4:1/12.31 MB 5:1/12.36 MB 6:1/12.37 MB 7:2/53.72 MB 9:1/12.39 MB - AverageThreadTokens: 1.0883190883190883 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 36259734 - PerHostPeakMemUsage: 192884167 - RowsProduced: 40250 - TotalNetworkReceiveTime: 156725122806 - TotalNetworkSendTime: 3841618933 - TotalStorageWaitTime: 153189208 - TotalThreadsInvoluntaryContextSwitches: 8955 - TotalThreadsTotalWallClockTime: 191884796667 - TotalThreadsSysTime: 249962000 - TotalThreadsUserTime: 7730824000 - TotalThreadsVoluntaryContextSwitches: 5076 - TotalTime: 177056610494 Fragment Instance Lifecycle Timings - ExecTime: 14695894463 - ExecTreeExecTime: 10374029621 - InactiveTotalTime: 0 - OpenTime: 161718790635 - ExecTreeOpenTime: 157577754046 - PrepareTime: 641808220 - ExecTreePrepareTime: 76857803 - TotalTime: 0 DataStreamSender (dst_id=18) - BytesSent: 2025368 - InactiveTotalTime: 0 - NetworkThroughput(*): 89115351 - OverallThroughput: 13282119 - PeakMemoryUsage: 245504 - RowsReturned: 40250 - SerializeBatchTime: 129561148 - TotalTime: 152488310 - TransmitDataRPCTime: 22727487 - UncompressedRowBatchSize: 6527950 CodeGen - CodegenTime: 655064 - CompileTime: 1171596804 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076168 - NumFunctions: 105 - NumInstructions: 6894 - OptimizationTime: 2964968329 - PeakMemoryUsage: 3529728 - PrepareTime: 250083691 - TotalTime: 4400945153 HASH_JOIN_NODE (id=7) ExecOption: Probe Side Codegen Enabled - BuildRows: 90 - BuildTime: 891556 - InactiveTotalTime: 0 - LocalTime: 12743443 - NumHashTableBuildsSkipped: 0 - PeakMemoryUsage: 8483488 - ProbeRows: 40250 - ProbeRowsPartitioned: 0 - ProbeTime: 7539609 - RowsReturned: 40250 - RowsReturnedRate: 239 - TotalTime: 168105135049 Hash Join Builder (join_node_id=7) ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 49102 - BuildRowsPartitioned: 90 - GetNewBlockTime: 104587 - HashBuckets: 202 - HashCollisions: 0 - HashTablesBuildTime: 203033 - InactiveTotalTime: 0 - LargestPartitionPercent: 14 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 1062016 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=17) - BytesReceived: 1257 - ConvertRowBatchTime: 20079 - DeserializeRowBatchTimer: 44107 - FirstBatchArrivalWaitTime: 156192551889 - InactiveTotalTime: 156725087447 - PeakMemoryUsage: 0 - RowsReturned: 90 - RowsReturnedRate: 0 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 156725130993 HASH_JOIN_NODE (id=6) ExecOption: Probe Side Codegen Enabled - BuildRows: 1800 - BuildTime: 1176718 - InactiveTotalTime: 0 - LocalTime: 111489476 - NumHashTableBuildsSkipped: 0 - PeakMemoryUsage: 3917328 - ProbeRows: 165471 - ProbeRowsPartitioned: 0 - ProbeTime: 27245817 - RowsReturned: 40250 - RowsReturnedRate: 3540 - TotalTime: 11367260613 Hash Join Builder (join_node_id=6) ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 340047 - BuildRowsPartitioned: 1800 - GetNewBlockTime: 115042 - HashBuckets: 4096 - HashCollisions: 0 - HashTablesBuildTime: 561991 - InactiveTotalTime: 0 - LargestPartitionPercent: 7 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 1135744 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=16) - BytesReceived: 14556 - ConvertRowBatchTime: 360913 - DeserializeRowBatchTimer: 89615 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 1800 - RowsReturnedRate: 4560668 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 394679 HASH_JOIN_NODE (id=5) ExecOption: Probe Side Codegen Enabled - BuildRows: 49 - BuildTime: 474247 - InactiveTotalTime: 0 - LocalTime: 382914490 - NumHashTableBuildsSkipped: 0 - PeakMemoryUsage: 3101808 - ProbeRows: 3257553 - ProbeRowsPartitioned: 0 - ProbeTime: 275867199 - RowsReturned: 165471 - RowsReturnedRate: 14701 - TotalTime: 11255376458 Hash Join Builder (join_node_id=5) ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 21908 - BuildRowsPartitioned: 49 - GetNewBlockTime: 72178 - HashBuckets: 87 - HashCollisions: 0 - HashTablesBuildTime: 202037 - InactiveTotalTime: 0 - LargestPartitionPercent: 12 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 1071600 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=15) - BytesReceived: 827 - ConvertRowBatchTime: 12138 - DeserializeRowBatchTimer: 33967 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 49 - RowsReturnedRate: 1737095 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 28208 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 10:2/24.56 MB 2:1/12.35 MB 11:1/12.34 MB 4:1/12.31 MB 5:1/12.36 MB 6:1/12.37 MB 7:2/53.72 MB 9:1/12.39 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 10 out of 10 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:80 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 1.0 - BytesRead: 48731967 - BytesReadDataNodeCache: 0 - BytesReadLocal: 48731967 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 48731967 - DecompressionTime: 70320337 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 8 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 8 - NumRowGroups: 10 - NumScannerThreadsStarted: 1 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 20282575 - PerReadThreadRawHdfsThroughput: 952119709 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 10786010734 - RowBatchQueuePutWaitTime: 2309223183 - RowsRead: 3257553 - RowsReturned: 3257553 - RowsReturnedRate: 299615 - ScanRangesComplete: 10 - ScannerThreadsInvoluntaryContextSwitches: 7962 - ScannerThreadsTotalWallClockTime: 15470140130 - MaterializeTupleTime(*): 10890360838 - ScannerThreadsSysTime: 163975000 - ScannerThreadsUserTime: 6105071000 - ScannerThreadsVoluntaryContextSwitches: 1836 - TotalRawHdfsReadTime(*): 51182605 - TotalReadThroughput: 277646 - TotalTime: 10872433760 Averaged Fragment F03 split sizes: min: 73.73 KB, max: 73.73 KB, avg: 73.73 KB, stddev: 0 completion times: min:2m16s max:2m16s mean: 2m16s stddev:0.000ns execution rates: min:551.00 B/sec max:551.00 B/sec mean:551.00 B/sec stddev:0.26 B/sec num instances: 1 - AverageThreadTokens: 1.982608695652174 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 329152 - PerHostPeakMemUsage: 200339133 - RowsProduced: 49 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 71662 - TotalStorageWaitTime: 109558321650 - TotalThreadsInvoluntaryContextSwitches: 36 - TotalThreadsTotalWallClockTime: 269164331885 - TotalThreadsSysTime: 4999000 - TotalThreadsUserTime: 97985000 - TotalThreadsVoluntaryContextSwitches: 162 - TotalTime: 136474309814 Fragment Instance Lifecycle Timings - ExecTime: 134296609694 - ExecTreeExecTime: 134171514835 - InactiveTotalTime: 0 - OpenTime: 759569868 - ExecTreeOpenTime: 175836 - PrepareTime: 1391164635 - ExecTreePrepareTime: 624299 - TotalTime: 0 DataStreamSender (dst_id=15) - BytesSent: 6616 - InactiveTotalTime: 0 - NetworkThroughput(*): 23519625 - OverallThroughput: 11855419 - PeakMemoryUsage: 41920 - RowsReturned: 49 - SerializeBatchTime: 147048 - TotalTime: 558057 - TransmitDataRPCTime: 281297 - UncompressedRowBatchSize: 14136 CodeGen - CodegenTime: 104383833 - CompileTime: 219117076 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076168 - NumFunctions: 36 - NumInstructions: 545 - OptimizationTime: 395497050 - PeakMemoryUsage: 279040 - PrepareTime: 992457636 - TotalTime: 1667811888 HDFS_SCAN_NODE (id=2) - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 1.0 - BytesRead: 80719 - BytesReadDataNodeCache: 0 - BytesReadLocal: 80719 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 80719 - DecompressionTime: 19339 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 1 - NumRowGroups: 1 - NumScannerThreadsStarted: 1 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 151585 - PerReadThreadRawHdfsThroughput: 834589575 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 134014428523 - RowBatchQueuePutWaitTime: 0 - RowsRead: 804 - RowsReturned: 49 - RowsReturnedRate: 0 - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 134108175851 - MaterializeTupleTime(*): 70662561 - ScannerThreadsSysTime: 999000 - ScannerThreadsUserTime: 5999000 - ScannerThreadsVoluntaryContextSwitches: 58 - TotalRawHdfsReadTime(*): 96717 - TotalReadThroughput: 701 - TotalTime: 134173175957 Fragment F03 Instance b4afd338536090b:47bd038400000007 (host=redacted-host8:22000) Hdfs split stats (:<# splits>/): 8:1/73.73 KB - AverageThreadTokens: 1.982608695652174 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 329152 - PerHostPeakMemUsage: 200339133 - RowsProduced: 49 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 71662 - TotalStorageWaitTime: 109558321650 - TotalThreadsInvoluntaryContextSwitches: 36 - TotalThreadsTotalWallClockTime: 269164331885 - TotalThreadsSysTime: 4999000 - TotalThreadsUserTime: 97985000 - TotalThreadsVoluntaryContextSwitches: 162 - TotalTime: 136474309814 Fragment Instance Lifecycle Timings - ExecTime: 134296609694 - ExecTreeExecTime: 134171514835 - InactiveTotalTime: 0 - OpenTime: 759569868 - ExecTreeOpenTime: 175836 - PrepareTime: 1391164635 - ExecTreePrepareTime: 624299 - TotalTime: 0 DataStreamSender (dst_id=15) - BytesSent: 6616 - InactiveTotalTime: 0 - NetworkThroughput(*): 23519625 - OverallThroughput: 11855419 - PeakMemoryUsage: 41920 - RowsReturned: 49 - SerializeBatchTime: 147048 - TotalTime: 558057 - TransmitDataRPCTime: 281297 - UncompressedRowBatchSize: 14136 CodeGen - CodegenTime: 104383833 - CompileTime: 219117076 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076168 - NumFunctions: 36 - NumInstructions: 545 - OptimizationTime: 395497050 - PeakMemoryUsage: 279040 - PrepareTime: 992457636 - TotalTime: 1667811888 HDFS_SCAN_NODE (id=2) Hdfs split stats (:<# splits>/): 8:1/73.73 KB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:2 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 1.0 - BytesRead: 80719 - BytesReadDataNodeCache: 0 - BytesReadLocal: 80719 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 80719 - DecompressionTime: 19339 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 1 - NumRowGroups: 1 - NumScannerThreadsStarted: 1 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 151585 - PerReadThreadRawHdfsThroughput: 834589575 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 134014428523 - RowBatchQueuePutWaitTime: 0 - RowsRead: 804 - RowsReturned: 49 - RowsReturnedRate: 0 - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 134108175851 - MaterializeTupleTime(*): 70662561 - ScannerThreadsSysTime: 999000 - ScannerThreadsUserTime: 5999000 - ScannerThreadsVoluntaryContextSwitches: 58 - TotalRawHdfsReadTime(*): 96717 - TotalReadThroughput: 701 - TotalTime: 134173175957 Averaged Fragment F04 split sizes: min: 41.55 KB, max: 41.55 KB, avg: 41.55 KB, stddev: 0 completion times: min:4s436ms max:4s436ms mean: 4s436ms stddev:0.000ns execution rates: min:9.37 KB/sec max:9.37 KB/sec mean:9.37 KB/sec stddev:0.61 B/sec num instances: 1 - AverageThreadTokens: 1.75 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 486078 - PerHostPeakMemUsage: 50773100 - RowsProduced: 1800 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 53530580 - TotalStorageWaitTime: 2235113595 - TotalThreadsInvoluntaryContextSwitches: 87 - TotalThreadsTotalWallClockTime: 6743691852 - TotalThreadsSysTime: 3999000 - TotalThreadsUserTime: 69989000 - TotalThreadsVoluntaryContextSwitches: 101 - TotalTime: 4010236519 Fragment Instance Lifecycle Timings - ExecTime: 3289447636 - ExecTreeExecTime: 3133489929 - InactiveTotalTime: 0 - OpenTime: 268084541 - ExecTreeOpenTime: 158667 - PrepareTime: 446933445 - ExecTreePrepareTime: 278401 - TotalTime: 0 DataStreamSender (dst_id=16) - BytesSent: 116448 - InactiveTotalTime: 0 - NetworkThroughput(*): 134403035 - OverallThroughput: 68446482 - PeakMemoryUsage: 61632 - RowsReturned: 1800 - SerializeBatchTime: 758263 - TotalTime: 1701300 - TransmitDataRPCTime: 866409 - UncompressedRowBatchSize: 302464 CodeGen - CodegenTime: 2015991 - CompileTime: 92760888 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076168 - NumFunctions: 15 - NumInstructions: 279 - OptimizationTime: 152658170 - PeakMemoryUsage: 142848 - PrepareTime: 235503876 - TotalTime: 482007996 HDFS_SCAN_NODE (id=3) - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 1.0 - BytesRead: 83413 - BytesReadDataNodeCache: 0 - BytesReadLocal: 83413 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 83413 - DecompressionTime: 14969 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 3 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 1 - NumRowGroups: 1 - NumScannerThreadsStarted: 1 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 388316 - PerReadThreadRawHdfsThroughput: 64604148 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 3131588069 - RowBatchQueuePutWaitTime: 0 - RowsRead: 7200 - RowsReturned: 1800 - RowsReturnedRate: 574 - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 3186175545 - MaterializeTupleTime(*): 3280404 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 5999000 - ScannerThreadsVoluntaryContextSwitches: 31 - TotalRawHdfsReadTime(*): 1291140 - TotalReadThroughput: 23803 - TotalTime: 3134295561 Fragment F04 Instance b4afd338536090b:47bd038400000008 (host=redacted-host6:22000) Hdfs split stats (:<# splits>/): 7:1/41.55 KB - AverageThreadTokens: 1.75 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 486078 - PerHostPeakMemUsage: 50773100 - RowsProduced: 1800 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 53530580 - TotalStorageWaitTime: 2235113595 - TotalThreadsInvoluntaryContextSwitches: 87 - TotalThreadsTotalWallClockTime: 6743691852 - TotalThreadsSysTime: 3999000 - TotalThreadsUserTime: 69989000 - TotalThreadsVoluntaryContextSwitches: 101 - TotalTime: 4010236519 Fragment Instance Lifecycle Timings - ExecTime: 3289447636 - ExecTreeExecTime: 3133489929 - InactiveTotalTime: 0 - OpenTime: 268084541 - ExecTreeOpenTime: 158667 - PrepareTime: 446933445 - ExecTreePrepareTime: 278401 - TotalTime: 0 DataStreamSender (dst_id=16) - BytesSent: 116448 - InactiveTotalTime: 0 - NetworkThroughput(*): 134403035 - OverallThroughput: 68446482 - PeakMemoryUsage: 61632 - RowsReturned: 1800 - SerializeBatchTime: 758263 - TotalTime: 1701300 - TransmitDataRPCTime: 866409 - UncompressedRowBatchSize: 302464 CodeGen - CodegenTime: 2015991 - CompileTime: 92760888 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076168 - NumFunctions: 15 - NumInstructions: 279 - OptimizationTime: 152658170 - PeakMemoryUsage: 142848 - PrepareTime: 235503876 - TotalTime: 482007996 HDFS_SCAN_NODE (id=3) Hdfs split stats (:<# splits>/): 7:1/41.55 KB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:3 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 1.0 - BytesRead: 83413 - BytesReadDataNodeCache: 0 - BytesReadLocal: 83413 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 83413 - DecompressionTime: 14969 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 3 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 1 - NumRowGroups: 1 - NumScannerThreadsStarted: 1 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 388316 - PerReadThreadRawHdfsThroughput: 64604148 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 3131588069 - RowBatchQueuePutWaitTime: 0 - RowsRead: 7200 - RowsReturned: 1800 - RowsReturnedRate: 574 - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 3186175545 - MaterializeTupleTime(*): 3280404 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 5999000 - ScannerThreadsVoluntaryContextSwitches: 31 - TotalRawHdfsReadTime(*): 1291140 - TotalReadThroughput: 23803 - TotalTime: 3134295561 Averaged Fragment F05 split sizes: min: 2.15 MB, max: 2.15 MB, avg: 2.15 MB, stddev: 0 completion times: min:2m39s max:2m39s mean: 2m39s stddev:0.000ns execution rates: min:13.79 KB/sec max:13.79 KB/sec mean:13.79 KB/sec stddev:0.30 B/sec num instances: 1 - AverageThreadTokens: 1.9852941176470589 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 4482459 - PerHostPeakMemUsage: 204141355 - RowsProduced: 90 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 38390 - TotalStorageWaitTime: 120251347719 - TotalThreadsInvoluntaryContextSwitches: 92 - TotalThreadsTotalWallClockTime: 315033584610 - TotalThreadsSysTime: 9998000 - TotalThreadsUserTime: 190970000 - TotalThreadsVoluntaryContextSwitches: 372 - TotalTime: 159454248693 Fragment Instance Lifecycle Timings - ExecTime: 157153699290 - ExecTreeExecTime: 156885230368 - InactiveTotalTime: 0 - OpenTime: 766830051 - ExecTreeOpenTime: 163811 - PrepareTime: 1522736164 - ExecTreePrepareTime: 206627 - TotalTime: 0 DataStreamSender (dst_id=17) - BytesSent: 10056 - InactiveTotalTime: 0 - NetworkThroughput(*): 55380548 - OverallThroughput: 28575894 - PeakMemoryUsage: 41920 - RowsReturned: 90 - SerializeBatchTime: 87745 - TotalTime: 351905 - TransmitDataRPCTime: 181580 - UncompressedRowBatchSize: 28112 CodeGen - CodegenTime: 126916049 - CompileTime: 76377192 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076168 - NumFunctions: 46 - NumInstructions: 773 - OptimizationTime: 658591169 - PeakMemoryUsage: 395776 - PrepareTime: 707156674 - TotalTime: 1630809565 HDFS_SCAN_NODE (id=1) - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 1.0 - BytesRead: 835696 - BytesReadDataNodeCache: 0 - BytesReadLocal: 835696 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 835696 - DecompressionTime: 174000784 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 1 - NumRowGroups: 1 - NumScannerThreadsStarted: 1 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 4429429 - PerReadThreadRawHdfsThroughput: 68782633 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 156818154074 - RowBatchQueuePutWaitTime: 0 - RowsRead: 73049 - RowsReturned: 90 - RowsReturnedRate: 0 - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 14 - ScannerThreadsTotalWallClockTime: 157113077271 - MaterializeTupleTime(*): 28886390 - ScannerThreadsSysTime: 1999000 - ScannerThreadsUserTime: 59990000 - ScannerThreadsVoluntaryContextSwitches: 231 - TotalRawHdfsReadTime(*): 12149811 - TotalReadThroughput: 6143 - TotalTime: 156885843856 Fragment F05 Instance b4afd338536090b:47bd038400000009 (host=redacted-host8:22000) Hdfs split stats (:<# splits>/): 11:1/2.15 MB - AverageThreadTokens: 1.9852941176470589 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 4482459 - PerHostPeakMemUsage: 204141355 - RowsProduced: 90 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 38390 - TotalStorageWaitTime: 120251347719 - TotalThreadsInvoluntaryContextSwitches: 92 - TotalThreadsTotalWallClockTime: 315033584610 - TotalThreadsSysTime: 9998000 - TotalThreadsUserTime: 190970000 - TotalThreadsVoluntaryContextSwitches: 372 - TotalTime: 159454248693 Fragment Instance Lifecycle Timings - ExecTime: 157153699290 - ExecTreeExecTime: 156885230368 - InactiveTotalTime: 0 - OpenTime: 766830051 - ExecTreeOpenTime: 163811 - PrepareTime: 1522736164 - ExecTreePrepareTime: 206627 - TotalTime: 0 DataStreamSender (dst_id=17) - BytesSent: 10056 - InactiveTotalTime: 0 - NetworkThroughput(*): 55380548 - OverallThroughput: 28575894 - PeakMemoryUsage: 41920 - RowsReturned: 90 - SerializeBatchTime: 87745 - TotalTime: 351905 - TransmitDataRPCTime: 181580 - UncompressedRowBatchSize: 28112 CodeGen - CodegenTime: 126916049 - CompileTime: 76377192 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076168 - NumFunctions: 46 - NumInstructions: 773 - OptimizationTime: 658591169 - PeakMemoryUsage: 395776 - PrepareTime: 707156674 - TotalTime: 1630809565 HDFS_SCAN_NODE (id=1) Hdfs split stats (:<# splits>/): 11:1/2.15 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:2 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 1.0 - BytesRead: 835696 - BytesReadDataNodeCache: 0 - BytesReadLocal: 835696 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 835696 - DecompressionTime: 174000784 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 1 - NumRowGroups: 1 - NumScannerThreadsStarted: 1 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 4429429 - PerReadThreadRawHdfsThroughput: 68782633 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 156818154074 - RowBatchQueuePutWaitTime: 0 - RowsRead: 73049 - RowsReturned: 90 - RowsReturnedRate: 0 - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 14 - ScannerThreadsTotalWallClockTime: 157113077271 - MaterializeTupleTime(*): 28886390 - ScannerThreadsSysTime: 1999000 - ScannerThreadsUserTime: 59990000 - ScannerThreadsVoluntaryContextSwitches: 231 - TotalRawHdfsReadTime(*): 12149811 - TotalReadThroughput: 6143 - TotalTime: 156885843856 Averaged Fragment F06 split sizes: min: 5.88 MB, max: 11.77 MB, avg: 6.81 MB, stddev: 2.02 MB completion times: min:11s837ms max:42s951ms mean: 17s395ms stddev:10s560ms execution rates: min:140.30 KB/sec max:710.78 KB/sec mean:477.30 KB/sec stddev:156.66 KB/sec num instances: 7 - AverageThreadTokens: 1.612081141589151 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 8599811 - PerHostPeakMemUsage: 67947854 - RowsProduced: 357142 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 11429050056 - TotalStorageWaitTime: 2527821753 - TotalThreadsInvoluntaryContextSwitches: 545 - TotalThreadsTotalWallClockTime: 26699293043 - TotalThreadsSysTime: 16997142 - TotalThreadsUserTime: 985707142 - TotalThreadsVoluntaryContextSwitches: 505 - TotalTime: 17055344064 Fragment Instance Lifecycle Timings - ExecTime: 16048071146 - ExecTreeExecTime: 3392574531 - InactiveTotalTime: 0 - OpenTime: 236251917 - ExecTreeOpenTime: 391931 - PrepareTime: 759733793 - ExecTreePrepareTime: 2226081 - TotalTime: 0 DataStreamSender (dst_id=19) - BytesSent: 6954405 - InactiveTotalTime: 0 - NetworkThroughput(*): 106616755 - OverallThroughput: 14144804 - PeakMemoryUsage: 336832 - RowsReturned: 357142 - SerializeBatchTime: 427824452 - TotalTime: 493295245 - TransmitDataRPCTime: 65079280 - UncompressedRowBatchSize: 13460325 CodeGen - CodegenTime: 1116950 - CompileTime: 44754887 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076168 - NumFunctions: 5 - NumInstructions: 98 - OptimizationTime: 150609110 - PeakMemoryUsage: 50176 - PrepareTime: 404709100 - TotalTime: 640923505 HDFS_SCAN_NODE (id=4) - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.6765259068054099 - BytesRead: 2098519 - BytesReadDataNodeCache: 0 - BytesReadLocal: 2098519 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 2098519 - DecompressionTime: 85054987 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 1 - NumRowGroups: 1 - NumScannerThreadsStarted: 1 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 8268280 - PerReadThreadRawHdfsThroughput: 836121282 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 3343993526 - RowBatchQueuePutWaitTime: 5374486830 - RowsRead: 357142 - RowsReturned: 357142 - RowsReturnedRate: 1108482 - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 92 - ScannerThreadsTotalWallClockTime: 10414989075 - MaterializeTupleTime(*): 737581065 - ScannerThreadsSysTime: 5570142 - ScannerThreadsUserTime: 199397857 - ScannerThreadsVoluntaryContextSwitches: 300 - TotalRawHdfsReadTime(*): 7435392 - TotalReadThroughput: 154542 - TotalTime: 3397537574 Fragment F06 Instance b4afd338536090b:47bd038400000016 (host=redacted-host8:22000) Hdfs split stats (:<# splits>/): 10:1/5.88 MB - AverageThreadTokens: 1.6578947368421053 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 8512917 - PerHostPeakMemUsage: 185442231 - RowsProduced: 308334 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 18358662275 - TotalStorageWaitTime: 15741559593 - TotalThreadsInvoluntaryContextSwitches: 468 - TotalThreadsTotalWallClockTime: 66061108206 - TotalThreadsSysTime: 35995000 - TotalThreadsUserTime: 971853000 - TotalThreadsVoluntaryContextSwitches: 751 - TotalTime: 42536272542 Fragment Instance Lifecycle Timings - ExecTime: 40022395252 - ExecTreeExecTime: 20090544009 - InactiveTotalTime: 0 - OpenTime: 876777103 - ExecTreeOpenTime: 185045 - PrepareTime: 1560023889 - ExecTreePrepareTime: 372145 - TotalTime: 0 DataStreamSender (dst_id=19) - BytesSent: 6020902 - InactiveTotalTime: 0 - NetworkThroughput(*): 87636963 - OverallThroughput: 11983487 - PeakMemoryUsage: 345024 - RowsReturned: 308334 - SerializeBatchTime: 433266342 - TotalTime: 502433200 - TransmitDataRPCTime: 68702768 - UncompressedRowBatchSize: 11622932 CodeGen - CodegenTime: 1451401 - CompileTime: 67481878 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076168 - NumFunctions: 5 - NumInstructions: 98 - OptimizationTime: 583997160 - PeakMemoryUsage: 50176 - PrepareTime: 1022001111 - TotalTime: 1808024148 HDFS_SCAN_NODE (id=4) Hdfs split stats (:<# splits>/): 10:1/5.88 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:2 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.7246376811594203 - BytesRead: 1814021 - BytesReadDataNodeCache: 0 - BytesReadLocal: 1814021 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1814021 - DecompressionTime: 158931915 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 1 - NumRowGroups: 1 - NumScannerThreadsStarted: 1 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 8199214 - PerReadThreadRawHdfsThroughput: 111276661 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 20061083000 - RowBatchQueuePutWaitTime: 223504819 - RowsRead: 308334 - RowsReturned: 308334 - RowsReturnedRate: 15347 - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 92 - ScannerThreadsTotalWallClockTime: 25161958701 - MaterializeTupleTime(*): 1897130353 - ScannerThreadsSysTime: 16997000 - ScannerThreadsUserTime: 209968000 - ScannerThreadsVoluntaryContextSwitches: 454 - TotalRawHdfsReadTime(*): 16301900 - TotalReadThroughput: 49696 - TotalTime: 20090498055 Instance b4afd338536090b:47bd038400000018 (host=redacted-host4:22000) Hdfs split stats (:<# splits>/): 7:1/5.89 MB 6:1/5.89 MB - AverageThreadTokens: 1.8484848484848484 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 8850881 - PerHostPeakMemUsage: 25776693 - RowsProduced: 616667 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 14175239638 - TotalStorageWaitTime: 129538054 - TotalThreadsInvoluntaryContextSwitches: 985 - TotalThreadsTotalWallClockTime: 29972593147 - TotalThreadsSysTime: 22996000 - TotalThreadsUserTime: 1636752000 - TotalThreadsVoluntaryContextSwitches: 753 - TotalTime: 16755495323 Fragment Instance Lifecycle Timings - ExecTime: 16162373650 - ExecTreeExecTime: 293531683 - InactiveTotalTime: 0 - OpenTime: 99713488 - ExecTreeOpenTime: 1905809 - PrepareTime: 492103827 - ExecTreePrepareTime: 400560 - TotalTime: 0 DataStreamSender (dst_id=19) - BytesSent: 11990092 - InactiveTotalTime: 0 - NetworkThroughput(*): 114590557 - OverallThroughput: 15844050 - PeakMemoryUsage: 336832 - RowsReturned: 616667 - SerializeBatchTime: 651557548 - TotalTime: 756756716 - TransmitDataRPCTime: 104634206 - UncompressedRowBatchSize: 23241438 CodeGen - CodegenTime: 1661611 - CompileTime: 46242966 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076168 - NumFunctions: 5 - NumInstructions: 98 - OptimizationTime: 48035804 - PeakMemoryUsage: 50176 - PrepareTime: 165730979 - TotalTime: 270010773 HDFS_SCAN_NODE (id=4) Hdfs split stats (:<# splits>/): 7:1/5.89 MB 6:1/5.89 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 2 out of 2 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:4 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.875 - BytesRead: 3628278 - BytesReadDataNodeCache: 0 - BytesReadLocal: 3628278 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 3628278 - DecompressionTime: 94839380 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 2 - NumRowGroups: 2 - NumScannerThreadsStarted: 1 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 8513757 - PerReadThreadRawHdfsThroughput: 253228432 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 205585512 - RowBatchQueuePutWaitTime: 12214306656 - RowsRead: 616667 - RowsReturned: 616667 - RowsReturnedRate: 2094064 - ScanRangesComplete: 2 - ScannerThreadsInvoluntaryContextSwitches: 121 - ScannerThreadsTotalWallClockTime: 13710522757 - MaterializeTupleTime(*): 747533691 - ScannerThreadsSysTime: 4999000 - ScannerThreadsUserTime: 354946000 - ScannerThreadsVoluntaryContextSwitches: 511 - TotalRawHdfsReadTime(*): 14328083 - TotalReadThroughput: 219802 - TotalTime: 294483337 Instance b4afd338536090b:47bd038400000012 (host=redacted-host6:22000) Hdfs split stats (:<# splits>/): 6:1/6.04 MB - AverageThreadTokens: 1.76 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 8570273 - PerHostPeakMemUsage: 53623348 - RowsProduced: 316666 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 8595753972 - TotalStorageWaitTime: 1287020442 - TotalThreadsInvoluntaryContextSwitches: 476 - TotalThreadsTotalWallClockTime: 21210839648 - TotalThreadsSysTime: 15997000 - TotalThreadsUserTime: 926859000 - TotalThreadsVoluntaryContextSwitches: 460 - TotalTime: 12651202152 Fragment Instance Lifecycle Timings - ExecTime: 11808030750 - ExecTreeExecTime: 2189559616 - InactiveTotalTime: 0 - OpenTime: 110132750 - ExecTreeOpenTime: 147285 - PrepareTime: 732816028 - ExecTreePrepareTime: 228709 - TotalTime: 0 DataStreamSender (dst_id=19) - BytesSent: 6170723 - InactiveTotalTime: 0 - NetworkThroughput(*): 102261094 - OverallThroughput: 13682324 - PeakMemoryUsage: 336832 - RowsReturned: 316666 - SerializeBatchTime: 390303173 - TotalTime: 450999593 - TransmitDataRPCTime: 60342822 - UncompressedRowBatchSize: 11933566 CodeGen - CodegenTime: 913020 - CompileTime: 19467752 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076168 - NumFunctions: 5 - NumInstructions: 98 - OptimizationTime: 80358408 - PeakMemoryUsage: 50176 - PrepareTime: 360583188 - TotalTime: 525919107 HDFS_SCAN_NODE (id=4) Hdfs split stats (:<# splits>/): 6:1/6.04 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:2 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.8260869565217391 - BytesRead: 1857986 - BytesReadDataNodeCache: 0 - BytesReadLocal: 1857986 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1857986 - DecompressionTime: 45763036 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 1 - NumRowGroups: 1 - NumScannerThreadsStarted: 1 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 8233018 - PerReadThreadRawHdfsThroughput: 118295181 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 2167839457 - RowBatchQueuePutWaitTime: 4310854708 - RowsRead: 316666 - RowsReturned: 316666 - RowsReturnedRate: 144664 - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 58 - ScannerThreadsTotalWallClockTime: 9292694846 - MaterializeTupleTime(*): 566683839 - ScannerThreadsSysTime: 2999000 - ScannerThreadsUserTime: 178973000 - ScannerThreadsVoluntaryContextSwitches: 282 - TotalRawHdfsReadTime(*): 15706354 - TotalReadThroughput: 154832 - TotalTime: 2188964993 Instance b4afd338536090b:47bd038400000014 (host=redacted-host3:22000) Hdfs split stats (:<# splits>/): 9:1/6.04 MB - AverageThreadTokens: 1.52 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 8578406 - PerHostPeakMemUsage: 53805933 - RowsProduced: 316667 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 10404368670 - TotalStorageWaitTime: 132798496 - TotalThreadsInvoluntaryContextSwitches: 474 - TotalThreadsTotalWallClockTime: 18519611104 - TotalThreadsSysTime: 10998000 - TotalThreadsUserTime: 845871000 - TotalThreadsVoluntaryContextSwitches: 410 - TotalTime: 12482245083 Fragment Instance Lifecycle Timings - ExecTime: 11777526678 - ExecTreeExecTime: 309723768 - InactiveTotalTime: 0 - OpenTime: 105639209 - ExecTreeOpenTime: 132538 - PrepareTime: 598990479 - ExecTreePrepareTime: 211859 - TotalTime: 0 DataStreamSender (dst_id=19) - BytesSent: 6164840 - InactiveTotalTime: 0 - NetworkThroughput(*): 109709927 - OverallThroughput: 15800857 - PeakMemoryUsage: 353216 - RowsReturned: 316667 - SerializeBatchTime: 333619838 - TotalTime: 390158573 - TransmitDataRPCTime: 56192180 - UncompressedRowBatchSize: 11934522 CodeGen - CodegenTime: 736194 - CompileTime: 21331461 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076168 - NumFunctions: 5 - NumInstructions: 98 - OptimizationTime: 80906875 - PeakMemoryUsage: 50176 - PrepareTime: 346561281 - TotalTime: 455232745 HDFS_SCAN_NODE (id=4) Hdfs split stats (:<# splits>/): 9:1/6.04 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:2 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.5909090909090909 - BytesRead: 1857941 - BytesReadDataNodeCache: 0 - BytesReadLocal: 1857941 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1857941 - DecompressionTime: 71583922 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 1 - NumRowGroups: 1 - NumScannerThreadsStarted: 1 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 8232959 - PerReadThreadRawHdfsThroughput: 1188175044 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 257615698 - RowBatchQueuePutWaitTime: 5389123763 - RowsRead: 316667 - RowsReturned: 316667 - RowsReturnedRate: 1024988 - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 99 - ScannerThreadsTotalWallClockTime: 6636462723 - MaterializeTupleTime(*): 749973419 - ScannerThreadsSysTime: 2999000 - ScannerThreadsUserTime: 173973000 - ScannerThreadsVoluntaryContextSwitches: 236 - TotalRawHdfsReadTime(*): 1563693 - TotalReadThroughput: 154751 - TotalTime: 308946768 Instance b4afd338536090b:47bd038400000013 (host=redacted-host1:22000) Hdfs split stats (:<# splits>/): 8:1/6.04 MB - AverageThreadTokens: 1.5416666666666667 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 8570244 - PerHostPeakMemUsage: 52574120 - RowsProduced: 316667 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 9784336687 - TotalStorageWaitTime: 57881307 - TotalThreadsInvoluntaryContextSwitches: 497 - TotalThreadsTotalWallClockTime: 17472460916 - TotalThreadsSysTime: 9998000 - TotalThreadsUserTime: 858869000 - TotalThreadsVoluntaryContextSwitches: 428 - TotalTime: 11890328981 Fragment Instance Lifecycle Timings - ExecTime: 11087740270 - ExecTreeExecTime: 208489396 - InactiveTotalTime: 0 - OpenTime: 170025497 - ExecTreeOpenTime: 116550 - PrepareTime: 632463390 - ExecTreePrepareTime: 230082 - TotalTime: 0 DataStreamSender (dst_id=19) - BytesSent: 6175039 - InactiveTotalTime: 0 - NetworkThroughput(*): 107941947 - OverallThroughput: 14512410 - PeakMemoryUsage: 336832 - RowsReturned: 316667 - SerializeBatchTime: 367953609 - TotalTime: 425500566 - TransmitDataRPCTime: 57207037 - UncompressedRowBatchSize: 11934572 CodeGen - CodegenTime: 668579 - CompileTime: 29842685 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076168 - NumFunctions: 5 - NumInstructions: 98 - OptimizationTime: 109864061 - PeakMemoryUsage: 50176 - PrepareTime: 266486399 - TotalTime: 407018587 HDFS_SCAN_NODE (id=4) Hdfs split stats (:<# splits>/): 8:1/6.04 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:2 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.6190476190476191 - BytesRead: 1858062 - BytesReadDataNodeCache: 0 - BytesReadLocal: 1858062 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1858062 - DecompressionTime: 53922779 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 1 - NumRowGroups: 1 - NumScannerThreadsStarted: 1 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 8232989 - PerReadThreadRawHdfsThroughput: 1020399623 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 137736388 - RowBatchQueuePutWaitTime: 5186454600 - RowsRead: 316667 - RowsReturned: 316667 - RowsReturnedRate: 1520959 - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 116 - ScannerThreadsTotalWallClockTime: 6214720619 - MaterializeTupleTime(*): 607682020 - ScannerThreadsSysTime: 1999000 - ScannerThreadsUserTime: 171973000 - ScannerThreadsVoluntaryContextSwitches: 245 - TotalRawHdfsReadTime(*): 1820916 - TotalReadThroughput: 168884 - TotalTime: 208202075 Instance b4afd338536090b:47bd038400000015 (host=redacted-host7:22000) Hdfs split stats (:<# splits>/): 9:1/5.89 MB - AverageThreadTokens: 1.4782608695652173 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 8570276 - PerHostPeakMemUsage: 52408409 - RowsProduced: 308333 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 9212089311 - TotalStorageWaitTime: 319463404 - TotalThreadsInvoluntaryContextSwitches: 391 - TotalThreadsTotalWallClockTime: 16983949584 - TotalThreadsSysTime: 11998000 - TotalThreadsUserTime: 812876000 - TotalThreadsVoluntaryContextSwitches: 341 - TotalTime: 11612374998 Fragment Instance Lifecycle Timings - ExecTime: 10881765665 - ExecTreeExecTime: 560516993 - InactiveTotalTime: 0 - OpenTime: 160939204 - ExecTreeOpenTime: 116555 - PrepareTime: 569542465 - ExecTreePrepareTime: 216416 - TotalTime: 0 DataStreamSender (dst_id=19) - BytesSent: 5997577 - InactiveTotalTime: 0 - NetworkThroughput(*): 111796334 - OverallThroughput: 16067028 - PeakMemoryUsage: 336832 - RowsReturned: 308333 - SerializeBatchTime: 319327513 - TotalTime: 373284757 - TransmitDataRPCTime: 53647349 - UncompressedRowBatchSize: 11619756 CodeGen - CodegenTime: 919465 - CompileTime: 81873152 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076168 - NumFunctions: 5 - NumInstructions: 98 - OptimizationTime: 75600472 - PeakMemoryUsage: 50176 - PrepareTime: 267770999 - TotalTime: 426427164 HDFS_SCAN_NODE (id=4) Hdfs split stats (:<# splits>/): 9:1/5.89 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:2 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.55 - BytesRead: 1814616 - BytesReadDataNodeCache: 0 - BytesReadLocal: 1814616 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1814616 - DecompressionTime: 31921324 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 1 - NumRowGroups: 1 - NumScannerThreadsStarted: 1 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 8233021 - PerReadThreadRawHdfsThroughput: 1628673593 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 534993540 - RowBatchQueuePutWaitTime: 5140713586 - RowsRead: 308333 - RowsReturned: 308333 - RowsReturnedRate: 550383 - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 71 - ScannerThreadsTotalWallClockTime: 5941260034 - MaterializeTupleTime(*): 203102120 - ScannerThreadsSysTime: 3999000 - ScannerThreadsUserTime: 145977000 - ScannerThreadsVoluntaryContextSwitches: 173 - TotalRawHdfsReadTime(*): 1114168 - TotalReadThroughput: 164890 - TotalTime: 560214935 Instance b4afd338536090b:47bd038400000017 (host=redacted-host2:22000) Hdfs split stats (:<# splits>/): 3:1/6.04 MB - AverageThreadTokens: 1.4782608695652173 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 8545684 - PerHostPeakMemUsage: 52004245 - RowsProduced: 316666 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 9472899841 - TotalStorageWaitTime: 26490979 - TotalThreadsInvoluntaryContextSwitches: 530 - TotalThreadsTotalWallClockTime: 16674488701 - TotalThreadsSysTime: 10998000 - TotalThreadsUserTime: 846870000 - TotalThreadsVoluntaryContextSwitches: 397 - TotalTime: 11459489373 Fragment Instance Lifecycle Timings - ExecTime: 10596665763 - ExecTreeExecTime: 95656257 - InactiveTotalTime: 0 - OpenTime: 130536171 - ExecTreeOpenTime: 139740 - PrepareTime: 732196473 - ExecTreePrepareTime: 13922797 - TotalTime: 0 DataStreamSender (dst_id=19) - BytesSent: 6161664 - InactiveTotalTime: 0 - NetworkThroughput(*): 112380468 - OverallThroughput: 11123476 - PeakMemoryUsage: 312256 - RowsReturned: 316666 - SerializeBatchTime: 498743142 - TotalTime: 553933314 - TransmitDataRPCTime: 54828602 - UncompressedRowBatchSize: 11935494 CodeGen - CodegenTime: 1468382 - CompileTime: 47044317 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076168 - NumFunctions: 5 - NumInstructions: 98 - OptimizationTime: 75500991 - PeakMemoryUsage: 50176 - PrepareTime: 403829746 - TotalTime: 593832017 HDFS_SCAN_NODE (id=4) Hdfs split stats (:<# splits>/): 3:1/6.04 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:2 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.55 - BytesRead: 1858729 - BytesReadDataNodeCache: 0 - BytesReadLocal: 1858729 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1858729 - DecompressionTime: 138422553 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 1 - NumRowGroups: 1 - NumScannerThreadsStarted: 1 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 8233005 - PerReadThreadRawHdfsThroughput: 1532800444 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 43101092 - RowBatchQueuePutWaitTime: 5156449679 - RowsRead: 316666 - RowsReturned: 316666 - RowsReturnedRate: 2408970 - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 92 - ScannerThreadsTotalWallClockTime: 5947303849 - MaterializeTupleTime(*): 390962016 - ScannerThreadsSysTime: 4999000 - ScannerThreadsUserTime: 159975000 - ScannerThreadsVoluntaryContextSwitches: 204 - TotalRawHdfsReadTime(*): 1212636 - TotalReadThroughput: 168944 - TotalTime: 131452859