Query (id=a9429a2e6e27c0c3:f784d2e700000000) DEBUG MODE WARNING: Query profile created while running a DEBUG build of Impala. Use RELEASE builds to measure query performance. Summary Session ID: 34cd62223ca8975:1a91eecd60f9d0ae Session Type: HIVESERVER2 HiveServer2 Protocol Version: V6 Start Time: 2017-05-31 23:26:34.738196000 End Time: 2017-05-31 23:31:46.477048000 Query Type: QUERY Query State: FINISHED Query Status: OK Impala Version: impalad version 2.8.0-cdh5.11.0 DEBUG (build e09660de6b503a15f07e84b99b63e8e745854c34) User: redacted Connected User: redacted Delegated User: Network Address: redacted Default Db: tpcds_300_decimal_parquet Sql Statement: /* Mem: 133 MB. Coordinator: redacted-host5. */ select c_last_name, c_first_name, c_salutation, c_preferred_cust_flag, ss_ticket_number, cnt from (select ss_ticket_number, ss_customer_sk, count(*) cnt from store_sales, date_dim, store, household_demographics where store_sales.ss_sold_date_sk = date_dim.d_date_sk and store_sales.ss_store_sk = store.s_store_sk and store_sales.ss_hdemo_sk = household_demographics.hd_demo_sk and (date_dim.d_dom between 1 and 3 or date_dim.d_dom between 25 and 28) and (household_demographics.hd_buy_potential = '>10000' or household_demographics.hd_buy_potential = 'unknown') and household_demographics.hd_vehicle_count > 0 and (case when household_demographics.hd_vehicle_count > 0 then household_demographics.hd_dep_count / household_demographics.hd_vehicle_count else null end) > 1.2 and date_dim.d_year in (1998, 1998 + 1, 1998 + 2) and store.s_county in ('Saginaw County', 'Sumner County', 'Appanoose County', 'Daviess County', 'Fairfield County', 'Raleigh County', 'Ziebach County', 'Williamson County') and ss_sold_date_sk between 2450816 and 2451910 -- partition key filter group by ss_ticket_number, ss_customer_sk ) dn, customer where ss_customer_sk = c_customer_sk and cnt between 15 and 20 order by c_last_name, c_first_name, c_salutation, c_preferred_cust_flag desc limit 100000; Coordinator: redacted-host5:22000 Query Options (non default): ABORT_ON_ERROR=1,MEM_LIMIT=139460608,RUNTIME_FILTER_MODE=0 Plan: ---------------- Estimated Per-Host Requirements: Memory=388.54MB VCores=4 PLAN-ROOT SINK | 18:MERGING-EXCHANGE [UNPARTITIONED] | order by: c_last_name ASC, c_first_name ASC, c_salutation ASC, c_preferred_cust_flag DESC | limit: 100000 | hosts=8 per-host-mem=unavailable | tuple-ids=7 row-size=96B cardinality=29939 | 10:TOP-N [LIMIT=100000] | order by: c_last_name ASC, c_first_name ASC, c_salutation ASC, c_preferred_cust_flag DESC | hosts=8 per-host-mem=2.73MB | tuple-ids=7 row-size=96B cardinality=29939 | 09:HASH JOIN [INNER JOIN, PARTITIONED] | hash predicates: c_customer_sk = ss_customer_sk | hosts=8 per-host-mem=16.28MB | tuple-ids=6,4 row-size=112B cardinality=29939 | |--17:EXCHANGE [HASH(ss_customer_sk)] | | hosts=8 per-host-mem=0B | | tuple-ids=4 row-size=24B cardinality=5173436 | | | 15:AGGREGATE [FINALIZE] | | output: count:merge(*) | | group by: ss_ticket_number, ss_customer_sk | | having: count(*) <= 20, count(*) >= 15 | | hosts=8 per-host-mem=130.25MB | | tuple-ids=4 row-size=24B cardinality=5173436 | | | 14:EXCHANGE [HASH(ss_ticket_number,ss_customer_sk)] | | hosts=8 per-host-mem=0B | | tuple-ids=4 row-size=24B cardinality=5173436 | | | 07:AGGREGATE [STREAMING] | | output: count(*) | | group by: ss_ticket_number, ss_customer_sk | | hosts=8 per-host-mem=130.25MB | | tuple-ids=4 row-size=24B cardinality=5173436 | | | 06:HASH JOIN [INNER JOIN, BROADCAST] | | hash predicates: store_sales.ss_store_sk = store.s_store_sk | | hosts=8 per-host-mem=16.63KB | | tuple-ids=0,3,1,2 row-size=134B cardinality=5173436 | | | |--13:EXCHANGE [BROADCAST] | | | hosts=1 per-host-mem=0B | | | tuple-ids=2 row-size=39B cardinality=402 | | | | | 02:SCAN HDFS [tpcds_300_decimal_parquet.store, RANDOM] | | partitions=1/1 files=1 size=71.36KB | | predicates: store.s_county IN ('Saginaw County', 'Sumner County', 'Appanoose County', 'Daviess County', 'Fairfield County', 'Raleigh County', 'Ziebach County', 'Williamson County') | | table stats: 804 rows total | | column stats: all | | hosts=1 per-host-mem=32.00MB | | tuple-ids=2 row-size=39B cardinality=402 | | | 05:HASH JOIN [INNER JOIN, BROADCAST] | | hash predicates: store_sales.ss_sold_date_sk = date_dim.d_date_sk | | hosts=8 per-host-mem=6.08KB | | tuple-ids=0,3,1 row-size=96B cardinality=5173436 | | | |--12:EXCHANGE [BROADCAST] | | | hosts=1 per-host-mem=0B | | | tuple-ids=1 row-size=16B cardinality=354 | | | | | 01:SCAN HDFS [tpcds_300_decimal_parquet.date_dim, RANDOM] | | partitions=1/1 files=1 size=2.15MB | | predicates: date_dim.d_year IN (1998, 1999, 2000), tpcds_300_decimal_parquet.date_dim.d_date_sk <= 2451910, tpcds_300_decimal_parquet.date_dim.d_date_sk >= 2450816, (date_dim.d_dom >= 1 AND date_dim.d_dom <= 3 OR date_dim.d_dom >= 25 AND date_dim.d_dom <= 28) | | table stats: 73049 rows total | | column stats: all | | hosts=1 per-host-mem=48.00MB | | tuple-ids=1 row-size=16B cardinality=354 | | | 04:HASH JOIN [INNER JOIN, BROADCAST] | | hash predicates: store_sales.ss_hdemo_sk = household_demographics.hd_demo_sk | | hosts=8 per-host-mem=16.89KB | | tuple-ids=0,3 row-size=80B cardinality=27319040 | | | |--11:EXCHANGE [BROADCAST] | | | hosts=1 per-host-mem=0B | | | tuple-ids=3 row-size=40B cardinality=398 | | | | | 03:SCAN HDFS [tpcds_300_decimal_parquet.household_demographics, RANDOM] | | partitions=1/1 files=1 size=41.12KB | | predicates: household_demographics.hd_vehicle_count > 0, (CASE WHEN household_demographics.hd_vehicle_count > 0 THEN household_demographics.hd_dep_count / household_demographics.hd_vehicle_count ELSE NULL END) > 1.2, (household_demographics.hd_buy_potential = '>10000' OR household_demographics.hd_buy_potential = 'unknown') | | table stats: 7200 rows total | | column stats: all | | hosts=1 per-host-mem=64.00MB | | tuple-ids=3 row-size=40B cardinality=398 | | | 00:SCAN HDFS [tpcds_300_decimal_parquet.store_sales, RANDOM] | partitions=1093/1824 files=1093 size=22.33GB | table stats: 864001869 rows total | column stats: all | hosts=8 per-host-mem=128.00MB | tuple-ids=0 row-size=40B cardinality=494213786 | 16:EXCHANGE [HASH(c_customer_sk)] | hosts=8 per-host-mem=0B | tuple-ids=6 row-size=88B cardinality=5000000 | 08:SCAN HDFS [tpcds_300_decimal_parquet.customer, RANDOM] partitions=1/1 files=8 size=266.45MB table stats: 5000000 rows total column stats: all hosts=8 per-host-mem=240.00MB tuple-ids=6 row-size=88B cardinality=5000000 ---------------- Estimated Per-Host Mem: 407415701 Estimated Per-Host VCores: 4 Request Pool: redacted Admission result: Admitted immediately ExecSummary: Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail ---------------------------------------------------------------------------------------------------------------------------------- 18:MERGING-EXCHANGE 1 35.419ms 35.419ms 18.96K 29.94K 0 -1.00 B UNPARTITIONED 10:TOP-N 7 32.082ms 68.794ms 18.96K 29.94K 8.58 MB 2.73 MB 09:HASH JOIN 7 372.790ms 1s173ms 18.96K 29.94K 1.66 MB 16.28 MB INNER JOIN, PARTITIONED |--17:EXCHANGE 7 881.351us 1.066ms 18.96K 5.17M 0 0 HASH(ss_customer_sk) | 15:AGGREGATE 8 497.526ms 1s864ms 18.96K 5.17M 3.11 MB 130.25 MB FINALIZE | 14:EXCHANGE 8 10.844ms 20.922ms 209.92K 5.17M 0 0 HASH(ss_ticket_number,ss_cu... | 07:AGGREGATE 8 11s457ms 16s706ms 209.92K 5.17M 14.00 MB 130.25 MB STREAMING | 06:HASH JOIN 8 1s691ms 4s795ms 2.18M 5.17M 10.73 MB 16.63 KB INNER JOIN, BROADCAST | |--13:EXCHANGE 8 80.996us 95.056us 229 402 0 0 BROADCAST | | 02:SCAN HDFS 1 28.054ms 28.054ms 229 402 140.00 KB 32.00 MB tpcds_300_decimal_parquet.s... | 05:HASH JOIN 8 805.261ms 1s058ms 7.94M 5.17M 3.03 MB 6.08 KB INNER JOIN, BROADCAST | |--12:EXCHANGE 8 73.225us 87.336us 251 354 0 0 BROADCAST | | 01:SCAN HDFS 1 350.355ms 350.355ms 251 354 3.05 MB 48.00 MB tpcds_300_decimal_parquet.d... | 04:HASH JOIN 8 6s555ms 7s551ms 34.84M 27.32M 1.97 MB 16.89 KB INNER JOIN, BROADCAST | |--11:EXCHANGE 8 150.636us 190.720us 520 398 0 0 BROADCAST | | 03:SCAN HDFS 1 360.869ms 360.869ms 520 398 575.20 KB 64.00 MB tpcds_300_decimal_parquet.h... | 00:SCAN HDFS 8 4m31s 4m36s 494.21M 494.21M 13.90 MB 128.00 MB tpcds_300_decimal_parquet.s... 16:EXCHANGE 7 359.953ms 473.886ms 5.00M 5.00M 0 0 HASH(c_customer_sk) 08:SCAN HDFS 7 411.894ms 902.620ms 5.00M 5.00M 23.12 MB 240.00 MB tpcds_300_decimal_parquet.c... - ComputeScanRangeAssignmentTimer: 64663544 - InactiveTotalTime: 0 - TotalTime: 0 Planner Timeline Analysis finished: 74862036 Equivalence classes computed: 75295184 Single node plan created: 80822406 Distributed plan created: 81336249 Lineage info computed: 81501413 Planning finished: 87752147 Query Timeline Query submitted: 8997448 Planning finished: 268314544 Submit for admission: 389757424 Completed admission: 518773672 Ready to start 34 fragment instances: 626233280 All 34 fragment instances started: 2554672584 Rows available: 309612198496 First row fetched: 309673306328 Unregister query: 311738671288 ImpalaServer - ClientFetchWaitTimer: 1997918616 - InactiveTotalTime: 0 - RowMaterializationTimer: 128394952 - TotalTime: 0 Execution Profile a9429a2e6e27c0c3:f784d2e700000000 Fragment instance start latencies: Count: 34, 25th %-ile: 16ms, 50th %-ile: 107ms, 75th %-ile: 182ms, 90th %-ile: 257ms, 95th %-ile: 276ms, 99.9th %-ile: 426ms Per Node Peak Memory Usage: redacted-host8:22000(28.01 MB) redacted-host4:22000(69.14 MB) redacted-host1:22000(68.08 MB) redacted-host3:22000(66.74 MB) redacted-host7:22000(68.98 MB) redacted-host2:22000(68.06 MB) redacted-host6:22000(70.30 MB) redacted-host5:22000(70.43 MB) - FiltersReceived: 0 - FinalizationTimer: 0 - InactiveTotalTime: 0 - TotalTime: 309108955016 Coordinator Fragment F07 Instance a9429a2e6e27c0c3:f784d2e700000000 (host=redacted-host5:22000) - AverageThreadTokens: 0.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 1996420 - PerHostPeakMemUsage: 73846530 - RowsProduced: 18956 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 146 - TotalThreadsTotalWallClockTime: 309668510896 - TotalThreadsSysTime: 5999000 - TotalThreadsUserTime: 292955000 - TotalThreadsVoluntaryContextSwitches: 100 - TotalTime: 309751793424 Fragment Instance Lifecycle Timings - ExecTime: 2043264840 - ExecTreeExecTime: 34959120 - InactiveTotalTime: 0 - OpenTime: 307636035296 - ExecTreeOpenTime: 307320442768 - PrepareTime: 72391640 - ExecTreePrepareTime: 138904 - TotalTime: 0 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 96 - BlocksRecycled: 18 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 34603008 - PeakMemoryUsage: 1377536 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 PLAN_ROOT_SINK - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - TotalTime: 0 CodeGen - CodegenTime: 4518680 - CompileTime: 27132632 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2021884 - NumFunctions: 31 - NumInstructions: 755 - OptimizationTime: 268666768 - PeakMemoryUsage: 386560 - PrepareTime: 58682736 - TotalTime: 367341520 EXCHANGE_NODE (id=18) ExecOption: Codegen Enabled - BytesReceived: 984590 - ConvertRowBatchTime: 0 - DeserializeRowBatchTimer: 18461680 - FirstBatchArrivalWaitTime: 307319863392 - InactiveTotalTime: 307319868608 - MergeGetNext: 34727688 - MergeGetNextBatch: 161808 - PeakMemoryUsage: 0 - RowsReturned: 18956 - RowsReturnedRate: 61 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 307355287808 Averaged Fragment F06 split sizes: min: 0, max: 0, avg: 0, stddev: 0 completion times: min:5m7s max:5m7s mean: 5m7s stddev:55.834ms execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec num instances: 7 - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 23066810 - PerHostPeakMemUsage: 72161767 - RowsProduced: 2708 - TotalNetworkReceiveTime: 303400553482 - TotalNetworkSendTime: 2125045 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 635 - TotalThreadsTotalWallClockTime: 306796774763 - TotalThreadsSysTime: 41708000 - TotalThreadsUserTime: 1238240142 - TotalThreadsVoluntaryContextSwitches: 2576 - TotalTime: 307567604028 Fragment Instance Lifecycle Timings - ExecTime: 9011890 - ExecTreeExecTime: 705738 - InactiveTotalTime: 0 - OpenTime: 306818441345 - ExecTreeOpenTime: 303771258631 - PrepareTime: 740049575 - ExecTreePrepareTime: 124839687 - TotalTime: 0 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 96 - BlocksRecycled: 21 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 34603008 - PeakMemoryUsage: 2131200 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 DataStreamSender (dst_id=18) - BytesSent: 140655 - InactiveTotalTime: 0 - NetworkThroughput(*): 182995135 - OverallThroughput: 20818972 - PeakMemoryUsage: 1616 - RowsReturned: 2708 - SerializeBatchTime: 5902160 - TotalTime: 7102616 - TransmitDataRPCTime: 819288 - UncompressedRowBatchSize: 272645 CodeGen - CodegenTime: 29486166 - CompileTime: 787718642 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2021884 - NumFunctions: 134 - NumInstructions: 4382 - OptimizationTime: 2152786348 - PeakMemoryUsage: 2243584 - PrepareTime: 295060329 - TotalTime: 3246745970 SORT_NODE (id=10) - InactiveTotalTime: 0 - InsertBatchTime: 3254974 - PeakMemoryUsage: 8982674 - RowsReturned: 2708 - RowsReturnedRate: 8 - TotalTime: 303896790866 HASH_JOIN_NODE (id=9) - BuildRows: 2708 - BuildTime: 3166270 - InactiveTotalTime: 0 - LocalTime: 372790180 - PeakMemoryUsage: 1589662 - ProbeRows: 714285 - ProbeRowsPartitioned: 0 - ProbeTime: 100027940 - RowsReturned: 2708 - RowsReturnedRate: 8 - TotalTime: 303979309456 Hash Join Builder (join_node_id=9) - BuildRowsPartitionTime: 695371 - BuildRowsPartitioned: 2708 - GetNewBlockTime: 74385 - HashBuckets: 5924 - HashCollisions: 0 - HashTablesBuildTime: 1669736 - InactiveTotalTime: 0 - LargestPartitionPercent: 6 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 1464594 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=17) - BytesReceived: 45578 - ConvertRowBatchTime: 708109 - DeserializeRowBatchTimer: 788411 - FirstBatchArrivalWaitTime: 300232942427 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 2708 - RowsReturnedRate: 8 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 300241280716 EXCHANGE_NODE (id=16) - BytesReceived: 35919087 - ConvertRowBatchTime: 180876962 - DeserializeRowBatchTimer: 2890057901 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 714285 - RowsReturnedRate: 212259 - SendersBlockedTimer: 288428175640 - SendersBlockedTotalTimer(*): 1606895076290 - TotalTime: 3365238558 Fragment F06 Instance a9429a2e6e27c0c3:1c (host=redacted-host5:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 23010579 - PerHostPeakMemUsage: 73846530 - RowsProduced: 2732 - TotalNetworkReceiveTime: 305555243184 - TotalNetworkSendTime: 1358968 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 674 - TotalThreadsTotalWallClockTime: 307578645080 - TotalThreadsSysTime: 34995000 - TotalThreadsUserTime: 1254809000 - TotalThreadsVoluntaryContextSwitches: 2494 - TotalTime: 307686807720 Fragment Instance Lifecycle Timings - ExecTime: 9252816 - ExecTreeExecTime: 734224 - InactiveTotalTime: 0 - OpenTime: 307583429752 - ExecTreeOpenTime: 305994710824 - PrepareTime: 94002968 - ExecTreePrepareTime: 636072 - TotalTime: 0 DataStreamSender (dst_id=18) - BytesSent: 142424 - InactiveTotalTime: 0 - NetworkThroughput(*): 317734825 - OverallThroughput: 19417888 - PeakMemoryUsage: 1616 - RowsReturned: 2732 - SerializeBatchTime: 6839816 - TotalTime: 7334680 - TransmitDataRPCTime: 448248 - UncompressedRowBatchSize: 275245 CodeGen - CodegenTime: 6255456 - CompileTime: 510091016 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2021884 - NumFunctions: 134 - NumInstructions: 4382 - OptimizationTime: 1054552704 - PeakMemoryUsage: 2243584 - PrepareTime: 66240368 - TotalTime: 1633450136 SORT_NODE (id=10) ExecOption: Codegen Enabled - InactiveTotalTime: 0 - InsertBatchTime: 3067280 - PeakMemoryUsage: 8988224 - RowsReturned: 2732 - RowsReturnedRate: 8 - TotalTime: 305996067048 HASH_JOIN_NODE (id=9) ExecOption: Probe Side Codegen Enabled - BuildRows: 2732 - BuildTime: 2685856 - InactiveTotalTime: 0 - LocalTime: 138839640 - PeakMemoryUsage: 1414956 - ProbeRows: 713170 - ProbeRowsPartitioned: 0 - ProbeTime: 115078448 - RowsReturned: 2732 - RowsReturnedRate: 8 - TotalTime: 305927272632 Hash Join Builder (join_node_id=9) ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 711584 - BuildRowsPartitioned: 2732 - GetNewBlockTime: 193752 - HashBuckets: 5376 - HashCollisions: 0 - HashTablesBuildTime: 1413648 - InactiveTotalTime: 0 - LargestPartitionPercent: 7 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 1287296 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=17) - BytesReceived: 46052 - ConvertRowBatchTime: 730240 - DeserializeRowBatchTimer: 1626280 - FirstBatchArrivalWaitTime: 302459452864 - InactiveTotalTime: 302467111904 - PeakMemoryUsage: 0 - RowsReturned: 2732 - RowsReturnedRate: 9 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 302468022944 EXCHANGE_NODE (id=16) - BytesReceived: 35868279 - ConvertRowBatchTime: 204632512 - DeserializeRowBatchTimer: 2283813672 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 2948577960 - PeakMemoryUsage: 0 - RowsReturned: 713170 - RowsReturnedRate: 214783 - SendersBlockedTimer: 288418958024 - SendersBlockedTotalTimer(*): 1442063881552 - TotalTime: 3320410048 Instance a9429a2e6e27c0c3:20 (host=redacted-host1:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 22798836 - PerHostPeakMemUsage: 71391289 - RowsProduced: 2635 - TotalNetworkReceiveTime: 305971448904 - TotalNetworkSendTime: 2482272 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 585 - TotalThreadsTotalWallClockTime: 307527883656 - TotalThreadsSysTime: 34995000 - TotalThreadsUserTime: 1159823000 - TotalThreadsVoluntaryContextSwitches: 2365 - TotalTime: 307645297168 Fragment Instance Lifecycle Timings - ExecTime: 10087448 - ExecTreeExecTime: 770056 - InactiveTotalTime: 0 - OpenTime: 307520199216 - ExecTreeOpenTime: 306327076976 - PrepareTime: 114898048 - ExecTreePrepareTime: 419496 - TotalTime: 0 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 96 - BlocksRecycled: 21 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 34603008 - PeakMemoryUsage: 2163968 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 DataStreamSender (dst_id=18) - BytesSent: 136924 - InactiveTotalTime: 0 - NetworkThroughput(*): 161792091 - OverallThroughput: 18480567 - PeakMemoryUsage: 1616 - RowsReturned: 2635 - SerializeBatchTime: 6523576 - TotalTime: 7409080 - TransmitDataRPCTime: 846296 - UncompressedRowBatchSize: 265290 CodeGen - CodegenTime: 3767528 - CompileTime: 350551800 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2021884 - NumFunctions: 134 - NumInstructions: 4382 - OptimizationTime: 823921960 - PeakMemoryUsage: 2243584 - PrepareTime: 56477848 - TotalTime: 1231888192 SORT_NODE (id=10) ExecOption: Codegen Enabled - InactiveTotalTime: 0 - InsertBatchTime: 3346512 - PeakMemoryUsage: 8979790 - RowsReturned: 2635 - RowsReturnedRate: 8 - TotalTime: 306328252592 HASH_JOIN_NODE (id=9) ExecOption: Probe Side Codegen Enabled - BuildRows: 2635 - BuildTime: 2366616 - InactiveTotalTime: 0 - LocalTime: 125988160 - PeakMemoryUsage: 1613436 - ProbeRows: 713823 - ProbeRowsPartitioned: 0 - ProbeTime: 91794816 - RowsReturned: 2635 - RowsReturnedRate: 8 - TotalTime: 306290009920 Hash Join Builder (join_node_id=9) ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 798272 - BuildRowsPartitioned: 2635 - GetNewBlockTime: 63368 - HashBuckets: 5632 - HashCollisions: 0 - HashTablesBuildTime: 1153408 - InactiveTotalTime: 0 - LargestPartitionPercent: 7 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 1488000 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=17) - BytesReceived: 44423 - ConvertRowBatchTime: 776664 - DeserializeRowBatchTimer: 339784 - FirstBatchArrivalWaitTime: 302775351760 - InactiveTotalTime: 302782837056 - PeakMemoryUsage: 0 - RowsReturned: 2635 - RowsReturnedRate: 8 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 302783788248 EXCHANGE_NODE (id=16) - BytesReceived: 35897698 - ConvertRowBatchTime: 169111520 - DeserializeRowBatchTimer: 2464527840 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 3069875336 - PeakMemoryUsage: 0 - RowsReturned: 713823 - RowsReturnedRate: 211175 - SendersBlockedTimer: 288421029392 - SendersBlockedTotalTimer(*): 1442070507960 - TotalTime: 3380233512 Instance a9429a2e6e27c0c3:1f (host=redacted-host3:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 23257772 - PerHostPeakMemUsage: 69985667 - RowsProduced: 2710 - TotalNetworkReceiveTime: 305531637952 - TotalNetworkSendTime: 1995520 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 588 - TotalThreadsTotalWallClockTime: 307460932400 - TotalThreadsSysTime: 31995000 - TotalThreadsUserTime: 1213815000 - TotalThreadsVoluntaryContextSwitches: 2437 - TotalTime: 307632231680 Fragment Instance Lifecycle Timings - ExecTime: 9483440 - ExecTreeExecTime: 760136 - InactiveTotalTime: 0 - OpenTime: 307468751824 - ExecTreeOpenTime: 305894077304 - PrepareTime: 153891280 - ExecTreePrepareTime: 624600 - TotalTime: 0 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 96 - BlocksRecycled: 22 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 34603008 - PeakMemoryUsage: 2000128 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 DataStreamSender (dst_id=18) - BytesSent: 140062 - InactiveTotalTime: 0 - NetworkThroughput(*): 163769234 - OverallThroughput: 19135763 - PeakMemoryUsage: 1616 - RowsReturned: 2710 - SerializeBatchTime: 6419160 - TotalTime: 7319384 - TransmitDataRPCTime: 855240 - UncompressedRowBatchSize: 272638 CodeGen - CodegenTime: 3708592 - CompileTime: 562198976 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2021884 - NumFunctions: 134 - NumInstructions: 4382 - OptimizationTime: 986632800 - PeakMemoryUsage: 2243584 - PrepareTime: 110386496 - TotalTime: 1660200520 SORT_NODE (id=10) ExecOption: Codegen Enabled - InactiveTotalTime: 0 - InsertBatchTime: 3238072 - PeakMemoryUsage: 8981189 - RowsReturned: 2710 - RowsReturnedRate: 8 - TotalTime: 305895448592 HASH_JOIN_NODE (id=9) ExecOption: Probe Side Codegen Enabled - BuildRows: 2710 - BuildTime: 4851408 - InactiveTotalTime: 0 - LocalTime: 121481160 - PeakMemoryUsage: 1682623 - ProbeRows: 714050 - ProbeRowsPartitioned: 0 - ProbeTime: 97820040 - RowsReturned: 2710 - RowsReturnedRate: 8 - TotalTime: 305857466344 Hash Join Builder (join_node_id=9) ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 588248 - BuildRowsPartitioned: 2710 - GetNewBlockTime: 71664 - HashBuckets: 5888 - HashCollisions: 0 - HashTablesBuildTime: 1922352 - InactiveTotalTime: 0 - LargestPartitionPercent: 7 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 1557632 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=17) - BytesReceived: 45619 - ConvertRowBatchTime: 727496 - DeserializeRowBatchTimer: 434368 - FirstBatchArrivalWaitTime: 302357380040 - InactiveTotalTime: 302363512600 - PeakMemoryUsage: 0 - RowsReturned: 2710 - RowsReturnedRate: 8 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 302364441576 EXCHANGE_NODE (id=16) - BytesReceived: 35900482 - ConvertRowBatchTime: 179713376 - DeserializeRowBatchTimer: 2133571096 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 2897657168 - PeakMemoryUsage: 0 - RowsReturned: 714050 - RowsReturnedRate: 211787 - SendersBlockedTimer: 288421926704 - SendersBlockedTotalTimer(*): 1442046313752 - TotalTime: 3371543608 Instance a9429a2e6e27c0c3:1b (host=redacted-host6:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 23171312 - PerHostPeakMemUsage: 73712395 - RowsProduced: 2684 - TotalNetworkReceiveTime: 301029865640 - TotalNetworkSendTime: 3424152 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 610 - TotalThreadsTotalWallClockTime: 306724218700 - TotalThreadsSysTime: 53992000 - TotalThreadsUserTime: 1269807000 - TotalThreadsVoluntaryContextSwitches: 2717 - TotalTime: 307581031656 Fragment Instance Lifecycle Timings - ExecTime: 7236952 - ExecTreeExecTime: 504632 - InactiveTotalTime: 0 - OpenTime: 306761802588 - ExecTreeOpenTime: 301378809684 - PrepareTime: 811904924 - ExecTreePrepareTime: 611552 - TotalTime: 0 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 96 - BlocksRecycled: 23 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 34603008 - PeakMemoryUsage: 2163968 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 DataStreamSender (dst_id=18) - BytesSent: 139503 - InactiveTotalTime: 0 - NetworkThroughput(*): 151277863 - OverallThroughput: 34643534 - PeakMemoryUsage: 1616 - RowsReturned: 2684 - SerializeBatchTime: 3031876 - TotalTime: 4026812 - TransmitDataRPCTime: 922164 - UncompressedRowBatchSize: 270345 CodeGen - CodegenTime: 45393672 - CompileTime: 1198896100 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2021884 - NumFunctions: 134 - NumInstructions: 4382 - OptimizationTime: 4073160120 - PeakMemoryUsage: 2243584 - PrepareTime: 433444436 - TotalTime: 5765906816 SORT_NODE (id=10) ExecOption: Codegen Enabled - InactiveTotalTime: 0 - InsertBatchTime: 3818632 - PeakMemoryUsage: 8966222 - RowsReturned: 2684 - RowsReturnedRate: 8 - TotalTime: 301379912928 HASH_JOIN_NODE (id=9) ExecOption: Probe Side Codegen Enabled - BuildRows: 2684 - BuildTime: 2825540 - InactiveTotalTime: 0 - LocalTime: 115000188 - PeakMemoryUsage: 1744433 - ProbeRows: 713910 - ProbeRowsPartitioned: 0 - ProbeTime: 93743188 - RowsReturned: 2684 - RowsReturnedRate: 8 - TotalTime: 301341200336 Hash Join Builder (join_node_id=9) ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 603880 - BuildRowsPartitioned: 2684 - GetNewBlockTime: 43760 - HashBuckets: 5888 - HashCollisions: 0 - HashTablesBuildTime: 1949256 - InactiveTotalTime: 0 - LargestPartitionPercent: 7 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 1623168 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=17) - BytesReceived: 45111 - ConvertRowBatchTime: 529532 - DeserializeRowBatchTimer: 1395132 - FirstBatchArrivalWaitTime: 297841719284 - InactiveTotalTime: 297850456136 - PeakMemoryUsage: 0 - RowsReturned: 2684 - RowsReturnedRate: 9 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 297851114540 EXCHANGE_NODE (id=16) - BytesReceived: 35905892 - ConvertRowBatchTime: 172438408 - DeserializeRowBatchTimer: 3808030104 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 3057243072 - PeakMemoryUsage: 0 - RowsReturned: 713910 - RowsReturnedRate: 211523 - SendersBlockedTimer: 288442494564 - SendersBlockedTotalTimer(*): 2018966822928 - TotalTime: 3375085608 Instance a9429a2e6e27c0c3:1e (host=redacted-host7:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 22903966 - PerHostPeakMemUsage: 72333694 - RowsProduced: 2765 - TotalNetworkReceiveTime: 303459508112 - TotalNetworkSendTime: 1451504 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 656 - TotalThreadsTotalWallClockTime: 307066923480 - TotalThreadsSysTime: 55991000 - TotalThreadsUserTime: 1211816000 - TotalThreadsVoluntaryContextSwitches: 2654 - TotalTime: 307526436344 Fragment Instance Lifecycle Timings - ExecTime: 9477240 - ExecTreeExecTime: 788568 - InactiveTotalTime: 0 - OpenTime: 307126790312 - ExecTreeOpenTime: 303812374056 - PrepareTime: 390078168 - ExecTreePrepareTime: 387488 - TotalTime: 0 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 96 - BlocksRecycled: 20 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 34603008 - PeakMemoryUsage: 2163968 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 DataStreamSender (dst_id=18) - BytesSent: 143253 - InactiveTotalTime: 0 - NetworkThroughput(*): 136984585 - OverallThroughput: 17818246 - PeakMemoryUsage: 1616 - RowsReturned: 2765 - SerializeBatchTime: 6911624 - TotalTime: 8039680 - TransmitDataRPCTime: 1045760 - UncompressedRowBatchSize: 278319 CodeGen - CodegenTime: 11921184 - CompileTime: 992994616 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2021884 - NumFunctions: 134 - NumInstructions: 4382 - OptimizationTime: 2192335496 - PeakMemoryUsage: 2243584 - PrepareTime: 284045968 - TotalTime: 3470352608 SORT_NODE (id=10) ExecOption: Codegen Enabled - InactiveTotalTime: 0 - InsertBatchTime: 3749576 - PeakMemoryUsage: 8986589 - RowsReturned: 2765 - RowsReturnedRate: 9 - TotalTime: 303813538136 HASH_JOIN_NODE (id=9) ExecOption: Probe Side Codegen Enabled - BuildRows: 2765 - BuildTime: 3776184 - InactiveTotalTime: 0 - LocalTime: 116698880 - PeakMemoryUsage: 1560071 - ProbeRows: 715524 - ProbeRowsPartitioned: 0 - ProbeTime: 94827560 - RowsReturned: 2765 - RowsReturnedRate: 9 - TotalTime: 303772694056 Hash Join Builder (join_node_id=9) ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 657792 - BuildRowsPartitioned: 2765 - GetNewBlockTime: 37648 - HashBuckets: 6656 - HashCollisions: 0 - HashTablesBuildTime: 2378736 - InactiveTotalTime: 0 - LargestPartitionPercent: 6 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 1438848 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=17) - BytesReceived: 46463 - ConvertRowBatchTime: 589544 - DeserializeRowBatchTimer: 544408 - FirstBatchArrivalWaitTime: 300278160384 - InactiveTotalTime: 300285756720 - PeakMemoryUsage: 0 - RowsReturned: 2765 - RowsReturnedRate: 9 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 300286494152 EXCHANGE_NODE (id=16) - BytesReceived: 35983557 - ConvertRowBatchTime: 172940176 - DeserializeRowBatchTimer: 2859722008 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 3022762064 - PeakMemoryUsage: 0 - RowsReturned: 715524 - RowsReturnedRate: 212353 - SendersBlockedTimer: 288434981304 - SendersBlockedTotalTimer(*): 1730554576448 - TotalTime: 3369501024 Instance a9429a2e6e27c0c3:1d (host=redacted-host2:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 23217560 - PerHostPeakMemUsage: 71363971 - RowsProduced: 2727 - TotalNetworkReceiveTime: 300239201980 - TotalNetworkSendTime: 2191392 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 675 - TotalThreadsTotalWallClockTime: 304803111604 - TotalThreadsSysTime: 39994000 - TotalThreadsUserTime: 1305801000 - TotalThreadsVoluntaryContextSwitches: 2629 - TotalTime: 307468909360 Fragment Instance Lifecycle Timings - ExecTime: 7520464 - ExecTreeExecTime: 572004 - InactiveTotalTime: 0 - OpenTime: 304834952524 - ExecTreeOpenTime: 300610345376 - PrepareTime: 2626349816 - ExecTreePrepareTime: 521866300 - TotalTime: 0 DataStreamSender (dst_id=18) - BytesSent: 141582 - InactiveTotalTime: 0 - NetworkThroughput(*): 171230988 - OverallThroughput: 18288476 - PeakMemoryUsage: 1616 - RowsReturned: 2727 - SerializeBatchTime: 4588868 - TotalTime: 7741596 - TransmitDataRPCTime: 826848 - UncompressedRowBatchSize: 274397 CodeGen - CodegenTime: 114696472 - CompileTime: 1072483804 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2021884 - NumFunctions: 134 - NumInstructions: 4382 - OptimizationTime: 3009739156 - PeakMemoryUsage: 2243584 - PrepareTime: 602117792 - TotalTime: 4686181880 SORT_NODE (id=10) ExecOption: Codegen Enabled - InactiveTotalTime: 0 - InsertBatchTime: 2824132 - PeakMemoryUsage: 8994081 - RowsReturned: 2727 - RowsReturnedRate: 9 - TotalTime: 301132773016 HASH_JOIN_NODE (id=9) ExecOption: Probe Side Codegen Enabled - BuildRows: 2727 - BuildTime: 2602600 - InactiveTotalTime: 0 - LocalTime: 1173053420 - PeakMemoryUsage: 1624769 - ProbeRows: 714139 - ProbeRowsPartitioned: 0 - ProbeTime: 107676876 - RowsReturned: 2727 - RowsReturnedRate: 9 - TotalTime: 301631512688 Hash Join Builder (join_node_id=9) ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 648104 - BuildRowsPartitioned: 2727 - GetNewBlockTime: 48980 - HashBuckets: 6144 - HashCollisions: 0 - HashTablesBuildTime: 1588140 - InactiveTotalTime: 0 - LargestPartitionPercent: 7 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 1496192 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=17) - BytesReceived: 45849 - ConvertRowBatchTime: 841308 - DeserializeRowBatchTimer: 673620 - FirstBatchArrivalWaitTime: 297076785812 - InactiveTotalTime: 297084415996 - PeakMemoryUsage: 0 - RowsReturned: 2727 - RowsReturnedRate: 9 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 297085482428 EXCHANGE_NODE (id=16) - BytesReceived: 35901660 - ConvertRowBatchTime: 192570056 - DeserializeRowBatchTimer: 3913355472 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 3013212052 - PeakMemoryUsage: 0 - RowsReturned: 714139 - RowsReturnedRate: 211723 - SendersBlockedTimer: 288433407472 - SendersBlockedTotalTimer(*): 1730456028848 - TotalTime: 3372976840 Instance a9429a2e6e27c0c3:21 (host=redacted-host4:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 23107649 - PerHostPeakMemUsage: 72498824 - RowsProduced: 2703 - TotalNetworkReceiveTime: 302016968608 - TotalNetworkSendTime: 1971512 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 659 - TotalThreadsTotalWallClockTime: 306415708424 - TotalThreadsSysTime: 39994000 - TotalThreadsUserTime: 1251810000 - TotalThreadsVoluntaryContextSwitches: 2736 - TotalTime: 307432514272 Fragment Instance Lifecycle Timings - ExecTime: 10024872 - ExecTreeExecTime: 810552 - InactiveTotalTime: 0 - OpenTime: 306433163200 - ExecTreeOpenTime: 302381416200 - PrepareTime: 989221824 - ExecTreePrepareTime: 349332304 - TotalTime: 0 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 96 - BlocksRecycled: 19 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 34603008 - PeakMemoryUsage: 2163968 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 DataStreamSender (dst_id=18) - BytesSent: 140842 - InactiveTotalTime: 0 - NetworkThroughput(*): 178176362 - OverallThroughput: 17948332 - PeakMemoryUsage: 1616 - RowsReturned: 2703 - SerializeBatchTime: 7000200 - TotalTime: 7847080 - TransmitDataRPCTime: 790464 - UncompressedRowBatchSize: 272281 CodeGen - CodegenTime: 20660264 - CompileTime: 826814184 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2021884 - NumFunctions: 134 - NumInstructions: 4382 - OptimizationTime: 2929162200 - PeakMemoryUsage: 2243584 - PrepareTime: 512709400 - TotalTime: 4279241640 SORT_NODE (id=10) ExecOption: Codegen Enabled - InactiveTotalTime: 0 - InsertBatchTime: 2740616 - PeakMemoryUsage: 8982628 - RowsReturned: 2703 - RowsReturnedRate: 8 - TotalTime: 302731543752 HASH_JOIN_NODE (id=9) ExecOption: Probe Side Codegen Enabled - BuildRows: 2703 - BuildTime: 3055688 - InactiveTotalTime: 0 - LocalTime: 818469816 - PeakMemoryUsage: 1487352 - ProbeRows: 715384 - ProbeRowsPartitioned: 0 - ProbeTime: 99254656 - RowsReturned: 2703 - RowsReturnedRate: 8 - TotalTime: 303035010216 Hash Join Builder (join_node_id=9) ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 859720 - BuildRowsPartitioned: 2703 - GetNewBlockTime: 61528 - HashBuckets: 5888 - HashCollisions: 0 - HashTablesBuildTime: 1282616 - InactiveTotalTime: 0 - LargestPartitionPercent: 7 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 1361024 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=17) - BytesReceived: 45533 - ConvertRowBatchTime: 761984 - DeserializeRowBatchTimer: 505288 - FirstBatchArrivalWaitTime: 298841746848 - InactiveTotalTime: 298848705144 - PeakMemoryUsage: 0 - RowsReturned: 2703 - RowsReturnedRate: 9 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 298849621128 EXCHANGE_NODE (id=16) - BytesReceived: 35976041 - ConvertRowBatchTime: 174732688 - DeserializeRowBatchTimer: 2767385120 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 3027664264 - PeakMemoryUsage: 0 - RowsReturned: 715384 - RowsReturnedRate: 212474 - SendersBlockedTimer: 288424432024 - SendersBlockedTotalTimer(*): 1442107402544 - TotalTime: 3366919272 Averaged Fragment F00 split sizes: min: 32.87 MB, max: 65.73 MB, avg: 38.06 MB, stddev: 11.30 MB completion times: min:5m5s max:5m7s mean: 5m5s stddev:729.622ms execution rates: min:110.18 KB/sec max:218.87 KB/sec mean:127.40 KB/sec stddev:37.36 KB/sec num instances: 7 - AverageThreadTokens: 1.9961963831893914 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 23616169 - PerHostPeakMemUsage: 72161767 - RowsProduced: 714285 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 301564247829 - TotalStorageWaitTime: 28923097 - TotalThreadsInvoluntaryContextSwitches: 1335 - TotalThreadsTotalWallClockTime: 609564454600 - TotalThreadsSysTime: 96270571 - TotalThreadsUserTime: 3467901000 - TotalThreadsVoluntaryContextSwitches: 1417 - TotalTime: 305710357708 Fragment Instance Lifecycle Timings - ExecTime: 304989415402 - ExecTreeExecTime: 412578988 - InactiveTotalTime: 0 - OpenTime: 170634401 - ExecTreeOpenTime: 699746 - PrepareTime: 550168893 - ExecTreePrepareTime: 267824 - TotalTime: 0 DataStreamSender (dst_id=16) - BytesSent: 35919087 - InactiveTotalTime: 0 - NetworkThroughput(*): 136601812 - OverallThroughput: 26322350 - PeakMemoryUsage: 213248 - RowsReturned: 714285 - SerializeBatchTime: 1086864063 - TotalTime: 1353336216 - TransmitDataRPCTime: 264843382 - UncompressedRowBatchSize: 66187166 CodeGen - CodegenTime: 6488169 - CompileTime: 6414713 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2021884 - NumFunctions: 5 - NumInstructions: 98 - OptimizationTime: 67230636 - PeakMemoryUsage: 50176 - PrepareTime: 188135594 - TotalTime: 267128953 HDFS_SCAN_NODE (id=8) - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.9980956052510722 - BytesRead: 5914124 - BytesReadDataNodeCache: 0 - BytesReadLocal: 5914124 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 5914124 - DecompressionTime: 304445327 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 5 - NumDisksAccessed: 1 - NumRowGroups: 1 - NumScannerThreadsStarted: 1 - PeakMemoryUsage: 23383692 - PerReadThreadRawHdfsThroughput: 802169580 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 297498308 - RowBatchQueuePutWaitTime: 300784713712 - RowsRead: 714285 - RowsReturned: 714285 - RowsReturnedRate: 2478038 - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 441 - ScannerThreadsTotalWallClockTime: 304453533420 - MaterializeTupleTime(*): 3016135696 - ScannerThreadsSysTime: 46992285 - ScannerThreadsUserTime: 1194389428 - ScannerThreadsVoluntaryContextSwitches: 963 - TotalRawHdfsReadTime(*): 8393526 - TotalReadThroughput: 19674 - TotalTime: 411894750 Fragment F00 Instance a9429a2e6e27c0c3:3 (host=redacted-host2:22000) Hdfs split stats (:<# splits>/): 1:1/32.87 MB 11:1/32.86 MB - AverageThreadTokens: 1.9933665008291874 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 22776442 - PerHostPeakMemUsage: 71363971 - RowsProduced: 1233332 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 299711748856 - TotalStorageWaitTime: 77509484 - TotalThreadsInvoluntaryContextSwitches: 1629 - TotalThreadsTotalWallClockTime: 610551986796 - TotalThreadsSysTime: 110982000 - TotalThreadsUserTime: 5601147000 - TotalThreadsVoluntaryContextSwitches: 2093 - TotalTime: 307474288676 Fragment Instance Lifecycle Timings - ExecTime: 305644961804 - ExecTreeExecTime: 804919860 - InactiveTotalTime: 0 - OpenTime: 206178300 - ExecTreeOpenTime: 182276 - PrepareTime: 1623059988 - ExecTreePrepareTime: 348956 - TotalTime: 0 DataStreamSender (dst_id=16) - BytesSent: 62501158 - InactiveTotalTime: 0 - NetworkThroughput(*): 130023297 - OverallThroughput: 28452122 - PeakMemoryUsage: 213248 - RowsReturned: 1233332 - SerializeBatchTime: 1714094968 - TotalTime: 2196713336 - TransmitDataRPCTime: 480691992 - UncompressedRowBatchSize: 114280306 CodeGen - CodegenTime: 1004688 - CompileTime: 8630732 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2021884 - NumFunctions: 5 - NumInstructions: 98 - OptimizationTime: 39368708 - PeakMemoryUsage: 50176 - PrepareTime: 206189860 - TotalTime: 255604208 HDFS_SCAN_NODE (id=8) Hdfs split stats (:<# splits>/): 1:1/32.87 MB 11:1/32.86 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 2 out of 2 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:10 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.9966722129783694 - BytesRead: 10218332 - BytesReadDataNodeCache: 0 - BytesReadLocal: 10218332 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 10218332 - DecompressionTime: 477771232 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 5 - NumDisksAccessed: 2 - NumRowGroups: 2 - NumScannerThreadsStarted: 1 - PeakMemoryUsage: 22512595 - PerReadThreadRawHdfsThroughput: 517498351 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 647804132 - RowBatchQueuePutWaitTime: 298684819928 - RowsRead: 1233332 - RowsReturned: 1233332 - RowsReturnedRate: 1535589 - ScanRangesComplete: 2 - ScannerThreadsInvoluntaryContextSwitches: 710 - ScannerThreadsTotalWallClockTime: 304830200928 - MaterializeTupleTime(*): 4951785308 - ScannerThreadsSysTime: 59990000 - ScannerThreadsUserTime: 2087682000 - ScannerThreadsVoluntaryContextSwitches: 1497 - TotalRawHdfsReadTime(*): 19745632 - TotalReadThroughput: 33938 - TotalTime: 803165100 Instance a9429a2e6e27c0c3:1 (host=redacted-host6:22000) Hdfs split stats (:<# splits>/): 4:1/33.74 MB - AverageThreadTokens: 1.994991652754591 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 24460643 - PerHostPeakMemUsage: 73712395 - RowsProduced: 633333 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 300488502532 - TotalStorageWaitTime: 2916376 - TotalThreadsInvoluntaryContextSwitches: 1406 - TotalThreadsTotalWallClockTime: 608591952720 - TotalThreadsSysTime: 105984000 - TotalThreadsUserTime: 3291500000 - TotalThreadsVoluntaryContextSwitches: 1652 - TotalTime: 305540560484 Fragment Instance Lifecycle Timings - ExecTime: 304409850908 - ExecTreeExecTime: 903833664 - InactiveTotalTime: 0 - OpenTime: 248383616 - ExecTreeOpenTime: 155632 - PrepareTime: 882234668 - ExecTreePrepareTime: 228100 - TotalTime: 0 DataStreamSender (dst_id=16) - BytesSent: 32536125 - InactiveTotalTime: 0 - NetworkThroughput(*): 143448830 - OverallThroughput: 26243377 - PeakMemoryUsage: 213248 - RowsReturned: 633333 - SerializeBatchTime: 1011546340 - TotalTime: 1239784220 - TransmitDataRPCTime: 226813456 - UncompressedRowBatchSize: 58686752 CodeGen - CodegenTime: 12862752 - CompileTime: 3797600 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2021884 - NumFunctions: 5 - NumInstructions: 98 - OptimizationTime: 79697020 - PeakMemoryUsage: 50176 - PrepareTime: 485159652 - TotalTime: 599454640 HDFS_SCAN_NODE (id=8) Hdfs split stats (:<# splits>/): 4:1/33.74 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:5 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.998324958123953 - BytesRead: 5240466 - BytesReadDataNodeCache: 0 - BytesReadLocal: 5240466 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 5240466 - DecompressionTime: 546665628 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 5 - NumDisksAccessed: 1 - NumRowGroups: 1 - NumScannerThreadsStarted: 1 - PeakMemoryUsage: 24238781 - PerReadThreadRawHdfsThroughput: 1165333175 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 835098660 - RowBatchQueuePutWaitTime: 297896269976 - RowsRead: 633333 - RowsReturned: 633333 - RowsReturnedRate: 701660 - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 456 - ScannerThreadsTotalWallClockTime: 303963957776 - MaterializeTupleTime(*): 4696185324 - ScannerThreadsSysTime: 56991000 - ScannerThreadsUserTime: 1130828000 - ScannerThreadsVoluntaryContextSwitches: 1190 - TotalRawHdfsReadTime(*): 4496968 - TotalReadThroughput: 17491 - TotalTime: 902620476 Instance a9429a2e6e27c0c3:5 (host=redacted-host3:22000) Hdfs split stats (:<# splits>/): 10:1/33.75 MB - AverageThreadTokens: 1.9983361064891847 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 24452448 - PerHostPeakMemUsage: 69985667 - RowsProduced: 633333 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 302674665096 - TotalStorageWaitTime: 21229136 - TotalThreadsInvoluntaryContextSwitches: 1265 - TotalThreadsTotalWallClockTime: 610291630624 - TotalThreadsSysTime: 95985000 - TotalThreadsUserTime: 3095529000 - TotalThreadsVoluntaryContextSwitches: 1084 - TotalTime: 305489170896 Fragment Instance Lifecycle Timings - ExecTime: 305345567768 - ExecTreeExecTime: 210861304 - InactiveTotalTime: 0 - OpenTime: 46391968 - ExecTreeOpenTime: 130040 - PrepareTime: 97054848 - ExecTreePrepareTime: 264608 - TotalTime: 0 DataStreamSender (dst_id=16) - BytesSent: 31471782 - InactiveTotalTime: 0 - NetworkThroughput(*): 135123003 - OverallThroughput: 25949191 - PeakMemoryUsage: 213248 - RowsReturned: 633333 - SerializeBatchTime: 978625248 - TotalTime: 1212823200 - TransmitDataRPCTime: 232912096 - UncompressedRowBatchSize: 58686030 CodeGen - CodegenTime: 930344 - CompileTime: 6627688 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2021884 - NumFunctions: 5 - NumInstructions: 98 - OptimizationTime: 19918280 - PeakMemoryUsage: 50176 - PrepareTime: 61164144 - TotalTime: 88778752 HDFS_SCAN_NODE (id=8) Hdfs split stats (:<# splits>/): 10:1/33.75 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:5 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.9983361064891847 - BytesRead: 5240284 - BytesReadDataNodeCache: 0 - BytesReadLocal: 5240284 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 5240284 - DecompressionTime: 106743920 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 5 - NumDisksAccessed: 1 - NumRowGroups: 1 - NumScannerThreadsStarted: 1 - PeakMemoryUsage: 24238777 - PerReadThreadRawHdfsThroughput: 612622997 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 46333872 - RowBatchQueuePutWaitTime: 303194941320 - RowsRead: 633333 - RowsReturned: 633333 - RowsReturnedRate: 3019808 - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 388 - ScannerThreadsTotalWallClockTime: 304912869400 - MaterializeTupleTime(*): 1522011128 - ScannerThreadsSysTime: 47992000 - ScannerThreadsUserTime: 1030843000 - ScannerThreadsVoluntaryContextSwitches: 705 - TotalRawHdfsReadTime(*): 8553848 - TotalReadThroughput: 17430 - TotalTime: 209726216 Instance a9429a2e6e27c0c3:6 (host=redacted-host1:22000) Hdfs split stats (:<# splits>/): 3:1/32.87 MB - AverageThreadTokens: 1.9966722129783694 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 22363490 - PerHostPeakMemUsage: 71391289 - RowsProduced: 616666 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 302620584304 - TotalStorageWaitTime: 13272392 - TotalThreadsInvoluntaryContextSwitches: 1237 - TotalThreadsTotalWallClockTime: 610207236584 - TotalThreadsSysTime: 82987000 - TotalThreadsUserTime: 3037538000 - TotalThreadsVoluntaryContextSwitches: 1118 - TotalTime: 305475637728 Fragment Instance Lifecycle Timings - ExecTime: 305330526776 - ExecTreeExecTime: 215410872 - InactiveTotalTime: 0 - OpenTime: 52139976 - ExecTreeOpenTime: 116064 - PrepareTime: 92865128 - ExecTreePrepareTime: 241704 - TotalTime: 0 DataStreamSender (dst_id=16) - BytesSent: 30260591 - InactiveTotalTime: 0 - NetworkThroughput(*): 139030703 - OverallThroughput: 25403531 - PeakMemoryUsage: 213248 - RowsReturned: 616666 - SerializeBatchTime: 972380952 - TotalTime: 1191196232 - TransmitDataRPCTime: 217654016 - UncompressedRowBatchSize: 57142019 CodeGen - CodegenTime: 1149536 - CompileTime: 5572816 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2021884 - NumFunctions: 5 - NumInstructions: 98 - OptimizationTime: 21016728 - PeakMemoryUsage: 50176 - PrepareTime: 69762624 - TotalTime: 97202560 HDFS_SCAN_NODE (id=8) Hdfs split stats (:<# splits>/): 3:1/32.87 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:5 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.9983333333333333 - BytesRead: 5108849 - BytesReadDataNodeCache: 0 - BytesReadLocal: 5108849 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 5108849 - DecompressionTime: 170725048 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 5 - NumDisksAccessed: 1 - NumRowGroups: 1 - NumScannerThreadsStarted: 1 - PeakMemoryUsage: 22141627 - PerReadThreadRawHdfsThroughput: 914550791 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 34432720 - RowBatchQueuePutWaitTime: 302691330248 - RowsRead: 616666 - RowsReturned: 616666 - RowsReturnedRate: 2879482 - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 401 - ScannerThreadsTotalWallClockTime: 304841292536 - MaterializeTupleTime(*): 1785279768 - ScannerThreadsSysTime: 35994000 - ScannerThreadsUserTime: 1022844000 - ScannerThreadsVoluntaryContextSwitches: 715 - TotalRawHdfsReadTime(*): 5586184 - TotalReadThroughput: 16994 - TotalTime: 214158640 Instance a9429a2e6e27c0c3:2 (host=redacted-host5:22000) Hdfs split stats (:<# splits>/): 1:1/33.74 MB - AverageThreadTokens: 1.9983471074380166 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 24452443 - PerHostPeakMemUsage: 73846530 - RowsProduced: 633334 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 302633108584 - TotalStorageWaitTime: 2841968 - TotalThreadsInvoluntaryContextSwitches: 1153 - TotalThreadsTotalWallClockTime: 609717586624 - TotalThreadsSysTime: 64990000 - TotalThreadsUserTime: 3006543000 - TotalThreadsVoluntaryContextSwitches: 1201 - TotalTime: 305373321000 Fragment Instance Lifecycle Timings - ExecTime: 305155617704 - ExecTreeExecTime: 139470160 - InactiveTotalTime: 0 - OpenTime: 62658152 - ExecTreeOpenTime: 104752 - PrepareTime: 154946472 - ExecTreePrepareTime: 289184 - TotalTime: 0 DataStreamSender (dst_id=16) - BytesSent: 31418431 - InactiveTotalTime: 0 - NetworkThroughput(*): 129722296 - OverallThroughput: 26420858 - PeakMemoryUsage: 213248 - RowsReturned: 633334 - SerializeBatchTime: 943911648 - TotalTime: 1189152552 - TransmitDataRPCTime: 242197616 - UncompressedRowBatchSize: 58687566 CodeGen - CodegenTime: 952040 - CompileTime: 3438632 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2021884 - NumFunctions: 5 - NumInstructions: 98 - OptimizationTime: 26754424 - PeakMemoryUsage: 50176 - PrepareTime: 103448008 - TotalTime: 134455632 HDFS_SCAN_NODE (id=8) Hdfs split stats (:<# splits>/): 1:1/33.74 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:5 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.9983471074380166 - BytesRead: 5241086 - BytesReadDataNodeCache: 0 - BytesReadLocal: 5241086 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 5241086 - DecompressionTime: 99031432 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 5 - NumDisksAccessed: 1 - NumRowGroups: 1 - NumScannerThreadsStarted: 1 - PeakMemoryUsage: 24238772 - PerReadThreadRawHdfsThroughput: 774303360 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 48824064 - RowBatchQueuePutWaitTime: 302524891048 - RowsRead: 633334 - RowsReturned: 633334 - RowsReturnedRate: 4573674 - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 338 - ScannerThreadsTotalWallClockTime: 304519009592 - MaterializeTupleTime(*): 1768362160 - ScannerThreadsSysTime: 26995000 - ScannerThreadsUserTime: 1044841000 - ScannerThreadsVoluntaryContextSwitches: 813 - TotalRawHdfsReadTime(*): 6768776 - TotalReadThroughput: 17321 - TotalTime: 138473784 Instance a9429a2e6e27c0c3:7 (host=redacted-host4:22000) Hdfs split stats (:<# splits>/): 11:1/33.74 MB - AverageThreadTokens: 1.996661101836394 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 24452432 - PerHostPeakMemUsage: 72498824 - RowsProduced: 633338 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 301395119504 - TotalStorageWaitTime: 5241992 - TotalThreadsInvoluntaryContextSwitches: 1386 - TotalThreadsTotalWallClockTime: 608909700776 - TotalThreadsSysTime: 109983000 - TotalThreadsUserTime: 3245506000 - TotalThreadsVoluntaryContextSwitches: 1455 - TotalTime: 305367299016 Fragment Instance Lifecycle Timings - ExecTime: 304617701400 - ExecTreeExecTime: 202583616 - InactiveTotalTime: 0 - OpenTime: 243568264 - ExecTreeOpenTime: 137680 - PrepareTime: 505910448 - ExecTreePrepareTime: 263688 - TotalTime: 0 DataStreamSender (dst_id=16) - BytesSent: 32646096 - InactiveTotalTime: 0 - NetworkThroughput(*): 139068425 - OverallThroughput: 25606630 - PeakMemoryUsage: 213248 - RowsReturned: 633338 - SerializeBatchTime: 1038834104 - TotalTime: 1274907936 - TransmitDataRPCTime: 234748440 - UncompressedRowBatchSize: 58687066 CodeGen - CodegenTime: 23660984 - CompileTime: 6762520 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2021884 - NumFunctions: 5 - NumInstructions: 98 - OptimizationTime: 102988984 - PeakMemoryUsage: 50176 - PrepareTime: 202370672 - TotalTime: 312994400 HDFS_SCAN_NODE (id=8) Hdfs split stats (:<# splits>/): 11:1/33.74 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:5 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.9983277591973244 - BytesRead: 5240386 - BytesReadDataNodeCache: 0 - BytesReadLocal: 5240386 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 5240386 - DecompressionTime: 346485048 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 5 - NumDisksAccessed: 1 - NumRowGroups: 1 - NumScannerThreadsStarted: 1 - PeakMemoryUsage: 24238761 - PerReadThreadRawHdfsThroughput: 1031318683 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 128969664 - RowBatchQueuePutWaitTime: 299670103832 - RowsRead: 633338 - RowsReturned: 633338 - RowsReturnedRate: 3145769 - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 427 - ScannerThreadsTotalWallClockTime: 304146080552 - MaterializeTupleTime(*): 3968044608 - ScannerThreadsSysTime: 57991000 - ScannerThreadsUserTime: 1066837000 - ScannerThreadsVoluntaryContextSwitches: 993 - TotalRawHdfsReadTime(*): 5081248 - TotalReadThroughput: 17492 - TotalTime: 201330072 Instance a9429a2e6e27c0c3:4 (host=redacted-host7:22000) Hdfs split stats (:<# splits>/): 10:1/32.88 MB - AverageThreadTokens: 1.995 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 22355291 - PerHostPeakMemUsage: 72333694 - RowsProduced: 616664 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 301426005928 - TotalStorageWaitTime: 79450336 - TotalThreadsInvoluntaryContextSwitches: 1274 - TotalThreadsTotalWallClockTime: 608681088080 - TotalThreadsSysTime: 102983000 - TotalThreadsUserTime: 2997544000 - TotalThreadsVoluntaryContextSwitches: 1321 - TotalTime: 305252226160 Fragment Instance Lifecycle Timings - ExecTime: 304421681456 - ExecTreeExecTime: 410973440 - InactiveTotalTime: 0 - OpenTime: 335120536 - ExecTreeOpenTime: 4071784 - PrepareTime: 495110704 - ExecTreePrepareTime: 238528 - TotalTime: 0 DataStreamSender (dst_id=16) - BytesSent: 30599426 - InactiveTotalTime: 0 - NetworkThroughput(*): 139796136 - OverallThroughput: 26180743 - PeakMemoryUsage: 213248 - RowsReturned: 616664 - SerializeBatchTime: 948655184 - TotalTime: 1168776040 - TransmitDataRPCTime: 218886064 - UncompressedRowBatchSize: 57140425 CodeGen - CodegenTime: 4856840 - CompileTime: 10073008 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2021884 - NumFunctions: 5 - NumInstructions: 98 - OptimizationTime: 180870312 - PeakMemoryUsage: 50176 - PrepareTime: 188854200 - TotalTime: 381412480 HDFS_SCAN_NODE (id=8) Hdfs split stats (:<# splits>/): 10:1/32.88 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:5 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.9983277591973244 - BytesRead: 5109467 - BytesReadDataNodeCache: 0 - BytesReadLocal: 5109467 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 5109467 - DecompressionTime: 383694984 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 5 - NumDisksAccessed: 1 - NumRowGroups: 1 - NumScannerThreadsStarted: 1 - PeakMemoryUsage: 22076532 - PerReadThreadRawHdfsThroughput: 599559705 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 341025048 - RowBatchQueuePutWaitTime: 300830639632 - RowsRead: 616664 - RowsReturned: 616664 - RowsReturnedRate: 1490286 - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 368 - ScannerThreadsTotalWallClockTime: 303961323160 - MaterializeTupleTime(*): 2421281576 - ScannerThreadsSysTime: 42993000 - ScannerThreadsUserTime: 976851000 - ScannerThreadsVoluntaryContextSwitches: 834 - TotalRawHdfsReadTime(*): 8522032 - TotalReadThroughput: 17053 - TotalTime: 413788968 Averaged Fragment F05 split sizes: min: 0, max: 0, avg: 0, stddev: 0 completion times: min:5m3s max:5m4s mean: 5m3s stddev:150.441ms execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec num instances: 8 - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 3311874 - PerHostPeakMemUsage: 66812489 - RowsProduced: 2369 - TotalNetworkReceiveTime: 302083440483 - TotalNetworkSendTime: 3433595 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 67 - TotalThreadsTotalWallClockTime: 302726414412 - TotalThreadsSysTime: 8624000 - TotalThreadsUserTime: 161725500 - TotalThreadsVoluntaryContextSwitches: 208 - TotalTime: 303826031768 Fragment Instance Lifecycle Timings - ExecTime: 23084602 - ExecTreeExecTime: 13908482 - InactiveTotalTime: 0 - OpenTime: 302716463754 - ExecTreeOpenTime: 302123190553 - PrepareTime: 1083358589 - ExecTreePrepareTime: 450694349 - TotalTime: 0 DataStreamSender (dst_id=17) - BytesSent: 39881 - InactiveTotalTime: 0 - NetworkThroughput(*): 75561177 - OverallThroughput: 17533183 - PeakMemoryUsage: 122696 - RowsReturned: 2369 - SerializeBatchTime: 1716414 - TotalTime: 2341700 - TransmitDataRPCTime: 530300 - UncompressedRowBatchSize: 68743 CodeGen - CodegenTime: 65041103 - CompileTime: 73111597 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2021884 - NumFunctions: 42 - NumInstructions: 750 - OptimizationTime: 367645211 - PeakMemoryUsage: 384000 - PrepareTime: 393420809 - TotalTime: 848085018 AGGREGATION_NODE (id=15) - BuildTime: 31611577 - GetNewBlockTime: 232038068 - GetResultsTime: 11604154 - HTResizeTime: 6630663 - HashBuckets: 65536 - InactiveTotalTime: 0 - LargestPartitionPercent: 6 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 3241593 - PinTime: 0 - RowsRepartitioned: 0 - RowsReturned: 2369 - RowsReturnedRate: 7 - SpilledPartitions: 0 - TotalTime: 302587735916 - UnpinTime: 5186 EXCHANGE_NODE (id=14) - BytesReceived: 474025 - ConvertRowBatchTime: 6354379 - DeserializeRowBatchTimer: 6333206 - FirstBatchArrivalWaitTime: 290566259138 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 26239 - RowsReturnedRate: 86 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 302090209521 Fragment F05 Instance a9429a2e6e27c0c3:14 (host=redacted-host3:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 3308288 - PerHostPeakMemUsage: 69985667 - RowsProduced: 2499 - TotalNetworkReceiveTime: 303704872904 - TotalNetworkSendTime: 4247224 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 89 - TotalThreadsTotalWallClockTime: 303892496480 - TotalThreadsSysTime: 6000000 - TotalThreadsUserTime: 156976000 - TotalThreadsVoluntaryContextSwitches: 179 - TotalTime: 304005417944 Fragment Instance Lifecycle Timings - ExecTime: 24306184 - ExecTreeExecTime: 12926936 - InactiveTotalTime: 0 - OpenTime: 303874489000 - ExecTreeOpenTime: 303749140608 - PrepareTime: 106522016 - ExecTreePrepareTime: 1570456 - TotalTime: 0 DataStreamSender (dst_id=17) - BytesSent: 42001 - InactiveTotalTime: 0 - NetworkThroughput(*): 80921792 - OverallThroughput: 13983851 - PeakMemoryUsage: 122696 - RowsReturned: 2499 - SerializeBatchTime: 2390248 - TotalTime: 3003536 - TransmitDataRPCTime: 519032 - UncompressedRowBatchSize: 72499 CodeGen - CodegenTime: 6109368 - CompileTime: 13446888 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2021884 - NumFunctions: 42 - NumInstructions: 750 - OptimizationTime: 98606880 - PeakMemoryUsage: 384000 - PrepareTime: 53480736 - TotalTime: 167567352 AGGREGATION_NODE (id=15) ExecOption: Codegen Enabled - BuildTime: 36879672 - GetNewBlockTime: 273704 - GetResultsTime: 11535496 - HTResizeTime: 9209512 - HashBuckets: 65536 - InactiveTotalTime: 0 - LargestPartitionPercent: 6 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 3238007 - PinTime: 0 - RowsRepartitioned: 0 - RowsReturned: 2499 - RowsReturnedRate: 8 - SpilledPartitions: 0 - TotalTime: 303763582840 - UnpinTime: 3368 EXCHANGE_NODE (id=14) - BytesReceived: 476416 - ConvertRowBatchTime: 5832944 - DeserializeRowBatchTimer: 5856304 - FirstBatchArrivalWaitTime: 292194511896 - InactiveTotalTime: 303690165784 - PeakMemoryUsage: 0 - RowsReturned: 26374 - RowsReturnedRate: 86 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 303711088720 Instance a9429a2e6e27c0c3:15 (host=redacted-host1:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 3312413 - PerHostPeakMemUsage: 71391289 - RowsProduced: 2429 - TotalNetworkReceiveTime: 303680830968 - TotalNetworkSendTime: 3904664 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 78 - TotalThreadsTotalWallClockTime: 303888371520 - TotalThreadsSysTime: 7999000 - TotalThreadsUserTime: 155977000 - TotalThreadsVoluntaryContextSwitches: 148 - TotalTime: 304003169688 Fragment Instance Lifecycle Timings - ExecTime: 28979456 - ExecTreeExecTime: 18872976 - InactiveTotalTime: 0 - OpenTime: 303866825256 - ExecTreeOpenTime: 303723946944 - PrepareTime: 107258768 - ExecTreePrepareTime: 6842192 - TotalTime: 0 DataStreamSender (dst_id=17) - BytesSent: 40857 - InactiveTotalTime: 0 - NetworkThroughput(*): 85715904 - OverallThroughput: 19216478 - PeakMemoryUsage: 122696 - RowsReturned: 2429 - SerializeBatchTime: 1575824 - TotalTime: 2126144 - TransmitDataRPCTime: 476656 - UncompressedRowBatchSize: 70469 CodeGen - CodegenTime: 8679824 - CompileTime: 13514728 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2021884 - NumFunctions: 42 - NumInstructions: 750 - OptimizationTime: 106920576 - PeakMemoryUsage: 384000 - PrepareTime: 58305264 - TotalTime: 179633168 AGGREGATION_NODE (id=15) ExecOption: Codegen Enabled - BuildTime: 33838912 - GetNewBlockTime: 5731344 - GetResultsTime: 11339160 - HTResizeTime: 6659448 - HashBuckets: 65536 - InactiveTotalTime: 0 - LargestPartitionPercent: 6 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 3242132 - PinTime: 0 - RowsRepartitioned: 0 - RowsReturned: 2429 - RowsReturnedRate: 7 - SpilledPartitions: 0 - TotalTime: 303749599984 - UnpinTime: 3752 EXCHANGE_NODE (id=14) - BytesReceived: 473761 - ConvertRowBatchTime: 7687872 - DeserializeRowBatchTimer: 5896664 - FirstBatchArrivalWaitTime: 292167987600 - InactiveTotalTime: 303668724368 - PeakMemoryUsage: 0 - RowsReturned: 26225 - RowsReturnedRate: 86 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 303688979248 Instance a9429a2e6e27c0c3:1a (host=redacted-host5:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 3308288 - PerHostPeakMemUsage: 73846530 - RowsProduced: 2375 - TotalNetworkReceiveTime: 303534882200 - TotalNetworkSendTime: 3232152 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 72 - TotalThreadsTotalWallClockTime: 303749961360 - TotalThreadsSysTime: 6999000 - TotalThreadsUserTime: 156976000 - TotalThreadsVoluntaryContextSwitches: 202 - TotalTime: 303914148984 Fragment Instance Lifecycle Timings - ExecTime: 23131200 - ExecTreeExecTime: 13775848 - InactiveTotalTime: 0 - OpenTime: 303739112464 - ExecTreeOpenTime: 303571401480 - PrepareTime: 151793064 - ExecTreePrepareTime: 7234336 - TotalTime: 0 DataStreamSender (dst_id=17) - BytesSent: 39883 - InactiveTotalTime: 0 - NetworkThroughput(*): 71457494 - OverallThroughput: 15675160 - PeakMemoryUsage: 122696 - RowsReturned: 2375 - SerializeBatchTime: 1825232 - TotalTime: 2544344 - TransmitDataRPCTime: 558136 - UncompressedRowBatchSize: 68903 CodeGen - CodegenTime: 7431920 - CompileTime: 21366584 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2021884 - NumFunctions: 42 - NumInstructions: 750 - OptimizationTime: 126430112 - PeakMemoryUsage: 384000 - PrepareTime: 69426080 - TotalTime: 223807888 AGGREGATION_NODE (id=15) ExecOption: Codegen Enabled - BuildTime: 29228784 - GetNewBlockTime: 6145576 - GetResultsTime: 12465400 - HTResizeTime: 8164984 - HashBuckets: 65536 - InactiveTotalTime: 0 - LargestPartitionPercent: 6 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 3238007 - PinTime: 0 - RowsRepartitioned: 0 - RowsReturned: 2375 - RowsReturnedRate: 7 - SpilledPartitions: 0 - TotalTime: 303592354624 - UnpinTime: 3848 EXCHANGE_NODE (id=14) - BytesReceived: 470613 - ConvertRowBatchTime: 5792984 - DeserializeRowBatchTimer: 4001008 - FirstBatchArrivalWaitTime: 292010518696 - InactiveTotalTime: 303534104224 - PeakMemoryUsage: 0 - RowsReturned: 26064 - RowsReturnedRate: 85 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 303541062304 Instance a9429a2e6e27c0c3:13 (host=redacted-host7:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 3312384 - PerHostPeakMemUsage: 72333694 - RowsProduced: 2269 - TotalNetworkReceiveTime: 302699905848 - TotalNetworkSendTime: 4041704 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 63 - TotalThreadsTotalWallClockTime: 303176825352 - TotalThreadsSysTime: 9999000 - TotalThreadsUserTime: 154976000 - TotalThreadsVoluntaryContextSwitches: 180 - TotalTime: 303872592968 Fragment Instance Lifecycle Timings - ExecTime: 21293072 - ExecTreeExecTime: 12008392 - InactiveTotalTime: 0 - OpenTime: 303178972160 - ExecTreeOpenTime: 302739609512 - PrepareTime: 648182920 - ExecTreePrepareTime: 115409624 - TotalTime: 0 DataStreamSender (dst_id=17) - BytesSent: 38328 - InactiveTotalTime: 0 - NetworkThroughput(*): 68507449 - OverallThroughput: 18887412 - PeakMemoryUsage: 122696 - RowsReturned: 2269 - SerializeBatchTime: 1366752 - TotalTime: 2029288 - TransmitDataRPCTime: 559472 - UncompressedRowBatchSize: 65829 CodeGen - CodegenTime: 230851040 - CompileTime: 78199480 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2021884 - NumFunctions: 42 - NumInstructions: 750 - OptimizationTime: 263397024 - PeakMemoryUsage: 384000 - PrepareTime: 205609080 - TotalTime: 548368088 AGGREGATION_NODE (id=15) ExecOption: Codegen Enabled - BuildTime: 31754552 - GetNewBlockTime: 89230216 - GetResultsTime: 10697688 - HTResizeTime: 6282456 - HashBuckets: 65536 - InactiveTotalTime: 0 - LargestPartitionPercent: 6 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 3242103 - PinTime: 0 - RowsRepartitioned: 0 - RowsReturned: 2269 - RowsReturnedRate: 7 - SpilledPartitions: 0 - TotalTime: 302866973936 - UnpinTime: 4872 EXCHANGE_NODE (id=14) - BytesReceived: 476284 - ConvertRowBatchTime: 6189704 - DeserializeRowBatchTimer: 7674656 - FirstBatchArrivalWaitTime: 291186497400 - InactiveTotalTime: 302698367616 - PeakMemoryUsage: 0 - RowsReturned: 26367 - RowsReturnedRate: 87 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 302706506992 Instance a9429a2e6e27c0c3:19 (host=redacted-host4:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 3328759 - PerHostPeakMemUsage: 72498824 - RowsProduced: 2332 - TotalNetworkReceiveTime: 301613336280 - TotalNetworkSendTime: 2856944 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 36 - TotalThreadsTotalWallClockTime: 302698763392 - TotalThreadsSysTime: 13998000 - TotalThreadsUserTime: 154977000 - TotalThreadsVoluntaryContextSwitches: 246 - TotalTime: 303814134472 Fragment Instance Lifecycle Timings - ExecTime: 20987184 - ExecTreeExecTime: 13375040 - InactiveTotalTime: 0 - OpenTime: 302683813240 - ExecTreeOpenTime: 301654414624 - PrepareTime: 1109254056 - ExecTreePrepareTime: 402154264 - TotalTime: 0 DataStreamSender (dst_id=17) - BytesSent: 39261 - InactiveTotalTime: 0 - NetworkThroughput(*): 73693595 - OverallThroughput: 20282040 - PeakMemoryUsage: 122696 - RowsReturned: 2332 - SerializeBatchTime: 1327232 - TotalTime: 1935752 - TransmitDataRPCTime: 532760 - UncompressedRowBatchSize: 67656 CodeGen - CodegenTime: 23007640 - CompileTime: 95902872 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2021884 - NumFunctions: 42 - NumInstructions: 750 - OptimizationTime: 674370120 - PeakMemoryUsage: 384000 - PrepareTime: 500623752 - TotalTime: 1330329120 AGGREGATION_NODE (id=15) ExecOption: Codegen Enabled - BuildTime: 31066728 - GetNewBlockTime: 57403992 - GetResultsTime: 10891816 - HTResizeTime: 3537808 - HashBuckets: 65536 - InactiveTotalTime: 0 - LargestPartitionPercent: 6 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 3258478 - PinTime: 0 - RowsRepartitioned: 0 - RowsReturned: 2332 - RowsReturnedRate: 7 - SpilledPartitions: 0 - TotalTime: 302069892032 - UnpinTime: 4072 EXCHANGE_NODE (id=14) - BytesReceived: 473891 - ConvertRowBatchTime: 7100168 - DeserializeRowBatchTimer: 8966192 - FirstBatchArrivalWaitTime: 290092582440 - InactiveTotalTime: 301611908112 - PeakMemoryUsage: 0 - RowsReturned: 26216 - RowsReturnedRate: 86 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 301620889216 Instance a9429a2e6e27c0c3:18 (host=redacted-host6:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 3308288 - PerHostPeakMemUsage: 73712395 - RowsProduced: 2357 - TotalNetworkReceiveTime: 301122935296 - TotalNetworkSendTime: 3039536 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 50 - TotalThreadsTotalWallClockTime: 302067252192 - TotalThreadsSysTime: 7999000 - TotalThreadsUserTime: 154976000 - TotalThreadsVoluntaryContextSwitches: 236 - TotalTime: 303794993720 Fragment Instance Lifecycle Timings - ExecTime: 22333268 - ExecTreeExecTime: 13911864 - InactiveTotalTime: 0 - OpenTime: 302048508444 - ExecTreeOpenTime: 301160197596 - PrepareTime: 1724032688 - ExecTreePrepareTime: 542127444 - TotalTime: 0 DataStreamSender (dst_id=17) - BytesSent: 39685 - InactiveTotalTime: 0 - NetworkThroughput(*): 73045434 - OverallThroughput: 16512299 - PeakMemoryUsage: 122696 - RowsReturned: 2357 - SerializeBatchTime: 1794636 - TotalTime: 2403360 - TransmitDataRPCTime: 543292 - UncompressedRowBatchSize: 68381 CodeGen - CodegenTime: 96069860 - CompileTime: 86031384 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2021884 - NumFunctions: 42 - NumInstructions: 750 - OptimizationTime: 602661280 - PeakMemoryUsage: 384000 - PrepareTime: 976539872 - TotalTime: 1666100596 AGGREGATION_NODE (id=15) ExecOption: Codegen Enabled - BuildTime: 29599316 - GetNewBlockTime: 323274812 - GetResultsTime: 12526208 - HTResizeTime: 5858040 - HashBuckets: 65536 - InactiveTotalTime: 0 - LargestPartitionPercent: 6 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 3238007 - PinTime: 0 - RowsRepartitioned: 0 - RowsReturned: 2357 - RowsReturnedRate: 7 - SpilledPartitions: 0 - TotalTime: 301716182616 - UnpinTime: 7624 EXCHANGE_NODE (id=14) - BytesReceived: 475250 - ConvertRowBatchTime: 5926536 - DeserializeRowBatchTimer: 5256072 - FirstBatchArrivalWaitTime: 289603573212 - InactiveTotalTime: 301122247892 - PeakMemoryUsage: 0 - RowsReturned: 26311 - RowsReturnedRate: 87 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 301129238692 Instance a9429a2e6e27c0c3:16 (host=redacted-host2:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 3308288 - PerHostPeakMemUsage: 71363971 - RowsProduced: 2379 - TotalNetworkReceiveTime: 300503177064 - TotalNetworkSendTime: 3276728 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 86 - TotalThreadsTotalWallClockTime: 301431067860 - TotalThreadsSysTime: 6999000 - TotalThreadsUserTime: 186972000 - TotalThreadsVoluntaryContextSwitches: 237 - TotalTime: 303632808272 Fragment Instance Lifecycle Timings - ExecTime: 23299988 - ExecTreeExecTime: 13620940 - InactiveTotalTime: 0 - OpenTime: 301418488272 - ExecTreeOpenTime: 300542176700 - PrepareTime: 2190853972 - ExecTreePrepareTime: 709019608 - TotalTime: 0 DataStreamSender (dst_id=17) - BytesSent: 39997 - InactiveTotalTime: 0 - NetworkThroughput(*): 69738530 - OverallThroughput: 13715884 - PeakMemoryUsage: 122696 - RowsReturned: 2379 - SerializeBatchTime: 2241472 - TotalTime: 2916108 - TransmitDataRPCTime: 573528 - UncompressedRowBatchSize: 69019 CodeGen - CodegenTime: 60405152 - CompileTime: 205062968 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2021884 - NumFunctions: 42 - NumInstructions: 750 - OptimizationTime: 456812300 - PeakMemoryUsage: 384000 - PrepareTime: 583207360 - TotalTime: 1266912836 AGGREGATION_NODE (id=15) ExecOption: Codegen Enabled - BuildTime: 31093372 - GetNewBlockTime: 81071328 - GetResultsTime: 12281136 - HTResizeTime: 7076368 - HashBuckets: 65536 - InactiveTotalTime: 0 - LargestPartitionPercent: 6 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 3238007 - PinTime: 0 - RowsRepartitioned: 0 - RowsReturned: 2379 - RowsReturnedRate: 7 - SpilledPartitions: 0 - TotalTime: 301264750952 - UnpinTime: 4600 EXCHANGE_NODE (id=14) - BytesReceived: 471696 - ConvertRowBatchTime: 6134896 - DeserializeRowBatchTimer: 7862420 - FirstBatchArrivalWaitTime: 288984409572 - InactiveTotalTime: 300502394724 - PeakMemoryUsage: 0 - RowsReturned: 26116 - RowsReturnedRate: 86 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 300509718640 Instance a9429a2e6e27c0c3:17 (host=redacted-host8:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 3308288 - PerHostPeakMemUsage: 29367542 - RowsProduced: 2316 - TotalNetworkReceiveTime: 299807583304 - TotalNetworkSendTime: 2869808 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 68 - TotalThreadsTotalWallClockTime: 300906577144 - TotalThreadsSysTime: 8999000 - TotalThreadsUserTime: 171974000 - TotalThreadsVoluntaryContextSwitches: 243 - TotalTime: 303570988096 Fragment Instance Lifecycle Timings - ExecTime: 20346464 - ExecTreeExecTime: 12775864 - InactiveTotalTime: 0 - OpenTime: 300921501200 - ExecTreeOpenTime: 299844636960 - PrepareTime: 2628971232 - ExecTreePrepareTime: 1821196872 - TotalTime: 0 DataStreamSender (dst_id=17) - BytesSent: 39038 - InactiveTotalTime: 0 - NetworkThroughput(*): 81409219 - OverallThroughput: 21992347 - PeakMemoryUsage: 122696 - RowsReturned: 2316 - SerializeBatchTime: 1209920 - TotalTime: 1775072 - TransmitDataRPCTime: 479528 - UncompressedRowBatchSize: 67192 CodeGen - CodegenTime: 87774024 - CompileTime: 71367872 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2021884 - NumFunctions: 42 - NumInstructions: 750 - OptimizationTime: 611963400 - PeakMemoryUsage: 384000 - PrepareTime: 700174328 - TotalTime: 1401961096 AGGREGATION_NODE (id=15) ExecOption: Codegen Enabled - BuildTime: 29431280 - GetNewBlockTime: 1293173576 - GetResultsTime: 11096328 - HTResizeTime: 6256688 - HashBuckets: 65536 - InactiveTotalTime: 0 - LargestPartitionPercent: 6 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 3238007 - PinTime: 0 - RowsRepartitioned: 0 - RowsReturned: 2316 - RowsReturnedRate: 7 - SpilledPartitions: 0 - TotalTime: 301678550344 - UnpinTime: 9352 EXCHANGE_NODE (id=14) - BytesReceived: 474292 - ConvertRowBatchTime: 6169928 - DeserializeRowBatchTimer: 5152336 - FirstBatchArrivalWaitTime: 288289992288 - InactiveTotalTime: 299807004968 - PeakMemoryUsage: 0 - RowsReturned: 26243 - RowsReturnedRate: 87 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 299814192360 Averaged Fragment F01 split sizes: min: 2.78 GB, max: 2.80 GB, avg: 2.79 GB, stddev: 7.21 MB completion times: min:4m52s max:5m3s mean: 4m58s stddev:3s877ms execution rates: min:9.40 MB/sec max:9.76 MB/sec mean:9.59 MB/sec stddev:137.89 KB/sec num instances: 8 - AverageThreadTokens: 1.976556633231709 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 26052885 - PerHostPeakMemUsage: 66812489 - RowsProduced: 26239 - TotalNetworkReceiveTime: 63433885 - TotalNetworkSendTime: 3775270 - TotalStorageWaitTime: 106519729159 - TotalThreadsInvoluntaryContextSwitches: 42814 - TotalThreadsTotalWallClockTime: 587442061272 - TotalThreadsSysTime: 2831194125 - TotalThreadsUserTime: 58452988250 - TotalThreadsVoluntaryContextSwitches: 92808 - TotalTime: 298026504003 Fragment Instance Lifecycle Timings - ExecTime: 267290638932 - ExecTreeExecTime: 267244451042 - InactiveTotalTime: 0 - OpenTime: 29082709656 - ExecTreeOpenTime: 24018652274 - PrepareTime: 1653036462 - ExecTreePrepareTime: 671359136 - TotalTime: 0 DataStreamSender (dst_id=14) - BytesSent: 474025 - InactiveTotalTime: 0 - NetworkThroughput(*): 101653186 - OverallThroughput: 27445682 - PeakMemoryUsage: 271296 - RowsReturned: 26239 - SerializeBatchTime: 12826887 - TotalTime: 17631250 - TransmitDataRPCTime: 4676517 - UncompressedRowBatchSize: 761120 CodeGen - CodegenTime: 20995781 - CompileTime: 1263877020 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2021884 - NumFunctions: 121 - NumInstructions: 7493 - OptimizationTime: 3740217897 - PeakMemoryUsage: 3836416 - PrepareTime: 448163299 - TotalTime: 5481153567 AGGREGATION_NODE (id=7) - GetNewBlockTime: 282369133 - GetResultsTime: 7693150 - HTResizeTime: 52062222 - HashBuckets: 67072 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 14081058 - PinTime: 0 - ReductionFactorEstimate: 473.4901500252598 - ReductionFactorThresholdToExpand: 1.0999999999999999 - RowsPassedThrough: 0 - RowsReturned: 26239 - RowsReturnedRate: 89 - StreamingTime: 11292659311 - TotalTime: 291934390907 - UnpinTime: 0 HASH_JOIN_NODE (id=6) - BuildRows: 229 - BuildTime: 28386434 - InactiveTotalTime: 0 - LocalTime: 1691045067 - PeakMemoryUsage: 11055116 - ProbeRows: 992224 - ProbeRowsPartitioned: 0 - ProbeTime: 136518018 - RowsReturned: 272206 - RowsReturnedRate: 970 - TotalTime: 280476405836 Hash Join Builder (join_node_id=6) - BuildRowsPartitionTime: 120558 - BuildRowsPartitioned: 229 - GetNewBlockTime: 27453193 - HashBuckets: 496 - HashCollisions: 0 - HashTablesBuildTime: 345551 - InactiveTotalTime: 0 - LargestPartitionPercent: 8 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 1078144 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=13) - BytesReceived: 4099 - ConvertRowBatchTime: 57952 - DeserializeRowBatchTimer: 15858822 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 229 - RowsReturnedRate: 2853921 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 80996 HASH_JOIN_NODE (id=5) - BuildRows: 251 - BuildTime: 21327387 - InactiveTotalTime: 0 - LocalTime: 805261264 - PeakMemoryUsage: 3133237 - ProbeRows: 4354750 - ProbeRowsPartitioned: 0 - ProbeTime: 503219870 - RowsReturned: 992224 - RowsReturnedRate: 3560 - TotalTime: 278785279772 Hash Join Builder (join_node_id=5) - BuildRowsPartitionTime: 62169 - BuildRowsPartitioned: 251 - GetNewBlockTime: 18164809 - HashBuckets: 480 - HashCollisions: 0 - HashTablesBuildTime: 228482 - InactiveTotalTime: 0 - LargestPartitionPercent: 7 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 1077888 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=12) - BytesReceived: 2832 - ConvertRowBatchTime: 52231 - DeserializeRowBatchTimer: 16037939 - FirstBatchArrivalWaitTime: 27505662 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 251 - RowsReturnedRate: 3201643 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 63476387 HASH_JOIN_NODE (id=4) - BuildRows: 520 - BuildTime: 28901627 - InactiveTotalTime: 0 - LocalTime: 6555089512 - PeakMemoryUsage: 2070272 - ProbeRows: 61776723 - ProbeRowsPartitioned: 0 - ProbeTime: 5529091172 - RowsReturned: 4354750 - RowsReturnedRate: 15672 - TotalTime: 277916542121 Hash Join Builder (join_node_id=4) - BuildRowsPartitionTime: 255242 - BuildRowsPartitioned: 520 - GetNewBlockTime: 27246000 - HashBuckets: 1152 - HashCollisions: 0 - HashTablesBuildTime: 467971 - InactiveTotalTime: 0 - LargestPartitionPercent: 9 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 1088640 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=11) - BytesReceived: 7274 - ConvertRowBatchTime: 127682 - DeserializeRowBatchTimer: 25621176 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 520 - RowsReturnedRate: 3498634 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 150636 HDFS_SCAN_NODE (id=0) - AverageHdfsReadThreadConcurrency: 0.0017355066154183022 - AverageScannerThreadConcurrency: 1.0 - BytesRead: 181226173 - BytesReadDataNodeCache: 0 - BytesReadLocal: 181226173 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 181226173 - DecompressionTime: 6017928021 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 4 - NumDisksAccessed: 12 - NumRowGroups: 136 - NumScannerThreadsStarted: 1 - PeakMemoryUsage: 12194077 - PerReadThreadRawHdfsThroughput: 362246702 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 269364420011 - RowBatchQueuePutWaitTime: 847531611 - RowsRead: 61776723 - RowsReturned: 61776723 - RowsReturnedRate: 227716 - ScanRangesComplete: 136 - ScannerThreadsInvoluntaryContextSwitches: 40102 - ScannerThreadsTotalWallClockTime: 291083326132 - MaterializeTupleTime(*): 140686346985 - ScannerThreadsSysTime: 1815473625 - ScannerThreadsUserTime: 48846698625 - ScannerThreadsVoluntaryContextSwitches: 29468 - TotalRawHdfsReadTime(*): 505515707 - TotalReadThroughput: 616109 - TotalTime: 271361301973 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 96 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 34603008 - PeakMemoryUsage: 1746176 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 Fragment F01 Instance a9429a2e6e27c0c3:10 (host=redacted-host6:22000) Hdfs split stats (:<# splits>/): 3:7/145.12 MB 1:12/234.99 MB 6:11/194.16 MB 7:8/215.53 MB 4:17/384.47 MB 8:8/186.35 MB 0:17/327.23 MB 2:8/187.35 MB 5:12/237.58 MB 10:13/290.33 MB 9:13/308.22 MB 11:8/142.34 MB - AverageThreadTokens: 1.971476510067114 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 26587084 - PerHostPeakMemUsage: 73712395 - RowsProduced: 23521 - TotalNetworkReceiveTime: 29644 - TotalNetworkSendTime: 2767616 - TotalStorageWaitTime: 119839683628 - TotalThreadsInvoluntaryContextSwitches: 37120 - TotalThreadsTotalWallClockTime: 595657243188 - TotalThreadsSysTime: 2901558000 - TotalThreadsUserTime: 58037176000 - TotalThreadsVoluntaryContextSwitches: 93806 - TotalTime: 303562084116 Fragment Instance Lifecycle Timings - ExecTime: 282142706576 - ExecTreeExecTime: 282112338032 - InactiveTotalTime: 0 - OpenTime: 18542182760 - ExecTreeOpenTime: 13013077752 - PrepareTime: 2877102116 - ExecTreePrepareTime: 1111134024 - TotalTime: 0 DataStreamSender (dst_id=14) - BytesSent: 424976 - InactiveTotalTime: 0 - NetworkThroughput(*): 103547115 - OverallThroughput: 36062664 - PeakMemoryUsage: 271296 - RowsReturned: 23521 - SerializeBatchTime: 7534716 - TotalTime: 11784376 - TransmitDataRPCTime: 4104180 - UncompressedRowBatchSize: 682269 CodeGen - CodegenTime: 76613796 - CompileTime: 1261387936 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2021884 - NumFunctions: 121 - NumInstructions: 7493 - OptimizationTime: 4162841412 - PeakMemoryUsage: 3836416 - PrepareTime: 1028628252 - TotalTime: 6479663708 AGGREGATION_NODE (id=7) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 452818544 - GetResultsTime: 4561200 - HTResizeTime: 87650476 - HashBuckets: 65536 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 13773955 - PinTime: 0 - ReductionFactorEstimate: 523.4074697173621 - ReductionFactorThresholdToExpand: 1.1 - RowsPassedThrough: 0 - RowsReturned: 23521 - RowsReturnedRate: 79 - StreamingTime: 10952183816 - TotalTime: 296236495484 - UnpinTime: 0 HASH_JOIN_NODE (id=6) ExecOption: Probe Side Codegen Enabled - BuildRows: 229 - BuildTime: 74436428 - InactiveTotalTime: 0 - LocalTime: 1502338444 - PeakMemoryUsage: 11162590 - ProbeRows: 893706 - ProbeRowsPartitioned: 0 - ProbeTime: 127111032 - RowsReturned: 244245 - RowsReturnedRate: 857 - TotalTime: 284850063380 Hash Join Builder (join_node_id=6) ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 141212 - BuildRowsPartitioned: 229 - GetNewBlockTime: 73049932 - HashBuckets: 496 - HashCollisions: 0 - HashTablesBuildTime: 350924 - InactiveTotalTime: 0 - LargestPartitionPercent: 8 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 1078144 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=13) - BytesReceived: 4099 - ConvertRowBatchTime: 53432 - DeserializeRowBatchTimer: 171216 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 229 - RowsReturnedRate: 2856216 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 80176 HASH_JOIN_NODE (id=5) ExecOption: Probe Side Codegen Enabled - BuildRows: 251 - BuildTime: 664016 - InactiveTotalTime: 0 - LocalTime: 1058998744 - PeakMemoryUsage: 3155048 - ProbeRows: 4354796 - ProbeRowsPartitioned: 0 - ProbeTime: 530440576 - RowsReturned: 893706 - RowsReturnedRate: 3154 - TotalTime: 283347644760 Hash Join Builder (join_node_id=5) ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 56420 - BuildRowsPartitioned: 251 - GetNewBlockTime: 142504 - HashBuckets: 480 - HashCollisions: 0 - HashTablesBuildTime: 248436 - InactiveTotalTime: 0 - LargestPartitionPercent: 7 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 1077888 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=12) - BytesReceived: 2832 - ConvertRowBatchTime: 56484 - DeserializeRowBatchTimer: 45861272 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 251 - RowsReturnedRate: 3334750 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 75268 HASH_JOIN_NODE (id=4) ExecOption: Probe Side Codegen Enabled - BuildRows: 520 - BuildTime: 16985336 - InactiveTotalTime: 0 - LocalTime: 6674281832 - PeakMemoryUsage: 2070272 - ProbeRows: 61686307 - ProbeRowsPartitioned: 0 - ProbeTime: 5635649136 - RowsReturned: 4354796 - RowsReturnedRate: 15426 - TotalTime: 282288570748 Hash Join Builder (join_node_id=4) ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 218332 - BuildRowsPartitioned: 520 - GetNewBlockTime: 16075860 - HashBuckets: 1152 - HashCollisions: 0 - HashTablesBuildTime: 424704 - InactiveTotalTime: 0 - LargestPartitionPercent: 9 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 1088640 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=11) - BytesReceived: 7274 - ConvertRowBatchTime: 123464 - DeserializeRowBatchTimer: 277208 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 520 - RowsReturnedRate: 3617039 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 143764 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 3:7/145.12 MB 1:12/234.99 MB 6:11/194.16 MB 7:8/215.53 MB 4:17/384.47 MB 8:8/186.35 MB 0:17/327.23 MB 2:8/187.35 MB 5:12/237.58 MB 10:13/290.33 MB 9:13/308.22 MB 11:8/142.34 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 134 out of 134 Hdfs Read Thread Concurrency Bucket: 0:99.65% 1:0.3454% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:536 - AverageHdfsReadThreadConcurrency: 0.0051813471502590676 - AverageScannerThreadConcurrency: 1.0 - BytesRead: 180876028 - BytesReadDataNodeCache: 0 - BytesReadLocal: 180876028 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 180876028 - DecompressionTime: 5797506720 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 4 - NumDisksAccessed: 12 - NumRowGroups: 134 - NumScannerThreadsStarted: 1 - PeakMemoryUsage: 11848814 - PerReadThreadRawHdfsThroughput: 357732224 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 274043874704 - RowBatchQueuePutWaitTime: 255956568 - RowsRead: 61686307 - RowsReturned: 61686307 - RowsReturnedRate: 223814 - ScanRangesComplete: 134 - ScannerThreadsInvoluntaryContextSwitches: 34022 - ScannerThreadsTotalWallClockTime: 294980458684 - MaterializeTupleTime(*): 137157203556 - ScannerThreadsSysTime: 1865716000 - ScannerThreadsUserTime: 48319654000 - ScannerThreadsVoluntaryContextSwitches: 30364 - TotalRawHdfsReadTime(*): 505618492 - TotalReadThroughput: 605110 - TotalTime: 275614145152 Instance a9429a2e6e27c0c3:11 (host=redacted-host4:22000) Hdfs split stats (:<# splits>/): 1:16/327.02 MB 0:16/312.59 MB 9:8/156.09 MB 6:13/276.39 MB 10:12/220.43 MB 2:9/169.15 MB 7:12/267.22 MB 4:15/286.00 MB 11:6/132.65 MB 5:17/372.34 MB 8:8/158.27 MB 3:9/169.67 MB - AverageThreadTokens: 1.9747048903878583 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 25402469 - PerHostPeakMemUsage: 72498824 - RowsProduced: 29128 - TotalNetworkReceiveTime: 31832 - TotalNetworkSendTime: 2971152 - TotalStorageWaitTime: 129147258000 - TotalThreadsInvoluntaryContextSwitches: 39208 - TotalThreadsTotalWallClockTime: 595797392400 - TotalThreadsSysTime: 2914556000 - TotalThreadsUserTime: 58671080000 - TotalThreadsVoluntaryContextSwitches: 93533 - TotalTime: 302871728120 Fragment Instance Lifecycle Timings - ExecTime: 190055911456 - ExecTreeExecTime: 190017753768 - InactiveTotalTime: 0 - OpenTime: 110757794704 - ExecTreeOpenTime: 105252013288 - PrepareTime: 2057884208 - ExecTreePrepareTime: 774694160 - TotalTime: 0 DataStreamSender (dst_id=14) - BytesSent: 526322 - InactiveTotalTime: 0 - NetworkThroughput(*): 96726328 - OverallThroughput: 30030582 - PeakMemoryUsage: 271296 - RowsReturned: 29128 - SerializeBatchTime: 11970312 - TotalTime: 17526200 - TransmitDataRPCTime: 5441352 - UncompressedRowBatchSize: 844904 CodeGen - CodegenTime: 14751752 - CompileTime: 1512401008 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2021884 - NumFunctions: 121 - NumInstructions: 7493 - OptimizationTime: 3905701616 - PeakMemoryUsage: 3836416 - PrepareTime: 495728256 - TotalTime: 5977002640 AGGREGATION_NODE (id=7) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 281634016 - GetResultsTime: 6449072 - HTResizeTime: 17757048 - HashBuckets: 65536 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 13931616 - PinTime: 0 - ReductionFactorEstimate: 511.3300628376144 - ReductionFactorThresholdToExpand: 1.1 - RowsPassedThrough: 0 - RowsReturned: 29128 - RowsReturnedRate: 98 - StreamingTime: 7497470976 - TotalTime: 296044398072 - UnpinTime: 0 HASH_JOIN_NODE (id=6) ExecOption: Probe Side Codegen Enabled - BuildRows: 229 - BuildTime: 35791840 - InactiveTotalTime: 0 - LocalTime: 4795790056 - PeakMemoryUsage: 10827675 - ProbeRows: 1106942 - ProbeRowsPartitioned: 0 - ProbeTime: 158824648 - RowsReturned: 302033 - RowsReturnedRate: 1046 - TotalTime: 288619537552 Hash Join Builder (join_node_id=6) ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 150272 - BuildRowsPartitioned: 229 - GetNewBlockTime: 34872000 - HashBuckets: 496 - HashCollisions: 0 - HashTablesBuildTime: 355096 - InactiveTotalTime: 0 - LargestPartitionPercent: 8 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 1078144 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=13) - BytesReceived: 4099 - ConvertRowBatchTime: 68480 - DeserializeRowBatchTimer: 211760 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 229 - RowsReturnedRate: 2409106 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 95056 HASH_JOIN_NODE (id=5) ExecOption: Probe Side Codegen Enabled - BuildRows: 251 - BuildTime: 102282816 - InactiveTotalTime: 0 - LocalTime: 946731424 - PeakMemoryUsage: 3054064 - ProbeRows: 4333369 - ProbeRowsPartitioned: 0 - ProbeTime: 487744632 - RowsReturned: 1106942 - RowsReturnedRate: 3900 - TotalTime: 283823652440 Hash Join Builder (join_node_id=5) ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 76208 - BuildRowsPartitioned: 251 - GetNewBlockTime: 83307704 - HashBuckets: 480 - HashCollisions: 0 - HashTablesBuildTime: 314392 - InactiveTotalTime: 0 - LargestPartitionPercent: 7 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 1077888 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=12) - BytesReceived: 2832 - ConvertRowBatchTime: 59216 - DeserializeRowBatchTimer: 45803160 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 251 - RowsReturnedRate: 3018278 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 83160 HASH_JOIN_NODE (id=4) ExecOption: Probe Side Codegen Enabled - BuildRows: 520 - BuildTime: 73133152 - InactiveTotalTime: 0 - LocalTime: 6714215824 - PeakMemoryUsage: 2070272 - ProbeRows: 61491771 - ProbeRowsPartitioned: 0 - ProbeTime: 5396845824 - RowsReturned: 4333369 - RowsReturnedRate: 15318 - TotalTime: 282876837856 Hash Join Builder (join_node_id=4) ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 242408 - BuildRowsPartitioned: 520 - GetNewBlockTime: 71964096 - HashBuckets: 1152 - HashCollisions: 0 - HashTablesBuildTime: 427968 - InactiveTotalTime: 0 - LargestPartitionPercent: 9 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 1088640 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=11) - BytesReceived: 7274 - ConvertRowBatchTime: 116272 - DeserializeRowBatchTimer: 136680 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 520 - RowsReturnedRate: 3795842 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 136992 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 1:16/327.02 MB 0:16/312.59 MB 9:8/156.09 MB 6:13/276.39 MB 10:12/220.43 MB 2:9/169.15 MB 7:12/267.22 MB 4:15/286.00 MB 11:6/132.65 MB 5:17/372.34 MB 8:8/158.27 MB 3:9/169.67 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 141 out of 141 Hdfs Read Thread Concurrency Bucket: 0:99.83% 1:0.173% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:564 - AverageHdfsReadThreadConcurrency: 0.0017301038062283738 - AverageScannerThreadConcurrency: 1.0 - BytesRead: 180592498 - BytesReadDataNodeCache: 0 - BytesReadLocal: 180592498 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 180592498 - DecompressionTime: 5743519224 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 4 - NumDisksAccessed: 12 - NumRowGroups: 141 - NumScannerThreadsStarted: 1 - PeakMemoryUsage: 14574784 - PerReadThreadRawHdfsThroughput: 371408670 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 273503324288 - RowBatchQueuePutWaitTime: 1861127024 - RowsRead: 61491771 - RowsReturned: 61491771 - RowsReturnedRate: 222665 - ScanRangesComplete: 141 - ScannerThreadsInvoluntaryContextSwitches: 36423 - ScannerThreadsTotalWallClockTime: 295033393104 - MaterializeTupleTime(*): 122817203488 - ScannerThreadsSysTime: 1871715000 - ScannerThreadsUserTime: 49191521000 - ScannerThreadsVoluntaryContextSwitches: 29308 - TotalRawHdfsReadTime(*): 486236624 - TotalReadThroughput: 606237 - TotalTime: 276162485040 Instance a9429a2e6e27c0c3:b (host=redacted-host7:22000) Hdfs split stats (:<# splits>/): 9:9/227.87 MB 0:14/274.43 MB 8:12/266.82 MB 2:16/343.09 MB 11:7/145.25 MB 1:16/271.10 MB 6:8/214.95 MB 4:14/259.78 MB 3:8/172.24 MB 10:10/168.20 MB 7:13/277.63 MB 5:12/236.21 MB - AverageThreadTokens: 1.976271186440678 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 27270368 - PerHostPeakMemUsage: 72333694 - RowsProduced: 25160 - TotalNetworkReceiveTime: 29288 - TotalNetworkSendTime: 4035280 - TotalStorageWaitTime: 103841535496 - TotalThreadsInvoluntaryContextSwitches: 43854 - TotalThreadsTotalWallClockTime: 592593700168 - TotalThreadsSysTime: 2912557000 - TotalThreadsUserTime: 59447962000 - TotalThreadsVoluntaryContextSwitches: 92610 - TotalTime: 300049197296 Fragment Instance Lifecycle Timings - ExecTime: 283949023008 - ExecTreeExecTime: 283902415600 - InactiveTotalTime: 0 - OpenTime: 15171390168 - ExecTreeOpenTime: 9646437176 - PrepareTime: 928683880 - ExecTreePrepareTime: 210752176 - TotalTime: 0 DataStreamSender (dst_id=14) - BytesSent: 454184 - InactiveTotalTime: 0 - NetworkThroughput(*): 84489162 - OverallThroughput: 21489222 - PeakMemoryUsage: 271296 - RowsReturned: 25160 - SerializeBatchTime: 15628288 - TotalTime: 21135432 - TransmitDataRPCTime: 5375648 - UncompressedRowBatchSize: 729800 CodeGen - CodegenTime: 18206352 - CompileTime: 954661232 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2021884 - NumFunctions: 121 - NumInstructions: 7493 - OptimizationTime: 4500088944 - PeakMemoryUsage: 3836416 - PrepareTime: 329210136 - TotalTime: 5784676880 AGGREGATION_NODE (id=7) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 28037776 - GetResultsTime: 8808392 - HTResizeTime: 28531840 - HashBuckets: 65536 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 14623522 - PinTime: 0 - ReductionFactorEstimate: 525.5112866817155 - ReductionFactorThresholdToExpand: 1.1 - RowsPassedThrough: 0 - RowsReturned: 25160 - RowsReturnedRate: 85 - StreamingTime: 11226499576 - TotalTime: 293759529752 - UnpinTime: 0 HASH_JOIN_NODE (id=6) ExecOption: Probe Side Codegen Enabled - BuildRows: 229 - BuildTime: 787192 - InactiveTotalTime: 0 - LocalTime: 725052016 - PeakMemoryUsage: 11153100 - ProbeRows: 956505 - ProbeRowsPartitioned: 0 - ProbeTime: 141513168 - RowsReturned: 261288 - RowsReturnedRate: 925 - TotalTime: 282313680280 Hash Join Builder (join_node_id=6) ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 103184 - BuildRowsPartitioned: 229 - GetNewBlockTime: 66880 - HashBuckets: 496 - HashCollisions: 0 - HashTablesBuildTime: 339288 - InactiveTotalTime: 0 - LargestPartitionPercent: 8 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 1078144 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=13) - BytesReceived: 4099 - ConvertRowBatchTime: 53304 - DeserializeRowBatchTimer: 76480 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 229 - RowsReturnedRate: 3103990 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 73776 HASH_JOIN_NODE (id=5) ExecOption: Probe Side Codegen Enabled - BuildRows: 251 - BuildTime: 6394656 - InactiveTotalTime: 0 - LocalTime: 660281352 - PeakMemoryUsage: 3123126 - ProbeRows: 4354897 - ProbeRowsPartitioned: 0 - ProbeTime: 513073480 - RowsReturned: 956505 - RowsReturnedRate: 3396 - TotalTime: 281588554488 Hash Join Builder (join_node_id=5) ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 64544 - BuildRowsPartitioned: 251 - GetNewBlockTime: 5670352 - HashBuckets: 480 - HashCollisions: 0 - HashTablesBuildTime: 247184 - InactiveTotalTime: 0 - LargestPartitionPercent: 7 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 1077888 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=12) - BytesReceived: 2832 - ConvertRowBatchTime: 60984 - DeserializeRowBatchTimer: 11114976 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 251 - RowsReturnedRate: 3094791 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 81104 HASH_JOIN_NODE (id=4) ExecOption: Probe Side Codegen Enabled - BuildRows: 520 - BuildTime: 23757520 - InactiveTotalTime: 0 - LocalTime: 6263994328 - PeakMemoryUsage: 2070272 - ProbeRows: 61724663 - ProbeRowsPartitioned: 0 - ProbeTime: 5529163448 - RowsReturned: 4354897 - RowsReturnedRate: 15501 - TotalTime: 280928192032 Hash Join Builder (join_node_id=4) ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 307016 - BuildRowsPartitioned: 520 - GetNewBlockTime: 22399304 - HashBuckets: 1152 - HashCollisions: 0 - HashTablesBuildTime: 538120 - InactiveTotalTime: 0 - LargestPartitionPercent: 9 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 1088640 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=11) - BytesReceived: 7274 - ConvertRowBatchTime: 166280 - DeserializeRowBatchTimer: 156112 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 520 - RowsReturnedRate: 2726510 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 190720 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 9:9/227.87 MB 0:14/274.43 MB 8:12/266.82 MB 2:16/343.09 MB 11:7/145.25 MB 1:16/271.10 MB 6:8/214.95 MB 4:14/259.78 MB 3:8/172.24 MB 10:10/168.20 MB 7:13/277.63 MB 5:12/236.21 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 139 out of 139 Hdfs Read Thread Concurrency Bucket: 0:99.83% 1:0.1736% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:556 - AverageHdfsReadThreadConcurrency: 0.001736111111111111 - AverageScannerThreadConcurrency: 1.0 - BytesRead: 181206489 - BytesReadDataNodeCache: 0 - BytesReadLocal: 181206489 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 181206489 - DecompressionTime: 6520169272 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 4 - NumDisksAccessed: 12 - NumRowGroups: 139 - NumScannerThreadsStarted: 1 - PeakMemoryUsage: 11291927 - PerReadThreadRawHdfsThroughput: 388767528 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 272973386336 - RowBatchQueuePutWaitTime: 183508984 - RowsRead: 61724663 - RowsReturned: 61724663 - RowsReturnedRate: 224727 - ScanRangesComplete: 139 - ScannerThreadsInvoluntaryContextSwitches: 41110 - ScannerThreadsTotalWallClockTime: 293491794856 - MaterializeTupleTime(*): 141400736528 - ScannerThreadsSysTime: 1889712000 - ScannerThreadsUserTime: 49700444000 - ScannerThreadsVoluntaryContextSwitches: 29580 - TotalRawHdfsReadTime(*): 466105000 - TotalReadThroughput: 609665 - TotalTime: 274664006984 Instance a9429a2e6e27c0c3:d (host=redacted-host1:22000) Hdfs split stats (:<# splits>/): 8:7/145.56 MB 10:10/166.30 MB 2:12/250.88 MB 7:11/224.67 MB 6:11/295.95 MB 1:13/336.57 MB 4:14/245.80 MB 3:11/252.27 MB 0:12/280.17 MB 11:12/249.98 MB 9:9/183.13 MB 5:12/235.13 MB - AverageThreadTokens: 1.9898132427843802 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 26321508 - PerHostPeakMemUsage: 71391289 - RowsProduced: 20327 - TotalNetworkReceiveTime: 507262192 - TotalNetworkSendTime: 4634152 - TotalStorageWaitTime: 112000376992 - TotalThreadsInvoluntaryContextSwitches: 40622 - TotalThreadsTotalWallClockTime: 596304978016 - TotalThreadsSysTime: 2887561000 - TotalThreadsUserTime: 58229147000 - TotalThreadsVoluntaryContextSwitches: 93708 - TotalTime: 299780922600 Fragment Instance Lifecycle Timings - ExecTime: 296546653240 - ExecTreeExecTime: 296506592624 - InactiveTotalTime: 0 - OpenTime: 3079764832 - ExecTreeOpenTime: 742223432 - PrepareTime: 154392432 - ExecTreePrepareTime: 11060696 - TotalTime: 0 DataStreamSender (dst_id=14) - BytesSent: 367004 - InactiveTotalTime: 0 - NetworkThroughput(*): 102492638 - OverallThroughput: 24882760 - PeakMemoryUsage: 271296 - RowsReturned: 20327 - SerializeBatchTime: 11079992 - TotalTime: 14749328 - TransmitDataRPCTime: 3580784 - UncompressedRowBatchSize: 589611 CodeGen - CodegenTime: 8524328 - CompileTime: 331531040 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2021884 - NumFunctions: 121 - NumInstructions: 7493 - OptimizationTime: 1989824296 - PeakMemoryUsage: 3836416 - PrepareTime: 54143184 - TotalTime: 2379914280 AGGREGATION_NODE (id=7) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 6523952 - GetResultsTime: 5959296 - HTResizeTime: 15644584 - HashBuckets: 65536 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 14677937 - PinTime: 0 - ReductionFactorEstimate: 523.1982124674737 - ReductionFactorThresholdToExpand: 1.1 - RowsPassedThrough: 0 - RowsReturned: 20327 - RowsReturnedRate: 68 - StreamingTime: 16679150032 - TotalTime: 297259816040 - UnpinTime: 0 HASH_JOIN_NODE (id=6) ExecOption: Probe Side Codegen Enabled - BuildRows: 229 - BuildTime: 1773720 - InactiveTotalTime: 0 - LocalTime: 254555104 - PeakMemoryUsage: 10745575 - ProbeRows: 767174 - ProbeRowsPartitioned: 0 - ProbeTime: 101598176 - RowsReturned: 210629 - RowsReturnedRate: 750 - TotalTime: 280553691288 Hash Join Builder (join_node_id=6) ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 90456 - BuildRowsPartitioned: 229 - GetNewBlockTime: 1062608 - HashBuckets: 496 - HashCollisions: 0 - HashTablesBuildTime: 321248 - InactiveTotalTime: 0 - LargestPartitionPercent: 8 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 1078144 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=13) - BytesReceived: 4099 - ConvertRowBatchTime: 52728 - DeserializeRowBatchTimer: 84048 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 229 - RowsReturnedRate: 3129441 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 73176 HASH_JOIN_NODE (id=5) ExecOption: Probe Side Codegen Enabled - BuildRows: 251 - BuildTime: 7716920 - InactiveTotalTime: 0 - LocalTime: 732455088 - PeakMemoryUsage: 3090032 - ProbeRows: 4365887 - ProbeRowsPartitioned: 0 - ProbeTime: 491032888 - RowsReturned: 767174 - RowsReturnedRate: 2736 - TotalTime: 280299063008 Hash Join Builder (join_node_id=5) ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 73824 - BuildRowsPartitioned: 251 - GetNewBlockTime: 7163360 - HashBuckets: 480 - HashCollisions: 0 - HashTablesBuildTime: 173888 - InactiveTotalTime: 0 - LargestPartitionPercent: 7 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 1077888 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=12) - BytesReceived: 2832 - ConvertRowBatchTime: 57776 - DeserializeRowBatchTimer: 35304 - FirstBatchArrivalWaitTime: 220045296 - InactiveTotalTime: 507225296 - PeakMemoryUsage: 0 - RowsReturned: 251 - RowsReturnedRate: 494 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 507312632 HASH_JOIN_NODE (id=4) ExecOption: Probe Side Codegen Enabled - BuildRows: 520 - BuildTime: 19665048 - InactiveTotalTime: 0 - LocalTime: 6322798048 - PeakMemoryUsage: 2070272 - ProbeRows: 61976722 - ProbeRowsPartitioned: 0 - ProbeTime: 5514615976 - RowsReturned: 4365887 - RowsReturnedRate: 15645 - TotalTime: 279059295288 Hash Join Builder (join_node_id=4) ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 239232 - BuildRowsPartitioned: 520 - GetNewBlockTime: 18674104 - HashBuckets: 1152 - HashCollisions: 0 - HashTablesBuildTime: 452432 - InactiveTotalTime: 0 - LargestPartitionPercent: 9 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 1088640 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=11) - BytesReceived: 7274 - ConvertRowBatchTime: 114280 - DeserializeRowBatchTimer: 394792 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 520 - RowsReturnedRate: 3779509 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 137584 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 8:7/145.56 MB 10:10/166.30 MB 2:12/250.88 MB 7:11/224.67 MB 6:11/295.95 MB 1:13/336.57 MB 4:14/245.80 MB 3:11/252.27 MB 0:12/280.17 MB 11:12/249.98 MB 9:9/183.13 MB 5:12/235.13 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 134 out of 134 Hdfs Read Thread Concurrency Bucket: 0:99.83% 1:0.1715% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:536 - AverageHdfsReadThreadConcurrency: 0.0017152658662092624 - AverageScannerThreadConcurrency: 1.0 - BytesRead: 181506059 - BytesReadDataNodeCache: 0 - BytesReadLocal: 181506059 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 181506059 - DecompressionTime: 6330400744 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 4 - NumDisksAccessed: 12 - NumRowGroups: 134 - NumScannerThreadsStarted: 1 - PeakMemoryUsage: 12385099 - PerReadThreadRawHdfsThroughput: 296678925 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 270955092872 - RowBatchQueuePutWaitTime: 2376542536 - RowsRead: 61976722 - RowsReturned: 61976722 - RowsReturnedRate: 227240 - ScanRangesComplete: 134 - ScannerThreadsInvoluntaryContextSwitches: 37884 - ScannerThreadsTotalWallClockTime: 296685545528 - MaterializeTupleTime(*): 143162121160 - ScannerThreadsSysTime: 1821723000 - ScannerThreadsUserTime: 48888567000 - ScannerThreadsVoluntaryContextSwitches: 30499 - TotalRawHdfsReadTime(*): 611792896 - TotalReadThroughput: 616082 - TotalTime: 272736359656 Instance a9429a2e6e27c0c3:c (host=redacted-host3:22000) Hdfs split stats (:<# splits>/): 5:12/279.98 MB 6:12/264.26 MB 7:8/142.35 MB 0:12/264.94 MB 8:14/319.68 MB 2:13/233.88 MB 4:11/194.32 MB 1:12/222.73 MB 11:14/333.26 MB 10:11/223.09 MB 3:10/182.97 MB 9:12/207.76 MB - AverageThreadTokens: 1.9827882960413081 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 22817672 - PerHostPeakMemUsage: 69985667 - RowsProduced: 29540 - TotalNetworkReceiveTime: 29968 - TotalNetworkSendTime: 2918136 - TotalStorageWaitTime: 103538882504 - TotalThreadsInvoluntaryContextSwitches: 46264 - TotalThreadsTotalWallClockTime: 586578996832 - TotalThreadsSysTime: 2821571000 - TotalThreadsUserTime: 58994031000 - TotalThreadsVoluntaryContextSwitches: 91925 - TotalTime: 295718065024 Fragment Instance Lifecycle Timings - ExecTime: 286432626312 - ExecTreeExecTime: 286377669432 - InactiveTotalTime: 0 - OpenTime: 9125105848 - ExecTreeOpenTime: 4839960856 - PrepareTime: 160186176 - ExecTreePrepareTime: 8057120 - TotalTime: 0 DataStreamSender (dst_id=14) - BytesSent: 533713 - InactiveTotalTime: 0 - NetworkThroughput(*): 105719405 - OverallThroughput: 26696841 - PeakMemoryUsage: 271296 - RowsReturned: 29540 - SerializeBatchTime: 14857664 - TotalTime: 19991616 - TransmitDataRPCTime: 5048392 - UncompressedRowBatchSize: 856852 CodeGen - CodegenTime: 5858176 - CompileTime: 1962521728 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2021884 - NumFunctions: 121 - NumInstructions: 7493 - OptimizationTime: 2304479848 - PeakMemoryUsage: 3836416 - PrepareTime: 46276584 - TotalTime: 4314194184 AGGREGATION_NODE (id=7) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 147320 - GetResultsTime: 9874200 - HTResizeTime: 89908632 - HashBuckets: 65536 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 13529102 - PinTime: 0 - ReductionFactorEstimate: 512.3710497237569 - ReductionFactorThresholdToExpand: 1.1 - RowsPassedThrough: 0 - RowsReturned: 29540 - RowsReturnedRate: 101 - StreamingTime: 9715272896 - TotalTime: 291225603792 - UnpinTime: 0 HASH_JOIN_NODE (id=6) ExecOption: Probe Side Codegen Enabled - BuildRows: 229 - BuildTime: 74549832 - InactiveTotalTime: 0 - LocalTime: 501058920 - PeakMemoryUsage: 11108385 - ProbeRows: 1112198 - ProbeRowsPartitioned: 0 - ProbeTime: 154066656 - RowsReturned: 306610 - RowsReturnedRate: 1089 - TotalTime: 281480640208 Hash Join Builder (join_node_id=6) ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 123192 - BuildRowsPartitioned: 229 - GetNewBlockTime: 73607520 - HashBuckets: 496 - HashCollisions: 0 - HashTablesBuildTime: 321192 - InactiveTotalTime: 0 - LargestPartitionPercent: 8 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 1078144 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=13) - BytesReceived: 4099 - ConvertRowBatchTime: 64792 - DeserializeRowBatchTimer: 183480 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 229 - RowsReturnedRate: 2587921 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 88488 HASH_JOIN_NODE (id=5) ExecOption: Probe Side Codegen Enabled - BuildRows: 251 - BuildTime: 9715192 - InactiveTotalTime: 0 - LocalTime: 667911616 - PeakMemoryUsage: 3161520 - ProbeRows: 4367594 - ProbeRowsPartitioned: 0 - ProbeTime: 499099288 - RowsReturned: 1112198 - RowsReturnedRate: 3958 - TotalTime: 280979492800 Hash Join Builder (join_node_id=5) ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 42408 - BuildRowsPartitioned: 251 - GetNewBlockTime: 9263304 - HashBuckets: 480 - HashCollisions: 0 - HashTablesBuildTime: 159968 - InactiveTotalTime: 0 - LargestPartitionPercent: 7 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 1077888 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=12) - BytesReceived: 2832 - ConvertRowBatchTime: 33360 - DeserializeRowBatchTimer: 33264 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 251 - RowsReturnedRate: 5028850 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 49912 HASH_JOIN_NODE (id=4) ExecOption: Probe Side Codegen Enabled - BuildRows: 520 - BuildTime: 31157920 - InactiveTotalTime: 0 - LocalTime: 6419897296 - PeakMemoryUsage: 2070272 - ProbeRows: 61962462 - ProbeRowsPartitioned: 0 - ProbeTime: 5687960536 - RowsReturned: 4367594 - RowsReturnedRate: 15581 - TotalTime: 280311531272 Hash Join Builder (join_node_id=4) ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 260152 - BuildRowsPartitioned: 520 - GetNewBlockTime: 29983824 - HashBuckets: 1152 - HashCollisions: 0 - HashTablesBuildTime: 550728 - InactiveTotalTime: 0 - LargestPartitionPercent: 9 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 1088640 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=11) - BytesReceived: 7274 - ConvertRowBatchTime: 145416 - DeserializeRowBatchTimer: 9876136 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 520 - RowsReturnedRate: 3051356 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 170416 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 5:12/279.98 MB 6:12/264.26 MB 7:8/142.35 MB 0:12/264.94 MB 8:14/319.68 MB 2:13/233.88 MB 4:11/194.32 MB 1:12/222.73 MB 11:14/333.26 MB 10:11/223.09 MB 3:10/182.97 MB 9:12/207.76 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 141 out of 141 Hdfs Read Thread Concurrency Bucket: 0:99.82% 1:0.1751% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:564 - AverageHdfsReadThreadConcurrency: 0.0017513134851138354 - AverageScannerThreadConcurrency: 1.0 - BytesRead: 181872584 - BytesReadDataNodeCache: 0 - BytesReadLocal: 181872584 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 181872584 - DecompressionTime: 5754980808 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 4 - NumDisksAccessed: 12 - NumRowGroups: 141 - NumScannerThreadsStarted: 1 - PeakMemoryUsage: 8478591 - PerReadThreadRawHdfsThroughput: 367347774 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 272272519320 - RowBatchQueuePutWaitTime: 0 - RowsRead: 61962462 - RowsReturned: 61962462 - RowsReturnedRate: 226229 - ScanRangesComplete: 141 - ScannerThreadsInvoluntaryContextSwitches: 43952 - ScannerThreadsTotalWallClockTime: 291024425440 - MaterializeTupleTime(*): 145387281736 - ScannerThreadsSysTime: 1854718000 - ScannerThreadsUserTime: 49249512000 - ScannerThreadsVoluntaryContextSwitches: 29553 - TotalRawHdfsReadTime(*): 495096464 - TotalReadThroughput: 621029 - TotalTime: 273891463560 Instance a9429a2e6e27c0c3:f (host=redacted-host8:22000) Hdfs split stats (:<# splits>/): 5:8/156.15 MB 2:10/211.50 MB 7:13/262.90 MB 9:14/288.51 MB 0:13/321.55 MB 10:10/152.83 MB 4:8/157.08 MB 1:10/152.99 MB 6:14/391.73 MB 11:7/129.74 MB 3:19/380.47 MB 8:12/252.57 MB - AverageThreadTokens: 1.9658119658119657 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 26924636 - PerHostPeakMemUsage: 29367542 - RowsProduced: 32416 - TotalNetworkReceiveTime: 31824 - TotalNetworkSendTime: 4049864 - TotalStorageWaitTime: 97388080368 - TotalThreadsInvoluntaryContextSwitches: 44751 - TotalThreadsTotalWallClockTime: 576963383296 - TotalThreadsSysTime: 2692590000 - TotalThreadsUserTime: 58216150000 - TotalThreadsVoluntaryContextSwitches: 91558 - TotalTime: 295242294056 Fragment Instance Lifecycle Timings - ExecTime: 253186895648 - ExecTreeExecTime: 253122086904 - InactiveTotalTime: 0 - OpenTime: 38545725528 - ExecTreeOpenTime: 32209186224 - PrepareTime: 3509530152 - ExecTreePrepareTime: 1719793760 - TotalTime: 0 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 96 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 34603008 - PeakMemoryUsage: 1869056 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 DataStreamSender (dst_id=14) - BytesSent: 585517 - InactiveTotalTime: 0 - NetworkThroughput(*): 114833373 - OverallThroughput: 27711596 - PeakMemoryUsage: 271296 - RowsReturned: 32416 - SerializeBatchTime: 15794544 - TotalTime: 21128952 - TransmitDataRPCTime: 5098840 - UncompressedRowBatchSize: 940284 CodeGen - CodegenTime: 21102112 - CompileTime: 1198385504 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2021884 - NumFunctions: 121 - NumInstructions: 7493 - OptimizationTime: 5042984216 - PeakMemoryUsage: 3836416 - PrepareTime: 1015565688 - TotalTime: 7379485536 AGGREGATION_NODE (id=7) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 1142409448 - GetResultsTime: 10646592 - HTResizeTime: 3393008 - HashBuckets: 77824 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 14654072 - PinTime: 0 - ReductionFactorEstimate: 142.55089504545032 - ReductionFactorThresholdToExpand: 1.1 - RowsPassedThrough: 0 - RowsReturned: 32416 - RowsReturnedRate: 112 - StreamingTime: 8876636488 - TotalTime: 287050978352 - UnpinTime: 0 HASH_JOIN_NODE (id=6) ExecOption: Probe Side Codegen Enabled - BuildRows: 229 - BuildTime: 5978920 - InactiveTotalTime: 0 - LocalTime: 2641969056 - PeakMemoryUsage: 11157844 - ProbeRows: 1221986 - ProbeRowsPartitioned: 0 - ProbeTime: 163768472 - RowsReturned: 337313 - RowsReturnedRate: 1216 - TotalTime: 277272138704 Hash Join Builder (join_node_id=6) ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 120432 - BuildRowsPartitioned: 229 - GetNewBlockTime: 4789568 - HashBuckets: 496 - HashCollisions: 0 - HashTablesBuildTime: 395416 - InactiveTotalTime: 0 - LargestPartitionPercent: 8 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 1078144 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=13) - BytesReceived: 4099 - ConvertRowBatchTime: 63992 - DeserializeRowBatchTimer: 106295224 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 229 - RowsReturnedRate: 2589326 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 88440 HASH_JOIN_NODE (id=5) ExecOption: Probe Side Codegen Enabled - BuildRows: 251 - BuildTime: 21725104 - InactiveTotalTime: 0 - LocalTime: 898803288 - PeakMemoryUsage: 3167627 - ProbeRows: 4354781 - ProbeRowsPartitioned: 0 - ProbeTime: 508314640 - RowsReturned: 1221986 - RowsReturnedRate: 4449 - TotalTime: 274630081208 Hash Join Builder (join_node_id=5) ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 49640 - BuildRowsPartitioned: 251 - GetNewBlockTime: 21214064 - HashBuckets: 480 - HashCollisions: 0 - HashTablesBuildTime: 171952 - InactiveTotalTime: 0 - LargestPartitionPercent: 7 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 1077888 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=12) - BytesReceived: 2832 - ConvertRowBatchTime: 35272 - DeserializeRowBatchTimer: 25298632 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 251 - RowsReturnedRate: 4656426 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 53904 HASH_JOIN_NODE (id=4) ExecOption: Probe Side Codegen Enabled - BuildRows: 520 - BuildTime: 26652216 - InactiveTotalTime: 0 - LocalTime: 6319150632 - PeakMemoryUsage: 2070272 - ProbeRows: 61742572 - ProbeRowsPartitioned: 0 - ProbeTime: 5472503704 - RowsReturned: 4354781 - RowsReturnedRate: 15908 - TotalTime: 273731224016 Hash Join Builder (join_node_id=4) ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 264712 - BuildRowsPartitioned: 520 - GetNewBlockTime: 25536664 - HashBuckets: 1152 - HashCollisions: 0 - HashTablesBuildTime: 443856 - InactiveTotalTime: 0 - LargestPartitionPercent: 9 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 1088640 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=11) - BytesReceived: 7274 - ConvertRowBatchTime: 126496 - DeserializeRowBatchTimer: 148530144 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 520 - RowsReturnedRate: 3441702 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 151088 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 5:8/156.15 MB 2:10/211.50 MB 7:13/262.90 MB 9:14/288.51 MB 0:13/321.55 MB 10:10/152.83 MB 4:8/157.08 MB 1:10/152.99 MB 6:14/391.73 MB 11:7/129.74 MB 3:19/380.47 MB 8:12/252.57 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 138 out of 138 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:552 - AverageHdfsReadThreadConcurrency: 0.0017699115044247787 - AverageScannerThreadConcurrency: 1.0 - BytesRead: 181196984 - BytesReadDataNodeCache: 0 - BytesReadLocal: 181196984 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 181196984 - DecompressionTime: 4811813480 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 4 - NumDisksAccessed: 12 - NumRowGroups: 138 - NumScannerThreadsStarted: 1 - PeakMemoryUsage: 13244006 - PerReadThreadRawHdfsThroughput: 431167674 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 265004847712 - RowBatchQueuePutWaitTime: 154517072 - RowsRead: 61742572 - RowsReturned: 61742572 - RowsReturnedRate: 230889 - ScanRangesComplete: 138 - ScannerThreadsInvoluntaryContextSwitches: 41969 - ScannerThreadsTotalWallClockTime: 285242147920 - MaterializeTupleTime(*): 142704240808 - ScannerThreadsSysTime: 1723737000 - ScannerThreadsUserTime: 48478630000 - ScannerThreadsVoluntaryContextSwitches: 27923 - TotalRawHdfsReadTime(*): 420247144 - TotalReadThroughput: 619286 - TotalTime: 267411922296 Instance a9429a2e6e27c0c3:e (host=redacted-host2:22000) Hdfs split stats (:<# splits>/): 2:11/223.74 MB 0:12/264.11 MB 10:5/61.57 MB 3:14/303.91 MB 4:14/290.72 MB 6:8/157.20 MB 1:13/291.60 MB 7:9/156.04 MB 9:15/415.36 MB 8:9/255.22 MB 11:7/130.97 MB 5:15/315.72 MB - AverageThreadTokens: 1.9688581314878892 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 26409018 - PerHostPeakMemUsage: 71363971 - RowsProduced: 26520 - TotalNetworkReceiveTime: 26968 - TotalNetworkSendTime: 4429764 - TotalStorageWaitTime: 96281746288 - TotalThreadsInvoluntaryContextSwitches: 43502 - TotalThreadsTotalWallClockTime: 576734437908 - TotalThreadsSysTime: 2794575000 - TotalThreadsUserTime: 58095168000 - TotalThreadsVoluntaryContextSwitches: 94124 - TotalTime: 294818068528 Fragment Instance Lifecycle Timings - ExecTime: 261091151556 - ExecTreeExecTime: 261037857020 - InactiveTotalTime: 0 - OpenTime: 30446960720 - ExecTreeOpenTime: 24251965764 - PrepareTime: 3279816076 - ExecTreePrepareTime: 1520574568 - TotalTime: 0 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 96 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 34603008 - PeakMemoryUsage: 1623296 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 DataStreamSender (dst_id=14) - BytesSent: 479482 - InactiveTotalTime: 0 - NetworkThroughput(*): 103639694 - OverallThroughput: 23753529 - PeakMemoryUsage: 271296 - RowsReturned: 26520 - SerializeBatchTime: 15422908 - TotalTime: 20185716 - TransmitDataRPCTime: 4626432 - UncompressedRowBatchSize: 769264 CodeGen - CodegenTime: 11858516 - CompileTime: 1544703568 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2021884 - NumFunctions: 121 - NumInstructions: 7493 - OptimizationTime: 4580306360 - PeakMemoryUsage: 3836416 - PrepareTime: 513915372 - TotalTime: 6642991812 AGGREGATION_NODE (id=7) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 337298376 - GetResultsTime: 8980136 - HTResizeTime: 120291132 - HashBuckets: 65536 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 14102821 - PinTime: 0 - ReductionFactorEstimate: 519.4123699809865 - ReductionFactorThresholdToExpand: 1.1 - RowsPassedThrough: 0 - RowsReturned: 26520 - RowsReturnedRate: 92 - StreamingTime: 11624735164 - TotalTime: 286810313748 - UnpinTime: 0 HASH_JOIN_NODE (id=6) ExecOption: Probe Side Codegen Enabled - BuildRows: 229 - BuildTime: 26064984 - InactiveTotalTime: 0 - LocalTime: 2651393868 - PeakMemoryUsage: 11036574 - ProbeRows: 1002095 - ProbeRowsPartitioned: 0 - ProbeTime: 133297192 - RowsReturned: 274404 - RowsReturnedRate: 996 - TotalTime: 275432271140 Hash Join Builder (join_node_id=6) ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 111808 - BuildRowsPartitioned: 229 - GetNewBlockTime: 25242516 - HashBuckets: 496 - HashCollisions: 0 - HashTablesBuildTime: 337404 - InactiveTotalTime: 0 - LargestPartitionPercent: 8 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 1078144 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=13) - BytesReceived: 4099 - ConvertRowBatchTime: 53264 - DeserializeRowBatchTimer: 19587456 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 229 - RowsReturnedRate: 3132352 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 73108 HASH_JOIN_NODE (id=5) ExecOption: Probe Side Codegen Enabled - BuildRows: 251 - BuildTime: 3017168 - InactiveTotalTime: 0 - LocalTime: 807575976 - PeakMemoryUsage: 3134305 - ProbeRows: 4368740 - ProbeRowsPartitioned: 0 - ProbeTime: 498144096 - RowsReturned: 1002095 - RowsReturnedRate: 3673 - TotalTime: 272780804164 Hash Join Builder (join_node_id=5) ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 55528 - BuildRowsPartitioned: 251 - GetNewBlockTime: 162476 - HashBuckets: 480 - HashCollisions: 0 - HashTablesBuildTime: 232832 - InactiveTotalTime: 0 - LargestPartitionPercent: 7 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 1077888 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=12) - BytesReceived: 2832 - ConvertRowBatchTime: 56832 - DeserializeRowBatchTimer: 75344 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 251 - RowsReturnedRate: 3346131 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 75012 HASH_JOIN_NODE (id=4) ExecOption: Probe Side Codegen Enabled - BuildRows: 520 - BuildTime: 14154292 - InactiveTotalTime: 0 - LocalTime: 7551084800 - PeakMemoryUsage: 2070272 - ProbeRows: 61980494 - ProbeRowsPartitioned: 0 - ProbeTime: 5543595320 - RowsReturned: 4368740 - RowsReturnedRate: 16063 - TotalTime: 271973153176 Hash Join Builder (join_node_id=4) ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 250648 - BuildRowsPartitioned: 520 - GetNewBlockTime: 13115068 - HashBuckets: 1152 - HashCollisions: 0 - HashTablesBuildTime: 463784 - InactiveTotalTime: 0 - LargestPartitionPercent: 9 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 1088640 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=11) - BytesReceived: 7274 - ConvertRowBatchTime: 113660 - DeserializeRowBatchTimer: 168232 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 520 - RowsReturnedRate: 3758528 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 138352 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 2:11/223.74 MB 0:12/264.11 MB 10:5/61.57 MB 3:14/303.91 MB 4:14/290.72 MB 6:8/157.20 MB 1:13/291.60 MB 7:9/156.04 MB 9:15/415.36 MB 8:9/255.22 MB 11:7/130.97 MB 5:15/315.72 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 132 out of 132 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:528 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 1.0 - BytesRead: 181771354 - BytesReadDataNodeCache: 0 - BytesReadLocal: 181771354 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 181771354 - DecompressionTime: 6881009396 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 4 - NumDisksAccessed: 12 - NumRowGroups: 132 - NumScannerThreadsStarted: 1 - PeakMemoryUsage: 13294659 - PerReadThreadRawHdfsThroughput: 348323498 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 261781868508 - RowBatchQueuePutWaitTime: 1121234912 - RowsRead: 61980494 - RowsReturned: 61980494 - RowsReturnedRate: 234399 - ScanRangesComplete: 132 - ScannerThreadsInvoluntaryContextSwitches: 40507 - ScannerThreadsTotalWallClockTime: 285210519072 - MaterializeTupleTime(*): 143605900100 - ScannerThreadsSysTime: 1762732000 - ScannerThreadsUserTime: 48428637000 - ScannerThreadsVoluntaryContextSwitches: 29833 - TotalRawHdfsReadTime(*): 521846372 - TotalReadThroughput: 627164 - TotalTime: 264421930024 Instance a9429a2e6e27c0c3:12 (host=redacted-host5:22000) Hdfs split stats (:<# splits>/): 9:9/183.22 MB 10:9/155.38 MB 1:13/262.48 MB 6:14/317.38 MB 2:9/183.93 MB 11:8/199.99 MB 3:6/162.73 MB 4:10/211.75 MB 7:11/238.69 MB 0:15/301.75 MB 5:15/259.20 MB 8:15/375.56 MB - AverageThreadTokens: 1.9827288428324699 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 26690328 - PerHostPeakMemUsage: 73846530 - RowsProduced: 23304 - TotalNetworkReceiveTime: 29368 - TotalNetworkSendTime: 4396200 - TotalStorageWaitTime: 90120270000 - TotalThreadsInvoluntaryContextSwitches: 47196 - TotalThreadsTotalWallClockTime: 578906358368 - TotalThreadsSysTime: 2724585000 - TotalThreadsUserTime: 57933192000 - TotalThreadsVoluntaryContextSwitches: 91206 - TotalTime: 292169672288 Fragment Instance Lifecycle Timings - ExecTime: 284920143664 - ExecTreeExecTime: 284878894960 - InactiveTotalTime: 0 - OpenTime: 6992752688 - ExecTreeOpenTime: 2194353704 - PrepareTime: 256696656 - ExecTreePrepareTime: 14806584 - TotalTime: 0 DataStreamSender (dst_id=14) - BytesSent: 421005 - InactiveTotalTime: 0 - NetworkThroughput(*): 101777777 - OverallThroughput: 28938265 - PeakMemoryUsage: 271296 - RowsReturned: 23304 - SerializeBatchTime: 10326672 - TotalTime: 14548384 - TransmitDataRPCTime: 4136512 - UncompressedRowBatchSize: 675976 CodeGen - CodegenTime: 11051216 - CompileTime: 1345424144 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2021884 - NumFunctions: 121 - NumInstructions: 7493 - OptimizationTime: 3435516488 - PeakMemoryUsage: 3836416 - PrepareTime: 101838920 - TotalTime: 4891299496 AGGREGATION_NODE (id=7) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 10083632 - GetResultsTime: 6266312 - HTResizeTime: 53321056 - HashBuckets: 65536 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 13355439 - PinTime: 0 - ReductionFactorEstimate: 530.1398537477148 - ReductionFactorThresholdToExpand: 1.1 - RowsPassedThrough: 0 - RowsReturned: 23304 - RowsReturnedRate: 81 - StreamingTime: 13769325544 - TotalTime: 287087992016 - UnpinTime: 0 HASH_JOIN_NODE (id=6) ExecOption: Probe Side Codegen Enabled - BuildRows: 229 - BuildTime: 7708560 - InactiveTotalTime: 0 - LocalTime: 456203072 - PeakMemoryUsage: 11249190 - ProbeRows: 877189 - ProbeRowsPartitioned: 0 - ProbeTime: 111964800 - RowsReturned: 241127 - RowsReturnedRate: 882 - TotalTime: 273289224136 Hash Join Builder (join_node_id=6) ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 123912 - BuildRowsPartitioned: 229 - GetNewBlockTime: 6934520 - HashBuckets: 496 - HashCollisions: 0 - HashTablesBuildTime: 343840 - InactiveTotalTime: 0 - LargestPartitionPercent: 8 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 1078144 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=13) - BytesReceived: 4099 - ConvertRowBatchTime: 53624 - DeserializeRowBatchTimer: 260912 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 229 - RowsReturnedRate: 3023022 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 75752 HASH_JOIN_NODE (id=5) ExecOption: Probe Side Codegen Enabled - BuildRows: 251 - BuildTime: 19103224 - InactiveTotalTime: 0 - LocalTime: 669332624 - PeakMemoryUsage: 3180178 - ProbeRows: 4337939 - ProbeRowsPartitioned: 0 - ProbeTime: 497909360 - RowsReturned: 877189 - RowsReturnedRate: 3215 - TotalTime: 272832945312 Hash Join Builder (join_node_id=5) ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 78784 - BuildRowsPartitioned: 251 - GetNewBlockTime: 18394712 - HashBuckets: 480 - HashCollisions: 0 - HashTablesBuildTime: 279208 - InactiveTotalTime: 0 - LargestPartitionPercent: 7 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 1077888 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=12) - BytesReceived: 2832 - ConvertRowBatchTime: 57928 - DeserializeRowBatchTimer: 81560 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 251 - RowsReturnedRate: 3133426 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 80104 HASH_JOIN_NODE (id=4) ExecOption: Probe Side Codegen Enabled - BuildRows: 520 - BuildTime: 25707536 - InactiveTotalTime: 0 - LocalTime: 6175293336 - PeakMemoryUsage: 2070272 - ProbeRows: 61648795 - ProbeRowsPartitioned: 0 - ProbeTime: 5452395432 - RowsReturned: 4337939 - RowsReturnedRate: 15938 - TotalTime: 272163532584 Hash Join Builder (join_node_id=4) ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 259440 - BuildRowsPartitioned: 520 - GetNewBlockTime: 20219080 - HashBuckets: 1152 - HashCollisions: 0 - HashTablesBuildTime: 442176 - InactiveTotalTime: 0 - LargestPartitionPercent: 9 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 1088640 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=11) - BytesReceived: 7274 - ConvertRowBatchTime: 115592 - DeserializeRowBatchTimer: 45430104 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 520 - RowsReturnedRate: 3818587 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 136176 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 9:9/183.22 MB 10:9/155.38 MB 1:13/262.48 MB 6:14/317.38 MB 2:9/183.93 MB 11:8/199.99 MB 3:6/162.73 MB 4:10/211.75 MB 7:11/238.69 MB 0:15/301.75 MB 5:15/259.20 MB 8:15/375.56 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 134 out of 134 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:536 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 1.0 - BytesRead: 180787391 - BytesReadDataNodeCache: 0 - BytesReadLocal: 180787391 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 180787391 - DecompressionTime: 6304024528 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 4 - NumDisksAccessed: 12 - NumRowGroups: 134 - NumScannerThreadsStarted: 1 - PeakMemoryUsage: 12434740 - PerReadThreadRawHdfsThroughput: 336547329 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 264380446352 - RowBatchQueuePutWaitTime: 827365792 - RowsRead: 61648795 - RowsReturned: 61648795 - RowsReturnedRate: 231772 - ScanRangesComplete: 134 - ScannerThreadsInvoluntaryContextSwitches: 44954 - ScannerThreadsTotalWallClockTime: 286998324456 - MaterializeTupleTime(*): 149256088504 - ScannerThreadsSysTime: 1733736000 - ScannerThreadsUserTime: 48516624000 - ScannerThreadsVoluntaryContextSwitches: 28691 - TotalRawHdfsReadTime(*): 537182664 - TotalReadThroughput: 624300 - TotalTime: 265988103072 Averaged Fragment F02 split sizes: min: 41.12 KB, max: 41.12 KB, avg: 41.12 KB, stddev: 0 completion times: min:2s019ms max:2s019ms mean: 2s019ms stddev:0.000ns execution rates: min:20.36 KB/sec max:20.36 KB/sec mean:20.36 KB/sec stddev:0.42 B/sec num instances: 1 - AverageThreadTokens: 1.25 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 632001 - PerHostPeakMemUsage: 20750450 - RowsProduced: 520 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 173722232 - TotalStorageWaitTime: 3657536 - TotalThreadsInvoluntaryContextSwitches: 84 - TotalThreadsTotalWallClockTime: 1631001408 - TotalThreadsSysTime: 4999000 - TotalThreadsUserTime: 133979000 - TotalThreadsVoluntaryContextSwitches: 146 - TotalTime: 1868050224 Fragment Instance Lifecycle Timings - ExecTime: 646841688 - ExecTreeExecTime: 355960280 - InactiveTotalTime: 0 - OpenTime: 691639232 - ExecTreeOpenTime: 335008 - PrepareTime: 529480912 - ExecTreePrepareTime: 1593792 - TotalTime: 0 DataStreamSender (dst_id=11) - BytesSent: 58192 - InactiveTotalTime: 0 - NetworkThroughput(*): 185164443 - OverallThroughput: 60618687 - PeakMemoryUsage: 31744 - RowsReturned: 520 - SerializeBatchTime: 573208 - TotalTime: 959968 - TransmitDataRPCTime: 314272 - UncompressedRowBatchSize: 178912 CodeGen - CodegenTime: 72810224 - CompileTime: 428120640 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2021884 - NumFunctions: 42 - NumInstructions: 723 - OptimizationTime: 193372040 - PeakMemoryUsage: 370176 - PrepareTime: 167484552 - TotalTime: 812120816 HDFS_SCAN_NODE (id=3) - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 1.0 - BytesRead: 83074 - BytesReadDataNodeCache: 0 - BytesReadLocal: 83074 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 83074 - DecompressionTime: 48136 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 4 - NumDisksAccessed: 1 - NumRowGroups: 1 - NumScannerThreadsStarted: 1 - PeakMemoryUsage: 589003 - PerReadThreadRawHdfsThroughput: 1493277250 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 346289632 - RowBatchQueuePutWaitTime: 0 - RowsRead: 7200 - RowsReturned: 520 - RowsReturnedRate: 1440 - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 6 - ScannerThreadsTotalWallClockTime: 347884384 - MaterializeTupleTime(*): 129781520 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 13997000 - ScannerThreadsVoluntaryContextSwitches: 55 - TotalRawHdfsReadTime(*): 55632 - TotalReadThroughput: 28070 - TotalTime: 360869112 Fragment F02 Instance a9429a2e6e27c0c3:8 (host=redacted-host4:22000) Hdfs split stats (:<# splits>/): 7:1/41.12 KB - AverageThreadTokens: 1.25 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 632001 - PerHostPeakMemUsage: 20750450 - RowsProduced: 520 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 173722232 - TotalStorageWaitTime: 3657536 - TotalThreadsInvoluntaryContextSwitches: 84 - TotalThreadsTotalWallClockTime: 1631001408 - TotalThreadsSysTime: 4999000 - TotalThreadsUserTime: 133979000 - TotalThreadsVoluntaryContextSwitches: 146 - TotalTime: 1868050224 Fragment Instance Lifecycle Timings - ExecTime: 646841688 - ExecTreeExecTime: 355960280 - InactiveTotalTime: 0 - OpenTime: 691639232 - ExecTreeOpenTime: 335008 - PrepareTime: 529480912 - ExecTreePrepareTime: 1593792 - TotalTime: 0 DataStreamSender (dst_id=11) - BytesSent: 58192 - InactiveTotalTime: 0 - NetworkThroughput(*): 185164443 - OverallThroughput: 60618687 - PeakMemoryUsage: 31744 - RowsReturned: 520 - SerializeBatchTime: 573208 - TotalTime: 959968 - TransmitDataRPCTime: 314272 - UncompressedRowBatchSize: 178912 CodeGen - CodegenTime: 72810224 - CompileTime: 428120640 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2021884 - NumFunctions: 42 - NumInstructions: 723 - OptimizationTime: 193372040 - PeakMemoryUsage: 370176 - PrepareTime: 167484552 - TotalTime: 812120816 HDFS_SCAN_NODE (id=3) Hdfs split stats (:<# splits>/): 7:1/41.12 KB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:4 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 1.0 - BytesRead: 83074 - BytesReadDataNodeCache: 0 - BytesReadLocal: 83074 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 83074 - DecompressionTime: 48136 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 4 - NumDisksAccessed: 1 - NumRowGroups: 1 - NumScannerThreadsStarted: 1 - PeakMemoryUsage: 589003 - PerReadThreadRawHdfsThroughput: 1493277250 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 346289632 - RowBatchQueuePutWaitTime: 0 - RowsRead: 7200 - RowsReturned: 520 - RowsReturnedRate: 1440 - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 6 - ScannerThreadsTotalWallClockTime: 347884384 - MaterializeTupleTime(*): 129781520 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 13997000 - ScannerThreadsVoluntaryContextSwitches: 55 - TotalRawHdfsReadTime(*): 55632 - TotalReadThroughput: 28070 - TotalTime: 360869112 Averaged Fragment F03 split sizes: min: 2.15 MB, max: 2.15 MB, avg: 2.15 MB, stddev: 0 completion times: min:2s885ms max:2s885ms mean: 2s885ms stddev:0.000ns execution rates: min:762.86 KB/sec max:762.86 KB/sec mean:762.86 KB/sec stddev:0.98 B/sec num instances: 1 - AverageThreadTokens: 1.1666666666666667 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 3270928 - PerHostPeakMemUsage: 23951185 - RowsProduced: 251 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 7372 - TotalStorageWaitTime: 83256056 - TotalThreadsInvoluntaryContextSwitches: 86 - TotalThreadsTotalWallClockTime: 2020968412 - TotalThreadsSysTime: 6998000 - TotalThreadsUserTime: 220966000 - TotalThreadsVoluntaryContextSwitches: 232 - TotalTime: 2766677616 Fragment Instance Lifecycle Timings - ExecTime: 637374380 - ExecTreeExecTime: 341768936 - InactiveTotalTime: 0 - OpenTime: 1013096396 - ExecTreeOpenTime: 170552 - PrepareTime: 1116090840 - ExecTreePrepareTime: 2900888 - TotalTime: 0 DataStreamSender (dst_id=12) - BytesSent: 22656 - InactiveTotalTime: 0 - NetworkThroughput(*): 113641379 - OverallThroughput: 53621637 - PeakMemoryUsage: 61632 - RowsReturned: 251 - SerializeBatchTime: 145704 - TotalTime: 422516 - TransmitDataRPCTime: 199364 - UncompressedRowBatchSize: 42200 CodeGen - CodegenTime: 173853124 - CompileTime: 25002564 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2021884 - NumFunctions: 42 - NumInstructions: 794 - OptimizationTime: 708430608 - PeakMemoryUsage: 406528 - PrepareTime: 906887420 - TotalTime: 1720306208 HDFS_SCAN_NODE (id=1) - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 1.0 - BytesRead: 480185 - BytesReadDataNodeCache: 0 - BytesReadLocal: 480185 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 480185 - DecompressionTime: 46158836 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 3 - NumDisksAccessed: 1 - NumRowGroups: 1 - NumScannerThreadsStarted: 1 - PeakMemoryUsage: 3197432 - PerReadThreadRawHdfsThroughput: 334475451 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 332943088 - RowBatchQueuePutWaitTime: 0 - RowsRead: 73049 - RowsReturned: 251 - RowsReturnedRate: 716 - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 28 - ScannerThreadsTotalWallClockTime: 373013164 - MaterializeTupleTime(*): 56888180 - ScannerThreadsSysTime: 999000 - ScannerThreadsUserTime: 67989000 - ScannerThreadsVoluntaryContextSwitches: 62 - TotalRawHdfsReadTime(*): 1435636 - TotalReadThroughput: 51200 - TotalTime: 350355212 Fragment F03 Instance a9429a2e6e27c0c3:9 (host=redacted-host6:22000) Hdfs split stats (:<# splits>/): 1:1/2.15 MB - AverageThreadTokens: 1.1666666666666667 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 3270928 - PerHostPeakMemUsage: 23951185 - RowsProduced: 251 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 7372 - TotalStorageWaitTime: 83256056 - TotalThreadsInvoluntaryContextSwitches: 86 - TotalThreadsTotalWallClockTime: 2020968412 - TotalThreadsSysTime: 6998000 - TotalThreadsUserTime: 220966000 - TotalThreadsVoluntaryContextSwitches: 232 - TotalTime: 2766677616 Fragment Instance Lifecycle Timings - ExecTime: 637374380 - ExecTreeExecTime: 341768936 - InactiveTotalTime: 0 - OpenTime: 1013096396 - ExecTreeOpenTime: 170552 - PrepareTime: 1116090840 - ExecTreePrepareTime: 2900888 - TotalTime: 0 DataStreamSender (dst_id=12) - BytesSent: 22656 - InactiveTotalTime: 0 - NetworkThroughput(*): 113641379 - OverallThroughput: 53621637 - PeakMemoryUsage: 61632 - RowsReturned: 251 - SerializeBatchTime: 145704 - TotalTime: 422516 - TransmitDataRPCTime: 199364 - UncompressedRowBatchSize: 42200 CodeGen - CodegenTime: 173853124 - CompileTime: 25002564 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2021884 - NumFunctions: 42 - NumInstructions: 794 - OptimizationTime: 708430608 - PeakMemoryUsage: 406528 - PrepareTime: 906887420 - TotalTime: 1720306208 HDFS_SCAN_NODE (id=1) Hdfs split stats (:<# splits>/): 1:1/2.15 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:3 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 1.0 - BytesRead: 480185 - BytesReadDataNodeCache: 0 - BytesReadLocal: 480185 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 480185 - DecompressionTime: 46158836 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 3 - NumDisksAccessed: 1 - NumRowGroups: 1 - NumScannerThreadsStarted: 1 - PeakMemoryUsage: 3197432 - PerReadThreadRawHdfsThroughput: 334475451 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 332943088 - RowBatchQueuePutWaitTime: 0 - RowsRead: 73049 - RowsReturned: 251 - RowsReturnedRate: 716 - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 28 - ScannerThreadsTotalWallClockTime: 373013164 - MaterializeTupleTime(*): 56888180 - ScannerThreadsSysTime: 999000 - ScannerThreadsUserTime: 67989000 - ScannerThreadsVoluntaryContextSwitches: 62 - TotalRawHdfsReadTime(*): 1435636 - TotalReadThroughput: 51200 - TotalTime: 350355212 Averaged Fragment F04 split sizes: min: 71.36 KB, max: 71.36 KB, avg: 71.36 KB, stddev: 0 completion times: min:1s865ms max:1s865ms mean: 1s865ms stddev:0.000ns execution rates: min:38.25 KB/sec max:38.25 KB/sec mean:38.25 KB/sec stddev:0.68 B/sec num instances: 1 - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 310208 - PerHostPeakMemUsage: 20785473 - RowsProduced: 229 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 336206376 - TotalStorageWaitTime: 4747432 - TotalThreadsInvoluntaryContextSwitches: 40 - TotalThreadsTotalWallClockTime: 1182994208 - TotalThreadsSysTime: 5999000 - TotalThreadsUserTime: 137979000 - TotalThreadsVoluntaryContextSwitches: 116 - TotalTime: 1791202992 Fragment Instance Lifecycle Timings - ExecTime: 385100360 - ExecTreeExecTime: 27183160 - InactiveTotalTime: 0 - OpenTime: 822721152 - ExecTreeOpenTime: 259400 - PrepareTime: 583277208 - ExecTreePrepareTime: 252984 - TotalTime: 0 DataStreamSender (dst_id=13) - BytesSent: 32792 - InactiveTotalTime: 0 - NetworkThroughput(*): 99251797 - OverallThroughput: 44664066 - PeakMemoryUsage: 41920 - RowsReturned: 229 - SerializeBatchTime: 277744 - TotalTime: 734192 - TransmitDataRPCTime: 330392 - UncompressedRowBatchSize: 81288 CodeGen - CodegenTime: 4099224 - CompileTime: 36617888 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2021884 - NumFunctions: 33 - NumInstructions: 508 - OptimizationTime: 486493552 - PeakMemoryUsage: 260096 - PrepareTime: 340865880 - TotalTime: 874040688 HDFS_SCAN_NODE (id=2) - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.0 - BytesRead: 78030 - BytesReadDataNodeCache: 0 - BytesReadLocal: 78030 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 78030 - DecompressionTime: 20376 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDisksAccessed: 1 - NumRowGroups: 1 - NumScannerThreadsStarted: 1 - PeakMemoryUsage: 143360 - PerReadThreadRawHdfsThroughput: 1722668668 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 21453464 - RowBatchQueuePutWaitTime: 0 - RowsRead: 804 - RowsReturned: 229 - RowsReturnedRate: 8162 - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 6 - ScannerThreadsTotalWallClockTime: 22915720 - MaterializeTupleTime(*): 1165736 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 3999000 - ScannerThreadsVoluntaryContextSwitches: 7 - TotalRawHdfsReadTime(*): 45296 - TotalReadThroughput: 0 - TotalTime: 28054272 Fragment F04 Instance a9429a2e6e27c0c3:a (host=redacted-host4:22000) Hdfs split stats (:<# splits>/): 9:1/71.36 KB - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 310208 - PerHostPeakMemUsage: 20785473 - RowsProduced: 229 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 336206376 - TotalStorageWaitTime: 4747432 - TotalThreadsInvoluntaryContextSwitches: 40 - TotalThreadsTotalWallClockTime: 1182994208 - TotalThreadsSysTime: 5999000 - TotalThreadsUserTime: 137979000 - TotalThreadsVoluntaryContextSwitches: 116 - TotalTime: 1791202992 Fragment Instance Lifecycle Timings - ExecTime: 385100360 - ExecTreeExecTime: 27183160 - InactiveTotalTime: 0 - OpenTime: 822721152 - ExecTreeOpenTime: 259400 - PrepareTime: 583277208 - ExecTreePrepareTime: 252984 - TotalTime: 0 DataStreamSender (dst_id=13) - BytesSent: 32792 - InactiveTotalTime: 0 - NetworkThroughput(*): 99251797 - OverallThroughput: 44664066 - PeakMemoryUsage: 41920 - RowsReturned: 229 - SerializeBatchTime: 277744 - TotalTime: 734192 - TransmitDataRPCTime: 330392 - UncompressedRowBatchSize: 81288 CodeGen - CodegenTime: 4099224 - CompileTime: 36617888 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2021884 - NumFunctions: 33 - NumInstructions: 508 - OptimizationTime: 486493552 - PeakMemoryUsage: 260096 - PrepareTime: 340865880 - TotalTime: 874040688 HDFS_SCAN_NODE (id=2) Hdfs split stats (:<# splits>/): 9:1/71.36 KB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:2 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.0 - BytesRead: 78030 - BytesReadDataNodeCache: 0 - BytesReadLocal: 78030 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 78030 - DecompressionTime: 20376 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDisksAccessed: 1 - NumRowGroups: 1 - NumScannerThreadsStarted: 1 - PeakMemoryUsage: 143360 - PerReadThreadRawHdfsThroughput: 1722668668 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 21453464 - RowBatchQueuePutWaitTime: 0 - RowsRead: 804 - RowsReturned: 229 - RowsReturnedRate: 8162 - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 6 - ScannerThreadsTotalWallClockTime: 22915720 - MaterializeTupleTime(*): 1165736 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 3999000 - ScannerThreadsVoluntaryContextSwitches: 7 - TotalRawHdfsReadTime(*): 45296 - TotalReadThroughput: 0 - TotalTime: 28054272