Query (id=3f4fc7887f663030:b56d0eb600000000) DEBUG MODE WARNING: Query profile created while running a DEBUG build of Impala. Use RELEASE builds to measure query performance. Summary Session ID: 9450f4be7fccb8c:8552edd21ee189ac Session Type: HIVESERVER2 HiveServer2 Protocol Version: V6 Start Time: 2017-05-31 22:41:53.431000000 End Time: 2017-05-31 22:50:53.575766000 Query Type: QUERY Query State: FINISHED Query Status: OK Impala Version: impalad version 2.8.0-cdh5.11.0 DEBUG (build e09660de6b503a15f07e84b99b63e8e745854c34) User: redacted Connected User: redacted Delegated User: Network Address: redacted Default Db: tpcds_300_decimal_parquet Sql Statement: /* Mem: 133 MB. Coordinator: redacted-host7. */ select c_last_name, c_first_name, c_salutation, c_preferred_cust_flag, ss_ticket_number, cnt from (select ss_ticket_number, ss_customer_sk, count(*) cnt from store_sales, date_dim, store, household_demographics where store_sales.ss_sold_date_sk = date_dim.d_date_sk and store_sales.ss_store_sk = store.s_store_sk and store_sales.ss_hdemo_sk = household_demographics.hd_demo_sk and (date_dim.d_dom between 1 and 3 or date_dim.d_dom between 25 and 28) and (household_demographics.hd_buy_potential = '>10000' or household_demographics.hd_buy_potential = 'unknown') and household_demographics.hd_vehicle_count > 0 and (case when household_demographics.hd_vehicle_count > 0 then household_demographics.hd_dep_count / household_demographics.hd_vehicle_count else null end) > 1.2 and date_dim.d_year in (1998, 1998 + 1, 1998 + 2) and store.s_county in ('Saginaw County', 'Sumner County', 'Appanoose County', 'Daviess County', 'Fairfield County', 'Raleigh County', 'Ziebach County', 'Williamson County') and ss_sold_date_sk between 2450816 and 2451910 -- partition key filter group by ss_ticket_number, ss_customer_sk ) dn, customer where ss_customer_sk = c_customer_sk and cnt between 15 and 20 order by c_last_name, c_first_name, c_salutation, c_preferred_cust_flag desc limit 100000; Coordinator: redacted-host7:22000 Query Options (non default): ABORT_ON_ERROR=1,MEM_LIMIT=139460608,RUNTIME_FILTER_MODE=0 Plan: ---------------- Estimated Per-Host Requirements: Memory=388.54MB VCores=4 PLAN-ROOT SINK | 18:MERGING-EXCHANGE [UNPARTITIONED] | order by: c_last_name ASC, c_first_name ASC, c_salutation ASC, c_preferred_cust_flag DESC | limit: 100000 | hosts=8 per-host-mem=unavailable | tuple-ids=7 row-size=96B cardinality=29939 | 10:TOP-N [LIMIT=100000] | order by: c_last_name ASC, c_first_name ASC, c_salutation ASC, c_preferred_cust_flag DESC | hosts=8 per-host-mem=2.73MB | tuple-ids=7 row-size=96B cardinality=29939 | 09:HASH JOIN [INNER JOIN, PARTITIONED] | hash predicates: c_customer_sk = ss_customer_sk | hosts=8 per-host-mem=16.28MB | tuple-ids=6,4 row-size=112B cardinality=29939 | |--17:EXCHANGE [HASH(ss_customer_sk)] | | hosts=8 per-host-mem=0B | | tuple-ids=4 row-size=24B cardinality=5173436 | | | 15:AGGREGATE [FINALIZE] | | output: count:merge(*) | | group by: ss_ticket_number, ss_customer_sk | | having: count(*) <= 20, count(*) >= 15 | | hosts=8 per-host-mem=130.25MB | | tuple-ids=4 row-size=24B cardinality=5173436 | | | 14:EXCHANGE [HASH(ss_ticket_number,ss_customer_sk)] | | hosts=8 per-host-mem=0B | | tuple-ids=4 row-size=24B cardinality=5173436 | | | 07:AGGREGATE [STREAMING] | | output: count(*) | | group by: ss_ticket_number, ss_customer_sk | | hosts=8 per-host-mem=130.25MB | | tuple-ids=4 row-size=24B cardinality=5173436 | | | 06:HASH JOIN [INNER JOIN, BROADCAST] | | hash predicates: store_sales.ss_store_sk = store.s_store_sk | | hosts=8 per-host-mem=16.63KB | | tuple-ids=0,3,1,2 row-size=134B cardinality=5173436 | | | |--13:EXCHANGE [BROADCAST] | | | hosts=1 per-host-mem=0B | | | tuple-ids=2 row-size=39B cardinality=402 | | | | | 02:SCAN HDFS [tpcds_300_decimal_parquet.store, RANDOM] | | partitions=1/1 files=1 size=71.36KB | | predicates: store.s_county IN ('Saginaw County', 'Sumner County', 'Appanoose County', 'Daviess County', 'Fairfield County', 'Raleigh County', 'Ziebach County', 'Williamson County') | | table stats: 804 rows total | | column stats: all | | hosts=1 per-host-mem=32.00MB | | tuple-ids=2 row-size=39B cardinality=402 | | | 05:HASH JOIN [INNER JOIN, BROADCAST] | | hash predicates: store_sales.ss_sold_date_sk = date_dim.d_date_sk | | hosts=8 per-host-mem=6.08KB | | tuple-ids=0,3,1 row-size=96B cardinality=5173436 | | | |--12:EXCHANGE [BROADCAST] | | | hosts=1 per-host-mem=0B | | | tuple-ids=1 row-size=16B cardinality=354 | | | | | 01:SCAN HDFS [tpcds_300_decimal_parquet.date_dim, RANDOM] | | partitions=1/1 files=1 size=2.15MB | | predicates: date_dim.d_year IN (1998, 1999, 2000), tpcds_300_decimal_parquet.date_dim.d_date_sk <= 2451910, tpcds_300_decimal_parquet.date_dim.d_date_sk >= 2450816, (date_dim.d_dom >= 1 AND date_dim.d_dom <= 3 OR date_dim.d_dom >= 25 AND date_dim.d_dom <= 28) | | table stats: 73049 rows total | | column stats: all | | hosts=1 per-host-mem=48.00MB | | tuple-ids=1 row-size=16B cardinality=354 | | | 04:HASH JOIN [INNER JOIN, BROADCAST] | | hash predicates: store_sales.ss_hdemo_sk = household_demographics.hd_demo_sk | | hosts=8 per-host-mem=16.89KB | | tuple-ids=0,3 row-size=80B cardinality=27319040 | | | |--11:EXCHANGE [BROADCAST] | | | hosts=1 per-host-mem=0B | | | tuple-ids=3 row-size=40B cardinality=398 | | | | | 03:SCAN HDFS [tpcds_300_decimal_parquet.household_demographics, RANDOM] | | partitions=1/1 files=1 size=41.12KB | | predicates: household_demographics.hd_vehicle_count > 0, (CASE WHEN household_demographics.hd_vehicle_count > 0 THEN household_demographics.hd_dep_count / household_demographics.hd_vehicle_count ELSE NULL END) > 1.2, (household_demographics.hd_buy_potential = '>10000' OR household_demographics.hd_buy_potential = 'unknown') | | table stats: 7200 rows total | | column stats: all | | hosts=1 per-host-mem=64.00MB | | tuple-ids=3 row-size=40B cardinality=398 | | | 00:SCAN HDFS [tpcds_300_decimal_parquet.store_sales, RANDOM] | partitions=1093/1824 files=1093 size=22.33GB | table stats: 864001869 rows total | column stats: all | hosts=8 per-host-mem=128.00MB | tuple-ids=0 row-size=40B cardinality=494213786 | 16:EXCHANGE [HASH(c_customer_sk)] | hosts=8 per-host-mem=0B | tuple-ids=6 row-size=88B cardinality=5000000 | 08:SCAN HDFS [tpcds_300_decimal_parquet.customer, RANDOM] partitions=1/1 files=8 size=266.45MB table stats: 5000000 rows total column stats: all hosts=8 per-host-mem=240.00MB tuple-ids=6 row-size=88B cardinality=5000000 ---------------- Estimated Per-Host Mem: 407415701 Estimated Per-Host VCores: 4 Request Pool: redacted Admission result: Admitted immediately ExecSummary: Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail ---------------------------------------------------------------------------------------------------------------------------------- 18:MERGING-EXCHANGE 1 55.261ms 55.261ms 18.98K 29.94K 0 -1.00 B UNPARTITIONED 10:TOP-N 7 347.638ms 523.890ms 18.98K 29.94K 8.58 MB 2.73 MB 09:HASH JOIN 7 425.848ms 1s515ms 18.98K 29.94K 1.67 MB 16.28 MB INNER JOIN, PARTITIONED |--17:EXCHANGE 7 2.603ms 13.771ms 18.96K 5.17M 0 0 HASH(ss_customer_sk) | 15:AGGREGATE 8 759.970ms 1s344ms 18.96K 5.17M 3.10 MB 130.25 MB FINALIZE | 14:EXCHANGE 8 15.812ms 33.342ms 209.92K 5.17M 0 0 HASH(ss_ticket_number,ss_cu... | 07:AGGREGATE 8 27s876ms 31s716ms 209.92K 5.17M 14.80 MB 130.25 MB STREAMING | 06:HASH JOIN 8 1s008ms 2s130ms 2.18M 5.17M 10.86 MB 16.63 KB INNER JOIN, BROADCAST | |--13:EXCHANGE 8 74.429us 80.456us 229 402 0 0 BROADCAST | | 02:SCAN HDFS 1 17s154ms 17s154ms 229 402 140.00 KB 32.00 MB tpcds_300_decimal_parquet.s... | 05:HASH JOIN 8 809.395ms 1s032ms 7.94M 5.17M 3.07 MB 6.08 KB INNER JOIN, BROADCAST | |--12:EXCHANGE 8 66.851us 70.344us 251 354 0 0 BROADCAST | | 01:SCAN HDFS 1 4s113ms 4s113ms 251 354 3.05 MB 48.00 MB tpcds_300_decimal_parquet.d... | 04:HASH JOIN 8 6s281ms 7s314ms 34.84M 27.32M 1.97 MB 16.89 KB INNER JOIN, BROADCAST | |--11:EXCHANGE 8 119.950us 125.616us 520 398 0 0 BROADCAST | | 03:SCAN HDFS 1 9s839ms 9s839ms 520 398 575.20 KB 64.00 MB tpcds_300_decimal_parquet.h... | 00:SCAN HDFS 8 6m33s 7m18s 494.21M 494.21M 13.90 MB 128.00 MB tpcds_300_decimal_parquet.s... 16:EXCHANGE 7 677.875ms 951.947ms 5.01M 5.00M 0 0 HASH(c_customer_sk) 08:SCAN HDFS 7 2s330ms 8s217ms 5.00M 5.00M 23.12 MB 240.00 MB tpcds_300_decimal_parquet.c... - ComputeScanRangeAssignmentTimer: 360880848 - InactiveTotalTime: 0 - TotalTime: 0 Planner Timeline Analysis finished: 391427737 Equivalence classes computed: 391954985 Single node plan created: 398065906 Distributed plan created: 398622003 Lineage info computed: 398840810 Planning finished: 405584592 Query Timeline Query submitted: 58421744 Planning finished: 1150564592 Submit for admission: 1955265104 Completed admission: 2138312632 Ready to start 34 fragment instances: 2597243816 All 34 fragment instances started: 7645318680 Rows available: 536029635632 First row fetched: 536257880472 Unregister query: 540144650944 ImpalaServer - ClientFetchWaitTimer: 3374311536 - InactiveTotalTime: 0 - RowMaterializationTimer: 740570288 - TotalTime: 0 Execution Profile 3f4fc7887f663030:b56d0eb600000000 Fragment instance start latencies: Count: 34, 25th %-ile: 41ms, 50th %-ile: 95ms, 75th %-ile: 245ms, 90th %-ile: 408ms, 95th %-ile: 409ms, 99.9th %-ile: 1s470ms Per Node Peak Memory Usage: redacted-host8:22000(30.18 MB) redacted-host4:22000(72.03 MB) redacted-host1:22000(70.88 MB) redacted-host2:22000(71.61 MB) redacted-host5:22000(72.41 MB) redacted-host6:22000(72.58 MB) redacted-host3:22000(72.66 MB) redacted-host7:22000(71.00 MB) - FiltersReceived: 0 - FinalizationTimer: 0 - InactiveTotalTime: 0 - TotalTime: 534229068696 Coordinator Fragment F07 Instance 3f4fc7887f663030:b56d0eb600000000 (host=redacted-host7:22000) - AverageThreadTokens: 0.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 1999447 - PerHostPeakMemUsage: 74453900 - RowsProduced: 18985 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 93 - TotalThreadsTotalWallClockTime: 533776968360 - TotalThreadsSysTime: 6999000 - TotalThreadsUserTime: 258960000 - TotalThreadsVoluntaryContextSwitches: 175 - TotalTime: 534165610736 Fragment Instance Lifecycle Timings - ExecTime: 3254909408 - ExecTreeExecTime: 55201392 - InactiveTotalTime: 0 - OpenTime: 530534651120 - ExecTreeOpenTime: 529748345832 - PrepareTime: 375931784 - ExecTreePrepareTime: 170832 - TotalTime: 0 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 96 - BlocksRecycled: 20 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 34603008 - PeakMemoryUsage: 2163968 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 PLAN_ROOT_SINK - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - TotalTime: 0 CodeGen - CodegenTime: 2352392 - CompileTime: 65510560 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2021884 - NumFunctions: 31 - NumInstructions: 755 - OptimizationTime: 648167624 - PeakMemoryUsage: 386560 - PrepareTime: 237455376 - TotalTime: 980590072 EXCHANGE_NODE (id=18) ExecOption: Codegen Enabled - BytesReceived: 985673 - ConvertRowBatchTime: 0 - DeserializeRowBatchTimer: 64166600 - FirstBatchArrivalWaitTime: 529748200656 - InactiveTotalTime: 529748206016 - MergeGetNext: 55006376 - MergeGetNextBatch: 23935528 - PeakMemoryUsage: 0 - RowsReturned: 18985 - RowsReturnedRate: 35 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 529803467408 Averaged Fragment F06 split sizes: min: 0, max: 0, avg: 0, stddev: 0 completion times: min:8m50s max:8m50s mean: 8m50s stddev:69.829ms execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec num instances: 7 - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 21828901 - PerHostPeakMemUsage: 75376687 - RowsProduced: 2712 - TotalNetworkReceiveTime: 523573503528 - TotalNetworkSendTime: 73754164 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 750 - TotalThreadsTotalWallClockTime: 529193774832 - TotalThreadsSysTime: 51706571 - TotalThreadsUserTime: 1185534142 - TotalThreadsVoluntaryContextSwitches: 2678 - TotalTime: 530519286552 Fragment Instance Lifecycle Timings - ExecTime: 122915500 - ExecTreeExecTime: 2361906 - InactiveTotalTime: 0 - OpenTime: 529113318937 - ExecTreeOpenTime: 524517964140 - PrepareTime: 1269025503 - ExecTreePrepareTime: 100850461 - TotalTime: 0 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 96 - BlocksRecycled: 20 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 34603008 - PeakMemoryUsage: 1934592 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 DataStreamSender (dst_id=18) - BytesSent: 140810 - InactiveTotalTime: 0 - NetworkThroughput(*): 175598158 - OverallThroughput: 10815523 - PeakMemoryUsage: 1616 - RowsReturned: 2712 - SerializeBatchTime: 38100305 - TotalTime: 40526336 - TransmitDataRPCTime: 2380272 - UncompressedRowBatchSize: 273060 CodeGen - CodegenTime: 44419939 - CompileTime: 850963970 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2021884 - NumFunctions: 134 - NumInstructions: 4382 - OptimizationTime: 3621748205 - PeakMemoryUsage: 2243584 - PrepareTime: 602896317 - TotalTime: 5132033729 SORT_NODE (id=10) - InactiveTotalTime: 0 - InsertBatchTime: 39375208 - PeakMemoryUsage: 8987812 - RowsReturned: 2712 - RowsReturnedRate: 5 - TotalTime: 524621161291 HASH_JOIN_NODE (id=9) - BuildRows: 2708 - BuildTime: 33759905 - InactiveTotalTime: 0 - LocalTime: 425848561 - PeakMemoryUsage: 1591159 - ProbeRows: 715373 - ProbeRowsPartitioned: 0 - ProbeTime: 153982776 - RowsReturned: 2712 - RowsReturnedRate: 5 - TotalTime: 524289332855 Hash Join Builder (join_node_id=9) - BuildRowsPartitionTime: 4624609 - BuildRowsPartitioned: 2708 - GetNewBlockTime: 11980705 - HashBuckets: 5924 - HashCollisions: 0 - HashTablesBuildTime: 16844736 - InactiveTotalTime: 0 - LargestPartitionPercent: 6 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 1464594 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=17) - BytesReceived: 45578 - ConvertRowBatchTime: 2433344 - DeserializeRowBatchTimer: 4758602 - FirstBatchArrivalWaitTime: 493927632184 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 2708 - RowsReturnedRate: 5 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 494988368872 EXCHANGE_NODE (id=16) - BytesReceived: 36215801 - ConvertRowBatchTime: 239304690 - DeserializeRowBatchTimer: 5128838738 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 715373 - RowsReturnedRate: 24774 - SendersBlockedTimer: 483926222076 - SendersBlockedTotalTimer(*): 2350367804281 - TotalTime: 28875115422 Fragment F06 Instance 3f4fc7887f663030:1f (host=redacted-host3:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 21943020 - PerHostPeakMemUsage: 76194127 - RowsProduced: 2713 - TotalNetworkReceiveTime: 526655744312 - TotalNetworkSendTime: 178622448 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 505 - TotalThreadsTotalWallClockTime: 530169920248 - TotalThreadsSysTime: 33995000 - TotalThreadsUserTime: 1104833000 - TotalThreadsVoluntaryContextSwitches: 2551 - TotalTime: 530699194544 Fragment Instance Lifecycle Timings - ExecTime: 192273288 - ExecTreeExecTime: 8016272 - InactiveTotalTime: 0 - OpenTime: 529983297216 - ExecTreeOpenTime: 527575477520 - PrepareTime: 523511880 - ExecTreePrepareTime: 676376 - TotalTime: 0 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 96 - BlocksRecycled: 22 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 34603008 - PeakMemoryUsage: 2163968 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 DataStreamSender (dst_id=18) - BytesSent: 140144 - InactiveTotalTime: 0 - NetworkThroughput(*): 255461253 - OverallThroughput: 26352248 - PeakMemoryUsage: 1616 - RowsReturned: 2713 - SerializeBatchTime: 4726384 - TotalTime: 5318104 - TransmitDataRPCTime: 548592 - UncompressedRowBatchSize: 272943 CodeGen - CodegenTime: 56148024 - CompileTime: 433451664 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2021884 - NumFunctions: 134 - NumInstructions: 4382 - OptimizationTime: 1896724368 - PeakMemoryUsage: 2243584 - PrepareTime: 300058784 - TotalTime: 2707616504 SORT_NODE (id=10) ExecOption: Codegen Enabled - InactiveTotalTime: 0 - InsertBatchTime: 44500168 - PeakMemoryUsage: 8984077 - RowsReturned: 2713 - RowsReturnedRate: 5 - TotalTime: 527584157128 HASH_JOIN_NODE (id=9) ExecOption: Probe Side Codegen Enabled - BuildRows: 2710 - BuildTime: 5096832 - InactiveTotalTime: 0 - LocalTime: 220948488 - PeakMemoryUsage: 1688783 - ProbeRows: 715170 - ProbeRowsPartitioned: 0 - ProbeTime: 151828368 - RowsReturned: 2713 - RowsReturnedRate: 5 - TotalTime: 527079431320 Hash Join Builder (join_node_id=9) ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 2622568 - BuildRowsPartitioned: 2710 - GetNewBlockTime: 1173464 - HashBuckets: 5888 - HashCollisions: 0 - HashTablesBuildTime: 1074000 - InactiveTotalTime: 0 - LargestPartitionPercent: 7 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 1557632 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=17) - BytesReceived: 45619 - ConvertRowBatchTime: 581440 - DeserializeRowBatchTimer: 604880 - FirstBatchArrivalWaitTime: 496989163368 - InactiveTotalTime: 498055003680 - PeakMemoryUsage: 0 - RowsReturned: 2710 - RowsReturnedRate: 5 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 498055773560 EXCHANGE_NODE (id=16) - BytesReceived: 36197147 - ConvertRowBatchTime: 177719144 - DeserializeRowBatchTimer: 3240726664 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 28359076568 - PeakMemoryUsage: 0 - RowsReturned: 715170 - RowsReturnedRate: 24829 - SendersBlockedTimer: 483898698512 - SendersBlockedTotalTimer(*): 2419426331024 - TotalTime: 28802709272 Instance 3f4fc7887f663030:1d (host=redacted-host2:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 21856089 - PerHostPeakMemUsage: 75091825 - RowsProduced: 2734 - TotalNetworkReceiveTime: 518812444316 - TotalNetworkSendTime: 74540128 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 1014 - TotalThreadsTotalWallClockTime: 528057888304 - TotalThreadsSysTime: 62991000 - TotalThreadsUserTime: 1174821000 - TotalThreadsVoluntaryContextSwitches: 2909 - TotalTime: 530628280528 Fragment Instance Lifecycle Timings - ExecTime: 192324564 - ExecTreeExecTime: 2996776 - InactiveTotalTime: 0 - OpenTime: 527879517060 - ExecTreeOpenTime: 519705943836 - PrepareTime: 2556321744 - ExecTreePrepareTime: 6453448 - TotalTime: 0 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 96 - BlocksRecycled: 21 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 34603008 - PeakMemoryUsage: 1869056 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 DataStreamSender (dst_id=18) - BytesSent: 141799 - InactiveTotalTime: 0 - NetworkThroughput(*): 33969267 - OverallThroughput: 1211550 - PeakMemoryUsage: 1616 - RowsReturned: 2734 - SerializeBatchTime: 112833432 - TotalTime: 117039288 - TransmitDataRPCTime: 4174332 - UncompressedRowBatchSize: 275082 CodeGen - CodegenTime: 57878916 - CompileTime: 1129173916 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2021884 - NumFunctions: 134 - NumInstructions: 4382 - OptimizationTime: 6920212972 - PeakMemoryUsage: 2243584 - PrepareTime: 884000896 - TotalTime: 8991573668 SORT_NODE (id=10) ExecOption: Codegen Enabled - InactiveTotalTime: 0 - InsertBatchTime: 35902456 - PeakMemoryUsage: 8999479 - RowsReturned: 2734 - RowsReturnedRate: 5 - TotalTime: 519715381336 HASH_JOIN_NODE (id=9) ExecOption: Probe Side Codegen Enabled - BuildRows: 2727 - BuildTime: 3044448 - InactiveTotalTime: 0 - LocalTime: 228514304 - PeakMemoryUsage: 1622331 - ProbeRows: 715483 - ProbeRowsPartitioned: 0 - ProbeTime: 160315756 - RowsReturned: 2734 - RowsReturnedRate: 5 - TotalTime: 519278278168 Hash Join Builder (join_node_id=9) ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 734624 - BuildRowsPartitioned: 2727 - GetNewBlockTime: 143680 - HashBuckets: 6144 - HashCollisions: 0 - HashTablesBuildTime: 1830560 - InactiveTotalTime: 0 - LargestPartitionPercent: 7 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 1496192 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=17) - BytesReceived: 45852 - ConvertRowBatchTime: 539532 - DeserializeRowBatchTimer: 442172 - FirstBatchArrivalWaitTime: 489112306368 - InactiveTotalTime: 490181629116 - PeakMemoryUsage: 0 - RowsReturned: 2727 - RowsReturnedRate: 5 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 490182340124 EXCHANGE_NODE (id=16) - BytesReceived: 36215793 - ConvertRowBatchTime: 195732276 - DeserializeRowBatchTimer: 7462341416 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 28207686664 - PeakMemoryUsage: 0 - RowsReturned: 715483 - RowsReturnedRate: 24785 - SendersBlockedTimer: 483898102256 - SendersBlockedTotalTimer(*): 2903176010964 - TotalTime: 28867423740 Instance 3f4fc7887f663030:1e (host=redacted-host7:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 21844158 - PerHostPeakMemUsage: 74453900 - RowsProduced: 2770 - TotalNetworkReceiveTime: 525868737784 - TotalNetworkSendTime: 2220680 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 613 - TotalThreadsTotalWallClockTime: 530039743768 - TotalThreadsSysTime: 50992000 - TotalThreadsUserTime: 1168822000 - TotalThreadsVoluntaryContextSwitches: 2582 - TotalTime: 530574479304 Fragment Instance Lifecycle Timings - ExecTime: 42235144 - ExecTreeExecTime: 641824 - InactiveTotalTime: 0 - OpenTime: 530001116376 - ExecTreeOpenTime: 527013647904 - PrepareTime: 531035472 - ExecTreePrepareTime: 579184 - TotalTime: 0 DataStreamSender (dst_id=18) - BytesSent: 143612 - InactiveTotalTime: 0 - NetworkThroughput(*): 253051874 - OverallThroughput: 7784695 - PeakMemoryUsage: 1616 - RowsReturned: 2770 - SerializeBatchTime: 17828288 - TotalTime: 18447992 - TransmitDataRPCTime: 567520 - UncompressedRowBatchSize: 278820 CodeGen - CodegenTime: 8535984 - CompileTime: 491368872 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2021884 - NumFunctions: 134 - NumInstructions: 4382 - OptimizationTime: 2446846888 - PeakMemoryUsage: 2243584 - PrepareTime: 337534912 - TotalTime: 3320709784 SORT_NODE (id=10) ExecOption: Codegen Enabled - InactiveTotalTime: 0 - InsertBatchTime: 20782904 - PeakMemoryUsage: 8985465 - RowsReturned: 2770 - RowsReturnedRate: 5 - TotalTime: 527014854832 HASH_JOIN_NODE (id=9) ExecOption: Probe Side Codegen Enabled - BuildRows: 2765 - BuildTime: 70925912 - InactiveTotalTime: 0 - LocalTime: 283734456 - PeakMemoryUsage: 1564235 - ProbeRows: 716868 - ProbeRowsPartitioned: 0 - ProbeTime: 193977360 - RowsReturned: 2770 - RowsReturnedRate: 5 - TotalTime: 526490964640 Hash Join Builder (join_node_id=9) ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 745608 - BuildRowsPartitioned: 2765 - GetNewBlockTime: 31537112 - HashBuckets: 6656 - HashCollisions: 0 - HashTablesBuildTime: 38297896 - InactiveTotalTime: 0 - LargestPartitionPercent: 6 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 1438848 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=17) - BytesReceived: 46463 - ConvertRowBatchTime: 610032 - DeserializeRowBatchTimer: 8034280 - FirstBatchArrivalWaitTime: 496407279440 - InactiveTotalTime: 497438276640 - PeakMemoryUsage: 0 - RowsReturned: 2765 - RowsReturnedRate: 5 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 497439063488 EXCHANGE_NODE (id=16) - BytesReceived: 36291268 - ConvertRowBatchTime: 265935328 - DeserializeRowBatchTimer: 3862700968 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 28151246048 - PeakMemoryUsage: 0 - RowsReturned: 716868 - RowsReturnedRate: 24918 - SendersBlockedTimer: 484009793104 - SendersBlockedTotalTimer(*): 2903672051552 - TotalTime: 28768166696 Instance 3f4fc7887f663030:1c (host=redacted-host5:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 21605565 - PerHostPeakMemUsage: 75932085 - RowsProduced: 2736 - TotalNetworkReceiveTime: 525693113768 - TotalNetworkSendTime: 12577416 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 696 - TotalThreadsTotalWallClockTime: 530138142144 - TotalThreadsSysTime: 37994000 - TotalThreadsUserTime: 1211816000 - TotalThreadsVoluntaryContextSwitches: 2596 - TotalTime: 530517990776 Fragment Instance Lifecycle Timings - ExecTime: 21883616 - ExecTreeExecTime: 670016 - InactiveTotalTime: 0 - OpenTime: 530124259976 - ExecTreeOpenTime: 526606381064 - PrepareTime: 371742160 - ExecTreePrepareTime: 520728 - TotalTime: 0 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 96 - BlocksRecycled: 18 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 34603008 - PeakMemoryUsage: 1623296 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 DataStreamSender (dst_id=18) - BytesSent: 142763 - InactiveTotalTime: 0 - NetworkThroughput(*): 232576665 - OverallThroughput: 22682136 - PeakMemoryUsage: 1616 - RowsReturned: 2736 - SerializeBatchTime: 5634272 - TotalTime: 6294072 - TransmitDataRPCTime: 613832 - UncompressedRowBatchSize: 275645 CodeGen - CodegenTime: 19279848 - CompileTime: 556027456 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2021884 - NumFunctions: 134 - NumInstructions: 4382 - OptimizationTime: 2909232760 - PeakMemoryUsage: 2243584 - PrepareTime: 257355240 - TotalTime: 3737229288 SORT_NODE (id=10) ExecOption: Codegen Enabled - InactiveTotalTime: 0 - InsertBatchTime: 59876424 - PeakMemoryUsage: 8984585 - RowsReturned: 2736 - RowsReturnedRate: 5 - TotalTime: 526607556984 HASH_JOIN_NODE (id=9) ExecOption: Probe Side Codegen Enabled - BuildRows: 2732 - BuildTime: 8499752 - InactiveTotalTime: 0 - LocalTime: 181981344 - PeakMemoryUsage: 1414103 - ProbeRows: 713842 - ProbeRowsPartitioned: 0 - ProbeTime: 122091056 - RowsReturned: 2736 - RowsReturnedRate: 5 - TotalTime: 526199985752 Hash Join Builder (join_node_id=9) ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 3776144 - BuildRowsPartitioned: 2732 - GetNewBlockTime: 3418936 - HashBuckets: 5376 - HashCollisions: 0 - HashTablesBuildTime: 1029672 - InactiveTotalTime: 0 - LargestPartitionPercent: 7 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 1287296 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=17) - BytesReceived: 46052 - ConvertRowBatchTime: 581728 - DeserializeRowBatchTimer: 661536 - FirstBatchArrivalWaitTime: 496090217184 - InactiveTotalTime: 497154232040 - PeakMemoryUsage: 0 - RowsReturned: 2732 - RowsReturnedRate: 5 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 497154968752 EXCHANGE_NODE (id=16) - BytesReceived: 36132132 - ConvertRowBatchTime: 283443120 - DeserializeRowBatchTimer: 3083296768 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 28345611088 - PeakMemoryUsage: 0 - RowsReturned: 713842 - RowsReturnedRate: 24732 - SendersBlockedTimer: 483892723096 - SendersBlockedTotalTimer(*): 1451612014992 - TotalTime: 28863035656 Instance 3f4fc7887f663030:1b (host=redacted-host6:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 21988987 - PerHostPeakMemUsage: 76106652 - RowsProduced: 2685 - TotalNetworkReceiveTime: 524251903248 - TotalNetworkSendTime: 45714088 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 709 - TotalThreadsTotalWallClockTime: 528930233088 - TotalThreadsSysTime: 60991000 - TotalThreadsUserTime: 1184820000 - TotalThreadsVoluntaryContextSwitches: 2629 - TotalTime: 530497021020 Fragment Instance Lifecycle Timings - ExecTime: 75198872 - ExecTreeExecTime: 2770296 - InactiveTotalTime: 0 - OpenTime: 529078678528 - ExecTreeOpenTime: 525070004484 - PrepareTime: 1343016180 - ExecTreePrepareTime: 531608 - TotalTime: 0 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 96 - BlocksRecycled: 23 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 34603008 - PeakMemoryUsage: 2163968 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 DataStreamSender (dst_id=18) - BytesSent: 139464 - InactiveTotalTime: 0 - NetworkThroughput(*): 231137923 - OverallThroughput: 8644032 - PeakMemoryUsage: 1616 - RowsReturned: 2685 - SerializeBatchTime: 15488004 - TotalTime: 16134136 - TransmitDataRPCTime: 603380 - UncompressedRowBatchSize: 270446 CodeGen - CodegenTime: 13142308 - CompileTime: 539234568 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2021884 - NumFunctions: 134 - NumInstructions: 4382 - OptimizationTime: 3189610832 - PeakMemoryUsage: 2243584 - PrepareTime: 427468108 - TotalTime: 4189472036 SORT_NODE (id=10) ExecOption: Codegen Enabled - InactiveTotalTime: 0 - InsertBatchTime: 69463588 - PeakMemoryUsage: 8981881 - RowsReturned: 2685 - RowsReturnedRate: 5 - TotalTime: 525073288936 HASH_JOIN_NODE (id=9) ExecOption: Probe Side Codegen Enabled - BuildRows: 2684 - BuildTime: 8923212 - InactiveTotalTime: 0 - LocalTime: 197345984 - PeakMemoryUsage: 1751950 - ProbeRows: 715030 - ProbeRowsPartitioned: 0 - ProbeTime: 144073012 - RowsReturned: 2685 - RowsReturnedRate: 5 - TotalTime: 524746738548 Hash Join Builder (join_node_id=9) ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 6193952 - BuildRowsPartitioned: 2684 - GetNewBlockTime: 161340 - HashBuckets: 5888 - HashCollisions: 0 - HashTablesBuildTime: 2253836 - InactiveTotalTime: 0 - LargestPartitionPercent: 7 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 1623168 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=17) - BytesReceived: 45108 - ConvertRowBatchTime: 574552 - DeserializeRowBatchTimer: 22524988 - FirstBatchArrivalWaitTime: 494600906984 - InactiveTotalTime: 495664876224 - PeakMemoryUsage: 0 - RowsReturned: 2684 - RowsReturnedRate: 5 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 495665629532 EXCHANGE_NODE (id=16) - BytesReceived: 36209051 - ConvertRowBatchTime: 242765284 - DeserializeRowBatchTimer: 4654078684 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 28079629640 - PeakMemoryUsage: 0 - RowsReturned: 715030 - RowsReturnedRate: 24755 - SendersBlockedTimer: 483918588220 - SendersBlockedTotalTimer(*): 2419500132760 - TotalTime: 28883763032 Instance 3f4fc7887f663030:20 (host=redacted-host1:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 21828692 - PerHostPeakMemUsage: 74325388 - RowsProduced: 2637 - TotalNetworkReceiveTime: 524662470784 - TotalNetworkSendTime: 133922152 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 815 - TotalThreadsTotalWallClockTime: 529250832680 - TotalThreadsSysTime: 55992000 - TotalThreadsUserTime: 1196818000 - TotalThreadsVoluntaryContextSwitches: 2527 - TotalTime: 530435779536 Fragment Instance Lifecycle Timings - ExecTime: 169571192 - ExecTreeExecTime: 610368 - InactiveTotalTime: 0 - OpenTime: 529102425920 - ExecTreeOpenTime: 525569515400 - PrepareTime: 1066242864 - ExecTreePrepareTime: 36730880 - TotalTime: 0 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 96 - BlocksRecycled: 21 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 34603008 - PeakMemoryUsage: 1623296 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 DataStreamSender (dst_id=18) - BytesSent: 136845 - InactiveTotalTime: 0 - NetworkThroughput(*): 208138141 - OverallThroughput: 7659068 - PeakMemoryUsage: 1616 - RowsReturned: 2637 - SerializeBatchTime: 17140224 - TotalTime: 17867056 - TransmitDataRPCTime: 657472 - UncompressedRowBatchSize: 265492 CodeGen - CodegenTime: 79964944 - CompileTime: 448426640 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2021884 - NumFunctions: 134 - NumInstructions: 4382 - OptimizationTime: 3041690184 - PeakMemoryUsage: 2243584 - PrepareTime: 720454552 - TotalTime: 4273576968 SORT_NODE (id=10) ExecOption: Codegen Enabled - InactiveTotalTime: 0 - InsertBatchTime: 10637144 - PeakMemoryUsage: 8991032 - RowsReturned: 2637 - RowsReturnedRate: 5 - TotalTime: 525606841568 HASH_JOIN_NODE (id=9) ExecOption: Probe Side Codegen Enabled - BuildRows: 2635 - BuildTime: 73952808 - InactiveTotalTime: 0 - LocalTime: 352565440 - PeakMemoryUsage: 1609204 - ProbeRows: 714719 - ProbeRowsPartitioned: 0 - ProbeTime: 187513744 - RowsReturned: 2637 - RowsReturnedRate: 5 - TotalTime: 525373214008 Hash Join Builder (join_node_id=9) ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 757176 - BuildRowsPartitioned: 2635 - GetNewBlockTime: 151672 - HashBuckets: 5632 - HashCollisions: 0 - HashTablesBuildTime: 72640800 - InactiveTotalTime: 0 - LargestPartitionPercent: 7 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 1488000 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=17) - BytesReceived: 44423 - ConvertRowBatchTime: 13591816 - DeserializeRowBatchTimer: 375472 - FirstBatchArrivalWaitTime: 494999531792 - InactiveTotalTime: 496068698320 - PeakMemoryUsage: 0 - RowsReturned: 2635 - RowsReturnedRate: 5 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 496082469800 EXCHANGE_NODE (id=16) - BytesReceived: 36191051 - ConvertRowBatchTime: 263084088 - DeserializeRowBatchTimer: 3631931936 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 28186848360 - PeakMemoryUsage: 0 - RowsReturned: 714719 - RowsReturnedRate: 24698 - SendersBlockedTimer: 484008221424 - SendersBlockedTotalTimer(*): 1935799036152 - TotalTime: 28938178768 Instance 3f4fc7887f663030:21 (host=redacted-host4:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 21735796 - PerHostPeakMemUsage: 75532836 - RowsProduced: 2710 - TotalNetworkReceiveTime: 519070110488 - TotalNetworkSendTime: 68682240 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 900 - TotalThreadsTotalWallClockTime: 527769663592 - TotalThreadsSysTime: 58991000 - TotalThreadsUserTime: 1256809000 - TotalThreadsVoluntaryContextSwitches: 2953 - TotalTime: 530282260160 Fragment Instance Lifecycle Timings - ExecTime: 166921824 - ExecTreeExecTime: 827792 - InactiveTotalTime: 0 - OpenTime: 527623937488 - ExecTreeOpenTime: 520084778776 - PrepareTime: 2491308224 - ExecTreePrepareTime: 660461008 - TotalTime: 0 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 96 - BlocksRecycled: 19 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 34603008 - PeakMemoryUsage: 2163968 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 DataStreamSender (dst_id=18) - BytesSent: 141046 - InactiveTotalTime: 0 - NetworkThroughput(*): 14851987 - OverallThroughput: 1374935 - PeakMemoryUsage: 1616 - RowsReturned: 2710 - SerializeBatchTime: 93051536 - TotalTime: 102583704 - TransmitDataRPCTime: 9496776 - UncompressedRowBatchSize: 272998 CodeGen - CodegenTime: 75989552 - CompileTime: 2359064680 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2021884 - NumFunctions: 134 - NumInstructions: 4382 - OptimizationTime: 4947919432 - PeakMemoryUsage: 2243584 - PrepareTime: 1293401728 - TotalTime: 8704057856 SORT_NODE (id=10) ExecOption: Codegen Enabled - InactiveTotalTime: 0 - InsertBatchTime: 34463776 - PeakMemoryUsage: 8988171 - RowsReturned: 2710 - RowsReturnedRate: 5 - TotalTime: 520746048256 HASH_JOIN_NODE (id=9) ExecOption: Probe Side Codegen Enabled - BuildRows: 2703 - BuildTime: 65876376 - InactiveTotalTime: 0 - LocalTime: 1515849912 - PeakMemoryUsage: 1487513 - ProbeRows: 716504 - ProbeRowsPartitioned: 0 - ProbeTime: 118080136 - RowsReturned: 2710 - RowsReturnedRate: 5 - TotalTime: 520856717552 Hash Join Builder (join_node_id=9) ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 17542192 - BuildRowsPartitioned: 2703 - GetNewBlockTime: 47278736 - HashBuckets: 5888 - HashCollisions: 0 - HashTablesBuildTime: 786392 - InactiveTotalTime: 0 - LargestPartitionPercent: 7 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 1361024 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=17) - BytesReceived: 45533 - ConvertRowBatchTime: 554312 - DeserializeRowBatchTimer: 666888 - FirstBatchArrivalWaitTime: 489294020152 - InactiveTotalTime: 490337640192 - PeakMemoryUsage: 0 - RowsReturned: 2703 - RowsReturnedRate: 5 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 490338336848 EXCHANGE_NODE (id=16) - BytesReceived: 36274171 - ConvertRowBatchTime: 246453592 - DeserializeRowBatchTimer: 9966794736 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 28050583248 - PeakMemoryUsage: 0 - RowsReturned: 716504 - RowsReturnedRate: 24704 - SendersBlockedTimer: 483857427920 - SendersBlockedTotalTimer(*): 2419389052528 - TotalTime: 29002530792 Averaged Fragment F00 split sizes: min: 32.87 MB, max: 65.73 MB, avg: 38.06 MB, stddev: 11.30 MB completion times: min:8m33s max:8m50s mean: 8m36s stddev:5s619ms execution rates: min:65.53 KB/sec max:126.91 KB/sec mean:75.17 KB/sec stddev:21.13 KB/sec num instances: 7 - AverageThreadTokens: 1.9903138151267206 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 23559514 - PerHostPeakMemUsage: 75376687 - RowsProduced: 714285 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 503044767182 - TotalStorageWaitTime: 1018938685 - TotalThreadsInvoluntaryContextSwitches: 5239 - TotalThreadsTotalWallClockTime: 1027314500173 - TotalThreadsSysTime: 144834571 - TotalThreadsUserTime: 3517893428 - TotalThreadsVoluntaryContextSwitches: 1771 - TotalTime: 516926563968 Fragment Instance Lifecycle Timings - ExecTime: 515329015478 - ExecTreeExecTime: 2320080247 - InactiveTotalTime: 0 - OpenTime: 337386190 - ExecTreeOpenTime: 143526 - PrepareTime: 1260047834 - ExecTreePrepareTime: 9356572 - TotalTime: 0 DataStreamSender (dst_id=16) - BytesSent: 36161407 - InactiveTotalTime: 0 - NetworkThroughput(*): 165990725 - OverallThroughput: 14313516 - PeakMemoryUsage: 213248 - RowsReturned: 714285 - SerializeBatchTime: 2333501678 - TotalTime: 2556078928 - TransmitDataRPCTime: 218129125 - UncompressedRowBatchSize: 66187166 CodeGen - CodegenTime: 44875190 - CompileTime: 18930278 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2021884 - NumFunctions: 5 - NumInstructions: 98 - OptimizationTime: 173071732 - PeakMemoryUsage: 50176 - PrepareTime: 499374470 - TotalTime: 733049969 HDFS_SCAN_NODE (id=8) - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.9930978620107422 - BytesRead: 5914124 - BytesReadDataNodeCache: 0 - BytesReadLocal: 5914124 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 5914124 - DecompressionTime: 352290307 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 5 - NumDisksAccessed: 1 - NumRowGroups: 1 - NumScannerThreadsStarted: 1 - PeakMemoryUsage: 23339993 - PerReadThreadRawHdfsThroughput: 497655361 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 1265705584 - RowBatchQueuePutWaitTime: 505175451238 - RowsRead: 714285 - RowsReturned: 714285 - RowsReturnedRate: 494244 - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 307 - ScannerThreadsTotalWallClockTime: 511727791614 - MaterializeTupleTime(*): 4378921970 - ScannerThreadsSysTime: 66560714 - ScannerThreadsUserTime: 1045126428 - ScannerThreadsVoluntaryContextSwitches: 989 - TotalRawHdfsReadTime(*): 14785829 - TotalReadThroughput: 11599 - TotalTime: 2330017577 Fragment F00 Instance 3f4fc7887f663030:3 (host=redacted-host2:22000) Hdfs split stats (:<# splits>/): 1:1/32.87 MB 11:1/32.86 MB - AverageThreadTokens: 1.989433237271854 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 22363474 - PerHostPeakMemUsage: 75091825 - RowsProduced: 1233332 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 504168897204 - TotalStorageWaitTime: 2804091872 - TotalThreadsInvoluntaryContextSwitches: 9799 - TotalThreadsTotalWallClockTime: 1050613611860 - TotalThreadsSysTime: 167974000 - TotalThreadsUserTime: 5933098000 - TotalThreadsVoluntaryContextSwitches: 2910 - TotalTime: 530254513800 Fragment Instance Lifecycle Timings - ExecTime: 527157921652 - ExecTreeExecTime: 2292215604 - InactiveTotalTime: 0 - OpenTime: 241378048 - ExecTreeOpenTime: 122288 - PrepareTime: 2855111428 - ExecTreePrepareTime: 474680 - TotalTime: 0 DataStreamSender (dst_id=16) - BytesSent: 62400820 - InactiveTotalTime: 0 - NetworkThroughput(*): 172445806 - OverallThroughput: 13583458 - PeakMemoryUsage: 213248 - RowsReturned: 1233332 - SerializeBatchTime: 4227591148 - TotalTime: 4593882956 - TransmitDataRPCTime: 361857568 - UncompressedRowBatchSize: 114280306 CodeGen - CodegenTime: 43127324 - CompileTime: 13265512 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2021884 - NumFunctions: 5 - NumInstructions: 98 - OptimizationTime: 140328744 - PeakMemoryUsage: 50176 - PrepareTime: 851295848 - TotalTime: 1014641064 HDFS_SCAN_NODE (id=8) Hdfs split stats (:<# splits>/): 1:1/32.87 MB 11:1/32.86 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 2 out of 2 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:10 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.9932497589199615 - BytesRead: 10218332 - BytesReadDataNodeCache: 0 - BytesReadLocal: 10218332 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 10218332 - DecompressionTime: 606581372 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 5 - NumDisksAccessed: 2 - NumRowGroups: 2 - NumScannerThreadsStarted: 1 - PeakMemoryUsage: 22141613 - PerReadThreadRawHdfsThroughput: 300216426 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 589373460 - RowBatchQueuePutWaitTime: 509410672088 - RowsRead: 1233332 - RowsReturned: 1233332 - RowsReturnedRate: 538954 - ScanRangesComplete: 2 - ScannerThreadsInvoluntaryContextSwitches: 739 - ScannerThreadsTotalWallClockTime: 523236623116 - MaterializeTupleTime(*): 9614803776 - ScannerThreadsSysTime: 62990000 - ScannerThreadsUserTime: 1756733000 - ScannerThreadsVoluntaryContextSwitches: 1580 - TotalRawHdfsReadTime(*): 34036552 - TotalReadThroughput: 19641 - TotalTime: 2288380208 Instance 3f4fc7887f663030:7 (host=redacted-host4:22000) Hdfs split stats (:<# splits>/): 11:1/33.74 MB - AverageThreadTokens: 1.9891944990176817 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 24460624 - PerHostPeakMemUsage: 75532836 - RowsProduced: 633338 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 495340358840 - TotalStorageWaitTime: 4008099792 - TotalThreadsInvoluntaryContextSwitches: 5067 - TotalThreadsTotalWallClockTime: 1028257510104 - TotalThreadsSysTime: 233964000 - TotalThreadsUserTime: 3399483000 - TotalThreadsVoluntaryContextSwitches: 2034 - TotalTime: 517810560920 Fragment Instance Lifecycle Timings - ExecTime: 515617168760 - ExecTreeExecTime: 8257873032 - InactiveTotalTime: 0 - OpenTime: 613388984 - ExecTreeOpenTime: 177056 - PrepareTime: 1579835960 - ExecTreePrepareTime: 286872 - TotalTime: 0 DataStreamSender (dst_id=16) - BytesSent: 32870191 - InactiveTotalTime: 0 - NetworkThroughput(*): 142221391 - OverallThroughput: 13202440 - PeakMemoryUsage: 213248 - RowsReturned: 633338 - SerializeBatchTime: 2256860120 - TotalTime: 2489705632 - TransmitDataRPCTime: 231119880 - UncompressedRowBatchSize: 58687066 CodeGen - CodegenTime: 189349008 - CompileTime: 6600696 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2021884 - NumFunctions: 5 - NumInstructions: 98 - OptimizationTime: 454427720 - PeakMemoryUsage: 50176 - PrepareTime: 541750776 - TotalTime: 1060238536 HDFS_SCAN_NODE (id=8) Hdfs split stats (:<# splits>/): 11:1/33.74 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:5 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.9930966469428008 - BytesRead: 5240386 - BytesReadDataNodeCache: 0 - BytesReadLocal: 5240386 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 5240386 - DecompressionTime: 449568256 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 5 - NumDisksAccessed: 1 - NumRowGroups: 1 - NumScannerThreadsStarted: 1 - PeakMemoryUsage: 24238761 - PerReadThreadRawHdfsThroughput: 597813578 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 7011199072 - RowBatchQueuePutWaitTime: 498412533976 - RowsRead: 633338 - RowsReturned: 633338 - RowsReturnedRate: 77076 - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 436 - ScannerThreadsTotalWallClockTime: 512084065472 - MaterializeTupleTime(*): 5860279280 - ScannerThreadsSysTime: 106983000 - ScannerThreadsUserTime: 1028843000 - ScannerThreadsVoluntaryContextSwitches: 1151 - TotalRawHdfsReadTime(*): 8765920 - TotalReadThroughput: 10300 - TotalTime: 8217046000 Instance 3f4fc7887f663030:1 (host=redacted-host6:22000) Hdfs split stats (:<# splits>/): 4:1/33.74 MB - AverageThreadTokens: 1.9881422924901186 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 24460643 - PerHostPeakMemUsage: 76106652 - RowsProduced: 633333 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 502533547156 - TotalStorageWaitTime: 10439232 - TotalThreadsInvoluntaryContextSwitches: 4336 - TotalThreadsTotalWallClockTime: 1021197097432 - TotalThreadsSysTime: 132979000 - TotalThreadsUserTime: 3148520000 - TotalThreadsVoluntaryContextSwitches: 1580 - TotalTime: 515058897052 Fragment Instance Lifecycle Timings - ExecTime: 512429649712 - ExecTreeExecTime: 1327528904 - InactiveTotalTime: 0 - OpenTime: 568360264 - ExecTreeOpenTime: 120304 - PrepareTime: 2060784452 - ExecTreePrepareTime: 57017192 - TotalTime: 0 DataStreamSender (dst_id=16) - BytesSent: 32260054 - InactiveTotalTime: 0 - NetworkThroughput(*): 155792768 - OverallThroughput: 12944235 - PeakMemoryUsage: 213248 - RowsReturned: 633333 - SerializeBatchTime: 2283801236 - TotalTime: 2492233256 - TransmitDataRPCTime: 207070292 - UncompressedRowBatchSize: 58686752 CodeGen - CodegenTime: 1039468 - CompileTime: 12114344 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2021884 - NumFunctions: 5 - NumInstructions: 98 - OptimizationTime: 137274460 - PeakMemoryUsage: 50176 - PrepareTime: 602966824 - TotalTime: 796318936 HDFS_SCAN_NODE (id=8) Hdfs split stats (:<# splits>/): 4:1/33.74 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:5 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.9920634920634921 - BytesRead: 5240466 - BytesReadDataNodeCache: 0 - BytesReadLocal: 5240466 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 5240466 - DecompressionTime: 416520428 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 5 - NumDisksAccessed: 1 - NumRowGroups: 1 - NumScannerThreadsStarted: 1 - PeakMemoryUsage: 24238781 - PerReadThreadRawHdfsThroughput: 689910456 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 318541388 - RowBatchQueuePutWaitTime: 504429172284 - RowsRead: 633333 - RowsReturned: 633333 - RowsReturnedRate: 440314 - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 165 - ScannerThreadsTotalWallClockTime: 508574512024 - MaterializeTupleTime(*): 3343500840 - ScannerThreadsSysTime: 63990000 - ScannerThreadsUserTime: 934857000 - ScannerThreadsVoluntaryContextSwitches: 889 - TotalRawHdfsReadTime(*): 7595864 - TotalReadThroughput: 10361 - TotalTime: 1438364036 Instance 3f4fc7887f663030:2 (host=redacted-host5:22000) Hdfs split stats (:<# splits>/): 1:1/33.74 MB - AverageThreadTokens: 1.9911242603550297 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 24452443 - PerHostPeakMemUsage: 75932085 - RowsProduced: 633334 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 505307935000 - TotalStorageWaitTime: 88048216 - TotalThreadsInvoluntaryContextSwitches: 4124 - TotalThreadsTotalWallClockTime: 1023854472640 - TotalThreadsSysTime: 135978000 - TotalThreadsUserTime: 3107527000 - TotalThreadsVoluntaryContextSwitches: 1510 - TotalTime: 514428988672 Fragment Instance Lifecycle Timings - ExecTime: 513645491008 - ExecTreeExecTime: 1293860496 - InactiveTotalTime: 0 - OpenTime: 214808000 - ExecTreeOpenTime: 142120 - PrepareTime: 568574960 - ExecTreePrepareTime: 265368 - TotalTime: 0 DataStreamSender (dst_id=16) - BytesSent: 31781549 - InactiveTotalTime: 0 - NetworkThroughput(*): 167932476 - OverallThroughput: 14786247 - PeakMemoryUsage: 213248 - RowsReturned: 633334 - SerializeBatchTime: 1958720968 - TotalTime: 2149399208 - TransmitDataRPCTime: 189251952 - UncompressedRowBatchSize: 58687566 CodeGen - CodegenTime: 52060952 - CompileTime: 8125032 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2021884 - NumFunctions: 5 - NumInstructions: 98 - OptimizationTime: 124316288 - PeakMemoryUsage: 50176 - PrepareTime: 209871856 - TotalTime: 452979840 HDFS_SCAN_NODE (id=8) Hdfs split stats (:<# splits>/): 1:1/33.74 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:5 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.9930830039525692 - BytesRead: 5241086 - BytesReadDataNodeCache: 0 - BytesReadLocal: 5241086 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 5241086 - DecompressionTime: 198059072 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 5 - NumDisksAccessed: 1 - NumRowGroups: 1 - NumScannerThreadsStarted: 1 - PeakMemoryUsage: 24238772 - PerReadThreadRawHdfsThroughput: 327804549 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 241678024 - RowBatchQueuePutWaitTime: 506861931576 - RowsRead: 633334 - RowsReturned: 633334 - RowsReturnedRate: 490193 - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 137 - ScannerThreadsTotalWallClockTime: 510037404840 - MaterializeTupleTime(*): 2659709776 - ScannerThreadsSysTime: 59990000 - ScannerThreadsUserTime: 924859000 - ScannerThreadsVoluntaryContextSwitches: 852 - TotalRawHdfsReadTime(*): 15988448 - TotalReadThroughput: 10331 - TotalTime: 1292008272 Instance 3f4fc7887f663030:5 (host=redacted-host3:22000) Hdfs split stats (:<# splits>/): 10:1/33.75 MB - AverageThreadTokens: 1.9920870425321464 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 24460639 - PerHostPeakMemUsage: 76194127 - RowsProduced: 633333 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 505069990944 - TotalStorageWaitTime: 85971832 - TotalThreadsInvoluntaryContextSwitches: 4443 - TotalThreadsTotalWallClockTime: 1023304371896 - TotalThreadsSysTime: 98984000 - TotalThreadsUserTime: 3040538000 - TotalThreadsVoluntaryContextSwitches: 1434 - TotalTime: 513739751800 Fragment Instance Lifecycle Timings - ExecTime: 513304847776 - ExecTreeExecTime: 771358928 - InactiveTotalTime: 0 - OpenTime: 210653840 - ExecTreeOpenTime: 148192 - PrepareTime: 224151992 - ExecTreePrepareTime: 4987640 - TotalTime: 0 DataStreamSender (dst_id=16) - BytesSent: 31692432 - InactiveTotalTime: 0 - NetworkThroughput(*): 174917001 - OverallThroughput: 14953922 - PeakMemoryUsage: 213248 - RowsReturned: 633333 - SerializeBatchTime: 1936138192 - TotalTime: 2119339008 - TransmitDataRPCTime: 181185544 - UncompressedRowBatchSize: 58686030 CodeGen - CodegenTime: 948720 - CompileTime: 37111720 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2021884 - NumFunctions: 5 - NumInstructions: 98 - OptimizationTime: 90482992 - PeakMemoryUsage: 50176 - PrepareTime: 159227576 - TotalTime: 314296672 HDFS_SCAN_NODE (id=8) Hdfs split stats (:<# splits>/): 10:1/33.75 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:5 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.9930693069306931 - BytesRead: 5240284 - BytesReadDataNodeCache: 0 - BytesReadLocal: 5240284 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 5240284 - DecompressionTime: 183318624 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 5 - NumDisksAccessed: 1 - NumRowGroups: 1 - NumScannerThreadsStarted: 1 - PeakMemoryUsage: 24238777 - PerReadThreadRawHdfsThroughput: 434162926 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 147618792 - RowBatchQueuePutWaitTime: 506848836232 - RowsRead: 633333 - RowsReturned: 633333 - RowsReturnedRate: 813253 - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 219 - ScannerThreadsTotalWallClockTime: 509802716696 - MaterializeTupleTime(*): 2491527864 - ScannerThreadsSysTime: 40993000 - ScannerThreadsUserTime: 886865000 - ScannerThreadsVoluntaryContextSwitches: 766 - TotalRawHdfsReadTime(*): 12069856 - TotalReadThroughput: 10359 - TotalTime: 778764792 Instance 3f4fc7887f663030:4 (host=redacted-host7:22000) Hdfs split stats (:<# splits>/): 10:1/32.88 MB - AverageThreadTokens: 1.9920870425321464 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 22355291 - PerHostPeakMemUsage: 74453900 - RowsProduced: 616664 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 504675284448 - TotalStorageWaitTime: 30806728 - TotalThreadsInvoluntaryContextSwitches: 4309 - TotalThreadsTotalWallClockTime: 1022502562192 - TotalThreadsSysTime: 125981000 - TotalThreadsUserTime: 2993545000 - TotalThreadsVoluntaryContextSwitches: 1426 - TotalTime: 513691283648 Fragment Instance Lifecycle Timings - ExecTime: 512836084008 - ExecTreeExecTime: 975328120 - InactiveTotalTime: 0 - OpenTime: 150888608 - ExecTreeOpenTime: 144144 - PrepareTime: 704231488 - ExecTreePrepareTime: 315136 - TotalTime: 0 DataStreamSender (dst_id=16) - BytesSent: 31207721 - InactiveTotalTime: 0 - NetworkThroughput(*): 173344679 - OverallThroughput: 15880902 - PeakMemoryUsage: 213248 - RowsReturned: 616664 - SerializeBatchTime: 1783706584 - TotalTime: 1965110008 - TransmitDataRPCTime: 180032760 - UncompressedRowBatchSize: 57140425 CodeGen - CodegenTime: 8585144 - CompileTime: 5277296 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2021884 - NumFunctions: 5 - NumInstructions: 98 - OptimizationTime: 96830272 - PeakMemoryUsage: 50176 - PrepareTime: 506605800 - TotalTime: 609596632 HDFS_SCAN_NODE (id=8) Hdfs split stats (:<# splits>/): 10:1/32.88 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:5 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.9930693069306931 - BytesRead: 5109467 - BytesReadDataNodeCache: 0 - BytesReadLocal: 5109467 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 5109467 - DecompressionTime: 371400128 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 5 - NumDisksAccessed: 1 - NumRowGroups: 1 - NumScannerThreadsStarted: 1 - PeakMemoryUsage: 22141621 - PerReadThreadRawHdfsThroughput: 266802086 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 199892536 - RowBatchQueuePutWaitTime: 505883179016 - RowsRead: 616664 - RowsReturned: 616664 - RowsReturnedRate: 633504 - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 239 - ScannerThreadsTotalWallClockTime: 509532763168 - MaterializeTupleTime(*): 3015094648 - ScannerThreadsSysTime: 64990000 - ScannerThreadsUserTime: 885865000 - ScannerThreadsVoluntaryContextSwitches: 809 - TotalRawHdfsReadTime(*): 19150776 - TotalReadThroughput: 10102 - TotalTime: 973416904 Instance 3f4fc7887f663030:6 (host=redacted-host1:22000) Hdfs split stats (:<# splits>/): 3:1/32.87 MB - AverageThreadTokens: 1.9901283316880554 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 22363490 - PerHostPeakMemUsage: 74325388 - RowsProduced: 616666 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 504217356688 - TotalStorageWaitTime: 105113128 - TotalThreadsInvoluntaryContextSwitches: 4595 - TotalThreadsTotalWallClockTime: 1021471875088 - TotalThreadsSysTime: 117982000 - TotalThreadsUserTime: 3002543000 - TotalThreadsVoluntaryContextSwitches: 1508 - TotalTime: 513501951888 Fragment Instance Lifecycle Timings - ExecTime: 512311945432 - ExecTreeExecTime: 1322396648 - InactiveTotalTime: 0 - OpenTime: 362225592 - ExecTreeOpenTime: 150584 - PrepareTime: 827644560 - ExecTreePrepareTime: 2149120 - TotalTime: 0 DataStreamSender (dst_id=16) - BytesSent: 30917086 - InactiveTotalTime: 0 - NetworkThroughput(*): 175280957 - OverallThroughput: 14843413 - PeakMemoryUsage: 213248 - RowsReturned: 616666 - SerializeBatchTime: 1887693504 - TotalTime: 2082882432 - TransmitDataRPCTime: 176385880 - UncompressedRowBatchSize: 57142019 CodeGen - CodegenTime: 19015720 - CompileTime: 50017352 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2021884 - NumFunctions: 5 - NumInstructions: 98 - OptimizationTime: 167841648 - PeakMemoryUsage: 50176 - PrepareTime: 623902616 - TotalTime: 883278104 HDFS_SCAN_NODE (id=8) Hdfs split stats (:<# splits>/): 3:1/32.87 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:5 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.9940535183349851 - BytesRead: 5108849 - BytesReadDataNodeCache: 0 - BytesReadLocal: 5108849 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 5108849 - DecompressionTime: 240584272 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 5 - NumDisksAccessed: 1 - NumRowGroups: 1 - NumScannerThreadsStarted: 1 - PeakMemoryUsage: 22141627 - PerReadThreadRawHdfsThroughput: 866877512 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 351635816 - RowBatchQueuePutWaitTime: 504381833496 - RowsRead: 616666 - RowsReturned: 616666 - RowsReturnedRate: 466414 - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 217 - ScannerThreadsTotalWallClockTime: 508826455984 - MaterializeTupleTime(*): 3667537608 - ScannerThreadsSysTime: 65989000 - ScannerThreadsUserTime: 897863000 - ScannerThreadsVoluntaryContextSwitches: 882 - TotalRawHdfsReadTime(*): 5893392 - TotalReadThroughput: 10101 - TotalTime: 1322142832 Averaged Fragment F05 split sizes: min: 0, max: 0, avg: 0, stddev: 0 completion times: min:8m19s max:8m20s mean: 8m19s stddev:419.347ms execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec num instances: 8 - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 3310334 - PerHostPeakMemUsage: 69909802 - RowsProduced: 2369 - TotalNetworkReceiveTime: 497278459491 - TotalNetworkSendTime: 47232961 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 82 - TotalThreadsTotalWallClockTime: 498565881641 - TotalThreadsSysTime: 15497875 - TotalThreadsUserTime: 157976125 - TotalThreadsVoluntaryContextSwitches: 223 - TotalTime: 499857312083 Fragment Instance Lifecycle Timings - ExecTime: 197172057 - ExecTreeExecTime: 126837617 - InactiveTotalTime: 0 - OpenTime: 498383560992 - ExecTreeOpenTime: 497722099966 - PrepareTime: 1276019075 - ExecTreePrepareTime: 195417046 - TotalTime: 0 DataStreamSender (dst_id=17) - BytesSent: 39881 - InactiveTotalTime: 0 - NetworkThroughput(*): 88708558 - OverallThroughput: 7900224 - PeakMemoryUsage: 122696 - RowsReturned: 2369 - SerializeBatchTime: 6909593 - TotalTime: 20180889 - TransmitDataRPCTime: 450192 - UncompressedRowBatchSize: 68743 CodeGen - CodegenTime: 57376292 - CompileTime: 141057023 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2021884 - NumFunctions: 42 - NumInstructions: 750 - OptimizationTime: 433111732 - PeakMemoryUsage: 384000 - PrepareTime: 505233960 - TotalTime: 1096790993 AGGREGATION_NODE (id=15) - BuildTime: 190293901 - GetNewBlockTime: 70570570 - GetResultsTime: 12483704 - HTResizeTime: 119141324 - HashBuckets: 65536 - InactiveTotalTime: 0 - LargestPartitionPercent: 6 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 3240053 - PinTime: 0 - RowsRepartitioned: 0 - RowsReturned: 2369 - RowsReturnedRate: 4 - SpilledPartitions: 0 - TotalTime: 498044291899 - UnpinTime: 4540 EXCHANGE_NODE (id=14) - BytesReceived: 474006 - ConvertRowBatchTime: 5452636 - DeserializeRowBatchTimer: 219315678 - FirstBatchArrivalWaitTime: 400651804622 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 26239 - RowsReturnedRate: 52 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 497284321542 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 96 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 34603008 - PeakMemoryUsage: 1672448 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 Fragment F05 Instance 3f4fc7887f663030:13 (host=redacted-host7:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 3324663 - PerHostPeakMemUsage: 74453900 - RowsProduced: 2269 - TotalNetworkReceiveTime: 498285643624 - TotalNetworkSendTime: 43519192 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 72 - TotalThreadsTotalWallClockTime: 500139117680 - TotalThreadsSysTime: 9999000 - TotalThreadsUserTime: 166974000 - TotalThreadsVoluntaryContextSwitches: 258 - TotalTime: 500763893760 Fragment Instance Lifecycle Timings - ExecTime: 269156592 - ExecTreeExecTime: 211266704 - InactiveTotalTime: 0 - OpenTime: 499884086480 - ExecTreeOpenTime: 499395622008 - PrepareTime: 610555512 - ExecTreePrepareTime: 29439808 - TotalTime: 0 DataStreamSender (dst_id=17) - BytesSent: 38328 - InactiveTotalTime: 0 - NetworkThroughput(*): 83980437 - OverallThroughput: 20707540 - PeakMemoryUsage: 122696 - RowsReturned: 2269 - SerializeBatchTime: 1303592 - TotalTime: 1850920 - TransmitDataRPCTime: 456392 - UncompressedRowBatchSize: 65829 CodeGen - CodegenTime: 17518328 - CompileTime: 117257720 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2021884 - NumFunctions: 42 - NumInstructions: 750 - OptimizationTime: 329063344 - PeakMemoryUsage: 384000 - PrepareTime: 271194920 - TotalTime: 726900968 AGGREGATION_NODE (id=15) ExecOption: Codegen Enabled - BuildTime: 175079680 - GetNewBlockTime: 19813784 - GetResultsTime: 12533960 - HTResizeTime: 137828488 - HashBuckets: 65536 - InactiveTotalTime: 0 - LargestPartitionPercent: 6 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 3254382 - PinTime: 0 - RowsRepartitioned: 0 - RowsReturned: 2269 - RowsReturnedRate: 4 - SpilledPartitions: 0 - TotalTime: 499636261728 - UnpinTime: 5928 EXCHANGE_NODE (id=14) - BytesReceived: 476192 - ConvertRowBatchTime: 5584264 - DeserializeRowBatchTimer: 158628112 - FirstBatchArrivalWaitTime: 401503241872 - InactiveTotalTime: 498284461176 - PeakMemoryUsage: 0 - RowsReturned: 26367 - RowsReturnedRate: 52 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 498291616864 Instance 3f4fc7887f663030:17 (host=redacted-host8:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 3308288 - PerHostPeakMemUsage: 31641609 - RowsProduced: 2316 - TotalNetworkReceiveTime: 498101965040 - TotalNetworkSendTime: 27306272 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 98 - TotalThreadsTotalWallClockTime: 499555978456 - TotalThreadsSysTime: 13998000 - TotalThreadsUserTime: 159976000 - TotalThreadsVoluntaryContextSwitches: 255 - TotalTime: 500156272112 Fragment Instance Lifecycle Timings - ExecTime: 245633800 - ExecTreeExecTime: 181347016 - InactiveTotalTime: 0 - OpenTime: 499329100984 - ExecTreeOpenTime: 498782895216 - PrepareTime: 581433912 - ExecTreePrepareTime: 59299200 - TotalTime: 0 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 96 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 34603008 - PeakMemoryUsage: 1672448 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 DataStreamSender (dst_id=17) - BytesSent: 39038 - InactiveTotalTime: 0 - NetworkThroughput(*): 81164132 - OverallThroughput: 18883969 - PeakMemoryUsage: 122696 - RowsReturned: 2316 - SerializeBatchTime: 1459768 - TotalTime: 2067256 - TransmitDataRPCTime: 480976 - UncompressedRowBatchSize: 67192 CodeGen - CodegenTime: 20250552 - CompileTime: 85176624 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2021884 - NumFunctions: 42 - NumInstructions: 750 - OptimizationTime: 367273728 - PeakMemoryUsage: 384000 - PrepareTime: 275189616 - TotalTime: 733745976 AGGREGATION_NODE (id=15) ExecOption: Codegen Enabled - BuildTime: 231015560 - GetNewBlockTime: 2485032 - GetResultsTime: 10226824 - HTResizeTime: 90641440 - HashBuckets: 65536 - InactiveTotalTime: 0 - LargestPartitionPercent: 6 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 3238007 - PinTime: 0 - RowsRepartitioned: 0 - RowsReturned: 2316 - RowsReturnedRate: 4 - SpilledPartitions: 0 - TotalTime: 499023467856 - UnpinTime: 3416 EXCHANGE_NODE (id=14) - BytesReceived: 474311 - ConvertRowBatchTime: 5425560 - DeserializeRowBatchTimer: 121346768 - FirstBatchArrivalWaitTime: 401349770768 - InactiveTotalTime: 498101439152 - PeakMemoryUsage: 0 - RowsReturned: 26243 - RowsReturnedRate: 52 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 498107791216 Instance 3f4fc7887f663030:1a (host=redacted-host5:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 3308288 - PerHostPeakMemUsage: 75932085 - RowsProduced: 2375 - TotalNetworkReceiveTime: 498356765120 - TotalNetworkSendTime: 68411504 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 72 - TotalThreadsTotalWallClockTime: 499357313624 - TotalThreadsSysTime: 10999000 - TotalThreadsUserTime: 151977000 - TotalThreadsVoluntaryContextSwitches: 185 - TotalTime: 499886406080 Fragment Instance Lifecycle Timings - ExecTime: 290000856 - ExecTreeExecTime: 179913792 - InactiveTotalTime: 0 - OpenTime: 499071428112 - ExecTreeOpenTime: 498558649592 - PrepareTime: 524845728 - ExecTreePrepareTime: 43707304 - TotalTime: 0 DataStreamSender (dst_id=17) - BytesSent: 39883 - InactiveTotalTime: 0 - NetworkThroughput(*): 87355440 - OverallThroughput: 2103299 - PeakMemoryUsage: 122696 - RowsReturned: 2375 - SerializeBatchTime: 18394192 - TotalTime: 18962112 - TransmitDataRPCTime: 456560 - UncompressedRowBatchSize: 68903 CodeGen - CodegenTime: 83278896 - CompileTime: 153417392 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2021884 - NumFunctions: 42 - NumInstructions: 750 - OptimizationTime: 337462416 - PeakMemoryUsage: 384000 - PrepareTime: 251863256 - TotalTime: 744086096 AGGREGATION_NODE (id=15) ExecOption: Codegen Enabled - BuildTime: 188401528 - GetNewBlockTime: 32878184 - GetResultsTime: 10292008 - HTResizeTime: 130181288 - HashBuckets: 65536 - InactiveTotalTime: 0 - LargestPartitionPercent: 6 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 3238007 - PinTime: 0 - RowsRepartitioned: 0 - RowsReturned: 2375 - RowsReturnedRate: 4 - SpilledPartitions: 0 - TotalTime: 498782195280 - UnpinTime: 4616 EXCHANGE_NODE (id=14) - BytesReceived: 470608 - ConvertRowBatchTime: 5299008 - DeserializeRowBatchTimer: 175214848 - FirstBatchArrivalWaitTime: 401478202368 - InactiveTotalTime: 498329101320 - PeakMemoryUsage: 0 - RowsReturned: 26064 - RowsReturnedRate: 52 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 498362444248 Instance 3f4fc7887f663030:18 (host=redacted-host6:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 3308288 - PerHostPeakMemUsage: 76106652 - RowsProduced: 2357 - TotalNetworkReceiveTime: 496448596328 - TotalNetworkSendTime: 71601128 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 65 - TotalThreadsTotalWallClockTime: 497600988468 - TotalThreadsSysTime: 15998000 - TotalThreadsUserTime: 146978000 - TotalThreadsVoluntaryContextSwitches: 203 - TotalTime: 499849038364 Fragment Instance Lifecycle Timings - ExecTime: 209873668 - ExecTreeExecTime: 108919096 - InactiveTotalTime: 0 - OpenTime: 497396595752 - ExecTreeOpenTime: 496722247468 - PrepareTime: 2242437288 - ExecTreePrepareTime: 329344340 - TotalTime: 0 DataStreamSender (dst_id=17) - BytesSent: 39688 - InactiveTotalTime: 0 - NetworkThroughput(*): 90334680 - OverallThroughput: 2388406 - PeakMemoryUsage: 122696 - RowsReturned: 2357 - SerializeBatchTime: 16086068 - TotalTime: 16616940 - TransmitDataRPCTime: 439344 - UncompressedRowBatchSize: 68381 CodeGen - CodegenTime: 34726964 - CompileTime: 111491836 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2021884 - NumFunctions: 42 - NumInstructions: 750 - OptimizationTime: 476818440 - PeakMemoryUsage: 384000 - PrepareTime: 513932944 - TotalTime: 1112967960 AGGREGATION_NODE (id=15) ExecOption: Codegen Enabled - BuildTime: 245816324 - GetNewBlockTime: 181937076 - GetResultsTime: 23084240 - HTResizeTime: 187540112 - HashBuckets: 65536 - InactiveTotalTime: 0 - LargestPartitionPercent: 6 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 3238007 - PinTime: 0 - RowsRepartitioned: 0 - RowsReturned: 2357 - RowsReturnedRate: 4 - SpilledPartitions: 0 - TotalTime: 497160452580 - UnpinTime: 5368 EXCHANGE_NODE (id=14) - BytesReceived: 475224 - ConvertRowBatchTime: 5470272 - DeserializeRowBatchTimer: 247408704 - FirstBatchArrivalWaitTime: 400475956104 - InactiveTotalTime: 496435648252 - PeakMemoryUsage: 0 - RowsReturned: 26311 - RowsReturnedRate: 52 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 496454442364 Instance 3f4fc7887f663030:14 (host=redacted-host3:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 3308288 - PerHostPeakMemUsage: 76194127 - RowsProduced: 2499 - TotalNetworkReceiveTime: 498002567360 - TotalNetworkSendTime: 80116992 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 58 - TotalThreadsTotalWallClockTime: 499320244584 - TotalThreadsSysTime: 8999000 - TotalThreadsUserTime: 157976000 - TotalThreadsVoluntaryContextSwitches: 189 - TotalTime: 499735302688 Fragment Instance Lifecycle Timings - ExecTime: 164196904 - ExecTreeExecTime: 67539048 - InactiveTotalTime: 0 - OpenTime: 499177749584 - ExecTreeOpenTime: 498700748440 - PrepareTime: 393152056 - ExecTreePrepareTime: 40313760 - TotalTime: 0 DataStreamSender (dst_id=17) - BytesSent: 42001 - InactiveTotalTime: 0 - NetworkThroughput(*): 92666707 - OverallThroughput: 5189865 - PeakMemoryUsage: 122696 - RowsReturned: 2499 - SerializeBatchTime: 7571560 - TotalTime: 8092888 - TransmitDataRPCTime: 453248 - UncompressedRowBatchSize: 72499 CodeGen - CodegenTime: 43088352 - CompileTime: 32893768 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2021884 - NumFunctions: 42 - NumInstructions: 750 - OptimizationTime: 340063784 - PeakMemoryUsage: 384000 - PrepareTime: 298416968 - TotalTime: 698304504 AGGREGATION_NODE (id=15) ExecOption: Codegen Enabled - BuildTime: 149881480 - GetNewBlockTime: 9044352 - GetResultsTime: 12507840 - HTResizeTime: 90801264 - HashBuckets: 65536 - InactiveTotalTime: 0 - LargestPartitionPercent: 6 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 3238007 - PinTime: 0 - RowsRepartitioned: 0 - RowsReturned: 2499 - RowsReturnedRate: 5 - SpilledPartitions: 0 - TotalTime: 498808550664 - UnpinTime: 3800 EXCHANGE_NODE (id=14) - BytesReceived: 476418 - ConvertRowBatchTime: 5359816 - DeserializeRowBatchTimer: 223561152 - FirstBatchArrivalWaitTime: 401806760448 - InactiveTotalTime: 498001989752 - PeakMemoryUsage: 0 - RowsReturned: 26374 - RowsReturnedRate: 52 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 498008348648 Instance 3f4fc7887f663030:16 (host=redacted-host2:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 3308288 - PerHostPeakMemUsage: 75091825 - RowsProduced: 2379 - TotalNetworkReceiveTime: 495962098464 - TotalNetworkSendTime: 38291012 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 100 - TotalThreadsTotalWallClockTime: 497008495180 - TotalThreadsSysTime: 26995000 - TotalThreadsUserTime: 148978000 - TotalThreadsVoluntaryContextSwitches: 208 - TotalTime: 499647189828 Fragment Instance Lifecycle Timings - ExecTime: 86233592 - ExecTreeExecTime: 38741068 - InactiveTotalTime: 0 - OpenTime: 496950131520 - ExecTreeOpenTime: 496230143960 - PrepareTime: 2607396044 - ExecTreePrepareTime: 387981900 - TotalTime: 0 DataStreamSender (dst_id=17) - BytesSent: 39997 - InactiveTotalTime: 0 - NetworkThroughput(*): 93346247 - OverallThroughput: 2037269 - PeakMemoryUsage: 122696 - RowsReturned: 2379 - SerializeBatchTime: 1352560 - TotalTime: 19632648 - TransmitDataRPCTime: 428480 - UncompressedRowBatchSize: 69019 CodeGen - CodegenTime: 87717592 - CompileTime: 128786660 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2021884 - NumFunctions: 42 - NumInstructions: 750 - OptimizationTime: 502904112 - PeakMemoryUsage: 384000 - PrepareTime: 839454900 - TotalTime: 1493991476 AGGREGATION_NODE (id=15) ExecOption: Codegen Enabled - BuildTime: 240390244 - GetNewBlockTime: 163592224 - GetResultsTime: 10357564 - HTResizeTime: 141070068 - HashBuckets: 65536 - InactiveTotalTime: 0 - LargestPartitionPercent: 6 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 3238007 - PinTime: 0 - RowsRepartitioned: 0 - RowsReturned: 2379 - RowsReturnedRate: 4 - SpilledPartitions: 0 - TotalTime: 496656814120 - UnpinTime: 4640 EXCHANGE_NODE (id=14) - BytesReceived: 471721 - ConvertRowBatchTime: 5645204 - DeserializeRowBatchTimer: 249568384 - FirstBatchArrivalWaitTime: 399227896168 - InactiveTotalTime: 495949188688 - PeakMemoryUsage: 0 - RowsReturned: 26116 - RowsReturnedRate: 52 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 495968241432 Instance 3f4fc7887f663030:15 (host=redacted-host1:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 3308288 - PerHostPeakMemUsage: 74325388 - RowsProduced: 2429 - TotalNetworkReceiveTime: 497680038920 - TotalNetworkSendTime: 28899576 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 73 - TotalThreadsTotalWallClockTime: 498600838224 - TotalThreadsSysTime: 24996000 - TotalThreadsUserTime: 153977000 - TotalThreadsVoluntaryContextSwitches: 220 - TotalTime: 499481618920 Fragment Instance Lifecycle Timings - ExecTime: 90949104 - ExecTreeExecTime: 49348560 - InactiveTotalTime: 0 - OpenTime: 498526457936 - ExecTreeOpenTime: 497891007696 - PrepareTime: 864047920 - ExecTreePrepareTime: 96128896 - TotalTime: 0 DataStreamSender (dst_id=17) - BytesSent: 40854 - InactiveTotalTime: 0 - NetworkThroughput(*): 89166608 - OverallThroughput: 11458384 - PeakMemoryUsage: 122696 - RowsReturned: 2429 - SerializeBatchTime: 3031024 - TotalTime: 3565424 - TransmitDataRPCTime: 458176 - UncompressedRowBatchSize: 70469 CodeGen - CodegenTime: 76441056 - CompileTime: 53016888 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2021884 - NumFunctions: 42 - NumInstructions: 750 - OptimizationTime: 507508032 - PeakMemoryUsage: 384000 - PrepareTime: 446481392 - TotalTime: 1026227720 AGGREGATION_NODE (id=15) ExecOption: Codegen Enabled - BuildTime: 199068016 - GetNewBlockTime: 7958800 - GetResultsTime: 10778680 - HTResizeTime: 120133136 - HashBuckets: 65536 - InactiveTotalTime: 0 - LargestPartitionPercent: 6 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 3238007 - PinTime: 0 - RowsRepartitioned: 0 - RowsReturned: 2429 - RowsReturnedRate: 4 - SpilledPartitions: 0 - TotalTime: 498036427616 - UnpinTime: 4064 EXCHANGE_NODE (id=14) - BytesReceived: 473725 - ConvertRowBatchTime: 5456272 - DeserializeRowBatchTimer: 161218784 - FirstBatchArrivalWaitTime: 400939617640 - InactiveTotalTime: 497656802080 - PeakMemoryUsage: 0 - RowsReturned: 26225 - RowsReturnedRate: 52 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 497685907040 Instance 3f4fc7887f663030:19 (host=redacted-host4:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 3308288 - PerHostPeakMemUsage: 75532836 - RowsProduced: 2332 - TotalNetworkReceiveTime: 495390001072 - TotalNetworkSendTime: 19718016 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 125 - TotalThreadsTotalWallClockTime: 496944076912 - TotalThreadsSysTime: 11999000 - TotalThreadsUserTime: 176973000 - TotalThreadsVoluntaryContextSwitches: 271 - TotalTime: 499338774912 Fragment Instance Lifecycle Timings - ExecTime: 221331944 - ExecTreeExecTime: 177625656 - InactiveTotalTime: 0 - OpenTime: 496732937568 - ExecTreeOpenTime: 495495485352 - PrepareTime: 2384284144 - ExecTreePrepareTime: 577121160 - TotalTime: 0 DataStreamSender (dst_id=17) - BytesSent: 39261 - InactiveTotalTime: 0 - NetworkThroughput(*): 91654216 - OverallThroughput: 433062 - PeakMemoryUsage: 122696 - RowsReturned: 2332 - SerializeBatchTime: 6077984 - TotalTime: 90658928 - TransmitDataRPCTime: 428360 - UncompressedRowBatchSize: 67656 CodeGen - CodegenTime: 95988600 - CompileTime: 446415296 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2021884 - NumFunctions: 42 - NumInstructions: 750 - OptimizationTime: 603800000 - PeakMemoryUsage: 384000 - PrepareTime: 1145337688 - TotalTime: 2238103248 AGGREGATION_NODE (id=15) ExecOption: Codegen Enabled - BuildTime: 92698376 - GetNewBlockTime: 146855112 - GetResultsTime: 10088520 - HTResizeTime: 54934800 - HashBuckets: 65536 - InactiveTotalTime: 0 - LargestPartitionPercent: 6 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 3238007 - PinTime: 0 - RowsRepartitioned: 0 - RowsReturned: 2332 - RowsReturnedRate: 4 - SpilledPartitions: 0 - TotalTime: 496250165352 - UnpinTime: 4488 EXCHANGE_NODE (id=14) - BytesReceived: 473853 - ConvertRowBatchTime: 5380696 - DeserializeRowBatchTimer: 417578672 - FirstBatchArrivalWaitTime: 398432991608 - InactiveTotalTime: 495389441296 - PeakMemoryUsage: 0 - RowsReturned: 26216 - RowsReturnedRate: 52 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 495395780528 Averaged Fragment F01 split sizes: min: 2.78 GB, max: 2.80 GB, avg: 2.79 GB, stddev: 7.21 MB completion times: min:6m43s max:8m17s mean: 7m32s stddev:29s143ms execution rates: min:5.73 MB/sec max:7.07 MB/sec mean:6.34 MB/sec stddev:427.39 KB/sec num instances: 8 - AverageThreadTokens: 1.9467000586794336 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 29152853 - PerHostPeakMemUsage: 69909802 - RowsProduced: 26239 - TotalNetworkReceiveTime: 11954798084 - TotalNetworkSendTime: 2266402215 - TotalStorageWaitTime: 92013050370 - TotalThreadsInvoluntaryContextSwitches: 79128 - TotalThreadsTotalWallClockTime: 878826325840 - TotalThreadsSysTime: 2709462625 - TotalThreadsUserTime: 60476806125 - TotalThreadsVoluntaryContextSwitches: 86349 - TotalTime: 452363783056 Fragment Instance Lifecycle Timings - ExecTime: 420216395317 - ExecTreeExecTime: 417661684090 - InactiveTotalTime: 0 - OpenTime: 30411816640 - ExecTreeOpenTime: 23538744650 - PrepareTime: 1733177708 - ExecTreePrepareTime: 311295918 - TotalTime: 0 DataStreamSender (dst_id=14) - BytesSent: 474006 - InactiveTotalTime: 0 - NetworkThroughput(*): 114464909 - OverallThroughput: 15020432 - PeakMemoryUsage: 271296 - RowsReturned: 26239 - SerializeBatchTime: 25256616 - TotalTime: 35374624 - TransmitDataRPCTime: 4264300 - UncompressedRowBatchSize: 761120 CodeGen - CodegenTime: 45947660 - CompileTime: 1290344418 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2021884 - NumFunctions: 121 - NumInstructions: 7493 - OptimizationTime: 5497837897 - PeakMemoryUsage: 3836416 - PrepareTime: 500011857 - TotalTime: 7313500142 AGGREGATION_NODE (id=7) - GetNewBlockTime: 61666293 - GetResultsTime: 13712923 - HTResizeTime: 61981312 - HashBuckets: 67584 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 14180613 - PinTime: 0 - ReductionFactorEstimate: 475.6586963709801 - ReductionFactorThresholdToExpand: 1.0999999999999999 - RowsPassedThrough: 0 - RowsReturned: 26239 - RowsReturnedRate: 59 - StreamingTime: 27043166011 - TotalTime: 441511577248 - UnpinTime: 0 HASH_JOIN_NODE (id=6) - BuildRows: 229 - BuildTime: 18733786 - InactiveTotalTime: 0 - LocalTime: 1008836116 - PeakMemoryUsage: 11099517 - ProbeRows: 992224 - ProbeRowsPartitioned: 0 - ProbeTime: 141551913 - RowsReturned: 272206 - RowsReturnedRate: 661 - TotalTime: 413635118123 Hash Join Builder (join_node_id=6) - BuildRowsPartitionTime: 115004 - BuildRowsPartitioned: 229 - GetNewBlockTime: 13721841 - HashBuckets: 496 - HashCollisions: 0 - HashTablesBuildTime: 2659514 - InactiveTotalTime: 0 - LargestPartitionPercent: 8 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 1078144 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=13) - BytesReceived: 4099 - ConvertRowBatchTime: 49108 - DeserializeRowBatchTimer: 2597604 - FirstBatchArrivalWaitTime: 11776818379 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 229 - RowsReturnedRate: 21 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 11954842156 HASH_JOIN_NODE (id=5) - BuildRows: 251 - BuildTime: 23769640 - InactiveTotalTime: 0 - LocalTime: 809395717 - PeakMemoryUsage: 3160071 - ProbeRows: 4354750 - ProbeRowsPartitioned: 0 - ProbeTime: 521748146 - RowsReturned: 992224 - RowsReturnedRate: 2491 - TotalTime: 400671439851 Hash Join Builder (join_node_id=5) - BuildRowsPartitionTime: 58591 - BuildRowsPartitioned: 251 - GetNewBlockTime: 23213229 - HashBuckets: 480 - HashCollisions: 0 - HashTablesBuildTime: 229318 - InactiveTotalTime: 0 - LargestPartitionPercent: 7 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 1077888 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=12) - BytesReceived: 2832 - ConvertRowBatchTime: 49308 - DeserializeRowBatchTimer: 2982930 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 251 - RowsReturnedRate: 3759059 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 66851 HASH_JOIN_NODE (id=4) - BuildRows: 520 - BuildTime: 6107074 - InactiveTotalTime: 0 - LocalTime: 6281436178 - PeakMemoryUsage: 2070272 - ProbeRows: 61776723 - ProbeRowsPartitioned: 0 - ProbeTime: 5197159188 - RowsReturned: 4354750 - RowsReturnedRate: 10942 - TotalTime: 399861977282 Hash Join Builder (join_node_id=4) - BuildRowsPartitionTime: 192501 - BuildRowsPartitioned: 520 - GetNewBlockTime: 4314055 - HashBuckets: 1152 - HashCollisions: 0 - HashTablesBuildTime: 1330272 - InactiveTotalTime: 0 - LargestPartitionPercent: 9 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 1088640 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=11) - BytesReceived: 7274 - ConvertRowBatchTime: 102010 - DeserializeRowBatchTimer: 885968 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 520 - RowsReturnedRate: 4338736 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 119950 HDFS_SCAN_NODE (id=0) - AverageHdfsReadThreadConcurrency: 0.0025003442446909522 - AverageScannerThreadConcurrency: 1.0 - BytesRead: 181226173 - BytesReadDataNodeCache: 0 - BytesReadLocal: 181226173 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 181226173 - DecompressionTime: 11939962051 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 4 - NumDisksAccessed: 12 - NumRowGroups: 136 - NumScannerThreadsStarted: 1 - PeakMemoryUsage: 14329945 - PerReadThreadRawHdfsThroughput: 229000332 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 389288669844 - RowBatchQueuePutWaitTime: 2834108314 - RowsRead: 61776723 - RowsReturned: 61776723 - RowsReturnedRate: 157723 - ScanRangesComplete: 136 - ScannerThreadsInvoluntaryContextSwitches: 77550 - ScannerThreadsTotalWallClockTime: 428210326496 - MaterializeTupleTime(*): 245251209311 - ScannerThreadsSysTime: 1710239500 - ScannerThreadsUserTime: 51348568625 - ScannerThreadsVoluntaryContextSwitches: 29611 - TotalRawHdfsReadTime(*): 797695827 - TotalReadThroughput: 410873 - TotalTime: 393580421154 Fragment F01 Instance 3f4fc7887f663030:10 (host=redacted-host6:22000) Hdfs split stats (:<# splits>/): 3:7/145.12 MB 1:12/234.99 MB 6:11/194.16 MB 7:8/215.53 MB 4:17/384.47 MB 8:8/186.35 MB 0:17/327.23 MB 2:8/187.35 MB 5:12/237.58 MB 10:13/290.33 MB 9:13/308.22 MB 11:8/142.34 MB - AverageThreadTokens: 1.9591002044989776 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 28950979 - PerHostPeakMemUsage: 76106652 - RowsProduced: 23521 - TotalNetworkReceiveTime: 9343381100 - TotalNetworkSendTime: 95951032 - TotalStorageWaitTime: 119305746160 - TotalThreadsInvoluntaryContextSwitches: 79119 - TotalThreadsTotalWallClockTime: 971724393332 - TotalThreadsSysTime: 2747582000 - TotalThreadsUserTime: 60715769000 - TotalThreadsVoluntaryContextSwitches: 88150 - TotalTime: 497465180216 Fragment Instance Lifecycle Timings - ExecTime: 475915870652 - ExecTreeExecTime: 475666759920 - InactiveTotalTime: 0 - OpenTime: 19015019144 - ExecTreeOpenTime: 11354859732 - PrepareTime: 2534196676 - ExecTreePrepareTime: 834179460 - TotalTime: 0 DataStreamSender (dst_id=14) - BytesSent: 424960 - InactiveTotalTime: 0 - NetworkThroughput(*): 115656648 - OverallThroughput: 15653369 - PeakMemoryUsage: 271296 - RowsReturned: 23521 - SerializeBatchTime: 23378744 - TotalTime: 27148148 - TransmitDataRPCTime: 3674324 - UncompressedRowBatchSize: 682269 CodeGen - CodegenTime: 64604312 - CompileTime: 1311791872 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2021884 - NumFunctions: 121 - NumInstructions: 7493 - OptimizationTime: 6237963368 - PeakMemoryUsage: 3836416 - PrepareTime: 482899356 - TotalTime: 8034100360 AGGREGATION_NODE (id=7) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 143980424 - GetResultsTime: 13979596 - HTResizeTime: 33420932 - HashBuckets: 65536 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 14043131 - PinTime: 0 - ReductionFactorEstimate: 532.8981355161437 - ReductionFactorThresholdToExpand: 1.1 - RowsPassedThrough: 0 - RowsReturned: 23521 - RowsReturnedRate: 48 - StreamingTime: 31440905652 - TotalTime: 487855678864 - UnpinTime: 0 HASH_JOIN_NODE (id=6) ExecOption: Probe Side Codegen Enabled - BuildRows: 229 - BuildTime: 6759192 - InactiveTotalTime: 0 - LocalTime: 432831948 - PeakMemoryUsage: 11300364 - ProbeRows: 893706 - ProbeRowsPartitioned: 0 - ProbeTime: 123271196 - RowsReturned: 244245 - RowsReturnedRate: 535 - TotalTime: 456138719300 Hash Join Builder (join_node_id=6) ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 121988 - BuildRowsPartitioned: 229 - GetNewBlockTime: 1702368 - HashBuckets: 496 - HashCollisions: 0 - HashTablesBuildTime: 288680 - InactiveTotalTime: 0 - LargestPartitionPercent: 8 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 1078144 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=13) - BytesReceived: 4099 - ConvertRowBatchTime: 48500 - DeserializeRowBatchTimer: 335980 - FirstBatchArrivalWaitTime: 9122209356 - InactiveTotalTime: 9343353208 - PeakMemoryUsage: 0 - RowsReturned: 229 - RowsReturnedRate: 24 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 9343425680 HASH_JOIN_NODE (id=5) ExecOption: Probe Side Codegen Enabled - BuildRows: 251 - BuildTime: 13192364 - InactiveTotalTime: 0 - LocalTime: 719500424 - PeakMemoryUsage: 3186314 - ProbeRows: 4354796 - ProbeRowsPartitioned: 0 - ProbeTime: 527216524 - RowsReturned: 893706 - RowsReturnedRate: 2002 - TotalTime: 446362461672 Hash Join Builder (join_node_id=5) ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 50828 - BuildRowsPartitioned: 251 - GetNewBlockTime: 12697552 - HashBuckets: 480 - HashCollisions: 0 - HashTablesBuildTime: 204404 - InactiveTotalTime: 0 - LargestPartitionPercent: 7 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 1077888 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=12) - BytesReceived: 2832 - ConvertRowBatchTime: 50188 - DeserializeRowBatchTimer: 130024 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 251 - RowsReturnedRate: 3893887 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 64460 HASH_JOIN_NODE (id=4) ExecOption: Probe Side Codegen Enabled - BuildRows: 520 - BuildTime: 11394648 - InactiveTotalTime: 0 - LocalTime: 7314233368 - PeakMemoryUsage: 2070272 - ProbeRows: 61686307 - ProbeRowsPartitioned: 0 - ProbeTime: 5219801552 - RowsReturned: 4354796 - RowsReturnedRate: 9771 - TotalTime: 445642896788 Hash Join Builder (join_node_id=4) ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 228536 - BuildRowsPartitioned: 520 - GetNewBlockTime: 2953208 - HashBuckets: 1152 - HashCollisions: 0 - HashTablesBuildTime: 7942244 - InactiveTotalTime: 0 - LargestPartitionPercent: 9 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 1088640 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=11) - BytesReceived: 7274 - ConvertRowBatchTime: 101608 - DeserializeRowBatchTimer: 148988 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 520 - RowsReturnedRate: 4353358 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 119448 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 3:7/145.12 MB 1:12/234.99 MB 6:11/194.16 MB 7:8/215.53 MB 4:17/384.47 MB 8:8/186.35 MB 0:17/327.23 MB 2:8/187.35 MB 5:12/237.58 MB 10:13/290.33 MB 9:13/308.22 MB 11:8/142.34 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 134 out of 134 Hdfs Read Thread Concurrency Bucket: 0:99.89% 1:0.1066% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:536 - AverageHdfsReadThreadConcurrency: 0.0021321961620469083 - AverageScannerThreadConcurrency: 1.0 - BytesRead: 180876028 - BytesReadDataNodeCache: 0 - BytesReadLocal: 180876028 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 180876028 - DecompressionTime: 12934706116 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 4 - NumDisksAccessed: 12 - NumRowGroups: 134 - NumScannerThreadsStarted: 1 - PeakMemoryUsage: 14568605 - PerReadThreadRawHdfsThroughput: 237628159 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 431705617104 - RowBatchQueuePutWaitTime: 2626737904 - RowsRead: 61686307 - RowsReturned: 61686307 - RowsReturnedRate: 140730 - ScanRangesComplete: 134 - ScannerThreadsInvoluntaryContextSwitches: 77076 - ScannerThreadsTotalWallClockTime: 476793816856 - MaterializeTupleTime(*): 263046743100 - ScannerThreadsSysTime: 1647749000 - ScannerThreadsUserTime: 51605154000 - ScannerThreadsVoluntaryContextSwitches: 31209 - TotalRawHdfsReadTime(*): 761172532 - TotalReadThroughput: 370848 - TotalTime: 438328543972 Instance 3f4fc7887f663030:11 (host=redacted-host4:22000) Hdfs split stats (:<# splits>/): 1:16/327.02 MB 0:16/312.59 MB 9:8/156.09 MB 6:13/276.39 MB 10:12/220.43 MB 2:9/169.15 MB 7:12/267.22 MB 4:15/286.00 MB 11:6/132.65 MB 5:17/372.34 MB 8:8/158.27 MB 3:9/169.67 MB - AverageThreadTokens: 1.9533404029692472 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 28468472 - PerHostPeakMemUsage: 75532836 - RowsProduced: 29128 - TotalNetworkReceiveTime: 5250814752 - TotalNetworkSendTime: 62924336 - TotalStorageWaitTime: 115264795440 - TotalThreadsInvoluntaryContextSwitches: 73720 - TotalThreadsTotalWallClockTime: 929042315288 - TotalThreadsSysTime: 2588607000 - TotalThreadsUserTime: 59700925000 - TotalThreadsVoluntaryContextSwitches: 87606 - TotalTime: 477409312224 Fragment Instance Lifecycle Timings - ExecTime: 456080365168 - ExecTreeExecTime: 455472643832 - InactiveTotalTime: 0 - OpenTime: 18085696768 - ExecTreeOpenTime: 6083084456 - PrepareTime: 3226448400 - ExecTreePrepareTime: 762036920 - TotalTime: 0 DataStreamSender (dst_id=14) - BytesSent: 526313 - InactiveTotalTime: 0 - NetworkThroughput(*): 123526542 - OverallThroughput: 14446318 - PeakMemoryUsage: 271296 - RowsReturned: 29128 - SerializeBatchTime: 32072712 - TotalTime: 36432328 - TransmitDataRPCTime: 4260728 - UncompressedRowBatchSize: 844904 CodeGen - CodegenTime: 117942160 - CompileTime: 2479498928 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2021884 - NumFunctions: 121 - NumInstructions: 7493 - OptimizationTime: 9470737696 - PeakMemoryUsage: 3836416 - PrepareTime: 1023229040 - TotalTime: 13049391688 AGGREGATION_NODE (id=7) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 120354736 - GetResultsTime: 13016336 - HTResizeTime: 26416792 - HashBuckets: 65536 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 14295752 - PinTime: 0 - ReductionFactorEstimate: 520.8816866659191 - ReductionFactorThresholdToExpand: 1.1 - RowsPassedThrough: 0 - RowsReturned: 29128 - RowsReturnedRate: 63 - StreamingTime: 27647327040 - TotalTime: 462317385144 - UnpinTime: 0 HASH_JOIN_NODE (id=6) ExecOption: Probe Side Codegen Enabled - BuildRows: 229 - BuildTime: 3542392 - InactiveTotalTime: 0 - LocalTime: 462881824 - PeakMemoryUsage: 11262661 - ProbeRows: 1106942 - ProbeRowsPartitioned: 0 - ProbeTime: 155233264 - RowsReturned: 302033 - RowsReturnedRate: 696 - TotalTime: 433558627080 Hash Join Builder (join_node_id=6) ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 115344 - BuildRowsPartitioned: 229 - GetNewBlockTime: 2583144 - HashBuckets: 496 - HashCollisions: 0 - HashTablesBuildTime: 362320 - InactiveTotalTime: 0 - LargestPartitionPercent: 8 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 1078144 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=13) - BytesReceived: 4099 - ConvertRowBatchTime: 47408 - DeserializeRowBatchTimer: 81488 - FirstBatchArrivalWaitTime: 5016110864 - InactiveTotalTime: 5250783224 - PeakMemoryUsage: 0 - RowsReturned: 229 - RowsReturnedRate: 43 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 5250855712 HASH_JOIN_NODE (id=5) ExecOption: Probe Side Codegen Enabled - BuildRows: 251 - BuildTime: 42427392 - InactiveTotalTime: 0 - LocalTime: 959949256 - PeakMemoryUsage: 3064804 - ProbeRows: 4333369 - ProbeRowsPartitioned: 0 - ProbeTime: 519586872 - RowsReturned: 1106942 - RowsReturnedRate: 2587 - TotalTime: 427844889544 Hash Join Builder (join_node_id=5) ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 61080 - BuildRowsPartitioned: 251 - GetNewBlockTime: 41877752 - HashBuckets: 480 - HashCollisions: 0 - HashTablesBuildTime: 217616 - InactiveTotalTime: 0 - LargestPartitionPercent: 7 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 1077888 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=12) - BytesReceived: 2832 - ConvertRowBatchTime: 50440 - DeserializeRowBatchTimer: 33568 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 251 - RowsReturnedRate: 3579169 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 70128 HASH_JOIN_NODE (id=4) ExecOption: Probe Side Codegen Enabled - BuildRows: 520 - BuildTime: 919664 - InactiveTotalTime: 0 - LocalTime: 6791422568 - PeakMemoryUsage: 2070272 - ProbeRows: 61491771 - ProbeRowsPartitioned: 0 - ProbeTime: 5275068032 - RowsReturned: 4333369 - RowsReturnedRate: 10151 - TotalTime: 426884870160 Hash Join Builder (join_node_id=4) ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 176736 - BuildRowsPartitioned: 520 - GetNewBlockTime: 132832 - HashBuckets: 1152 - HashCollisions: 0 - HashTablesBuildTime: 380712 - InactiveTotalTime: 0 - LargestPartitionPercent: 9 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 1088640 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=11) - BytesReceived: 7274 - ConvertRowBatchTime: 101336 - DeserializeRowBatchTimer: 196720 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 520 - RowsReturnedRate: 4440497 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 117104 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 1:16/327.02 MB 0:16/312.59 MB 9:8/156.09 MB 6:13/276.39 MB 10:12/220.43 MB 2:9/169.15 MB 7:12/267.22 MB 4:15/286.00 MB 11:6/132.65 MB 5:17/372.34 MB 8:8/158.27 MB 3:9/169.67 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 141 out of 141 Hdfs Read Thread Concurrency Bucket: 0:99.89% 1:0% 2:0.1112% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:564 - AverageHdfsReadThreadConcurrency: 0.0033370411568409346 - AverageScannerThreadConcurrency: 1.0 - BytesRead: 180592498 - BytesReadDataNodeCache: 0 - BytesReadLocal: 180592498 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 180592498 - DecompressionTime: 12323307120 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 4 - NumDisksAccessed: 12 - NumRowGroups: 141 - NumScannerThreadsStarted: 1 - PeakMemoryUsage: 12796194 - PerReadThreadRawHdfsThroughput: 209474686 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 416277576088 - RowBatchQueuePutWaitTime: 2364065104 - RowsRead: 61491771 - RowsReturned: 61491771 - RowsReturnedRate: 146376 - ScanRangesComplete: 141 - ScannerThreadsInvoluntaryContextSwitches: 71736 - ScannerThreadsTotalWallClockTime: 454883566024 - MaterializeTupleTime(*): 245677388544 - ScannerThreadsSysTime: 1624753000 - ScannerThreadsUserTime: 50371343000 - ScannerThreadsVoluntaryContextSwitches: 30860 - TotalRawHdfsReadTime(*): 862120864 - TotalReadThroughput: 384465 - TotalTime: 420093330488 Instance 3f4fc7887f663030:b (host=redacted-host7:22000) Hdfs split stats (:<# splits>/): 9:9/227.87 MB 0:14/274.43 MB 8:12/266.82 MB 2:16/343.09 MB 11:7/145.25 MB 1:16/271.10 MB 6:8/214.95 MB 4:14/259.78 MB 3:8/172.24 MB 10:10/168.20 MB 7:13/277.63 MB 5:12/236.21 MB - AverageThreadTokens: 1.9518201284796575 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 29402965 - PerHostPeakMemUsage: 74453900 - RowsProduced: 25160 - TotalNetworkReceiveTime: 14947887128 - TotalNetworkSendTime: 63358272 - TotalStorageWaitTime: 98365482792 - TotalThreadsInvoluntaryContextSwitches: 80745 - TotalThreadsTotalWallClockTime: 925060662336 - TotalThreadsSysTime: 2702589000 - TotalThreadsUserTime: 60617785000 - TotalThreadsVoluntaryContextSwitches: 87652 - TotalTime: 474373883248 Fragment Instance Lifecycle Timings - ExecTime: 445050887008 - ExecTreeExecTime: 444758027520 - InactiveTotalTime: 0 - OpenTime: 28186970272 - ExecTreeOpenTime: 23154567784 - PrepareTime: 1135923264 - ExecTreePrepareTime: 110169184 - TotalTime: 0 DataStreamSender (dst_id=14) - BytesSent: 454185 - InactiveTotalTime: 0 - NetworkThroughput(*): 120290709 - OverallThroughput: 5951622 - PeakMemoryUsage: 271296 - RowsReturned: 25160 - SerializeBatchTime: 49932408 - TotalTime: 76312800 - TransmitDataRPCTime: 3775728 - UncompressedRowBatchSize: 729800 CodeGen - CodegenTime: 32859176 - CompileTime: 1125195968 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2021884 - NumFunctions: 121 - NumInstructions: 7493 - OptimizationTime: 3781016840 - PeakMemoryUsage: 3836416 - PrepareTime: 376707936 - TotalTime: 5321923520 AGGREGATION_NODE (id=7) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 42398728 - GetResultsTime: 14401824 - HTResizeTime: 90140648 - HashBuckets: 65536 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 15519684 - PinTime: 0 - ReductionFactorEstimate: 515.5960442507543 - ReductionFactorThresholdToExpand: 1.1 - RowsPassedThrough: 0 - RowsReturned: 25160 - RowsReturnedRate: 53 - StreamingTime: 29394637656 - TotalTime: 468022659024 - UnpinTime: 0 HASH_JOIN_NODE (id=6) ExecOption: Probe Side Codegen Enabled - BuildRows: 229 - BuildTime: 29864464 - InactiveTotalTime: 0 - LocalTime: 758603000 - PeakMemoryUsage: 11388068 - ProbeRows: 956505 - ProbeRowsPartitioned: 0 - ProbeTime: 148775544 - RowsReturned: 261288 - RowsReturnedRate: 597 - TotalTime: 437649095008 Hash Join Builder (join_node_id=6) ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 120264 - BuildRowsPartitioned: 229 - GetNewBlockTime: 28702976 - HashBuckets: 496 - HashCollisions: 0 - HashTablesBuildTime: 354280 - InactiveTotalTime: 0 - LargestPartitionPercent: 8 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 1078144 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=13) - BytesReceived: 4099 - ConvertRowBatchTime: 52152 - DeserializeRowBatchTimer: 19732720 - FirstBatchArrivalWaitTime: 14799763032 - InactiveTotalTime: 14947857520 - PeakMemoryUsage: 0 - RowsReturned: 229 - RowsReturnedRate: 15 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 14947935608 HASH_JOIN_NODE (id=5) ExecOption: Probe Side Codegen Enabled - BuildRows: 251 - BuildTime: 4323776 - InactiveTotalTime: 0 - LocalTime: 741984752 - PeakMemoryUsage: 3171471 - ProbeRows: 4354897 - ProbeRowsPartitioned: 0 - ProbeTime: 520486208 - RowsReturned: 956505 - RowsReturnedRate: 2266 - TotalTime: 421942556400 Hash Join Builder (join_node_id=5) ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 54680 - BuildRowsPartitioned: 251 - GetNewBlockTime: 3736904 - HashBuckets: 480 - HashCollisions: 0 - HashTablesBuildTime: 215032 - InactiveTotalTime: 0 - LargestPartitionPercent: 7 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 1077888 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=12) - BytesReceived: 2832 - ConvertRowBatchTime: 49080 - DeserializeRowBatchTimer: 25000 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 251 - RowsReturnedRate: 3732453 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 67248 HASH_JOIN_NODE (id=4) ExecOption: Probe Side Codegen Enabled - BuildRows: 520 - BuildTime: 903520 - InactiveTotalTime: 0 - LocalTime: 5898004616 - PeakMemoryUsage: 2070272 - ProbeRows: 61724663 - ProbeRowsPartitioned: 0 - ProbeTime: 5118762528 - RowsReturned: 4354897 - RowsReturnedRate: 10339 - TotalTime: 421200504400 Hash Join Builder (join_node_id=4) ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 178704 - BuildRowsPartitioned: 520 - GetNewBlockTime: 117616 - HashBuckets: 1152 - HashCollisions: 0 - HashTablesBuildTime: 378304 - InactiveTotalTime: 0 - LargestPartitionPercent: 9 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 1088640 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=11) - BytesReceived: 7274 - ConvertRowBatchTime: 100768 - DeserializeRowBatchTimer: 174880 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 520 - RowsReturnedRate: 4391595 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 118408 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 9:9/227.87 MB 0:14/274.43 MB 8:12/266.82 MB 2:16/343.09 MB 11:7/145.25 MB 1:16/271.10 MB 6:8/214.95 MB 4:14/259.78 MB 3:8/172.24 MB 10:10/168.20 MB 7:13/277.63 MB 5:12/236.21 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 139 out of 139 Hdfs Read Thread Concurrency Bucket: 0:99.66% 1:0.3375% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:556 - AverageHdfsReadThreadConcurrency: 0.0022497187851518562 - AverageScannerThreadConcurrency: 1.0 - BytesRead: 181206489 - BytesReadDataNodeCache: 0 - BytesReadLocal: 181206489 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 181206489 - DecompressionTime: 13245756936 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 4 - NumDisksAccessed: 12 - NumRowGroups: 139 - NumScannerThreadsStarted: 1 - PeakMemoryUsage: 14564489 - PerReadThreadRawHdfsThroughput: 198993920 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 412229230792 - RowBatchQueuePutWaitTime: 3163275744 - RowsRead: 61724663 - RowsReturned: 61724663 - RowsReturnedRate: 148625 - ScanRangesComplete: 139 - ScannerThreadsInvoluntaryContextSwitches: 79446 - ScannerThreadsTotalWallClockTime: 451823183544 - MaterializeTupleTime(*): 254489172288 - ScannerThreadsSysTime: 1676745000 - ScannerThreadsUserTime: 51557162000 - ScannerThreadsVoluntaryContextSwitches: 30416 - TotalRawHdfsReadTime(*): 910613192 - TotalReadThroughput: 389074 - TotalTime: 415302381376 Instance 3f4fc7887f663030:c (host=redacted-host3:22000) Hdfs split stats (:<# splits>/): 5:12/279.98 MB 6:12/264.26 MB 7:8/142.35 MB 0:12/264.94 MB 8:14/319.68 MB 2:13/233.88 MB 4:11/194.32 MB 1:12/222.73 MB 11:14/333.26 MB 10:11/223.09 MB 3:10/182.97 MB 9:12/207.76 MB - AverageThreadTokens: 1.9282560706401766 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 29091031 - PerHostPeakMemUsage: 76194127 - RowsProduced: 29540 - TotalNetworkReceiveTime: 15792128320 - TotalNetworkSendTime: 11475758496 - TotalStorageWaitTime: 91202032392 - TotalThreadsInvoluntaryContextSwitches: 81832 - TotalThreadsTotalWallClockTime: 887377670408 - TotalThreadsSysTime: 2800574000 - TotalThreadsUserTime: 60639782000 - TotalThreadsVoluntaryContextSwitches: 85773 - TotalTime: 461135583280 Fragment Instance Lifecycle Timings - ExecTime: 409779553040 - ExecTreeExecTime: 397859372968 - InactiveTotalTime: 0 - OpenTime: 49839627512 - ExecTreeOpenTime: 46300044560 - PrepareTime: 1516262688 - ExecTreePrepareTime: 88499216 - TotalTime: 0 DataStreamSender (dst_id=14) - BytesSent: 533675 - InactiveTotalTime: 0 - NetworkThroughput(*): 78583313 - OverallThroughput: 20778467 - PeakMemoryUsage: 271296 - RowsReturned: 29540 - SerializeBatchTime: 18739632 - TotalTime: 25684040 - TransmitDataRPCTime: 6791200 - UncompressedRowBatchSize: 856852 CodeGen - CodegenTime: 9786136 - CompileTime: 479963648 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2021884 - NumFunctions: 121 - NumInstructions: 7493 - OptimizationTime: 3021734752 - PeakMemoryUsage: 3836416 - PrepareTime: 273530360 - TotalTime: 3775947616 AGGREGATION_NODE (id=7) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 2529616 - GetResultsTime: 14644176 - HTResizeTime: 73454256 - HashBuckets: 65536 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 13377591 - PinTime: 0 - ReductionFactorEstimate: 513.4022469434959 - ReductionFactorThresholdToExpand: 1.1 - RowsPassedThrough: 0 - RowsReturned: 29540 - RowsReturnedRate: 66 - StreamingTime: 25144480936 - TotalTime: 444247806048 - UnpinTime: 0 HASH_JOIN_NODE (id=6) ExecOption: Probe Side Codegen Enabled - BuildRows: 229 - BuildTime: 2972408 - InactiveTotalTime: 0 - LocalTime: 1421239720 - PeakMemoryUsage: 10486068 - ProbeRows: 1112198 - ProbeRowsPartitioned: 0 - ProbeTime: 153201752 - RowsReturned: 306610 - RowsReturnedRate: 732 - TotalTime: 418579912048 Hash Join Builder (join_node_id=6) ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 103112 - BuildRowsPartitioned: 229 - GetNewBlockTime: 2063568 - HashBuckets: 496 - HashCollisions: 0 - HashTablesBuildTime: 270840 - InactiveTotalTime: 0 - LargestPartitionPercent: 8 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 1078144 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=13) - BytesReceived: 4099 - ConvertRowBatchTime: 47000 - DeserializeRowBatchTimer: 81448 - FirstBatchArrivalWaitTime: 15567687928 - InactiveTotalTime: 15792099960 - PeakMemoryUsage: 0 - RowsReturned: 229 - RowsReturnedRate: 14 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 15792169496 HASH_JOIN_NODE (id=5) ExecOption: Probe Side Codegen Enabled - BuildRows: 251 - BuildTime: 17183760 - InactiveTotalTime: 0 - LocalTime: 741982296 - PeakMemoryUsage: 3161520 - ProbeRows: 4367594 - ProbeRowsPartitioned: 0 - ProbeTime: 525470920 - RowsReturned: 1112198 - RowsReturnedRate: 2771 - TotalTime: 401366502832 Hash Join Builder (join_node_id=5) ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 62320 - BuildRowsPartitioned: 251 - GetNewBlockTime: 16585952 - HashBuckets: 480 - HashCollisions: 0 - HashTablesBuildTime: 249864 - InactiveTotalTime: 0 - LargestPartitionPercent: 7 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 1077888 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=12) - BytesReceived: 2832 - ConvertRowBatchTime: 47712 - DeserializeRowBatchTimer: 31184 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 251 - RowsReturnedRate: 3917957 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 64064 HASH_JOIN_NODE (id=4) ExecOption: Probe Side Codegen Enabled - BuildRows: 520 - BuildTime: 8495664 - InactiveTotalTime: 0 - LocalTime: 6061510872 - PeakMemoryUsage: 2070272 - ProbeRows: 61962462 - ProbeRowsPartitioned: 0 - ProbeTime: 5173593808 - RowsReturned: 4367594 - RowsReturnedRate: 10901 - TotalTime: 400624456472 Hash Join Builder (join_node_id=4) ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 215480 - BuildRowsPartitioned: 520 - GetNewBlockTime: 7582800 - HashBuckets: 1152 - HashCollisions: 0 - HashTablesBuildTime: 375680 - InactiveTotalTime: 0 - LargestPartitionPercent: 9 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 1088640 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=11) - BytesReceived: 7274 - ConvertRowBatchTime: 95968 - DeserializeRowBatchTimer: 5924792 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 520 - RowsReturnedRate: 4514829 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 115176 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 5:12/279.98 MB 6:12/264.26 MB 7:8/142.35 MB 0:12/264.94 MB 8:14/319.68 MB 2:13/233.88 MB 4:11/194.32 MB 1:12/222.73 MB 11:14/333.26 MB 10:11/223.09 MB 3:10/182.97 MB 9:12/207.76 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 141 out of 141 Hdfs Read Thread Concurrency Bucket: 0:99.64% 1:0.3567% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:564 - AverageHdfsReadThreadConcurrency: 0.0035671819262782403 - AverageScannerThreadConcurrency: 1.0 - BytesRead: 181872584 - BytesReadDataNodeCache: 0 - BytesReadLocal: 181872584 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 181872584 - DecompressionTime: 11113303488 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 4 - NumDisksAccessed: 12 - NumRowGroups: 141 - NumScannerThreadsStarted: 1 - PeakMemoryUsage: 14567679 - PerReadThreadRawHdfsThroughput: 223849556 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 391305501208 - RowBatchQueuePutWaitTime: 3551819608 - RowsRead: 61962462 - RowsReturned: 61962462 - RowsReturnedRate: 157040 - ScanRangesComplete: 141 - ScannerThreadsInvoluntaryContextSwitches: 80743 - ScannerThreadsTotalWallClockTime: 427762811016 - MaterializeTupleTime(*): 244267105592 - ScannerThreadsSysTime: 1798726000 - ScannerThreadsUserTime: 51626152000 - ScannerThreadsVoluntaryContextSwitches: 28807 - TotalRawHdfsReadTime(*): 812476856 - TotalReadThroughput: 412598 - TotalTime: 394562830424 Instance 3f4fc7887f663030:e (host=redacted-host2:22000) Hdfs split stats (:<# splits>/): 2:11/223.74 MB 0:12/264.11 MB 10:5/61.57 MB 3:14/303.91 MB 4:14/290.72 MB 6:8/157.20 MB 1:13/291.60 MB 7:9/156.04 MB 9:15/415.36 MB 8:9/255.22 MB 11:7/130.97 MB 5:15/315.72 MB - AverageThreadTokens: 1.9400452488687783 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 30056821 - PerHostPeakMemUsage: 75091825 - RowsProduced: 26520 - TotalNetworkReceiveTime: 6994691212 - TotalNetworkSendTime: 4220119312 - TotalStorageWaitTime: 89992421580 - TotalThreadsInvoluntaryContextSwitches: 78847 - TotalThreadsTotalWallClockTime: 865232286600 - TotalThreadsSysTime: 2706587000 - TotalThreadsUserTime: 60173852000 - TotalThreadsVoluntaryContextSwitches: 87008 - TotalTime: 447205551720 Fragment Instance Lifecycle Timings - ExecTime: 405434252204 - ExecTreeExecTime: 400948259316 - InactiveTotalTime: 0 - OpenTime: 39672555804 - ExecTreeOpenTime: 28245652464 - PrepareTime: 2097048228 - ExecTreePrepareTime: 436031124 - TotalTime: 0 DataStreamSender (dst_id=14) - BytesSent: 479497 - InactiveTotalTime: 0 - NetworkThroughput(*): 125117942 - OverallThroughput: 13833356 - PeakMemoryUsage: 271296 - RowsReturned: 26520 - SerializeBatchTime: 13714732 - TotalTime: 34662376 - TransmitDataRPCTime: 3832360 - UncompressedRowBatchSize: 769264 CodeGen - CodegenTime: 16405740 - CompileTime: 1595062984 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2021884 - NumFunctions: 121 - NumInstructions: 7493 - OptimizationTime: 9719632544 - PeakMemoryUsage: 3836416 - PrepareTime: 477081488 - TotalTime: 11850086528 AGGREGATION_NODE (id=7) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 98329000 - GetResultsTime: 9429672 - HTResizeTime: 80656248 - HashBuckets: 65536 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 14734981 - PinTime: 0 - ReductionFactorEstimate: 527.9058971141782 - ReductionFactorThresholdToExpand: 1.1 - RowsPassedThrough: 0 - RowsReturned: 26520 - RowsReturnedRate: 61 - StreamingTime: 26316716056 - TotalTime: 429629830124 - UnpinTime: 0 HASH_JOIN_NODE (id=6) ExecOption: Probe Side Codegen Enabled - BuildRows: 229 - BuildTime: 21764308 - InactiveTotalTime: 0 - LocalTime: 2130363484 - PeakMemoryUsage: 11094368 - ProbeRows: 1002095 - ProbeRowsPartitioned: 0 - ProbeTime: 145381212 - RowsReturned: 274404 - RowsReturnedRate: 683 - TotalTime: 401467572132 Hash Join Builder (join_node_id=6) ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 109488 - BuildRowsPartitioned: 229 - GetNewBlockTime: 11089380 - HashBuckets: 496 - HashCollisions: 0 - HashTablesBuildTime: 329296 - InactiveTotalTime: 0 - LargestPartitionPercent: 8 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 1078144 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=13) - BytesReceived: 4099 - ConvertRowBatchTime: 49200 - DeserializeRowBatchTimer: 80544 - FirstBatchArrivalWaitTime: 6825675404 - InactiveTotalTime: 6994658688 - PeakMemoryUsage: 0 - RowsReturned: 229 - RowsReturnedRate: 32 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 6994736016 HASH_JOIN_NODE (id=5) ExecOption: Probe Side Codegen Enabled - BuildRows: 251 - BuildTime: 54444392 - InactiveTotalTime: 0 - LocalTime: 1032169172 - PeakMemoryUsage: 3220158 - ProbeRows: 4368740 - ProbeRowsPartitioned: 0 - ProbeTime: 513906132 - RowsReturned: 1002095 - RowsReturnedRate: 2554 - TotalTime: 392342472632 Hash Join Builder (join_node_id=5) ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 50172 - BuildRowsPartitioned: 251 - GetNewBlockTime: 53974200 - HashBuckets: 480 - HashCollisions: 0 - HashTablesBuildTime: 218104 - InactiveTotalTime: 0 - LargestPartitionPercent: 7 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 1077888 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=12) - BytesReceived: 2832 - ConvertRowBatchTime: 49916 - DeserializeRowBatchTimer: 23550616 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 251 - RowsReturnedRate: 3692696 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 67972 HASH_JOIN_NODE (id=4) ExecOption: Probe Side Codegen Enabled - BuildRows: 520 - BuildTime: 14530144 - InactiveTotalTime: 0 - LocalTime: 6109769120 - PeakMemoryUsage: 2070272 - ProbeRows: 61980494 - ProbeRowsPartitioned: 0 - ProbeTime: 5173562856 - RowsReturned: 4368740 - RowsReturnedRate: 11164 - TotalTime: 391310235488 Hash Join Builder (join_node_id=4) ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 196224 - BuildRowsPartitioned: 520 - GetNewBlockTime: 13678228 - HashBuckets: 1152 - HashCollisions: 0 - HashTablesBuildTime: 399532 - InactiveTotalTime: 0 - LargestPartitionPercent: 9 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 1088640 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=11) - BytesReceived: 7274 - ConvertRowBatchTime: 105080 - DeserializeRowBatchTimer: 165744 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 520 - RowsReturnedRate: 4237840 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 122704 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 2:11/223.74 MB 0:12/264.11 MB 10:5/61.57 MB 3:14/303.91 MB 4:14/290.72 MB 6:8/157.20 MB 1:13/291.60 MB 7:9/156.04 MB 9:15/415.36 MB 8:9/255.22 MB 11:7/130.97 MB 5:15/315.72 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 132 out of 132 Hdfs Read Thread Concurrency Bucket: 0:99.76% 1:0.2407% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:528 - AverageHdfsReadThreadConcurrency: 0.0036101083032490976 - AverageScannerThreadConcurrency: 1.0 - BytesRead: 181771354 - BytesReadDataNodeCache: 0 - BytesReadLocal: 181771354 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 181771354 - DecompressionTime: 11601558844 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 4 - NumDisksAccessed: 12 - NumRowGroups: 132 - NumScannerThreadsStarted: 1 - PeakMemoryUsage: 14504640 - PerReadThreadRawHdfsThroughput: 256628482 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 381221959692 - RowBatchQueuePutWaitTime: 1454405740 - RowsRead: 61980494 - RowsReturned: 61980494 - RowsReturnedRate: 160904 - ScanRangesComplete: 132 - ScannerThreadsInvoluntaryContextSwitches: 76775 - ScannerThreadsTotalWallClockTime: 420151740092 - MaterializeTupleTime(*): 242709075708 - ScannerThreadsSysTime: 1718738000 - ScannerThreadsUserTime: 51192217000 - ScannerThreadsVoluntaryContextSwitches: 30302 - TotalRawHdfsReadTime(*): 708305456 - TotalReadThroughput: 417188 - TotalTime: 385200343664 Instance 3f4fc7887f663030:d (host=redacted-host1:22000) Hdfs split stats (:<# splits>/): 8:7/145.56 MB 10:10/166.30 MB 2:12/250.88 MB 7:11/224.67 MB 6:11/295.95 MB 1:13/336.57 MB 4:14/245.80 MB 3:11/252.27 MB 0:12/280.17 MB 11:12/249.98 MB 9:9/183.13 MB 5:12/235.13 MB - AverageThreadTokens: 1.9487776484284052 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 29239069 - PerHostPeakMemUsage: 74325388 - RowsProduced: 20327 - TotalNetworkReceiveTime: 14998019120 - TotalNetworkSendTime: 99231760 - TotalStorageWaitTime: 78621513368 - TotalThreadsInvoluntaryContextSwitches: 79916 - TotalThreadsTotalWallClockTime: 843161463352 - TotalThreadsSysTime: 2479622000 - TotalThreadsUserTime: 59916891000 - TotalThreadsVoluntaryContextSwitches: 85650 - TotalTime: 433299799408 Fragment Instance Lifecycle Timings - ExecTime: 392655030352 - ExecTreeExecTime: 392239543808 - InactiveTotalTime: 0 - OpenTime: 39690858696 - ExecTreeOpenTime: 34591579504 - PrepareTime: 953828424 - ExecTreePrepareTime: 54544976 - TotalTime: 0 DataStreamSender (dst_id=14) - BytesSent: 366997 - InactiveTotalTime: 0 - NetworkThroughput(*): 124463142 - OverallThroughput: 16137217 - PeakMemoryUsage: 271296 - RowsReturned: 20327 - SerializeBatchTime: 19674752 - TotalTime: 22742272 - TransmitDataRPCTime: 2948640 - UncompressedRowBatchSize: 589611 CodeGen - CodegenTime: 27703552 - CompileTime: 1006440032 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2021884 - NumFunctions: 121 - NumInstructions: 7493 - OptimizationTime: 4011359616 - PeakMemoryUsage: 3836416 - PrepareTime: 367331392 - TotalTime: 5390389568 AGGREGATION_NODE (id=7) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 26907824 - GetResultsTime: 14671560 - HTResizeTime: 179057536 - HashBuckets: 65536 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 14080314 - PinTime: 0 - ReductionFactorEstimate: 521.2898469158038 - ReductionFactorThresholdToExpand: 1.1 - RowsPassedThrough: 0 - RowsReturned: 20327 - RowsReturnedRate: 47 - StreamingTime: 25611323104 - TotalTime: 426885557920 - UnpinTime: 0 HASH_JOIN_NODE (id=6) ExecOption: Probe Side Codegen Enabled - BuildRows: 229 - BuildTime: 41485360 - InactiveTotalTime: 0 - LocalTime: 1806587592 - PeakMemoryUsage: 11225067 - ProbeRows: 767174 - ProbeRowsPartitioned: 0 - ProbeTime: 104666768 - RowsReturned: 210629 - RowsReturnedRate: 526 - TotalTime: 400401203072 Hash Join Builder (join_node_id=6) ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 112976 - BuildRowsPartitioned: 229 - GetNewBlockTime: 40644616 - HashBuckets: 496 - HashCollisions: 0 - HashTablesBuildTime: 304912 - InactiveTotalTime: 0 - LargestPartitionPercent: 8 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 1078144 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=13) - BytesReceived: 4099 - ConvertRowBatchTime: 44216 - DeserializeRowBatchTimer: 114272 - FirstBatchArrivalWaitTime: 14819395136 - InactiveTotalTime: 14997989296 - PeakMemoryUsage: 0 - RowsReturned: 229 - RowsReturnedRate: 15 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 14998056944 HASH_JOIN_NODE (id=5) ExecOption: Probe Side Codegen Enabled - BuildRows: 251 - BuildTime: 29073520 - InactiveTotalTime: 0 - LocalTime: 710195464 - PeakMemoryUsage: 3181584 - ProbeRows: 4365887 - ProbeRowsPartitioned: 0 - ProbeTime: 493972960 - RowsReturned: 767174 - RowsReturnedRate: 1999 - TotalTime: 383596558536 Hash Join Builder (join_node_id=5) ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 63240 - BuildRowsPartitioned: 251 - GetNewBlockTime: 28377392 - HashBuckets: 480 - HashCollisions: 0 - HashTablesBuildTime: 275632 - InactiveTotalTime: 0 - LargestPartitionPercent: 7 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 1077888 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=12) - BytesReceived: 2832 - ConvertRowBatchTime: 47432 - DeserializeRowBatchTimer: 30416 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 251 - RowsReturnedRate: 3855843 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 65096 HASH_JOIN_NODE (id=4) ExecOption: Probe Side Codegen Enabled - BuildRows: 520 - BuildTime: 1069736 - InactiveTotalTime: 0 - LocalTime: 6075609232 - PeakMemoryUsage: 2070272 - ProbeRows: 61976722 - ProbeRowsPartitioned: 0 - ProbeTime: 5191213192 - RowsReturned: 4365887 - RowsReturnedRate: 11402 - TotalTime: 382886297976 Hash Join Builder (join_node_id=4) ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 180944 - BuildRowsPartitioned: 520 - GetNewBlockTime: 162656 - HashBuckets: 1152 - HashCollisions: 0 - HashTablesBuildTime: 415120 - InactiveTotalTime: 0 - LargestPartitionPercent: 9 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 1088640 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=11) - BytesReceived: 7274 - ConvertRowBatchTime: 105504 - DeserializeRowBatchTimer: 161440 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 520 - RowsReturnedRate: 4196526 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 123912 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 8:7/145.56 MB 10:10/166.30 MB 2:12/250.88 MB 7:11/224.67 MB 6:11/295.95 MB 1:13/336.57 MB 4:14/245.80 MB 3:11/252.27 MB 0:12/280.17 MB 11:12/249.98 MB 9:9/183.13 MB 5:12/235.13 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 134 out of 134 Hdfs Read Thread Concurrency Bucket: 0:99.88% 1:0.1227% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:536 - AverageHdfsReadThreadConcurrency: 0.00245398773006135 - AverageScannerThreadConcurrency: 1.0 - BytesRead: 181506059 - BytesReadDataNodeCache: 0 - BytesReadLocal: 181506059 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 181506059 - DecompressionTime: 12067712448 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 4 - NumDisksAccessed: 12 - NumRowGroups: 134 - NumScannerThreadsStarted: 1 - PeakMemoryUsage: 14513341 - PerReadThreadRawHdfsThroughput: 259863158 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 372282171296 - RowBatchQueuePutWaitTime: 2734636592 - RowsRead: 61976722 - RowsReturned: 61976722 - RowsReturnedRate: 164477 - ScanRangesComplete: 134 - ScannerThreadsInvoluntaryContextSwitches: 78679 - ScannerThreadsTotalWallClockTime: 410856982432 - MaterializeTupleTime(*): 245217561824 - ScannerThreadsSysTime: 1546764000 - ScannerThreadsUserTime: 50880265000 - ScannerThreadsVoluntaryContextSwitches: 29452 - TotalRawHdfsReadTime(*): 698467840 - TotalReadThroughput: 423851 - TotalTime: 376810564832 Instance 3f4fc7887f663030:12 (host=redacted-host5:22000) Hdfs split stats (:<# splits>/): 9:9/183.22 MB 10:9/155.38 MB 1:13/262.48 MB 6:14/317.38 MB 2:9/183.93 MB 11:8/199.99 MB 3:6/162.73 MB 4:10/211.75 MB 7:11/238.69 MB 0:15/301.75 MB 5:15/259.20 MB 8:15/375.56 MB - AverageThreadTokens: 1.9497607655502391 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 28814789 - PerHostPeakMemUsage: 75932085 - RowsProduced: 23304 - TotalNetworkReceiveTime: 13859421752 - TotalNetworkSendTime: 47543200 - TotalStorageWaitTime: 72648500640 - TotalThreadsInvoluntaryContextSwitches: 79434 - TotalThreadsTotalWallClockTime: 826304953016 - TotalThreadsSysTime: 3048536000 - TotalThreadsUserTime: 61332675000 - TotalThreadsVoluntaryContextSwitches: 85615 - TotalTime: 424206773584 Fragment Instance Lifecycle Timings - ExecTime: 395052979536 - ExecTreeExecTime: 394815154480 - InactiveTotalTime: 0 - OpenTime: 28151055880 - ExecTreeOpenTime: 22753316952 - PrepareTime: 1002596256 - ExecTreePrepareTime: 71945968 - TotalTime: 0 DataStreamSender (dst_id=14) - BytesSent: 420993 - InactiveTotalTime: 0 - NetworkThroughput(*): 114523758 - OverallThroughput: 15951088 - PeakMemoryUsage: 271296 - RowsReturned: 23304 - SerializeBatchTime: 22618200 - TotalTime: 26392744 - TransmitDataRPCTime: 3676032 - UncompressedRowBatchSize: 675976 CodeGen - CodegenTime: 31936264 - CompileTime: 1413566120 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2021884 - NumFunctions: 121 - NumInstructions: 7493 - OptimizationTime: 3925076544 - PeakMemoryUsage: 3836416 - PrepareTime: 402523864 - TotalTime: 5753666336 AGGREGATION_NODE (id=7) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 8808072 - GetResultsTime: 16272704 - HTResizeTime: 2723504 - HashBuckets: 65536 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 13649182 - PinTime: 0 - ReductionFactorEstimate: 530.7299020724209 - ReductionFactorThresholdToExpand: 1.1 - RowsPassedThrough: 0 - RowsReturned: 23304 - RowsReturnedRate: 55 - StreamingTime: 30799620456 - TotalTime: 417640298296 - UnpinTime: 0 HASH_JOIN_NODE (id=6) ExecOption: Probe Side Codegen Enabled - BuildRows: 229 - BuildTime: 36451152 - InactiveTotalTime: 0 - LocalTime: 701601872 - PeakMemoryUsage: 10908191 - ProbeRows: 877189 - ProbeRowsPartitioned: 0 - ProbeTime: 128550720 - RowsReturned: 241127 - RowsReturnedRate: 624 - TotalTime: 386403343848 Hash Join Builder (join_node_id=6) ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 118120 - BuildRowsPartitioned: 229 - GetNewBlockTime: 16749856 - HashBuckets: 496 - HashCollisions: 0 - HashTablesBuildTime: 19040552 - InactiveTotalTime: 0 - LargestPartitionPercent: 8 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 1078144 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=13) - BytesReceived: 4099 - ConvertRowBatchTime: 49600 - DeserializeRowBatchTimer: 94608 - FirstBatchArrivalWaitTime: 13808835880 - InactiveTotalTime: 13859390408 - PeakMemoryUsage: 0 - RowsReturned: 229 - RowsReturnedRate: 16 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 13859467824 HASH_JOIN_NODE (id=5) ExecOption: Probe Side Codegen Enabled - BuildRows: 251 - BuildTime: 1587664 - InactiveTotalTime: 0 - LocalTime: 811004208 - PeakMemoryUsage: 3146897 - ProbeRows: 4337939 - ProbeRowsPartitioned: 0 - ProbeTime: 531721232 - RowsReturned: 877189 - RowsReturnedRate: 2359 - TotalTime: 371842274152 Hash Join Builder (join_node_id=5) ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 60824 - BuildRowsPartitioned: 251 - GetNewBlockTime: 1072344 - HashBuckets: 480 - HashCollisions: 0 - HashTablesBuildTime: 226352 - InactiveTotalTime: 0 - LargestPartitionPercent: 7 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 1077888 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=12) - BytesReceived: 2832 - ConvertRowBatchTime: 51512 - DeserializeRowBatchTimer: 26544 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 251 - RowsReturnedRate: 3568179 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 70344 HASH_JOIN_NODE (id=4) ExecOption: Probe Side Codegen Enabled - BuildRows: 520 - BuildTime: 10557168 - InactiveTotalTime: 0 - LocalTime: 6096207864 - PeakMemoryUsage: 2070272 - ProbeRows: 61648795 - ProbeRowsPartitioned: 0 - ProbeTime: 5264369040 - RowsReturned: 4337939 - RowsReturnedRate: 11691 - TotalTime: 371031199600 Hash Join Builder (join_node_id=4) ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 185544 - BuildRowsPartitioned: 520 - GetNewBlockTime: 9719176 - HashBuckets: 1152 - HashCollisions: 0 - HashTablesBuildTime: 380272 - InactiveTotalTime: 0 - LargestPartitionPercent: 9 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 1088640 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=11) - BytesReceived: 7274 - ConvertRowBatchTime: 106776 - DeserializeRowBatchTimer: 154456 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 520 - RowsReturnedRate: 4139600 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 125616 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 9:9/183.22 MB 10:9/155.38 MB 1:13/262.48 MB 6:14/317.38 MB 2:9/183.93 MB 11:8/199.99 MB 3:6/162.73 MB 4:10/211.75 MB 7:11/238.69 MB 0:15/301.75 MB 5:15/259.20 MB 8:15/375.56 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 134 out of 134 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:536 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 1.0 - BytesRead: 180787391 - BytesReadDataNodeCache: 0 - BytesReadLocal: 180787391 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 180787391 - DecompressionTime: 12658150816 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 4 - NumDisksAccessed: 12 - NumRowGroups: 134 - NumScannerThreadsStarted: 1 - PeakMemoryUsage: 14547165 - PerReadThreadRawHdfsThroughput: 212216304 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 360567511144 - RowBatchQueuePutWaitTime: 5730078160 - RowsRead: 61648795 - RowsReturned: 61648795 - RowsReturnedRate: 168930 - ScanRangesComplete: 134 - ScannerThreadsInvoluntaryContextSwitches: 77884 - ScannerThreadsTotalWallClockTime: 403109087032 - MaterializeTupleTime(*): 243240234232 - ScannerThreadsSysTime: 2039689000 - ScannerThreadsUserTime: 52034089000 - ScannerThreadsVoluntaryContextSwitches: 29329 - TotalRawHdfsReadTime(*): 851901512 - TotalReadThroughput: 433304 - TotalTime: 364934866120 Instance 3f4fc7887f663030:f (host=redacted-host8:22000) Hdfs split stats (:<# splits>/): 5:8/156.15 MB 2:10/211.50 MB 7:13/262.90 MB 9:14/288.51 MB 0:13/321.55 MB 10:10/152.83 MB 4:8/157.08 MB 1:10/152.99 MB 6:14/391.73 MB 11:7/129.74 MB 3:19/380.47 MB 8:12/252.57 MB - AverageThreadTokens: 1.9425 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 29198703 - PerHostPeakMemUsage: 31641609 - RowsProduced: 32416 - TotalNetworkReceiveTime: 14452041288 - TotalNetworkSendTime: 2066331312 - TotalStorageWaitTime: 70703910592 - TotalThreadsInvoluntaryContextSwitches: 79416 - TotalThreadsTotalWallClockTime: 782706862392 - TotalThreadsSysTime: 2601604000 - TotalThreadsUserTime: 60716770000 - TotalThreadsVoluntaryContextSwitches: 83341 - TotalTime: 403814180768 Fragment Instance Lifecycle Timings - ExecTime: 381762224576 - ExecTreeExecTime: 379533710880 - InactiveTotalTime: 0 - OpenTime: 20652749048 - ExecTreeOpenTime: 15826851752 - PrepareTime: 1399117728 - ExecTreePrepareTime: 132960496 - TotalTime: 0 DataStreamSender (dst_id=14) - BytesSent: 585432 - InactiveTotalTime: 0 - NetworkThroughput(*): 113557223 - OverallThroughput: 17412021 - PeakMemoryUsage: 271296 - RowsReturned: 32416 - SerializeBatchTime: 21921752 - TotalTime: 33622288 - TransmitDataRPCTime: 5155392 - UncompressedRowBatchSize: 940284 CodeGen - CodegenTime: 66343944 - CompileTime: 911235792 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2021884 - NumFunctions: 121 - NumInstructions: 7493 - OptimizationTime: 3815181816 - PeakMemoryUsage: 3836416 - PrepareTime: 596791424 - TotalTime: 5332495520 AGGREGATION_NODE (id=7) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 50021944 - GetResultsTime: 13287520 - HTResizeTime: 9980584 - HashBuckets: 81920 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 13744271 - PinTime: 0 - ReductionFactorEstimate: 142.56581148912437 - ReductionFactorThresholdToExpand: 1.1 - RowsPassedThrough: 0 - RowsReturned: 32416 - RowsReturnedRate: 81 - StreamingTime: 19990317192 - TotalTime: 395493402568 - UnpinTime: 0 HASH_JOIN_NODE (id=6) ExecOption: Probe Side Codegen Enabled - BuildRows: 229 - BuildTime: 7031016 - InactiveTotalTime: 0 - LocalTime: 356579488 - PeakMemoryUsage: 11131349 - ProbeRows: 1221986 - ProbeRowsPartitioned: 0 - ProbeTime: 173334848 - RowsReturned: 337313 - RowsReturnedRate: 899 - TotalTime: 374882472496 Hash Join Builder (join_node_id=6) ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 118744 - BuildRowsPartitioned: 229 - GetNewBlockTime: 6238824 - HashBuckets: 496 - HashCollisions: 0 - HashTablesBuildTime: 325232 - InactiveTotalTime: 0 - LargestPartitionPercent: 8 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 1078144 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=13) - BytesReceived: 4099 - ConvertRowBatchTime: 54792 - DeserializeRowBatchTimer: 259776 - FirstBatchArrivalWaitTime: 14254869432 - InactiveTotalTime: 14452009512 - PeakMemoryUsage: 0 - RowsReturned: 229 - RowsReturnedRate: 15 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 14452089968 HASH_JOIN_NODE (id=5) ExecOption: Probe Side Codegen Enabled - BuildRows: 251 - BuildTime: 27924256 - InactiveTotalTime: 0 - LocalTime: 758380168 - PeakMemoryUsage: 3147826 - ProbeRows: 4354781 - ProbeRowsPartitioned: 0 - ProbeTime: 541624320 - RowsReturned: 1221986 - RowsReturnedRate: 3393 - TotalTime: 360073803040 Hash Join Builder (join_node_id=5) ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 65584 - BuildRowsPartitioned: 251 - GetNewBlockTime: 27383736 - HashBuckets: 480 - HashCollisions: 0 - HashTablesBuildTime: 227544 - InactiveTotalTime: 0 - LargestPartitionPercent: 7 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 1077888 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=12) - BytesReceived: 2832 - ConvertRowBatchTime: 48184 - DeserializeRowBatchTimer: 36088 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 251 - RowsReturnedRate: 3832295 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 65496 HASH_JOIN_NODE (id=4) ExecOption: Probe Side Codegen Enabled - BuildRows: 520 - BuildTime: 986048 - InactiveTotalTime: 0 - LocalTime: 5904731784 - PeakMemoryUsage: 2070272 - ProbeRows: 61742572 - ProbeRowsPartitioned: 0 - ProbeTime: 5160902496 - RowsReturned: 4354781 - RowsReturnedRate: 12119 - TotalTime: 359315357376 Hash Join Builder (join_node_id=4) ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 177840 - BuildRowsPartitioned: 520 - GetNewBlockTime: 165928 - HashBuckets: 1152 - HashCollisions: 0 - HashTablesBuildTime: 370312 - InactiveTotalTime: 0 - LargestPartitionPercent: 9 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 1088640 - PinTime: 0 - RepartitionTime: 0 - SpilledPartitions: 0 - TotalTime: 0 - UnpinTime: 0 EXCHANGE_NODE (id=11) - BytesReceived: 7274 - ConvertRowBatchTime: 99040 - DeserializeRowBatchTimer: 160728 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 520 - RowsReturnedRate: 4435648 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 117232 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 5:8/156.15 MB 2:10/211.50 MB 7:13/262.90 MB 9:14/288.51 MB 0:13/321.55 MB 10:10/152.83 MB 4:8/157.08 MB 1:10/152.99 MB 6:14/391.73 MB 11:7/129.74 MB 3:19/380.47 MB 8:12/252.57 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 138 out of 138 Hdfs Read Thread Concurrency Bucket: 0:99.6% 1:0.3979% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:552 - AverageHdfsReadThreadConcurrency: 0.002652519893899204 - AverageScannerThreadConcurrency: 1.0 - BytesRead: 181196984 - BytesReadDataNodeCache: 0 - BytesReadLocal: 181196984 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 181196984 - DecompressionTime: 9575200640 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 4 - NumDisksAccessed: 12 - NumRowGroups: 138 - NumScannerThreadsStarted: 1 - PeakMemoryUsage: 14577451 - PerReadThreadRawHdfsThroughput: 233348398 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 348719791432 - RowBatchQueuePutWaitTime: 1047847664 - RowsRead: 61742572 - RowsReturned: 61742572 - RowsReturnedRate: 174704 - ScanRangesComplete: 138 - ScannerThreadsInvoluntaryContextSwitches: 78065 - ScannerThreadsTotalWallClockTime: 380301424976 - MaterializeTupleTime(*): 223362393200 - ScannerThreadsSysTime: 1628752000 - ScannerThreadsUserTime: 51522167000 - ScannerThreadsVoluntaryContextSwitches: 26517 - TotalRawHdfsReadTime(*): 776508368 - TotalReadThroughput: 455661 - TotalTime: 353410508360 Averaged Fragment F02 split sizes: min: 41.12 KB, max: 41.12 KB, avg: 41.12 KB, stddev: 0 completion times: min:12s577ms max:12s577ms mean: 12s577ms stddev:0.000ns execution rates: min:3.27 KB/sec max:3.27 KB/sec mean:3.27 KB/sec stddev:0.61 B/sec num instances: 1 - AverageThreadTokens: 1.826086956521739 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 632001 - PerHostPeakMemUsage: 42179840 - RowsProduced: 520 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 7048 - TotalStorageWaitTime: 7645813336 - TotalThreadsInvoluntaryContextSwitches: 109 - TotalThreadsTotalWallClockTime: 20328002000 - TotalThreadsSysTime: 5999000 - TotalThreadsUserTime: 151977000 - TotalThreadsVoluntaryContextSwitches: 158 - TotalTime: 12270251472 Fragment Instance Lifecycle Timings - ExecTime: 9919176432 - ExecTreeExecTime: 9816044648 - InactiveTotalTime: 0 - OpenTime: 671332504 - ExecTreeOpenTime: 245952 - PrepareTime: 1679629576 - ExecTreePrepareTime: 11715120 - TotalTime: 0 DataStreamSender (dst_id=11) - BytesSent: 58192 - InactiveTotalTime: 0 - NetworkThroughput(*): 108713196 - OverallThroughput: 51787354 - PeakMemoryUsage: 31744 - RowsReturned: 520 - SerializeBatchTime: 501736 - TotalTime: 1123672 - TransmitDataRPCTime: 535280 - UncompressedRowBatchSize: 178912 CodeGen - CodegenTime: 37731248 - CompileTime: 75176736 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2021884 - NumFunctions: 42 - NumInstructions: 723 - OptimizationTime: 472880544 - PeakMemoryUsage: 370176 - PrepareTime: 980191496 - TotalTime: 1540497056 HDFS_SCAN_NODE (id=3) - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 1.0 - BytesRead: 83074 - BytesReadDataNodeCache: 0 - BytesReadLocal: 83074 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 83074 - DecompressionTime: 37136 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 4 - NumDisksAccessed: 1 - NumRowGroups: 1 - NumScannerThreadsStarted: 1 - PeakMemoryUsage: 589003 - PerReadThreadRawHdfsThroughput: 295493995 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 9756922208 - RowBatchQueuePutWaitTime: 0 - RowsRead: 7200 - RowsReturned: 520 - RowsReturnedRate: 52 - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 9758117176 - MaterializeTupleTime(*): 122493128 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 11998000 - ScannerThreadsVoluntaryContextSwitches: 57 - TotalRawHdfsReadTime(*): 281136 - TotalReadThroughput: 7221 - TotalTime: 9839802120 Fragment F02 Instance 3f4fc7887f663030:8 (host=redacted-host4:22000) Hdfs split stats (:<# splits>/): 7:1/41.12 KB - AverageThreadTokens: 1.826086956521739 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 632001 - PerHostPeakMemUsage: 42179840 - RowsProduced: 520 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 7048 - TotalStorageWaitTime: 7645813336 - TotalThreadsInvoluntaryContextSwitches: 109 - TotalThreadsTotalWallClockTime: 20328002000 - TotalThreadsSysTime: 5999000 - TotalThreadsUserTime: 151977000 - TotalThreadsVoluntaryContextSwitches: 158 - TotalTime: 12270251472 Fragment Instance Lifecycle Timings - ExecTime: 9919176432 - ExecTreeExecTime: 9816044648 - InactiveTotalTime: 0 - OpenTime: 671332504 - ExecTreeOpenTime: 245952 - PrepareTime: 1679629576 - ExecTreePrepareTime: 11715120 - TotalTime: 0 DataStreamSender (dst_id=11) - BytesSent: 58192 - InactiveTotalTime: 0 - NetworkThroughput(*): 108713196 - OverallThroughput: 51787354 - PeakMemoryUsage: 31744 - RowsReturned: 520 - SerializeBatchTime: 501736 - TotalTime: 1123672 - TransmitDataRPCTime: 535280 - UncompressedRowBatchSize: 178912 CodeGen - CodegenTime: 37731248 - CompileTime: 75176736 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2021884 - NumFunctions: 42 - NumInstructions: 723 - OptimizationTime: 472880544 - PeakMemoryUsage: 370176 - PrepareTime: 980191496 - TotalTime: 1540497056 HDFS_SCAN_NODE (id=3) Hdfs split stats (:<# splits>/): 7:1/41.12 KB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:4 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 1.0 - BytesRead: 83074 - BytesReadDataNodeCache: 0 - BytesReadLocal: 83074 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 83074 - DecompressionTime: 37136 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 4 - NumDisksAccessed: 1 - NumRowGroups: 1 - NumScannerThreadsStarted: 1 - PeakMemoryUsage: 589003 - PerReadThreadRawHdfsThroughput: 295493995 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 9756922208 - RowBatchQueuePutWaitTime: 0 - RowsRead: 7200 - RowsReturned: 520 - RowsReturnedRate: 52 - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 9758117176 - MaterializeTupleTime(*): 122493128 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 11998000 - ScannerThreadsVoluntaryContextSwitches: 57 - TotalRawHdfsReadTime(*): 281136 - TotalReadThroughput: 7221 - TotalTime: 9839802120 Averaged Fragment F03 split sizes: min: 2.15 MB, max: 2.15 MB, avg: 2.15 MB, stddev: 0 completion times: min:6s327ms max:6s327ms mean: 6s327ms stddev:0.000ns execution rates: min:347.94 KB/sec max:347.94 KB/sec mean:347.94 KB/sec stddev:0.76 B/sec num instances: 1 - AverageThreadTokens: 1.75 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 3270928 - PerHostPeakMemUsage: 38211481 - RowsProduced: 251 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 5392 - TotalStorageWaitTime: 3000278180 - TotalThreadsInvoluntaryContextSwitches: 163 - TotalThreadsTotalWallClockTime: 9004387164 - TotalThreadsSysTime: 8998000 - TotalThreadsUserTime: 209968000 - TotalThreadsVoluntaryContextSwitches: 187 - TotalTime: 6142761636 Fragment Instance Lifecycle Timings - ExecTime: 4296245044 - ExecTreeExecTime: 4112177216 - InactiveTotalTime: 0 - OpenTime: 676119824 - ExecTreeOpenTime: 208816 - PrepareTime: 1170308340 - ExecTreePrepareTime: 422376 - TotalTime: 0 DataStreamSender (dst_id=12) - BytesSent: 22656 - InactiveTotalTime: 0 - NetworkThroughput(*): 88589974 - OverallThroughput: 38228683 - PeakMemoryUsage: 61632 - RowsReturned: 251 - SerializeBatchTime: 169928 - TotalTime: 592644 - TransmitDataRPCTime: 255740 - UncompressedRowBatchSize: 42200 CodeGen - CodegenTime: 137816308 - CompileTime: 104013168 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2021884 - NumFunctions: 42 - NumInstructions: 794 - OptimizationTime: 353316544 - PeakMemoryUsage: 406528 - PrepareTime: 407731940 - TotalTime: 880473896 HDFS_SCAN_NODE (id=1) - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 1.0 - BytesRead: 480185 - BytesReadDataNodeCache: 0 - BytesReadLocal: 480185 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 480185 - DecompressionTime: 164676860 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 3 - NumDisksAccessed: 1 - NumRowGroups: 1 - NumScannerThreadsStarted: 1 - PeakMemoryUsage: 3197432 - PerReadThreadRawHdfsThroughput: 454266377 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 4090002280 - RowBatchQueuePutWaitTime: 0 - RowsRead: 73049 - RowsReturned: 251 - RowsReturnedRate: 61 - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 68 - ScannerThreadsTotalWallClockTime: 4218570672 - MaterializeTupleTime(*): 376410992 - ScannerThreadsSysTime: 4999000 - ScannerThreadsUserTime: 63990000 - ScannerThreadsVoluntaryContextSwitches: 79 - TotalRawHdfsReadTime(*): 1057056 - TotalReadThroughput: 87242 - TotalTime: 4113408492 Fragment F03 Instance 3f4fc7887f663030:9 (host=redacted-host6:22000) Hdfs split stats (:<# splits>/): 1:1/2.15 MB - AverageThreadTokens: 1.75 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 3270928 - PerHostPeakMemUsage: 38211481 - RowsProduced: 251 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 5392 - TotalStorageWaitTime: 3000278180 - TotalThreadsInvoluntaryContextSwitches: 163 - TotalThreadsTotalWallClockTime: 9004387164 - TotalThreadsSysTime: 8998000 - TotalThreadsUserTime: 209968000 - TotalThreadsVoluntaryContextSwitches: 187 - TotalTime: 6142761636 Fragment Instance Lifecycle Timings - ExecTime: 4296245044 - ExecTreeExecTime: 4112177216 - InactiveTotalTime: 0 - OpenTime: 676119824 - ExecTreeOpenTime: 208816 - PrepareTime: 1170308340 - ExecTreePrepareTime: 422376 - TotalTime: 0 DataStreamSender (dst_id=12) - BytesSent: 22656 - InactiveTotalTime: 0 - NetworkThroughput(*): 88589974 - OverallThroughput: 38228683 - PeakMemoryUsage: 61632 - RowsReturned: 251 - SerializeBatchTime: 169928 - TotalTime: 592644 - TransmitDataRPCTime: 255740 - UncompressedRowBatchSize: 42200 CodeGen - CodegenTime: 137816308 - CompileTime: 104013168 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2021884 - NumFunctions: 42 - NumInstructions: 794 - OptimizationTime: 353316544 - PeakMemoryUsage: 406528 - PrepareTime: 407731940 - TotalTime: 880473896 HDFS_SCAN_NODE (id=1) Hdfs split stats (:<# splits>/): 1:1/2.15 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:3 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 1.0 - BytesRead: 480185 - BytesReadDataNodeCache: 0 - BytesReadLocal: 480185 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 480185 - DecompressionTime: 164676860 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 3 - NumDisksAccessed: 1 - NumRowGroups: 1 - NumScannerThreadsStarted: 1 - PeakMemoryUsage: 3197432 - PerReadThreadRawHdfsThroughput: 454266377 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 4090002280 - RowBatchQueuePutWaitTime: 0 - RowsRead: 73049 - RowsReturned: 251 - RowsReturnedRate: 61 - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 68 - ScannerThreadsTotalWallClockTime: 4218570672 - MaterializeTupleTime(*): 376410992 - ScannerThreadsSysTime: 4999000 - ScannerThreadsUserTime: 63990000 - ScannerThreadsVoluntaryContextSwitches: 79 - TotalRawHdfsReadTime(*): 1057056 - TotalReadThroughput: 87242 - TotalTime: 4113408492 Averaged Fragment F04 split sizes: min: 71.36 KB, max: 71.36 KB, avg: 71.36 KB, stddev: 0 completion times: min:20s566ms max:20s566ms mean: 20s566ms stddev:0.000ns execution rates: min:3.47 KB/sec max:3.47 KB/sec mean:3.47 KB/sec stddev:0.99 B/sec num instances: 1 - AverageThreadTokens: 1.85 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 310208 - PerHostPeakMemUsage: 50341168 - RowsProduced: 229 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 4792 - TotalStorageWaitTime: 13975059248 - TotalThreadsInvoluntaryContextSwitches: 143 - TotalThreadsTotalWallClockTime: 35482931632 - TotalThreadsSysTime: 8998000 - TotalThreadsUserTime: 174973000 - TotalThreadsVoluntaryContextSwitches: 153 - TotalTime: 20435150328 Fragment Instance Lifecycle Timings - ExecTime: 17252046112 - ExecTreeExecTime: 17153712072 - InactiveTotalTime: 0 - OpenTime: 1121584472 - ExecTreeOpenTime: 191408 - PrepareTime: 2061012552 - ExecTreePrepareTime: 253776 - TotalTime: 0 DataStreamSender (dst_id=13) - BytesSent: 32792 - InactiveTotalTime: 0 - NetworkThroughput(*): 118608756 - OverallThroughput: 64350529 - PeakMemoryUsage: 41920 - RowsReturned: 229 - SerializeBatchTime: 118848 - TotalTime: 509584 - TransmitDataRPCTime: 276472 - UncompressedRowBatchSize: 81288 CodeGen - CodegenTime: 5137880 - CompileTime: 270952880 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2021884 - NumFunctions: 33 - NumInstructions: 508 - OptimizationTime: 781882688 - PeakMemoryUsage: 260096 - PrepareTime: 1315242272 - TotalTime: 2431180352 HDFS_SCAN_NODE (id=2) - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 1.0 - BytesRead: 78030 - BytesReadDataNodeCache: 0 - BytesReadLocal: 78030 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 78030 - DecompressionTime: 12672 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDisksAccessed: 1 - NumRowGroups: 1 - NumScannerThreadsStarted: 1 - PeakMemoryUsage: 143360 - PerReadThreadRawHdfsThroughput: 1585975609 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 17126662872 - RowBatchQueuePutWaitTime: 0 - RowsRead: 804 - RowsReturned: 229 - RowsReturnedRate: 13 - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 17126850288 - MaterializeTupleTime(*): 630184 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 2999000 - ScannerThreadsVoluntaryContextSwitches: 16 - TotalRawHdfsReadTime(*): 49200 - TotalReadThroughput: 3900 - TotalTime: 17154509104 Fragment F04 Instance 3f4fc7887f663030:a (host=redacted-host4:22000) Hdfs split stats (:<# splits>/): 9:1/71.36 KB - AverageThreadTokens: 1.85 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 310208 - PerHostPeakMemUsage: 50341168 - RowsProduced: 229 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 4792 - TotalStorageWaitTime: 13975059248 - TotalThreadsInvoluntaryContextSwitches: 143 - TotalThreadsTotalWallClockTime: 35482931632 - TotalThreadsSysTime: 8998000 - TotalThreadsUserTime: 174973000 - TotalThreadsVoluntaryContextSwitches: 153 - TotalTime: 20435150328 Fragment Instance Lifecycle Timings - ExecTime: 17252046112 - ExecTreeExecTime: 17153712072 - InactiveTotalTime: 0 - OpenTime: 1121584472 - ExecTreeOpenTime: 191408 - PrepareTime: 2061012552 - ExecTreePrepareTime: 253776 - TotalTime: 0 DataStreamSender (dst_id=13) - BytesSent: 32792 - InactiveTotalTime: 0 - NetworkThroughput(*): 118608756 - OverallThroughput: 64350529 - PeakMemoryUsage: 41920 - RowsReturned: 229 - SerializeBatchTime: 118848 - TotalTime: 509584 - TransmitDataRPCTime: 276472 - UncompressedRowBatchSize: 81288 CodeGen - CodegenTime: 5137880 - CompileTime: 270952880 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2021884 - NumFunctions: 33 - NumInstructions: 508 - OptimizationTime: 781882688 - PeakMemoryUsage: 260096 - PrepareTime: 1315242272 - TotalTime: 2431180352 HDFS_SCAN_NODE (id=2) Hdfs split stats (:<# splits>/): 9:1/71.36 KB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:2 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 1.0 - BytesRead: 78030 - BytesReadDataNodeCache: 0 - BytesReadLocal: 78030 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 78030 - DecompressionTime: 12672 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDisksAccessed: 1 - NumRowGroups: 1 - NumScannerThreadsStarted: 1 - PeakMemoryUsage: 143360 - PerReadThreadRawHdfsThroughput: 1585975609 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 17126662872 - RowBatchQueuePutWaitTime: 0 - RowsRead: 804 - RowsReturned: 229 - RowsReturnedRate: 13 - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 17126850288 - MaterializeTupleTime(*): 630184 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 2999000 - ScannerThreadsVoluntaryContextSwitches: 16 - TotalRawHdfsReadTime(*): 49200 - TotalReadThroughput: 3900 - TotalTime: 17154509104