Query (id=a6492cb57c2f2439:29baebe700000000): DEBUG MODE WARNING: Query profile created while running a DEBUG build of Impala. Use RELEASE builds to measure query performance. Summary: Session ID: b54cb40aa70e8a3f:ad70f5627f4e24ae Session Type: HIVESERVER2 HiveServer2 Protocol Version: V6 Start Time: 2017-05-26 08:28:57.112244000 End Time: 2017-05-26 08:33:19.467863000 Query Type: QUERY Query State: FINISHED Query Status: OK Impala Version: impalad version 2.9.0-SNAPSHOT DEBUG (build 470e6de60c3171e58c4ffeea48d456945ab6dd22) User: redacted Connected User: same as above Delegated User: Network Address: redacted:59996 Default Db: tpch_100_parquet Sql Statement: /* Mem: 2035 MB. Coordinator: redacted-host1. */ select l_orderkey, sum(l_extendedprice * (1 - l_discount)) as revenue, o_orderdate, o_shippriority from customer, orders, lineitem where c_mktsegment = 'BUILDING' and c_custkey = o_custkey and l_orderkey = o_orderkey and o_orderdate < '1995-03-15' and l_shipdate > '1995-03-15' group by l_orderkey, o_orderdate, o_shippriority order by revenue desc, o_orderdate limit 10 Coordinator: redacted-host1:22000 Query Options (non default): ABORT_ON_ERROR=1,MEM_LIMIT=2133852160 Plan: ---------------- Per-Host Resource Reservation: Memory=536.00MB Per-Host Resource Estimates: Memory=673.67MB F06:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1 PLAN-ROOT SINK | mem-estimate=0B mem-reservation=0B | 13:MERGING-EXCHANGE [UNPARTITIONED] | order by: sum(l_extendedprice * (1 - l_discount)) DESC, o_orderdate ASC | limit: 10 | mem-estimate=0B mem-reservation=0B | tuple-ids=4 row-size=58B cardinality=10 | F05:PLAN FRAGMENT [HASH(l_orderkey,o_orderdate,o_shippriority)] hosts=8 instances=8 06:TOP-N [LIMIT=10] | order by: sum(l_extendedprice * (1 - l_discount)) DESC, o_orderdate ASC | mem-estimate=580B mem-reservation=0B | tuple-ids=4 row-size=58B cardinality=10 | 12:AGGREGATE [FINALIZE] | output: sum:merge(l_extendedprice * (1 - l_discount)) | group by: l_orderkey, o_orderdate, o_shippriority | mem-estimate=105.17MB mem-reservation=264.00MB | tuple-ids=3 row-size=58B cardinality=1728520 | 11:EXCHANGE [HASH(l_orderkey,o_orderdate,o_shippriority)] | mem-estimate=0B mem-reservation=0B | tuple-ids=3 row-size=58B cardinality=1728520 | F04:PLAN FRAGMENT [HASH(o_custkey)] hosts=8 instances=8 05:AGGREGATE [STREAMING] | output: sum(l_extendedprice * (1 - l_discount)) | group by: l_orderkey, o_orderdate, o_shippriority | mem-estimate=105.17MB mem-reservation=0B | tuple-ids=3 row-size=58B cardinality=1728520 | 04:HASH JOIN [INNER JOIN, PARTITIONED] | hash predicates: o_custkey = c_custkey | runtime filters: RF000 <- c_custkey | mem-estimate=12.98MB mem-reservation=136.00MB | tuple-ids=2,1,0 row-size=133B cardinality=1728520 | |--10:EXCHANGE [HASH(c_custkey)] | | mem-estimate=0B mem-reservation=0B | | tuple-ids=0 row-size=33B cardinality=3000000 | | | F03:PLAN FRAGMENT [RANDOM] hosts=8 instances=8 | 00:SCAN HDFS [tpch_100_parquet.customer, RANDOM] | partitions=1/1 files=8 size=1.16GB | predicates: c_mktsegment = 'BUILDING' | table stats: 15000000 rows total | column stats: all | parquet statistics predicates: c_mktsegment = 'BUILDING' | parquet dictionary predicates: c_mktsegment = 'BUILDING' | mem-estimate=176.00MB mem-reservation=0B | tuple-ids=0 row-size=33B cardinality=3000000 | 09:EXCHANGE [HASH(o_custkey)] | mem-estimate=0B mem-reservation=0B | tuple-ids=2,1 row-size=100B cardinality=6000379 | F02:PLAN FRAGMENT [HASH(l_orderkey)] hosts=8 instances=8 03:HASH JOIN [INNER JOIN, PARTITIONED] | hash predicates: l_orderkey = o_orderkey | runtime filters: RF001 <- o_orderkey | mem-estimate=98.35MB mem-reservation=136.00MB | tuple-ids=2,1 row-size=100B cardinality=6000379 | |--08:EXCHANGE [HASH(o_orderkey)] | | mem-estimate=0B mem-reservation=0B | | tuple-ids=1 row-size=50B cardinality=15000000 | | | F01:PLAN FRAGMENT [RANDOM] hosts=8 instances=8 | 01:SCAN HDFS [tpch_100_parquet.orders, RANDOM] | partitions=1/1 files=31 size=6.07GB | predicates: o_orderdate < '1995-03-15' | runtime filters: RF000 -> o_custkey | table stats: 150000000 rows total | column stats: all | parquet statistics predicates: o_orderdate < '1995-03-15' | parquet dictionary predicates: o_orderdate < '1995-03-15' | mem-estimate=352.00MB mem-reservation=0B | tuple-ids=1 row-size=50B cardinality=15000000 | 07:EXCHANGE [HASH(l_orderkey)] | mem-estimate=0B mem-reservation=0B | tuple-ids=2 row-size=50B cardinality=60003790 | F00:PLAN FRAGMENT [RANDOM] hosts=8 instances=8 02:SCAN HDFS [tpch_100_parquet.lineitem, RANDOM] partitions=1/1 files=88 size=21.06GB predicates: l_shipdate > '1995-03-15' runtime filters: RF001 -> l_orderkey table stats: 600037902 rows total column stats: all parquet statistics predicates: l_shipdate > '1995-03-15' parquet dictionary predicates: l_shipdate > '1995-03-15' mem-estimate=352.00MB mem-reservation=0B tuple-ids=2 row-size=50B cardinality=60003790 ---------------- Estimated Per-Host Mem: 706395485 Per-Host Memory Reservation: 562036736 Request Pool: root.redacted Admission result: Admitted immediately ExecSummary: Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail ---------------------------------------------------------------------------------------------------------------------------------- 13:MERGING-EXCHANGE 1 308.431us 308.431us 10 10 0 0 UNPARTITIONED 06:TOP-N 8 15.787ms 18.612ms 80 10 12.00 KB 580.00 B 12:AGGREGATE 8 506.351ms 692.593ms 1.13M 1.73M 14.24 MB 105.17 MB FINALIZE 11:EXCHANGE 8 75.520ms 138.635ms 1.13M 1.73M 0 0 HASH(l_orderkey,o_orderdate... 05:AGGREGATE 8 389.129ms 650.835ms 1.13M 1.73M 13.70 MB 105.17 MB STREAMING 04:HASH JOIN 8 1s901ms 2s576ms 2.99M 1.73M 153.17 MB 12.98 MB INNER JOIN, PARTITIONED |--10:EXCHANGE 8 235.256ms 552.595ms 3.00M 3.00M 0 0 HASH(c_custkey) | 00:SCAN HDFS 5 323.828ms 621.551ms 3.00M 3.00M 29.30 MB 176.00 MB tpch_100_parquet.customer 09:EXCHANGE 8 728.297ms 758.348ms 14.57M 6.00M 0 0 HASH(o_custkey) 03:HASH JOIN 8 24s679ms 29s349ms 14.57M 6.00M 777.11 MB 98.35 MB INNER JOIN, PARTITIONED |--08:EXCHANGE 8 5s521ms 8s310ms 70.97M 15.00M 0 0 HASH(o_orderkey) | 01:SCAN HDFS 8 3s626ms 7s399ms 70.97M 15.00M 80.88 MB 352.00 MB tpch_100_parquet.orders 07:EXCHANGE 8 14s268ms 15s285ms 323.49M 60.00M 0 0 HASH(l_orderkey) 02:SCAN HDFS 8 11s632ms 17s863ms 323.49M 60.00M 78.65 MB 352.00 MB tpch_100_parquet.lineitem Errors: Planner Timeline: 662.876ms - Analysis finished: 233.181ms (233.181ms) - Equivalence classes computed: 233.657ms (476.295us) - Single node plan created: 658.302ms (424.644ms) - Runtime filters computed: 658.540ms (238.852us) - Distributed plan created: 659.300ms (759.885us) - Lineage info computed: 659.561ms (260.189us) - Planning finished: 662.876ms (3.315ms) Query Timeline: 4m22s - Query submitted: 120.588us (120.588us) - Planning finished: 723.529ms (723.409ms) - Submit for admission: 988.116ms (264.587ms) - Completed admission: 1s056ms (68.633ms) - Ready to start on 8 backends: 1s192ms (135.966ms) - All 8 execution backends (46 fragment instances) started: 1s651ms (458.981ms) - First dynamic filter received: 53s628ms (51s977ms) - Rows available: 4m22s (3m28s) - First row fetched: 4m22s (54.741ms) - Unregister query: 4m22s (106.705ms) - ComputeScanRangeAssignmentTimer: 2.509ms ImpalaServer: - ClientFetchWaitTimer: 141.233ms - RowMaterializationTimer: 20.171ms Execution Profile a6492cb57c2f2439:29baebe700000000:(Total: 4m21s, non-child: 0.000ns, % non-child: 0.00%) Number of filters: 2 Filter routing table: ID Src. Node Tgt. Node(s) Target type Partition filter Pending (Expected) First arrived Completed Enabled ------------------------------------------------------------------------------------------------------------------- 1 3 2 REMOTE false 8 (8) N/A N/A true 0 4 1 REMOTE false 8 (8) N/A N/A true Backend startup latencies: Count: 8, min / max: 35ms / 391ms, 25th %-ile: 69ms, 50th %-ile: 134ms, 75th %-ile: 306ms, 90th %-ile: 351ms, 95th %-ile: 391ms, 99.9th %-ile: 391ms Per Node Peak Memory Usage: redacted-host2:22000(1.02 GB) redacted-host3:22000(1.01 GB) redacted-host4:22000(1.03 GB) redacted-host5:22000(1.02 GB) redacted-host1:22000(1.03 GB) redacted-host6:22000(1.03 GB) redacted-host7:22000(1.03 GB) redacted-host8:22000(1.02 GB) Final filter table: ID Src. Node Tgt. Node(s) Target type Partition filter Pending (Expected) First arrived Completed Enabled ------------------------------------------------------------------------------------------------------------------- 1 3 2 REMOTE false 0 (8) 1m7s 1m7s false 0 4 1 REMOTE false 0 (8) 53s628ms 53s646ms false - FiltersReceived: 16 (16) - FinalizationTimer: 0.000ns Averaged Fragment F06:(Total: 4m20s, non-child: 80.821ms, % non-child: 0.03%) split sizes: min: 0, max: 0, avg: 0, stddev: 0 completion times: min:4m20s max:4m20s mean: 4m20s stddev:0.000ns execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec num instances: 1 - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 288.00 KB (294912) - PerHostPeakMemUsage: 1.03 GB (1105124622) - RowsProduced: 10 (10) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 47 (47) - TotalThreadsTotalWallClockTime: 4m20s - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 91.986ms - TotalThreadsVoluntaryContextSwitches: 41 (41) Fragment Instance Lifecycle Timings: - ExecTime: 54.912ms - ExecTreeExecTime: 410.386us - OpenTime: 4m20s - ExecTreeOpenTime: 4m20s - PrepareTime: 359.331ms - ExecTreePrepareTime: 126.304us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 208 (208) - BlocksRecycled: 16 (16) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 1.59 GB (1707081728) - PeakMemoryUsage: 916.38 MB (960888832) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns PLAN_ROOT_SINK: - PeakMemoryUsage: 0 CodeGen:(Total: 518.151ms, non-child: 518.151ms, % non-child: 100.00%) - CodegenTime: 1.684ms - CompileTime: 20.615ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2076168) - NumFunctions: 28 (28) - NumInstructions: 560 (560) - OptimizationTime: 156.772ms - PeakMemoryUsage: 280.00 KB (286720) - PrepareTime: 339.801ms EXCHANGE_NODE (id=13):(Total: 4m20s, non-child: 4m20s, % non-child: 100.00%) - BytesReceived: 2.81 KB (2874) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 168.890us - FirstBatchArrivalWaitTime: 4m20s - MergeGetNext: 403.605us - MergeGetNextBatch: 268.306us - PeakMemoryUsage: 0 - RowsReturned: 10 (10) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Coordinator Fragment F06: Instance a6492cb57c2f2439:29baebe700000000 (host=redacted-host1:22000):(Total: 4m20s, non-child: 80.821ms, % non-child: 0.03%) MemoryUsage(8s000ms): 8.35 KB, 8.91 KB, 8.91 KB, 8.91 KB, 8.91 KB, 8.91 KB, 8.91 KB, 8.91 KB, 8.91 KB, 8.91 KB, 8.91 KB, 8.91 KB, 8.91 KB, 8.91 KB, 8.91 KB, 8.91 KB, 8.91 KB, 8.91 KB, 8.91 KB, 8.91 KB, 8.91 KB, 8.91 KB, 8.91 KB, 8.91 KB, 8.91 KB, 8.91 KB, 8.91 KB, 8.91 KB, 8.91 KB, 8.91 KB, 8.91 KB, 8.91 KB - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 288.00 KB (294912) - PerHostPeakMemUsage: 1.03 GB (1105124622) - RowsProduced: 10 (10) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 47 (47) - TotalThreadsTotalWallClockTime: 4m20s - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 91.986ms - TotalThreadsVoluntaryContextSwitches: 41 (41) Fragment Instance Lifecycle Timings: - ExecTime: 54.912ms - ExecTreeExecTime: 410.386us - OpenTime: 4m20s - ExecTreeOpenTime: 4m20s - PrepareTime: 359.331ms - ExecTreePrepareTime: 126.304us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 208 (208) - BlocksRecycled: 16 (16) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 1.59 GB (1707081728) - PeakMemoryUsage: 916.38 MB (960888832) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns PLAN_ROOT_SINK: - PeakMemoryUsage: 0 CodeGen:(Total: 518.151ms, non-child: 518.151ms, % non-child: 100.00%) - CodegenTime: 1.684ms - CompileTime: 20.615ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2076168) - NumFunctions: 28 (28) - NumInstructions: 560 (560) - OptimizationTime: 156.772ms - PeakMemoryUsage: 280.00 KB (286720) - PrepareTime: 339.801ms EXCHANGE_NODE (id=13):(Total: 4m20s, non-child: 308.431us, % non-child: 0.00%) ExecOption: Codegen Enabled BytesReceived(8s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 2.81 KB (2874) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 168.890us - FirstBatchArrivalWaitTime: 4m20s - MergeGetNext: 403.605us - MergeGetNextBatch: 268.306us - PeakMemoryUsage: 0 - RowsReturned: 10 (10) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Averaged Fragment F05:(Total: 4m20s, non-child: 44.178ms, % non-child: 0.02%) split sizes: min: 0, max: 0, avg: 0, stddev: 0 completion times: min:4m20s max:4m20s mean: 4m20s stddev:153.277ms execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec num instances: 8 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 14.28 MB (14978905) - PerHostPeakMemUsage: 1.02 GB (1098647219) - RowsProduced: 10 (10) - TotalNetworkReceiveTime: 4m18s - TotalNetworkSendTime: 275.974us - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 674 (674) - TotalThreadsTotalWallClockTime: 4m20s - TotalThreadsSysTime: 24.621ms - TotalThreadsUserTime: 717.890ms - TotalThreadsVoluntaryContextSwitches: 420 (420) Fragment Instance Lifecycle Timings: - ExecTime: 551.983us - ExecTreeExecTime: 18.424us - OpenTime: 4m20s - ExecTreeOpenTime: 4m19s - PrepareTime: 453.449ms - ExecTreePrepareTime: 210.860ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 208 (208) - BlocksRecycled: 16 (16) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 1.59 GB (1707081728) - PeakMemoryUsage: 916.38 MB (960888832) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=13):(Total: 115.512us, non-child: 115.512us, % non-child: 100.00%) - BytesSent: 359.00 B (359) - NetworkThroughput(*): 14.15 MB/sec - OverallThroughput: 3.10 MB/sec - PeakMemoryUsage: 2.61 KB (2672) - RowsReturned: 10 (10) - SerializeBatchTime: 42.823us - TransmitDataRPCTime: 24.539us - UncompressedRowBatchSize: 634.00 B (634) CodeGen:(Total: 1s222ms, non-child: 1s222ms, % non-child: 100.00%) - CodegenTime: 22.543ms - CompileTime: 200.739ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2076168) - NumFunctions: 117 (117) - NumInstructions: 2.41K (2414) - OptimizationTime: 799.449ms - PeakMemoryUsage: 1.18 MB (1235968) - PrepareTime: 203.988ms SORT_NODE (id=6):(Total: 4m19s, non-child: 15.787ms, % non-child: 0.01%) - InsertBatchTime: 14.765ms - PeakMemoryUsage: 12.00 KB (12288) - RowsReturned: 10 (10) - RowsReturnedRate: 0 AGGREGATION_NODE (id=12):(Total: 4m19s, non-child: 506.351ms, % non-child: 0.20%) - BuildTime: 220.049ms - GetNewBlockTime: 39.799ms - GetResultsTime: 51.125ms - HTResizeTime: 25.230ms - HashBuckets: 262.14K (262144) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 14.23 MB (14920920) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 141.38K (141380) - RowsReturnedRate: 544.00 /sec - SpilledPartitions: 0 (0) - UnpinTime: 3.417us EXCHANGE_NODE (id=11):(Total: 4m18s, non-child: 4m18s, % non-child: 100.00%) - BytesReceived: 3.80 MB (3982768) - ConvertRowBatchTime: 39.159ms - DeserializeRowBatchTimer: 52.857ms - FirstBatchArrivalWaitTime: 4m18s - PeakMemoryUsage: 0 - RowsReturned: 141.38K (141380) - RowsReturnedRate: 545.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Fragment F05: Instance a6492cb57c2f2439:29baebe70000002a (host=redacted-host3:22000):(Total: 4m20s, non-child: 20.102ms, % non-child: 0.01%) MemoryUsage(8s000ms): 2.39 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB ThreadUsage(8s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 14.29 MB (14982518) - PerHostPeakMemUsage: 1.01 GB (1089011159) - RowsProduced: 10 (10) - TotalNetworkReceiveTime: 4m19s - TotalNetworkSendTime: 366.896us - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 686 (686) - TotalThreadsTotalWallClockTime: 4m20s - TotalThreadsSysTime: 20.996ms - TotalThreadsUserTime: 702.893ms - TotalThreadsVoluntaryContextSwitches: 277 (277) Fragment Instance Lifecycle Timings: - ExecTime: 667.976us - ExecTreeExecTime: 24.188us - OpenTime: 4m20s - ExecTreeOpenTime: 4m20s - PrepareTime: 121.853ms - ExecTreePrepareTime: 1.306ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 208 (208) - BlocksRecycled: 16 (16) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 1.59 GB (1707081728) - PeakMemoryUsage: 916.38 MB (960888832) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=13):(Total: 119.020us, non-child: 119.020us, % non-child: 100.00%) - BytesSent: 348.00 B (348) - NetworkThroughput(*): 15.27 MB/sec - OverallThroughput: 2.79 MB/sec - PeakMemoryUsage: 2.61 KB (2672) - RowsReturned: 10 (10) - SerializeBatchTime: 56.305us - TransmitDataRPCTime: 21.733us - UncompressedRowBatchSize: 634.00 B (634) CodeGen:(Total: 600.878ms, non-child: 600.878ms, % non-child: 100.00%) - CodegenTime: 9.789ms - CompileTime: 23.797ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2076168) - NumFunctions: 117 (117) - NumInstructions: 2.41K (2414) - OptimizationTime: 466.666ms - PeakMemoryUsage: 1.18 MB (1235968) - PrepareTime: 105.793ms SORT_NODE (id=6):(Total: 4m20s, non-child: 16.450ms, % non-child: 0.01%) ExecOption: Codegen Enabled - InsertBatchTime: 15.418ms - PeakMemoryUsage: 12.00 KB (12288) - RowsReturned: 10 (10) - RowsReturnedRate: 0 AGGREGATION_NODE (id=12):(Total: 4m20s, non-child: 368.619ms, % non-child: 0.14%) ExecOption: Codegen Enabled - BuildTime: 277.304ms - GetNewBlockTime: 8.045ms - GetResultsTime: 61.701ms - HTResizeTime: 41.932ms - HashBuckets: 262.14K (262144) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 14.24 MB (14931987) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 141.97K (141965) - RowsReturnedRate: 545.00 /sec - SpilledPartitions: 0 (0) - UnpinTime: 3.006us EXCHANGE_NODE (id=11):(Total: 4m19s, non-child: 138.635ms, % non-child: 0.05%) BytesReceived(8s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 3.81 MB (4000216) - ConvertRowBatchTime: 46.471ms - DeserializeRowBatchTimer: 49.920ms - FirstBatchArrivalWaitTime: 4m19s - PeakMemoryUsage: 0 - RowsReturned: 141.97K (141965) - RowsReturnedRate: 546.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance a6492cb57c2f2439:29baebe70000002c (host=redacted-host6:22000):(Total: 4m20s, non-child: 85.489ms, % non-child: 0.03%) MemoryUsage(8s000ms): 2.25 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB ThreadUsage(8s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 14.31 MB (15004483) - PerHostPeakMemUsage: 1.03 GB (1100730973) - RowsProduced: 10 (10) - TotalNetworkReceiveTime: 4m18s - TotalNetworkSendTime: 385.617us - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 822 (822) - TotalThreadsTotalWallClockTime: 4m20s - TotalThreadsSysTime: 21.997ms - TotalThreadsUserTime: 734.888ms - TotalThreadsVoluntaryContextSwitches: 447 (447) Fragment Instance Lifecycle Timings: - ExecTime: 673.182us - ExecTreeExecTime: 15.324us - OpenTime: 4m20s - ExecTreeOpenTime: 4m19s - PrepareTime: 586.335ms - ExecTreePrepareTime: 199.888ms DataStreamSender (dst_id=13):(Total: 108.198us, non-child: 108.198us, % non-child: 100.00%) - BytesSent: 367.00 B (367) - NetworkThroughput(*): 12.81 MB/sec - OverallThroughput: 3.23 MB/sec - PeakMemoryUsage: 2.61 KB (2672) - RowsReturned: 10 (10) - SerializeBatchTime: 25.642us - TransmitDataRPCTime: 27.322us - UncompressedRowBatchSize: 634.00 B (634) CodeGen:(Total: 1s249ms, non-child: 1s249ms, % non-child: 100.00%) - CodegenTime: 29.144ms - CompileTime: 173.581ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2076168) - NumFunctions: 117 (117) - NumInstructions: 2.41K (2414) - OptimizationTime: 754.772ms - PeakMemoryUsage: 1.18 MB (1235968) - PrepareTime: 308.823ms SORT_NODE (id=6):(Total: 4m19s, non-child: 18.612ms, % non-child: 0.01%) ExecOption: Codegen Enabled - InsertBatchTime: 17.287ms - PeakMemoryUsage: 12.00 KB (12288) - RowsReturned: 10 (10) - RowsReturnedRate: 0 AGGREGATION_NODE (id=12):(Total: 4m19s, non-child: 559.297ms, % non-child: 0.22%) ExecOption: Codegen Enabled - BuildTime: 240.294ms - GetNewBlockTime: 32.450ms - GetResultsTime: 57.507ms - HTResizeTime: 26.333ms - HashBuckets: 262.14K (262144) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 14.24 MB (14931574) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 141.45K (141449) - RowsReturnedRate: 545.00 /sec - SpilledPartitions: 0 (0) - UnpinTime: 3.864us EXCHANGE_NODE (id=11):(Total: 4m18s, non-child: 73.058ms, % non-child: 0.03%) BytesReceived(8s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 3.80 MB (3985075) - ConvertRowBatchTime: 43.382ms - DeserializeRowBatchTimer: 49.358ms - FirstBatchArrivalWaitTime: 4m18s - PeakMemoryUsage: 0 - RowsReturned: 141.45K (141449) - RowsReturnedRate: 546.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance a6492cb57c2f2439:29baebe70000002b (host=redacted-host1:22000):(Total: 4m20s, non-child: 53.969ms, % non-child: 0.02%) MemoryUsage(8s000ms): 2.46 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB ThreadUsage(8s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 14.29 MB (14981178) - PerHostPeakMemUsage: 1.03 GB (1105124622) - RowsProduced: 10 (10) - TotalNetworkReceiveTime: 4m18s - TotalNetworkSendTime: 215.480us - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 594 (594) - TotalThreadsTotalWallClockTime: 4m20s - TotalThreadsSysTime: 25.996ms - TotalThreadsUserTime: 719.890ms - TotalThreadsVoluntaryContextSwitches: 463 (463) Fragment Instance Lifecycle Timings: - ExecTime: 413.714us - ExecTreeExecTime: 9.026us - OpenTime: 4m20s - ExecTreeOpenTime: 4m19s - PrepareTime: 374.541ms - ExecTreePrepareTime: 34.825ms DataStreamSender (dst_id=13):(Total: 87.168us, non-child: 87.168us, % non-child: 100.00%) - BytesSent: 345.00 B (345) - NetworkThroughput(*): 11.09 MB/sec - OverallThroughput: 3.77 MB/sec - PeakMemoryUsage: 2.61 KB (2672) - RowsReturned: 10 (10) - SerializeBatchTime: 18.385us - TransmitDataRPCTime: 29.678us - UncompressedRowBatchSize: 634.00 B (634) CodeGen:(Total: 1s430ms, non-child: 1s430ms, % non-child: 100.00%) - CodegenTime: 21.913ms - CompileTime: 153.957ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2076168) - NumFunctions: 117 (117) - NumInstructions: 2.41K (2414) - OptimizationTime: 979.216ms - PeakMemoryUsage: 1.18 MB (1235968) - PrepareTime: 296.525ms SORT_NODE (id=6):(Total: 4m19s, non-child: 13.790ms, % non-child: 0.01%) ExecOption: Codegen Enabled - InsertBatchTime: 12.958ms - PeakMemoryUsage: 12.00 KB (12288) - RowsReturned: 10 (10) - RowsReturnedRate: 0 AGGREGATION_NODE (id=12):(Total: 4m19s, non-child: 295.111ms, % non-child: 0.11%) ExecOption: Codegen Enabled - BuildTime: 197.816ms - GetNewBlockTime: 27.388ms - GetResultsTime: 42.569ms - HTResizeTime: 21.615ms - HashBuckets: 262.14K (262144) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 14.22 MB (14908269) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 141.15K (141148) - RowsReturnedRate: 544.00 /sec - SpilledPartitions: 0 (0) - UnpinTime: 3.141us EXCHANGE_NODE (id=11):(Total: 4m18s, non-child: 64.019ms, % non-child: 0.02%) BytesReceived(8s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 3.79 MB (3976519) - ConvertRowBatchTime: 37.431ms - DeserializeRowBatchTimer: 55.160ms - FirstBatchArrivalWaitTime: 4m18s - PeakMemoryUsage: 0 - RowsReturned: 141.15K (141148) - RowsReturnedRate: 545.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance a6492cb57c2f2439:29baebe700000027 (host=redacted-host4:22000):(Total: 4m20s, non-child: 23.010ms, % non-child: 0.01%) MemoryUsage(8s000ms): 2.46 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB ThreadUsage(8s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 14.29 MB (14979905) - PerHostPeakMemUsage: 1.03 GB (1100732840) - RowsProduced: 10 (10) - TotalNetworkReceiveTime: 4m18s - TotalNetworkSendTime: 191.243us - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 603 (603) - TotalThreadsTotalWallClockTime: 4m20s - TotalThreadsSysTime: 29.996ms - TotalThreadsUserTime: 705.892ms - TotalThreadsVoluntaryContextSwitches: 459 (459) Fragment Instance Lifecycle Timings: - ExecTime: 475.469us - ExecTreeExecTime: 25.404us - OpenTime: 4m20s - ExecTreeOpenTime: 4m19s - PrepareTime: 435.607ms - ExecTreePrepareTime: 190.668ms DataStreamSender (dst_id=13):(Total: 117.354us, non-child: 117.354us, % non-child: 100.00%) - BytesSent: 369.00 B (369) - NetworkThroughput(*): 16.46 MB/sec - OverallThroughput: 3.00 MB/sec - PeakMemoryUsage: 2.61 KB (2672) - RowsReturned: 10 (10) - SerializeBatchTime: 59.673us - TransmitDataRPCTime: 21.379us - UncompressedRowBatchSize: 634.00 B (634) CodeGen:(Total: 1s258ms, non-child: 1s258ms, % non-child: 100.00%) - CodegenTime: 17.246ms - CompileTime: 128.411ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2076168) - NumFunctions: 117 (117) - NumInstructions: 2.41K (2414) - OptimizationTime: 839.726ms - PeakMemoryUsage: 1.18 MB (1235968) - PrepareTime: 205.855ms SORT_NODE (id=6):(Total: 4m19s, non-child: 16.611ms, % non-child: 0.01%) ExecOption: Codegen Enabled - InsertBatchTime: 15.133ms - PeakMemoryUsage: 12.00 KB (12288) - RowsReturned: 10 (10) - RowsReturnedRate: 0 AGGREGATION_NODE (id=12):(Total: 4m19s, non-child: 436.981ms, % non-child: 0.17%) ExecOption: Codegen Enabled - BuildTime: 185.688ms - GetNewBlockTime: 40.262ms - GetResultsTime: 51.292ms - HTResizeTime: 20.400ms - HashBuckets: 262.14K (262144) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 14.22 MB (14906996) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 141.30K (141300) - RowsReturnedRate: 545.00 /sec - SpilledPartitions: 0 (0) - UnpinTime: 2.591us EXCHANGE_NODE (id=11):(Total: 4m18s, non-child: 61.639ms, % non-child: 0.02%) BytesReceived(8s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 3.80 MB (3981311) - ConvertRowBatchTime: 33.518ms - DeserializeRowBatchTimer: 53.889ms - FirstBatchArrivalWaitTime: 4m18s - PeakMemoryUsage: 0 - RowsReturned: 141.30K (141300) - RowsReturnedRate: 545.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance a6492cb57c2f2439:29baebe70000002d (host=redacted-host7:22000):(Total: 4m20s, non-child: 43.655ms, % non-child: 0.02%) MemoryUsage(8s000ms): 2.39 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB ThreadUsage(8s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 14.29 MB (14983226) - PerHostPeakMemUsage: 1.03 GB (1101185652) - RowsProduced: 10 (10) - TotalNetworkReceiveTime: 4m18s - TotalNetworkSendTime: 224.473us - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 859 (859) - TotalThreadsTotalWallClockTime: 4m19s - TotalThreadsSysTime: 20.996ms - TotalThreadsUserTime: 712.892ms - TotalThreadsVoluntaryContextSwitches: 345 (345) Fragment Instance Lifecycle Timings: - ExecTime: 608.626us - ExecTreeExecTime: 25.535us - OpenTime: 4m19s - ExecTreeOpenTime: 4m18s - PrepareTime: 573.372ms - ExecTreePrepareTime: 344.269ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 208 (208) - BlocksRecycled: 16 (16) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 1.59 GB (1707081728) - PeakMemoryUsage: 916.38 MB (960888832) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=13):(Total: 137.925us, non-child: 137.925us, % non-child: 100.00%) - BytesSent: 370.00 B (370) - NetworkThroughput(*): 14.75 MB/sec - OverallThroughput: 2.56 MB/sec - PeakMemoryUsage: 2.61 KB (2672) - RowsReturned: 10 (10) - SerializeBatchTime: 53.694us - TransmitDataRPCTime: 23.930us - UncompressedRowBatchSize: 634.00 B (634) CodeGen:(Total: 1s289ms, non-child: 1s289ms, % non-child: 100.00%) - CodegenTime: 19.200ms - CompileTime: 238.514ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2076168) - NumFunctions: 117 (117) - NumInstructions: 2.41K (2414) - OptimizationTime: 814.285ms - PeakMemoryUsage: 1.18 MB (1235968) - PrepareTime: 215.998ms SORT_NODE (id=6):(Total: 4m19s, non-child: 15.549ms, % non-child: 0.01%) ExecOption: Codegen Enabled - InsertBatchTime: 14.678ms - PeakMemoryUsage: 12.00 KB (12288) - RowsReturned: 10 (10) - RowsReturnedRate: 0 AGGREGATION_NODE (id=12):(Total: 4m19s, non-child: 692.593ms, % non-child: 0.27%) ExecOption: Codegen Enabled - BuildTime: 251.568ms - GetNewBlockTime: 51.620ms - GetResultsTime: 57.375ms - HTResizeTime: 29.621ms - HashBuckets: 262.14K (262144) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 14.24 MB (14932695) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 140.77K (140770) - RowsReturnedRate: 543.00 /sec - SpilledPartitions: 0 (0) - UnpinTime: 2.980us EXCHANGE_NODE (id=11):(Total: 4m18s, non-child: 87.097ms, % non-child: 0.03%) BytesReceived(8s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 3.78 MB (3965370) - ConvertRowBatchTime: 45.486ms - DeserializeRowBatchTimer: 51.420ms - FirstBatchArrivalWaitTime: 4m17s - PeakMemoryUsage: 0 - RowsReturned: 140.77K (140770) - RowsReturnedRate: 544.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance a6492cb57c2f2439:29baebe700000029 (host=redacted-host8:22000):(Total: 4m20s, non-child: 54.197ms, % non-child: 0.02%) MemoryUsage(8s000ms): 2.39 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB ThreadUsage(8s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 14.28 MB (14973137) - PerHostPeakMemUsage: 1.02 GB (1092393946) - RowsProduced: 10 (10) - TotalNetworkReceiveTime: 4m18s - TotalNetworkSendTime: 308.831us - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 690 (690) - TotalThreadsTotalWallClockTime: 4m19s - TotalThreadsSysTime: 22.996ms - TotalThreadsUserTime: 718.891ms - TotalThreadsVoluntaryContextSwitches: 449 (449) Fragment Instance Lifecycle Timings: - ExecTime: 513.397us - ExecTreeExecTime: 12.198us - OpenTime: 4m19s - ExecTreeOpenTime: 4m18s - PrepareTime: 555.851ms - ExecTreePrepareTime: 321.794ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 208 (208) - BlocksRecycled: 16 (16) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 1.59 GB (1707081728) - PeakMemoryUsage: 916.38 MB (960888832) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=13):(Total: 85.024us, non-child: 85.024us, % non-child: 100.00%) - BytesSent: 353.00 B (353) - NetworkThroughput(*): 13.67 MB/sec - OverallThroughput: 3.96 MB/sec - PeakMemoryUsage: 2.61 KB (2672) - RowsReturned: 10 (10) - SerializeBatchTime: 25.744us - TransmitDataRPCTime: 24.632us - UncompressedRowBatchSize: 634.00 B (634) CodeGen:(Total: 1s469ms, non-child: 1s469ms, % non-child: 100.00%) - CodegenTime: 40.324ms - CompileTime: 207.327ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2076168) - NumFunctions: 117 (117) - NumInstructions: 2.41K (2414) - OptimizationTime: 1s076ms - PeakMemoryUsage: 1.18 MB (1235968) - PrepareTime: 174.282ms SORT_NODE (id=6):(Total: 4m18s, non-child: 15.766ms, % non-child: 0.01%) ExecOption: Codegen Enabled - InsertBatchTime: 14.917ms - PeakMemoryUsage: 12.00 KB (12288) - RowsReturned: 10 (10) - RowsReturnedRate: 0 AGGREGATION_NODE (id=12):(Total: 4m18s, non-child: 592.968ms, % non-child: 0.23%) ExecOption: Codegen Enabled - BuildTime: 190.340ms - GetNewBlockTime: 8.172ms - GetResultsTime: 59.784ms - HTResizeTime: 21.791ms - HashBuckets: 262.14K (262144) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 14.23 MB (14922606) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 141.46K (141459) - RowsReturnedRate: 546.00 /sec - SpilledPartitions: 0 (0) - UnpinTime: 3.015us EXCHANGE_NODE (id=11):(Total: 4m18s, non-child: 65.146ms, % non-child: 0.03%) BytesReceived(8s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 3.80 MB (3985063) - ConvertRowBatchTime: 33.724ms - DeserializeRowBatchTimer: 49.855ms - FirstBatchArrivalWaitTime: 4m17s - PeakMemoryUsage: 0 - RowsReturned: 141.46K (141459) - RowsReturnedRate: 547.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance a6492cb57c2f2439:29baebe700000028 (host=redacted-host2:22000):(Total: 4m20s, non-child: 52.806ms, % non-child: 0.02%) MemoryUsage(8s000ms): 2.39 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB ThreadUsage(8s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 14.27 MB (14961160) - PerHostPeakMemUsage: 1.02 GB (1100062902) - RowsProduced: 10 (10) - TotalNetworkReceiveTime: 4m18s - TotalNetworkSendTime: 286.861us - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 587 (587) - TotalThreadsTotalWallClockTime: 4m19s - TotalThreadsSysTime: 17.997ms - TotalThreadsUserTime: 703.893ms - TotalThreadsVoluntaryContextSwitches: 503 (503) Fragment Instance Lifecycle Timings: - ExecTime: 524.231us - ExecTreeExecTime: 13.581us - OpenTime: 4m19s - ExecTreeOpenTime: 4m18s - PrepareTime: 423.017ms - ExecTreePrepareTime: 240.937ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 208 (208) - BlocksRecycled: 16 (16) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 1.59 GB (1707081728) - PeakMemoryUsage: 916.38 MB (960888832) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=13):(Total: 99.518us, non-child: 99.518us, % non-child: 100.00%) - BytesSent: 366.00 B (366) - NetworkThroughput(*): 13.40 MB/sec - OverallThroughput: 3.51 MB/sec - PeakMemoryUsage: 2.61 KB (2672) - RowsReturned: 10 (10) - SerializeBatchTime: 30.996us - TransmitDataRPCTime: 26.050us - UncompressedRowBatchSize: 634.00 B (634) CodeGen:(Total: 1s229ms, non-child: 1s229ms, % non-child: 100.00%) - CodegenTime: 24.968ms - CompileTime: 343.644ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2076168) - NumFunctions: 117 (117) - NumInstructions: 2.41K (2414) - OptimizationTime: 745.503ms - PeakMemoryUsage: 1.18 MB (1235968) - PrepareTime: 126.212ms SORT_NODE (id=6):(Total: 4m19s, non-child: 14.375ms, % non-child: 0.01%) ExecOption: Codegen Enabled - InsertBatchTime: 13.518ms - PeakMemoryUsage: 12.00 KB (12288) - RowsReturned: 10 (10) - RowsReturnedRate: 0 AGGREGATION_NODE (id=12):(Total: 4m19s, non-child: 482.433ms, % non-child: 0.19%) ExecOption: Codegen Enabled - BuildTime: 191.703ms - GetNewBlockTime: 54.228ms - GetResultsTime: 42.709ms - HTResizeTime: 18.802ms - HashBuckets: 262.14K (262144) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 14.22 MB (14910629) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 141.57K (141569) - RowsReturnedRate: 546.00 /sec - SpilledPartitions: 0 (0) - UnpinTime: 3.005us EXCHANGE_NODE (id=11):(Total: 4m18s, non-child: 49.582ms, % non-child: 0.02%) BytesReceived(8s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 3.80 MB (3986555) - ConvertRowBatchTime: 32.965ms - DeserializeRowBatchTimer: 54.500ms - FirstBatchArrivalWaitTime: 4m17s - PeakMemoryUsage: 0 - RowsReturned: 141.57K (141569) - RowsReturnedRate: 547.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance a6492cb57c2f2439:29baebe700000026 (host=redacted-host5:22000):(Total: 4m20s, non-child: 20.194ms, % non-child: 0.01%) MemoryUsage(8s000ms): 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB ThreadUsage(8s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 14.27 MB (14965633) - PerHostPeakMemUsage: 1.02 GB (1099935664) - RowsProduced: 10 (10) - TotalNetworkReceiveTime: 4m18s - TotalNetworkSendTime: 228.392us - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 558 (558) - TotalThreadsTotalWallClockTime: 4m19s - TotalThreadsSysTime: 35.994ms - TotalThreadsUserTime: 743.887ms - TotalThreadsVoluntaryContextSwitches: 421 (421) Fragment Instance Lifecycle Timings: - ExecTime: 539.276us - ExecTreeExecTime: 22.142us - OpenTime: 4m19s - ExecTreeOpenTime: 4m18s - PrepareTime: 557.014ms - ExecTreePrepareTime: 353.194ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 208 (208) - BlocksRecycled: 16 (16) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 1.59 GB (1707081728) - PeakMemoryUsage: 916.38 MB (960888832) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=13):(Total: 169.889us, non-child: 169.889us, % non-child: 100.00%) - BytesSent: 356.00 B (356) - NetworkThroughput(*): 15.73 MB/sec - OverallThroughput: 2.00 MB/sec - PeakMemoryUsage: 2.61 KB (2672) - RowsReturned: 10 (10) - SerializeBatchTime: 72.150us - TransmitDataRPCTime: 21.590us - UncompressedRowBatchSize: 634.00 B (634) CodeGen:(Total: 1s254ms, non-child: 1s254ms, % non-child: 100.00%) - CodegenTime: 17.760ms - CompileTime: 336.679ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2076168) - NumFunctions: 117 (117) - NumInstructions: 2.41K (2414) - OptimizationTime: 718.524ms - PeakMemoryUsage: 1.18 MB (1235968) - PrepareTime: 198.413ms SORT_NODE (id=6):(Total: 4m19s, non-child: 15.145ms, % non-child: 0.01%) ExecOption: Codegen Enabled - InsertBatchTime: 14.214ms - PeakMemoryUsage: 12.00 KB (12288) - RowsReturned: 10 (10) - RowsReturnedRate: 0 AGGREGATION_NODE (id=12):(Total: 4m19s, non-child: 622.807ms, % non-child: 0.24%) ExecOption: Codegen Enabled - BuildTime: 225.677ms - GetNewBlockTime: 96.224ms - GetResultsTime: 36.062ms - HTResizeTime: 21.347ms - HashBuckets: 262.14K (262144) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 14.23 MB (14922606) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 141.38K (141381) - RowsReturnedRate: 545.00 /sec - SpilledPartitions: 0 (0) - UnpinTime: 5.736us EXCHANGE_NODE (id=11):(Total: 4m18s, non-child: 64.982ms, % non-child: 0.03%) BytesReceived(8s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 3.80 MB (3982036) - ConvertRowBatchTime: 40.294ms - DeserializeRowBatchTimer: 58.750ms - FirstBatchArrivalWaitTime: 4m17s - PeakMemoryUsage: 0 - RowsReturned: 141.38K (141381) - RowsReturnedRate: 547.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Averaged Fragment F04:(Total: 4m20s, non-child: 436.021ms, % non-child: 0.17%) split sizes: min: 0, max: 0, avg: 0, stddev: 0 completion times: min:4m20s max:4m20s mean: 4m20s stddev:225.933ms execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec num instances: 8 - AverageThreadTokens: 1.00 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 167.92 MB (176077088) - PerHostPeakMemUsage: 1.02 GB (1098647219) - RowsProduced: 141.38K (141380) - TotalNetworkReceiveTime: 4m14s - TotalNetworkSendTime: 13.203ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 1.06K (1065) - TotalThreadsTotalWallClockTime: 4m19s - TotalThreadsSysTime: 134.604ms - TotalThreadsUserTime: 2s986ms - TotalThreadsVoluntaryContextSwitches: 10.26K (10261) Fragment Instance Lifecycle Timings: - ExecTime: 3m9s - ExecTreeExecTime: 3m8s - OpenTime: 1m10s - ExecTreeOpenTime: 1m8s - PrepareTime: 580.833ms - ExecTreePrepareTime: 241.450ms DataStreamSender (dst_id=11):(Total: 173.437ms, non-child: 173.437ms, % non-child: 100.00%) - BytesSent: 3.80 MB (3982768) - NetworkThroughput(*): 131.18 MB/sec - OverallThroughput: 22.09 MB/sec - PeakMemoryUsage: 244.88 KB (250752) - RowsReturned: 141.38K (141380) - SerializeBatchTime: 143.556ms - TransmitDataRPCTime: 29.006ms - UncompressedRowBatchSize: 8.50 MB (8908656) CodeGen:(Total: 1s787ms, non-child: 1s787ms, % non-child: 100.00%) - CodegenTime: 64.721ms - CompileTime: 423.281ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2076168) - NumFunctions: 131 (131) - NumInstructions: 5.07K (5071) - OptimizationTime: 1s143ms - PeakMemoryUsage: 2.48 MB (2596352) - PrepareTime: 204.897ms AGGREGATION_NODE (id=5):(Total: 4m17s, non-child: 389.129ms, % non-child: 0.15%) - GetNewBlockTime: 27.370ms - GetResultsTime: 53.511ms - HTResizeTime: 53.212ms - HashBuckets: 262.14K (262144) - LargestPartitionPercent: 2 (2) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 13.69 MB (14354367) - PinTime: 0.000ns - ReductionFactorEstimate: 12.57 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 0 (0) - RowsReturned: 141.38K (141380) - RowsReturnedRate: 548.00 /sec - StreamingTime: 452.592ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=4):(Total: 4m17s, non-child: 1s901ms, % non-child: 0.74%) - BuildRows: 375.02K (375023) - BuildTime: 1s056ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 153.17 MB (160605554) - ProbeRows: 1.82M (1821104) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 354.799ms - RowsReturned: 373.45K (373447) - RowsReturnedRate: 1.45 K/sec Hash Join Builder (join_node_id=4): - BuildRowsPartitionTime: 744.250ms - BuildRowsPartitioned: 375.02K (375023) - GetNewBlockTime: 194.909ms - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 231.413ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160453760) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=10):(Total: 48s998ms, non-child: 48s998ms, % non-child: 100.00%) - BytesReceived: 4.55 MB (4770771) - ConvertRowBatchTime: 88.408ms - DeserializeRowBatchTimer: 1s295ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 375.02K (375023) - RowsReturnedRate: 7.66 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=9):(Total: 3m26s, non-child: 3m26s, % non-child: 100.00%) - BytesReceived: 79.80 MB (83673475) - ConvertRowBatchTime: 434.858ms - DeserializeRowBatchTimer: 1s463ms - FirstBatchArrivalWaitTime: 18s264ms - PeakMemoryUsage: 0 - RowsReturned: 1.82M (1821104) - RowsReturnedRate: 8.82 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Fragment F04: Instance a6492cb57c2f2439:29baebe700000022 (host=redacted-host3:22000):(Total: 4m20s, non-child: 578.070ms, % non-child: 0.22%) MemoryUsage(8s000ms): 8.47 MB, 11.43 MB, 11.42 MB, 11.43 MB, 11.43 MB, 11.43 MB, 105.91 MB, 155.40 MB, 155.51 MB, 156.06 MB, 156.44 MB, 159.05 MB, 164.56 MB, 164.50 MB, 165.48 MB, 165.49 MB, 165.55 MB, 165.50 MB, 165.53 MB, 165.53 MB, 165.55 MB, 165.67 MB, 167.46 MB, 167.60 MB, 167.51 MB, 167.55 MB, 167.52 MB, 167.50 MB, 167.58 MB, 167.59 MB, 167.55 MB, 167.50 MB ThreadUsage(8s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 167.92 MB (176077453) - PerHostPeakMemUsage: 1.01 GB (1089011159) - RowsProduced: 141.88K (141885) - TotalNetworkReceiveTime: 4m16s - TotalNetworkSendTime: 21.982ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 1.28K (1277) - TotalThreadsTotalWallClockTime: 4m20s - TotalThreadsSysTime: 171.974ms - TotalThreadsUserTime: 2s863ms - TotalThreadsVoluntaryContextSwitches: 10.16K (10158) Fragment Instance Lifecycle Timings: - ExecTime: 3m9s - ExecTreeExecTime: 3m9s - OpenTime: 1m10s - ExecTreeOpenTime: 1m10s - PrepareTime: 188.308ms - ExecTreePrepareTime: 7.801ms DataStreamSender (dst_id=11):(Total: 210.563ms, non-child: 210.563ms, % non-child: 100.00%) - BytesSent: 3.81 MB (3996875) - NetworkThroughput(*): 135.35 MB/sec - OverallThroughput: 18.10 MB/sec - PeakMemoryUsage: 244.88 KB (250752) - RowsReturned: 141.88K (141885) - SerializeBatchTime: 182.137ms - TransmitDataRPCTime: 28.160ms - UncompressedRowBatchSize: 8.53 MB (8940471) CodeGen:(Total: 674.799ms, non-child: 674.799ms, % non-child: 100.00%) - CodegenTime: 51.441ms - CompileTime: 37.013ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2076168) - NumFunctions: 131 (131) - NumInstructions: 5.07K (5071) - OptimizationTime: 508.225ms - PeakMemoryUsage: 2.48 MB (2596352) - PrepareTime: 128.590ms AGGREGATION_NODE (id=5):(Total: 4m19s, non-child: 650.835ms, % non-child: 0.25%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 5.812ms - GetResultsTime: 68.829ms - HTResizeTime: 81.087ms - HashBuckets: 262.14K (262144) - LargestPartitionPercent: 2 (2) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 13.70 MB (14363140) - PinTime: 0.000ns - ReductionFactorEstimate: 12.53 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 0 (0) - RowsReturned: 141.88K (141885) - RowsReturnedRate: 547.00 /sec - StreamingTime: 546.162ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=4):(Total: 4m18s, non-child: 1s197ms, % non-child: 0.46%) ExecOption: Probe Side Codegen Enabled - BuildRows: 375.57K (375566) - BuildTime: 793.295ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 153.17 MB (160606832) - ProbeRows: 1.82M (1818609) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 351.103ms - RowsReturned: 374.46K (374456) - RowsReturnedRate: 1.45 K/sec Hash Join Builder (join_node_id=4): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 645.289ms - BuildRowsPartitioned: 375.57K (375566) - GetNewBlockTime: 32.675ms - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 144.366ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160453760) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=10):(Total: 50s967ms, non-child: 188.729ms, % non-child: 0.37%) BytesReceived(8s000ms): 457.08 KB, 1.06 MB, 2.11 MB, 3.08 MB, 3.28 MB, 3.28 MB, 4.06 MB, 4.56 MB, 4.56 MB, 4.56 MB, 4.56 MB, 4.56 MB, 4.56 MB, 4.56 MB, 4.56 MB, 4.56 MB, 4.56 MB, 4.56 MB, 4.56 MB, 4.56 MB, 4.56 MB, 4.56 MB, 4.56 MB, 4.56 MB, 4.56 MB, 4.56 MB, 4.56 MB, 4.56 MB, 4.56 MB, 4.56 MB, 4.56 MB, 4.56 MB - BytesReceived: 4.56 MB (4778575) - ConvertRowBatchTime: 91.804ms - DeserializeRowBatchTimer: 1s126ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 375.57K (375566) - RowsReturnedRate: 7.37 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=9):(Total: 3m26s, non-child: 725.895ms, % non-child: 0.35%) BytesReceived(8s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 75.37 KB, 2.37 MB, 6.21 MB, 9.62 MB, 12.76 MB, 16.63 MB, 20.72 MB, 24.24 MB, 27.35 MB, 30.65 MB, 33.08 MB, 36.62 MB, 40.57 MB, 44.45 MB, 48.32 MB, 52.22 MB, 56.25 MB, 60.28 MB, 64.44 MB, 68.76 MB, 72.61 MB, 75.77 MB, 77.67 MB, 78.97 MB - BytesReceived: 79.69 MB (83557041) - ConvertRowBatchTime: 435.514ms - DeserializeRowBatchTimer: 1s537ms - FirstBatchArrivalWaitTime: 18s350ms - PeakMemoryUsage: 0 - RowsReturned: 1.82M (1818609) - RowsReturnedRate: 8.80 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance a6492cb57c2f2439:29baebe700000024 (host=redacted-host6:22000):(Total: 4m20s, non-child: 564.031ms, % non-child: 0.22%) MemoryUsage(8s000ms): 8.46 MB, 11.44 MB, 11.43 MB, 11.43 MB, 11.43 MB, 11.43 MB, 108.29 MB, 155.40 MB, 155.55 MB, 156.08 MB, 156.47 MB, 159.38 MB, 164.52 MB, 164.58 MB, 165.47 MB, 165.58 MB, 165.51 MB, 165.47 MB, 165.50 MB, 165.48 MB, 165.51 MB, 165.70 MB, 167.42 MB, 167.58 MB, 167.50 MB, 167.56 MB, 167.56 MB, 167.55 MB, 167.56 MB, 167.54 MB, 167.53 MB, 167.53 MB ThreadUsage(8s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 167.92 MB (176077453) - PerHostPeakMemUsage: 1.03 GB (1100730973) - RowsProduced: 141.90K (141903) - TotalNetworkReceiveTime: 4m14s - TotalNetworkSendTime: 7.624ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 1.71K (1714) - TotalThreadsTotalWallClockTime: 4m19s - TotalThreadsSysTime: 110.983ms - TotalThreadsUserTime: 3s083ms - TotalThreadsVoluntaryContextSwitches: 10.35K (10354) Fragment Instance Lifecycle Timings: - ExecTime: 3m9s - ExecTreeExecTime: 3m8s - OpenTime: 1m10s - ExecTreeOpenTime: 1m8s - PrepareTime: 663.533ms - ExecTreePrepareTime: 111.453ms DataStreamSender (dst_id=11):(Total: 172.119ms, non-child: 172.119ms, % non-child: 100.00%) - BytesSent: 3.81 MB (3998036) - NetworkThroughput(*): 135.53 MB/sec - OverallThroughput: 22.15 MB/sec - PeakMemoryUsage: 244.88 KB (250752) - RowsReturned: 141.90K (141903) - SerializeBatchTime: 143.726ms - TransmitDataRPCTime: 28.132ms - UncompressedRowBatchSize: 8.53 MB (8941605) CodeGen:(Total: 1s965ms, non-child: 1s965ms, % non-child: 100.00%) - CodegenTime: 49.805ms - CompileTime: 284.224ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2076168) - NumFunctions: 131 (131) - NumInstructions: 5.07K (5071) - OptimizationTime: 1s365ms - PeakMemoryUsage: 2.48 MB (2596352) - PrepareTime: 272.567ms AGGREGATION_NODE (id=5):(Total: 4m17s, non-child: 597.671ms, % non-child: 0.23%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 71.232ms - GetResultsTime: 56.459ms - HTResizeTime: 68.431ms - HashBuckets: 262.14K (262144) - LargestPartitionPercent: 2 (2) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 13.70 MB (14363140) - PinTime: 0.000ns - ReductionFactorEstimate: 12.57 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 0 (0) - RowsReturned: 141.90K (141903) - RowsReturnedRate: 550.00 /sec - StreamingTime: 417.081ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=4):(Total: 4m17s, non-child: 1s634ms, % non-child: 0.64%) ExecOption: Probe Side Codegen Enabled - BuildRows: 374.21K (374209) - BuildTime: 1s201ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 153.17 MB (160605372) - ProbeRows: 1.82M (1822073) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 354.431ms - RowsReturned: 374.79K (374785) - RowsReturnedRate: 1.46 K/sec Hash Join Builder (join_node_id=4): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 959.739ms - BuildRowsPartitioned: 374.21K (374209) - GetNewBlockTime: 248.458ms - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 201.949ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160453760) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=10):(Total: 48s902ms, non-child: 552.595ms, % non-child: 1.13%) BytesReceived(8s000ms): 452.78 KB, 1.08 MB, 2.11 MB, 3.10 MB, 3.27 MB, 3.27 MB, 4.08 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB - BytesReceived: 4.54 MB (4760573) - ConvertRowBatchTime: 88.976ms - DeserializeRowBatchTimer: 1s918ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 374.21K (374209) - RowsReturnedRate: 7.65 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=9):(Total: 3m26s, non-child: 758.348ms, % non-child: 0.37%) BytesReceived(8s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 91.15 KB, 2.48 MB, 6.32 MB, 9.72 MB, 12.88 MB, 16.76 MB, 20.86 MB, 24.39 MB, 27.53 MB, 30.83 MB, 33.04 MB, 36.54 MB, 40.48 MB, 44.36 MB, 48.24 MB, 52.14 MB, 56.20 MB, 60.20 MB, 64.33 MB, 68.66 MB, 72.58 MB, 75.76 MB, 77.72 MB, 79.07 MB - BytesReceived: 79.85 MB (83730809) - ConvertRowBatchTime: 434.239ms - DeserializeRowBatchTimer: 1s416ms - FirstBatchArrivalWaitTime: 18s289ms - PeakMemoryUsage: 0 - RowsReturned: 1.82M (1822073) - RowsReturnedRate: 8.82 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance a6492cb57c2f2439:29baebe700000023 (host=redacted-host1:22000):(Total: 4m20s, non-child: 462.629ms, % non-child: 0.18%) MemoryUsage(8s000ms): 8.34 MB, 11.43 MB, 11.42 MB, 11.44 MB, 11.44 MB, 11.44 MB, 99.36 MB, 155.40 MB, 155.50 MB, 156.00 MB, 156.49 MB, 158.78 MB, 164.61 MB, 164.52 MB, 165.39 MB, 165.53 MB, 165.56 MB, 165.40 MB, 165.56 MB, 165.57 MB, 165.56 MB, 165.54 MB, 167.12 MB, 167.58 MB, 167.55 MB, 167.51 MB, 167.56 MB, 167.53 MB, 167.53 MB, 167.59 MB, 167.50 MB, 167.52 MB ThreadUsage(8s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 167.92 MB (176077453) - PerHostPeakMemUsage: 1.03 GB (1105124622) - RowsProduced: 141.57K (141571) - TotalNetworkReceiveTime: 4m15s - TotalNetworkSendTime: 15.518ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 930 (930) - TotalThreadsTotalWallClockTime: 4m19s - TotalThreadsSysTime: 107.984ms - TotalThreadsUserTime: 3s068ms - TotalThreadsVoluntaryContextSwitches: 10.28K (10280) Fragment Instance Lifecycle Timings: - ExecTime: 3m9s - ExecTreeExecTime: 3m8s - OpenTime: 1m10s - ExecTreeOpenTime: 1m8s - PrepareTime: 496.373ms - ExecTreePrepareTime: 77.201ms DataStreamSender (dst_id=11):(Total: 172.494ms, non-child: 172.494ms, % non-child: 100.00%) - BytesSent: 3.80 MB (3988530) - NetworkThroughput(*): 126.75 MB/sec - OverallThroughput: 22.05 MB/sec - PeakMemoryUsage: 244.88 KB (250752) - RowsReturned: 141.57K (141571) - SerializeBatchTime: 142.214ms - TransmitDataRPCTime: 30.009ms - UncompressedRowBatchSize: 8.51 MB (8920685) CodeGen:(Total: 1s934ms, non-child: 1s934ms, % non-child: 100.00%) - CodegenTime: 59.153ms - CompileTime: 443.405ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2076168) - NumFunctions: 131 (131) - NumInstructions: 5.07K (5071) - OptimizationTime: 1s263ms - PeakMemoryUsage: 2.48 MB (2596352) - PrepareTime: 225.178ms AGGREGATION_NODE (id=5):(Total: 4m17s, non-child: 512.632ms, % non-child: 0.20%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 52.060ms - GetResultsTime: 52.691ms - HTResizeTime: 62.763ms - HashBuckets: 262.14K (262144) - LargestPartitionPercent: 2 (2) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 13.70 MB (14363140) - PinTime: 0.000ns - ReductionFactorEstimate: 12.57 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 0 (0) - RowsReturned: 141.57K (141571) - RowsReturnedRate: 549.00 /sec - StreamingTime: 394.163ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=4):(Total: 4m17s, non-child: 1s540ms, % non-child: 0.60%) ExecOption: Probe Side Codegen Enabled - BuildRows: 375.54K (375538) - BuildTime: 999.882ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 153.17 MB (160605372) - ProbeRows: 1.82M (1822606) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 358.417ms - RowsReturned: 374.47K (374473) - RowsReturnedRate: 1.46 K/sec Hash Join Builder (join_node_id=4): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 754.387ms - BuildRowsPartitioned: 375.54K (375538) - GetNewBlockTime: 242.085ms - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 195.619ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160453760) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=10):(Total: 49s122ms, non-child: 123.843ms, % non-child: 0.25%) BytesReceived(8s000ms): 432.47 KB, 1.04 MB, 2.10 MB, 3.04 MB, 3.28 MB, 3.28 MB, 4.02 MB, 4.56 MB, 4.56 MB, 4.56 MB, 4.56 MB, 4.56 MB, 4.56 MB, 4.56 MB, 4.56 MB, 4.56 MB, 4.56 MB, 4.56 MB, 4.56 MB, 4.56 MB, 4.56 MB, 4.56 MB, 4.56 MB, 4.56 MB, 4.56 MB, 4.56 MB, 4.56 MB, 4.56 MB, 4.56 MB, 4.56 MB, 4.56 MB, 4.56 MB - BytesReceived: 4.56 MB (4777376) - ConvertRowBatchTime: 86.951ms - DeserializeRowBatchTimer: 628.038ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 375.54K (375538) - RowsReturnedRate: 7.64 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=9):(Total: 3m26s, non-child: 727.239ms, % non-child: 0.35%) BytesReceived(8s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 49.45 KB, 2.23 MB, 6.08 MB, 9.53 MB, 12.66 MB, 16.45 MB, 20.55 MB, 24.12 MB, 27.26 MB, 30.57 MB, 32.75 MB, 36.20 MB, 40.10 MB, 44.02 MB, 47.95 MB, 51.87 MB, 55.94 MB, 59.92 MB, 64.06 MB, 68.36 MB, 72.33 MB, 75.57 MB, 77.63 MB, 79.02 MB - BytesReceived: 79.87 MB (83747362) - ConvertRowBatchTime: 435.735ms - DeserializeRowBatchTimer: 1s448ms - FirstBatchArrivalWaitTime: 18s299ms - PeakMemoryUsage: 0 - RowsReturned: 1.82M (1822606) - RowsReturnedRate: 8.82 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance a6492cb57c2f2439:29baebe700000025 (host=redacted-host7:22000):(Total: 4m20s, non-child: 508.617ms, % non-child: 0.20%) MemoryUsage(8s000ms): 8.76 MB, 11.43 MB, 11.44 MB, 11.43 MB, 11.43 MB, 11.43 MB, 133.91 MB, 155.40 MB, 155.60 MB, 156.10 MB, 156.48 MB, 160.27 MB, 164.50 MB, 164.71 MB, 165.51 MB, 165.54 MB, 165.54 MB, 165.61 MB, 165.49 MB, 165.54 MB, 165.56 MB, 165.65 MB, 167.36 MB, 167.54 MB, 167.55 MB, 167.54 MB, 167.55 MB, 167.49 MB, 167.52 MB, 167.51 MB, 167.55 MB, 167.50 MB ThreadUsage(8s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 167.91 MB (176071353) - PerHostPeakMemUsage: 1.03 GB (1101185652) - RowsProduced: 140.52K (140516) - TotalNetworkReceiveTime: 4m13s - TotalNetworkSendTime: 5.961ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 1.42K (1420) - TotalThreadsTotalWallClockTime: 4m19s - TotalThreadsSysTime: 154.976ms - TotalThreadsUserTime: 2s974ms - TotalThreadsVoluntaryContextSwitches: 10.26K (10260) Fragment Instance Lifecycle Timings: - ExecTime: 3m9s - ExecTreeExecTime: 3m9s - OpenTime: 1m9s - ExecTreeOpenTime: 1m8s - PrepareTime: 701.123ms - ExecTreePrepareTime: 376.166ms DataStreamSender (dst_id=11):(Total: 185.834ms, non-child: 185.834ms, % non-child: 100.00%) - BytesSent: 3.78 MB (3959669) - NetworkThroughput(*): 135.57 MB/sec - OverallThroughput: 20.32 MB/sec - PeakMemoryUsage: 244.88 KB (250752) - RowsReturned: 140.52K (140516) - SerializeBatchTime: 157.724ms - TransmitDataRPCTime: 27.854ms - UncompressedRowBatchSize: 8.44 MB (8854208) CodeGen:(Total: 1s981ms, non-child: 1s981ms, % non-child: 100.00%) - CodegenTime: 65.337ms - CompileTime: 563.431ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2076168) - NumFunctions: 131 (131) - NumInstructions: 5.07K (5071) - OptimizationTime: 1s229ms - PeakMemoryUsage: 2.48 MB (2596352) - PrepareTime: 177.579ms AGGREGATION_NODE (id=5):(Total: 4m17s, non-child: 294.385ms, % non-child: 0.11%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 35.181ms - GetResultsTime: 57.848ms - HTResizeTime: 27.116ms - HashBuckets: 262.14K (262144) - LargestPartitionPercent: 2 (2) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 13.67 MB (14333558) - PinTime: 0.000ns - ReductionFactorEstimate: 12.58 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 0 (0) - RowsReturned: 140.52K (140516) - RowsReturnedRate: 545.00 /sec - StreamingTime: 455.087ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=4):(Total: 4m17s, non-child: 2s576ms, % non-child: 1.00%) ExecOption: Probe Side Codegen Enabled - BuildRows: 375.63K (375632) - BuildTime: 1s548ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 153.17 MB (160605372) - ProbeRows: 1.82M (1819000) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 356.226ms - RowsReturned: 370.83K (370830) - RowsReturnedRate: 1.44 K/sec Hash Join Builder (join_node_id=4): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 1s030ms - BuildRowsPartitioned: 375.63K (375632) - GetNewBlockTime: 344.665ms - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 381.868ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160453760) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=10):(Total: 48s259ms, non-child: 385.029ms, % non-child: 0.80%) BytesReceived(8s000ms): 485.75 KB, 1.10 MB, 2.17 MB, 3.27 MB, 3.29 MB, 3.29 MB, 4.30 MB, 4.55 MB, 4.55 MB, 4.55 MB, 4.55 MB, 4.55 MB, 4.55 MB, 4.55 MB, 4.55 MB, 4.55 MB, 4.55 MB, 4.55 MB, 4.55 MB, 4.55 MB, 4.55 MB, 4.55 MB, 4.55 MB, 4.55 MB, 4.55 MB, 4.55 MB, 4.55 MB, 4.55 MB, 4.55 MB, 4.55 MB, 4.55 MB, 4.55 MB - BytesReceived: 4.55 MB (4776001) - ConvertRowBatchTime: 85.544ms - DeserializeRowBatchTimer: 1s980ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 375.63K (375632) - RowsReturnedRate: 7.78 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=9):(Total: 3m26s, non-child: 717.411ms, % non-child: 0.35%) BytesReceived(8s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 223.67 KB, 3.07 MB, 6.83 MB, 10.14 MB, 13.36 MB, 17.39 MB, 21.39 MB, 24.82 MB, 27.96 MB, 31.07 MB, 33.34 MB, 36.94 MB, 40.87 MB, 44.79 MB, 48.65 MB, 52.56 MB, 56.63 MB, 60.65 MB, 64.85 MB, 69.17 MB, 72.92 MB, 76.01 MB, 77.84 MB, 79.09 MB - BytesReceived: 79.71 MB (83578514) - ConvertRowBatchTime: 434.508ms - DeserializeRowBatchTimer: 1s511ms - FirstBatchArrivalWaitTime: 18s103ms - PeakMemoryUsage: 0 - RowsReturned: 1.82M (1819000) - RowsReturnedRate: 8.81 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance a6492cb57c2f2439:29baebe70000001f (host=redacted-host4:22000):(Total: 4m20s, non-child: 316.470ms, % non-child: 0.12%) MemoryUsage(8s000ms): 8.08 MB, 11.44 MB, 11.43 MB, 11.43 MB, 11.43 MB, 11.43 MB, 107.42 MB, 155.40 MB, 155.52 MB, 156.01 MB, 156.38 MB, 158.93 MB, 164.46 MB, 164.49 MB, 165.47 MB, 165.54 MB, 165.56 MB, 165.65 MB, 165.55 MB, 165.53 MB, 165.53 MB, 165.62 MB, 167.33 MB, 167.55 MB, 167.52 MB, 167.56 MB, 167.50 MB, 167.51 MB, 167.62 MB, 167.50 MB, 167.57 MB, 167.51 MB ThreadUsage(8s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 167.94 MB (176100935) - PerHostPeakMemUsage: 1.03 GB (1100732840) - RowsProduced: 140.92K (140921) - TotalNetworkReceiveTime: 4m14s - TotalNetworkSendTime: 15.946ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 602 (602) - TotalThreadsTotalWallClockTime: 4m19s - TotalThreadsSysTime: 157.976ms - TotalThreadsUserTime: 2s919ms - TotalThreadsVoluntaryContextSwitches: 10.28K (10282) Fragment Instance Lifecycle Timings: - ExecTime: 3m9s - ExecTreeExecTime: 3m8s - OpenTime: 1m10s - ExecTreeOpenTime: 1m8s - PrepareTime: 669.918ms - ExecTreePrepareTime: 221.770ms DataStreamSender (dst_id=11):(Total: 149.252ms, non-child: 149.252ms, % non-child: 100.00%) - BytesSent: 3.79 MB (3969297) - NetworkThroughput(*): 130.74 MB/sec - OverallThroughput: 25.36 MB/sec - PeakMemoryUsage: 244.88 KB (250752) - RowsReturned: 140.92K (140921) - SerializeBatchTime: 120.048ms - TransmitDataRPCTime: 28.953ms - UncompressedRowBatchSize: 8.47 MB (8879727) CodeGen:(Total: 2s061ms, non-child: 2s061ms, % non-child: 100.00%) - CodegenTime: 152.690ms - CompileTime: 279.355ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2076168) - NumFunctions: 131 (131) - NumInstructions: 5.07K (5071) - OptimizationTime: 1s426ms - PeakMemoryUsage: 2.48 MB (2596352) - PrepareTime: 299.663ms AGGREGATION_NODE (id=5):(Total: 4m17s, non-child: 402.952ms, % non-child: 0.16%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 294.466us - GetResultsTime: 44.880ms - HTResizeTime: 56.186ms - HashBuckets: 262.14K (262144) - LargestPartitionPercent: 2 (2) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 13.68 MB (14342842) - PinTime: 0.000ns - ReductionFactorEstimate: 12.63 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 0 (0) - RowsReturned: 140.92K (140921) - RowsReturnedRate: 547.00 /sec - StreamingTime: 469.632ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=4):(Total: 4m17s, non-child: 1s712ms, % non-child: 0.67%) ExecOption: Probe Side Codegen Enabled - BuildRows: 374.80K (374796) - BuildTime: 926.657ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 153.17 MB (160605372) - ProbeRows: 1.82M (1822454) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 354.486ms - RowsReturned: 372.97K (372970) - RowsReturnedRate: 1.45 K/sec Hash Join Builder (join_node_id=4): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 734.805ms - BuildRowsPartitioned: 374.80K (374796) - GetNewBlockTime: 182.954ms - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 184.824ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160453760) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=10):(Total: 48s921ms, non-child: 191.484ms, % non-child: 0.39%) BytesReceived(8s000ms): 441.92 KB, 1.06 MB, 2.10 MB, 3.08 MB, 3.27 MB, 3.27 MB, 4.06 MB, 4.55 MB, 4.55 MB, 4.55 MB, 4.55 MB, 4.55 MB, 4.55 MB, 4.55 MB, 4.55 MB, 4.55 MB, 4.55 MB, 4.55 MB, 4.55 MB, 4.55 MB, 4.55 MB, 4.55 MB, 4.55 MB, 4.55 MB, 4.55 MB, 4.55 MB, 4.55 MB, 4.55 MB, 4.55 MB, 4.55 MB, 4.55 MB, 4.55 MB - BytesReceived: 4.55 MB (4768379) - ConvertRowBatchTime: 85.561ms - DeserializeRowBatchTimer: 1s244ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 374.80K (374796) - RowsReturnedRate: 7.66 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=9):(Total: 3m26s, non-child: 717.980ms, % non-child: 0.35%) BytesReceived(8s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 77.71 KB, 2.40 MB, 6.21 MB, 9.58 MB, 12.75 MB, 16.60 MB, 20.74 MB, 24.28 MB, 27.40 MB, 30.70 MB, 33.15 MB, 36.73 MB, 40.67 MB, 44.56 MB, 48.43 MB, 52.33 MB, 56.40 MB, 60.40 MB, 64.59 MB, 68.90 MB, 72.74 MB, 75.92 MB, 77.81 MB, 79.14 MB - BytesReceived: 79.85 MB (83725760) - ConvertRowBatchTime: 436.046ms - DeserializeRowBatchTimer: 1s422ms - FirstBatchArrivalWaitTime: 18s314ms - PeakMemoryUsage: 0 - RowsReturned: 1.82M (1822454) - RowsReturnedRate: 8.82 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance a6492cb57c2f2439:29baebe700000021 (host=redacted-host8:22000):(Total: 4m19s, non-child: 386.862ms, % non-child: 0.15%) MemoryUsage(8s000ms): 8.34 MB, 11.43 MB, 11.43 MB, 11.41 MB, 11.40 MB, 11.40 MB, 107.59 MB, 155.40 MB, 155.52 MB, 156.05 MB, 156.43 MB, 159.20 MB, 164.50 MB, 164.57 MB, 165.40 MB, 165.52 MB, 165.52 MB, 165.50 MB, 165.49 MB, 165.49 MB, 165.43 MB, 165.54 MB, 167.23 MB, 167.52 MB, 167.48 MB, 167.55 MB, 167.54 MB, 167.55 MB, 167.53 MB, 167.56 MB, 167.56 MB, 167.53 MB ThreadUsage(8s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 167.92 MB (176077453) - PerHostPeakMemUsage: 1.02 GB (1092393946) - RowsProduced: 141.74K (141737) - TotalNetworkReceiveTime: 4m14s - TotalNetworkSendTime: 13.390ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 1.00K (1003) - TotalThreadsTotalWallClockTime: 4m19s - TotalThreadsSysTime: 104.984ms - TotalThreadsUserTime: 3s048ms - TotalThreadsVoluntaryContextSwitches: 10.29K (10286) Fragment Instance Lifecycle Timings: - ExecTime: 3m9s - ExecTreeExecTime: 3m8s - OpenTime: 1m10s - ExecTreeOpenTime: 1m8s - PrepareTime: 556.324ms - ExecTreePrepareTime: 299.814ms DataStreamSender (dst_id=11):(Total: 168.398ms, non-child: 168.398ms, % non-child: 100.00%) - BytesSent: 3.81 MB (3994095) - NetworkThroughput(*): 137.38 MB/sec - OverallThroughput: 22.62 MB/sec - PeakMemoryUsage: 244.88 KB (250752) - RowsReturned: 141.74K (141737) - SerializeBatchTime: 136.254ms - TransmitDataRPCTime: 27.725ms - UncompressedRowBatchSize: 8.52 MB (8931143) CodeGen:(Total: 1s701ms, non-child: 1s701ms, % non-child: 100.00%) - CodegenTime: 42.451ms - CompileTime: 408.666ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2076168) - NumFunctions: 131 (131) - NumInstructions: 5.07K (5071) - OptimizationTime: 1s164ms - PeakMemoryUsage: 2.48 MB (2596352) - PrepareTime: 121.058ms AGGREGATION_NODE (id=5):(Total: 4m17s, non-child: 303.877ms, % non-child: 0.12%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 12.363ms - GetResultsTime: 50.881ms - HTResizeTime: 54.460ms - HashBuckets: 262.14K (262144) - LargestPartitionPercent: 2 (2) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 13.70 MB (14363140) - PinTime: 0.000ns - ReductionFactorEstimate: 12.63 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 0 (0) - RowsReturned: 141.74K (141737) - RowsReturnedRate: 549.00 /sec - StreamingTime: 515.066ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=4):(Total: 4m17s, non-child: 2s151ms, % non-child: 0.84%) ExecOption: Probe Side Codegen Enabled - BuildRows: 375.14K (375142) - BuildTime: 1s041ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 153.17 MB (160605372) - ProbeRows: 1.83M (1825673) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 361.758ms - RowsReturned: 374.80K (374799) - RowsReturnedRate: 1.46 K/sec Hash Join Builder (join_node_id=4): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 687.976ms - BuildRowsPartitioned: 375.14K (375142) - GetNewBlockTime: 135.724ms - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 281.158ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160453760) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=10):(Total: 48s873ms, non-child: 226.953ms, % non-child: 0.46%) BytesReceived(8s000ms): 507.23 KB, 1.10 MB, 2.11 MB, 3.14 MB, 3.26 MB, 3.26 MB, 4.15 MB, 4.55 MB, 4.55 MB, 4.55 MB, 4.55 MB, 4.55 MB, 4.55 MB, 4.55 MB, 4.55 MB, 4.55 MB, 4.55 MB, 4.55 MB, 4.55 MB, 4.55 MB, 4.55 MB, 4.55 MB, 4.55 MB, 4.55 MB, 4.55 MB, 4.55 MB, 4.55 MB, 4.55 MB, 4.55 MB, 4.55 MB, 4.55 MB, 4.55 MB - BytesReceived: 4.55 MB (4772926) - ConvertRowBatchTime: 92.862ms - DeserializeRowBatchTimer: 1s553ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 375.14K (375142) - RowsReturnedRate: 7.67 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=9):(Total: 3m26s, non-child: 733.050ms, % non-child: 0.36%) BytesReceived(8s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 86.45 KB, 2.44 MB, 6.30 MB, 9.72 MB, 12.85 MB, 16.72 MB, 20.81 MB, 24.31 MB, 27.45 MB, 30.74 MB, 32.95 MB, 36.41 MB, 40.35 MB, 44.26 MB, 48.18 MB, 52.12 MB, 56.16 MB, 60.20 MB, 64.37 MB, 68.71 MB, 72.66 MB, 75.88 MB, 77.84 MB, 79.20 MB - BytesReceived: 79.99 MB (83875554) - ConvertRowBatchTime: 436.282ms - DeserializeRowBatchTimer: 1s426ms - FirstBatchArrivalWaitTime: 18s217ms - PeakMemoryUsage: 0 - RowsReturned: 1.83M (1825673) - RowsReturnedRate: 8.84 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance a6492cb57c2f2439:29baebe700000020 (host=redacted-host2:22000):(Total: 4m19s, non-child: 331.800ms, % non-child: 0.13%) MemoryUsage(8s000ms): 8.66 MB, 11.44 MB, 11.42 MB, 11.43 MB, 11.42 MB, 11.42 MB, 108.16 MB, 155.40 MB, 155.55 MB, 156.06 MB, 156.49 MB, 159.29 MB, 164.56 MB, 164.60 MB, 165.49 MB, 165.53 MB, 165.55 MB, 165.57 MB, 165.51 MB, 165.48 MB, 165.51 MB, 165.51 MB, 167.25 MB, 167.49 MB, 167.54 MB, 167.53 MB, 167.55 MB, 167.53 MB, 167.49 MB, 167.47 MB, 167.54 MB, 167.48 MB ThreadUsage(8s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 167.90 MB (176057155) - PerHostPeakMemUsage: 1.02 GB (1100062902) - RowsProduced: 141.51K (141509) - TotalNetworkReceiveTime: 4m14s - TotalNetworkSendTime: 9.732ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 717 (717) - TotalThreadsTotalWallClockTime: 4m19s - TotalThreadsSysTime: 124.981ms - TotalThreadsUserTime: 2s947ms - TotalThreadsVoluntaryContextSwitches: 10.19K (10190) Fragment Instance Lifecycle Timings: - ExecTime: 3m9s - ExecTreeExecTime: 3m8s - OpenTime: 1m9s - ExecTreeOpenTime: 1m8s - PrepareTime: 620.942ms - ExecTreePrepareTime: 406.384ms DataStreamSender (dst_id=11):(Total: 163.540ms, non-child: 163.540ms, % non-child: 100.00%) - BytesSent: 3.80 MB (3985724) - NetworkThroughput(*): 128.16 MB/sec - OverallThroughput: 23.24 MB/sec - PeakMemoryUsage: 244.88 KB (250752) - RowsReturned: 141.51K (141509) - SerializeBatchTime: 132.867ms - TransmitDataRPCTime: 29.657ms - UncompressedRowBatchSize: 8.50 MB (8916775) CodeGen:(Total: 1s758ms, non-child: 1s758ms, % non-child: 100.00%) - CodegenTime: 61.817ms - CompileTime: 580.490ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2076168) - NumFunctions: 131 (131) - NumInstructions: 5.07K (5071) - OptimizationTime: 1s025ms - PeakMemoryUsage: 2.48 MB (2596352) - PrepareTime: 149.338ms AGGREGATION_NODE (id=5):(Total: 4m17s, non-child: 58.047ms, % non-child: 0.02%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 3.142ms - GetResultsTime: 48.613ms - HTResizeTime: 39.941ms - HashBuckets: 262.14K (262144) - LargestPartitionPercent: 2 (2) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 13.68 MB (14342842) - PinTime: 0.000ns - ReductionFactorEstimate: 12.54 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 0 (0) - RowsReturned: 141.51K (141509) - RowsReturnedRate: 549.00 /sec - StreamingTime: 373.657ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=4):(Total: 4m17s, non-child: 2s201ms, % non-child: 0.85%) ExecOption: Probe Side Codegen Enabled - BuildRows: 374.68K (374681) - BuildTime: 809.815ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 153.17 MB (160605372) - ProbeRows: 1.82M (1820537) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 349.428ms - RowsReturned: 373.93K (373929) - RowsReturnedRate: 1.45 K/sec Hash Join Builder (join_node_id=4): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 511.651ms - BuildRowsPartitioned: 374.68K (374681) - GetNewBlockTime: 49.363ms - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 272.132ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160453760) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=10):(Total: 48s836ms, non-child: 108.632ms, % non-child: 0.22%) BytesReceived(8s000ms): 481.70 KB, 1.09 MB, 2.12 MB, 3.10 MB, 3.27 MB, 3.27 MB, 4.09 MB, 4.55 MB, 4.55 MB, 4.55 MB, 4.55 MB, 4.55 MB, 4.55 MB, 4.55 MB, 4.55 MB, 4.55 MB, 4.55 MB, 4.55 MB, 4.55 MB, 4.55 MB, 4.55 MB, 4.55 MB, 4.55 MB, 4.55 MB, 4.55 MB, 4.55 MB, 4.55 MB, 4.55 MB, 4.55 MB, 4.55 MB, 4.55 MB, 4.55 MB - BytesReceived: 4.55 MB (4765963) - ConvertRowBatchTime: 87.608ms - DeserializeRowBatchTimer: 991.516ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 374.68K (374681) - RowsReturnedRate: 7.67 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=9):(Total: 3m26s, non-child: 718.089ms, % non-child: 0.35%) BytesReceived(8s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 92.70 KB, 2.49 MB, 6.33 MB, 9.72 MB, 12.87 MB, 16.76 MB, 20.88 MB, 24.39 MB, 27.49 MB, 30.73 MB, 32.91 MB, 36.41 MB, 40.32 MB, 44.22 MB, 48.13 MB, 52.03 MB, 56.11 MB, 60.11 MB, 64.27 MB, 68.58 MB, 72.49 MB, 75.70 MB, 77.66 MB, 79.01 MB - BytesReceived: 79.77 MB (83647927) - ConvertRowBatchTime: 430.510ms - DeserializeRowBatchTimer: 1s387ms - FirstBatchArrivalWaitTime: 18s225ms - PeakMemoryUsage: 0 - RowsReturned: 1.82M (1820537) - RowsReturnedRate: 8.81 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance a6492cb57c2f2439:29baebe70000001e (host=redacted-host5:22000):(Total: 4m19s, non-child: 339.692ms, % non-child: 0.13%) MemoryUsage(8s000ms): 8.14 MB, 11.44 MB, 11.44 MB, 11.44 MB, 11.44 MB, 11.44 MB, 108.42 MB, 155.40 MB, 155.53 MB, 156.04 MB, 156.56 MB, 159.35 MB, 164.54 MB, 164.60 MB, 165.51 MB, 165.58 MB, 165.54 MB, 165.60 MB, 165.60 MB, 165.58 MB, 165.55 MB, 165.61 MB, 167.27 MB, 167.54 MB, 167.52 MB, 167.57 MB, 167.50 MB, 167.56 MB, 167.56 MB, 167.51 MB, 167.49 MB, 167.51 MB ThreadUsage(8s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 167.92 MB (176077453) - PerHostPeakMemUsage: 1.02 GB (1099935664) - RowsProduced: 141.00K (140999) - TotalNetworkReceiveTime: 4m14s - TotalNetworkSendTime: 15.472ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 860 (860) - TotalThreadsTotalWallClockTime: 4m19s - TotalThreadsSysTime: 142.978ms - TotalThreadsUserTime: 2s986ms - TotalThreadsVoluntaryContextSwitches: 10.28K (10280) Fragment Instance Lifecycle Timings: - ExecTime: 3m9s - ExecTreeExecTime: 3m8s - OpenTime: 1m9s - ExecTreeOpenTime: 1m7s - PrepareTime: 750.141ms - ExecTreePrepareTime: 431.013ms DataStreamSender (dst_id=11):(Total: 165.298ms, non-child: 165.298ms, % non-child: 100.00%) - BytesSent: 3.79 MB (3969919) - NetworkThroughput(*): 119.97 MB/sec - OverallThroughput: 22.90 MB/sec - PeakMemoryUsage: 244.88 KB (250752) - RowsReturned: 141.00K (140999) - SerializeBatchTime: 133.478ms - TransmitDataRPCTime: 31.557ms - UncompressedRowBatchSize: 8.47 MB (8884637) CodeGen:(Total: 2s221ms, non-child: 2s221ms, % non-child: 100.00%) - CodegenTime: 35.075ms - CompileTime: 789.663ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2076168) - NumFunctions: 131 (131) - NumInstructions: 5.07K (5071) - OptimizationTime: 1s166ms - PeakMemoryUsage: 2.48 MB (2596352) - PrepareTime: 265.206ms AGGREGATION_NODE (id=5):(Total: 4m17s, non-child: 292.633ms, % non-child: 0.11%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 38.877ms - GetResultsTime: 47.886ms - HTResizeTime: 35.710ms - HashBuckets: 262.14K (262144) - LargestPartitionPercent: 2 (2) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 13.70 MB (14363140) - PinTime: 0.000ns - ReductionFactorEstimate: 12.53 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 0 (0) - RowsReturned: 141.00K (140999) - RowsReturnedRate: 548.00 /sec - StreamingTime: 449.883ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=4):(Total: 4m16s, non-child: 2s195ms, % non-child: 0.85%) ExecOption: Probe Side Codegen Enabled - BuildRows: 374.62K (374624) - BuildTime: 1s133ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 153.17 MB (160605372) - ProbeRows: 1.82M (1817887) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 352.546ms - RowsReturned: 371.34K (371336) - RowsReturnedRate: 1.45 K/sec Hash Join Builder (join_node_id=4): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 629.400ms - BuildRowsPartitioned: 374.62K (374624) - GetNewBlockTime: 323.348ms - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 189.390ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160453760) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=10):(Total: 48s105ms, non-child: 104.783ms, % non-child: 0.22%) BytesReceived(8s000ms): 489.39 KB, 1.10 MB, 2.13 MB, 3.11 MB, 3.27 MB, 3.27 MB, 4.10 MB, 4.55 MB, 4.55 MB, 4.55 MB, 4.55 MB, 4.55 MB, 4.55 MB, 4.55 MB, 4.55 MB, 4.55 MB, 4.55 MB, 4.55 MB, 4.55 MB, 4.55 MB, 4.55 MB, 4.55 MB, 4.55 MB, 4.55 MB, 4.55 MB, 4.55 MB, 4.55 MB, 4.55 MB, 4.55 MB, 4.55 MB, 4.55 MB, 4.55 MB - BytesReceived: 4.55 MB (4766379) - ConvertRowBatchTime: 87.955ms - DeserializeRowBatchTimer: 919.446ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 374.62K (374624) - RowsReturnedRate: 7.79 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=9):(Total: 3m26s, non-child: 728.367ms, % non-child: 0.35%) BytesReceived(8s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 92.22 KB, 2.48 MB, 6.28 MB, 9.69 MB, 12.86 MB, 16.71 MB, 20.79 MB, 24.30 MB, 27.41 MB, 30.66 MB, 33.12 MB, 36.70 MB, 40.62 MB, 44.51 MB, 48.42 MB, 52.32 MB, 56.36 MB, 60.39 MB, 64.60 MB, 68.90 MB, 72.67 MB, 75.79 MB, 77.67 MB, 78.98 MB - BytesReceived: 79.66 MB (83524837) - ConvertRowBatchTime: 436.030ms - DeserializeRowBatchTimer: 1s557ms - FirstBatchArrivalWaitTime: 18s315ms - PeakMemoryUsage: 0 - RowsReturned: 1.82M (1817887) - RowsReturnedRate: 8.80 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Averaged Fragment F02:(Total: 4m19s, non-child: 4s345ms, % non-child: 1.67%) split sizes: min: 0, max: 0, avg: 0, stddev: 0 completion times: min:4m19s max:4m19s mean: 4m19s stddev:148.533ms execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec num instances: 8 - AverageThreadTokens: 1.00 - BloomFilterBytes: 8.00 MB (8388608) - PeakMemoryUsage: 809.55 MB (848874904) - PerHostPeakMemUsage: 1.02 GB (1098647219) - RowsProduced: 1.82M (1821104) - TotalNetworkReceiveTime: 3m31s - TotalNetworkSendTime: 11.485ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 30.15K (30147) - TotalThreadsTotalWallClockTime: 4m18s - TotalThreadsSysTime: 1s399ms - TotalThreadsUserTime: 37s284ms - TotalThreadsVoluntaryContextSwitches: 100.27K (100272) Fragment Instance Lifecycle Timings: - ExecTime: 3m8s - ExecTreeExecTime: 2m59s - OpenTime: 1m10s - ExecTreeOpenTime: 1m9s - PrepareTime: 641.771ms - ExecTreePrepareTime: 257.062ms DataStreamSender (dst_id=9):(Total: 4s175ms, non-child: 4s175ms, % non-child: 100.00%) - BytesSent: 79.80 MB (83673475) - NetworkThroughput(*): 121.91 MB/sec - OverallThroughput: 19.11 MB/sec - PeakMemoryUsage: 248.88 KB (254848) - RowsReturned: 1.82M (1821104) - SerializeBatchTime: 3s516ms - TransmitDataRPCTime: 654.618ms - UncompressedRowBatchSize: 191.11 MB (200394777) CodeGen:(Total: 1s165ms, non-child: 1s165ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 216.389ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2076168) - NumFunctions: 54 (54) - NumInstructions: 2.41K (2406) - OptimizationTime: 710.316ms - PeakMemoryUsage: 1.17 MB (1231872) - PrepareTime: 219.915ms HASH_JOIN_NODE (id=3):(Total: 4m9s, non-child: 24s679ms, % non-child: 9.87%) - BuildRows: 8.87M (8870888) - BuildTime: 16s795ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 777.10 MB (814852042) - ProbeRows: 40.44M (40436523) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 6s501ms - RowsReturned: 1.82M (1821104) - RowsReturnedRate: 7.29 K/sec Hash Join Builder (join_node_id=3): - BuildRowsPartitionTime: 11s253ms - BuildRowsPartitioned: 8.87M (8870888) - GetNewBlockTime: 344.763ms - HashBuckets: 16.78M (16777216) - HashCollisions: 0 (0) - HashTablesBuildTime: 5s484ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 777.02 MB (814765184) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=8):(Total: 52s979ms, non-child: 52s979ms, % non-child: 100.00%) - BytesReceived: 207.81 MB (217907563) - ConvertRowBatchTime: 2s399ms - DeserializeRowBatchTimer: 6s164ms - FirstBatchArrivalWaitTime: 65.861ms - PeakMemoryUsage: 0 - RowsReturned: 8.87M (8870888) - RowsReturnedRate: 167.63 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=7):(Total: 2m52s, non-child: 2m52s, % non-child: 100.00%) - BytesReceived: 945.47 MB (991396656) - ConvertRowBatchTime: 9s686ms - DeserializeRowBatchTimer: 16s748ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 40.44M (40436523) - RowsReturnedRate: 234.73 K/sec - SendersBlockedTimer: 35s799ms - SendersBlockedTotalTimer(*): 1m59s BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 208 (208) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 1.59 GB (1707081728) - PeakMemoryUsage: 916.38 MB (960888832) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns Fragment F02: Instance a6492cb57c2f2439:29baebe700000015 (host=redacted-host3:22000):(Total: 4m19s, non-child: 4s351ms, % non-child: 1.67%) MemoryUsage(8s000ms): 14.79 MB, 54.21 MB, 163.77 MB, 185.31 MB, 297.33 MB, 417.34 MB, 505.29 MB, 553.30 MB, 678.95 MB, 786.02 MB, 786.00 MB, 786.10 MB, 785.91 MB, 785.86 MB, 785.86 MB, 785.97 MB, 785.77 MB, 786.01 MB, 785.80 MB, 785.82 MB, 785.91 MB, 785.87 MB, 785.87 MB, 785.89 MB, 785.99 MB, 785.97 MB, 786.02 MB, 785.84 MB, 785.85 MB, 785.79 MB, 785.76 MB, 785.94 MB ThreadUsage(8s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 8.00 MB (8388608) - PeakMemoryUsage: 809.49 MB (848806775) - PerHostPeakMemUsage: 1.01 GB (1089011159) - RowsProduced: 1.82M (1819663) - TotalNetworkReceiveTime: 3m36s - TotalNetworkSendTime: 10.702ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 28.40K (28398) - TotalThreadsTotalWallClockTime: 4m19s - TotalThreadsSysTime: 1s340ms - TotalThreadsUserTime: 36s985ms - TotalThreadsVoluntaryContextSwitches: 102.29K (102286) Fragment Instance Lifecycle Timings: - ExecTime: 3m8s - ExecTreeExecTime: 3m - OpenTime: 1m11s - ExecTreeOpenTime: 1m10s - PrepareTime: 169.232ms - ExecTreePrepareTime: 396.153us DataStreamSender (dst_id=9):(Total: 4s136ms, non-child: 4s136ms, % non-child: 100.00%) - BytesSent: 79.74 MB (83609606) - NetworkThroughput(*): 121.95 MB/sec - OverallThroughput: 19.28 MB/sec - PeakMemoryUsage: 248.88 KB (254848) - RowsReturned: 1.82M (1819663) - SerializeBatchTime: 3s477ms - TransmitDataRPCTime: 653.861ms - UncompressedRowBatchSize: 190.96 MB (200236106) CodeGen:(Total: 599.994ms, non-child: 599.994ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 36.955ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2076168) - NumFunctions: 54 (54) - NumInstructions: 2.41K (2406) - OptimizationTime: 436.830ms - PeakMemoryUsage: 1.17 MB (1231872) - PrepareTime: 113.115ms HASH_JOIN_NODE (id=3):(Total: 4m10s, non-child: 21s464ms, % non-child: 8.56%) ExecOption: Probe Side Codegen Enabled - BuildRows: 8.87M (8867954) - BuildTime: 14s380ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 777.10 MB (814852606) - ProbeRows: 40.45M (40448814) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 6s282ms - RowsReturned: 1.82M (1819663) - RowsReturnedRate: 7.25 K/sec Hash Join Builder (join_node_id=3): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 9s411ms - BuildRowsPartitioned: 8.87M (8867954) - GetNewBlockTime: 289.017ms - HashBuckets: 16.78M (16777216) - HashCollisions: 0 (0) - HashTablesBuildTime: 4s939ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 777.02 MB (814765184) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=8):(Total: 56s148ms, non-child: 3s969ms, % non-child: 7.07%) BytesReceived(8s000ms): 677.77 KB, 3.26 MB, 18.22 MB, 48.12 MB, 98.69 MB, 150.32 MB, 191.99 MB, 203.52 MB, 207.66 MB, 207.74 MB, 207.74 MB, 207.74 MB, 207.74 MB, 207.74 MB, 207.74 MB, 207.74 MB, 207.74 MB, 207.74 MB, 207.74 MB, 207.74 MB, 207.74 MB, 207.74 MB, 207.74 MB, 207.74 MB, 207.74 MB, 207.74 MB, 207.74 MB, 207.74 MB, 207.74 MB, 207.74 MB, 207.74 MB, 207.74 MB - BytesReceived: 207.74 MB (217836059) - ConvertRowBatchTime: 2s293ms - DeserializeRowBatchTimer: 4s567ms - FirstBatchArrivalWaitTime: 526.891ms - PeakMemoryUsage: 0 - RowsReturned: 8.87M (8867954) - RowsReturnedRate: 157.94 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=7):(Total: 2m53s, non-child: 13s948ms, % non-child: 8.05%) BytesReceived(8s000ms): 729.75 KB, 2.09 MB, 7.67 MB, 10.01 MB, 10.03 MB, 10.04 MB, 10.05 MB, 10.06 MB, 10.06 MB, 29.06 MB, 74.29 MB, 114.66 MB, 152.14 MB, 198.14 MB, 247.23 MB, 289.32 MB, 326.54 MB, 365.95 MB, 394.98 MB, 437.42 MB, 484.60 MB, 530.65 MB, 576.28 MB, 622.39 MB, 670.35 MB, 717.66 MB, 766.80 MB, 817.63 MB, 863.06 MB, 900.29 MB, 922.52 MB, 938.03 MB - BytesReceived: 945.75 MB (991687138) - ConvertRowBatchTime: 9s496ms - DeserializeRowBatchTimer: 16s817ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 40.45M (40448814) - RowsReturnedRate: 233.47 K/sec - SendersBlockedTimer: 48s949ms - SendersBlockedTotalTimer(*): 3m57s Instance a6492cb57c2f2439:29baebe700000017 (host=redacted-host6:22000):(Total: 4m19s, non-child: 5s127ms, % non-child: 1.97%) MemoryUsage(8s000ms): 13.00 MB, 46.51 MB, 164.31 MB, 179.85 MB, 297.35 MB, 411.36 MB, 502.30 MB, 553.29 MB, 672.20 MB, 785.84 MB, 786.02 MB, 785.96 MB, 786.02 MB, 785.94 MB, 786.01 MB, 785.88 MB, 785.89 MB, 785.75 MB, 785.86 MB, 785.82 MB, 786.13 MB, 785.93 MB, 785.87 MB, 785.93 MB, 785.91 MB, 785.79 MB, 785.85 MB, 785.89 MB, 785.90 MB, 785.77 MB, 785.81 MB, 785.72 MB ThreadUsage(8s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 8.00 MB (8388608) - PeakMemoryUsage: 809.39 MB (848703035) - PerHostPeakMemUsage: 1.03 GB (1100730973) - RowsProduced: 1.82M (1821952) - TotalNetworkReceiveTime: 3m30s - TotalNetworkSendTime: 11.596ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 26.00K (25998) - TotalThreadsTotalWallClockTime: 4m19s - TotalThreadsSysTime: 1s331ms - TotalThreadsUserTime: 37s436ms - TotalThreadsVoluntaryContextSwitches: 99.39K (99394) Fragment Instance Lifecycle Timings: - ExecTime: 3m8s - ExecTreeExecTime: 2m59s - OpenTime: 1m10s - ExecTreeOpenTime: 1m9s - PrepareTime: 657.220ms - ExecTreePrepareTime: 12.918ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 208 (208) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 1.59 GB (1707081728) - PeakMemoryUsage: 916.38 MB (960888832) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=9):(Total: 4s201ms, non-child: 4s201ms, % non-child: 100.00%) - BytesSent: 79.84 MB (83714962) - NetworkThroughput(*): 122.35 MB/sec - OverallThroughput: 19.00 MB/sec - PeakMemoryUsage: 248.88 KB (254848) - RowsReturned: 1.82M (1821952) - SerializeBatchTime: 3s545ms - TransmitDataRPCTime: 652.507ms - UncompressedRowBatchSize: 191.20 MB (200488000) CodeGen:(Total: 1s456ms, non-child: 1s456ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 208.438ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2076168) - NumFunctions: 54 (54) - NumInstructions: 2.41K (2406) - OptimizationTime: 796.975ms - PeakMemoryUsage: 1.17 MB (1231872) - PrepareTime: 374.178ms HASH_JOIN_NODE (id=3):(Total: 4m9s, non-child: 24s747ms, % non-child: 9.94%) ExecOption: Probe Side Codegen Enabled - BuildRows: 8.87M (8871979) - BuildTime: 17s407ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 777.10 MB (814847863) - ProbeRows: 40.43M (40430661) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 6s471ms - RowsReturned: 1.82M (1821952) - RowsReturnedRate: 7.32 K/sec Hash Join Builder (join_node_id=3): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 12s244ms - BuildRowsPartitioned: 8.87M (8871979) - GetNewBlockTime: 413.695ms - HashBuckets: 16.78M (16777216) - HashCollisions: 0 (0) - HashTablesBuildTime: 5s083ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 777.02 MB (814765184) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=8):(Total: 52s082ms, non-child: 7s148ms, % non-child: 13.73%) BytesReceived(8s000ms): 616.19 KB, 3.04 MB, 17.54 MB, 46.79 MB, 97.02 MB, 148.62 MB, 191.34 MB, 203.41 MB, 207.72 MB, 207.85 MB, 207.85 MB, 207.85 MB, 207.85 MB, 207.85 MB, 207.85 MB, 207.85 MB, 207.85 MB, 207.85 MB, 207.85 MB, 207.85 MB, 207.85 MB, 207.85 MB, 207.85 MB, 207.85 MB, 207.85 MB, 207.85 MB, 207.85 MB, 207.85 MB, 207.85 MB, 207.85 MB, 207.85 MB, 207.85 MB - BytesReceived: 207.85 MB (217944335) - ConvertRowBatchTime: 2s392ms - DeserializeRowBatchTimer: 7s865ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 8.87M (8871979) - RowsReturnedRate: 170.34 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=7):(Total: 2m52s, non-child: 14s167ms, % non-child: 8.23%) BytesReceived(8s000ms): 657.06 KB, 2.00 MB, 7.46 MB, 9.98 MB, 10.00 MB, 10.01 MB, 10.01 MB, 10.02 MB, 10.03 MB, 27.62 MB, 72.67 MB, 113.25 MB, 150.68 MB, 196.24 MB, 245.42 MB, 287.78 MB, 325.05 MB, 364.58 MB, 390.59 MB, 431.65 MB, 478.65 MB, 524.74 MB, 570.42 MB, 616.20 MB, 664.27 MB, 711.41 MB, 760.28 MB, 811.00 MB, 857.75 MB, 896.05 MB, 919.72 MB, 936.03 MB - BytesReceived: 945.36 MB (991279223) - ConvertRowBatchTime: 9s736ms - DeserializeRowBatchTimer: 16s826ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 40.43M (40430661) - RowsReturnedRate: 234.76 K/sec - SendersBlockedTimer: 35s166ms - SendersBlockedTotalTimer(*): 1m8s Instance a6492cb57c2f2439:29baebe700000016 (host=redacted-host1:22000):(Total: 4m19s, non-child: 4s623ms, % non-child: 1.78%) MemoryUsage(8s000ms): 14.16 MB, 54.04 MB, 163.31 MB, 184.32 MB, 297.34 MB, 411.83 MB, 501.81 MB, 553.30 MB, 658.27 MB, 786.17 MB, 786.09 MB, 786.00 MB, 785.92 MB, 785.96 MB, 785.88 MB, 785.96 MB, 785.90 MB, 785.86 MB, 785.84 MB, 786.05 MB, 785.93 MB, 785.89 MB, 785.82 MB, 785.93 MB, 785.96 MB, 785.98 MB, 785.90 MB, 785.92 MB, 785.85 MB, 786.04 MB, 785.86 MB, 785.84 MB ThreadUsage(8s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 8.00 MB (8388608) - PeakMemoryUsage: 809.47 MB (848790815) - PerHostPeakMemUsage: 1.03 GB (1105124622) - RowsProduced: 1.82M (1823367) - TotalNetworkReceiveTime: 3m32s - TotalNetworkSendTime: 10.681ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 32.80K (32797) - TotalThreadsTotalWallClockTime: 4m19s - TotalThreadsSysTime: 1s311ms - TotalThreadsUserTime: 37s551ms - TotalThreadsVoluntaryContextSwitches: 100.05K (100047) Fragment Instance Lifecycle Timings: - ExecTime: 3m7s - ExecTreeExecTime: 2m59s - OpenTime: 1m11s - ExecTreeOpenTime: 1m10s - PrepareTime: 512.116ms - ExecTreePrepareTime: 7.191ms DataStreamSender (dst_id=9):(Total: 4s184ms, non-child: 4s184ms, % non-child: 100.00%) - BytesSent: 79.90 MB (83782031) - NetworkThroughput(*): 121.14 MB/sec - OverallThroughput: 19.10 MB/sec - PeakMemoryUsage: 248.88 KB (254848) - RowsReturned: 1.82M (1823367) - SerializeBatchTime: 3s520ms - TransmitDataRPCTime: 659.558ms - UncompressedRowBatchSize: 191.35 MB (200643706) CodeGen:(Total: 1s219ms, non-child: 1s219ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 146.005ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2076168) - NumFunctions: 54 (54) - NumInstructions: 2.41K (2406) - OptimizationTime: 790.897ms - PeakMemoryUsage: 1.17 MB (1231872) - PrepareTime: 256.735ms HASH_JOIN_NODE (id=3):(Total: 4m9s, non-child: 23s995ms, % non-child: 9.61%) ExecOption: Probe Side Codegen Enabled - BuildRows: 8.87M (8871817) - BuildTime: 16s509ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 777.11 MB (814856482) - ProbeRows: 40.45M (40446415) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 6s549ms - RowsReturned: 1.82M (1823367) - RowsReturnedRate: 7.30 K/sec Hash Join Builder (join_node_id=3): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 10s651ms - BuildRowsPartitioned: 8.87M (8871817) - GetNewBlockTime: 195.517ms - HashBuckets: 16.78M (16777216) - HashCollisions: 0 (0) - HashTablesBuildTime: 5s808ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 777.02 MB (814765184) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=8):(Total: 53s898ms, non-child: 3s921ms, % non-child: 7.27%) BytesReceived(8s000ms): 651.85 KB, 3.14 MB, 17.70 MB, 46.99 MB, 97.21 MB, 148.73 MB, 191.35 MB, 203.39 MB, 207.71 MB, 207.83 MB, 207.83 MB, 207.83 MB, 207.83 MB, 207.83 MB, 207.83 MB, 207.83 MB, 207.83 MB, 207.83 MB, 207.83 MB, 207.83 MB, 207.83 MB, 207.83 MB, 207.83 MB, 207.83 MB, 207.83 MB, 207.83 MB, 207.83 MB, 207.83 MB, 207.83 MB, 207.83 MB, 207.83 MB, 207.83 MB - BytesReceived: 207.83 MB (217928025) - ConvertRowBatchTime: 2s457ms - DeserializeRowBatchTimer: 4s369ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 8.87M (8871817) - RowsReturnedRate: 164.60 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=7):(Total: 2m51s, non-child: 14s209ms, % non-child: 8.27%) BytesReceived(8s000ms): 700.28 KB, 2.03 MB, 7.51 MB, 10.00 MB, 10.01 MB, 10.02 MB, 10.03 MB, 10.04 MB, 10.04 MB, 27.56 MB, 72.53 MB, 113.11 MB, 150.46 MB, 196.01 MB, 245.26 MB, 287.66 MB, 324.85 MB, 364.35 MB, 390.37 MB, 431.36 MB, 478.38 MB, 524.64 MB, 570.35 MB, 616.20 MB, 664.18 MB, 711.24 MB, 760.14 MB, 810.90 MB, 857.82 MB, 896.26 MB, 920.02 MB, 936.40 MB - BytesReceived: 945.73 MB (991671093) - ConvertRowBatchTime: 9s804ms - DeserializeRowBatchTimer: 15s697ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 40.45M (40446415) - RowsReturnedRate: 235.31 K/sec - SendersBlockedTimer: 38s160ms - SendersBlockedTotalTimer(*): 2m23s Instance a6492cb57c2f2439:29baebe700000012 (host=redacted-host4:22000):(Total: 4m19s, non-child: 4s031ms, % non-child: 1.55%) MemoryUsage(8s000ms): 13.19 MB, 54.29 MB, 163.84 MB, 185.35 MB, 297.34 MB, 417.33 MB, 505.30 MB, 553.30 MB, 667.13 MB, 786.01 MB, 785.80 MB, 785.86 MB, 785.94 MB, 786.00 MB, 786.02 MB, 785.94 MB, 785.96 MB, 785.85 MB, 786.01 MB, 786.07 MB, 785.73 MB, 785.88 MB, 785.90 MB, 785.99 MB, 785.82 MB, 785.83 MB, 785.91 MB, 785.88 MB, 786.03 MB, 785.99 MB, 785.76 MB, 785.86 MB ThreadUsage(8s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 8.00 MB (8388608) - PeakMemoryUsage: 809.63 MB (848955602) - PerHostPeakMemUsage: 1.03 GB (1100732840) - RowsProduced: 1.82M (1822902) - TotalNetworkReceiveTime: 3m31s - TotalNetworkSendTime: 12.269ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 32.09K (32086) - TotalThreadsTotalWallClockTime: 4m18s - TotalThreadsSysTime: 1s386ms - TotalThreadsUserTime: 37s183ms - TotalThreadsVoluntaryContextSwitches: 100.25K (100248) Fragment Instance Lifecycle Timings: - ExecTime: 3m7s - ExecTreeExecTime: 2m59s - OpenTime: 1m11s - ExecTreeOpenTime: 1m10s - PrepareTime: 792.408ms - ExecTreePrepareTime: 332.109ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 208 (208) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 1.59 GB (1707081728) - PeakMemoryUsage: 916.38 MB (960888832) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=9):(Total: 4s190ms, non-child: 4s190ms, % non-child: 100.00%) - BytesSent: 79.87 MB (83748616) - NetworkThroughput(*): 121.00 MB/sec - OverallThroughput: 19.06 MB/sec - PeakMemoryUsage: 248.88 KB (254848) - RowsReturned: 1.82M (1822902) - SerializeBatchTime: 3s524ms - TransmitDataRPCTime: 660.063ms - UncompressedRowBatchSize: 191.30 MB (200592540) CodeGen:(Total: 1s372ms, non-child: 1s372ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 236.056ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2076168) - NumFunctions: 54 (54) - NumInstructions: 2.41K (2406) - OptimizationTime: 840.679ms - PeakMemoryUsage: 1.17 MB (1231872) - PrepareTime: 294.100ms HASH_JOIN_NODE (id=3):(Total: 4m10s, non-child: 25s031ms, % non-child: 10.01%) ExecOption: Probe Side Codegen Enabled - BuildRows: 8.87M (8867889) - BuildTime: 16s886ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 777.10 MB (814851959) - ProbeRows: 40.46M (40455253) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 6s611ms - RowsReturned: 1.82M (1822902) - RowsReturnedRate: 7.29 K/sec Hash Join Builder (join_node_id=3): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 10s777ms - BuildRowsPartitioned: 8.87M (8867889) - GetNewBlockTime: 353.360ms - HashBuckets: 16.78M (16777216) - HashCollisions: 0 (0) - HashTablesBuildTime: 6s078ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 777.02 MB (814765184) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=8):(Total: 53s236ms, non-child: 5s492ms, % non-child: 10.32%) BytesReceived(8s000ms): 657.13 KB, 3.34 MB, 18.45 MB, 48.51 MB, 99.19 MB, 150.76 MB, 192.14 MB, 203.56 MB, 207.66 MB, 207.75 MB, 207.75 MB, 207.75 MB, 207.75 MB, 207.75 MB, 207.75 MB, 207.75 MB, 207.75 MB, 207.75 MB, 207.75 MB, 207.75 MB, 207.75 MB, 207.75 MB, 207.75 MB, 207.75 MB, 207.75 MB, 207.75 MB, 207.75 MB, 207.75 MB, 207.75 MB, 207.75 MB, 207.75 MB, 207.75 MB - BytesReceived: 207.75 MB (217840083) - ConvertRowBatchTime: 2s355ms - DeserializeRowBatchTimer: 6s049ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 8.87M (8867889) - RowsReturnedRate: 166.57 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=7):(Total: 2m51s, non-child: 14s298ms, % non-child: 8.32%) BytesReceived(8s000ms): 716.60 KB, 2.12 MB, 7.73 MB, 10.01 MB, 10.03 MB, 10.04 MB, 10.05 MB, 10.06 MB, 10.06 MB, 29.31 MB, 74.49 MB, 114.81 MB, 152.24 MB, 198.22 MB, 247.25 MB, 289.35 MB, 326.69 MB, 366.12 MB, 395.48 MB, 438.07 MB, 485.37 MB, 531.42 MB, 577.09 MB, 623.21 MB, 671.12 MB, 718.30 MB, 767.50 MB, 818.32 MB, 863.53 MB, 900.68 MB, 922.83 MB, 938.28 MB - BytesReceived: 945.87 MB (991817192) - ConvertRowBatchTime: 9s718ms - DeserializeRowBatchTimer: 17s462ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 40.46M (40455253) - RowsReturnedRate: 235.52 K/sec - SendersBlockedTimer: 50s088ms - SendersBlockedTotalTimer(*): 4m5s Instance a6492cb57c2f2439:29baebe700000018 (host=redacted-host7:22000):(Total: 4m19s, non-child: 4s091ms, % non-child: 1.58%) MemoryUsage(8s000ms): 14.20 MB, 62.64 MB, 164.56 MB, 209.32 MB, 313.37 MB, 425.40 MB, 529.31 MB, 553.30 MB, 695.62 MB, 785.82 MB, 786.05 MB, 785.94 MB, 786.01 MB, 785.85 MB, 785.98 MB, 785.85 MB, 785.87 MB, 786.08 MB, 785.93 MB, 786.02 MB, 786.14 MB, 785.91 MB, 786.00 MB, 786.10 MB, 785.97 MB, 785.87 MB, 785.80 MB, 785.86 MB, 785.96 MB, 785.86 MB, 785.91 MB, 785.85 MB ThreadUsage(8s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 8.00 MB (8388608) - PeakMemoryUsage: 810.26 MB (849621134) - PerHostPeakMemUsage: 1.03 GB (1101185652) - RowsProduced: 1.82M (1822311) - TotalNetworkReceiveTime: 3m27s - TotalNetworkSendTime: 11.019ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 26.64K (26640) - TotalThreadsTotalWallClockTime: 4m18s - TotalThreadsSysTime: 1s752ms - TotalThreadsUserTime: 37s460ms - TotalThreadsVoluntaryContextSwitches: 99.25K (99249) Fragment Instance Lifecycle Timings: - ExecTime: 3m6s - ExecTreeExecTime: 2m57s - OpenTime: 1m11s - ExecTreeOpenTime: 1m10s - PrepareTime: 1s062ms - ExecTreePrepareTime: 787.190ms DataStreamSender (dst_id=9):(Total: 4s146ms, non-child: 4s146ms, % non-child: 100.00%) - BytesSent: 79.85 MB (83732968) - NetworkThroughput(*): 122.30 MB/sec - OverallThroughput: 19.26 MB/sec - PeakMemoryUsage: 248.88 KB (254848) - RowsReturned: 1.82M (1822311) - SerializeBatchTime: 3s489ms - TransmitDataRPCTime: 652.949ms - UncompressedRowBatchSize: 191.24 MB (200527490) CodeGen:(Total: 1s044ms, non-child: 1s044ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 166.328ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2076168) - NumFunctions: 54 (54) - NumInstructions: 2.41K (2406) - OptimizationTime: 698.486ms - PeakMemoryUsage: 1.17 MB (1231872) - PrepareTime: 178.115ms HASH_JOIN_NODE (id=3):(Total: 4m10s, non-child: 29s349ms, % non-child: 11.73%) ExecOption: Probe Side Codegen Enabled - BuildRows: 8.87M (8873734) - BuildTime: 20s244ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 777.10 MB (814852351) - ProbeRows: 40.43M (40428804) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 6s528ms - RowsReturned: 1.82M (1822311) - RowsReturnedRate: 7.28 K/sec Hash Join Builder (join_node_id=3): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 13s213ms - BuildRowsPartitioned: 8.87M (8873734) - GetNewBlockTime: 327.616ms - HashBuckets: 16.78M (16777216) - HashCollisions: 0 (0) - HashTablesBuildTime: 6s964ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 777.02 MB (814765184) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=8):(Total: 50s420ms, non-child: 6s714ms, % non-child: 13.32%) BytesReceived(8s000ms): 750.43 KB, 3.64 MB, 19.62 MB, 57.06 MB, 108.46 MB, 160.54 MB, 195.79 MB, 204.86 MB, 207.88 MB, 207.88 MB, 207.88 MB, 207.88 MB, 207.88 MB, 207.88 MB, 207.88 MB, 207.88 MB, 207.88 MB, 207.88 MB, 207.88 MB, 207.88 MB, 207.88 MB, 207.88 MB, 207.88 MB, 207.88 MB, 207.88 MB, 207.88 MB, 207.88 MB, 207.88 MB, 207.88 MB, 207.88 MB, 207.88 MB, 207.88 MB - BytesReceived: 207.88 MB (217977289) - ConvertRowBatchTime: 2s523ms - DeserializeRowBatchTimer: 8s392ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 8.87M (8873734) - RowsReturnedRate: 176.00 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=7):(Total: 2m50s, non-child: 14s387ms, % non-child: 8.44%) BytesReceived(8s000ms): 792.77 KB, 2.24 MB, 7.98 MB, 9.98 MB, 10.01 MB, 10.01 MB, 10.02 MB, 10.03 MB, 10.27 MB, 37.44 MB, 82.09 MB, 121.31 MB, 159.43 MB, 207.39 MB, 255.30 MB, 295.73 MB, 333.45 MB, 370.96 MB, 398.08 MB, 441.35 MB, 488.58 MB, 534.54 MB, 580.16 MB, 626.45 MB, 674.22 MB, 721.60 MB, 771.01 MB, 821.80 MB, 866.13 MB, 902.45 MB, 923.77 MB, 938.68 MB - BytesReceived: 945.28 MB (991200700) - ConvertRowBatchTime: 9s653ms - DeserializeRowBatchTimer: 17s837ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 40.43M (40428804) - RowsReturnedRate: 237.16 K/sec - SendersBlockedTimer: 37s062ms - SendersBlockedTotalTimer(*): 1m55s Instance a6492cb57c2f2439:29baebe700000014 (host=redacted-host8:22000):(Total: 4m19s, non-child: 4s488ms, % non-child: 1.73%) MemoryUsage(8s000ms): 14.21 MB, 54.04 MB, 165.56 MB, 185.04 MB, 297.22 MB, 417.27 MB, 505.72 MB, 553.29 MB, 671.01 MB, 785.99 MB, 785.97 MB, 785.95 MB, 785.94 MB, 785.89 MB, 785.94 MB, 785.85 MB, 785.80 MB, 785.82 MB, 785.91 MB, 785.93 MB, 785.90 MB, 785.91 MB, 786.00 MB, 785.99 MB, 785.86 MB, 785.86 MB, 785.90 MB, 785.99 MB, 785.92 MB, 785.77 MB, 785.95 MB, 785.83 MB ThreadUsage(8s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 8.00 MB (8388608) - PeakMemoryUsage: 809.40 MB (848722187) - PerHostPeakMemUsage: 1.02 GB (1092393946) - RowsProduced: 1.82M (1820500) - TotalNetworkReceiveTime: 3m29s - TotalNetworkSendTime: 9.678ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 25.21K (25212) - TotalThreadsTotalWallClockTime: 4m18s - TotalThreadsSysTime: 1s405ms - TotalThreadsUserTime: 37s358ms - TotalThreadsVoluntaryContextSwitches: 99.50K (99500) Fragment Instance Lifecycle Timings: - ExecTime: 3m7s - ExecTreeExecTime: 2m59s - OpenTime: 1m11s - ExecTreeOpenTime: 1m10s - PrepareTime: 579.250ms - ExecTreePrepareTime: 290.468ms DataStreamSender (dst_id=9):(Total: 4s110ms, non-child: 4s110ms, % non-child: 100.00%) - BytesSent: 79.75 MB (83629084) - NetworkThroughput(*): 121.46 MB/sec - OverallThroughput: 19.40 MB/sec - PeakMemoryUsage: 248.88 KB (254848) - RowsReturned: 1.82M (1820500) - SerializeBatchTime: 3s449ms - TransmitDataRPCTime: 656.648ms - UncompressedRowBatchSize: 191.05 MB (200328224) CodeGen:(Total: 1s097ms, non-child: 1s097ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 150.567ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2076168) - NumFunctions: 54 (54) - NumInstructions: 2.41K (2406) - OptimizationTime: 766.457ms - PeakMemoryUsage: 1.17 MB (1231872) - PrepareTime: 166.395ms HASH_JOIN_NODE (id=3):(Total: 4m9s, non-child: 27s279ms, % non-child: 10.92%) ExecOption: Probe Side Codegen Enabled - BuildRows: 8.87M (8871571) - BuildTime: 19s407ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 777.11 MB (814855258) - ProbeRows: 40.42M (40424347) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 6s406ms - RowsReturned: 1.82M (1820500) - RowsReturnedRate: 7.29 K/sec Hash Join Builder (join_node_id=3): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 13s544ms - BuildRowsPartitioned: 8.87M (8871571) - GetNewBlockTime: 420.418ms - HashBuckets: 16.78M (16777216) - HashCollisions: 0 (0) - HashTablesBuildTime: 5s784ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 777.02 MB (814765184) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=8):(Total: 50s524ms, non-child: 8s310ms, % non-child: 16.45%) BytesReceived(8s000ms): 785.58 KB, 3.82 MB, 19.92 MB, 51.61 MB, 102.81 MB, 154.68 MB, 193.73 MB, 204.12 MB, 207.79 MB, 207.82 MB, 207.82 MB, 207.82 MB, 207.82 MB, 207.82 MB, 207.82 MB, 207.82 MB, 207.82 MB, 207.82 MB, 207.82 MB, 207.82 MB, 207.82 MB, 207.82 MB, 207.82 MB, 207.82 MB, 207.82 MB, 207.82 MB, 207.82 MB, 207.82 MB, 207.82 MB, 207.82 MB, 207.82 MB, 207.82 MB - BytesReceived: 207.82 MB (217913599) - ConvertRowBatchTime: 2s456ms - DeserializeRowBatchTimer: 8s940ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 8.87M (8871571) - RowsReturnedRate: 175.59 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=7):(Total: 2m51s, non-child: 13s834ms, % non-child: 8.05%) BytesReceived(8s000ms): 711.52 KB, 2.02 MB, 7.63 MB, 9.87 MB, 9.92 MB, 9.94 MB, 9.96 MB, 10.00 MB, 10.01 MB, 29.75 MB, 74.89 MB, 115.21 MB, 152.68 MB, 198.73 MB, 247.66 MB, 289.67 MB, 326.93 MB, 366.10 MB, 392.18 MB, 433.69 MB, 480.80 MB, 526.93 MB, 572.70 MB, 618.60 MB, 666.59 MB, 713.75 MB, 762.64 MB, 813.37 MB, 859.60 MB, 897.47 MB, 920.56 MB, 936.53 MB - BytesReceived: 945.21 MB (991121991) - ConvertRowBatchTime: 9s484ms - DeserializeRowBatchTimer: 17s407ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 40.42M (40424347) - RowsReturnedRate: 235.11 K/sec - SendersBlockedTimer: 9s806ms - SendersBlockedTotalTimer(*): 11s340ms Instance a6492cb57c2f2439:29baebe700000013 (host=redacted-host2:22000):(Total: 4m19s, non-child: 3s867ms, % non-child: 1.49%) MemoryUsage(8s000ms): 14.41 MB, 55.49 MB, 164.15 MB, 191.77 MB, 297.30 MB, 419.33 MB, 510.81 MB, 553.31 MB, 690.63 MB, 785.95 MB, 785.92 MB, 785.81 MB, 785.88 MB, 786.03 MB, 786.06 MB, 785.86 MB, 785.95 MB, 785.97 MB, 785.78 MB, 785.92 MB, 786.02 MB, 785.91 MB, 785.91 MB, 786.06 MB, 785.88 MB, 785.75 MB, 785.97 MB, 785.90 MB, 786.01 MB, 785.89 MB, 785.85 MB, 785.97 MB ThreadUsage(8s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 8.00 MB (8388608) - PeakMemoryUsage: 809.41 MB (848726576) - PerHostPeakMemUsage: 1.02 GB (1100062902) - RowsProduced: 1.82M (1820969) - TotalNetworkReceiveTime: 3m33s - TotalNetworkSendTime: 13.246ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 35.77K (35771) - TotalThreadsTotalWallClockTime: 4m18s - TotalThreadsSysTime: 1s334ms - TotalThreadsUserTime: 36s965ms - TotalThreadsVoluntaryContextSwitches: 100.91K (100907) Fragment Instance Lifecycle Timings: - ExecTime: 3m8s - ExecTreeExecTime: 3m - OpenTime: 1m9s - ExecTreeOpenTime: 1m8s - PrepareTime: 623.659ms - ExecTreePrepareTime: 389.465ms DataStreamSender (dst_id=9):(Total: 4s247ms, non-child: 4s247ms, % non-child: 100.00%) - BytesSent: 79.79 MB (83667150) - NetworkThroughput(*): 124.12 MB/sec - OverallThroughput: 18.79 MB/sec - PeakMemoryUsage: 248.88 KB (254848) - RowsReturned: 1.82M (1820969) - SerializeBatchTime: 3s600ms - TransmitDataRPCTime: 642.863ms - UncompressedRowBatchSize: 191.10 MB (200379830) CodeGen:(Total: 1s378ms, non-child: 1s378ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 499.068ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2076168) - NumFunctions: 54 (54) - NumInstructions: 2.41K (2406) - OptimizationTime: 711.981ms - PeakMemoryUsage: 1.17 MB (1231872) - PrepareTime: 166.985ms HASH_JOIN_NODE (id=3):(Total: 4m9s, non-child: 23s108ms, % non-child: 9.25%) ExecOption: Probe Side Codegen Enabled - BuildRows: 8.87M (8871335) - BuildTime: 15s003ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 777.10 MB (814847863) - ProbeRows: 40.43M (40429232) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 6s517ms - RowsReturned: 1.82M (1820969) - RowsReturnedRate: 7.29 K/sec Hash Join Builder (join_node_id=3): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 10s238ms - BuildRowsPartitioned: 8.87M (8871335) - GetNewBlockTime: 460.217ms - HashBuckets: 16.78M (16777216) - HashCollisions: 0 (0) - HashTablesBuildTime: 4s719ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 777.02 MB (814765184) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=8):(Total: 53s564ms, non-child: 4s503ms, % non-child: 8.41%) BytesReceived(8s000ms): 749.09 KB, 3.55 MB, 19.04 MB, 49.59 MB, 100.47 MB, 152.14 MB, 192.75 MB, 203.80 MB, 207.76 MB, 207.82 MB, 207.82 MB, 207.82 MB, 207.82 MB, 207.82 MB, 207.82 MB, 207.82 MB, 207.82 MB, 207.82 MB, 207.82 MB, 207.82 MB, 207.82 MB, 207.82 MB, 207.82 MB, 207.82 MB, 207.82 MB, 207.82 MB, 207.82 MB, 207.82 MB, 207.82 MB, 207.82 MB, 207.82 MB, 207.82 MB - BytesReceived: 207.82 MB (217918163) - ConvertRowBatchTime: 2s366ms - DeserializeRowBatchTimer: 4s596ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 8.87M (8871335) - RowsReturnedRate: 165.62 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=7):(Total: 2m53s, non-child: 14s019ms, % non-child: 8.09%) BytesReceived(8s000ms): 783.33 KB, 2.18 MB, 7.85 MB, 9.97 MB, 9.99 MB, 10.00 MB, 10.01 MB, 10.02 MB, 10.03 MB, 30.23 MB, 75.34 MB, 115.54 MB, 153.16 MB, 199.35 MB, 248.26 MB, 290.06 MB, 327.30 MB, 366.40 MB, 392.51 MB, 434.25 MB, 481.31 MB, 527.30 MB, 572.97 MB, 618.88 MB, 666.85 MB, 714.04 MB, 763.04 MB, 813.83 MB, 859.92 MB, 897.77 MB, 920.76 MB, 936.72 MB - BytesReceived: 945.28 MB (991198019) - ConvertRowBatchTime: 9s750ms - DeserializeRowBatchTimer: 15s606ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 40.43M (40429232) - RowsReturnedRate: 233.38 K/sec - SendersBlockedTimer: 33s703ms - SendersBlockedTotalTimer(*): 1m6s Instance a6492cb57c2f2439:29baebe700000011 (host=redacted-host5:22000):(Total: 4m19s, non-child: 4s182ms, % non-child: 1.61%) MemoryUsage(8s000ms): 14.88 MB, 62.53 MB, 164.24 MB, 193.28 MB, 297.30 MB, 424.88 MB, 512.31 MB, 553.30 MB, 693.79 MB, 785.90 MB, 786.03 MB, 785.96 MB, 785.91 MB, 785.86 MB, 786.00 MB, 785.74 MB, 785.85 MB, 785.96 MB, 785.91 MB, 785.95 MB, 785.94 MB, 785.93 MB, 785.85 MB, 785.97 MB, 785.91 MB, 786.07 MB, 785.93 MB, 785.92 MB, 785.92 MB, 785.96 MB, 786.02 MB, 785.97 MB ThreadUsage(8s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 8.00 MB (8388608) - PeakMemoryUsage: 809.36 MB (848673110) - PerHostPeakMemUsage: 1.02 GB (1099935664) - RowsProduced: 1.82M (1817175) - TotalNetworkReceiveTime: 3m33s - TotalNetworkSendTime: 12.686ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 34.28K (34281) - TotalThreadsTotalWallClockTime: 4m18s - TotalThreadsSysTime: 1s328ms - TotalThreadsUserTime: 37s335ms - TotalThreadsVoluntaryContextSwitches: 100.55K (100547) Fragment Instance Lifecycle Timings: - ExecTime: 3m9s - ExecTreeExecTime: 3m - OpenTime: 1m9s - ExecTreeOpenTime: 1m8s - PrepareTime: 737.820ms - ExecTreePrepareTime: 236.759ms DataStreamSender (dst_id=9):(Total: 4s188ms, non-child: 4s188ms, % non-child: 100.00%) - BytesSent: 79.64 MB (83503387) - NetworkThroughput(*): 120.93 MB/sec - OverallThroughput: 19.01 MB/sec - PeakMemoryUsage: 248.88 KB (254848) - RowsReturned: 1.82M (1817175) - SerializeBatchTime: 3s525ms - TransmitDataRPCTime: 658.498ms - UncompressedRowBatchSize: 190.70 MB (199962322) CodeGen:(Total: 1s152ms, non-child: 1s152ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 287.699ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2076168) - NumFunctions: 54 (54) - NumInstructions: 2.41K (2406) - OptimizationTime: 640.221ms - PeakMemoryUsage: 1.17 MB (1231872) - PrepareTime: 209.697ms HASH_JOIN_NODE (id=3):(Total: 4m9s, non-child: 22s462ms, % non-child: 8.99%) ExecOption: Probe Side Codegen Enabled - BuildRows: 8.87M (8870827) - BuildTime: 14s523ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 777.10 MB (814851959) - ProbeRows: 40.43M (40428663) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 6s647ms - RowsReturned: 1.82M (1817175) - RowsReturnedRate: 7.27 K/sec Hash Join Builder (join_node_id=3): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 9s944ms - BuildRowsPartitioned: 8.87M (8870827) - GetNewBlockTime: 298.264ms - HashBuckets: 16.78M (16777216) - HashCollisions: 0 (0) - HashTablesBuildTime: 4s495ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 777.02 MB (814765184) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=8):(Total: 53s959ms, non-child: 4s107ms, % non-child: 7.61%) BytesReceived(8s000ms): 744.75 KB, 3.59 MB, 19.20 MB, 49.93 MB, 100.80 MB, 152.49 MB, 192.88 MB, 203.82 MB, 207.75 MB, 207.81 MB, 207.81 MB, 207.81 MB, 207.81 MB, 207.81 MB, 207.81 MB, 207.81 MB, 207.81 MB, 207.81 MB, 207.81 MB, 207.81 MB, 207.81 MB, 207.81 MB, 207.81 MB, 207.81 MB, 207.81 MB, 207.81 MB, 207.81 MB, 207.81 MB, 207.81 MB, 207.81 MB, 207.81 MB, 207.81 MB - BytesReceived: 207.81 MB (217902954) - ConvertRowBatchTime: 2s349ms - DeserializeRowBatchTimer: 4s530ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 8.87M (8870827) - RowsReturnedRate: 164.40 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=7):(Total: 2m53s, non-child: 15s285ms, % non-child: 8.81%) BytesReceived(8s000ms): 787.08 KB, 2.23 MB, 7.90 MB, 9.98 MB, 10.00 MB, 10.01 MB, 10.01 MB, 10.02 MB, 10.03 MB, 30.43 MB, 75.51 MB, 115.73 MB, 153.28 MB, 199.47 MB, 248.30 MB, 290.13 MB, 327.48 MB, 366.53 MB, 395.92 MB, 438.80 MB, 485.97 MB, 531.93 MB, 577.59 MB, 623.72 MB, 671.58 MB, 718.80 MB, 768.10 MB, 818.96 MB, 863.95 MB, 900.87 MB, 922.71 MB, 937.95 MB - BytesReceived: 945.28 MB (991197894) - ConvertRowBatchTime: 9s849ms - DeserializeRowBatchTimer: 16s329ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 40.43M (40428663) - RowsReturnedRate: 233.13 K/sec - SendersBlockedTimer: 33s461ms - SendersBlockedTotalTimer(*): 1m5s Averaged Fragment F00:(Total: 4m, non-child: 2m46s, % non-child: 69.14%) split sizes: min: 2.41 GB, max: 2.72 GB, avg: 2.63 GB, stddev: 106.96 MB completion times: min:3m45s max:4m19s mean: 4m1s stddev:11s935ms execution rates: min:10.35 MB/sec max:12.31 MB/sec mean:11.20 MB/sec stddev:569.74 KB/sec num instances: 8 - AverageThreadTokens: 2.00 - BloomFilterBytes: 8.00 MB (8388608) - PeakMemoryUsage: 85.61 MB (89773369) - PerHostPeakMemUsage: 1.02 GB (1098647219) - RowsProduced: 40.44M (40436523) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1m15s - TotalStorageWaitTime: 749.885ms - TotalThreadsInvoluntaryContextSwitches: 322.23K (322231) - TotalThreadsTotalWallClockTime: 8m - TotalThreadsSysTime: 3s626ms - TotalThreadsUserTime: 2m38s - TotalThreadsVoluntaryContextSwitches: 15.22K (15216) Fragment Instance Lifecycle Timings: - ExecTime: 4m - ExecTreeExecTime: 11s813ms - OpenTime: 160.525ms - ExecTreeOpenTime: 164.909us - PrepareTime: 405.469ms - ExecTreePrepareTime: 496.655us DataStreamSender (dst_id=7):(Total: 1m2s, non-child: 1m2s, % non-child: 100.00%) - BytesSent: 945.47 MB (991396656) - NetworkThroughput(*): 129.59 MB/sec - OverallThroughput: 15.17 MB/sec - PeakMemoryUsage: 248.94 KB (254912) - RowsReturned: 40.44M (40436523) - SerializeBatchTime: 55s047ms - TransmitDataRPCTime: 7s295ms - UncompressedRowBatchSize: 2.07 GB (2224414191) CodeGen:(Total: 331.478ms, non-child: 331.478ms, % non-child: 100.00%) - CodegenTime: 10.521ms - CompileTime: 21.378ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2076168) - NumFunctions: 46 (46) - NumInstructions: 720 (720) - OptimizationTime: 122.397ms - PeakMemoryUsage: 360.00 KB (368640) - PrepareTime: 180.315ms HDFS_SCAN_NODE (id=2):(Total: 11s632ms, non-child: 11s632ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 633.72 MB (664506956) - BytesReadDataNodeCache: 0 - BytesReadLocal: 633.72 MB (664506956) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 633.72 MB (664506956) - DecompressionTime: 2s972ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 7 (7) - NumRowGroups: 11 (11) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 77.35 MB (81112225) - PerReadThreadRawHdfsThroughput: 639.13 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 8s056ms - RowBatchQueuePutWaitTime: 1m16s - RowsRead: 75.00M (75004737) - RowsReturned: 40.44M (40436523) - RowsReturnedRate: 3.81 M/sec - ScanRangesComplete: 11 (11) - ScannerThreadsInvoluntaryContextSwitches: 109.99K (109987) - ScannerThreadsTotalWallClockTime: 4m - MaterializeTupleTime(*): 2m36s - ScannerThreadsSysTime: 1s942ms - ScannerThreadsUserTime: 1m17s - ScannerThreadsVoluntaryContextSwitches: 10.28K (10275) - TotalRawHdfsReadTime(*): 999.906ms - TotalReadThroughput: 2.65 MB/sec Filter 1 (8.00 MB): - Rows processed: 322.86K (322858) - Rows rejected: 298 (298) - Rows total: 75.00M (75004737) Fragment F00: Instance a6492cb57c2f2439:29baebe700000008 (host=redacted-host7:22000):(Total: 4m19s, non-child: 2m57s, % non-child: 68.42%) Hdfs split stats (:<# splits>/): 9:1/253.29 MB 6:1/253.32 MB 7:1/253.30 MB 11:1/253.31 MB 10:2/506.59 MB 0:2/506.67 MB 5:1/253.30 MB 8:2/506.58 MB Filter 1 arrival: 1m6s MemoryUsage(8s000ms): 58.22 MB, 73.91 MB, 73.91 MB, 73.91 MB, 73.91 MB, 73.91 MB, 73.91 MB, 73.91 MB, 80.91 MB, 69.15 MB, 48.05 MB, 61.33 MB, 66.30 MB, 54.47 MB, 62.17 MB, 45.19 MB, 72.04 MB, 67.05 MB, 52.09 MB, 68.45 MB, 53.09 MB, 66.02 MB, 54.02 MB, 71.84 MB, 58.94 MB, 70.41 MB, 49.76 MB, 65.94 MB, 57.39 MB, 64.52 MB, 61.03 MB, 59.26 MB ThreadUsage(8s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 8.00 MB (8388608) - PeakMemoryUsage: 86.08 MB (90260228) - PerHostPeakMemUsage: 1.03 GB (1101185652) - RowsProduced: 41.82M (41816642) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1m16s - TotalStorageWaitTime: 541.272ms - TotalThreadsInvoluntaryContextSwitches: 337.72K (337718) - TotalThreadsTotalWallClockTime: 8m37s - TotalThreadsSysTime: 3s705ms - TotalThreadsUserTime: 2m44s - TotalThreadsVoluntaryContextSwitches: 15.38K (15375) Fragment Instance Lifecycle Timings: - ExecTime: 4m18s - ExecTreeExecTime: 15s240ms - OpenTime: 180.970ms - ExecTreeOpenTime: 170.596us - PrepareTime: 618.338ms - ExecTreePrepareTime: 407.188us DataStreamSender (dst_id=7):(Total: 1m6s, non-child: 1m6s, % non-child: 100.00%) - BytesSent: 976.07 MB (1023478541) - NetworkThroughput(*): 129.69 MB/sec - OverallThroughput: 14.67 MB/sec - PeakMemoryUsage: 248.94 KB (254912) - RowsReturned: 41.82M (41816642) - SerializeBatchTime: 58s967ms - TransmitDataRPCTime: 7s526ms - UncompressedRowBatchSize: 2.14 GB (2300334538) CodeGen:(Total: 294.806ms, non-child: 294.806ms, % non-child: 100.00%) - CodegenTime: 3.048ms - CompileTime: 40.035ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2076168) - NumFunctions: 46 (46) - NumInstructions: 720 (720) - OptimizationTime: 136.728ms - PeakMemoryUsage: 360.00 KB (368640) - PrepareTime: 109.957ms HDFS_SCAN_NODE (id=2):(Total: 15s070ms, non-child: 15s070ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 9:1/253.29 MB 6:1/253.32 MB 7:1/253.30 MB 11:1/253.31 MB 10:2/506.59 MB 0:2/506.67 MB 5:1/253.30 MB 8:2/506.58 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 11 out of 11 Runtime filters: Only following filters arrived: , waited 423ms Hdfs Read Thread Concurrency Bucket: 0:99.81% 1:0.1949% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:44 BytesRead(8s000ms): 45.74 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.91 MB, 59.56 MB, 104.22 MB, 119.11 MB, 140.22 MB, 176.43 MB, 178.67 MB, 230.78 MB, 238.22 MB, 238.22 MB, 294.70 MB, 297.78 MB, 349.89 MB, 357.33 MB, 405.71 MB, 416.88 MB, 472.72 MB, 483.48 MB, 533.76 MB, 550.88 MB, 595.55 MB, 629.04 MB, 655.09 MB - FooterProcessingTime: (Avg: 8.574ms ; Min: 2.405ms ; Max: 42.428ms ; Number of samples: 11) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 655.09 MB (686915434) - BytesReadDataNodeCache: 0 - BytesReadLocal: 655.09 MB (686915434) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 655.09 MB (686915434) - DecompressionTime: 3s199ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 8 (8) - NumRowGroups: 11 (11) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 77.82 MB (81597290) - PerReadThreadRawHdfsThroughput: 644.90 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 10s788ms - RowBatchQueuePutWaitTime: 1m18s - RowsRead: 77.55M (77549411) - RowsReturned: 41.82M (41816642) - RowsReturnedRate: 2.77 M/sec - ScanRangesComplete: 11 (11) - ScannerThreadsInvoluntaryContextSwitches: 113.56K (113555) - ScannerThreadsTotalWallClockTime: 4m18s - MaterializeTupleTime(*): 2m51s - ScannerThreadsSysTime: 2s006ms - ScannerThreadsUserTime: 1m20s - ScannerThreadsVoluntaryContextSwitches: 10.27K (10266) - TotalRawHdfsReadTime(*): 1s015ms - TotalReadThroughput: 2.55 MB/sec Filter 1 (8.00 MB): - Rows processed: 331.28K (331283) - Rows rejected: 324 (324) - Rows total: 77.55M (77549411) Instance a6492cb57c2f2439:29baebe700000007 (host=redacted-host6:22000):(Total: 4m16s, non-child: 2m56s, % non-child: 69.02%) Hdfs split stats (:<# splits>/): 7:1/253.31 MB 0:1/253.32 MB 8:2/506.63 MB 6:3/498.75 MB 3:3/759.98 MB 5:1/253.29 MB 11:1/253.27 MB Filter 1 arrival: 1m6s MemoryUsage(4s000ms): 51.03 MB, 73.95 MB, 73.95 MB, 73.95 MB, 73.95 MB, 73.95 MB, 73.95 MB, 73.95 MB, 73.95 MB, 73.95 MB, 73.95 MB, 73.95 MB, 73.95 MB, 73.95 MB, 73.95 MB, 73.95 MB, 77.95 MB, 81.96 MB, 80.59 MB, 66.45 MB, 58.16 MB, 44.78 MB, 72.68 MB, 65.16 MB, 64.96 MB, 48.59 MB, 59.79 MB, 70.10 MB, 64.58 MB, 57.54 MB, 40.00 MB, 39.13 MB, 75.65 MB, 70.94 MB, 58.89 MB, 47.29 MB, 43.50 MB, 72.84 MB, 75.62 MB, 65.14 MB, 39.44 MB, 63.09 MB, 73.62 MB, 68.80 MB, 50.80 MB, 62.73 MB, 73.77 MB, 66.16 MB, 48.02 MB, 60.82 MB, 76.19 MB, 70.18 MB, 47.58 MB, 68.77 MB, 70.08 MB, 67.16 MB, 46.90 MB, 44.40 MB, 58.62 MB, 76.67 MB, 61.35 MB, 43.03 MB, 60.76 MB ThreadUsage(4s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 8.00 MB (8388608) - PeakMemoryUsage: 86.30 MB (90492696) - PerHostPeakMemUsage: 1.03 GB (1100730973) - RowsProduced: 41.69M (41686680) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1m17s - TotalStorageWaitTime: 774.051ms - TotalThreadsInvoluntaryContextSwitches: 340.45K (340449) - TotalThreadsTotalWallClockTime: 8m31s - TotalThreadsSysTime: 3s814ms - TotalThreadsUserTime: 2m43s - TotalThreadsVoluntaryContextSwitches: 16.41K (16412) Fragment Instance Lifecycle Timings: - ExecTime: 4m15s - ExecTreeExecTime: 12s283ms - OpenTime: 141.764ms - ExecTreeOpenTime: 143.676us - PrepareTime: 513.922ms - ExecTreePrepareTime: 628.336us DataStreamSender (dst_id=7):(Total: 1m6s, non-child: 1m6s, % non-child: 100.00%) - BytesSent: 972.49 MB (1019733204) - NetworkThroughput(*): 129.09 MB/sec - OverallThroughput: 14.55 MB/sec - PeakMemoryUsage: 248.94 KB (254912) - RowsReturned: 41.69M (41686680) - SerializeBatchTime: 59s262ms - TransmitDataRPCTime: 7s533ms - UncompressedRowBatchSize: 2.14 GB (2293185320) CodeGen:(Total: 463.791ms, non-child: 463.791ms, % non-child: 100.00%) - CodegenTime: 51.905ms - CompileTime: 13.571ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2076168) - NumFunctions: 46 (46) - NumInstructions: 720 (720) - OptimizationTime: 116.380ms - PeakMemoryUsage: 360.00 KB (368640) - PrepareTime: 332.580ms HDFS_SCAN_NODE (id=2):(Total: 12s099ms, non-child: 12s099ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:1/253.31 MB 0:1/253.32 MB 8:2/506.63 MB 6:3/498.75 MB 3:3/759.98 MB 5:1/253.29 MB 11:1/253.27 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 12 out of 12 Runtime filters: Only following filters arrived: , waited 384ms Hdfs Read Thread Concurrency Bucket: 0:99.61% 1:0.3929% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:48 BytesRead(4s000ms): 42.23 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 57.12 MB, 59.56 MB, 66.61 MB, 115.86 MB, 116.27 MB, 119.12 MB, 119.12 MB, 148.89 MB, 178.66 MB, 178.66 MB, 178.66 MB, 178.66 MB, 193.55 MB, 238.22 MB, 238.22 MB, 238.22 MB, 238.22 MB, 238.22 MB, 282.89 MB, 297.78 MB, 297.78 MB, 297.78 MB, 342.44 MB, 357.33 MB, 357.33 MB, 357.33 MB, 392.53 MB, 413.63 MB, 416.47 MB, 416.88 MB, 455.12 MB, 476.44 MB, 476.44 MB, 476.44 MB, 521.11 MB, 536.00 MB, 536.00 MB, 536.00 MB, 551.41 MB, 586.32 MB, 616.10 MB, 616.10 MB, 625.45 MB, 653.48 MB - FooterProcessingTime: (Avg: 10.514ms ; Min: 2.417ms ; Max: 40.739ms ; Number of samples: 12) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 653.48 MB (685220896) - BytesReadDataNodeCache: 0 - BytesReadLocal: 653.48 MB (685220896) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 653.48 MB (685220896) - DecompressionTime: 3s081ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 7 (7) - NumRowGroups: 12 (12) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 78.00 MB (81787786) - PerReadThreadRawHdfsThroughput: 744.56 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 7s244ms - RowBatchQueuePutWaitTime: 1m22s - RowsRead: 77.32M (77318295) - RowsReturned: 41.69M (41686680) - RowsReturnedRate: 3.45 M/sec - ScanRangesComplete: 12 (12) - ScannerThreadsInvoluntaryContextSwitches: 116.03K (116034) - ScannerThreadsTotalWallClockTime: 4m15s - MaterializeTupleTime(*): 2m44s - ScannerThreadsSysTime: 2s014ms - ScannerThreadsUserTime: 1m19s - ScannerThreadsVoluntaryContextSwitches: 11.42K (11423) - TotalRawHdfsReadTime(*): 877.673ms - TotalReadThroughput: 2.56 MB/sec Filter 1 (8.00 MB): - Rows processed: 363.19K (363190) - Rows rejected: 429 (429) - Rows total: 77.32M (77318295) Instance a6492cb57c2f2439:29baebe700000005 (host=redacted-host3:22000):(Total: 4m8s, non-child: 2m51s, % non-child: 68.99%) Hdfs split stats (:<# splits>/): 2:1/253.30 MB 10:1/253.34 MB 3:1/253.31 MB 11:1/253.33 MB 9:3/759.90 MB 8:1/253.30 MB 0:1/253.29 MB 7:2/506.65 MB Filter 1 arrival: 1m6s MemoryUsage(4s000ms): 47.07 MB, 65.91 MB, 65.91 MB, 65.20 MB, 65.01 MB, 62.53 MB, 62.07 MB, 62.07 MB, 62.07 MB, 62.07 MB, 62.07 MB, 62.07 MB, 62.07 MB, 62.07 MB, 62.07 MB, 62.07 MB, 66.07 MB, 70.05 MB, 67.91 MB, 41.67 MB, 68.90 MB, 62.77 MB, 57.17 MB, 41.91 MB, 48.53 MB, 62.81 MB, 69.33 MB, 50.77 MB, 57.52 MB, 65.94 MB, 64.47 MB, 47.44 MB, 51.19 MB, 73.67 MB, 69.51 MB, 68.26 MB, 55.99 MB, 41.55 MB, 78.94 MB, 73.12 MB, 69.15 MB, 52.52 MB, 61.14 MB, 75.55 MB, 68.05 MB, 46.86 MB, 46.84 MB, 73.63 MB, 63.48 MB, 48.30 MB, 48.84 MB, 71.84 MB, 65.27 MB, 50.38 MB, 58.87 MB, 71.83 MB, 67.34 MB, 47.29 MB, 67.85 MB, 63.63 MB, 57.77 MB ThreadUsage(4s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 8.00 MB (8388608) - PeakMemoryUsage: 82.05 MB (86030758) - PerHostPeakMemUsage: 1.01 GB (1089011159) - RowsProduced: 41.82M (41823838) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1m11s - TotalStorageWaitTime: 558.438ms - TotalThreadsInvoluntaryContextSwitches: 352.31K (352311) - TotalThreadsTotalWallClockTime: 8m16s - TotalThreadsSysTime: 3s845ms - TotalThreadsUserTime: 2m44s - TotalThreadsVoluntaryContextSwitches: 16.67K (16667) Fragment Instance Lifecycle Timings: - ExecTime: 4m8s - ExecTreeExecTime: 10s918ms - OpenTime: 123.475ms - ExecTreeOpenTime: 256.846us - PrepareTime: 160.327ms - ExecTreePrepareTime: 491.118us DataStreamSender (dst_id=7):(Total: 1m6s, non-child: 1m6s, % non-child: 100.00%) - BytesSent: 978.37 MB (1025891733) - NetworkThroughput(*): 129.90 MB/sec - OverallThroughput: 14.76 MB/sec - PeakMemoryUsage: 248.94 KB (254912) - RowsReturned: 41.82M (41823838) - SerializeBatchTime: 58s658ms - TransmitDataRPCTime: 7s531ms - UncompressedRowBatchSize: 2.14 GB (2300730394) CodeGen:(Total: 194.025ms, non-child: 194.025ms, % non-child: 100.00%) - CodegenTime: 4.257ms - CompileTime: 12.562ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2076168) - NumFunctions: 46 (46) - NumInstructions: 720 (720) - OptimizationTime: 102.643ms - PeakMemoryUsage: 360.00 KB (368640) - PrepareTime: 60.886ms HDFS_SCAN_NODE (id=2):(Total: 10s689ms, non-child: 10s689ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:1/253.30 MB 10:1/253.34 MB 3:1/253.31 MB 11:1/253.33 MB 9:3/759.90 MB 8:1/253.30 MB 0:1/253.29 MB 7:2/506.65 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 11 out of 11 Runtime filters: Only following filters arrived: , waited 743ms Hdfs Read Thread Concurrency Bucket: 0:99.6% 1:0.4049% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:44 BytesRead(4s000ms): 36.23 MB, 48.30 MB, 48.30 MB, 48.30 MB, 53.30 MB, 59.14 MB, 59.55 MB, 59.55 MB, 59.55 MB, 59.55 MB, 59.55 MB, 59.55 MB, 59.55 MB, 59.55 MB, 59.55 MB, 59.55 MB, 59.55 MB, 59.55 MB, 59.55 MB, 63.59 MB, 115.84 MB, 116.65 MB, 119.09 MB, 119.09 MB, 143.24 MB, 171.38 MB, 177.83 MB, 178.64 MB, 214.87 MB, 232.94 MB, 237.79 MB, 238.20 MB, 259.31 MB, 294.50 MB, 295.73 MB, 297.76 MB, 297.76 MB, 297.76 MB, 354.06 MB, 354.06 MB, 356.91 MB, 357.32 MB, 392.50 MB, 413.61 MB, 416.05 MB, 416.86 MB, 441.25 MB, 473.17 MB, 475.20 MB, 476.42 MB, 504.57 MB, 532.72 MB, 534.74 MB, 535.96 MB, 571.15 MB, 592.26 MB, 595.52 MB, 595.52 MB, 644.78 MB, 652.23 MB, 655.08 MB - FooterProcessingTime: (Avg: 3.686ms ; Min: 468.174us ; Max: 6.381ms ; Number of samples: 11) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 655.08 MB (686899821) - BytesReadDataNodeCache: 0 - BytesReadLocal: 655.08 MB (686899821) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 655.08 MB (686899821) - DecompressionTime: 3s164ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 8 (8) - NumRowGroups: 11 (11) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 73.84 MB (77426188) - PerReadThreadRawHdfsThroughput: 568.63 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 4s925ms - RowBatchQueuePutWaitTime: 1m15s - RowsRead: 77.55M (77548800) - RowsReturned: 41.82M (41823838) - RowsReturnedRate: 3.91 M/sec - ScanRangesComplete: 11 (11) - ScannerThreadsInvoluntaryContextSwitches: 122.63K (122631) - ScannerThreadsTotalWallClockTime: 4m8s - MaterializeTupleTime(*): 2m44s - ScannerThreadsSysTime: 2s049ms - ScannerThreadsUserTime: 1m19s - ScannerThreadsVoluntaryContextSwitches: 11.83K (11829) - TotalRawHdfsReadTime(*): 1s152ms - TotalReadThroughput: 2.65 MB/sec Filter 1 (8.00 MB): - Rows processed: 308.60K (308600) - Rows rejected: 280 (280) - Rows total: 77.55M (77548800) Instance a6492cb57c2f2439:29baebe700000004 (host=redacted-host8:22000):(Total: 3m58s, non-child: 2m40s, % non-child: 67.40%) Hdfs split stats (:<# splits>/): 4:2/444.66 MB 11:1/253.34 MB 0:1/253.33 MB 7:1/253.31 MB 6:2/506.66 MB 9:2/506.61 MB 8:1/253.29 MB Filter 1 arrival: 1m6s MemoryUsage(4s000ms): 44.37 MB, 73.97 MB, 74.00 MB, 69.79 MB, 59.64 MB, 58.08 MB, 65.98 MB, 65.98 MB, 65.98 MB, 65.98 MB, 65.98 MB, 65.98 MB, 65.98 MB, 65.98 MB, 65.98 MB, 65.98 MB, 68.98 MB, 73.99 MB, 70.60 MB, 61.80 MB, 36.74 MB, 53.59 MB, 66.54 MB, 61.47 MB, 57.05 MB, 38.99 MB, 66.51 MB, 69.67 MB, 58.48 MB, 37.33 MB, 47.90 MB, 71.93 MB, 66.01 MB, 58.05 MB, 46.92 MB, 35.43 MB, 65.45 MB, 80.41 MB, 74.79 MB, 62.37 MB, 36.82 MB, 74.56 MB, 67.24 MB, 56.92 MB, 35.83 MB, 68.88 MB, 70.07 MB, 59.98 MB, 39.06 MB, 52.93 MB, 57.84 MB, 47.90 MB, 67.41 MB, 73.03 MB, 59.43 MB, 44.39 MB, 70.51 MB, 66.56 MB, 51.78 MB ThreadUsage(4s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 8.00 MB (8388608) - PeakMemoryUsage: 86.05 MB (90226065) - PerHostPeakMemUsage: 1.02 GB (1092393946) - RowsProduced: 37.07M (37071536) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1m9s - TotalStorageWaitTime: 536.379ms - TotalThreadsInvoluntaryContextSwitches: 291.02K (291016) - TotalThreadsTotalWallClockTime: 7m55s - TotalThreadsSysTime: 3s394ms - TotalThreadsUserTime: 2m25s - TotalThreadsVoluntaryContextSwitches: 15.95K (15945) Fragment Instance Lifecycle Timings: - ExecTime: 3m57s - ExecTreeExecTime: 18s040ms - OpenTime: 189.554ms - ExecTreeOpenTime: 156.821us - PrepareTime: 328.924ms - ExecTreePrepareTime: 470.408us DataStreamSender (dst_id=7):(Total: 59s540ms, non-child: 59s540ms, % non-child: 100.00%) - BytesSent: 867.67 MB (909816134) - NetworkThroughput(*): 128.36 MB/sec - OverallThroughput: 14.57 MB/sec - PeakMemoryUsage: 248.94 KB (254912) - RowsReturned: 37.07M (37071536) - SerializeBatchTime: 52s718ms - TransmitDataRPCTime: 6s759ms - UncompressedRowBatchSize: 1.90 GB (2039306140) CodeGen:(Total: 325.124ms, non-child: 325.124ms, % non-child: 100.00%) - CodegenTime: 3.551ms - CompileTime: 11.882ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2076168) - NumFunctions: 46 (46) - NumInstructions: 720 (720) - OptimizationTime: 153.738ms - PeakMemoryUsage: 360.00 KB (368640) - PrepareTime: 158.828ms HDFS_SCAN_NODE (id=2):(Total: 17s863ms, non-child: 17s863ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:2/444.66 MB 11:1/253.34 MB 0:1/253.33 MB 7:1/253.31 MB 6:2/506.66 MB 9:2/506.61 MB 8:1/253.29 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 10 out of 10 Runtime filters: Only following filters arrived: , waited 524ms Hdfs Read Thread Concurrency Bucket: 0:99.79% 1:0.211% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:40 BytesRead(4s000ms): 42.23 MB, 56.31 MB, 56.31 MB, 56.31 MB, 56.31 MB, 56.31 MB, 56.31 MB, 56.31 MB, 56.31 MB, 56.31 MB, 56.31 MB, 56.31 MB, 56.31 MB, 56.31 MB, 56.31 MB, 56.31 MB, 56.31 MB, 56.31 MB, 57.93 MB, 59.56 MB, 59.56 MB, 101.79 MB, 115.87 MB, 117.49 MB, 119.12 MB, 119.12 MB, 173.51 MB, 178.68 MB, 178.68 MB, 178.68 MB, 215.90 MB, 238.24 MB, 238.24 MB, 238.24 MB, 238.24 MB, 238.24 MB, 282.91 MB, 297.81 MB, 297.81 MB, 297.81 MB, 307.53 MB, 357.37 MB, 357.37 MB, 357.37 MB, 357.37 MB, 416.93 MB, 416.93 MB, 416.93 MB, 416.93 MB, 456.33 MB, 461.96 MB, 461.96 MB, 514.07 MB, 521.51 MB, 521.51 MB, 521.51 MB, 581.08 MB, 581.08 MB, 581.08 MB - FooterProcessingTime: (Avg: 5.505ms ; Min: 337.262us ; Max: 12.013ms ; Number of samples: 10) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 581.08 MB (609302905) - BytesReadDataNodeCache: 0 - BytesReadLocal: 581.08 MB (609302905) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 581.08 MB (609302905) - DecompressionTime: 2s824ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 7 (7) - NumRowGroups: 10 (10) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 77.78 MB (81562103) - PerReadThreadRawHdfsThroughput: 706.65 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 14s988ms - RowBatchQueuePutWaitTime: 1m4s - RowsRead: 68.77M (68773599) - RowsReturned: 37.07M (37071536) - RowsReturnedRate: 2.08 M/sec - ScanRangesComplete: 10 (10) - ScannerThreadsInvoluntaryContextSwitches: 100.37K (100367) - ScannerThreadsTotalWallClockTime: 3m57s - MaterializeTupleTime(*): 2m44s - ScannerThreadsSysTime: 1s790ms - ScannerThreadsUserTime: 1m11s - ScannerThreadsVoluntaryContextSwitches: 10.61K (10610) - TotalRawHdfsReadTime(*): 822.299ms - TotalReadThroughput: 2.45 MB/sec Filter 1 (8.00 MB): - Rows processed: 304.60K (304597) - Rows rejected: 246 (246) - Rows total: 68.77M (68773599) Instance a6492cb57c2f2439:29baebe700000006 (host=redacted-host1:22000):(Total: 3m57s, non-child: 2m46s, % non-child: 70.09%) Hdfs split stats (:<# splits>/): 11:2/506.67 MB 8:2/506.69 MB 5:1/253.34 MB 3:1/253.33 MB 7:1/253.30 MB 10:1/253.31 MB 9:3/670.40 MB Filter 1 arrival: 1m6s MemoryUsage(4s000ms): 36.16 MB, 77.61 MB, 77.95 MB, 77.95 MB, 77.95 MB, 77.95 MB, 77.95 MB, 77.95 MB, 77.95 MB, 77.95 MB, 77.95 MB, 77.95 MB, 77.94 MB, 77.89 MB, 77.89 MB, 77.89 MB, 80.89 MB, 85.91 MB, 83.93 MB, 72.44 MB, 60.37 MB, 46.18 MB, 42.08 MB, 53.93 MB, 51.24 MB, 49.45 MB, 70.31 MB, 61.73 MB, 40.11 MB, 63.16 MB, 67.24 MB, 60.94 MB, 49.10 MB, 35.99 MB, 74.30 MB, 76.28 MB, 73.95 MB, 65.70 MB, 39.44 MB, 79.73 MB, 70.12 MB, 49.62 MB, 58.05 MB, 73.24 MB, 62.14 MB, 43.07 MB, 64.30 MB, 69.92 MB, 56.84 MB, 56.83 MB, 75.45 MB, 67.70 MB, 46.73 MB, 77.36 MB, 68.66 MB, 51.43 MB, 69.39 MB, 64.73 MB, 47.03 MB ThreadUsage(4s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 8.00 MB (8388608) - PeakMemoryUsage: 86.53 MB (90735400) - PerHostPeakMemUsage: 1.03 GB (1105124622) - RowsProduced: 40.47M (40465735) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1m17s - TotalStorageWaitTime: 821.014ms - TotalThreadsInvoluntaryContextSwitches: 319.26K (319262) - TotalThreadsTotalWallClockTime: 7m53s - TotalThreadsSysTime: 3s673ms - TotalThreadsUserTime: 2m38s - TotalThreadsVoluntaryContextSwitches: 14.19K (14187) Fragment Instance Lifecycle Timings: - ExecTime: 3m56s - ExecTreeExecTime: 9s464ms - OpenTime: 168.722ms - ExecTreeOpenTime: 140.434us - PrepareTime: 377.686ms - ExecTreePrepareTime: 781.808us DataStreamSender (dst_id=7):(Total: 1m1s, non-child: 1m1s, % non-child: 100.00%) - BytesSent: 947.19 MB (993204415) - NetworkThroughput(*): 128.97 MB/sec - OverallThroughput: 15.42 MB/sec - PeakMemoryUsage: 248.94 KB (254912) - RowsReturned: 40.47M (40465735) - SerializeBatchTime: 54s003ms - TransmitDataRPCTime: 7s344ms - UncompressedRowBatchSize: 2.07 GB (2226021113) CodeGen:(Total: 296.195ms, non-child: 296.195ms, % non-child: 100.00%) - CodegenTime: 13.399ms - CompileTime: 49.211ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2076168) - NumFunctions: 46 (46) - NumInstructions: 720 (720) - OptimizationTime: 112.186ms - PeakMemoryUsage: 360.00 KB (368640) - PrepareTime: 134.018ms HDFS_SCAN_NODE (id=2):(Total: 9s272ms, non-child: 9s272ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 11:2/506.67 MB 8:2/506.69 MB 5:1/253.34 MB 3:1/253.33 MB 7:1/253.30 MB 10:1/253.31 MB 9:3/670.40 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 11 out of 11 Runtime filters: Only following filters arrived: , waited 502ms Hdfs Read Thread Concurrency Bucket: 0:99.58% 1:0.4237% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:44 BytesRead(4s000ms): 31.07 MB, 59.56 MB, 59.56 MB, 59.56 MB, 59.56 MB, 59.56 MB, 59.56 MB, 59.56 MB, 59.56 MB, 59.56 MB, 59.56 MB, 59.56 MB, 59.56 MB, 59.56 MB, 59.56 MB, 59.56 MB, 59.56 MB, 59.56 MB, 59.56 MB, 59.56 MB, 59.56 MB, 59.56 MB, 77.00 MB, 98.13 MB, 98.13 MB, 112.21 MB, 154.44 MB, 156.88 MB, 157.69 MB, 202.36 MB, 217.25 MB, 217.25 MB, 217.25 MB, 224.70 MB, 276.82 MB, 276.82 MB, 276.82 MB, 276.82 MB, 276.82 MB, 336.38 MB, 336.38 MB, 336.38 MB, 364.54 MB, 392.69 MB, 395.13 MB, 395.94 MB, 440.20 MB, 455.50 MB, 455.50 MB, 482.87 MB, 515.05 MB, 515.05 MB, 515.05 MB, 567.18 MB, 574.63 MB, 574.63 MB, 619.31 MB, 634.20 MB, 634.20 MB - FooterProcessingTime: (Avg: 15.234ms ; Min: 2.928ms ; Max: 123.005ms ; Number of samples: 11) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 634.20 MB (665009357) - BytesReadDataNodeCache: 0 - BytesReadLocal: 634.20 MB (665009357) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 634.20 MB (665009357) - DecompressionTime: 2s934ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 7 (7) - NumRowGroups: 11 (11) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 78.23 MB (82030478) - PerReadThreadRawHdfsThroughput: 609.50 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 6s275ms - RowBatchQueuePutWaitTime: 1m16s - RowsRead: 75.06M (75059060) - RowsReturned: 40.47M (40465735) - RowsReturnedRate: 4.36 M/sec - ScanRangesComplete: 11 (11) - ScannerThreadsInvoluntaryContextSwitches: 107.90K (107901) - ScannerThreadsTotalWallClockTime: 3m56s - MaterializeTupleTime(*): 2m32s - ScannerThreadsSysTime: 1s972ms - ScannerThreadsUserTime: 1m17s - ScannerThreadsVoluntaryContextSwitches: 9.63K (9630) - TotalRawHdfsReadTime(*): 1s040ms - TotalReadThroughput: 2.68 MB/sec Filter 1 (8.00 MB): - Rows processed: 324.24K (324243) - Rows rejected: 328 (328) - Rows total: 75.06M (75059060) Instance a6492cb57c2f2439:29baebe700000002 (host=redacted-host4:22000):(Total: 3m55s, non-child: 2m43s, % non-child: 69.26%) Hdfs split stats (:<# splits>/): 3:1/253.30 MB 7:1/253.34 MB 9:1/253.30 MB 11:1/253.31 MB 2:1/190.65 MB 10:2/506.63 MB 5:2/506.59 MB 1:2/422.05 MB Filter 1 arrival: 1m6s MemoryUsage(4s000ms): 48.70 MB, 73.86 MB, 73.84 MB, 73.83 MB, 73.83 MB, 73.83 MB, 73.83 MB, 73.83 MB, 73.83 MB, 73.83 MB, 73.83 MB, 73.83 MB, 73.83 MB, 73.83 MB, 73.84 MB, 73.85 MB, 77.85 MB, 81.85 MB, 76.85 MB, 62.49 MB, 59.50 MB, 41.96 MB, 67.49 MB, 68.63 MB, 62.86 MB, 55.60 MB, 52.43 MB, 77.12 MB, 61.88 MB, 41.30 MB, 68.44 MB, 74.59 MB, 61.24 MB, 44.30 MB, 49.37 MB, 60.07 MB, 60.97 MB, 52.23 MB, 61.57 MB, 70.47 MB, 62.61 MB, 40.31 MB, 58.27 MB, 75.64 MB, 60.20 MB, 40.26 MB, 76.58 MB, 66.19 MB, 49.31 MB, 51.51 MB, 70.03 MB, 59.87 MB, 47.27 MB, 63.40 MB, 47.75 MB, 68.73 MB, 71.86 MB, 54.25 MB ThreadUsage(4s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 8.00 MB (8388608) - PeakMemoryUsage: 86.48 MB (90685224) - PerHostPeakMemUsage: 1.03 GB (1100732840) - RowsProduced: 39.60M (39599277) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1m17s - TotalStorageWaitTime: 806.381ms - TotalThreadsInvoluntaryContextSwitches: 314.59K (314588) - TotalThreadsTotalWallClockTime: 7m50s - TotalThreadsSysTime: 3s509ms - TotalThreadsUserTime: 2m34s - TotalThreadsVoluntaryContextSwitches: 14.63K (14626) Fragment Instance Lifecycle Timings: - ExecTime: 3m55s - ExecTreeExecTime: 11s724ms - OpenTime: 200.427ms - ExecTreeOpenTime: 185.375us - PrepareTime: 386.874ms - ExecTreePrepareTime: 440.289us DataStreamSender (dst_id=7):(Total: 1m, non-child: 1m, % non-child: 100.00%) - BytesSent: 926.68 MB (971692894) - NetworkThroughput(*): 129.44 MB/sec - OverallThroughput: 15.31 MB/sec - PeakMemoryUsage: 248.94 KB (254912) - RowsReturned: 39.60M (39599277) - SerializeBatchTime: 53s292ms - TransmitDataRPCTime: 7s159ms - UncompressedRowBatchSize: 2.03 GB (2178357235) CodeGen:(Total: 349.282ms, non-child: 349.282ms, % non-child: 100.00%) - CodegenTime: 2.547ms - CompileTime: 22.330ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2076168) - NumFunctions: 46 (46) - NumInstructions: 720 (720) - OptimizationTime: 132.236ms - PeakMemoryUsage: 360.00 KB (368640) - PrepareTime: 192.323ms HDFS_SCAN_NODE (id=2):(Total: 11s570ms, non-child: 11s570ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:1/253.30 MB 7:1/253.34 MB 9:1/253.30 MB 11:1/253.31 MB 2:1/190.65 MB 10:2/506.63 MB 5:2/506.59 MB 1:2/422.05 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 11 out of 11 Runtime filters: Only following filters arrived: , waited 462ms Hdfs Read Thread Concurrency Bucket: 0:99.79% 1:0.2141% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:44 BytesRead(4s000ms): 38.47 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 59.56 MB, 59.56 MB, 109.27 MB, 119.12 MB, 119.12 MB, 119.12 MB, 134.01 MB, 178.67 MB, 178.67 MB, 178.67 MB, 230.79 MB, 238.24 MB, 238.24 MB, 238.24 MB, 260.68 MB, 283.12 MB, 283.12 MB, 283.12 MB, 320.35 MB, 342.67 MB, 342.67 MB, 342.67 MB, 379.89 MB, 402.22 MB, 402.22 MB, 402.22 MB, 461.78 MB, 461.78 MB, 461.78 MB, 491.56 MB, 521.33 MB, 521.33 MB, 526.30 MB, 561.06 MB, 561.06 MB, 598.28 MB, 620.60 MB, 620.60 MB - FooterProcessingTime: (Avg: 6.823ms ; Min: 321.729us ; Max: 24.218ms ; Number of samples: 11) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 620.60 MB (650751269) - BytesReadDataNodeCache: 0 - BytesReadLocal: 620.60 MB (650751269) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 620.60 MB (650751269) - DecompressionTime: 3s114ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 8 (8) - NumRowGroups: 11 (11) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 78.23 MB (82030478) - PerReadThreadRawHdfsThroughput: 583.20 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 8s710ms - RowBatchQueuePutWaitTime: 1m16s - RowsRead: 73.45M (73445556) - RowsReturned: 39.60M (39599277) - RowsReturnedRate: 3.42 M/sec - ScanRangesComplete: 11 (11) - ScannerThreadsInvoluntaryContextSwitches: 108.77K (108772) - ScannerThreadsTotalWallClockTime: 3m54s - MaterializeTupleTime(*): 2m30s - ScannerThreadsSysTime: 1s905ms - ScannerThreadsUserTime: 1m15s - ScannerThreadsVoluntaryContextSwitches: 9.47K (9473) - TotalRawHdfsReadTime(*): 1s064ms - TotalReadThroughput: 2.65 MB/sec Filter 1 (8.00 MB): - Rows processed: 314.14K (314137) - Rows rejected: 258 (258) - Rows total: 73.45M (73445556) Instance a6492cb57c2f2439:29baebe700000001 (host=redacted-host5:22000):(Total: 3m46s, non-child: 2m39s, % non-child: 70.35%) Hdfs split stats (:<# splits>/): 4:1/253.29 MB 2:1/253.33 MB 10:2/506.60 MB 0:2/506.62 MB 7:2/506.59 MB 1:2/506.65 MB 11:1/253.31 MB Filter 1 arrival: 1m6s MemoryUsage(4s000ms): 42.60 MB, 73.87 MB, 73.87 MB, 73.87 MB, 73.87 MB, 73.87 MB, 73.87 MB, 73.87 MB, 73.90 MB, 73.90 MB, 73.90 MB, 73.90 MB, 73.90 MB, 73.90 MB, 73.90 MB, 73.90 MB, 77.90 MB, 81.90 MB, 75.95 MB, 67.93 MB, 50.42 MB, 59.20 MB, 69.29 MB, 61.68 MB, 41.01 MB, 60.67 MB, 68.93 MB, 52.59 MB, 72.55 MB, 70.29 MB, 55.77 MB, 56.00 MB, 78.65 MB, 71.68 MB, 52.59 MB, 66.08 MB, 83.43 MB, 71.59 MB, 54.70 MB, 50.70 MB, 72.34 MB, 61.06 MB, 42.76 MB, 75.56 MB, 67.82 MB, 45.28 MB, 72.38 MB, 69.34 MB, 54.90 MB, 48.22 MB, 75.74 MB, 60.90 MB, 41.26 MB, 71.11 MB, 70.40 MB, 49.34 MB ThreadUsage(4s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 1.99 - BloomFilterBytes: 8.00 MB (8388608) - PeakMemoryUsage: 86.88 MB (91104040) - PerHostPeakMemUsage: 1.02 GB (1099935664) - RowsProduced: 41.79M (41794519) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1m16s - TotalStorageWaitTime: 634.113ms - TotalThreadsInvoluntaryContextSwitches: 315.65K (315651) - TotalThreadsTotalWallClockTime: 7m30s - TotalThreadsSysTime: 3s665ms - TotalThreadsUserTime: 2m42s - TotalThreadsVoluntaryContextSwitches: 14.52K (14518) Fragment Instance Lifecycle Timings: - ExecTime: 3m45s - ExecTreeExecTime: 6s470ms - OpenTime: 145.420ms - ExecTreeOpenTime: 168.238us - PrepareTime: 515.286ms - ExecTreePrepareTime: 496.806us DataStreamSender (dst_id=7):(Total: 1m, non-child: 1m, % non-child: 100.00%) - BytesSent: 976.99 MB (1024443454) - NetworkThroughput(*): 129.36 MB/sec - OverallThroughput: 16.18 MB/sec - PeakMemoryUsage: 248.94 KB (254912) - RowsReturned: 41.79M (41794519) - SerializeBatchTime: 52s788ms - TransmitDataRPCTime: 7s552ms - UncompressedRowBatchSize: 2.14 GB (2299117553) CodeGen:(Total: 373.711ms, non-child: 373.711ms, % non-child: 100.00%) - CodegenTime: 2.795ms - CompileTime: 11.992ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2076168) - NumFunctions: 46 (46) - NumInstructions: 720 (720) - OptimizationTime: 106.855ms - PeakMemoryUsage: 360.00 KB (368640) - PrepareTime: 233.736ms HDFS_SCAN_NODE (id=2):(Total: 6s281ms, non-child: 6s281ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:1/253.29 MB 2:1/253.33 MB 10:2/506.60 MB 0:2/506.62 MB 7:2/506.59 MB 1:2/506.65 MB 11:1/253.31 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 11 out of 11 Runtime filters: Only following filters arrived: , waited 382ms Hdfs Read Thread Concurrency Bucket: 0:99.33% 1:0.6696% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:44 BytesRead(4s000ms): 35.20 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 57.93 MB, 59.56 MB, 96.78 MB, 119.11 MB, 119.11 MB, 119.11 MB, 161.35 MB, 176.65 MB, 178.68 MB, 223.34 MB, 238.23 MB, 238.23 MB, 260.57 MB, 297.79 MB, 297.79 MB, 297.79 MB, 335.01 MB, 357.35 MB, 357.35 MB, 357.35 MB, 383.50 MB, 413.65 MB, 416.50 MB, 424.35 MB, 476.45 MB, 476.45 MB, 476.45 MB, 521.13 MB, 536.03 MB, 536.03 MB, 552.19 MB, 595.58 MB, 595.58 MB, 601.62 MB, 651.89 MB, 654.33 MB, 655.14 MB - FooterProcessingTime: (Avg: 11.711ms ; Min: 251.650us ; Max: 65.865ms ; Number of samples: 11) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 655.14 MB (686961504) - BytesReadDataNodeCache: 0 - BytesReadLocal: 655.14 MB (686961504) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 655.14 MB (686961504) - DecompressionTime: 2s849ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 7 (7) - NumRowGroups: 11 (11) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 78.65 MB (82474894) - PerReadThreadRawHdfsThroughput: 665.27 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 3s791ms - RowBatchQueuePutWaitTime: 1m16s - RowsRead: 77.55M (77549499) - RowsReturned: 41.79M (41794519) - RowsReturnedRate: 6.65 M/sec - ScanRangesComplete: 11 (11) - ScannerThreadsInvoluntaryContextSwitches: 104.05K (104054) - ScannerThreadsTotalWallClockTime: 3m45s - MaterializeTupleTime(*): 2m22s - ScannerThreadsSysTime: 1s988ms - ScannerThreadsUserTime: 1m19s - ScannerThreadsVoluntaryContextSwitches: 9.82K (9820) - TotalRawHdfsReadTime(*): 984.773ms - TotalReadThroughput: 2.92 MB/sec Filter 1 (8.00 MB): - Rows processed: 318.49K (318490) - Rows rejected: 233 (233) - Rows total: 77.55M (77549499) Instance a6492cb57c2f2439:29baebe700000003 (host=redacted-host2:22000):(Total: 3m45s, non-child: 2m37s, % non-child: 69.73%) Hdfs split stats (:<# splits>/): 2:1/253.33 MB 11:1/253.32 MB 10:2/449.12 MB 5:5/1.13 GB 8:2/506.65 MB Filter 1 arrival: 1m6s MemoryUsage(4s000ms): 35.89 MB, 73.81 MB, 73.81 MB, 73.81 MB, 73.81 MB, 73.81 MB, 73.81 MB, 73.81 MB, 73.81 MB, 73.83 MB, 73.83 MB, 73.83 MB, 73.83 MB, 73.83 MB, 73.83 MB, 73.83 MB, 78.83 MB, 81.84 MB, 77.86 MB, 70.01 MB, 48.79 MB, 58.47 MB, 50.75 MB, 44.44 MB, 53.55 MB, 72.86 MB, 65.41 MB, 40.68 MB, 75.95 MB, 71.76 MB, 55.22 MB, 30.68 MB, 74.47 MB, 66.49 MB, 56.85 MB, 44.02 MB, 40.56 MB, 72.07 MB, 72.11 MB, 55.24 MB, 42.17 MB, 44.48 MB, 67.76 MB, 69.99 MB, 61.35 MB, 45.91 MB, 73.08 MB, 66.32 MB, 48.55 MB, 53.15 MB, 76.75 MB, 70.11 MB, 48.43 MB, 77.91 MB, 71.25 MB, 48.15 MB ThreadUsage(4s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 8.00 MB (8388608) - PeakMemoryUsage: 84.55 MB (88652548) - PerHostPeakMemUsage: 1.02 GB (1100062902) - RowsProduced: 39.23M (39233962) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1m16s - TotalStorageWaitTime: 1s327ms - TotalThreadsInvoluntaryContextSwitches: 306.86K (306857) - TotalThreadsTotalWallClockTime: 7m29s - TotalThreadsSysTime: 3s405ms - TotalThreadsUserTime: 2m31s - TotalThreadsVoluntaryContextSwitches: 14.00K (13999) Fragment Instance Lifecycle Timings: - ExecTime: 3m45s - ExecTreeExecTime: 10s365ms - OpenTime: 133.866ms - ExecTreeOpenTime: 97.287us - PrepareTime: 342.391ms - ExecTreePrepareTime: 257.286us DataStreamSender (dst_id=7):(Total: 57s697ms, non-child: 57s697ms, % non-child: 100.00%) - BytesSent: 918.31 MB (962912875) - NetworkThroughput(*): 131.95 MB/sec - OverallThroughput: 15.92 MB/sec - PeakMemoryUsage: 248.94 KB (254912) - RowsReturned: 39.23M (39233962) - SerializeBatchTime: 50s688ms - TransmitDataRPCTime: 6s959ms - UncompressedRowBatchSize: 2.01 GB (2158261242) CodeGen:(Total: 354.893ms, non-child: 354.893ms, % non-child: 100.00%) - CodegenTime: 2.667ms - CompileTime: 9.443ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2076168) - NumFunctions: 46 (46) - NumInstructions: 720 (720) - OptimizationTime: 118.410ms - PeakMemoryUsage: 360.00 KB (368640) - PrepareTime: 220.192ms HDFS_SCAN_NODE (id=2):(Total: 10s209ms, non-child: 10s209ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:1/253.33 MB 11:1/253.32 MB 10:2/449.12 MB 5:5/1.13 GB 8:2/506.65 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 11 out of 11 Runtime filters: Only following filters arrived: , waited 542ms Hdfs Read Thread Concurrency Bucket: 0:99.33% 1:0.6696% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:44 BytesRead(4s000ms): 29.44 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 57.92 MB, 59.55 MB, 99.88 MB, 105.64 MB, 105.64 MB, 134.01 MB, 165.19 MB, 165.19 MB, 165.19 MB, 224.75 MB, 224.75 MB, 224.75 MB, 224.75 MB, 284.31 MB, 284.31 MB, 284.31 MB, 284.31 MB, 291.75 MB, 343.87 MB, 343.87 MB, 343.87 MB, 360.39 MB, 376.91 MB, 414.13 MB, 436.46 MB, 436.46 MB, 441.50 MB, 496.00 MB, 496.00 MB, 496.00 MB, 523.37 MB, 555.56 MB, 555.56 MB, 555.56 MB, 615.11 MB, 615.11 MB, 615.11 MB - FooterProcessingTime: (Avg: 19.010ms ; Min: 2.855ms ; Max: 123.962ms ; Number of samples: 11) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 615.11 MB (644994467) - BytesReadDataNodeCache: 0 - BytesReadLocal: 615.11 MB (644994467) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 615.11 MB (644994467) - DecompressionTime: 2s613ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 5 (5) - NumRowGroups: 11 (11) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 76.28 MB (79988586) - PerReadThreadRawHdfsThroughput: 590.31 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 7s730ms - RowBatchQueuePutWaitTime: 1m17s - RowsRead: 72.79M (72793682) - RowsReturned: 39.23M (39233962) - RowsReturnedRate: 3.84 M/sec - ScanRangesComplete: 11 (11) - ScannerThreadsInvoluntaryContextSwitches: 106.58K (106584) - ScannerThreadsTotalWallClockTime: 3m44s - MaterializeTupleTime(*): 2m19s - ScannerThreadsSysTime: 1s811ms - ScannerThreadsUserTime: 1m14s - ScannerThreadsVoluntaryContextSwitches: 9.16K (9156) - TotalRawHdfsReadTime(*): 1s042ms - TotalReadThroughput: 2.74 MB/sec Filter 1 (8.00 MB): - Rows processed: 318.32K (318325) - Rows rejected: 288 (288) - Rows total: 72.79M (72793682) Averaged Fragment F01:(Total: 52s286ms, non-child: 36s818ms, % non-child: 70.42%) split sizes: min: 523.59 MB, max: 1001.63 MB, avg: 776.99 MB, stddev: 121.73 MB completion times: min:47s349ms max:1m6s mean: 52s462ms stddev:5s831ms execution rates: min:10.98 MB/sec max:20.35 MB/sec mean:14.95 MB/sec stddev:2.76 MB/sec num instances: 8 - AverageThreadTokens: 1.98 - BloomFilterBytes: 512.00 KB (524288) - PeakMemoryUsage: 80.67 MB (84589264) - PerHostPeakMemUsage: 706.65 MB (740978929) - RowsProduced: 8.87M (8870888) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 21s537ms - TotalStorageWaitTime: 451.796ms - TotalThreadsInvoluntaryContextSwitches: 43.97K (43970) - TotalThreadsTotalWallClockTime: 1m43s - TotalThreadsSysTime: 665.898ms - TotalThreadsUserTime: 33s271ms - TotalThreadsVoluntaryContextSwitches: 6.34K (6336) Fragment Instance Lifecycle Timings: - ExecTime: 51s725ms - ExecTreeExecTime: 3s652ms - OpenTime: 160.157ms - ExecTreeOpenTime: 160.071us - PrepareTime: 400.617ms - ExecTreePrepareTime: 285.718us DataStreamSender (dst_id=8):(Total: 11s498ms, non-child: 11s498ms, % non-child: 100.00%) - BytesSent: 207.81 MB (217907563) - NetworkThroughput(*): 129.12 MB/sec - OverallThroughput: 18.17 MB/sec - PeakMemoryUsage: 248.94 KB (254912) - RowsReturned: 8.87M (8870888) - SerializeBatchTime: 9s875ms - TransmitDataRPCTime: 1s612ms - UncompressedRowBatchSize: 465.38 MB (487987799) CodeGen:(Total: 343.506ms, non-child: 343.506ms, % non-child: 100.00%) - CodegenTime: 7.246ms - CompileTime: 22.022ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2076168) - NumFunctions: 46 (46) - NumInstructions: 720 (720) - OptimizationTime: 119.052ms - PeakMemoryUsage: 360.00 KB (368640) - PrepareTime: 186.878ms HDFS_SCAN_NODE (id=1):(Total: 3s626ms, non-child: 3s626ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 195.05 MB (204526229) - BytesReadDataNodeCache: 0 - BytesReadLocal: 195.05 MB (204526229) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 195.05 MB (204526229) - DecompressionTime: 752.565ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 3 (3) - NumRowGroups: 3 (3) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 80.41 MB (84317372) - PerReadThreadRawHdfsThroughput: 744.65 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 1s843ms - RowBatchQueuePutWaitTime: 20s377ms - RowsRead: 18.75M (18750000) - RowsReturned: 8.87M (8870888) - RowsReturnedRate: 2.98 M/sec - ScanRangesComplete: 3 (3) - ScannerThreadsInvoluntaryContextSwitches: 13.92K (13920) - ScannerThreadsTotalWallClockTime: 51s429ms - MaterializeTupleTime(*): 28s579ms - ScannerThreadsSysTime: 366.568ms - ScannerThreadsUserTime: 15s475ms - ScannerThreadsVoluntaryContextSwitches: 4.48K (4479) - TotalRawHdfsReadTime(*): 301.155ms - TotalReadThroughput: 3.82 MB/sec Filter 0 (1.00 MB): - Rows processed: 1.66M (1657121) - Rows rejected: 490.57K (490568) - Rows total: 18.75M (18750000) Fragment F01: Instance a6492cb57c2f2439:29baebe70000000e (host=redacted-host2:22000):(Total: 1m5s, non-child: 49s139ms, % non-child: 74.66%) Hdfs split stats (:<# splits>/): 4:1/253.03 MB 3:1/253.01 MB 6:1/253.01 MB Filter 0 arrival: 51s877ms MemoryUsage(2s000ms): 76.42 KB, 62.75 MB, 80.18 MB, 80.16 MB, 80.17 MB, 80.17 MB, 80.17 MB, 80.17 MB, 80.17 MB, 80.17 MB, 80.17 MB, 80.17 MB, 80.17 MB, 80.17 MB, 80.17 MB, 80.17 MB, 80.17 MB, 80.17 MB, 80.17 MB, 80.17 MB, 80.16 MB, 75.14 MB, 62.20 MB, 50.01 MB, 47.22 MB, 77.82 MB, 50.72 MB, 37.71 MB, 36.33 MB, 65.65 MB, 49.68 MB, 35.62 MB ThreadUsage(2s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 1.99 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 80.28 MB (84184178) - PerHostPeakMemUsage: 856.65 MB (898257857) - RowsProduced: 7.38M (7380513) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 39s626ms - TotalStorageWaitTime: 710.218ms - TotalThreadsInvoluntaryContextSwitches: 37.02K (37015) - TotalThreadsTotalWallClockTime: 2m10s - TotalThreadsSysTime: 581.911ms - TotalThreadsUserTime: 30s411ms - TotalThreadsVoluntaryContextSwitches: 5.17K (5175) Fragment Instance Lifecycle Timings: - ExecTime: 1m5s - ExecTreeExecTime: 7s420ms - OpenTime: 171.026ms - ExecTreeOpenTime: 144.450us - PrepareTime: 297.265ms - ExecTreePrepareTime: 169.806us DataStreamSender (dst_id=8):(Total: 8s905ms, non-child: 8s905ms, % non-child: 100.00%) - BytesSent: 174.92 MB (183411919) - NetworkThroughput(*): 134.13 MB/sec - OverallThroughput: 19.64 MB/sec - PeakMemoryUsage: 248.94 KB (254912) - RowsReturned: 7.38M (7380513) - SerializeBatchTime: 7s594ms - TransmitDataRPCTime: 1s304ms - UncompressedRowBatchSize: 387.19 MB (406002223) CodeGen:(Total: 376.225ms, non-child: 376.225ms, % non-child: 100.00%) - CodegenTime: 2.627ms - CompileTime: 28.192ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2076168) - NumFunctions: 46 (46) - NumInstructions: 720 (720) - OptimizationTime: 133.808ms - PeakMemoryUsage: 360.00 KB (368640) - PrepareTime: 190.424ms HDFS_SCAN_NODE (id=1):(Total: 7s399ms, non-child: 7s399ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:1/253.03 MB 3:1/253.01 MB 6:1/253.01 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 3 out of 3 Runtime filters: Only following filters arrived: , waited 545ms Hdfs Read Thread Concurrency Bucket: 0:99.23% 1:0.7692% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:12 BytesRead(2s000ms): 25.00 KB, 53.83 MB, 63.48 MB, 63.48 MB, 63.48 MB, 63.48 MB, 63.48 MB, 63.48 MB, 63.48 MB, 63.48 MB, 63.48 MB, 63.48 MB, 63.48 MB, 63.48 MB, 63.48 MB, 63.48 MB, 63.48 MB, 63.48 MB, 63.48 MB, 63.48 MB, 63.48 MB, 63.48 MB, 63.48 MB, 63.48 MB, 77.54 MB, 126.95 MB, 126.95 MB, 126.95 MB, 142.82 MB, 190.42 MB, 190.42 MB, 190.42 MB - FooterProcessingTime: (Avg: 65.782ms ; Min: 2.544ms ; Max: 191.607ms ; Number of samples: 3) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 190.42 MB (199671771) - BytesReadDataNodeCache: 0 - BytesReadLocal: 190.42 MB (199671771) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 190.42 MB (199671771) - DecompressionTime: 642.165ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 3 (3) - NumRowGroups: 3 (3) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 80.03 MB (83919070) - PerReadThreadRawHdfsThroughput: 997.86 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 5s756ms - RowBatchQueuePutWaitTime: 40s224ms - RowsRead: 18.32M (18324633) - RowsReturned: 7.38M (7380513) - RowsReturnedRate: 997.41 K/sec - ScanRangesComplete: 3 (3) - ScannerThreadsInvoluntaryContextSwitches: 16.15K (16148) - ScannerThreadsTotalWallClockTime: 1m5s - MaterializeTupleTime(*): 20s885ms - ScannerThreadsSysTime: 332.949ms - ScannerThreadsUserTime: 15s896ms - ScannerThreadsVoluntaryContextSwitches: 2.65K (2651) - TotalRawHdfsReadTime(*): 190.830ms - TotalReadThroughput: 2.91 MB/sec Filter 0 (1.00 MB): - Rows processed: 10.57M (10574249) - Rows rejected: 3.13M (3130379) - Rows total: 18.32M (18324633) Instance a6492cb57c2f2439:29baebe70000000a (host=redacted-host6:22000):(Total: 54s440ms, non-child: 35s974ms, % non-child: 66.08%) Hdfs split stats (:<# splits>/): 1:1/253.04 MB 6:1/253.00 MB 8:1/253.01 MB 10:2/67.63 MB Filter 0 arrival: 52s288ms MemoryUsage(1s000ms): 12.47 KB, 110.90 KB, 30.04 MB, 69.51 MB, 77.92 MB, 80.13 MB, 80.19 MB, 80.18 MB, 80.15 MB, 80.12 MB, 80.19 MB, 80.18 MB, 79.86 MB, 78.48 MB, 76.32 MB, 78.26 MB, 76.14 MB, 70.92 MB, 66.65 MB, 59.43 MB, 55.74 MB, 54.53 MB, 62.83 MB, 55.23 MB, 56.29 MB, 56.23 MB, 48.11 MB, 33.09 MB, 27.55 MB, 19.61 MB, 61.24 MB, 73.42 MB, 70.44 MB, 52.54 MB, 51.17 MB, 48.02 MB, 44.15 MB, 41.83 MB, 38.62 MB, 32.80 MB, 29.97 MB, 32.49 MB, 80.45 MB, 79.67 MB, 79.07 MB, 72.15 MB, 62.24 MB, 56.14 MB, 54.80 MB, 48.18 MB, 39.86 MB, 29.00 MB, 23.91 MB, 20.64 MB ThreadUsage(1s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 1.97 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 81.10 MB (85044526) - PerHostPeakMemUsage: 809.92 MB (849263872) - RowsProduced: 9.51M (9509897) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 16s502ms - TotalStorageWaitTime: 1s185ms - TotalThreadsInvoluntaryContextSwitches: 54.04K (54040) - TotalThreadsTotalWallClockTime: 1m47s - TotalThreadsSysTime: 750.885ms - TotalThreadsUserTime: 36s038ms - TotalThreadsVoluntaryContextSwitches: 6.54K (6539) Fragment Instance Lifecycle Timings: - ExecTime: 53s693ms - ExecTreeExecTime: 4s778ms - OpenTime: 155.132ms - ExecTreeOpenTime: 134.390us - PrepareTime: 591.807ms - ExecTreePrepareTime: 330.216us DataStreamSender (dst_id=8):(Total: 13s255ms, non-child: 13s255ms, % non-child: 100.00%) - BytesSent: 222.79 MB (233614441) - NetworkThroughput(*): 128.16 MB/sec - OverallThroughput: 16.81 MB/sec - PeakMemoryUsage: 248.94 KB (254912) - RowsReturned: 9.51M (9509897) - SerializeBatchTime: 11s503ms - TransmitDataRPCTime: 1s738ms - UncompressedRowBatchSize: 498.90 MB (523139687) CodeGen:(Total: 457.045ms, non-child: 457.045ms, % non-child: 100.00%) - CodegenTime: 4.323ms - CompileTime: 21.208ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2076168) - NumFunctions: 46 (46) - NumInstructions: 720 (720) - OptimizationTime: 108.391ms - PeakMemoryUsage: 360.00 KB (368640) - PrepareTime: 326.311ms HDFS_SCAN_NODE (id=1):(Total: 4s753ms, non-child: 4s753ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:1/253.04 MB 6:1/253.00 MB 8:1/253.01 MB 10:2/67.63 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 5 out of 5 Runtime filters: Only following filters arrived: , waited 303ms Hdfs Read Thread Concurrency Bucket: 0:99.06% 1:0.9434% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:20 BytesRead(1s000ms): 0, 4.48 MB, 52.17 MB, 63.47 MB, 63.47 MB, 63.47 MB, 63.47 MB, 63.47 MB, 63.47 MB, 63.47 MB, 63.47 MB, 63.47 MB, 63.47 MB, 63.47 MB, 63.47 MB, 63.47 MB, 63.47 MB, 63.47 MB, 63.47 MB, 63.47 MB, 63.47 MB, 63.47 MB, 63.47 MB, 63.47 MB, 63.47 MB, 63.47 MB, 63.47 MB, 63.47 MB, 63.47 MB, 87.90 MB, 126.95 MB, 126.95 MB, 126.95 MB, 126.95 MB, 126.95 MB, 126.95 MB, 126.95 MB, 126.95 MB, 126.95 MB, 126.95 MB, 129.49 MB, 176.20 MB, 195.50 MB, 195.50 MB, 195.50 MB, 195.50 MB, 195.50 MB, 195.50 MB, 195.50 MB, 195.50 MB, 195.50 MB, 195.50 MB, 207.69 MB - FooterProcessingTime: (Avg: 86.286ms ; Min: 2.191ms ; Max: 409.022ms ; Number of samples: 5) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 207.69 MB (217778642) - BytesReadDataNodeCache: 0 - BytesReadLocal: 207.69 MB (217778642) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 207.69 MB (217778642) - DecompressionTime: 953.950ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 4 (4) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 80.88 MB (84812186) - PerReadThreadRawHdfsThroughput: 458.97 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 3s445ms - RowBatchQueuePutWaitTime: 10s878ms - RowsRead: 19.94M (19943008) - RowsReturned: 9.51M (9509897) - RowsReturnedRate: 2.00 M/sec - ScanRangesComplete: 5 (5) - ScannerThreadsInvoluntaryContextSwitches: 16.35K (16354) - ScannerThreadsTotalWallClockTime: 53s558ms - MaterializeTupleTime(*): 39s278ms - ScannerThreadsSysTime: 447.931ms - ScannerThreadsUserTime: 16s639ms - ScannerThreadsVoluntaryContextSwitches: 4.95K (4947) - TotalRawHdfsReadTime(*): 452.511ms - TotalReadThroughput: 3.88 MB/sec Filter 0 (1.00 MB): - Rows processed: 1.23M (1231483) - Rows rejected: 364.24K (364241) - Rows total: 19.94M (19943008) Instance a6492cb57c2f2439:29baebe70000000b (host=redacted-host8:22000):(Total: 53s426ms, non-child: 35s869ms, % non-child: 67.14%) Hdfs split stats (:<# splits>/): 8:1/253.04 MB 6:1/2.08 MB 1:1/252.98 MB 2:1/253.02 MB Filter 0 arrival: 51s948ms MemoryUsage(1s000ms): 21.45 KB, 4.07 MB, 53.58 MB, 78.55 MB, 80.24 MB, 80.18 MB, 80.18 MB, 80.15 MB, 80.16 MB, 80.19 MB, 80.19 MB, 80.14 MB, 80.03 MB, 79.89 MB, 77.80 MB, 75.10 MB, 74.14 MB, 74.40 MB, 62.56 MB, 58.67 MB, 54.65 MB, 50.58 MB, 51.29 MB, 54.03 MB, 56.13 MB, 55.75 MB, 47.30 MB, 39.24 MB, 35.46 MB, 27.20 MB, 70.01 MB, 70.09 MB, 69.53 MB, 61.83 MB, 53.06 MB, 49.15 MB, 43.49 MB, 43.79 MB, 40.24 MB, 32.12 MB, 25.80 MB, 24.01 MB, 67.60 MB, 67.66 MB, 68.06 MB, 60.40 MB, 56.24 MB, 55.65 MB, 46.00 MB, 46.10 MB, 40.97 MB, 39.93 MB, 26.23 MB ThreadUsage(1s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 1.98 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 80.24 MB (84134002) - PerHostPeakMemUsage: 817.84 MB (857571206) - RowsProduced: 8.82M (8819555) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 16s400ms - TotalStorageWaitTime: 711.123ms - TotalThreadsInvoluntaryContextSwitches: 49.53K (49530) - TotalThreadsTotalWallClockTime: 1m45s - TotalThreadsSysTime: 669.897ms - TotalThreadsUserTime: 33s204ms - TotalThreadsVoluntaryContextSwitches: 6.63K (6632) Fragment Instance Lifecycle Timings: - ExecTime: 52s917ms - ExecTreeExecTime: 4s632ms - OpenTime: 136.339ms - ExecTreeOpenTime: 157.319us - PrepareTime: 372.276ms - ExecTreePrepareTime: 299.309us DataStreamSender (dst_id=8):(Total: 12s624ms, non-child: 12s624ms, % non-child: 100.00%) - BytesSent: 205.23 MB (215196242) - NetworkThroughput(*): 125.86 MB/sec - OverallThroughput: 16.26 MB/sec - PeakMemoryUsage: 248.94 KB (254912) - RowsReturned: 8.82M (8819555) - SerializeBatchTime: 10s980ms - TransmitDataRPCTime: 1s630ms - UncompressedRowBatchSize: 462.69 MB (485163957) CodeGen:(Total: 330.027ms, non-child: 330.027ms, % non-child: 100.00%) - CodegenTime: 13.541ms - CompileTime: 11.431ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2076168) - NumFunctions: 46 (46) - NumInstructions: 720 (720) - OptimizationTime: 112.607ms - PeakMemoryUsage: 360.00 KB (368640) - PrepareTime: 191.424ms HDFS_SCAN_NODE (id=1):(Total: 4s602ms, non-child: 4s602ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 8:1/253.04 MB 6:1/2.08 MB 1:1/252.98 MB 2:1/253.02 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 4 out of 4 Runtime filters: Only following filters arrived: , waited 524ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:16 BytesRead(1s000ms): 0, 20.48 MB, 63.48 MB, 63.48 MB, 63.48 MB, 63.48 MB, 63.48 MB, 63.48 MB, 63.48 MB, 63.48 MB, 63.48 MB, 63.48 MB, 63.48 MB, 63.48 MB, 63.48 MB, 63.48 MB, 63.48 MB, 63.48 MB, 63.48 MB, 63.48 MB, 63.48 MB, 63.48 MB, 63.48 MB, 63.48 MB, 63.48 MB, 63.48 MB, 63.48 MB, 63.48 MB, 63.48 MB, 95.21 MB, 126.93 MB, 126.93 MB, 126.93 MB, 126.93 MB, 126.93 MB, 126.93 MB, 126.93 MB, 126.93 MB, 126.93 MB, 126.93 MB, 126.93 MB, 159.02 MB, 191.10 MB, 191.10 MB, 191.10 MB, 191.10 MB, 191.10 MB, 191.10 MB, 191.10 MB, 191.10 MB, 191.10 MB, 191.10 MB - FooterProcessingTime: (Avg: 58.947ms ; Min: 5.455ms ; Max: 211.707ms ; Number of samples: 4) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.99 - BytesRead: 191.10 MB (200385214) - BytesReadDataNodeCache: 0 - BytesReadLocal: 191.10 MB (200385214) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 191.10 MB (200385214) - DecompressionTime: 855.554ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 4 (4) - NumRowGroups: 4 (4) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 79.91 MB (83793118) - PerReadThreadRawHdfsThroughput: 863.37 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 3s614ms - RowBatchQueuePutWaitTime: 9s686ms - RowsRead: 18.37M (18365130) - RowsReturned: 8.82M (8819555) - RowsReturnedRate: 1.92 M/sec - ScanRangesComplete: 4 (4) - ScannerThreadsInvoluntaryContextSwitches: 14.00K (13999) - ScannerThreadsTotalWallClockTime: 52s791ms - MaterializeTupleTime(*): 40s175ms - ScannerThreadsSysTime: 356.945ms - ScannerThreadsUserTime: 15s245ms - ScannerThreadsVoluntaryContextSwitches: 4.82K (4819) - TotalRawHdfsReadTime(*): 221.343ms - TotalReadThroughput: 3.64 MB/sec Filter 0 (1.00 MB): - Rows processed: 707.30K (707301) - Rows rejected: 209.48K (209477) - Rows total: 18.37M (18365130) Instance a6492cb57c2f2439:29baebe70000000f (host=redacted-host7:22000):(Total: 53s275ms, non-child: 37s058ms, % non-child: 69.56%) Hdfs split stats (:<# splits>/): 5:1/253.00 MB 7:1/252.99 MB 11:1/36.53 MB 0:1/253.00 MB Filter 0 arrival: 51s878ms MemoryUsage(1s000ms): 33.92 KB, 60.55 MB, 75.85 MB, 80.18 MB, 80.19 MB, 80.17 MB, 80.21 MB, 80.15 MB, 80.17 MB, 80.15 MB, 80.17 MB, 80.15 MB, 80.17 MB, 79.49 MB, 79.60 MB, 75.40 MB, 69.13 MB, 66.52 MB, 59.79 MB, 59.46 MB, 62.75 MB, 60.16 MB, 56.30 MB, 56.09 MB, 51.51 MB, 43.13 MB, 37.76 MB, 31.93 MB, 26.85 MB, 28.84 MB, 48.38 MB, 69.65 MB, 69.13 MB, 63.71 MB, 58.15 MB, 60.19 MB, 53.73 MB, 49.60 MB, 43.40 MB, 40.33 MB, 36.03 MB, 52.10 MB, 78.76 MB, 78.19 MB, 68.69 MB, 53.63 MB, 53.79 MB, 48.64 MB, 48.15 MB, 40.32 MB, 36.36 MB ThreadUsage(1s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 1.99 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 80.28 MB (84175986) - PerHostPeakMemUsage: 822.49 MB (862446591) - RowsProduced: 9.22M (9220772) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 16s325ms - TotalStorageWaitTime: 290.606ms - TotalThreadsInvoluntaryContextSwitches: 53.35K (53352) - TotalThreadsTotalWallClockTime: 1m45s - TotalThreadsSysTime: 945.855ms - TotalThreadsUserTime: 35s113ms - TotalThreadsVoluntaryContextSwitches: 6.41K (6414) Fragment Instance Lifecycle Timings: - ExecTime: 52s614ms - ExecTreeExecTime: 2s892ms - OpenTime: 168.040ms - ExecTreeOpenTime: 149.071us - PrepareTime: 493.260ms - ExecTreePrepareTime: 321.010us DataStreamSender (dst_id=8):(Total: 13s035ms, non-child: 13s035ms, % non-child: 100.00%) - BytesSent: 215.54 MB (226008351) - NetworkThroughput(*): 123.98 MB/sec - OverallThroughput: 16.54 MB/sec - PeakMemoryUsage: 248.94 KB (254912) - RowsReturned: 9.22M (9220772) - SerializeBatchTime: 11s287ms - TransmitDataRPCTime: 1s738ms - UncompressedRowBatchSize: 483.74 MB (507234912) CodeGen:(Total: 322.362ms, non-child: 322.362ms, % non-child: 100.00%) - CodegenTime: 5.255ms - CompileTime: 19.001ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2076168) - NumFunctions: 46 (46) - NumInstructions: 720 (720) - OptimizationTime: 132.723ms - PeakMemoryUsage: 360.00 KB (368640) - PrepareTime: 151.142ms HDFS_SCAN_NODE (id=1):(Total: 2s859ms, non-child: 2s859ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:1/253.00 MB 7:1/252.99 MB 11:1/36.53 MB 0:1/253.00 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 4 out of 4 Runtime filters: Only following filters arrived: , waited 448ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:16 BytesRead(1s000ms): 0, 56.16 MB, 63.46 MB, 63.46 MB, 63.46 MB, 63.46 MB, 63.46 MB, 63.46 MB, 63.46 MB, 63.46 MB, 63.46 MB, 63.46 MB, 63.46 MB, 63.46 MB, 63.46 MB, 63.46 MB, 63.46 MB, 63.46 MB, 63.46 MB, 63.46 MB, 63.46 MB, 63.46 MB, 63.46 MB, 63.46 MB, 63.46 MB, 63.46 MB, 63.46 MB, 63.46 MB, 68.12 MB, 72.77 MB, 104.50 MB, 136.24 MB, 136.24 MB, 136.24 MB, 136.24 MB, 136.24 MB, 136.24 MB, 136.24 MB, 136.24 MB, 136.24 MB, 136.24 MB, 167.97 MB, 199.71 MB, 199.71 MB, 199.71 MB, 199.71 MB, 199.71 MB, 199.71 MB, 199.71 MB, 199.71 MB, 199.71 MB - FooterProcessingTime: (Avg: 9.123ms ; Min: 3.164ms ; Max: 20.376ms ; Number of samples: 4) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 199.71 MB (209406920) - BytesReadDataNodeCache: 0 - BytesReadLocal: 199.71 MB (209406920) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 199.71 MB (209406920) - DecompressionTime: 914.050ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 4 (4) - NumRowGroups: 4 (4) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 79.99 MB (83877086) - PerReadThreadRawHdfsThroughput: 414.83 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 921.020ms - RowBatchQueuePutWaitTime: 11s971ms - RowsRead: 19.20M (19196895) - RowsReturned: 9.22M (9220772) - RowsReturnedRate: 3.22 M/sec - ScanRangesComplete: 4 (4) - ScannerThreadsInvoluntaryContextSwitches: 15.11K (15111) - ScannerThreadsTotalWallClockTime: 52s340ms - MaterializeTupleTime(*): 38s129ms - ScannerThreadsSysTime: 579.911ms - ScannerThreadsUserTime: 16s078ms - ScannerThreadsVoluntaryContextSwitches: 4.68K (4679) - TotalRawHdfsReadTime(*): 481.414ms - TotalReadThroughput: 3.88 MB/sec Filter 0 (1.00 MB): - Rows processed: 743.94K (743937) - Rows rejected: 220.45K (220454) - Rows total: 19.20M (19196895) Instance a6492cb57c2f2439:29baebe70000000c (host=redacted-host3:22000):(Total: 49s184ms, non-child: 33s393ms, % non-child: 67.89%) Hdfs split stats (:<# splits>/): 6:1/252.99 MB 7:1/239.19 MB 5:1/253.01 MB 1:1/253.01 MB 2:1/3.44 MB MemoryUsage(1s000ms): 42.89 KB, 72.43 MB, 79.61 MB, 79.71 MB, 79.71 MB, 79.71 MB, 79.71 MB, 79.71 MB, 79.71 MB, 79.71 MB, 79.71 MB, 79.66 MB, 79.58 MB, 79.67 MB, 79.18 MB, 79.62 MB, 79.25 MB, 75.70 MB, 71.68 MB, 63.79 MB, 63.57 MB, 59.72 MB, 55.74 MB, 51.78 MB, 47.81 MB, 39.71 MB, 56.21 MB, 79.68 MB, 76.09 MB, 64.24 MB, 54.87 MB, 50.99 MB, 40.17 MB, 55.85 MB, 79.98 MB, 76.11 MB, 64.22 MB, 55.96 MB, 52.28 MB, 40.30 MB, 55.33 MB, 80.11 MB, 74.38 MB, 67.67 MB, 58.91 MB, 52.01 MB, 40.30 MB, 36.12 MB ThreadUsage(1s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 81.07 MB (85010734) - PerHostPeakMemUsage: 581.53 MB (609782368) - RowsProduced: 11.74M (11744465) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 18s922ms - TotalStorageWaitTime: 142.750ms - TotalThreadsInvoluntaryContextSwitches: 40.04K (40040) - TotalThreadsTotalWallClockTime: 1m37s - TotalThreadsSysTime: 706.892ms - TotalThreadsUserTime: 42s201ms - TotalThreadsVoluntaryContextSwitches: 8.15K (8150) Fragment Instance Lifecycle Timings: - ExecTime: 48s954ms - ExecTreeExecTime: 2s100ms - OpenTime: 92.527ms - ExecTreeOpenTime: 196.649us - PrepareTime: 137.234ms - ExecTreePrepareTime: 338.483us DataStreamSender (dst_id=8):(Total: 13s559ms, non-child: 13s559ms, % non-child: 100.00%) - BytesSent: 274.32 MB (287644259) - NetworkThroughput(*): 131.03 MB/sec - OverallThroughput: 20.23 MB/sec - PeakMemoryUsage: 248.94 KB (254912) - RowsReturned: 11.74M (11744465) - SerializeBatchTime: 11s453ms - TransmitDataRPCTime: 2s093ms - UncompressedRowBatchSize: 616.13 MB (646063331) CodeGen:(Total: 164.018ms, non-child: 164.018ms, % non-child: 100.00%) - CodegenTime: 6.080ms - CompileTime: 10.395ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2076168) - NumFunctions: 46 (46) - NumInstructions: 720 (720) - OptimizationTime: 77.897ms - PeakMemoryUsage: 360.00 KB (368640) - PrepareTime: 74.803ms HDFS_SCAN_NODE (id=1):(Total: 2s068ms, non-child: 2s068ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 6:1/252.99 MB 7:1/239.19 MB 5:1/253.01 MB 1:1/253.01 MB 2:1/3.44 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 5 out of 5 Runtime filters: Only following filters arrived: , waited 803ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:20 BytesRead(1s000ms): 0, 60.00 MB, 60.00 MB, 60.00 MB, 60.00 MB, 60.00 MB, 60.00 MB, 60.00 MB, 60.00 MB, 60.00 MB, 60.00 MB, 60.00 MB, 60.00 MB, 60.00 MB, 60.00 MB, 60.00 MB, 60.00 MB, 60.00 MB, 60.00 MB, 60.00 MB, 60.00 MB, 60.00 MB, 60.00 MB, 60.00 MB, 60.00 MB, 60.00 MB, 91.73 MB, 123.47 MB, 123.47 MB, 123.47 MB, 123.47 MB, 123.47 MB, 123.47 MB, 155.20 MB, 186.93 MB, 186.93 MB, 186.93 MB, 186.93 MB, 186.93 MB, 186.93 MB, 218.67 MB, 250.40 MB, 250.40 MB, 250.40 MB, 250.40 MB, 250.40 MB, 250.40 MB, 250.40 MB - FooterProcessingTime: (Avg: 3.031ms ; Min: 2.386ms ; Max: 4.109ms ; Number of samples: 5) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 251.44 MB (263653344) - BytesReadDataNodeCache: 0 - BytesReadLocal: 251.44 MB (263653344) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 251.44 MB (263653344) - DecompressionTime: 770.265ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 5 (5) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 80.84 MB (84770202) - PerReadThreadRawHdfsThroughput: 1.12 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 118.781ms - RowBatchQueuePutWaitTime: 21s557ms - RowsRead: 24.17M (24170250) - RowsReturned: 11.74M (11744465) - RowsReturnedRate: 5.68 M/sec - ScanRangesComplete: 5 (5) - ScannerThreadsInvoluntaryContextSwitches: 15.55K (15552) - ScannerThreadsTotalWallClockTime: 48s578ms - MaterializeTupleTime(*): 24s841ms - ScannerThreadsSysTime: 345.947ms - ScannerThreadsUserTime: 19s325ms - ScannerThreadsVoluntaryContextSwitches: 6.02K (6016) - TotalRawHdfsReadTime(*): 219.070ms - TotalReadThroughput: 5.18 MB/sec Filter 0 (1.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 24.17M (24170250) Instance a6492cb57c2f2439:29baebe70000000d (host=redacted-host4:22000):(Total: 47s525ms, non-child: 32s994ms, % non-child: 69.43%) Hdfs split stats (:<# splits>/): 5:1/253.03 MB 4:1/253.02 MB 3:1/30.26 MB 0:1/253.01 MB MemoryUsage(1s000ms): 33.92 KB, 68.55 MB, 79.02 MB, 80.10 MB, 80.14 MB, 80.12 MB, 80.15 MB, 80.21 MB, 80.17 MB, 80.06 MB, 80.20 MB, 80.19 MB, 80.11 MB, 80.17 MB, 79.70 MB, 79.94 MB, 79.47 MB, 72.18 MB, 68.15 MB, 64.16 MB, 64.19 MB, 60.17 MB, 55.80 MB, 56.22 MB, 52.25 MB, 44.29 MB, 34.12 MB, 56.71 MB, 79.16 MB, 76.12 MB, 68.07 MB, 62.39 MB, 53.96 MB, 51.95 MB, 42.88 MB, 31.86 MB, 50.20 MB, 74.97 MB, 71.33 MB, 63.47 MB, 63.24 MB, 56.25 MB, 52.29 MB, 42.74 MB, 33.35 MB, 28.16 MB, 19.36 MB ThreadUsage(1s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1 - AverageThreadTokens: 1.98 - BloomFilterBytes: 0 - PeakMemoryUsage: 81.07 MB (85010734) - PerHostPeakMemUsage: 576.57 MB (604580816) - RowsProduced: 9.25M (9253653) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 17s751ms - TotalStorageWaitTime: 147.679ms - TotalThreadsInvoluntaryContextSwitches: 46.49K (46486) - TotalThreadsTotalWallClockTime: 1m33s - TotalThreadsSysTime: 611.907ms - TotalThreadsUserTime: 33s739ms - TotalThreadsVoluntaryContextSwitches: 6.34K (6339) Fragment Instance Lifecycle Timings: - ExecTime: 46s960ms - ExecTreeExecTime: 2s590ms - OpenTime: 152.575ms - ExecTreeOpenTime: 173.810us - PrepareTime: 412.344ms - ExecTreePrepareTime: 199.276us DataStreamSender (dst_id=8):(Total: 11s663ms, non-child: 11s663ms, % non-child: 100.00%) - BytesSent: 217.34 MB (227900366) - NetworkThroughput(*): 131.44 MB/sec - OverallThroughput: 18.63 MB/sec - PeakMemoryUsage: 248.94 KB (254912) - RowsReturned: 9.25M (9253653) - SerializeBatchTime: 9s999ms - TransmitDataRPCTime: 1s653ms - UncompressedRowBatchSize: 485.46 MB (509043695) CodeGen:(Total: 306.259ms, non-child: 306.259ms, % non-child: 100.00%) - CodegenTime: 2.903ms - CompileTime: 12.950ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2076168) - NumFunctions: 46 (46) - NumInstructions: 720 (720) - OptimizationTime: 137.026ms - PeakMemoryUsage: 360.00 KB (368640) - PrepareTime: 136.537ms HDFS_SCAN_NODE (id=1):(Total: 2s561ms, non-child: 2s561ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:1/253.03 MB 4:1/253.02 MB 3:1/30.26 MB 0:1/253.01 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 4 out of 4 Runtime filters: Only following filters arrived: , waited 482ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:16 BytesRead(1s000ms): 0, 59.86 MB, 63.47 MB, 63.47 MB, 63.47 MB, 63.47 MB, 63.47 MB, 63.47 MB, 63.47 MB, 63.47 MB, 63.47 MB, 63.47 MB, 63.47 MB, 63.47 MB, 63.47 MB, 63.47 MB, 63.47 MB, 63.47 MB, 63.47 MB, 63.47 MB, 63.47 MB, 63.47 MB, 63.47 MB, 63.47 MB, 63.47 MB, 63.47 MB, 63.47 MB, 95.20 MB, 126.94 MB, 126.94 MB, 126.94 MB, 126.94 MB, 126.94 MB, 126.94 MB, 126.94 MB, 126.94 MB, 158.67 MB, 190.40 MB, 190.40 MB, 190.40 MB, 190.40 MB, 190.40 MB, 190.40 MB, 190.40 MB, 190.40 MB, 194.28 MB, 198.15 MB - FooterProcessingTime: (Avg: 3.691ms ; Min: 2.412ms ; Max: 5.917ms ; Number of samples: 4) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.99 - BytesRead: 198.15 MB (207774701) - BytesReadDataNodeCache: 0 - BytesReadLocal: 198.15 MB (207774701) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 198.15 MB (207774701) - DecompressionTime: 773.521ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 4 (4) - NumRowGroups: 4 (4) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 80.84 MB (84770202) - PerReadThreadRawHdfsThroughput: 1.04 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 194.740ms - RowBatchQueuePutWaitTime: 19s444ms - RowsRead: 19.05M (19046157) - RowsReturned: 9.25M (9253653) - RowsReturnedRate: 3.61 M/sec - ScanRangesComplete: 4 (4) - ScannerThreadsInvoluntaryContextSwitches: 13.47K (13466) - ScannerThreadsTotalWallClockTime: 46s377ms - MaterializeTupleTime(*): 25s133ms - ScannerThreadsSysTime: 308.953ms - ScannerThreadsUserTime: 15s370ms - ScannerThreadsVoluntaryContextSwitches: 4.50K (4500) - TotalRawHdfsReadTime(*): 185.337ms - TotalReadThroughput: 4.22 MB/sec Filter 0 (1.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 19.05M (19046157) Instance a6492cb57c2f2439:29baebe700000009 (host=redacted-host5:22000):(Total: 47s375ms, non-child: 37s495ms, % non-child: 79.14%) Hdfs split stats (:<# splits>/): 11:1/17.59 MB 0:1/253.01 MB 6:1/253.00 MB MemoryUsage(1s000ms): 21.45 KB, 33.46 MB, 73.93 MB, 79.73 MB, 80.13 MB, 80.13 MB, 80.13 MB, 80.13 MB, 80.13 MB, 80.13 MB, 80.13 MB, 80.13 MB, 80.13 MB, 80.13 MB, 80.13 MB, 80.13 MB, 80.13 MB, 80.13 MB, 80.13 MB, 80.13 MB, 80.13 MB, 80.13 MB, 80.13 MB, 80.13 MB, 80.13 MB, 80.13 MB, 80.13 MB, 80.13 MB, 80.13 MB, 79.97 MB, 80.10 MB, 71.78 MB, 62.61 MB, 54.85 MB, 48.08 MB, 39.90 MB, 32.24 MB, 80.16 MB, 79.56 MB, 72.22 MB, 62.55 MB, 56.77 MB, 49.64 MB, 48.12 MB, 40.27 MB, 36.11 MB, 26.40 MB ThreadUsage(1s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 1.98 - BloomFilterBytes: 0 - PeakMemoryUsage: 81.06 MB (84994350) - PerHostPeakMemUsage: 577.24 MB (605279868) - RowsProduced: 6.14M (6137753) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 28s339ms - TotalStorageWaitTime: 228.575ms - TotalThreadsInvoluntaryContextSwitches: 29.29K (29287) - TotalThreadsTotalWallClockTime: 1m33s - TotalThreadsSysTime: 427.934ms - TotalThreadsUserTime: 22s211ms - TotalThreadsVoluntaryContextSwitches: 3.51K (3514) Fragment Instance Lifecycle Timings: - ExecTime: 46s697ms - ExecTreeExecTime: 1s858ms - OpenTime: 146.281ms - ExecTreeOpenTime: 149.390us - PrepareTime: 531.541ms - ExecTreePrepareTime: 263.571us DataStreamSender (dst_id=8):(Total: 7s649ms, non-child: 7s649ms, % non-child: 100.00%) - BytesSent: 144.23 MB (151240785) - NetworkThroughput(*): 132.16 MB/sec - OverallThroughput: 18.86 MB/sec - PeakMemoryUsage: 248.94 KB (254912) - RowsReturned: 6.14M (6137753) - SerializeBatchTime: 6s552ms - TransmitDataRPCTime: 1s091ms - UncompressedRowBatchSize: 322.00 MB (337637963) CodeGen:(Total: 390.446ms, non-child: 390.446ms, % non-child: 100.00%) - CodegenTime: 6.705ms - CompileTime: 40.857ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2076168) - NumFunctions: 46 (46) - NumInstructions: 720 (720) - OptimizationTime: 102.523ms - PeakMemoryUsage: 360.00 KB (368640) - PrepareTime: 203.476ms HDFS_SCAN_NODE (id=1):(Total: 1s840ms, non-child: 1s840ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 11:1/17.59 MB 0:1/253.01 MB 6:1/253.00 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 3 out of 3 Runtime filters: Only following filters arrived: , waited 391ms Hdfs Read Thread Concurrency Bucket: 0:97.85% 1:2.151% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:12 BytesRead(1s000ms): 0, 24.48 MB, 63.46 MB, 63.46 MB, 63.46 MB, 63.46 MB, 63.46 MB, 63.46 MB, 63.46 MB, 63.46 MB, 63.46 MB, 63.46 MB, 63.46 MB, 63.46 MB, 63.46 MB, 63.46 MB, 63.46 MB, 63.46 MB, 63.46 MB, 63.46 MB, 63.46 MB, 63.46 MB, 63.46 MB, 63.46 MB, 63.46 MB, 63.46 MB, 63.46 MB, 63.46 MB, 63.46 MB, 63.46 MB, 63.46 MB, 63.46 MB, 63.46 MB, 63.46 MB, 63.46 MB, 63.46 MB, 63.46 MB, 126.93 MB, 126.93 MB, 126.93 MB, 126.93 MB, 126.93 MB, 126.93 MB, 126.93 MB, 126.93 MB, 126.93 MB, 129.22 MB - FooterProcessingTime: (Avg: 17.615ms ; Min: 3.275ms ; Max: 45.367ms ; Number of samples: 3) - AverageHdfsReadThreadConcurrency: 0.02 - AverageScannerThreadConcurrency: 0.99 - BytesRead: 131.51 MB (137896530) - BytesReadDataNodeCache: 0 - BytesReadLocal: 131.51 MB (137896530) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 131.51 MB (137896530) - DecompressionTime: 445.769ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 3 (3) - NumRowGroups: 3 (3) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 80.76 MB (84678042) - PerReadThreadRawHdfsThroughput: 552.92 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 472.891ms - RowBatchQueuePutWaitTime: 29s506ms - RowsRead: 12.63M (12631978) - RowsReturned: 6.14M (6137753) - RowsReturnedRate: 3.33 M/sec - ScanRangesComplete: 3 (3) - ScannerThreadsInvoluntaryContextSwitches: 9.13K (9131) - ScannerThreadsTotalWallClockTime: 46s272ms - MaterializeTupleTime(*): 15s353ms - ScannerThreadsSysTime: 225.965ms - ScannerThreadsUserTime: 10s096ms - ScannerThreadsVoluntaryContextSwitches: 2.56K (2558) - TotalRawHdfsReadTime(*): 237.844ms - TotalReadThroughput: 2.80 MB/sec Filter 0 (1.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 12.63M (12631978) Instance a6492cb57c2f2439:29baebe700000010 (host=redacted-host1:22000):(Total: 47s240ms, non-child: 32s619ms, % non-child: 69.05%) Hdfs split stats (:<# splits>/): 6:1/252.99 MB 9:1/253.01 MB 11:1/252.99 MB MemoryUsage(1s000ms): 16.47 KB, 34.79 MB, 74.01 MB, 78.58 MB, 80.12 MB, 80.12 MB, 80.17 MB, 80.21 MB, 80.20 MB, 80.13 MB, 80.18 MB, 80.11 MB, 79.95 MB, 79.99 MB, 80.13 MB, 79.15 MB, 79.32 MB, 76.18 MB, 72.15 MB, 63.89 MB, 64.24 MB, 60.29 MB, 56.18 MB, 52.24 MB, 48.27 MB, 43.13 MB, 34.68 MB, 45.61 MB, 79.17 MB, 74.53 MB, 63.45 MB, 63.64 MB, 54.98 MB, 49.85 MB, 38.99 MB, 36.37 MB, 31.53 MB, 78.73 MB, 79.58 MB, 71.26 MB, 63.74 MB, 64.16 MB, 56.20 MB, 56.14 MB, 44.25 MB, 39.41 MB, 30.49 MB ThreadUsage(1s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 1.98 - BloomFilterBytes: 0 - PeakMemoryUsage: 80.26 MB (84159602) - PerHostPeakMemUsage: 610.97 MB (640648855) - RowsProduced: 8.90M (8900498) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 18s431ms - TotalStorageWaitTime: 198.152ms - TotalThreadsInvoluntaryContextSwitches: 42.02K (42016) - TotalThreadsTotalWallClockTime: 1m33s - TotalThreadsSysTime: 631.904ms - TotalThreadsUserTime: 33s247ms - TotalThreadsVoluntaryContextSwitches: 7.93K (7928) Fragment Instance Lifecycle Timings: - ExecTime: 46s611ms - ExecTreeExecTime: 2s947ms - OpenTime: 259.332ms - ExecTreeOpenTime: 175.494us - PrepareTime: 369.207ms - ExecTreePrepareTime: 364.077us DataStreamSender (dst_id=8):(Total: 11s294ms, non-child: 11s294ms, % non-child: 100.00%) - BytesSent: 208.13 MB (218244144) - NetworkThroughput(*): 126.19 MB/sec - OverallThroughput: 18.43 MB/sec - PeakMemoryUsage: 248.94 KB (254912) - RowsReturned: 8.90M (8900498) - SerializeBatchTime: 9s636ms - TransmitDataRPCTime: 1s649ms - UncompressedRowBatchSize: 466.93 MB (489616630) CodeGen:(Total: 401.667ms, non-child: 401.667ms, % non-child: 100.00%) - CodegenTime: 16.537ms - CompileTime: 32.139ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2076168) - NumFunctions: 46 (46) - NumInstructions: 720 (720) - OptimizationTime: 147.444ms - PeakMemoryUsage: 360.00 KB (368640) - PrepareTime: 220.907ms HDFS_SCAN_NODE (id=1):(Total: 2s924ms, non-child: 2s924ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 6:1/252.99 MB 9:1/253.01 MB 11:1/252.99 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 3 out of 3 Runtime filters: Only following filters arrived: , waited 425ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:12 BytesRead(1s000ms): 0, 31.73 MB, 63.47 MB, 63.47 MB, 63.47 MB, 63.47 MB, 63.47 MB, 63.47 MB, 63.47 MB, 63.47 MB, 63.47 MB, 63.47 MB, 63.47 MB, 63.47 MB, 63.47 MB, 63.47 MB, 63.47 MB, 63.47 MB, 63.47 MB, 63.47 MB, 63.47 MB, 63.47 MB, 63.47 MB, 63.47 MB, 63.47 MB, 63.47 MB, 63.47 MB, 95.20 MB, 126.93 MB, 126.93 MB, 126.93 MB, 126.93 MB, 126.93 MB, 126.93 MB, 126.93 MB, 126.93 MB, 126.93 MB, 190.39 MB, 190.39 MB, 190.39 MB, 190.39 MB, 190.39 MB, 190.39 MB, 190.39 MB, 190.39 MB, 190.39 MB, 190.39 MB - FooterProcessingTime: (Avg: 34.212ms ; Min: 2.863ms ; Max: 94.545ms ; Number of samples: 3) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 190.39 MB (199642712) - BytesReadDataNodeCache: 0 - BytesReadLocal: 190.39 MB (199642712) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 190.39 MB (199642712) - DecompressionTime: 665.247ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 3 (3) - NumRowGroups: 3 (3) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 80.03 MB (83919070) - PerReadThreadRawHdfsThroughput: 452.36 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 226.786ms - RowBatchQueuePutWaitTime: 19s751ms - RowsRead: 18.32M (18321949) - RowsReturned: 8.90M (8900498) - RowsReturnedRate: 3.04 M/sec - ScanRangesComplete: 3 (3) - ScannerThreadsInvoluntaryContextSwitches: 11.60K (11599) - ScannerThreadsTotalWallClockTime: 46s317ms - MaterializeTupleTime(*): 24s842ms - ScannerThreadsSysTime: 333.949ms - ScannerThreadsUserTime: 15s154ms - ScannerThreadsVoluntaryContextSwitches: 5.67K (5669) - TotalRawHdfsReadTime(*): 420.892ms - TotalReadThroughput: 4.05 MB/sec Filter 0 (1.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 18.32M (18321949) Averaged Fragment F03:(Total: 32s229ms, non-child: 30s891ms, % non-child: 95.85%) split sizes: min: 142.33 MB, max: 296.57 MB, avg: 237.21 MB, stddev: 72.72 MB completion times: min:13s401ms max:52s366ms mean: 32s383ms stddev:16s501ms execution rates: min:3.00 MB/sec max:16.38 MB/sec mean:9.36 MB/sec stddev:4.65 MB/sec num instances: 5 - AverageThreadTokens: 1.92 - BloomFilterBytes: 0 - PeakMemoryUsage: 29.50 MB (30930812) - PerHostPeakMemUsage: 515.27 MB (540304102) - RowsProduced: 600.04K (600037) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 29s978ms - TotalStorageWaitTime: 173.814ms - TotalThreadsInvoluntaryContextSwitches: 1.93K (1929) - TotalThreadsTotalWallClockTime: 1m2s - TotalThreadsSysTime: 22.596ms - TotalThreadsUserTime: 2s634ms - TotalThreadsVoluntaryContextSwitches: 255 (255) Fragment Instance Lifecycle Timings: - ExecTime: 31s728ms - ExecTreeExecTime: 324.632ms - OpenTime: 165.511ms - ExecTreeOpenTime: 166.099us - PrepareTime: 334.655ms - ExecTreePrepareTime: 268.065us DataStreamSender (dst_id=10):(Total: 643.974ms, non-child: 643.974ms, % non-child: 100.00%) - BytesSent: 7.28 MB (7633234) - NetworkThroughput(*): 83.35 MB/sec - OverallThroughput: 11.43 MB/sec - PeakMemoryUsage: 264.94 KB (271296) - RowsReturned: 600.04K (600037) - SerializeBatchTime: 557.030ms - TransmitDataRPCTime: 86.382ms - UncompressedRowBatchSize: 21.18 MB (22205073) CodeGen:(Total: 369.726ms, non-child: 369.726ms, % non-child: 100.00%) - CodegenTime: 2.185ms - CompileTime: 15.812ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2076168) - NumFunctions: 30 (30) - NumInstructions: 476 (476) - OptimizationTime: 120.098ms - PeakMemoryUsage: 238.00 KB (243712) - PrepareTime: 214.250ms HDFS_SCAN_NODE (id=0):(Total: 323.828ms, non-child: 323.828ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.94 - BytesRead: 12.84 MB (13464689) - BytesReadDataNodeCache: 0 - BytesReadLocal: 12.84 MB (13464689) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 12.84 MB (13464689) - DecompressionTime: 60.128ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 29.17 MB (30582460) - PerReadThreadRawHdfsThroughput: 975.66 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 287.499ms - RowBatchQueuePutWaitTime: 28s934ms - RowsRead: 3.00M (3000000) - RowsReturned: 600.04K (600037) - RowsReturnedRate: 2.81 M/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 754 (754) - ScannerThreadsTotalWallClockTime: 30s824ms - MaterializeTupleTime(*): 1s526ms - ScannerThreadsSysTime: 9.598ms - ScannerThreadsUserTime: 1s391ms - ScannerThreadsVoluntaryContextSwitches: 109 (109) - TotalRawHdfsReadTime(*): 16.170ms - TotalReadThroughput: 532.32 KB/sec Fragment F03: Instance a6492cb57c2f2439:29baebe70000001a (host=redacted-host1:22000):(Total: 52s248ms, non-child: 50s818ms, % non-child: 97.26%) Hdfs split stats (:<# splits>/): 2:1/142.37 MB 7:1/154.20 MB MemoryUsage(1s000ms): 31.14 KB, 28.23 MB, 29.41 MB, 29.35 MB, 29.35 MB, 29.41 MB, 29.36 MB, 29.35 MB, 29.40 MB, 29.46 MB, 29.46 MB, 29.46 MB, 29.46 MB, 29.46 MB, 29.46 MB, 29.46 MB, 29.46 MB, 29.46 MB, 29.46 MB, 29.46 MB, 29.46 MB, 29.46 MB, 29.46 MB, 29.46 MB, 29.46 MB, 29.46 MB, 29.46 MB, 29.46 MB, 29.46 MB, 29.46 MB, 29.46 MB, 29.46 MB, 29.46 MB, 29.46 MB, 29.46 MB, 29.46 MB, 29.46 MB, 29.46 MB, 29.46 MB, 29.46 MB, 29.46 MB, 29.46 MB, 29.46 MB, 29.46 MB, 29.46 MB, 29.46 MB, 29.46 MB, 29.46 MB, 29.46 MB, 29.46 MB, 28.71 MB, 27.78 MB ThreadUsage(1s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 1.99 - BloomFilterBytes: 0 - PeakMemoryUsage: 29.48 MB (30916374) - PerHostPeakMemUsage: 802.40 MB (841380786) - RowsProduced: 751.13K (751129) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 49s595ms - TotalStorageWaitTime: 101.674ms - TotalThreadsInvoluntaryContextSwitches: 2.12K (2125) - TotalThreadsTotalWallClockTime: 1m43s - TotalThreadsSysTime: 29.996ms - TotalThreadsUserTime: 3s234ms - TotalThreadsVoluntaryContextSwitches: 189 (189) Fragment Instance Lifecycle Timings: - ExecTime: 51s671ms - ExecTreeExecTime: 239.230ms - OpenTime: 172.750ms - ExecTreeOpenTime: 150.560us - PrepareTime: 404.252ms - ExecTreePrepareTime: 275.296us DataStreamSender (dst_id=10):(Total: 812.883ms, non-child: 812.883ms, % non-child: 100.00%) - BytesSent: 9.06 MB (9499651) - NetworkThroughput(*): 86.16 MB/sec - OverallThroughput: 11.14 MB/sec - PeakMemoryUsage: 264.94 KB (271296) - RowsReturned: 751.13K (751129) - SerializeBatchTime: 707.236ms - TransmitDataRPCTime: 105.150ms - UncompressedRowBatchSize: 26.51 MB (27796381) CodeGen:(Total: 379.303ms, non-child: 379.303ms, % non-child: 100.00%) - CodegenTime: 2.822ms - CompileTime: 15.342ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2076168) - NumFunctions: 30 (30) - NumInstructions: 476 (476) - OptimizationTime: 119.420ms - PeakMemoryUsage: 238.00 KB (243712) - PrepareTime: 243.520ms HDFS_SCAN_NODE (id=0):(Total: 238.131ms, non-child: 238.131ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:1/142.37 MB 7:1/154.20 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 2 out of 2 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:4 BytesRead(1s000ms): 0, 7.71 MB, 7.71 MB, 7.71 MB, 7.71 MB, 7.71 MB, 7.71 MB, 7.71 MB, 7.71 MB, 7.71 MB, 7.71 MB, 7.71 MB, 7.71 MB, 7.71 MB, 7.71 MB, 7.71 MB, 7.71 MB, 7.71 MB, 7.71 MB, 7.71 MB, 7.71 MB, 7.71 MB, 7.71 MB, 7.71 MB, 7.71 MB, 7.71 MB, 7.71 MB, 7.71 MB, 7.71 MB, 7.71 MB, 7.71 MB, 7.71 MB, 7.71 MB, 7.71 MB, 7.71 MB, 7.71 MB, 7.71 MB, 7.71 MB, 7.71 MB, 7.71 MB, 7.71 MB, 7.71 MB, 7.71 MB, 7.71 MB, 7.71 MB, 7.71 MB, 7.71 MB, 7.71 MB, 7.71 MB, 7.71 MB, 7.71 MB, 16.05 MB - FooterProcessingTime: (Avg: 17.557ms ; Min: 2.621ms ; Max: 32.493ms ; Number of samples: 2) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 16.05 MB (16831789) - BytesReadDataNodeCache: 0 - BytesReadLocal: 16.05 MB (16831789) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 16.05 MB (16831789) - DecompressionTime: 53.185ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 2 (2) - NumRowGroups: 2 (2) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 29.20 MB (30618096) - PerReadThreadRawHdfsThroughput: 1.04 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 212.864ms - RowBatchQueuePutWaitTime: 49s322ms - RowsRead: 3.75M (3750000) - RowsReturned: 751.13K (751129) - RowsReturnedRate: 3.15 M/sec - ScanRangesComplete: 2 (2) - ScannerThreadsInvoluntaryContextSwitches: 919 (919) - ScannerThreadsTotalWallClockTime: 51s453ms - MaterializeTupleTime(*): 1s846ms - ScannerThreadsSysTime: 12.998ms - ScannerThreadsUserTime: 1s754ms - ScannerThreadsVoluntaryContextSwitches: 80 (80) - TotalRawHdfsReadTime(*): 15.086ms - TotalReadThroughput: 316.10 KB/sec Instance a6492cb57c2f2439:29baebe70000001c (host=redacted-host2:22000):(Total: 51s231ms, non-child: 50s211ms, % non-child: 98.01%) Hdfs split stats (:<# splits>/): 4:1/154.21 MB MemoryUsage(1s000ms): 4.56 MB, 29.39 MB, 29.28 MB, 29.36 MB, 29.37 MB, 29.37 MB, 29.40 MB, 29.44 MB, 29.45 MB, 29.45 MB, 29.45 MB, 29.45 MB, 29.45 MB, 29.45 MB, 29.45 MB, 29.45 MB, 29.45 MB, 29.45 MB, 29.45 MB, 29.45 MB, 29.45 MB, 29.45 MB, 29.45 MB, 29.45 MB, 29.45 MB, 29.45 MB, 29.45 MB, 29.45 MB, 29.45 MB, 29.45 MB, 29.45 MB, 29.45 MB, 29.45 MB, 29.45 MB, 29.45 MB, 29.45 MB, 29.45 MB, 29.45 MB, 29.45 MB, 29.45 MB, 29.45 MB, 29.45 MB, 29.45 MB, 29.45 MB, 29.45 MB, 29.45 MB, 29.45 MB, 29.45 MB, 29.45 MB, 29.45 MB, 22.05 MB ThreadUsage(1s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1 - AverageThreadTokens: 1.98 - BloomFilterBytes: 0 - PeakMemoryUsage: 29.49 MB (30917398) - PerHostPeakMemUsage: 856.65 MB (898257857) - RowsProduced: 390.09K (390093) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 49s636ms - TotalStorageWaitTime: 211.821ms - TotalThreadsInvoluntaryContextSwitches: 982 (982) - TotalThreadsTotalWallClockTime: 1m41s - TotalThreadsSysTime: 5.998ms - TotalThreadsUserTime: 1s658ms - TotalThreadsVoluntaryContextSwitches: 231 (231) Fragment Instance Lifecycle Timings: - ExecTime: 50s851ms - ExecTreeExecTime: 377.328ms - OpenTime: 98.101ms - ExecTreeOpenTime: 173.880us - PrepareTime: 281.742ms - ExecTreePrepareTime: 245.850us DataStreamSender (dst_id=10):(Total: 376.911ms, non-child: 376.911ms, % non-child: 100.00%) - BytesSent: 4.76 MB (4993824) - NetworkThroughput(*): 88.25 MB/sec - OverallThroughput: 12.64 MB/sec - PeakMemoryUsage: 264.94 KB (271296) - RowsReturned: 390.09K (390093) - SerializeBatchTime: 322.626ms - TransmitDataRPCTime: 53.965ms - UncompressedRowBatchSize: 13.77 MB (14435841) CodeGen:(Total: 265.599ms, non-child: 265.599ms, % non-child: 100.00%) - CodegenTime: 1.576ms - CompileTime: 10.488ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2076168) - NumFunctions: 30 (30) - NumInstructions: 476 (476) - OptimizationTime: 79.526ms - PeakMemoryUsage: 238.00 KB (243712) - PrepareTime: 169.909ms HDFS_SCAN_NODE (id=0):(Total: 377.097ms, non-child: 377.097ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:1/154.21 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:99.01% 1:0.9901% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:2 BytesRead(1s000ms): 409.36 KB, 8.34 MB, 8.34 MB, 8.34 MB, 8.34 MB, 8.34 MB, 8.34 MB, 8.34 MB, 8.34 MB, 8.34 MB, 8.34 MB, 8.34 MB, 8.34 MB, 8.34 MB, 8.34 MB, 8.34 MB, 8.34 MB, 8.34 MB, 8.34 MB, 8.34 MB, 8.34 MB, 8.34 MB, 8.34 MB, 8.34 MB, 8.34 MB, 8.34 MB, 8.34 MB, 8.34 MB, 8.34 MB, 8.34 MB, 8.34 MB, 8.34 MB, 8.34 MB, 8.34 MB, 8.34 MB, 8.34 MB, 8.34 MB, 8.34 MB, 8.34 MB, 8.34 MB, 8.34 MB, 8.34 MB, 8.34 MB, 8.34 MB, 8.34 MB, 8.34 MB, 8.34 MB, 8.34 MB, 8.34 MB, 8.34 MB, 8.34 MB - FooterProcessingTime: (Avg: 15.628ms ; Min: 15.628ms ; Max: 15.628ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 0.99 - BytesRead: 8.34 MB (8743875) - BytesReadDataNodeCache: 0 - BytesReadLocal: 8.34 MB (8743875) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 8.34 MB (8743875) - DecompressionTime: 50.868ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 29.12 MB (30533104) - PerReadThreadRawHdfsThroughput: 382.65 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 348.050ms - RowBatchQueuePutWaitTime: 49s188ms - RowsRead: 1.95M (1950000) - RowsReturned: 390.09K (390093) - RowsReturnedRate: 1.03 M/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 342 (342) - ScannerThreadsTotalWallClockTime: 50s524ms - MaterializeTupleTime(*): 969.142ms - ScannerThreadsSysTime: 1.999ms - ScannerThreadsUserTime: 829.873ms - ScannerThreadsVoluntaryContextSwitches: 114 (114) - TotalRawHdfsReadTime(*): 21.791ms - TotalReadThroughput: 167.43 KB/sec Instance a6492cb57c2f2439:29baebe70000001b (host=redacted-host4:22000):(Total: 26s362ms, non-child: 24s886ms, % non-child: 94.40%) Hdfs split stats (:<# splits>/): 3:2/296.45 MB MemoryUsage(500.000ms): 40.94 KB, 198.32 KB, 26.40 MB, 29.44 MB, 29.44 MB, 29.44 MB, 29.44 MB, 29.44 MB, 29.44 MB, 29.44 MB, 29.44 MB, 29.44 MB, 29.44 MB, 29.44 MB, 29.44 MB, 29.44 MB, 29.44 MB, 29.44 MB, 29.44 MB, 29.44 MB, 29.44 MB, 29.44 MB, 29.44 MB, 29.44 MB, 29.44 MB, 29.44 MB, 29.44 MB, 29.44 MB, 29.44 MB, 29.44 MB, 29.44 MB, 29.44 MB, 29.44 MB, 29.44 MB, 29.44 MB, 29.44 MB, 29.44 MB, 29.44 MB, 29.44 MB, 29.44 MB, 29.44 MB, 29.44 MB, 29.44 MB, 29.44 MB, 29.44 MB, 29.44 MB, 29.44 MB, 29.44 MB, 29.33 MB, 29.07 MB, 26.10 MB, 21.90 MB ThreadUsage(500.000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 1.98 - BloomFilterBytes: 0 - PeakMemoryUsage: 29.44 MB (30866197) - PerHostPeakMemUsage: 353.99 MB (371184907) - RowsProduced: 749.89K (749894) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 23s815ms - TotalStorageWaitTime: 158.389ms - TotalThreadsInvoluntaryContextSwitches: 3.27K (3272) - TotalThreadsTotalWallClockTime: 51s411ms - TotalThreadsSysTime: 26.996ms - TotalThreadsUserTime: 3s172ms - TotalThreadsVoluntaryContextSwitches: 126 (126) Fragment Instance Lifecycle Timings: - ExecTime: 25s737ms - ExecTreeExecTime: 267.529ms - OpenTime: 201.522ms - ExecTreeOpenTime: 199.118us - PrepareTime: 422.972ms - ExecTreePrepareTime: 277.262us DataStreamSender (dst_id=10):(Total: 734.259ms, non-child: 734.259ms, % non-child: 100.00%) - BytesSent: 9.04 MB (9481724) - NetworkThroughput(*): 92.79 MB/sec - OverallThroughput: 12.32 MB/sec - PeakMemoryUsage: 264.94 KB (271296) - RowsReturned: 749.89K (749894) - SerializeBatchTime: 636.298ms - TransmitDataRPCTime: 97.451ms - UncompressedRowBatchSize: 26.47 MB (27750678) CodeGen:(Total: 475.850ms, non-child: 475.850ms, % non-child: 100.00%) - CodegenTime: 3.032ms - CompileTime: 23.766ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2076168) - NumFunctions: 30 (30) - NumInstructions: 476 (476) - OptimizationTime: 149.231ms - PeakMemoryUsage: 238.00 KB (243712) - PrepareTime: 220.668ms HDFS_SCAN_NODE (id=0):(Total: 266.375ms, non-child: 266.375ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:2/296.45 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 2 out of 2 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:4 BytesRead(500.000ms): 0, 0, 8.34 MB, 8.34 MB, 8.34 MB, 8.34 MB, 8.34 MB, 8.34 MB, 8.34 MB, 8.34 MB, 8.34 MB, 8.34 MB, 8.34 MB, 8.34 MB, 8.34 MB, 8.34 MB, 8.34 MB, 8.34 MB, 8.34 MB, 8.34 MB, 8.34 MB, 8.34 MB, 8.34 MB, 8.34 MB, 8.34 MB, 8.34 MB, 8.34 MB, 8.34 MB, 8.34 MB, 8.34 MB, 8.34 MB, 8.34 MB, 8.34 MB, 8.34 MB, 8.34 MB, 8.34 MB, 8.34 MB, 8.34 MB, 8.34 MB, 8.34 MB, 8.34 MB, 8.34 MB, 8.34 MB, 8.34 MB, 8.34 MB, 8.34 MB, 8.34 MB, 8.34 MB, 8.34 MB, 8.34 MB, 16.05 MB, 16.05 MB - FooterProcessingTime: (Avg: 66.571ms ; Min: 2.656ms ; Max: 130.486ms ; Number of samples: 2) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 16.05 MB (16831571) - BytesReadDataNodeCache: 0 - BytesReadLocal: 16.05 MB (16831571) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 16.05 MB (16831571) - DecompressionTime: 70.236ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumRowGroups: 2 (2) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 29.07 MB (30481903) - PerReadThreadRawHdfsThroughput: 2.12 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 209.343ms - RowBatchQueuePutWaitTime: 23s269ms - RowsRead: 3.75M (3750000) - RowsReturned: 749.89K (749894) - RowsReturnedRate: 2.82 M/sec - ScanRangesComplete: 2 (2) - ScannerThreadsInvoluntaryContextSwitches: 1.02K (1018) - ScannerThreadsTotalWallClockTime: 25s472ms - MaterializeTupleTime(*): 1s910ms - ScannerThreadsSysTime: 11.998ms - ScannerThreadsUserTime: 1s706ms - ScannerThreadsVoluntaryContextSwitches: 50 (50) - TotalRawHdfsReadTime(*): 7.383ms - TotalReadThroughput: 631.98 KB/sec Instance a6492cb57c2f2439:29baebe70000001d (host=redacted-host3:22000):(Total: 18s054ms, non-child: 16s837ms, % non-child: 93.26%) Hdfs split stats (:<# splits>/): 11:1/154.14 MB 1:1/142.35 MB MemoryUsage(500.000ms): 12.81 MB, 29.24 MB, 29.49 MB, 29.39 MB, 29.37 MB, 29.51 MB, 29.51 MB, 29.43 MB, 29.41 MB, 29.41 MB, 29.41 MB, 29.41 MB, 29.41 MB, 29.41 MB, 29.41 MB, 29.41 MB, 29.41 MB, 29.41 MB, 29.41 MB, 29.41 MB, 29.41 MB, 29.41 MB, 29.41 MB, 29.41 MB, 29.41 MB, 29.41 MB, 29.41 MB, 29.41 MB, 29.41 MB, 29.41 MB, 26.66 MB, 29.25 MB, 29.41 MB, 29.34 MB, 12.93 MB, 74.29 KB ThreadUsage(500.000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1 - AverageThreadTokens: 1.94 - BloomFilterBytes: 0 - PeakMemoryUsage: 29.59 MB (31028502) - PerHostPeakMemUsage: 345.10 MB (361862096) - RowsProduced: 749.10K (749100) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 15s813ms - TotalStorageWaitTime: 39.944ms - TotalThreadsInvoluntaryContextSwitches: 2.43K (2434) - TotalThreadsTotalWallClockTime: 34s888ms - TotalThreadsSysTime: 35.994ms - TotalThreadsUserTime: 3s349ms - TotalThreadsVoluntaryContextSwitches: 416 (416) Fragment Instance Lifecycle Timings: - ExecTime: 17s803ms - ExecTreeExecTime: 117.264ms - OpenTime: 128.193ms - ExecTreeOpenTime: 135.034us - PrepareTime: 123.597ms - ExecTreePrepareTime: 277.187us DataStreamSender (dst_id=10):(Total: 890.370ms, non-child: 890.370ms, % non-child: 100.00%) - BytesSent: 9.17 MB (9611147) - NetworkThroughput(*): 85.72 MB/sec - OverallThroughput: 10.29 MB/sec - PeakMemoryUsage: 264.94 KB (271296) - RowsReturned: 749.10K (749100) - SerializeBatchTime: 782.904ms - TransmitDataRPCTime: 106.922ms - UncompressedRowBatchSize: 26.44 MB (27721292) CodeGen:(Total: 211.093ms, non-child: 211.093ms, % non-child: 100.00%) - CodegenTime: 1.634ms - CompileTime: 10.539ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2076168) - NumFunctions: 30 (30) - NumInstructions: 476 (476) - OptimizationTime: 107.928ms - PeakMemoryUsage: 238.00 KB (243712) - PrepareTime: 91.783ms HDFS_SCAN_NODE (id=0):(Total: 115.987ms, non-child: 115.987ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 11:1/154.14 MB 1:1/142.35 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 2 out of 2 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:4 BytesRead(500.000ms): 8.34 MB, 8.34 MB, 8.34 MB, 8.34 MB, 8.34 MB, 8.34 MB, 8.34 MB, 8.34 MB, 8.34 MB, 8.34 MB, 8.34 MB, 8.34 MB, 8.34 MB, 8.34 MB, 8.34 MB, 8.34 MB, 8.34 MB, 8.34 MB, 8.34 MB, 8.34 MB, 8.34 MB, 8.34 MB, 8.34 MB, 8.34 MB, 8.34 MB, 8.34 MB, 8.34 MB, 8.34 MB, 8.34 MB, 8.34 MB, 16.05 MB, 16.05 MB, 16.05 MB, 16.05 MB, 16.05 MB - FooterProcessingTime: (Avg: 3.476ms ; Min: 2.632ms ; Max: 4.320ms ; Number of samples: 2) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.97 - BytesRead: 16.05 MB (16830300) - BytesReadDataNodeCache: 0 - BytesReadLocal: 16.05 MB (16830300) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 16.05 MB (16830300) - DecompressionTime: 53.181ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 2 (2) - NumRowGroups: 2 (2) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 29.30 MB (30720496) - PerReadThreadRawHdfsThroughput: 737.32 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 56.856ms - RowBatchQueuePutWaitTime: 14s868ms - RowsRead: 3.75M (3750000) - RowsReturned: 749.10K (749100) - RowsReturnedRate: 6.46 M/sec - ScanRangesComplete: 2 (2) - ScannerThreadsInvoluntaryContextSwitches: 1.08K (1080) - ScannerThreadsTotalWallClockTime: 16s956ms - MaterializeTupleTime(*): 1s928ms - ScannerThreadsSysTime: 15.997ms - ScannerThreadsUserTime: 1s765ms - ScannerThreadsVoluntaryContextSwitches: 186 (186) - TotalRawHdfsReadTime(*): 21.768ms - TotalReadThroughput: 939.08 KB/sec Instance a6492cb57c2f2439:29baebe700000019 (host=redacted-host6:22000):(Total: 13s248ms, non-child: 11s704ms, % non-child: 88.35%) Hdfs split stats (:<# splits>/): 5:1/142.33 MB MemoryUsage(500.000ms): 0, 286.94 KB, 1.08 MB, 20.69 MB, 29.38 MB, 29.41 MB, 29.41 MB, 29.39 MB, 29.41 MB, 29.43 MB, 29.41 MB, 29.42 MB, 29.42 MB, 29.38 MB, 29.40 MB, 29.40 MB, 29.37 MB, 29.40 MB, 29.39 MB, 29.42 MB, 29.34 MB, 18.88 MB, 18.23 MB, 16.31 MB, 15.01 MB, 8.16 MB, 1.64 MB ThreadUsage(500.000ms): 1, 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.70 - BloomFilterBytes: 0 - PeakMemoryUsage: 29.49 MB (30925590) - PerHostPeakMemUsage: 218.23 MB (228834866) - RowsProduced: 359.97K (359972) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 11s033ms - TotalStorageWaitTime: 357.244ms - TotalThreadsInvoluntaryContextSwitches: 832 (832) - TotalThreadsTotalWallClockTime: 22s521ms - TotalThreadsSysTime: 13.997ms - TotalThreadsUserTime: 1s755ms - TotalThreadsVoluntaryContextSwitches: 314 (314) Fragment Instance Lifecycle Timings: - ExecTime: 12s580ms - ExecTreeExecTime: 621.807ms - OpenTime: 226.987ms - ExecTreeOpenTime: 171.904us - PrepareTime: 440.713ms - ExecTreePrepareTime: 264.730us DataStreamSender (dst_id=10):(Total: 405.448ms, non-child: 405.448ms, % non-child: 100.00%) - BytesSent: 4.37 MB (4579826) - NetworkThroughput(*): 63.83 MB/sec - OverallThroughput: 10.77 MB/sec - PeakMemoryUsage: 264.94 KB (271296) - RowsReturned: 359.97K (359972) - SerializeBatchTime: 336.088ms - TransmitDataRPCTime: 68.422ms - UncompressedRowBatchSize: 12.70 MB (13321176) CodeGen:(Total: 516.782ms, non-child: 516.782ms, % non-child: 100.00%) - CodegenTime: 1.860ms - CompileTime: 18.926ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2076168) - NumFunctions: 30 (30) - NumInstructions: 476 (476) - OptimizationTime: 144.383ms - PeakMemoryUsage: 238.00 KB (243712) - PrepareTime: 345.370ms HDFS_SCAN_NODE (id=0):(Total: 621.551ms, non-child: 621.551ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:1/142.33 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:2 BytesRead(500.000ms): 0, 100.00 KB, 7.71 MB, 7.71 MB, 7.71 MB, 7.71 MB, 7.71 MB, 7.71 MB, 7.71 MB, 7.71 MB, 7.71 MB, 7.71 MB, 7.71 MB, 7.71 MB, 7.71 MB, 7.71 MB, 7.71 MB, 7.71 MB, 7.71 MB, 7.71 MB, 7.71 MB, 7.71 MB, 7.71 MB, 7.71 MB, 7.71 MB, 7.71 MB - FooterProcessingTime: (Avg: 44.193ms ; Min: 44.193ms ; Max: 44.193ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.76 - BytesRead: 7.71 MB (8085910) - BytesReadDataNodeCache: 0 - BytesReadLocal: 7.71 MB (8085910) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 7.71 MB (8085910) - DecompressionTime: 73.170ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 29.14 MB (30558703) - PerReadThreadRawHdfsThroughput: 520.18 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 610.384ms - RowBatchQueuePutWaitTime: 8s024ms - RowsRead: 1.80M (1800000) - RowsReturned: 359.97K (359972) - RowsReturnedRate: 579.15 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 412 (412) - ScannerThreadsTotalWallClockTime: 9s714ms - MaterializeTupleTime(*): 980.003ms - ScannerThreadsSysTime: 4.999ms - ScannerThreadsUserTime: 901.862ms - ScannerThreadsVoluntaryContextSwitches: 115 (115) - TotalRawHdfsReadTime(*): 14.824ms - TotalReadThroughput: 606.99 KB/sec