Query (id=674b2fc81eb8bff4:b6ab0eca00000000): DEBUG MODE WARNING: Query profile created while running a DEBUG build of Impala. Use RELEASE builds to measure query performance. Summary: Session ID: b4ab5d35385e78e:258879558aad28bd Session Type: HIVESERVER2 HiveServer2 Protocol Version: V6 Start Time: 2017-05-26 08:25:14.022878000 End Time: 2017-05-26 08:33:25.472337000 Query Type: QUERY Query State: FINISHED Query Status: OK Impala Version: impalad version 2.9.0-SNAPSHOT DEBUG (build 470e6de60c3171e58c4ffeea48d456945ab6dd22) User: redacted Connected User: redacted Delegated User: Network Address: redacted Default Db: tpch_100_parquet Sql Statement: /* Mem: 2035 MB. Coordinator: redacted-host5. */ select l_orderkey, sum(l_extendedprice * (1 - l_discount)) as revenue, o_orderdate, o_shippriority from customer, orders, lineitem where c_mktsegment = 'BUILDING' and c_custkey = o_custkey and l_orderkey = o_orderkey and o_orderdate < '1995-03-15' and l_shipdate > '1995-03-15' group by l_orderkey, o_orderdate, o_shippriority order by revenue desc, o_orderdate limit 10 Coordinator: redacted-host5:22000 Query Options (non default): ABORT_ON_ERROR=1,MEM_LIMIT=2133852160 Plan: ---------------- Per-Host Resource Reservation: Memory=536.00MB Per-Host Resource Estimates: Memory=673.67MB F06:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1 PLAN-ROOT SINK | mem-estimate=0B mem-reservation=0B | 13:MERGING-EXCHANGE [UNPARTITIONED] | order by: sum(l_extendedprice * (1 - l_discount)) DESC, o_orderdate ASC | limit: 10 | mem-estimate=0B mem-reservation=0B | tuple-ids=4 row-size=58B cardinality=10 | F05:PLAN FRAGMENT [HASH(l_orderkey,o_orderdate,o_shippriority)] hosts=8 instances=8 06:TOP-N [LIMIT=10] | order by: sum(l_extendedprice * (1 - l_discount)) DESC, o_orderdate ASC | mem-estimate=580B mem-reservation=0B | tuple-ids=4 row-size=58B cardinality=10 | 12:AGGREGATE [FINALIZE] | output: sum:merge(l_extendedprice * (1 - l_discount)) | group by: l_orderkey, o_orderdate, o_shippriority | mem-estimate=105.17MB mem-reservation=264.00MB | tuple-ids=3 row-size=58B cardinality=1728520 | 11:EXCHANGE [HASH(l_orderkey,o_orderdate,o_shippriority)] | mem-estimate=0B mem-reservation=0B | tuple-ids=3 row-size=58B cardinality=1728520 | F04:PLAN FRAGMENT [HASH(o_custkey)] hosts=8 instances=8 05:AGGREGATE [STREAMING] | output: sum(l_extendedprice * (1 - l_discount)) | group by: l_orderkey, o_orderdate, o_shippriority | mem-estimate=105.17MB mem-reservation=0B | tuple-ids=3 row-size=58B cardinality=1728520 | 04:HASH JOIN [INNER JOIN, PARTITIONED] | hash predicates: o_custkey = c_custkey | runtime filters: RF000 <- c_custkey | mem-estimate=12.98MB mem-reservation=136.00MB | tuple-ids=2,1,0 row-size=133B cardinality=1728520 | |--10:EXCHANGE [HASH(c_custkey)] | | mem-estimate=0B mem-reservation=0B | | tuple-ids=0 row-size=33B cardinality=3000000 | | | F03:PLAN FRAGMENT [RANDOM] hosts=8 instances=8 | 00:SCAN HDFS [tpch_100_parquet.customer, RANDOM] | partitions=1/1 files=8 size=1.16GB | predicates: c_mktsegment = 'BUILDING' | table stats: 15000000 rows total | column stats: all | parquet statistics predicates: c_mktsegment = 'BUILDING' | parquet dictionary predicates: c_mktsegment = 'BUILDING' | mem-estimate=176.00MB mem-reservation=0B | tuple-ids=0 row-size=33B cardinality=3000000 | 09:EXCHANGE [HASH(o_custkey)] | mem-estimate=0B mem-reservation=0B | tuple-ids=2,1 row-size=100B cardinality=6000379 | F02:PLAN FRAGMENT [HASH(l_orderkey)] hosts=8 instances=8 03:HASH JOIN [INNER JOIN, PARTITIONED] | hash predicates: l_orderkey = o_orderkey | runtime filters: RF001 <- o_orderkey | mem-estimate=98.35MB mem-reservation=136.00MB | tuple-ids=2,1 row-size=100B cardinality=6000379 | |--08:EXCHANGE [HASH(o_orderkey)] | | mem-estimate=0B mem-reservation=0B | | tuple-ids=1 row-size=50B cardinality=15000000 | | | F01:PLAN FRAGMENT [RANDOM] hosts=8 instances=8 | 01:SCAN HDFS [tpch_100_parquet.orders, RANDOM] | partitions=1/1 files=31 size=6.07GB | predicates: o_orderdate < '1995-03-15' | runtime filters: RF000 -> o_custkey | table stats: 150000000 rows total | column stats: all | parquet statistics predicates: o_orderdate < '1995-03-15' | parquet dictionary predicates: o_orderdate < '1995-03-15' | mem-estimate=352.00MB mem-reservation=0B | tuple-ids=1 row-size=50B cardinality=15000000 | 07:EXCHANGE [HASH(l_orderkey)] | mem-estimate=0B mem-reservation=0B | tuple-ids=2 row-size=50B cardinality=60003790 | F00:PLAN FRAGMENT [RANDOM] hosts=8 instances=8 02:SCAN HDFS [tpch_100_parquet.lineitem, RANDOM] partitions=1/1 files=88 size=21.06GB predicates: l_shipdate > '1995-03-15' runtime filters: RF001 -> l_orderkey table stats: 600037902 rows total column stats: all parquet statistics predicates: l_shipdate > '1995-03-15' parquet dictionary predicates: l_shipdate > '1995-03-15' mem-estimate=352.00MB mem-reservation=0B tuple-ids=2 row-size=50B cardinality=60003790 ---------------- Estimated Per-Host Mem: 706395485 Per-Host Memory Reservation: 562036736 Request Pool: redacted Admission result: Admitted immediately ExecSummary: Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail ---------------------------------------------------------------------------------------------------------------------------------- 13:MERGING-EXCHANGE 1 304.504us 304.504us 10 10 0 0 UNPARTITIONED 06:TOP-N 8 19.261ms 29.196ms 80 10 12.00 KB 580.00 B 12:AGGREGATE 8 305.220ms 449.997ms 1.13M 1.73M 14.24 MB 105.17 MB FINALIZE 11:EXCHANGE 8 66.207ms 96.284ms 1.13M 1.73M 0 0 HASH(l_orderkey,o_orderdate... 05:AGGREGATE 8 516.324ms 653.086ms 1.13M 1.73M 13.58 MB 105.17 MB STREAMING 04:HASH JOIN 8 1s217ms 1s461ms 2.99M 1.73M 153.17 MB 12.98 MB INNER JOIN, PARTITIONED |--10:EXCHANGE 8 150.899ms 213.929ms 3.00M 3.00M 0 0 HASH(c_custkey) | 00:SCAN HDFS 5 937.452ms 1s753ms 3.00M 3.00M 29.09 MB 176.00 MB tpch_100_parquet.customer 09:EXCHANGE 8 563.317ms 581.895ms 11.04M 6.00M 0 0 HASH(o_custkey) 03:HASH JOIN 8 24s420ms 28s126ms 11.04M 6.00M 649.11 MB 98.35 MB INNER JOIN, PARTITIONED |--08:EXCHANGE 8 2s733ms 2s967ms 53.80M 15.00M 0 0 HASH(o_orderkey) | 01:SCAN HDFS 8 30s937ms 47s728ms 53.80M 15.00M 85.11 MB 352.00 MB tpch_100_parquet.orders 07:EXCHANGE 8 13s816ms 14s173ms 323.49M 60.00M 0 0 HASH(l_orderkey) 02:SCAN HDFS 8 10s053ms 12s288ms 323.48M 60.00M 78.57 MB 352.00 MB tpch_100_parquet.lineitem Errors: Planner Timeline: 88.911ms - Analysis finished: 36.854ms (36.854ms) - Equivalence classes computed: 37.238ms (384.398us) - Single node plan created: 78.180ms (40.941ms) - Runtime filters computed: 78.414ms (233.708us) - Distributed plan created: 79.189ms (775.614us) - Lineage info computed: 79.540ms (350.958us) - Planning finished: 88.911ms (9.370ms) Query Timeline: 8m11s - Query submitted: 290.850us (290.850us) - Planning finished: 112.058ms (111.767ms) - Submit for admission: 143.843ms (31.785ms) - Completed admission: 155.633ms (11.789ms) - Ready to start on 8 backends: 180.614ms (24.980ms) - All 8 execution backends (46 fragment instances) started: 212.610ms (31.995ms) - First dynamic filter received: 7s033ms (6s820ms) - Rows available: 8m11s (8m4s) - First row fetched: 8m11s (71.526ms) - Unregister query: 8m11s (119.696ms) - ComputeScanRangeAssignmentTimer: 9.557ms ImpalaServer: - ClientFetchWaitTimer: 130.601ms - RowMaterializationTimer: 60.416ms Execution Profile 674b2fc81eb8bff4:b6ab0eca00000000:(Total: 8m11s, non-child: 0.000ns, % non-child: 0.00%) Number of filters: 2 Filter routing table: ID Src. Node Tgt. Node(s) Target type Partition filter Pending (Expected) First arrived Completed Enabled ------------------------------------------------------------------------------------------------------------------- 1 3 2 REMOTE false 8 (8) N/A N/A true 0 4 1 REMOTE false 8 (8) N/A N/A true Backend startup latencies: Count: 8, min / max: 14ms / 29ms, 25th %-ile: 15ms, 50th %-ile: 21ms, 75th %-ile: 25ms, 90th %-ile: 26ms, 95th %-ile: 29ms, 99.9th %-ile: 29ms Per Node Peak Memory Usage: redacted-host2:22000(914.55 MB) redacted-host3:22000(920.75 MB) redacted-host4:22000(920.38 MB) redacted-host5:22000(920.19 MB) redacted-host1:22000(920.64 MB) redacted-host6:22000(920.61 MB) redacted-host7:22000(920.96 MB) redacted-host8:22000(924.63 MB) Final filter table: ID Src. Node Tgt. Node(s) Target type Partition filter Pending (Expected) First arrived Completed Enabled ------------------------------------------------------------------------------------------------------------------- 1 3 2 REMOTE false 0 (8) 5m2s 5m2s false 0 4 1 REMOTE false 0 (8) 7s033ms 7s048ms false - FiltersReceived: 16 (16) - FinalizationTimer: 0.000ns Averaged Fragment F06:(Total: 8m11s, non-child: 77.498ms, % non-child: 0.02%) split sizes: min: 0, max: 0, avg: 0, stddev: 0 completion times: min:8m11s max:8m11s mean: 8m11s stddev:0.000ns execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec num instances: 1 - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 288.00 KB (294912) - PerHostPeakMemUsage: 920.19 MB (964894132) - RowsProduced: 10 (10) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 66 (66) - TotalThreadsTotalWallClockTime: 8m10s - TotalThreadsSysTime: 1.000ms - TotalThreadsUserTime: 78.988ms - TotalThreadsVoluntaryContextSwitches: 9 (9) Fragment Instance Lifecycle Timings: - ExecTime: 72.414ms - ExecTreeExecTime: 1.949ms - OpenTime: 8m10s - ExecTreeOpenTime: 8m10s - PrepareTime: 96.652ms - ExecTreePrepareTime: 108.396us PLAN_ROOT_SINK: - PeakMemoryUsage: 0 CodeGen:(Total: 189.039ms, non-child: 189.039ms, % non-child: 100.00%) - CodegenTime: 1.794ms - CompileTime: 6.939ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2076168) - NumFunctions: 28 (28) - NumInstructions: 560 (560) - OptimizationTime: 89.373ms - PeakMemoryUsage: 280.00 KB (286720) - PrepareTime: 86.316ms EXCHANGE_NODE (id=13):(Total: 8m10s, non-child: 8m10s, % non-child: 100.00%) - BytesReceived: 2.80 KB (2867) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 304.899us - FirstBatchArrivalWaitTime: 8m10s - MergeGetNext: 1.942ms - MergeGetNextBatch: 1.814ms - PeakMemoryUsage: 0 - RowsReturned: 10 (10) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Coordinator Fragment F06: Instance 674b2fc81eb8bff4:b6ab0eca00000000 (host=redacted-host5:22000):(Total: 8m11s, non-child: 77.498ms, % non-child: 0.02%) MemoryUsage(8s000ms): 8.91 KB, 8.91 KB, 8.91 KB, 8.91 KB, 8.91 KB, 8.91 KB, 8.91 KB, 8.91 KB, 8.91 KB, 8.91 KB, 8.91 KB, 8.91 KB, 8.91 KB, 8.91 KB, 8.91 KB, 8.91 KB, 8.91 KB, 8.91 KB, 8.91 KB, 8.91 KB, 8.91 KB, 8.91 KB, 8.91 KB, 8.91 KB, 8.91 KB, 8.91 KB, 8.91 KB, 8.91 KB, 8.91 KB, 8.91 KB, 8.91 KB, 8.91 KB, 8.91 KB, 8.91 KB, 8.91 KB, 8.91 KB, 8.91 KB, 8.91 KB, 8.91 KB, 8.91 KB, 8.91 KB, 8.91 KB, 8.91 KB, 8.91 KB, 8.91 KB, 8.91 KB, 8.91 KB, 8.91 KB, 8.91 KB, 8.91 KB, 8.91 KB, 8.91 KB, 8.91 KB, 8.91 KB, 8.91 KB, 8.91 KB, 8.91 KB, 8.91 KB, 8.91 KB, 8.91 KB - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 288.00 KB (294912) - PerHostPeakMemUsage: 920.19 MB (964894132) - RowsProduced: 10 (10) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 66 (66) - TotalThreadsTotalWallClockTime: 8m10s - TotalThreadsSysTime: 1.000ms - TotalThreadsUserTime: 78.988ms - TotalThreadsVoluntaryContextSwitches: 9 (9) Fragment Instance Lifecycle Timings: - ExecTime: 72.414ms - ExecTreeExecTime: 1.949ms - OpenTime: 8m10s - ExecTreeOpenTime: 8m10s - PrepareTime: 96.652ms - ExecTreePrepareTime: 108.396us PLAN_ROOT_SINK: - PeakMemoryUsage: 0 CodeGen:(Total: 189.039ms, non-child: 189.039ms, % non-child: 100.00%) - CodegenTime: 1.794ms - CompileTime: 6.939ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2076168) - NumFunctions: 28 (28) - NumInstructions: 560 (560) - OptimizationTime: 89.373ms - PeakMemoryUsage: 280.00 KB (286720) - PrepareTime: 86.316ms EXCHANGE_NODE (id=13):(Total: 8m10s, non-child: 304.504us, % non-child: 0.00%) ExecOption: Codegen Enabled BytesReceived(8s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 2.80 KB (2867) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 304.899us - FirstBatchArrivalWaitTime: 8m10s - MergeGetNext: 1.942ms - MergeGetNextBatch: 1.814ms - PeakMemoryUsage: 0 - RowsReturned: 10 (10) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Averaged Fragment F05:(Total: 8m10s, non-child: 32.549ms, % non-child: 0.01%) split sizes: min: 0, max: 0, avg: 0, stddev: 0 completion times: min:8m10s max:8m11s mean: 8m10s stddev:30.741ms execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec num instances: 8 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 14.29 MB (14982365) - PerHostPeakMemUsage: 920.34 MB (965044373) - RowsProduced: 10 (10) - TotalNetworkReceiveTime: 8m9s - TotalNetworkSendTime: 515.284us - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 688 (688) - TotalThreadsTotalWallClockTime: 8m10s - TotalThreadsSysTime: 25.871ms - TotalThreadsUserTime: 666.648ms - TotalThreadsVoluntaryContextSwitches: 362 (362) Fragment Instance Lifecycle Timings: - ExecTime: 3.491ms - ExecTreeExecTime: 1.364ms - OpenTime: 8m10s - ExecTreeOpenTime: 8m10s - PrepareTime: 163.516ms - ExecTreePrepareTime: 13.910ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 192 (192) - BlocksRecycled: 16 (16) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 1.59 GB (1707081728) - PeakMemoryUsage: 788.38 MB (826671104) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=13):(Total: 141.459us, non-child: 141.459us, % non-child: 100.00%) - BytesSent: 358.00 B (358) - NetworkThroughput(*): 12.39 MB/sec - OverallThroughput: 2.50 MB/sec - PeakMemoryUsage: 2.61 KB (2672) - RowsReturned: 10 (10) - SerializeBatchTime: 60.661us - TransmitDataRPCTime: 29.353us - UncompressedRowBatchSize: 634.00 B (634) CodeGen:(Total: 840.310ms, non-child: 840.310ms, % non-child: 100.00%) - CodegenTime: 17.047ms - CompileTime: 114.296ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2076168) - NumFunctions: 117 (117) - NumInstructions: 2.41K (2414) - OptimizationTime: 600.627ms - PeakMemoryUsage: 1.18 MB (1235968) - PrepareTime: 122.164ms SORT_NODE (id=6):(Total: 8m10s, non-child: 19.261ms, % non-child: 0.00%) - InsertBatchTime: 16.845ms - PeakMemoryUsage: 12.00 KB (12288) - RowsReturned: 10 (10) - RowsReturnedRate: 0 AGGREGATION_NODE (id=12):(Total: 8m10s, non-child: 305.220ms, % non-child: 0.06%) - BuildTime: 218.595ms - GetNewBlockTime: 8.464ms - GetResultsTime: 56.325ms - HTResizeTime: 30.166ms - HashBuckets: 262.14K (262144) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 14.23 MB (14917513) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 141.38K (141380) - RowsReturnedRate: 288.00 /sec - SpilledPartitions: 0 (0) - UnpinTime: 2.908us EXCHANGE_NODE (id=11):(Total: 8m9s, non-child: 8m9s, % non-child: 100.00%) - BytesReceived: 3.80 MB (3982845) - ConvertRowBatchTime: 37.158ms - DeserializeRowBatchTimer: 52.533ms - FirstBatchArrivalWaitTime: 8m9s - PeakMemoryUsage: 0 - RowsReturned: 141.38K (141380) - RowsReturnedRate: 288.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Fragment F05: Instance 674b2fc81eb8bff4:b6ab0eca0000002a (host=redacted-host3:22000):(Total: 8m11s, non-child: 54.039ms, % non-child: 0.01%) MemoryUsage(8s000ms): 2.39 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB ThreadUsage(8s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 14.27 MB (14968181) - PerHostPeakMemUsage: 920.75 MB (965473154) - RowsProduced: 10 (10) - TotalNetworkReceiveTime: 8m9s - TotalNetworkSendTime: 2.014ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 858 (858) - TotalThreadsTotalWallClockTime: 8m10s - TotalThreadsSysTime: 29.995ms - TotalThreadsUserTime: 672.898ms - TotalThreadsVoluntaryContextSwitches: 300 (300) Fragment Instance Lifecycle Timings: - ExecTime: 12.955ms - ExecTreeExecTime: 31.364us - OpenTime: 8m10s - ExecTreeOpenTime: 8m9s - PrepareTime: 177.343ms - ExecTreePrepareTime: 14.938ms DataStreamSender (dst_id=13):(Total: 118.876us, non-child: 118.876us, % non-child: 100.00%) - BytesSent: 351.00 B (351) - NetworkThroughput(*): 13.62 MB/sec - OverallThroughput: 2.82 MB/sec - PeakMemoryUsage: 2.61 KB (2672) - RowsReturned: 10 (10) - SerializeBatchTime: 58.623us - TransmitDataRPCTime: 24.573us - UncompressedRowBatchSize: 634.00 B (634) CodeGen:(Total: 1s047ms, non-child: 1s047ms, % non-child: 100.00%) - CodegenTime: 14.363ms - CompileTime: 187.353ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2076168) - NumFunctions: 117 (117) - NumInstructions: 2.41K (2414) - OptimizationTime: 729.186ms - PeakMemoryUsage: 1.18 MB (1235968) - PrepareTime: 130.458ms SORT_NODE (id=6):(Total: 8m9s, non-child: 21.396ms, % non-child: 0.00%) ExecOption: Codegen Enabled - InsertBatchTime: 20.383ms - PeakMemoryUsage: 12.00 KB (12288) - RowsReturned: 10 (10) - RowsReturnedRate: 0 AGGREGATION_NODE (id=12):(Total: 8m9s, non-child: 449.997ms, % non-child: 0.09%) ExecOption: Codegen Enabled - BuildTime: 303.018ms - GetNewBlockTime: 9.763ms - GetResultsTime: 84.550ms - HTResizeTime: 55.888ms - HashBuckets: 262.14K (262144) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 14.23 MB (14917650) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 141.97K (141965) - RowsReturnedRate: 289.00 /sec - SpilledPartitions: 0 (0) - UnpinTime: 3.135us EXCHANGE_NODE (id=11):(Total: 8m9s, non-child: 96.284ms, % non-child: 0.02%) BytesReceived(8s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 3.82 MB (4000496) - ConvertRowBatchTime: 48.029ms - DeserializeRowBatchTimer: 52.923ms - FirstBatchArrivalWaitTime: 8m8s - PeakMemoryUsage: 0 - RowsReturned: 141.97K (141965) - RowsReturnedRate: 290.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 674b2fc81eb8bff4:b6ab0eca0000002c (host=redacted-host6:22000):(Total: 8m10s, non-child: 33.750ms, % non-child: 0.01%) MemoryUsage(8s000ms): 2.46 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB ThreadUsage(8s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 14.29 MB (14983321) - PerHostPeakMemUsage: 920.61 MB (965327461) - RowsProduced: 10 (10) - TotalNetworkReceiveTime: 8m9s - TotalNetworkSendTime: 270.484us - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 872 (872) - TotalThreadsTotalWallClockTime: 8m10s - TotalThreadsSysTime: 26.996ms - TotalThreadsUserTime: 673.898ms - TotalThreadsVoluntaryContextSwitches: 363 (363) Fragment Instance Lifecycle Timings: - ExecTime: 582.696us - ExecTreeExecTime: 23.473us - OpenTime: 8m10s - ExecTreeOpenTime: 8m10s - PrepareTime: 146.340ms - ExecTreePrepareTime: 5.497ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 192 (192) - BlocksRecycled: 16 (16) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 1.59 GB (1707081728) - PeakMemoryUsage: 788.38 MB (826671104) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=13):(Total: 142.369us, non-child: 142.369us, % non-child: 100.00%) - BytesSent: 367.00 B (367) - NetworkThroughput(*): 8.02 MB/sec - OverallThroughput: 2.46 MB/sec - PeakMemoryUsage: 2.61 KB (2672) - RowsReturned: 10 (10) - SerializeBatchTime: 49.617us - TransmitDataRPCTime: 43.628us - UncompressedRowBatchSize: 634.00 B (634) CodeGen:(Total: 844.608ms, non-child: 844.608ms, % non-child: 100.00%) - CodegenTime: 14.474ms - CompileTime: 111.761ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2076168) - NumFunctions: 117 (117) - NumInstructions: 2.41K (2414) - OptimizationTime: 617.001ms - PeakMemoryUsage: 1.18 MB (1235968) - PrepareTime: 113.934ms SORT_NODE (id=6):(Total: 8m10s, non-child: 17.392ms, % non-child: 0.00%) ExecOption: Codegen Enabled - InsertBatchTime: 16.081ms - PeakMemoryUsage: 12.00 KB (12288) - RowsReturned: 10 (10) - RowsReturnedRate: 0 AGGREGATION_NODE (id=12):(Total: 8m10s, non-child: 321.704ms, % non-child: 0.07%) ExecOption: Codegen Enabled - BuildTime: 227.760ms - GetNewBlockTime: 4.703ms - GetResultsTime: 76.690ms - HTResizeTime: 25.845ms - HashBuckets: 262.14K (262144) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 14.23 MB (14922606) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 141.45K (141449) - RowsReturnedRate: 288.00 /sec - SpilledPartitions: 0 (0) - UnpinTime: 3.167us EXCHANGE_NODE (id=11):(Total: 8m9s, non-child: 64.173ms, % non-child: 0.01%) BytesReceived(8s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 3.80 MB (3985007) - ConvertRowBatchTime: 32.935ms - DeserializeRowBatchTimer: 49.114ms - FirstBatchArrivalWaitTime: 8m9s - PeakMemoryUsage: 0 - RowsReturned: 141.45K (141449) - RowsReturnedRate: 288.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 674b2fc81eb8bff4:b6ab0eca00000028 (host=redacted-host2:22000):(Total: 8m10s, non-child: 23.877ms, % non-child: 0.00%) MemoryUsage(8s000ms): 2.39 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 3.56 MB ThreadUsage(8s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 14.27 MB (14959536) - PerHostPeakMemUsage: 914.55 MB (958972542) - RowsProduced: 10 (10) - TotalNetworkReceiveTime: 8m9s - TotalNetworkSendTime: 350.752us - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 689 (689) - TotalThreadsTotalWallClockTime: 8m10s - TotalThreadsSysTime: 25.996ms - TotalThreadsUserTime: 665.899ms - TotalThreadsVoluntaryContextSwitches: 351 (351) Fragment Instance Lifecycle Timings: - ExecTime: 697.024us - ExecTreeExecTime: 25.632us - OpenTime: 8m10s - ExecTreeOpenTime: 8m10s - PrepareTime: 175.110ms - ExecTreePrepareTime: 9.092ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 192 (192) - BlocksRecycled: 16 (16) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 1.59 GB (1707081728) - PeakMemoryUsage: 788.38 MB (826671104) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=13):(Total: 119.229us, non-child: 119.229us, % non-child: 100.00%) - BytesSent: 356.00 B (356) - NetworkThroughput(*): 14.36 MB/sec - OverallThroughput: 2.85 MB/sec - PeakMemoryUsage: 2.61 KB (2672) - RowsReturned: 10 (10) - SerializeBatchTime: 57.963us - TransmitDataRPCTime: 23.649us - UncompressedRowBatchSize: 634.00 B (634) CodeGen:(Total: 885.058ms, non-child: 885.058ms, % non-child: 100.00%) - CodegenTime: 29.548ms - CompileTime: 116.474ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2076168) - NumFunctions: 117 (117) - NumInstructions: 2.41K (2414) - OptimizationTime: 622.331ms - PeakMemoryUsage: 1.18 MB (1235968) - PrepareTime: 145.480ms SORT_NODE (id=6):(Total: 8m10s, non-child: 16.884ms, % non-child: 0.00%) ExecOption: Codegen Enabled - InsertBatchTime: 15.906ms - PeakMemoryUsage: 12.00 KB (12288) - RowsReturned: 10 (10) - RowsReturnedRate: 0 AGGREGATION_NODE (id=12):(Total: 8m10s, non-child: 282.927ms, % non-child: 0.06%) ExecOption: Codegen Enabled - BuildTime: 211.223ms - GetNewBlockTime: 9.658ms - GetResultsTime: 53.789ms - HTResizeTime: 28.929ms - HashBuckets: 262.14K (262144) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 14.23 MB (14922606) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 141.57K (141569) - RowsReturnedRate: 288.00 /sec - SpilledPartitions: 0 (0) - UnpinTime: 2.400us EXCHANGE_NODE (id=11):(Total: 8m9s, non-child: 61.195ms, % non-child: 0.01%) BytesReceived(8s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 385.19 KB - BytesReceived: 3.80 MB (3986508) - ConvertRowBatchTime: 36.641ms - DeserializeRowBatchTimer: 54.366ms - FirstBatchArrivalWaitTime: 8m9s - PeakMemoryUsage: 0 - RowsReturned: 141.57K (141569) - RowsReturnedRate: 289.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 674b2fc81eb8bff4:b6ab0eca00000026 (host=redacted-host5:22000):(Total: 8m10s, non-child: 35.244ms, % non-child: 0.01%) MemoryUsage(8s000ms): 2.39 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB ThreadUsage(8s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 14.29 MB (14988907) - PerHostPeakMemUsage: 920.19 MB (964894132) - RowsProduced: 10 (10) - TotalNetworkReceiveTime: 8m9s - TotalNetworkSendTime: 229.991us - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 456 (456) - TotalThreadsTotalWallClockTime: 8m10s - TotalThreadsSysTime: 29.995ms - TotalThreadsUserTime: 678.897ms - TotalThreadsVoluntaryContextSwitches: 406 (406) Fragment Instance Lifecycle Timings: - ExecTime: 11.137ms - ExecTreeExecTime: 10.643ms - OpenTime: 8m10s - ExecTreeOpenTime: 8m10s - PrepareTime: 186.595ms - ExecTreePrepareTime: 47.604ms DataStreamSender (dst_id=13):(Total: 157.809us, non-child: 157.809us, % non-child: 100.00%) - BytesSent: 356.00 B (356) - NetworkThroughput(*): 8.58 MB/sec - OverallThroughput: 2.15 MB/sec - PeakMemoryUsage: 2.61 KB (2672) - RowsReturned: 10 (10) - SerializeBatchTime: 63.285us - TransmitDataRPCTime: 39.549us - UncompressedRowBatchSize: 634.00 B (634) CodeGen:(Total: 730.039ms, non-child: 730.039ms, % non-child: 100.00%) - CodegenTime: 15.679ms - CompileTime: 62.675ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2076168) - NumFunctions: 117 (117) - NumInstructions: 2.41K (2414) - OptimizationTime: 558.230ms - PeakMemoryUsage: 1.18 MB (1235968) - PrepareTime: 108.379ms SORT_NODE (id=6):(Total: 8m10s, non-child: 29.196ms, % non-child: 0.01%) ExecOption: Codegen Enabled - InsertBatchTime: 17.455ms - PeakMemoryUsage: 12.00 KB (12288) - RowsReturned: 10 (10) - RowsReturnedRate: 0 AGGREGATION_NODE (id=12):(Total: 8m10s, non-child: 312.865ms, % non-child: 0.06%) ExecOption: Codegen Enabled - BuildTime: 200.094ms - GetNewBlockTime: 12.610ms - GetResultsTime: 52.931ms - HTResizeTime: 22.317ms - HashBuckets: 262.14K (262144) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 14.23 MB (14915998) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 141.38K (141381) - RowsReturnedRate: 288.00 /sec - SpilledPartitions: 0 (0) - UnpinTime: 3.161us EXCHANGE_NODE (id=11):(Total: 8m9s, non-child: 61.559ms, % non-child: 0.01%) BytesReceived(8s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 3.80 MB (3982022) - ConvertRowBatchTime: 34.757ms - DeserializeRowBatchTimer: 56.237ms - FirstBatchArrivalWaitTime: 8m9s - PeakMemoryUsage: 0 - RowsReturned: 141.38K (141381) - RowsReturnedRate: 288.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 674b2fc81eb8bff4:b6ab0eca0000002b (host=redacted-host1:22000):(Total: 8m10s, non-child: 21.096ms, % non-child: 0.00%) MemoryUsage(8s000ms): 2.46 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB ThreadUsage(8s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 14.29 MB (14988573) - PerHostPeakMemUsage: 920.64 MB (965362430) - RowsProduced: 10 (10) - TotalNetworkReceiveTime: 8m9s - TotalNetworkSendTime: 294.906us - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 510 (510) - TotalThreadsTotalWallClockTime: 8m10s - TotalThreadsSysTime: 20.997ms - TotalThreadsUserTime: 649.901ms - TotalThreadsVoluntaryContextSwitches: 349 (349) Fragment Instance Lifecycle Timings: - ExecTime: 577.588us - ExecTreeExecTime: 29.642us - OpenTime: 8m10s - ExecTreeOpenTime: 8m10s - PrepareTime: 135.046ms - ExecTreePrepareTime: 7.776ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 192 (192) - BlocksRecycled: 16 (16) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 1.59 GB (1707081728) - PeakMemoryUsage: 788.38 MB (826671104) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=13):(Total: 211.491us, non-child: 211.491us, % non-child: 100.00%) - BytesSent: 345.00 B (345) - NetworkThroughput(*): 10.62 MB/sec - OverallThroughput: 1.56 MB/sec - PeakMemoryUsage: 2.61 KB (2672) - RowsReturned: 10 (10) - SerializeBatchTime: 61.371us - TransmitDataRPCTime: 30.973us - UncompressedRowBatchSize: 634.00 B (634) CodeGen:(Total: 850.645ms, non-child: 850.645ms, % non-child: 100.00%) - CodegenTime: 9.069ms - CompileTime: 83.009ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2076168) - NumFunctions: 117 (117) - NumInstructions: 2.41K (2414) - OptimizationTime: 647.915ms - PeakMemoryUsage: 1.18 MB (1235968) - PrepareTime: 118.897ms SORT_NODE (id=6):(Total: 8m10s, non-child: 13.991ms, % non-child: 0.00%) ExecOption: Codegen Enabled - InsertBatchTime: 13.133ms - PeakMemoryUsage: 12.00 KB (12288) - RowsReturned: 10 (10) - RowsReturnedRate: 0 AGGREGATION_NODE (id=12):(Total: 8m10s, non-child: 254.407ms, % non-child: 0.05%) ExecOption: Codegen Enabled - BuildTime: 199.904ms - GetNewBlockTime: 6.880ms - GetResultsTime: 35.632ms - HTResizeTime: 27.376ms - HashBuckets: 262.14K (262144) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 14.22 MB (14909567) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 141.15K (141148) - RowsReturnedRate: 288.00 /sec - SpilledPartitions: 0 (0) - UnpinTime: 2.777us EXCHANGE_NODE (id=11):(Total: 8m9s, non-child: 57.909ms, % non-child: 0.01%) BytesReceived(8s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 3.79 MB (3976562) - ConvertRowBatchTime: 34.853ms - DeserializeRowBatchTimer: 54.251ms - FirstBatchArrivalWaitTime: 8m9s - PeakMemoryUsage: 0 - RowsReturned: 141.15K (141148) - RowsReturnedRate: 288.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 674b2fc81eb8bff4:b6ab0eca0000002d (host=redacted-host7:22000):(Total: 8m10s, non-child: 15.389ms, % non-child: 0.00%) MemoryUsage(8s000ms): 2.39 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB ThreadUsage(8s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 14.30 MB (14999611) - PerHostPeakMemUsage: 920.96 MB (965694713) - RowsProduced: 10 (10) - TotalNetworkReceiveTime: 8m9s - TotalNetworkSendTime: 201.982us - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 846 (846) - TotalThreadsTotalWallClockTime: 8m10s - TotalThreadsSysTime: 28.996ms - TotalThreadsUserTime: 650.901ms - TotalThreadsVoluntaryContextSwitches: 373 (373) Fragment Instance Lifecycle Timings: - ExecTime: 566.034us - ExecTreeExecTime: 25.410us - OpenTime: 8m10s - ExecTreeOpenTime: 8m10s - PrepareTime: 127.354ms - ExecTreePrepareTime: 7.557ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 192 (192) - BlocksRecycled: 16 (16) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 1.59 GB (1707081728) - PeakMemoryUsage: 788.38 MB (826671104) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=13):(Total: 120.146us, non-child: 120.146us, % non-child: 100.00%) - BytesSent: 370.00 B (370) - NetworkThroughput(*): 12.21 MB/sec - OverallThroughput: 2.94 MB/sec - PeakMemoryUsage: 2.61 KB (2672) - RowsReturned: 10 (10) - SerializeBatchTime: 53.395us - TransmitDataRPCTime: 28.891us - UncompressedRowBatchSize: 634.00 B (634) CodeGen:(Total: 792.355ms, non-child: 792.355ms, % non-child: 100.00%) - CodegenTime: 14.822ms - CompileTime: 143.762ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2076168) - NumFunctions: 117 (117) - NumInstructions: 2.41K (2414) - OptimizationTime: 540.356ms - PeakMemoryUsage: 1.18 MB (1235968) - PrepareTime: 107.459ms SORT_NODE (id=6):(Total: 8m10s, non-child: 16.719ms, % non-child: 0.00%) ExecOption: Codegen Enabled - InsertBatchTime: 15.759ms - PeakMemoryUsage: 12.00 KB (12288) - RowsReturned: 10 (10) - RowsReturnedRate: 0 AGGREGATION_NODE (id=12):(Total: 8m10s, non-child: 272.318ms, % non-child: 0.06%) ExecOption: Codegen Enabled - BuildTime: 205.841ms - GetNewBlockTime: 5.134ms - GetResultsTime: 47.383ms - HTResizeTime: 26.681ms - HashBuckets: 262.14K (262144) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 14.24 MB (14926702) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 140.77K (140770) - RowsReturnedRate: 287.00 /sec - SpilledPartitions: 0 (0) - UnpinTime: 2.742us EXCHANGE_NODE (id=11):(Total: 8m9s, non-child: 64.007ms, % non-child: 0.01%) BytesReceived(8s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 3.78 MB (3965497) - ConvertRowBatchTime: 40.293ms - DeserializeRowBatchTimer: 50.177ms - FirstBatchArrivalWaitTime: 8m9s - PeakMemoryUsage: 0 - RowsReturned: 140.77K (140770) - RowsReturnedRate: 287.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 674b2fc81eb8bff4:b6ab0eca00000029 (host=redacted-host8:22000):(Total: 8m10s, non-child: 59.303ms, % non-child: 0.01%) MemoryUsage(8s000ms): 2.39 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB ThreadUsage(8s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 14.29 MB (14986193) - PerHostPeakMemUsage: 924.63 MB (969540410) - RowsProduced: 10 (10) - TotalNetworkReceiveTime: 8m9s - TotalNetworkSendTime: 206.925us - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 603 (603) - TotalThreadsTotalWallClockTime: 8m10s - TotalThreadsSysTime: 17.997ms - TotalThreadsUserTime: 672.898ms - TotalThreadsVoluntaryContextSwitches: 350 (350) Fragment Instance Lifecycle Timings: - ExecTime: 477.161us - ExecTreeExecTime: 19.297us - OpenTime: 8m10s - ExecTreeOpenTime: 8m10s - PrepareTime: 207.676ms - ExecTreePrepareTime: 2.977ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 192 (192) - BlocksRecycled: 16 (16) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 1.59 GB (1707081728) - PeakMemoryUsage: 788.38 MB (826671104) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=13):(Total: 124.939us, non-child: 124.939us, % non-child: 100.00%) - BytesSent: 353.00 B (353) - NetworkThroughput(*): 14.81 MB/sec - OverallThroughput: 2.69 MB/sec - PeakMemoryUsage: 2.61 KB (2672) - RowsReturned: 10 (10) - SerializeBatchTime: 60.312us - TransmitDataRPCTime: 22.732us - UncompressedRowBatchSize: 634.00 B (634) CodeGen:(Total: 811.513ms, non-child: 811.513ms, % non-child: 100.00%) - CodegenTime: 22.775ms - CompileTime: 113.678ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2076168) - NumFunctions: 117 (117) - NumInstructions: 2.41K (2414) - OptimizationTime: 548.403ms - PeakMemoryUsage: 1.18 MB (1235968) - PrepareTime: 131.038ms SORT_NODE (id=6):(Total: 8m10s, non-child: 15.801ms, % non-child: 0.00%) ExecOption: Codegen Enabled - InsertBatchTime: 14.923ms - PeakMemoryUsage: 12.00 KB (12288) - RowsReturned: 10 (10) - RowsReturnedRate: 0 AGGREGATION_NODE (id=12):(Total: 8m10s, non-child: 267.585ms, % non-child: 0.05%) ExecOption: Codegen Enabled - BuildTime: 202.436ms - GetNewBlockTime: 4.986ms - GetResultsTime: 52.534ms - HTResizeTime: 33.703ms - HashBuckets: 262.14K (262144) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 14.22 MB (14913284) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 141.46K (141459) - RowsReturnedRate: 288.00 /sec - SpilledPartitions: 0 (0) - UnpinTime: 2.773us EXCHANGE_NODE (id=11):(Total: 8m9s, non-child: 58.333ms, % non-child: 0.01%) BytesReceived(8s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 3.80 MB (3985143) - ConvertRowBatchTime: 35.122ms - DeserializeRowBatchTimer: 51.133ms - FirstBatchArrivalWaitTime: 8m9s - PeakMemoryUsage: 0 - RowsReturned: 141.46K (141459) - RowsReturnedRate: 288.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 674b2fc81eb8bff4:b6ab0eca00000027 (host=redacted-host4:22000):(Total: 8m10s, non-child: 17.693ms, % non-child: 0.00%) MemoryUsage(8s000ms): 2.39 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB, 2.32 MB ThreadUsage(8s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 14.29 MB (14984600) - PerHostPeakMemUsage: 920.38 MB (965090143) - RowsProduced: 10 (10) - TotalNetworkReceiveTime: 8m9s - TotalNetworkSendTime: 552.844us - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 675 (675) - TotalThreadsTotalWallClockTime: 8m10s - TotalThreadsSysTime: 25.996ms - TotalThreadsUserTime: 667.899ms - TotalThreadsVoluntaryContextSwitches: 408 (408) Fragment Instance Lifecycle Timings: - ExecTime: 934.872us - ExecTreeExecTime: 118.244us - OpenTime: 8m10s - ExecTreeOpenTime: 8m10s - PrepareTime: 152.664ms - ExecTreePrepareTime: 15.843ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 192 (192) - BlocksRecycled: 16 (16) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 1.59 GB (1707081728) - PeakMemoryUsage: 788.38 MB (826671104) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=13):(Total: 136.816us, non-child: 136.816us, % non-child: 100.00%) - BytesSent: 369.00 B (369) - NetworkThroughput(*): 16.89 MB/sec - OverallThroughput: 2.57 MB/sec - PeakMemoryUsage: 2.61 KB (2672) - RowsReturned: 10 (10) - SerializeBatchTime: 80.729us - TransmitDataRPCTime: 20.832us - UncompressedRowBatchSize: 634.00 B (634) CodeGen:(Total: 760.492ms, non-child: 760.492ms, % non-child: 100.00%) - CodegenTime: 15.646ms - CompileTime: 95.657ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2076168) - NumFunctions: 117 (117) - NumInstructions: 2.41K (2414) - OptimizationTime: 541.595ms - PeakMemoryUsage: 1.18 MB (1235968) - PrepareTime: 121.665ms SORT_NODE (id=6):(Total: 8m10s, non-child: 22.710ms, % non-child: 0.00%) ExecOption: Codegen Enabled - InsertBatchTime: 21.119ms - PeakMemoryUsage: 12.00 KB (12288) - RowsReturned: 10 (10) - RowsReturnedRate: 0 AGGREGATION_NODE (id=12):(Total: 8m10s, non-child: 279.957ms, % non-child: 0.06%) ExecOption: Codegen Enabled - BuildTime: 198.481ms - GetNewBlockTime: 13.979ms - GetResultsTime: 47.094ms - HTResizeTime: 20.593ms - HashBuckets: 262.14K (262144) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 14.22 MB (14911691) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 141.30K (141300) - RowsReturnedRate: 288.00 /sec - SpilledPartitions: 0 (0) - UnpinTime: 3.116us EXCHANGE_NODE (id=11):(Total: 8m9s, non-child: 66.195ms, % non-child: 0.01%) BytesReceived(8s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 3.80 MB (3981529) - ConvertRowBatchTime: 34.631ms - DeserializeRowBatchTimer: 52.065ms - FirstBatchArrivalWaitTime: 8m9s - PeakMemoryUsage: 0 - RowsReturned: 141.30K (141300) - RowsReturnedRate: 288.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Averaged Fragment F04:(Total: 8m10s, non-child: 366.033ms, % non-child: 0.07%) split sizes: min: 0, max: 0, avg: 0, stddev: 0 completion times: min:8m10s max:8m10s mean: 8m10s stddev:133.776ms execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec num instances: 8 - AverageThreadTokens: 1.00 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 167.78 MB (175928619) - PerHostPeakMemUsage: 920.34 MB (965044373) - RowsProduced: 141.38K (141380) - TotalNetworkReceiveTime: 8m6s - TotalNetworkSendTime: 5.761ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 1.22K (1223) - TotalThreadsTotalWallClockTime: 8m10s - TotalThreadsSysTime: 117.732ms - TotalThreadsUserTime: 2s590ms - TotalThreadsVoluntaryContextSwitches: 7.81K (7814) Fragment Instance Lifecycle Timings: - ExecTime: 3m4s - ExecTreeExecTime: 3m4s - OpenTime: 5m5s - ExecTreeOpenTime: 5m4s - PrepareTime: 243.876ms - ExecTreePrepareTime: 9.984ms DataStreamSender (dst_id=11):(Total: 170.324ms, non-child: 170.324ms, % non-child: 100.00%) - BytesSent: 3.80 MB (3982845) - NetworkThroughput(*): 133.36 MB/sec - OverallThroughput: 23.26 MB/sec - PeakMemoryUsage: 244.88 KB (250752) - RowsReturned: 141.38K (141380) - SerializeBatchTime: 141.576ms - TransmitDataRPCTime: 28.516ms - UncompressedRowBatchSize: 8.50 MB (8908656) CodeGen:(Total: 1s231ms, non-child: 1s231ms, % non-child: 100.00%) - CodegenTime: 55.737ms - CompileTime: 242.860ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2076168) - NumFunctions: 131 (131) - NumInstructions: 5.07K (5071) - OptimizationTime: 858.352ms - PeakMemoryUsage: 2.48 MB (2596352) - PrepareTime: 125.149ms AGGREGATION_NODE (id=5):(Total: 8m8s, non-child: 516.324ms, % non-child: 0.11%) - GetNewBlockTime: 10.275ms - GetResultsTime: 50.000ms - HTResizeTime: 53.437ms - HashBuckets: 262.14K (262144) - LargestPartitionPercent: 2 (2) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 13.54 MB (14201645) - PinTime: 0.000ns - ReductionFactorEstimate: 12.57 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 0 (0) - RowsReturned: 141.38K (141380) - RowsReturnedRate: 288.00 /sec - StreamingTime: 446.540ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=4):(Total: 8m8s, non-child: 1s217ms, % non-child: 0.25%) - BuildRows: 375.02K (375023) - BuildTime: 872.627ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 153.17 MB (160605372) - ProbeRows: 1.38M (1380305) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 285.099ms - RowsReturned: 373.46K (373463) - RowsReturnedRate: 764.00 /sec Hash Join Builder (join_node_id=4): - BuildRowsPartitionTime: 590.411ms - BuildRowsPartitioned: 375.02K (375023) - GetNewBlockTime: 78.951ms - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 264.512ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160453760) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=10):(Total: 4s815ms, non-child: 4s815ms, % non-child: 100.00%) - BytesReceived: 4.54 MB (4755813) - ConvertRowBatchTime: 94.983ms - DeserializeRowBatchTimer: 435.923ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 375.02K (375023) - RowsReturnedRate: 77.98 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=9):(Total: 8m2s, non-child: 8m2s, % non-child: 100.00%) - BytesReceived: 60.77 MB (63722784) - ConvertRowBatchTime: 331.031ms - DeserializeRowBatchTimer: 1s067ms - FirstBatchArrivalWaitTime: 4m58s - PeakMemoryUsage: 0 - RowsReturned: 1.38M (1380305) - RowsReturnedRate: 2.86 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 192 (192) - BlocksRecycled: 15 (15) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 1.59 GB (1707081728) - PeakMemoryUsage: 788.38 MB (826671104) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns Fragment F04: Instance 674b2fc81eb8bff4:b6ab0eca00000022 (host=redacted-host3:22000):(Total: 8m10s, non-child: 569.894ms, % non-child: 0.12%) MemoryUsage(8s000ms): 84.17 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.43 MB, 155.93 MB, 155.94 MB, 156.38 MB, 161.00 MB, 164.38 MB, 164.60 MB, 165.43 MB, 165.48 MB, 165.51 MB, 165.49 MB, 165.50 MB, 165.46 MB, 165.45 MB, 166.36 MB, 167.47 MB, 167.47 MB, 167.47 MB, 167.52 MB, 167.47 MB, 167.45 MB, 167.48 MB, 167.48 MB ThreadUsage(8s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 167.73 MB (175874473) - PerHostPeakMemUsage: 920.75 MB (965473154) - RowsProduced: 141.88K (141885) - TotalNetworkReceiveTime: 8m6s - TotalNetworkSendTime: 5.841ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 2.12K (2119) - TotalThreadsTotalWallClockTime: 8m10s - TotalThreadsSysTime: 143.978ms - TotalThreadsUserTime: 2s623ms - TotalThreadsVoluntaryContextSwitches: 7.74K (7740) Fragment Instance Lifecycle Timings: - ExecTime: 3m5s - ExecTreeExecTime: 3m4s - OpenTime: 5m5s - ExecTreeOpenTime: 5m4s - PrepareTime: 279.486ms - ExecTreePrepareTime: 17.463ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 192 (192) - BlocksRecycled: 16 (16) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 1.59 GB (1707081728) - PeakMemoryUsage: 788.38 MB (826671104) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=11):(Total: 276.657ms, non-child: 276.657ms, % non-child: 100.00%) - BytesSent: 3.81 MB (3996721) - NetworkThroughput(*): 132.09 MB/sec - OverallThroughput: 13.78 MB/sec - PeakMemoryUsage: 244.88 KB (250752) - RowsReturned: 141.88K (141885) - SerializeBatchTime: 247.557ms - TransmitDataRPCTime: 28.856ms - UncompressedRowBatchSize: 8.53 MB (8940471) CodeGen:(Total: 1s289ms, non-child: 1s289ms, % non-child: 100.00%) - CodegenTime: 48.898ms - CompileTime: 210.372ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2076168) - NumFunctions: 131 (131) - NumInstructions: 5.07K (5071) - OptimizationTime: 924.461ms - PeakMemoryUsage: 2.48 MB (2596352) - PrepareTime: 152.676ms AGGREGATION_NODE (id=5):(Total: 8m8s, non-child: 553.754ms, % non-child: 0.11%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 2.734ms - GetResultsTime: 69.141ms - HTResizeTime: 32.130ms - HashBuckets: 262.14K (262144) - LargestPartitionPercent: 2 (2) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 13.50 MB (14160160) - PinTime: 0.000ns - ReductionFactorEstimate: 12.53 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 0 (0) - RowsReturned: 141.88K (141885) - RowsReturnedRate: 290.00 /sec - StreamingTime: 460.477ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=4):(Total: 8m8s, non-child: 1s184ms, % non-child: 0.24%) ExecOption: Probe Side Codegen Enabled - BuildRows: 375.57K (375566) - BuildTime: 813.686ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 153.17 MB (160605372) - ProbeRows: 1.38M (1379347) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 282.333ms - RowsReturned: 374.48K (374476) - RowsReturnedRate: 767.00 /sec Hash Join Builder (join_node_id=4): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 556.316ms - BuildRowsPartitioned: 375.57K (375566) - GetNewBlockTime: 36.663ms - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 255.183ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160453760) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=10):(Total: 4s787ms, non-child: 142.670ms, % non-child: 2.98%) BytesReceived(8s000ms): 3.09 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB - BytesReceived: 4.54 MB (4760573) - ConvertRowBatchTime: 110.359ms - DeserializeRowBatchTimer: 524.624ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 375.57K (375566) - RowsReturnedRate: 78.44 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=9):(Total: 8m2s, non-child: 555.386ms, % non-child: 0.12%) BytesReceived(8s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 14.65 KB, 501.79 KB, 2.42 MB, 4.94 MB, 7.87 MB, 10.96 MB, 13.50 MB, 15.92 MB, 18.32 MB, 20.36 MB, 23.26 MB, 26.25 MB, 29.31 MB, 32.30 MB, 35.33 MB, 38.35 MB, 41.33 MB, 44.39 MB, 47.78 MB, 51.43 MB, 55.06 MB, 57.66 MB, 59.00 MB - BytesReceived: 60.73 MB (63680459) - ConvertRowBatchTime: 329.677ms - DeserializeRowBatchTimer: 1s135ms - FirstBatchArrivalWaitTime: 4m58s - PeakMemoryUsage: 0 - RowsReturned: 1.38M (1379347) - RowsReturnedRate: 2.86 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 674b2fc81eb8bff4:b6ab0eca00000024 (host=redacted-host6:22000):(Total: 8m10s, non-child: 375.716ms, % non-child: 0.08%) MemoryUsage(8s000ms): 83.99 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.63 MB, 156.04 MB, 156.09 MB, 156.46 MB, 163.43 MB, 164.51 MB, 164.97 MB, 165.45 MB, 165.50 MB, 165.44 MB, 165.49 MB, 165.49 MB, 165.43 MB, 165.50 MB, 166.91 MB, 167.46 MB, 167.46 MB, 167.55 MB, 167.50 MB, 167.46 MB, 167.45 MB, 167.51 MB, 167.48 MB ThreadUsage(8s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 167.72 MB (175868373) - PerHostPeakMemUsage: 920.61 MB (965327461) - RowsProduced: 141.90K (141903) - TotalNetworkReceiveTime: 8m6s - TotalNetworkSendTime: 8.960ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 1.49K (1489) - TotalThreadsTotalWallClockTime: 8m10s - TotalThreadsSysTime: 104.984ms - TotalThreadsUserTime: 2s607ms - TotalThreadsVoluntaryContextSwitches: 7.84K (7843) Fragment Instance Lifecycle Timings: - ExecTime: 3m4s - ExecTreeExecTime: 3m4s - OpenTime: 5m5s - ExecTreeOpenTime: 5m4s - PrepareTime: 257.991ms - ExecTreePrepareTime: 5.643ms DataStreamSender (dst_id=11):(Total: 165.845ms, non-child: 165.845ms, % non-child: 100.00%) - BytesSent: 3.81 MB (3997974) - NetworkThroughput(*): 136.87 MB/sec - OverallThroughput: 22.99 MB/sec - PeakMemoryUsage: 244.88 KB (250752) - RowsReturned: 141.90K (141903) - SerializeBatchTime: 137.748ms - TransmitDataRPCTime: 27.856ms - UncompressedRowBatchSize: 8.53 MB (8941605) CodeGen:(Total: 1s080ms, non-child: 1s080ms, % non-child: 100.00%) - CodegenTime: 63.603ms - CompileTime: 272.201ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2076168) - NumFunctions: 131 (131) - NumInstructions: 5.07K (5071) - OptimizationTime: 676.433ms - PeakMemoryUsage: 2.48 MB (2596352) - PrepareTime: 130.629ms AGGREGATION_NODE (id=5):(Total: 8m8s, non-child: 653.086ms, % non-child: 0.13%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 38.788ms - GetResultsTime: 53.622ms - HTResizeTime: 30.182ms - HashBuckets: 262.14K (262144) - LargestPartitionPercent: 2 (2) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 13.49 MB (14145244) - PinTime: 0.000ns - ReductionFactorEstimate: 12.56 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 0 (0) - RowsReturned: 141.90K (141903) - RowsReturnedRate: 290.00 /sec - StreamingTime: 578.962ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=4):(Total: 8m8s, non-child: 1s155ms, % non-child: 0.24%) ExecOption: Probe Side Codegen Enabled - BuildRows: 374.21K (374209) - BuildTime: 812.884ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 153.17 MB (160605372) - ProbeRows: 1.38M (1380489) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 281.520ms - RowsReturned: 374.79K (374793) - RowsReturnedRate: 767.00 /sec Hash Join Builder (join_node_id=4): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 579.770ms - BuildRowsPartitioned: 374.21K (374209) - GetNewBlockTime: 85.082ms - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 218.392ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160453760) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=10):(Total: 4s970ms, non-child: 156.064ms, % non-child: 3.14%) BytesReceived(8s000ms): 3.08 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB - BytesReceived: 4.53 MB (4745331) - ConvertRowBatchTime: 84.158ms - DeserializeRowBatchTimer: 359.146ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 374.21K (374209) - RowsReturnedRate: 75.28 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=9):(Total: 8m2s, non-child: 573.840ms, % non-child: 0.12%) BytesReceived(8s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 111.46 KB, 929.72 KB, 3.24 MB, 5.83 MB, 8.95 MB, 11.86 MB, 14.30 MB, 16.87 MB, 18.90 MB, 21.12 MB, 24.03 MB, 27.02 MB, 30.07 MB, 33.06 MB, 36.11 MB, 39.16 MB, 42.16 MB, 45.27 MB, 48.74 MB, 52.44 MB, 55.93 MB, 58.11 MB, 59.38 MB - BytesReceived: 60.79 MB (63741230) - ConvertRowBatchTime: 329.492ms - DeserializeRowBatchTimer: 1s028ms - FirstBatchArrivalWaitTime: 4m58s - PeakMemoryUsage: 0 - RowsReturned: 1.38M (1380489) - RowsReturnedRate: 2.86 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 674b2fc81eb8bff4:b6ab0eca00000023 (host=redacted-host1:22000):(Total: 8m10s, non-child: 366.075ms, % non-child: 0.07%) MemoryUsage(8s000ms): 84.01 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.55 MB, 156.01 MB, 156.06 MB, 156.44 MB, 162.33 MB, 164.49 MB, 164.72 MB, 165.46 MB, 165.51 MB, 165.46 MB, 165.51 MB, 165.45 MB, 165.49 MB, 165.47 MB, 166.52 MB, 167.46 MB, 167.46 MB, 167.47 MB, 167.47 MB, 167.50 MB, 167.46 MB, 167.47 MB, 167.49 MB ThreadUsage(8s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 167.80 MB (175946381) - PerHostPeakMemUsage: 920.64 MB (965362430) - RowsProduced: 141.57K (141571) - TotalNetworkReceiveTime: 8m6s - TotalNetworkSendTime: 5.104ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 995 (995) - TotalThreadsTotalWallClockTime: 8m10s - TotalThreadsSysTime: 107.983ms - TotalThreadsUserTime: 2s586ms - TotalThreadsVoluntaryContextSwitches: 7.82K (7819) Fragment Instance Lifecycle Timings: - ExecTime: 3m4s - ExecTreeExecTime: 3m4s - OpenTime: 5m5s - ExecTreeOpenTime: 5m4s - PrepareTime: 215.686ms - ExecTreePrepareTime: 15.326ms DataStreamSender (dst_id=11):(Total: 155.481ms, non-child: 155.481ms, % non-child: 100.00%) - BytesSent: 3.80 MB (3988499) - NetworkThroughput(*): 133.64 MB/sec - OverallThroughput: 24.46 MB/sec - PeakMemoryUsage: 244.88 KB (250752) - RowsReturned: 141.57K (141571) - SerializeBatchTime: 126.791ms - TransmitDataRPCTime: 28.463ms - UncompressedRowBatchSize: 8.51 MB (8920685) CodeGen:(Total: 1s125ms, non-child: 1s125ms, % non-child: 100.00%) - CodegenTime: 49.468ms - CompileTime: 184.925ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2076168) - NumFunctions: 131 (131) - NumInstructions: 5.07K (5071) - OptimizationTime: 850.316ms - PeakMemoryUsage: 2.48 MB (2596352) - PrepareTime: 89.565ms AGGREGATION_NODE (id=5):(Total: 8m8s, non-child: 503.671ms, % non-child: 0.10%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 10.298ms - GetResultsTime: 49.978ms - HTResizeTime: 128.527ms - HashBuckets: 262.14K (262144) - LargestPartitionPercent: 2 (2) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 13.55 MB (14211770) - PinTime: 0.000ns - ReductionFactorEstimate: 12.63 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 0 (0) - RowsReturned: 141.57K (141571) - RowsReturnedRate: 289.00 /sec - StreamingTime: 429.918ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=4):(Total: 8m8s, non-child: 1s132ms, % non-child: 0.23%) ExecOption: Probe Side Codegen Enabled - BuildRows: 375.54K (375538) - BuildTime: 781.287ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 153.17 MB (160605372) - ProbeRows: 1.38M (1381703) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 287.125ms - RowsReturned: 374.48K (374482) - RowsReturnedRate: 766.00 /sec Hash Join Builder (join_node_id=4): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 572.392ms - BuildRowsPartitioned: 375.54K (375538) - GetNewBlockTime: 50.803ms - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 203.564ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160453760) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=10):(Total: 4s951ms, non-child: 111.540ms, % non-child: 2.25%) BytesReceived(8s000ms): 3.10 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB - BytesReceived: 4.54 MB (4761516) - ConvertRowBatchTime: 85.282ms - DeserializeRowBatchTimer: 433.170ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 375.54K (375538) - RowsReturnedRate: 75.84 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=9):(Total: 8m2s, non-child: 571.320ms, % non-child: 0.12%) BytesReceived(8s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 72.28 KB, 726.80 KB, 2.94 MB, 5.51 MB, 8.58 MB, 11.53 MB, 14.01 MB, 16.55 MB, 18.69 MB, 20.71 MB, 23.66 MB, 26.66 MB, 29.70 MB, 32.67 MB, 35.73 MB, 38.78 MB, 41.77 MB, 44.82 MB, 48.24 MB, 51.90 MB, 55.51 MB, 57.92 MB, 59.24 MB - BytesReceived: 60.84 MB (63798256) - ConvertRowBatchTime: 329.222ms - DeserializeRowBatchTimer: 1s027ms - FirstBatchArrivalWaitTime: 4m58s - PeakMemoryUsage: 0 - RowsReturned: 1.38M (1381703) - RowsReturnedRate: 2.86 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 674b2fc81eb8bff4:b6ab0eca00000021 (host=redacted-host8:22000):(Total: 8m10s, non-child: 339.782ms, % non-child: 0.07%) MemoryUsage(8s000ms): 84.43 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.48 MB, 155.97 MB, 155.98 MB, 156.45 MB, 161.47 MB, 164.43 MB, 164.66 MB, 165.44 MB, 165.48 MB, 165.49 MB, 165.45 MB, 165.50 MB, 165.51 MB, 165.47 MB, 166.28 MB, 167.45 MB, 167.50 MB, 167.51 MB, 167.43 MB, 167.49 MB, 167.43 MB, 167.44 MB, 167.52 MB ThreadUsage(8s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 167.72 MB (175868373) - PerHostPeakMemUsage: 924.63 MB (969540410) - RowsProduced: 141.74K (141737) - TotalNetworkReceiveTime: 8m6s - TotalNetworkSendTime: 3.362ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 1.10K (1096) - TotalThreadsTotalWallClockTime: 8m10s - TotalThreadsSysTime: 109.983ms - TotalThreadsUserTime: 2s645ms - TotalThreadsVoluntaryContextSwitches: 7.88K (7877) Fragment Instance Lifecycle Timings: - ExecTime: 3m4s - ExecTreeExecTime: 3m4s - OpenTime: 5m5s - ExecTreeOpenTime: 5m4s - PrepareTime: 223.936ms - ExecTreePrepareTime: 1.127ms DataStreamSender (dst_id=11):(Total: 167.363ms, non-child: 167.363ms, % non-child: 100.00%) - BytesSent: 3.81 MB (3994030) - NetworkThroughput(*): 135.36 MB/sec - OverallThroughput: 22.76 MB/sec - PeakMemoryUsage: 244.88 KB (250752) - RowsReturned: 141.74K (141737) - SerializeBatchTime: 139.018ms - TransmitDataRPCTime: 28.140ms - UncompressedRowBatchSize: 8.52 MB (8931143) CodeGen:(Total: 1s374ms, non-child: 1s374ms, % non-child: 100.00%) - CodegenTime: 25.543ms - CompileTime: 226.500ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2076168) - NumFunctions: 131 (131) - NumInstructions: 5.07K (5071) - OptimizationTime: 1s008ms - PeakMemoryUsage: 2.48 MB (2596352) - PrepareTime: 132.486ms AGGREGATION_NODE (id=5):(Total: 8m8s, non-child: 475.188ms, % non-child: 0.10%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 223.949us - GetResultsTime: 53.100ms - HTResizeTime: 40.365ms - HashBuckets: 262.14K (262144) - LargestPartitionPercent: 2 (2) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 13.48 MB (14139862) - PinTime: 0.000ns - ReductionFactorEstimate: 12.62 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 0 (0) - RowsReturned: 141.74K (141737) - RowsReturnedRate: 290.00 /sec - StreamingTime: 406.745ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=4):(Total: 8m8s, non-child: 1s343ms, % non-child: 0.28%) ExecOption: Probe Side Codegen Enabled - BuildRows: 375.14K (375142) - BuildTime: 987.845ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 153.17 MB (160605372) - ProbeRows: 1.38M (1383233) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 295.691ms - RowsReturned: 374.82K (374817) - RowsReturnedRate: 767.00 /sec Hash Join Builder (join_node_id=4): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 718.312ms - BuildRowsPartitioned: 375.14K (375142) - GetNewBlockTime: 136.393ms - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 234.289ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160453760) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=10):(Total: 4s522ms, non-child: 175.179ms, % non-child: 3.87%) BytesReceived(8s000ms): 3.15 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB - BytesReceived: 4.54 MB (4758634) - ConvertRowBatchTime: 94.906ms - DeserializeRowBatchTimer: 503.987ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 375.14K (375142) - RowsReturnedRate: 82.95 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=9):(Total: 8m2s, non-child: 581.895ms, % non-child: 0.12%) BytesReceived(8s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 37.91 KB, 583.35 KB, 2.63 MB, 5.14 MB, 8.15 MB, 11.17 MB, 13.72 MB, 16.21 MB, 18.51 MB, 20.41 MB, 23.31 MB, 26.29 MB, 29.33 MB, 32.31 MB, 35.36 MB, 38.42 MB, 41.41 MB, 44.46 MB, 47.85 MB, 51.55 MB, 55.18 MB, 57.78 MB, 59.14 MB - BytesReceived: 60.89 MB (63842873) - ConvertRowBatchTime: 338.541ms - DeserializeRowBatchTimer: 1s066ms - FirstBatchArrivalWaitTime: 4m58s - PeakMemoryUsage: 0 - RowsReturned: 1.38M (1383233) - RowsReturnedRate: 2.87 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 674b2fc81eb8bff4:b6ab0eca00000025 (host=redacted-host7:22000):(Total: 8m10s, non-child: 352.372ms, % non-child: 0.07%) MemoryUsage(8s000ms): 84.21 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.50 MB, 156.01 MB, 155.99 MB, 156.51 MB, 161.46 MB, 164.50 MB, 164.64 MB, 165.46 MB, 165.44 MB, 165.47 MB, 165.51 MB, 165.43 MB, 165.44 MB, 165.47 MB, 166.17 MB, 167.47 MB, 167.47 MB, 167.50 MB, 167.47 MB, 167.49 MB, 167.48 MB, 167.45 MB, 167.48 MB ThreadUsage(8s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 167.82 MB (175975963) - PerHostPeakMemUsage: 920.96 MB (965694713) - RowsProduced: 140.52K (140516) - TotalNetworkReceiveTime: 8m6s - TotalNetworkSendTime: 3.127ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 1.06K (1059) - TotalThreadsTotalWallClockTime: 8m10s - TotalThreadsSysTime: 109.984ms - TotalThreadsUserTime: 2s578ms - TotalThreadsVoluntaryContextSwitches: 7.74K (7743) Fragment Instance Lifecycle Timings: - ExecTime: 3m4s - ExecTreeExecTime: 3m4s - OpenTime: 5m5s - ExecTreeOpenTime: 5m4s - PrepareTime: 230.776ms - ExecTreePrepareTime: 1.339ms DataStreamSender (dst_id=11):(Total: 162.062ms, non-child: 162.062ms, % non-child: 100.00%) - BytesSent: 3.78 MB (3959804) - NetworkThroughput(*): 137.11 MB/sec - OverallThroughput: 23.30 MB/sec - PeakMemoryUsage: 244.88 KB (250752) - RowsReturned: 140.52K (140516) - SerializeBatchTime: 134.294ms - TransmitDataRPCTime: 27.543ms - UncompressedRowBatchSize: 8.44 MB (8854208) CodeGen:(Total: 1s111ms, non-child: 1s111ms, % non-child: 100.00%) - CodegenTime: 51.445ms - CompileTime: 190.462ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2076168) - NumFunctions: 131 (131) - NumInstructions: 5.07K (5071) - OptimizationTime: 807.767ms - PeakMemoryUsage: 2.48 MB (2596352) - PrepareTime: 112.128ms AGGREGATION_NODE (id=5):(Total: 8m8s, non-child: 637.133ms, % non-child: 0.13%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 3.172ms - GetResultsTime: 47.620ms - HTResizeTime: 58.750ms - HashBuckets: 262.14K (262144) - LargestPartitionPercent: 2 (2) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 13.58 MB (14241352) - PinTime: 0.000ns - ReductionFactorEstimate: 12.56 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 0 (0) - RowsReturned: 140.52K (140516) - RowsReturnedRate: 287.00 /sec - StreamingTime: 574.452ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=4):(Total: 8m8s, non-child: 1s184ms, % non-child: 0.24%) ExecOption: Probe Side Codegen Enabled - BuildRows: 375.63K (375632) - BuildTime: 859.387ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 153.17 MB (160605372) - ProbeRows: 1.38M (1378359) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 290.605ms - RowsReturned: 370.84K (370841) - RowsReturnedRate: 759.00 /sec Hash Join Builder (join_node_id=4): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 598.841ms - BuildRowsPartitioned: 375.63K (375632) - GetNewBlockTime: 98.249ms - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 233.526ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160453760) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=10):(Total: 4s928ms, non-child: 141.493ms, % non-child: 2.87%) BytesReceived(8s000ms): 3.14 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB, 4.54 MB - BytesReceived: 4.54 MB (4764800) - ConvertRowBatchTime: 92.568ms - DeserializeRowBatchTimer: 404.405ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 375.63K (375632) - RowsReturnedRate: 76.21 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=9):(Total: 8m2s, non-child: 564.611ms, % non-child: 0.12%) BytesReceived(8s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 44.62 KB, 594.78 KB, 2.70 MB, 5.22 MB, 8.21 MB, 11.21 MB, 13.72 MB, 16.21 MB, 18.45 MB, 20.37 MB, 23.30 MB, 26.29 MB, 29.33 MB, 32.34 MB, 35.40 MB, 38.41 MB, 41.40 MB, 44.47 MB, 47.89 MB, 51.52 MB, 55.12 MB, 57.66 MB, 59.00 MB - BytesReceived: 60.68 MB (63632466) - ConvertRowBatchTime: 328.348ms - DeserializeRowBatchTimer: 1s081ms - FirstBatchArrivalWaitTime: 4m58s - PeakMemoryUsage: 0 - RowsReturned: 1.38M (1378359) - RowsReturnedRate: 2.86 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 674b2fc81eb8bff4:b6ab0eca0000001f (host=redacted-host4:22000):(Total: 8m10s, non-child: 320.620ms, % non-child: 0.07%) MemoryUsage(8s000ms): 84.32 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.43 MB, 156.00 MB, 156.02 MB, 156.38 MB, 161.02 MB, 164.43 MB, 164.64 MB, 165.48 MB, 165.48 MB, 165.48 MB, 165.55 MB, 165.49 MB, 165.47 MB, 165.48 MB, 166.16 MB, 167.46 MB, 167.45 MB, 167.47 MB, 167.50 MB, 167.44 MB, 167.49 MB, 167.45 MB, 167.44 MB ThreadUsage(8s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 167.82 MB (175975963) - PerHostPeakMemUsage: 920.38 MB (965090143) - RowsProduced: 140.92K (140921) - TotalNetworkReceiveTime: 8m6s - TotalNetworkSendTime: 4.279ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 1.29K (1291) - TotalThreadsTotalWallClockTime: 8m10s - TotalThreadsSysTime: 142.978ms - TotalThreadsUserTime: 2s586ms - TotalThreadsVoluntaryContextSwitches: 7.84K (7837) Fragment Instance Lifecycle Timings: - ExecTime: 3m4s - ExecTreeExecTime: 3m4s - OpenTime: 5m5s - ExecTreeOpenTime: 5m4s - PrepareTime: 270.150ms - ExecTreePrepareTime: 23.825ms DataStreamSender (dst_id=11):(Total: 158.913ms, non-child: 158.913ms, % non-child: 100.00%) - BytesSent: 3.79 MB (3969506) - NetworkThroughput(*): 134.69 MB/sec - OverallThroughput: 23.82 MB/sec - PeakMemoryUsage: 244.88 KB (250752) - RowsReturned: 140.92K (140921) - SerializeBatchTime: 130.537ms - TransmitDataRPCTime: 28.105ms - UncompressedRowBatchSize: 8.47 MB (8879727) CodeGen:(Total: 1s348ms, non-child: 1s348ms, % non-child: 100.00%) - CodegenTime: 100.310ms - CompileTime: 209.864ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2076168) - NumFunctions: 131 (131) - NumInstructions: 5.07K (5071) - OptimizationTime: 983.391ms - PeakMemoryUsage: 2.48 MB (2596352) - PrepareTime: 126.086ms AGGREGATION_NODE (id=5):(Total: 8m8s, non-child: 460.042ms, % non-child: 0.09%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 8.281ms - GetResultsTime: 47.214ms - HTResizeTime: 50.105ms - HashBuckets: 262.14K (262144) - LargestPartitionPercent: 2 (2) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 13.58 MB (14241352) - PinTime: 0.000ns - ReductionFactorEstimate: 12.57 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 0 (0) - RowsReturned: 140.92K (140921) - RowsReturnedRate: 288.00 /sec - StreamingTime: 386.271ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=4):(Total: 8m8s, non-child: 1s461ms, % non-child: 0.30%) ExecOption: Probe Side Codegen Enabled - BuildRows: 374.80K (374796) - BuildTime: 1s115ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 153.17 MB (160605372) - ProbeRows: 1.38M (1382328) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 282.846ms - RowsReturned: 372.99K (372993) - RowsReturnedRate: 764.00 /sec Hash Join Builder (join_node_id=4): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 699.074ms - BuildRowsPartitioned: 374.80K (374796) - GetNewBlockTime: 97.715ms - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 386.890ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160453760) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=10):(Total: 4s566ms, non-child: 213.929ms, % non-child: 4.68%) BytesReceived(8s000ms): 3.12 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB - BytesReceived: 4.53 MB (4751329) - ConvertRowBatchTime: 95.836ms - DeserializeRowBatchTimer: 461.000ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 374.80K (374796) - RowsReturnedRate: 82.08 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=9):(Total: 8m2s, non-child: 560.549ms, % non-child: 0.12%) BytesReceived(8s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 14.08 KB, 482.21 KB, 2.42 MB, 4.96 MB, 7.92 MB, 10.99 MB, 13.54 MB, 15.98 MB, 18.39 MB, 20.45 MB, 23.32 MB, 26.27 MB, 29.32 MB, 32.31 MB, 35.36 MB, 38.39 MB, 41.40 MB, 44.48 MB, 47.87 MB, 51.51 MB, 55.14 MB, 57.71 MB, 59.07 MB - BytesReceived: 60.84 MB (63792058) - ConvertRowBatchTime: 331.500ms - DeserializeRowBatchTimer: 1s091ms - FirstBatchArrivalWaitTime: 4m58s - PeakMemoryUsage: 0 - RowsReturned: 1.38M (1382328) - RowsReturnedRate: 2.87 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 674b2fc81eb8bff4:b6ab0eca00000020 (host=redacted-host2:22000):(Total: 8m10s, non-child: 316.055ms, % non-child: 0.06%) MemoryUsage(8s000ms): 84.04 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.44 MB, 156.02 MB, 155.99 MB, 156.41 MB, 160.90 MB, 164.44 MB, 164.60 MB, 165.43 MB, 165.50 MB, 165.51 MB, 165.47 MB, 165.48 MB, 165.46 MB, 165.52 MB, 166.18 MB, 167.46 MB, 167.50 MB, 167.50 MB, 167.44 MB, 167.42 MB, 167.48 MB, 167.45 MB, 167.50 MB ThreadUsage(8s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 167.80 MB (175949565) - PerHostPeakMemUsage: 914.55 MB (958972542) - RowsProduced: 141.51K (141509) - TotalNetworkReceiveTime: 8m6s - TotalNetworkSendTime: 4.248ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 912 (912) - TotalThreadsTotalWallClockTime: 8m10s - TotalThreadsSysTime: 101.985ms - TotalThreadsUserTime: 2s548ms - TotalThreadsVoluntaryContextSwitches: 7.89K (7890) Fragment Instance Lifecycle Timings: - ExecTime: 3m4s - ExecTreeExecTime: 3m4s - OpenTime: 5m5s - ExecTreeOpenTime: 5m4s - PrepareTime: 246.504ms - ExecTreePrepareTime: 5.424ms DataStreamSender (dst_id=11):(Total: 140.759ms, non-child: 140.759ms, % non-child: 100.00%) - BytesSent: 3.80 MB (3985892) - NetworkThroughput(*): 135.01 MB/sec - OverallThroughput: 27.01 MB/sec - PeakMemoryUsage: 244.88 KB (250752) - RowsReturned: 141.51K (141509) - SerializeBatchTime: 112.386ms - TransmitDataRPCTime: 28.155ms - UncompressedRowBatchSize: 8.50 MB (8916775) CodeGen:(Total: 1s260ms, non-child: 1s260ms, % non-child: 100.00%) - CodegenTime: 60.312ms - CompileTime: 281.083ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2076168) - NumFunctions: 131 (131) - NumInstructions: 5.07K (5071) - OptimizationTime: 842.262ms - PeakMemoryUsage: 2.48 MB (2596352) - PrepareTime: 136.542ms AGGREGATION_NODE (id=5):(Total: 8m8s, non-child: 416.058ms, % non-child: 0.09%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 15.947ms - GetResultsTime: 42.669ms - HTResizeTime: 46.727ms - HashBuckets: 262.14K (262144) - LargestPartitionPercent: 2 (2) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 13.57 MB (14232068) - PinTime: 0.000ns - ReductionFactorEstimate: 12.60 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 0 (0) - RowsReturned: 141.51K (141509) - RowsReturnedRate: 289.00 /sec - StreamingTime: 358.668ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=4):(Total: 8m8s, non-child: 1s166ms, % non-child: 0.24%) ExecOption: Probe Side Codegen Enabled - BuildRows: 374.68K (374681) - BuildTime: 838.263ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 153.17 MB (160605372) - ProbeRows: 1.38M (1378725) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 278.287ms - RowsReturned: 373.94K (373942) - RowsReturnedRate: 765.00 /sec Hash Join Builder (join_node_id=4): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 511.323ms - BuildRowsPartitioned: 374.68K (374681) - GetNewBlockTime: 84.679ms - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 305.621ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160453760) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=10):(Total: 4s880ms, non-child: 130.595ms, % non-child: 2.68%) BytesReceived(8s000ms): 3.07 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB - BytesReceived: 4.53 MB (4751237) - ConvertRowBatchTime: 82.739ms - DeserializeRowBatchTimer: 441.083ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 374.68K (374681) - RowsReturnedRate: 76.78 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=9):(Total: 8m2s, non-child: 537.898ms, % non-child: 0.11%) BytesReceived(8s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 19.19 KB, 524.11 KB, 2.48 MB, 4.98 MB, 7.96 MB, 11.03 MB, 13.57 MB, 16.04 MB, 18.38 MB, 20.20 MB, 23.10 MB, 26.04 MB, 29.10 MB, 32.10 MB, 35.12 MB, 38.16 MB, 41.19 MB, 44.24 MB, 47.56 MB, 51.21 MB, 54.84 MB, 57.52 MB, 58.91 MB - BytesReceived: 60.71 MB (63658654) - ConvertRowBatchTime: 327.124ms - DeserializeRowBatchTimer: 1s067ms - FirstBatchArrivalWaitTime: 4m58s - PeakMemoryUsage: 0 - RowsReturned: 1.38M (1378725) - RowsReturnedRate: 2.86 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 674b2fc81eb8bff4:b6ab0eca0000001e (host=redacted-host5:22000):(Total: 8m10s, non-child: 287.749ms, % non-child: 0.06%) MemoryUsage(8s000ms): 84.42 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.40 MB, 155.41 MB, 155.97 MB, 156.01 MB, 156.45 MB, 160.32 MB, 164.49 MB, 164.58 MB, 165.46 MB, 165.47 MB, 165.41 MB, 165.51 MB, 165.48 MB, 165.46 MB, 165.44 MB, 166.20 MB, 167.45 MB, 167.44 MB, 167.50 MB, 167.48 MB, 167.47 MB, 167.50 MB, 167.49 MB, 167.47 MB ThreadUsage(8s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 167.82 MB (175969863) - PerHostPeakMemUsage: 920.19 MB (964894132) - RowsProduced: 141.00K (140999) - TotalNetworkReceiveTime: 8m6s - TotalNetworkSendTime: 11.171ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 824 (824) - TotalThreadsTotalWallClockTime: 8m10s - TotalThreadsSysTime: 119.982ms - TotalThreadsUserTime: 2s545ms - TotalThreadsVoluntaryContextSwitches: 7.77K (7768) Fragment Instance Lifecycle Timings: - ExecTime: 3m4s - ExecTreeExecTime: 3m4s - OpenTime: 5m5s - ExecTreeOpenTime: 5m4s - PrepareTime: 226.479ms - ExecTreePrepareTime: 9.727ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 192 (192) - BlocksRecycled: 15 (15) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 1.59 GB (1707081728) - PeakMemoryUsage: 788.38 MB (826671104) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=11):(Total: 135.512ms, non-child: 135.512ms, % non-child: 100.00%) - BytesSent: 3.79 MB (3970338) - NetworkThroughput(*): 122.10 MB/sec - OverallThroughput: 27.94 MB/sec - PeakMemoryUsage: 244.88 KB (250752) - RowsReturned: 141.00K (140999) - SerializeBatchTime: 104.281ms - TransmitDataRPCTime: 31.010ms - UncompressedRowBatchSize: 8.47 MB (8884637) CodeGen:(Total: 1s262ms, non-child: 1s262ms, % non-child: 100.00%) - CodegenTime: 46.319ms - CompileTime: 367.477ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2076168) - NumFunctions: 131 (131) - NumInstructions: 5.07K (5071) - OptimizationTime: 773.204ms - PeakMemoryUsage: 2.48 MB (2596352) - PrepareTime: 121.079ms AGGREGATION_NODE (id=5):(Total: 8m8s, non-child: 431.660ms, % non-child: 0.09%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 2.755ms - GetResultsTime: 36.659ms - HTResizeTime: 40.711ms - HashBuckets: 262.14K (262144) - LargestPartitionPercent: 2 (2) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 13.58 MB (14241352) - PinTime: 0.000ns - ReductionFactorEstimate: 12.49 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 0 (0) - RowsReturned: 141.00K (140999) - RowsReturnedRate: 288.00 /sec - StreamingTime: 376.825ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=4):(Total: 8m8s, non-child: 1s112ms, % non-child: 0.23%) ExecOption: Probe Side Codegen Enabled - BuildRows: 374.62K (374624) - BuildTime: 772.351ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 153.17 MB (160605372) - ProbeRows: 1.38M (1378257) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 282.382ms - RowsReturned: 371.36K (371361) - RowsReturnedRate: 760.00 /sec Hash Join Builder (join_node_id=4): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 487.258ms - BuildRowsPartitioned: 374.62K (374624) - GetNewBlockTime: 42.020ms - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 278.632ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160453760) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=10):(Total: 4s912ms, non-child: 135.724ms, % non-child: 2.76%) BytesReceived(8s000ms): 3.16 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB, 4.53 MB - BytesReceived: 4.53 MB (4753090) - ConvertRowBatchTime: 114.020ms - DeserializeRowBatchTimer: 359.967ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 374.62K (374624) - RowsReturnedRate: 76.27 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=9):(Total: 8m2s, non-child: 561.034ms, % non-child: 0.12%) BytesReceived(8s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 5.66 KB, 478.92 KB, 2.33 MB, 4.85 MB, 7.74 MB, 10.83 MB, 13.42 MB, 15.86 MB, 18.28 MB, 20.29 MB, 23.14 MB, 26.12 MB, 29.16 MB, 32.15 MB, 35.18 MB, 38.18 MB, 41.20 MB, 44.23 MB, 47.57 MB, 51.23 MB, 54.87 MB, 57.52 MB, 58.91 MB - BytesReceived: 60.69 MB (63636280) - ConvertRowBatchTime: 334.341ms - DeserializeRowBatchTimer: 1s039ms - FirstBatchArrivalWaitTime: 4m58s - PeakMemoryUsage: 0 - RowsReturned: 1.38M (1378257) - RowsReturnedRate: 2.86 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Averaged Fragment F02:(Total: 8m9s, non-child: 3s525ms, % non-child: 0.72%) split sizes: min: 0, max: 0, avg: 0, stddev: 0 completion times: min:8m9s max:8m10s mean: 8m10s stddev:22.775ms execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec num instances: 8 - AverageThreadTokens: 1.00 - BloomFilterBytes: 8.00 MB (8388608) - PeakMemoryUsage: 680.55 MB (713603368) - PerHostPeakMemUsage: 920.34 MB (965044373) - RowsProduced: 1.38M (1380305) - TotalNetworkReceiveTime: 7m25s - TotalNetworkSendTime: 13.427ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 21.76K (21757) - TotalThreadsTotalWallClockTime: 8m9s - TotalThreadsSysTime: 1s864ms - TotalThreadsUserTime: 32s191ms - TotalThreadsVoluntaryContextSwitches: 102.25K (102252) Fragment Instance Lifecycle Timings: - ExecTime: 3m1s - ExecTreeExecTime: 2m55s - OpenTime: 5m7s - ExecTreeOpenTime: 5m7s - PrepareTime: 197.096ms - ExecTreePrepareTime: 1.911ms DataStreamSender (dst_id=9):(Total: 3s150ms, non-child: 3s150ms, % non-child: 100.00%) - BytesSent: 60.77 MB (63722784) - NetworkThroughput(*): 122.59 MB/sec - OverallThroughput: 19.29 MB/sec - PeakMemoryUsage: 248.88 KB (254848) - RowsReturned: 1.38M (1380305) - SerializeBatchTime: 2s651ms - TransmitDataRPCTime: 495.730ms - UncompressedRowBatchSize: 144.85 MB (151889090) CodeGen:(Total: 736.719ms, non-child: 736.719ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 108.445ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2076168) - NumFunctions: 54 (54) - NumInstructions: 2.41K (2406) - OptimizationTime: 521.263ms - PeakMemoryUsage: 1.17 MB (1231872) - PrepareTime: 105.807ms HASH_JOIN_NODE (id=3):(Total: 8m2s, non-child: 24s420ms, % non-child: 5.06%) - BuildRows: 6.72M (6724470) - BuildTime: 17s704ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 649.10 MB (680632931) - ProbeRows: 40.44M (40436380) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 5s849ms - RowsReturned: 1.38M (1380305) - RowsReturnedRate: 2.86 K/sec Hash Join Builder (join_node_id=3): - BuildRowsPartitionTime: 11s258ms - BuildRowsPartitioned: 6.72M (6724470) - GetNewBlockTime: 136.654ms - HashBuckets: 16.78M (16777216) - HashCollisions: 0 (0) - HashTablesBuildTime: 6s387ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 649.02 MB (680547456) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=8):(Total: 4m49s, non-child: 4m49s, % non-child: 100.00%) - BytesReceived: 161.99 MB (169860296) - ConvertRowBatchTime: 1s577ms - DeserializeRowBatchTimer: 4s545ms - FirstBatchArrivalWaitTime: 280.644ms - PeakMemoryUsage: 0 - RowsReturned: 6.72M (6724470) - RowsReturnedRate: 23.23 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=7):(Total: 2m48s, non-child: 2m48s, % non-child: 100.00%) - BytesReceived: 946.86 MB (992853323) - ConvertRowBatchTime: 9s540ms - DeserializeRowBatchTimer: 15s032ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 40.44M (40436380) - RowsReturnedRate: 239.80 K/sec - SendersBlockedTimer: 4m26s - SendersBlockedTotalTimer(*): 23m32s Fragment F02: Instance 674b2fc81eb8bff4:b6ab0eca00000016 (host=redacted-host1:22000):(Total: 8m10s, non-child: 3s372ms, % non-child: 0.69%) MemoryUsage(8s000ms): 102.45 MB, 168.48 MB, 251.98 MB, 296.47 MB, 296.48 MB, 328.48 MB, 424.47 MB, 424.47 MB, 424.47 MB, 424.49 MB, 424.49 MB, 424.49 MB, 424.49 MB, 424.49 MB, 424.49 MB, 424.49 MB, 424.46 MB, 424.47 MB, 424.47 MB, 424.47 MB, 424.47 MB, 424.47 MB, 424.47 MB, 424.47 MB, 424.47 MB, 424.47 MB, 424.47 MB, 424.47 MB, 424.47 MB, 424.47 MB, 424.47 MB, 424.47 MB, 424.47 MB, 424.47 MB, 424.47 MB, 424.47 MB, 424.47 MB, 496.44 MB, 652.63 MB, 658.00 MB, 658.19 MB, 657.94 MB, 658.09 MB, 658.11 MB, 657.96 MB, 658.13 MB, 658.11 MB, 658.17 MB, 658.17 MB, 658.05 MB, 657.86 MB, 657.85 MB, 658.17 MB, 658.11 MB, 658.06 MB, 658.08 MB, 658.11 MB, 657.97 MB, 658.10 MB, 658.04 MB ThreadUsage(8s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 8.00 MB (8388608) - PeakMemoryUsage: 680.58 MB (713645062) - PerHostPeakMemUsage: 920.64 MB (965362430) - RowsProduced: 1.38M (1380247) - TotalNetworkReceiveTime: 7m23s - TotalNetworkSendTime: 13.705ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 23.04K (23038) - TotalThreadsTotalWallClockTime: 8m9s - TotalThreadsSysTime: 2s696ms - TotalThreadsUserTime: 32s260ms - TotalThreadsVoluntaryContextSwitches: 102.59K (102589) Fragment Instance Lifecycle Timings: - ExecTime: 2m58s - ExecTreeExecTime: 2m52s - OpenTime: 5m10s - ExecTreeOpenTime: 5m10s - PrepareTime: 192.046ms - ExecTreePrepareTime: 5.950ms DataStreamSender (dst_id=9):(Total: 3s195ms, non-child: 3s195ms, % non-child: 100.00%) - BytesSent: 60.77 MB (63721269) - NetworkThroughput(*): 121.81 MB/sec - OverallThroughput: 19.02 MB/sec - PeakMemoryUsage: 248.88 KB (254848) - RowsReturned: 1.38M (1380247) - SerializeBatchTime: 2s693ms - TransmitDataRPCTime: 498.868ms - UncompressedRowBatchSize: 144.85 MB (151882698) CodeGen:(Total: 747.144ms, non-child: 747.144ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 118.618ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2076168) - NumFunctions: 54 (54) - NumInstructions: 2.41K (2406) - OptimizationTime: 517.534ms - PeakMemoryUsage: 1.17 MB (1231872) - PrepareTime: 110.190ms HASH_JOIN_NODE (id=3):(Total: 8m2s, non-child: 27s206ms, % non-child: 5.64%) ExecOption: Probe Side Codegen Enabled - BuildRows: 6.72M (6724244) - BuildTime: 20s439ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 649.10 MB (680630135) - ProbeRows: 40.45M (40446905) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 5s916ms - RowsReturned: 1.38M (1380247) - RowsReturnedRate: 2.86 K/sec Hash Join Builder (join_node_id=3): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 11s044ms - BuildRowsPartitioned: 6.72M (6724244) - GetNewBlockTime: 82.002ms - HashBuckets: 16.78M (16777216) - HashCollisions: 0 (0) - HashTablesBuildTime: 9s366ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 649.02 MB (680547456) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=8):(Total: 4m49s, non-child: 2s583ms, % non-child: 0.89%) BytesReceived(8s000ms): 9.36 MB, 46.04 MB, 71.91 MB, 92.86 MB, 111.07 MB, 128.40 MB, 144.85 MB, 154.48 MB, 158.20 MB, 160.14 MB, 160.21 MB, 160.21 MB, 160.21 MB, 160.21 MB, 160.21 MB, 160.23 MB, 161.35 MB, 161.93 MB, 161.93 MB, 161.93 MB, 161.93 MB, 161.93 MB, 161.93 MB, 161.93 MB, 161.93 MB, 161.93 MB, 161.93 MB, 161.93 MB, 161.93 MB, 161.93 MB, 161.93 MB, 161.93 MB, 161.93 MB, 161.93 MB, 161.93 MB, 161.93 MB, 161.93 MB, 161.97 MB, 161.97 MB, 161.97 MB, 161.97 MB, 161.97 MB, 161.97 MB, 161.97 MB, 161.97 MB, 161.97 MB, 161.97 MB, 161.97 MB, 161.97 MB, 161.97 MB, 161.97 MB, 161.97 MB, 161.97 MB, 161.97 MB, 161.97 MB, 161.97 MB, 161.97 MB, 161.97 MB, 161.97 MB, 161.97 MB - BytesReceived: 161.97 MB (169842948) - ConvertRowBatchTime: 1s534ms - DeserializeRowBatchTimer: 4s123ms - FirstBatchArrivalWaitTime: 288.982ms - PeakMemoryUsage: 0 - RowsReturned: 6.72M (6724244) - RowsReturnedRate: 23.20 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=7):(Total: 2m45s, non-child: 13s796ms, % non-child: 8.33%) BytesReceived(8s000ms): 7.04 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 14.06 MB, 47.30 MB, 87.10 MB, 135.54 MB, 181.78 MB, 220.48 MB, 259.37 MB, 292.61 MB, 324.52 MB, 369.76 MB, 416.64 MB, 464.18 MB, 510.27 MB, 557.16 MB, 604.40 MB, 651.49 MB, 699.70 MB, 752.76 MB, 809.66 MB, 865.39 MB, 902.50 MB, 922.97 MB - BytesReceived: 947.14 MB (993150183) - ConvertRowBatchTime: 9s556ms - DeserializeRowBatchTimer: 15s030ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 40.45M (40446905) - RowsReturnedRate: 244.07 K/sec - SendersBlockedTimer: 5m7s - SendersBlockedTotalTimer(*): 30m54s Instance 674b2fc81eb8bff4:b6ab0eca00000015 (host=redacted-host3:22000):(Total: 8m10s, non-child: 3s623ms, % non-child: 0.74%) MemoryUsage(8s000ms): 102.90 MB, 168.48 MB, 250.98 MB, 296.47 MB, 296.48 MB, 328.49 MB, 424.48 MB, 424.48 MB, 424.47 MB, 424.45 MB, 424.45 MB, 424.45 MB, 424.45 MB, 424.45 MB, 424.45 MB, 424.45 MB, 424.47 MB, 424.45 MB, 424.45 MB, 424.45 MB, 424.45 MB, 424.45 MB, 424.45 MB, 424.45 MB, 424.45 MB, 424.45 MB, 424.45 MB, 424.45 MB, 424.45 MB, 424.45 MB, 424.45 MB, 424.45 MB, 424.45 MB, 424.45 MB, 424.45 MB, 424.45 MB, 424.45 MB, 507.44 MB, 659.07 MB, 658.11 MB, 658.04 MB, 658.23 MB, 657.92 MB, 658.00 MB, 658.09 MB, 658.22 MB, 658.18 MB, 658.20 MB, 657.99 MB, 657.97 MB, 657.97 MB, 657.95 MB, 658.22 MB, 658.04 MB, 658.35 MB, 658.16 MB, 658.12 MB, 658.13 MB, 658.13 MB, 658.02 MB ThreadUsage(8s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 8.00 MB (8388608) - PeakMemoryUsage: 680.49 MB (713543317) - PerHostPeakMemUsage: 920.75 MB (965473154) - RowsProduced: 1.38M (1378510) - TotalNetworkReceiveTime: 7m27s - TotalNetworkSendTime: 19.594ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 19.03K (19030) - TotalThreadsTotalWallClockTime: 8m9s - TotalThreadsSysTime: 1s192ms - TotalThreadsUserTime: 31s938ms - TotalThreadsVoluntaryContextSwitches: 102.16K (102164) Fragment Instance Lifecycle Timings: - ExecTime: 3m3s - ExecTreeExecTime: 2m57s - OpenTime: 5m6s - ExecTreeOpenTime: 5m5s - PrepareTime: 199.013ms - ExecTreePrepareTime: 426.742us DataStreamSender (dst_id=9):(Total: 3s103ms, non-child: 3s103ms, % non-child: 100.00%) - BytesSent: 60.70 MB (63644574) - NetworkThroughput(*): 122.71 MB/sec - OverallThroughput: 19.56 MB/sec - PeakMemoryUsage: 248.88 KB (254848) - RowsReturned: 1.38M (1378510) - SerializeBatchTime: 2s605ms - TransmitDataRPCTime: 494.646ms - UncompressedRowBatchSize: 144.66 MB (151691556) CodeGen:(Total: 956.679ms, non-child: 956.679ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 178.380ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2076168) - NumFunctions: 54 (54) - NumInstructions: 2.41K (2406) - OptimizationTime: 666.330ms - PeakMemoryUsage: 1.17 MB (1231872) - PrepareTime: 110.813ms HASH_JOIN_NODE (id=3):(Total: 8m2s, non-child: 22s517ms, % non-child: 4.67%) ExecOption: Probe Side Codegen Enabled - BuildRows: 6.72M (6723800) - BuildTime: 15s911ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 649.10 MB (680635694) - ProbeRows: 40.45M (40447091) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 5s761ms - RowsReturned: 1.38M (1378510) - RowsReturnedRate: 2.86 K/sec Hash Join Builder (join_node_id=3): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 11s297ms - BuildRowsPartitioned: 6.72M (6723800) - GetNewBlockTime: 100.077ms - HashBuckets: 16.78M (16777216) - HashCollisions: 0 (0) - HashTablesBuildTime: 4s577ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 649.02 MB (680547456) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=8):(Total: 4m49s, non-child: 2s861ms, % non-child: 0.99%) BytesReceived(8s000ms): 9.31 MB, 45.96 MB, 71.84 MB, 92.78 MB, 111.01 MB, 128.33 MB, 144.77 MB, 154.45 MB, 158.19 MB, 160.14 MB, 160.21 MB, 160.21 MB, 160.21 MB, 160.21 MB, 160.21 MB, 160.22 MB, 161.19 MB, 161.91 MB, 161.93 MB, 161.93 MB, 161.93 MB, 161.93 MB, 161.93 MB, 161.93 MB, 161.93 MB, 161.93 MB, 161.93 MB, 161.93 MB, 161.93 MB, 161.93 MB, 161.93 MB, 161.93 MB, 161.93 MB, 161.93 MB, 161.93 MB, 161.93 MB, 161.93 MB, 161.96 MB, 161.98 MB, 161.98 MB, 161.98 MB, 161.98 MB, 161.98 MB, 161.98 MB, 161.98 MB, 161.98 MB, 161.98 MB, 161.98 MB, 161.98 MB, 161.98 MB, 161.98 MB, 161.98 MB, 161.98 MB, 161.98 MB, 161.98 MB, 161.98 MB, 161.98 MB, 161.98 MB, 161.98 MB, 161.98 MB - BytesReceived: 161.98 MB (169844416) - ConvertRowBatchTime: 1s602ms - DeserializeRowBatchTimer: 4s864ms - FirstBatchArrivalWaitTime: 54.670ms - PeakMemoryUsage: 0 - RowsReturned: 6.72M (6723800) - RowsReturnedRate: 23.24 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=7):(Total: 2m50s, non-child: 13s849ms, % non-child: 8.12%) BytesReceived(8s000ms): 6.97 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.01 MB, 11.10 MB, 38.87 MB, 78.23 MB, 124.48 MB, 172.51 MB, 212.57 MB, 250.71 MB, 287.84 MB, 319.05 MB, 364.03 MB, 410.70 MB, 458.20 MB, 504.43 MB, 551.16 MB, 598.40 MB, 645.55 MB, 693.52 MB, 745.93 MB, 802.40 MB, 859.07 MB, 899.29 MB, 920.42 MB - BytesReceived: 947.10 MB (993103503) - ConvertRowBatchTime: 9s438ms - DeserializeRowBatchTimer: 15s712ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 40.45M (40447091) - RowsReturnedRate: 237.18 K/sec - SendersBlockedTimer: 5m3s - SendersBlockedTotalTimer(*): 5m3s Instance 674b2fc81eb8bff4:b6ab0eca00000013 (host=redacted-host2:22000):(Total: 8m9s, non-child: 3s460ms, % non-child: 0.71%) MemoryUsage(8s000ms): 102.85 MB, 168.55 MB, 256.50 MB, 296.47 MB, 296.47 MB, 335.99 MB, 424.49 MB, 424.47 MB, 424.47 MB, 424.46 MB, 424.47 MB, 424.47 MB, 424.47 MB, 424.47 MB, 424.47 MB, 424.47 MB, 424.47 MB, 424.47 MB, 424.47 MB, 424.47 MB, 424.47 MB, 424.47 MB, 424.47 MB, 424.47 MB, 424.47 MB, 424.47 MB, 424.47 MB, 424.47 MB, 424.47 MB, 424.47 MB, 424.47 MB, 424.47 MB, 424.47 MB, 424.47 MB, 424.47 MB, 424.47 MB, 424.47 MB, 518.08 MB, 658.49 MB, 658.14 MB, 658.03 MB, 658.09 MB, 657.89 MB, 658.21 MB, 658.06 MB, 658.02 MB, 658.04 MB, 658.26 MB, 658.10 MB, 658.02 MB, 657.89 MB, 658.10 MB, 658.07 MB, 658.08 MB, 657.93 MB, 657.99 MB, 658.11 MB, 658.14 MB, 658.24 MB, 658.00 MB ThreadUsage(8s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 8.00 MB (8388608) - PeakMemoryUsage: 680.54 MB (713601172) - PerHostPeakMemUsage: 914.55 MB (958972542) - RowsProduced: 1.38M (1378239) - TotalNetworkReceiveTime: 7m27s - TotalNetworkSendTime: 26.848ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 24.81K (24813) - TotalThreadsTotalWallClockTime: 8m9s - TotalThreadsSysTime: 1s570ms - TotalThreadsUserTime: 32s162ms - TotalThreadsVoluntaryContextSwitches: 101.34K (101336) Fragment Instance Lifecycle Timings: - ExecTime: 3m4s - ExecTreeExecTime: 2m57s - OpenTime: 5m5s - ExecTreeOpenTime: 5m4s - PrepareTime: 189.434ms - ExecTreePrepareTime: 3.138ms DataStreamSender (dst_id=9):(Total: 3s132ms, non-child: 3s132ms, % non-child: 100.00%) - BytesSent: 60.69 MB (63637919) - NetworkThroughput(*): 124.37 MB/sec - OverallThroughput: 19.38 MB/sec - PeakMemoryUsage: 248.88 KB (254848) - RowsReturned: 1.38M (1378239) - SerializeBatchTime: 2s641ms - TransmitDataRPCTime: 487.971ms - UncompressedRowBatchSize: 144.64 MB (151661738) CodeGen:(Total: 705.771ms, non-child: 705.771ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 95.777ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2076168) - NumFunctions: 54 (54) - NumInstructions: 2.41K (2406) - OptimizationTime: 526.341ms - PeakMemoryUsage: 1.17 MB (1231872) - PrepareTime: 80.234ms HASH_JOIN_NODE (id=3):(Total: 8m2s, non-child: 22s022ms, % non-child: 4.56%) ExecOption: Probe Side Codegen Enabled - BuildRows: 6.72M (6724943) - BuildTime: 15s235ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 649.10 MB (680630135) - ProbeRows: 40.43M (40429690) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 5s941ms - RowsReturned: 1.38M (1378239) - RowsReturnedRate: 2.85 K/sec Hash Join Builder (join_node_id=3): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 11s178ms - BuildRowsPartitioned: 6.72M (6724943) - GetNewBlockTime: 82.049ms - HashBuckets: 16.78M (16777216) - HashCollisions: 0 (0) - HashTablesBuildTime: 4s021ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 649.02 MB (680547456) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=8):(Total: 4m49s, non-child: 2s847ms, % non-child: 0.98%) BytesReceived(8s000ms): 9.26 MB, 46.77 MB, 72.74 MB, 93.58 MB, 111.70 MB, 128.99 MB, 145.37 MB, 154.67 MB, 158.35 MB, 160.19 MB, 160.25 MB, 160.25 MB, 160.25 MB, 160.25 MB, 160.25 MB, 160.27 MB, 161.28 MB, 161.95 MB, 161.96 MB, 161.96 MB, 161.96 MB, 161.96 MB, 161.96 MB, 161.96 MB, 161.96 MB, 161.96 MB, 161.96 MB, 161.96 MB, 161.96 MB, 161.96 MB, 161.96 MB, 161.96 MB, 161.96 MB, 161.96 MB, 161.96 MB, 161.96 MB, 161.96 MB, 161.99 MB, 162.01 MB, 162.01 MB, 162.01 MB, 162.01 MB, 162.01 MB, 162.01 MB, 162.01 MB, 162.01 MB, 162.01 MB, 162.01 MB, 162.01 MB, 162.01 MB, 162.01 MB, 162.01 MB, 162.01 MB, 162.01 MB, 162.01 MB, 162.01 MB, 162.01 MB, 162.01 MB, 162.01 MB, 162.01 MB - BytesReceived: 162.01 MB (169875658) - ConvertRowBatchTime: 1s603ms - DeserializeRowBatchTimer: 4s736ms - FirstBatchArrivalWaitTime: 309.343ms - PeakMemoryUsage: 0 - RowsReturned: 6.72M (6724943) - RowsReturnedRate: 23.22 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=7):(Total: 2m51s, non-child: 13s907ms, % non-child: 8.13%) BytesReceived(8s000ms): 6.99 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 11.50 MB, 40.01 MB, 79.33 MB, 125.84 MB, 173.55 MB, 213.39 MB, 251.56 MB, 287.83 MB, 315.98 MB, 360.85 MB, 407.39 MB, 454.78 MB, 501.03 MB, 547.73 MB, 594.92 MB, 642.11 MB, 689.94 MB, 741.94 MB, 798.22 MB, 855.32 MB, 897.10 MB, 918.74 MB - BytesReceived: 946.68 MB (992666286) - ConvertRowBatchTime: 9s705ms - DeserializeRowBatchTimer: 14s831ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 40.43M (40429690) - RowsReturnedRate: 236.40 K/sec - SendersBlockedTimer: 5m2s - SendersBlockedTotalTimer(*): 30m15s Instance 674b2fc81eb8bff4:b6ab0eca00000017 (host=redacted-host6:22000):(Total: 8m9s, non-child: 3s950ms, % non-child: 0.81%) MemoryUsage(8s000ms): 102.83 MB, 168.42 MB, 251.93 MB, 296.41 MB, 296.41 MB, 328.92 MB, 424.41 MB, 424.40 MB, 424.41 MB, 424.40 MB, 424.42 MB, 424.42 MB, 424.42 MB, 424.42 MB, 424.42 MB, 424.41 MB, 424.39 MB, 424.38 MB, 424.38 MB, 424.38 MB, 424.38 MB, 424.38 MB, 424.38 MB, 424.38 MB, 424.38 MB, 424.38 MB, 424.38 MB, 424.38 MB, 424.38 MB, 424.38 MB, 424.38 MB, 424.38 MB, 424.38 MB, 424.38 MB, 424.38 MB, 424.38 MB, 424.38 MB, 550.64 MB, 658.10 MB, 657.97 MB, 658.12 MB, 658.33 MB, 658.15 MB, 658.12 MB, 658.04 MB, 657.95 MB, 658.01 MB, 658.23 MB, 658.12 MB, 658.17 MB, 658.12 MB, 658.22 MB, 658.04 MB, 657.99 MB, 658.07 MB, 658.11 MB, 657.88 MB, 658.10 MB, 657.96 MB, 657.95 MB ThreadUsage(8s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 8.00 MB (8388608) - PeakMemoryUsage: 680.41 MB (713463729) - PerHostPeakMemUsage: 920.61 MB (965327461) - RowsProduced: 1.38M (1381411) - TotalNetworkReceiveTime: 7m24s - TotalNetworkSendTime: 8.225ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 20.32K (20318) - TotalThreadsTotalWallClockTime: 8m9s - TotalThreadsSysTime: 2s580ms - TotalThreadsUserTime: 32s156ms - TotalThreadsVoluntaryContextSwitches: 102.31K (102307) Fragment Instance Lifecycle Timings: - ExecTime: 3m1s - ExecTreeExecTime: 2m54s - OpenTime: 5m8s - ExecTreeOpenTime: 5m7s - PrepareTime: 238.620ms - ExecTreePrepareTime: 469.911us DataStreamSender (dst_id=9):(Total: 3s128ms, non-child: 3s128ms, % non-child: 100.00%) - BytesSent: 60.82 MB (63777893) - NetworkThroughput(*): 122.51 MB/sec - OverallThroughput: 19.44 MB/sec - PeakMemoryUsage: 248.88 KB (254848) - RowsReturned: 1.38M (1381411) - SerializeBatchTime: 2s628ms - TransmitDataRPCTime: 496.495ms - UncompressedRowBatchSize: 144.97 MB (152010786) CodeGen:(Total: 720.798ms, non-child: 720.798ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 99.620ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2076168) - NumFunctions: 54 (54) - NumInstructions: 2.41K (2406) - OptimizationTime: 470.888ms - PeakMemoryUsage: 1.17 MB (1231872) - PrepareTime: 149.110ms HASH_JOIN_NODE (id=3):(Total: 8m2s, non-child: 25s166ms, % non-child: 5.22%) ExecOption: Probe Side Codegen Enabled - BuildRows: 6.73M (6725264) - BuildTime: 18s608ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 649.10 MB (680634231) - ProbeRows: 40.43M (40428701) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 5s746ms - RowsReturned: 1.38M (1381411) - RowsReturnedRate: 2.86 K/sec Hash Join Builder (join_node_id=3): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 11s724ms - BuildRowsPartitioned: 6.73M (6725264) - GetNewBlockTime: 134.220ms - HashBuckets: 16.78M (16777216) - HashCollisions: 0 (0) - HashTablesBuildTime: 6s846ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 649.02 MB (680547456) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=8):(Total: 4m49s, non-child: 2s823ms, % non-child: 0.98%) BytesReceived(8s000ms): 9.33 MB, 46.02 MB, 71.93 MB, 92.88 MB, 111.10 MB, 128.44 MB, 144.87 MB, 154.51 MB, 158.23 MB, 160.18 MB, 160.25 MB, 160.25 MB, 160.25 MB, 160.25 MB, 160.25 MB, 160.47 MB, 161.57 MB, 161.95 MB, 161.95 MB, 161.95 MB, 161.95 MB, 161.95 MB, 161.95 MB, 161.95 MB, 161.95 MB, 161.95 MB, 161.95 MB, 161.95 MB, 161.95 MB, 161.95 MB, 161.95 MB, 161.95 MB, 161.95 MB, 161.95 MB, 161.95 MB, 161.95 MB, 161.95 MB, 162.00 MB, 162.01 MB, 162.01 MB, 162.01 MB, 162.01 MB, 162.01 MB, 162.01 MB, 162.01 MB, 162.01 MB, 162.01 MB, 162.01 MB, 162.01 MB, 162.01 MB, 162.01 MB, 162.01 MB, 162.01 MB, 162.01 MB, 162.01 MB, 162.01 MB, 162.01 MB, 162.01 MB, 162.01 MB, 162.01 MB - BytesReceived: 162.01 MB (169877440) - ConvertRowBatchTime: 1s584ms - DeserializeRowBatchTimer: 4s761ms - FirstBatchArrivalWaitTime: 298.261ms - PeakMemoryUsage: 0 - RowsReturned: 6.73M (6725264) - RowsReturnedRate: 23.26 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=7):(Total: 2m47s, non-child: 13s858ms, % non-child: 8.25%) BytesReceived(8s000ms): 6.96 MB, 9.97 MB, 9.97 MB, 9.97 MB, 9.97 MB, 9.97 MB, 9.97 MB, 9.97 MB, 9.97 MB, 9.97 MB, 9.97 MB, 9.97 MB, 9.97 MB, 9.97 MB, 9.97 MB, 9.97 MB, 9.97 MB, 9.97 MB, 9.97 MB, 9.97 MB, 9.97 MB, 9.97 MB, 9.97 MB, 9.97 MB, 9.97 MB, 9.97 MB, 9.97 MB, 9.97 MB, 9.97 MB, 9.97 MB, 9.97 MB, 9.97 MB, 9.97 MB, 9.97 MB, 9.97 MB, 9.97 MB, 9.97 MB, 9.98 MB, 16.48 MB, 52.00 MB, 92.40 MB, 141.69 MB, 186.82 MB, 224.98 MB, 264.28 MB, 295.34 MB, 329.94 MB, 375.28 MB, 422.24 MB, 469.77 MB, 515.67 MB, 562.61 MB, 610.11 MB, 657.14 MB, 705.67 MB, 759.24 MB, 816.83 MB, 871.04 MB, 905.02 MB, 925.08 MB - BytesReceived: 946.70 MB (992691777) - ConvertRowBatchTime: 9s420ms - DeserializeRowBatchTimer: 14s609ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 40.43M (40428701) - RowsReturnedRate: 240.75 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 674b2fc81eb8bff4:b6ab0eca00000018 (host=redacted-host7:22000):(Total: 8m9s, non-child: 3s795ms, % non-child: 0.77%) MemoryUsage(8s000ms): 103.24 MB, 168.48 MB, 255.99 MB, 296.48 MB, 296.47 MB, 329.48 MB, 424.47 MB, 424.47 MB, 424.47 MB, 424.47 MB, 424.49 MB, 424.49 MB, 424.49 MB, 424.49 MB, 424.49 MB, 424.49 MB, 424.47 MB, 424.47 MB, 424.47 MB, 424.47 MB, 424.47 MB, 424.47 MB, 424.47 MB, 424.47 MB, 424.47 MB, 424.47 MB, 424.47 MB, 424.47 MB, 424.47 MB, 424.47 MB, 424.47 MB, 424.47 MB, 424.47 MB, 424.47 MB, 424.47 MB, 424.47 MB, 424.47 MB, 488.45 MB, 641.25 MB, 658.16 MB, 658.03 MB, 658.20 MB, 658.08 MB, 658.22 MB, 658.07 MB, 657.97 MB, 658.03 MB, 658.05 MB, 658.24 MB, 658.25 MB, 658.43 MB, 657.90 MB, 658.07 MB, 658.13 MB, 658.03 MB, 658.00 MB, 658.08 MB, 658.15 MB, 658.07 MB, 657.98 MB ThreadUsage(8s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 8.00 MB (8388608) - PeakMemoryUsage: 680.68 MB (713745511) - PerHostPeakMemUsage: 920.96 MB (965694713) - RowsProduced: 1.38M (1382557) - TotalNetworkReceiveTime: 7m22s - TotalNetworkSendTime: 8.571ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 19.52K (19525) - TotalThreadsTotalWallClockTime: 8m9s - TotalThreadsSysTime: 2s346ms - TotalThreadsUserTime: 32s217ms - TotalThreadsVoluntaryContextSwitches: 102.33K (102334) Fragment Instance Lifecycle Timings: - ExecTime: 2m58s - ExecTreeExecTime: 2m51s - OpenTime: 5m11s - ExecTreeOpenTime: 5m11s - PrepareTime: 178.630ms - ExecTreePrepareTime: 3.939ms DataStreamSender (dst_id=9):(Total: 3s156ms, non-child: 3s156ms, % non-child: 100.00%) - BytesSent: 60.87 MB (63824964) - NetworkThroughput(*): 122.80 MB/sec - OverallThroughput: 19.29 MB/sec - PeakMemoryUsage: 248.88 KB (254848) - RowsReturned: 1.38M (1382557) - SerializeBatchTime: 2s656ms - TransmitDataRPCTime: 495.661ms - UncompressedRowBatchSize: 145.09 MB (152136886) CodeGen:(Total: 672.715ms, non-child: 672.715ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 143.368ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2076168) - NumFunctions: 54 (54) - NumInstructions: 2.41K (2406) - OptimizationTime: 451.071ms - PeakMemoryUsage: 1.17 MB (1231872) - PrepareTime: 77.511ms HASH_JOIN_NODE (id=3):(Total: 8m2s, non-child: 27s601ms, % non-child: 5.72%) ExecOption: Probe Side Codegen Enabled - BuildRows: 6.73M (6726084) - BuildTime: 21s034ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 649.10 MB (680630135) - ProbeRows: 40.43M (40429467) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 5s702ms - RowsReturned: 1.38M (1382557) - RowsReturnedRate: 2.87 K/sec Hash Join Builder (join_node_id=3): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 10s820ms - BuildRowsPartitioned: 6.73M (6726084) - GetNewBlockTime: 213.924ms - HashBuckets: 16.78M (16777216) - HashCollisions: 0 (0) - HashTablesBuildTime: 10s089ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 649.02 MB (680547456) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=8):(Total: 4m49s, non-child: 2s500ms, % non-child: 0.86%) BytesReceived(8s000ms): 9.67 MB, 46.36 MB, 72.15 MB, 93.07 MB, 111.28 MB, 128.61 MB, 145.05 MB, 154.58 MB, 158.29 MB, 160.21 MB, 160.28 MB, 160.28 MB, 160.28 MB, 160.28 MB, 160.28 MB, 160.29 MB, 161.27 MB, 161.97 MB, 161.99 MB, 161.99 MB, 161.99 MB, 161.99 MB, 161.99 MB, 161.99 MB, 161.99 MB, 161.99 MB, 161.99 MB, 161.99 MB, 161.99 MB, 161.99 MB, 161.99 MB, 161.99 MB, 161.99 MB, 161.99 MB, 161.99 MB, 161.99 MB, 161.99 MB, 162.02 MB, 162.03 MB, 162.03 MB, 162.03 MB, 162.03 MB, 162.03 MB, 162.03 MB, 162.03 MB, 162.03 MB, 162.03 MB, 162.03 MB, 162.03 MB, 162.03 MB, 162.03 MB, 162.03 MB, 162.03 MB, 162.03 MB, 162.03 MB, 162.03 MB, 162.03 MB, 162.03 MB, 162.03 MB, 162.03 MB - BytesReceived: 162.03 MB (169903268) - ConvertRowBatchTime: 1s569ms - DeserializeRowBatchTimer: 4s345ms - FirstBatchArrivalWaitTime: 327.758ms - PeakMemoryUsage: 0 - RowsReturned: 6.73M (6726084) - RowsReturnedRate: 23.20 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=7):(Total: 2m44s, non-child: 13s750ms, % non-child: 8.34%) BytesReceived(8s000ms): 7.17 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 10.06 MB, 12.57 MB, 43.68 MB, 83.11 MB, 130.57 MB, 177.63 MB, 216.88 MB, 255.38 MB, 290.19 MB, 320.14 MB, 365.13 MB, 411.88 MB, 459.34 MB, 505.51 MB, 552.31 MB, 599.49 MB, 646.61 MB, 694.51 MB, 747.01 MB, 803.58 MB, 860.06 MB, 899.62 MB, 920.57 MB - BytesReceived: 946.69 MB (992675347) - ConvertRowBatchTime: 9s429ms - DeserializeRowBatchTimer: 15s279ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 40.43M (40429467) - RowsReturnedRate: 245.28 K/sec - SendersBlockedTimer: 5m8s - SendersBlockedTotalTimer(*): 36m Instance 674b2fc81eb8bff4:b6ab0eca00000014 (host=redacted-host8:22000):(Total: 8m9s, non-child: 3s496ms, % non-child: 0.71%) MemoryUsage(8s000ms): 103.33 MB, 168.49 MB, 256.51 MB, 296.48 MB, 296.62 MB, 337.48 MB, 424.47 MB, 424.47 MB, 424.47 MB, 424.46 MB, 424.47 MB, 424.47 MB, 424.47 MB, 424.47 MB, 424.47 MB, 424.47 MB, 424.47 MB, 424.47 MB, 424.47 MB, 424.47 MB, 424.47 MB, 424.47 MB, 424.47 MB, 424.47 MB, 424.47 MB, 424.47 MB, 424.47 MB, 424.47 MB, 424.47 MB, 424.47 MB, 424.47 MB, 424.47 MB, 424.47 MB, 424.47 MB, 424.47 MB, 424.47 MB, 424.47 MB, 485.45 MB, 650.71 MB, 658.18 MB, 658.32 MB, 658.08 MB, 658.19 MB, 658.00 MB, 658.10 MB, 657.95 MB, 658.07 MB, 658.07 MB, 658.16 MB, 658.07 MB, 658.12 MB, 658.19 MB, 658.05 MB, 658.13 MB, 657.91 MB, 657.99 MB, 658.01 MB, 658.15 MB, 658.14 MB, 657.97 MB ThreadUsage(8s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 8.00 MB (8388608) - PeakMemoryUsage: 680.55 MB (713613492) - PerHostPeakMemUsage: 924.63 MB (969540410) - RowsProduced: 1.38M (1380801) - TotalNetworkReceiveTime: 7m22s - TotalNetworkSendTime: 12.891ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 19.39K (19392) - TotalThreadsTotalWallClockTime: 8m9s - TotalThreadsSysTime: 2s049ms - TotalThreadsUserTime: 32s473ms - TotalThreadsVoluntaryContextSwitches: 103.55K (103549) Fragment Instance Lifecycle Timings: - ExecTime: 2m59s - ExecTreeExecTime: 2m53s - OpenTime: 5m10s - ExecTreeOpenTime: 5m9s - PrepareTime: 215.398ms - ExecTreePrepareTime: 410.607us DataStreamSender (dst_id=9):(Total: 3s115ms, non-child: 3s115ms, % non-child: 100.00%) - BytesSent: 60.78 MB (63727719) - NetworkThroughput(*): 121.69 MB/sec - OverallThroughput: 19.51 MB/sec - PeakMemoryUsage: 248.88 KB (254848) - RowsReturned: 1.38M (1380801) - SerializeBatchTime: 2s613ms - TransmitDataRPCTime: 499.411ms - UncompressedRowBatchSize: 144.90 MB (151943646) CodeGen:(Total: 722.344ms, non-child: 722.344ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 106.530ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2076168) - NumFunctions: 54 (54) - NumInstructions: 2.41K (2406) - OptimizationTime: 515.695ms - PeakMemoryUsage: 1.17 MB (1231872) - PrepareTime: 99.344ms HASH_JOIN_NODE (id=3):(Total: 8m2s, non-child: 28s126ms, % non-child: 5.83%) ExecOption: Probe Side Codegen Enabled - BuildRows: 6.72M (6723851) - BuildTime: 21s489ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 649.11 MB (680638754) - ProbeRows: 40.42M (40424404) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 5s808ms - RowsReturned: 1.38M (1380801) - RowsReturnedRate: 2.86 K/sec Hash Join Builder (join_node_id=3): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 12s717ms - BuildRowsPartitioned: 6.72M (6723851) - GetNewBlockTime: 193.100ms - HashBuckets: 16.78M (16777216) - HashCollisions: 0 (0) - HashTablesBuildTime: 8s660ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 649.02 MB (680547456) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=8):(Total: 4m47s, non-child: 2s967ms, % non-child: 1.03%) BytesReceived(8s000ms): 9.79 MB, 46.49 MB, 72.27 MB, 93.18 MB, 112.33 MB, 129.71 MB, 145.94 MB, 154.85 MB, 158.45 MB, 160.18 MB, 160.23 MB, 160.23 MB, 160.23 MB, 160.23 MB, 160.23 MB, 160.27 MB, 161.30 MB, 161.94 MB, 161.94 MB, 161.94 MB, 161.94 MB, 161.94 MB, 161.94 MB, 161.94 MB, 161.94 MB, 161.94 MB, 161.94 MB, 161.94 MB, 161.94 MB, 161.94 MB, 161.94 MB, 161.94 MB, 161.94 MB, 161.94 MB, 161.94 MB, 161.94 MB, 161.94 MB, 161.97 MB, 161.99 MB, 161.99 MB, 161.99 MB, 161.99 MB, 161.99 MB, 161.99 MB, 161.99 MB, 161.99 MB, 161.99 MB, 161.99 MB, 161.99 MB, 161.99 MB, 161.99 MB, 161.99 MB, 161.99 MB, 161.99 MB, 161.99 MB, 161.99 MB, 161.99 MB, 161.99 MB, 161.99 MB, 161.99 MB - BytesReceived: 161.99 MB (169854899) - ConvertRowBatchTime: 1s579ms - DeserializeRowBatchTimer: 5s201ms - FirstBatchArrivalWaitTime: 265.657ms - PeakMemoryUsage: 0 - RowsReturned: 6.72M (6723851) - RowsReturnedRate: 23.35 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=7):(Total: 2m46s, non-child: 13s488ms, % non-child: 8.10%) BytesReceived(8s000ms): 7.19 MB, 10.04 MB, 10.04 MB, 10.04 MB, 10.04 MB, 10.04 MB, 10.04 MB, 10.04 MB, 10.04 MB, 10.04 MB, 10.04 MB, 10.04 MB, 10.04 MB, 10.04 MB, 10.04 MB, 10.04 MB, 10.04 MB, 10.04 MB, 10.04 MB, 10.04 MB, 10.04 MB, 10.04 MB, 10.04 MB, 10.04 MB, 10.04 MB, 10.04 MB, 10.04 MB, 10.04 MB, 10.04 MB, 10.04 MB, 10.04 MB, 10.04 MB, 10.04 MB, 10.04 MB, 10.04 MB, 10.04 MB, 10.04 MB, 10.04 MB, 11.98 MB, 41.96 MB, 81.40 MB, 128.42 MB, 175.72 MB, 215.33 MB, 253.75 MB, 289.22 MB, 318.38 MB, 363.34 MB, 410.01 MB, 457.45 MB, 503.73 MB, 550.48 MB, 597.58 MB, 644.70 MB, 692.55 MB, 744.81 MB, 801.22 MB, 858.03 MB, 898.50 MB, 919.70 MB - BytesReceived: 946.58 MB (992564351) - ConvertRowBatchTime: 9s352ms - DeserializeRowBatchTimer: 14s726ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 40.42M (40424404) - RowsReturnedRate: 242.76 K/sec - SendersBlockedTimer: 5m7s - SendersBlockedTotalTimer(*): 25m40s Instance 674b2fc81eb8bff4:b6ab0eca00000012 (host=redacted-host4:22000):(Total: 8m9s, non-child: 3s216ms, % non-child: 0.66%) MemoryUsage(8s000ms): 103.19 MB, 168.49 MB, 254.98 MB, 296.48 MB, 296.49 MB, 330.47 MB, 424.48 MB, 424.47 MB, 424.46 MB, 424.47 MB, 424.45 MB, 424.45 MB, 424.45 MB, 424.45 MB, 424.45 MB, 424.45 MB, 424.47 MB, 424.47 MB, 424.47 MB, 424.47 MB, 424.47 MB, 424.47 MB, 424.47 MB, 424.47 MB, 424.47 MB, 424.47 MB, 424.47 MB, 424.47 MB, 424.47 MB, 424.47 MB, 424.47 MB, 424.47 MB, 424.47 MB, 424.47 MB, 424.47 MB, 424.47 MB, 424.47 MB, 511.35 MB, 658.08 MB, 658.13 MB, 658.30 MB, 658.05 MB, 658.08 MB, 658.11 MB, 658.13 MB, 658.28 MB, 658.11 MB, 657.97 MB, 657.86 MB, 658.12 MB, 658.03 MB, 657.97 MB, 658.19 MB, 658.03 MB, 658.16 MB, 657.98 MB, 658.08 MB, 658.21 MB, 658.00 MB, 657.91 MB ThreadUsage(8s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 8.00 MB (8388608) - PeakMemoryUsage: 680.53 MB (713584015) - PerHostPeakMemUsage: 920.38 MB (965090143) - RowsProduced: 1.38M (1381535) - TotalNetworkReceiveTime: 7m28s - TotalNetworkSendTime: 9.443ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 21.64K (21635) - TotalThreadsTotalWallClockTime: 8m9s - TotalThreadsSysTime: 1s253ms - TotalThreadsUserTime: 32s122ms - TotalThreadsVoluntaryContextSwitches: 101.97K (101972) Fragment Instance Lifecycle Timings: - ExecTime: 3m4s - ExecTreeExecTime: 2m57s - OpenTime: 5m5s - ExecTreeOpenTime: 5m5s - PrepareTime: 163.258ms - ExecTreePrepareTime: 340.149us DataStreamSender (dst_id=9):(Total: 3s179ms, non-child: 3s179ms, % non-child: 100.00%) - BytesSent: 60.82 MB (63778450) - NetworkThroughput(*): 122.44 MB/sec - OverallThroughput: 19.13 MB/sec - PeakMemoryUsage: 248.88 KB (254848) - RowsReturned: 1.38M (1381535) - SerializeBatchTime: 2s679ms - TransmitDataRPCTime: 496.758ms - UncompressedRowBatchSize: 144.98 MB (152024418) CodeGen:(Total: 655.803ms, non-child: 655.803ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 56.223ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2076168) - NumFunctions: 54 (54) - NumInstructions: 2.41K (2406) - OptimizationTime: 492.566ms - PeakMemoryUsage: 1.17 MB (1231872) - PrepareTime: 106.192ms HASH_JOIN_NODE (id=3):(Total: 8m2s, non-child: 21s506ms, % non-child: 4.45%) ExecOption: Probe Side Codegen Enabled - BuildRows: 6.72M (6722395) - BuildTime: 14s530ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 649.10 MB (680630135) - ProbeRows: 40.46M (40455451) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 5s938ms - RowsReturned: 1.38M (1381535) - RowsReturnedRate: 2.86 K/sec Hash Join Builder (join_node_id=3): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 10s510ms - BuildRowsPartitioned: 6.72M (6722395) - GetNewBlockTime: 135.841ms - HashBuckets: 16.78M (16777216) - HashCollisions: 0 (0) - HashTablesBuildTime: 3s981ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 649.02 MB (680547456) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=8):(Total: 4m50s, non-child: 2s581ms, % non-child: 0.89%) BytesReceived(8s000ms): 9.61 MB, 46.26 MB, 72.05 MB, 92.98 MB, 111.22 MB, 128.52 MB, 144.93 MB, 154.48 MB, 158.19 MB, 160.11 MB, 160.18 MB, 160.18 MB, 160.18 MB, 160.18 MB, 160.18 MB, 160.19 MB, 161.16 MB, 161.87 MB, 161.89 MB, 161.89 MB, 161.89 MB, 161.89 MB, 161.89 MB, 161.89 MB, 161.89 MB, 161.89 MB, 161.89 MB, 161.89 MB, 161.89 MB, 161.89 MB, 161.89 MB, 161.89 MB, 161.89 MB, 161.89 MB, 161.89 MB, 161.89 MB, 161.89 MB, 161.91 MB, 161.94 MB, 161.94 MB, 161.94 MB, 161.94 MB, 161.94 MB, 161.94 MB, 161.94 MB, 161.94 MB, 161.94 MB, 161.94 MB, 161.94 MB, 161.94 MB, 161.94 MB, 161.94 MB, 161.94 MB, 161.94 MB, 161.94 MB, 161.94 MB, 161.94 MB, 161.94 MB, 161.94 MB, 161.94 MB - BytesReceived: 161.94 MB (169803191) - ConvertRowBatchTime: 1s561ms - DeserializeRowBatchTimer: 4s102ms - FirstBatchArrivalWaitTime: 380.563ms - PeakMemoryUsage: 0 - RowsReturned: 6.72M (6722395) - RowsReturnedRate: 23.16 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=7):(Total: 2m51s, non-child: 13s709ms, % non-child: 8.01%) BytesReceived(8s000ms): 7.13 MB, 10.05 MB, 10.05 MB, 10.05 MB, 10.05 MB, 10.05 MB, 10.05 MB, 10.05 MB, 10.05 MB, 10.05 MB, 10.05 MB, 10.05 MB, 10.05 MB, 10.05 MB, 10.05 MB, 10.05 MB, 10.05 MB, 10.05 MB, 10.05 MB, 10.05 MB, 10.05 MB, 10.05 MB, 10.05 MB, 10.05 MB, 10.05 MB, 10.05 MB, 10.05 MB, 10.05 MB, 10.05 MB, 10.05 MB, 10.05 MB, 10.05 MB, 10.05 MB, 10.05 MB, 10.05 MB, 10.05 MB, 10.05 MB, 10.05 MB, 11.22 MB, 39.07 MB, 78.46 MB, 124.73 MB, 172.76 MB, 212.77 MB, 250.93 MB, 287.99 MB, 319.70 MB, 364.64 MB, 411.43 MB, 458.96 MB, 505.22 MB, 551.94 MB, 599.07 MB, 646.22 MB, 694.22 MB, 746.77 MB, 803.34 MB, 859.88 MB, 899.77 MB, 920.83 MB - BytesReceived: 947.30 MB (993311689) - ConvertRowBatchTime: 9s612ms - DeserializeRowBatchTimer: 15s176ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 40.46M (40455451) - RowsReturnedRate: 236.30 K/sec - SendersBlockedTimer: 5m2s - SendersBlockedTotalTimer(*): 25m12s Instance 674b2fc81eb8bff4:b6ab0eca00000011 (host=redacted-host5:22000):(Total: 8m9s, non-child: 3s291ms, % non-child: 0.67%) MemoryUsage(8s000ms): 103.37 MB, 168.48 MB, 256.00 MB, 296.48 MB, 296.47 MB, 331.48 MB, 424.50 MB, 424.47 MB, 424.46 MB, 424.46 MB, 424.45 MB, 424.45 MB, 424.45 MB, 424.45 MB, 424.45 MB, 424.45 MB, 424.46 MB, 424.47 MB, 424.47 MB, 424.47 MB, 424.47 MB, 424.47 MB, 424.47 MB, 424.47 MB, 424.47 MB, 424.47 MB, 424.47 MB, 424.47 MB, 424.47 MB, 424.47 MB, 424.47 MB, 424.47 MB, 424.47 MB, 424.47 MB, 424.47 MB, 424.47 MB, 424.47 MB, 506.00 MB, 657.67 MB, 658.04 MB, 658.09 MB, 658.14 MB, 658.14 MB, 658.18 MB, 658.12 MB, 658.01 MB, 658.29 MB, 657.90 MB, 658.04 MB, 657.98 MB, 658.13 MB, 657.99 MB, 658.07 MB, 658.24 MB, 658.10 MB, 658.07 MB, 658.20 MB, 658.31 MB, 658.27 MB, 658.10 MB ThreadUsage(8s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 8.00 MB (8388608) - PeakMemoryUsage: 680.57 MB (713630649) - PerHostPeakMemUsage: 920.19 MB (964894132) - RowsProduced: 1.38M (1379141) - TotalNetworkReceiveTime: 7m28s - TotalNetworkSendTime: 8.140ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 26.31K (26311) - TotalThreadsTotalWallClockTime: 8m9s - TotalThreadsSysTime: 1s227ms - TotalThreadsUserTime: 32s201ms - TotalThreadsVoluntaryContextSwitches: 101.77K (101765) Fragment Instance Lifecycle Timings: - ExecTime: 3m4s - ExecTreeExecTime: 2m58s - OpenTime: 5m5s - ExecTreeOpenTime: 5m4s - PrepareTime: 200.371ms - ExecTreePrepareTime: 615.653us DataStreamSender (dst_id=9):(Total: 3s195ms, non-child: 3s195ms, % non-child: 100.00%) - BytesSent: 60.72 MB (63669488) - NetworkThroughput(*): 122.41 MB/sec - OverallThroughput: 19.00 MB/sec - PeakMemoryUsage: 248.88 KB (254848) - RowsReturned: 1.38M (1379141) - SerializeBatchTime: 2s696ms - TransmitDataRPCTime: 496.029ms - UncompressedRowBatchSize: 144.73 MB (151760998) CodeGen:(Total: 712.500ms, non-child: 712.500ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 69.042ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2076168) - NumFunctions: 54 (54) - NumInstructions: 2.41K (2406) - OptimizationTime: 529.677ms - PeakMemoryUsage: 1.17 MB (1231872) - PrepareTime: 113.063ms HASH_JOIN_NODE (id=3):(Total: 8m2s, non-child: 21s218ms, % non-child: 4.40%) ExecOption: Probe Side Codegen Enabled - BuildRows: 6.73M (6725186) - BuildTime: 14s383ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 649.10 MB (680634231) - ProbeRows: 40.43M (40429336) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 5s983ms - RowsReturned: 1.38M (1379141) - RowsReturnedRate: 2.86 K/sec Hash Join Builder (join_node_id=3): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 10s771ms - BuildRowsPartitioned: 6.73M (6725186) - GetNewBlockTime: 152.019ms - HashBuckets: 16.78M (16777216) - HashCollisions: 0 (0) - HashTablesBuildTime: 3s558ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 649.02 MB (680547456) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=8):(Total: 4m50s, non-child: 2s701ms, % non-child: 0.93%) BytesReceived(8s000ms): 9.88 MB, 46.59 MB, 72.30 MB, 93.20 MB, 111.38 MB, 128.70 MB, 145.12 MB, 154.59 MB, 158.28 MB, 160.19 MB, 160.26 MB, 160.26 MB, 160.26 MB, 160.26 MB, 160.26 MB, 160.27 MB, 161.24 MB, 161.95 MB, 161.97 MB, 161.97 MB, 161.97 MB, 161.97 MB, 161.97 MB, 161.97 MB, 161.97 MB, 161.97 MB, 161.97 MB, 161.97 MB, 161.97 MB, 161.97 MB, 161.97 MB, 161.97 MB, 161.97 MB, 161.97 MB, 161.97 MB, 161.97 MB, 161.97 MB, 161.99 MB, 162.01 MB, 162.01 MB, 162.01 MB, 162.01 MB, 162.01 MB, 162.01 MB, 162.01 MB, 162.01 MB, 162.01 MB, 162.01 MB, 162.01 MB, 162.01 MB, 162.01 MB, 162.01 MB, 162.01 MB, 162.01 MB, 162.01 MB, 162.01 MB, 162.01 MB, 162.01 MB, 162.01 MB, 162.01 MB - BytesReceived: 162.01 MB (169880552) - ConvertRowBatchTime: 1s588ms - DeserializeRowBatchTimer: 4s230ms - FirstBatchArrivalWaitTime: 319.919ms - PeakMemoryUsage: 0 - RowsReturned: 6.73M (6725186) - RowsReturnedRate: 23.19 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=7):(Total: 2m51s, non-child: 14s173ms, % non-child: 8.26%) BytesReceived(8s000ms): 7.23 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.97 MB, 37.67 MB, 76.91 MB, 122.84 MB, 171.13 MB, 211.32 MB, 249.31 MB, 286.44 MB, 317.60 MB, 362.47 MB, 409.13 MB, 456.60 MB, 502.86 MB, 549.63 MB, 596.86 MB, 643.96 MB, 691.83 MB, 743.93 MB, 800.28 MB, 857.16 MB, 898.04 MB, 919.41 MB - BytesReceived: 946.68 MB (992663448) - ConvertRowBatchTime: 9s811ms - DeserializeRowBatchTimer: 14s893ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 40.43M (40429336) - RowsReturnedRate: 235.69 K/sec - SendersBlockedTimer: 5m2s - SendersBlockedTotalTimer(*): 35m14s Averaged Fragment F00:(Total: 7m55s, non-child: 6m43s, % non-child: 84.88%) split sizes: min: 2.41 GB, max: 2.72 GB, avg: 2.63 GB, stddev: 106.96 MB completion times: min:7m41s max:8m9s mean: 7m55s stddev:11s112ms execution rates: min:5.24 MB/sec max:6.04 MB/sec mean:5.67 MB/sec stddev:207.55 KB/sec num instances: 8 - AverageThreadTokens: 2.00 - BloomFilterBytes: 8.00 MB (8388608) - PeakMemoryUsage: 85.60 MB (89756191) - PerHostPeakMemUsage: 920.34 MB (965044373) - RowsProduced: 40.43M (40434535) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 5m14s - TotalStorageWaitTime: 575.570ms - TotalThreadsInvoluntaryContextSwitches: 321.48K (321481) - TotalThreadsTotalWallClockTime: 15m48s - TotalThreadsSysTime: 3s531ms - TotalThreadsUserTime: 2m37s - TotalThreadsVoluntaryContextSwitches: 13.86K (13862) Fragment Instance Lifecycle Timings: - ExecTime: 7m54s - ExecTreeExecTime: 10s231ms - OpenTime: 144.170ms - ExecTreeOpenTime: 1.103ms - PrepareTime: 184.883ms - ExecTreePrepareTime: 993.849us DataStreamSender (dst_id=7):(Total: 1m1s, non-child: 1m1s, % non-child: 100.00%) - BytesSent: 946.81 MB (992806184) - NetworkThroughput(*): 130.48 MB/sec - OverallThroughput: 15.40 MB/sec - PeakMemoryUsage: 248.94 KB (254912) - RowsReturned: 40.43M (40434535) - SerializeBatchTime: 54s254ms - TransmitDataRPCTime: 7s256ms - UncompressedRowBatchSize: 2.07 GB (2224304813) CodeGen:(Total: 241.371ms, non-child: 241.371ms, % non-child: 100.00%) - CodegenTime: 5.476ms - CompileTime: 24.384ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2076168) - NumFunctions: 46 (46) - NumInstructions: 720 (720) - OptimizationTime: 113.026ms - PeakMemoryUsage: 360.00 KB (368640) - PrepareTime: 101.141ms HDFS_SCAN_NODE (id=2):(Total: 10s053ms, non-child: 10s053ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 633.72 MB (664506956) - BytesReadDataNodeCache: 0 - BytesReadLocal: 633.72 MB (664506956) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 633.72 MB (664506956) - DecompressionTime: 2s883ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 7 (7) - NumRowGroups: 11 (11) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 77.34 MB (81092841) - PerReadThreadRawHdfsThroughput: 697.51 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 5s992ms - RowBatchQueuePutWaitTime: 5m18s - RowsRead: 75.00M (75004737) - RowsReturned: 40.43M (40434535) - RowsReturnedRate: 4.16 M/sec - ScanRangesComplete: 11 (11) - ScannerThreadsInvoluntaryContextSwitches: 108.84K (108844) - ScannerThreadsTotalWallClockTime: 7m53s - MaterializeTupleTime(*): 2m29s - ScannerThreadsSysTime: 1s862ms - ScannerThreadsUserTime: 1m17s - ScannerThreadsVoluntaryContextSwitches: 9.44K (9438) - TotalRawHdfsReadTime(*): 951.623ms - TotalReadThroughput: 1.34 MB/sec Filter 1 (8.00 MB): - Rows processed: 323.59K (323590) - Rows rejected: 2.79K (2785) - Rows total: 75.00M (75004737) Fragment F00: Instance 674b2fc81eb8bff4:b6ab0eca00000005 (host=redacted-host3:22000):(Total: 8m9s, non-child: 6m52s, % non-child: 84.26%) Hdfs split stats (:<# splits>/): 2:1/253.30 MB 10:1/253.34 MB 3:1/253.31 MB 11:1/253.33 MB 9:3/759.90 MB 8:1/253.30 MB 0:1/253.29 MB 7:2/506.65 MB Filter 1 arrival: 5m2s MemoryUsage(8s000ms): 59.58 MB, 73.90 MB, 73.90 MB, 73.90 MB, 73.90 MB, 73.90 MB, 73.90 MB, 73.90 MB, 73.90 MB, 73.90 MB, 73.90 MB, 73.90 MB, 73.90 MB, 73.90 MB, 73.90 MB, 73.90 MB, 73.90 MB, 73.90 MB, 73.90 MB, 73.90 MB, 73.90 MB, 73.90 MB, 73.90 MB, 73.90 MB, 73.90 MB, 73.90 MB, 73.90 MB, 73.90 MB, 73.90 MB, 73.90 MB, 73.90 MB, 73.90 MB, 73.90 MB, 73.90 MB, 73.90 MB, 73.90 MB, 73.90 MB, 77.90 MB, 80.20 MB, 63.17 MB, 53.05 MB, 66.03 MB, 50.41 MB, 69.57 MB, 49.99 MB, 78.21 MB, 69.88 MB, 58.45 MB, 64.15 MB, 57.15 MB, 68.25 MB, 49.12 MB, 72.50 MB, 55.50 MB, 74.52 MB, 56.89 MB, 70.29 MB, 56.70 MB, 60.92 MB, 63.40 MB ThreadUsage(8s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 8.00 MB (8388608) - PeakMemoryUsage: 86.22 MB (90408894) - PerHostPeakMemUsage: 920.75 MB (965473154) - RowsProduced: 41.82M (41821821) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 5m13s - TotalStorageWaitTime: 651.386ms - TotalThreadsInvoluntaryContextSwitches: 351.25K (351253) - TotalThreadsTotalWallClockTime: 16m18s - TotalThreadsSysTime: 3s775ms - TotalThreadsUserTime: 2m43s - TotalThreadsVoluntaryContextSwitches: 14.32K (14325) Fragment Instance Lifecycle Timings: - ExecTime: 8m9s - ExecTreeExecTime: 10s951ms - OpenTime: 116.638ms - ExecTreeOpenTime: 181.343us - PrepareTime: 159.745ms - ExecTreePrepareTime: 377.005us DataStreamSender (dst_id=7):(Total: 1m6s, non-child: 1m6s, % non-child: 100.00%) - BytesSent: 979.62 MB (1027205898) - NetworkThroughput(*): 130.55 MB/sec - OverallThroughput: 14.80 MB/sec - PeakMemoryUsage: 248.94 KB (254912) - RowsReturned: 41.82M (41821821) - SerializeBatchTime: 58s601ms - TransmitDataRPCTime: 7s503ms - UncompressedRowBatchSize: 2.14 GB (2300619435) CodeGen:(Total: 222.629ms, non-child: 222.629ms, % non-child: 100.00%) - CodegenTime: 3.456ms - CompileTime: 24.437ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2076168) - NumFunctions: 46 (46) - NumInstructions: 720 (720) - OptimizationTime: 89.476ms - PeakMemoryUsage: 360.00 KB (368640) - PrepareTime: 107.146ms HDFS_SCAN_NODE (id=2):(Total: 10s726ms, non-child: 10s726ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:1/253.30 MB 10:1/253.34 MB 3:1/253.31 MB 11:1/253.33 MB 9:3/759.90 MB 8:1/253.30 MB 0:1/253.29 MB 7:2/506.65 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 11 out of 11 Runtime filters: Only following filters arrived: , waited 746ms Hdfs Read Thread Concurrency Bucket: 0:99.69% 1:0.3086% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:44 BytesRead(8s000ms): 47.76 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 58.13 MB, 77.46 MB, 119.09 MB, 139.34 MB, 178.65 MB, 179.29 MB, 238.22 MB, 238.22 MB, 264.27 MB, 297.76 MB, 320.10 MB, 357.32 MB, 375.93 MB, 416.87 MB, 431.75 MB, 476.42 MB, 490.10 MB, 535.96 MB, 557.07 MB, 594.50 MB, 643.91 MB - FooterProcessingTime: (Avg: 6.716ms ; Min: 2.066ms ; Max: 27.808ms ; Number of samples: 11) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 655.08 MB (686899821) - BytesReadDataNodeCache: 0 - BytesReadLocal: 655.08 MB (686899821) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 655.08 MB (686899821) - DecompressionTime: 3s235ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 8 (8) - NumRowGroups: 11 (11) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 77.96 MB (81744932) - PerReadThreadRawHdfsThroughput: 632.90 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 4s553ms - RowBatchQueuePutWaitTime: 5m21s - RowsRead: 77.55M (77548800) - RowsReturned: 41.82M (41821821) - RowsReturnedRate: 3.90 M/sec - ScanRangesComplete: 11 (11) - ScannerThreadsInvoluntaryContextSwitches: 115.47K (115465) - ScannerThreadsTotalWallClockTime: 8m8s - MaterializeTupleTime(*): 2m39s - ScannerThreadsSysTime: 2s000ms - ScannerThreadsUserTime: 1m19s - ScannerThreadsVoluntaryContextSwitches: 10.42K (10419) - TotalRawHdfsReadTime(*): 1s035ms - TotalReadThroughput: 1.35 MB/sec Filter 1 (8.00 MB): - Rows processed: 322.68K (322681) - Rows rejected: 2.82K (2824) - Rows total: 77.55M (77548800) Instance 674b2fc81eb8bff4:b6ab0eca00000008 (host=redacted-host7:22000):(Total: 8m8s, non-child: 6m51s, % non-child: 84.21%) Hdfs split stats (:<# splits>/): 9:1/253.29 MB 6:1/253.32 MB 7:1/253.30 MB 11:1/253.31 MB 10:2/506.59 MB 0:2/506.67 MB 5:1/253.30 MB 8:2/506.58 MB Filter 1 arrival: 5m2s MemoryUsage(8s000ms): 59.90 MB, 73.92 MB, 73.92 MB, 73.92 MB, 73.92 MB, 73.92 MB, 73.92 MB, 73.92 MB, 73.92 MB, 73.92 MB, 73.92 MB, 73.92 MB, 73.92 MB, 73.92 MB, 73.92 MB, 73.92 MB, 73.92 MB, 73.92 MB, 73.92 MB, 73.92 MB, 73.92 MB, 73.92 MB, 73.92 MB, 73.92 MB, 73.92 MB, 73.92 MB, 73.92 MB, 73.92 MB, 73.92 MB, 73.92 MB, 73.92 MB, 73.92 MB, 73.92 MB, 73.92 MB, 73.92 MB, 73.92 MB, 73.92 MB, 78.41 MB, 79.12 MB, 63.80 MB, 42.40 MB, 68.23 MB, 40.64 MB, 71.94 MB, 58.80 MB, 38.18 MB, 75.26 MB, 52.38 MB, 66.15 MB, 48.76 MB, 67.75 MB, 54.94 MB, 69.99 MB, 52.94 MB, 71.42 MB, 55.81 MB, 65.50 MB, 62.84 MB, 56.30 MB, 61.74 MB ThreadUsage(8s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 8.00 MB (8388608) - PeakMemoryUsage: 85.60 MB (89757444) - PerHostPeakMemUsage: 920.96 MB (965694713) - RowsProduced: 41.81M (41814816) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 5m13s - TotalStorageWaitTime: 774.940ms - TotalThreadsInvoluntaryContextSwitches: 335.69K (335691) - TotalThreadsTotalWallClockTime: 16m16s - TotalThreadsSysTime: 3s684ms - TotalThreadsUserTime: 2m43s - TotalThreadsVoluntaryContextSwitches: 14.10K (14099) Fragment Instance Lifecycle Timings: - ExecTime: 8m8s - ExecTreeExecTime: 11s661ms - OpenTime: 148.461ms - ExecTreeOpenTime: 6.578ms - PrepareTime: 161.054ms - ExecTreePrepareTime: 5.294ms DataStreamSender (dst_id=7):(Total: 1m5s, non-child: 1m5s, % non-child: 100.00%) - BytesSent: 976.88 MB (1024331761) - NetworkThroughput(*): 130.11 MB/sec - OverallThroughput: 14.92 MB/sec - PeakMemoryUsage: 248.94 KB (254912) - RowsReturned: 41.81M (41814816) - SerializeBatchTime: 57s907ms - TransmitDataRPCTime: 7s507ms - UncompressedRowBatchSize: 2.14 GB (2300234092) CodeGen:(Total: 224.194ms, non-child: 224.194ms, % non-child: 100.00%) - CodegenTime: 7.224ms - CompileTime: 19.854ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2076168) - NumFunctions: 46 (46) - NumInstructions: 720 (720) - OptimizationTime: 115.625ms - PeakMemoryUsage: 360.00 KB (368640) - PrepareTime: 87.742ms HDFS_SCAN_NODE (id=2):(Total: 11s475ms, non-child: 11s475ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 9:1/253.29 MB 6:1/253.32 MB 7:1/253.30 MB 11:1/253.31 MB 10:2/506.59 MB 0:2/506.67 MB 5:1/253.30 MB 8:2/506.58 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 11 out of 11 Runtime filters: Only following filters arrived: , waited 705ms Hdfs Read Thread Concurrency Bucket: 0:99.69% 1:0.3096% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:44 BytesRead(8s000ms): 47.77 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 58.34 MB, 68.62 MB, 114.88 MB, 119.76 MB, 178.67 MB, 178.67 MB, 179.31 MB, 238.22 MB, 238.22 MB, 290.33 MB, 297.78 MB, 350.97 MB, 361.06 MB, 416.88 MB, 428.05 MB, 476.44 MB, 493.53 MB, 534.57 MB, 569.49 MB, 595.55 MB, 645.01 MB - FooterProcessingTime: (Avg: 4.479ms ; Min: 249.410us ; Max: 14.256ms ; Number of samples: 11) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 655.09 MB (686915434) - BytesReadDataNodeCache: 0 - BytesReadLocal: 655.09 MB (686915434) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 655.09 MB (686915434) - DecompressionTime: 3s092ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 8 (8) - NumRowGroups: 11 (11) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 77.32 MB (81075844) - PerReadThreadRawHdfsThroughput: 552.20 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 8s338ms - RowBatchQueuePutWaitTime: 5m15s - RowsRead: 77.55M (77549411) - RowsReturned: 41.81M (41814816) - RowsReturnedRate: 3.64 M/sec - ScanRangesComplete: 11 (11) - ScannerThreadsInvoluntaryContextSwitches: 115.87K (115872) - ScannerThreadsTotalWallClockTime: 8m7s - MaterializeTupleTime(*): 2m44s - ScannerThreadsSysTime: 1s995ms - ScannerThreadsUserTime: 1m20s - ScannerThreadsVoluntaryContextSwitches: 9.55K (9553) - TotalRawHdfsReadTime(*): 1s186ms - TotalReadThroughput: 1.35 MB/sec Filter 1 (8.00 MB): - Rows processed: 319.78K (319776) - Rows rejected: 2.68K (2676) - Rows total: 77.55M (77549411) Instance 674b2fc81eb8bff4:b6ab0eca00000007 (host=redacted-host6:22000):(Total: 8m7s, non-child: 6m50s, % non-child: 84.19%) Hdfs split stats (:<# splits>/): 7:1/253.31 MB 0:1/253.32 MB 8:2/506.63 MB 6:3/498.75 MB 3:3/759.98 MB 5:1/253.29 MB 11:1/253.27 MB Filter 1 arrival: 5m2s MemoryUsage(8s000ms): 59.62 MB, 73.87 MB, 73.87 MB, 73.87 MB, 73.87 MB, 73.87 MB, 73.87 MB, 73.87 MB, 73.87 MB, 73.87 MB, 73.87 MB, 73.87 MB, 73.87 MB, 73.87 MB, 73.87 MB, 73.87 MB, 73.87 MB, 73.87 MB, 73.87 MB, 73.87 MB, 73.87 MB, 73.87 MB, 73.87 MB, 73.87 MB, 73.87 MB, 73.87 MB, 73.87 MB, 73.87 MB, 73.87 MB, 73.87 MB, 73.87 MB, 73.87 MB, 73.87 MB, 73.87 MB, 73.87 MB, 73.87 MB, 73.87 MB, 80.37 MB, 77.24 MB, 56.54 MB, 63.95 MB, 63.15 MB, 40.13 MB, 71.96 MB, 57.00 MB, 47.81 MB, 71.20 MB, 44.60 MB, 73.74 MB, 56.00 MB, 68.38 MB, 54.93 MB, 70.75 MB, 46.67 MB, 56.84 MB, 69.12 MB, 56.45 MB, 58.53 MB, 48.93 MB, 64.76 MB ThreadUsage(8s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 8.00 MB (8388608) - PeakMemoryUsage: 86.79 MB (91003688) - PerHostPeakMemUsage: 920.61 MB (965327461) - RowsProduced: 41.68M (41684642) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 5m14s - TotalStorageWaitTime: 507.776ms - TotalThreadsInvoluntaryContextSwitches: 347.79K (347792) - TotalThreadsTotalWallClockTime: 16m14s - TotalThreadsSysTime: 3s771ms - TotalThreadsUserTime: 2m42s - TotalThreadsVoluntaryContextSwitches: 15.00K (14997) Fragment Instance Lifecycle Timings: - ExecTime: 8m7s - ExecTreeExecTime: 12s462ms - OpenTime: 134.602ms - ExecTreeOpenTime: 158.083us - PrepareTime: 195.845ms - ExecTreePrepareTime: 352.108us DataStreamSender (dst_id=7):(Total: 1m4s, non-child: 1m4s, % non-child: 100.00%) - BytesSent: 973.49 MB (1020777292) - NetworkThroughput(*): 129.91 MB/sec - OverallThroughput: 15.07 MB/sec - PeakMemoryUsage: 248.94 KB (254912) - RowsReturned: 41.68M (41684642) - SerializeBatchTime: 57s042ms - TransmitDataRPCTime: 7s493ms - UncompressedRowBatchSize: 2.14 GB (2293073218) CodeGen:(Total: 227.457ms, non-child: 227.457ms, % non-child: 100.00%) - CodegenTime: 6.358ms - CompileTime: 19.546ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2076168) - NumFunctions: 46 (46) - NumInstructions: 720 (720) - OptimizationTime: 112.160ms - PeakMemoryUsage: 360.00 KB (368640) - PrepareTime: 89.102ms HDFS_SCAN_NODE (id=2):(Total: 12s288ms, non-child: 12s288ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:1/253.31 MB 0:1/253.32 MB 8:2/506.63 MB 6:3/498.75 MB 3:3/759.98 MB 5:1/253.29 MB 11:1/253.27 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 12 out of 12 Runtime filters: Only following filters arrived: , waited 688ms Hdfs Read Thread Concurrency Bucket: 0:99.59% 1:0.4149% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:48 BytesRead(8s000ms): 47.76 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 58.95 MB, 92.35 MB, 119.11 MB, 119.11 MB, 176.08 MB, 178.66 MB, 193.55 MB, 238.22 MB, 245.67 MB, 297.77 MB, 316.18 MB, 357.32 MB, 379.65 MB, 416.88 MB, 433.63 MB, 471.66 MB, 513.81 MB, 541.96 MB, 572.56 MB, 602.52 MB, 653.48 MB - FooterProcessingTime: (Avg: 5.085ms ; Min: 2.401ms ; Max: 17.742ms ; Number of samples: 12) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 653.48 MB (685220896) - BytesReadDataNodeCache: 0 - BytesReadLocal: 653.48 MB (685220896) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 653.48 MB (685220896) - DecompressionTime: 2s996ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 7 (7) - NumRowGroups: 12 (12) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 78.57 MB (82390926) - PerReadThreadRawHdfsThroughput: 685.39 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 8s705ms - RowBatchQueuePutWaitTime: 5m17s - RowsRead: 77.32M (77318295) - RowsReturned: 41.68M (41684642) - RowsReturnedRate: 3.39 M/sec - ScanRangesComplete: 12 (12) - ScannerThreadsInvoluntaryContextSwitches: 117.43K (117429) - ScannerThreadsTotalWallClockTime: 8m6s - MaterializeTupleTime(*): 2m41s - ScannerThreadsSysTime: 1s965ms - ScannerThreadsUserTime: 1m19s - ScannerThreadsVoluntaryContextSwitches: 9.94K (9940) - TotalRawHdfsReadTime(*): 953.436ms - TotalReadThroughput: 1.35 MB/sec Filter 1 (8.00 MB): - Rows processed: 350.05K (350045) - Rows rejected: 3.05K (3049) - Rows total: 77.32M (77318295) Instance 674b2fc81eb8bff4:b6ab0eca00000004 (host=redacted-host8:22000):(Total: 7m51s, non-child: 6m41s, % non-child: 85.07%) Hdfs split stats (:<# splits>/): 4:2/444.66 MB 11:1/253.34 MB 0:1/253.33 MB 7:1/253.31 MB 6:2/506.66 MB 9:2/506.61 MB 8:1/253.29 MB Filter 1 arrival: 5m2s MemoryUsage(8s000ms): 64.38 MB, 77.94 MB, 77.94 MB, 77.94 MB, 77.94 MB, 77.94 MB, 77.94 MB, 77.94 MB, 77.94 MB, 77.94 MB, 77.94 MB, 77.94 MB, 77.94 MB, 77.94 MB, 77.94 MB, 77.94 MB, 77.94 MB, 77.94 MB, 77.94 MB, 77.94 MB, 77.94 MB, 77.94 MB, 77.94 MB, 77.94 MB, 77.94 MB, 77.94 MB, 77.94 MB, 77.94 MB, 77.94 MB, 77.94 MB, 77.94 MB, 77.94 MB, 77.94 MB, 77.94 MB, 77.94 MB, 77.94 MB, 77.94 MB, 81.94 MB, 84.77 MB, 66.67 MB, 44.06 MB, 72.59 MB, 45.12 MB, 71.95 MB, 53.86 MB, 63.34 MB, 75.45 MB, 46.25 MB, 69.12 MB, 53.42 MB, 60.82 MB, 57.91 MB, 65.72 MB, 57.23 MB, 61.96 MB, 57.68 MB, 55.74 MB, 62.82 MB ThreadUsage(8s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 8.00 MB (8388608) - PeakMemoryUsage: 86.09 MB (90268420) - PerHostPeakMemUsage: 924.63 MB (969540410) - RowsProduced: 37.07M (37069680) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 5m14s - TotalStorageWaitTime: 446.109ms - TotalThreadsInvoluntaryContextSwitches: 296.41K (296411) - TotalThreadsTotalWallClockTime: 15m42s - TotalThreadsSysTime: 3s357ms - TotalThreadsUserTime: 2m24s - TotalThreadsVoluntaryContextSwitches: 13.20K (13195) Fragment Instance Lifecycle Timings: - ExecTime: 7m51s - ExecTreeExecTime: 12s003ms - OpenTime: 170.127ms - ExecTreeOpenTime: 167.105us - PrepareTime: 231.492ms - ExecTreePrepareTime: 391.318us DataStreamSender (dst_id=7):(Total: 58s309ms, non-child: 58s309ms, % non-child: 100.00%) - BytesSent: 867.90 MB (910055600) - NetworkThroughput(*): 129.49 MB/sec - OverallThroughput: 14.88 MB/sec - PeakMemoryUsage: 248.94 KB (254912) - RowsReturned: 37.07M (37069680) - SerializeBatchTime: 51s560ms - TransmitDataRPCTime: 6s702ms - UncompressedRowBatchSize: 1.90 GB (2039204044) CodeGen:(Total: 291.629ms, non-child: 291.629ms, % non-child: 100.00%) - CodegenTime: 5.554ms - CompileTime: 18.691ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2076168) - NumFunctions: 46 (46) - NumInstructions: 720 (720) - OptimizationTime: 134.790ms - PeakMemoryUsage: 360.00 KB (368640) - PrepareTime: 137.359ms HDFS_SCAN_NODE (id=2):(Total: 11s823ms, non-child: 11s823ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:2/444.66 MB 11:1/253.34 MB 0:1/253.33 MB 7:1/253.31 MB 6:2/506.66 MB 9:2/506.61 MB 8:1/253.29 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 10 out of 10 Runtime filters: Only following filters arrived: , waited 622ms Hdfs Read Thread Concurrency Bucket: 0:99.79% 1:0.2139% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:40 BytesRead(8s000ms): 52.11 MB, 59.56 MB, 59.56 MB, 59.56 MB, 59.56 MB, 59.56 MB, 59.56 MB, 59.56 MB, 59.56 MB, 59.56 MB, 59.56 MB, 59.56 MB, 59.56 MB, 59.56 MB, 59.56 MB, 59.56 MB, 59.56 MB, 59.56 MB, 59.56 MB, 59.56 MB, 59.56 MB, 59.56 MB, 59.56 MB, 59.56 MB, 59.56 MB, 59.56 MB, 59.56 MB, 59.56 MB, 59.56 MB, 59.56 MB, 59.56 MB, 59.56 MB, 59.56 MB, 59.56 MB, 59.56 MB, 59.56 MB, 59.56 MB, 59.56 MB, 59.56 MB, 59.56 MB, 69.02 MB, 119.12 MB, 126.57 MB, 178.69 MB, 178.69 MB, 215.91 MB, 238.25 MB, 243.11 MB, 297.81 MB, 306.25 MB, 342.83 MB, 372.62 MB, 402.40 MB, 432.18 MB, 461.97 MB, 499.18 MB, 521.52 MB, 572.24 MB - FooterProcessingTime: (Avg: 6.367ms ; Min: 2.810ms ; Max: 24.318ms ; Number of samples: 10) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 581.08 MB (609302905) - BytesReadDataNodeCache: 0 - BytesReadLocal: 581.08 MB (609302905) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 581.08 MB (609302905) - DecompressionTime: 2s913ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 7 (7) - NumRowGroups: 10 (10) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 77.79 MB (81563498) - PerReadThreadRawHdfsThroughput: 794.35 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 8s434ms - RowBatchQueuePutWaitTime: 5m15s - RowsRead: 68.77M (68773599) - RowsReturned: 37.07M (37069680) - RowsReturnedRate: 3.14 M/sec - ScanRangesComplete: 10 (10) - ScannerThreadsInvoluntaryContextSwitches: 100.22K (100220) - ScannerThreadsTotalWallClockTime: 7m50s - MaterializeTupleTime(*): 2m27s - ScannerThreadsSysTime: 1s791ms - ScannerThreadsUserTime: 1m10s - ScannerThreadsVoluntaryContextSwitches: 8.60K (8599) - TotalRawHdfsReadTime(*): 731.512ms - TotalReadThroughput: 1.24 MB/sec Filter 1 (8.00 MB): - Rows processed: 286.61K (286605) - Rows rejected: 2.56K (2565) - Rows total: 68.77M (68773599) Instance 674b2fc81eb8bff4:b6ab0eca00000006 (host=redacted-host1:22000):(Total: 7m50s, non-child: 6m39s, % non-child: 84.95%) Hdfs split stats (:<# splits>/): 11:2/506.67 MB 8:2/506.69 MB 5:1/253.34 MB 3:1/253.33 MB 7:1/253.30 MB 10:1/253.31 MB 9:3/670.40 MB Filter 1 arrival: 5m2s MemoryUsage(8s000ms): 60.95 MB, 73.93 MB, 73.93 MB, 73.93 MB, 73.93 MB, 73.93 MB, 73.93 MB, 73.93 MB, 73.93 MB, 73.93 MB, 73.93 MB, 73.93 MB, 73.93 MB, 73.93 MB, 73.93 MB, 73.93 MB, 73.93 MB, 73.93 MB, 73.93 MB, 73.93 MB, 73.93 MB, 73.93 MB, 73.93 MB, 73.93 MB, 73.93 MB, 73.93 MB, 73.93 MB, 73.93 MB, 73.93 MB, 73.93 MB, 73.93 MB, 73.93 MB, 73.93 MB, 73.93 MB, 73.93 MB, 73.93 MB, 73.93 MB, 79.41 MB, 78.97 MB, 66.48 MB, 49.63 MB, 60.91 MB, 60.29 MB, 60.46 MB, 48.49 MB, 72.88 MB, 55.02 MB, 62.56 MB, 56.64 MB, 66.08 MB, 47.65 MB, 70.24 MB, 58.06 MB, 64.39 MB, 52.33 MB, 56.51 MB, 63.13 MB, 48.86 MB ThreadUsage(8s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 8.00 MB (8388608) - PeakMemoryUsage: 82.07 MB (86056708) - PerHostPeakMemUsage: 920.64 MB (965362430) - RowsProduced: 40.46M (40463716) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 5m14s - TotalStorageWaitTime: 564.793ms - TotalThreadsInvoluntaryContextSwitches: 308.77K (308773) - TotalThreadsTotalWallClockTime: 15m39s - TotalThreadsSysTime: 3s517ms - TotalThreadsUserTime: 2m37s - TotalThreadsVoluntaryContextSwitches: 13.72K (13723) Fragment Instance Lifecycle Timings: - ExecTime: 7m50s - ExecTreeExecTime: 9s537ms - OpenTime: 137.411ms - ExecTreeOpenTime: 1.168ms - PrepareTime: 183.643ms - ExecTreePrepareTime: 358.714us DataStreamSender (dst_id=7):(Total: 1m1s, non-child: 1m1s, % non-child: 100.00%) - BytesSent: 947.48 MB (993500947) - NetworkThroughput(*): 129.78 MB/sec - OverallThroughput: 15.48 MB/sec - PeakMemoryUsage: 248.94 KB (254912) - RowsReturned: 40.46M (40463716) - SerializeBatchTime: 53s853ms - TransmitDataRPCTime: 7s300ms - UncompressedRowBatchSize: 2.07 GB (2225910040) CodeGen:(Total: 238.869ms, non-child: 238.869ms, % non-child: 100.00%) - CodegenTime: 4.120ms - CompileTime: 19.158ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2076168) - NumFunctions: 46 (46) - NumInstructions: 720 (720) - OptimizationTime: 110.321ms - PeakMemoryUsage: 360.00 KB (368640) - PrepareTime: 106.139ms HDFS_SCAN_NODE (id=2):(Total: 9s354ms, non-child: 9s354ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 11:2/506.67 MB 8:2/506.69 MB 5:1/253.34 MB 3:1/253.33 MB 7:1/253.30 MB 10:1/253.31 MB 9:3/670.40 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 11 out of 11 Runtime filters: Only following filters arrived: , waited 703ms Hdfs Read Thread Concurrency Bucket: 0:99.79% 1:0.2148% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:44 BytesRead(8s000ms): 49.27 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 58.74 MB, 83.19 MB, 117.89 MB, 154.30 MB, 177.45 MB, 199.79 MB, 235.18 MB, 238.24 MB, 285.35 MB, 301.33 MB, 354.93 MB, 367.93 MB, 414.90 MB, 438.05 MB, 474.87 MB, 504.65 MB, 535.24 MB, 587.37 MB, 619.74 MB - FooterProcessingTime: (Avg: 9.222ms ; Min: 279.585us ; Max: 68.550ms ; Number of samples: 11) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 634.20 MB (665009357) - BytesReadDataNodeCache: 0 - BytesReadLocal: 634.20 MB (665009357) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 634.20 MB (665009357) - DecompressionTime: 2s745ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 7 (7) - NumRowGroups: 11 (11) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 73.83 MB (77411178) - PerReadThreadRawHdfsThroughput: 742.17 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 5s749ms - RowBatchQueuePutWaitTime: 5m17s - RowsRead: 75.06M (75059060) - RowsReturned: 40.46M (40463716) - RowsReturnedRate: 4.33 M/sec - ScanRangesComplete: 11 (11) - ScannerThreadsInvoluntaryContextSwitches: 104.87K (104866) - ScannerThreadsTotalWallClockTime: 7m49s - MaterializeTupleTime(*): 2m25s - ScannerThreadsSysTime: 1s827ms - ScannerThreadsUserTime: 1m17s - ScannerThreadsVoluntaryContextSwitches: 9.17K (9168) - TotalRawHdfsReadTime(*): 854.523ms - TotalReadThroughput: 1.36 MB/sec Filter 1 (8.00 MB): - Rows processed: 330.59K (330589) - Rows rejected: 2.80K (2802) - Rows total: 75.06M (75059060) Instance 674b2fc81eb8bff4:b6ab0eca00000002 (host=redacted-host4:22000):(Total: 7m47s, non-child: 6m39s, % non-child: 85.34%) Hdfs split stats (:<# splits>/): 3:1/253.30 MB 7:1/253.34 MB 9:1/253.30 MB 11:1/253.31 MB 2:1/190.65 MB 10:2/506.63 MB 5:2/506.59 MB 1:2/422.05 MB Filter 1 arrival: 5m2s MemoryUsage(8s000ms): 62.59 MB, 73.97 MB, 73.97 MB, 73.97 MB, 73.97 MB, 73.97 MB, 73.97 MB, 73.97 MB, 73.97 MB, 73.97 MB, 73.97 MB, 73.97 MB, 73.97 MB, 73.97 MB, 73.97 MB, 73.97 MB, 73.97 MB, 73.97 MB, 73.97 MB, 73.97 MB, 73.97 MB, 73.97 MB, 73.97 MB, 73.97 MB, 73.97 MB, 73.97 MB, 73.97 MB, 73.97 MB, 73.97 MB, 73.97 MB, 73.97 MB, 73.97 MB, 73.97 MB, 73.97 MB, 73.97 MB, 73.97 MB, 73.97 MB, 77.97 MB, 81.03 MB, 64.06 MB, 48.30 MB, 73.28 MB, 62.23 MB, 68.61 MB, 48.59 MB, 72.44 MB, 65.25 MB, 45.62 MB, 58.46 MB, 58.69 MB, 56.91 MB, 55.93 MB, 50.56 MB, 60.51 MB, 68.98 MB, 62.85 MB, 53.92 MB, 58.88 MB ThreadUsage(8s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 8.00 MB (8388608) - PeakMemoryUsage: 85.97 MB (90143492) - PerHostPeakMemUsage: 920.38 MB (965090143) - RowsProduced: 39.60M (39597356) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 5m13s - TotalStorageWaitTime: 373.768ms - TotalThreadsInvoluntaryContextSwitches: 306.34K (306344) - TotalThreadsTotalWallClockTime: 15m33s - TotalThreadsSysTime: 3s408ms - TotalThreadsUserTime: 2m34s - TotalThreadsVoluntaryContextSwitches: 12.85K (12853) Fragment Instance Lifecycle Timings: - ExecTime: 7m47s - ExecTreeExecTime: 8s892ms - OpenTime: 153.836ms - ExecTreeOpenTime: 181.837us - PrepareTime: 180.136ms - ExecTreePrepareTime: 506.548us DataStreamSender (dst_id=7):(Total: 59s574ms, non-child: 59s574ms, % non-child: 100.00%) - BytesSent: 926.85 MB (971875478) - NetworkThroughput(*): 130.02 MB/sec - OverallThroughput: 15.56 MB/sec - PeakMemoryUsage: 248.94 KB (254912) - RowsReturned: 39.60M (39597356) - SerializeBatchTime: 52s388ms - TransmitDataRPCTime: 7s128ms - UncompressedRowBatchSize: 2.03 GB (2178251564) CodeGen:(Total: 239.463ms, non-child: 239.463ms, % non-child: 100.00%) - CodegenTime: 5.494ms - CompileTime: 39.324ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2076168) - NumFunctions: 46 (46) - NumInstructions: 720 (720) - OptimizationTime: 111.647ms - PeakMemoryUsage: 360.00 KB (368640) - PrepareTime: 86.606ms HDFS_SCAN_NODE (id=2):(Total: 8s733ms, non-child: 8s733ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:1/253.30 MB 7:1/253.34 MB 9:1/253.30 MB 11:1/253.31 MB 2:1/190.65 MB 10:2/506.63 MB 5:2/506.59 MB 1:2/422.05 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 11 out of 11 Runtime filters: Only following filters arrived: , waited 685ms Hdfs Read Thread Concurrency Bucket: 0:99.78% 1:0.2157% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:44 BytesRead(8s000ms): 48.76 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 56.30 MB, 57.72 MB, 74.44 MB, 119.11 MB, 145.17 MB, 178.67 MB, 189.22 MB, 234.97 MB, 237.61 MB, 262.08 MB, 299.06 MB, 336.28 MB, 373.02 MB, 397.06 MB, 433.52 MB, 466.57 MB, 500.26 MB, 542.43 MB, 572.21 MB, 620.60 MB - FooterProcessingTime: (Avg: 3.553ms ; Min: 2.566ms ; Max: 6.958ms ; Number of samples: 11) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 620.60 MB (650751269) - BytesReadDataNodeCache: 0 - BytesReadLocal: 620.60 MB (650751269) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 620.60 MB (650751269) - DecompressionTime: 2s770ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 8 (8) - NumRowGroups: 11 (11) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 77.70 MB (81479530) - PerReadThreadRawHdfsThroughput: 794.56 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 5s361ms - RowBatchQueuePutWaitTime: 5m16s - RowsRead: 73.45M (73445556) - RowsReturned: 39.60M (39597356) - RowsReturnedRate: 4.53 M/sec - ScanRangesComplete: 11 (11) - ScannerThreadsInvoluntaryContextSwitches: 104.56K (104560) - ScannerThreadsTotalWallClockTime: 7m46s - MaterializeTupleTime(*): 2m24s - ScannerThreadsSysTime: 1s794ms - ScannerThreadsUserTime: 1m15s - ScannerThreadsVoluntaryContextSwitches: 8.62K (8623) - TotalRawHdfsReadTime(*): 781.065ms - TotalReadThroughput: 1.34 MB/sec Filter 1 (8.00 MB): - Rows processed: 315.51K (315514) - Rows rejected: 2.68K (2682) - Rows total: 73.45M (73445556) Instance 674b2fc81eb8bff4:b6ab0eca00000003 (host=redacted-host2:22000):(Total: 7m43s, non-child: 6m36s, % non-child: 85.56%) Hdfs split stats (:<# splits>/): 2:1/253.33 MB 11:1/253.32 MB 10:2/449.12 MB 5:5/1.13 GB 8:2/506.65 MB Filter 1 arrival: 5m1s MemoryUsage(8s000ms): 51.94 MB, 62.40 MB, 62.40 MB, 62.40 MB, 62.40 MB, 62.40 MB, 62.40 MB, 62.40 MB, 62.40 MB, 62.40 MB, 62.40 MB, 62.40 MB, 62.40 MB, 62.40 MB, 62.40 MB, 62.40 MB, 62.40 MB, 62.40 MB, 62.40 MB, 62.40 MB, 62.40 MB, 62.40 MB, 62.40 MB, 62.40 MB, 62.40 MB, 62.40 MB, 62.40 MB, 62.40 MB, 62.40 MB, 62.40 MB, 62.40 MB, 62.40 MB, 62.40 MB, 62.40 MB, 62.40 MB, 62.40 MB, 62.40 MB, 66.90 MB, 70.21 MB, 50.07 MB, 63.55 MB, 53.02 MB, 68.58 MB, 54.28 MB, 72.31 MB, 60.63 MB, 59.94 MB, 70.19 MB, 56.93 MB, 63.68 MB, 63.19 MB, 51.13 MB, 73.70 MB, 54.79 MB, 67.08 MB, 46.52 MB, 72.20 MB ThreadUsage(8s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 8.00 MB (8388608) - PeakMemoryUsage: 86.00 MB (90176260) - PerHostPeakMemUsage: 914.55 MB (958972542) - RowsProduced: 39.23M (39231790) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 5m15s - TotalStorageWaitTime: 381.966ms - TotalThreadsInvoluntaryContextSwitches: 313.75K (313748) - TotalThreadsTotalWallClockTime: 15m25s - TotalThreadsSysTime: 3s172ms - TotalThreadsUserTime: 2m32s - TotalThreadsVoluntaryContextSwitches: 14.10K (14104) Fragment Instance Lifecycle Timings: - ExecTime: 7m42s - ExecTreeExecTime: 9s181ms - OpenTime: 143.560ms - ExecTreeOpenTime: 212.191us - PrepareTime: 176.197ms - ExecTreePrepareTime: 361.114us DataStreamSender (dst_id=7):(Total: 57s573ms, non-child: 57s573ms, % non-child: 100.00%) - BytesSent: 922.43 MB (967241300) - NetworkThroughput(*): 133.10 MB/sec - OverallThroughput: 16.02 MB/sec - PeakMemoryUsage: 248.94 KB (254912) - RowsReturned: 39.23M (39231790) - SerializeBatchTime: 50s596ms - TransmitDataRPCTime: 6s930ms - UncompressedRowBatchSize: 2.01 GB (2158141766) CodeGen:(Total: 260.341ms, non-child: 260.341ms, % non-child: 100.00%) - CodegenTime: 4.528ms - CompileTime: 13.224ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2076168) - NumFunctions: 46 (46) - NumInstructions: 720 (720) - OptimizationTime: 126.564ms - PeakMemoryUsage: 360.00 KB (368640) - PrepareTime: 119.555ms HDFS_SCAN_NODE (id=2):(Total: 9s039ms, non-child: 9s039ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:1/253.33 MB 11:1/253.32 MB 10:2/449.12 MB 5:5/1.13 GB 8:2/506.65 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 11 out of 11 Runtime filters: Only following filters arrived: , waited 708ms Hdfs Read Thread Concurrency Bucket: 0:99.67% 1:0.3264% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:44 BytesRead(8s000ms): 39.13 MB, 46.09 MB, 46.09 MB, 46.09 MB, 46.09 MB, 46.09 MB, 46.09 MB, 46.09 MB, 46.09 MB, 46.09 MB, 46.09 MB, 46.09 MB, 46.09 MB, 46.09 MB, 46.09 MB, 46.09 MB, 46.09 MB, 46.09 MB, 46.09 MB, 46.09 MB, 46.09 MB, 46.09 MB, 46.09 MB, 46.09 MB, 46.09 MB, 46.09 MB, 46.09 MB, 46.09 MB, 46.09 MB, 46.09 MB, 46.09 MB, 46.09 MB, 46.09 MB, 46.09 MB, 46.09 MB, 46.09 MB, 46.09 MB, 46.09 MB, 46.09 MB, 46.09 MB, 88.32 MB, 105.24 MB, 161.48 MB, 165.20 MB, 217.31 MB, 224.76 MB, 253.83 MB, 284.31 MB, 317.82 MB, 343.87 MB, 389.82 MB, 407.15 MB, 462.98 MB, 477.05 MB, 520.91 MB, 544.53 MB, 609.37 MB - FooterProcessingTime: (Avg: 4.561ms ; Min: 2.388ms ; Max: 13.702ms ; Number of samples: 11) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 615.11 MB (644994467) - BytesReadDataNodeCache: 0 - BytesReadLocal: 615.11 MB (644994467) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 615.11 MB (644994467) - DecompressionTime: 2s683ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 5 (5) - NumRowGroups: 11 (11) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 77.70 MB (81471338) - PerReadThreadRawHdfsThroughput: 908.54 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 3s692ms - RowBatchQueuePutWaitTime: 5m21s - RowsRead: 72.79M (72793682) - RowsReturned: 39.23M (39231790) - RowsReturnedRate: 4.34 M/sec - ScanRangesComplete: 11 (11) - ScannerThreadsInvoluntaryContextSwitches: 108.53K (108532) - ScannerThreadsTotalWallClockTime: 7m42s - MaterializeTupleTime(*): 2m14s - ScannerThreadsSysTime: 1s648ms - ScannerThreadsUserTime: 1m14s - ScannerThreadsVoluntaryContextSwitches: 10.01K (10009) - TotalRawHdfsReadTime(*): 677.036ms - TotalReadThroughput: 1.34 MB/sec Filter 1 (8.00 MB): - Rows processed: 327.76K (327761) - Rows rejected: 2.92K (2919) - Rows total: 72.79M (72793682) Instance 674b2fc81eb8bff4:b6ab0eca00000001 (host=redacted-host5:22000):(Total: 7m41s, non-child: 6m34s, % non-child: 85.52%) Hdfs split stats (:<# splits>/): 4:1/253.29 MB 2:1/253.33 MB 10:2/506.60 MB 0:2/506.62 MB 7:2/506.59 MB 1:2/506.65 MB 11:1/253.31 MB Filter 1 arrival: 5m2s MemoryUsage(8s000ms): 61.64 MB, 73.90 MB, 73.90 MB, 73.90 MB, 73.90 MB, 73.90 MB, 73.90 MB, 73.90 MB, 73.90 MB, 73.90 MB, 73.90 MB, 73.90 MB, 73.90 MB, 73.90 MB, 73.90 MB, 73.90 MB, 73.90 MB, 73.90 MB, 73.90 MB, 73.90 MB, 73.90 MB, 73.90 MB, 73.90 MB, 73.90 MB, 73.90 MB, 73.90 MB, 73.90 MB, 73.90 MB, 73.90 MB, 73.90 MB, 73.90 MB, 73.90 MB, 73.90 MB, 73.90 MB, 73.90 MB, 73.90 MB, 73.90 MB, 77.40 MB, 81.37 MB, 67.28 MB, 58.20 MB, 57.98 MB, 71.80 MB, 49.55 MB, 69.65 MB, 44.85 MB, 71.57 MB, 59.53 MB, 73.72 MB, 57.18 MB, 66.39 MB, 59.29 MB, 49.47 MB, 74.20 MB, 61.46 MB, 56.47 MB, 59.22 MB ThreadUsage(8s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 8.00 MB (8388608) - PeakMemoryUsage: 86.05 MB (90234628) - PerHostPeakMemUsage: 920.19 MB (964894132) - RowsProduced: 41.79M (41792461) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 5m13s - TotalStorageWaitTime: 903.827ms - TotalThreadsInvoluntaryContextSwitches: 311.84K (311837) - TotalThreadsTotalWallClockTime: 15m21s - TotalThreadsSysTime: 3s562ms - TotalThreadsUserTime: 2m42s - TotalThreadsVoluntaryContextSwitches: 13.60K (13601) Fragment Instance Lifecycle Timings: - ExecTime: 7m41s - ExecTreeExecTime: 7s163ms - OpenTime: 148.723ms - ExecTreeOpenTime: 176.155us - PrepareTime: 190.951ms - ExecTreePrepareTime: 309.090us DataStreamSender (dst_id=7):(Total: 59s620ms, non-child: 59s620ms, % non-child: 100.00%) - BytesSent: 979.86 MB (1027461197) - NetworkThroughput(*): 130.90 MB/sec - OverallThroughput: 16.44 MB/sec - PeakMemoryUsage: 248.94 KB (254912) - RowsReturned: 41.79M (41792461) - SerializeBatchTime: 52s085ms - TransmitDataRPCTime: 7s485ms - UncompressedRowBatchSize: 2.14 GB (2299004347) CodeGen:(Total: 226.389ms, non-child: 226.389ms, % non-child: 100.00%) - CodegenTime: 7.078ms - CompileTime: 40.834ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2076168) - NumFunctions: 46 (46) - NumInstructions: 720 (720) - OptimizationTime: 103.622ms - PeakMemoryUsage: 360.00 KB (368640) - PrepareTime: 75.477ms HDFS_SCAN_NODE (id=2):(Total: 6s987ms, non-child: 6s987ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:1/253.29 MB 2:1/253.33 MB 10:2/506.60 MB 0:2/506.62 MB 7:2/506.59 MB 1:2/506.65 MB 11:1/253.31 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 11 out of 11 Runtime filters: Only following filters arrived: , waited 683ms Hdfs Read Thread Concurrency Bucket: 0:99.67% 1:0.2186% 2:0% 3:0.1093% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:44 BytesRead(8s000ms): 49.27 MB, 56.31 MB, 56.31 MB, 56.31 MB, 56.31 MB, 56.31 MB, 56.31 MB, 56.31 MB, 56.31 MB, 56.31 MB, 56.31 MB, 56.31 MB, 56.31 MB, 56.31 MB, 56.31 MB, 56.31 MB, 56.31 MB, 56.31 MB, 56.31 MB, 56.31 MB, 56.31 MB, 56.31 MB, 56.31 MB, 56.31 MB, 56.31 MB, 56.31 MB, 56.31 MB, 56.31 MB, 56.31 MB, 56.31 MB, 56.31 MB, 56.31 MB, 56.31 MB, 56.31 MB, 56.31 MB, 56.31 MB, 56.31 MB, 56.31 MB, 56.31 MB, 58.14 MB, 89.35 MB, 119.14 MB, 178.69 MB, 197.30 MB, 238.25 MB, 238.25 MB, 294.72 MB, 308.77 MB, 357.36 MB, 383.42 MB, 416.92 MB, 454.14 MB, 476.47 MB, 536.03 MB, 557.66 MB, 595.59 MB, 649.59 MB - FooterProcessingTime: (Avg: 9.152ms ; Min: 2.320ms ; Max: 26.807ms ; Number of samples: 11) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 655.14 MB (686961504) - BytesReadDataNodeCache: 0 - BytesReadLocal: 655.14 MB (686961504) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 655.14 MB (686961504) - DecompressionTime: 2s631ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 7 (7) - NumRowGroups: 11 (11) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 77.83 MB (81605482) - PerReadThreadRawHdfsThroughput: 469.96 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 3s106ms - RowBatchQueuePutWaitTime: 5m18s - RowsRead: 77.55M (77549499) - RowsReturned: 41.79M (41792461) - RowsReturnedRate: 5.98 M/sec - ScanRangesComplete: 11 (11) - ScannerThreadsInvoluntaryContextSwitches: 103.81K (103812) - ScannerThreadsTotalWallClockTime: 7m40s - MaterializeTupleTime(*): 2m15s - ScannerThreadsSysTime: 1s875ms - ScannerThreadsUserTime: 1m19s - ScannerThreadsVoluntaryContextSwitches: 9.19K (9193) - TotalRawHdfsReadTime(*): 1s394ms - TotalReadThroughput: 1.43 MB/sec Filter 1 (8.00 MB): - Rows processed: 335.75K (335750) - Rows rejected: 2.77K (2770) - Rows total: 77.55M (77549499) Averaged Fragment F01:(Total: 1m25s, non-child: 45s897ms, % non-child: 53.62%) split sizes: min: 523.59 MB, max: 1001.63 MB, avg: 776.99 MB, stddev: 121.73 MB completion times: min:31s195ms max:5m1s mean: 1m25s stddev:1m22s execution rates: min:3.32 MB/sec max:16.78 MB/sec mean:12.61 MB/sec stddev:3.83 MB/sec num instances: 8 - AverageThreadTokens: 1.92 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 81.56 MB (85519022) - PerHostPeakMemUsage: 693.04 MB (726706481) - RowsProduced: 6.72M (6724470) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 34s308ms - TotalStorageWaitTime: 226.262ms - TotalThreadsInvoluntaryContextSwitches: 33.40K (33396) - TotalThreadsTotalWallClockTime: 2m29s - TotalThreadsSysTime: 623.529ms - TotalThreadsUserTime: 31s624ms - TotalThreadsVoluntaryContextSwitches: 9.21K (9213) Fragment Instance Lifecycle Timings: - ExecTime: 1m25s - ExecTreeExecTime: 30s962ms - OpenTime: 144.305ms - ExecTreeOpenTime: 153.232us - PrepareTime: 188.025ms - ExecTreePrepareTime: 641.038us DataStreamSender (dst_id=8):(Total: 8s505ms, non-child: 8s505ms, % non-child: 100.00%) - BytesSent: 161.99 MB (169860296) - NetworkThroughput(*): 131.31 MB/sec - OverallThroughput: 19.04 MB/sec - PeakMemoryUsage: 248.94 KB (254912) - RowsReturned: 6.72M (6724470) - SerializeBatchTime: 7s263ms - TransmitDataRPCTime: 1s233ms - UncompressedRowBatchSize: 352.78 MB (369913325) CodeGen:(Total: 249.472ms, non-child: 249.472ms, % non-child: 100.00%) - CodegenTime: 3.938ms - CompileTime: 26.983ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2076168) - NumFunctions: 46 (46) - NumInstructions: 720 (720) - OptimizationTime: 112.138ms - PeakMemoryUsage: 360.00 KB (368640) - PrepareTime: 106.735ms HDFS_SCAN_NODE (id=1):(Total: 30s937ms, non-child: 30s937ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 0.93 - BytesRead: 195.05 MB (204526229) - BytesReadDataNodeCache: 0 - BytesReadLocal: 195.05 MB (204526229) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 195.05 MB (204526229) - DecompressionTime: 915.538ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 3 (3) - NumRowGroups: 3 (3) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 81.05 MB (84985498) - PerReadThreadRawHdfsThroughput: 601.89 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 29s942ms - RowBatchQueuePutWaitTime: 10s008ms - RowsRead: 18.75M (18750000) - RowsReturned: 6.72M (6724470) - RowsReturnedRate: 231.20 K/sec - ScanRangesComplete: 3 (3) - ScannerThreadsInvoluntaryContextSwitches: 18.38K (18379) - ScannerThreadsTotalWallClockTime: 1m4s - MaterializeTupleTime(*): 46s579ms - ScannerThreadsSysTime: 383.941ms - ScannerThreadsUserTime: 17s906ms - ScannerThreadsVoluntaryContextSwitches: 4.71K (4712) - TotalRawHdfsReadTime(*): 339.572ms - TotalReadThroughput: 3.19 MB/sec Filter 0 (1.00 MB): - Rows processed: 16.59M (16588792) - Rows rejected: 4.91M (4907988) - Rows total: 18.75M (18750000) Fragment F01: Instance 674b2fc81eb8bff4:b6ab0eca0000000c (host=redacted-host3:22000):(Total: 5m1s, non-child: 4m3s, % non-child: 80.62%) Hdfs split stats (:<# splits>/): 6:1/252.99 MB 7:1/239.19 MB 5:1/253.01 MB 1:1/253.01 MB 2:1/3.44 MB Filter 0 arrival: 6s811ms MemoryUsage(8s000ms): 58.31 MB, 42.21 MB, 58.51 MB, 35.20 MB, 62.47 MB, 44.80 MB, 40.13 MB, 59.11 MB, 47.24 MB, 44.22 MB, 46.65 MB, 46.65 MB, 46.65 MB, 46.65 MB, 46.65 MB, 46.26 MB, 25.95 MB, 6.99 MB, 4.06 MB, 4.06 MB, 4.06 MB, 4.06 MB, 4.06 MB, 4.06 MB, 4.06 MB, 4.06 MB, 4.06 MB, 4.06 MB, 4.06 MB, 4.06 MB, 4.06 MB, 4.06 MB, 4.06 MB, 4.06 MB, 4.06 MB, 4.06 MB, 4.06 MB ThreadUsage(8s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.46 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 86.43 MB (90625138) - PerHostPeakMemUsage: 724.11 MB (759284958) - RowsProduced: 8.56M (8561418) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 3m48s - TotalStorageWaitTime: 432.321ms - TotalThreadsInvoluntaryContextSwitches: 39.19K (39186) - TotalThreadsTotalWallClockTime: 7m19s - TotalThreadsSysTime: 719.890ms - TotalThreadsUserTime: 40s385ms - TotalThreadsVoluntaryContextSwitches: 13.70K (13698) Fragment Instance Lifecycle Timings: - ExecTime: 5m1s - ExecTreeExecTime: 47s749ms - OpenTime: 149.928ms - ExecTreeOpenTime: 159.637us - PrepareTime: 194.731ms - ExecTreePrepareTime: 2.889ms DataStreamSender (dst_id=8):(Total: 10s521ms, non-child: 10s521ms, % non-child: 100.00%) - BytesSent: 204.91 MB (214866339) - NetworkThroughput(*): 133.37 MB/sec - OverallThroughput: 19.48 MB/sec - PeakMemoryUsage: 248.94 KB (254912) - RowsReturned: 8.56M (8561418) - SerializeBatchTime: 8s976ms - TransmitDataRPCTime: 1s536ms - UncompressedRowBatchSize: 449.15 MB (470963830) CodeGen:(Total: 239.458ms, non-child: 239.458ms, % non-child: 100.00%) - CodegenTime: 2.772ms - CompileTime: 10.766ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2076168) - NumFunctions: 46 (46) - NumInstructions: 720 (720) - OptimizationTime: 125.352ms - PeakMemoryUsage: 360.00 KB (368640) - PrepareTime: 87.575ms HDFS_SCAN_NODE (id=1):(Total: 47s728ms, non-child: 47s728ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 6:1/252.99 MB 7:1/239.19 MB 5:1/253.01 MB 1:1/253.01 MB 2:1/3.44 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 5 out of 5 Runtime filters: Only following filters arrived: , waited 687ms Hdfs Read Thread Concurrency Bucket: 0:99.67% 1:0.3344% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:20 BytesRead(8s000ms): 52.12 MB, 70.97 MB, 123.47 MB, 123.47 MB, 179.00 MB, 186.94 MB, 209.82 MB, 250.40 MB, 250.40 MB, 250.40 MB, 250.40 MB, 250.40 MB, 250.40 MB, 250.40 MB, 250.40 MB, 250.40 MB, 250.40 MB, 251.25 MB, 251.44 MB, 251.44 MB, 251.44 MB, 251.44 MB, 251.44 MB, 251.44 MB, 251.44 MB, 251.44 MB, 251.44 MB, 251.44 MB, 251.44 MB, 251.44 MB, 251.44 MB, 251.44 MB, 251.44 MB, 251.44 MB, 251.44 MB, 251.44 MB, 251.44 MB - FooterProcessingTime: (Avg: 12.563ms ; Min: 4.247ms ; Max: 40.742ms ; Number of samples: 5) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.46 - BytesRead: 251.44 MB (263653344) - BytesReadDataNodeCache: 0 - BytesReadLocal: 251.44 MB (263653344) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 251.44 MB (263653344) - DecompressionTime: 1s134ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 5 (5) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 85.11 MB (89242846) - PerReadThreadRawHdfsThroughput: 593.57 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 46s765ms - RowBatchQueuePutWaitTime: 53s696ms - RowsRead: 24.17M (24170250) - RowsReturned: 8.56M (8561418) - RowsReturnedRate: 179.38 K/sec - ScanRangesComplete: 5 (5) - ScannerThreadsInvoluntaryContextSwitches: 20.86K (20857) - ScannerThreadsTotalWallClockTime: 2m17s - MaterializeTupleTime(*): 1m14s - ScannerThreadsSysTime: 441.932ms - ScannerThreadsUserTime: 23s127ms - ScannerThreadsVoluntaryContextSwitches: 7.80K (7796) - TotalRawHdfsReadTime(*): 423.605ms - TotalReadThroughput: 859.49 KB/sec Filter 0 (1.00 MB): - Rows processed: 22.13M (22125322) - Rows rejected: 6.55M (6551156) - Rows total: 24.17M (24170250) Instance 674b2fc81eb8bff4:b6ab0eca0000000d (host=redacted-host4:22000):(Total: 1m13s, non-child: 29s866ms, % non-child: 40.74%) Hdfs split stats (:<# splits>/): 5:1/253.03 MB 4:1/253.02 MB 3:1/30.26 MB 0:1/253.01 MB Filter 0 arrival: 6s814ms MemoryUsage(2s000ms): 31.50 MB, 78.24 MB, 79.19 MB, 60.37 MB, 45.78 MB, 53.68 MB, 54.59 MB, 54.59 MB, 54.59 MB, 54.59 MB, 43.82 MB, 25.99 MB, 31.74 MB, 67.76 MB, 76.58 MB, 61.53 MB, 55.49 MB, 51.60 MB, 43.64 MB, 41.62 MB, 33.82 MB, 33.23 MB, 21.51 MB, 67.53 MB, 67.54 MB, 65.62 MB, 57.65 MB, 51.67 MB, 45.68 MB, 43.69 MB, 39.99 MB, 31.79 MB, 27.80 MB, 22.00 MB, 16.19 MB, 12.66 MB ThreadUsage(2s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 1.99 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 84.36 MB (88454258) - PerHostPeakMemUsage: 724.62 MB (759820761) - RowsProduced: 6.82M (6822821) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 17s422ms - TotalStorageWaitTime: 217.359ms - TotalThreadsInvoluntaryContextSwitches: 33.23K (33230) - TotalThreadsTotalWallClockTime: 2m25s - TotalThreadsSysTime: 568.913ms - TotalThreadsUserTime: 32s033ms - TotalThreadsVoluntaryContextSwitches: 9.54K (9539) Fragment Instance Lifecycle Timings: - ExecTime: 1m12s - ExecTreeExecTime: 34s556ms - OpenTime: 117.800ms - ExecTreeOpenTime: 169.184us - PrepareTime: 229.698ms - ExecTreePrepareTime: 325.849us DataStreamSender (dst_id=8):(Total: 8s674ms, non-child: 8s674ms, % non-child: 100.00%) - BytesSent: 163.10 MB (171018313) - NetworkThroughput(*): 130.13 MB/sec - OverallThroughput: 18.80 MB/sec - PeakMemoryUsage: 248.94 KB (254912) - RowsReturned: 6.82M (6822821) - SerializeBatchTime: 7s413ms - TransmitDataRPCTime: 1s253ms - UncompressedRowBatchSize: 357.94 MB (375323571) CodeGen:(Total: 238.849ms, non-child: 238.849ms, % non-child: 100.00%) - CodegenTime: 2.706ms - CompileTime: 18.773ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2076168) - NumFunctions: 46 (46) - NumInstructions: 720 (720) - OptimizationTime: 92.639ms - PeakMemoryUsage: 360.00 KB (368640) - PrepareTime: 126.641ms HDFS_SCAN_NODE (id=1):(Total: 34s526ms, non-child: 34s526ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:1/253.03 MB 4:1/253.02 MB 3:1/30.26 MB 0:1/253.01 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 4 out of 4 Runtime filters: Only following filters arrived: , waited 664ms Hdfs Read Thread Concurrency Bucket: 0:99.31% 1:0.6897% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:16 BytesRead(2s000ms): 28.08 MB, 63.47 MB, 63.47 MB, 63.47 MB, 63.47 MB, 63.47 MB, 63.47 MB, 63.47 MB, 63.47 MB, 63.47 MB, 63.47 MB, 63.47 MB, 79.34 MB, 126.94 MB, 126.94 MB, 126.94 MB, 126.94 MB, 126.94 MB, 126.94 MB, 126.94 MB, 126.94 MB, 126.94 MB, 126.94 MB, 190.40 MB, 190.40 MB, 190.40 MB, 190.40 MB, 190.40 MB, 190.40 MB, 190.40 MB, 190.40 MB, 190.40 MB, 190.40 MB, 190.40 MB, 194.28 MB, 198.15 MB - FooterProcessingTime: (Avg: 6.377ms ; Min: 4.482ms ; Max: 9.646ms ; Number of samples: 4) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 0.99 - BytesRead: 198.15 MB (207774701) - BytesReadDataNodeCache: 0 - BytesReadLocal: 198.15 MB (207774701) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 198.15 MB (207774701) - DecompressionTime: 988.760ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 4 (4) - NumRowGroups: 4 (4) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 83.05 MB (87088350) - PerReadThreadRawHdfsThroughput: 541.75 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 33s610ms - RowBatchQueuePutWaitTime: 11s833ms - RowsRead: 19.05M (19046157) - RowsReturned: 6.82M (6822821) - RowsReturnedRate: 197.61 K/sec - ScanRangesComplete: 4 (4) - ScannerThreadsInvoluntaryContextSwitches: 18.39K (18393) - ScannerThreadsTotalWallClockTime: 1m12s - MaterializeTupleTime(*): 51s803ms - ScannerThreadsSysTime: 332.949ms - ScannerThreadsUserTime: 18s192ms - ScannerThreadsVoluntaryContextSwitches: 4.99K (4990) - TotalRawHdfsReadTime(*): 365.756ms - TotalReadThroughput: 2.71 MB/sec Filter 0 (1.00 MB): - Rows processed: 16.92M (16916536) - Rows rejected: 5.00M (5003617) - Rows total: 19.05M (19046157) Instance 674b2fc81eb8bff4:b6ab0eca0000000a (host=redacted-host6:22000):(Total: 1m, non-child: 20s517ms, % non-child: 33.81%) Hdfs split stats (:<# splits>/): 1:1/253.04 MB 6:1/253.00 MB 8:1/253.01 MB 10:2/67.63 MB Filter 0 arrival: 6s878ms MemoryUsage(1s000ms): 33.92 KB, 42.14 MB, 74.95 MB, 80.10 MB, 80.10 MB, 79.51 MB, 74.73 MB, 68.83 MB, 59.83 MB, 44.60 MB, 59.37 MB, 56.66 MB, 37.87 MB, 27.63 MB, 19.75 MB, 20.14 MB, 21.85 MB, 20.61 MB, 44.07 MB, 67.66 MB, 67.57 MB, 67.52 MB, 67.48 MB, 59.59 MB, 55.66 MB, 51.63 MB, 51.66 MB, 51.76 MB, 47.61 MB, 43.55 MB, 43.63 MB, 43.58 MB, 35.55 MB, 37.63 MB, 28.61 MB, 27.70 MB, 23.70 MB, 19.76 MB, 51.58 MB, 67.51 MB, 67.92 MB, 67.51 MB, 67.59 MB, 63.79 MB, 64.47 MB, 68.19 MB, 58.41 MB, 54.08 MB, 47.71 MB, 44.24 MB, 43.61 MB, 43.59 MB, 35.71 MB, 31.61 MB, 27.72 MB, 27.70 MB, 23.67 MB, 19.67 MB, 14.76 MB, 9.55 MB ThreadUsage(1s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 1.98 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 80.25 MB (84143218) - PerHostPeakMemUsage: 717.82 MB (752685264) - RowsProduced: 7.09M (7086870) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 7s223ms - TotalStorageWaitTime: 227.162ms - TotalThreadsInvoluntaryContextSwitches: 37.19K (37191) - TotalThreadsTotalWallClockTime: 2m - TotalThreadsSysTime: 697.894ms - TotalThreadsUserTime: 33s679ms - TotalThreadsVoluntaryContextSwitches: 9.31K (9310) Fragment Instance Lifecycle Timings: - ExecTime: 1m - ExecTreeExecTime: 30s493ms - OpenTime: 130.254ms - ExecTreeOpenTime: 150.444us - PrepareTime: 222.692ms - ExecTreePrepareTime: 533.085us DataStreamSender (dst_id=8):(Total: 9s445ms, non-child: 9s445ms, % non-child: 100.00%) - BytesSent: 170.74 MB (179037738) - NetworkThroughput(*): 133.12 MB/sec - OverallThroughput: 18.08 MB/sec - PeakMemoryUsage: 248.94 KB (254912) - RowsReturned: 7.09M (7086870) - SerializeBatchTime: 8s155ms - TransmitDataRPCTime: 1s282ms - UncompressedRowBatchSize: 371.79 MB (389848910) CodeGen:(Total: 261.484ms, non-child: 261.484ms, % non-child: 100.00%) - CodegenTime: 2.478ms - CompileTime: 25.238ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2076168) - NumFunctions: 46 (46) - NumInstructions: 720 (720) - OptimizationTime: 102.237ms - PeakMemoryUsage: 360.00 KB (368640) - PrepareTime: 133.227ms HDFS_SCAN_NODE (id=1):(Total: 30s466ms, non-child: 30s466ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:1/253.04 MB 6:1/253.00 MB 8:1/253.01 MB 10:2/67.63 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 5 out of 5 Runtime filters: Only following filters arrived: , waited 654ms Hdfs Read Thread Concurrency Bucket: 0:99.17% 1:0.8333% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:20 BytesRead(1s000ms): 0, 36.17 MB, 63.47 MB, 63.47 MB, 63.47 MB, 63.47 MB, 63.47 MB, 63.47 MB, 63.47 MB, 63.47 MB, 63.47 MB, 63.47 MB, 63.47 MB, 63.47 MB, 63.47 MB, 69.56 MB, 75.66 MB, 75.66 MB, 107.40 MB, 139.13 MB, 139.13 MB, 139.13 MB, 139.13 MB, 139.13 MB, 139.13 MB, 139.13 MB, 139.13 MB, 139.13 MB, 139.13 MB, 139.13 MB, 139.13 MB, 139.13 MB, 139.13 MB, 139.13 MB, 139.13 MB, 139.13 MB, 139.13 MB, 139.13 MB, 183.31 MB, 202.61 MB, 202.61 MB, 202.61 MB, 202.61 MB, 202.61 MB, 202.61 MB, 202.61 MB, 202.61 MB, 202.61 MB, 202.61 MB, 202.61 MB, 202.61 MB, 202.61 MB, 202.61 MB, 202.61 MB, 202.61 MB, 202.61 MB, 202.61 MB, 202.61 MB, 205.15 MB, 207.69 MB - FooterProcessingTime: (Avg: 5.276ms ; Min: 2.902ms ; Max: 11.368ms ; Number of samples: 5) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 0.99 - BytesRead: 207.69 MB (217778642) - BytesReadDataNodeCache: 0 - BytesReadLocal: 207.69 MB (217778642) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 207.69 MB (217778642) - DecompressionTime: 1s045ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 4 (4) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 79.99 MB (83877086) - PerReadThreadRawHdfsThroughput: 492.37 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 29s377ms - RowBatchQueuePutWaitTime: 3s401ms - RowsRead: 19.94M (19943008) - RowsReturned: 7.09M (7086870) - RowsReturnedRate: 232.61 K/sec - ScanRangesComplete: 5 (5) - ScannerThreadsInvoluntaryContextSwitches: 20.38K (20375) - ScannerThreadsTotalWallClockTime: 59s596ms - MaterializeTupleTime(*): 48s065ms - ScannerThreadsSysTime: 420.936ms - ScannerThreadsUserTime: 19s101ms - ScannerThreadsVoluntaryContextSwitches: 4.79K (4792) - TotalRawHdfsReadTime(*): 421.816ms - TotalReadThroughput: 3.43 MB/sec Filter 0 (1.00 MB): - Rows processed: 18.08M (18084448) - Rows rejected: 5.35M (5351185) - Rows total: 19.94M (19943008) Instance 674b2fc81eb8bff4:b6ab0eca0000000e (host=redacted-host2:22000):(Total: 56s068ms, non-child: 14s713ms, % non-child: 26.24%) Hdfs split stats (:<# splits>/): 4:1/253.03 MB 3:1/253.01 MB 6:1/253.01 MB Filter 0 arrival: 6s815ms MemoryUsage(1s000ms): 33.92 KB, 54.32 MB, 80.17 MB, 80.19 MB, 78.94 MB, 79.30 MB, 72.09 MB, 56.60 MB, 51.75 MB, 43.73 MB, 43.62 MB, 39.72 MB, 31.78 MB, 27.77 MB, 23.85 MB, 19.90 MB, 47.10 MB, 67.60 MB, 67.67 MB, 67.56 MB, 64.07 MB, 59.68 MB, 51.62 MB, 51.67 MB, 51.61 MB, 47.62 MB, 43.73 MB, 43.68 MB, 43.70 MB, 35.73 MB, 31.69 MB, 27.73 MB, 27.86 MB, 27.91 MB, 19.72 MB, 67.51 MB, 67.50 MB, 67.55 MB, 67.55 MB, 67.56 MB, 63.58 MB, 59.57 MB, 55.65 MB, 51.68 MB, 51.61 MB, 47.63 MB, 43.68 MB, 43.57 MB, 43.67 MB, 35.67 MB, 35.62 MB, 27.66 MB, 27.63 MB, 24.25 MB, 19.67 MB ThreadUsage(1s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 1.98 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 80.24 MB (84135026) - PerHostPeakMemUsage: 689.43 MB (722922786) - RowsProduced: 6.56M (6559795) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 3s715ms - TotalStorageWaitTime: 395.580ms - TotalThreadsInvoluntaryContextSwitches: 32.85K (32854) - TotalThreadsTotalWallClockTime: 1m51s - TotalThreadsSysTime: 675.896ms - TotalThreadsUserTime: 31s182ms - TotalThreadsVoluntaryContextSwitches: 9.25K (9246) Fragment Instance Lifecycle Timings: - ExecTime: 55s793ms - ExecTreeExecTime: 32s893ms - OpenTime: 133.806ms - ExecTreeOpenTime: 176.824us - PrepareTime: 141.410ms - ExecTreePrepareTime: 275.935us DataStreamSender (dst_id=8):(Total: 8s261ms, non-child: 8s261ms, % non-child: 100.00%) - BytesSent: 158.25 MB (165934382) - NetworkThroughput(*): 128.22 MB/sec - OverallThroughput: 19.15 MB/sec - PeakMemoryUsage: 248.94 KB (254912) - RowsReturned: 6.56M (6559795) - SerializeBatchTime: 7s019ms - TransmitDataRPCTime: 1s234ms - UncompressedRowBatchSize: 344.14 MB (360854501) CodeGen:(Total: 223.440ms, non-child: 223.440ms, % non-child: 100.00%) - CodegenTime: 2.857ms - CompileTime: 21.536ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2076168) - NumFunctions: 46 (46) - NumInstructions: 720 (720) - OptimizationTime: 109.612ms - PeakMemoryUsage: 360.00 KB (368640) - PrepareTime: 91.088ms HDFS_SCAN_NODE (id=1):(Total: 32s869ms, non-child: 32s869ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:1/253.03 MB 3:1/253.01 MB 6:1/253.01 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 3 out of 3 Runtime filters: Only following filters arrived: , waited 746ms Hdfs Read Thread Concurrency Bucket: 0:98.18% 1:1.818% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:12 BytesRead(1s000ms): 0, 44.17 MB, 63.47 MB, 63.47 MB, 63.47 MB, 63.47 MB, 63.47 MB, 63.47 MB, 63.47 MB, 63.47 MB, 63.47 MB, 63.47 MB, 63.47 MB, 63.47 MB, 63.47 MB, 63.47 MB, 103.64 MB, 126.94 MB, 126.94 MB, 126.94 MB, 126.94 MB, 126.94 MB, 126.94 MB, 126.94 MB, 126.94 MB, 126.94 MB, 126.94 MB, 126.94 MB, 126.94 MB, 126.94 MB, 126.94 MB, 126.94 MB, 126.94 MB, 126.94 MB, 126.94 MB, 190.42 MB, 190.42 MB, 190.42 MB, 190.42 MB, 190.42 MB, 190.42 MB, 190.42 MB, 190.42 MB, 190.42 MB, 190.42 MB, 190.42 MB, 190.42 MB, 190.42 MB, 190.42 MB, 190.42 MB, 190.42 MB, 190.42 MB, 190.42 MB, 190.42 MB, 190.42 MB - FooterProcessingTime: (Avg: 35.944ms ; Min: 8.364ms ; Max: 87.813ms ; Number of samples: 3) - AverageHdfsReadThreadConcurrency: 0.02 - AverageScannerThreadConcurrency: 0.99 - BytesRead: 190.42 MB (199671771) - BytesReadDataNodeCache: 0 - BytesReadLocal: 190.42 MB (199671771) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 190.42 MB (199671771) - DecompressionTime: 915.839ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 3 (3) - NumRowGroups: 3 (3) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 80.03 MB (83919070) - PerReadThreadRawHdfsThroughput: 438.50 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 31s645ms - RowBatchQueuePutWaitTime: 2s271ms - RowsRead: 18.32M (18324633) - RowsReturned: 6.56M (6559795) - RowsReturnedRate: 199.57 K/sec - ScanRangesComplete: 3 (3) - ScannerThreadsInvoluntaryContextSwitches: 19.93K (19933) - ScannerThreadsTotalWallClockTime: 55s380ms - MaterializeTupleTime(*): 43s833ms - ScannerThreadsSysTime: 421.935ms - ScannerThreadsUserTime: 17s673ms - ScannerThreadsVoluntaryContextSwitches: 4.29K (4291) - TotalRawHdfsReadTime(*): 434.259ms - TotalReadThroughput: 3.43 MB/sec Filter 0 (1.00 MB): - Rows processed: 16.30M (16296089) - Rows rejected: 4.82M (4821625) - Rows total: 18.32M (18324633) Instance 674b2fc81eb8bff4:b6ab0eca0000000f (host=redacted-host7:22000):(Total: 55s213ms, non-child: 16s548ms, % non-child: 29.97%) Hdfs split stats (:<# splits>/): 5:1/253.00 MB 7:1/252.99 MB 11:1/36.53 MB 0:1/253.00 MB Filter 0 arrival: 6s896ms MemoryUsage(1s000ms): 217.92 KB, 15.76 MB, 24.82 MB, 29.18 MB, 58.92 MB, 78.92 MB, 74.91 MB, 65.96 MB, 53.00 MB, 47.70 MB, 60.44 MB, 60.93 MB, 42.17 MB, 31.75 MB, 27.97 MB, 20.32 MB, 51.34 MB, 67.56 MB, 67.57 MB, 67.59 MB, 63.60 MB, 59.60 MB, 51.75 MB, 51.72 MB, 51.67 MB, 47.62 MB, 43.83 MB, 43.66 MB, 43.78 MB, 39.69 MB, 35.88 MB, 31.75 MB, 27.71 MB, 32.63 MB, 19.83 MB, 35.65 MB, 67.53 MB, 67.55 MB, 67.52 MB, 67.53 MB, 60.02 MB, 55.65 MB, 51.63 MB, 51.65 MB, 51.79 MB, 43.67 MB, 43.73 MB, 43.67 MB, 39.78 MB, 35.69 MB, 31.72 MB, 27.76 MB, 27.76 MB, 20.00 MB, 19.76 MB ThreadUsage(1s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 1.99 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 80.47 MB (84382292) - PerHostPeakMemUsage: 700.38 MB (734396720) - RowsProduced: 6.91M (6910271) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 5s316ms - TotalStorageWaitTime: 153.618ms - TotalThreadsInvoluntaryContextSwitches: 35.05K (35053) - TotalThreadsTotalWallClockTime: 1m49s - TotalThreadsSysTime: 615.906ms - TotalThreadsUserTime: 32s227ms - TotalThreadsVoluntaryContextSwitches: 8.79K (8792) Fragment Instance Lifecycle Timings: - ExecTime: 54s904ms - ExecTreeExecTime: 29s877ms - OpenTime: 129.062ms - ExecTreeOpenTime: 150.353us - PrepareTime: 180.171ms - ExecTreePrepareTime: 300.950us DataStreamSender (dst_id=8):(Total: 8s577ms, non-child: 8s577ms, % non-child: 100.00%) - BytesSent: 166.62 MB (174712404) - NetworkThroughput(*): 133.41 MB/sec - OverallThroughput: 19.43 MB/sec - PeakMemoryUsage: 248.94 KB (254912) - RowsReturned: 6.91M (6910271) - SerializeBatchTime: 7s310ms - TransmitDataRPCTime: 1s248ms - UncompressedRowBatchSize: 362.52 MB (380134193) CodeGen:(Total: 234.300ms, non-child: 234.300ms, % non-child: 100.00%) - CodegenTime: 8.477ms - CompileTime: 40.613ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2076168) - NumFunctions: 46 (46) - NumInstructions: 720 (720) - OptimizationTime: 85.592ms - PeakMemoryUsage: 360.00 KB (368640) - PrepareTime: 107.386ms HDFS_SCAN_NODE (id=1):(Total: 29s853ms, non-child: 29s853ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:1/253.00 MB 7:1/252.99 MB 11:1/36.53 MB 0:1/253.00 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 4 out of 4 Runtime filters: Only following filters arrived: , waited 704ms Hdfs Read Thread Concurrency Bucket: 0:98.17% 1:1.835% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:16 BytesRead(1s000ms): 0, 9.31 MB, 9.31 MB, 9.31 MB, 49.47 MB, 72.77 MB, 72.77 MB, 72.77 MB, 72.77 MB, 72.77 MB, 72.77 MB, 72.77 MB, 72.77 MB, 72.77 MB, 72.77 MB, 72.77 MB, 116.94 MB, 136.24 MB, 136.24 MB, 136.24 MB, 136.24 MB, 136.24 MB, 136.24 MB, 136.24 MB, 136.24 MB, 136.24 MB, 136.24 MB, 136.24 MB, 136.24 MB, 136.24 MB, 136.24 MB, 136.24 MB, 136.24 MB, 136.24 MB, 136.24 MB, 160.36 MB, 199.71 MB, 199.71 MB, 199.71 MB, 199.71 MB, 199.71 MB, 199.71 MB, 199.71 MB, 199.71 MB, 199.71 MB, 199.71 MB, 199.71 MB, 199.71 MB, 199.71 MB, 199.71 MB, 199.71 MB, 199.71 MB, 199.71 MB, 199.71 MB, 199.71 MB - FooterProcessingTime: (Avg: 5.809ms ; Min: 3.411ms ; Max: 8.981ms ; Number of samples: 4) - AverageHdfsReadThreadConcurrency: 0.02 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 199.71 MB (209406920) - BytesReadDataNodeCache: 0 - BytesReadLocal: 199.71 MB (209406920) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 199.71 MB (209406920) - DecompressionTime: 889.803ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 4 (4) - NumRowGroups: 4 (4) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 80.23 MB (84125376) - PerReadThreadRawHdfsThroughput: 580.06 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 28s870ms - RowBatchQueuePutWaitTime: 3s035ms - RowsRead: 19.20M (19196895) - RowsReturned: 6.91M (6910271) - RowsReturnedRate: 231.47 K/sec - ScanRangesComplete: 4 (4) - ScannerThreadsInvoluntaryContextSwitches: 19.62K (19619) - ScannerThreadsTotalWallClockTime: 54s453ms - MaterializeTupleTime(*): 43s178ms - ScannerThreadsSysTime: 388.940ms - ScannerThreadsUserTime: 18s233ms - ScannerThreadsVoluntaryContextSwitches: 4.12K (4121) - TotalRawHdfsReadTime(*): 344.285ms - TotalReadThroughput: 3.63 MB/sec Filter 0 (1.00 MB): - Rows processed: 16.82M (16821499) - Rows rejected: 4.97M (4973474) - Rows total: 19.20M (19196895) Instance 674b2fc81eb8bff4:b6ab0eca00000010 (host=redacted-host1:22000):(Total: 53s702ms, non-child: 16s464ms, % non-child: 30.66%) Hdfs split stats (:<# splits>/): 6:1/252.99 MB 9:1/253.01 MB 11:1/252.99 MB Filter 0 arrival: 6s879ms MemoryUsage(1s000ms): 217.92 KB, 70.10 MB, 76.31 MB, 80.12 MB, 80.12 MB, 80.08 MB, 78.81 MB, 67.01 MB, 54.35 MB, 47.74 MB, 58.94 MB, 47.81 MB, 27.77 MB, 23.88 MB, 19.88 MB, 67.56 MB, 67.82 MB, 67.59 MB, 67.55 MB, 63.54 MB, 65.06 MB, 51.60 MB, 51.64 MB, 51.52 MB, 43.72 MB, 44.11 MB, 43.68 MB, 35.75 MB, 31.70 MB, 27.82 MB, 27.70 MB, 19.82 MB, 19.76 MB, 71.40 MB, 67.69 MB, 67.60 MB, 67.49 MB, 67.60 MB, 63.52 MB, 59.64 MB, 51.57 MB, 51.62 MB, 51.65 MB, 47.75 MB, 43.64 MB, 43.60 MB, 43.67 MB, 35.58 MB, 35.99 MB, 27.63 MB, 27.74 MB, 27.67 MB, 19.79 MB ThreadUsage(1s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 1.98 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 80.25 MB (84143218) - PerHostPeakMemUsage: 699.98 MB (733984713) - RowsProduced: 6.47M (6472147) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 6s180ms - TotalStorageWaitTime: 105.049ms - TotalThreadsInvoluntaryContextSwitches: 33.64K (33644) - TotalThreadsTotalWallClockTime: 1m46s - TotalThreadsSysTime: 614.906ms - TotalThreadsUserTime: 30s864ms - TotalThreadsVoluntaryContextSwitches: 8.39K (8395) Fragment Instance Lifecycle Timings: - ExecTime: 53s325ms - ExecTreeExecTime: 28s813ms - OpenTime: 216.295ms - ExecTreeOpenTime: 123.562us - PrepareTime: 160.317ms - ExecTreePrepareTime: 199.953us DataStreamSender (dst_id=8):(Total: 8s132ms, non-child: 8s132ms, % non-child: 100.00%) - BytesSent: 156.59 MB (164193818) - NetworkThroughput(*): 131.06 MB/sec - OverallThroughput: 19.25 MB/sec - PeakMemoryUsage: 248.94 KB (254912) - RowsReturned: 6.47M (6472147) - SerializeBatchTime: 6s929ms - TransmitDataRPCTime: 1s194ms - UncompressedRowBatchSize: 339.54 MB (356032981) CodeGen:(Total: 314.574ms, non-child: 314.574ms, % non-child: 100.00%) - CodegenTime: 3.373ms - CompileTime: 55.830ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2076168) - NumFunctions: 46 (46) - NumInstructions: 720 (720) - OptimizationTime: 157.875ms - PeakMemoryUsage: 360.00 KB (368640) - PrepareTime: 95.620ms HDFS_SCAN_NODE (id=1):(Total: 28s789ms, non-child: 28s789ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 6:1/252.99 MB 9:1/253.01 MB 11:1/252.99 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 3 out of 3 Runtime filters: Only following filters arrived: , waited 632ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:12 BytesRead(1s000ms): 0, 63.46 MB, 63.46 MB, 63.46 MB, 63.46 MB, 63.46 MB, 63.46 MB, 63.46 MB, 63.46 MB, 63.46 MB, 63.46 MB, 63.46 MB, 63.46 MB, 63.46 MB, 63.46 MB, 126.93 MB, 126.93 MB, 126.93 MB, 126.93 MB, 126.93 MB, 126.93 MB, 126.93 MB, 126.93 MB, 126.93 MB, 126.93 MB, 126.93 MB, 126.93 MB, 126.93 MB, 126.93 MB, 126.93 MB, 126.93 MB, 126.93 MB, 126.93 MB, 190.39 MB, 190.39 MB, 190.39 MB, 190.39 MB, 190.39 MB, 190.39 MB, 190.39 MB, 190.39 MB, 190.39 MB, 190.39 MB, 190.39 MB, 190.39 MB, 190.39 MB, 190.39 MB, 190.39 MB, 190.39 MB, 190.39 MB, 190.39 MB, 190.39 MB, 190.39 MB - FooterProcessingTime: (Avg: 13.275ms ; Min: 7.822ms ; Max: 23.053ms ; Number of samples: 3) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.99 - BytesRead: 190.39 MB (199642712) - BytesReadDataNodeCache: 0 - BytesReadLocal: 190.39 MB (199642712) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 190.39 MB (199642712) - DecompressionTime: 827.400ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 3 (3) - NumRowGroups: 3 (3) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 79.99 MB (83877086) - PerReadThreadRawHdfsThroughput: 926.63 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 27s878ms - RowBatchQueuePutWaitTime: 3s373ms - RowsRead: 18.32M (18321949) - RowsReturned: 6.47M (6472147) - RowsReturnedRate: 224.81 K/sec - ScanRangesComplete: 3 (3) - ScannerThreadsInvoluntaryContextSwitches: 19.58K (19576) - ScannerThreadsTotalWallClockTime: 52s665ms - MaterializeTupleTime(*): 41s429ms - ScannerThreadsSysTime: 393.940ms - ScannerThreadsUserTime: 17s549ms - ScannerThreadsVoluntaryContextSwitches: 3.91K (3909) - TotalRawHdfsReadTime(*): 205.469ms - TotalReadThroughput: 3.56 MB/sec Filter 0 (1.00 MB): - Rows processed: 16.88M (16879133) - Rows rejected: 5.00M (4995052) - Rows total: 18.32M (18321949) Instance 674b2fc81eb8bff4:b6ab0eca0000000b (host=redacted-host8:22000):(Total: 52s836ms, non-child: 13s771ms, % non-child: 26.06%) Hdfs split stats (:<# splits>/): 8:1/253.04 MB 6:1/2.08 MB 1:1/252.98 MB 2:1/253.02 MB Filter 0 arrival: 6s909ms MemoryUsage(1s000ms): 217.92 KB, 58.59 MB, 77.48 MB, 76.38 MB, 68.26 MB, 56.41 MB, 57.04 MB, 46.18 MB, 43.79 MB, 35.84 MB, 42.59 MB, 22.59 MB, 34.41 MB, 67.75 MB, 67.57 MB, 67.59 MB, 59.60 MB, 51.62 MB, 51.62 MB, 51.73 MB, 45.51 MB, 43.76 MB, 43.75 MB, 35.87 MB, 35.69 MB, 27.71 MB, 27.89 MB, 27.75 MB, 19.74 MB, 19.84 MB, 43.63 MB, 67.54 MB, 67.50 MB, 67.59 MB, 67.57 MB, 67.50 MB, 59.62 MB, 59.65 MB, 51.86 MB, 51.62 MB, 51.62 MB, 43.64 MB, 43.58 MB, 43.64 MB, 43.64 MB, 39.65 MB, 35.63 MB, 27.80 MB, 27.84 MB, 27.78 MB, 23.80 MB, 19.80 MB ThreadUsage(1s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 1.99 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 80.21 MB (84109426) - PerHostPeakMemUsage: 704.00 MB (738193391) - RowsProduced: 6.71M (6713401) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 2s502ms - TotalStorageWaitTime: 186.896ms - TotalThreadsInvoluntaryContextSwitches: 31.13K (31128) - TotalThreadsTotalWallClockTime: 1m44s - TotalThreadsSysTime: 630.904ms - TotalThreadsUserTime: 31s317ms - TotalThreadsVoluntaryContextSwitches: 9.24K (9238) Fragment Instance Lifecycle Timings: - ExecTime: 52s504ms - ExecTreeExecTime: 30s440ms - OpenTime: 125.013ms - ExecTreeOpenTime: 120.072us - PrepareTime: 206.600ms - ExecTreePrepareTime: 309.693us DataStreamSender (dst_id=8):(Total: 8s432ms, non-child: 8s432ms, % non-child: 100.00%) - BytesSent: 162.22 MB (170097225) - NetworkThroughput(*): 129.46 MB/sec - OverallThroughput: 19.24 MB/sec - PeakMemoryUsage: 248.94 KB (254912) - RowsReturned: 6.71M (6713401) - SerializeBatchTime: 7s171ms - TransmitDataRPCTime: 1s253ms - UncompressedRowBatchSize: 352.20 MB (369304379) CodeGen:(Total: 214.896ms, non-child: 214.896ms, % non-child: 100.00%) - CodegenTime: 3.328ms - CompileTime: 18.399ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2076168) - NumFunctions: 46 (46) - NumInstructions: 720 (720) - OptimizationTime: 101.216ms - PeakMemoryUsage: 360.00 KB (368640) - PrepareTime: 94.484ms HDFS_SCAN_NODE (id=1):(Total: 30s418ms, non-child: 30s418ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 8:1/253.04 MB 6:1/2.08 MB 1:1/252.98 MB 2:1/253.02 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 4 out of 4 Runtime filters: Only following filters arrived: , waited 688ms Hdfs Read Thread Concurrency Bucket: 0:99.03% 1:0.9709% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:16 BytesRead(1s000ms): 0, 52.16 MB, 63.45 MB, 63.45 MB, 63.45 MB, 63.45 MB, 63.45 MB, 63.45 MB, 63.45 MB, 63.45 MB, 63.45 MB, 63.45 MB, 95.62 MB, 127.62 MB, 127.62 MB, 127.62 MB, 127.62 MB, 127.62 MB, 127.62 MB, 127.62 MB, 127.62 MB, 127.62 MB, 127.62 MB, 127.62 MB, 127.62 MB, 127.62 MB, 127.62 MB, 127.62 MB, 127.62 MB, 127.62 MB, 159.36 MB, 191.10 MB, 191.10 MB, 191.10 MB, 191.10 MB, 191.10 MB, 191.10 MB, 191.10 MB, 191.10 MB, 191.10 MB, 191.10 MB, 191.10 MB, 191.10 MB, 191.10 MB, 191.10 MB, 191.10 MB, 191.10 MB, 191.10 MB, 191.10 MB, 191.10 MB, 191.10 MB, 191.10 MB - FooterProcessingTime: (Avg: 4.643ms ; Min: 2.234ms ; Max: 6.775ms ; Number of samples: 4) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 191.10 MB (200385214) - BytesReadDataNodeCache: 0 - BytesReadLocal: 191.10 MB (200385214) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 191.10 MB (200385214) - DecompressionTime: 927.560ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 4 (4) - NumRowGroups: 4 (4) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 79.95 MB (83835102) - PerReadThreadRawHdfsThroughput: 609.45 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 29s492ms - RowBatchQueuePutWaitTime: 529.195ms - RowsRead: 18.37M (18365130) - RowsReturned: 6.71M (6713401) - RowsReturnedRate: 220.70 K/sec - ScanRangesComplete: 4 (4) - ScannerThreadsInvoluntaryContextSwitches: 16.67K (16666) - ScannerThreadsTotalWallClockTime: 52s110ms - MaterializeTupleTime(*): 44s364ms - ScannerThreadsSysTime: 397.939ms - ScannerThreadsUserTime: 17s544ms - ScannerThreadsVoluntaryContextSwitches: 4.79K (4786) - TotalRawHdfsReadTime(*): 313.566ms - TotalReadThroughput: 3.67 MB/sec Filter 0 (1.00 MB): - Rows processed: 15.36M (15356618) - Rows rejected: 4.54M (4544243) - Rows total: 18.37M (18365130) Instance 674b2fc81eb8bff4:b6ab0eca00000009 (host=redacted-host5:22000):(Total: 31s140ms, non-child: 12s024ms, % non-child: 38.61%) Hdfs split stats (:<# splits>/): 11:1/17.59 MB 0:1/253.01 MB 6:1/253.00 MB Filter 0 arrival: 6s851ms MemoryUsage(500.000ms): 32.94 KB, 42.89 KB, 66.38 MB, 67.38 MB, 74.24 MB, 80.21 MB, 80.21 MB, 80.17 MB, 80.11 MB, 80.03 MB, 78.31 MB, 70.89 MB, 69.46 MB, 62.54 MB, 61.47 MB, 69.62 MB, 57.33 MB, 51.74 MB, 43.67 MB, 50.56 MB, 54.57 MB, 35.32 MB, 27.60 MB, 27.76 MB, 19.84 MB, 19.77 MB, 9.52 MB, 9.51 MB, 67.61 MB, 67.55 MB, 67.51 MB, 67.54 MB, 67.57 MB, 67.66 MB, 68.15 MB, 59.75 MB, 64.08 MB, 53.13 MB, 52.99 MB, 51.67 MB, 51.58 MB, 51.65 MB, 51.66 MB, 43.57 MB, 43.57 MB, 43.69 MB, 43.66 MB, 43.57 MB, 43.61 MB, 35.71 MB, 35.86 MB, 35.62 MB, 27.64 MB, 27.69 MB, 27.72 MB, 27.75 MB, 27.69 MB, 27.67 MB, 19.91 MB, 19.78 MB, 19.70 MB, 19.73 MB ThreadUsage(500.000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 1.98 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 80.26 MB (84159602) - PerHostPeakMemUsage: 584.00 MB (612363260) - RowsProduced: 4.67M (4669044) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 3s953ms - TotalStorageWaitTime: 92.112ms - TotalThreadsInvoluntaryContextSwitches: 24.88K (24883) - TotalThreadsTotalWallClockTime: 1m1s - TotalThreadsSysTime: 463.929ms - TotalThreadsUserTime: 21s304ms - TotalThreadsVoluntaryContextSwitches: 5.49K (5490) Fragment Instance Lifecycle Timings: - ExecTime: 30s819ms - ExecTreeExecTime: 12s871ms - OpenTime: 152.282ms - ExecTreeOpenTime: 175.785us - PrepareTime: 168.582ms - ExecTreePrepareTime: 293.618us DataStreamSender (dst_id=8):(Total: 6s001ms, non-child: 6s001ms, % non-child: 100.00%) - BytesSent: 113.51 MB (119022153) - NetworkThroughput(*): 131.68 MB/sec - OverallThroughput: 18.91 MB/sec - PeakMemoryUsage: 248.94 KB (254912) - RowsReturned: 4.67M (4669044) - SerializeBatchTime: 5s133ms - TransmitDataRPCTime: 861.987ms - UncompressedRowBatchSize: 244.95 MB (256844236) CodeGen:(Total: 268.779ms, non-child: 268.779ms, % non-child: 100.00%) - CodegenTime: 5.509ms - CompileTime: 24.706ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2076168) - NumFunctions: 46 (46) - NumInstructions: 720 (720) - OptimizationTime: 122.582ms - PeakMemoryUsage: 360.00 KB (368640) - PrepareTime: 117.859ms HDFS_SCAN_NODE (id=1):(Total: 12s846ms, non-child: 12s846ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 11:1/17.59 MB 0:1/253.01 MB 6:1/253.00 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 3 out of 3 Runtime filters: Only following filters arrived: , waited 692ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:12 BytesRead(500.000ms): 0, 0, 63.47 MB, 63.47 MB, 63.47 MB, 63.47 MB, 63.47 MB, 63.47 MB, 63.47 MB, 63.47 MB, 63.47 MB, 63.47 MB, 63.47 MB, 63.47 MB, 63.47 MB, 63.47 MB, 63.47 MB, 63.47 MB, 63.47 MB, 63.47 MB, 63.47 MB, 63.47 MB, 63.47 MB, 63.47 MB, 63.47 MB, 63.47 MB, 68.04 MB, 68.04 MB, 131.51 MB, 131.51 MB, 131.51 MB, 131.51 MB, 131.51 MB, 131.51 MB, 131.51 MB, 131.51 MB, 131.51 MB, 131.51 MB, 131.51 MB, 131.51 MB, 131.51 MB, 131.51 MB, 131.51 MB, 131.51 MB, 131.51 MB, 131.51 MB, 131.51 MB, 131.51 MB, 131.51 MB, 131.51 MB, 131.51 MB, 131.51 MB, 131.51 MB, 131.51 MB, 131.51 MB, 131.51 MB, 131.51 MB, 131.51 MB, 131.51 MB, 131.51 MB, 131.51 MB, 131.51 MB - FooterProcessingTime: (Avg: 2.531ms ; Min: 205.461us ; Max: 5.180ms ; Number of samples: 3) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 131.51 MB (137896530) - BytesReadDataNodeCache: 0 - BytesReadLocal: 131.51 MB (137896530) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 131.51 MB (137896530) - DecompressionTime: 594.576ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 3 (3) - NumRowGroups: 3 (3) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 80.03 MB (83919070) - PerReadThreadRawHdfsThroughput: 632.80 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 11s901ms - RowBatchQueuePutWaitTime: 1s925ms - RowsRead: 12.63M (12631978) - RowsReturned: 4.67M (4669044) - RowsReturnedRate: 363.46 K/sec - ScanRangesComplete: 3 (3) - ScannerThreadsInvoluntaryContextSwitches: 11.62K (11617) - ScannerThreadsTotalWallClockTime: 30s403ms - MaterializeTupleTime(*): 25s188ms - ScannerThreadsSysTime: 272.958ms - ScannerThreadsUserTime: 11s833ms - ScannerThreadsVoluntaryContextSwitches: 3.01K (3013) - TotalRawHdfsReadTime(*): 207.819ms - TotalReadThroughput: 4.24 MB/sec Filter 0 (1.00 MB): - Rows processed: 10.23M (10230698) - Rows rejected: 3.02M (3023552) - Rows total: 12.63M (12631978) Averaged Fragment F03:(Total: 4s258ms, non-child: 2s457ms, % non-child: 57.71%) split sizes: min: 142.33 MB, max: 296.57 MB, avg: 237.21 MB, stddev: 72.72 MB completion times: min:2s242ms max:6s848ms mean: 4s318ms stddev:1s472ms execution rates: min:36.47 MB/sec max:74.66 MB/sec mean:57.36 MB/sec stddev:14.86 MB/sec num instances: 5 - AverageThreadTokens: 1.73 - BloomFilterBytes: 0 - PeakMemoryUsage: 19.26 MB (20195700) - PerHostPeakMemUsage: 416.50 MB (436729314) - RowsProduced: 600.04K (600037) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1s501ms - TotalStorageWaitTime: 54.466ms - TotalThreadsInvoluntaryContextSwitches: 2.62K (2620) - TotalThreadsTotalWallClockTime: 7s620ms - TotalThreadsSysTime: 45.592ms - TotalThreadsUserTime: 2s580ms - TotalThreadsVoluntaryContextSwitches: 788 (788) Fragment Instance Lifecycle Timings: - ExecTime: 3s971ms - ExecTreeExecTime: 932.934ms - OpenTime: 133.831ms - ExecTreeOpenTime: 163.538us - PrepareTime: 153.002ms - ExecTreePrepareTime: 3.101ms DataStreamSender (dst_id=10):(Total: 637.417ms, non-child: 637.417ms, % non-child: 100.00%) - BytesSent: 7.26 MB (7609302) - NetworkThroughput(*): 91.93 MB/sec - OverallThroughput: 11.40 MB/sec - PeakMemoryUsage: 264.94 KB (271296) - RowsReturned: 600.04K (600037) - SerializeBatchTime: 558.371ms - TransmitDataRPCTime: 78.594ms - UncompressedRowBatchSize: 21.18 MB (22205073) CodeGen:(Total: 225.913ms, non-child: 225.913ms, % non-child: 100.00%) - CodegenTime: 2.985ms - CompileTime: 16.743ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2076168) - NumFunctions: 30 (30) - NumInstructions: 476 (476) - OptimizationTime: 110.785ms - PeakMemoryUsage: 238.00 KB (243712) - PrepareTime: 94.845ms HDFS_SCAN_NODE (id=0):(Total: 937.452ms, non-child: 937.452ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.83 - BytesRead: 12.84 MB (13464689) - BytesReadDataNodeCache: 0 - BytesReadLocal: 12.84 MB (13464689) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 12.84 MB (13464689) - DecompressionTime: 69.748ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 18.94 MB (19855643) - PerReadThreadRawHdfsThroughput: 1.17 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 906.635ms - RowBatchQueuePutWaitTime: 508.970ms - RowsRead: 3.00M (3000000) - RowsReturned: 600.04K (600037) - RowsReturnedRate: 705.58 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 1.20K (1202) - ScannerThreadsTotalWallClockTime: 3s515ms - MaterializeTupleTime(*): 2s697ms - ScannerThreadsSysTime: 31.394ms - ScannerThreadsUserTime: 1s410ms - ScannerThreadsVoluntaryContextSwitches: 511 (511) - TotalRawHdfsReadTime(*): 16.867ms - TotalReadThroughput: 2.96 MB/sec Fragment F03: Instance 674b2fc81eb8bff4:b6ab0eca0000001b (host=redacted-host4:22000):(Total: 6s761ms, non-child: 5s037ms, % non-child: 74.51%) Hdfs split stats (:<# splits>/): 3:2/296.45 MB MemoryUsage(500.000ms): 286.94 KB, 10.14 MB, 12.16 MB, 9.75 MB, 13.26 MB, 22.87 MB, 29.39 MB, 29.39 MB, 29.39 MB, 29.39 MB, 29.39 MB, 28.73 MB, 20.48 MB, 1.22 MB ThreadUsage(500.000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1 - AverageThreadTokens: 1.86 - BloomFilterBytes: 0 - PeakMemoryUsage: 29.45 MB (30876438) - PerHostPeakMemUsage: 493.89 MB (517881137) - RowsProduced: 749.89K (749894) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 3s831ms - TotalStorageWaitTime: 44.729ms - TotalThreadsInvoluntaryContextSwitches: 3.56K (3565) - TotalThreadsTotalWallClockTime: 12s836ms - TotalThreadsSysTime: 54.991ms - TotalThreadsUserTime: 3s253ms - TotalThreadsVoluntaryContextSwitches: 805 (805) Fragment Instance Lifecycle Timings: - ExecTime: 6s459ms - ExecTreeExecTime: 660.653ms - OpenTime: 147.168ms - ExecTreeOpenTime: 165.089us - PrepareTime: 154.518ms - ExecTreePrepareTime: 299.556us DataStreamSender (dst_id=10):(Total: 821.554ms, non-child: 821.554ms, % non-child: 100.00%) - BytesSent: 9.07 MB (9513302) - NetworkThroughput(*): 93.35 MB/sec - OverallThroughput: 11.04 MB/sec - PeakMemoryUsage: 264.94 KB (271296) - RowsReturned: 749.89K (749894) - SerializeBatchTime: 723.829ms - TransmitDataRPCTime: 97.190ms - UncompressedRowBatchSize: 26.47 MB (27750678) CodeGen:(Total: 242.930ms, non-child: 242.930ms, % non-child: 100.00%) - CodegenTime: 3.457ms - CompileTime: 11.662ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2076168) - NumFunctions: 30 (30) - NumInstructions: 476 (476) - OptimizationTime: 132.566ms - PeakMemoryUsage: 238.00 KB (243712) - PrepareTime: 97.746ms HDFS_SCAN_NODE (id=0):(Total: 659.023ms, non-child: 659.023ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:2/296.45 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 2 out of 2 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:4 BytesRead(500.000ms): 0, 7.71 MB, 7.71 MB, 7.71 MB, 16.05 MB, 16.05 MB, 16.05 MB, 16.05 MB, 16.05 MB, 16.05 MB, 16.05 MB, 16.05 MB, 16.05 MB, 16.05 MB - FooterProcessingTime: (Avg: 2.625ms ; Min: 2.286ms ; Max: 2.964ms ; Number of samples: 2) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.92 - BytesRead: 16.05 MB (16831571) - BytesReadDataNodeCache: 0 - BytesReadLocal: 16.05 MB (16831571) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 16.05 MB (16831571) - DecompressionTime: 80.161ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumRowGroups: 2 (2) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 29.09 MB (30507504) - PerReadThreadRawHdfsThroughput: 851.86 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 633.022ms - RowBatchQueuePutWaitTime: 2s544ms - RowsRead: 3.75M (3750000) - RowsReturned: 749.89K (749894) - RowsReturnedRate: 1.14 M/sec - ScanRangesComplete: 2 (2) - ScannerThreadsInvoluntaryContextSwitches: 1.57K (1566) - ScannerThreadsTotalWallClockTime: 6s229ms - MaterializeTupleTime(*): 3s392ms - ScannerThreadsSysTime: 37.994ms - ScannerThreadsUserTime: 1s776ms - ScannerThreadsVoluntaryContextSwitches: 581 (581) - TotalRawHdfsReadTime(*): 18.843ms - TotalReadThroughput: 2.29 MB/sec Instance 674b2fc81eb8bff4:b6ab0eca0000001d (host=redacted-host3:22000):(Total: 4s253ms, non-child: 1s499ms, % non-child: 35.25%) Hdfs split stats (:<# splits>/): 11:1/154.14 MB 1:1/142.35 MB MemoryUsage(500.000ms): 40.94 KB, 9.83 MB, 10.04 MB, 9.72 MB, 9.74 MB, 9.80 MB, 9.74 MB, 9.80 MB, 9.79 MB ThreadUsage(500.000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 1.89 - BloomFilterBytes: 0 - PeakMemoryUsage: 11.56 MB (12116758) - PerHostPeakMemUsage: 474.78 MB (497844916) - RowsProduced: 749.10K (749100) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 284.141ms - TotalStorageWaitTime: 26.060ms - TotalThreadsInvoluntaryContextSwitches: 3.02K (3024) - TotalThreadsTotalWallClockTime: 8s011ms - TotalThreadsSysTime: 47.992ms - TotalThreadsUserTime: 3s222ms - TotalThreadsVoluntaryContextSwitches: 1.11K (1115) Fragment Instance Lifecycle Timings: - ExecTime: 3s969ms - ExecTreeExecTime: 1s727ms - OpenTime: 104.546ms - ExecTreeOpenTime: 151.839us - PrepareTime: 178.505ms - ExecTreePrepareTime: 13.966ms DataStreamSender (dst_id=10):(Total: 785.090ms, non-child: 785.090ms, % non-child: 100.00%) - BytesSent: 9.05 MB (9494306) - NetworkThroughput(*): 92.75 MB/sec - OverallThroughput: 11.53 MB/sec - PeakMemoryUsage: 264.94 KB (271296) - RowsReturned: 749.10K (749100) - SerializeBatchTime: 686.896ms - TransmitDataRPCTime: 97.619ms - UncompressedRowBatchSize: 26.44 MB (27721292) CodeGen:(Total: 215.691ms, non-child: 215.691ms, % non-child: 100.00%) - CodegenTime: 4.232ms - CompileTime: 18.391ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2076168) - NumFunctions: 30 (30) - NumInstructions: 476 (476) - OptimizationTime: 83.298ms - PeakMemoryUsage: 238.00 KB (243712) - PrepareTime: 100.726ms HDFS_SCAN_NODE (id=0):(Total: 1s753ms, non-child: 1s753ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 11:1/154.14 MB 1:1/142.35 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 2 out of 2 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:4 BytesRead(500.000ms): 0, 7.71 MB, 7.71 MB, 7.71 MB, 7.71 MB, 16.05 MB, 16.05 MB, 16.05 MB, 16.05 MB - FooterProcessingTime: (Avg: 3.525ms ; Min: 3.003ms ; Max: 4.047ms ; Number of samples: 2) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 16.05 MB (16830300) - BytesReadDataNodeCache: 0 - BytesReadLocal: 16.05 MB (16830300) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 16.05 MB (16830300) - DecompressionTime: 111.916ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 2 (2) - NumRowGroups: 2 (2) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 11.25 MB (11798000) - PerReadThreadRawHdfsThroughput: 2.05 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 1s689ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 3.75M (3750000) - RowsReturned: 749.10K (749100) - RowsReturnedRate: 427.28 K/sec - ScanRangesComplete: 2 (2) - ScannerThreadsInvoluntaryContextSwitches: 1.79K (1788) - ScannerThreadsTotalWallClockTime: 3s936ms - MaterializeTupleTime(*): 3s419ms - ScannerThreadsSysTime: 33.994ms - ScannerThreadsUserTime: 1s791ms - ScannerThreadsVoluntaryContextSwitches: 652 (652) - TotalRawHdfsReadTime(*): 7.648ms - TotalReadThroughput: 3.57 MB/sec Instance 674b2fc81eb8bff4:b6ab0eca0000001c (host=redacted-host2:22000):(Total: 4s174ms, non-child: 2s851ms, % non-child: 68.30%) Hdfs split stats (:<# splits>/): 4:1/154.21 MB MemoryUsage(500.000ms): 48.94 KB, 10.65 MB, 11.52 MB, 9.86 MB, 11.57 MB, 5.62 MB, 5.62 MB, 5.62 MB, 978.79 KB ThreadUsage(500.000ms): 1, 2, 2, 2, 2, 1, 1, 1, 1 - AverageThreadTokens: 1.44 - BloomFilterBytes: 0 - PeakMemoryUsage: 14.66 MB (15377136) - PerHostPeakMemUsage: 458.52 MB (480798162) - RowsProduced: 390.09K (390093) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 2s157ms - TotalStorageWaitTime: 33.292ms - TotalThreadsInvoluntaryContextSwitches: 1.89K (1886) - TotalThreadsTotalWallClockTime: 6s025ms - TotalThreadsSysTime: 30.994ms - TotalThreadsUserTime: 1s714ms - TotalThreadsVoluntaryContextSwitches: 657 (657) Fragment Instance Lifecycle Timings: - ExecTime: 3s919ms - ExecTreeExecTime: 690.875ms - OpenTime: 135.798ms - ExecTreeOpenTime: 178.213us - PrepareTime: 119.719ms - ExecTreePrepareTime: 294.533us DataStreamSender (dst_id=10):(Total: 445.417ms, non-child: 445.417ms, % non-child: 100.00%) - BytesSent: 4.73 MB (4956371) - NetworkThroughput(*): 91.30 MB/sec - OverallThroughput: 10.61 MB/sec - PeakMemoryUsage: 264.94 KB (271296) - RowsReturned: 390.09K (390093) - SerializeBatchTime: 393.349ms - TransmitDataRPCTime: 51.770ms - UncompressedRowBatchSize: 13.77 MB (14435841) CodeGen:(Total: 188.009ms, non-child: 188.009ms, % non-child: 100.00%) - CodegenTime: 1.400ms - CompileTime: 21.520ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2076168) - NumFunctions: 30 (30) - NumInstructions: 476 (476) - OptimizationTime: 95.173ms - PeakMemoryUsage: 238.00 KB (243712) - PrepareTime: 69.390ms HDFS_SCAN_NODE (id=0):(Total: 690.195ms, non-child: 690.195ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:1/154.21 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:2 BytesRead(500.000ms): 0, 8.34 MB, 8.34 MB, 8.34 MB, 8.34 MB, 8.34 MB, 8.34 MB, 8.34 MB, 8.34 MB - FooterProcessingTime: (Avg: 18.152ms ; Min: 18.152ms ; Max: 18.152ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.50 - BytesRead: 8.34 MB (8743875) - BytesReadDataNodeCache: 0 - BytesReadLocal: 8.34 MB (8743875) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 8.34 MB (8743875) - DecompressionTime: 27.460ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 14.35 MB (15041994) - PerReadThreadRawHdfsThroughput: 1.85 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 660.161ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 1.95M (1950000) - RowsReturned: 390.09K (390093) - RowsReturnedRate: 565.19 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 754 (754) - ScannerThreadsTotalWallClockTime: 1s970ms - MaterializeTupleTime(*): 1s815ms - ScannerThreadsSysTime: 19.996ms - ScannerThreadsUserTime: 908.861ms - ScannerThreadsVoluntaryContextSwitches: 447 (447) - TotalRawHdfsReadTime(*): 4.410ms - TotalReadThroughput: 1.85 MB/sec Instance 674b2fc81eb8bff4:b6ab0eca0000001a (host=redacted-host1:22000):(Total: 3s927ms, non-child: 2s077ms, % non-child: 52.89%) Hdfs split stats (:<# splits>/): 2:1/142.37 MB 7:1/154.20 MB MemoryUsage(500.000ms): 286.94 KB, 9.94 MB, 12.90 MB, 26.56 MB, 20.33 MB, 11.03 MB, 9.78 MB, 9.93 MB ThreadUsage(500.000ms): 1, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 1.88 - BloomFilterBytes: 0 - PeakMemoryUsage: 26.98 MB (28287766) - PerHostPeakMemUsage: 472.35 MB (495297749) - RowsProduced: 751.13K (751129) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 900.370ms - TotalStorageWaitTime: 61.856ms - TotalThreadsInvoluntaryContextSwitches: 3.46K (3457) - TotalThreadsTotalWallClockTime: 7s340ms - TotalThreadsSysTime: 65.990ms - TotalThreadsUserTime: 3s179ms - TotalThreadsVoluntaryContextSwitches: 844 (844) Fragment Instance Lifecycle Timings: - ExecTime: 3s584ms - ExecTreeExecTime: 801.827ms - OpenTime: 186.760ms - ExecTreeOpenTime: 163.372us - PrepareTime: 156.875ms - ExecTreePrepareTime: 247.280us DataStreamSender (dst_id=10):(Total: 776.110ms, non-child: 776.110ms, % non-child: 100.00%) - BytesSent: 9.08 MB (9522759) - NetworkThroughput(*): 92.96 MB/sec - OverallThroughput: 11.70 MB/sec - PeakMemoryUsage: 264.94 KB (271296) - RowsReturned: 751.13K (751129) - SerializeBatchTime: 677.868ms - TransmitDataRPCTime: 97.696ms - UncompressedRowBatchSize: 26.51 MB (27796381) CodeGen:(Total: 274.036ms, non-child: 274.036ms, % non-child: 100.00%) - CodegenTime: 4.383ms - CompileTime: 13.869ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2076168) - NumFunctions: 30 (30) - NumInstructions: 476 (476) - OptimizationTime: 169.109ms - PeakMemoryUsage: 238.00 KB (243712) - PrepareTime: 90.296ms HDFS_SCAN_NODE (id=0):(Total: 800.047ms, non-child: 800.047ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:1/142.37 MB 7:1/154.20 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 2 out of 2 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:4 BytesRead(500.000ms): 0, 8.34 MB, 8.34 MB, 8.34 MB, 8.34 MB, 16.05 MB, 16.05 MB, 16.05 MB - FooterProcessingTime: (Avg: 17.836ms ; Min: 7.528ms ; Max: 28.145ms ; Number of samples: 2) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 16.05 MB (16831789) - BytesReadDataNodeCache: 0 - BytesReadLocal: 16.05 MB (16831789) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 16.05 MB (16831789) - DecompressionTime: 95.669ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 2 (2) - NumRowGroups: 2 (2) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 26.66 MB (27953648) - PerReadThreadRawHdfsThroughput: 943.58 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 783.746ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 3.75M (3750000) - RowsReturned: 751.13K (751129) - RowsReturnedRate: 938.86 K/sec - ScanRangesComplete: 2 (2) - ScannerThreadsInvoluntaryContextSwitches: 1.32K (1323) - ScannerThreadsTotalWallClockTime: 3s569ms - MaterializeTupleTime(*): 3s198ms - ScannerThreadsSysTime: 44.993ms - ScannerThreadsUserTime: 1s746ms - ScannerThreadsVoluntaryContextSwitches: 564 (564) - TotalRawHdfsReadTime(*): 17.011ms - TotalReadThroughput: 4.01 MB/sec Instance 674b2fc81eb8bff4:b6ab0eca00000019 (host=redacted-host6:22000):(Total: 2s175ms, non-child: 823.151ms, % non-child: 37.83%) Hdfs split stats (:<# splits>/): 5:1/142.33 MB MemoryUsage(500.000ms): 40.94 KB, 9.71 MB, 13.08 MB, 9.73 MB, 879.79 KB ThreadUsage(500.000ms): 1, 2, 2, 2, 1 - AverageThreadTokens: 1.60 - BloomFilterBytes: 0 - PeakMemoryUsage: 13.66 MB (14320406) - PerHostPeakMemUsage: 182.94 MB (191824606) - RowsProduced: 359.97K (359972) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 333.055ms - TotalStorageWaitTime: 106.392ms - TotalThreadsInvoluntaryContextSwitches: 1.17K (1169) - TotalThreadsTotalWallClockTime: 3s891ms - TotalThreadsSysTime: 27.995ms - TotalThreadsUserTime: 1s529ms - TotalThreadsVoluntaryContextSwitches: 520 (520) Fragment Instance Lifecycle Timings: - ExecTime: 1s925ms - ExecTreeExecTime: 784.166ms - OpenTime: 94.884ms - ExecTreeOpenTime: 159.180us - PrepareTime: 155.395ms - ExecTreePrepareTime: 700.910us DataStreamSender (dst_id=10):(Total: 358.913ms, non-child: 358.913ms, % non-child: 100.00%) - BytesSent: 4.35 MB (4559772) - NetworkThroughput(*): 89.30 MB/sec - OverallThroughput: 12.12 MB/sec - PeakMemoryUsage: 264.94 KB (271296) - RowsReturned: 359.97K (359972) - SerializeBatchTime: 309.915ms - TransmitDataRPCTime: 48.698ms - UncompressedRowBatchSize: 12.70 MB (13321176) CodeGen:(Total: 208.898ms, non-child: 208.898ms, % non-child: 100.00%) - CodegenTime: 1.452ms - CompileTime: 18.270ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2076168) - NumFunctions: 30 (30) - NumInstructions: 476 (476) - OptimizationTime: 73.780ms - PeakMemoryUsage: 238.00 KB (243712) - PrepareTime: 116.067ms HDFS_SCAN_NODE (id=0):(Total: 784.827ms, non-child: 784.827ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:1/142.33 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:2 BytesRead(500.000ms): 0, 7.71 MB, 7.71 MB, 7.71 MB, 7.71 MB - FooterProcessingTime: (Avg: 45.106ms ; Min: 45.106ms ; Max: 45.106ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.75 - BytesRead: 7.71 MB (8085910) - BytesReadDataNodeCache: 0 - BytesReadLocal: 7.71 MB (8085910) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 7.71 MB (8085910) - DecompressionTime: 33.536ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 13.33 MB (13977072) - PerReadThreadRawHdfsThroughput: 211.71 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 767.028ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 1.80M (1800000) - RowsReturned: 359.97K (359972) - RowsReturnedRate: 458.66 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 579 (579) - ScannerThreadsTotalWallClockTime: 1s870ms - MaterializeTupleTime(*): 1s661ms - ScannerThreadsSysTime: 19.996ms - ScannerThreadsUserTime: 826.874ms - ScannerThreadsVoluntaryContextSwitches: 312 (312) - TotalRawHdfsReadTime(*): 36.424ms - TotalReadThroughput: 3.08 MB/sec