================================================================================ SUMMARY: +---------------------+--------+----------+---------+----------+-------+-----------+ | Operator | #Hosts | Avg Time | Std Dev | Max Time | #Rows | Est #Rows | +---------------------+--------+----------+---------+----------+-------+-----------+ | 05:MERGING-EXCHANGE | 1 | 90.18us | 0ns | 90.18us | 4 | 6 | | 02:SORT | 14 | 576.98us | 0ns | 1.79ms | 4 | 6 | | 04:AGGREGATE | 14 | 2.78ms | 0ns | 3.09ms | 4 | 6 | | 03:EXCHANGE | 14 | 55.75us | 0ns | 207.66us | 56 | 6 | | 01:AGGREGATE | 14 | 19.43s | 0ns | 20.31s | 56 | 6 | | 00:SCAN HDFS | 14 | 818.09ms | 0ns | 861.42ms | 1.77B | 180.00M | +---------------------+--------+----------+---------+----------+-------+-----------+ PROFILE: Query (id=6746754113c855a3:d4ee941f00000000): Summary: Session ID: d1497594880f28d2:126331a94d1fe589 Session Type: BEESWAX Start Time: 2017-06-18 23:30:18.108621000 End Time: Query Type: QUERY Query State: FINISHED Query Status: OK Impala Version: impalad version 2.9.0-SNAPSHOT RELEASE (build 659a7c7beb75d45bcd92af1d6a5c0e58cace65b5) User: jenkins Connected User: jenkins Delegated User: Network Address: 10.17.193.6:50880 Default Db: tpch_300_parquet Sql Statement: select l_returnflag, l_linestatus, sum(l_quantity) as sum_qty, sum(l_extendedprice) as sum_base_price, sum(l_extendedprice * (1 - l_discount)) as sum_disc_price, sum(l_extendedprice * (1 - l_discount) * (1 + l_tax)) as sum_charge, avg(l_quantity) as avg_qty, avg(l_extendedprice) as avg_price, avg(l_discount) as avg_disc, count(*) as count_order from lineitem where l_shipdate <= '1998-09-02' group by l_returnflag, l_linestatus order by l_returnflag, l_linestatus Coordinator: vb0204.halxg.cloudera.com:22000 Query Options (non default): NUM_SCANNER_THREADS=12,SYNC_DDL=1,MAX_NUM_RUNTIME_FILTERS=50 Plan: ---------------- Per-Host Resource Reservation: Memory=320.00MB Per-Host Resource Estimates: Memory=636.00MB F02:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1 PLAN-ROOT SINK | mem-estimate=0B mem-reservation=0B | 05:MERGING-EXCHANGE [UNPARTITIONED] | order by: l_returnflag ASC, l_linestatus ASC | mem-estimate=0B mem-reservation=0B | tuple-ids=3 row-size=130B cardinality=6 | F01:PLAN FRAGMENT [HASH(l_returnflag,l_linestatus)] hosts=14 instances=14 02:SORT | order by: l_returnflag ASC, l_linestatus ASC | mem-estimate=16.00MB mem-reservation=48.00MB | tuple-ids=3 row-size=130B cardinality=6 | 04:AGGREGATE [FINALIZE] | output: sum:merge(l_quantity), sum:merge(l_extendedprice), sum:merge(l_extendedprice * (1 - l_discount)), sum:merge(l_extendedprice * (1 - l_discount) * (1 + l_tax)), avg:merge(l_quantity), avg:merge(l_extendedprice), avg:merge(l_discount), count:merge(*) | group by: l_returnflag, l_linestatus | mem-estimate=10.00MB mem-reservation=272.00MB | tuple-ids=2 row-size=130B cardinality=6 | 03:EXCHANGE [HASH(l_returnflag,l_linestatus)] | mem-estimate=0B mem-reservation=0B | tuple-ids=1 row-size=130B cardinality=6 | F00:PLAN FRAGMENT [RANDOM] hosts=14 instances=14 01:AGGREGATE [STREAMING] | output: sum(l_quantity), sum(l_extendedprice), sum(l_extendedprice * (1 - l_discount)), sum(l_extendedprice * (1 - l_discount) * (1 + l_tax)), avg(l_quantity), avg(l_extendedprice), avg(l_discount), count(*) | group by: l_returnflag, l_linestatus | mem-estimate=10.00MB mem-reservation=0B | tuple-ids=1 row-size=130B cardinality=6 | 00:SCAN HDFS [tpch_300_parquet.lineitem, RANDOM] partitions=1/1 files=264 size=64.36GB predicates: l_shipdate <= '1998-09-02' stats-rows=1799989091 extrapolated-rows=disabled table stats: rows=1799989091 size=unavailable column stats: all parquet statistics predicates: l_shipdate <= '1998-09-02' parquet dictionary predicates: l_shipdate <= '1998-09-02' mem-estimate=616.00MB mem-reservation=0B tuple-ids=0 row-size=92B cardinality=179998909 ---------------- Estimated Per-Host Mem: 666894336 Per-Host Memory Reservation: 335544320 Request Pool: root.jenkins Admission result: Admitted immediately Planner Timeline: 4s983ms - Metadata load started: 7.991ms (7.991ms) - Metadata load finished: 4s803ms (4s795ms) - Analysis finished: 4s829ms (25.789ms) - Equivalence classes computed: 4s835ms (6.076ms) - Single node plan created: 4s927ms (91.752ms) - Runtime filters computed: 4s930ms (3.386ms) - Distributed plan created: 4s934ms (3.600ms) - Lineage info computed: 4s935ms (1.001ms) - Planning finished: 4s983ms (48.654ms) Query Timeline: 26s485ms - Query submitted: 35.339us (35.339us) - Planning finished: 5s003ms (5s003ms) - Submit for admission: 5s005ms (1.693ms) - Completed admission: 5s005ms (127.727us) - Ready to start on 14 backends: 5s005ms (394.306us) - All 14 execution backends (29 fragment instances) started: 5s012ms (7.013ms) - Rows available: 26s444ms (21s431ms) - First row fetched: 26s475ms (31.809ms) - ComputeScanRangeAssignmentTimer: 774.036us ImpalaServer: - ClientFetchWaitTimer: 31.824ms - RowMaterializationTimer: 5.296ms Execution Profile 6746754113c855a3:d4ee941f00000000:(Total: 21s443ms, non-child: 0.000ns, % non-child: 0.00%) Number of filters: 0 Filter routing table: ID Src. Node Tgt. Node(s) Target type Partition filter Pending (Expected) First arrived Completed Enabled ------------------------------------------------------------------------------------------------------------------- Backend startup latencies: Count: 14, min / max: 2ms / 3ms, 25th %-ile: 2ms, 50th %-ile: 3ms, 75th %-ile: 3ms, 90th %-ile: 3ms, 95th %-ile: 3ms, 99.9th %-ile: 3ms Per Node Peak Memory Usage: 10.17.193.10:22000(786.79 MB) 10.17.193.11:22000(822.59 MB) 10.17.193.12:22000(817.67 MB) 10.17.193.14:22000(806.54 MB) 10.17.193.15:22000(792.64 MB) 10.17.193.16:22000(774.84 MB) 10.17.193.17:22000(790.89 MB) 10.17.193.18:22000(822.75 MB) 10.17.193.19:22000(808.67 MB) 10.17.193.20:22000(817.59 MB) 10.17.193.22:22000(822.59 MB) 10.17.193.23:22000(822.67 MB) 10.17.193.24:22000(794.75 MB) 10.17.193.25:22000(822.67 MB) - FiltersReceived: 0 (0) - FinalizationTimer: 0.000ns Averaged Fragment F02:(Total: 21s467ms, non-child: 33.206ms, % non-child: 0.15%) split sizes: min: 0, max: 0, avg: 0, stddev: 0 completion times: min:21s468ms max:21s468ms mean: 21s468ms stddev:0.000ns execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec num instances: 1 - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 296.50 KB (303616) - PerHostPeakMemUsage: 786.79 MB (825011284) - RowsProduced: 4 (4) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 4 (4) - TotalThreadsTotalWallClockTime: 21s435ms - TotalThreadsSysTime: 3.000ms - TotalThreadsUserTime: 38.994ms - TotalThreadsVoluntaryContextSwitches: 16 (16) Fragment Instance Lifecycle Timings: - ExecTime: 31.987ms - ExecTreeExecTime: 97.643us - OpenTime: 21s403ms - ExecTreeOpenTime: 21s361ms - PrepareTime: 31.532ms - ExecTreePrepareTime: 60.671us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 49 (49) - BlocksRecycled: 3 (3) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 32.02 MB (33570816) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns PLAN_ROOT_SINK: - PeakMemoryUsage: 0 CodeGen:(Total: 72.574ms, non-child: 72.574ms, % non-child: 100.00%) - CodegenTime: 1.199ms - CompileTime: 6.290ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2068576) - NumFunctions: 28 (28) - NumInstructions: 577 (577) - OptimizationTime: 35.423ms - PeakMemoryUsage: 288.50 KB (295424) - PrepareTime: 30.253ms EXCHANGE_NODE (id=5):(Total: 21s361ms, non-child: 21s361ms, % non-child: 100.00%) - ConvertRowBatchTime: 0.000ns - MergeGetNext: 91.157us - MergeGetNextBatch: 81.367us - PeakMemoryUsage: 0 - RowsReturned: 4 (4) - RowsReturnedRate: 0 RecvrSide: - FirstBatchArrivalWaitTime: 21s361ms - TotalBytesReceived: 417.00 B (417) - TotalGetBatchTime: 21s361ms - DataArrivalTimer: 21s361ms SenderSide: - DeserializeRowBatchTimer: 26.624us - NumBatchesAccepted: 4 (4) - NumBatchesRejected: 0 (0) Coordinator Fragment F02: Instance 6746754113c855a3:d4ee941f00000000 (host=10.17.193.10:22000):(Total: 21s467ms, non-child: 33.206ms, % non-child: 0.15%) MemoryUsage(500.000ms): 0, 8.29 KB, 8.29 KB, 8.29 KB, 8.29 KB, 8.29 KB, 8.29 KB, 8.29 KB, 8.29 KB, 8.29 KB, 8.29 KB, 8.29 KB, 8.29 KB, 8.29 KB, 8.29 KB, 8.29 KB, 8.29 KB, 8.29 KB, 8.29 KB, 8.29 KB, 8.29 KB, 8.29 KB, 8.29 KB, 8.29 KB, 8.29 KB, 8.29 KB, 8.29 KB, 8.29 KB, 8.29 KB, 8.29 KB, 8.29 KB, 8.29 KB, 8.29 KB, 8.29 KB, 8.29 KB, 8.29 KB, 8.29 KB, 8.29 KB, 8.29 KB, 8.29 KB, 8.29 KB, 8.29 KB, 8.29 KB - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 296.50 KB (303616) - PerHostPeakMemUsage: 786.79 MB (825011284) - RowsProduced: 4 (4) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 4 (4) - TotalThreadsTotalWallClockTime: 21s435ms - TotalThreadsSysTime: 3.000ms - TotalThreadsUserTime: 38.994ms - TotalThreadsVoluntaryContextSwitches: 16 (16) Fragment Instance Lifecycle Timings: - ExecTime: 31.987ms - ExecTreeExecTime: 97.643us - OpenTime: 21s403ms - ExecTreeOpenTime: 21s361ms - PrepareTime: 31.532ms - ExecTreePrepareTime: 60.671us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 49 (49) - BlocksRecycled: 3 (3) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 32.02 MB (33570816) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns PLAN_ROOT_SINK: - PeakMemoryUsage: 0 CodeGen:(Total: 72.574ms, non-child: 72.574ms, % non-child: 100.00%) - CodegenTime: 1.199ms - CompileTime: 6.290ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2068576) - NumFunctions: 28 (28) - NumInstructions: 577 (577) - OptimizationTime: 35.423ms - PeakMemoryUsage: 288.50 KB (295424) - PrepareTime: 30.253ms EXCHANGE_NODE (id=5):(Total: 21s361ms, non-child: 90.179us, % non-child: 0.00%) ExecOption: Codegen Enabled - ConvertRowBatchTime: 0.000ns - MergeGetNext: 91.157us - MergeGetNextBatch: 81.367us - PeakMemoryUsage: 0 - RowsReturned: 4 (4) - RowsReturnedRate: 0 RecvrSide: BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - FirstBatchArrivalWaitTime: 21s361ms - TotalBytesReceived: 417.00 B (417) - TotalGetBatchTime: 21s361ms - DataArrivalTimer: 21s361ms SenderSide: - DeserializeRowBatchTimer: 26.624us - NumBatchesAccepted: 4 (4) - NumBatchesRejected: 0 (0) Averaged Fragment F01:(Total: 21s425ms, non-child: 4.515ms, % non-child: 0.02%) split sizes: min: 0, max: 0, avg: 0, stddev: 0 completion times: min:21s419ms max:21s435ms mean: 21s427ms stddev:5.312ms execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec num instances: 14 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 32.10 MB (33662895) - PerHostPeakMemUsage: 807.40 MB (846624050) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 21s217ms - TotalNetworkSendTime: 114.684us - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 17 (17) - TotalThreadsTotalWallClockTime: 21s392ms - TotalThreadsSysTime: 4.142ms - TotalThreadsUserTime: 170.402ms - TotalThreadsVoluntaryContextSwitches: 8 (8) Fragment Instance Lifecycle Timings: - ExecTime: 605.152us - ExecTreeExecTime: 6.653us - OpenTime: 21s391ms - ExecTreeOpenTime: 21s219ms - PrepareTime: 33.342ms - ExecTreePrepareTime: 1.701ms DataStreamSender (dst_id=5):(Total: 25.801us, non-child: 25.801us, % non-child: 100.00%) - BytesSent: 29.00 B (29) - OverallThroughput: 645.89 KB/sec - PeakMemoryUsage: 1008.00 B (1008) - RowsReturned: 0 (0) - SerializeBatchTime: 8.208us - UncompressedRowBatchSize: 29.00 B (29) CodeGen:(Total: 200.404ms, non-child: 200.404ms, % non-child: 100.00%) - CodegenTime: 7.136ms - CompileTime: 43.806ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2068576) - NumFunctions: 89 (89) - NumInstructions: 1.98K (1981) - OptimizationTime: 128.176ms - PeakMemoryUsage: 990.50 KB (1014272) - PrepareTime: 27.766ms SORT_NODE (id=2):(Total: 21s220ms, non-child: 576.985us, % non-child: 0.00%) - InMemorySortTime: 1.338us - InitialRunsCreated: 1 (1) - PeakMemoryUsage: 24.01 MB (25176356) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SortDataSize: 37.00 B (37) - SpilledRuns: 0 (0) - TotalMergesPerformed: 0 (0) AGGREGATION_NODE (id=4):(Total: 21s220ms, non-child: 2.781ms, % non-child: 0.01%) - BuildTime: 28.713us - GetNewBlockTime: 526.227us - GetResultsTime: 14.464us - HTResizeTime: 3.163us - HashBuckets: 292 (292) - LargestPartitionPercent: 2 (2) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 10.32 MB (10816786) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 2.080us EXCHANGE_NODE (id=3):(Total: 21s217ms, non-child: 21s217ms, % non-child: 100.00%) - ConvertRowBatchTime: 8.455us - PeakMemoryUsage: 0 - RowsReturned: 4 (4) - RowsReturnedRate: 0 RecvrSide: - FirstBatchArrivalWaitTime: 20s521ms - TotalBytesReceived: 595.00 B (595) - TotalGetBatchTime: 21s217ms - DataArrivalTimer: 21s217ms SenderSide: - DeserializeRowBatchTimer: 37.423us - NumBatchesAccepted: 4 (4) - NumBatchesRejected: 0 (0) BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 49 (49) - BlocksRecycled: 3 (3) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 32.00 MB (33557162) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns Fragment F01: Instance 6746754113c855a3:d4ee941f0000001b (host=10.17.193.17:22000):(Total: 21s434ms, non-child: 6.072ms, % non-child: 0.03%) MemoryUsage(500.000ms): 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.32 MB, 10.32 MB, 10.33 MB, 10.35 MB, 10.36 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 32.21 MB (33774073) - PerHostPeakMemUsage: 790.89 MB (829304513) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 21s216ms - TotalNetworkSendTime: 447.725us - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 17 (17) - TotalThreadsTotalWallClockTime: 21s392ms - TotalThreadsSysTime: 4.999ms - TotalThreadsUserTime: 170.974ms - TotalThreadsVoluntaryContextSwitches: 18 (18) Fragment Instance Lifecycle Timings: - ExecTime: 800.034us - ExecTreeExecTime: 8.150us - OpenTime: 21s391ms - ExecTreeOpenTime: 21s218ms - PrepareTime: 41.386ms - ExecTreePrepareTime: 1.863ms DataStreamSender (dst_id=5):(Total: 44.722us, non-child: 44.722us, % non-child: 100.00%) - BytesSent: 107.00 B (107) - OverallThroughput: 2.28 MB/sec - PeakMemoryUsage: 1008.00 B (1008) - RowsReturned: 1 (1) - SerializeBatchTime: 27.754us - UncompressedRowBatchSize: 107.00 B (107) CodeGen:(Total: 207.253ms, non-child: 207.253ms, % non-child: 100.00%) - CodegenTime: 10.432ms - CompileTime: 43.595ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2068576) - NumFunctions: 89 (89) - NumInstructions: 1.98K (1981) - OptimizationTime: 128.466ms - PeakMemoryUsage: 990.50 KB (1014272) - PrepareTime: 34.429ms SORT_NODE (id=2):(Total: 21s220ms, non-child: 1.075ms, % non-child: 0.01%) ExecOption: Codegen Enabled - InMemorySortTime: 1.601us - InitialRunsCreated: 1 (1) - PeakMemoryUsage: 24.02 MB (25182208) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SortDataSize: 132.00 B (132) - SpilledRuns: 0 (0) - TotalMergesPerformed: 0 (0) AGGREGATION_NODE (id=4):(Total: 21s219ms, non-child: 3.092ms, % non-child: 0.01%) ExecOption: Codegen Enabled - BuildTime: 142.378us - GetNewBlockTime: 719.941us - GetResultsTime: 50.857us - HTResizeTime: 2.844us - HashBuckets: 1.02K (1024) - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 10.36 MB (10860672) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 2.495us EXCHANGE_NODE (id=3):(Total: 21s216ms, non-child: 207.659us, % non-child: 0.00%) - ConvertRowBatchTime: 34.434us - PeakMemoryUsage: 0 - RowsReturned: 14 (14) - RowsReturnedRate: 0 RecvrSide: BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 298.00 B, 447.00 B, 596.00 B, 1.31 KB, 1.89 KB - FirstBatchArrivalWaitTime: 18s782ms - TotalBytesReceived: 2.04 KB (2086) - TotalGetBatchTime: 21s216ms - DataArrivalTimer: 21s216ms SenderSide: - DeserializeRowBatchTimer: 115.773us - NumBatchesAccepted: 14 (14) - NumBatchesRejected: 0 (0) Instance 6746754113c855a3:d4ee941f0000001c (host=10.17.193.18:22000):(Total: 21s433ms, non-child: 4.540ms, % non-child: 0.02%) MemoryUsage(500.000ms): 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 32.06 MB (33618425) - PerHostPeakMemUsage: 822.75 MB (862714127) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 21s226ms - TotalNetworkSendTime: 936.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 18 (18) - TotalThreadsTotalWallClockTime: 21s400ms - TotalThreadsSysTime: 5.000ms - TotalThreadsUserTime: 169.974ms - TotalThreadsVoluntaryContextSwitches: 3 (3) Fragment Instance Lifecycle Timings: - ExecTime: 592.387us - ExecTreeExecTime: 5.664us - OpenTime: 21s400ms - ExecTreeOpenTime: 21s227ms - PrepareTime: 33.045ms - ExecTreePrepareTime: 1.804ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 49 (49) - BlocksRecycled: 3 (3) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 32.00 MB (33554432) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=5):(Total: 19.502us, non-child: 19.502us, % non-child: 100.00%) - BytesSent: 0 - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1008.00 B (1008) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 200.177ms, non-child: 200.177ms, % non-child: 100.00%) - CodegenTime: 7.050ms - CompileTime: 44.259ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2068576) - NumFunctions: 89 (89) - NumInstructions: 1.98K (1981) - OptimizationTime: 128.000ms - PeakMemoryUsage: 990.50 KB (1014272) - PrepareTime: 27.313ms SORT_NODE (id=2):(Total: 21s229ms, non-child: 335.798us, % non-child: 0.00%) ExecOption: Codegen Enabled - InMemorySortTime: 1.209us - InitialRunsCreated: 1 (1) - PeakMemoryUsage: 24.01 MB (25174016) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SortDataSize: 0 - SpilledRuns: 0 (0) - TotalMergesPerformed: 0 (0) AGGREGATION_NODE (id=4):(Total: 21s228ms, non-child: 2.875ms, % non-child: 0.01%) ExecOption: Codegen Enabled - BuildTime: 7.719us - GetNewBlockTime: 653.488us - GetResultsTime: 0.000ns - HTResizeTime: 3.122us - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 10.30 MB (10799232) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.879us EXCHANGE_NODE (id=3):(Total: 21s226ms, non-child: 14.995us, % non-child: 0.00%) - ConvertRowBatchTime: 745.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 RecvrSide: BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - FirstBatchArrivalWaitTime: 21s225ms - TotalBytesReceived: 0 - TotalGetBatchTime: 21s226ms - DataArrivalTimer: 21s225ms SenderSide: - DeserializeRowBatchTimer: 0.000ns - NumBatchesAccepted: 0 (0) - NumBatchesRejected: 0 (0) Instance 6746754113c855a3:d4ee941f00000019 (host=10.17.193.12:22000):(Total: 21s430ms, non-child: 4.399ms, % non-child: 0.02%) MemoryUsage(500.000ms): 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 32.06 MB (33618425) - PerHostPeakMemUsage: 817.67 MB (857388272) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 21s221ms - TotalNetworkSendTime: 1.022us - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 17 (17) - TotalThreadsTotalWallClockTime: 21s396ms - TotalThreadsSysTime: 5.999ms - TotalThreadsUserTime: 169.974ms - TotalThreadsVoluntaryContextSwitches: 3 (3) Fragment Instance Lifecycle Timings: - ExecTime: 502.753us - ExecTreeExecTime: 5.751us - OpenTime: 21s396ms - ExecTreeOpenTime: 21s222ms - PrepareTime: 33.137ms - ExecTreePrepareTime: 1.517ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 49 (49) - BlocksRecycled: 3 (3) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 32.00 MB (33554432) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=5):(Total: 18.413us, non-child: 18.413us, % non-child: 100.00%) - BytesSent: 0 - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1008.00 B (1008) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 201.466ms, non-child: 201.466ms, % non-child: 100.00%) - CodegenTime: 6.734ms - CompileTime: 44.374ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2068576) - NumFunctions: 89 (89) - NumInstructions: 1.98K (1981) - OptimizationTime: 128.692ms - PeakMemoryUsage: 990.50 KB (1014272) - PrepareTime: 27.594ms SORT_NODE (id=2):(Total: 21s224ms, non-child: 315.628us, % non-child: 0.00%) ExecOption: Codegen Enabled - InMemorySortTime: 1.551us - InitialRunsCreated: 1 (1) - PeakMemoryUsage: 24.01 MB (25174016) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SortDataSize: 0 - SpilledRuns: 0 (0) - TotalMergesPerformed: 0 (0) AGGREGATION_NODE (id=4):(Total: 21s223ms, non-child: 2.572ms, % non-child: 0.01%) ExecOption: Codegen Enabled - BuildTime: 8.408us - GetNewBlockTime: 242.442us - GetResultsTime: 0.000ns - HTResizeTime: 3.936us - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 10.30 MB (10799232) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 2.366us EXCHANGE_NODE (id=3):(Total: 21s221ms, non-child: 17.136us, % non-child: 0.00%) - ConvertRowBatchTime: 1.106us - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 RecvrSide: BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - FirstBatchArrivalWaitTime: 21s221ms - TotalBytesReceived: 0 - TotalGetBatchTime: 21s221ms - DataArrivalTimer: 21s221ms SenderSide: - DeserializeRowBatchTimer: 0.000ns - NumBatchesAccepted: 0 (0) - NumBatchesRejected: 0 (0) Instance 6746754113c855a3:d4ee941f00000016 (host=10.17.193.10:22000):(Total: 21s429ms, non-child: 4.004ms, % non-child: 0.02%) MemoryUsage(500.000ms): 10.29 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.31 MB, 10.32 MB, 10.32 MB, 10.33 MB, 10.35 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 32.21 MB (33774073) - PerHostPeakMemUsage: 786.79 MB (825011284) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 21s222ms - TotalNetworkSendTime: 358.625us - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 17 (17) - TotalThreadsTotalWallClockTime: 21s395ms - TotalThreadsSysTime: 2.999ms - TotalThreadsUserTime: 168.974ms - TotalThreadsVoluntaryContextSwitches: 36 (36) Fragment Instance Lifecycle Timings: - ExecTime: 700.304us - ExecTreeExecTime: 8.042us - OpenTime: 21s394ms - ExecTreeOpenTime: 21s225ms - PrepareTime: 34.469ms - ExecTreePrepareTime: 1.271ms DataStreamSender (dst_id=5):(Total: 47.026us, non-child: 47.026us, % non-child: 100.00%) - BytesSent: 103.00 B (103) - OverallThroughput: 2.09 MB/sec - PeakMemoryUsage: 1008.00 B (1008) - RowsReturned: 1 (1) - SerializeBatchTime: 35.399us - UncompressedRowBatchSize: 103.00 B (103) CodeGen:(Total: 199.014ms, non-child: 199.014ms, % non-child: 100.00%) - CodegenTime: 6.828ms - CompileTime: 42.215ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2068576) - NumFunctions: 89 (89) - NumInstructions: 1.98K (1981) - OptimizationTime: 126.298ms - PeakMemoryUsage: 990.50 KB (1014272) - PrepareTime: 29.861ms SORT_NODE (id=2):(Total: 21s226ms, non-child: 1.785ms, % non-child: 0.01%) ExecOption: Codegen Enabled - InMemorySortTime: 1.788us - InitialRunsCreated: 1 (1) - PeakMemoryUsage: 24.02 MB (25182208) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SortDataSize: 132.00 B (132) - SpilledRuns: 0 (0) - TotalMergesPerformed: 0 (0) AGGREGATION_NODE (id=4):(Total: 21s225ms, non-child: 2.405ms, % non-child: 0.01%) ExecOption: Codegen Enabled - BuildTime: 117.287us - GetNewBlockTime: 282.998us - GetResultsTime: 50.506us - HTResizeTime: 2.459us - HashBuckets: 1.02K (1024) - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 10.36 MB (10860672) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.587us EXCHANGE_NODE (id=3):(Total: 21s222ms, non-child: 146.235us, % non-child: 0.00%) - ConvertRowBatchTime: 24.898us - PeakMemoryUsage: 0 - RowsReturned: 14 (14) - RowsReturnedRate: 0 RecvrSide: BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 151.00 B, 302.00 B, 453.00 B, 906.00 B, 1.47 KB - FirstBatchArrivalWaitTime: 18s786ms - TotalBytesReceived: 2.06 KB (2114) - TotalGetBatchTime: 21s222ms - DataArrivalTimer: 21s222ms SenderSide: - DeserializeRowBatchTimer: 108.544us - NumBatchesAccepted: 14 (14) - NumBatchesRejected: 0 (0) Instance 6746754113c855a3:d4ee941f0000001a (host=10.17.193.24:22000):(Total: 21s429ms, non-child: 4.269ms, % non-child: 0.02%) MemoryUsage(500.000ms): 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 32.06 MB (33618425) - PerHostPeakMemUsage: 794.75 MB (833359080) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 21s224ms - TotalNetworkSendTime: 1.089us - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 18 (18) - TotalThreadsTotalWallClockTime: 21s397ms - TotalThreadsSysTime: 5.000ms - TotalThreadsUserTime: 167.974ms - TotalThreadsVoluntaryContextSwitches: 2 (2) Fragment Instance Lifecycle Timings: - ExecTime: 534.210us - ExecTreeExecTime: 4.511us - OpenTime: 21s397ms - ExecTreeOpenTime: 21s225ms - PrepareTime: 31.740ms - ExecTreePrepareTime: 1.553ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 49 (49) - BlocksRecycled: 3 (3) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 32.00 MB (33554432) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=5):(Total: 16.958us, non-child: 16.958us, % non-child: 100.00%) - BytesSent: 0 - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1008.00 B (1008) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 197.926ms, non-child: 197.926ms, % non-child: 100.00%) - CodegenTime: 6.611ms - CompileTime: 43.369ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2068576) - NumFunctions: 89 (89) - NumInstructions: 1.98K (1981) - OptimizationTime: 127.521ms - PeakMemoryUsage: 990.50 KB (1014272) - PrepareTime: 26.476ms SORT_NODE (id=2):(Total: 21s227ms, non-child: 325.167us, % non-child: 0.00%) ExecOption: Codegen Enabled - InMemorySortTime: 865.000ns - InitialRunsCreated: 1 (1) - PeakMemoryUsage: 24.01 MB (25174016) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SortDataSize: 0 - SpilledRuns: 0 (0) - TotalMergesPerformed: 0 (0) AGGREGATION_NODE (id=4):(Total: 21s227ms, non-child: 2.582ms, % non-child: 0.01%) ExecOption: Codegen Enabled - BuildTime: 7.956us - GetNewBlockTime: 383.273us - GetResultsTime: 0.000ns - HTResizeTime: 3.161us - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 10.30 MB (10799232) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 2.016us EXCHANGE_NODE (id=3):(Total: 21s224ms, non-child: 13.877us, % non-child: 0.00%) - ConvertRowBatchTime: 942.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 RecvrSide: BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - FirstBatchArrivalWaitTime: 21s224ms - TotalBytesReceived: 0 - TotalGetBatchTime: 21s224ms - DataArrivalTimer: 21s224ms SenderSide: - DeserializeRowBatchTimer: 0.000ns - NumBatchesAccepted: 0 (0) - NumBatchesRejected: 0 (0) Instance 6746754113c855a3:d4ee941f00000017 (host=10.17.193.14:22000):(Total: 21s428ms, non-child: 5.147ms, % non-child: 0.02%) MemoryUsage(500.000ms): 11.27 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.31 MB, 10.32 MB, 10.32 MB, 10.33 MB, 10.35 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 32.21 MB (33774073) - PerHostPeakMemUsage: 806.54 MB (845719692) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 21s222ms - TotalNetworkSendTime: 380.305us - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 17 (17) - TotalThreadsTotalWallClockTime: 21s398ms - TotalThreadsSysTime: 3.000ms - TotalThreadsUserTime: 172.974ms - TotalThreadsVoluntaryContextSwitches: 17 (17) Fragment Instance Lifecycle Timings: - ExecTime: 744.145us - ExecTreeExecTime: 7.185us - OpenTime: 21s397ms - ExecTreeOpenTime: 21s225ms - PrepareTime: 30.183ms - ExecTreePrepareTime: 1.882ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 49 (49) - BlocksRecycled: 3 (3) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 32.02 MB (33570816) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=5):(Total: 42.169us, non-child: 42.169us, % non-child: 100.00%) - BytesSent: 107.00 B (107) - OverallThroughput: 2.42 MB/sec - PeakMemoryUsage: 1008.00 B (1008) - RowsReturned: 1 (1) - SerializeBatchTime: 25.100us - UncompressedRowBatchSize: 107.00 B (107) CodeGen:(Total: 196.685ms, non-child: 196.685ms, % non-child: 100.00%) - CodegenTime: 8.224ms - CompileTime: 43.596ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2068576) - NumFunctions: 89 (89) - NumInstructions: 1.98K (1981) - OptimizationTime: 128.649ms - PeakMemoryUsage: 990.50 KB (1014272) - PrepareTime: 23.712ms SORT_NODE (id=2):(Total: 21s227ms, non-child: 1.063ms, % non-child: 0.01%) ExecOption: Codegen Enabled - InMemorySortTime: 1.724us - InitialRunsCreated: 1 (1) - PeakMemoryUsage: 24.02 MB (25182208) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SortDataSize: 132.00 B (132) - SpilledRuns: 0 (0) - TotalMergesPerformed: 0 (0) AGGREGATION_NODE (id=4):(Total: 21s226ms, non-child: 3.012ms, % non-child: 0.01%) ExecOption: Codegen Enabled - BuildTime: 24.846us - GetNewBlockTime: 722.030us - GetResultsTime: 48.187us - HTResizeTime: 2.620us - HashBuckets: 1.02K (1024) - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 10.36 MB (10860672) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 2.344us EXCHANGE_NODE (id=3):(Total: 21s223ms, non-child: 155.913us, % non-child: 0.00%) - ConvertRowBatchTime: 26.795us - PeakMemoryUsage: 0 - RowsReturned: 14 (14) - RowsReturnedRate: 0 RecvrSide: BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 149.00 B, 298.00 B, 447.00 B, 894.00 B, 1.46 KB - FirstBatchArrivalWaitTime: 18s786ms - TotalBytesReceived: 2.04 KB (2086) - TotalGetBatchTime: 21s222ms - DataArrivalTimer: 21s222ms SenderSide: - DeserializeRowBatchTimer: 121.525us - NumBatchesAccepted: 14 (14) - NumBatchesRejected: 0 (0) Instance 6746754113c855a3:d4ee941f00000018 (host=10.17.193.22:22000):(Total: 21s427ms, non-child: 4.090ms, % non-child: 0.02%) MemoryUsage(500.000ms): 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 32.06 MB (33618425) - PerHostPeakMemUsage: 822.59 MB (862548675) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 21s223ms - TotalNetworkSendTime: 610.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 18 (18) - TotalThreadsTotalWallClockTime: 21s395ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 171.974ms - TotalThreadsVoluntaryContextSwitches: 2 (2) Fragment Instance Lifecycle Timings: - ExecTime: 301.230us - ExecTreeExecTime: 3.036us - OpenTime: 21s395ms - ExecTreeOpenTime: 21s224ms - PrepareTime: 31.937ms - ExecTreePrepareTime: 2.157ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 49 (49) - BlocksRecycled: 3 (3) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 32.00 MB (33554432) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=5):(Total: 9.092us, non-child: 9.092us, % non-child: 100.00%) - BytesSent: 0 - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1008.00 B (1008) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 197.380ms, non-child: 197.380ms, % non-child: 100.00%) - CodegenTime: 6.412ms - CompileTime: 43.491ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2068576) - NumFunctions: 89 (89) - NumInstructions: 1.98K (1981) - OptimizationTime: 126.986ms - PeakMemoryUsage: 990.50 KB (1014272) - PrepareTime: 26.333ms SORT_NODE (id=2):(Total: 21s226ms, non-child: 195.473us, % non-child: 0.00%) ExecOption: Codegen Enabled - InMemorySortTime: 616.000ns - InitialRunsCreated: 1 (1) - PeakMemoryUsage: 24.01 MB (25174016) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SortDataSize: 0 - SpilledRuns: 0 (0) - TotalMergesPerformed: 0 (0) AGGREGATION_NODE (id=4):(Total: 21s226ms, non-child: 3.024ms, % non-child: 0.01%) ExecOption: Codegen Enabled - BuildTime: 6.867us - GetNewBlockTime: 1.210ms - GetResultsTime: 0.000ns - HTResizeTime: 2.459us - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 10.30 MB (10799232) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 2.211us EXCHANGE_NODE (id=3):(Total: 21s223ms, non-child: 12.683us, % non-child: 0.00%) - ConvertRowBatchTime: 759.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 RecvrSide: BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - FirstBatchArrivalWaitTime: 21s223ms - TotalBytesReceived: 0 - TotalGetBatchTime: 21s223ms - DataArrivalTimer: 21s223ms SenderSide: - DeserializeRowBatchTimer: 0.000ns - NumBatchesAccepted: 0 (0) - NumBatchesRejected: 0 (0) Instance 6746754113c855a3:d4ee941f00000015 (host=10.17.193.19:22000):(Total: 21s426ms, non-child: 4.478ms, % non-child: 0.02%) MemoryUsage(500.000ms): 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.31 MB, 10.32 MB, 10.32 MB, 10.33 MB, 10.36 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 32.21 MB (33774073) - PerHostPeakMemUsage: 808.67 MB (847950800) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 21s214ms - TotalNetworkSendTime: 409.292us - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 17 (17) - TotalThreadsTotalWallClockTime: 21s390ms - TotalThreadsSysTime: 3.999ms - TotalThreadsUserTime: 170.974ms - TotalThreadsVoluntaryContextSwitches: 18 (18) Fragment Instance Lifecycle Timings: - ExecTime: 766.548us - ExecTreeExecTime: 10.567us - OpenTime: 21s389ms - ExecTreeOpenTime: 21s216ms - PrepareTime: 35.658ms - ExecTreePrepareTime: 1.830ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 49 (49) - BlocksRecycled: 3 (3) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 32.02 MB (33570816) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=5):(Total: 46.746us, non-child: 46.746us, % non-child: 100.00%) - BytesSent: 100.00 B (100) - OverallThroughput: 2.04 MB/sec - PeakMemoryUsage: 1008.00 B (1008) - RowsReturned: 1 (1) - SerializeBatchTime: 26.669us - UncompressedRowBatchSize: 100.00 B (100) CodeGen:(Total: 203.158ms, non-child: 203.158ms, % non-child: 100.00%) - CodegenTime: 6.501ms - CompileTime: 44.357ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2068576) - NumFunctions: 89 (89) - NumInstructions: 1.98K (1981) - OptimizationTime: 128.087ms - PeakMemoryUsage: 990.50 KB (1014272) - PrepareTime: 29.853ms SORT_NODE (id=2):(Total: 21s218ms, non-child: 1.102ms, % non-child: 0.01%) ExecOption: Codegen Enabled - InMemorySortTime: 2.576us - InitialRunsCreated: 1 (1) - PeakMemoryUsage: 24.02 MB (25182208) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SortDataSize: 132.00 B (132) - SpilledRuns: 0 (0) - TotalMergesPerformed: 0 (0) AGGREGATION_NODE (id=4):(Total: 21s217ms, non-child: 2.881ms, % non-child: 0.01%) ExecOption: Codegen Enabled - BuildTime: 39.595us - GetNewBlockTime: 615.506us - GetResultsTime: 52.948us - HTResizeTime: 3.805us - HashBuckets: 1.02K (1024) - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 10.36 MB (10860672) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 2.015us EXCHANGE_NODE (id=3):(Total: 21s214ms, non-child: 128.413us, % non-child: 0.00%) - ConvertRowBatchTime: 23.463us - PeakMemoryUsage: 0 - RowsReturned: 14 (14) - RowsReturnedRate: 0 RecvrSide: BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 148.00 B, 440.00 B, 440.00 B, 878.00 B, 1.86 KB - FirstBatchArrivalWaitTime: 18s777ms - TotalBytesReceived: 2.00 KB (2046) - TotalGetBatchTime: 21s214ms - DataArrivalTimer: 21s214ms SenderSide: - DeserializeRowBatchTimer: 178.085us - NumBatchesAccepted: 14 (14) - NumBatchesRejected: 0 (0) Instance 6746754113c855a3:d4ee941f00000013 (host=10.17.193.20:22000):(Total: 21s422ms, non-child: 4.464ms, % non-child: 0.02%) MemoryUsage(500.000ms): 10.29 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 32.06 MB (33618425) - PerHostPeakMemUsage: 817.59 MB (857305787) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 21s218ms - TotalNetworkSendTime: 962.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 17 (17) - TotalThreadsTotalWallClockTime: 21s393ms - TotalThreadsSysTime: 6.999ms - TotalThreadsUserTime: 167.974ms - TotalThreadsVoluntaryContextSwitches: 5 (5) Fragment Instance Lifecycle Timings: - ExecTime: 561.354us - ExecTreeExecTime: 5.871us - OpenTime: 21s393ms - ExecTreeOpenTime: 21s220ms - PrepareTime: 28.679ms - ExecTreePrepareTime: 1.398ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 49 (49) - BlocksRecycled: 3 (3) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 32.00 MB (33554432) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=5):(Total: 17.746us, non-child: 17.746us, % non-child: 100.00%) - BytesSent: 0 - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1008.00 B (1008) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 196.556ms, non-child: 196.556ms, % non-child: 100.00%) - CodegenTime: 7.106ms - CompileTime: 44.013ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2068576) - NumFunctions: 89 (89) - NumInstructions: 1.98K (1981) - OptimizationTime: 128.555ms - PeakMemoryUsage: 990.50 KB (1014272) - PrepareTime: 23.400ms SORT_NODE (id=2):(Total: 21s221ms, non-child: 318.414us, % non-child: 0.00%) ExecOption: Codegen Enabled - InMemorySortTime: 1.360us - InitialRunsCreated: 1 (1) - PeakMemoryUsage: 24.01 MB (25174016) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SortDataSize: 0 - SpilledRuns: 0 (0) - TotalMergesPerformed: 0 (0) AGGREGATION_NODE (id=4):(Total: 21s221ms, non-child: 2.511ms, % non-child: 0.01%) ExecOption: Codegen Enabled - BuildTime: 8.377us - GetNewBlockTime: 231.472us - GetResultsTime: 0.000ns - HTResizeTime: 3.991us - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 10.30 MB (10799232) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 2.198us EXCHANGE_NODE (id=3):(Total: 21s218ms, non-child: 13.784us, % non-child: 0.00%) - ConvertRowBatchTime: 972.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 RecvrSide: BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - FirstBatchArrivalWaitTime: 21s218ms - TotalBytesReceived: 0 - TotalGetBatchTime: 21s218ms - DataArrivalTimer: 21s218ms SenderSide: - DeserializeRowBatchTimer: 0.000ns - NumBatchesAccepted: 0 (0) - NumBatchesRejected: 0 (0) Instance 6746754113c855a3:d4ee941f00000012 (host=10.17.193.15:22000):(Total: 21s421ms, non-child: 4.263ms, % non-child: 0.02%) MemoryUsage(500.000ms): 11.27 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 32.06 MB (33618425) - PerHostPeakMemUsage: 792.64 MB (831148106) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 21s213ms - TotalNetworkSendTime: 1.196us - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 17 (17) - TotalThreadsTotalWallClockTime: 21s387ms - TotalThreadsSysTime: 999.000us - TotalThreadsUserTime: 172.974ms - TotalThreadsVoluntaryContextSwitches: 2 (2) Fragment Instance Lifecycle Timings: - ExecTime: 625.111us - ExecTreeExecTime: 5.023us - OpenTime: 21s387ms - ExecTreeOpenTime: 21s215ms - PrepareTime: 33.614ms - ExecTreePrepareTime: 1.833ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 49 (49) - BlocksRecycled: 3 (3) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 32.00 MB (33554432) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=5):(Total: 18.306us, non-child: 18.306us, % non-child: 100.00%) - BytesSent: 0 - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1008.00 B (1008) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 200.035ms, non-child: 200.035ms, % non-child: 100.00%) - CodegenTime: 6.416ms - CompileTime: 43.704ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2068576) - NumFunctions: 89 (89) - NumInstructions: 1.98K (1981) - OptimizationTime: 127.560ms - PeakMemoryUsage: 990.50 KB (1014272) - PrepareTime: 28.203ms SORT_NODE (id=2):(Total: 21s217ms, non-child: 336.222us, % non-child: 0.00%) ExecOption: Codegen Enabled - InMemorySortTime: 1.008us - InitialRunsCreated: 1 (1) - PeakMemoryUsage: 24.01 MB (25174016) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SortDataSize: 0 - SpilledRuns: 0 (0) - TotalMergesPerformed: 0 (0) AGGREGATION_NODE (id=4):(Total: 21s216ms, non-child: 3.052ms, % non-child: 0.01%) ExecOption: Codegen Enabled - BuildTime: 8.461us - GetNewBlockTime: 285.384us - GetResultsTime: 0.000ns - HTResizeTime: 3.504us - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 10.30 MB (10799232) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.981us EXCHANGE_NODE (id=3):(Total: 21s213ms, non-child: 13.617us, % non-child: 0.00%) - ConvertRowBatchTime: 808.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 RecvrSide: BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - FirstBatchArrivalWaitTime: 21s213ms - TotalBytesReceived: 0 - TotalGetBatchTime: 21s213ms - DataArrivalTimer: 21s213ms SenderSide: - DeserializeRowBatchTimer: 0.000ns - NumBatchesAccepted: 0 (0) - NumBatchesRejected: 0 (0) Instance 6746754113c855a3:d4ee941f00000014 (host=10.17.193.25:22000):(Total: 21s420ms, non-child: 4.093ms, % non-child: 0.02%) MemoryUsage(500.000ms): 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 32.06 MB (33618425) - PerHostPeakMemUsage: 822.67 MB (862629328) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 21s213ms - TotalNetworkSendTime: 1.014us - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 17 (17) - TotalThreadsTotalWallClockTime: 21s387ms - TotalThreadsSysTime: 3.000ms - TotalThreadsUserTime: 170.974ms - TotalThreadsVoluntaryContextSwitches: 3 (3) Fragment Instance Lifecycle Timings: - ExecTime: 575.262us - ExecTreeExecTime: 4.144us - OpenTime: 21s386ms - ExecTreeOpenTime: 21s214ms - PrepareTime: 33.626ms - ExecTreePrepareTime: 1.522ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 49 (49) - BlocksRecycled: 3 (3) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 32.00 MB (33554432) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=5):(Total: 17.518us, non-child: 17.518us, % non-child: 100.00%) - BytesSent: 0 - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1008.00 B (1008) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 200.700ms, non-child: 200.700ms, % non-child: 100.00%) - CodegenTime: 6.218ms - CompileTime: 43.480ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2068576) - NumFunctions: 89 (89) - NumInstructions: 1.98K (1981) - OptimizationTime: 127.719ms - PeakMemoryUsage: 990.50 KB (1014272) - PrepareTime: 28.948ms SORT_NODE (id=2):(Total: 21s215ms, non-child: 306.983us, % non-child: 0.00%) ExecOption: Codegen Enabled - InMemorySortTime: 945.000ns - InitialRunsCreated: 1 (1) - PeakMemoryUsage: 24.01 MB (25174016) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SortDataSize: 0 - SpilledRuns: 0 (0) - TotalMergesPerformed: 0 (0) AGGREGATION_NODE (id=4):(Total: 21s215ms, non-child: 2.621ms, % non-child: 0.01%) ExecOption: Codegen Enabled - BuildTime: 7.612us - GetNewBlockTime: 317.815us - GetResultsTime: 0.000ns - HTResizeTime: 2.944us - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 10.30 MB (10799232) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 2.009us EXCHANGE_NODE (id=3):(Total: 21s213ms, non-child: 13.825us, % non-child: 0.00%) - ConvertRowBatchTime: 678.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 RecvrSide: BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - FirstBatchArrivalWaitTime: 21s213ms - TotalBytesReceived: 0 - TotalGetBatchTime: 21s213ms - DataArrivalTimer: 21s213ms SenderSide: - DeserializeRowBatchTimer: 0.000ns - NumBatchesAccepted: 0 (0) - NumBatchesRejected: 0 (0) Instance 6746754113c855a3:d4ee941f00000011 (host=10.17.193.11:22000):(Total: 21s420ms, non-child: 4.590ms, % non-child: 0.02%) MemoryUsage(500.000ms): 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 32.06 MB (33618425) - PerHostPeakMemUsage: 822.59 MB (862549272) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 21s208ms - TotalNetworkSendTime: 835.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 17 (17) - TotalThreadsTotalWallClockTime: 21s386ms - TotalThreadsSysTime: 5.999ms - TotalThreadsUserTime: 171.974ms - TotalThreadsVoluntaryContextSwitches: 2 (2) Fragment Instance Lifecycle Timings: - ExecTime: 576.371us - ExecTreeExecTime: 4.654us - OpenTime: 21s386ms - ExecTreeOpenTime: 21s209ms - PrepareTime: 33.487ms - ExecTreePrepareTime: 2.118ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 49 (49) - BlocksRecycled: 3 (3) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 32.00 MB (33554432) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=5):(Total: 26.454us, non-child: 26.454us, % non-child: 100.00%) - BytesSent: 0 - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1008.00 B (1008) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 204.237ms, non-child: 204.237ms, % non-child: 100.00%) - CodegenTime: 7.852ms - CompileTime: 44.100ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2068576) - NumFunctions: 89 (89) - NumInstructions: 1.98K (1981) - OptimizationTime: 131.957ms - PeakMemoryUsage: 990.50 KB (1014272) - PrepareTime: 27.409ms SORT_NODE (id=2):(Total: 21s211ms, non-child: 307.593us, % non-child: 0.00%) ExecOption: Codegen Enabled - InMemorySortTime: 999.000ns - InitialRunsCreated: 1 (1) - PeakMemoryUsage: 24.01 MB (25174016) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SortDataSize: 0 - SpilledRuns: 0 (0) - TotalMergesPerformed: 0 (0) AGGREGATION_NODE (id=4):(Total: 21s211ms, non-child: 3.086ms, % non-child: 0.01%) ExecOption: Codegen Enabled - BuildTime: 7.017us - GetNewBlockTime: 990.372us - GetResultsTime: 0.000ns - HTResizeTime: 2.983us - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 10.30 MB (10799232) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.887us EXCHANGE_NODE (id=3):(Total: 21s208ms, non-child: 13.810us, % non-child: 0.00%) - ConvertRowBatchTime: 983.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 RecvrSide: BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - FirstBatchArrivalWaitTime: 21s208ms - TotalBytesReceived: 0 - TotalGetBatchTime: 21s208ms - DataArrivalTimer: 21s208ms SenderSide: - DeserializeRowBatchTimer: 0.000ns - NumBatchesAccepted: 0 (0) - NumBatchesRejected: 0 (0) Instance 6746754113c855a3:d4ee941f00000010 (host=10.17.193.16:22000):(Total: 21s418ms, non-child: 4.349ms, % non-child: 0.02%) MemoryUsage(500.000ms): 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 32.06 MB (33618425) - PerHostPeakMemUsage: 774.84 MB (812476542) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 21s209ms - TotalNetworkSendTime: 778.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 18 (18) - TotalThreadsTotalWallClockTime: 21s384ms - TotalThreadsSysTime: 2.999ms - TotalThreadsUserTime: 170.974ms - TotalThreadsVoluntaryContextSwitches: 3 (3) Fragment Instance Lifecycle Timings: - ExecTime: 516.062us - ExecTreeExecTime: 15.252us - OpenTime: 21s383ms - ExecTreeOpenTime: 21s210ms - PrepareTime: 34.472ms - ExecTreePrepareTime: 1.671ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 49 (49) - BlocksRecycled: 3 (3) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 32.00 MB (33554432) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=5):(Total: 18.222us, non-child: 18.222us, % non-child: 100.00%) - BytesSent: 0 - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1008.00 B (1008) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 202.052ms, non-child: 202.052ms, % non-child: 100.00%) - CodegenTime: 6.562ms - CompileTime: 44.317ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2068576) - NumFunctions: 89 (89) - NumInstructions: 1.98K (1981) - OptimizationTime: 128.146ms - PeakMemoryUsage: 990.50 KB (1014272) - PrepareTime: 28.986ms SORT_NODE (id=2):(Total: 21s212ms, non-child: 303.315us, % non-child: 0.00%) ExecOption: Codegen Enabled - InMemorySortTime: 1.216us - InitialRunsCreated: 1 (1) - PeakMemoryUsage: 24.01 MB (25174016) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SortDataSize: 0 - SpilledRuns: 0 (0) - TotalMergesPerformed: 0 (0) AGGREGATION_NODE (id=4):(Total: 21s212ms, non-child: 2.693ms, % non-child: 0.01%) ExecOption: Codegen Enabled - BuildTime: 7.375us - GetNewBlockTime: 472.323us - GetResultsTime: 0.000ns - HTResizeTime: 2.813us - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 10.30 MB (10799232) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 2.260us EXCHANGE_NODE (id=3):(Total: 21s209ms, non-child: 14.302us, % non-child: 0.00%) - ConvertRowBatchTime: 979.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 RecvrSide: BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - FirstBatchArrivalWaitTime: 21s209ms - TotalBytesReceived: 0 - TotalGetBatchTime: 21s209ms - DataArrivalTimer: 21s209ms SenderSide: - DeserializeRowBatchTimer: 0.000ns - NumBatchesAccepted: 0 (0) - NumBatchesRejected: 0 (0) Instance 6746754113c855a3:d4ee941f0000000f (host=10.17.193.23:22000):(Total: 21s418ms, non-child: 4.454ms, % non-child: 0.02%) MemoryUsage(500.000ms): 11.27 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 32.06 MB (33618425) - PerHostPeakMemUsage: 822.67 MB (862631231) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 21s211ms - TotalNetworkSendTime: 1.190us - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 17 (17) - TotalThreadsTotalWallClockTime: 21s386ms - TotalThreadsSysTime: 6.999ms - TotalThreadsUserTime: 166.975ms - TotalThreadsVoluntaryContextSwitches: 3 (3) Fragment Instance Lifecycle Timings: - ExecTime: 676.361us - ExecTreeExecTime: 5.303us - OpenTime: 21s386ms - ExecTreeOpenTime: 21s213ms - PrepareTime: 31.357ms - ExecTreePrepareTime: 1.389ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 49 (49) - BlocksRecycled: 3 (3) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 32.00 MB (33554432) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=5):(Total: 18.341us, non-child: 18.341us, % non-child: 100.00%) - BytesSent: 0 - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1008.00 B (1008) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 199.016ms, non-child: 199.016ms, % non-child: 100.00%) - CodegenTime: 6.959ms - CompileTime: 44.407ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2068576) - NumFunctions: 89 (89) - NumInstructions: 1.98K (1981) - OptimizationTime: 127.823ms - PeakMemoryUsage: 990.50 KB (1014272) - PrepareTime: 26.210ms SORT_NODE (id=2):(Total: 21s214ms, non-child: 306.705us, % non-child: 0.00%) ExecOption: Codegen Enabled - InMemorySortTime: 1.283us - InitialRunsCreated: 1 (1) - PeakMemoryUsage: 24.01 MB (25174016) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SortDataSize: 0 - SpilledRuns: 0 (0) - TotalMergesPerformed: 0 (0) AGGREGATION_NODE (id=4):(Total: 21s214ms, non-child: 2.533ms, % non-child: 0.01%) ExecOption: Codegen Enabled - BuildTime: 8.096us - GetNewBlockTime: 239.873us - GetResultsTime: 0.000ns - HTResizeTime: 3.648us - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 10.30 MB (10799232) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.875us EXCHANGE_NODE (id=3):(Total: 21s211ms, non-child: 14.216us, % non-child: 0.00%) - ConvertRowBatchTime: 812.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 RecvrSide: BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - FirstBatchArrivalWaitTime: 21s211ms - TotalBytesReceived: 0 - TotalGetBatchTime: 21s211ms - DataArrivalTimer: 21s211ms SenderSide: - DeserializeRowBatchTimer: 0.000ns - NumBatchesAccepted: 0 (0) - NumBatchesRejected: 0 (0) Averaged Fragment F00:(Total: 20s537ms, non-child: 23.535ms, % non-child: 0.11%) split sizes: min: 4.21 GB, max: 4.71 GB, avg: 4.60 GB, stddev: 147.33 MB completion times: min:19s000ms max:21s433ms mean: 20s539ms stddev:698.059ms execution rates: min:222.70 MB/sec max:235.43 MB/sec mean:229.24 MB/sec stddev:3.87 MB/sec num instances: 14 - AverageThreadTokens: 11.03 - BloomFilterBytes: 0 - PeakMemoryUsage: 797.10 MB (835819739) - PerHostPeakMemUsage: 807.40 MB (846624050) - RowsProduced: 4 (4) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 4.329ms - TotalStorageWaitTime: 10s674ms - TotalThreadsInvoluntaryContextSwitches: 11.39K (11386) - TotalThreadsTotalWallClockTime: 3m46s - TotalThreadsSysTime: 766.520ms - TotalThreadsUserTime: 42s459ms - TotalThreadsVoluntaryContextSwitches: 123.71K (123706) Fragment Instance Lifecycle Timings: - ExecTime: 20s237ms - ExecTreeExecTime: 20s219ms - OpenTime: 237.693ms - ExecTreeOpenTime: 73.617us - PrepareTime: 62.819ms - ExecTreePrepareTime: 32.087ms DataStreamSender (dst_id=3):(Total: 95.141us, non-child: 95.141us, % non-child: 100.00%) - BytesSent: 595.00 B (595) - OverallThroughput: 7.07 MB/sec - PeakMemoryUsage: 27.59 KB (28256) - RowsReturned: 4 (4) - SerializeBatchTime: 57.222us - UncompressedRowBatchSize: 595.00 B (595) CodeGen:(Total: 261.897ms, non-child: 261.897ms, % non-child: 100.00%) - CodegenTime: 16.081ms - CompileTime: 61.980ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2068576) - NumFunctions: 139 (139) - NumInstructions: 4.38K (4382) - OptimizationTime: 174.918ms - PeakMemoryUsage: 2.14 MB (2243584) - PrepareTime: 24.419ms AGGREGATION_NODE (id=1):(Total: 20s252ms, non-child: 19s434ms, % non-child: 95.96%) - GetNewBlockTime: 92.991us - GetResultsTime: 26.103us - HTResizeTime: 1.707ms - HashBuckets: 8.19K (8192) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.44 MB (2557804) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 4 (4) - RowsReturnedRate: 0 - StreamingTime: 19s202ms - UnpinTime: 0.000ns HDFS_SCAN_NODE (id=0):(Total: 818.090ms, non-child: 818.090ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.50 - AverageScannerThreadConcurrency: 10.19 - BytesRead: 1.07 GB (1145053905) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.07 GB (1145053905) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.07 GB (1145053905) - CachedFileHandlesHitCount: 224 (224) - CachedFileHandlesMissCount: 18 (18) - DecompressionTime: 2s134ms - MaxCompressedTextFileLength: 0 - NumColumns: 7 (7) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 8 (8) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 12 (12) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 795.42 MB (834062878) - PerReadThreadRawHdfsThroughput: 116.26 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 298.714ms - RowBatchQueuePutWaitTime: 2m53s - RowsRead: 128.57M (128570649) - RowsReturned: 126.76M (126762585) - RowsReturnedRate: 155.11 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 9.29K (9291) - ScannerThreadsTotalWallClockTime: 3m26s - MaterializeTupleTime(*): 18s342ms - ScannerThreadsSysTime: 504.417ms - ScannerThreadsUserTime: 22s564ms - ScannerThreadsVoluntaryContextSwitches: 123.66K (123663) - TotalRawHdfsReadTime(*): 9s885ms - TotalReadThroughput: 53.20 MB/sec BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 49 (49) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 8.77 MB (9191424) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns Fragment F00: Instance 6746754113c855a3:d4ee941f0000000a (host=10.17.193.22:22000):(Total: 21s431ms, non-child: 24.135ms, % non-child: 0.11%) Hdfs split stats (:<# splits>/): 10:1/253.39 MB 8:3/760.20 MB 1:2/506.78 MB 3:3/760.20 MB 7:2/506.77 MB 2:2/506.80 MB 5:1/253.40 MB 0:5/1.24 GB MemoryUsage(500.000ms): 3.45 MB, 333.77 MB, 557.54 MB, 747.97 MB, 812.29 MB, 788.13 MB, 780.27 MB, 772.24 MB, 748.56 MB, 724.65 MB, 716.78 MB, 692.73 MB, 684.81 MB, 677.08 MB, 661.06 MB, 629.36 MB, 621.43 MB, 605.54 MB, 589.54 MB, 581.38 MB, 557.51 MB, 509.90 MB, 485.99 MB, 454.20 MB, 406.32 MB, 391.55 MB, 537.51 MB, 491.05 MB, 510.62 MB, 459.90 MB, 471.94 MB, 448.27 MB, 440.09 MB, 424.20 MB, 408.31 MB, 384.52 MB, 368.87 MB, 360.79 MB, 328.63 MB, 305.02 MB, 273.13 MB, 225.14 MB, 76.19 MB ThreadUsage(500.000ms): 1, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 3 - AverageThreadTokens: 10.98 - BloomFilterBytes: 0 - PeakMemoryUsage: 812.29 MB (851744970) - PerHostPeakMemUsage: 822.59 MB (862548675) - RowsProduced: 4 (4) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 4.343ms - TotalStorageWaitTime: 10s427ms - TotalThreadsInvoluntaryContextSwitches: 12.03K (12031) - TotalThreadsTotalWallClockTime: 3m58s - TotalThreadsSysTime: 902.855ms - TotalThreadsUserTime: 45s349ms - TotalThreadsVoluntaryContextSwitches: 126.33K (126330) Fragment Instance Lifecycle Timings: - ExecTime: 21s131ms - ExecTreeExecTime: 21s113ms - OpenTime: 236.806ms - ExecTreeOpenTime: 82.001us - PrepareTime: 63.446ms - ExecTreePrepareTime: 29.272ms DataStreamSender (dst_id=3):(Total: 93.477us, non-child: 93.477us, % non-child: 100.00%) - BytesSent: 595.00 B (595) - OverallThroughput: 6.07 MB/sec - PeakMemoryUsage: 27.59 KB (28256) - RowsReturned: 4 (4) - SerializeBatchTime: 60.470us - UncompressedRowBatchSize: 595.00 B (595) CodeGen:(Total: 264.297ms, non-child: 264.297ms, % non-child: 100.00%) - CodegenTime: 16.041ms - CompileTime: 62.092ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2068576) - NumFunctions: 139 (139) - NumInstructions: 4.38K (4382) - OptimizationTime: 173.981ms - PeakMemoryUsage: 2.14 MB (2243584) - PrepareTime: 27.626ms AGGREGATION_NODE (id=1):(Total: 21s142ms, non-child: 20s307ms, % non-child: 96.05%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 93.029us - GetResultsTime: 27.271us - HTResizeTime: 585.684us - HashBuckets: 8.19K (8192) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.44 MB (2557804) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 4 (4) - RowsReturnedRate: 0 - StreamingTime: 20s048ms - UnpinTime: 0.000ns HDFS_SCAN_NODE (id=0):(Total: 834.916ms, non-child: 834.916ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 10:1/253.39 MB 8:3/760.20 MB 1:2/506.78 MB 3:3/760.20 MB 7:2/506.77 MB 2:2/506.80 MB 5:1/253.40 MB 0:5/1.24 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 19 out of 19 Hdfs Read Thread Concurrency Bucket: 0:80.95% 1:7.143% 2:7.143% 3:0% 4:2.381% 5:2.381% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:133 BytesRead(500.000ms): 0, 248.40 MB, 446.31 MB, 631.03 MB, 705.37 MB, 705.37 MB, 705.37 MB, 705.37 MB, 705.37 MB, 705.37 MB, 705.37 MB, 705.37 MB, 705.37 MB, 705.37 MB, 705.37 MB, 705.37 MB, 705.37 MB, 705.37 MB, 705.37 MB, 705.37 MB, 705.37 MB, 705.37 MB, 705.37 MB, 705.37 MB, 705.37 MB, 737.67 MB, 929.92 MB, 940.60 MB, 988.79 MB, 1.07 GB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB - FooterProcessingTime: (Avg: 204.992ms ; Min: 4.533ms ; Max: 367.866ms ; Number of samples: 19) - AverageHdfsReadThreadConcurrency: 0.43 - AverageScannerThreadConcurrency: 10.21 - BytesRead: 1.09 GB (1171103522) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.09 GB (1171103522) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.09 GB (1171103522) - CachedFileHandlesHitCount: 228 (228) - CachedFileHandlesMissCount: 19 (19) - DecompressionTime: 2s307ms - MaxCompressedTextFileLength: 0 - NumColumns: 7 (7) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 8 (8) - NumRowGroups: 19 (19) - NumScannerThreadsStarted: 12 (12) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 810.61 MB (849987613) - PerReadThreadRawHdfsThroughput: 118.40 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 286.373ms - RowBatchQueuePutWaitTime: 3m3s - RowsRead: 131.50M (131502186) - RowsReturned: 129.65M (129652573) - RowsReturnedRate: 155.29 M/sec - ScanRangesComplete: 19 (19) - ScannerThreadsInvoluntaryContextSwitches: 9.91K (9910) - ScannerThreadsTotalWallClockTime: 3m36s - MaterializeTupleTime(*): 19s862ms - ScannerThreadsSysTime: 585.904ms - ScannerThreadsUserTime: 24s605ms - ScannerThreadsVoluntaryContextSwitches: 126.23K (126227) - TotalRawHdfsReadTime(*): 9s432ms - TotalReadThroughput: 51.95 MB/sec Instance 6746754113c855a3:d4ee941f00000005 (host=10.17.193.20:22000):(Total: 21s177ms, non-child: 22.136ms, % non-child: 0.10%) Hdfs split stats (:<# splits>/): 4:1/253.39 MB 1:1/253.41 MB 8:1/253.40 MB 10:1/253.38 MB 5:1/253.39 MB 9:3/760.18 MB 7:2/506.77 MB 6:2/506.79 MB 3:6/1.46 GB 0:1/253.39 MB MemoryUsage(500.000ms): 0, 2.59 MB, 601.06 MB, 695.57 MB, 806.97 MB, 806.97 MB, 791.16 MB, 759.30 MB, 735.46 MB, 719.65 MB, 711.78 MB, 711.78 MB, 703.86 MB, 663.95 MB, 640.25 MB, 632.28 MB, 616.46 MB, 616.30 MB, 616.39 MB, 568.79 MB, 552.79 MB, 544.87 MB, 473.27 MB, 457.32 MB, 449.62 MB, 377.57 MB, 361.44 MB, 246.50 MB, 139.59 MB, 259.21 MB, 399.98 MB, 448.03 MB, 432.22 MB, 416.42 MB, 400.53 MB, 384.40 MB, 333.98 MB, 317.93 MB, 309.93 MB, 278.26 MB, 238.37 MB, 188.73 MB, 76.16 MB ThreadUsage(500.000ms): 1, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 8, 8, 8, 8, 8, 8, 8, 8, 7, 7, 7, 7, 7, 6, 3 - AverageThreadTokens: 10.70 - BloomFilterBytes: 0 - PeakMemoryUsage: 807.29 MB (846502082) - PerHostPeakMemUsage: 817.59 MB (857305787) - RowsProduced: 4 (4) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 4.269ms - TotalStorageWaitTime: 13s919ms - TotalThreadsInvoluntaryContextSwitches: 11.17K (11171) - TotalThreadsTotalWallClockTime: 3m49s - TotalThreadsSysTime: 733.884ms - TotalThreadsUserTime: 43s141ms - TotalThreadsVoluntaryContextSwitches: 125.39K (125394) Fragment Instance Lifecycle Timings: - ExecTime: 20s877ms - ExecTreeExecTime: 20s862ms - OpenTime: 239.214ms - ExecTreeOpenTime: 78.170us - PrepareTime: 60.179ms - ExecTreePrepareTime: 29.563ms DataStreamSender (dst_id=3):(Total: 79.717us, non-child: 79.717us, % non-child: 100.00%) - BytesSent: 595.00 B (595) - OverallThroughput: 7.12 MB/sec - PeakMemoryUsage: 27.59 KB (28256) - RowsReturned: 4 (4) - SerializeBatchTime: 64.238us - UncompressedRowBatchSize: 595.00 B (595) CodeGen:(Total: 263.128ms, non-child: 263.128ms, % non-child: 100.00%) - CodegenTime: 16.443ms - CompileTime: 62.173ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2068576) - NumFunctions: 139 (139) - NumInstructions: 4.38K (4382) - OptimizationTime: 176.240ms - PeakMemoryUsage: 2.14 MB (2243584) - PrepareTime: 24.134ms AGGREGATION_NODE (id=1):(Total: 20s892ms, non-child: 20s081ms, % non-child: 96.12%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 79.022us - GetResultsTime: 24.281us - HTResizeTime: 710.926us - HashBuckets: 8.19K (8192) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.44 MB (2557804) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 4 (4) - RowsReturnedRate: 0 - StreamingTime: 19s838ms - UnpinTime: 0.000ns HDFS_SCAN_NODE (id=0):(Total: 810.915ms, non-child: 810.915ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:1/253.39 MB 1:1/253.41 MB 8:1/253.40 MB 10:1/253.38 MB 5:1/253.39 MB 9:3/760.18 MB 7:2/506.77 MB 6:2/506.79 MB 3:6/1.46 GB 0:1/253.39 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 19 out of 19 Hdfs Read Thread Concurrency Bucket: 0:83.33% 1:2.381% 2:9.524% 3:0% 4:2.381% 5:0% 6:0% 7:0% 8:0% 9:0% 10:2.381% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:133 BytesRead(500.000ms): 0, 0, 491.19 MB, 589.85 MB, 699.42 MB, 699.42 MB, 699.42 MB, 699.42 MB, 699.42 MB, 699.42 MB, 699.42 MB, 699.42 MB, 699.42 MB, 699.42 MB, 699.42 MB, 699.42 MB, 699.42 MB, 699.42 MB, 699.42 MB, 699.42 MB, 699.42 MB, 699.42 MB, 699.42 MB, 699.42 MB, 699.42 MB, 699.42 MB, 699.42 MB, 758.49 MB, 796.65 MB, 911.17 MB, 1.02 GB, 1.08 GB, 1.08 GB, 1.08 GB, 1.08 GB, 1.08 GB, 1.08 GB, 1.08 GB, 1.08 GB, 1.08 GB, 1.08 GB, 1.08 GB, 1.08 GB - FooterProcessingTime: (Avg: 230.517ms ; Min: 6.726ms ; Max: 701.632ms ; Number of samples: 19) - AverageHdfsReadThreadConcurrency: 0.55 - AverageScannerThreadConcurrency: 9.93 - BytesRead: 1.08 GB (1164848599) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.08 GB (1164848599) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.08 GB (1164848599) - CachedFileHandlesHitCount: 227 (227) - CachedFileHandlesMissCount: 19 (19) - DecompressionTime: 2s156ms - MaxCompressedTextFileLength: 0 - NumColumns: 7 (7) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 10 (10) - NumRowGroups: 19 (19) - NumScannerThreadsStarted: 12 (12) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 805.62 MB (844751670) - PerReadThreadRawHdfsThroughput: 112.52 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 280.220ms - RowBatchQueuePutWaitTime: 2m52s - RowsRead: 130.80M (130797756) - RowsReturned: 128.96M (128958843) - RowsReturnedRate: 159.03 M/sec - ScanRangesComplete: 19 (19) - ScannerThreadsInvoluntaryContextSwitches: 9.07K (9067) - ScannerThreadsTotalWallClockTime: 3m28s - MaterializeTupleTime(*): 18s440ms - ScannerThreadsSysTime: 483.922ms - ScannerThreadsUserTime: 22s568ms - ScannerThreadsVoluntaryContextSwitches: 125.35K (125353) - TotalRawHdfsReadTime(*): 9s872ms - TotalReadThroughput: 51.67 MB/sec Instance 6746754113c855a3:d4ee941f0000000d (host=10.17.193.17:22000):(Total: 21s153ms, non-child: 23.582ms, % non-child: 0.11%) Hdfs split stats (:<# splits>/): 8:2/506.78 MB 7:1/253.38 MB 6:2/506.80 MB 10:1/253.39 MB 9:3/760.16 MB 3:3/760.19 MB 4:3/760.18 MB 2:4/1013.56 MB MemoryUsage(500.000ms): 2.34 MB, 400.64 MB, 563.80 MB, 697.58 MB, 756.08 MB, 780.11 MB, 780.35 MB, 756.34 MB, 748.40 MB, 724.57 MB, 700.73 MB, 685.00 MB, 684.84 MB, 660.87 MB, 652.94 MB, 629.11 MB, 605.48 MB, 589.55 MB, 589.47 MB, 541.95 MB, 525.85 MB, 502.20 MB, 454.39 MB, 430.31 MB, 440.28 MB, 529.50 MB, 525.82 MB, 526.93 MB, 554.16 MB, 498.47 MB, 448.19 MB, 440.09 MB, 424.28 MB, 400.57 MB, 392.42 MB, 376.45 MB, 360.71 MB, 336.79 MB, 288.80 MB, 273.04 MB, 233.06 MB, 102.82 MB ThreadUsage(500.000ms): 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 12, 9, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 4 - AverageThreadTokens: 11.36 - BloomFilterBytes: 0 - PeakMemoryUsage: 780.58 MB (818500808) - PerHostPeakMemUsage: 790.89 MB (829304513) - RowsProduced: 4 (4) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 3.967ms - TotalStorageWaitTime: 12s270ms - TotalThreadsInvoluntaryContextSwitches: 12.41K (12413) - TotalThreadsTotalWallClockTime: 3m55s - TotalThreadsSysTime: 832.867ms - TotalThreadsUserTime: 45s537ms - TotalThreadsVoluntaryContextSwitches: 126.26K (126261) Fragment Instance Lifecycle Timings: - ExecTime: 20s853ms - ExecTreeExecTime: 20s836ms - OpenTime: 237.914ms - ExecTreeOpenTime: 74.614us - PrepareTime: 61.382ms - ExecTreePrepareTime: 30.472ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 49 (49) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 8.77 MB (9191424) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=3):(Total: 78.426us, non-child: 78.426us, % non-child: 100.00%) - BytesSent: 595.00 B (595) - OverallThroughput: 7.24 MB/sec - PeakMemoryUsage: 27.59 KB (28256) - RowsReturned: 4 (4) - SerializeBatchTime: 55.191us - UncompressedRowBatchSize: 595.00 B (595) CodeGen:(Total: 262.528ms, non-child: 262.528ms, % non-child: 100.00%) - CodegenTime: 15.792ms - CompileTime: 62.116ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2068576) - NumFunctions: 139 (139) - NumInstructions: 4.38K (4382) - OptimizationTime: 175.008ms - PeakMemoryUsage: 2.14 MB (2243584) - PrepareTime: 24.833ms AGGREGATION_NODE (id=1):(Total: 20s867ms, non-child: 20s034ms, % non-child: 96.01%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 63.163us - GetResultsTime: 27.650us - HTResizeTime: 1.009ms - HashBuckets: 8.19K (8192) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.44 MB (2557804) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 4 (4) - RowsReturnedRate: 0 - StreamingTime: 19s796ms - UnpinTime: 0.000ns HDFS_SCAN_NODE (id=0):(Total: 832.945ms, non-child: 832.945ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 8:2/506.78 MB 7:1/253.38 MB 6:2/506.80 MB 10:1/253.39 MB 9:3/760.16 MB 3:3/760.19 MB 4:3/760.18 MB 2:4/1013.56 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 19 out of 19 Hdfs Read Thread Concurrency Bucket: 0:78.57% 1:11.9% 2:2.381% 3:2.381% 4:0% 5:2.381% 6:0% 7:0% 8:2.381% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:133 BytesRead(500.000ms): 0, 310.66 MB, 468.87 MB, 592.87 MB, 660.21 MB, 705.39 MB, 705.39 MB, 705.39 MB, 705.39 MB, 705.39 MB, 705.39 MB, 705.39 MB, 705.39 MB, 705.39 MB, 705.39 MB, 705.39 MB, 705.39 MB, 705.39 MB, 705.39 MB, 705.39 MB, 705.39 MB, 705.39 MB, 705.39 MB, 705.39 MB, 776.77 MB, 929.93 MB, 940.52 MB, 1.01 GB, 1.05 GB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB - FooterProcessingTime: (Avg: 207.580ms ; Min: 4.693ms ; Max: 492.156ms ; Number of samples: 19) - AverageHdfsReadThreadConcurrency: 0.55 - AverageScannerThreadConcurrency: 10.36 - BytesRead: 1.09 GB (1171118566) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.09 GB (1171118566) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.09 GB (1171118566) - CachedFileHandlesHitCount: 228 (228) - CachedFileHandlesMissCount: 19 (19) - DecompressionTime: 2s321ms - MaxCompressedTextFileLength: 0 - NumColumns: 7 (7) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 8 (8) - NumRowGroups: 19 (19) - NumScannerThreadsStarted: 12 (12) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 778.91 MB (816743451) - PerReadThreadRawHdfsThroughput: 105.95 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 271.476ms - RowBatchQueuePutWaitTime: 2m58s - RowsRead: 131.50M (131502508) - RowsReturned: 129.65M (129654866) - RowsReturnedRate: 155.66 M/sec - ScanRangesComplete: 19 (19) - ScannerThreadsInvoluntaryContextSwitches: 10.32K (10325) - ScannerThreadsTotalWallClockTime: 3m34s - MaterializeTupleTime(*): 20s320ms - ScannerThreadsSysTime: 566.907ms - ScannerThreadsUserTime: 24s999ms - ScannerThreadsVoluntaryContextSwitches: 126.22K (126224) - TotalRawHdfsReadTime(*): 10s541ms - TotalReadThroughput: 53.18 MB/sec Instance 6746754113c855a3:d4ee941f00000004 (host=10.17.193.15:22000):(Total: 21s078ms, non-child: 21.770ms, % non-child: 0.10%) Hdfs split stats (:<# splits>/): 6:2/506.79 MB 8:3/760.21 MB 1:4/1013.54 MB 3:1/187.22 MB 5:3/760.16 MB 7:1/253.39 MB 2:3/706.54 MB 0:2/506.78 MB MemoryUsage(500.000ms): 3.45 MB, 66.59 MB, 601.51 MB, 724.96 MB, 781.97 MB, 782.21 MB, 758.21 MB, 742.40 MB, 702.51 MB, 694.65 MB, 686.70 MB, 686.70 MB, 670.89 MB, 646.91 MB, 623.33 MB, 599.09 MB, 591.17 MB, 591.41 MB, 583.25 MB, 551.17 MB, 527.27 MB, 533.16 MB, 541.23 MB, 517.65 MB, 501.62 MB, 461.90 MB, 437.65 MB, 448.13 MB, 543.56 MB, 490.40 MB, 464.16 MB, 448.17 MB, 408.54 MB, 408.23 MB, 408.15 MB, 352.98 MB, 345.04 MB, 336.95 MB, 320.95 MB, 254.21 MB, 188.13 MB, 179.97 MB, 91.17 KB ThreadUsage(500.000ms): 1, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 11, 9, 8, 8, 8, 8, 8, 8, 8, 8, 8, 7, 6, 6, 1 - AverageThreadTokens: 10.79 - BloomFilterBytes: 0 - PeakMemoryUsage: 782.34 MB (820344401) - PerHostPeakMemUsage: 792.64 MB (831148106) - RowsProduced: 4 (4) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 3.778ms - TotalStorageWaitTime: 8s439ms - TotalThreadsInvoluntaryContextSwitches: 12.29K (12292) - TotalThreadsTotalWallClockTime: 3m53s - TotalThreadsSysTime: 791.873ms - TotalThreadsUserTime: 43s372ms - TotalThreadsVoluntaryContextSwitches: 123.52K (123522) Fragment Instance Lifecycle Timings: - ExecTime: 20s785ms - ExecTreeExecTime: 20s770ms - OpenTime: 236.466ms - ExecTreeOpenTime: 70.789us - PrepareTime: 56.514ms - ExecTreePrepareTime: 26.821ms DataStreamSender (dst_id=3):(Total: 51.672us, non-child: 51.672us, % non-child: 100.00%) - BytesSent: 595.00 B (595) - OverallThroughput: 10.98 MB/sec - PeakMemoryUsage: 27.59 KB (28256) - RowsReturned: 4 (4) - SerializeBatchTime: 37.179us - UncompressedRowBatchSize: 595.00 B (595) CodeGen:(Total: 259.846ms, non-child: 259.846ms, % non-child: 100.00%) - CodegenTime: 15.718ms - CompileTime: 61.581ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2068576) - NumFunctions: 139 (139) - NumInstructions: 4.38K (4382) - OptimizationTime: 174.145ms - PeakMemoryUsage: 2.14 MB (2243584) - PrepareTime: 23.553ms AGGREGATION_NODE (id=1):(Total: 20s796ms, non-child: 19s986ms, % non-child: 96.10%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 67.849us - GetResultsTime: 27.061us - HTResizeTime: 519.221us - HashBuckets: 8.19K (8192) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.44 MB (2557804) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 4 (4) - RowsReturnedRate: 0 - StreamingTime: 19s734ms - UnpinTime: 0.000ns HDFS_SCAN_NODE (id=0):(Total: 810.096ms, non-child: 810.096ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 6:2/506.79 MB 8:3/760.21 MB 1:4/1013.54 MB 3:1/187.22 MB 5:3/760.16 MB 7:1/253.39 MB 2:3/706.54 MB 0:2/506.78 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 19 out of 19 Hdfs Read Thread Concurrency Bucket: 0:90.24% 1:0% 2:2.439% 3:2.439% 4:2.439% 5:0% 6:0% 7:0% 8:2.439% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:133 BytesRead(500.000ms): 0, 47.62 MB, 497.76 MB, 615.23 MB, 677.62 MB, 677.62 MB, 677.62 MB, 677.62 MB, 677.62 MB, 677.62 MB, 677.62 MB, 677.62 MB, 677.62 MB, 677.62 MB, 677.62 MB, 677.62 MB, 677.62 MB, 677.62 MB, 677.62 MB, 677.62 MB, 677.62 MB, 736.40 MB, 795.18 MB, 795.18 MB, 795.18 MB, 795.18 MB, 795.18 MB, 907.12 MB, 1.06 GB, 1.06 GB, 1.06 GB, 1.06 GB, 1.06 GB, 1.06 GB, 1.06 GB, 1.06 GB, 1.06 GB, 1.06 GB, 1.06 GB, 1.06 GB, 1.06 GB, 1.06 GB - FooterProcessingTime: (Avg: 190.417ms ; Min: 4.229ms ; Max: 362.259ms ; Number of samples: 19) - AverageHdfsReadThreadConcurrency: 0.41 - AverageScannerThreadConcurrency: 10.27 - BytesRead: 1.06 GB (1141997471) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.06 GB (1141997471) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.06 GB (1141997471) - CachedFileHandlesHitCount: 224 (224) - CachedFileHandlesMissCount: 19 (19) - DecompressionTime: 2s150ms - MaxCompressedTextFileLength: 0 - NumColumns: 7 (7) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 8 (8) - NumRowGroups: 19 (19) - NumScannerThreadsStarted: 12 (12) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 780.67 MB (818587044) - PerReadThreadRawHdfsThroughput: 127.21 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 277.716ms - RowBatchQueuePutWaitTime: 3m1s - RowsRead: 128.22M (128222964) - RowsReturned: 126.42M (126422094) - RowsReturnedRate: 156.06 M/sec - ScanRangesComplete: 19 (19) - ScannerThreadsInvoluntaryContextSwitches: 10.19K (10193) - ScannerThreadsTotalWallClockTime: 3m32s - MaterializeTupleTime(*): 18s598ms - ScannerThreadsSysTime: 528.913ms - ScannerThreadsUserTime: 22s907ms - ScannerThreadsVoluntaryContextSwitches: 123.49K (123486) - TotalRawHdfsReadTime(*): 8s561ms - TotalReadThroughput: 51.86 MB/sec Instance 6746754113c855a3:d4ee941f00000002 (host=10.17.193.16:22000):(Total: 20s907ms, non-child: 23.267ms, % non-child: 0.11%) Hdfs split stats (:<# splits>/): 5:1/253.41 MB 7:2/506.81 MB 3:2/506.77 MB 10:1/253.39 MB 2:1/253.39 MB 9:2/506.79 MB 6:3/760.19 MB 1:3/760.21 MB 0:4/1013.61 MB MemoryUsage(500.000ms): 2.46 MB, 543.10 MB, 618.96 MB, 664.08 MB, 702.24 MB, 752.38 MB, 756.35 MB, 740.45 MB, 740.46 MB, 740.53 MB, 724.81 MB, 676.92 MB, 653.03 MB, 645.22 MB, 645.13 MB, 645.30 MB, 637.06 MB, 581.54 MB, 557.73 MB, 549.57 MB, 501.71 MB, 486.23 MB, 470.17 MB, 414.32 MB, 397.84 MB, 476.11 MB, 536.42 MB, 530.69 MB, 559.80 MB, 532.83 MB, 440.09 MB, 432.38 MB, 424.28 MB, 384.60 MB, 376.68 MB, 368.52 MB, 352.68 MB, 328.52 MB, 289.04 MB, 264.93 MB, 225.42 MB, 13.50 MB ThreadUsage(500.000ms): 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 12, 11, 11, 10, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 1 - AverageThreadTokens: 11.21 - BloomFilterBytes: 0 - PeakMemoryUsage: 764.53 MB (801672837) - PerHostPeakMemUsage: 774.84 MB (812476542) - RowsProduced: 4 (4) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 4.024ms - TotalStorageWaitTime: 13s253ms - TotalThreadsInvoluntaryContextSwitches: 10.87K (10866) - TotalThreadsTotalWallClockTime: 3m53s - TotalThreadsSysTime: 695.887ms - TotalThreadsUserTime: 40s218ms - TotalThreadsVoluntaryContextSwitches: 126.64K (126642) Fragment Instance Lifecycle Timings: - ExecTime: 20s606ms - ExecTreeExecTime: 20s589ms - OpenTime: 236.271ms - ExecTreeOpenTime: 66.980us - PrepareTime: 64.660ms - ExecTreePrepareTime: 33.564ms DataStreamSender (dst_id=3):(Total: 299.380us, non-child: 299.380us, % non-child: 100.00%) - BytesSent: 595.00 B (595) - OverallThroughput: 1.90 MB/sec - PeakMemoryUsage: 27.59 KB (28256) - RowsReturned: 4 (4) - SerializeBatchTime: 62.864us - UncompressedRowBatchSize: 595.00 B (595) CodeGen:(Total: 260.347ms, non-child: 260.347ms, % non-child: 100.00%) - CodegenTime: 16.681ms - CompileTime: 61.588ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2068576) - NumFunctions: 139 (139) - NumInstructions: 4.38K (4382) - OptimizationTime: 173.675ms - PeakMemoryUsage: 2.14 MB (2243584) - PrepareTime: 24.504ms AGGREGATION_NODE (id=1):(Total: 20s623ms, non-child: 19s834ms, % non-child: 96.17%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 72.662us - GetResultsTime: 23.902us - HTResizeTime: 1.496ms - HashBuckets: 8.19K (8192) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.44 MB (2557804) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 4 (4) - RowsReturnedRate: 0 - StreamingTime: 19s614ms - UnpinTime: 0.000ns HDFS_SCAN_NODE (id=0):(Total: 788.907ms, non-child: 788.907ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:1/253.41 MB 7:2/506.81 MB 3:2/506.77 MB 10:1/253.39 MB 2:1/253.39 MB 9:2/506.79 MB 6:3/760.19 MB 1:3/760.21 MB 0:4/1013.61 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 19 out of 19 Hdfs Read Thread Concurrency Bucket: 0:78.57% 1:2.381% 2:4.762% 3:9.524% 4:2.381% 5:0% 6:0% 7:0% 8:0% 9:2.381% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:133 BytesRead(500.000ms): 0, 445.43 MB, 530.61 MB, 550.17 MB, 589.09 MB, 686.80 MB, 705.39 MB, 705.39 MB, 705.39 MB, 705.39 MB, 705.39 MB, 705.39 MB, 705.39 MB, 705.39 MB, 705.39 MB, 705.39 MB, 705.39 MB, 705.39 MB, 705.39 MB, 705.39 MB, 705.39 MB, 705.39 MB, 705.39 MB, 705.39 MB, 705.39 MB, 924.86 MB, 1.02 GB, 1.04 GB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB - FooterProcessingTime: (Avg: 215.845ms ; Min: 3.545ms ; Max: 429.593ms ; Number of samples: 19) - AverageHdfsReadThreadConcurrency: 0.71 - AverageScannerThreadConcurrency: 10.21 - BytesRead: 1.09 GB (1171114598) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.09 GB (1171114598) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.09 GB (1171114598) - CachedFileHandlesHitCount: 228 (228) - CachedFileHandlesMissCount: 19 (19) - DecompressionTime: 1s907ms - MaxCompressedTextFileLength: 0 - NumColumns: 7 (7) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 9 (9) - NumRowGroups: 19 (19) - NumScannerThreadsStarted: 12 (12) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 762.86 MB (799915480) - PerReadThreadRawHdfsThroughput: 81.23 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 299.727ms - RowBatchQueuePutWaitTime: 3m - RowsRead: 131.50M (131502362) - RowsReturned: 129.65M (129654681) - RowsReturnedRate: 164.35 M/sec - ScanRangesComplete: 19 (19) - ScannerThreadsInvoluntaryContextSwitches: 8.79K (8790) - ScannerThreadsTotalWallClockTime: 3m32s - MaterializeTupleTime(*): 16s005ms - ScannerThreadsSysTime: 472.921ms - ScannerThreadsUserTime: 19s914ms - ScannerThreadsVoluntaryContextSwitches: 126.60K (126603) - TotalRawHdfsReadTime(*): 13s749ms - TotalReadThroughput: 53.18 MB/sec Instance 6746754113c855a3:d4ee941f0000000b (host=10.17.193.12:22000):(Total: 20s876ms, non-child: 20.861ms, % non-child: 0.10%) Hdfs split stats (:<# splits>/): 2:2/506.78 MB 5:1/253.40 MB 7:1/253.42 MB 9:1/253.40 MB 8:3/760.15 MB 1:5/1.24 GB 4:4/986.05 MB 3:1/253.39 MB 0:1/253.41 MB MemoryUsage(500.000ms): 3.45 MB, 382.38 MB, 641.88 MB, 678.43 MB, 745.97 MB, 807.21 MB, 775.19 MB, 743.56 MB, 735.70 MB, 727.44 MB, 719.65 MB, 711.70 MB, 679.84 MB, 648.28 MB, 640.51 MB, 632.39 MB, 624.57 MB, 616.68 MB, 576.84 MB, 552.92 MB, 528.88 MB, 481.04 MB, 457.40 MB, 449.32 MB, 385.37 MB, 337.79 MB, 475.57 MB, 529.21 MB, 507.34 MB, 506.32 MB, 440.17 MB, 424.20 MB, 424.35 MB, 416.46 MB, 376.79 MB, 368.90 MB, 368.66 MB, 321.01 MB, 304.83 MB, 265.30 MB, 241.28 MB, 174.11 MB ThreadUsage(500.000ms): 1, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 10, 9, 9, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 7 - AverageThreadTokens: 11.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 807.37 MB (846584567) - PerHostPeakMemUsage: 817.67 MB (857388272) - RowsProduced: 4 (4) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 3.901ms - TotalStorageWaitTime: 10s602ms - TotalThreadsInvoluntaryContextSwitches: 12.18K (12180) - TotalThreadsTotalWallClockTime: 3m51s - TotalThreadsSysTime: 788.876ms - TotalThreadsUserTime: 43s002ms - TotalThreadsVoluntaryContextSwitches: 126.03K (126025) Fragment Instance Lifecycle Timings: - ExecTime: 20s575ms - ExecTreeExecTime: 20s560ms - OpenTime: 237.830ms - ExecTreeOpenTime: 64.979us - PrepareTime: 62.896ms - ExecTreePrepareTime: 32.617ms DataStreamSender (dst_id=3):(Total: 88.728us, non-child: 88.728us, % non-child: 100.00%) - BytesSent: 595.00 B (595) - OverallThroughput: 6.40 MB/sec - PeakMemoryUsage: 27.59 KB (28256) - RowsReturned: 4 (4) - SerializeBatchTime: 63.850us - UncompressedRowBatchSize: 595.00 B (595) CodeGen:(Total: 261.734ms, non-child: 261.734ms, % non-child: 100.00%) - CodegenTime: 15.952ms - CompileTime: 62.182ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2068576) - NumFunctions: 139 (139) - NumInstructions: 4.38K (4382) - OptimizationTime: 174.942ms - PeakMemoryUsage: 2.14 MB (2243584) - PrepareTime: 24.030ms AGGREGATION_NODE (id=1):(Total: 20s593ms, non-child: 19s747ms, % non-child: 95.89%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 71.876us - GetResultsTime: 22.221us - HTResizeTime: 1.464ms - HashBuckets: 8.19K (8192) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.44 MB (2557804) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 4 (4) - RowsReturnedRate: 0 - StreamingTime: 19s516ms - UnpinTime: 0.000ns HDFS_SCAN_NODE (id=0):(Total: 845.632ms, non-child: 845.632ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:2/506.78 MB 5:1/253.40 MB 7:1/253.42 MB 9:1/253.40 MB 8:3/760.15 MB 1:5/1.24 GB 4:4/986.05 MB 3:1/253.39 MB 0:1/253.41 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 19 out of 19 Hdfs Read Thread Concurrency Bucket: 0:82.93% 1:4.878% 2:4.878% 3:4.878% 4:0% 5:2.439% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:133 BytesRead(500.000ms): 0, 301.37 MB, 533.62 MB, 578.28 MB, 634.95 MB, 699.00 MB, 699.00 MB, 699.00 MB, 699.00 MB, 699.00 MB, 699.00 MB, 699.00 MB, 699.00 MB, 699.00 MB, 699.00 MB, 699.00 MB, 699.00 MB, 699.00 MB, 699.00 MB, 699.00 MB, 699.00 MB, 699.00 MB, 699.00 MB, 699.00 MB, 699.00 MB, 711.59 MB, 961.24 MB, 1.07 GB, 1.08 GB, 1.08 GB, 1.08 GB, 1.08 GB, 1.08 GB, 1.08 GB, 1.08 GB, 1.08 GB, 1.08 GB, 1.08 GB, 1.08 GB, 1.08 GB, 1.08 GB, 1.08 GB - FooterProcessingTime: (Avg: 222.309ms ; Min: 5.138ms ; Max: 429.182ms ; Number of samples: 19) - AverageHdfsReadThreadConcurrency: 0.41 - AverageScannerThreadConcurrency: 10.24 - BytesRead: 1.08 GB (1164407727) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.08 GB (1164407727) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.08 GB (1164407727) - CachedFileHandlesHitCount: 227 (227) - CachedFileHandlesMissCount: 19 (19) - DecompressionTime: 2s135ms - MaxCompressedTextFileLength: 0 - NumColumns: 7 (7) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 9 (9) - NumRowGroups: 19 (19) - NumScannerThreadsStarted: 12 (12) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 805.69 MB (844827210) - PerReadThreadRawHdfsThroughput: 119.66 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 326.440ms - RowBatchQueuePutWaitTime: 2m58s - RowsRead: 130.75M (130748840) - RowsReturned: 128.91M (128910645) - RowsReturnedRate: 152.44 M/sec - ScanRangesComplete: 19 (19) - ScannerThreadsInvoluntaryContextSwitches: 10.11K (10106) - ScannerThreadsTotalWallClockTime: 3m30s - MaterializeTupleTime(*): 18s523ms - ScannerThreadsSysTime: 533.915ms - ScannerThreadsUserTime: 22s786ms - ScannerThreadsVoluntaryContextSwitches: 125.99K (125988) - TotalRawHdfsReadTime(*): 9s280ms - TotalReadThroughput: 52.88 MB/sec Instance 6746754113c855a3:d4ee941f00000006 (host=10.17.193.25:22000):(Total: 20s832ms, non-child: 22.222ms, % non-child: 0.11%) Hdfs split stats (:<# splits>/): 4:1/253.42 MB 8:2/506.78 MB 6:2/506.78 MB 9:2/506.78 MB 1:3/512.04 MB 3:5/1.24 GB 7:2/506.78 MB 0:3/760.19 MB MemoryUsage(500.000ms): 2.34 MB, 455.87 MB, 690.57 MB, 812.21 MB, 812.05 MB, 796.24 MB, 772.40 MB, 772.24 MB, 732.75 MB, 716.54 MB, 716.70 MB, 700.73 MB, 676.78 MB, 677.03 MB, 637.43 MB, 621.30 MB, 621.39 MB, 605.54 MB, 581.65 MB, 573.57 MB, 509.87 MB, 486.15 MB, 462.34 MB, 414.31 MB, 390.25 MB, 493.57 MB, 521.46 MB, 519.56 MB, 479.82 MB, 464.16 MB, 448.19 MB, 424.12 MB, 424.43 MB, 392.49 MB, 376.60 MB, 368.71 MB, 344.98 MB, 321.07 MB, 281.10 MB, 249.54 MB, 171.98 MB ThreadUsage(500.000ms): 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 12, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 6 - AverageThreadTokens: 11.34 - BloomFilterBytes: 0 - PeakMemoryUsage: 812.36 MB (851825623) - PerHostPeakMemUsage: 822.67 MB (862629328) - RowsProduced: 4 (4) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 3.899ms - TotalStorageWaitTime: 8s135ms - TotalThreadsInvoluntaryContextSwitches: 12.71K (12705) - TotalThreadsTotalWallClockTime: 3m51s - TotalThreadsSysTime: 814.870ms - TotalThreadsUserTime: 44s980ms - TotalThreadsVoluntaryContextSwitches: 126.70K (126700) Fragment Instance Lifecycle Timings: - ExecTime: 20s531ms - ExecTreeExecTime: 20s515ms - OpenTime: 238.172ms - ExecTreeOpenTime: 75.414us - PrepareTime: 62.757ms - ExecTreePrepareTime: 32.160ms DataStreamSender (dst_id=3):(Total: 88.278us, non-child: 88.278us, % non-child: 100.00%) - BytesSent: 595.00 B (595) - OverallThroughput: 6.43 MB/sec - PeakMemoryUsage: 27.59 KB (28256) - RowsReturned: 4 (4) - SerializeBatchTime: 65.108us - UncompressedRowBatchSize: 595.00 B (595) CodeGen:(Total: 262.431ms, non-child: 262.431ms, % non-child: 100.00%) - CodegenTime: 15.981ms - CompileTime: 62.145ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2068576) - NumFunctions: 139 (139) - NumInstructions: 4.38K (4382) - OptimizationTime: 175.276ms - PeakMemoryUsage: 2.14 MB (2243584) - PrepareTime: 24.439ms AGGREGATION_NODE (id=1):(Total: 20s548ms, non-child: 19s773ms, % non-child: 96.23%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 76.664us - GetResultsTime: 26.243us - HTResizeTime: 847.788us - HashBuckets: 8.19K (8192) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.44 MB (2557804) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 4 (4) - RowsReturnedRate: 0 - StreamingTime: 19s545ms - UnpinTime: 0.000ns HDFS_SCAN_NODE (id=0):(Total: 774.549ms, non-child: 774.549ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:1/253.42 MB 8:2/506.78 MB 6:2/506.78 MB 9:2/506.78 MB 1:3/512.04 MB 3:5/1.24 GB 7:2/506.78 MB 0:3/760.19 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 20 out of 20 Hdfs Read Thread Concurrency Bucket: 0:85.37% 1:7.317% 2:2.439% 3:0% 4:2.439% 5:0% 6:0% 7:0% 8:2.439% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:140 BytesRead(500.000ms): 0, 356.90 MB, 579.43 MB, 702.80 MB, 705.39 MB, 705.39 MB, 705.39 MB, 705.39 MB, 705.39 MB, 705.39 MB, 705.39 MB, 705.39 MB, 705.39 MB, 705.39 MB, 705.39 MB, 705.39 MB, 705.39 MB, 705.39 MB, 705.39 MB, 705.39 MB, 705.39 MB, 705.39 MB, 705.39 MB, 705.39 MB, 705.39 MB, 881.73 MB, 972.71 MB, 1.03 GB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB - FooterProcessingTime: (Avg: 156.782ms ; Min: 4.370ms ; Max: 343.975ms ; Number of samples: 20) - AverageHdfsReadThreadConcurrency: 0.41 - AverageScannerThreadConcurrency: 10.34 - BytesRead: 1.09 GB (1172468261) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.09 GB (1172468261) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.09 GB (1172468261) - CachedFileHandlesHitCount: 235 (235) - CachedFileHandlesMissCount: 20 (20) - DecompressionTime: 2s290ms - MaxCompressedTextFileLength: 0 - NumColumns: 7 (7) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 8 (8) - NumRowGroups: 20 (20) - NumScannerThreadsStarted: 12 (12) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 810.69 MB (850068266) - PerReadThreadRawHdfsThroughput: 143.30 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 248.169ms - RowBatchQueuePutWaitTime: 2m58s - RowsRead: 131.63M (131633679) - RowsReturned: 129.78M (129779873) - RowsReturnedRate: 167.56 M/sec - ScanRangesComplete: 20 (20) - ScannerThreadsInvoluntaryContextSwitches: 10.62K (10623) - ScannerThreadsTotalWallClockTime: 3m30s - MaterializeTupleTime(*): 20s086ms - ScannerThreadsSysTime: 541.911ms - ScannerThreadsUserTime: 24s746ms - ScannerThreadsVoluntaryContextSwitches: 126.66K (126662) - TotalRawHdfsReadTime(*): 7s802ms - TotalReadThroughput: 54.54 MB/sec Instance 6746754113c855a3:d4ee941f00000007 (host=10.17.193.19:22000):(Total: 20s765ms, non-child: 22.166ms, % non-child: 0.11%) Hdfs split stats (:<# splits>/): 8:1/253.40 MB 0:1/253.39 MB 7:1/253.40 MB 3:1/7.47 MB 9:2/506.76 MB 10:3/760.18 MB 6:2/506.78 MB 2:3/760.19 MB 4:2/445.03 MB 5:2/506.80 MB 1:2/506.81 MB MemoryUsage(500.000ms): 3.45 MB, 550.23 MB, 645.84 MB, 711.64 MB, 797.97 MB, 798.05 MB, 790.18 MB, 734.41 MB, 726.53 MB, 718.67 MB, 702.46 MB, 702.54 MB, 663.19 MB, 639.25 MB, 631.20 MB, 623.44 MB, 607.46 MB, 607.62 MB, 551.76 MB, 543.68 MB, 535.68 MB, 463.96 MB, 448.26 MB, 424.85 MB, 414.18 MB, 397.68 MB, 378.61 MB, 446.55 MB, 498.47 MB, 455.98 MB, 448.19 MB, 424.20 MB, 416.39 MB, 400.68 MB, 369.01 MB, 361.17 MB, 344.93 MB, 329.07 MB, 281.04 MB, 248.99 MB, 206.58 MB, 14.31 MB ThreadUsage(500.000ms): 1, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 12, 9, 9, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 7, 1 - AverageThreadTokens: 10.76 - BloomFilterBytes: 0 - PeakMemoryUsage: 798.37 MB (837147095) - PerHostPeakMemUsage: 808.67 MB (847950800) - RowsProduced: 4 (4) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 4.169ms - TotalStorageWaitTime: 10s554ms - TotalThreadsInvoluntaryContextSwitches: 12.44K (12437) - TotalThreadsTotalWallClockTime: 3m47s - TotalThreadsSysTime: 826.867ms - TotalThreadsUserTime: 43s883ms - TotalThreadsVoluntaryContextSwitches: 125.42K (125416) Fragment Instance Lifecycle Timings: - ExecTime: 20s462ms - ExecTreeExecTime: 20s446ms - OpenTime: 237.594ms - ExecTreeOpenTime: 70.001us - PrepareTime: 65.279ms - ExecTreePrepareTime: 35.216ms DataStreamSender (dst_id=3):(Total: 66.406us, non-child: 66.406us, % non-child: 100.00%) - BytesSent: 595.00 B (595) - OverallThroughput: 8.54 MB/sec - PeakMemoryUsage: 27.59 KB (28256) - RowsReturned: 4 (4) - SerializeBatchTime: 41.868us - UncompressedRowBatchSize: 595.00 B (595) CodeGen:(Total: 261.336ms, non-child: 261.336ms, % non-child: 100.00%) - CodegenTime: 15.763ms - CompileTime: 61.334ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2068576) - NumFunctions: 139 (139) - NumInstructions: 4.38K (4382) - OptimizationTime: 175.528ms - PeakMemoryUsage: 2.14 MB (2243584) - PrepareTime: 23.900ms AGGREGATION_NODE (id=1):(Total: 20s481ms, non-child: 19s650ms, % non-child: 95.94%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 78.292us - GetResultsTime: 31.261us - HTResizeTime: 1.620ms - HashBuckets: 8.19K (8192) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.44 MB (2557804) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 4 (4) - RowsReturnedRate: 0 - StreamingTime: 19s420ms - UnpinTime: 0.000ns HDFS_SCAN_NODE (id=0):(Total: 831.069ms, non-child: 831.069ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 8:1/253.40 MB 0:1/253.39 MB 7:1/253.40 MB 3:1/7.47 MB 9:2/506.76 MB 10:3/760.18 MB 6:2/506.78 MB 2:3/760.19 MB 4:2/445.03 MB 5:2/506.80 MB 1:2/506.81 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 20 out of 20 Hdfs Read Thread Concurrency Bucket: 0:85.37% 1:2.439% 2:7.317% 3:2.439% 4:2.439% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:140 BytesRead(500.000ms): 0, 453.11 MB, 553.56 MB, 601.90 MB, 692.88 MB, 692.88 MB, 692.88 MB, 692.88 MB, 692.88 MB, 692.88 MB, 692.88 MB, 692.88 MB, 692.88 MB, 692.88 MB, 692.88 MB, 692.88 MB, 692.88 MB, 692.88 MB, 692.88 MB, 692.88 MB, 692.88 MB, 692.88 MB, 692.88 MB, 705.47 MB, 751.66 MB, 751.66 MB, 901.96 MB, 1.01 GB, 1.08 GB, 1.08 GB, 1.08 GB, 1.08 GB, 1.08 GB, 1.08 GB, 1.08 GB, 1.08 GB, 1.08 GB, 1.08 GB, 1.08 GB, 1.08 GB, 1.08 GB, 1.08 GB - FooterProcessingTime: (Avg: 203.668ms ; Min: 4.732ms ; Max: 429.288ms ; Number of samples: 20) - AverageHdfsReadThreadConcurrency: 0.34 - AverageScannerThreadConcurrency: 10.00 - BytesRead: 1.08 GB (1157998147) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.08 GB (1157998147) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.08 GB (1157998147) - CachedFileHandlesHitCount: 233 (233) - CachedFileHandlesMissCount: 20 (20) - DecompressionTime: 2s262ms - MaxCompressedTextFileLength: 0 - NumColumns: 7 (7) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 11 (11) - NumRowGroups: 20 (20) - NumScannerThreadsStarted: 12 (12) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 796.69 MB (835389738) - PerReadThreadRawHdfsThroughput: 99.29 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 286.375ms - RowBatchQueuePutWaitTime: 2m53s - RowsRead: 130.00M (130003664) - RowsReturned: 128.17M (128173546) - RowsReturnedRate: 154.23 M/sec - ScanRangesComplete: 20 (20) - ScannerThreadsInvoluntaryContextSwitches: 9.61K (9614) - ScannerThreadsTotalWallClockTime: 3m27s - MaterializeTupleTime(*): 19s296ms - ScannerThreadsSysTime: 533.912ms - ScannerThreadsUserTime: 23s792ms - ScannerThreadsVoluntaryContextSwitches: 125.38K (125377) - TotalRawHdfsReadTime(*): 11s122ms - TotalReadThroughput: 52.59 MB/sec Instance 6746754113c855a3:d4ee941f0000000c (host=10.17.193.24:22000):(Total: 20s509ms, non-child: 21.846ms, % non-child: 0.11%) Hdfs split stats (:<# splits>/): 10:1/253.39 MB 7:2/487.75 MB 3:1/253.39 MB 5:1/253.39 MB 8:3/760.21 MB 9:1/253.38 MB 4:6/1.48 GB 1:4/1013.56 MB MemoryUsage(500.000ms): 2.34 MB, 346.89 MB, 560.70 MB, 673.24 MB, 724.05 MB, 784.20 MB, 776.11 MB, 752.59 MB, 728.59 MB, 720.78 MB, 688.81 MB, 681.05 MB, 672.67 MB, 657.27 MB, 633.28 MB, 617.28 MB, 593.65 MB, 585.57 MB, 553.54 MB, 529.52 MB, 505.90 MB, 465.95 MB, 418.25 MB, 489.51 MB, 460.26 MB, 431.22 MB, 474.20 MB, 449.29 MB, 464.08 MB, 456.06 MB, 432.21 MB, 408.57 MB, 400.41 MB, 384.49 MB, 352.68 MB, 352.52 MB, 320.73 MB, 296.74 MB, 264.98 MB, 171.82 MB, 41.47 MB ThreadUsage(500.000ms): 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 9, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 6, 2 - AverageThreadTokens: 11.12 - BloomFilterBytes: 0 - PeakMemoryUsage: 784.45 MB (822555375) - PerHostPeakMemUsage: 794.75 MB (833359080) - RowsProduced: 4 (4) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 3.863ms - TotalStorageWaitTime: 15s215ms - TotalThreadsInvoluntaryContextSwitches: 9.88K (9878) - TotalThreadsTotalWallClockTime: 3m46s - TotalThreadsSysTime: 581.904ms - TotalThreadsUserTime: 38s381ms - TotalThreadsVoluntaryContextSwitches: 126.15K (126146) Fragment Instance Lifecycle Timings: - ExecTime: 20s210ms - ExecTreeExecTime: 20s195ms - OpenTime: 237.145ms - ExecTreeOpenTime: 74.313us - PrepareTime: 60.941ms - ExecTreePrepareTime: 30.233ms DataStreamSender (dst_id=3):(Total: 80.891us, non-child: 80.891us, % non-child: 100.00%) - BytesSent: 595.00 B (595) - OverallThroughput: 7.01 MB/sec - PeakMemoryUsage: 27.59 KB (28256) - RowsReturned: 4 (4) - SerializeBatchTime: 65.634us - UncompressedRowBatchSize: 595.00 B (595) CodeGen:(Total: 261.222ms, non-child: 261.222ms, % non-child: 100.00%) - CodegenTime: 16.130ms - CompileTime: 62.152ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2068576) - NumFunctions: 139 (139) - NumInstructions: 4.38K (4382) - OptimizationTime: 174.220ms - PeakMemoryUsage: 2.14 MB (2243584) - PrepareTime: 24.273ms AGGREGATION_NODE (id=1):(Total: 20s225ms, non-child: 19s390ms, % non-child: 95.87%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 79.228us - GetResultsTime: 25.858us - HTResizeTime: 2.079ms - HashBuckets: 8.19K (8192) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.44 MB (2557804) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 4 (4) - RowsReturnedRate: 0 - StreamingTime: 19s173ms - UnpinTime: 0.000ns HDFS_SCAN_NODE (id=0):(Total: 835.571ms, non-child: 835.571ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 10:1/253.39 MB 7:2/487.75 MB 3:1/253.39 MB 5:1/253.39 MB 8:3/760.21 MB 9:1/253.38 MB 4:6/1.48 GB 1:4/1013.56 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 19 out of 19 Hdfs Read Thread Concurrency Bucket: 0:78.05% 1:4.878% 2:9.756% 3:0% 4:2.439% 5:2.439% 6:0% 7:0% 8:2.439% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:133 BytesRead(500.000ms): 0, 265.22 MB, 458.26 MB, 563.49 MB, 629.22 MB, 700.97 MB, 700.97 MB, 700.97 MB, 700.97 MB, 700.97 MB, 700.97 MB, 700.97 MB, 700.97 MB, 700.97 MB, 700.97 MB, 700.97 MB, 700.97 MB, 700.97 MB, 700.97 MB, 700.97 MB, 700.97 MB, 700.97 MB, 700.97 MB, 818.54 MB, 836.10 MB, 860.76 MB, 939.22 MB, 1.04 GB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB - FooterProcessingTime: (Avg: 298.074ms ; Min: 6.123ms ; Max: 625.178ms ; Number of samples: 19) - AverageHdfsReadThreadConcurrency: 0.66 - AverageScannerThreadConcurrency: 10.12 - BytesRead: 1.09 GB (1166485155) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.09 GB (1166485155) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.09 GB (1166485155) - CachedFileHandlesHitCount: 227 (227) - CachedFileHandlesMissCount: 19 (19) - DecompressionTime: 1s825ms - MaxCompressedTextFileLength: 0 - NumColumns: 7 (7) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 8 (8) - NumRowGroups: 19 (19) - NumScannerThreadsStarted: 12 (12) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 782.77 MB (820798018) - PerReadThreadRawHdfsThroughput: 82.96 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 394.749ms - RowBatchQueuePutWaitTime: 2m52s - RowsRead: 130.98M (130981145) - RowsReturned: 129.14M (129141301) - RowsReturnedRate: 154.55 M/sec - ScanRangesComplete: 19 (19) - ScannerThreadsInvoluntaryContextSwitches: 7.85K (7846) - ScannerThreadsTotalWallClockTime: 3m25s - MaterializeTupleTime(*): 15s043ms - ScannerThreadsSysTime: 351.939ms - ScannerThreadsUserTime: 18s573ms - ScannerThreadsVoluntaryContextSwitches: 126.11K (126110) - TotalRawHdfsReadTime(*): 13s409ms - TotalReadThroughput: 54.27 MB/sec Instance 6746754113c855a3:d4ee941f00000008 (host=10.17.193.10:22000):(Total: 20s478ms, non-child: 21.429ms, % non-child: 0.10%) Hdfs split stats (:<# splits>/): 9:1/253.38 MB 2:2/506.76 MB 5:2/506.79 MB 6:2/506.82 MB 1:3/760.20 MB 8:2/506.79 MB 7:2/506.81 MB 0:2/506.79 MB 4:2/506.83 MB 3:1/253.39 MB MemoryUsage(500.000ms): 4.00 KB, 2.59 MB, 503.07 MB, 610.22 MB, 705.72 MB, 743.03 MB, 772.40 MB, 756.59 MB, 748.56 MB, 740.62 MB, 732.44 MB, 692.79 MB, 676.95 MB, 661.49 MB, 653.44 MB, 645.52 MB, 637.51 MB, 589.41 MB, 581.57 MB, 573.65 MB, 517.81 MB, 501.98 MB, 486.20 MB, 430.42 MB, 405.99 MB, 536.11 MB, 538.80 MB, 629.00 MB, 594.30 MB, 532.86 MB, 448.11 MB, 440.01 MB, 424.28 MB, 408.28 MB, 384.46 MB, 368.42 MB, 368.41 MB, 328.63 MB, 280.96 MB, 265.09 MB, 217.13 MB ThreadUsage(500.000ms): 1, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 12, 10, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8 - AverageThreadTokens: 11.27 - BloomFilterBytes: 0 - PeakMemoryUsage: 776.48 MB (814199086) - PerHostPeakMemUsage: 786.79 MB (825011284) - RowsProduced: 4 (4) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 3.395ms - TotalStorageWaitTime: 12s174ms - TotalThreadsInvoluntaryContextSwitches: 9.76K (9755) - TotalThreadsTotalWallClockTime: 3m50s - TotalThreadsSysTime: 672.893ms - TotalThreadsUserTime: 41s522ms - TotalThreadsVoluntaryContextSwitches: 126.41K (126406) Fragment Instance Lifecycle Timings: - ExecTime: 20s177ms - ExecTreeExecTime: 20s162ms - OpenTime: 241.992ms - ExecTreeOpenTime: 82.619us - PrepareTime: 59.026ms - ExecTreePrepareTime: 28.142ms DataStreamSender (dst_id=3):(Total: 62.591us, non-child: 62.591us, % non-child: 100.00%) - BytesSent: 595.00 B (595) - OverallThroughput: 9.07 MB/sec - PeakMemoryUsage: 27.59 KB (28256) - RowsReturned: 4 (4) - SerializeBatchTime: 46.684us - UncompressedRowBatchSize: 595.00 B (595) CodeGen:(Total: 266.262ms, non-child: 266.262ms, % non-child: 100.00%) - CodegenTime: 16.666ms - CompileTime: 62.882ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2068576) - NumFunctions: 139 (139) - NumInstructions: 4.38K (4382) - OptimizationTime: 177.911ms - PeakMemoryUsage: 2.14 MB (2243584) - PrepareTime: 24.903ms AGGREGATION_NODE (id=1):(Total: 20s190ms, non-child: 19s373ms, % non-child: 95.95%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 346.484us - GetResultsTime: 26.624us - HTResizeTime: 2.004ms - HashBuckets: 8.19K (8192) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.44 MB (2557804) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 4 (4) - RowsReturnedRate: 0 - StreamingTime: 19s130ms - UnpinTime: 0.000ns HDFS_SCAN_NODE (id=0):(Total: 817.392ms, non-child: 817.392ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 9:1/253.38 MB 2:2/506.76 MB 5:2/506.79 MB 6:2/506.82 MB 1:3/760.20 MB 8:2/506.79 MB 7:2/506.81 MB 0:2/506.79 MB 4:2/506.83 MB 3:1/253.39 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 19 out of 19 Hdfs Read Thread Concurrency Bucket: 0:80% 1:7.5% 2:2.5% 3:2.5% 4:2.5% 5:0% 6:2.5% 7:0% 8:0% 9:0% 10:2.5% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:133 BytesRead(500.000ms): 0, 0, 392.26 MB, 507.77 MB, 598.43 MB, 653.58 MB, 705.39 MB, 705.39 MB, 705.39 MB, 705.39 MB, 705.39 MB, 705.39 MB, 705.39 MB, 705.39 MB, 705.39 MB, 705.39 MB, 705.39 MB, 705.39 MB, 705.39 MB, 705.39 MB, 705.39 MB, 705.39 MB, 705.39 MB, 705.39 MB, 705.39 MB, 953.11 MB, 999.30 MB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB - FooterProcessingTime: (Avg: 213.234ms ; Min: 4.403ms ; Max: 404.045ms ; Number of samples: 19) - AverageHdfsReadThreadConcurrency: 0.70 - AverageScannerThreadConcurrency: 10.53 - BytesRead: 1.09 GB (1171111928) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.09 GB (1171111928) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.09 GB (1171111928) - CachedFileHandlesHitCount: 228 (228) - CachedFileHandlesMissCount: 19 (19) - DecompressionTime: 2s122ms - MaxCompressedTextFileLength: 0 - NumColumns: 7 (7) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 10 (10) - NumRowGroups: 19 (19) - NumScannerThreadsStarted: 12 (12) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 774.80 MB (812441729) - PerReadThreadRawHdfsThroughput: 84.45 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 319.326ms - RowBatchQueuePutWaitTime: 2m57s - RowsRead: 131.50M (131502268) - RowsReturned: 129.65M (129654003) - RowsReturnedRate: 158.62 M/sec - ScanRangesComplete: 19 (19) - ScannerThreadsInvoluntaryContextSwitches: 7.69K (7690) - ScannerThreadsTotalWallClockTime: 3m30s - MaterializeTupleTime(*): 17s767ms - ScannerThreadsSysTime: 406.933ms - ScannerThreadsUserTime: 21s703ms - ScannerThreadsVoluntaryContextSwitches: 126.37K (126368) - TotalRawHdfsReadTime(*): 13s225ms - TotalReadThroughput: 54.48 MB/sec Instance 6746754113c855a3:d4ee941f00000003 (host=10.17.193.11:22000):(Total: 20s277ms, non-child: 26.746ms, % non-child: 0.13%) Hdfs split stats (:<# splits>/): 7:1/253.41 MB 9:1/253.39 MB 8:2/506.77 MB 5:2/506.79 MB 1:3/760.18 MB 4:3/760.17 MB 2:4/1013.60 MB 3:2/506.81 MB MemoryUsage(500.000ms): 2.34 MB, 622.03 MB, 680.73 MB, 812.13 MB, 811.97 MB, 811.89 MB, 756.43 MB, 740.54 MB, 740.46 MB, 716.77 MB, 716.62 MB, 717.02 MB, 661.10 MB, 644.87 MB, 644.87 MB, 621.14 MB, 621.45 MB, 613.06 MB, 565.09 MB, 549.17 MB, 533.31 MB, 469.71 MB, 453.84 MB, 430.12 MB, 374.01 MB, 397.83 MB, 303.37 MB, 467.21 MB, 413.70 MB, 397.73 MB, 365.71 MB, 365.79 MB, 349.98 MB, 318.01 MB, 318.09 MB, 310.00 MB, 270.23 MB, 230.53 MB, 214.68 MB, 156.77 MB ThreadUsage(500.000ms): 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 10, 9, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 6 - AverageThreadTokens: 11.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 812.29 MB (851745567) - PerHostPeakMemUsage: 822.59 MB (862549272) - RowsProduced: 4 (4) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 5.155ms - TotalStorageWaitTime: 8s421ms - TotalThreadsInvoluntaryContextSwitches: 11.44K (11435) - TotalThreadsTotalWallClockTime: 3m39s - TotalThreadsSysTime: 935.851ms - TotalThreadsUserTime: 44s639ms - TotalThreadsVoluntaryContextSwitches: 119.75K (119751) Fragment Instance Lifecycle Timings: - ExecTime: 19s974ms - ExecTreeExecTime: 19s954ms - OpenTime: 236.960ms - ExecTreeOpenTime: 72.954us - PrepareTime: 66.002ms - ExecTreePrepareTime: 35.655ms DataStreamSender (dst_id=3):(Total: 79.850us, non-child: 79.850us, % non-child: 100.00%) - BytesSent: 595.00 B (595) - OverallThroughput: 7.11 MB/sec - PeakMemoryUsage: 27.59 KB (28256) - RowsReturned: 4 (4) - SerializeBatchTime: 55.193us - UncompressedRowBatchSize: 595.00 B (595) CodeGen:(Total: 260.696ms, non-child: 260.696ms, % non-child: 100.00%) - CodegenTime: 16.174ms - CompileTime: 61.912ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2068576) - NumFunctions: 139 (139) - NumInstructions: 4.38K (4382) - OptimizationTime: 174.315ms - PeakMemoryUsage: 2.14 MB (2243584) - PrepareTime: 23.889ms AGGREGATION_NODE (id=1):(Total: 19s989ms, non-child: 19s164ms, % non-child: 95.87%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 76.416us - GetResultsTime: 26.101us - HTResizeTime: 5.818ms - HashBuckets: 8.19K (8192) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.44 MB (2557804) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 4 (4) - RowsReturnedRate: 0 - StreamingTime: 18s920ms - UnpinTime: 0.000ns HDFS_SCAN_NODE (id=0):(Total: 825.697ms, non-child: 825.697ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:1/253.41 MB 9:1/253.39 MB 8:2/506.77 MB 5:2/506.79 MB 1:3/760.18 MB 4:3/760.17 MB 2:4/1013.60 MB 3:2/506.81 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 18 out of 18 Hdfs Read Thread Concurrency Bucket: 0:90% 1:0% 2:5% 3:2.5% 4:0% 5:0% 6:0% 7:0% 8:2.5% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:126 BytesRead(500.000ms): 0, 522.58 MB, 576.30 MB, 705.37 MB, 705.37 MB, 705.37 MB, 705.37 MB, 705.37 MB, 705.37 MB, 705.37 MB, 705.37 MB, 705.37 MB, 705.37 MB, 705.37 MB, 705.37 MB, 705.37 MB, 705.37 MB, 705.37 MB, 705.37 MB, 705.37 MB, 705.37 MB, 705.37 MB, 705.37 MB, 705.37 MB, 705.37 MB, 764.16 MB, 866.26 MB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB - FooterProcessingTime: (Avg: 163.816ms ; Min: 5.509ms ; Max: 304.126ms ; Number of samples: 18) - AverageHdfsReadThreadConcurrency: 0.38 - AverageScannerThreadConcurrency: 10.00 - BytesRead: 1.03 GB (1109466574) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.03 GB (1109466574) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.03 GB (1109466574) - CachedFileHandlesHitCount: 216 (216) - CachedFileHandlesMissCount: 18 (18) - DecompressionTime: 2s301ms - MaxCompressedTextFileLength: 0 - NumColumns: 7 (7) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 8 (8) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 12 (12) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 810.61 MB (849988210) - PerReadThreadRawHdfsThroughput: 152.26 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 262.776ms - RowBatchQueuePutWaitTime: 2m47s - RowsRead: 124.58M (124580562) - RowsReturned: 122.83M (122831031) - RowsReturnedRate: 148.76 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 9.43K (9428) - ScannerThreadsTotalWallClockTime: 3m19s - MaterializeTupleTime(*): 20s338ms - ScannerThreadsSysTime: 641.895ms - ScannerThreadsUserTime: 25s011ms - ScannerThreadsVoluntaryContextSwitches: 119.71K (119708) - TotalRawHdfsReadTime(*): 6s949ms - TotalReadThroughput: 52.90 MB/sec Instance 6746754113c855a3:d4ee941f00000001 (host=10.17.193.23:22000):(Total: 19s668ms, non-child: 22.248ms, % non-child: 0.11%) Hdfs split stats (:<# splits>/): 5:1/253.40 MB 0:1/253.40 MB 9:2/506.78 MB 7:1/253.38 MB 8:2/506.80 MB 6:3/760.18 MB 2:2/506.76 MB 1:4/767.55 MB 3:3/760.16 MB MemoryUsage(500.000ms): 3.45 MB, 49.78 MB, 768.04 MB, 811.89 MB, 812.37 MB, 812.05 MB, 812.05 MB, 740.62 MB, 716.78 MB, 716.78 MB, 716.54 MB, 716.62 MB, 716.70 MB, 637.11 MB, 621.64 MB, 621.17 MB, 621.25 MB, 621.25 MB, 621.01 MB, 549.36 MB, 525.51 MB, 493.68 MB, 437.89 MB, 430.11 MB, 430.42 MB, 358.06 MB, 310.03 MB, 368.53 MB, 413.24 MB, 413.39 MB, 373.73 MB, 365.79 MB, 365.79 MB, 318.23 MB, 318.30 MB, 302.23 MB, 270.06 MB, 230.54 MB, 206.74 MB, 68.08 MB ThreadUsage(500.000ms): 1, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 3 - AverageThreadTokens: 10.65 - BloomFilterBytes: 0 - PeakMemoryUsage: 812.37 MB (851827526) - PerHostPeakMemUsage: 822.67 MB (862631231) - RowsProduced: 4 (4) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 4.228ms - TotalStorageWaitTime: 6s213ms - TotalThreadsInvoluntaryContextSwitches: 10.66K (10661) - TotalThreadsTotalWallClockTime: 3m33s - TotalThreadsSysTime: 711.885ms - TotalThreadsUserTime: 38s596ms - TotalThreadsVoluntaryContextSwitches: 120.32K (120323) Fragment Instance Lifecycle Timings: - ExecTime: 19s367ms - ExecTreeExecTime: 19s351ms - OpenTime: 237.766ms - ExecTreeOpenTime: 66.665us - PrepareTime: 63.378ms - ExecTreePrepareTime: 33.164ms DataStreamSender (dst_id=3):(Total: 83.508us, non-child: 83.508us, % non-child: 100.00%) - BytesSent: 595.00 B (595) - OverallThroughput: 6.79 MB/sec - PeakMemoryUsage: 27.59 KB (28256) - RowsReturned: 4 (4) - SerializeBatchTime: 53.841us - UncompressedRowBatchSize: 595.00 B (595) CodeGen:(Total: 261.663ms, non-child: 261.663ms, % non-child: 100.00%) - CodegenTime: 15.888ms - CompileTime: 62.281ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2068576) - NumFunctions: 139 (139) - NumInstructions: 4.38K (4382) - OptimizationTime: 174.764ms - PeakMemoryUsage: 2.14 MB (2243584) - PrepareTime: 23.987ms AGGREGATION_NODE (id=1):(Total: 19s384ms, non-child: 18s597ms, % non-child: 95.94%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 70.778us - GetResultsTime: 24.028us - HTResizeTime: 4.806ms - HashBuckets: 8.19K (8192) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.44 MB (2557804) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 4 (4) - RowsReturnedRate: 0 - StreamingTime: 18s367ms - UnpinTime: 0.000ns HDFS_SCAN_NODE (id=0):(Total: 786.591ms, non-child: 786.591ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:1/253.40 MB 0:1/253.40 MB 9:2/506.78 MB 7:1/253.38 MB 8:2/506.80 MB 6:3/760.18 MB 2:2/506.76 MB 1:4/767.55 MB 3:3/760.16 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 19 out of 19 Hdfs Read Thread Concurrency Bucket: 0:89.74% 1:0% 2:7.692% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:2.564% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:133 BytesRead(500.000ms): 0, 800.00 KB, 649.61 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 722.94 MB, 1008.05 MB, 1.04 GB, 1.04 GB, 1.04 GB, 1.04 GB, 1.04 GB, 1.04 GB, 1.04 GB, 1.04 GB, 1.04 GB, 1.04 GB, 1.04 GB, 1.04 GB - FooterProcessingTime: (Avg: 190.872ms ; Min: 3.723ms ; Max: 361.186ms ; Number of samples: 19) - AverageHdfsReadThreadConcurrency: 0.38 - AverageScannerThreadConcurrency: 9.90 - BytesRead: 1.04 GB (1111338292) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.04 GB (1111338292) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.04 GB (1111338292) - CachedFileHandlesHitCount: 223 (223) - CachedFileHandlesMissCount: 19 (19) - DecompressionTime: 1s874ms - MaxCompressedTextFileLength: 0 - NumColumns: 7 (7) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 9 (9) - NumRowGroups: 19 (19) - NumScannerThreadsStarted: 12 (12) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 810.69 MB (850070169) - PerReadThreadRawHdfsThroughput: 176.16 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 317.300ms - RowBatchQueuePutWaitTime: 2m49s - RowsRead: 124.77M (124770055) - RowsReturned: 123.01M (123014381) - RowsReturnedRate: 156.39 M/sec - ScanRangesComplete: 19 (19) - ScannerThreadsInvoluntaryContextSwitches: 8.70K (8697) - ScannerThreadsTotalWallClockTime: 3m13s - MaterializeTupleTime(*): 15s817ms - ScannerThreadsSysTime: 468.922ms - ScannerThreadsUserTime: 19s571ms - ScannerThreadsVoluntaryContextSwitches: 120.27K (120274) - TotalRawHdfsReadTime(*): 6s016ms - TotalReadThroughput: 52.99 MB/sec Instance 6746754113c855a3:d4ee941f0000000e (host=10.17.193.18:22000):(Total: 19s372ms, non-child: 23.885ms, % non-child: 0.12%) Hdfs split stats (:<# splits>/): 0:1/253.41 MB 8:2/506.77 MB 6:1/253.41 MB 9:2/506.78 MB 7:1/253.41 MB 5:5/1.24 GB 3:3/760.18 MB 2:2/506.80 MB 1:1/253.41 MB MemoryUsage(500.000ms): 2.46 MB, 518.82 MB, 714.80 MB, 812.05 MB, 812.29 MB, 796.32 MB, 764.30 MB, 740.54 MB, 716.55 MB, 716.55 MB, 716.54 MB, 684.84 MB, 669.21 MB, 645.28 MB, 621.28 MB, 621.44 MB, 621.28 MB, 589.36 MB, 557.44 MB, 541.50 MB, 493.76 MB, 453.92 MB, 430.07 MB, 398.09 MB, 397.62 MB, 483.55 MB, 492.97 MB, 413.62 MB, 397.73 MB, 365.87 MB, 365.79 MB, 349.90 MB, 318.01 MB, 318.01 MB, 294.01 MB, 262.23 MB, 222.38 MB, 190.35 MB ThreadUsage(500.000ms): 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 10, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7 - AverageThreadTokens: 11.18 - BloomFilterBytes: 0 - PeakMemoryUsage: 812.45 MB (851910422) - PerHostPeakMemUsage: 822.75 MB (862714127) - RowsProduced: 4 (4) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 4.293ms - TotalStorageWaitTime: 8s048ms - TotalThreadsInvoluntaryContextSwitches: 9.98K (9980) - TotalThreadsTotalWallClockTime: 3m31s - TotalThreadsSysTime: 626.899ms - TotalThreadsUserTime: 38s662ms - TotalThreadsVoluntaryContextSwitches: 119.97K (119974) Fragment Instance Lifecycle Timings: - ExecTime: 19s066ms - ExecTreeExecTime: 19s048ms - OpenTime: 236.016ms - ExecTreeOpenTime: 67.767us - PrepareTime: 69.964ms - ExecTreePrepareTime: 39.566ms DataStreamSender (dst_id=3):(Total: 119.702us, non-child: 119.702us, % non-child: 100.00%) - BytesSent: 595.00 B (595) - OverallThroughput: 4.74 MB/sec - PeakMemoryUsage: 27.59 KB (28256) - RowsReturned: 4 (4) - SerializeBatchTime: 89.933us - UncompressedRowBatchSize: 595.00 B (595) CodeGen:(Total: 259.718ms, non-child: 259.718ms, % non-child: 100.00%) - CodegenTime: 16.046ms - CompileTime: 61.384ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2068576) - NumFunctions: 139 (139) - NumInstructions: 4.38K (4382) - OptimizationTime: 173.935ms - PeakMemoryUsage: 2.14 MB (2243584) - PrepareTime: 23.832ms AGGREGATION_NODE (id=1):(Total: 19s088ms, non-child: 18s290ms, % non-child: 95.82%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 59.440us - GetResultsTime: 24.491us - HTResizeTime: 449.604us - HashBuckets: 8.19K (8192) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.44 MB (2557804) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 4 (4) - RowsReturnedRate: 0 - StreamingTime: 18s094ms - UnpinTime: 0.000ns HDFS_SCAN_NODE (id=0):(Total: 797.561ms, non-child: 797.561ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/253.41 MB 8:2/506.77 MB 6:1/253.41 MB 9:2/506.78 MB 7:1/253.41 MB 5:5/1.24 GB 3:3/760.18 MB 2:2/506.80 MB 1:1/253.41 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 18 out of 18 Hdfs Read Thread Concurrency Bucket: 0:89.47% 1:0% 2:2.632% 3:2.632% 4:0% 5:2.632% 6:0% 7:0% 8:0% 9:2.632% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:126 BytesRead(500.000ms): 0, 423.86 MB, 597.82 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 764.16 MB, 931.48 MB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB - FooterProcessingTime: (Avg: 196.251ms ; Min: 4.099ms ; Max: 361.112ms ; Number of samples: 18) - AverageHdfsReadThreadConcurrency: 0.50 - AverageScannerThreadConcurrency: 10.18 - BytesRead: 1.03 GB (1109460615) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.03 GB (1109460615) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.03 GB (1109460615) - CachedFileHandlesHitCount: 216 (216) - CachedFileHandlesMissCount: 18 (18) - DecompressionTime: 1s932ms - MaxCompressedTextFileLength: 0 - NumColumns: 7 (7) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 9 (9) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 12 (12) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 810.77 MB (850153065) - PerReadThreadRawHdfsThroughput: 121.14 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 305.572ms - RowBatchQueuePutWaitTime: 2m45s - RowsRead: 124.58M (124581269) - RowsReturned: 122.83M (122825043) - RowsReturnedRate: 154.00 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 8.06K (8062) - ScannerThreadsTotalWallClockTime: 3m12s - MaterializeTupleTime(*): 16s293ms - ScannerThreadsSysTime: 388.935ms - ScannerThreadsUserTime: 19s919ms - ScannerThreadsVoluntaryContextSwitches: 119.94K (119940) - TotalRawHdfsReadTime(*): 8s734ms - TotalReadThroughput: 55.69 MB/sec Instance 6746754113c855a3:d4ee941f00000009 (host=10.17.193.14:22000):(Total: 18s999ms, non-child: 33.197ms, % non-child: 0.17%) Hdfs split stats (:<# splits>/): 9:1/253.40 MB 5:3/760.21 MB 4:3/760.19 MB 7:2/506.80 MB 2:3/760.21 MB 6:2/506.82 MB 1:3/760.22 MB MemoryUsage(500.000ms): 3.45 MB, 10.11 MB, 441.27 MB, 578.69 MB, 746.73 MB, 788.21 MB, 772.24 MB, 772.23 MB, 764.30 MB, 732.75 MB, 724.48 MB, 700.63 MB, 676.97 MB, 676.89 MB, 668.84 MB, 644.95 MB, 629.06 MB, 605.28 MB, 581.28 MB, 565.56 MB, 533.59 MB, 501.78 MB, 485.78 MB, 438.09 MB, 374.91 MB, 502.92 MB, 544.21 MB, 549.34 MB, 506.52 MB, 373.70 MB, 315.17 MB, 307.38 MB, 275.44 MB, 267.63 MB, 267.55 MB, 235.71 MB, 195.88 MB, 171.88 MB ThreadUsage(500.000ms): 1, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 12, 7, 6, 6, 6, 6, 6, 6, 6, 6 - AverageThreadTokens: 11.03 - BloomFilterBytes: 0 - PeakMemoryUsage: 796.24 MB (834915987) - PerHostPeakMemUsage: 806.54 MB (845719692) - RowsProduced: 4 (4) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 7.319ms - TotalStorageWaitTime: 11s768ms - TotalThreadsInvoluntaryContextSwitches: 11.60K (11601) - TotalThreadsTotalWallClockTime: 3m29s - TotalThreadsSysTime: 813.872ms - TotalThreadsUserTime: 43s151ms - TotalThreadsVoluntaryContextSwitches: 113.00K (112998) Fragment Instance Lifecycle Timings: - ExecTime: 18s698ms - ExecTreeExecTime: 18s671ms - OpenTime: 237.555ms - ExecTreeOpenTime: 83.377us - PrepareTime: 63.049ms - ExecTreePrepareTime: 32.774ms DataStreamSender (dst_id=3):(Total: 59.354us, non-child: 59.354us, % non-child: 100.00%) - BytesSent: 597.00 B (597) - OverallThroughput: 9.59 MB/sec - PeakMemoryUsage: 27.59 KB (28256) - RowsReturned: 4 (4) - SerializeBatchTime: 39.060us - UncompressedRowBatchSize: 597.00 B (597) CodeGen:(Total: 261.350ms, non-child: 261.350ms, % non-child: 100.00%) - CodegenTime: 15.859ms - CompileTime: 61.896ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2068576) - NumFunctions: 139 (139) - NumInstructions: 4.38K (4382) - OptimizationTime: 174.919ms - PeakMemoryUsage: 2.14 MB (2243584) - PrepareTime: 23.964ms AGGREGATION_NODE (id=1):(Total: 18s704ms, non-child: 17s843ms, % non-child: 95.39%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 66.974us - GetResultsTime: 28.458us - HTResizeTime: 495.338us - HashBuckets: 8.19K (8192) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.44 MB (2557804) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 4 (4) - RowsReturnedRate: 0 - StreamingTime: 17s626ms - UnpinTime: 0.000ns HDFS_SCAN_NODE (id=0):(Total: 861.418ms, non-child: 861.418ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 9:1/253.40 MB 5:3/760.21 MB 4:3/760.19 MB 7:2/506.80 MB 2:3/760.21 MB 6:2/506.82 MB 1:3/760.22 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 17 out of 17 Hdfs Read Thread Concurrency Bucket: 0:81.08% 1:8.108% 2:2.703% 3:0% 4:5.405% 5:0% 6:0% 7:2.703% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:119 BytesRead(500.000ms): 0, 200.00 KB, 358.49 MB, 473.63 MB, 637.58 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 717.98 MB, 921.93 MB, 963.49 MB, 999.29 MB, 999.29 MB, 999.29 MB, 999.29 MB, 999.29 MB, 999.29 MB, 999.29 MB, 999.29 MB, 999.29 MB, 999.29 MB, 999.29 MB - FooterProcessingTime: (Avg: 239.473ms ; Min: 3.694ms ; Max: 490.492ms ; Number of samples: 17) - AverageHdfsReadThreadConcurrency: 0.54 - AverageScannerThreadConcurrency: 10.30 - BytesRead: 999.29 MB (1047835215) - BytesReadDataNodeCache: 0 - BytesReadLocal: 999.29 MB (1047835215) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 999.29 MB (1047835215) - CachedFileHandlesHitCount: 204 (204) - CachedFileHandlesMissCount: 17 (17) - DecompressionTime: 2s288ms - MaxCompressedTextFileLength: 0 - NumColumns: 7 (7) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 7 (7) - NumRowGroups: 17 (17) - NumScannerThreadsStarted: 12 (12) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 794.56 MB (833158630) - PerReadThreadRawHdfsThroughput: 103.09 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 305.770ms - RowBatchQueuePutWaitTime: 2m34s - RowsRead: 117.66M (117659833) - RowsReturned: 116.00M (116003313) - RowsReturnedRate: 134.67 M/sec - ScanRangesComplete: 17 (17) - ScannerThreadsInvoluntaryContextSwitches: 9.73K (9731) - ScannerThreadsTotalWallClockTime: 3m10s - MaterializeTupleTime(*): 20s399ms - ScannerThreadsSysTime: 554.911ms - ScannerThreadsUserTime: 24s808ms - ScannerThreadsVoluntaryContextSwitches: 112.97K (112965) - TotalRawHdfsReadTime(*): 9s693ms - TotalReadThroughput: 52.59 MB/sec ================================================================================ ================================================================================ SUMMARY: +---------------------+--------+----------+---------+----------+-------+-----------+ | Operator | #Hosts | Avg Time | Std Dev | Max Time | #Rows | Est #Rows | +---------------------+--------+----------+---------+----------+-------+-----------+ | 05:MERGING-EXCHANGE | 1 | 92.20us | 0ns | 92.20us | 4 | 6 | | 02:SORT | 14 | 528.35us | 0ns | 1.45ms | 4 | 6 | | 04:AGGREGATE | 14 | 2.51ms | 0ns | 2.91ms | 4 | 6 | | 03:EXCHANGE | 14 | 78.20us | 0ns | 321.44us | 56 | 6 | | 01:AGGREGATE | 14 | 19.61s | 0ns | 20.48s | 56 | 6 | | 00:SCAN HDFS | 14 | 505.37ms | 0ns | 617.24ms | 1.77B | 180.00M | +---------------------+--------+----------+---------+----------+-------+-----------+ PROFILE: Query (id=8c41d37ad1fc525e:2bf936bd00000000): Summary: Session ID: b14bc2f0dd731fd9:792c2ae7c1094598 Session Type: BEESWAX Start Time: 2017-06-18 23:30:44.673137000 End Time: Query Type: QUERY Query State: FINISHED Query Status: OK Impala Version: impalad version 2.9.0-SNAPSHOT RELEASE (build 659a7c7beb75d45bcd92af1d6a5c0e58cace65b5) User: jenkins Connected User: jenkins Delegated User: Network Address: 10.17.193.6:50904 Default Db: tpch_300_parquet Sql Statement: select l_returnflag, l_linestatus, sum(l_quantity) as sum_qty, sum(l_extendedprice) as sum_base_price, sum(l_extendedprice * (1 - l_discount)) as sum_disc_price, sum(l_extendedprice * (1 - l_discount) * (1 + l_tax)) as sum_charge, avg(l_quantity) as avg_qty, avg(l_extendedprice) as avg_price, avg(l_discount) as avg_disc, count(*) as count_order from lineitem where l_shipdate <= '1998-09-02' group by l_returnflag, l_linestatus order by l_returnflag, l_linestatus Coordinator: vb0204.halxg.cloudera.com:22000 Query Options (non default): NUM_SCANNER_THREADS=12,SYNC_DDL=1,MAX_NUM_RUNTIME_FILTERS=50 Plan: ---------------- Per-Host Resource Reservation: Memory=320.00MB Per-Host Resource Estimates: Memory=636.00MB F02:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1 PLAN-ROOT SINK | mem-estimate=0B mem-reservation=0B | 05:MERGING-EXCHANGE [UNPARTITIONED] | order by: l_returnflag ASC, l_linestatus ASC | mem-estimate=0B mem-reservation=0B | tuple-ids=3 row-size=130B cardinality=6 | F01:PLAN FRAGMENT [HASH(l_returnflag,l_linestatus)] hosts=14 instances=14 02:SORT | order by: l_returnflag ASC, l_linestatus ASC | mem-estimate=16.00MB mem-reservation=48.00MB | tuple-ids=3 row-size=130B cardinality=6 | 04:AGGREGATE [FINALIZE] | output: sum:merge(l_quantity), sum:merge(l_extendedprice), sum:merge(l_extendedprice * (1 - l_discount)), sum:merge(l_extendedprice * (1 - l_discount) * (1 + l_tax)), avg:merge(l_quantity), avg:merge(l_extendedprice), avg:merge(l_discount), count:merge(*) | group by: l_returnflag, l_linestatus | mem-estimate=10.00MB mem-reservation=272.00MB | tuple-ids=2 row-size=130B cardinality=6 | 03:EXCHANGE [HASH(l_returnflag,l_linestatus)] | mem-estimate=0B mem-reservation=0B | tuple-ids=1 row-size=130B cardinality=6 | F00:PLAN FRAGMENT [RANDOM] hosts=14 instances=14 01:AGGREGATE [STREAMING] | output: sum(l_quantity), sum(l_extendedprice), sum(l_extendedprice * (1 - l_discount)), sum(l_extendedprice * (1 - l_discount) * (1 + l_tax)), avg(l_quantity), avg(l_extendedprice), avg(l_discount), count(*) | group by: l_returnflag, l_linestatus | mem-estimate=10.00MB mem-reservation=0B | tuple-ids=1 row-size=130B cardinality=6 | 00:SCAN HDFS [tpch_300_parquet.lineitem, RANDOM] partitions=1/1 files=264 size=64.36GB predicates: l_shipdate <= '1998-09-02' stats-rows=1799989091 extrapolated-rows=disabled table stats: rows=1799989091 size=unavailable column stats: all parquet statistics predicates: l_shipdate <= '1998-09-02' parquet dictionary predicates: l_shipdate <= '1998-09-02' mem-estimate=616.00MB mem-reservation=0B tuple-ids=0 row-size=92B cardinality=179998909 ---------------- Estimated Per-Host Mem: 666894336 Per-Host Memory Reservation: 335544320 Request Pool: root.jenkins Admission result: Admitted immediately Planner Timeline: 63.467ms - Analysis finished: 15.562ms (15.562ms) - Equivalence classes computed: 21.154ms (5.591ms) - Single node plan created: 41.830ms (20.676ms) - Runtime filters computed: 41.877ms (47.825us) - Distributed plan created: 44.445ms (2.567ms) - Lineage info computed: 45.375ms (930.073us) - Planning finished: 63.467ms (18.091ms) Query Timeline: 21s419ms - Query submitted: 32.121us (32.121us) - Planning finished: 72.391ms (72.359ms) - Submit for admission: 73.778ms (1.387ms) - Completed admission: 73.882ms (103.160us) - Ready to start on 14 backends: 74.236ms (354.860us) - All 14 execution backends (29 fragment instances) started: 77.832ms (3.595ms) - Rows available: 21s396ms (21s318ms) - First row fetched: 21s410ms (14.229ms) - ComputeScanRangeAssignmentTimer: 574.176us ImpalaServer: - ClientFetchWaitTimer: 14.241ms - RowMaterializationTimer: 5.560ms Execution Profile 8c41d37ad1fc525e:2bf936bd00000000:(Total: 21s327ms, non-child: 0.000ns, % non-child: 0.00%) Number of filters: 0 Filter routing table: ID Src. Node Tgt. Node(s) Target type Partition filter Pending (Expected) First arrived Completed Enabled ------------------------------------------------------------------------------------------------------------------- Backend startup latencies: Count: 14, min / max: 1ms / 2ms, 25th %-ile: 1ms, 50th %-ile: 2ms, 75th %-ile: 2ms, 90th %-ile: 2ms, 95th %-ile: 2ms, 99.9th %-ile: 2ms Per Node Peak Memory Usage: 10.17.193.10:22000(822.76 MB) 10.17.193.11:22000(822.75 MB) 10.17.193.12:22000(822.67 MB) 10.17.193.14:22000(822.75 MB) 10.17.193.15:22000(792.75 MB) 10.17.193.16:22000(822.75 MB) 10.17.193.17:22000(822.67 MB) 10.17.193.18:22000(822.75 MB) 10.17.193.19:22000(808.83 MB) 10.17.193.20:22000(817.83 MB) 10.17.193.22:22000(822.75 MB) 10.17.193.23:22000(822.83 MB) 10.17.193.24:22000(818.75 MB) 10.17.193.25:22000(822.62 MB) - FiltersReceived: 0 (0) - FinalizationTimer: 0.000ns Averaged Fragment F02:(Total: 21s333ms, non-child: 15.273ms, % non-child: 0.07%) split sizes: min: 0, max: 0, avg: 0, stddev: 0 completion times: min:21s335ms max:21s335ms mean: 21s335ms stddev:0.000ns execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec num instances: 1 - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 296.50 KB (303616) - PerHostPeakMemUsage: 822.76 MB (862722974) - RowsProduced: 4 (4) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 4 (4) - TotalThreadsTotalWallClockTime: 21s308ms - TotalThreadsSysTime: 999.000us - TotalThreadsUserTime: 39.994ms - TotalThreadsVoluntaryContextSwitches: 16 (16) Fragment Instance Lifecycle Timings: - ExecTime: 14.442ms - ExecTreeExecTime: 192.719us - OpenTime: 21s294ms - ExecTreeOpenTime: 21s253ms - PrepareTime: 25.309ms - ExecTreePrepareTime: 89.820us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 49 (49) - BlocksRecycled: 3 (3) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 32.02 MB (33570816) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns PLAN_ROOT_SINK: - PeakMemoryUsage: 0 CodeGen:(Total: 64.593ms, non-child: 64.593ms, % non-child: 100.00%) - CodegenTime: 1.220ms - CompileTime: 5.270ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2068576) - NumFunctions: 28 (28) - NumInstructions: 577 (577) - OptimizationTime: 34.409ms - PeakMemoryUsage: 288.50 KB (295424) - PrepareTime: 24.302ms EXCHANGE_NODE (id=5):(Total: 21s253ms, non-child: 21s253ms, % non-child: 100.00%) - ConvertRowBatchTime: 0.000ns - MergeGetNext: 186.147us - MergeGetNextBatch: 170.452us - PeakMemoryUsage: 0 - RowsReturned: 4 (4) - RowsReturnedRate: 0 RecvrSide: - FirstBatchArrivalWaitTime: 21s253ms - TotalBytesReceived: 417.00 B (417) - TotalGetBatchTime: 21s253ms - DataArrivalTimer: 21s253ms SenderSide: - DeserializeRowBatchTimer: 31.840us - NumBatchesAccepted: 4 (4) - NumBatchesRejected: 0 (0) Coordinator Fragment F02: Instance 8c41d37ad1fc525e:2bf936bd00000000 (host=10.17.193.10:22000):(Total: 21s333ms, non-child: 15.273ms, % non-child: 0.07%) MemoryUsage(500.000ms): 8.29 KB, 8.29 KB, 8.29 KB, 8.29 KB, 8.29 KB, 8.29 KB, 8.29 KB, 8.29 KB, 8.29 KB, 8.29 KB, 8.29 KB, 8.29 KB, 8.29 KB, 8.29 KB, 8.29 KB, 8.29 KB, 8.29 KB, 8.29 KB, 8.29 KB, 8.29 KB, 8.29 KB, 8.29 KB, 8.29 KB, 8.29 KB, 8.29 KB, 8.29 KB, 8.29 KB, 8.29 KB, 8.29 KB, 8.29 KB, 8.29 KB, 8.29 KB, 8.29 KB, 8.29 KB, 8.29 KB, 8.29 KB, 8.29 KB, 8.29 KB, 8.29 KB, 8.29 KB, 8.29 KB, 8.29 KB - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 296.50 KB (303616) - PerHostPeakMemUsage: 822.76 MB (862722974) - RowsProduced: 4 (4) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 4 (4) - TotalThreadsTotalWallClockTime: 21s308ms - TotalThreadsSysTime: 999.000us - TotalThreadsUserTime: 39.994ms - TotalThreadsVoluntaryContextSwitches: 16 (16) Fragment Instance Lifecycle Timings: - ExecTime: 14.442ms - ExecTreeExecTime: 192.719us - OpenTime: 21s294ms - ExecTreeOpenTime: 21s253ms - PrepareTime: 25.309ms - ExecTreePrepareTime: 89.820us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 49 (49) - BlocksRecycled: 3 (3) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 32.02 MB (33570816) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns PLAN_ROOT_SINK: - PeakMemoryUsage: 0 CodeGen:(Total: 64.593ms, non-child: 64.593ms, % non-child: 100.00%) - CodegenTime: 1.220ms - CompileTime: 5.270ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2068576) - NumFunctions: 28 (28) - NumInstructions: 577 (577) - OptimizationTime: 34.409ms - PeakMemoryUsage: 288.50 KB (295424) - PrepareTime: 24.302ms EXCHANGE_NODE (id=5):(Total: 21s253ms, non-child: 92.201us, % non-child: 0.00%) ExecOption: Codegen Enabled - ConvertRowBatchTime: 0.000ns - MergeGetNext: 186.147us - MergeGetNextBatch: 170.452us - PeakMemoryUsage: 0 - RowsReturned: 4 (4) - RowsReturnedRate: 0 RecvrSide: BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - FirstBatchArrivalWaitTime: 21s253ms - TotalBytesReceived: 417.00 B (417) - TotalGetBatchTime: 21s253ms - DataArrivalTimer: 21s253ms SenderSide: - DeserializeRowBatchTimer: 31.840us - NumBatchesAccepted: 4 (4) - NumBatchesRejected: 0 (0) Averaged Fragment F01:(Total: 21s314ms, non-child: 4.067ms, % non-child: 0.02%) split sizes: min: 0, max: 0, avg: 0, stddev: 0 completion times: min:21s310ms max:21s320ms mean: 21s315ms stddev:3.460ms execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec num instances: 14 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 32.10 MB (33662895) - PerHostPeakMemUsage: 818.96 MB (858741807) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 21s109ms - TotalNetworkSendTime: 106.006us - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 17 (17) - TotalThreadsTotalWallClockTime: 21s283ms - TotalThreadsSysTime: 2.142ms - TotalThreadsUserTime: 171.188ms - TotalThreadsVoluntaryContextSwitches: 6 (6) Fragment Instance Lifecycle Timings: - ExecTime: 586.449us - ExecTreeExecTime: 6.567us - OpenTime: 21s282ms - ExecTreeOpenTime: 21s111ms - PrepareTime: 30.574ms - ExecTreePrepareTime: 1.265ms DataStreamSender (dst_id=5):(Total: 25.040us, non-child: 25.040us, % non-child: 100.00%) - BytesSent: 29.00 B (29) - OverallThroughput: 599.04 KB/sec - PeakMemoryUsage: 1008.00 B (1008) - RowsReturned: 0 (0) - SerializeBatchTime: 12.055us - UncompressedRowBatchSize: 29.00 B (29) CodeGen:(Total: 197.074ms, non-child: 197.074ms, % non-child: 100.00%) - CodegenTime: 6.788ms - CompileTime: 42.641ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2068576) - NumFunctions: 89 (89) - NumInstructions: 1.98K (1981) - OptimizationTime: 127.909ms - PeakMemoryUsage: 990.50 KB (1014272) - PrepareTime: 25.938ms SORT_NODE (id=2):(Total: 21s112ms, non-child: 528.351us, % non-child: 0.00%) - InMemorySortTime: 1.441us - InitialRunsCreated: 1 (1) - PeakMemoryUsage: 24.01 MB (25176356) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SortDataSize: 37.00 B (37) - SpilledRuns: 0 (0) - TotalMergesPerformed: 0 (0) AGGREGATION_NODE (id=4):(Total: 21s112ms, non-child: 2.513ms, % non-child: 0.01%) - BuildTime: 16.015us - GetNewBlockTime: 164.067us - GetResultsTime: 6.364us - HTResizeTime: 4.549us - HashBuckets: 292 (292) - LargestPartitionPercent: 2 (2) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 10.32 MB (10816786) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.940us EXCHANGE_NODE (id=3):(Total: 21s109ms, non-child: 21s109ms, % non-child: 100.00%) - ConvertRowBatchTime: 9.568us - PeakMemoryUsage: 0 - RowsReturned: 4 (4) - RowsReturnedRate: 0 RecvrSide: - FirstBatchArrivalWaitTime: 20s398ms - TotalBytesReceived: 595.00 B (595) - TotalGetBatchTime: 21s109ms - DataArrivalTimer: 21s109ms SenderSide: - DeserializeRowBatchTimer: 32.445us - NumBatchesAccepted: 4 (4) - NumBatchesRejected: 0 (0) BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 49 (49) - BlocksRecycled: 3 (3) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 32.00 MB (33558212) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns Fragment F01: Instance 8c41d37ad1fc525e:2bf936bd0000001b (host=10.17.193.17:22000):(Total: 21s319ms, non-child: 5.653ms, % non-child: 0.03%) MemoryUsage(500.000ms): 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.31 MB, 10.33 MB, 10.33 MB, 10.35 MB, 10.36 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 32.21 MB (33774073) - PerHostPeakMemUsage: 822.67 MB (862631663) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 21s105ms - TotalNetworkSendTime: 323.506us - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 19 (19) - TotalThreadsTotalWallClockTime: 21s284ms - TotalThreadsSysTime: 3.999ms - TotalThreadsUserTime: 174.973ms - TotalThreadsVoluntaryContextSwitches: 18 (18) Fragment Instance Lifecycle Timings: - ExecTime: 791.610us - ExecTreeExecTime: 13.369us - OpenTime: 21s283ms - ExecTreeOpenTime: 21s107ms - PrepareTime: 34.791ms - ExecTreePrepareTime: 1.307ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 49 (49) - BlocksRecycled: 3 (3) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 32.02 MB (33570816) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=5):(Total: 50.425us, non-child: 50.425us, % non-child: 100.00%) - BytesSent: 107.00 B (107) - OverallThroughput: 2.02 MB/sec - PeakMemoryUsage: 1008.00 B (1008) - RowsReturned: 1 (1) - SerializeBatchTime: 38.282us - UncompressedRowBatchSize: 107.00 B (107) CodeGen:(Total: 204.259ms, non-child: 204.259ms, % non-child: 100.00%) - CodegenTime: 10.634ms - CompileTime: 43.090ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2068576) - NumFunctions: 89 (89) - NumInstructions: 1.98K (1981) - OptimizationTime: 131.452ms - PeakMemoryUsage: 990.50 KB (1014272) - PrepareTime: 29.107ms SORT_NODE (id=2):(Total: 21s109ms, non-child: 1.104ms, % non-child: 0.01%) ExecOption: Codegen Enabled - InMemorySortTime: 1.618us - InitialRunsCreated: 1 (1) - PeakMemoryUsage: 24.02 MB (25182208) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SortDataSize: 132.00 B (132) - SpilledRuns: 0 (0) - TotalMergesPerformed: 0 (0) AGGREGATION_NODE (id=4):(Total: 21s108ms, non-child: 2.905ms, % non-child: 0.01%) ExecOption: Codegen Enabled - BuildTime: 35.422us - GetNewBlockTime: 170.085us - GetResultsTime: 21.144us - HTResizeTime: 4.838us - HashBuckets: 1.02K (1024) - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 10.36 MB (10860672) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 2.498us EXCHANGE_NODE (id=3):(Total: 21s105ms, non-child: 185.205us, % non-child: 0.00%) - ConvertRowBatchTime: 29.758us - PeakMemoryUsage: 0 - RowsReturned: 14 (14) - RowsReturnedRate: 0 RecvrSide: BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 149.00 B, 596.00 B, 894.00 B, 1.31 KB, 1.89 KB - FirstBatchArrivalWaitTime: 18s613ms - TotalBytesReceived: 2.04 KB (2086) - TotalGetBatchTime: 21s105ms - DataArrivalTimer: 21s104ms SenderSide: - DeserializeRowBatchTimer: 136.909us - NumBatchesAccepted: 14 (14) - NumBatchesRejected: 0 (0) Instance 8c41d37ad1fc525e:2bf936bd0000001c (host=10.17.193.18:22000):(Total: 21s318ms, non-child: 4.071ms, % non-child: 0.02%) MemoryUsage(500.000ms): 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 32.06 MB (33618425) - PerHostPeakMemUsage: 822.75 MB (862713138) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 21s117ms - TotalNetworkSendTime: 989.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 17 (17) - TotalThreadsTotalWallClockTime: 21s290ms - TotalThreadsSysTime: 2.000ms - TotalThreadsUserTime: 170.974ms - TotalThreadsVoluntaryContextSwitches: 4 (4) Fragment Instance Lifecycle Timings: - ExecTime: 593.875us - ExecTreeExecTime: 5.541us - OpenTime: 21s289ms - ExecTreeOpenTime: 21s119ms - PrepareTime: 27.938ms - ExecTreePrepareTime: 1.243ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 49 (49) - BlocksRecycled: 3 (3) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 32.00 MB (33554432) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=5):(Total: 11.385us, non-child: 11.385us, % non-child: 100.00%) - BytesSent: 0 - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1008.00 B (1008) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 194.027ms, non-child: 194.027ms, % non-child: 100.00%) - CodegenTime: 6.439ms - CompileTime: 42.733ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2068576) - NumFunctions: 89 (89) - NumInstructions: 1.98K (1981) - OptimizationTime: 127.376ms - PeakMemoryUsage: 990.50 KB (1014272) - PrepareTime: 23.323ms SORT_NODE (id=2):(Total: 21s120ms, non-child: 305.153us, % non-child: 0.00%) ExecOption: Codegen Enabled - InMemorySortTime: 1.267us - InitialRunsCreated: 1 (1) - PeakMemoryUsage: 24.01 MB (25174016) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SortDataSize: 0 - SpilledRuns: 0 (0) - TotalMergesPerformed: 0 (0) AGGREGATION_NODE (id=4):(Total: 21s120ms, non-child: 2.466ms, % non-child: 0.01%) ExecOption: Codegen Enabled - BuildTime: 10.034us - GetNewBlockTime: 132.851us - GetResultsTime: 0.000ns - HTResizeTime: 5.597us - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 10.30 MB (10799232) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.991us EXCHANGE_NODE (id=3):(Total: 21s117ms, non-child: 9.330us, % non-child: 0.00%) - ConvertRowBatchTime: 1.032us - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 RecvrSide: BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - FirstBatchArrivalWaitTime: 21s117ms - TotalBytesReceived: 0 - TotalGetBatchTime: 21s117ms - DataArrivalTimer: 21s117ms SenderSide: - DeserializeRowBatchTimer: 0.000ns - NumBatchesAccepted: 0 (0) - NumBatchesRejected: 0 (0) Instance 8c41d37ad1fc525e:2bf936bd00000019 (host=10.17.193.12:22000):(Total: 21s316ms, non-child: 3.739ms, % non-child: 0.02%) MemoryUsage(500.000ms): 11.27 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 32.06 MB (33618425) - PerHostPeakMemUsage: 822.67 MB (862631842) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 21s116ms - TotalNetworkSendTime: 568.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 18 (18) - TotalThreadsTotalWallClockTime: 21s287ms - TotalThreadsSysTime: 2.000ms - TotalThreadsUserTime: 168.975ms - TotalThreadsVoluntaryContextSwitches: 2 (2) Fragment Instance Lifecycle Timings: - ExecTime: 390.337us - ExecTreeExecTime: 4.893us - OpenTime: 21s286ms - ExecTreeOpenTime: 21s117ms - PrepareTime: 29.582ms - ExecTreePrepareTime: 1.144ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 49 (49) - BlocksRecycled: 3 (3) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 32.00 MB (33554432) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=5):(Total: 14.339us, non-child: 14.339us, % non-child: 100.00%) - BytesSent: 0 - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1008.00 B (1008) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 194.507ms, non-child: 194.507ms, % non-child: 100.00%) - CodegenTime: 6.556ms - CompileTime: 42.199ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2068576) - NumFunctions: 89 (89) - NumInstructions: 1.98K (1981) - OptimizationTime: 126.548ms - PeakMemoryUsage: 990.50 KB (1014272) - PrepareTime: 25.188ms SORT_NODE (id=2):(Total: 21s118ms, non-child: 237.663us, % non-child: 0.00%) ExecOption: Codegen Enabled - InMemorySortTime: 896.000ns - InitialRunsCreated: 1 (1) - PeakMemoryUsage: 24.01 MB (25174016) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SortDataSize: 0 - SpilledRuns: 0 (0) - TotalMergesPerformed: 0 (0) AGGREGATION_NODE (id=4):(Total: 21s118ms, non-child: 2.340ms, % non-child: 0.01%) ExecOption: Codegen Enabled - BuildTime: 7.693us - GetNewBlockTime: 125.521us - GetResultsTime: 0.000ns - HTResizeTime: 4.176us - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 10.30 MB (10799232) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 2.202us EXCHANGE_NODE (id=3):(Total: 21s116ms, non-child: 8.173us, % non-child: 0.00%) - ConvertRowBatchTime: 832.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 RecvrSide: BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - FirstBatchArrivalWaitTime: 21s116ms - TotalBytesReceived: 0 - TotalGetBatchTime: 21s116ms - DataArrivalTimer: 21s116ms SenderSide: - DeserializeRowBatchTimer: 0.000ns - NumBatchesAccepted: 0 (0) - NumBatchesRejected: 0 (0) Instance 8c41d37ad1fc525e:2bf936bd00000017 (host=10.17.193.14:22000):(Total: 21s316ms, non-child: 4.008ms, % non-child: 0.02%) MemoryUsage(500.000ms): 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.31 MB, 10.31 MB, 10.33 MB, 10.33 MB, 10.35 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 32.21 MB (33774073) - PerHostPeakMemUsage: 822.75 MB (862716148) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 21s110ms - TotalNetworkSendTime: 372.842us - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 17 (17) - TotalThreadsTotalWallClockTime: 21s284ms - TotalThreadsSysTime: 2.000ms - TotalThreadsUserTime: 171.974ms - TotalThreadsVoluntaryContextSwitches: 18 (18) Fragment Instance Lifecycle Timings: - ExecTime: 764.449us - ExecTreeExecTime: 7.215us - OpenTime: 21s283ms - ExecTreeOpenTime: 21s112ms - PrepareTime: 32.675ms - ExecTreePrepareTime: 1.079ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 49 (49) - BlocksRecycled: 3 (3) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 32.02 MB (33570816) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=5):(Total: 88.429us, non-child: 88.429us, % non-child: 100.00%) - BytesSent: 107.00 B (107) - OverallThroughput: 1.15 MB/sec - PeakMemoryUsage: 1008.00 B (1008) - RowsReturned: 1 (1) - SerializeBatchTime: 74.453us - UncompressedRowBatchSize: 107.00 B (107) CodeGen:(Total: 198.910ms, non-child: 198.910ms, % non-child: 100.00%) - CodegenTime: 6.330ms - CompileTime: 42.291ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2068576) - NumFunctions: 89 (89) - NumInstructions: 1.98K (1981) - OptimizationTime: 127.708ms - PeakMemoryUsage: 990.50 KB (1014272) - PrepareTime: 28.354ms SORT_NODE (id=2):(Total: 21s113ms, non-child: 1.043ms, % non-child: 0.00%) ExecOption: Codegen Enabled - InMemorySortTime: 1.798us - InitialRunsCreated: 1 (1) - PeakMemoryUsage: 24.02 MB (25182208) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SortDataSize: 132.00 B (132) - SpilledRuns: 0 (0) - TotalMergesPerformed: 0 (0) AGGREGATION_NODE (id=4):(Total: 21s112ms, non-child: 2.298ms, % non-child: 0.01%) ExecOption: Codegen Enabled - BuildTime: 29.644us - GetNewBlockTime: 139.014us - GetResultsTime: 18.680us - HTResizeTime: 4.237us - HashBuckets: 1.02K (1024) - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 10.36 MB (10860672) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 2.083us EXCHANGE_NODE (id=3):(Total: 21s110ms, non-child: 266.044us, % non-child: 0.00%) - ConvertRowBatchTime: 25.639us - PeakMemoryUsage: 0 - RowsReturned: 14 (14) - RowsReturnedRate: 0 RecvrSide: BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 149.00 B, 149.00 B, 596.00 B, 894.00 B, 1.60 KB - FirstBatchArrivalWaitTime: 18s619ms - TotalBytesReceived: 2.04 KB (2086) - TotalGetBatchTime: 21s110ms - DataArrivalTimer: 21s110ms SenderSide: - DeserializeRowBatchTimer: 112.103us - NumBatchesAccepted: 14 (14) - NumBatchesRejected: 0 (0) Instance 8c41d37ad1fc525e:2bf936bd0000001a (host=10.17.193.24:22000):(Total: 21s316ms, non-child: 3.915ms, % non-child: 0.02%) MemoryUsage(500.000ms): 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 32.06 MB (33618425) - PerHostPeakMemUsage: 818.75 MB (858519883) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 21s116ms - TotalNetworkSendTime: 996.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 18 (18) - TotalThreadsTotalWallClockTime: 21s289ms - TotalThreadsSysTime: 2.999ms - TotalThreadsUserTime: 169.974ms - TotalThreadsVoluntaryContextSwitches: 3 (3) Fragment Instance Lifecycle Timings: - ExecTime: 582.213us - ExecTreeExecTime: 5.454us - OpenTime: 21s288ms - ExecTreeOpenTime: 21s117ms - PrepareTime: 26.896ms - ExecTreePrepareTime: 1.185ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 49 (49) - BlocksRecycled: 3 (3) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 32.00 MB (33554432) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=5):(Total: 12.347us, non-child: 12.347us, % non-child: 100.00%) - BytesSent: 0 - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1008.00 B (1008) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 193.353ms, non-child: 193.353ms, % non-child: 100.00%) - CodegenTime: 6.432ms - CompileTime: 42.759ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2068576) - NumFunctions: 89 (89) - NumInstructions: 1.98K (1981) - OptimizationTime: 127.529ms - PeakMemoryUsage: 990.50 KB (1014272) - PrepareTime: 22.417ms SORT_NODE (id=2):(Total: 21s118ms, non-child: 301.482us, % non-child: 0.00%) ExecOption: Codegen Enabled - InMemorySortTime: 1.209us - InitialRunsCreated: 1 (1) - PeakMemoryUsage: 24.01 MB (25174016) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SortDataSize: 0 - SpilledRuns: 0 (0) - TotalMergesPerformed: 0 (0) AGGREGATION_NODE (id=4):(Total: 21s118ms, non-child: 2.417ms, % non-child: 0.01%) ExecOption: Codegen Enabled - BuildTime: 8.340us - GetNewBlockTime: 129.369us - GetResultsTime: 0.000ns - HTResizeTime: 4.302us - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 10.30 MB (10799232) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.926us EXCHANGE_NODE (id=3):(Total: 21s116ms, non-child: 10.538us, % non-child: 0.00%) - ConvertRowBatchTime: 1.908us - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 RecvrSide: BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - FirstBatchArrivalWaitTime: 21s116ms - TotalBytesReceived: 0 - TotalGetBatchTime: 21s116ms - DataArrivalTimer: 21s116ms SenderSide: - DeserializeRowBatchTimer: 0.000ns - NumBatchesAccepted: 0 (0) - NumBatchesRejected: 0 (0) Instance 8c41d37ad1fc525e:2bf936bd00000016 (host=10.17.193.10:22000):(Total: 21s316ms, non-child: 4.090ms, % non-child: 0.02%) MemoryUsage(500.000ms): 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.31 MB, 10.31 MB, 10.33 MB, 10.33 MB, 10.35 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 32.21 MB (33774073) - PerHostPeakMemUsage: 822.76 MB (862722974) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 21s112ms - TotalNetworkSendTime: 360.393us - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 17 (17) - TotalThreadsTotalWallClockTime: 21s286ms - TotalThreadsSysTime: 6.998ms - TotalThreadsUserTime: 165.975ms - TotalThreadsVoluntaryContextSwitches: 19 (19) Fragment Instance Lifecycle Timings: - ExecTime: 748.165us - ExecTreeExecTime: 8.959us - OpenTime: 21s285ms - ExecTreeOpenTime: 21s115ms - PrepareTime: 29.477ms - ExecTreePrepareTime: 1.399ms DataStreamSender (dst_id=5):(Total: 48.970us, non-child: 48.970us, % non-child: 100.00%) - BytesSent: 103.00 B (103) - OverallThroughput: 2.01 MB/sec - PeakMemoryUsage: 1008.00 B (1008) - RowsReturned: 1 (1) - SerializeBatchTime: 36.759us - UncompressedRowBatchSize: 103.00 B (103) CodeGen:(Total: 194.539ms, non-child: 194.539ms, % non-child: 100.00%) - CodegenTime: 6.498ms - CompileTime: 41.995ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2068576) - NumFunctions: 89 (89) - NumInstructions: 1.98K (1981) - OptimizationTime: 127.105ms - PeakMemoryUsage: 990.50 KB (1014272) - PrepareTime: 24.887ms SORT_NODE (id=2):(Total: 21s117ms, non-child: 1.447ms, % non-child: 0.01%) ExecOption: Codegen Enabled - InMemorySortTime: 2.706us - InitialRunsCreated: 1 (1) - PeakMemoryUsage: 24.02 MB (25182208) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SortDataSize: 132.00 B (132) - SpilledRuns: 0 (0) - TotalMergesPerformed: 0 (0) AGGREGATION_NODE (id=4):(Total: 21s115ms, non-child: 2.854ms, % non-child: 0.01%) ExecOption: Codegen Enabled - BuildTime: 40.200us - GetNewBlockTime: 235.772us - GetResultsTime: 27.025us - HTResizeTime: 5.150us - HashBuckets: 1.02K (1024) - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 10.36 MB (10860672) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.858us EXCHANGE_NODE (id=3):(Total: 21s113ms, non-child: 231.006us, % non-child: 0.00%) - ConvertRowBatchTime: 39.517us - PeakMemoryUsage: 0 - RowsReturned: 14 (14) - RowsReturnedRate: 0 RecvrSide: BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 151.00 B, 151.00 B, 604.00 B, 906.00 B, 1.47 KB - FirstBatchArrivalWaitTime: 18s622ms - TotalBytesReceived: 2.06 KB (2114) - TotalGetBatchTime: 21s112ms - DataArrivalTimer: 21s112ms SenderSide: - DeserializeRowBatchTimer: 96.534us - NumBatchesAccepted: 14 (14) - NumBatchesRejected: 0 (0) Instance 8c41d37ad1fc525e:2bf936bd00000018 (host=10.17.193.22:22000):(Total: 21s315ms, non-child: 3.876ms, % non-child: 0.02%) MemoryUsage(500.000ms): 11.27 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 32.06 MB (33618425) - PerHostPeakMemUsage: 822.75 MB (862714848) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 21s113ms - TotalNetworkSendTime: 963.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 17 (17) - TotalThreadsTotalWallClockTime: 21s284ms - TotalThreadsSysTime: 2.000ms - TotalThreadsUserTime: 167.975ms - TotalThreadsVoluntaryContextSwitches: 2 (2) Fragment Instance Lifecycle Timings: - ExecTime: 455.247us - ExecTreeExecTime: 4.929us - OpenTime: 21s283ms - ExecTreeOpenTime: 21s114ms - PrepareTime: 31.506ms - ExecTreePrepareTime: 1.320ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 49 (49) - BlocksRecycled: 3 (3) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 32.00 MB (33554432) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=5):(Total: 11.552us, non-child: 11.552us, % non-child: 100.00%) - BytesSent: 0 - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1008.00 B (1008) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 195.682ms, non-child: 195.682ms, % non-child: 100.00%) - CodegenTime: 6.506ms - CompileTime: 42.124ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2068576) - NumFunctions: 89 (89) - NumInstructions: 1.98K (1981) - OptimizationTime: 126.130ms - PeakMemoryUsage: 990.50 KB (1014272) - PrepareTime: 26.834ms SORT_NODE (id=2):(Total: 21s116ms, non-child: 265.343us, % non-child: 0.00%) ExecOption: Codegen Enabled - InMemorySortTime: 875.000ns - InitialRunsCreated: 1 (1) - PeakMemoryUsage: 24.01 MB (25174016) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SortDataSize: 0 - SpilledRuns: 0 (0) - TotalMergesPerformed: 0 (0) AGGREGATION_NODE (id=4):(Total: 21s115ms, non-child: 2.476ms, % non-child: 0.01%) ExecOption: Codegen Enabled - BuildTime: 9.705us - GetNewBlockTime: 205.308us - GetResultsTime: 0.000ns - HTResizeTime: 5.498us - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 10.30 MB (10799232) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.845us EXCHANGE_NODE (id=3):(Total: 21s113ms, non-child: 8.341us, % non-child: 0.00%) - ConvertRowBatchTime: 1.029us - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 RecvrSide: BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - FirstBatchArrivalWaitTime: 21s113ms - TotalBytesReceived: 0 - TotalGetBatchTime: 21s113ms - DataArrivalTimer: 21s113ms SenderSide: - DeserializeRowBatchTimer: 0.000ns - NumBatchesAccepted: 0 (0) - NumBatchesRejected: 0 (0) Instance 8c41d37ad1fc525e:2bf936bd00000015 (host=10.17.193.19:22000):(Total: 21s314ms, non-child: 4.366ms, % non-child: 0.02%) MemoryUsage(500.000ms): 11.27 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.31 MB, 10.31 MB, 10.33 MB, 10.34 MB, 10.36 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 32.21 MB (33774073) - PerHostPeakMemUsage: 808.83 MB (848116900) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 21s111ms - TotalNetworkSendTime: 417.543us - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 17 (17) - TotalThreadsTotalWallClockTime: 21s284ms - TotalThreadsSysTime: 1.000ms - TotalThreadsUserTime: 171.974ms - TotalThreadsVoluntaryContextSwitches: 17 (17) Fragment Instance Lifecycle Timings: - ExecTime: 801.817us - ExecTreeExecTime: 9.163us - OpenTime: 21s283ms - ExecTreeOpenTime: 21s113ms - PrepareTime: 30.161ms - ExecTreePrepareTime: 1.174ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 49 (49) - BlocksRecycled: 3 (3) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 32.02 MB (33570816) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=5):(Total: 31.721us, non-child: 31.721us, % non-child: 100.00%) - BytesSent: 100.00 B (100) - OverallThroughput: 3.01 MB/sec - PeakMemoryUsage: 1008.00 B (1008) - RowsReturned: 1 (1) - SerializeBatchTime: 19.278us - UncompressedRowBatchSize: 100.00 B (100) CodeGen:(Total: 195.049ms, non-child: 195.049ms, % non-child: 100.00%) - CodegenTime: 6.916ms - CompileTime: 42.468ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2068576) - NumFunctions: 89 (89) - NumInstructions: 1.98K (1981) - OptimizationTime: 126.528ms - PeakMemoryUsage: 990.50 KB (1014272) - PrepareTime: 25.464ms SORT_NODE (id=2):(Total: 21s115ms, non-child: 1.009ms, % non-child: 0.00%) ExecOption: Codegen Enabled - InMemorySortTime: 3.088us - InitialRunsCreated: 1 (1) - PeakMemoryUsage: 24.02 MB (25182208) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SortDataSize: 132.00 B (132) - SpilledRuns: 0 (0) - TotalMergesPerformed: 0 (0) AGGREGATION_NODE (id=4):(Total: 21s114ms, non-child: 2.417ms, % non-child: 0.01%) ExecOption: Codegen Enabled - BuildTime: 33.888us - GetNewBlockTime: 129.282us - GetResultsTime: 22.259us - HTResizeTime: 5.501us - HashBuckets: 1.02K (1024) - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 10.36 MB (10860672) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.801us EXCHANGE_NODE (id=3):(Total: 21s111ms, non-child: 321.444us, % non-child: 0.00%) - ConvertRowBatchTime: 27.805us - PeakMemoryUsage: 0 - RowsReturned: 14 (14) - RowsReturnedRate: 0 RecvrSide: BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 148.00 B, 148.00 B, 586.00 B, 1.14 KB, 1.71 KB - FirstBatchArrivalWaitTime: 18s621ms - TotalBytesReceived: 2.00 KB (2046) - TotalGetBatchTime: 21s111ms - DataArrivalTimer: 21s111ms SenderSide: - DeserializeRowBatchTimer: 108.703us - NumBatchesAccepted: 14 (14) - NumBatchesRejected: 0 (0) Instance 8c41d37ad1fc525e:2bf936bd00000013 (host=10.17.193.20:22000):(Total: 21s312ms, non-child: 3.858ms, % non-child: 0.02%) MemoryUsage(500.000ms): 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 32.06 MB (33618425) - PerHostPeakMemUsage: 817.83 MB (857554824) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 21s112ms - TotalNetworkSendTime: 1.183us - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 18 (18) - TotalThreadsTotalWallClockTime: 21s284ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 171.974ms - TotalThreadsVoluntaryContextSwitches: 2 (2) Fragment Instance Lifecycle Timings: - ExecTime: 570.256us - ExecTreeExecTime: 6.125us - OpenTime: 21s284ms - ExecTreeOpenTime: 21s113ms - PrepareTime: 27.679ms - ExecTreePrepareTime: 1.143ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 49 (49) - BlocksRecycled: 3 (3) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 32.00 MB (33554432) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=5):(Total: 12.998us, non-child: 12.998us, % non-child: 100.00%) - BytesSent: 0 - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1008.00 B (1008) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 193.395ms, non-child: 193.395ms, % non-child: 100.00%) - CodegenTime: 6.502ms - CompileTime: 42.268ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2068576) - NumFunctions: 89 (89) - NumInstructions: 1.98K (1981) - OptimizationTime: 127.197ms - PeakMemoryUsage: 990.50 KB (1014272) - PrepareTime: 23.381ms SORT_NODE (id=2):(Total: 21s115ms, non-child: 269.983us, % non-child: 0.00%) ExecOption: Codegen Enabled - InMemorySortTime: 949.000ns - InitialRunsCreated: 1 (1) - PeakMemoryUsage: 24.01 MB (25174016) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SortDataSize: 0 - SpilledRuns: 0 (0) - TotalMergesPerformed: 0 (0) AGGREGATION_NODE (id=4):(Total: 21s114ms, non-child: 2.374ms, % non-child: 0.01%) ExecOption: Codegen Enabled - BuildTime: 9.118us - GetNewBlockTime: 131.729us - GetResultsTime: 0.000ns - HTResizeTime: 5.030us - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 10.30 MB (10799232) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.742us EXCHANGE_NODE (id=3):(Total: 21s112ms, non-child: 7.969us, % non-child: 0.00%) - ConvertRowBatchTime: 912.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 RecvrSide: BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - FirstBatchArrivalWaitTime: 21s112ms - TotalBytesReceived: 0 - TotalGetBatchTime: 21s112ms - DataArrivalTimer: 21s112ms SenderSide: - DeserializeRowBatchTimer: 0.000ns - NumBatchesAccepted: 0 (0) - NumBatchesRejected: 0 (0) Instance 8c41d37ad1fc525e:2bf936bd00000014 (host=10.17.193.25:22000):(Total: 21s311ms, non-child: 3.855ms, % non-child: 0.02%) MemoryUsage(500.000ms): 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 32.06 MB (33618425) - PerHostPeakMemUsage: 822.62 MB (862580130) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 21s108ms - TotalNetworkSendTime: 1.062us - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 17 (17) - TotalThreadsTotalWallClockTime: 21s281ms - TotalThreadsSysTime: 999.000us - TotalThreadsUserTime: 170.974ms - TotalThreadsVoluntaryContextSwitches: 2 (2) Fragment Instance Lifecycle Timings: - ExecTime: 381.592us - ExecTreeExecTime: 5.309us - OpenTime: 21s280ms - ExecTreeOpenTime: 21s109ms - PrepareTime: 30.276ms - ExecTreePrepareTime: 1.259ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 49 (49) - BlocksRecycled: 3 (3) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 32.00 MB (33554432) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=5):(Total: 12.520us, non-child: 12.520us, % non-child: 100.00%) - BytesSent: 0 - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1008.00 B (1008) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 196.555ms, non-child: 196.555ms, % non-child: 100.00%) - CodegenTime: 6.490ms - CompileTime: 42.862ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2068576) - NumFunctions: 89 (89) - NumInstructions: 1.98K (1981) - OptimizationTime: 127.497ms - PeakMemoryUsage: 990.50 KB (1014272) - PrepareTime: 25.589ms SORT_NODE (id=2):(Total: 21s111ms, non-child: 259.048us, % non-child: 0.00%) ExecOption: Codegen Enabled - InMemorySortTime: 1.290us - InitialRunsCreated: 1 (1) - PeakMemoryUsage: 24.01 MB (25174016) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SortDataSize: 0 - SpilledRuns: 0 (0) - TotalMergesPerformed: 0 (0) AGGREGATION_NODE (id=4):(Total: 21s110ms, non-child: 2.518ms, % non-child: 0.01%) ExecOption: Codegen Enabled - BuildTime: 8.140us - GetNewBlockTime: 166.183us - GetResultsTime: 0.000ns - HTResizeTime: 4.011us - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 10.30 MB (10799232) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.931us EXCHANGE_NODE (id=3):(Total: 21s108ms, non-child: 10.128us, % non-child: 0.00%) - ConvertRowBatchTime: 1.159us - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 RecvrSide: BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - FirstBatchArrivalWaitTime: 21s108ms - TotalBytesReceived: 0 - TotalGetBatchTime: 21s108ms - DataArrivalTimer: 21s108ms SenderSide: - DeserializeRowBatchTimer: 0.000ns - NumBatchesAccepted: 0 (0) - NumBatchesRejected: 0 (0) Instance 8c41d37ad1fc525e:2bf936bd00000012 (host=10.17.193.15:22000):(Total: 21s310ms, non-child: 3.857ms, % non-child: 0.02%) MemoryUsage(500.000ms): 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 32.06 MB (33618425) - PerHostPeakMemUsage: 792.75 MB (831257803) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 21s109ms - TotalNetworkSendTime: 1.056us - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 17 (17) - TotalThreadsTotalWallClockTime: 21s281ms - TotalThreadsSysTime: 999.000us - TotalThreadsUserTime: 170.974ms - TotalThreadsVoluntaryContextSwitches: 2 (2) Fragment Instance Lifecycle Timings: - ExecTime: 468.471us - ExecTreeExecTime: 4.485us - OpenTime: 21s281ms - ExecTreeOpenTime: 21s110ms - PrepareTime: 28.434ms - ExecTreePrepareTime: 1.181ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 49 (49) - BlocksRecycled: 3 (3) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 32.00 MB (33554432) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=5):(Total: 12.685us, non-child: 12.685us, % non-child: 100.00%) - BytesSent: 0 - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1008.00 B (1008) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 194.419ms, non-child: 194.419ms, % non-child: 100.00%) - CodegenTime: 6.407ms - CompileTime: 42.776ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2068576) - NumFunctions: 89 (89) - NumInstructions: 1.98K (1981) - OptimizationTime: 127.134ms - PeakMemoryUsage: 990.50 KB (1014272) - PrepareTime: 23.931ms SORT_NODE (id=2):(Total: 21s111ms, non-child: 304.469us, % non-child: 0.00%) ExecOption: Codegen Enabled - InMemorySortTime: 1.293us - InitialRunsCreated: 1 (1) - PeakMemoryUsage: 24.01 MB (25174016) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SortDataSize: 0 - SpilledRuns: 0 (0) - TotalMergesPerformed: 0 (0) AGGREGATION_NODE (id=4):(Total: 21s111ms, non-child: 2.366ms, % non-child: 0.01%) ExecOption: Codegen Enabled - BuildTime: 7.869us - GetNewBlockTime: 137.543us - GetResultsTime: 0.000ns - HTResizeTime: 3.572us - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 10.30 MB (10799232) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.576us EXCHANGE_NODE (id=3):(Total: 21s109ms, non-child: 10.003us, % non-child: 0.00%) - ConvertRowBatchTime: 1.226us - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 RecvrSide: BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - FirstBatchArrivalWaitTime: 21s109ms - TotalBytesReceived: 0 - TotalGetBatchTime: 21s109ms - DataArrivalTimer: 21s109ms SenderSide: - DeserializeRowBatchTimer: 0.000ns - NumBatchesAccepted: 0 (0) - NumBatchesRejected: 0 (0) Instance 8c41d37ad1fc525e:2bf936bd00000011 (host=10.17.193.11:22000):(Total: 21s310ms, non-child: 3.992ms, % non-child: 0.02%) MemoryUsage(500.000ms): 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 32.06 MB (33618425) - PerHostPeakMemUsage: 822.75 MB (862714739) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 21s098ms - TotalNetworkSendTime: 772.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 17 (17) - TotalThreadsTotalWallClockTime: 21s276ms - TotalThreadsSysTime: 2.000ms - TotalThreadsUserTime: 176.973ms - TotalThreadsVoluntaryContextSwitches: 2 (2) Fragment Instance Lifecycle Timings: - ExecTime: 612.546us - ExecTreeExecTime: 5.623us - OpenTime: 21s276ms - ExecTreeOpenTime: 21s099ms - PrepareTime: 33.180ms - ExecTreePrepareTime: 1.719ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 49 (49) - BlocksRecycled: 3 (3) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 32.00 MB (33554432) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=5):(Total: 16.133us, non-child: 16.133us, % non-child: 100.00%) - BytesSent: 0 - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1008.00 B (1008) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 204.913ms, non-child: 204.913ms, % non-child: 100.00%) - CodegenTime: 6.432ms - CompileTime: 43.123ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2068576) - NumFunctions: 89 (89) - NumInstructions: 1.98K (1981) - OptimizationTime: 132.968ms - PeakMemoryUsage: 990.50 KB (1014272) - PrepareTime: 28.236ms SORT_NODE (id=2):(Total: 21s101ms, non-child: 303.481us, % non-child: 0.00%) ExecOption: Codegen Enabled - InMemorySortTime: 1.043us - InitialRunsCreated: 1 (1) - PeakMemoryUsage: 24.01 MB (25174016) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SortDataSize: 0 - SpilledRuns: 0 (0) - TotalMergesPerformed: 0 (0) AGGREGATION_NODE (id=4):(Total: 21s101ms, non-child: 2.749ms, % non-child: 0.01%) ExecOption: Codegen Enabled - BuildTime: 8.488us - GetNewBlockTime: 279.035us - GetResultsTime: 0.000ns - HTResizeTime: 4.327us - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 10.30 MB (10799232) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 2.004us EXCHANGE_NODE (id=3):(Total: 21s098ms, non-child: 8.486us, % non-child: 0.00%) - ConvertRowBatchTime: 942.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 RecvrSide: BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - FirstBatchArrivalWaitTime: 21s098ms - TotalBytesReceived: 0 - TotalGetBatchTime: 21s098ms - DataArrivalTimer: 21s098ms SenderSide: - DeserializeRowBatchTimer: 0.000ns - NumBatchesAccepted: 0 (0) - NumBatchesRejected: 0 (0) Instance 8c41d37ad1fc525e:2bf936bd00000010 (host=10.17.193.16:22000):(Total: 21s309ms, non-child: 3.924ms, % non-child: 0.02%) MemoryUsage(500.000ms): 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 32.06 MB (33618425) - PerHostPeakMemUsage: 822.75 MB (862714071) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 21s098ms - TotalNetworkSendTime: 1.173us - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 18 (18) - TotalThreadsTotalWallClockTime: 21s274ms - TotalThreadsSysTime: 1.000ms - TotalThreadsUserTime: 173.973ms - TotalThreadsVoluntaryContextSwitches: 3 (3) Fragment Instance Lifecycle Timings: - ExecTime: 518.160us - ExecTreeExecTime: 5.430us - OpenTime: 21s273ms - ExecTreeOpenTime: 21s100ms - PrepareTime: 34.513ms - ExecTreePrepareTime: 1.337ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 49 (49) - BlocksRecycled: 3 (3) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 32.00 MB (33554432) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=5):(Total: 12.939us, non-child: 12.939us, % non-child: 100.00%) - BytesSent: 0 - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1008.00 B (1008) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 203.660ms, non-child: 203.660ms, % non-child: 100.00%) - CodegenTime: 6.605ms - CompileTime: 44.020ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2068576) - NumFunctions: 89 (89) - NumInstructions: 1.98K (1981) - OptimizationTime: 129.206ms - PeakMemoryUsage: 990.50 KB (1014272) - PrepareTime: 29.848ms SORT_NODE (id=2):(Total: 21s101ms, non-child: 259.571us, % non-child: 0.00%) ExecOption: Codegen Enabled - InMemorySortTime: 1.264us - InitialRunsCreated: 1 (1) - PeakMemoryUsage: 24.01 MB (25174016) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SortDataSize: 0 - SpilledRuns: 0 (0) - TotalMergesPerformed: 0 (0) AGGREGATION_NODE (id=4):(Total: 21s101ms, non-child: 2.422ms, % non-child: 0.01%) ExecOption: Codegen Enabled - BuildTime: 7.137us - GetNewBlockTime: 168.803us - GetResultsTime: 0.000ns - HTResizeTime: 3.077us - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 10.30 MB (10799232) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 2.045us EXCHANGE_NODE (id=3):(Total: 21s098ms, non-child: 9.607us, % non-child: 0.00%) - ConvertRowBatchTime: 1.126us - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 RecvrSide: BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - FirstBatchArrivalWaitTime: 21s098ms - TotalBytesReceived: 0 - TotalGetBatchTime: 21s098ms - DataArrivalTimer: 21s098ms SenderSide: - DeserializeRowBatchTimer: 0.000ns - NumBatchesAccepted: 0 (0) - NumBatchesRejected: 0 (0) Instance 8c41d37ad1fc525e:2bf936bd0000000f (host=10.17.193.23:22000):(Total: 21s308ms, non-child: 3.741ms, % non-child: 0.02%) MemoryUsage(500.000ms): 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 32.06 MB (33618425) - PerHostPeakMemUsage: 822.83 MB (862796339) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 21s106ms - TotalNetworkSendTime: 1.049us - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 17 (17) - TotalThreadsTotalWallClockTime: 21s277ms - TotalThreadsSysTime: 2.000ms - TotalThreadsUserTime: 168.974ms - TotalThreadsVoluntaryContextSwitches: 2 (2) Fragment Instance Lifecycle Timings: - ExecTime: 531.556us - ExecTreeExecTime: 5.450us - OpenTime: 21s277ms - ExecTreeOpenTime: 21s108ms - PrepareTime: 30.929ms - ExecTreePrepareTime: 1.226ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 49 (49) - BlocksRecycled: 3 (3) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 32.00 MB (33554432) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=5):(Total: 14.118us, non-child: 14.118us, % non-child: 100.00%) - BytesSent: 0 - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1008.00 B (1008) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 195.760ms, non-child: 195.760ms, % non-child: 100.00%) - CodegenTime: 6.283ms - CompileTime: 42.264ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2068576) - NumFunctions: 89 (89) - NumInstructions: 1.98K (1981) - OptimizationTime: 126.348ms - PeakMemoryUsage: 990.50 KB (1014272) - PrepareTime: 26.576ms SORT_NODE (id=2):(Total: 21s109ms, non-child: 285.506us, % non-child: 0.00%) ExecOption: Codegen Enabled - InMemorySortTime: 889.000ns - InitialRunsCreated: 1 (1) - PeakMemoryUsage: 24.01 MB (25174016) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SortDataSize: 0 - SpilledRuns: 0 (0) - TotalMergesPerformed: 0 (0) AGGREGATION_NODE (id=4):(Total: 21s108ms, non-child: 2.584ms, % non-child: 0.01%) ExecOption: Codegen Enabled - BuildTime: 8.551us - GetNewBlockTime: 146.446us - GetResultsTime: 0.000ns - HTResizeTime: 4.379us - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 10.30 MB (10799232) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.662us EXCHANGE_NODE (id=3):(Total: 21s106ms, non-child: 8.554us, % non-child: 0.00%) - ConvertRowBatchTime: 1.076us - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 RecvrSide: BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - FirstBatchArrivalWaitTime: 21s106ms - TotalBytesReceived: 0 - TotalGetBatchTime: 21s106ms - DataArrivalTimer: 21s106ms SenderSide: - DeserializeRowBatchTimer: 0.000ns - NumBatchesAccepted: 0 (0) - NumBatchesRejected: 0 (0) Averaged Fragment F00:(Total: 20s394ms, non-child: 15.024ms, % non-child: 0.07%) split sizes: min: 4.21 GB, max: 4.71 GB, avg: 4.60 GB, stddev: 147.33 MB completion times: min:18s827ms max:21s318ms mean: 20s395ms stddev:689.597ms execution rates: min:225.84 MB/sec max:237.61 MB/sec mean:230.84 MB/sec stddev:3.37 MB/sec num instances: 14 - AverageThreadTokens: 10.97 - BloomFilterBytes: 0 - PeakMemoryUsage: 808.66 MB (847937495) - PerHostPeakMemUsage: 818.96 MB (858741807) - RowsProduced: 4 (4) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1.787ms - TotalStorageWaitTime: 739.221ms - TotalThreadsInvoluntaryContextSwitches: 11.76K (11757) - TotalThreadsTotalWallClockTime: 3m43s - TotalThreadsSysTime: 764.734ms - TotalThreadsUserTime: 43s761ms - TotalThreadsVoluntaryContextSwitches: 123.78K (123778) Fragment Instance Lifecycle Timings: - ExecTime: 20s117ms - ExecTreeExecTime: 20s109ms - OpenTime: 240.474ms - ExecTreeOpenTime: 67.630us - PrepareTime: 35.683ms - ExecTreePrepareTime: 1.456ms DataStreamSender (dst_id=3):(Total: 77.382us, non-child: 77.382us, % non-child: 100.00%) - BytesSent: 595.00 B (595) - OverallThroughput: 7.79 MB/sec - PeakMemoryUsage: 27.59 KB (28256) - RowsReturned: 4 (4) - SerializeBatchTime: 44.749us - UncompressedRowBatchSize: 595.00 B (595) CodeGen:(Total: 267.752ms, non-child: 267.752ms, % non-child: 100.00%) - CodegenTime: 17.079ms - CompileTime: 62.599ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2068576) - NumFunctions: 139 (139) - NumInstructions: 4.38K (4382) - OptimizationTime: 177.043ms - PeakMemoryUsage: 2.14 MB (2243584) - PrepareTime: 27.512ms AGGREGATION_NODE (id=1):(Total: 20s111ms, non-child: 19s605ms, % non-child: 97.49%) - GetNewBlockTime: 157.468us - GetResultsTime: 22.230us - HTResizeTime: 912.139us - HashBuckets: 8.19K (8192) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.44 MB (2557804) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 4 (4) - RowsReturnedRate: 0 - StreamingTime: 19s318ms - UnpinTime: 0.000ns HDFS_SCAN_NODE (id=0):(Total: 505.367ms, non-child: 505.367ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.05 - AverageScannerThreadConcurrency: 10.08 - BytesRead: 1.07 GB (1145053905) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.07 GB (1145053905) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.07 GB (1145053905) - CachedFileHandlesHitCount: 243 (243) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 2s220ms - MaxCompressedTextFileLength: 0 - NumColumns: 7 (7) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 8 (8) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 12 (12) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 806.98 MB (846174825) - PerReadThreadRawHdfsThroughput: 1.07 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 32.364ms - RowBatchQueuePutWaitTime: 3m - RowsRead: 128.57M (128570649) - RowsReturned: 126.76M (126762585) - RowsReturnedRate: 252.90 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 9.71K (9714) - ScannerThreadsTotalWallClockTime: 3m23s - MaterializeTupleTime(*): 19s217ms - ScannerThreadsSysTime: 493.276ms - ScannerThreadsUserTime: 23s713ms - ScannerThreadsVoluntaryContextSwitches: 123.74K (123744) - TotalRawHdfsReadTime(*): 1s004ms - TotalReadThroughput: 53.57 MB/sec Fragment F00: Instance 8c41d37ad1fc525e:2bf936bd0000000d (host=10.17.193.17:22000):(Total: 21s316ms, non-child: 19.217ms, % non-child: 0.09%) Hdfs split stats (:<# splits>/): 8:2/506.78 MB 7:1/253.38 MB 6:2/506.80 MB 10:1/253.39 MB 9:3/760.16 MB 3:3/760.19 MB 4:3/760.18 MB 2:4/1013.56 MB MemoryUsage(500.000ms): 1.31 MB, 812.20 MB, 812.05 MB, 811.88 MB, 811.97 MB, 812.13 MB, 764.30 MB, 716.55 MB, 716.70 MB, 716.61 MB, 716.70 MB, 716.70 MB, 700.88 MB, 621.39 MB, 621.22 MB, 621.55 MB, 621.54 MB, 621.47 MB, 621.39 MB, 525.68 MB, 525.60 MB, 485.84 MB, 430.43 MB, 430.43 MB, 430.51 MB, 334.62 MB, 333.89 MB, 479.90 MB, 479.82 MB, 479.82 MB, 463.93 MB, 424.28 MB, 424.43 MB, 424.36 MB, 368.45 MB, 368.68 MB, 368.68 MB, 368.60 MB, 312.90 MB, 273.05 MB, 257.18 MB, 217.34 MB, 42.02 MB ThreadUsage(500.000ms): 1, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 2 - AverageThreadTokens: 10.72 - BloomFilterBytes: 0 - PeakMemoryUsage: 812.37 MB (851827958) - PerHostPeakMemUsage: 822.67 MB (862631663) - RowsProduced: 4 (4) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1.789ms - TotalStorageWaitTime: 732.616ms - TotalThreadsInvoluntaryContextSwitches: 12.81K (12806) - TotalThreadsTotalWallClockTime: 3m54s - TotalThreadsSysTime: 835.867ms - TotalThreadsUserTime: 46s372ms - TotalThreadsVoluntaryContextSwitches: 126.58K (126579) Fragment Instance Lifecycle Timings: - ExecTime: 21s033ms - ExecTreeExecTime: 21s022ms - OpenTime: 243.797ms - ExecTreeOpenTime: 72.421us - PrepareTime: 39.440ms - ExecTreePrepareTime: 1.402ms DataStreamSender (dst_id=3):(Total: 68.797us, non-child: 68.797us, % non-child: 100.00%) - BytesSent: 595.00 B (595) - OverallThroughput: 8.25 MB/sec - PeakMemoryUsage: 27.59 KB (28256) - RowsReturned: 4 (4) - SerializeBatchTime: 38.355us - UncompressedRowBatchSize: 595.00 B (595) CodeGen:(Total: 273.131ms, non-child: 273.131ms, % non-child: 100.00%) - CodegenTime: 19.402ms - CompileTime: 63.601ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2068576) - NumFunctions: 139 (139) - NumInstructions: 4.38K (4382) - OptimizationTime: 179.332ms - PeakMemoryUsage: 2.14 MB (2243584) - PrepareTime: 29.608ms AGGREGATION_NODE (id=1):(Total: 21s023ms, non-child: 20s479ms, % non-child: 97.41%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 183.273us - GetResultsTime: 22.017us - HTResizeTime: 1.134ms - HashBuckets: 8.19K (8192) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.44 MB (2557804) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 4 (4) - RowsReturnedRate: 0 - StreamingTime: 20s169ms - UnpinTime: 0.000ns HDFS_SCAN_NODE (id=0):(Total: 544.399ms, non-child: 544.399ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 8:2/506.78 MB 7:1/253.38 MB 6:2/506.80 MB 10:1/253.39 MB 9:3/760.16 MB 3:3/760.19 MB 4:3/760.18 MB 2:4/1013.56 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 19 out of 19 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:133 BytesRead(500.000ms): 0, 705.39 MB, 705.39 MB, 705.39 MB, 705.39 MB, 705.39 MB, 705.39 MB, 705.39 MB, 705.39 MB, 705.39 MB, 705.39 MB, 705.39 MB, 705.39 MB, 705.39 MB, 705.39 MB, 705.39 MB, 705.39 MB, 705.39 MB, 705.39 MB, 705.39 MB, 705.39 MB, 705.39 MB, 705.39 MB, 705.39 MB, 705.39 MB, 705.39 MB, 705.39 MB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB - FooterProcessingTime: (Avg: 1.549ms ; Min: 464.425us ; Max: 3.040ms ; Number of samples: 19) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 9.95 - BytesRead: 1.09 GB (1171118566) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.09 GB (1171118566) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.09 GB (1171118566) - CachedFileHandlesHitCount: 247 (247) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 2s376ms - MaxCompressedTextFileLength: 0 - NumColumns: 7 (7) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 8 (8) - NumRowGroups: 19 (19) - NumScannerThreadsStarted: 12 (12) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 810.69 MB (850070601) - PerReadThreadRawHdfsThroughput: 1.09 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 31.502ms - RowBatchQueuePutWaitTime: 3m8s - RowsRead: 131.50M (131502508) - RowsReturned: 129.65M (129654866) - RowsReturnedRate: 238.16 M/sec - ScanRangesComplete: 19 (19) - ScannerThreadsInvoluntaryContextSwitches: 10.68K (10680) - ScannerThreadsTotalWallClockTime: 3m32s - MaterializeTupleTime(*): 20s709ms - ScannerThreadsSysTime: 518.914ms - ScannerThreadsUserTime: 25s452ms - ScannerThreadsVoluntaryContextSwitches: 126.55K (126545) - TotalRawHdfsReadTime(*): 1s001ms - TotalReadThroughput: 51.95 MB/sec Instance 8c41d37ad1fc525e:2bf936bd00000008 (host=10.17.193.10:22000):(Total: 21s184ms, non-child: 14.072ms, % non-child: 0.07%) Hdfs split stats (:<# splits>/): 9:1/253.38 MB 2:2/506.76 MB 5:2/506.79 MB 6:2/506.82 MB 1:3/760.20 MB 8:2/506.79 MB 7:2/506.81 MB 0:2/506.79 MB 4:2/506.83 MB 3:1/253.39 MB MemoryUsage(500.000ms): 795.92 MB, 812.21 MB, 812.05 MB, 812.05 MB, 812.05 MB, 811.88 MB, 724.56 MB, 716.70 MB, 716.86 MB, 716.86 MB, 716.78 MB, 716.70 MB, 676.73 MB, 621.25 MB, 621.33 MB, 621.25 MB, 621.40 MB, 621.25 MB, 589.20 MB, 525.49 MB, 525.57 MB, 485.81 MB, 430.56 MB, 430.24 MB, 430.48 MB, 334.70 MB, 333.56 MB, 479.82 MB, 479.82 MB, 479.90 MB, 440.09 MB, 424.20 MB, 424.35 MB, 424.20 MB, 368.63 MB, 368.79 MB, 368.79 MB, 312.74 MB, 312.82 MB, 257.26 MB, 257.26 MB, 201.12 MB ThreadUsage(500.000ms): 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8 - AverageThreadTokens: 11.21 - BloomFilterBytes: 0 - PeakMemoryUsage: 812.45 MB (851910776) - PerHostPeakMemUsage: 822.76 MB (862722974) - RowsProduced: 4 (4) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1.631ms - TotalStorageWaitTime: 741.685ms - TotalThreadsInvoluntaryContextSwitches: 12.07K (12074) - TotalThreadsTotalWallClockTime: 3m54s - TotalThreadsSysTime: 828.868ms - TotalThreadsUserTime: 50s417ms - TotalThreadsVoluntaryContextSwitches: 126.73K (126727) Fragment Instance Lifecycle Timings: - ExecTime: 20s908ms - ExecTreeExecTime: 20s901ms - OpenTime: 240.884ms - ExecTreeOpenTime: 67.684us - PrepareTime: 35.388ms - ExecTreePrepareTime: 1.292ms DataStreamSender (dst_id=3):(Total: 54.269us, non-child: 54.269us, % non-child: 100.00%) - BytesSent: 595.00 B (595) - OverallThroughput: 10.46 MB/sec - PeakMemoryUsage: 27.59 KB (28256) - RowsReturned: 4 (4) - SerializeBatchTime: 35.491us - UncompressedRowBatchSize: 595.00 B (595) CodeGen:(Total: 268.266ms, non-child: 268.266ms, % non-child: 100.00%) - CodegenTime: 17.011ms - CompileTime: 62.277ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2068576) - NumFunctions: 139 (139) - NumInstructions: 4.38K (4382) - OptimizationTime: 177.703ms - PeakMemoryUsage: 2.14 MB (2243584) - PrepareTime: 27.580ms AGGREGATION_NODE (id=1):(Total: 20s902ms, non-child: 20s285ms, % non-child: 97.05%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 168.259us - GetResultsTime: 20.483us - HTResizeTime: 1.203ms - HashBuckets: 8.19K (8192) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.44 MB (2557804) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 4 (4) - RowsReturnedRate: 0 - StreamingTime: 19s977ms - UnpinTime: 0.000ns HDFS_SCAN_NODE (id=0):(Total: 617.244ms, non-child: 617.244ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 9:1/253.38 MB 2:2/506.76 MB 5:2/506.79 MB 6:2/506.82 MB 1:3/760.20 MB 8:2/506.79 MB 7:2/506.81 MB 0:2/506.79 MB 4:2/506.83 MB 3:1/253.39 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 19 out of 19 Hdfs Read Thread Concurrency Bucket: 0:97.62% 1:2.381% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:133 BytesRead(500.000ms): 684.21 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB - FooterProcessingTime: (Avg: 1.462ms ; Min: 432.278us ; Max: 2.955ms ; Number of samples: 19) - AverageHdfsReadThreadConcurrency: 0.02 - AverageScannerThreadConcurrency: 10.21 - BytesRead: 1.09 GB (1171111928) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.09 GB (1171111928) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.09 GB (1171111928) - CachedFileHandlesHitCount: 247 (247) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 2s779ms - MaxCompressedTextFileLength: 0 - NumColumns: 7 (7) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 10 (10) - NumRowGroups: 19 (19) - NumScannerThreadsStarted: 12 (12) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 810.77 MB (850153419) - PerReadThreadRawHdfsThroughput: 1014.74 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 38.914ms - RowBatchQueuePutWaitTime: 3m3s - RowsRead: 131.50M (131502268) - RowsReturned: 129.65M (129654003) - RowsReturnedRate: 210.05 M/sec - ScanRangesComplete: 19 (19) - ScannerThreadsInvoluntaryContextSwitches: 9.93K (9934) - ScannerThreadsTotalWallClockTime: 3m32s - MaterializeTupleTime(*): 24s728ms - ScannerThreadsSysTime: 494.919ms - ScannerThreadsUserTime: 29s646ms - ScannerThreadsVoluntaryContextSwitches: 126.69K (126693) - TotalRawHdfsReadTime(*): 1s100ms - TotalReadThroughput: 53.18 MB/sec Instance 8c41d37ad1fc525e:2bf936bd0000000c (host=10.17.193.24:22000):(Total: 21s090ms, non-child: 14.928ms, % non-child: 0.07%) Hdfs split stats (:<# splits>/): 10:1/253.39 MB 7:2/487.75 MB 3:1/253.39 MB 5:1/253.39 MB 8:3/760.21 MB 9:1/253.38 MB 4:6/1.48 GB 1:4/1013.56 MB MemoryUsage(500.000ms): 420.92 MB, 807.89 MB, 808.29 MB, 807.88 MB, 807.88 MB, 807.97 MB, 744.48 MB, 712.62 MB, 712.78 MB, 712.70 MB, 712.78 MB, 712.78 MB, 672.92 MB, 617.30 MB, 617.62 MB, 617.31 MB, 617.61 MB, 617.38 MB, 593.34 MB, 522.00 MB, 521.60 MB, 474.05 MB, 426.43 MB, 426.35 MB, 410.52 MB, 374.19 MB, 453.36 MB, 479.90 MB, 479.97 MB, 480.13 MB, 424.36 MB, 424.28 MB, 424.35 MB, 408.46 MB, 368.52 MB, 368.60 MB, 360.52 MB, 328.79 MB, 296.84 MB, 265.01 MB, 241.15 MB, 174.43 MB ThreadUsage(500.000ms): 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 7 - AverageThreadTokens: 11.19 - BloomFilterBytes: 0 - PeakMemoryUsage: 808.45 MB (847716178) - PerHostPeakMemUsage: 818.75 MB (858519883) - RowsProduced: 4 (4) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1.957ms - TotalStorageWaitTime: 840.154ms - TotalThreadsInvoluntaryContextSwitches: 12.61K (12605) - TotalThreadsTotalWallClockTime: 3m52s - TotalThreadsSysTime: 826.868ms - TotalThreadsUserTime: 45s619ms - TotalThreadsVoluntaryContextSwitches: 126.11K (126113) Fragment Instance Lifecycle Timings: - ExecTime: 20s817ms - ExecTreeExecTime: 20s808ms - OpenTime: 240.651ms - ExecTreeOpenTime: 65.238us - PrepareTime: 32.623ms - ExecTreePrepareTime: 1.927ms DataStreamSender (dst_id=3):(Total: 50.448us, non-child: 50.448us, % non-child: 100.00%) - BytesSent: 595.00 B (595) - OverallThroughput: 11.25 MB/sec - PeakMemoryUsage: 27.59 KB (28256) - RowsReturned: 4 (4) - SerializeBatchTime: 33.596us - UncompressedRowBatchSize: 595.00 B (595) CodeGen:(Total: 264.718ms, non-child: 264.718ms, % non-child: 100.00%) - CodegenTime: 16.574ms - CompileTime: 62.804ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2068576) - NumFunctions: 139 (139) - NumInstructions: 4.38K (4382) - OptimizationTime: 177.057ms - PeakMemoryUsage: 2.14 MB (2243584) - PrepareTime: 24.290ms AGGREGATION_NODE (id=1):(Total: 20s810ms, non-child: 20s269ms, % non-child: 97.40%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 151.107us - GetResultsTime: 19.614us - HTResizeTime: 788.823us - HashBuckets: 8.19K (8192) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.44 MB (2557804) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 4 (4) - RowsReturnedRate: 0 - StreamingTime: 19s963ms - UnpinTime: 0.000ns HDFS_SCAN_NODE (id=0):(Total: 541.353ms, non-child: 541.353ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 10:1/253.39 MB 7:2/487.75 MB 3:1/253.39 MB 5:1/253.39 MB 8:3/760.21 MB 9:1/253.38 MB 4:6/1.48 GB 1:4/1013.56 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 19 out of 19 Hdfs Read Thread Concurrency Bucket: 0:97.62% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:2.381% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:133 BytesRead(500.000ms): 308.76 MB, 700.97 MB, 700.97 MB, 700.97 MB, 700.97 MB, 700.97 MB, 700.97 MB, 700.97 MB, 700.97 MB, 700.97 MB, 700.97 MB, 700.97 MB, 700.97 MB, 700.97 MB, 700.97 MB, 700.97 MB, 700.97 MB, 700.97 MB, 700.97 MB, 700.97 MB, 700.97 MB, 700.97 MB, 700.97 MB, 700.97 MB, 700.97 MB, 759.76 MB, 877.32 MB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB - FooterProcessingTime: (Avg: 1.833ms ; Min: 849.136us ; Max: 5.184ms ; Number of samples: 19) - AverageHdfsReadThreadConcurrency: 0.17 - AverageScannerThreadConcurrency: 10.19 - BytesRead: 1.09 GB (1166485155) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.09 GB (1166485155) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.09 GB (1166485155) - CachedFileHandlesHitCount: 246 (246) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 2s278ms - MaxCompressedTextFileLength: 0 - NumColumns: 7 (7) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 8 (8) - NumRowGroups: 19 (19) - NumScannerThreadsStarted: 12 (12) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 806.77 MB (845958821) - PerReadThreadRawHdfsThroughput: 1.06 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 28.373ms - RowBatchQueuePutWaitTime: 3m7s - RowsRead: 130.98M (130981145) - RowsReturned: 129.14M (129141301) - RowsReturnedRate: 238.55 M/sec - ScanRangesComplete: 19 (19) - ScannerThreadsInvoluntaryContextSwitches: 10.50K (10497) - ScannerThreadsTotalWallClockTime: 3m31s - MaterializeTupleTime(*): 19s836ms - ScannerThreadsSysTime: 562.908ms - ScannerThreadsUserTime: 24s858ms - ScannerThreadsVoluntaryContextSwitches: 126.08K (126078) - TotalRawHdfsReadTime(*): 1s027ms - TotalReadThroughput: 52.97 MB/sec Instance 8c41d37ad1fc525e:2bf936bd00000005 (host=10.17.193.20:22000):(Total: 20s940ms, non-child: 15.594ms, % non-child: 0.07%) Hdfs split stats (:<# splits>/): 4:1/253.39 MB 1:1/253.41 MB 8:1/253.40 MB 10:1/253.38 MB 5:1/253.39 MB 9:3/760.18 MB 7:2/506.77 MB 6:2/506.79 MB 3:6/1.46 GB 0:1/253.39 MB MemoryUsage(500.000ms): 798.90 MB, 807.21 MB, 806.96 MB, 806.97 MB, 807.21 MB, 807.13 MB, 711.62 MB, 711.70 MB, 711.70 MB, 711.86 MB, 711.62 MB, 711.70 MB, 632.40 MB, 616.20 MB, 616.20 MB, 616.51 MB, 616.20 MB, 616.28 MB, 560.81 MB, 520.71 MB, 520.79 MB, 433.48 MB, 425.70 MB, 425.61 MB, 414.15 MB, 374.30 MB, 573.99 MB, 479.97 MB, 472.02 MB, 471.87 MB, 424.43 MB, 424.51 MB, 416.51 MB, 400.49 MB, 368.55 MB, 360.74 MB, 360.73 MB, 305.04 MB, 289.01 MB, 249.34 MB, 206.60 MB, 94.46 MB ThreadUsage(500.000ms): 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 12, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 7, 4 - AverageThreadTokens: 11.07 - BloomFilterBytes: 0 - PeakMemoryUsage: 807.52 MB (846751119) - PerHostPeakMemUsage: 817.83 MB (857554824) - RowsProduced: 4 (4) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1.910ms - TotalStorageWaitTime: 728.760ms - TotalThreadsInvoluntaryContextSwitches: 13.03K (13032) - TotalThreadsTotalWallClockTime: 3m49s - TotalThreadsSysTime: 926.854ms - TotalThreadsUserTime: 45s986ms - TotalThreadsVoluntaryContextSwitches: 126.00K (126001) Fragment Instance Lifecycle Timings: - ExecTime: 20s667ms - ExecTreeExecTime: 20s658ms - OpenTime: 240.113ms - ExecTreeOpenTime: 72.770us - PrepareTime: 33.591ms - ExecTreePrepareTime: 1.411ms DataStreamSender (dst_id=3):(Total: 70.609us, non-child: 70.609us, % non-child: 100.00%) - BytesSent: 595.00 B (595) - OverallThroughput: 8.04 MB/sec - PeakMemoryUsage: 27.59 KB (28256) - RowsReturned: 4 (4) - SerializeBatchTime: 39.979us - UncompressedRowBatchSize: 595.00 B (595) CodeGen:(Total: 265.596ms, non-child: 265.596ms, % non-child: 100.00%) - CodegenTime: 16.714ms - CompileTime: 63.143ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2068576) - NumFunctions: 139 (139) - NumInstructions: 4.38K (4382) - OptimizationTime: 176.150ms - PeakMemoryUsage: 2.14 MB (2243584) - PrepareTime: 25.725ms AGGREGATION_NODE (id=1):(Total: 20s659ms, non-child: 20s122ms, % non-child: 97.40%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 125.303us - GetResultsTime: 23.753us - HTResizeTime: 1.396ms - HashBuckets: 8.19K (8192) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.44 MB (2557804) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 4 (4) - RowsReturnedRate: 0 - StreamingTime: 19s825ms - UnpinTime: 0.000ns HDFS_SCAN_NODE (id=0):(Total: 537.326ms, non-child: 537.326ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:1/253.39 MB 1:1/253.41 MB 8:1/253.40 MB 10:1/253.38 MB 5:1/253.39 MB 9:3/760.18 MB 7:2/506.77 MB 6:2/506.79 MB 3:6/1.46 GB 0:1/253.39 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 19 out of 19 Hdfs Read Thread Concurrency Bucket: 0:95.24% 1:4.762% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:133 BytesRead(500.000ms): 686.24 MB, 699.42 MB, 699.42 MB, 699.42 MB, 699.42 MB, 699.42 MB, 699.42 MB, 699.42 MB, 699.42 MB, 699.42 MB, 699.42 MB, 699.42 MB, 699.42 MB, 699.42 MB, 699.42 MB, 699.42 MB, 699.42 MB, 699.42 MB, 699.42 MB, 699.42 MB, 699.42 MB, 699.42 MB, 699.42 MB, 699.42 MB, 758.20 MB, 758.20 MB, 1.07 GB, 1.08 GB, 1.08 GB, 1.08 GB, 1.08 GB, 1.08 GB, 1.08 GB, 1.08 GB, 1.08 GB, 1.08 GB, 1.08 GB, 1.08 GB, 1.08 GB, 1.08 GB, 1.08 GB, 1.08 GB - FooterProcessingTime: (Avg: 2.438ms ; Min: 500.264us ; Max: 9.046ms ; Number of samples: 19) - AverageHdfsReadThreadConcurrency: 0.05 - AverageScannerThreadConcurrency: 10.07 - BytesRead: 1.08 GB (1164848599) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.08 GB (1164848599) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.08 GB (1164848599) - CachedFileHandlesHitCount: 246 (246) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 2s317ms - MaxCompressedTextFileLength: 0 - NumColumns: 7 (7) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 10 (10) - NumRowGroups: 19 (19) - NumScannerThreadsStarted: 12 (12) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 805.78 MB (844919383) - PerReadThreadRawHdfsThroughput: 1.04 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 34.377ms - RowBatchQueuePutWaitTime: 3m4s - RowsRead: 130.80M (130797756) - RowsReturned: 128.96M (128958843) - RowsReturnedRate: 240.00 M/sec - ScanRangesComplete: 19 (19) - ScannerThreadsInvoluntaryContextSwitches: 10.94K (10941) - ScannerThreadsTotalWallClockTime: 3m29s - MaterializeTupleTime(*): 20s327ms - ScannerThreadsSysTime: 621.900ms - ScannerThreadsUserTime: 25s425ms - ScannerThreadsVoluntaryContextSwitches: 125.97K (125969) - TotalRawHdfsReadTime(*): 1s044ms - TotalReadThroughput: 52.90 MB/sec Instance 8c41d37ad1fc525e:2bf936bd00000002 (host=10.17.193.16:22000):(Total: 20s880ms, non-child: 15.921ms, % non-child: 0.08%) Hdfs split stats (:<# splits>/): 5:1/253.41 MB 7:2/506.81 MB 3:2/506.77 MB 10:1/253.39 MB 2:1/253.39 MB 9:2/506.79 MB 6:3/760.19 MB 1:3/760.21 MB 0:4/1013.61 MB MemoryUsage(500.000ms): 1.31 MB, 812.05 MB, 811.97 MB, 811.97 MB, 811.97 MB, 812.05 MB, 796.32 MB, 716.70 MB, 716.70 MB, 716.62 MB, 716.54 MB, 716.54 MB, 685.03 MB, 621.58 MB, 621.20 MB, 621.20 MB, 621.12 MB, 621.43 MB, 541.60 MB, 525.76 MB, 525.68 MB, 430.59 MB, 430.51 MB, 430.59 MB, 350.37 MB, 334.18 MB, 533.36 MB, 479.90 MB, 479.89 MB, 479.74 MB, 424.36 MB, 424.27 MB, 424.35 MB, 392.49 MB, 368.52 MB, 368.52 MB, 368.52 MB, 312.79 MB, 296.84 MB, 257.23 MB, 225.23 MB, 122.82 MB ThreadUsage(500.000ms): 1, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 10, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 6 - AverageThreadTokens: 10.81 - BloomFilterBytes: 0 - PeakMemoryUsage: 812.45 MB (851910366) - PerHostPeakMemUsage: 822.75 MB (862714071) - RowsProduced: 4 (4) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1.758ms - TotalStorageWaitTime: 723.688ms - TotalThreadsInvoluntaryContextSwitches: 13.00K (12997) - TotalThreadsTotalWallClockTime: 3m49s - TotalThreadsSysTime: 842.865ms - TotalThreadsUserTime: 46s070ms - TotalThreadsVoluntaryContextSwitches: 126.67K (126666) Fragment Instance Lifecycle Timings: - ExecTime: 20s601ms - ExecTreeExecTime: 20s592ms - OpenTime: 243.040ms - ExecTreeOpenTime: 70.204us - PrepareTime: 36.342ms - ExecTreePrepareTime: 1.433ms DataStreamSender (dst_id=3):(Total: 72.384us, non-child: 72.384us, % non-child: 100.00%) - BytesSent: 595.00 B (595) - OverallThroughput: 7.84 MB/sec - PeakMemoryUsage: 27.59 KB (28256) - RowsReturned: 4 (4) - SerializeBatchTime: 38.108us - UncompressedRowBatchSize: 595.00 B (595) CodeGen:(Total: 270.732ms, non-child: 270.732ms, % non-child: 100.00%) - CodegenTime: 17.298ms - CompileTime: 63.404ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2068576) - NumFunctions: 139 (139) - NumInstructions: 4.38K (4382) - OptimizationTime: 178.792ms - PeakMemoryUsage: 2.14 MB (2243584) - PrepareTime: 27.907ms AGGREGATION_NODE (id=1):(Total: 20s593ms, non-child: 20s044ms, % non-child: 97.33%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 157.724us - GetResultsTime: 20.040us - HTResizeTime: 826.067us - HashBuckets: 8.19K (8192) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.44 MB (2557804) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 4 (4) - RowsReturnedRate: 0 - StreamingTime: 19s731ms - UnpinTime: 0.000ns HDFS_SCAN_NODE (id=0):(Total: 549.204ms, non-child: 549.204ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:1/253.41 MB 7:2/506.81 MB 3:2/506.77 MB 10:1/253.39 MB 2:1/253.39 MB 9:2/506.79 MB 6:3/760.19 MB 1:3/760.21 MB 0:4/1013.61 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 19 out of 19 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:133 BytesRead(500.000ms): 0, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB - FooterProcessingTime: (Avg: 1.686ms ; Min: 760.494us ; Max: 3.774ms ; Number of samples: 19) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 10.05 - BytesRead: 1.09 GB (1171114598) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.09 GB (1171114598) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.09 GB (1171114598) - CachedFileHandlesHitCount: 247 (247) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 2s378ms - MaxCompressedTextFileLength: 0 - NumColumns: 7 (7) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 9 (9) - NumRowGroups: 19 (19) - NumScannerThreadsStarted: 12 (12) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 810.77 MB (850153009) - PerReadThreadRawHdfsThroughput: 1.07 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 34.649ms - RowBatchQueuePutWaitTime: 3m3s - RowsRead: 131.50M (131502362) - RowsReturned: 129.65M (129654681) - RowsReturnedRate: 236.08 M/sec - ScanRangesComplete: 19 (19) - ScannerThreadsInvoluntaryContextSwitches: 10.91K (10912) - ScannerThreadsTotalWallClockTime: 3m28s - MaterializeTupleTime(*): 20s876ms - ScannerThreadsSysTime: 539.911ms - ScannerThreadsUserTime: 25s572ms - ScannerThreadsVoluntaryContextSwitches: 126.63K (126632) - TotalRawHdfsReadTime(*): 1s023ms - TotalReadThroughput: 53.18 MB/sec Instance 8c41d37ad1fc525e:2bf936bd00000006 (host=10.17.193.25:22000):(Total: 20s664ms, non-child: 15.223ms, % non-child: 0.07%) Hdfs split stats (:<# splits>/): 4:1/253.42 MB 8:2/506.78 MB 6:2/506.78 MB 9:2/506.78 MB 1:3/512.04 MB 3:5/1.24 GB 7:2/506.78 MB 0:3/760.19 MB MemoryUsage(500.000ms): 1.31 MB, 812.13 MB, 811.97 MB, 812.12 MB, 812.29 MB, 812.12 MB, 756.35 MB, 716.70 MB, 716.78 MB, 716.77 MB, 716.62 MB, 716.62 MB, 653.40 MB, 621.54 MB, 621.54 MB, 621.38 MB, 621.62 MB, 621.39 MB, 565.68 MB, 525.79 MB, 525.87 MB, 446.42 MB, 430.86 MB, 430.54 MB, 358.46 MB, 334.25 MB, 559.43 MB, 479.97 MB, 479.90 MB, 480.13 MB, 424.12 MB, 424.43 MB, 424.28 MB, 368.70 MB, 368.71 MB, 368.71 MB, 368.63 MB, 312.90 MB, 265.12 MB, 257.10 MB, 209.45 MB ThreadUsage(500.000ms): 1, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 11, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8 - AverageThreadTokens: 10.95 - BloomFilterBytes: 0 - PeakMemoryUsage: 812.32 MB (851776425) - PerHostPeakMemUsage: 822.62 MB (862580130) - RowsProduced: 4 (4) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1.828ms - TotalStorageWaitTime: 727.703ms - TotalThreadsInvoluntaryContextSwitches: 9.82K (9824) - TotalThreadsTotalWallClockTime: 3m47s - TotalThreadsSysTime: 580.905ms - TotalThreadsUserTime: 39s663ms - TotalThreadsVoluntaryContextSwitches: 126.62K (126618) Fragment Instance Lifecycle Timings: - ExecTime: 20s387ms - ExecTreeExecTime: 20s379ms - OpenTime: 240.960ms - ExecTreeOpenTime: 58.312us - PrepareTime: 35.845ms - ExecTreePrepareTime: 1.417ms DataStreamSender (dst_id=3):(Total: 64.349us, non-child: 64.349us, % non-child: 100.00%) - BytesSent: 595.00 B (595) - OverallThroughput: 8.82 MB/sec - PeakMemoryUsage: 27.59 KB (28256) - RowsReturned: 4 (4) - SerializeBatchTime: 33.255us - UncompressedRowBatchSize: 595.00 B (595) CodeGen:(Total: 268.516ms, non-child: 268.516ms, % non-child: 100.00%) - CodegenTime: 16.982ms - CompileTime: 62.886ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2068576) - NumFunctions: 139 (139) - NumInstructions: 4.38K (4382) - OptimizationTime: 177.259ms - PeakMemoryUsage: 2.14 MB (2243584) - PrepareTime: 27.797ms AGGREGATION_NODE (id=1):(Total: 20s381ms, non-child: 19s958ms, % non-child: 97.92%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 151.147us - GetResultsTime: 20.889us - HTResizeTime: 1.130ms - HashBuckets: 8.19K (8192) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.44 MB (2557804) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 4 (4) - RowsReturnedRate: 0 - StreamingTime: 19s684ms - UnpinTime: 0.000ns HDFS_SCAN_NODE (id=0):(Total: 422.913ms, non-child: 422.913ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:1/253.42 MB 8:2/506.78 MB 6:2/506.78 MB 9:2/506.78 MB 1:3/512.04 MB 3:5/1.24 GB 7:2/506.78 MB 0:3/760.19 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 20 out of 20 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:140 BytesRead(500.000ms): 0, 705.39 MB, 705.39 MB, 705.39 MB, 705.39 MB, 705.39 MB, 705.39 MB, 705.39 MB, 705.39 MB, 705.39 MB, 705.39 MB, 705.39 MB, 705.39 MB, 705.39 MB, 705.39 MB, 705.39 MB, 705.39 MB, 705.39 MB, 705.39 MB, 705.39 MB, 705.39 MB, 705.39 MB, 705.39 MB, 705.39 MB, 705.39 MB, 705.39 MB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB - FooterProcessingTime: (Avg: 1.761ms ; Min: 468.687us ; Max: 6.123ms ; Number of samples: 20) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 10.20 - BytesRead: 1.09 GB (1172468261) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.09 GB (1172468261) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.09 GB (1172468261) - CachedFileHandlesHitCount: 255 (255) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 1s893ms - MaxCompressedTextFileLength: 0 - NumColumns: 7 (7) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 8 (8) - NumRowGroups: 20 (20) - NumScannerThreadsStarted: 12 (12) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 810.64 MB (850019068) - PerReadThreadRawHdfsThroughput: 1.15 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 27.975ms - RowBatchQueuePutWaitTime: 3m8s - RowsRead: 131.63M (131633679) - RowsReturned: 129.78M (129779873) - RowsReturnedRate: 306.87 M/sec - ScanRangesComplete: 20 (20) - ScannerThreadsInvoluntaryContextSwitches: 7.76K (7758) - ScannerThreadsTotalWallClockTime: 3m27s - MaterializeTupleTime(*): 15s620ms - ScannerThreadsSysTime: 335.942ms - ScannerThreadsUserTime: 19s312ms - ScannerThreadsVoluntaryContextSwitches: 126.59K (126587) - TotalRawHdfsReadTime(*): 949.776ms - TotalReadThroughput: 54.54 MB/sec Instance 8c41d37ad1fc525e:2bf936bd0000000a (host=10.17.193.22:22000):(Total: 20s604ms, non-child: 13.734ms, % non-child: 0.07%) Hdfs split stats (:<# splits>/): 10:1/253.39 MB 8:3/760.20 MB 1:2/506.78 MB 3:3/760.20 MB 7:2/506.77 MB 2:2/506.80 MB 5:1/253.40 MB 0:5/1.24 GB MemoryUsage(500.000ms): 3.45 MB, 811.82 MB, 811.89 MB, 812.13 MB, 812.21 MB, 812.05 MB, 796.24 MB, 716.54 MB, 716.86 MB, 716.70 MB, 716.78 MB, 716.70 MB, 708.78 MB, 621.39 MB, 621.54 MB, 621.38 MB, 621.38 MB, 621.46 MB, 621.47 MB, 525.63 MB, 525.78 MB, 486.10 MB, 430.30 MB, 430.70 MB, 422.46 MB, 342.62 MB, 340.08 MB, 479.97 MB, 479.97 MB, 479.90 MB, 424.28 MB, 424.20 MB, 424.43 MB, 408.49 MB, 368.60 MB, 368.68 MB, 368.68 MB, 320.79 MB, 289.06 MB, 257.07 MB, 209.07 MB, 5.26 MB ThreadUsage(500.000ms): 1, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 1 - AverageThreadTokens: 10.76 - BloomFilterBytes: 0 - PeakMemoryUsage: 812.45 MB (851911143) - PerHostPeakMemUsage: 822.75 MB (862714848) - RowsProduced: 4 (4) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1.806ms - TotalStorageWaitTime: 910.970ms - TotalThreadsInvoluntaryContextSwitches: 11.85K (11848) - TotalThreadsTotalWallClockTime: 3m47s - TotalThreadsSysTime: 748.879ms - TotalThreadsUserTime: 42s501ms - TotalThreadsVoluntaryContextSwitches: 126.42K (126420) Fragment Instance Lifecycle Timings: - ExecTime: 20s328ms - ExecTreeExecTime: 20s321ms - OpenTime: 238.742ms - ExecTreeOpenTime: 63.210us - PrepareTime: 36.792ms - ExecTreePrepareTime: 1.431ms DataStreamSender (dst_id=3):(Total: 91.648us, non-child: 91.648us, % non-child: 100.00%) - BytesSent: 595.00 B (595) - OverallThroughput: 6.19 MB/sec - PeakMemoryUsage: 27.59 KB (28256) - RowsReturned: 4 (4) - SerializeBatchTime: 49.217us - UncompressedRowBatchSize: 595.00 B (595) CodeGen:(Total: 267.438ms, non-child: 267.438ms, % non-child: 100.00%) - CodegenTime: 16.844ms - CompileTime: 61.987ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2068576) - NumFunctions: 139 (139) - NumInstructions: 4.38K (4382) - OptimizationTime: 175.873ms - PeakMemoryUsage: 2.14 MB (2243584) - PrepareTime: 28.984ms AGGREGATION_NODE (id=1):(Total: 20s323ms, non-child: 19s837ms, % non-child: 97.61%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 177.559us - GetResultsTime: 26.176us - HTResizeTime: 1.002ms - HashBuckets: 8.19K (8192) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.44 MB (2557804) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 4 (4) - RowsReturnedRate: 0 - StreamingTime: 19s559ms - UnpinTime: 0.000ns HDFS_SCAN_NODE (id=0):(Total: 486.085ms, non-child: 486.085ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 10:1/253.39 MB 8:3/760.20 MB 1:2/506.78 MB 3:3/760.20 MB 7:2/506.77 MB 2:2/506.80 MB 5:1/253.40 MB 0:5/1.24 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 19 out of 19 Hdfs Read Thread Concurrency Bucket: 0:97.56% 1:0% 2:2.439% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:133 BytesRead(500.000ms): 0, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 746.85 MB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB - FooterProcessingTime: (Avg: 3.400ms ; Min: 620.214us ; Max: 7.988ms ; Number of samples: 19) - AverageHdfsReadThreadConcurrency: 0.05 - AverageScannerThreadConcurrency: 10.00 - BytesRead: 1.09 GB (1171103522) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.09 GB (1171103522) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.09 GB (1171103522) - CachedFileHandlesHitCount: 247 (247) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 2s087ms - MaxCompressedTextFileLength: 0 - NumColumns: 7 (7) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 8 (8) - NumRowGroups: 19 (19) - NumScannerThreadsStarted: 12 (12) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 810.77 MB (850153786) - PerReadThreadRawHdfsThroughput: 990.87 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 37.201ms - RowBatchQueuePutWaitTime: 3m5s - RowsRead: 131.50M (131502186) - RowsReturned: 129.65M (129652573) - RowsReturnedRate: 266.73 M/sec - ScanRangesComplete: 19 (19) - ScannerThreadsInvoluntaryContextSwitches: 9.79K (9792) - ScannerThreadsTotalWallClockTime: 3m27s - MaterializeTupleTime(*): 17s775ms - ScannerThreadsSysTime: 496.918ms - ScannerThreadsUserTime: 22s230ms - ScannerThreadsVoluntaryContextSwitches: 126.39K (126387) - TotalRawHdfsReadTime(*): 1s127ms - TotalReadThroughput: 53.18 MB/sec Instance 8c41d37ad1fc525e:2bf936bd00000004 (host=10.17.193.15:22000):(Total: 20s595ms, non-child: 15.961ms, % non-child: 0.08%) Hdfs split stats (:<# splits>/): 6:2/506.79 MB 8:3/760.21 MB 1:4/1013.54 MB 3:1/187.22 MB 5:3/760.16 MB 7:1/253.39 MB 2:3/706.54 MB 0:2/506.78 MB MemoryUsage(500.000ms): 782.05 MB, 781.81 MB, 782.21 MB, 782.21 MB, 781.88 MB, 782.05 MB, 686.70 MB, 686.70 MB, 686.70 MB, 686.70 MB, 686.62 MB, 686.70 MB, 591.17 MB, 591.17 MB, 591.24 MB, 591.09 MB, 591.25 MB, 591.16 MB, 503.41 MB, 535.31 MB, 573.14 MB, 493.69 MB, 493.84 MB, 493.92 MB, 430.03 MB, 405.46 MB, 516.93 MB, 464.16 MB, 463.92 MB, 456.27 MB, 408.46 MB, 408.46 MB, 408.31 MB, 368.71 MB, 352.82 MB, 337.18 MB, 336.95 MB, 280.98 MB, 211.86 MB, 188.13 MB, 147.84 MB ThreadUsage(500.000ms): 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 10, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 6, 6, 6 - AverageThreadTokens: 11.07 - BloomFilterBytes: 0 - PeakMemoryUsage: 782.45 MB (820454098) - PerHostPeakMemUsage: 792.75 MB (831257803) - RowsProduced: 4 (4) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 2.116ms - TotalStorageWaitTime: 719.238ms - TotalThreadsInvoluntaryContextSwitches: 12.58K (12576) - TotalThreadsTotalWallClockTime: 3m45s - TotalThreadsSysTime: 831.867ms - TotalThreadsUserTime: 45s814ms - TotalThreadsVoluntaryContextSwitches: 123.49K (123494) Fragment Instance Lifecycle Timings: - ExecTime: 20s317ms - ExecTreeExecTime: 20s308ms - OpenTime: 241.943ms - ExecTreeOpenTime: 62.684us - PrepareTime: 35.284ms - ExecTreePrepareTime: 1.470ms DataStreamSender (dst_id=3):(Total: 78.022us, non-child: 78.022us, % non-child: 100.00%) - BytesSent: 595.00 B (595) - OverallThroughput: 7.27 MB/sec - PeakMemoryUsage: 27.59 KB (28256) - RowsReturned: 4 (4) - SerializeBatchTime: 49.135us - UncompressedRowBatchSize: 595.00 B (595) CodeGen:(Total: 268.576ms, non-child: 268.576ms, % non-child: 100.00%) - CodegenTime: 17.859ms - CompileTime: 62.819ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2068576) - NumFunctions: 139 (139) - NumInstructions: 4.38K (4382) - OptimizationTime: 178.287ms - PeakMemoryUsage: 2.14 MB (2243584) - PrepareTime: 26.863ms AGGREGATION_NODE (id=1):(Total: 20s310ms, non-child: 19s777ms, % non-child: 97.38%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 156.841us - GetResultsTime: 20.328us - HTResizeTime: 795.413us - HashBuckets: 8.19K (8192) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.44 MB (2557804) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 4 (4) - RowsReturnedRate: 0 - StreamingTime: 19s487ms - UnpinTime: 0.000ns HDFS_SCAN_NODE (id=0):(Total: 532.898ms, non-child: 532.898ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 6:2/506.79 MB 8:3/760.21 MB 1:4/1013.54 MB 3:1/187.22 MB 5:3/760.16 MB 7:1/253.39 MB 2:3/706.54 MB 0:2/506.78 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 19 out of 19 Hdfs Read Thread Concurrency Bucket: 0:97.56% 1:2.439% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:133 BytesRead(500.000ms): 677.62 MB, 677.62 MB, 677.62 MB, 677.62 MB, 677.62 MB, 677.62 MB, 677.62 MB, 677.62 MB, 677.62 MB, 677.62 MB, 677.62 MB, 677.62 MB, 677.62 MB, 677.62 MB, 677.62 MB, 677.62 MB, 677.62 MB, 677.62 MB, 677.62 MB, 736.41 MB, 792.60 MB, 795.19 MB, 795.19 MB, 795.19 MB, 795.19 MB, 795.19 MB, 1.06 GB, 1.06 GB, 1.06 GB, 1.06 GB, 1.06 GB, 1.06 GB, 1.06 GB, 1.06 GB, 1.06 GB, 1.06 GB, 1.06 GB, 1.06 GB, 1.06 GB, 1.06 GB, 1.06 GB - FooterProcessingTime: (Avg: 1.969ms ; Min: 462.591us ; Max: 3.885ms ; Number of samples: 19) - AverageHdfsReadThreadConcurrency: 0.02 - AverageScannerThreadConcurrency: 10.07 - BytesRead: 1.06 GB (1141997471) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.06 GB (1141997471) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.06 GB (1141997471) - CachedFileHandlesHitCount: 243 (243) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 2s383ms - MaxCompressedTextFileLength: 0 - NumColumns: 7 (7) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 8 (8) - NumRowGroups: 19 (19) - NumScannerThreadsStarted: 12 (12) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 780.77 MB (818696741) - PerReadThreadRawHdfsThroughput: 1.12 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 30.657ms - RowBatchQueuePutWaitTime: 2m59s - RowsRead: 128.22M (128222964) - RowsReturned: 126.42M (126422094) - RowsReturnedRate: 237.23 M/sec - ScanRangesComplete: 19 (19) - ScannerThreadsInvoluntaryContextSwitches: 10.52K (10519) - ScannerThreadsTotalWallClockTime: 3m24s - MaterializeTupleTime(*): 20s878ms - ScannerThreadsSysTime: 560.908ms - ScannerThreadsUserTime: 25s563ms - ScannerThreadsVoluntaryContextSwitches: 123.46K (123458) - TotalRawHdfsReadTime(*): 949.859ms - TotalReadThroughput: 53.13 MB/sec Instance 8c41d37ad1fc525e:2bf936bd0000000b (host=10.17.193.12:22000):(Total: 20s144ms, non-child: 14.826ms, % non-child: 0.07%) Hdfs split stats (:<# splits>/): 2:2/506.78 MB 5:1/253.40 MB 7:1/253.42 MB 9:1/253.40 MB 8:3/760.15 MB 1:5/1.24 GB 4:4/986.05 MB 3:1/253.39 MB 0:1/253.41 MB MemoryUsage(500.000ms): 3.45 MB, 812.05 MB, 811.96 MB, 812.13 MB, 811.97 MB, 811.97 MB, 803.95 MB, 716.64 MB, 716.78 MB, 716.54 MB, 716.62 MB, 716.62 MB, 685.22 MB, 621.65 MB, 621.57 MB, 621.57 MB, 621.41 MB, 621.34 MB, 557.57 MB, 525.60 MB, 525.76 MB, 446.23 MB, 430.27 MB, 430.75 MB, 350.51 MB, 334.03 MB, 527.99 MB, 474.82 MB, 475.05 MB, 467.03 MB, 419.28 MB, 419.36 MB, 419.28 MB, 363.77 MB, 363.93 MB, 363.93 MB, 307.93 MB, 307.85 MB, 252.20 MB, 222.71 MB, 121.68 MB ThreadUsage(500.000ms): 1, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 10, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 7, 5 - AverageThreadTokens: 10.83 - BloomFilterBytes: 0 - PeakMemoryUsage: 812.37 MB (851828137) - PerHostPeakMemUsage: 822.67 MB (862631842) - RowsProduced: 4 (4) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1.649ms - TotalStorageWaitTime: 701.988ms - TotalThreadsInvoluntaryContextSwitches: 11.37K (11368) - TotalThreadsTotalWallClockTime: 3m41s - TotalThreadsSysTime: 659.894ms - TotalThreadsUserTime: 41s090ms - TotalThreadsVoluntaryContextSwitches: 125.92K (125924) Fragment Instance Lifecycle Timings: - ExecTime: 19s869ms - ExecTreeExecTime: 19s861ms - OpenTime: 239.163ms - ExecTreeOpenTime: 64.224us - PrepareTime: 35.683ms - ExecTreePrepareTime: 1.399ms DataStreamSender (dst_id=3):(Total: 82.242us, non-child: 82.242us, % non-child: 100.00%) - BytesSent: 595.00 B (595) - OverallThroughput: 6.90 MB/sec - PeakMemoryUsage: 27.59 KB (28256) - RowsReturned: 4 (4) - SerializeBatchTime: 51.739us - UncompressedRowBatchSize: 595.00 B (595) CodeGen:(Total: 266.566ms, non-child: 266.566ms, % non-child: 100.00%) - CodegenTime: 17.285ms - CompileTime: 62.638ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2068576) - NumFunctions: 139 (139) - NumInstructions: 4.38K (4382) - OptimizationTime: 175.724ms - PeakMemoryUsage: 2.14 MB (2243584) - PrepareTime: 27.632ms AGGREGATION_NODE (id=1):(Total: 19s863ms, non-child: 19s396ms, % non-child: 97.65%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 149.775us - GetResultsTime: 27.704us - HTResizeTime: 497.818us - HashBuckets: 8.19K (8192) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.44 MB (2557804) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 4 (4) - RowsReturnedRate: 0 - StreamingTime: 19s127ms - UnpinTime: 0.000ns HDFS_SCAN_NODE (id=0):(Total: 467.262ms, non-child: 467.262ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:2/506.78 MB 5:1/253.40 MB 7:1/253.42 MB 9:1/253.40 MB 8:3/760.15 MB 1:5/1.24 GB 4:4/986.05 MB 3:1/253.39 MB 0:1/253.41 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 19 out of 19 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:133 BytesRead(500.000ms): 0, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 1.08 GB, 1.08 GB, 1.08 GB, 1.08 GB, 1.08 GB, 1.08 GB, 1.08 GB, 1.08 GB, 1.08 GB, 1.08 GB, 1.08 GB, 1.08 GB, 1.08 GB, 1.08 GB, 1.08 GB - FooterProcessingTime: (Avg: 1.879ms ; Min: 444.730us ; Max: 6.251ms ; Number of samples: 19) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 10.07 - BytesRead: 1.08 GB (1164407727) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.08 GB (1164407727) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.08 GB (1164407727) - CachedFileHandlesHitCount: 246 (246) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 2s064ms - MaxCompressedTextFileLength: 0 - NumColumns: 7 (7) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 9 (9) - NumRowGroups: 19 (19) - NumScannerThreadsStarted: 12 (12) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 810.69 MB (850070780) - PerReadThreadRawHdfsThroughput: 1.11 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 33.788ms - RowBatchQueuePutWaitTime: 3m1s - RowsRead: 130.75M (130748840) - RowsReturned: 128.91M (128910645) - RowsReturnedRate: 275.88 M/sec - ScanRangesComplete: 19 (19) - ScannerThreadsInvoluntaryContextSwitches: 9.32K (9316) - ScannerThreadsTotalWallClockTime: 3m21s - MaterializeTupleTime(*): 17s240ms - ScannerThreadsSysTime: 393.935ms - ScannerThreadsUserTime: 21s288ms - ScannerThreadsVoluntaryContextSwitches: 125.89K (125890) - TotalRawHdfsReadTime(*): 980.601ms - TotalReadThroughput: 54.17 MB/sec Instance 8c41d37ad1fc525e:2bf936bd00000007 (host=10.17.193.19:22000):(Total: 20s144ms, non-child: 13.593ms, % non-child: 0.07%) Hdfs split stats (:<# splits>/): 8:1/253.40 MB 0:1/253.39 MB 7:1/253.40 MB 3:1/7.47 MB 9:2/506.76 MB 10:3/760.18 MB 6:2/506.78 MB 2:3/760.19 MB 4:2/445.03 MB 5:2/506.80 MB 1:2/506.81 MB MemoryUsage(500.000ms): 3.45 MB, 798.37 MB, 797.97 MB, 798.05 MB, 797.97 MB, 798.05 MB, 789.94 MB, 702.70 MB, 702.78 MB, 702.62 MB, 702.70 MB, 702.62 MB, 671.11 MB, 607.73 MB, 607.57 MB, 607.57 MB, 607.57 MB, 607.49 MB, 567.76 MB, 511.79 MB, 549.66 MB, 502.11 MB, 462.66 MB, 462.50 MB, 414.27 MB, 374.10 MB, 605.22 MB, 472.11 MB, 471.95 MB, 472.19 MB, 416.46 MB, 416.31 MB, 416.62 MB, 360.82 MB, 360.66 MB, 352.96 MB, 329.04 MB, 270.93 MB, 222.52 MB, 206.60 MB, 40.49 MB ThreadUsage(500.000ms): 1, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 7, 7, 7, 2 - AverageThreadTokens: 10.78 - BloomFilterBytes: 0 - PeakMemoryUsage: 798.52 MB (837313195) - PerHostPeakMemUsage: 808.83 MB (848116900) - RowsProduced: 4 (4) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1.522ms - TotalStorageWaitTime: 723.181ms - TotalThreadsInvoluntaryContextSwitches: 12.28K (12280) - TotalThreadsTotalWallClockTime: 3m42s - TotalThreadsSysTime: 722.883ms - TotalThreadsUserTime: 42s041ms - TotalThreadsVoluntaryContextSwitches: 125.06K (125062) Fragment Instance Lifecycle Timings: - ExecTime: 19s869ms - ExecTreeExecTime: 19s862ms - OpenTime: 238.388ms - ExecTreeOpenTime: 70.435us - PrepareTime: 35.967ms - ExecTreePrepareTime: 1.478ms DataStreamSender (dst_id=3):(Total: 61.679us, non-child: 61.679us, % non-child: 100.00%) - BytesSent: 595.00 B (595) - OverallThroughput: 9.20 MB/sec - PeakMemoryUsage: 27.59 KB (28256) - RowsReturned: 4 (4) - SerializeBatchTime: 31.342us - UncompressedRowBatchSize: 595.00 B (595) CodeGen:(Total: 266.269ms, non-child: 266.269ms, % non-child: 100.00%) - CodegenTime: 16.612ms - CompileTime: 62.155ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2068576) - NumFunctions: 139 (139) - NumInstructions: 4.38K (4382) - OptimizationTime: 175.409ms - PeakMemoryUsage: 2.14 MB (2243584) - PrepareTime: 28.138ms AGGREGATION_NODE (id=1):(Total: 19s864ms, non-child: 19s397ms, % non-child: 97.65%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 138.649us - GetResultsTime: 20.836us - HTResizeTime: 683.365us - HashBuckets: 8.19K (8192) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.44 MB (2557804) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 4 (4) - RowsReturnedRate: 0 - StreamingTime: 19s109ms - UnpinTime: 0.000ns HDFS_SCAN_NODE (id=0):(Total: 466.710ms, non-child: 466.710ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 8:1/253.40 MB 0:1/253.39 MB 7:1/253.40 MB 3:1/7.47 MB 9:2/506.76 MB 10:3/760.18 MB 6:2/506.78 MB 2:3/760.19 MB 4:2/445.03 MB 5:2/506.80 MB 1:2/506.81 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 20 out of 20 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:140 BytesRead(500.000ms): 0, 692.88 MB, 692.88 MB, 692.88 MB, 692.88 MB, 692.88 MB, 692.88 MB, 692.88 MB, 692.88 MB, 692.88 MB, 692.88 MB, 692.88 MB, 692.88 MB, 692.88 MB, 692.88 MB, 692.88 MB, 692.88 MB, 692.88 MB, 692.88 MB, 692.88 MB, 751.66 MB, 751.66 MB, 751.66 MB, 751.66 MB, 751.66 MB, 751.66 MB, 1.08 GB, 1.08 GB, 1.08 GB, 1.08 GB, 1.08 GB, 1.08 GB, 1.08 GB, 1.08 GB, 1.08 GB, 1.08 GB, 1.08 GB, 1.08 GB, 1.08 GB, 1.08 GB, 1.08 GB - FooterProcessingTime: (Avg: 1.115ms ; Min: 599.768us ; Max: 2.414ms ; Number of samples: 20) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 10.03 - BytesRead: 1.08 GB (1157998147) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.08 GB (1157998147) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.08 GB (1157998147) - CachedFileHandlesHitCount: 253 (253) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 2s080ms - MaxCompressedTextFileLength: 0 - NumColumns: 7 (7) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 11 (11) - NumRowGroups: 20 (20) - NumScannerThreadsStarted: 12 (12) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 796.85 MB (835555838) - PerReadThreadRawHdfsThroughput: 972.52 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 20.679ms - RowBatchQueuePutWaitTime: 3m - RowsRead: 130.00M (130003664) - RowsReturned: 128.17M (128173546) - RowsReturnedRate: 274.63 M/sec - ScanRangesComplete: 20 (20) - ScannerThreadsInvoluntaryContextSwitches: 10.25K (10252) - ScannerThreadsTotalWallClockTime: 3m22s - MaterializeTupleTime(*): 17s832ms - ScannerThreadsSysTime: 480.919ms - ScannerThreadsUserTime: 22s202ms - ScannerThreadsVoluntaryContextSwitches: 125.03K (125027) - TotalRawHdfsReadTime(*): 1s135ms - TotalReadThroughput: 53.87 MB/sec Instance 8c41d37ad1fc525e:2bf936bd0000000e (host=10.17.193.18:22000):(Total: 19s757ms, non-child: 14.209ms, % non-child: 0.07%) Hdfs split stats (:<# splits>/): 0:1/253.41 MB 8:2/506.77 MB 6:1/253.41 MB 9:2/506.78 MB 7:1/253.41 MB 5:5/1.24 GB 3:3/760.18 MB 2:2/506.80 MB 1:1/253.41 MB MemoryUsage(500.000ms): 293.05 MB, 811.88 MB, 811.97 MB, 812.13 MB, 812.05 MB, 811.81 MB, 716.70 MB, 716.70 MB, 716.63 MB, 716.63 MB, 716.78 MB, 716.78 MB, 620.98 MB, 621.22 MB, 621.22 MB, 620.98 MB, 621.29 MB, 621.22 MB, 573.06 MB, 525.30 MB, 525.06 MB, 445.68 MB, 429.81 MB, 429.72 MB, 382.23 MB, 334.25 MB, 568.57 MB, 413.38 MB, 413.46 MB, 405.44 MB, 365.95 MB, 365.71 MB, 365.95 MB, 318.23 MB, 318.23 MB, 286.31 MB, 270.15 MB, 222.68 MB, 174.76 MB ThreadUsage(500.000ms): 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7 - AverageThreadTokens: 11.15 - BloomFilterBytes: 0 - PeakMemoryUsage: 812.44 MB (851909433) - PerHostPeakMemUsage: 822.75 MB (862713138) - RowsProduced: 4 (4) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1.783ms - TotalStorageWaitTime: 716.117ms - TotalThreadsInvoluntaryContextSwitches: 10.40K (10401) - TotalThreadsTotalWallClockTime: 3m35s - TotalThreadsSysTime: 687.890ms - TotalThreadsUserTime: 40s406ms - TotalThreadsVoluntaryContextSwitches: 119.99K (119990) Fragment Instance Lifecycle Timings: - ExecTime: 19s485ms - ExecTreeExecTime: 19s477ms - OpenTime: 238.513ms - ExecTreeOpenTime: 59.702us - PrepareTime: 33.624ms - ExecTreePrepareTime: 1.347ms DataStreamSender (dst_id=3):(Total: 94.857us, non-child: 94.857us, % non-child: 100.00%) - BytesSent: 595.00 B (595) - OverallThroughput: 5.98 MB/sec - PeakMemoryUsage: 27.59 KB (28256) - RowsReturned: 4 (4) - SerializeBatchTime: 45.434us - UncompressedRowBatchSize: 595.00 B (595) CodeGen:(Total: 263.904ms, non-child: 263.904ms, % non-child: 100.00%) - CodegenTime: 16.936ms - CompileTime: 61.997ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2068576) - NumFunctions: 139 (139) - NumInstructions: 4.38K (4382) - OptimizationTime: 175.713ms - PeakMemoryUsage: 2.14 MB (2243584) - PrepareTime: 25.603ms AGGREGATION_NODE (id=1):(Total: 19s479ms, non-child: 19s026ms, % non-child: 97.68%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 166.148us - GetResultsTime: 20.581us - HTResizeTime: 999.691us - HashBuckets: 8.19K (8192) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.44 MB (2557804) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 4 (4) - RowsReturnedRate: 0 - StreamingTime: 18s762ms - UnpinTime: 0.000ns HDFS_SCAN_NODE (id=0):(Total: 452.693ms, non-child: 452.693ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/253.41 MB 8:2/506.77 MB 6:1/253.41 MB 9:2/506.78 MB 7:1/253.41 MB 5:5/1.24 GB 3:3/760.18 MB 2:2/506.80 MB 1:1/253.41 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 18 out of 18 Hdfs Read Thread Concurrency Bucket: 0:94.87% 1:2.564% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:2.564% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:126 BytesRead(500.000ms): 203.06 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 1.02 GB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB - FooterProcessingTime: (Avg: 4.443ms ; Min: 439.671us ; Max: 11.554ms ; Number of samples: 18) - AverageHdfsReadThreadConcurrency: 0.26 - AverageScannerThreadConcurrency: 10.15 - BytesRead: 1.03 GB (1109460615) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.03 GB (1109460615) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.03 GB (1109460615) - CachedFileHandlesHitCount: 234 (234) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 1s988ms - MaxCompressedTextFileLength: 0 - NumColumns: 7 (7) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 9 (9) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 12 (12) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 810.77 MB (850152076) - PerReadThreadRawHdfsThroughput: 1.07 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 34.887ms - RowBatchQueuePutWaitTime: 2m54s - RowsRead: 124.58M (124581269) - RowsReturned: 122.83M (122825043) - RowsReturnedRate: 271.32 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 8.42K (8422) - ScannerThreadsTotalWallClockTime: 3m15s - MaterializeTupleTime(*): 16s969ms - ScannerThreadsSysTime: 414.931ms - ScannerThreadsUserTime: 20s997ms - ScannerThreadsVoluntaryContextSwitches: 119.96K (119958) - TotalRawHdfsReadTime(*): 965.246ms - TotalReadThroughput: 54.26 MB/sec Instance 8c41d37ad1fc525e:2bf936bd00000001 (host=10.17.193.23:22000):(Total: 19s724ms, non-child: 14.651ms, % non-child: 0.07%) Hdfs split stats (:<# splits>/): 5:1/253.40 MB 0:1/253.40 MB 9:2/506.78 MB 7:1/253.38 MB 8:2/506.80 MB 6:3/760.18 MB 2:2/506.76 MB 1:4/767.55 MB 3:3/760.16 MB MemoryUsage(500.000ms): 811.95 MB, 812.05 MB, 811.97 MB, 812.05 MB, 811.97 MB, 811.96 MB, 724.81 MB, 716.54 MB, 716.78 MB, 716.70 MB, 716.70 MB, 716.78 MB, 637.27 MB, 621.54 MB, 621.31 MB, 621.38 MB, 621.54 MB, 621.46 MB, 541.46 MB, 525.39 MB, 525.62 MB, 438.07 MB, 430.29 MB, 430.29 MB, 350.35 MB, 334.03 MB, 470.63 MB, 413.23 MB, 413.46 MB, 373.82 MB, 365.70 MB, 365.79 MB, 318.17 MB, 318.01 MB, 318.17 MB, 270.28 MB, 238.37 MB, 222.49 MB, 174.49 MB ThreadUsage(500.000ms): 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 10, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7 - AverageThreadTokens: 11.08 - BloomFilterBytes: 0 - PeakMemoryUsage: 812.52 MB (851992634) - PerHostPeakMemUsage: 822.83 MB (862796339) - RowsProduced: 4 (4) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1.939ms - TotalStorageWaitTime: 743.637ms - TotalThreadsInvoluntaryContextSwitches: 11.46K (11455) - TotalThreadsTotalWallClockTime: 3m34s - TotalThreadsSysTime: 781.876ms - TotalThreadsUserTime: 44s361ms - TotalThreadsVoluntaryContextSwitches: 120.15K (120148) Fragment Instance Lifecycle Timings: - ExecTime: 19s449ms - ExecTreeExecTime: 19s441ms - OpenTime: 238.979ms - ExecTreeOpenTime: 66.319us - PrepareTime: 36.730ms - ExecTreePrepareTime: 1.486ms DataStreamSender (dst_id=3):(Total: 71.335us, non-child: 71.335us, % non-child: 100.00%) - BytesSent: 595.00 B (595) - OverallThroughput: 7.95 MB/sec - PeakMemoryUsage: 27.59 KB (28256) - RowsReturned: 4 (4) - SerializeBatchTime: 38.609us - UncompressedRowBatchSize: 595.00 B (595) CodeGen:(Total: 267.582ms, non-child: 267.582ms, % non-child: 100.00%) - CodegenTime: 16.624ms - CompileTime: 61.960ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2068576) - NumFunctions: 139 (139) - NumInstructions: 4.38K (4382) - OptimizationTime: 176.219ms - PeakMemoryUsage: 2.14 MB (2243584) - PrepareTime: 28.821ms AGGREGATION_NODE (id=1):(Total: 19s442ms, non-child: 18s945ms, % non-child: 97.44%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 147.855us - GetResultsTime: 23.132us - HTResizeTime: 512.152us - HashBuckets: 8.19K (8192) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.44 MB (2557804) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 4 (4) - RowsReturnedRate: 0 - StreamingTime: 18s660ms - UnpinTime: 0.000ns HDFS_SCAN_NODE (id=0):(Total: 497.599ms, non-child: 497.599ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:1/253.40 MB 0:1/253.40 MB 9:2/506.78 MB 7:1/253.38 MB 8:2/506.80 MB 6:3/760.18 MB 2:2/506.76 MB 1:4/767.55 MB 3:3/760.16 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 19 out of 19 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:133 BytesRead(500.000ms): 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 1.04 GB, 1.04 GB, 1.04 GB, 1.04 GB, 1.04 GB, 1.04 GB, 1.04 GB, 1.04 GB, 1.04 GB, 1.04 GB, 1.04 GB, 1.04 GB, 1.04 GB - FooterProcessingTime: (Avg: 1.841ms ; Min: 505.294us ; Max: 3.252ms ; Number of samples: 19) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 10.08 - BytesRead: 1.04 GB (1111338292) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.04 GB (1111338292) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.04 GB (1111338292) - CachedFileHandlesHitCount: 242 (242) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 2s309ms - MaxCompressedTextFileLength: 0 - NumColumns: 7 (7) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 9 (9) - NumRowGroups: 19 (19) - NumScannerThreadsStarted: 12 (12) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 810.85 MB (850235277) - PerReadThreadRawHdfsThroughput: 1.02 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 35.495ms - RowBatchQueuePutWaitTime: 2m50s - RowsRead: 124.77M (124770055) - RowsReturned: 123.01M (123014381) - RowsReturnedRate: 247.22 M/sec - ScanRangesComplete: 19 (19) - ScannerThreadsInvoluntaryContextSwitches: 9.48K (9482) - ScannerThreadsTotalWallClockTime: 3m15s - MaterializeTupleTime(*): 20s226ms - ScannerThreadsSysTime: 529.914ms - ScannerThreadsUserTime: 24s967ms - ScannerThreadsVoluntaryContextSwitches: 120.11K (120109) - TotalRawHdfsReadTime(*): 1s014ms - TotalReadThroughput: 54.35 MB/sec Instance 8c41d37ad1fc525e:2bf936bd00000003 (host=10.17.193.11:22000):(Total: 19s642ms, non-child: 14.360ms, % non-child: 0.07%) Hdfs split stats (:<# splits>/): 7:1/253.41 MB 9:1/253.39 MB 8:2/506.77 MB 5:2/506.79 MB 1:3/760.18 MB 4:3/760.17 MB 2:4/1013.60 MB 3:2/506.81 MB MemoryUsage(500.000ms): 667.84 MB, 812.05 MB, 812.21 MB, 811.81 MB, 812.04 MB, 812.05 MB, 716.86 MB, 716.70 MB, 716.62 MB, 716.54 MB, 716.86 MB, 716.70 MB, 645.25 MB, 621.17 MB, 621.33 MB, 621.25 MB, 621.17 MB, 621.25 MB, 557.25 MB, 525.44 MB, 525.28 MB, 438.12 MB, 430.03 MB, 430.02 MB, 358.03 MB, 333.76 MB, 440.73 MB, 413.62 MB, 413.54 MB, 365.71 MB, 365.63 MB, 365.79 MB, 325.82 MB, 317.82 MB, 317.82 MB, 278.12 MB, 246.41 MB, 222.60 MB, 174.64 MB ThreadUsage(500.000ms): 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 8, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7 - AverageThreadTokens: 11.03 - BloomFilterBytes: 0 - PeakMemoryUsage: 812.45 MB (851911034) - PerHostPeakMemUsage: 822.75 MB (862714739) - RowsProduced: 4 (4) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1.803ms - TotalStorageWaitTime: 651.828ms - TotalThreadsInvoluntaryContextSwitches: 10.73K (10727) - TotalThreadsTotalWallClockTime: 3m33s - TotalThreadsSysTime: 724.884ms - TotalThreadsUserTime: 42s276ms - TotalThreadsVoluntaryContextSwitches: 119.89K (119890) Fragment Instance Lifecycle Timings: - ExecTime: 19s363ms - ExecTreeExecTime: 19s355ms - OpenTime: 241.389ms - ExecTreeOpenTime: 83.427us - PrepareTime: 38.085ms - ExecTreePrepareTime: 1.529ms DataStreamSender (dst_id=3):(Total: 140.004us, non-child: 140.004us, % non-child: 100.00%) - BytesSent: 595.00 B (595) - OverallThroughput: 4.05 MB/sec - PeakMemoryUsage: 27.59 KB (28256) - RowsReturned: 4 (4) - SerializeBatchTime: 92.125us - UncompressedRowBatchSize: 595.00 B (595) CodeGen:(Total: 271.191ms, non-child: 271.191ms, % non-child: 100.00%) - CodegenTime: 16.642ms - CompileTime: 62.291ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2068576) - NumFunctions: 139 (139) - NumInstructions: 4.38K (4382) - OptimizationTime: 178.239ms - PeakMemoryUsage: 2.14 MB (2243584) - PrepareTime: 30.051ms AGGREGATION_NODE (id=1):(Total: 19s357ms, non-child: 18s864ms, % non-child: 97.46%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 208.696us - GetResultsTime: 23.116us - HTResizeTime: 939.224us - HashBuckets: 8.19K (8192) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.44 MB (2557804) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 4 (4) - RowsReturnedRate: 0 - StreamingTime: 18s578ms - UnpinTime: 0.000ns HDFS_SCAN_NODE (id=0):(Total: 492.292ms, non-child: 492.292ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:1/253.41 MB 9:1/253.39 MB 8:2/506.77 MB 5:2/506.79 MB 1:3/760.18 MB 4:3/760.17 MB 2:4/1013.60 MB 3:2/506.81 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 18 out of 18 Hdfs Read Thread Concurrency Bucket: 0:97.44% 1:0% 2:0% 3:0% 4:2.564% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:126 BytesRead(500.000ms): 540.67 MB, 705.37 MB, 705.37 MB, 705.37 MB, 705.37 MB, 705.37 MB, 705.37 MB, 705.37 MB, 705.37 MB, 705.37 MB, 705.37 MB, 705.37 MB, 705.37 MB, 705.37 MB, 705.37 MB, 705.37 MB, 705.37 MB, 705.37 MB, 705.37 MB, 705.37 MB, 705.37 MB, 705.37 MB, 705.37 MB, 705.37 MB, 705.37 MB, 705.37 MB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB - FooterProcessingTime: (Avg: 1.606ms ; Min: 436.320us ; Max: 3.405ms ; Number of samples: 18) - AverageHdfsReadThreadConcurrency: 0.10 - AverageScannerThreadConcurrency: 10.03 - BytesRead: 1.03 GB (1109466574) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.03 GB (1109466574) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.03 GB (1109466574) - CachedFileHandlesHitCount: 234 (234) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 2s147ms - MaxCompressedTextFileLength: 0 - NumColumns: 7 (7) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 8 (8) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 12 (12) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 810.77 MB (850153677) - PerReadThreadRawHdfsThroughput: 1.16 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 35.240ms - RowBatchQueuePutWaitTime: 2m51s - RowsRead: 124.58M (124580562) - RowsReturned: 122.83M (122831031) - RowsReturnedRate: 249.51 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 8.77K (8765) - ScannerThreadsTotalWallClockTime: 3m13s - MaterializeTupleTime(*): 18s617ms - ScannerThreadsSysTime: 467.923ms - ScannerThreadsUserTime: 22s968ms - ScannerThreadsVoluntaryContextSwitches: 119.86K (119859) - TotalRawHdfsReadTime(*): 889.709ms - TotalReadThroughput: 54.26 MB/sec Instance 8c41d37ad1fc525e:2bf936bd00000009 (host=10.17.193.14:22000):(Total: 18s825ms, non-child: 14.049ms, % non-child: 0.07%) Hdfs split stats (:<# splits>/): 9:1/253.40 MB 5:3/760.21 MB 4:3/760.19 MB 7:2/506.80 MB 2:3/760.21 MB 6:2/506.82 MB 1:3/760.22 MB MemoryUsage(500.000ms): 811.97 MB, 811.89 MB, 812.29 MB, 811.96 MB, 812.13 MB, 812.29 MB, 716.86 MB, 716.54 MB, 716.86 MB, 716.78 MB, 716.46 MB, 716.94 MB, 621.33 MB, 621.33 MB, 621.17 MB, 621.25 MB, 621.33 MB, 621.56 MB, 525.19 MB, 525.28 MB, 517.50 MB, 430.26 MB, 430.18 MB, 430.11 MB, 350.35 MB, 333.83 MB, 357.57 MB, 347.11 MB, 346.88 MB, 307.38 MB, 307.46 MB, 275.49 MB, 267.60 MB, 267.36 MB, 227.74 MB, 187.97 MB, 164.01 MB ThreadUsage(500.000ms): 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 7, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6 - AverageThreadTokens: 10.95 - BloomFilterBytes: 0 - PeakMemoryUsage: 812.45 MB (851912443) - PerHostPeakMemUsage: 822.75 MB (862716148) - RowsProduced: 4 (4) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1.531ms - TotalStorageWaitTime: 687.531ms - TotalThreadsInvoluntaryContextSwitches: 10.61K (10607) - TotalThreadsTotalWallClockTime: 3m22s - TotalThreadsSysTime: 705.887ms - TotalThreadsUserTime: 40s038ms - TotalThreadsVoluntaryContextSwitches: 113.26K (113260) Fragment Instance Lifecycle Timings: - ExecTime: 18s551ms - ExecTreeExecTime: 18s543ms - OpenTime: 240.071ms - ExecTreeOpenTime: 70.196us - PrepareTime: 34.168ms - ExecTreePrepareTime: 1.358ms DataStreamSender (dst_id=3):(Total: 82.708us, non-child: 82.708us, % non-child: 100.00%) - BytesSent: 597.00 B (597) - OverallThroughput: 6.88 MB/sec - PeakMemoryUsage: 27.59 KB (28256) - RowsReturned: 4 (4) - SerializeBatchTime: 50.110us - UncompressedRowBatchSize: 597.00 B (597) CodeGen:(Total: 266.050ms, non-child: 266.050ms, % non-child: 100.00%) - CodegenTime: 16.319ms - CompileTime: 62.423ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2068576) - NumFunctions: 139 (139) - NumInstructions: 4.38K (4382) - OptimizationTime: 176.844ms - PeakMemoryUsage: 2.14 MB (2243584) - PrepareTime: 26.174ms AGGREGATION_NODE (id=1):(Total: 18s545ms, non-child: 18s078ms, % non-child: 97.48%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 122.224us - GetResultsTime: 22.554us - HTResizeTime: 859.306us - HashBuckets: 8.19K (8192) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.44 MB (2557804) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 4 (4) - RowsReturnedRate: 0 - StreamingTime: 17s814ms - UnpinTime: 0.000ns HDFS_SCAN_NODE (id=0):(Total: 467.154ms, non-child: 467.154ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 9:1/253.40 MB 5:3/760.21 MB 4:3/760.19 MB 7:2/506.80 MB 2:3/760.21 MB 6:2/506.82 MB 1:3/760.22 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 17 out of 17 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:119 BytesRead(500.000ms): 705.39 MB, 705.39 MB, 705.39 MB, 705.39 MB, 705.39 MB, 705.39 MB, 705.39 MB, 705.39 MB, 705.39 MB, 705.39 MB, 705.39 MB, 705.39 MB, 705.39 MB, 705.39 MB, 705.39 MB, 705.39 MB, 705.39 MB, 705.39 MB, 705.39 MB, 705.39 MB, 705.39 MB, 705.39 MB, 705.39 MB, 705.39 MB, 705.39 MB, 705.39 MB, 999.29 MB, 999.29 MB, 999.29 MB, 999.29 MB, 999.29 MB, 999.29 MB, 999.29 MB, 999.29 MB, 999.29 MB, 999.29 MB, 999.29 MB - FooterProcessingTime: (Avg: 2.198ms ; Min: 451.967us ; Max: 4.199ms ; Number of samples: 17) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 9.95 - BytesRead: 999.29 MB (1047835215) - BytesReadDataNodeCache: 0 - BytesReadLocal: 999.29 MB (1047835215) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 999.29 MB (1047835215) - CachedFileHandlesHitCount: 221 (221) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 2s004ms - MaxCompressedTextFileLength: 0 - NumColumns: 7 (7) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 7 (7) - NumRowGroups: 17 (17) - NumScannerThreadsStarted: 12 (12) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 810.77 MB (850155086) - PerReadThreadRawHdfsThroughput: 1.14 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 29.354ms - RowBatchQueuePutWaitTime: 2m43s - RowsRead: 117.66M (117659833) - RowsReturned: 116.00M (116003313) - RowsReturnedRate: 248.32 M/sec - ScanRangesComplete: 17 (17) - ScannerThreadsInvoluntaryContextSwitches: 8.73K (8729) - ScannerThreadsTotalWallClockTime: 3m4s - MaterializeTupleTime(*): 17s398ms - ScannerThreadsSysTime: 485.921ms - ScannerThreadsUserTime: 21s503ms - ScannerThreadsVoluntaryContextSwitches: 113.23K (113229) - TotalRawHdfsReadTime(*): 858.767ms - TotalReadThroughput: 54.02 MB/sec ================================================================================ ================================================================================ SUMMARY: +---------------------+--------+----------+---------+----------+-------+-----------+ | Operator | #Hosts | Avg Time | Std Dev | Max Time | #Rows | Est #Rows | +---------------------+--------+----------+---------+----------+-------+-----------+ | 05:MERGING-EXCHANGE | 1 | 75.50us | 0ns | 75.50us | 4 | 6 | | 02:SORT | 14 | 449.29us | 0ns | 1.06ms | 4 | 6 | | 04:AGGREGATE | 14 | 2.50ms | 0ns | 2.92ms | 4 | 6 | | 03:EXCHANGE | 14 | 69.54us | 0ns | 351.21us | 56 | 6 | | 01:AGGREGATE | 14 | 19.74s | 0ns | 20.59s | 56 | 6 | | 00:SCAN HDFS | 14 | 485.73ms | 0ns | 545.30ms | 1.77B | 180.00M | +---------------------+--------+----------+---------+----------+-------+-----------+ PROFILE: Query (id=9e48f6ed8577ed82:58f004f400000000): Summary: Session ID: a241ebba6781c2c6:84648d9961f17b92 Session Type: BEESWAX Start Time: 2017-06-18 23:31:06.173636000 End Time: Query Type: QUERY Query State: FINISHED Query Status: OK Impala Version: impalad version 2.9.0-SNAPSHOT RELEASE (build 659a7c7beb75d45bcd92af1d6a5c0e58cace65b5) User: jenkins Connected User: jenkins Delegated User: Network Address: 10.17.193.6:50933 Default Db: tpch_300_parquet Sql Statement: select l_returnflag, l_linestatus, sum(l_quantity) as sum_qty, sum(l_extendedprice) as sum_base_price, sum(l_extendedprice * (1 - l_discount)) as sum_disc_price, sum(l_extendedprice * (1 - l_discount) * (1 + l_tax)) as sum_charge, avg(l_quantity) as avg_qty, avg(l_extendedprice) as avg_price, avg(l_discount) as avg_disc, count(*) as count_order from lineitem where l_shipdate <= '1998-09-02' group by l_returnflag, l_linestatus order by l_returnflag, l_linestatus Coordinator: vb0204.halxg.cloudera.com:22000 Query Options (non default): NUM_SCANNER_THREADS=12,SYNC_DDL=1,MAX_NUM_RUNTIME_FILTERS=50 Plan: ---------------- Per-Host Resource Reservation: Memory=320.00MB Per-Host Resource Estimates: Memory=636.00MB F02:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1 PLAN-ROOT SINK | mem-estimate=0B mem-reservation=0B | 05:MERGING-EXCHANGE [UNPARTITIONED] | order by: l_returnflag ASC, l_linestatus ASC | mem-estimate=0B mem-reservation=0B | tuple-ids=3 row-size=130B cardinality=6 | F01:PLAN FRAGMENT [HASH(l_returnflag,l_linestatus)] hosts=14 instances=14 02:SORT | order by: l_returnflag ASC, l_linestatus ASC | mem-estimate=16.00MB mem-reservation=48.00MB | tuple-ids=3 row-size=130B cardinality=6 | 04:AGGREGATE [FINALIZE] | output: sum:merge(l_quantity), sum:merge(l_extendedprice), sum:merge(l_extendedprice * (1 - l_discount)), sum:merge(l_extendedprice * (1 - l_discount) * (1 + l_tax)), avg:merge(l_quantity), avg:merge(l_extendedprice), avg:merge(l_discount), count:merge(*) | group by: l_returnflag, l_linestatus | mem-estimate=10.00MB mem-reservation=272.00MB | tuple-ids=2 row-size=130B cardinality=6 | 03:EXCHANGE [HASH(l_returnflag,l_linestatus)] | mem-estimate=0B mem-reservation=0B | tuple-ids=1 row-size=130B cardinality=6 | F00:PLAN FRAGMENT [RANDOM] hosts=14 instances=14 01:AGGREGATE [STREAMING] | output: sum(l_quantity), sum(l_extendedprice), sum(l_extendedprice * (1 - l_discount)), sum(l_extendedprice * (1 - l_discount) * (1 + l_tax)), avg(l_quantity), avg(l_extendedprice), avg(l_discount), count(*) | group by: l_returnflag, l_linestatus | mem-estimate=10.00MB mem-reservation=0B | tuple-ids=1 row-size=130B cardinality=6 | 00:SCAN HDFS [tpch_300_parquet.lineitem, RANDOM] partitions=1/1 files=264 size=64.36GB predicates: l_shipdate <= '1998-09-02' stats-rows=1799989091 extrapolated-rows=disabled table stats: rows=1799989091 size=unavailable column stats: all parquet statistics predicates: l_shipdate <= '1998-09-02' parquet dictionary predicates: l_shipdate <= '1998-09-02' mem-estimate=616.00MB mem-reservation=0B tuple-ids=0 row-size=92B cardinality=179998909 ---------------- Estimated Per-Host Mem: 666894336 Per-Host Memory Reservation: 335544320 Request Pool: root.jenkins Admission result: Admitted immediately Planner Timeline: 51.781ms - Analysis finished: 9.792ms (9.792ms) - Equivalence classes computed: 14.359ms (4.566ms) - Single node plan created: 33.172ms (18.812ms) - Runtime filters computed: 33.219ms (47.509us) - Distributed plan created: 35.661ms (2.442ms) - Lineage info computed: 36.569ms (907.719us) - Planning finished: 51.781ms (15.211ms) Query Timeline: 21s527ms - Query submitted: 31.767us (31.767us) - Planning finished: 61.280ms (61.249ms) - Submit for admission: 62.643ms (1.362ms) - Completed admission: 62.750ms (107.002us) - Ready to start on 14 backends: 63.098ms (347.513us) - All 14 execution backends (29 fragment instances) started: 66.805ms (3.707ms) - Rows available: 21s466ms (21s399ms) - First row fetched: 21s518ms (52.340ms) - ComputeScanRangeAssignmentTimer: 572.171us ImpalaServer: - ClientFetchWaitTimer: 52.352ms - RowMaterializationTimer: 5.196ms Execution Profile 9e48f6ed8577ed82:58f004f400000000:(Total: 21s408ms, non-child: 0.000ns, % non-child: 0.00%) Number of filters: 0 Filter routing table: ID Src. Node Tgt. Node(s) Target type Partition filter Pending (Expected) First arrived Completed Enabled ------------------------------------------------------------------------------------------------------------------- Backend startup latencies: Count: 14, min / max: 1ms / 2ms, 25th %-ile: 1ms, 50th %-ile: 2ms, 75th %-ile: 2ms, 90th %-ile: 2ms, 95th %-ile: 2ms, 99.9th %-ile: 2ms Per Node Peak Memory Usage: 10.17.193.10:22000(822.84 MB) 10.17.193.11:22000(822.75 MB) 10.17.193.12:22000(822.91 MB) 10.17.193.14:22000(822.83 MB) 10.17.193.15:22000(792.83 MB) 10.17.193.16:22000(822.67 MB) 10.17.193.17:22000(822.83 MB) 10.17.193.18:22000(822.83 MB) 10.17.193.19:22000(808.83 MB) 10.17.193.20:22000(817.75 MB) 10.17.193.22:22000(822.91 MB) 10.17.193.23:22000(822.83 MB) 10.17.193.24:22000(818.75 MB) 10.17.193.25:22000(822.75 MB) - FiltersReceived: 0 (0) - FinalizationTimer: 0.000ns Averaged Fragment F02:(Total: 21s453ms, non-child: 53.088ms, % non-child: 0.25%) split sizes: min: 0, max: 0, avg: 0, stddev: 0 completion times: min:21s454ms max:21s454ms mean: 21s454ms stddev:0.000ns execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec num instances: 1 - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 296.50 KB (303616) - PerHostPeakMemUsage: 822.84 MB (862806005) - RowsProduced: 4 (4) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 5 (5) - TotalThreadsTotalWallClockTime: 21s428ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 41.993ms - TotalThreadsVoluntaryContextSwitches: 11 (11) Fragment Instance Lifecycle Timings: - ExecTime: 52.549ms - ExecTreeExecTime: 324.179us - OpenTime: 21s375ms - ExecTreeOpenTime: 21s334ms - PrepareTime: 25.296ms - ExecTreePrepareTime: 91.875us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 49 (49) - BlocksRecycled: 3 (3) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 32.02 MB (33570816) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns PLAN_ROOT_SINK: - PeakMemoryUsage: 0 CodeGen:(Total: 65.897ms, non-child: 65.897ms, % non-child: 100.00%) - CodegenTime: 1.169ms - CompileTime: 5.323ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2068576) - NumFunctions: 28 (28) - NumInstructions: 577 (577) - OptimizationTime: 35.224ms - PeakMemoryUsage: 288.50 KB (295424) - PrepareTime: 24.743ms EXCHANGE_NODE (id=5):(Total: 21s334ms, non-child: 21s334ms, % non-child: 100.00%) - ConvertRowBatchTime: 0.000ns - MergeGetNext: 317.616us - MergeGetNextBatch: 308.525us - PeakMemoryUsage: 0 - RowsReturned: 4 (4) - RowsReturnedRate: 0 RecvrSide: - FirstBatchArrivalWaitTime: 21s334ms - TotalBytesReceived: 417.00 B (417) - TotalGetBatchTime: 21s334ms - DataArrivalTimer: 21s334ms SenderSide: - DeserializeRowBatchTimer: 24.035us - NumBatchesAccepted: 4 (4) - NumBatchesRejected: 0 (0) Coordinator Fragment F02: Instance 9e48f6ed8577ed82:58f004f400000000 (host=10.17.193.10:22000):(Total: 21s453ms, non-child: 53.088ms, % non-child: 0.25%) MemoryUsage(500.000ms): 8.29 KB, 8.29 KB, 8.29 KB, 8.29 KB, 8.29 KB, 8.29 KB, 8.29 KB, 8.29 KB, 8.29 KB, 8.29 KB, 8.29 KB, 8.29 KB, 8.29 KB, 8.29 KB, 8.29 KB, 8.29 KB, 8.29 KB, 8.29 KB, 8.29 KB, 8.29 KB, 8.29 KB, 8.29 KB, 8.29 KB, 8.29 KB, 8.29 KB, 8.29 KB, 8.29 KB, 8.29 KB, 8.29 KB, 8.29 KB, 8.29 KB, 8.29 KB, 8.29 KB, 8.29 KB, 8.29 KB, 8.29 KB, 8.29 KB, 8.29 KB, 8.29 KB, 8.29 KB, 8.29 KB, 8.29 KB, 24.29 KB - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 296.50 KB (303616) - PerHostPeakMemUsage: 822.84 MB (862806005) - RowsProduced: 4 (4) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 5 (5) - TotalThreadsTotalWallClockTime: 21s428ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 41.993ms - TotalThreadsVoluntaryContextSwitches: 11 (11) Fragment Instance Lifecycle Timings: - ExecTime: 52.549ms - ExecTreeExecTime: 324.179us - OpenTime: 21s375ms - ExecTreeOpenTime: 21s334ms - PrepareTime: 25.296ms - ExecTreePrepareTime: 91.875us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 49 (49) - BlocksRecycled: 3 (3) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 32.02 MB (33570816) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns PLAN_ROOT_SINK: - PeakMemoryUsage: 0 CodeGen:(Total: 65.897ms, non-child: 65.897ms, % non-child: 100.00%) - CodegenTime: 1.169ms - CompileTime: 5.323ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2068576) - NumFunctions: 28 (28) - NumInstructions: 577 (577) - OptimizationTime: 35.224ms - PeakMemoryUsage: 288.50 KB (295424) - PrepareTime: 24.743ms EXCHANGE_NODE (id=5):(Total: 21s334ms, non-child: 75.501us, % non-child: 0.00%) ExecOption: Codegen Enabled - ConvertRowBatchTime: 0.000ns - MergeGetNext: 317.616us - MergeGetNextBatch: 308.525us - PeakMemoryUsage: 0 - RowsReturned: 4 (4) - RowsReturnedRate: 0 RecvrSide: BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 417.00 B - FirstBatchArrivalWaitTime: 21s334ms - TotalBytesReceived: 417.00 B (417) - TotalGetBatchTime: 21s334ms - DataArrivalTimer: 21s334ms SenderSide: - DeserializeRowBatchTimer: 24.035us - NumBatchesAccepted: 4 (4) - NumBatchesRejected: 0 (0) Averaged Fragment F01:(Total: 21s395ms, non-child: 4.099ms, % non-child: 0.02%) split sizes: min: 0, max: 0, avg: 0, stddev: 0 completion times: min:21s391ms max:21s402ms mean: 21s396ms stddev:3.415ms execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec num instances: 14 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 32.10 MB (33662895) - PerHostPeakMemUsage: 819.02 MB (858804772) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 21s193ms - TotalNetworkSendTime: 101.017us - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 16 (16) - TotalThreadsTotalWallClockTime: 21s365ms - TotalThreadsSysTime: 1.999ms - TotalThreadsUserTime: 170.188ms - TotalThreadsVoluntaryContextSwitches: 6 (6) Fragment Instance Lifecycle Timings: - ExecTime: 625.466us - ExecTreeExecTime: 6.174us - OpenTime: 21s365ms - ExecTreeOpenTime: 21s195ms - PrepareTime: 29.539ms - ExecTreePrepareTime: 1.260ms DataStreamSender (dst_id=5):(Total: 24.102us, non-child: 24.102us, % non-child: 100.00%) - BytesSent: 29.00 B (29) - OverallThroughput: 696.57 KB/sec - PeakMemoryUsage: 1008.00 B (1008) - RowsReturned: 0 (0) - SerializeBatchTime: 11.557us - UncompressedRowBatchSize: 29.00 B (29) CodeGen:(Total: 194.915ms, non-child: 194.915ms, % non-child: 100.00%) - CodegenTime: 6.543ms - CompileTime: 42.327ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2068576) - NumFunctions: 89 (89) - NumInstructions: 1.98K (1981) - OptimizationTime: 127.110ms - PeakMemoryUsage: 990.50 KB (1014272) - PrepareTime: 24.910ms SORT_NODE (id=2):(Total: 21s196ms, non-child: 449.289us, % non-child: 0.00%) - InMemorySortTime: 1.464us - InitialRunsCreated: 1 (1) - PeakMemoryUsage: 24.01 MB (25176356) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SortDataSize: 37.00 B (37) - SpilledRuns: 0 (0) - TotalMergesPerformed: 0 (0) AGGREGATION_NODE (id=4):(Total: 21s195ms, non-child: 2.504ms, % non-child: 0.01%) - BuildTime: 18.054us - GetNewBlockTime: 152.574us - GetResultsTime: 6.248us - HTResizeTime: 5.615us - HashBuckets: 292 (292) - LargestPartitionPercent: 2 (2) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 10.32 MB (10816786) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.896us EXCHANGE_NODE (id=3):(Total: 21s193ms, non-child: 21s193ms, % non-child: 100.00%) - ConvertRowBatchTime: 11.127us - PeakMemoryUsage: 0 - RowsReturned: 4 (4) - RowsReturnedRate: 0 RecvrSide: - FirstBatchArrivalWaitTime: 20s405ms - TotalBytesReceived: 595.00 B (595) - TotalGetBatchTime: 21s193ms - DataArrivalTimer: 21s193ms SenderSide: - DeserializeRowBatchTimer: 33.671us - NumBatchesAccepted: 4 (4) - NumBatchesRejected: 0 (0) BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 49 (49) - BlocksRecycled: 3 (3) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 32.00 MB (33558212) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns Fragment F01: Instance 9e48f6ed8577ed82:58f004f40000001b (host=10.17.193.17:22000):(Total: 21s400ms, non-child: 4.513ms, % non-child: 0.02%) MemoryUsage(500.000ms): 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.31 MB, 10.31 MB, 10.31 MB, 10.33 MB, 10.35 MB, 10.35 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 32.21 MB (33774073) - PerHostPeakMemUsage: 822.83 MB (862797622) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 21s195ms - TotalNetworkSendTime: 379.716us - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 17 (17) - TotalThreadsTotalWallClockTime: 21s368ms - TotalThreadsSysTime: 2.999ms - TotalThreadsUserTime: 169.974ms - TotalThreadsVoluntaryContextSwitches: 17 (17) Fragment Instance Lifecycle Timings: - ExecTime: 761.036us - ExecTreeExecTime: 8.260us - OpenTime: 21s368ms - ExecTreeOpenTime: 21s197ms - PrepareTime: 31.545ms - ExecTreePrepareTime: 1.356ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 49 (49) - BlocksRecycled: 3 (3) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 32.02 MB (33570816) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=5):(Total: 31.818us, non-child: 31.818us, % non-child: 100.00%) - BytesSent: 107.00 B (107) - OverallThroughput: 3.21 MB/sec - PeakMemoryUsage: 1008.00 B (1008) - RowsReturned: 1 (1) - SerializeBatchTime: 19.898us - UncompressedRowBatchSize: 107.00 B (107) CodeGen:(Total: 196.681ms, non-child: 196.681ms, % non-child: 100.00%) - CodegenTime: 6.516ms - CompileTime: 42.324ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2068576) - NumFunctions: 89 (89) - NumInstructions: 1.98K (1981) - OptimizationTime: 127.232ms - PeakMemoryUsage: 990.50 KB (1014272) - PrepareTime: 26.542ms SORT_NODE (id=2):(Total: 21s199ms, non-child: 1.062ms, % non-child: 0.01%) ExecOption: Codegen Enabled - InMemorySortTime: 1.818us - InitialRunsCreated: 1 (1) - PeakMemoryUsage: 24.02 MB (25182208) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SortDataSize: 132.00 B (132) - SpilledRuns: 0 (0) - TotalMergesPerformed: 0 (0) AGGREGATION_NODE (id=4):(Total: 21s198ms, non-child: 2.715ms, % non-child: 0.01%) ExecOption: Codegen Enabled - BuildTime: 40.702us - GetNewBlockTime: 270.123us - GetResultsTime: 18.725us - HTResizeTime: 5.621us - HashBuckets: 1.02K (1024) - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 10.36 MB (10860672) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 2.413us EXCHANGE_NODE (id=3):(Total: 21s195ms, non-child: 224.907us, % non-child: 0.00%) - ConvertRowBatchTime: 60.101us - PeakMemoryUsage: 0 - RowsReturned: 14 (14) - RowsReturnedRate: 0 RecvrSide: BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 149.00 B, 149.00 B, 149.00 B, 894.00 B, 1.31 KB, 1.60 KB - FirstBatchArrivalWaitTime: 18s438ms - TotalBytesReceived: 2.04 KB (2086) - TotalGetBatchTime: 21s195ms - DataArrivalTimer: 21s195ms SenderSide: - DeserializeRowBatchTimer: 140.006us - NumBatchesAccepted: 14 (14) - NumBatchesRejected: 0 (0) Instance 9e48f6ed8577ed82:58f004f40000001c (host=10.17.193.18:22000):(Total: 21s400ms, non-child: 4.124ms, % non-child: 0.02%) MemoryUsage(500.000ms): 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 32.06 MB (33618425) - PerHostPeakMemUsage: 822.83 MB (862797317) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 21s199ms - TotalNetworkSendTime: 952.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 17 (17) - TotalThreadsTotalWallClockTime: 21s371ms - TotalThreadsSysTime: 2.999ms - TotalThreadsUserTime: 168.975ms - TotalThreadsVoluntaryContextSwitches: 2 (2) Fragment Instance Lifecycle Timings: - ExecTime: 674.014us - ExecTreeExecTime: 6.607us - OpenTime: 21s370ms - ExecTreeOpenTime: 21s200ms - PrepareTime: 28.450ms - ExecTreePrepareTime: 1.266ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 49 (49) - BlocksRecycled: 3 (3) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 32.00 MB (33554432) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=5):(Total: 12.585us, non-child: 12.585us, % non-child: 100.00%) - BytesSent: 0 - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1008.00 B (1008) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 194.093ms, non-child: 194.093ms, % non-child: 100.00%) - CodegenTime: 6.587ms - CompileTime: 42.656ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2068576) - NumFunctions: 89 (89) - NumInstructions: 1.98K (1981) - OptimizationTime: 127.013ms - PeakMemoryUsage: 990.50 KB (1014272) - PrepareTime: 23.857ms SORT_NODE (id=2):(Total: 21s201ms, non-child: 257.547us, % non-child: 0.00%) ExecOption: Codegen Enabled - InMemorySortTime: 1.266us - InitialRunsCreated: 1 (1) - PeakMemoryUsage: 24.01 MB (25174016) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SortDataSize: 0 - SpilledRuns: 0 (0) - TotalMergesPerformed: 0 (0) AGGREGATION_NODE (id=4):(Total: 21s201ms, non-child: 2.554ms, % non-child: 0.01%) ExecOption: Codegen Enabled - BuildTime: 8.758us - GetNewBlockTime: 159.665us - GetResultsTime: 0.000ns - HTResizeTime: 4.625us - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 10.30 MB (10799232) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.881us EXCHANGE_NODE (id=3):(Total: 21s199ms, non-child: 9.407us, % non-child: 0.00%) - ConvertRowBatchTime: 779.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 RecvrSide: BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - FirstBatchArrivalWaitTime: 21s199ms - TotalBytesReceived: 0 - TotalGetBatchTime: 21s199ms - DataArrivalTimer: 21s199ms SenderSide: - DeserializeRowBatchTimer: 0.000ns - NumBatchesAccepted: 0 (0) - NumBatchesRejected: 0 (0) Instance 9e48f6ed8577ed82:58f004f400000019 (host=10.17.193.12:22000):(Total: 21s398ms, non-child: 4.114ms, % non-child: 0.02%) MemoryUsage(500.000ms): 11.27 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 32.06 MB (33618425) - PerHostPeakMemUsage: 822.91 MB (862880460) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 21s199ms - TotalNetworkSendTime: 715.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 16 (16) - TotalThreadsTotalWallClockTime: 21s368ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 168.975ms - TotalThreadsVoluntaryContextSwitches: 2 (2) Fragment Instance Lifecycle Timings: - ExecTime: 410.380us - ExecTreeExecTime: 4.825us - OpenTime: 21s368ms - ExecTreeOpenTime: 21s201ms - PrepareTime: 29.705ms - ExecTreePrepareTime: 1.053ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 49 (49) - BlocksRecycled: 3 (3) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 32.00 MB (33554432) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=5):(Total: 11.352us, non-child: 11.352us, % non-child: 100.00%) - BytesSent: 0 - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1008.00 B (1008) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 192.370ms, non-child: 192.370ms, % non-child: 100.00%) - CodegenTime: 6.553ms - CompileTime: 41.343ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2068576) - NumFunctions: 89 (89) - NumInstructions: 1.98K (1981) - OptimizationTime: 125.425ms - PeakMemoryUsage: 990.50 KB (1014272) - PrepareTime: 25.033ms SORT_NODE (id=2):(Total: 21s202ms, non-child: 254.809us, % non-child: 0.00%) ExecOption: Codegen Enabled - InMemorySortTime: 899.000ns - InitialRunsCreated: 1 (1) - PeakMemoryUsage: 24.01 MB (25174016) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SortDataSize: 0 - SpilledRuns: 0 (0) - TotalMergesPerformed: 0 (0) AGGREGATION_NODE (id=4):(Total: 21s201ms, non-child: 2.273ms, % non-child: 0.01%) ExecOption: Codegen Enabled - BuildTime: 17.010us - GetNewBlockTime: 129.509us - GetResultsTime: 0.000ns - HTResizeTime: 12.300us - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 10.30 MB (10799232) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 2.087us EXCHANGE_NODE (id=3):(Total: 21s199ms, non-child: 8.876us, % non-child: 0.00%) - ConvertRowBatchTime: 1.080us - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 RecvrSide: BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - FirstBatchArrivalWaitTime: 21s199ms - TotalBytesReceived: 0 - TotalGetBatchTime: 21s199ms - DataArrivalTimer: 21s199ms SenderSide: - DeserializeRowBatchTimer: 0.000ns - NumBatchesAccepted: 0 (0) - NumBatchesRejected: 0 (0) Instance 9e48f6ed8577ed82:58f004f400000017 (host=10.17.193.14:22000):(Total: 21s398ms, non-child: 4.023ms, % non-child: 0.02%) MemoryUsage(500.000ms): 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.31 MB, 10.31 MB, 10.32 MB, 10.33 MB, 10.35 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 32.21 MB (33774073) - PerHostPeakMemUsage: 822.83 MB (862798187) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 21s195ms - TotalNetworkSendTime: 309.712us - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 17 (17) - TotalThreadsTotalWallClockTime: 21s369ms - TotalThreadsSysTime: 5.999ms - TotalThreadsUserTime: 167.974ms - TotalThreadsVoluntaryContextSwitches: 17 (17) Fragment Instance Lifecycle Timings: - ExecTime: 715.563us - ExecTreeExecTime: 7.780us - OpenTime: 21s368ms - ExecTreeOpenTime: 21s198ms - PrepareTime: 28.853ms - ExecTreePrepareTime: 1.192ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 49 (49) - BlocksRecycled: 3 (3) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 32.02 MB (33570816) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=5):(Total: 33.189us, non-child: 33.189us, % non-child: 100.00%) - BytesSent: 107.00 B (107) - OverallThroughput: 3.07 MB/sec - PeakMemoryUsage: 1008.00 B (1008) - RowsReturned: 1 (1) - SerializeBatchTime: 20.973us - UncompressedRowBatchSize: 107.00 B (107) CodeGen:(Total: 194.817ms, non-child: 194.817ms, % non-child: 100.00%) - CodegenTime: 6.374ms - CompileTime: 42.489ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2068576) - NumFunctions: 89 (89) - NumInstructions: 1.98K (1981) - OptimizationTime: 127.329ms - PeakMemoryUsage: 990.50 KB (1014272) - PrepareTime: 24.449ms SORT_NODE (id=2):(Total: 21s199ms, non-child: 1.064ms, % non-child: 0.01%) ExecOption: Codegen Enabled - InMemorySortTime: 2.112us - InitialRunsCreated: 1 (1) - PeakMemoryUsage: 24.02 MB (25182208) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SortDataSize: 132.00 B (132) - SpilledRuns: 0 (0) - TotalMergesPerformed: 0 (0) AGGREGATION_NODE (id=4):(Total: 21s198ms, non-child: 2.491ms, % non-child: 0.01%) ExecOption: Codegen Enabled - BuildTime: 33.337us - GetNewBlockTime: 139.550us - GetResultsTime: 18.790us - HTResizeTime: 5.627us - HashBuckets: 1.02K (1024) - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 10.36 MB (10860672) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 2.095us EXCHANGE_NODE (id=3):(Total: 21s195ms, non-child: 153.828us, % non-child: 0.00%) - ConvertRowBatchTime: 28.363us - PeakMemoryUsage: 0 - RowsReturned: 14 (14) - RowsReturnedRate: 0 RecvrSide: BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 149.00 B, 149.00 B, 298.00 B, 894.00 B, 1.46 KB - FirstBatchArrivalWaitTime: 18s438ms - TotalBytesReceived: 2.04 KB (2086) - TotalGetBatchTime: 21s195ms - DataArrivalTimer: 21s195ms SenderSide: - DeserializeRowBatchTimer: 117.148us - NumBatchesAccepted: 14 (14) - NumBatchesRejected: 0 (0) Instance 9e48f6ed8577ed82:58f004f400000018 (host=10.17.193.22:22000):(Total: 21s397ms, non-child: 3.926ms, % non-child: 0.02%) MemoryUsage(500.000ms): 11.27 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 32.06 MB (33618425) - PerHostPeakMemUsage: 822.91 MB (862881254) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 21s198ms - TotalNetworkSendTime: 1.103us - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 17 (17) - TotalThreadsTotalWallClockTime: 21s371ms - TotalThreadsSysTime: 2.000ms - TotalThreadsUserTime: 169.974ms - TotalThreadsVoluntaryContextSwitches: 2 (2) Fragment Instance Lifecycle Timings: - ExecTime: 630.256us - ExecTreeExecTime: 4.782us - OpenTime: 21s370ms - ExecTreeOpenTime: 21s200ms - PrepareTime: 26.420ms - ExecTreePrepareTime: 1.643ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 49 (49) - BlocksRecycled: 3 (3) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 32.00 MB (33554432) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=5):(Total: 7.387us, non-child: 7.387us, % non-child: 100.00%) - BytesSent: 0 - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1008.00 B (1008) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 191.500ms, non-child: 191.500ms, % non-child: 100.00%) - CodegenTime: 6.314ms - CompileTime: 42.467ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2068576) - NumFunctions: 89 (89) - NumInstructions: 1.98K (1981) - OptimizationTime: 126.867ms - PeakMemoryUsage: 990.50 KB (1014272) - PrepareTime: 21.597ms SORT_NODE (id=2):(Total: 21s202ms, non-child: 254.758us, % non-child: 0.00%) ExecOption: Codegen Enabled - InMemorySortTime: 946.000ns - InitialRunsCreated: 1 (1) - PeakMemoryUsage: 24.01 MB (25174016) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SortDataSize: 0 - SpilledRuns: 0 (0) - TotalMergesPerformed: 0 (0) AGGREGATION_NODE (id=4):(Total: 21s201ms, non-child: 2.923ms, % non-child: 0.01%) ExecOption: Codegen Enabled - BuildTime: 9.664us - GetNewBlockTime: 134.597us - GetResultsTime: 0.000ns - HTResizeTime: 5.677us - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 10.30 MB (10799232) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.745us EXCHANGE_NODE (id=3):(Total: 21s198ms, non-child: 7.763us, % non-child: 0.00%) - ConvertRowBatchTime: 678.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 RecvrSide: BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - FirstBatchArrivalWaitTime: 21s198ms - TotalBytesReceived: 0 - TotalGetBatchTime: 21s198ms - DataArrivalTimer: 21s198ms SenderSide: - DeserializeRowBatchTimer: 0.000ns - NumBatchesAccepted: 0 (0) - NumBatchesRejected: 0 (0) Instance 9e48f6ed8577ed82:58f004f400000016 (host=10.17.193.10:22000):(Total: 21s397ms, non-child: 4.108ms, % non-child: 0.02%) MemoryUsage(500.000ms): 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.31 MB, 10.31 MB, 10.32 MB, 10.33 MB, 10.35 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 32.21 MB (33774073) - PerHostPeakMemUsage: 822.84 MB (862806005) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 21s196ms - TotalNetworkSendTime: 236.979us - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 17 (17) - TotalThreadsTotalWallClockTime: 21s367ms - TotalThreadsSysTime: 999.000us - TotalThreadsUserTime: 170.974ms - TotalThreadsVoluntaryContextSwitches: 17 (17) Fragment Instance Lifecycle Timings: - ExecTime: 666.308us - ExecTreeExecTime: 9.434us - OpenTime: 21s367ms - ExecTreeOpenTime: 21s198ms - PrepareTime: 29.256ms - ExecTreePrepareTime: 1.269ms DataStreamSender (dst_id=5):(Total: 113.146us, non-child: 113.146us, % non-child: 100.00%) - BytesSent: 103.00 B (103) - OverallThroughput: 888.99 KB/sec - PeakMemoryUsage: 1008.00 B (1008) - RowsReturned: 1 (1) - SerializeBatchTime: 100.476us - UncompressedRowBatchSize: 103.00 B (103) CodeGen:(Total: 193.439ms, non-child: 193.439ms, % non-child: 100.00%) - CodegenTime: 6.840ms - CompileTime: 41.655ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2068576) - NumFunctions: 89 (89) - NumInstructions: 1.98K (1981) - OptimizationTime: 126.637ms - PeakMemoryUsage: 990.50 KB (1014272) - PrepareTime: 24.626ms SORT_NODE (id=2):(Total: 21s199ms, non-child: 298.372us, % non-child: 0.00%) ExecOption: Codegen Enabled - InMemorySortTime: 2.943us - InitialRunsCreated: 1 (1) - PeakMemoryUsage: 24.02 MB (25182208) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SortDataSize: 132.00 B (132) - SpilledRuns: 0 (0) - TotalMergesPerformed: 0 (0) AGGREGATION_NODE (id=4):(Total: 21s199ms, non-child: 2.636ms, % non-child: 0.01%) ExecOption: Codegen Enabled - BuildTime: 39.836us - GetNewBlockTime: 162.510us - GetResultsTime: 25.813us - HTResizeTime: 4.535us - HashBuckets: 1.02K (1024) - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 10.36 MB (10860672) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.926us EXCHANGE_NODE (id=3):(Total: 21s196ms, non-child: 351.215us, % non-child: 0.00%) - ConvertRowBatchTime: 29.998us - PeakMemoryUsage: 0 - RowsReturned: 14 (14) - RowsReturnedRate: 0 RecvrSide: BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 151.00 B, 151.00 B, 302.00 B, 906.00 B, 1.33 KB - FirstBatchArrivalWaitTime: 18s438ms - TotalBytesReceived: 2.06 KB (2114) - TotalGetBatchTime: 21s196ms - DataArrivalTimer: 21s196ms SenderSide: - DeserializeRowBatchTimer: 103.595us - NumBatchesAccepted: 14 (14) - NumBatchesRejected: 0 (0) Instance 9e48f6ed8577ed82:58f004f40000001a (host=10.17.193.24:22000):(Total: 21s396ms, non-child: 3.952ms, % non-child: 0.02%) MemoryUsage(500.000ms): 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 32.06 MB (33618425) - PerHostPeakMemUsage: 818.75 MB (858519817) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 21s195ms - TotalNetworkSendTime: 925.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 17 (17) - TotalThreadsTotalWallClockTime: 21s368ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 172.974ms - TotalThreadsVoluntaryContextSwitches: 2 (2) Fragment Instance Lifecycle Timings: - ExecTime: 454.353us - ExecTreeExecTime: 4.170us - OpenTime: 21s368ms - ExecTreeOpenTime: 21s196ms - PrepareTime: 27.912ms - ExecTreePrepareTime: 1.224ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 49 (49) - BlocksRecycled: 3 (3) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 32.00 MB (33554432) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=5):(Total: 13.252us, non-child: 13.252us, % non-child: 100.00%) - BytesSent: 0 - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1008.00 B (1008) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 195.153ms, non-child: 195.153ms, % non-child: 100.00%) - CodegenTime: 6.531ms - CompileTime: 42.752ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2068576) - NumFunctions: 89 (89) - NumInstructions: 1.98K (1981) - OptimizationTime: 128.478ms - PeakMemoryUsage: 990.50 KB (1014272) - PrepareTime: 23.345ms SORT_NODE (id=2):(Total: 21s197ms, non-child: 210.514us, % non-child: 0.00%) ExecOption: Codegen Enabled - InMemorySortTime: 1.062us - InitialRunsCreated: 1 (1) - PeakMemoryUsage: 24.01 MB (25174016) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SortDataSize: 0 - SpilledRuns: 0 (0) - TotalMergesPerformed: 0 (0) AGGREGATION_NODE (id=4):(Total: 21s197ms, non-child: 2.013ms, % non-child: 0.01%) ExecOption: Codegen Enabled - BuildTime: 5.902us - GetNewBlockTime: 131.613us - GetResultsTime: 0.000ns - HTResizeTime: 2.942us - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 10.30 MB (10799232) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 2.041us EXCHANGE_NODE (id=3):(Total: 21s195ms, non-child: 7.549us, % non-child: 0.00%) - ConvertRowBatchTime: 918.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 RecvrSide: BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - FirstBatchArrivalWaitTime: 21s195ms - TotalBytesReceived: 0 - TotalGetBatchTime: 21s195ms - DataArrivalTimer: 21s195ms SenderSide: - DeserializeRowBatchTimer: 0.000ns - NumBatchesAccepted: 0 (0) - NumBatchesRejected: 0 (0) Instance 9e48f6ed8577ed82:58f004f400000015 (host=10.17.193.19:22000):(Total: 21s396ms, non-child: 4.311ms, % non-child: 0.02%) MemoryUsage(500.000ms): 11.27 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.31 MB, 10.31 MB, 10.33 MB, 10.34 MB, 10.35 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 32.21 MB (33774073) - PerHostPeakMemUsage: 808.83 MB (848117519) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 21s191ms - TotalNetworkSendTime: 478.060us - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 17 (17) - TotalThreadsTotalWallClockTime: 21s365ms - TotalThreadsSysTime: 3.000ms - TotalThreadsUserTime: 170.974ms - TotalThreadsVoluntaryContextSwitches: 17 (17) Fragment Instance Lifecycle Timings: - ExecTime: 836.629us - ExecTreeExecTime: 9.544us - OpenTime: 21s364ms - ExecTreeOpenTime: 21s194ms - PrepareTime: 30.637ms - ExecTreePrepareTime: 1.188ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 49 (49) - BlocksRecycled: 3 (3) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 32.02 MB (33570816) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=5):(Total: 40.180us, non-child: 40.180us, % non-child: 100.00%) - BytesSent: 100.00 B (100) - OverallThroughput: 2.37 MB/sec - PeakMemoryUsage: 1008.00 B (1008) - RowsReturned: 1 (1) - SerializeBatchTime: 20.454us - UncompressedRowBatchSize: 100.00 B (100) CodeGen:(Total: 196.415ms, non-child: 196.415ms, % non-child: 100.00%) - CodegenTime: 6.879ms - CompileTime: 42.654ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2068576) - NumFunctions: 89 (89) - NumInstructions: 1.98K (1981) - OptimizationTime: 127.134ms - PeakMemoryUsage: 990.50 KB (1014272) - PrepareTime: 26.038ms SORT_NODE (id=2):(Total: 21s195ms, non-child: 1.048ms, % non-child: 0.00%) ExecOption: Codegen Enabled - InMemorySortTime: 3.124us - InitialRunsCreated: 1 (1) - PeakMemoryUsage: 24.02 MB (25182208) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SortDataSize: 132.00 B (132) - SpilledRuns: 0 (0) - TotalMergesPerformed: 0 (0) AGGREGATION_NODE (id=4):(Total: 21s194ms, non-child: 2.498ms, % non-child: 0.01%) ExecOption: Codegen Enabled - BuildTime: 38.499us - GetNewBlockTime: 132.230us - GetResultsTime: 24.150us - HTResizeTime: 5.061us - HashBuckets: 1.02K (1024) - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 10.36 MB (10860672) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.864us EXCHANGE_NODE (id=3):(Total: 21s191ms, non-child: 155.847us, % non-child: 0.00%) - ConvertRowBatchTime: 27.931us - PeakMemoryUsage: 0 - RowsReturned: 14 (14) - RowsReturnedRate: 0 RecvrSide: BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 148.00 B, 148.00 B, 732.00 B, 1.00 KB, 1.43 KB - FirstBatchArrivalWaitTime: 18s434ms - TotalBytesReceived: 2.00 KB (2046) - TotalGetBatchTime: 21s191ms - DataArrivalTimer: 21s191ms SenderSide: - DeserializeRowBatchTimer: 110.648us - NumBatchesAccepted: 14 (14) - NumBatchesRejected: 0 (0) Instance 9e48f6ed8577ed82:58f004f400000012 (host=10.17.193.15:22000):(Total: 21s392ms, non-child: 4.690ms, % non-child: 0.02%) MemoryUsage(500.000ms): 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 32.06 MB (33618425) - PerHostPeakMemUsage: 792.83 MB (831339591) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 21s190ms - TotalNetworkSendTime: 1.006us - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 17 (17) - TotalThreadsTotalWallClockTime: 21s362ms - TotalThreadsSysTime: 1.999ms - TotalThreadsUserTime: 168.974ms - TotalThreadsVoluntaryContextSwitches: 2 (2) Fragment Instance Lifecycle Timings: - ExecTime: 1.075ms - ExecTreeExecTime: 5.393us - OpenTime: 21s361ms - ExecTreeOpenTime: 21s192ms - PrepareTime: 29.981ms - ExecTreePrepareTime: 1.319ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 49 (49) - BlocksRecycled: 3 (3) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 32.00 MB (33554432) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=5):(Total: 12.474us, non-child: 12.474us, % non-child: 100.00%) - BytesSent: 0 - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1008.00 B (1008) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 194.436ms, non-child: 194.436ms, % non-child: 100.00%) - CodegenTime: 6.965ms - CompileTime: 42.156ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2068576) - NumFunctions: 89 (89) - NumInstructions: 1.98K (1981) - OptimizationTime: 126.575ms - PeakMemoryUsage: 990.50 KB (1014272) - PrepareTime: 25.119ms SORT_NODE (id=2):(Total: 21s193ms, non-child: 287.085us, % non-child: 0.00%) ExecOption: Codegen Enabled - InMemorySortTime: 946.000ns - InitialRunsCreated: 1 (1) - PeakMemoryUsage: 24.01 MB (25174016) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SortDataSize: 0 - SpilledRuns: 0 (0) - TotalMergesPerformed: 0 (0) AGGREGATION_NODE (id=4):(Total: 21s193ms, non-child: 2.633ms, % non-child: 0.01%) ExecOption: Codegen Enabled - BuildTime: 10.208us - GetNewBlockTime: 174.415us - GetResultsTime: 0.000ns - HTResizeTime: 5.782us - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 10.30 MB (10799232) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.708us EXCHANGE_NODE (id=3):(Total: 21s190ms, non-child: 8.157us, % non-child: 0.00%) - ConvertRowBatchTime: 816.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 RecvrSide: BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - FirstBatchArrivalWaitTime: 21s190ms - TotalBytesReceived: 0 - TotalGetBatchTime: 21s190ms - DataArrivalTimer: 21s190ms SenderSide: - DeserializeRowBatchTimer: 0.000ns - NumBatchesAccepted: 0 (0) - NumBatchesRejected: 0 (0) Instance 9e48f6ed8577ed82:58f004f400000013 (host=10.17.193.20:22000):(Total: 21s392ms, non-child: 3.827ms, % non-child: 0.02%) MemoryUsage(500.000ms): 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 32.06 MB (33618425) - PerHostPeakMemUsage: 817.75 MB (857471434) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 21s192ms - TotalNetworkSendTime: 1.217us - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 17 (17) - TotalThreadsTotalWallClockTime: 21s364ms - TotalThreadsSysTime: 1.000ms - TotalThreadsUserTime: 170.974ms - TotalThreadsVoluntaryContextSwitches: 4 (4) Fragment Instance Lifecycle Timings: - ExecTime: 512.971us - ExecTreeExecTime: 4.447us - OpenTime: 21s363ms - ExecTreeOpenTime: 21s193ms - PrepareTime: 28.161ms - ExecTreePrepareTime: 1.133ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 49 (49) - BlocksRecycled: 3 (3) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 32.00 MB (33554432) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=5):(Total: 18.060us, non-child: 18.060us, % non-child: 100.00%) - BytesSent: 0 - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1008.00 B (1008) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 193.679ms, non-child: 193.679ms, % non-child: 100.00%) - CodegenTime: 6.428ms - CompileTime: 41.980ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2068576) - NumFunctions: 89 (89) - NumInstructions: 1.98K (1981) - OptimizationTime: 127.313ms - PeakMemoryUsage: 990.50 KB (1014272) - PrepareTime: 23.814ms SORT_NODE (id=2):(Total: 21s194ms, non-child: 238.729us, % non-child: 0.00%) ExecOption: Codegen Enabled - InMemorySortTime: 1.020us - InitialRunsCreated: 1 (1) - PeakMemoryUsage: 24.01 MB (25174016) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SortDataSize: 0 - SpilledRuns: 0 (0) - TotalMergesPerformed: 0 (0) AGGREGATION_NODE (id=4):(Total: 21s194ms, non-child: 2.446ms, % non-child: 0.01%) ExecOption: Codegen Enabled - BuildTime: 11.063us - GetNewBlockTime: 128.544us - GetResultsTime: 0.000ns - HTResizeTime: 5.909us - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 10.30 MB (10799232) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.581us EXCHANGE_NODE (id=3):(Total: 21s192ms, non-child: 8.539us, % non-child: 0.00%) - ConvertRowBatchTime: 1.025us - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 RecvrSide: BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - FirstBatchArrivalWaitTime: 21s192ms - TotalBytesReceived: 0 - TotalGetBatchTime: 21s192ms - DataArrivalTimer: 21s192ms SenderSide: - DeserializeRowBatchTimer: 0.000ns - NumBatchesAccepted: 0 (0) - NumBatchesRejected: 0 (0) Instance 9e48f6ed8577ed82:58f004f400000011 (host=10.17.193.11:22000):(Total: 21s391ms, non-child: 4.078ms, % non-child: 0.02%) MemoryUsage(500.000ms): 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 32.06 MB (33618425) - PerHostPeakMemUsage: 822.75 MB (862714452) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 21s192ms - TotalNetworkSendTime: 1.239us - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 17 (17) - TotalThreadsTotalWallClockTime: 21s364ms - TotalThreadsSysTime: 3.000ms - TotalThreadsUserTime: 168.974ms - TotalThreadsVoluntaryContextSwitches: 2 (2) Fragment Instance Lifecycle Timings: - ExecTime: 546.276us - ExecTreeExecTime: 4.966us - OpenTime: 21s364ms - ExecTreeOpenTime: 21s193ms - PrepareTime: 26.774ms - ExecTreePrepareTime: 1.534ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 49 (49) - BlocksRecycled: 3 (3) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 32.00 MB (33554432) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=5):(Total: 7.736us, non-child: 7.736us, % non-child: 100.00%) - BytesSent: 0 - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1008.00 B (1008) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 192.255ms, non-child: 192.255ms, % non-child: 100.00%) - CodegenTime: 6.361ms - CompileTime: 42.393ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2068576) - NumFunctions: 89 (89) - NumInstructions: 1.98K (1981) - OptimizationTime: 127.473ms - PeakMemoryUsage: 990.50 KB (1014272) - PrepareTime: 21.829ms SORT_NODE (id=2):(Total: 21s195ms, non-child: 548.628us, % non-child: 0.00%) ExecOption: Codegen Enabled - InMemorySortTime: 922.000ns - InitialRunsCreated: 1 (1) - PeakMemoryUsage: 24.01 MB (25174016) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SortDataSize: 0 - SpilledRuns: 0 (0) - TotalMergesPerformed: 0 (0) AGGREGATION_NODE (id=4):(Total: 21s194ms, non-child: 2.486ms, % non-child: 0.01%) ExecOption: Codegen Enabled - BuildTime: 9.045us - GetNewBlockTime: 150.070us - GetResultsTime: 0.000ns - HTResizeTime: 5.018us - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 10.30 MB (10799232) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.686us EXCHANGE_NODE (id=3):(Total: 21s192ms, non-child: 8.061us, % non-child: 0.00%) - ConvertRowBatchTime: 665.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 RecvrSide: BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - FirstBatchArrivalWaitTime: 21s192ms - TotalBytesReceived: 0 - TotalGetBatchTime: 21s192ms - DataArrivalTimer: 21s192ms SenderSide: - DeserializeRowBatchTimer: 0.000ns - NumBatchesAccepted: 0 (0) - NumBatchesRejected: 0 (0) Instance 9e48f6ed8577ed82:58f004f400000010 (host=10.17.193.16:22000):(Total: 21s391ms, non-child: 3.900ms, % non-child: 0.02%) MemoryUsage(500.000ms): 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 32.06 MB (33618425) - PerHostPeakMemUsage: 822.67 MB (862631247) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 21s184ms - TotalNetworkSendTime: 833.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 17 (17) - TotalThreadsTotalWallClockTime: 21s357ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 171.973ms - TotalThreadsVoluntaryContextSwitches: 2 (2) Fragment Instance Lifecycle Timings: - ExecTime: 534.580us - ExecTreeExecTime: 5.159us - OpenTime: 21s356ms - ExecTreeOpenTime: 21s186ms - PrepareTime: 34.172ms - ExecTreePrepareTime: 1.191ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 49 (49) - BlocksRecycled: 3 (3) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 32.00 MB (33554432) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=5):(Total: 11.545us, non-child: 11.545us, % non-child: 100.00%) - BytesSent: 0 - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1008.00 B (1008) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 200.159ms, non-child: 200.159ms, % non-child: 100.00%) - CodegenTime: 6.434ms - CompileTime: 42.578ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2068576) - NumFunctions: 89 (89) - NumInstructions: 1.98K (1981) - OptimizationTime: 127.288ms - PeakMemoryUsage: 990.50 KB (1014272) - PrepareTime: 29.738ms SORT_NODE (id=2):(Total: 21s187ms, non-child: 256.088us, % non-child: 0.00%) ExecOption: Codegen Enabled - InMemorySortTime: 1.263us - InitialRunsCreated: 1 (1) - PeakMemoryUsage: 24.01 MB (25174016) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SortDataSize: 0 - SpilledRuns: 0 (0) - TotalMergesPerformed: 0 (0) AGGREGATION_NODE (id=4):(Total: 21s187ms, non-child: 2.762ms, % non-child: 0.01%) ExecOption: Codegen Enabled - BuildTime: 9.998us - GetNewBlockTime: 140.157us - GetResultsTime: 0.000ns - HTResizeTime: 5.844us - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 10.30 MB (10799232) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 2.016us EXCHANGE_NODE (id=3):(Total: 21s184ms, non-child: 8.953us, % non-child: 0.00%) - ConvertRowBatchTime: 855.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 RecvrSide: BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - FirstBatchArrivalWaitTime: 21s184ms - TotalBytesReceived: 0 - TotalGetBatchTime: 21s184ms - DataArrivalTimer: 21s184ms SenderSide: - DeserializeRowBatchTimer: 0.000ns - NumBatchesAccepted: 0 (0) - NumBatchesRejected: 0 (0) Instance 9e48f6ed8577ed82:58f004f400000014 (host=10.17.193.25:22000):(Total: 21s391ms, non-child: 4.005ms, % non-child: 0.02%) MemoryUsage(500.000ms): 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 32.06 MB (33618425) - PerHostPeakMemUsage: 822.75 MB (862714050) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 21s187ms - TotalNetworkSendTime: 916.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 17 (17) - TotalThreadsTotalWallClockTime: 21s360ms - TotalThreadsSysTime: 1.000ms - TotalThreadsUserTime: 171.974ms - TotalThreadsVoluntaryContextSwitches: 2 (2) Fragment Instance Lifecycle Timings: - ExecTime: 405.867us - ExecTreeExecTime: 6.161us - OpenTime: 21s360ms - ExecTreeOpenTime: 21s188ms - PrepareTime: 30.846ms - ExecTreePrepareTime: 1.185ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 49 (49) - BlocksRecycled: 3 (3) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 32.00 MB (33554432) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=5):(Total: 12.055us, non-child: 12.055us, % non-child: 100.00%) - BytesSent: 0 - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1008.00 B (1008) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 197.316ms, non-child: 197.316ms, % non-child: 100.00%) - CodegenTime: 6.501ms - CompileTime: 42.619ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2068576) - NumFunctions: 89 (89) - NumInstructions: 1.98K (1981) - OptimizationTime: 127.937ms - PeakMemoryUsage: 990.50 KB (1014272) - PrepareTime: 26.170ms SORT_NODE (id=2):(Total: 21s190ms, non-child: 265.905us, % non-child: 0.00%) ExecOption: Codegen Enabled - InMemorySortTime: 1.313us - InitialRunsCreated: 1 (1) - PeakMemoryUsage: 24.01 MB (25174016) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SortDataSize: 0 - SpilledRuns: 0 (0) - TotalMergesPerformed: 0 (0) AGGREGATION_NODE (id=4):(Total: 21s189ms, non-child: 2.336ms, % non-child: 0.01%) ExecOption: Codegen Enabled - BuildTime: 9.566us - GetNewBlockTime: 143.275us - GetResultsTime: 0.000ns - HTResizeTime: 4.591us - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 10.30 MB (10799232) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.860us EXCHANGE_NODE (id=3):(Total: 21s187ms, non-child: 11.428us, % non-child: 0.00%) - ConvertRowBatchTime: 1.350us - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 RecvrSide: BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - FirstBatchArrivalWaitTime: 21s187ms - TotalBytesReceived: 0 - TotalGetBatchTime: 21s187ms - DataArrivalTimer: 21s187ms SenderSide: - DeserializeRowBatchTimer: 0.000ns - NumBatchesAccepted: 0 (0) - NumBatchesRejected: 0 (0) Instance 9e48f6ed8577ed82:58f004f40000000f (host=10.17.193.23:22000):(Total: 21s390ms, non-child: 3.816ms, % non-child: 0.02%) MemoryUsage(500.000ms): 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB, 10.30 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 32.06 MB (33618425) - PerHostPeakMemUsage: 822.83 MB (862797854) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 21s187ms - TotalNetworkSendTime: 868.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 17 (17) - TotalThreadsTotalWallClockTime: 21s359ms - TotalThreadsSysTime: 2.999ms - TotalThreadsUserTime: 168.974ms - TotalThreadsVoluntaryContextSwitches: 2 (2) Fragment Instance Lifecycle Timings: - ExecTime: 533.223us - ExecTreeExecTime: 4.916us - OpenTime: 21s358ms - ExecTreeOpenTime: 21s188ms - PrepareTime: 30.839ms - ExecTreePrepareTime: 1.088ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 49 (49) - BlocksRecycled: 3 (3) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 32.00 MB (33554432) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=5):(Total: 12.661us, non-child: 12.661us, % non-child: 100.00%) - BytesSent: 0 - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1008.00 B (1008) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 196.498ms, non-child: 196.498ms, % non-child: 100.00%) - CodegenTime: 6.315ms - CompileTime: 42.516ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2068576) - NumFunctions: 89 (89) - NumInstructions: 1.98K (1981) - OptimizationTime: 126.842ms - PeakMemoryUsage: 990.50 KB (1014272) - PrepareTime: 26.587ms SORT_NODE (id=2):(Total: 21s190ms, non-child: 242.771us, % non-child: 0.00%) ExecOption: Codegen Enabled - InMemorySortTime: 875.000ns - InitialRunsCreated: 1 (1) - PeakMemoryUsage: 24.01 MB (25174016) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SortDataSize: 0 - SpilledRuns: 0 (0) - TotalMergesPerformed: 0 (0) AGGREGATION_NODE (id=4):(Total: 21s189ms, non-child: 2.297ms, % non-child: 0.01%) ExecOption: Codegen Enabled - BuildTime: 9.176us - GetNewBlockTime: 139.789us - GetResultsTime: 0.000ns - HTResizeTime: 5.090us - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 10.30 MB (10799232) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.646us EXCHANGE_NODE (id=3):(Total: 21s187ms, non-child: 8.991us, % non-child: 0.00%) - ConvertRowBatchTime: 1.223us - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 RecvrSide: BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - FirstBatchArrivalWaitTime: 21s187ms - TotalBytesReceived: 0 - TotalGetBatchTime: 21s187ms - DataArrivalTimer: 21s187ms SenderSide: - DeserializeRowBatchTimer: 0.000ns - NumBatchesAccepted: 0 (0) - NumBatchesRejected: 0 (0) Averaged Fragment F00:(Total: 20s507ms, non-child: 14.873ms, % non-child: 0.07%) split sizes: min: 4.21 GB, max: 4.71 GB, avg: 4.60 GB, stddev: 147.33 MB completion times: min:18s642ms max:21s399ms mean: 20s509ms stddev:738.160ms execution rates: min:224.98 MB/sec max:237.67 MB/sec mean:229.60 MB/sec stddev:4.11 MB/sec num instances: 14 - AverageThreadTokens: 11.01 - BloomFilterBytes: 0 - PeakMemoryUsage: 808.72 MB (848000460) - PerHostPeakMemUsage: 819.02 MB (858804772) - RowsProduced: 4 (4) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1.957ms - TotalStorageWaitTime: 669.764ms - TotalThreadsInvoluntaryContextSwitches: 11.18K (11184) - TotalThreadsTotalWallClockTime: 3m44s - TotalThreadsSysTime: 718.170ms - TotalThreadsUserTime: 42s654ms - TotalThreadsVoluntaryContextSwitches: 123.78K (123783) Fragment Instance Lifecycle Timings: - ExecTime: 20s232ms - ExecTreeExecTime: 20s223ms - OpenTime: 239.902ms - ExecTreeOpenTime: 69.658us - PrepareTime: 35.163ms - ExecTreePrepareTime: 1.410ms DataStreamSender (dst_id=3):(Total: 110.627us, non-child: 110.627us, % non-child: 100.00%) - BytesSent: 595.00 B (595) - OverallThroughput: 6.41 MB/sec - PeakMemoryUsage: 27.59 KB (28256) - RowsReturned: 4 (4) - SerializeBatchTime: 76.743us - UncompressedRowBatchSize: 595.00 B (595) CodeGen:(Total: 267.026ms, non-child: 267.026ms, % non-child: 100.00%) - CodegenTime: 16.883ms - CompileTime: 62.177ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2068576) - NumFunctions: 139 (139) - NumInstructions: 4.38K (4382) - OptimizationTime: 176.892ms - PeakMemoryUsage: 2.14 MB (2243584) - PrepareTime: 27.371ms AGGREGATION_NODE (id=1):(Total: 20s225ms, non-child: 19s739ms, % non-child: 97.60%) - GetNewBlockTime: 143.239us - GetResultsTime: 22.047us - HTResizeTime: 915.808us - HashBuckets: 8.19K (8192) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.44 MB (2557804) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 4 (4) - RowsReturnedRate: 0 - StreamingTime: 19s441ms - UnpinTime: 0.000ns HDFS_SCAN_NODE (id=0):(Total: 485.732ms, non-child: 485.732ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.04 - AverageScannerThreadConcurrency: 10.11 - BytesRead: 1.07 GB (1145053905) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.07 GB (1145053905) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.07 GB (1145053905) - CachedFileHandlesHitCount: 243 (243) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 2s116ms - MaxCompressedTextFileLength: 0 - NumColumns: 7 (7) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 8 (8) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 12 (12) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 807.04 MB (846243610) - PerReadThreadRawHdfsThroughput: 1.18 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 29.288ms - RowBatchQueuePutWaitTime: 3m2s - RowsRead: 128.57M (128570649) - RowsReturned: 126.76M (126762585) - RowsReturnedRate: 262.80 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 9.13K (9129) - ScannerThreadsTotalWallClockTime: 3m24s - MaterializeTupleTime(*): 18s168ms - ScannerThreadsSysTime: 462.780ms - ScannerThreadsUserTime: 22s473ms - ScannerThreadsVoluntaryContextSwitches: 123.75K (123749) - TotalRawHdfsReadTime(*): 912.527ms - TotalReadThroughput: 53.39 MB/sec Fragment F00: Instance 9e48f6ed8577ed82:58f004f40000000a (host=10.17.193.22:22000):(Total: 21s397ms, non-child: 16.558ms, % non-child: 0.08%) Hdfs split stats (:<# splits>/): 10:1/253.39 MB 8:3/760.20 MB 1:2/506.78 MB 3:3/760.20 MB 7:2/506.77 MB 2:2/506.80 MB 5:1/253.40 MB 0:5/1.24 GB MemoryUsage(500.000ms): 3.45 MB, 811.97 MB, 811.89 MB, 812.29 MB, 811.96 MB, 811.97 MB, 812.05 MB, 716.70 MB, 716.70 MB, 716.78 MB, 716.70 MB, 716.70 MB, 716.62 MB, 621.19 MB, 621.51 MB, 621.43 MB, 621.28 MB, 621.44 MB, 621.20 MB, 525.53 MB, 525.68 MB, 525.76 MB, 430.43 MB, 430.43 MB, 430.27 MB, 366.83 MB, 334.14 MB, 497.63 MB, 479.81 MB, 479.97 MB, 479.90 MB, 424.28 MB, 424.36 MB, 424.20 MB, 416.28 MB, 368.71 MB, 368.71 MB, 368.47 MB, 328.66 MB, 312.90 MB, 257.26 MB, 249.18 MB, 200.92 MB ThreadUsage(500.000ms): 1, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 12, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8 - AverageThreadTokens: 10.95 - BloomFilterBytes: 0 - PeakMemoryUsage: 812.60 MB (852077549) - PerHostPeakMemUsage: 822.91 MB (862881254) - RowsProduced: 4 (4) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 2.074ms - TotalStorageWaitTime: 764.570ms - TotalThreadsInvoluntaryContextSwitches: 12.47K (12472) - TotalThreadsTotalWallClockTime: 3m55s - TotalThreadsSysTime: 801.873ms - TotalThreadsUserTime: 45s149ms - TotalThreadsVoluntaryContextSwitches: 126.67K (126666) Fragment Instance Lifecycle Timings: - ExecTime: 21s126ms - ExecTreeExecTime: 21s116ms - OpenTime: 238.593ms - ExecTreeOpenTime: 73.201us - PrepareTime: 32.163ms - ExecTreePrepareTime: 1.683ms DataStreamSender (dst_id=3):(Total: 72.043us, non-child: 72.043us, % non-child: 100.00%) - BytesSent: 595.00 B (595) - OverallThroughput: 7.88 MB/sec - PeakMemoryUsage: 27.59 KB (28256) - RowsReturned: 4 (4) - SerializeBatchTime: 42.302us - UncompressedRowBatchSize: 595.00 B (595) CodeGen:(Total: 262.632ms, non-child: 262.632ms, % non-child: 100.00%) - CodegenTime: 16.310ms - CompileTime: 61.686ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2068576) - NumFunctions: 139 (139) - NumInstructions: 4.38K (4382) - OptimizationTime: 176.087ms - PeakMemoryUsage: 2.14 MB (2243584) - PrepareTime: 24.275ms AGGREGATION_NODE (id=1):(Total: 21s118ms, non-child: 20s591ms, % non-child: 97.50%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 94.082us - GetResultsTime: 23.389us - HTResizeTime: 652.868us - HashBuckets: 8.19K (8192) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.44 MB (2557804) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 4 (4) - RowsReturnedRate: 0 - StreamingTime: 20s264ms - UnpinTime: 0.000ns HDFS_SCAN_NODE (id=0):(Total: 527.310ms, non-child: 527.310ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 10:1/253.39 MB 8:3/760.20 MB 1:2/506.78 MB 3:3/760.20 MB 7:2/506.77 MB 2:2/506.80 MB 5:1/253.40 MB 0:5/1.24 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 19 out of 19 Hdfs Read Thread Concurrency Bucket: 0:97.62% 1:2.381% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:133 BytesRead(500.000ms): 0, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 1.01 GB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB - FooterProcessingTime: (Avg: 2.047ms ; Min: 528.316us ; Max: 12.231ms ; Number of samples: 19) - AverageHdfsReadThreadConcurrency: 0.02 - AverageScannerThreadConcurrency: 10.19 - BytesRead: 1.09 GB (1171103522) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.09 GB (1171103522) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.09 GB (1171103522) - CachedFileHandlesHitCount: 247 (247) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 2s259ms - MaxCompressedTextFileLength: 0 - NumColumns: 7 (7) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 8 (8) - NumRowGroups: 19 (19) - NumScannerThreadsStarted: 12 (12) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 810.94 MB (850328384) - PerReadThreadRawHdfsThroughput: 1.16 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 28.986ms - RowBatchQueuePutWaitTime: 3m10s - RowsRead: 131.50M (131502186) - RowsReturned: 129.65M (129652573) - RowsReturnedRate: 245.88 M/sec - ScanRangesComplete: 19 (19) - ScannerThreadsInvoluntaryContextSwitches: 10.34K (10337) - ScannerThreadsTotalWallClockTime: 3m34s - MaterializeTupleTime(*): 19s486ms - ScannerThreadsSysTime: 479.922ms - ScannerThreadsUserTime: 24s146ms - ScannerThreadsVoluntaryContextSwitches: 126.63K (126634) - TotalRawHdfsReadTime(*): 937.491ms - TotalReadThroughput: 51.95 MB/sec Instance 9e48f6ed8577ed82:58f004f400000002 (host=10.17.193.16:22000):(Total: 21s343ms, non-child: 14.651ms, % non-child: 0.07%) Hdfs split stats (:<# splits>/): 5:1/253.41 MB 7:2/506.81 MB 3:2/506.77 MB 10:1/253.39 MB 2:1/253.39 MB 9:2/506.79 MB 6:3/760.19 MB 1:3/760.21 MB 0:4/1013.61 MB MemoryUsage(500.000ms): 1.31 MB, 812.29 MB, 811.97 MB, 812.05 MB, 811.97 MB, 812.13 MB, 804.26 MB, 716.62 MB, 716.62 MB, 716.56 MB, 716.86 MB, 716.78 MB, 716.46 MB, 621.28 MB, 621.43 MB, 621.43 MB, 621.36 MB, 621.36 MB, 621.36 MB, 525.65 MB, 525.49 MB, 485.81 MB, 430.48 MB, 430.24 MB, 430.16 MB, 342.32 MB, 333.83 MB, 506.96 MB, 479.89 MB, 479.97 MB, 479.97 MB, 424.20 MB, 424.19 MB, 424.28 MB, 376.60 MB, 368.44 MB, 368.44 MB, 368.52 MB, 312.74 MB, 289.01 MB, 257.17 MB, 233.26 MB, 121.17 MB ThreadUsage(500.000ms): 1, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 9, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 5 - AverageThreadTokens: 10.81 - BloomFilterBytes: 0 - PeakMemoryUsage: 812.37 MB (851827542) - PerHostPeakMemUsage: 822.67 MB (862631247) - RowsProduced: 4 (4) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1.936ms - TotalStorageWaitTime: 630.968ms - TotalThreadsInvoluntaryContextSwitches: 12.59K (12589) - TotalThreadsTotalWallClockTime: 3m55s - TotalThreadsSysTime: 730.883ms - TotalThreadsUserTime: 45s384ms - TotalThreadsVoluntaryContextSwitches: 126.61K (126613) Fragment Instance Lifecycle Timings: - ExecTime: 21s068ms - ExecTreeExecTime: 21s060ms - OpenTime: 240.156ms - ExecTreeOpenTime: 57.783us - PrepareTime: 34.832ms - ExecTreePrepareTime: 1.328ms DataStreamSender (dst_id=3):(Total: 95.173us, non-child: 95.173us, % non-child: 100.00%) - BytesSent: 595.00 B (595) - OverallThroughput: 5.96 MB/sec - PeakMemoryUsage: 27.59 KB (28256) - RowsReturned: 4 (4) - SerializeBatchTime: 62.935us - UncompressedRowBatchSize: 595.00 B (595) CodeGen:(Total: 267.281ms, non-child: 267.281ms, % non-child: 100.00%) - CodegenTime: 16.121ms - CompileTime: 62.277ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2068576) - NumFunctions: 139 (139) - NumInstructions: 4.38K (4382) - OptimizationTime: 177.120ms - PeakMemoryUsage: 2.14 MB (2243584) - PrepareTime: 27.309ms AGGREGATION_NODE (id=1):(Total: 21s061ms, non-child: 20s516ms, % non-child: 97.41%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 142.252us - GetResultsTime: 20.882us - HTResizeTime: 927.438us - HashBuckets: 8.19K (8192) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.44 MB (2557804) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 4 (4) - RowsReturnedRate: 0 - StreamingTime: 20s180ms - UnpinTime: 0.000ns HDFS_SCAN_NODE (id=0):(Total: 545.297ms, non-child: 545.297ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:1/253.41 MB 7:2/506.81 MB 3:2/506.77 MB 10:1/253.39 MB 2:1/253.39 MB 9:2/506.79 MB 6:3/760.19 MB 1:3/760.21 MB 0:4/1013.61 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 19 out of 19 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:133 BytesRead(500.000ms): 0, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB - FooterProcessingTime: (Avg: 1.543ms ; Min: 535.682us ; Max: 3.425ms ; Number of samples: 19) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 10.05 - BytesRead: 1.09 GB (1171114598) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.09 GB (1171114598) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.09 GB (1171114598) - CachedFileHandlesHitCount: 247 (247) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 2s280ms - MaxCompressedTextFileLength: 0 - NumColumns: 7 (7) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 9 (9) - NumRowGroups: 19 (19) - NumScannerThreadsStarted: 12 (12) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 810.69 MB (850070185) - PerReadThreadRawHdfsThroughput: 1.23 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 31.119ms - RowBatchQueuePutWaitTime: 3m10s - RowsRead: 131.50M (131502362) - RowsReturned: 129.65M (129654681) - RowsReturnedRate: 237.77 M/sec - ScanRangesComplete: 19 (19) - ScannerThreadsInvoluntaryContextSwitches: 10.46K (10460) - ScannerThreadsTotalWallClockTime: 3m33s - MaterializeTupleTime(*): 19s737ms - ScannerThreadsSysTime: 468.923ms - ScannerThreadsUserTime: 24s375ms - ScannerThreadsVoluntaryContextSwitches: 126.58K (126578) - TotalRawHdfsReadTime(*): 885.345ms - TotalReadThroughput: 51.95 MB/sec Instance 9e48f6ed8577ed82:58f004f40000000d (host=10.17.193.17:22000):(Total: 21s336ms, non-child: 13.920ms, % non-child: 0.07%) Hdfs split stats (:<# splits>/): 8:2/506.78 MB 7:1/253.38 MB 6:2/506.80 MB 10:1/253.39 MB 9:3/760.16 MB 3:3/760.19 MB 4:3/760.18 MB 2:4/1013.56 MB MemoryUsage(500.000ms): 1.31 MB, 812.13 MB, 812.05 MB, 812.13 MB, 811.97 MB, 812.21 MB, 780.24 MB, 716.78 MB, 716.70 MB, 716.64 MB, 716.55 MB, 716.62 MB, 709.05 MB, 621.57 MB, 621.57 MB, 621.57 MB, 621.42 MB, 621.65 MB, 613.42 MB, 525.76 MB, 525.68 MB, 517.75 MB, 430.19 MB, 430.37 MB, 430.35 MB, 342.35 MB, 333.75 MB, 479.98 MB, 479.82 MB, 479.90 MB, 424.28 MB, 424.28 MB, 424.43 MB, 424.20 MB, 368.65 MB, 368.50 MB, 368.50 MB, 360.52 MB, 312.66 MB, 265.12 MB, 257.26 MB, 217.34 MB, 120.73 MB ThreadUsage(500.000ms): 1, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 5 - AverageThreadTokens: 10.79 - BloomFilterBytes: 0 - PeakMemoryUsage: 812.52 MB (851993917) - PerHostPeakMemUsage: 822.83 MB (862797622) - RowsProduced: 4 (4) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1.789ms - TotalStorageWaitTime: 644.367ms - TotalThreadsInvoluntaryContextSwitches: 12.38K (12385) - TotalThreadsTotalWallClockTime: 3m54s - TotalThreadsSysTime: 816.869ms - TotalThreadsUserTime: 46s738ms - TotalThreadsVoluntaryContextSwitches: 126.72K (126722) Fragment Instance Lifecycle Timings: - ExecTime: 21s060ms - ExecTreeExecTime: 21s052ms - OpenTime: 239.449ms - ExecTreeOpenTime: 78.111us - PrepareTime: 36.602ms - ExecTreePrepareTime: 1.300ms DataStreamSender (dst_id=3):(Total: 121.713us, non-child: 121.713us, % non-child: 100.00%) - BytesSent: 595.00 B (595) - OverallThroughput: 4.66 MB/sec - PeakMemoryUsage: 27.59 KB (28256) - RowsReturned: 4 (4) - SerializeBatchTime: 82.810us - UncompressedRowBatchSize: 595.00 B (595) CodeGen:(Total: 268.344ms, non-child: 268.344ms, % non-child: 100.00%) - CodegenTime: 16.683ms - CompileTime: 62.161ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2068576) - NumFunctions: 139 (139) - NumInstructions: 4.38K (4382) - OptimizationTime: 176.408ms - PeakMemoryUsage: 2.14 MB (2243584) - PrepareTime: 29.177ms AGGREGATION_NODE (id=1):(Total: 21s054ms, non-child: 20s514ms, % non-child: 97.44%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 177.747us - GetResultsTime: 22.733us - HTResizeTime: 694.853us - HashBuckets: 8.19K (8192) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.44 MB (2557804) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 4 (4) - RowsReturnedRate: 0 - StreamingTime: 20s206ms - UnpinTime: 0.000ns HDFS_SCAN_NODE (id=0):(Total: 539.423ms, non-child: 539.423ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 8:2/506.78 MB 7:1/253.38 MB 6:2/506.80 MB 10:1/253.39 MB 9:3/760.16 MB 3:3/760.19 MB 4:3/760.18 MB 2:4/1013.56 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 19 out of 19 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:133 BytesRead(500.000ms): 0, 705.39 MB, 705.39 MB, 705.39 MB, 705.39 MB, 705.39 MB, 705.39 MB, 705.39 MB, 705.39 MB, 705.39 MB, 705.39 MB, 705.39 MB, 705.39 MB, 705.39 MB, 705.39 MB, 705.39 MB, 705.39 MB, 705.39 MB, 705.39 MB, 705.39 MB, 705.39 MB, 705.39 MB, 705.39 MB, 705.39 MB, 705.39 MB, 705.39 MB, 705.39 MB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB - FooterProcessingTime: (Avg: 1.442ms ; Min: 447.685us ; Max: 2.456ms ; Number of samples: 19) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 10.02 - BytesRead: 1.09 GB (1171118566) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.09 GB (1171118566) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.09 GB (1171118566) - CachedFileHandlesHitCount: 247 (247) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 2s379ms - MaxCompressedTextFileLength: 0 - NumColumns: 7 (7) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 8 (8) - NumRowGroups: 19 (19) - NumScannerThreadsStarted: 12 (12) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 810.85 MB (850236560) - PerReadThreadRawHdfsThroughput: 1.23 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 33.858ms - RowBatchQueuePutWaitTime: 3m8s - RowsRead: 131.50M (131502508) - RowsReturned: 129.65M (129654866) - RowsReturnedRate: 240.36 M/sec - ScanRangesComplete: 19 (19) - ScannerThreadsInvoluntaryContextSwitches: 10.26K (10257) - ScannerThreadsTotalWallClockTime: 3m33s - MaterializeTupleTime(*): 20s818ms - ScannerThreadsSysTime: 555.909ms - ScannerThreadsUserTime: 25s739ms - ScannerThreadsVoluntaryContextSwitches: 126.69K (126686) - TotalRawHdfsReadTime(*): 888.712ms - TotalReadThroughput: 51.95 MB/sec Instance 9e48f6ed8577ed82:58f004f40000000c (host=10.17.193.24:22000):(Total: 21s264ms, non-child: 15.083ms, % non-child: 0.07%) Hdfs split stats (:<# splits>/): 10:1/253.39 MB 7:2/487.75 MB 3:1/253.39 MB 5:1/253.39 MB 8:3/760.21 MB 9:1/253.38 MB 4:6/1.48 GB 1:4/1013.56 MB MemoryUsage(500.000ms): 605.92 MB, 808.05 MB, 807.97 MB, 807.97 MB, 808.05 MB, 808.05 MB, 712.78 MB, 712.54 MB, 712.78 MB, 712.94 MB, 712.62 MB, 712.70 MB, 649.18 MB, 617.17 MB, 617.40 MB, 617.25 MB, 617.33 MB, 617.17 MB, 593.59 MB, 521.54 MB, 521.55 MB, 481.94 MB, 426.13 MB, 426.21 MB, 425.99 MB, 374.02 MB, 373.43 MB, 480.05 MB, 479.90 MB, 472.11 MB, 432.14 MB, 424.28 MB, 424.43 MB, 416.54 MB, 368.74 MB, 368.82 MB, 368.82 MB, 328.93 MB, 313.01 MB, 257.45 MB, 257.37 MB, 201.55 MB ThreadUsage(500.000ms): 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8 - AverageThreadTokens: 11.21 - BloomFilterBytes: 0 - PeakMemoryUsage: 808.45 MB (847716112) - PerHostPeakMemUsage: 818.75 MB (858519817) - RowsProduced: 4 (4) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 2.031ms - TotalStorageWaitTime: 664.563ms - TotalThreadsInvoluntaryContextSwitches: 11.95K (11948) - TotalThreadsTotalWallClockTime: 3m54s - TotalThreadsSysTime: 778.876ms - TotalThreadsUserTime: 44s064ms - TotalThreadsVoluntaryContextSwitches: 126.15K (126147) Fragment Instance Lifecycle Timings: - ExecTime: 20s991ms - ExecTreeExecTime: 20s983ms - OpenTime: 239.559ms - ExecTreeOpenTime: 59.457us - PrepareTime: 33.507ms - ExecTreePrepareTime: 1.329ms DataStreamSender (dst_id=3):(Total: 83.314us, non-child: 83.314us, % non-child: 100.00%) - BytesSent: 595.00 B (595) - OverallThroughput: 6.81 MB/sec - PeakMemoryUsage: 27.59 KB (28256) - RowsReturned: 4 (4) - SerializeBatchTime: 51.729us - UncompressedRowBatchSize: 595.00 B (595) CodeGen:(Total: 265.148ms, non-child: 265.148ms, % non-child: 100.00%) - CodegenTime: 17.030ms - CompileTime: 62.317ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2068576) - NumFunctions: 139 (139) - NumInstructions: 4.38K (4382) - OptimizationTime: 176.423ms - PeakMemoryUsage: 2.14 MB (2243584) - PrepareTime: 25.827ms AGGREGATION_NODE (id=1):(Total: 20s984ms, non-child: 20s465ms, % non-child: 97.53%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 151.766us - GetResultsTime: 21.504us - HTResizeTime: 1.009ms - HashBuckets: 8.19K (8192) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.44 MB (2557804) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 4 (4) - RowsReturnedRate: 0 - StreamingTime: 20s154ms - UnpinTime: 0.000ns HDFS_SCAN_NODE (id=0):(Total: 518.851ms, non-child: 518.851ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 10:1/253.39 MB 7:2/487.75 MB 3:1/253.39 MB 5:1/253.39 MB 8:3/760.21 MB 9:1/253.38 MB 4:6/1.48 GB 1:4/1013.56 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 19 out of 19 Hdfs Read Thread Concurrency Bucket: 0:97.62% 1:0% 2:0% 3:0% 4:0% 5:2.381% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:133 BytesRead(500.000ms): 478.83 MB, 700.97 MB, 700.97 MB, 700.97 MB, 700.97 MB, 700.97 MB, 700.97 MB, 700.97 MB, 700.97 MB, 700.97 MB, 700.97 MB, 700.97 MB, 700.97 MB, 700.97 MB, 700.97 MB, 700.97 MB, 700.97 MB, 700.97 MB, 700.97 MB, 700.97 MB, 700.97 MB, 700.97 MB, 700.97 MB, 700.97 MB, 700.97 MB, 759.76 MB, 759.76 MB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB - FooterProcessingTime: (Avg: 1.736ms ; Min: 550.923us ; Max: 8.693ms ; Number of samples: 19) - AverageHdfsReadThreadConcurrency: 0.12 - AverageScannerThreadConcurrency: 10.21 - BytesRead: 1.09 GB (1166485155) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.09 GB (1166485155) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.09 GB (1166485155) - CachedFileHandlesHitCount: 246 (246) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 2s169ms - MaxCompressedTextFileLength: 0 - NumColumns: 7 (7) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 8 (8) - NumRowGroups: 19 (19) - NumScannerThreadsStarted: 12 (12) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 806.77 MB (845958755) - PerReadThreadRawHdfsThroughput: 1.24 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 28.947ms - RowBatchQueuePutWaitTime: 3m10s - RowsRead: 130.98M (130981145) - RowsReturned: 129.14M (129141301) - RowsReturnedRate: 248.90 M/sec - ScanRangesComplete: 19 (19) - ScannerThreadsInvoluntaryContextSwitches: 9.82K (9825) - ScannerThreadsTotalWallClockTime: 3m33s - MaterializeTupleTime(*): 18s606ms - ScannerThreadsSysTime: 519.914ms - ScannerThreadsUserTime: 23s126ms - ScannerThreadsVoluntaryContextSwitches: 126.11K (126110) - TotalRawHdfsReadTime(*): 877.686ms - TotalReadThroughput: 52.97 MB/sec Instance 9e48f6ed8577ed82:58f004f400000006 (host=10.17.193.25:22000):(Total: 20s957ms, non-child: 16.453ms, % non-child: 0.08%) Hdfs split stats (:<# splits>/): 4:1/253.42 MB 8:2/506.78 MB 6:2/506.78 MB 9:2/506.78 MB 1:3/512.04 MB 3:5/1.24 GB 7:2/506.78 MB 0:3/760.19 MB MemoryUsage(500.000ms): 1.31 MB, 812.21 MB, 812.04 MB, 812.05 MB, 811.89 MB, 811.97 MB, 772.48 MB, 716.78 MB, 717.02 MB, 716.62 MB, 716.70 MB, 716.86 MB, 716.78 MB, 621.39 MB, 621.54 MB, 621.54 MB, 621.62 MB, 621.54 MB, 621.54 MB, 525.71 MB, 525.71 MB, 525.87 MB, 430.70 MB, 430.54 MB, 430.38 MB, 342.46 MB, 334.04 MB, 479.97 MB, 479.82 MB, 479.82 MB, 471.87 MB, 424.20 MB, 424.28 MB, 424.12 MB, 369.03 MB, 368.71 MB, 368.63 MB, 312.65 MB, 312.90 MB, 257.17 MB, 257.10 MB, 201.21 MB ThreadUsage(500.000ms): 1, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8 - AverageThreadTokens: 10.93 - BloomFilterBytes: 0 - PeakMemoryUsage: 812.45 MB (851910345) - PerHostPeakMemUsage: 822.75 MB (862714050) - RowsProduced: 4 (4) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 2.243ms - TotalStorageWaitTime: 695.347ms - TotalThreadsInvoluntaryContextSwitches: 9.94K (9937) - TotalThreadsTotalWallClockTime: 3m52s - TotalThreadsSysTime: 616.900ms - TotalThreadsUserTime: 41s198ms - TotalThreadsVoluntaryContextSwitches: 126.60K (126603) Fragment Instance Lifecycle Timings: - ExecTime: 20s680ms - ExecTreeExecTime: 20s671ms - OpenTime: 240.372ms - ExecTreeOpenTime: 58.169us - PrepareTime: 36.329ms - ExecTreePrepareTime: 1.415ms DataStreamSender (dst_id=3):(Total: 63.262us, non-child: 63.262us, % non-child: 100.00%) - BytesSent: 595.00 B (595) - OverallThroughput: 8.97 MB/sec - PeakMemoryUsage: 27.59 KB (28256) - RowsReturned: 4 (4) - SerializeBatchTime: 32.450us - UncompressedRowBatchSize: 595.00 B (595) CodeGen:(Total: 268.625ms, non-child: 268.625ms, % non-child: 100.00%) - CodegenTime: 17.284ms - CompileTime: 62.222ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2068576) - NumFunctions: 139 (139) - NumInstructions: 4.38K (4382) - OptimizationTime: 177.330ms - PeakMemoryUsage: 2.14 MB (2243584) - PrepareTime: 28.481ms AGGREGATION_NODE (id=1):(Total: 20s672ms, non-child: 20s231ms, % non-child: 97.87%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 162.751us - GetResultsTime: 20.422us - HTResizeTime: 1.034ms - HashBuckets: 8.19K (8192) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.44 MB (2557804) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 4 (4) - RowsReturnedRate: 0 - StreamingTime: 19s932ms - UnpinTime: 0.000ns HDFS_SCAN_NODE (id=0):(Total: 440.759ms, non-child: 440.759ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:1/253.42 MB 8:2/506.78 MB 6:2/506.78 MB 9:2/506.78 MB 1:3/512.04 MB 3:5/1.24 GB 7:2/506.78 MB 0:3/760.19 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 20 out of 20 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:140 BytesRead(500.000ms): 0, 706.68 MB, 706.68 MB, 706.68 MB, 706.68 MB, 706.68 MB, 706.68 MB, 706.68 MB, 706.68 MB, 706.68 MB, 706.68 MB, 706.68 MB, 706.68 MB, 706.68 MB, 706.68 MB, 706.68 MB, 706.68 MB, 706.68 MB, 706.68 MB, 706.68 MB, 706.68 MB, 706.68 MB, 706.68 MB, 706.68 MB, 706.68 MB, 706.68 MB, 706.68 MB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB - FooterProcessingTime: (Avg: 2.655ms ; Min: 694.213us ; Max: 10.322ms ; Number of samples: 20) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 10.17 - BytesRead: 1.09 GB (1172468261) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.09 GB (1172468261) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.09 GB (1172468261) - CachedFileHandlesHitCount: 255 (255) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 1s980ms - MaxCompressedTextFileLength: 0 - NumColumns: 7 (7) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 8 (8) - NumRowGroups: 20 (20) - NumScannerThreadsStarted: 12 (12) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 810.77 MB (850152988) - PerReadThreadRawHdfsThroughput: 1.28 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 12.329ms - RowBatchQueuePutWaitTime: 3m11s - RowsRead: 131.63M (131633679) - RowsReturned: 129.78M (129779873) - RowsReturnedRate: 294.45 M/sec - ScanRangesComplete: 20 (20) - ScannerThreadsInvoluntaryContextSwitches: 7.84K (7842) - ScannerThreadsTotalWallClockTime: 3m31s - MaterializeTupleTime(*): 16s538ms - ScannerThreadsSysTime: 393.934ms - ScannerThreadsUserTime: 20s518ms - ScannerThreadsVoluntaryContextSwitches: 126.57K (126570) - TotalRawHdfsReadTime(*): 851.039ms - TotalReadThroughput: 53.25 MB/sec Instance 9e48f6ed8577ed82:58f004f40000000b (host=10.17.193.12:22000):(Total: 20s690ms, non-child: 13.810ms, % non-child: 0.07%) Hdfs split stats (:<# splits>/): 2:2/506.78 MB 5:1/253.40 MB 7:1/253.42 MB 9:1/253.40 MB 8:3/760.15 MB 1:5/1.24 GB 4:4/986.05 MB 3:1/253.39 MB 0:1/253.41 MB MemoryUsage(500.000ms): 3.45 MB, 812.05 MB, 811.89 MB, 812.05 MB, 812.13 MB, 811.80 MB, 812.05 MB, 716.62 MB, 716.62 MB, 716.54 MB, 716.86 MB, 716.62 MB, 716.78 MB, 621.34 MB, 621.57 MB, 621.65 MB, 621.57 MB, 621.57 MB, 621.49 MB, 525.52 MB, 525.52 MB, 470.44 MB, 430.35 MB, 430.35 MB, 406.35 MB, 334.47 MB, 418.19 MB, 474.90 MB, 474.89 MB, 474.90 MB, 419.28 MB, 419.28 MB, 419.28 MB, 403.54 MB, 363.85 MB, 364.01 MB, 364.01 MB, 307.77 MB, 307.93 MB, 252.44 MB, 244.23 MB, 148.45 MB ThreadUsage(500.000ms): 1, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 12, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 6 - AverageThreadTokens: 10.86 - BloomFilterBytes: 0 - PeakMemoryUsage: 812.60 MB (852076755) - PerHostPeakMemUsage: 822.91 MB (862880460) - RowsProduced: 4 (4) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1.929ms - TotalStorageWaitTime: 676.412ms - TotalThreadsInvoluntaryContextSwitches: 11.38K (11377) - TotalThreadsTotalWallClockTime: 3m47s - TotalThreadsSysTime: 622.898ms - TotalThreadsUserTime: 40s906ms - TotalThreadsVoluntaryContextSwitches: 125.76K (125759) Fragment Instance Lifecycle Timings: - ExecTime: 20s418ms - ExecTreeExecTime: 20s410ms - OpenTime: 238.014ms - ExecTreeOpenTime: 71.682us - PrepareTime: 34.552ms - ExecTreePrepareTime: 1.167ms DataStreamSender (dst_id=3):(Total: 67.865us, non-child: 67.865us, % non-child: 100.00%) - BytesSent: 595.00 B (595) - OverallThroughput: 8.36 MB/sec - PeakMemoryUsage: 27.59 KB (28256) - RowsReturned: 4 (4) - SerializeBatchTime: 44.454us - UncompressedRowBatchSize: 595.00 B (595) CodeGen:(Total: 265.211ms, non-child: 265.211ms, % non-child: 100.00%) - CodegenTime: 16.726ms - CompileTime: 61.349ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2068576) - NumFunctions: 139 (139) - NumInstructions: 4.38K (4382) - OptimizationTime: 175.904ms - PeakMemoryUsage: 2.14 MB (2243584) - PrepareTime: 27.422ms AGGREGATION_NODE (id=1):(Total: 20s411ms, non-child: 19s971ms, % non-child: 97.84%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 145.224us - GetResultsTime: 23.524us - HTResizeTime: 1.333ms - HashBuckets: 8.19K (8192) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.44 MB (2557804) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 4 (4) - RowsReturnedRate: 0 - StreamingTime: 19s668ms - UnpinTime: 0.000ns HDFS_SCAN_NODE (id=0):(Total: 439.872ms, non-child: 439.872ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:2/506.78 MB 5:1/253.40 MB 7:1/253.42 MB 9:1/253.40 MB 8:3/760.15 MB 1:5/1.24 GB 4:4/986.05 MB 3:1/253.39 MB 0:1/253.41 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 19 out of 19 Hdfs Read Thread Concurrency Bucket: 0:97.56% 1:0% 2:2.439% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:133 BytesRead(500.000ms): 0, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 949.00 MB, 1.08 GB, 1.08 GB, 1.08 GB, 1.08 GB, 1.08 GB, 1.08 GB, 1.08 GB, 1.08 GB, 1.08 GB, 1.08 GB, 1.08 GB, 1.08 GB, 1.08 GB, 1.08 GB, 1.08 GB - FooterProcessingTime: (Avg: 2.033ms ; Min: 397.200us ; Max: 9.568ms ; Number of samples: 19) - AverageHdfsReadThreadConcurrency: 0.05 - AverageScannerThreadConcurrency: 10.10 - BytesRead: 1.08 GB (1164407727) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.08 GB (1164407727) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.08 GB (1164407727) - CachedFileHandlesHitCount: 246 (246) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 1s968ms - MaxCompressedTextFileLength: 0 - NumColumns: 7 (7) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 9 (9) - NumRowGroups: 19 (19) - NumScannerThreadsStarted: 12 (12) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 810.93 MB (850319398) - PerReadThreadRawHdfsThroughput: 1.20 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 30.210ms - RowBatchQueuePutWaitTime: 3m6s - RowsRead: 130.75M (130748840) - RowsReturned: 128.91M (128910645) - RowsReturnedRate: 293.06 M/sec - ScanRangesComplete: 19 (19) - ScannerThreadsInvoluntaryContextSwitches: 9.28K (9284) - ScannerThreadsTotalWallClockTime: 3m26s - MaterializeTupleTime(*): 16s558ms - ScannerThreadsSysTime: 399.932ms - ScannerThreadsUserTime: 20s512ms - ScannerThreadsVoluntaryContextSwitches: 125.73K (125727) - TotalRawHdfsReadTime(*): 905.242ms - TotalReadThroughput: 52.88 MB/sec Instance 9e48f6ed8577ed82:58f004f400000005 (host=10.17.193.20:22000):(Total: 20s631ms, non-child: 15.011ms, % non-child: 0.07%) Hdfs split stats (:<# splits>/): 4:1/253.39 MB 1:1/253.41 MB 8:1/253.40 MB 10:1/253.38 MB 5:1/253.39 MB 9:3/760.18 MB 7:2/506.77 MB 6:2/506.79 MB 3:6/1.46 GB 0:1/253.39 MB MemoryUsage(500.000ms): 798.83 MB, 806.97 MB, 807.12 MB, 807.05 MB, 807.05 MB, 807.05 MB, 719.64 MB, 711.78 MB, 711.86 MB, 711.70 MB, 711.70 MB, 711.54 MB, 640.25 MB, 616.54 MB, 616.46 MB, 616.39 MB, 616.39 MB, 616.54 MB, 560.79 MB, 520.79 MB, 520.95 MB, 457.13 MB, 425.54 MB, 425.53 MB, 406.34 MB, 373.99 MB, 586.14 MB, 480.05 MB, 479.81 MB, 471.95 MB, 424.20 MB, 424.28 MB, 416.20 MB, 376.49 MB, 368.52 MB, 360.71 MB, 328.82 MB, 304.80 MB, 265.19 MB, 249.29 MB, 174.52 MB ThreadUsage(500.000ms): 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 12, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 7 - AverageThreadTokens: 11.24 - BloomFilterBytes: 0 - PeakMemoryUsage: 807.45 MB (846667729) - PerHostPeakMemUsage: 817.75 MB (857471434) - RowsProduced: 4 (4) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1.947ms - TotalStorageWaitTime: 763.540ms - TotalThreadsInvoluntaryContextSwitches: 11.52K (11519) - TotalThreadsTotalWallClockTime: 3m48s - TotalThreadsSysTime: 715.884ms - TotalThreadsUserTime: 42s117ms - TotalThreadsVoluntaryContextSwitches: 125.99K (125991) Fragment Instance Lifecycle Timings: - ExecTime: 20s356ms - ExecTreeExecTime: 20s348ms - OpenTime: 239.953ms - ExecTreeOpenTime: 86.319us - PrepareTime: 34.332ms - ExecTreePrepareTime: 1.392ms DataStreamSender (dst_id=3):(Total: 80.678us, non-child: 80.678us, % non-child: 100.00%) - BytesSent: 595.00 B (595) - OverallThroughput: 7.03 MB/sec - PeakMemoryUsage: 27.59 KB (28256) - RowsReturned: 4 (4) - SerializeBatchTime: 50.136us - UncompressedRowBatchSize: 595.00 B (595) CodeGen:(Total: 265.843ms, non-child: 265.843ms, % non-child: 100.00%) - CodegenTime: 17.174ms - CompileTime: 62.167ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2068576) - NumFunctions: 139 (139) - NumInstructions: 4.38K (4382) - OptimizationTime: 176.906ms - PeakMemoryUsage: 2.14 MB (2243584) - PrepareTime: 26.196ms AGGREGATION_NODE (id=1):(Total: 20s350ms, non-child: 19s882ms, % non-child: 97.70%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 134.511us - GetResultsTime: 22.128us - HTResizeTime: 1.270ms - HashBuckets: 8.19K (8192) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.44 MB (2557804) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 4 (4) - RowsReturnedRate: 0 - StreamingTime: 19s600ms - UnpinTime: 0.000ns HDFS_SCAN_NODE (id=0):(Total: 467.382ms, non-child: 467.382ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:1/253.39 MB 1:1/253.41 MB 8:1/253.40 MB 10:1/253.38 MB 5:1/253.39 MB 9:3/760.18 MB 7:2/506.77 MB 6:2/506.79 MB 3:6/1.46 GB 0:1/253.39 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 19 out of 19 Hdfs Read Thread Concurrency Bucket: 0:97.56% 1:0% 2:2.439% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:133 BytesRead(500.000ms): 683.65 MB, 699.42 MB, 699.42 MB, 699.42 MB, 699.42 MB, 699.42 MB, 699.42 MB, 699.42 MB, 699.42 MB, 699.42 MB, 699.42 MB, 699.42 MB, 699.42 MB, 699.42 MB, 699.42 MB, 699.42 MB, 699.42 MB, 699.42 MB, 699.42 MB, 699.42 MB, 699.42 MB, 699.42 MB, 699.42 MB, 699.42 MB, 758.20 MB, 758.20 MB, 1.08 GB, 1.08 GB, 1.08 GB, 1.08 GB, 1.08 GB, 1.08 GB, 1.08 GB, 1.08 GB, 1.08 GB, 1.08 GB, 1.08 GB, 1.08 GB, 1.08 GB, 1.08 GB, 1.08 GB - FooterProcessingTime: (Avg: 2.414ms ; Min: 720.579us ; Max: 8.701ms ; Number of samples: 19) - AverageHdfsReadThreadConcurrency: 0.05 - AverageScannerThreadConcurrency: 10.24 - BytesRead: 1.08 GB (1164848599) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.08 GB (1164848599) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.08 GB (1164848599) - CachedFileHandlesHitCount: 246 (246) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 2s031ms - MaxCompressedTextFileLength: 0 - NumColumns: 7 (7) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 10 (10) - NumRowGroups: 19 (19) - NumScannerThreadsStarted: 12 (12) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 805.77 MB (844910372) - PerReadThreadRawHdfsThroughput: 1.07 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 35.127ms - RowBatchQueuePutWaitTime: 3m6s - RowsRead: 130.80M (130797756) - RowsReturned: 128.96M (128958843) - RowsReturnedRate: 275.92 M/sec - ScanRangesComplete: 19 (19) - ScannerThreadsInvoluntaryContextSwitches: 9.44K (9442) - ScannerThreadsTotalWallClockTime: 3m27s - MaterializeTupleTime(*): 17s421ms - ScannerThreadsSysTime: 477.920ms - ScannerThreadsUserTime: 21s800ms - ScannerThreadsVoluntaryContextSwitches: 125.96K (125960) - TotalRawHdfsReadTime(*): 1s018ms - TotalReadThroughput: 54.19 MB/sec Instance 9e48f6ed8577ed82:58f004f400000008 (host=10.17.193.10:22000):(Total: 20s592ms, non-child: 13.853ms, % non-child: 0.07%) Hdfs split stats (:<# splits>/): 9:1/253.38 MB 2:2/506.76 MB 5:2/506.79 MB 6:2/506.82 MB 1:3/760.20 MB 8:2/506.79 MB 7:2/506.81 MB 0:2/506.79 MB 4:2/506.83 MB 3:1/253.39 MB MemoryUsage(500.000ms): 812.03 MB, 811.97 MB, 812.13 MB, 812.05 MB, 811.97 MB, 812.13 MB, 716.46 MB, 716.62 MB, 717.02 MB, 716.62 MB, 716.62 MB, 716.78 MB, 621.52 MB, 621.43 MB, 621.28 MB, 621.11 MB, 621.20 MB, 621.43 MB, 525.41 MB, 525.50 MB, 509.92 MB, 430.17 MB, 430.16 MB, 422.39 MB, 342.43 MB, 376.44 MB, 479.97 MB, 479.82 MB, 480.05 MB, 424.28 MB, 424.36 MB, 424.28 MB, 424.51 MB, 368.44 MB, 368.68 MB, 368.52 MB, 312.98 MB, 312.82 MB, 257.26 MB, 249.52 MB, 200.87 MB ThreadUsage(500.000ms): 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8 - AverageThreadTokens: 11.17 - BloomFilterBytes: 0 - PeakMemoryUsage: 812.52 MB (851993807) - PerHostPeakMemUsage: 822.84 MB (862806005) - RowsProduced: 4 (4) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1.683ms - TotalStorageWaitTime: 640.863ms - TotalThreadsInvoluntaryContextSwitches: 11.34K (11340) - TotalThreadsTotalWallClockTime: 3m47s - TotalThreadsSysTime: 701.887ms - TotalThreadsUserTime: 42s188ms - TotalThreadsVoluntaryContextSwitches: 126.52K (126521) Fragment Instance Lifecycle Timings: - ExecTime: 20s311ms - ExecTreeExecTime: 20s304ms - OpenTime: 240.682ms - ExecTreeOpenTime: 73.200us - PrepareTime: 39.835ms - ExecTreePrepareTime: 1.304ms DataStreamSender (dst_id=3):(Total: 93.149us, non-child: 93.149us, % non-child: 100.00%) - BytesSent: 595.00 B (595) - OverallThroughput: 6.09 MB/sec - PeakMemoryUsage: 27.59 KB (28256) - RowsReturned: 4 (4) - SerializeBatchTime: 63.031us - UncompressedRowBatchSize: 595.00 B (595) CodeGen:(Total: 272.572ms, non-child: 272.572ms, % non-child: 100.00%) - CodegenTime: 16.620ms - CompileTime: 62.006ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2068576) - NumFunctions: 139 (139) - NumInstructions: 4.38K (4382) - OptimizationTime: 177.798ms - PeakMemoryUsage: 2.14 MB (2243584) - PrepareTime: 32.163ms AGGREGATION_NODE (id=1):(Total: 20s305ms, non-child: 19s838ms, % non-child: 97.70%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 105.265us - GetResultsTime: 20.138us - HTResizeTime: 570.310us - HashBuckets: 8.19K (8192) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.44 MB (2557804) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 4 (4) - RowsReturnedRate: 0 - StreamingTime: 19s550ms - UnpinTime: 0.000ns HDFS_SCAN_NODE (id=0):(Total: 467.810ms, non-child: 467.810ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 9:1/253.38 MB 2:2/506.76 MB 5:2/506.79 MB 6:2/506.82 MB 1:3/760.20 MB 8:2/506.79 MB 7:2/506.81 MB 0:2/506.79 MB 4:2/506.83 MB 3:1/253.39 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 19 out of 19 Hdfs Read Thread Concurrency Bucket: 0:97.56% 1:2.439% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:133 BytesRead(500.000ms): 705.39 MB, 705.39 MB, 705.39 MB, 705.39 MB, 705.39 MB, 705.39 MB, 705.39 MB, 705.39 MB, 705.39 MB, 705.39 MB, 705.39 MB, 705.39 MB, 705.39 MB, 705.39 MB, 705.39 MB, 705.39 MB, 705.39 MB, 705.39 MB, 705.39 MB, 705.39 MB, 705.39 MB, 705.39 MB, 705.39 MB, 705.39 MB, 705.39 MB, 781.73 MB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB - FooterProcessingTime: (Avg: 2.003ms ; Min: 423.626us ; Max: 3.514ms ; Number of samples: 19) - AverageHdfsReadThreadConcurrency: 0.02 - AverageScannerThreadConcurrency: 10.17 - BytesRead: 1.09 GB (1171111928) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.09 GB (1171111928) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.09 GB (1171111928) - CachedFileHandlesHitCount: 247 (247) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 2s050ms - MaxCompressedTextFileLength: 0 - NumColumns: 7 (7) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 10 (10) - NumRowGroups: 19 (19) - NumScannerThreadsStarted: 12 (12) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 810.85 MB (850236450) - PerReadThreadRawHdfsThroughput: 1.11 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 37.386ms - RowBatchQueuePutWaitTime: 3m5s - RowsRead: 131.50M (131502268) - RowsReturned: 129.65M (129654003) - RowsReturnedRate: 277.15 M/sec - ScanRangesComplete: 19 (19) - ScannerThreadsInvoluntaryContextSwitches: 9.27K (9265) - ScannerThreadsTotalWallClockTime: 3m26s - MaterializeTupleTime(*): 17s759ms - ScannerThreadsSysTime: 461.923ms - ScannerThreadsUserTime: 21s917ms - ScannerThreadsVoluntaryContextSwitches: 126.48K (126484) - TotalRawHdfsReadTime(*): 979.675ms - TotalReadThroughput: 54.48 MB/sec Instance 9e48f6ed8577ed82:58f004f400000001 (host=10.17.193.23:22000):(Total: 20s243ms, non-child: 15.184ms, % non-child: 0.08%) Hdfs split stats (:<# splits>/): 5:1/253.40 MB 0:1/253.40 MB 9:2/506.78 MB 7:1/253.38 MB 8:2/506.80 MB 6:3/760.18 MB 2:2/506.76 MB 1:4/767.55 MB 3:3/760.16 MB MemoryUsage(500.000ms): 750.16 MB, 811.97 MB, 812.05 MB, 812.29 MB, 811.89 MB, 811.97 MB, 724.89 MB, 716.62 MB, 716.94 MB, 716.54 MB, 716.62 MB, 716.62 MB, 677.03 MB, 621.29 MB, 621.43 MB, 621.28 MB, 621.11 MB, 621.51 MB, 573.19 MB, 525.36 MB, 525.35 MB, 461.86 MB, 429.87 MB, 430.26 MB, 382.40 MB, 334.31 MB, 467.22 MB, 413.62 MB, 413.62 MB, 413.46 MB, 365.87 MB, 365.70 MB, 365.55 MB, 318.04 MB, 318.04 MB, 318.12 MB, 270.07 MB, 238.56 MB, 222.44 MB, 174.64 MB ThreadUsage(500.000ms): 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7 - AverageThreadTokens: 11.05 - BloomFilterBytes: 0 - PeakMemoryUsage: 812.52 MB (851994149) - PerHostPeakMemUsage: 822.83 MB (862797854) - RowsProduced: 4 (4) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1.974ms - TotalStorageWaitTime: 633.905ms - TotalThreadsInvoluntaryContextSwitches: 10.79K (10786) - TotalThreadsTotalWallClockTime: 3m40s - TotalThreadsSysTime: 847.866ms - TotalThreadsUserTime: 44s202ms - TotalThreadsVoluntaryContextSwitches: 120.19K (120187) Fragment Instance Lifecycle Timings: - ExecTime: 19s966ms - ExecTreeExecTime: 19s957ms - OpenTime: 240.466ms - ExecTreeOpenTime: 72.164us - PrepareTime: 36.870ms - ExecTreePrepareTime: 1.357ms DataStreamSender (dst_id=3):(Total: 86.087us, non-child: 86.087us, % non-child: 100.00%) - BytesSent: 595.00 B (595) - OverallThroughput: 6.59 MB/sec - PeakMemoryUsage: 27.59 KB (28256) - RowsReturned: 4 (4) - SerializeBatchTime: 51.018us - UncompressedRowBatchSize: 595.00 B (595) CodeGen:(Total: 269.102ms, non-child: 269.102ms, % non-child: 100.00%) - CodegenTime: 16.919ms - CompileTime: 62.692ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2068576) - NumFunctions: 139 (139) - NumInstructions: 4.38K (4382) - OptimizationTime: 176.955ms - PeakMemoryUsage: 2.14 MB (2243584) - PrepareTime: 28.864ms AGGREGATION_NODE (id=1):(Total: 19s959ms, non-child: 19s456ms, % non-child: 97.48%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 124.379us - GetResultsTime: 23.945us - HTResizeTime: 696.883us - HashBuckets: 8.19K (8192) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.44 MB (2557804) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 4 (4) - RowsReturnedRate: 0 - StreamingTime: 19s166ms - UnpinTime: 0.000ns HDFS_SCAN_NODE (id=0):(Total: 502.764ms, non-child: 502.764ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:1/253.40 MB 0:1/253.40 MB 9:2/506.78 MB 7:1/253.38 MB 8:2/506.80 MB 6:3/760.18 MB 2:2/506.76 MB 1:4/767.55 MB 3:3/760.16 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 19 out of 19 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:133 BytesRead(500.000ms): 648.39 MB, 707.17 MB, 707.17 MB, 707.17 MB, 707.17 MB, 707.17 MB, 707.17 MB, 707.17 MB, 707.17 MB, 707.17 MB, 707.17 MB, 707.17 MB, 707.17 MB, 707.17 MB, 707.17 MB, 707.17 MB, 707.17 MB, 707.17 MB, 707.17 MB, 707.17 MB, 707.17 MB, 707.17 MB, 707.17 MB, 707.17 MB, 707.17 MB, 707.17 MB, 942.29 MB, 1.04 GB, 1.04 GB, 1.04 GB, 1.04 GB, 1.04 GB, 1.04 GB, 1.04 GB, 1.04 GB, 1.04 GB, 1.04 GB, 1.04 GB, 1.04 GB, 1.04 GB - FooterProcessingTime: (Avg: 1.735ms ; Min: 683.749us ; Max: 2.884ms ; Number of samples: 19) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 10.05 - BytesRead: 1.04 GB (1111338292) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.04 GB (1111338292) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.04 GB (1111338292) - CachedFileHandlesHitCount: 242 (242) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 2s257ms - MaxCompressedTextFileLength: 0 - NumColumns: 7 (7) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 9 (9) - NumRowGroups: 19 (19) - NumScannerThreadsStarted: 12 (12) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 810.85 MB (850236792) - PerReadThreadRawHdfsThroughput: 1.10 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 34.396ms - RowBatchQueuePutWaitTime: 2m56s - RowsRead: 124.77M (124770055) - RowsReturned: 123.01M (123014381) - RowsReturnedRate: 244.68 M/sec - ScanRangesComplete: 19 (19) - ScannerThreadsInvoluntaryContextSwitches: 8.77K (8767) - ScannerThreadsTotalWallClockTime: 3m19s - MaterializeTupleTime(*): 19s761ms - ScannerThreadsSysTime: 573.907ms - ScannerThreadsUserTime: 24s310ms - ScannerThreadsVoluntaryContextSwitches: 120.15K (120149) - TotalRawHdfsReadTime(*): 942.264ms - TotalReadThroughput: 52.99 MB/sec Instance 9e48f6ed8577ed82:58f004f400000003 (host=10.17.193.11:22000):(Total: 20s110ms, non-child: 14.368ms, % non-child: 0.07%) Hdfs split stats (:<# splits>/): 7:1/253.41 MB 9:1/253.39 MB 8:2/506.77 MB 5:2/506.79 MB 1:3/760.18 MB 4:3/760.17 MB 2:4/1013.60 MB 3:2/506.81 MB MemoryUsage(500.000ms): 779.85 MB, 812.04 MB, 811.97 MB, 812.05 MB, 812.05 MB, 812.29 MB, 732.44 MB, 716.47 MB, 716.70 MB, 716.62 MB, 717.02 MB, 716.47 MB, 692.78 MB, 621.14 MB, 621.22 MB, 621.22 MB, 621.14 MB, 621.14 MB, 613.22 MB, 525.20 MB, 525.67 MB, 485.51 MB, 430.03 MB, 430.11 MB, 422.02 MB, 334.45 MB, 361.08 MB, 413.54 MB, 413.30 MB, 413.46 MB, 365.79 MB, 365.87 MB, 365.71 MB, 318.09 MB, 318.17 MB, 318.17 MB, 270.31 MB, 230.70 MB, 222.60 MB, 174.50 MB ThreadUsage(500.000ms): 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7 - AverageThreadTokens: 11.05 - BloomFilterBytes: 0 - PeakMemoryUsage: 812.45 MB (851910747) - PerHostPeakMemUsage: 822.75 MB (862714452) - RowsProduced: 4 (4) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 2.013ms - TotalStorageWaitTime: 669.336ms - TotalThreadsInvoluntaryContextSwitches: 10.26K (10264) - TotalThreadsTotalWallClockTime: 3m38s - TotalThreadsSysTime: 739.884ms - TotalThreadsUserTime: 43s010ms - TotalThreadsVoluntaryContextSwitches: 119.92K (119920) Fragment Instance Lifecycle Timings: - ExecTime: 19s838ms - ExecTreeExecTime: 19s830ms - OpenTime: 240.366ms - ExecTreeOpenTime: 66.255us - PrepareTime: 32.476ms - ExecTreePrepareTime: 1.832ms DataStreamSender (dst_id=3):(Total: 79.561us, non-child: 79.561us, % non-child: 100.00%) - BytesSent: 595.00 B (595) - OverallThroughput: 7.13 MB/sec - PeakMemoryUsage: 27.59 KB (28256) - RowsReturned: 4 (4) - SerializeBatchTime: 52.056us - UncompressedRowBatchSize: 595.00 B (595) CodeGen:(Total: 264.590ms, non-child: 264.590ms, % non-child: 100.00%) - CodegenTime: 16.652ms - CompileTime: 62.497ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2068576) - NumFunctions: 139 (139) - NumInstructions: 4.38K (4382) - OptimizationTime: 177.054ms - PeakMemoryUsage: 2.14 MB (2243584) - PrepareTime: 24.454ms AGGREGATION_NODE (id=1):(Total: 19s831ms, non-child: 19s318ms, % non-child: 97.41%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 125.909us - GetResultsTime: 22.850us - HTResizeTime: 994.189us - HashBuckets: 8.19K (8192) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.44 MB (2557804) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 4 (4) - RowsReturnedRate: 0 - StreamingTime: 19s005ms - UnpinTime: 0.000ns HDFS_SCAN_NODE (id=0):(Total: 513.798ms, non-child: 513.798ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:1/253.41 MB 9:1/253.39 MB 8:2/506.77 MB 5:2/506.79 MB 1:3/760.18 MB 4:3/760.17 MB 2:4/1013.60 MB 3:2/506.81 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 18 out of 18 Hdfs Read Thread Concurrency Bucket: 0:95% 1:2.5% 2:0% 3:2.5% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:126 BytesRead(500.000ms): 657.85 MB, 705.37 MB, 705.37 MB, 705.37 MB, 705.37 MB, 705.37 MB, 705.37 MB, 705.37 MB, 705.37 MB, 705.37 MB, 705.37 MB, 705.37 MB, 705.37 MB, 705.37 MB, 705.37 MB, 705.37 MB, 705.37 MB, 705.37 MB, 705.37 MB, 705.37 MB, 705.37 MB, 705.37 MB, 705.37 MB, 705.37 MB, 705.37 MB, 705.37 MB, 745.57 MB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB - FooterProcessingTime: (Avg: 1.968ms ; Min: 536.478us ; Max: 6.615ms ; Number of samples: 18) - AverageHdfsReadThreadConcurrency: 0.10 - AverageScannerThreadConcurrency: 10.05 - BytesRead: 1.03 GB (1109466574) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.03 GB (1109466574) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.03 GB (1109466574) - CachedFileHandlesHitCount: 234 (234) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 2s178ms - MaxCompressedTextFileLength: 0 - NumColumns: 7 (7) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 8 (8) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 12 (12) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 810.77 MB (850153390) - PerReadThreadRawHdfsThroughput: 1.20 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 31.007ms - RowBatchQueuePutWaitTime: 2m55s - RowsRead: 124.58M (124580562) - RowsReturned: 122.83M (122831031) - RowsReturnedRate: 239.06 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 8.26K (8255) - ScannerThreadsTotalWallClockTime: 3m18s - MaterializeTupleTime(*): 18s810ms - ScannerThreadsSysTime: 460.926ms - ScannerThreadsUserTime: 23s246ms - ScannerThreadsVoluntaryContextSwitches: 119.89K (119889) - TotalRawHdfsReadTime(*): 863.287ms - TotalReadThroughput: 52.90 MB/sec Instance 9e48f6ed8577ed82:58f004f400000007 (host=10.17.193.19:22000):(Total: 20s026ms, non-child: 13.474ms, % non-child: 0.07%) Hdfs split stats (:<# splits>/): 8:1/253.40 MB 0:1/253.39 MB 7:1/253.40 MB 3:1/7.47 MB 9:2/506.76 MB 10:3/760.18 MB 6:2/506.78 MB 2:3/760.19 MB 4:2/445.03 MB 5:2/506.80 MB 1:2/506.81 MB MemoryUsage(500.000ms): 3.45 MB, 798.13 MB, 797.97 MB, 797.96 MB, 797.97 MB, 797.96 MB, 790.10 MB, 702.78 MB, 702.62 MB, 702.86 MB, 702.62 MB, 702.78 MB, 662.94 MB, 607.42 MB, 607.57 MB, 607.73 MB, 607.65 MB, 607.81 MB, 535.87 MB, 511.87 MB, 549.66 MB, 478.30 MB, 462.27 MB, 462.35 MB, 390.58 MB, 373.91 MB, 525.25 MB, 472.03 MB, 471.95 MB, 456.06 MB, 416.54 MB, 416.23 MB, 416.38 MB, 360.66 MB, 360.65 MB, 353.12 MB, 312.72 MB, 296.81 MB, 222.60 MB, 182.68 MB ThreadUsage(500.000ms): 1, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 10, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 7, 7 - AverageThreadTokens: 10.95 - BloomFilterBytes: 0 - PeakMemoryUsage: 798.52 MB (837313814) - PerHostPeakMemUsage: 808.83 MB (848117519) - RowsProduced: 4 (4) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1.683ms - TotalStorageWaitTime: 696.554ms - TotalThreadsInvoluntaryContextSwitches: 11.00K (10999) - TotalThreadsTotalWallClockTime: 3m40s - TotalThreadsSysTime: 629.897ms - TotalThreadsUserTime: 40s101ms - TotalThreadsVoluntaryContextSwitches: 125.02K (125023) Fragment Instance Lifecycle Timings: - ExecTime: 19s752ms - ExecTreeExecTime: 19s745ms - OpenTime: 238.135ms - ExecTreeOpenTime: 74.816us - PrepareTime: 36.265ms - ExecTreePrepareTime: 1.479ms DataStreamSender (dst_id=3):(Total: 105.377us, non-child: 105.377us, % non-child: 100.00%) - BytesSent: 595.00 B (595) - OverallThroughput: 5.38 MB/sec - PeakMemoryUsage: 27.59 KB (28256) - RowsReturned: 4 (4) - SerializeBatchTime: 55.915us - UncompressedRowBatchSize: 595.00 B (595) CodeGen:(Total: 266.312ms, non-child: 266.312ms, % non-child: 100.00%) - CodegenTime: 17.094ms - CompileTime: 61.359ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2068576) - NumFunctions: 139 (139) - NumInstructions: 4.38K (4382) - OptimizationTime: 175.941ms - PeakMemoryUsage: 2.14 MB (2243584) - PrepareTime: 28.434ms AGGREGATION_NODE (id=1):(Total: 19s746ms, non-child: 19s321ms, % non-child: 97.84%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 145.280us - GetResultsTime: 20.747us - HTResizeTime: 788.854us - HashBuckets: 8.19K (8192) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.44 MB (2557804) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 4 (4) - RowsReturnedRate: 0 - StreamingTime: 19s039ms - UnpinTime: 0.000ns HDFS_SCAN_NODE (id=0):(Total: 425.576ms, non-child: 425.576ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 8:1/253.40 MB 0:1/253.39 MB 7:1/253.40 MB 3:1/7.47 MB 9:2/506.76 MB 10:3/760.18 MB 6:2/506.78 MB 2:3/760.19 MB 4:2/445.03 MB 5:2/506.80 MB 1:2/506.81 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 20 out of 20 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:140 BytesRead(500.000ms): 0, 692.88 MB, 692.88 MB, 692.88 MB, 692.88 MB, 692.88 MB, 692.88 MB, 692.88 MB, 692.88 MB, 692.88 MB, 692.88 MB, 692.88 MB, 692.88 MB, 692.88 MB, 692.88 MB, 692.88 MB, 692.88 MB, 692.88 MB, 692.88 MB, 692.88 MB, 751.66 MB, 751.66 MB, 751.66 MB, 751.66 MB, 751.66 MB, 751.66 MB, 1.08 GB, 1.08 GB, 1.08 GB, 1.08 GB, 1.08 GB, 1.08 GB, 1.08 GB, 1.08 GB, 1.08 GB, 1.08 GB, 1.08 GB, 1.08 GB, 1.08 GB, 1.08 GB - FooterProcessingTime: (Avg: 1.531ms ; Min: 540.449us ; Max: 2.827ms ; Number of samples: 20) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 10.21 - BytesRead: 1.08 GB (1157998147) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.08 GB (1157998147) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.08 GB (1157998147) - CachedFileHandlesHitCount: 253 (253) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 1s956ms - MaxCompressedTextFileLength: 0 - NumColumns: 7 (7) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 11 (11) - NumRowGroups: 20 (20) - NumScannerThreadsStarted: 12 (12) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 796.85 MB (835556457) - PerReadThreadRawHdfsThroughput: 984.38 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 17.512ms - RowBatchQueuePutWaitTime: 3m - RowsRead: 130.00M (130003664) - RowsReturned: 128.17M (128173546) - RowsReturnedRate: 301.18 M/sec - ScanRangesComplete: 20 (20) - ScannerThreadsInvoluntaryContextSwitches: 8.96K (8965) - ScannerThreadsTotalWallClockTime: 3m20s - MaterializeTupleTime(*): 16s409ms - ScannerThreadsSysTime: 388.933ms - ScannerThreadsUserTime: 20s377ms - ScannerThreadsVoluntaryContextSwitches: 124.99K (124989) - TotalRawHdfsReadTime(*): 1s121ms - TotalReadThroughput: 55.22 MB/sec Instance 9e48f6ed8577ed82:58f004f40000000e (host=10.17.193.18:22000):(Total: 20s002ms, non-child: 14.914ms, % non-child: 0.07%) Hdfs split stats (:<# splits>/): 0:1/253.41 MB 8:2/506.77 MB 6:1/253.41 MB 9:2/506.78 MB 7:1/253.41 MB 5:5/1.24 GB 3:3/760.18 MB 2:2/506.80 MB 1:1/253.41 MB MemoryUsage(500.000ms): 516.76 MB, 812.05 MB, 812.05 MB, 812.05 MB, 811.96 MB, 812.05 MB, 724.65 MB, 716.62 MB, 716.71 MB, 717.10 MB, 716.78 MB, 716.54 MB, 629.30 MB, 621.14 MB, 621.06 MB, 621.06 MB, 621.22 MB, 621.06 MB, 565.06 MB, 525.06 MB, 525.22 MB, 437.83 MB, 429.81 MB, 429.89 MB, 390.08 MB, 334.23 MB, 453.38 MB, 413.31 MB, 413.31 MB, 405.52 MB, 365.71 MB, 365.87 MB, 357.63 MB, 318.15 MB, 318.39 MB, 310.23 MB, 270.23 MB, 222.68 MB, 214.60 MB, 148.58 MB ThreadUsage(500.000ms): 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 6 - AverageThreadTokens: 11.03 - BloomFilterBytes: 0 - PeakMemoryUsage: 812.52 MB (851993612) - PerHostPeakMemUsage: 822.83 MB (862797317) - RowsProduced: 4 (4) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 2.051ms - TotalStorageWaitTime: 644.186ms - TotalThreadsInvoluntaryContextSwitches: 9.87K (9868) - TotalThreadsTotalWallClockTime: 3m36s - TotalThreadsSysTime: 732.884ms - TotalThreadsUserTime: 41s212ms - TotalThreadsVoluntaryContextSwitches: 120.00K (119997) Fragment Instance Lifecycle Timings: - ExecTime: 19s729ms - ExecTreeExecTime: 19s720ms - OpenTime: 239.535ms - ExecTreeOpenTime: 65.090us - PrepareTime: 33.939ms - ExecTreePrepareTime: 1.429ms DataStreamSender (dst_id=3):(Total: 83.598us, non-child: 83.598us, % non-child: 100.00%) - BytesSent: 595.00 B (595) - OverallThroughput: 6.79 MB/sec - PeakMemoryUsage: 27.59 KB (28256) - RowsReturned: 4 (4) - SerializeBatchTime: 32.829us - UncompressedRowBatchSize: 595.00 B (595) CodeGen:(Total: 265.461ms, non-child: 265.461ms, % non-child: 100.00%) - CodegenTime: 16.938ms - CompileTime: 62.318ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2068576) - NumFunctions: 139 (139) - NumInstructions: 4.38K (4382) - OptimizationTime: 176.387ms - PeakMemoryUsage: 2.14 MB (2243584) - PrepareTime: 26.165ms AGGREGATION_NODE (id=1):(Total: 19s722ms, non-child: 19s239ms, % non-child: 97.55%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 191.298us - GetResultsTime: 21.222us - HTResizeTime: 1.134ms - HashBuckets: 8.19K (8192) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.44 MB (2557804) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 4 (4) - RowsReturnedRate: 0 - StreamingTime: 18s952ms - UnpinTime: 0.000ns HDFS_SCAN_NODE (id=0):(Total: 482.499ms, non-child: 482.499ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/253.41 MB 8:2/506.77 MB 6:1/253.41 MB 9:2/506.78 MB 7:1/253.41 MB 5:5/1.24 GB 3:3/760.18 MB 2:2/506.80 MB 1:1/253.41 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 18 out of 18 Hdfs Read Thread Concurrency Bucket: 0:95% 1:2.5% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:2.5% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:126 BytesRead(500.000ms): 379.04 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 947.48 MB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB - FooterProcessingTime: (Avg: 2.117ms ; Min: 767.429us ; Max: 15.351ms ; Number of samples: 18) - AverageHdfsReadThreadConcurrency: 0.25 - AverageScannerThreadConcurrency: 10.03 - BytesRead: 1.03 GB (1109460615) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.03 GB (1109460615) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.03 GB (1109460615) - CachedFileHandlesHitCount: 234 (234) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 2s048ms - MaxCompressedTextFileLength: 0 - NumColumns: 7 (7) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 9 (9) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 12 (12) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 810.85 MB (850236255) - PerReadThreadRawHdfsThroughput: 1.21 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 32.526ms - RowBatchQueuePutWaitTime: 2m55s - RowsRead: 124.58M (124581269) - RowsReturned: 122.83M (122825043) - RowsReturnedRate: 254.56 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 7.87K (7871) - ScannerThreadsTotalWallClockTime: 3m16s - MaterializeTupleTime(*): 17s468ms - ScannerThreadsSysTime: 465.924ms - ScannerThreadsUserTime: 21s550ms - ScannerThreadsVoluntaryContextSwitches: 119.97K (119965) - TotalRawHdfsReadTime(*): 853.997ms - TotalReadThroughput: 52.90 MB/sec Instance 9e48f6ed8577ed82:58f004f400000004 (host=10.17.193.15:22000):(Total: 19s861ms, non-child: 15.097ms, % non-child: 0.08%) Hdfs split stats (:<# splits>/): 6:2/506.79 MB 8:3/760.21 MB 1:4/1013.54 MB 3:1/187.22 MB 5:3/760.16 MB 7:1/253.39 MB 2:3/706.54 MB 0:2/506.78 MB MemoryUsage(500.000ms): 782.05 MB, 782.13 MB, 781.89 MB, 781.97 MB, 782.13 MB, 782.21 MB, 686.62 MB, 686.94 MB, 686.70 MB, 686.70 MB, 686.54 MB, 678.73 MB, 591.36 MB, 591.28 MB, 591.43 MB, 591.12 MB, 591.36 MB, 551.43 MB, 535.22 MB, 535.17 MB, 517.60 MB, 493.79 MB, 494.03 MB, 437.81 MB, 405.57 MB, 543.61 MB, 464.00 MB, 463.92 MB, 455.95 MB, 408.42 MB, 408.65 MB, 408.49 MB, 360.95 MB, 352.63 MB, 336.84 MB, 336.99 MB, 280.61 MB, 187.92 MB, 156.10 MB ThreadUsage(500.000ms): 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 11, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 6, 6 - AverageThreadTokens: 11.18 - BloomFilterBytes: 0 - PeakMemoryUsage: 782.52 MB (820535886) - PerHostPeakMemUsage: 792.83 MB (831339591) - RowsProduced: 4 (4) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 2.110ms - TotalStorageWaitTime: 601.680ms - TotalThreadsInvoluntaryContextSwitches: 10.52K (10524) - TotalThreadsTotalWallClockTime: 3m37s - TotalThreadsSysTime: 642.896ms - TotalThreadsUserTime: 39s473ms - TotalThreadsVoluntaryContextSwitches: 123.56K (123557) Fragment Instance Lifecycle Timings: - ExecTime: 19s586ms - ExecTreeExecTime: 19s578ms - OpenTime: 240.153ms - ExecTreeOpenTime: 65.129us - PrepareTime: 34.952ms - ExecTreePrepareTime: 1.348ms DataStreamSender (dst_id=3):(Total: 84.519us, non-child: 84.519us, % non-child: 100.00%) - BytesSent: 595.00 B (595) - OverallThroughput: 6.71 MB/sec - PeakMemoryUsage: 27.59 KB (28256) - RowsReturned: 4 (4) - SerializeBatchTime: 56.099us - UncompressedRowBatchSize: 595.00 B (595) CodeGen:(Total: 267.081ms, non-child: 267.081ms, % non-child: 100.00%) - CodegenTime: 17.047ms - CompileTime: 62.008ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2068576) - NumFunctions: 139 (139) - NumInstructions: 4.38K (4382) - OptimizationTime: 177.258ms - PeakMemoryUsage: 2.14 MB (2243584) - PrepareTime: 27.233ms AGGREGATION_NODE (id=1):(Total: 19s579ms, non-child: 19s148ms, % non-child: 97.80%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 143.305us - GetResultsTime: 22.547us - HTResizeTime: 803.761us - HashBuckets: 8.19K (8192) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.44 MB (2557804) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 4 (4) - RowsReturnedRate: 0 - StreamingTime: 18s864ms - UnpinTime: 0.000ns HDFS_SCAN_NODE (id=0):(Total: 431.221ms, non-child: 431.221ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 6:2/506.79 MB 8:3/760.21 MB 1:4/1013.54 MB 3:1/187.22 MB 5:3/760.16 MB 7:1/253.39 MB 2:3/706.54 MB 0:2/506.78 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 19 out of 19 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:133 BytesRead(500.000ms): 677.62 MB, 677.62 MB, 677.62 MB, 677.62 MB, 677.62 MB, 677.62 MB, 677.62 MB, 677.62 MB, 677.62 MB, 677.62 MB, 677.62 MB, 677.62 MB, 677.62 MB, 677.62 MB, 677.62 MB, 677.62 MB, 677.62 MB, 677.62 MB, 736.40 MB, 736.40 MB, 795.18 MB, 795.18 MB, 795.18 MB, 795.18 MB, 795.18 MB, 1.06 GB, 1.06 GB, 1.06 GB, 1.06 GB, 1.06 GB, 1.06 GB, 1.06 GB, 1.06 GB, 1.06 GB, 1.06 GB, 1.06 GB, 1.06 GB, 1.06 GB, 1.06 GB - FooterProcessingTime: (Avg: 1.279ms ; Min: 428.108us ; Max: 2.347ms ; Number of samples: 19) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 10.18 - BytesRead: 1.06 GB (1141997471) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.06 GB (1141997471) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.06 GB (1141997471) - CachedFileHandlesHitCount: 243 (243) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 1s905ms - MaxCompressedTextFileLength: 0 - NumColumns: 7 (7) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 8 (8) - NumRowGroups: 19 (19) - NumScannerThreadsStarted: 12 (12) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 780.85 MB (818778529) - PerReadThreadRawHdfsThroughput: 1.28 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 26.668ms - RowBatchQueuePutWaitTime: 2m58s - RowsRead: 128.22M (128222964) - RowsReturned: 126.42M (126422094) - RowsReturnedRate: 293.17 M/sec - ScanRangesComplete: 19 (19) - ScannerThreadsInvoluntaryContextSwitches: 8.52K (8519) - ScannerThreadsTotalWallClockTime: 3m18s - MaterializeTupleTime(*): 16s115ms - ScannerThreadsSysTime: 420.930ms - ScannerThreadsUserTime: 19s902ms - ScannerThreadsVoluntaryContextSwitches: 123.52K (123523) - TotalRawHdfsReadTime(*): 831.070ms - TotalReadThroughput: 55.85 MB/sec Instance 9e48f6ed8577ed82:58f004f400000009 (host=10.17.193.14:22000):(Total: 18s640ms, non-child: 15.840ms, % non-child: 0.08%) Hdfs split stats (:<# splits>/): 9:1/253.40 MB 5:3/760.21 MB 4:3/760.19 MB 7:2/506.80 MB 2:3/760.21 MB 6:2/506.82 MB 1:3/760.22 MB MemoryUsage(500.000ms): 811.89 MB, 812.05 MB, 812.21 MB, 811.97 MB, 811.97 MB, 811.96 MB, 716.86 MB, 716.78 MB, 716.62 MB, 716.78 MB, 716.78 MB, 716.70 MB, 621.22 MB, 621.22 MB, 621.30 MB, 621.06 MB, 621.14 MB, 621.06 MB, 525.62 MB, 525.54 MB, 525.39 MB, 430.29 MB, 430.21 MB, 430.14 MB, 342.62 MB, 333.91 MB, 347.11 MB, 347.03 MB, 347.11 MB, 307.38 MB, 307.38 MB, 267.55 MB, 267.55 MB, 259.71 MB, 227.55 MB, 187.94 MB, 121.95 MB ThreadUsage(500.000ms): 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 5 - AverageThreadTokens: 10.89 - BloomFilterBytes: 0 - PeakMemoryUsage: 812.53 MB (851994482) - PerHostPeakMemUsage: 822.83 MB (862798187) - RowsProduced: 4 (4) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1.929ms - TotalStorageWaitTime: 650.406ms - TotalThreadsInvoluntaryContextSwitches: 10.58K (10580) - TotalThreadsTotalWallClockTime: 3m21s - TotalThreadsSysTime: 674.890ms - TotalThreadsUserTime: 41s409ms - TotalThreadsVoluntaryContextSwitches: 113.27K (113266) Fragment Instance Lifecycle Timings: - ExecTime: 18s362ms - ExecTreeExecTime: 18s353ms - OpenTime: 243.196ms - ExecTreeOpenTime: 73.841us - PrepareTime: 35.631ms - ExecTreePrepareTime: 1.380ms DataStreamSender (dst_id=3):(Total: 432.450us, non-child: 432.450us, % non-child: 100.00%) - BytesSent: 597.00 B (597) - OverallThroughput: 1.32 MB/sec - PeakMemoryUsage: 27.59 KB (28256) - RowsReturned: 4 (4) - SerializeBatchTime: 396.648us - UncompressedRowBatchSize: 597.00 B (597) CodeGen:(Total: 270.169ms, non-child: 270.169ms, % non-child: 100.00%) - CodegenTime: 17.768ms - CompileTime: 63.413ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2068576) - NumFunctions: 139 (139) - NumInstructions: 4.38K (4382) - OptimizationTime: 178.919ms - PeakMemoryUsage: 2.14 MB (2243584) - PrepareTime: 27.196ms AGGREGATION_NODE (id=1):(Total: 18s354ms, non-child: 17s856ms, % non-child: 97.29%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 161.589us - GetResultsTime: 22.635us - HTResizeTime: 910.293us - HashBuckets: 8.19K (8192) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.44 MB (2557804) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 4 (4) - RowsReturnedRate: 0 - StreamingTime: 17s590ms - UnpinTime: 0.000ns HDFS_SCAN_NODE (id=0):(Total: 497.689ms, non-child: 497.689ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 9:1/253.40 MB 5:3/760.21 MB 4:3/760.19 MB 7:2/506.80 MB 2:3/760.21 MB 6:2/506.82 MB 1:3/760.22 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 17 out of 17 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:119 BytesRead(500.000ms): 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 705.38 MB, 999.29 MB, 999.29 MB, 999.29 MB, 999.29 MB, 999.29 MB, 999.29 MB, 999.29 MB, 999.29 MB, 999.29 MB, 999.29 MB, 999.29 MB - FooterProcessingTime: (Avg: 1.529ms ; Min: 420.553us ; Max: 2.332ms ; Number of samples: 17) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 9.89 - BytesRead: 999.29 MB (1047835215) - BytesReadDataNodeCache: 0 - BytesReadLocal: 999.29 MB (1047835215) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 999.29 MB (1047835215) - CachedFileHandlesHitCount: 221 (221) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 2s167ms - MaxCompressedTextFileLength: 0 - NumColumns: 7 (7) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 7 (7) - NumRowGroups: 17 (17) - NumScannerThreadsStarted: 12 (12) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 810.85 MB (850236033) - PerReadThreadRawHdfsThroughput: 1.19 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 29.956ms - RowBatchQueuePutWaitTime: 2m40s - RowsRead: 117.66M (117659833) - RowsReturned: 116.00M (116003313) - RowsReturnedRate: 233.08 M/sec - ScanRangesComplete: 17 (17) - ScannerThreadsInvoluntaryContextSwitches: 8.72K (8720) - ScannerThreadsTotalWallClockTime: 3m2s - MaterializeTupleTime(*): 18s869ms - ScannerThreadsSysTime: 409.931ms - ScannerThreadsUserTime: 23s107ms - ScannerThreadsVoluntaryContextSwitches: 113.23K (113234) - TotalRawHdfsReadTime(*): 819.064ms - TotalReadThroughput: 54.02 MB/sec ================================================================================