impalad / /backends /catalog /hadoop-varz /log_level /logs /memz /metrics /queries /rpcz /sessions /threadz /varz Query a445b5ae5528dff9:8a3b9aa600000000 Plan Query Text plan Summary Profile Memory Backends Fragment Instances Download Thrift Profile Query (id=a445b5ae5528dff9:8a3b9aa600000000): Summary: Session ID: 314eb11f8f411c1e:72175dbc55ef8f97 Session Type: BEESWAX Start Time: 2018-03-26 18:25:17.914352000 End Time: 2018-03-26 18:30:01.423180000 Query Type: QUERY Query State: FINISHED Query Status: OK Impala Version: impalad version 3.0.0-SNAPSHOT RELEASE (build 1d0b618cac905c2e3af5cdb41d440b56b76f2b01) User: mmokhtar Connected User: mmokhtar Delegated User: Network Address: ::ffff:127.0.0.1:48357 Default Db: tpch_10_parquet Sql Statement: select l_commitdate ,avg(l_extendedprice) as avg_perc ,percentile_cont (.25) within group (order by l_extendedprice asc) as perc_25 ,percentile_cont (.5) within group (order by l_extendedprice asc) as perc_50 ,percentile_cont (.75) within group (order by l_extendedprice asc) as perc_75 ,percentile_cont (.90) within group (order by l_extendedprice asc) as perc_90 from lineitem group by l_commitdate order by l_commitdate Coordinator: mostafa-01:22000 Query Options (set by configuration): DISABLE_CODEGEN=1,NUM_SCANNER_THREADS=1,MT_DOP=0,DISABLE_CODEGEN_ROWS_THRESHOLD=1 Query Options (set by configuration and planner): DISABLE_CODEGEN=1,NUM_SCANNER_THREADS=1,MT_DOP=0,DISABLE_CODEGEN_ROWS_THRESHOLD=1 Plan: ---------------- Max Per-Host Resource Reservation: Memory=35.94MB Per-Host Resource Estimates: Memory=174.00MB F03:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1 | Per-Host Resources: mem-estimate=0B mem-reservation=0B PLAN-ROOT SINK | mem-estimate=0B mem-reservation=0B | 09:MERGING-EXCHANGE [UNPARTITIONED] | order by: l_commitdate ASC | mem-estimate=0B mem-reservation=0B | tuple-ids=5 row-size=66B cardinality=2559 | F02:PLAN FRAGMENT [HASH(l_commitdate)] hosts=1 instances=1 Per-Host Resources: mem-estimate=22.00MB mem-reservation=13.94MB 05:SORT | order by: l_commitdate ASC | mem-estimate=12.00MB mem-reservation=12.00MB spill-buffer=2.00MB | tuple-ids=5 row-size=66B cardinality=2559 | 08:AGGREGATE [FINALIZE] | output: avg:merge(l_extendedprice), _percentile_cont_interpolation:merge(l_extendedprice, `_percentile_row_number_diff_0`), _percentile_cont_interpolation:merge(l_extendedprice, `_percentile_row_number_diff_1`), _percentile_cont_interpolation:merge(l_extendedprice, `_percentile_row_number_diff_2`), _percentile_cont_interpolation:merge(l_extendedprice, `_percentile_row_number_diff_3`) | group by: l_commitdate | mem-estimate=10.00MB mem-reservation=1.94MB spill-buffer=64.00KB | tuple-ids=4 row-size=66B cardinality=2559 | 07:EXCHANGE [HASH(l_commitdate)] | mem-estimate=0B mem-reservation=0B | tuple-ids=3 row-size=66B cardinality=2559 | F01:PLAN FRAGMENT [HASH(l_commitdate)] hosts=1 instances=1 Per-Host Resources: mem-estimate=64.00MB mem-reservation=22.00MB 04:AGGREGATE [STREAMING] | output: avg(l_extendedprice), _percentile_cont_interpolation(l_extendedprice, row_number() - 1 - count(l_extendedprice) - 1 * 0.25), _percentile_cont_interpolation(l_extendedprice, row_number() - 1 - count(l_extendedprice) - 1 * 0.5), _percentile_cont_interpolation(l_extendedprice, row_number() - 1 - count(l_extendedprice) - 1 * 0.75), _percentile_cont_interpolation(l_extendedprice, row_number() - 1 - count(l_extendedprice) - 1 * 0.90) | group by: l_commitdate | mem-estimate=10.00MB mem-reservation=2.00MB spill-buffer=64.00KB | tuple-ids=3 row-size=66B cardinality=2559 | 03:ANALYTIC | functions: count(l_extendedprice) | partition by: l_commitdate | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB | tuple-ids=9,7,8 row-size=50B cardinality=59986052 | 02:ANALYTIC | functions: row_number() | partition by: l_commitdate | order by: l_extendedprice ASC | window: ROWS BETWEEN UNBOUNDED PRECEDING AND CURRENT ROW | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB | tuple-ids=9,7 row-size=42B cardinality=59986052 | 01:SORT | order by: l_commitdate ASC NULLS FIRST, l_extendedprice ASC NULLS LAST | mem-estimate=46.00MB mem-reservation=12.00MB spill-buffer=2.00MB | tuple-ids=9 row-size=34B cardinality=59986052 | 06:EXCHANGE [HASH(l_commitdate)] | mem-estimate=0B mem-reservation=0B | tuple-ids=0 row-size=34B cardinality=59986052 | F00:PLAN FRAGMENT [RANDOM] hosts=1 instances=1 Per-Host Resources: mem-estimate=88.00MB mem-reservation=0B 00:SCAN HDFS [tpch_10_parquet.lineitem, RANDOM] partitions=1/1 files=15 size=2.05GB stored statistics: table: rows=59986052 size=2.05GB columns: all extrapolated-rows=disabled mem-estimate=88.00MB mem-reservation=0B tuple-ids=0 row-size=34B cardinality=59986052 ---------------- Estimated Per-Host Mem: 182452224 Per Host Min Reservation: mostafa-01:22000(35.94 MB) Request Pool: default-pool Admission result: Admitted immediately ExecSummary: Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail --------------------------------------------------------------------------------------------------------------------------- 09:MERGING-EXCHANGE 1 71.878us 71.878us 2.47K 2.56K 304.00 KB 0 UNPARTITIONED 05:SORT 1 1.305ms 1.305ms 2.47K 2.56K 12.02 MB 12.00 MB 08:AGGREGATE 1 2.411ms 2.411ms 2.47K 2.56K 1.97 MB 10.00 MB FINALIZE 07:EXCHANGE 1 39.824us 39.824us 2.47K 2.56K 392.00 KB 0 HASH(l_commitdate) 04:AGGREGATE 1 1m56s 1m56s 2.47K 2.56K 2.11 MB 10.00 MB STREAMING 03:ANALYTIC 1 10s727ms 10s727ms 59.99M 59.99M 13.09 MB 4.00 MB 02:ANALYTIC 1 23s279ms 23s279ms 59.99M 59.99M 14.05 MB 4.00 MB 01:SORT 1 2m10s 2m10s 59.99M 59.99M 1.96 GB 46.00 MB 06:EXCHANGE 1 644.020ms 644.020ms 59.99M 59.99M 13.42 MB 0 HASH(l_commitdate) 00:SCAN HDFS 1 114.594ms 114.594ms 59.99M 59.99M 34.18 MB 88.00 MB tpch_10_parquet.lineitem Errors: Query Compilation: 12.719ms - Metadata of all 1 tables cached: 604.534us (604.534us) - Analysis finished: 5.293ms (4.689ms) - Value transfer graph computed: 5.530ms (236.918us) - Single node plan created: 8.074ms (2.543ms) - Runtime filters computed: 9.179ms (1.105ms) - Distributed plan created: 9.235ms (56.103us) - Planning finished: 12.719ms (3.483ms) Query Timeline: 4m43s - Query submitted: 22.329us (22.329us) - Planning finished: 18.232ms (18.210ms) - Submit for admission: 18.417ms (184.592us) - Completed admission: 18.472ms (55.643us) - Ready to start on 1 backends: 18.552ms (79.519us) - All 1 execution backends (4 fragment instances) started: 19.907ms (1.355ms) - Rows available: 4m43s (4m43s) - First row fetched: 4m43s (20.251ms) - Last row fetched: 4m43s (335.192ms) - Released admission control resources: 4m43s (403.770us) - Unregister query: 4m43s (93.022ms) - ComputeScanRangeAssignmentTimer: 22.760us ImpalaServer: - ClientFetchWaitTimer: 437.383ms - RowMaterializationTimer: 11.448ms Execution Profile a445b5ae5528dff9:8a3b9aa600000000:(Total: 4m43s, non-child: 0.000ns, % non-child: 0.00%) Number of filters: 0 Filter routing table: ID Src. Node Tgt. Node(s) Target type Partition filter Pending (Expected) First arrived Completed Enabled ------------------------------------------------------------------------------------------------------------------- Backend startup latencies: Count: 1, min / max: 1ms / 1ms, 25th %-ile: 1ms, 50th %-ile: 1ms, 75th %-ile: 1ms, 90th %-ile: 1ms, 95th %-ile: 1ms, 99.9th %-ile: 1ms Per Node Peak Memory Usage: mostafa-01:22000(2.01 GB) - FiltersReceived: 0 (0) - FinalizationTimer: 0.000ns - NumBackends: 1 (1) - NumFragmentInstances: 4 (4) - NumFragments: 4 (4) Averaged Fragment F03:(Total: 4m43s, non-child: 355.790ms, % non-child: 0.13%) split sizes: min: 0, max: 0, avg: 0, stddev: 0 completion times: min:4m43s max:4m43s mean: 4m43s stddev:0.000ns execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec num instances: 1 - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 312.00 KB (319488) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 2.01 GB (2159741702) - RowsProduced: 2.47K (2466) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 1 (1) - TotalThreadsTotalWallClockTime: 4m43s - TotalThreadsSysTime: 19.000us - TotalThreadsUserTime: 9.126ms - TotalThreadsVoluntaryContextSwitches: 5 (5) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 355.445ms - ExecTreeExecTime: 219.718us - OpenTime: 4m43s - ExecTreeOpenTime: 4m43s - PrepareTime: 527.200us - ExecTreePrepareTime: 50.282us PLAN_ROOT_SINK: - PeakMemoryUsage: 0 EXCHANGE_NODE (id=9):(Total: 4m43s, non-child: 4m43s, % non-child: 100.00%) - ConvertRowBatchTime: 0.000ns - MergeGetNext: 210.853us - MergeGetNextBatch: 168.306us - PeakMemoryUsage: 304.00 KB (311296) - RowsReturned: 2.47K (2466) - RowsReturnedRate: 8.00 /sec Buffer pool: - AllocTime: 7.257us - CumulativeAllocationBytes: 312.00 KB (319488) - CumulativeAllocations: 6 (6) - PeakReservation: 304.00 KB (311296) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 304.00 KB (311296) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns RecvrSide: - FirstBatchArrivalWaitTime: 4m43s - TotalBytesReceived: 180.62 KB (184950) - TotalGetBatchTime: 4m43s - DataArrivalTimer: 4m43s SenderSide: - DeserializeRowBatchTime: 114.742us - NumBatchesArrived: 3 (3) - NumBatchesDeferred: 0 (0) - NumBatchesEnqueued: 3 (3) - NumBatchesReceived: 3 (3) - NumEarlySenders: 0 (0) - NumEosReceived: 1 (1) Coordinator Fragment F03: Instance a445b5ae5528dff9:8a3b9aa600000000 (host=mostafa-01:22000):(Total: 4m43s, non-child: 355.790ms, % non-child: 0.13%) Fragment Instance Lifecycle Event Timeline: 4m43s - Prepare Finished: 614.249us (614.249us) - Open Finished: 4m43s (4m43s) - First Batch Produced: 4m43s (180.329us) - First Batch Sent: 4m43s (25.184ms) - ExecInternal Finished: 4m43s (330.080ms) MemoryUsage(8s000ms): 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 312.00 KB (319488) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 2.01 GB (2159741702) - RowsProduced: 2.47K (2466) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 1 (1) - TotalThreadsTotalWallClockTime: 4m43s - TotalThreadsSysTime: 19.000us - TotalThreadsUserTime: 9.126ms - TotalThreadsVoluntaryContextSwitches: 5 (5) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 355.445ms - ExecTreeExecTime: 219.718us - OpenTime: 4m43s - ExecTreeOpenTime: 4m43s - PrepareTime: 527.200us - ExecTreePrepareTime: 50.282us PLAN_ROOT_SINK: - PeakMemoryUsage: 0 EXCHANGE_NODE (id=9):(Total: 4m43s, non-child: 71.878us, % non-child: 0.00%) ExecOption: Codegen Disabled: disabled by query option DISABLE_CODEGEN - ConvertRowBatchTime: 0.000ns - MergeGetNext: 210.853us - MergeGetNextBatch: 168.306us - PeakMemoryUsage: 304.00 KB (311296) - RowsReturned: 2.47K (2466) - RowsReturnedRate: 8.00 /sec Buffer pool: - AllocTime: 7.257us - CumulativeAllocationBytes: 312.00 KB (319488) - CumulativeAllocations: 6 (6) - PeakReservation: 304.00 KB (311296) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 304.00 KB (311296) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns RecvrSide: BytesReceived(8s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - FirstBatchArrivalWaitTime: 4m43s - TotalBytesReceived: 180.62 KB (184950) - TotalGetBatchTime: 4m43s - DataArrivalTimer: 4m43s SenderSide: - DeserializeRowBatchTime: 114.742us - NumBatchesArrived: 3 (3) - NumBatchesDeferred: 0 (0) - NumBatchesEnqueued: 3 (3) - NumBatchesReceived: 3 (3) - NumEarlySenders: 0 (0) - NumEosReceived: 1 (1) Averaged Fragment F02:(Total: 4m43s, non-child: 425.560us, % non-child: 0.00%) split sizes: min: 0, max: 0, avg: 0, stddev: 0 completion times: min:4m43s max:4m43s mean: 4m43s stddev:0.000ns execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec num instances: 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 13.99 MB (14671224) - PeakReservation: 13.94 MB (14614528) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 2.01 GB (2159741702) - RowsProduced: 2.47K (2466) - TotalNetworkReceiveTime: 4m43s - TotalNetworkSendTime: 203.917us - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 1 (1) - TotalThreadsTotalWallClockTime: 4m43s - TotalThreadsSysTime: 4.230ms - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 12 (12) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 704.226us - ExecTreeExecTime: 8.916us - OpenTime: 4m43s - ExecTreeOpenTime: 4m43s - PrepareTime: 347.245us - ExecTreePrepareTime: 106.910us KrpcDataStreamSender (dst_id=9):(Total: 537.231us, non-child: 537.231us, % non-child: 100.00%) - BytesSent: 110.41 KB (113060) - EosSent: 1 (1) - OverallThroughput: 200.70 MB/sec - PeakMemoryUsage: 2.24 KB (2296) - RowsReturned: 2.47K (2466) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 469.182us - UncompressedRowBatchSize: 180.62 KB (184950) SORT_NODE (id=5):(Total: 4m43s, non-child: 1.305ms, % non-child: 0.00%) - InMemorySortTime: 1.067ms - InitialRunsCreated: 1 (1) - PeakMemoryUsage: 12.02 MB (12603392) - RowsReturned: 2.47K (2466) - RowsReturnedRate: 8.00 /sec - SortDataSize: 161.35 KB (165222) - SpilledRuns: 0 (0) - TotalMergesPerformed: 0 (0) AGGREGATION_NODE (id=8):(Total: 4m43s, non-child: 2.411ms, % non-child: 0.00%) - BuildTime: 826.734us - GetResultsTime: 875.985us - HTResizeTime: 63.445us - HashBuckets: 32.77K (32768) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.97 MB (2065536) - RowsRepartitioned: 0 (0) - RowsReturned: 2.47K (2466) - RowsReturnedRate: 8.00 /sec - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=7):(Total: 4m43s, non-child: 4m43s, % non-child: 100.00%) - ConvertRowBatchTime: 23.224us - PeakMemoryUsage: 392.00 KB (401408) - RowsReturned: 2.47K (2466) - RowsReturnedRate: 8.00 /sec Buffer pool: - AllocTime: 12.973us - CumulativeAllocationBytes: 640.00 KB (655360) - CumulativeAllocations: 32 (32) - PeakReservation: 392.00 KB (401408) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 392.00 KB (401408) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns RecvrSide: - FirstBatchArrivalWaitTime: 4m43s - TotalBytesReceived: 450.33 KB (461142) - TotalGetBatchTime: 4m43s - DataArrivalTimer: 4m43s SenderSide: - DeserializeRowBatchTime: 306.705us - NumBatchesArrived: 16 (16) - NumBatchesDeferred: 0 (0) - NumBatchesEnqueued: 16 (16) - NumBatchesReceived: 16 (16) - NumEarlySenders: 0 (0) - NumEosReceived: 1 (1) Buffer pool: - AllocTime: 4.919us - CumulativeAllocationBytes: 1.56 MB (1638400) - CumulativeAllocations: 25 (25) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.56 MB (1638400) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Buffer pool: - AllocTime: 728.000ns - CumulativeAllocationBytes: 6.00 MB (6291456) - CumulativeAllocations: 3 (3) - PeakReservation: 12.00 MB (12582912) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 6.00 MB (6291456) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment F02: Instance a445b5ae5528dff9:8a3b9aa600000003 (host=mostafa-01:22000):(Total: 4m43s, non-child: 425.560us, % non-child: 0.00%) Fragment Instance Lifecycle Event Timeline: 4m43s - Prepare Finished: 625.414us (625.414us) - Open Finished: 4m43s (4m43s) - First Batch Produced: 4m43s (3.939us) - First Batch Sent: 4m43s (205.240us) - ExecInternal Finished: 4m43s (493.887us) MemoryUsage(8s000ms): 35.37 KB, 35.37 KB, 35.37 KB, 35.37 KB, 35.37 KB, 35.37 KB, 35.37 KB, 35.37 KB, 35.37 KB, 35.37 KB, 35.37 KB, 35.37 KB, 35.37 KB, 35.37 KB, 35.37 KB, 35.37 KB, 35.37 KB, 35.37 KB, 35.37 KB, 35.37 KB, 35.37 KB, 35.37 KB, 35.37 KB, 35.37 KB, 35.37 KB, 35.37 KB, 35.37 KB, 35.37 KB, 35.37 KB, 35.37 KB, 35.37 KB, 35.37 KB, 35.37 KB, 35.37 KB, 35.37 KB ThreadUsage(8s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 13.99 MB (14671224) - PeakReservation: 13.94 MB (14614528) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 2.01 GB (2159741702) - RowsProduced: 2.47K (2466) - TotalNetworkReceiveTime: 4m43s - TotalNetworkSendTime: 203.917us - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 1 (1) - TotalThreadsTotalWallClockTime: 4m43s - TotalThreadsSysTime: 4.230ms - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 12 (12) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 704.226us - ExecTreeExecTime: 8.916us - OpenTime: 4m43s - ExecTreeOpenTime: 4m43s - PrepareTime: 347.245us - ExecTreePrepareTime: 106.910us KrpcDataStreamSender (dst_id=9):(Total: 537.231us, non-child: 537.231us, % non-child: 100.00%) - BytesSent: 110.41 KB (113060) - EosSent: 1 (1) - OverallThroughput: 200.70 MB/sec - PeakMemoryUsage: 2.24 KB (2296) - RowsReturned: 2.47K (2466) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 469.182us - UncompressedRowBatchSize: 180.62 KB (184950) SORT_NODE (id=5):(Total: 4m43s, non-child: 1.305ms, % non-child: 0.00%) SortType: Total ExecOption: Codegen Disabled: disabled by query option DISABLE_CODEGEN - NumRowsPerRun: (Avg: 2.47K (2466) ; Min: 2.47K (2466) ; Max: 2.47K (2466) ; Number of samples: 1) - InMemorySortTime: 1.067ms - InitialRunsCreated: 1 (1) - PeakMemoryUsage: 12.02 MB (12603392) - RowsReturned: 2.47K (2466) - RowsReturnedRate: 8.00 /sec - SortDataSize: 161.35 KB (165222) - SpilledRuns: 0 (0) - TotalMergesPerformed: 0 (0) AGGREGATION_NODE (id=8):(Total: 4m43s, non-child: 2.411ms, % non-child: 0.00%) ExecOption: Codegen Disabled: disabled by query option DISABLE_CODEGEN - BuildTime: 826.734us - GetResultsTime: 875.985us - HTResizeTime: 63.445us - HashBuckets: 32.77K (32768) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.97 MB (2065536) - RowsRepartitioned: 0 (0) - RowsReturned: 2.47K (2466) - RowsReturnedRate: 8.00 /sec - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=7):(Total: 4m43s, non-child: 39.824us, % non-child: 0.00%) - ConvertRowBatchTime: 23.224us - PeakMemoryUsage: 392.00 KB (401408) - RowsReturned: 2.47K (2466) - RowsReturnedRate: 8.00 /sec Buffer pool: - AllocTime: 12.973us - CumulativeAllocationBytes: 640.00 KB (655360) - CumulativeAllocations: 32 (32) - PeakReservation: 392.00 KB (401408) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 392.00 KB (401408) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns RecvrSide: BytesReceived(8s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - FirstBatchArrivalWaitTime: 4m43s - TotalBytesReceived: 450.33 KB (461142) - TotalGetBatchTime: 4m43s - DataArrivalTimer: 4m43s SenderSide: - DeserializeRowBatchTime: 306.705us - NumBatchesArrived: 16 (16) - NumBatchesDeferred: 0 (0) - NumBatchesEnqueued: 16 (16) - NumBatchesReceived: 16 (16) - NumEarlySenders: 0 (0) - NumEosReceived: 1 (1) Buffer pool: - AllocTime: 4.919us - CumulativeAllocationBytes: 1.56 MB (1638400) - CumulativeAllocations: 25 (25) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.56 MB (1638400) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Buffer pool: - AllocTime: 728.000ns - CumulativeAllocationBytes: 6.00 MB (6291456) - CumulativeAllocations: 3 (3) - PeakReservation: 12.00 MB (12582912) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 6.00 MB (6291456) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Averaged Fragment F01:(Total: 4m43s, non-child: 1.167ms, % non-child: 0.00%) split sizes: min: 0, max: 0, avg: 0, stddev: 0 completion times: min:4m43s max:4m43s mean: 4m43s stddev:0.000ns execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec num instances: 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.97 GB (2119665536) - PeakReservation: 1.97 GB (2116026368) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 2.01 GB (2159741702) - RowsProduced: 2.47K (2466) - TotalNetworkReceiveTime: 1s268ms - TotalNetworkSendTime: 667.187us - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 38.78K (38784) - TotalThreadsTotalWallClockTime: 4m43s - TotalThreadsSysTime: 799.685ms - TotalThreadsUserTime: 4m40s - TotalThreadsVoluntaryContextSwitches: 43.56K (43558) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 2m30s - ExecTreeExecTime: 2m30s - OpenTime: 2m12s - ExecTreeOpenTime: 2m12s - PrepareTime: 510.597us - ExecTreePrepareTime: 136.983us KrpcDataStreamSender (dst_id=7):(Total: 1.257ms, non-child: 1.257ms, % non-child: 100.00%) - BytesSent: 214.63 KB (219786) - EosSent: 1 (1) - OverallThroughput: 166.64 MB/sec - PeakMemoryUsage: 768.00 B (768) - RowsReturned: 2.47K (2466) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 1.208ms - UncompressedRowBatchSize: 450.33 KB (461142) AGGREGATION_NODE (id=4):(Total: 4m43s, non-child: 1m56s, % non-child: 41.12%) - GetResultsTime: 147.154us - HTResizeTime: 71.759us - HashBuckets: 32.77K (32768) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.11 MB (2208896) - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 2.47K (2466) - RowsReturnedRate: 8.00 /sec - StreamingTime: 1m56s ANALYTIC_EVAL_NODE (id=3):(Total: 2m46s, non-child: 10s727ms, % non-child: 6.44%) - EvaluationTime: 10s637ms - PeakMemoryUsage: 13.09 MB (13729792) - RowsReturned: 59.99M (59986052) - RowsReturnedRate: 359.97 K/sec ANALYTIC_EVAL_NODE (id=2):(Total: 2m35s, non-child: 23s279ms, % non-child: 14.93%) - EvaluationTime: 23s249ms - PeakMemoryUsage: 14.05 MB (14737408) - RowsReturned: 59.99M (59986052) - RowsReturnedRate: 384.74 K/sec SORT_NODE (id=1):(Total: 2m12s, non-child: 2m10s, % non-child: 98.60%) - InMemorySortTime: 2m7s - InitialRunsCreated: 1 (1) - PeakMemoryUsage: 1.96 GB (2105556992) - RowsReturned: 59.99M (59986052) - RowsReturnedRate: 452.27 K/sec - SortDataSize: 1.96 GB (2099511820) - SpilledRuns: 0 (0) - TotalMergesPerformed: 0 (0) Buffer pool: - AllocTime: 57.320ms - CumulativeAllocationBytes: 1.96 GB (2105540608) - CumulativeAllocations: 1.00K (1004) - PeakReservation: 1.96 GB (2105540608) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.96 GB (2105540608) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns EXCHANGE_NODE (id=6):(Total: 1s860ms, non-child: 1s860ms, % non-child: 100.00%) - ConvertRowBatchTime: 573.989ms - PeakMemoryUsage: 13.42 MB (14073856) - RowsReturned: 59.99M (59986052) - RowsReturnedRate: 32.24 M/sec Buffer pool: - AllocTime: 32.713ms - CumulativeAllocationBytes: 4.02 GB (4318896128) - CumulativeAllocations: 117.17K (117174) - PeakReservation: 13.42 MB (14073856) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 13.42 MB (14073856) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns RecvrSide: - FirstBatchArrivalWaitTime: 9.146ms - TotalBytesReceived: 2.40 GB (2579400236) - TotalGetBatchTime: 1s262ms - DataArrivalTimer: 1s219ms SenderSide: - DeserializeRowBatchTime: 1s319ms - NumBatchesArrived: 58.59K (58587) - NumBatchesDeferred: 0 (0) - NumBatchesEnqueued: 58.59K (58587) - NumBatchesReceived: 58.59K (58587) - NumEarlySenders: 0 (0) - NumEosReceived: 1 (1) Buffer pool: - AllocTime: 1.630ms - CumulativeAllocationBytes: 1.96 GB (2101346304) - CumulativeAllocations: 1.00K (1002) - PeakReservation: 4.00 MB (4194304) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 4.00 MB (4194304) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Buffer pool: - AllocTime: 1.896ms - CumulativeAllocationBytes: 2.46 GB (2640314368) - CumulativeAllocations: 1.26K (1259) - PeakReservation: 4.00 MB (4194304) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 4.00 MB (4194304) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Buffer pool: - AllocTime: 40.486us - CumulativeAllocationBytes: 1.56 MB (1638400) - CumulativeAllocations: 25 (25) - PeakReservation: 2.00 MB (2097152) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.56 MB (1638400) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment F01: Instance a445b5ae5528dff9:8a3b9aa600000002 (host=mostafa-01:22000):(Total: 4m43s, non-child: 1.167ms, % non-child: 0.00%) Fragment Instance Lifecycle Event Timeline: 4m43s - Prepare Finished: 847.394us (847.394us) - Open Finished: 2m12s (2m12s) - First Batch Produced: 4m43s (2m30s) - First Batch Sent: 4m43s (735.000ns) - ExecInternal Finished: 4m43s (2.362ms) MemoryUsage(8s000ms): 1.29 GB, 1.96 GB, 1.96 GB, 1.96 GB, 1.96 GB, 1.96 GB, 1.96 GB, 1.96 GB, 1.96 GB, 1.96 GB, 1.96 GB, 1.96 GB, 1.96 GB, 1.96 GB, 1.96 GB, 1.96 GB, 1.96 GB, 1.91 GB, 1.83 GB, 1.76 GB, 1.69 GB, 1.61 GB, 1.54 GB, 1.47 GB, 1.39 GB, 1.32 GB, 1.24 GB, 1.17 GB, 1.10 GB, 1.02 GB, 972.32 MB, 896.62 MB, 819.31 MB, 741.62 MB, 664.32 MB ThreadUsage(8s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.97 GB (2119665536) - PeakReservation: 1.97 GB (2116026368) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 2.01 GB (2159741702) - RowsProduced: 2.47K (2466) - TotalNetworkReceiveTime: 1s268ms - TotalNetworkSendTime: 667.187us - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 38.78K (38784) - TotalThreadsTotalWallClockTime: 4m43s - TotalThreadsSysTime: 799.685ms - TotalThreadsUserTime: 4m40s - TotalThreadsVoluntaryContextSwitches: 43.56K (43558) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 2m30s - ExecTreeExecTime: 2m30s - OpenTime: 2m12s - ExecTreeOpenTime: 2m12s - PrepareTime: 510.597us - ExecTreePrepareTime: 136.983us KrpcDataStreamSender (dst_id=7):(Total: 1.257ms, non-child: 1.257ms, % non-child: 100.00%) - BytesSent: 214.63 KB (219786) - EosSent: 1 (1) - OverallThroughput: 166.64 MB/sec - PeakMemoryUsage: 768.00 B (768) - RowsReturned: 2.47K (2466) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 1.208ms - UncompressedRowBatchSize: 450.33 KB (461142) AGGREGATION_NODE (id=4):(Total: 4m43s, non-child: 1m56s, % non-child: 41.12%) ExecOption: Streaming Preaggregation, Codegen Disabled: disabled by query option DISABLE_CODEGEN - GetResultsTime: 147.154us - HTResizeTime: 71.759us - HashBuckets: 32.77K (32768) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.11 MB (2208896) - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 2.47K (2466) - RowsReturnedRate: 8.00 /sec - StreamingTime: 1m56s ANALYTIC_EVAL_NODE (id=3):(Total: 2m46s, non-child: 10s727ms, % non-child: 6.44%) - EvaluationTime: 10s637ms - PeakMemoryUsage: 13.09 MB (13729792) - RowsReturned: 59.99M (59986052) - RowsReturnedRate: 359.97 K/sec ANALYTIC_EVAL_NODE (id=2):(Total: 2m35s, non-child: 23s279ms, % non-child: 14.93%) - EvaluationTime: 23s249ms - PeakMemoryUsage: 14.05 MB (14737408) - RowsReturned: 59.99M (59986052) - RowsReturnedRate: 384.74 K/sec SORT_NODE (id=1):(Total: 2m12s, non-child: 2m10s, % non-child: 98.60%) SortType: Total ExecOption: Codegen Disabled: disabled by query option DISABLE_CODEGEN - NumRowsPerRun: (Avg: 59.99M (59986052) ; Min: 59.99M (59986052) ; Max: 59.99M (59986052) ; Number of samples: 1) - InMemorySortTime: 2m7s - InitialRunsCreated: 1 (1) - PeakMemoryUsage: 1.96 GB (2105556992) - RowsReturned: 59.99M (59986052) - RowsReturnedRate: 452.27 K/sec - SortDataSize: 1.96 GB (2099511820) - SpilledRuns: 0 (0) - TotalMergesPerformed: 0 (0) Buffer pool: - AllocTime: 57.320ms - CumulativeAllocationBytes: 1.96 GB (2105540608) - CumulativeAllocations: 1.00K (1004) - PeakReservation: 1.96 GB (2105540608) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.96 GB (2105540608) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns EXCHANGE_NODE (id=6):(Total: 1s860ms, non-child: 644.020ms, % non-child: 34.61%) - ConvertRowBatchTime: 573.989ms - PeakMemoryUsage: 13.42 MB (14073856) - RowsReturned: 59.99M (59986052) - RowsReturnedRate: 32.24 M/sec Buffer pool: - AllocTime: 32.713ms - CumulativeAllocationBytes: 4.02 GB (4318896128) - CumulativeAllocations: 117.17K (117174) - PeakReservation: 13.42 MB (14073856) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 13.42 MB (14073856) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns RecvrSide: BytesReceived(500.000ms): 82.01 MB, 298.12 MB, 534.44 MB, 783.24 MB, 1021.20 MB, 1.23 GB, 1.45 GB, 1.64 GB, 1.85 GB, 2.10 GB, 2.32 GB - FirstBatchArrivalWaitTime: 9.146ms - TotalBytesReceived: 2.40 GB (2579400236) - TotalGetBatchTime: 1s262ms - DataArrivalTimer: 1s219ms SenderSide: - DeserializeRowBatchTime: 1s319ms - NumBatchesArrived: 58.59K (58587) - NumBatchesDeferred: 0 (0) - NumBatchesEnqueued: 58.59K (58587) - NumBatchesReceived: 58.59K (58587) - NumEarlySenders: 0 (0) - NumEosReceived: 1 (1) Buffer pool: - AllocTime: 1.630ms - CumulativeAllocationBytes: 1.96 GB (2101346304) - CumulativeAllocations: 1.00K (1002) - PeakReservation: 4.00 MB (4194304) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 4.00 MB (4194304) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Buffer pool: - AllocTime: 1.896ms - CumulativeAllocationBytes: 2.46 GB (2640314368) - CumulativeAllocations: 1.26K (1259) - PeakReservation: 4.00 MB (4194304) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 4.00 MB (4194304) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Buffer pool: - AllocTime: 40.486us - CumulativeAllocationBytes: 1.56 MB (1638400) - CumulativeAllocations: 25 (25) - PeakReservation: 2.00 MB (2097152) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.56 MB (1638400) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Averaged Fragment F00:(Total: 5s411ms, non-child: 383.535ms, % non-child: 7.09%) split sizes: min: 2.05 GB, max: 2.05 GB, avg: 2.05 GB, stddev: 0 completion times: min:5s411ms max:5s411ms mean: 5s411ms stddev:0.000ns execution rates: min:388.43 MB/sec max:388.43 MB/sec mean:388.43 MB/sec stddev:0.35 B/sec num instances: 1 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 34.19 MB (35854160) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 2.01 GB (2159741702) - RowsProduced: 59.99M (59986052) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 153.764ms - TotalStorageWaitTime: 69.428ms - TotalThreadsInvoluntaryContextSwitches: 1.46K (1463) - TotalThreadsTotalWallClockTime: 10s815ms - TotalThreadsSysTime: 127.302ms - TotalThreadsUserTime: 7s166ms - TotalThreadsVoluntaryContextSwitches: 55.18K (55184) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 5s409ms - ExecTreeExecTime: 126.824ms - OpenTime: 30.225us - ExecTreeOpenTime: 25.753us - PrepareTime: 1.618ms - ExecTreePrepareTime: 83.117us KrpcDataStreamSender (dst_id=6):(Total: 4s913ms, non-child: 4s913ms, % non-child: 100.00%) - BytesSent: 1.04 GB (1112585107) - EosSent: 1 (1) - OverallThroughput: 215.96 MB/sec - PeakMemoryUsage: 5.12 KB (5240) - RowsReturned: 59.99M (59986052) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 4s909ms - UncompressedRowBatchSize: 2.40 GB (2579400236) HDFS_SCAN_NODE (id=0):(Total: 114.594ms, non-child: 114.594ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 387.58 MB (406402865) - BytesReadDataNodeCache: 0 - BytesReadLocal: 387.58 MB (406402865) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 387.58 MB (406402865) - CachedFileHandlesHitCount: 74 (74) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 468.747ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumRowGroups: 15 (15) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 34.18 MB (35840728) - PerReadThreadRawHdfsThroughput: 2.32 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 23.201ms - RowBatchQueuePutWaitTime: 3s400ms - RowsRead: 59.99M (59986052) - RowsReturned: 59.99M (59986052) - RowsReturnedRate: 523.47 M/sec - ScanRangesComplete: 15 (15) - ScannerThreadsInvoluntaryContextSwitches: 888 (888) - ScannerThreadsTotalWallClockTime: 5s405ms - MaterializeTupleTime(*): 1s366ms - ScannerThreadsSysTime: 51.115ms - ScannerThreadsUserTime: 2s005ms - ScannerThreadsVoluntaryContextSwitches: 52.28K (52285) - TotalRawHdfsOpenFileTime(*): 127.440us - TotalRawHdfsReadTime(*): 162.965ms - TotalReadThroughput: 70.47 MB/sec Fragment F00: Instance a445b5ae5528dff9:8a3b9aa600000001 (host=mostafa-01:22000):(Total: 5s411ms, non-child: 383.535ms, % non-child: 7.09%) Hdfs split stats (:<# splits>/): 0:15/2.05 GB Fragment Instance Lifecycle Event Timeline: 5s411ms - Prepare Finished: 1.995ms (1.995ms) - Open Finished: 2.026ms (31.374us) - First Batch Produced: 9.674ms (7.647ms) - First Batch Sent: 9.796ms (122.734us) - ExecInternal Finished: 5s411ms (5s401ms) MemoryUsage(500.000ms): 10.20 MB, 34.19 MB, 27.24 MB, 18.24 MB, 26.24 MB, 30.19 MB, 27.24 MB, 18.24 MB, 22.35 MB, 34.19 MB, 26.19 MB ThreadUsage(500.000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 34.19 MB (35854160) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 2.01 GB (2159741702) - RowsProduced: 59.99M (59986052) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 153.764ms - TotalStorageWaitTime: 69.428ms - TotalThreadsInvoluntaryContextSwitches: 1.46K (1463) - TotalThreadsTotalWallClockTime: 10s815ms - TotalThreadsSysTime: 127.302ms - TotalThreadsUserTime: 7s166ms - TotalThreadsVoluntaryContextSwitches: 55.18K (55184) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 5s409ms - ExecTreeExecTime: 126.824ms - OpenTime: 30.225us - ExecTreeOpenTime: 25.753us - PrepareTime: 1.618ms - ExecTreePrepareTime: 83.117us KrpcDataStreamSender (dst_id=6):(Total: 4s913ms, non-child: 4s913ms, % non-child: 100.00%) - BytesSent: 1.04 GB (1112585107) - EosSent: 1 (1) - OverallThroughput: 215.96 MB/sec - PeakMemoryUsage: 5.12 KB (5240) - RowsReturned: 59.99M (59986052) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 4s909ms - UncompressedRowBatchSize: 2.40 GB (2579400236) HDFS_SCAN_NODE (id=0):(Total: 114.594ms, non-child: 114.594ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:15/2.05 GB ExecOption: Codegen Disabled: disabled by query option DISABLE_CODEGEN, Codegen enabled: 0 out of 15 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% File Formats: PARQUET/SNAPPY:15 BytesRead(500.000ms): 13.45 MB, 66.93 MB, 98.98 MB, 125.70 MB, 175.01 MB, 219.21 MB, 250.95 MB, 271.03 MB, 304.70 MB, 366.59 MB, 387.58 MB - FooterProcessingTime: (Avg: 1.296ms ; Min: 47.234us ; Max: 2.316ms ; Number of samples: 15) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 387.58 MB (406402865) - BytesReadDataNodeCache: 0 - BytesReadLocal: 387.58 MB (406402865) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 387.58 MB (406402865) - CachedFileHandlesHitCount: 74 (74) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 468.747ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumRowGroups: 15 (15) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 34.18 MB (35840728) - PerReadThreadRawHdfsThroughput: 2.32 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 23.201ms - RowBatchQueuePutWaitTime: 3s400ms - RowsRead: 59.99M (59986052) - RowsReturned: 59.99M (59986052) - RowsReturnedRate: 523.47 M/sec - ScanRangesComplete: 15 (15) - ScannerThreadsInvoluntaryContextSwitches: 888 (888) - ScannerThreadsTotalWallClockTime: 5s405ms - MaterializeTupleTime(*): 1s366ms - ScannerThreadsSysTime: 51.115ms - ScannerThreadsUserTime: 2s005ms - ScannerThreadsVoluntaryContextSwitches: 52.28K (52285) - TotalRawHdfsOpenFileTime(*): 127.440us - TotalRawHdfsReadTime(*): 162.965ms - TotalReadThroughput: 70.47 MB/sec