Query (id=504b379400cba9f2:2d2cf00700000000): DEBUG MODE WARNING: Query profile created while running a DEBUG build of Impala. Use RELEASE builds to measure query performance. Summary: Session ID: e64d5ef7e3dd582c:6a1614c448f4d0be Session Type: BEESWAX Start Time: 2020-04-23 18:04:33.361181000 End Time: 2020-04-23 18:04:35.294015000 Query Type: QUERY Query State: FINISHED Impala Query State: FINISHED Query Status: OK Impala Version: impalad version 4.0.0-SNAPSHOT DEBUG (build 1062fe22c6667e2420c0c4248deb03f320a87cff) User: tarmstrong Connected User: tarmstrong Delegated User: Network Address: ::ffff:127.0.0.1:58132 Default Db: default Sql Statement: select count(distinct l_partkey) from tpch.lineitem Coordinator: tarmstrong-box2:22000 Query Options (set by configuration): MT_DOP=4,TIMEZONE=America/Los_Angeles,CLIENT_IDENTIFIER=Impala Shell v4.0.0-SNAPSHOT (1062fe2) built on Thu Apr 23 17:58:12 PDT 2020 Query Options (set by configuration and planner): MT_DOP=4,TIMEZONE=America/Los_Angeles,CLIENT_IDENTIFIER=Impala Shell v4.0.0-SNAPSHOT (1062fe2) built on Thu Apr 23 17:58:12 PDT 2020 Plan: ---------------- Max Per-Host Resource Reservation: Memory=25.88MB Threads=5 Per-Host Resource Estimates: Memory=246MB Analyzed query: SELECT count(DISTINCT l_partkey) FROM tpch.lineitem F02:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1 | Per-Instance Resources: mem-estimate=10.02MB mem-reservation=0B thread-reservation=1 PLAN-ROOT SINK | output exprs: count(l_partkey) | mem-estimate=0B mem-reservation=0B thread-reservation=0 | 06:AGGREGATE [FINALIZE] | output: count:merge(l_partkey) | mem-estimate=10.00MB mem-reservation=0B spill-buffer=2.00MB thread-reservation=0 | tuple-ids=2 row-size=8B cardinality=1 | in pipelines: 06(GETNEXT), 02(OPEN) | 05:EXCHANGE [UNPARTITIONED] | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0 | tuple-ids=2 row-size=8B cardinality=1 | in pipelines: 02(GETNEXT) | F01:PLAN FRAGMENT [HASH(l_partkey)] hosts=3 instances=6 Per-Instance Resources: mem-estimate=20.00MB mem-reservation=1.94MB thread-reservation=1 02:AGGREGATE | output: count(l_partkey) | mem-estimate=10.00MB mem-reservation=0B spill-buffer=2.00MB thread-reservation=0 | tuple-ids=2 row-size=8B cardinality=1 | in pipelines: 02(GETNEXT), 04(OPEN) | 04:AGGREGATE | group by: l_partkey | mem-estimate=10.00MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0 | tuple-ids=1 row-size=8B cardinality=200.52K | in pipelines: 04(GETNEXT), 00(OPEN) | 03:EXCHANGE [HASH(l_partkey)] | mem-estimate=594.18KB mem-reservation=0B thread-reservation=0 | tuple-ids=1 row-size=8B cardinality=200.52K | in pipelines: 00(GETNEXT) | F00:PLAN FRAGMENT [RANDOM] hosts=3 instances=6 Per-Instance Resources: mem-estimate=98.00MB mem-reservation=11.00MB thread-reservation=1 01:AGGREGATE [STREAMING] | group by: l_partkey | mem-estimate=10.00MB mem-reservation=3.00MB spill-buffer=128.00KB thread-reservation=0 | tuple-ids=1 row-size=8B cardinality=200.52K | in pipelines: 00(GETNEXT) | 00:SCAN HDFS [tpch.lineitem, RANDOM] HDFS partitions=1/1 files=1 size=718.94MB stored statistics: table: rows=6.00M size=718.94MB columns: all extrapolated-rows=disabled max-scan-range-rows=1.07M mem-estimate=88.00MB mem-reservation=8.00MB thread-reservation=0 tuple-ids=0 row-size=8B cardinality=6.00M in pipelines: 00(GETNEXT) ---------------- Estimated Per-Host Mem: 257966080 Request Pool: default-pool Per Host Min Memory Reservation: tarmstrong-box2:22001(25.88 MB) tarmstrong-box2:22002(25.88 MB) tarmstrong-box2:22000(25.88 MB) Per Host Number of Fragment Instances: tarmstrong-box2:22001(4) tarmstrong-box2:22002(4) tarmstrong-box2:22000(5) Admission result: Admitted immediately Cluster Memory Admitted: 738.05 MB Executor Group: default ExecSummary: Operator #Hosts #Inst Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail -------------------------------------------------------------------------------------------------------------------------- F02:ROOT 1 1 55.594us 55.594us 0 0 06:AGGREGATE 1 1 286.905us 286.905us 1 1 16.00 KB 10.00 MB FINALIZE 05:EXCHANGE 1 1 93.267us 93.267us 6 1 64.00 KB 16.00 KB UNPARTITIONED F01:EXCHANGE SENDER 3 6 93.504us 108.045us 16.00 KB 0 02:AGGREGATE 3 6 463.254us 482.606us 6 1 16.00 KB 10.00 MB 04:AGGREGATE 3 6 39.199ms 45.770ms 200.00K 200.52K 2.96 MB 10.00 MB 03:EXCHANGE 3 6 172.764ms 183.971ms 1.19M 200.52K 112.00 KB 594.18 KB HASH(l_partkey) F00:EXCHANGE SENDER 3 6 219.697ms 224.245ms 389.31 KB 0 01:AGGREGATE 3 6 203.594ms 232.293ms 1.19M 200.52K 10.30 MB 10.00 MB STREAMING 00:SCAN HDFS 3 6 1s079ms 1s280ms 6.00M 6.00M 24.00 MB 88.00 MB tpch.lineitem Errors: Query Compilation: 6.610ms - Metadata of all 1 tables cached: 420.375us (420.375us) - Analysis finished: 1.304ms (884.257us) - Authorization finished (noop): 1.380ms (76.073us) - Value transfer graph computed: 1.587ms (207.061us) - Single node plan created: 2.886ms (1.298ms) - Runtime filters computed: 3.169ms (283.290us) - Distributed plan created: 3.470ms (300.549us) - Parallel plans created: 3.489ms (19.075us) - Planning finished: 6.610ms (3.121ms) Query Timeline: 1s935ms - Query submitted: 49.462us (49.462us) - Planning finished: 19.158ms (19.108ms) - Submit for admission: 19.333ms (174.694us) - Completed admission: 19.762ms (429.111us) - Ready to start on 3 backends: 20.185ms (423.672us) - All 3 execution backends (13 fragment instances) started: 21.440ms (1.254ms) - Rows available: 1s896ms (1s875ms) - First row fetched: 1s929ms (32.510ms) - Last row fetched: 1s929ms (16.973us) - Released admission control resources: 1s932ms (3.555ms) - Unregister query: 1s935ms (2.591ms) - AdmissionControlTimeSinceLastUpdate: 28.000ms - ComputeScanRangeAssignmentTimer: 208.060us Frontend: ImpalaServer: - ClientFetchWaitTimer: 32.840ms - NumRowsFetched: 1 (1) - NumRowsFetchedFromCache: 0 (0) - RowMaterializationRate: 171.00 /sec - RowMaterializationTimer: 5.833ms Execution Profile 504b379400cba9f2:2d2cf00700000000:(Total: 1s882ms, non-child: 0.000ns, % non-child: 0.00%) Number of filters: 0 Filter routing table: ID Src. Node Tgt. Node(s) Target type Partition filter Pending (Expected) First arrived Completed Enabled ------------------------------------------------------------------------------------------------------------------- Backend startup latencies: Count: 3, min / max: 0 / 1ms, 25th %-ile: 0, 50th %-ile: 1ms, 75th %-ile: 1ms, 90th %-ile: 1ms, 95th %-ile: 1ms, 99.9th %-ile: 1ms Slowest backend to start up: tarmstrong-box2:22002 Per Node Peak Memory Usage: tarmstrong-box2:22001(72.72 MB) tarmstrong-box2:22002(74.71 MB) tarmstrong-box2:22000(74.46 MB) Per Node Bytes Read: tarmstrong-box2:22001(207.00 MB) tarmstrong-box2:22002(256.12 MB) tarmstrong-box2:22000(256.12 MB) Per Node User Time: tarmstrong-box2:22001(2s757ms) tarmstrong-box2:22002(3s866ms) tarmstrong-box2:22000(3s611ms) Per Node System Time: tarmstrong-box2:22001(120.908ms) tarmstrong-box2:22002(143.431ms) tarmstrong-box2:22000(144.299ms) - ExchangeScanRatio: 0.01 - FiltersReceived: 0 (0) - FinalizationTimer: 0.000ns - InnerNodeSelectivityRatio: 0.00 - NumBackends: 3 (3) - NumCompletedBackends: 3 (3) - NumFragmentInstances: 13 (13) - NumFragments: 3 (3) - TotalBytesRead: 719.25 MB (754189752) - TotalBytesSent: 9.64 MB (10112114) - TotalCpuTime: 10s643ms - TotalInnerBytesSent: 72.00 B (72) - TotalScanBytesSent: 9.64 MB (10112042) Per Node Profiles: tarmstrong-box2:22001: - AdmissionSlots: 2 (2) - BloomFilterBytes: 0 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns - UncompressedScratchBytesWritten: 0 Buffer pool: - AllocTime: 0.000ns - CompressionTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - EncryptionTime: 0.000ns - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment F01: CodeGen:(Total: 81.252ms, non-child: 81.252ms, % non-child: 100.00%) - CodegenInvoluntaryContextSwitches: 5 (5) - CodegenTotalWallClockTime: 81.241ms - CodegenSysTime: 0.000ns - CodegenUserTime: 80.700ms - CodegenVoluntaryContextSwitches: 0 (0) - CompileTime: 6.273ms - IrGenerationTime: 4.079ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.53 MB (2648160) - NumFunctions: 35 (35) - NumInstructions: 669 (669) - OptimizationTime: 51.397ms - PeakMemoryUsage: 334.50 KB (342528) - PrepareTime: 18.338ms Fragment F00: CodeGen:(Total: 111.827ms, non-child: 111.827ms, % non-child: 100.00%) - CodegenInvoluntaryContextSwitches: 3 (3) - CodegenTotalWallClockTime: 111.811ms - CodegenSysTime: 0.000ns - CodegenUserTime: 108.473ms - CodegenVoluntaryContextSwitches: 0 (0) - CompileTime: 10.016ms - IrGenerationTime: 6.815ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.53 MB (2648160) - NumFunctions: 63 (63) - NumInstructions: 1.44K (1437) - OptimizationTime: 78.838ms - PeakMemoryUsage: 718.50 KB (735744) - PrepareTime: 14.929ms tarmstrong-box2:22002: - AdmissionSlots: 2 (2) - BloomFilterBytes: 0 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns - UncompressedScratchBytesWritten: 0 Buffer pool: - AllocTime: 0.000ns - CompressionTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - EncryptionTime: 0.000ns - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment F01: CodeGen:(Total: 81.492ms, non-child: 81.492ms, % non-child: 100.00%) - CodegenInvoluntaryContextSwitches: 2 (2) - CodegenTotalWallClockTime: 81.483ms - CodegenSysTime: 0.000ns - CodegenUserTime: 79.916ms - CodegenVoluntaryContextSwitches: 0 (0) - CompileTime: 6.053ms - IrGenerationTime: 4.100ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.53 MB (2648160) - NumFunctions: 35 (35) - NumInstructions: 669 (669) - OptimizationTime: 50.613ms - PeakMemoryUsage: 334.50 KB (342528) - PrepareTime: 19.566ms Fragment F00: CodeGen:(Total: 130.036ms, non-child: 130.036ms, % non-child: 100.00%) - CodegenInvoluntaryContextSwitches: 1 (1) - CodegenTotalWallClockTime: 130.025ms - CodegenSysTime: 0.000ns - CodegenUserTime: 128.729ms - CodegenVoluntaryContextSwitches: 0 (0) - CompileTime: 9.663ms - IrGenerationTime: 6.804ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.53 MB (2648160) - NumFunctions: 63 (63) - NumInstructions: 1.44K (1437) - OptimizationTime: 92.377ms - PeakMemoryUsage: 718.50 KB (735744) - PrepareTime: 20.021ms tarmstrong-box2:22000: - AdmissionSlots: 2 (2) - BloomFilterBytes: 0 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns - UncompressedScratchBytesWritten: 0 Buffer pool: - AllocTime: 0.000ns - CompressionTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - EncryptionTime: 0.000ns - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment F02: CodeGen:(Total: 31.913ms, non-child: 31.913ms, % non-child: 100.00%) - CodegenInvoluntaryContextSwitches: 9 (9) - CodegenTotalWallClockTime: 31.902ms - CodegenSysTime: 0.000ns - CodegenUserTime: 31.174ms - CodegenVoluntaryContextSwitches: 0 (0) - CompileTime: 1.885ms - IrGenerationTime: 560.663us - LoadTime: 0.000ns - ModuleBitcodeSize: 2.53 MB (2648160) - NumFunctions: 8 (8) - NumInstructions: 85 (85) - OptimizationTime: 8.185ms - PeakMemoryUsage: 42.50 KB (43520) - PrepareTime: 20.093ms Fragment F01: CodeGen:(Total: 80.423ms, non-child: 80.423ms, % non-child: 100.00%) - CodegenInvoluntaryContextSwitches: 1 (1) - CodegenTotalWallClockTime: 80.413ms - CodegenSysTime: 0.000ns - CodegenUserTime: 79.848ms - CodegenVoluntaryContextSwitches: 0 (0) - CompileTime: 4.254ms - IrGenerationTime: 4.142ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.53 MB (2648160) - NumFunctions: 35 (35) - NumInstructions: 669 (669) - OptimizationTime: 51.297ms - PeakMemoryUsage: 334.50 KB (342528) - PrepareTime: 19.529ms Fragment F00: CodeGen:(Total: 99.948ms, non-child: 99.948ms, % non-child: 100.00%) - CodegenInvoluntaryContextSwitches: 2 (2) - CodegenTotalWallClockTime: 99.938ms - CodegenSysTime: 0.000ns - CodegenUserTime: 96.891ms - CodegenVoluntaryContextSwitches: 0 (0) - CompileTime: 7.582ms - IrGenerationTime: 4.922ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.53 MB (2648160) - NumFunctions: 63 (63) - NumInstructions: 1.44K (1437) - OptimizationTime: 72.772ms - PeakMemoryUsage: 718.50 KB (735744) - PrepareTime: 13.619ms Coordinator Fragment F02:(Total: 1s894ms, non-child: 32.233ms, % non-child: 1.70%) Instances: Instance 504b379400cba9f2:2d2cf00700000000 (host=tarmstrong-box2:22000) Last report received time[0]: 2020-04-23 18:04:35.292 - AverageThreadTokens: 0.00 - BytesAssigned: 0 - CompletionTime: 1s910ms - ExchangeScanRatio: 0.00 - ExecutionRate: 0.00 /sec - PeakMemoryUsage: 88.00 KB (90112) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 74.46 MB (78079577) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 1s829ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 9 (9) - TotalThreadsTotalWallClockTime: 1s894ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 31.955ms - TotalThreadsVoluntaryContextSwitches: 5 (5) Fragment Instance Lifecycle Timings: - ExecTime: 32.509ms - ExecTreeExecTime: 8.687us - OpenTime: 1s861ms - ExecTreeOpenTime: 1s829ms - PrepareTime: 322.177us - ExecTreePrepareTime: 206.050us PLAN_ROOT_SINK:(Total: 32.468ms, non-child: 32.468ms, % non-child: 100.00%) - PeakMemoryUsage: 0 - RowsSent: 1 (1) - RowsSentRate: 30.00 /sec AGGREGATION_NODE (id=6):(Total: 1s830ms, non-child: 286.905us, % non-child: 0.02%) - PeakMemoryUsage: 16.00 KB (16384) - RowsReturned: 1 (1) - RowsReturnedRate: 0 NonGroupingAggregator 0: ExecOption[0]: Codegen Enabled - BuildTime: 2.112us - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 1 (1) EXCHANGE_NODE (id=5):(Total: 1s829ms, non-child: 1s829ms, % non-child: 100.00%) - ConvertRowBatchTime: 14.352us - PeakMemoryUsage: 64.00 KB (65536) - RowsReturned: 6 (6) - RowsReturnedRate: 3.00 /sec Buffer pool: - AllocTime: 21.271us - CompressionTime: 0.000ns - CumulativeAllocationBytes: 96.00 KB (98304) - CumulativeAllocations: 12 (12) - EncryptionTime: 0.000ns - PeakReservation: 64.00 KB (65536) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 64.00 KB (65536) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 2.277us - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Dequeue: - FirstBatchWaitTime: 1s829ms - TotalBytesDequeued: 96.00 B (96) - TotalGetBatchTime: 1s829ms - DataWaitTime: 1s829ms Enqueue: - DispatchTime: 0.000ns ; Min: -89845.000ns ; Max: -33271.000ns ; Number of samples: 6) [0]- DispatchTime: -54515.000ns ; Min: -89845.000ns ; Max: -33271.000ns ; Number of samples: 6) - DeserializeRowBatchTime: 151.863us - TotalBatchesEnqueued: 6 (6) - TotalBatchesReceived: 6 (6) - TotalBytesReceived: 72.00 B (72) - TotalEarlySenders: 0 (0) - TotalEosReceived: 6 (6) - TotalHasDeferredRPCsTime: 0.000ns - TotalRPCsDeferred: 0 (0) Fragment F01 [6 instances]:(Total: 1s873ms, non-child: 81.263ms, % non-child: 4.34%) Instances: Instance 504b379400cba9f2:2d2cf00700000007 (host=tarmstrong-box2:22002), Instance 504b379400cba9f2:2d2cf00700000008 (host=tarmstrong-box2:22002), Instance 504b379400cba9f2:2d2cf00700000009 (host=tarmstrong-box2:22000), Instance 504b379400cba9f2:2d2cf0070000000a (host=tarmstrong-box2:22000), Instance 504b379400cba9f2:2d2cf0070000000b (host=tarmstrong-box2:22001), Instance 504b379400cba9f2:2d2cf0070000000c (host=tarmstrong-box2:22001) Last report received time[4-5]: 2020-04-23 18:04:35.259 Last report received time[0-1]: 2020-04-23 18:04:35.260 Last report received time[2-3]: 2020-04-23 18:04:35.293 - AverageThreadTokens: min=1.00 mean=1.00 max=1.00 [1.00, 1.00, 1.00, 1.00, 1.00, 1.00] - BytesAssigned: min=0 mean=0 max=0 [0, 0, 0, 0, 0, 0] - CompletionTime: min=1s877ms mean=1s888ms max=1s910ms [1s878ms, 1s878ms, 1s910ms, 1s910ms, 1s877ms, 1s877ms] - ExchangeScanRatio: min=0.00 mean=0.00 max=0.00 [0.00, 0.00, 0.00, 0.00, 0.00, 0.00] - ExecutionRate: min=0.00 /sec mean=0.00 /sec max=0.00 /sec [0.00 /sec, 0.00 /sec, 0.00 /sec, 0.00 /sec, 0.00 /sec, 0.00 /sec] - PeakMemoryUsage: min=2.84 MB (2983040) mean=2.98 MB (3122304) max=3.09 MB (3245184) [2.91 MB, 3.09 MB, 3.02 MB, 3.09 MB, 2.91 MB, 2.84 MB] - PeakReservation: min=2.69 MB (2818048) mean=2.82 MB (2960042) max=2.94 MB (3080192) [2.75 MB, 2.94 MB, 2.88 MB, 2.94 MB, 2.75 MB, 2.69 MB] - PeakUsedReservation: min=0 mean=0 max=0 [0, 0, 0, 0, 0, 0] - PerHostPeakMemUsage: min=72.72 MB (76248388) mean=73.96 MB (77555104) max=74.71 MB (78337348) [74.71 MB, 74.71 MB, 74.46 MB, 74.46 MB, 72.72 MB, 72.72 MB] - RowsProduced: min=1 (1) mean=1 (1) max=1 (1) [1, 1, 1, 1, 1, 1] - TotalNetworkReceiveTime: min=1s560ms mean=1s580ms max=1s595ms [1s593ms, 1s584ms, 1s581ms, 1s560ms, 1s567ms, 1s595ms] - TotalNetworkSendTime: min=360.717us mean=420.398us max=472.375us [443.870us, 472.375us, 360.717us, 389.516us, 415.981us, 439.929us] - TotalStorageWaitTime: min=0.000ns mean=0.000ns max=0.000ns [0.000ns, 0.000ns, 0.000ns, 0.000ns, 0.000ns, 0.000ns] - TotalThreadsInvoluntaryContextSwitches: min=141 (141) mean=183 (183) max=225 (225) [141, 161, 195, 180, 197, 225] - TotalThreadsTotalWallClockTime: min=1s869ms mean=1s872ms max=1s874ms [1s873ms, 1s873ms, 1s869ms, 1s869ms, 1s874ms, 1s874ms] - TotalThreadsSysTime: min=30.635ms mean=38.810ms max=49.443ms [42.009ms, 49.443ms, 32.909ms, 39.377ms, 38.487ms, 30.635ms] - TotalThreadsUserTime: min=133.117ms mean=181.885ms max=226.136ms [222.650ms, 133.117ms, 226.136ms, 141.759ms, 223.229ms, 144.423ms] - TotalThreadsVoluntaryContextSwitches: min=88 (88) mean=92 (92) max=97 (97) [92, 94, 95, 88, 89, 97] Fragment Instance Lifecycle Timings [6 instances]: - ExecTime: min=436.118us mean=504.612us max=558.385us [547.126us, 558.385us, 436.118us, 468.825us, 498.315us, 518.903us] - ExecTreeExecTime: min=7.592us mean=8.739us max=9.928us [9.928us, 8.959us, 8.816us, 8.844us, 7.592us, 8.299us] - OpenTime: min=1s869ms mean=1s872ms max=1s874ms [1s873ms, 1s873ms, 1s869ms, 1s869ms, 1s874ms, 1s874ms] - ExecTreeOpenTime: min=1s788ms mean=1s791ms max=1s792ms [1s791ms, 1s791ms, 1s788ms, 1s788ms, 1s792ms, 1s792ms] - PrepareTime: min=382.098us mean=392.968us max=418.378us [382.098us, 389.687us, 396.046us, 382.716us, 388.883us, 418.378us] - ExecTreePrepareTime: min=246.323us mean=257.593us max=272.969us [246.323us, 255.464us, 247.838us, 250.921us, 272.046us, 272.969us] KrpcDataStreamSender (dst_id=5) [6 instances]:(Total: 513.902us, non-child: 513.902us, % non-child: 100.00%) ExecOption[0-5]: Unpartitioned Sender Codegen Disabled: not needed - NetworkThroughput: 0.00 /sec ; Min: 24.83 KB/sec ; Max: 43.91 KB/sec ; Number of samples: 6) [0]- NetworkThroughput: 24.83 KB/sec ; Min: 24.83 KB/sec ; Max: 24.83 KB/sec ; Number of samples: 1) [1]- NetworkThroughput: 36.44 KB/sec ; Min: 36.44 KB/sec ; Max: 36.44 KB/sec ; Number of samples: 1) [2]- NetworkThroughput: 43.91 KB/sec ; Min: 43.91 KB/sec ; Max: 43.91 KB/sec ; Number of samples: 1) [3]- NetworkThroughput: 37.16 KB/sec ; Min: 37.16 KB/sec ; Max: 37.16 KB/sec ; Number of samples: 1) [4]- NetworkThroughput: 30.70 KB/sec ; Min: 30.70 KB/sec ; Max: 30.70 KB/sec ; Number of samples: 1) [5]- NetworkThroughput: 31.91 KB/sec ; Min: 31.91 KB/sec ; Max: 31.91 KB/sec ; Number of samples: 1) - RpcNetworkTime: 0.000ns ; Min: 224.696us ; Max: 471.896us ; Number of samples: 12) [0]- RpcNetworkTime: 374.362us ; Min: 276.828us ; Max: 471.896us ; Number of samples: 2) [1]- RpcNetworkTime: 314.589us ; Min: 307.571us ; Max: 321.608us ; Number of samples: 2) [2]- RpcNetworkTime: 250.251us ; Min: 233.644us ; Max: 266.858us ; Number of samples: 2) [3]- RpcNetworkTime: 270.013us ; Min: 224.696us ; Max: 315.331us ; Number of samples: 2) [4]- RpcNetworkTime: 331.256us ; Min: 280.840us ; Max: 381.672us ; Number of samples: 2) [5]- RpcNetworkTime: 302.924us ; Min: 238.637us ; Max: 367.211us ; Number of samples: 2) - RpcRecvrTime: 0.000ns ; Min: -135019.000ns ; Max: -31923.000ns ; Number of samples: 12) [0]- RpcRecvrTime: -86921.000ns ; Min: -135019.000ns ; Max: -38824.000ns ; Number of samples: 2) [1]- RpcRecvrTime: -62684.000ns ; Min: -79855.000ns ; Max: -45513.000ns ; Number of samples: 2) [2]- RpcRecvrTime: -45585.000ns ; Min: -58518.000ns ; Max: -32653.000ns ; Number of samples: 2) [3]- RpcRecvrTime: -50963.000ns ; Min: -64856.000ns ; Max: -37070.000ns ; Number of samples: 2) [4]- RpcRecvrTime: -72276.000ns ; Min: -109426.000ns ; Max: -35126.000ns ; Number of samples: 2) [5]- RpcRecvrTime: -56318.000ns ; Min: -80714.000ns ; Max: -31923.000ns ; Number of samples: 2) - EosSent: min=1 (1) mean=1 (1) max=1 (1) [1, 1, 1, 1, 1, 1] - PeakMemoryUsage: min=16.00 KB (16384) mean=16.00 KB (16384) max=16.00 KB (16384) [16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB] - RowsSent: min=1 (1) mean=1 (1) max=1 (1) [1, 1, 1, 1, 1, 1] - RpcFailure: min=0 (0) mean=0 (0) max=0 (0) [0, 0, 0, 0, 0, 0] - RpcRetry: min=0 (0) mean=0 (0) max=0 (0) [0, 0, 0, 0, 0, 0] - SerializeBatchTime: min=4.803us mean=8.620us max=12.294us [8.788us, 10.503us, 4.803us, 10.272us, 5.065us, 12.294us] - TotalBytesSent: min=12.00 B (12) mean=12.00 B (12) max=12.00 B (12) [12.00 B, 12.00 B, 12.00 B, 12.00 B, 12.00 B, 12.00 B] - UncompressedRowBatchSize: min=16.00 B (16) mean=16.00 B (16) max=16.00 B (16) [16.00 B, 16.00 B, 16.00 B, 16.00 B, 16.00 B, 16.00 B] AGGREGATION_NODE (id=2) [6 instances]:(Total: 1s791ms, non-child: 463.254us, % non-child: 0.03%) - PeakMemoryUsage: min=16.00 KB (16384) mean=16.00 KB (16384) max=16.00 KB (16384) [16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB] - RowsReturned: min=1 (1) mean=1 (1) max=1 (1) [1, 1, 1, 1, 1, 1] - RowsReturnedRate: min=0 mean=0 max=0 [0, 0, 0, 0, 0, 0] NonGroupingAggregator 0 [6 instances]: ExecOption[0-5]: Codegen Enabled - BuildTime: min=194.025us mean=196.364us max=198.820us [197.433us, 197.337us, 198.820us, 195.921us, 194.025us, 194.649us] - PeakMemoryUsage: min=8.00 KB (8192) mean=8.00 KB (8192) max=8.00 KB (8192) [8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB] - RowsReturned: min=1 (1) mean=1 (1) max=1 (1) [1, 1, 1, 1, 1, 1] AGGREGATION_NODE (id=4) [6 instances]:(Total: 1s791ms, non-child: 39.199ms, % non-child: 2.19%) - PeakMemoryUsage: min=2.71 MB (2839680) mean=2.84 MB (2981674) max=2.96 MB (3101824) [2.77 MB, 2.96 MB, 2.90 MB, 2.96 MB, 2.77 MB, 2.71 MB] - RowsReturned: min=33.17K (33166) mean=33.33K (33333) max=33.56K (33557) [33.17K, 33.44K, 33.56K, 33.47K, 33.17K, 33.20K] - RowsReturnedRate: min=18.50 K/sec mean=18.61 K/sec max=18.76 K/sec [18.51 K/sec, 18.66 K/sec, 18.76 K/sec, 18.71 K/sec, 18.50 K/sec, 18.52 K/sec] GroupingAggregator 0 [6 instances]: ExecOption[0-5]: Codegen Enabled - BuildTime: min=22.714ms mean=28.467ms max=34.958ms [22.714ms, 27.279ms, 26.315ms, 34.958ms, 34.591ms, 24.947ms] - GetResultsTime: min=7.699ms mean=7.758ms max=7.846ms [7.709ms, 7.846ms, 7.795ms, 7.784ms, 7.699ms, 7.714ms] - HTResizeTime: min=4.276ms mean=5.266ms max=6.632ms [4.460ms, 5.835ms, 5.875ms, 4.520ms, 6.632ms, 4.276ms] - LargestPartitionPercent: min=1 (1) mean=1 (1) max=1 (1) [1, 1, 1, 1, 1, 1] - MaxPartitionLevel: min=0 (0) mean=0 (0) max=0 (0) [0, 0, 0, 0, 0, 0] - NumRepartitions: min=0 (0) mean=0 (0) max=0 (0) [0, 0, 0, 0, 0, 0] - PartitionsCreated: min=16 (16) mean=16 (16) max=16 (16) [16, 16, 16, 16, 16, 16] - PeakMemoryUsage: min=2.70 MB (2831488) mean=2.84 MB (2973482) max=2.95 MB (3093632) [2.76 MB, 2.95 MB, 2.89 MB, 2.95 MB, 2.76 MB, 2.70 MB] - PeakReservation: min=2.69 MB (2818048) mean=2.82 MB (2960042) max=2.94 MB (3080192) [2.75 MB, 2.94 MB, 2.88 MB, 2.94 MB, 2.75 MB, 2.69 MB] - PeakUsedReservation: min=0 mean=0 max=0 [0, 0, 0, 0, 0, 0] - RowsRepartitioned: min=0 (0) mean=0 (0) max=0 (0) [0, 0, 0, 0, 0, 0] - RowsReturned: min=33.17K (33166) mean=33.33K (33333) max=33.56K (33557) [33.17K, 33.44K, 33.56K, 33.47K, 33.17K, 33.20K] - SpilledPartitions: min=0 (0) mean=0 (0) max=0 (0) [0, 0, 0, 0, 0, 0] Buffer pool [6 instances]: - AllocTime: min=153.845us mean=227.828us max=278.957us [278.957us, 264.819us, 210.517us, 153.845us, 238.282us, 220.549us] - CompressionTime: min=0.000ns mean=0.000ns max=0.000ns [0.000ns, 0.000ns, 0.000ns, 0.000ns, 0.000ns, 0.000ns] - CumulativeAllocationBytes: min=3.81 MB (3997696) mean=4.08 MB (4281685) max=4.31 MB (4521984) [3.94 MB, 4.31 MB, 4.19 MB, 4.31 MB, 3.94 MB, 3.81 MB] - CumulativeAllocations: min=51 (51) mean=53 (53) max=55 (55) [52, 55, 54, 55, 52, 51] - EncryptionTime: min=0.000ns mean=0.000ns max=0.000ns [0.000ns, 0.000ns, 0.000ns, 0.000ns, 0.000ns, 0.000ns] - PeakReservation: min=2.69 MB (2818048) mean=2.82 MB (2960042) max=2.94 MB (3080192) [2.75 MB, 2.94 MB, 2.88 MB, 2.94 MB, 2.75 MB, 2.69 MB] - PeakUnpinnedBytes: min=0 mean=0 max=0 [0, 0, 0, 0, 0, 0] - PeakUsedReservation: min=2.69 MB (2818048) mean=2.82 MB (2960042) max=2.94 MB (3080192) [2.75 MB, 2.94 MB, 2.88 MB, 2.94 MB, 2.75 MB, 2.69 MB] - ReadIoBytes: min=0 mean=0 max=0 [0, 0, 0, 0, 0, 0] - ReadIoOps: min=0 (0) mean=0 (0) max=0 (0) [0, 0, 0, 0, 0, 0] - ReadIoWaitTime: min=0.000ns mean=0.000ns max=0.000ns [0.000ns, 0.000ns, 0.000ns, 0.000ns, 0.000ns, 0.000ns] - SystemAllocTime: min=13.247us mean=109.758us max=190.786us [190.786us, 162.268us, 23.863us, 13.247us, 140.152us, 128.235us] - WriteIoBytes: min=0 mean=0 max=0 [0, 0, 0, 0, 0, 0] - WriteIoOps: min=0 (0) mean=0 (0) max=0 (0) [0, 0, 0, 0, 0, 0] - WriteIoWaitTime: min=0.000ns mean=0.000ns max=0.000ns [0.000ns, 0.000ns, 0.000ns, 0.000ns, 0.000ns, 0.000ns] Hash Table [6 instances]: - HashBuckets: min=106.50K (106496) mean=115.37K (115370) max=122.88K (122880) [110.59K, 122.88K, 118.78K, 122.88K, 110.59K, 106.50K] - HashCollisions: min=0 (0) mean=0 (0) max=0 (0) [0, 0, 0, 0, 0, 0] - Probes: min=232.64K (232636) mean=240.83K (240827) max=247.68K (247676) [236.13K, 247.11K, 244.58K, 247.68K, 236.83K, 232.64K] - Resizes: min=42 (42) mean=44 (44) max=46 (46) [43, 46, 45, 46, 43, 42] - Travel: min=40.78K (40778) mean=43.56K (43565) max=45.77K (45771) [44.78K, 42.55K, 40.78K, 42.84K, 45.77K, 44.67K] EXCHANGE_NODE (id=3) [6 instances]:(Total: 1s751ms, non-child: 1s751ms, % non-child: 100.00%) - ConvertRowBatchTime: min=159.101ms mean=170.192ms max=181.260ms [164.141ms, 168.685ms, 168.772ms, 181.260ms, 179.195ms, 159.101ms] - PeakMemoryUsage: min=96.00 KB (98304) mean=109.33 KB (111957) max=112.00 KB (114688) [112.00 KB, 112.00 KB, 96.00 KB, 112.00 KB, 112.00 KB, 112.00 KB] - RowsReturned: min=196.88K (196879) mean=197.95K (197953) max=199.34K (199337) [196.88K, 198.57K, 199.34K, 198.81K, 197.03K, 197.10K] - RowsReturnedRate: min=111.97 K/sec mean=113.00 K/sec max=114.06 K/sec [111.97 K/sec, 113.23 K/sec, 113.81 K/sec, 114.06 K/sec, 112.76 K/sec, 112.16 K/sec] Buffer pool [6 instances]: - AllocTime: min=416.095us mean=440.116us max=477.376us [448.266us, 452.649us, 477.376us, 416.095us, 425.598us, 420.715us] - CompressionTime: min=0.000ns mean=0.000ns max=0.000ns [0.000ns, 0.000ns, 0.000ns, 0.000ns, 0.000ns, 0.000ns] - CumulativeAllocationBytes: min=3.45 MB (3612672) mean=3.45 MB (3618133) max=3.45 MB (3620864) [3.45 MB, 3.45 MB, 3.45 MB, 3.45 MB, 3.45 MB, 3.45 MB] - CumulativeAllocations: min=226 (226) mean=226 (226) max=226 (226) [226, 226, 226, 226, 226, 226] - EncryptionTime: min=0.000ns mean=0.000ns max=0.000ns [0.000ns, 0.000ns, 0.000ns, 0.000ns, 0.000ns, 0.000ns] - PeakReservation: min=96.00 KB (98304) mean=109.33 KB (111957) max=112.00 KB (114688) [112.00 KB, 112.00 KB, 96.00 KB, 112.00 KB, 112.00 KB, 112.00 KB] - PeakUnpinnedBytes: min=0 mean=0 max=0 [0, 0, 0, 0, 0, 0] - PeakUsedReservation: min=96.00 KB (98304) mean=109.33 KB (111957) max=112.00 KB (114688) [112.00 KB, 112.00 KB, 96.00 KB, 112.00 KB, 112.00 KB, 112.00 KB] - ReadIoBytes: min=0 mean=0 max=0 [0, 0, 0, 0, 0, 0] - ReadIoOps: min=0 (0) mean=0 (0) max=0 (0) [0, 0, 0, 0, 0, 0] - ReadIoWaitTime: min=0.000ns mean=0.000ns max=0.000ns [0.000ns, 0.000ns, 0.000ns, 0.000ns, 0.000ns, 0.000ns] - SystemAllocTime: min=6.195us mean=25.399us max=55.813us [55.813us, 35.036us, 8.045us, 30.795us, 6.195us, 16.510us] - WriteIoBytes: min=0 mean=0 max=0 [0, 0, 0, 0, 0, 0] - WriteIoOps: min=0 (0) mean=0 (0) max=0 (0) [0, 0, 0, 0, 0, 0] - WriteIoWaitTime: min=0.000ns mean=0.000ns max=0.000ns [0.000ns, 0.000ns, 0.000ns, 0.000ns, 0.000ns, 0.000ns] Dequeue [6 instances]: - FirstBatchWaitTime: min=770.449ms mean=773.736ms max=778.966ms [773.434ms, 774.405ms, 770.449ms, 770.987ms, 774.174ms, 778.966ms] - TotalBytesDequeued: min=3.19 MB (3346943) mean=3.21 MB (3365203) max=3.23 MB (3388729) [3.19 MB, 3.22 MB, 3.23 MB, 3.22 MB, 3.19 MB, 3.20 MB] - TotalGetBatchTime: min=1s560ms mean=1s580ms max=1s595ms [1s593ms, 1s583ms, 1s581ms, 1s560ms, 1s566ms, 1s595ms] - DataWaitTime: min=1s559ms mean=1s579ms max=1s594ms [1s592ms, 1s583ms, 1s580ms, 1s559ms, 1s565ms, 1s594ms] Enqueue [6 instances]: - DispatchTime: 0.000ns ; Min: -981524.000ns ; Max: -27897.000ns ; Number of samples: 678) [0]- DispatchTime: -54088.000ns ; Min: -349542.000ns ; Max: -27897.000ns ; Number of samples: 113) [1]- DispatchTime: -57175.000ns ; Min: -605977.000ns ; Max: -29040.000ns ; Number of samples: 113) [2]- DispatchTime: -59276.000ns ; Min: -704497.000ns ; Max: -30073.000ns ; Number of samples: 113) [3]- DispatchTime: -59807.000ns ; Min: -981524.000ns ; Max: -29143.000ns ; Number of samples: 113) [4]- DispatchTime: -56188.000ns ; Min: -294321.000ns ; Max: -31746.000ns ; Number of samples: 113) [5]- DispatchTime: -46071.000ns ; Min: -83436.000ns ; Max: -28664.000ns ; Number of samples: 113) - DeserializeRowBatchTime: min=3.918ms mean=4.031ms max=4.143ms [4.041ms, 4.008ms, 4.045ms, 3.918ms, 4.033ms, 4.143ms] - TotalBatchesEnqueued: min=113 (113) mean=113 (113) max=113 (113) [113, 113, 113, 113, 113, 113] - TotalBatchesReceived: min=113 (113) mean=113 (113) max=113 (113) [113, 113, 113, 113, 113, 113] - TotalBytesReceived: min=1.60 MB (1674805) mean=1.61 MB (1685340) max=1.62 MB (1701620) [1.60 MB, 1.61 MB, 1.62 MB, 1.61 MB, 1.60 MB, 1.60 MB] - TotalEarlySenders: min=0 (0) mean=0 (0) max=0 (0) [0, 0, 0, 0, 0, 0] - TotalEosReceived: min=6 (6) mean=6 (6) max=6 (6) [6, 6, 6, 6, 6, 6] - TotalHasDeferredRPCsTime: min=0.000ns mean=0.000ns max=0.000ns [0.000ns, 0.000ns, 0.000ns, 0.000ns, 0.000ns, 0.000ns] - TotalRPCsDeferred: min=0 (0) mean=0 (0) max=0 (0) [0, 0, 0, 0, 0, 0] Fragment F00 [6 instances]:(Total: 1s619ms, non-child: 114.849ms, % non-child: 7.09%) Instances: Instance 504b379400cba9f2:2d2cf00700000001 (host=tarmstrong-box2:22002), Instance 504b379400cba9f2:2d2cf00700000002 (host=tarmstrong-box2:22002), Instance 504b379400cba9f2:2d2cf00700000003 (host=tarmstrong-box2:22000), Instance 504b379400cba9f2:2d2cf00700000004 (host=tarmstrong-box2:22000), Instance 504b379400cba9f2:2d2cf00700000005 (host=tarmstrong-box2:22001), Instance 504b379400cba9f2:2d2cf00700000006 (host=tarmstrong-box2:22001) Hdfs split stats (<volume id>:<# splits>/<split lengths>)[0-4]: -1:1/128.00 MB Hdfs split stats (<volume id>:<# splits>/<split lengths>)[5]: -1:1/78.94 MB Last report received time[1,4-5]: 2020-04-23 18:04:35.260 Last report received time[0]: 2020-04-23 18:04:35.261 Last report received time[2-3]: 2020-04-23 18:04:35.293 - AverageThreadTokens: min=1.00 mean=1.00 max=1.00 [1.00, 1.00, 1.00, 1.00, 1.00, 1.00] - BytesAssigned: min=78.94 MB (82773432) mean=119.82 MB (125643678) max=128.00 MB (134217728) [128.00 MB, 128.00 MB, 128.00 MB, 128.00 MB, 128.00 MB, 78.94 MB] - CompletionTime: min=1s877ms mean=1s889ms max=1s911ms [1s878ms, 1s878ms, 1s911ms, 1s910ms, 1s878ms, 1s877ms] - ExchangeScanRatio: min=0.01 mean=0.01 max=0.02 [0.01, 0.01, 0.01, 0.01, 0.01, 0.02] - ExecutionRate: min=42.04 MB/sec mean=63.40 MB/sec max=68.15 MB/sec [68.13 MB/sec, 68.14 MB/sec, 66.98 MB/sec, 66.98 MB/sec, 68.15 MB/sec, 42.04 MB/sec] - PeakMemoryUsage: min=34.37 MB (36044224) mean=34.38 MB (36053440) max=34.39 MB (36062656) [34.37 MB, 34.39 MB, 34.37 MB, 34.39 MB, 34.39 MB, 34.37 MB] - PeakReservation: min=34.25 MB (35913728) mean=34.25 MB (35913728) max=34.25 MB (35913728) [34.25 MB, 34.25 MB, 34.25 MB, 34.25 MB, 34.25 MB, 34.25 MB] - PeakUsedReservation: min=0 mean=0 max=0 [0, 0, 0, 0, 0, 0] - PerHostPeakMemUsage: min=72.72 MB (76248388) mean=73.96 MB (77555104) max=74.71 MB (78337348) [74.71 MB, 74.71 MB, 74.46 MB, 74.46 MB, 72.72 MB, 72.72 MB] - RowsProduced: min=192.58K (192584) mean=197.95K (197953) max=199.09K (199087) [199.09K, 198.98K, 199.00K, 199.05K, 199.02K, 192.58K] - TotalNetworkReceiveTime: min=0.000ns mean=0.000ns max=0.000ns [0.000ns, 0.000ns, 0.000ns, 0.000ns, 0.000ns, 0.000ns] - TotalNetworkSendTime: min=482.701us mean=2.336ms max=9.238ms [9.238ms, 482.701us, 1.262ms, 802.944us, 623.040us, 1.608ms] - TotalStorageWaitTime: min=2.727ms mean=3.395ms max=3.927ms [3.927ms, 3.780ms, 3.653ms, 3.193ms, 3.087ms, 2.727ms] - TotalThreadsInvoluntaryContextSwitches: min=33 (33) mean=52 (52) max=88 (88) [47, 52, 39, 33, 88, 54] - TotalThreadsTotalWallClockTime: min=1s105ms mean=1s619ms max=1s874ms [1s874ms, 1s838ms, 1s706ms, 1s699ms, 1s491ms, 1s105ms] - TotalThreadsSysTime: min=23.896ms mean=29.296ms max=40.056ms [23.978ms, 28.001ms, 31.957ms, 40.056ms, 23.896ms, 27.890ms] - TotalThreadsUserTime: min=948.277ms mean=1s518ms max=1s834ms [1s834ms, 1s676ms, 1s665ms, 1s546ms, 1s441ms, 948.277ms] - TotalThreadsVoluntaryContextSwitches: min=6 (6) mean=8 (8) max=11 (11) [6, 7, 7, 11, 11, 7] Fragment Instance Lifecycle Timings [6 instances]: - ExecTime: min=992.832ms mean=1s504ms max=1s743ms [1s743ms, 1s708ms, 1s605ms, 1s598ms, 1s378ms, 992.832ms] - ExecTreeExecTime: min=766.479ms mean=1s282ms max=1s512ms [1s512ms, 1s484ms, 1s381ms, 1s380ms, 1s166ms, 766.479ms] - OpenTime: min=100.735ms mean=114.829ms max=130.766ms [130.766ms, 130.708ms, 100.735ms, 100.827ms, 112.990ms, 112.947ms] - ExecTreeOpenTime: min=640.167us mean=837.661us max=1.052ms [640.167us, 650.940us, 708.278us, 921.784us, 1.052ms, 1.052ms] - PrepareTime: min=292.926us mean=362.130us max=422.624us [385.489us, 339.631us, 292.926us, 358.690us, 422.624us, 373.422us] - ExecTreePrepareTime: min=140.097us mean=176.132us max=230.405us [176.816us, 165.903us, 140.097us, 168.614us, 230.405us, 174.958us] KrpcDataStreamSender (dst_id=3) [6 instances]:(Total: 222.034ms, non-child: 222.034ms, % non-child: 100.00%) ExecOption[0-5]: Hash Partitioned Sender Codegen Enabled - NetworkThroughput: 0.00 /sec ; Min: 1.86 MB/sec ; Max: 68.12 MB/sec ; Number of samples: 678) [0]- NetworkThroughput: 44.33 MB/sec ; Min: 6.57 MB/sec ; Max: 65.90 MB/sec ; Number of samples: 114) [1]- NetworkThroughput: 43.38 MB/sec ; Min: 5.96 MB/sec ; Max: 68.12 MB/sec ; Number of samples: 114) [2]- NetworkThroughput: 39.41 MB/sec ; Min: 5.34 MB/sec ; Max: 60.78 MB/sec ; Number of samples: 114) [3]- NetworkThroughput: 39.63 MB/sec ; Min: 6.66 MB/sec ; Max: 65.74 MB/sec ; Number of samples: 114) [4]- NetworkThroughput: 39.06 MB/sec ; Min: 6.10 MB/sec ; Max: 53.82 MB/sec ; Number of samples: 114) [5]- NetworkThroughput: 29.39 MB/sec ; Min: 1.86 MB/sec ; Max: 55.56 MB/sec ; Number of samples: 108) - RpcNetworkTime: 0.000ns ; Min: 196.891us ; Max: 7.910ms ; Number of samples: 714) [0]- RpcNetworkTime: 331.390us ; Min: 222.907us ; Max: 677.381us ; Number of samples: 120) [1]- RpcNetworkTime: 342.901us ; Min: 215.521us ; Max: 949.874us ; Number of samples: 120) [2]- RpcNetworkTime: 390.436us ; Min: 196.891us ; Max: 989.350us ; Number of samples: 120) [3]- RpcNetworkTime: 393.221us ; Min: 223.385us ; Max: 2.204ms ; Number of samples: 120) [4]- RpcNetworkTime: 420.046us ; Min: 270.223us ; Max: 1.783ms ; Number of samples: 120) [5]- RpcNetworkTime: 1.073ms ; Min: 275.558us ; Max: 7.910ms ; Number of samples: 114) - RpcRecvrTime: 0.000ns ; Min: -1031876.000ns ; Max: -32196.000ns ; Number of samples: 714) [0]- RpcRecvrTime: -85355.000ns ; Min: -222700.000ns ; Max: -38096.000ns ; Number of samples: 120) [1]- RpcRecvrTime: -92224.000ns ; Min: -400350.000ns ; Max: -36559.000ns ; Number of samples: 120) [2]- RpcRecvrTime: -96477.000ns ; Min: -333316.000ns ; Max: -32196.000ns ; Number of samples: 120) [3]- RpcRecvrTime: -108890.000ns ; Min: -1031876.000ns ; Max: -33807.000ns ; Number of samples: 120) [4]- RpcRecvrTime: -94734.000ns ; Min: -177983.000ns ; Max: -38898.000ns ; Number of samples: 120) [5]- RpcRecvrTime: -110937.000ns ; Min: -764999.000ns ; Max: -35717.000ns ; Number of samples: 114) - EosSent: min=6 (6) mean=6 (6) max=6 (6) [6, 6, 6, 6, 6, 6] - PeakMemoryUsage: min=357.31 KB (365888) mean=362.65 KB (371349) max=389.31 KB (398656) [357.31 KB, 357.31 KB, 357.31 KB, 357.31 KB, 357.31 KB, 389.31 KB] - RowsSent: min=192.58K (192584) mean=197.95K (197953) max=199.09K (199087) [199.09K, 198.98K, 199.00K, 199.05K, 199.02K, 192.58K] - RpcFailure: min=0 (0) mean=0 (0) max=0 (0) [0, 0, 0, 0, 0, 0] - RpcRetry: min=0 (0) mean=0 (0) max=0 (0) [0, 0, 0, 0, 0, 0] - SerializeBatchTime: min=50.876ms mean=55.662ms max=60.309ms [53.162ms, 50.876ms, 56.581ms, 57.064ms, 55.979ms, 60.309ms] - TotalBytesSent: min=1.56 MB (1639649) mean=1.61 MB (1685340) max=1.62 MB (1698179) [1.62 MB, 1.61 MB, 1.62 MB, 1.62 MB, 1.61 MB, 1.56 MB] - UncompressedRowBatchSize: min=3.12 MB (3273928) mean=3.21 MB (3365203) max=3.23 MB (3384479) [3.23 MB, 3.23 MB, 3.23 MB, 3.23 MB, 3.23 MB, 3.12 MB] AGGREGATION_NODE (id=1) [6 instances]:(Total: 1s282ms, non-child: 203.594ms, % non-child: 15.87%) - PeakMemoryUsage: min=10.28 MB (10778752) mean=10.29 MB (10787968) max=10.30 MB (10797184) [10.28 MB, 10.30 MB, 10.28 MB, 10.30 MB, 10.30 MB, 10.28 MB] - RowsReturned: min=192.58K (192584) mean=197.95K (197953) max=199.09K (199087) [199.09K, 198.98K, 199.00K, 199.05K, 199.02K, 192.58K] - RowsReturnedRate: min=131.59 K/sec mean=162.49 K/sec max=250.92 K/sec [131.59 K/sec, 133.94 K/sec, 143.93 K/sec, 144.14 K/sec, 170.40 K/sec, 250.92 K/sec] GroupingAggregator 0 [6 instances]: ExecOption[0-5]: Streaming Preaggregation, Codegen Enabled - BuildTime: min=0.000ns mean=0.000ns max=0.000ns [0.000ns, 0.000ns, 0.000ns, 0.000ns, 0.000ns, 0.000ns] - GetResultsTime: min=31.082ms mean=34.777ms max=38.423ms [37.053ms, 38.423ms, 35.927ms, 33.538ms, 31.082ms, 32.641ms] - HTResizeTime: min=17.354ms mean=19.409ms max=23.064ms [23.064ms, 17.354ms, 19.113ms, 19.140ms, 17.673ms, 20.110ms] - LargestPartitionPercent: min=1 (1) mean=1 (1) max=1 (1) [1, 1, 1, 1, 1, 1] - PartitionsCreated: min=16 (16) mean=16 (16) max=16 (16) [16, 16, 16, 16, 16, 16] - PeakMemoryUsage: min=10.26 MB (10761344) mean=10.26 MB (10761344) max=10.26 MB (10761344) [10.26 MB, 10.26 MB, 10.26 MB, 10.26 MB, 10.26 MB, 10.26 MB] - PeakReservation: min=10.25 MB (10747904) mean=10.25 MB (10747904) max=10.25 MB (10747904) [10.25 MB, 10.25 MB, 10.25 MB, 10.25 MB, 10.25 MB, 10.25 MB] - PeakUsedReservation: min=0 mean=0 max=0 [0, 0, 0, 0, 0, 0] - ReductionFactorEstimate: min=20.16 mean=20.33 max=20.51 [20.41, 20.16, 20.39, 20.51, 20.23, 20.25] - ReductionFactorThresholdToExpand: min=2.00 mean=2.00 max=2.00 [2.00, 2.00, 2.00, 2.00, 2.00, 2.00] - RowsPassedThrough: min=0 (0) mean=0 (0) max=0 (0) [0, 0, 0, 0, 0, 0] - RowsReturned: min=192.58K (192584) mean=197.95K (197953) max=199.09K (199087) [199.09K, 198.98K, 199.00K, 199.05K, 199.02K, 192.58K] - StreamingTime: min=113.140ms mean=162.549ms max=188.721ms [188.721ms, 180.603ms, 172.983ms, 170.604ms, 149.245ms, 113.140ms] Buffer pool [6 instances]: - AllocTime: min=128.443us mean=282.498us max=423.136us [423.136us, 128.443us, 218.489us, 235.987us, 280.520us, 408.417us] - CompressionTime: min=0.000ns mean=0.000ns max=0.000ns [0.000ns, 0.000ns, 0.000ns, 0.000ns, 0.000ns, 0.000ns] - CumulativeAllocationBytes: min=17.12 MB (17956864) mean=17.12 MB (17956864) max=17.12 MB (17956864) [17.12 MB, 17.12 MB, 17.12 MB, 17.12 MB, 17.12 MB, 17.12 MB] - CumulativeAllocations: min=73 (73) mean=73 (73) max=73 (73) [73, 73, 73, 73, 73, 73] - EncryptionTime: min=0.000ns mean=0.000ns max=0.000ns [0.000ns, 0.000ns, 0.000ns, 0.000ns, 0.000ns, 0.000ns] - PeakReservation: min=10.25 MB (10747904) mean=10.25 MB (10747904) max=10.25 MB (10747904) [10.25 MB, 10.25 MB, 10.25 MB, 10.25 MB, 10.25 MB, 10.25 MB] - PeakUnpinnedBytes: min=0 mean=0 max=0 [0, 0, 0, 0, 0, 0] - PeakUsedReservation: min=10.25 MB (10747904) mean=10.25 MB (10747904) max=10.25 MB (10747904) [10.25 MB, 10.25 MB, 10.25 MB, 10.25 MB, 10.25 MB, 10.25 MB] - ReadIoBytes: min=0 mean=0 max=0 [0, 0, 0, 0, 0, 0] - ReadIoOps: min=0 (0) mean=0 (0) max=0 (0) [0, 0, 0, 0, 0, 0] - ReadIoWaitTime: min=0.000ns mean=0.000ns max=0.000ns [0.000ns, 0.000ns, 0.000ns, 0.000ns, 0.000ns, 0.000ns] - SystemAllocTime: min=0.000ns mean=186.488us max=339.716us [339.716us, 0.000ns, 121.305us, 145.242us, 186.302us, 326.366us] - WriteIoBytes: min=0 mean=0 max=0 [0, 0, 0, 0, 0, 0] - WriteIoOps: min=0 (0) mean=0 (0) max=0 (0) [0, 0, 0, 0, 0, 0] - WriteIoWaitTime: min=0.000ns mean=0.000ns max=0.000ns [0.000ns, 0.000ns, 0.000ns, 0.000ns, 0.000ns, 0.000ns] Hash Table [6 instances]: - HashBuckets: min=524.29K (524288) mean=524.29K (524288) max=524.29K (524288) [524.29K, 524.29K, 524.29K, 524.29K, 524.29K, 524.29K] - HashCollisions: min=0 (0) mean=0 (0) max=0 (0) [0, 0, 0, 0, 0, 0] - Probes: min=962.44K (962442) mean=1.30M (1304626) max=1.38M (1380017) [1.38M, 1.37M, 1.37M, 1.37M, 1.37M, 962.44K] - Resizes: min=80 (80) mean=80 (80) max=80 (80) [80, 80, 80, 80, 80, 80] - Travel: min=42.84K (42845) mean=43.35K (43350) max=43.85K (43855) [43.26K, 43.17K, 43.52K, 42.84K, 43.45K, 43.85K] HDFS_SCAN_NODE (id=0) [6 instances]:(Total: 1s079ms, non-child: 1s079ms, % non-child: 100.00%) ExecOption[0-5]: TEXT Codegen Enabled, Codegen enabled: 1 out of 1 File Formats[0-5]: TEXT/NONE:1 Hdfs Read Thread Concurrency Bucket[0-5]: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% Hdfs split stats (<volume id>:<# splits>/<split lengths>)[0-4]: -1:1/128.00 MB Hdfs split stats (<volume id>:<# splits>/<split lengths>)[5]: -1:1/78.94 MB Table Name[0-5]: tpch.lineitem - InitialRangeActualReservation: 0 ; Min: 24.00 MB (25165824) ; Max: 24.00 MB (25165824) ; Number of samples: 6) [0]- InitialRangeActualReservation: 24.00 MB (25165824) ; Min: 24.00 MB (25165824) ; Max: 24.00 MB (25165824) ; Number of samples: 1) [1]- InitialRangeActualReservation: 24.00 MB (25165824) ; Min: 24.00 MB (25165824) ; Max: 24.00 MB (25165824) ; Number of samples: 1) [2]- InitialRangeActualReservation: 24.00 MB (25165824) ; Min: 24.00 MB (25165824) ; Max: 24.00 MB (25165824) ; Number of samples: 1) [3]- InitialRangeActualReservation: 24.00 MB (25165824) ; Min: 24.00 MB (25165824) ; Max: 24.00 MB (25165824) ; Number of samples: 1) [4]- InitialRangeActualReservation: 24.00 MB (25165824) ; Min: 24.00 MB (25165824) ; Max: 24.00 MB (25165824) ; Number of samples: 1) [5]- InitialRangeActualReservation: 24.00 MB (25165824) ; Min: 24.00 MB (25165824) ; Max: 24.00 MB (25165824) ; Number of samples: 1) - InitialRangeIdealReservation: 0 ; Min: 24.00 MB (25165824) ; Max: 24.00 MB (25165824) ; Number of samples: 6) [0]- InitialRangeIdealReservation: 24.00 MB (25165824) ; Min: 24.00 MB (25165824) ; Max: 24.00 MB (25165824) ; Number of samples: 1) [1]- InitialRangeIdealReservation: 24.00 MB (25165824) ; Min: 24.00 MB (25165824) ; Max: 24.00 MB (25165824) ; Number of samples: 1) [2]- InitialRangeIdealReservation: 24.00 MB (25165824) ; Min: 24.00 MB (25165824) ; Max: 24.00 MB (25165824) ; Number of samples: 1) [3]- InitialRangeIdealReservation: 24.00 MB (25165824) ; Min: 24.00 MB (25165824) ; Max: 24.00 MB (25165824) ; Number of samples: 1) [4]- InitialRangeIdealReservation: 24.00 MB (25165824) ; Min: 24.00 MB (25165824) ; Max: 24.00 MB (25165824) ; Number of samples: 1) [5]- InitialRangeIdealReservation: 24.00 MB (25165824) ; Min: 24.00 MB (25165824) ; Max: 24.00 MB (25165824) ; Number of samples: 1) - ParquetCompressedBytesReadPerColumn: 0 (Number of samples: 0) [0]- ParquetCompressedBytesReadPerColumn: 0 (Number of samples: 0) [1]- ParquetCompressedBytesReadPerColumn: 0 (Number of samples: 0) [2]- ParquetCompressedBytesReadPerColumn: 0 (Number of samples: 0) [3]- ParquetCompressedBytesReadPerColumn: 0 (Number of samples: 0) [4]- ParquetCompressedBytesReadPerColumn: 0 (Number of samples: 0) [5]- ParquetCompressedBytesReadPerColumn: 0 (Number of samples: 0) - ParquetUncompressedBytesReadPerColumn: 0 (Number of samples: 0) [0]- ParquetUncompressedBytesReadPerColumn: 0 (Number of samples: 0) [1]- ParquetUncompressedBytesReadPerColumn: 0 (Number of samples: 0) [2]- ParquetUncompressedBytesReadPerColumn: 0 (Number of samples: 0) [3]- ParquetUncompressedBytesReadPerColumn: 0 (Number of samples: 0) [4]- ParquetUncompressedBytesReadPerColumn: 0 (Number of samples: 0) [5]- ParquetUncompressedBytesReadPerColumn: 0 (Number of samples: 0) - AverageHdfsReadThreadConcurrency: min=0.00 mean=0.00 max=0.00 [0.00, 0.00, 0.00, 0.00, 0.00, 0.00] - BytesRead: min=78.94 MB (82773432) mean=119.88 MB (125698292) max=128.06 MB (134283264) [128.06 MB, 128.06 MB, 128.06 MB, 128.06 MB, 128.06 MB, 78.94 MB] - BytesReadDataNodeCache: min=0 mean=0 max=0 [0, 0, 0, 0, 0, 0] - BytesReadLocal: min=78.94 MB (82773432) mean=119.88 MB (125698292) max=128.06 MB (134283264) [128.06 MB, 128.06 MB, 128.06 MB, 128.06 MB, 128.06 MB, 78.94 MB] - BytesReadRemoteUnexpected: min=0 mean=0 max=0 [0, 0, 0, 0, 0, 0] - BytesReadShortCircuit: min=78.94 MB (82773432) mean=119.88 MB (125698292) max=128.06 MB (134283264) [128.06 MB, 128.06 MB, 128.06 MB, 128.06 MB, 128.06 MB, 78.94 MB] - CachedFileHandlesHitCount: min=10 (10) mean=15 (15) max=17 (17) [17, 17, 17, 17, 17, 10] - CachedFileHandlesMissCount: min=0 (0) mean=0 (0) max=0 (0) [0, 0, 0, 0, 0, 0] - CollectionItemsRead: min=0 (0) mean=0 (0) max=0 (0) [0, 0, 0, 0, 0, 0] - DataCacheHitBytes: min=0 mean=0 max=0 [0, 0, 0, 0, 0, 0] - DataCacheHitCount: min=0 (0) mean=0 (0) max=0 (0) [0, 0, 0, 0, 0, 0] - DataCacheMissBytes: min=0 mean=0 max=0 [0, 0, 0, 0, 0, 0] - DataCacheMissCount: min=0 (0) mean=0 (0) max=0 (0) [0, 0, 0, 0, 0, 0] - DataCachePartialHitCount: min=0 (0) mean=0 (0) max=0 (0) [0, 0, 0, 0, 0, 0] - DecompressionTime: min=0.000ns mean=0.000ns max=0.000ns [0.000ns, 0.000ns, 0.000ns, 0.000ns, 0.000ns, 0.000ns] - DelimiterParseTime: min=577.615ms mean=1s013ms max=1s205ms [1s205ms, 1s186ms, 1s097ms, 1s099ms, 916.889ms, 577.615ms] - MaterializeTupleTime: min=31.473ms mean=53.338ms max=62.763ms [62.763ms, 61.070ms, 58.038ms, 57.239ms, 49.443ms, 31.473ms] - MaxCompressedTextFileLength: min=0 mean=0 max=0 [0, 0, 0, 0, 0, 0] - NumDisksAccessed: min=1 (1) mean=1 (1) max=1 (1) [1, 1, 1, 1, 1, 1] - PeakMemoryUsage: min=24.00 MB (25169920) mean=24.00 MB (25169920) max=24.00 MB (25169920) [24.00 MB, 24.00 MB, 24.00 MB, 24.00 MB, 24.00 MB, 24.00 MB] - PerReadThreadRawHdfsThroughput: min=3.47 GB/sec mean=3.55 GB/sec max=3.62 GB/sec [3.55 GB/sec, 3.47 GB/sec, 3.62 GB/sec, 3.53 GB/sec, 3.55 GB/sec, 3.55 GB/sec] - RemoteScanRanges: min=0 (0) mean=0 (0) max=0 (0) [0, 0, 0, 0, 0, 0] - RowsRead: min=657.97K (657972) mean=1.00M (1000202) max=1.08M (1075655) [1.08M, 1.07M, 1.07M, 1.07M, 1.07M, 657.97K] - RowsReturned: min=657.97K (657972) mean=1.00M (1000202) max=1.08M (1075655) [1.08M, 1.07M, 1.07M, 1.07M, 1.07M, 657.97K] - RowsReturnedRate: min=839.98 K/sec mean=944.41 K/sec max=1.09 M/sec [839.98 K/sec, 846.67 K/sec, 914.22 K/sec, 911.86 K/sec, 1.09 M/sec, 1.07 M/sec] - ScanRangesComplete: min=1 (1) mean=1 (1) max=1 (1) [1, 1, 1, 1, 1, 1] - ScannerIoWaitTime: min=2.727ms mean=3.395ms max=3.927ms [3.927ms, 3.780ms, 3.653ms, 3.193ms, 3.087ms, 2.727ms] - TotalRawHdfsOpenFileTime: min=105.051us mean=147.345us max=170.243us [170.243us, 158.653us, 152.763us, 140.676us, 156.684us, 105.051us] - TotalRawHdfsReadTime: min=21.706ms mean=33.028ms max=36.014ms [35.210ms, 36.014ms, 34.552ms, 35.456ms, 35.230ms, 21.706ms] - TotalReadThroughput: min=56.00 MB/sec mean=75.97 MB/sec max=95.90 MB/sec [64.00 MB/sec, 64.00 MB/sec, 95.90 MB/sec, 95.90 MB/sec, 80.00 MB/sec, 56.00 MB/sec] Buffer pool [6 instances]: - AllocTime: min=4.154us mean=28.847us max=61.085us [50.363us, 4.154us, 44.139us, 7.282us, 6.064us, 61.085us] - CompressionTime: min=0.000ns mean=0.000ns max=0.000ns [0.000ns, 0.000ns, 0.000ns, 0.000ns, 0.000ns, 0.000ns] - CumulativeAllocationBytes: min=24.00 MB (25165824) mean=24.05 MB (25220437) max=24.06 MB (25231360) [24.06 MB, 24.06 MB, 24.06 MB, 24.06 MB, 24.06 MB, 24.00 MB] - CumulativeAllocations: min=3 (3) mean=3 (3) max=4 (4) [4, 4, 4, 4, 4, 3] - EncryptionTime: min=0.000ns mean=0.000ns max=0.000ns [0.000ns, 0.000ns, 0.000ns, 0.000ns, 0.000ns, 0.000ns] - PeakReservation: min=24.00 MB (25165824) mean=24.00 MB (25165824) max=24.00 MB (25165824) [24.00 MB, 24.00 MB, 24.00 MB, 24.00 MB, 24.00 MB, 24.00 MB] - PeakUnpinnedBytes: min=0 mean=0 max=0 [0, 0, 0, 0, 0, 0] - PeakUsedReservation: min=24.00 MB (25165824) mean=24.00 MB (25165824) max=24.00 MB (25165824) [24.00 MB, 24.00 MB, 24.00 MB, 24.00 MB, 24.00 MB, 24.00 MB] - ReadIoBytes: min=0 mean=0 max=0 [0, 0, 0, 0, 0, 0] - ReadIoOps: min=0 (0) mean=0 (0) max=0 (0) [0, 0, 0, 0, 0, 0] - ReadIoWaitTime: min=0.000ns mean=0.000ns max=0.000ns [0.000ns, 0.000ns, 0.000ns, 0.000ns, 0.000ns, 0.000ns] - SystemAllocTime: min=0.000ns mean=23.789us max=57.988us [45.002us, 0.000ns, 39.746us, 0.000ns, 0.000ns, 57.988us] - WriteIoBytes: min=0 mean=0 max=0 [0, 0, 0, 0, 0, 0] - WriteIoOps: min=0 (0) mean=0 (0) max=0 (0) [0, 0, 0, 0, 0, 0] - WriteIoWaitTime: min=0.000ns mean=0.000ns max=0.000ns [0.000ns, 0.000ns, 0.000ns, 0.000ns, 0.000ns, 0.000ns]