Query (id=034e7209bd98c96c:9a448dfc00000000): Summary: Session ID: 2349bad730f0305b:d0880f19c92ebab2 Session Type: HIVESERVER2 HiveServer2 Protocol Version: V6 Start Time: 2020-07-15 01:13:56.102928000 End Time: 2020-07-15 01:14:21.319629000 Query Type: QUERY Query State: FINISHED Impala Query State: FINISHED Query Status: OK Impala Version: impalad version 4.0.0-SNAPSHOT RELEASE (build 62608b0ffe5854b76983bcd5e7e34954a6aff35f) User: admin Connected User: hue Delegated User: admin Network Address: ::ffff:172.27.180.8:48020 Default Db: default Sql Statement: select * from web_logs order by id limit 100 Coordinator: nightly7x-unsecure-4.nightly7x-unsecure.root.hwx.site:22000 Query Options (set by configuration): QUERY_TIMEOUT_S=300,IDLE_SESSION_TIMEOUT=900,TIMEZONE=UTC,DEFAULT_FILE_FORMAT=4,DEFAULT_TRANSACTIONAL_TYPE=1 Query Options (set by configuration and planner): QUERY_TIMEOUT_S=300,MT_DOP=0,IDLE_SESSION_TIMEOUT=900,TIMEZONE=UTC,DEFAULT_FILE_FORMAT=4,DEFAULT_TRANSACTIONAL_TYPE=1 Plan: ---------------- Max Per-Host Resource Reservation: Memory=224.00KB Threads=3 Per-Host Resource Estimates: Memory=64MB WARNING: The following tables are missing relevant table and/or column statistics. default.web_logs Analyzed query: SELECT * FROM `default`.web_logs ORDER BY id ASC LIMIT CAST(100 AS TINYINT) F01:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1 | Per-Host Resources: mem-estimate=102.08KB mem-reservation=0B thread-reservation=1 PLAN-ROOT SINK | output exprs: _version_, app, bytes, city, client_ip, code, country_code, country_code3, country_name, device_family, extension, latitude, longitude, method, os_family, os_major, protocol, record, referer, region_code, request, subapp, time, url, user_agent, user_agent_family, user_agent_major, id, date | mem-estimate=0B mem-reservation=0B thread-reservation=0 | 02:MERGING-EXCHANGE [UNPARTITIONED] | order by: id ASC | limit: 100 | mem-estimate=102.08KB mem-reservation=0B thread-reservation=0 | tuple-ids=1 row-size=310B cardinality=100 | in pipelines: 01(GETNEXT) | F00:PLAN FRAGMENT [RANDOM] hosts=3 instances=3 Per-Host Resources: mem-estimate=64.03MB mem-reservation=224.00KB thread-reservation=2 01:TOP-N [LIMIT=100] | order by: id ASC | mem-estimate=30.27KB mem-reservation=0B thread-reservation=0 | tuple-ids=1 row-size=310B cardinality=100 | in pipelines: 01(GETNEXT), 00(OPEN) | 00:SCAN HDFS [default.web_logs, RANDOM] HDFS partitions=4/4 files=4 size=170.11KB stored statistics: table: rows=unavailable size=unavailable partitions: 4/4 rows=1.00K columns missing stats: _version_, app, bytes, city, client_ip, code, country_code, country_code3, country_name, device_family, extension, latitude, longitude, method, os_family, os_major, protocol, record, referer, region_code, request, subapp, time, url, user_agent, user_agent_family, user_agent_major, id extrapolated-rows=disabled max-scan-range-rows=250 mem-estimate=64.00MB mem-reservation=224.00KB thread-reservation=1 tuple-ids=0 row-size=310B cardinality=1.00K in pipelines: 00(GETNEXT) ---------------- Estimated Per-Host Mem: 67244397 Tables Missing Stats: default.web_logs Request Pool: root.admin Per Host Min Memory Reservation: nightly7x-unsecure-1.nightly7x-unsecure.root.hwx.site:22000(224.00 KB) nightly7x-unsecure-3.nightly7x-unsecure.root.hwx.site:22000(224.00 KB) nightly7x-unsecure-4.nightly7x-unsecure.root.hwx.site:22000(224.00 KB) Per Host Number of Fragment Instances: nightly7x-unsecure-1.nightly7x-unsecure.root.hwx.site:22000(1) nightly7x-unsecure-3.nightly7x-unsecure.root.hwx.site:22000(1) nightly7x-unsecure-4.nightly7x-unsecure.root.hwx.site:22000(2) Admission result: Admitted immediately Cluster Memory Admitted: 192.39 MB Executor Group: default ExecSummary: Operator #Hosts #Inst Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail ------------------------------------------------------------------------------------------------------------------------- F01:ROOT 1 1 396.991us 396.991us 0 0 02:MERGING-EXCHANGE 1 1 150.195us 150.195us 100 100 344.00 KB 102.08 KB UNPARTITIONED F00:EXCHANGE SENDER 3 3 1.591ms 3.185ms 416.00 B 0 01:TOP-N 3 3 434.951us 803.821us 300 100 671.77 KB 30.27 KB 00:SCAN HDFS 3 3 243.582ms 321.828ms 1.00K 1.00K 1.33 MB 64.00 MB default.web_logs Errors: Query Compilation: 524.684ms - Metadata of all 1 tables cached: 103.651ms (103.651ms) - Analysis finished: 159.485ms (55.834ms) - Authorization finished (noop): 159.895ms (409.399us) - Value transfer graph computed: 211.325ms (51.430ms) - Single node plan created: 319.552ms (108.226ms) - Runtime filters computed: 328.059ms (8.506ms) - Distributed plan created: 331.171ms (3.112ms) - Lineage info computed: 363.247ms (32.076ms) - Planning finished: 524.684ms (161.436ms) Query Timeline: 2m54s - Query submitted: 43.620us (43.620us) - Planning finished: 551.422ms (551.378ms) - Submit for admission: 569.969ms (18.547ms) - Completed admission: 570.517ms (548.144us) - Ready to start on 3 backends: 572.220ms (1.702ms) - All 3 execution backends (4 fragment instances) started: 758.546ms (186.325ms) - Rows available: 1s757ms (999.105ms) - First row fetched: 3s336ms (1s578ms) - Last row fetched: 25s216ms (21s880ms) - Released admission control resources: 25s216ms (143.064us) - AdmissionControlTimeSinceLastUpdate: 74.000ms - ComputeScanRangeAssignmentTimer: 210.095us Frontend: - CatalogFetch.ColumnStats.Hits: 29 - CatalogFetch.ColumnStats.Misses: 0 - CatalogFetch.ColumnStats.Requests: 29 - CatalogFetch.ColumnStats.Time: 0 - CatalogFetch.Config.Hits: 1 - CatalogFetch.Config.Misses: 0 - CatalogFetch.Config.Requests: 1 - CatalogFetch.Config.Time: 0 - CatalogFetch.DatabaseList.Hits: 1 - CatalogFetch.DatabaseList.Misses: 0 - CatalogFetch.DatabaseList.Requests: 1 - CatalogFetch.DatabaseList.Time: 0 - CatalogFetch.PartitionLists.Hits: 1 - CatalogFetch.PartitionLists.Misses: 0 - CatalogFetch.PartitionLists.Requests: 1 - CatalogFetch.PartitionLists.Time: 0 - CatalogFetch.Partitions.Hits: 8 - CatalogFetch.Partitions.Misses: 4 - CatalogFetch.Partitions.Requests: 12 - CatalogFetch.Partitions.Time: 30ms - CatalogFetch.RPCs.Bytes: 11.48 KB (11752) - CatalogFetch.RPCs.Requests: 2 - CatalogFetch.RPCs.Time: 8ms - CatalogFetch.StorageLoad.Time: 0 - CatalogFetch.TableList.Hits: 1 - CatalogFetch.TableList.Misses: 0 - CatalogFetch.TableList.Requests: 1 - CatalogFetch.TableList.Time: 0 - CatalogFetch.Tables.Hits: 0 - CatalogFetch.Tables.Misses: 1 - CatalogFetch.Tables.Requests: 1 - CatalogFetch.Tables.Time: 3ms ImpalaServer: - ClientFetchWaitTimer: 23s458ms - NumRowsFetched: 100 (100) - NumRowsFetchedFromCache: 0 (0) - RowMaterializationRate: 66.84 K/sec - RowMaterializationTimer: 1.496ms Execution Profile 034e7209bd98c96c:9a448dfc00000000:(Total: 1s186ms, non-child: 0.000ns, % non-child: 0.00%) Number of filters: 0 Filter routing table: ID Src. Node Tgt. Node(s) Target type Partition filter Pending (Expected) First arrived Completed Enabled ------------------------------------------------------------------------------------------------------------------- Backend startup latencies: Count: 3, min / max: 4ms / 186ms, 25th %-ile: 4ms, 50th %-ile: 5ms, 75th %-ile: 5ms, 90th %-ile: 186ms, 95th %-ile: 186ms, 99.9th %-ile: 186ms Slowest backend to start up: nightly7x-unsecure-3.nightly7x-unsecure.root.hwx.site:22000 Per Node Peak Memory Usage: nightly7x-unsecure-1.nightly7x-unsecure.root.hwx.site:22000(2.17 MB) nightly7x-unsecure-3.nightly7x-unsecure.root.hwx.site:22000(2.17 MB) nightly7x-unsecure-4.nightly7x-unsecure.root.hwx.site:22000(2.91 MB) Per Node Bytes Read: nightly7x-unsecure-1.nightly7x-unsecure.root.hwx.site:22000(117.77 KB) nightly7x-unsecure-3.nightly7x-unsecure.root.hwx.site:22000(124.34 KB) nightly7x-unsecure-4.nightly7x-unsecure.root.hwx.site:22000(78.80 KB) Per Node User Time: nightly7x-unsecure-1.nightly7x-unsecure.root.hwx.site:22000(354.183ms) nightly7x-unsecure-3.nightly7x-unsecure.root.hwx.site:22000(326.594ms) nightly7x-unsecure-4.nightly7x-unsecure.root.hwx.site:22000(583.448ms) Per Node System Time: nightly7x-unsecure-1.nightly7x-unsecure.root.hwx.site:22000(20.885ms) nightly7x-unsecure-3.nightly7x-unsecure.root.hwx.site:22000(109.001ms) nightly7x-unsecure-4.nightly7x-unsecure.root.hwx.site:22000(39.960ms) - ExchangeScanRatio: 0.25 - FiltersReceived: 0 (0) - FinalizationTimer: 0.000ns - InnerNodeSelectivityRatio: 0.00 - NumBackends: 3 (3) - NumCompletedBackends: 3 (3) - NumFragmentInstances: 4 (4) - NumFragments: 2 (2) - TotalBytesRead: 320.90 KB (328604) - TotalBytesSent: 81.07 KB (83019) - TotalCpuTime: 1s434ms - TotalInnerBytesSent: 0 - TotalScanBytesSent: 81.07 KB (83019) Per Node Profiles: nightly7x-unsecure-1.nightly7x-unsecure.root.hwx.site:22000: - AdmissionSlots: 1 (1) - BloomFilterBytes: 0 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns - UncompressedScratchBytesWritten: 0 Buffer pool: - AllocTime: 0.000ns - CompressionTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - EncryptionTime: 0.000ns - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment F00: CodeGen:(Total: 432.481ms, non-child: 0.000ns, % non-child: 0.00%) - CodegenInvoluntaryContextSwitches: 1 (1) - CodegenTotalWallClockTime: 432.471ms - CodegenSysTime: 18.866ms - CodegenUserTime: 347.473ms - CodegenVoluntaryContextSwitches: 90 (90) - CompileTime: 161.708ms - IrGenerationTime: 12.161ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.50 MB (2624960) - NumFunctions: 82 (82) - NumInstructions: 3.97K (3971) - OptimizationTime: 233.338ms - PeakMemoryUsage: 1.94 MB (2033152) - PrepareTime: 24.486ms nightly7x-unsecure-3.nightly7x-unsecure.root.hwx.site:22000: - AdmissionSlots: 1 (1) - BloomFilterBytes: 0 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns - UncompressedScratchBytesWritten: 0 Buffer pool: - AllocTime: 0.000ns - CompressionTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - EncryptionTime: 0.000ns - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment F00: CodeGen:(Total: 588.351ms, non-child: 0.000ns, % non-child: 0.00%) - CodegenInvoluntaryContextSwitches: 46 (46) - CodegenTotalWallClockTime: 588.341ms - CodegenSysTime: 89.764ms - CodegenUserTime: 324.266ms - CodegenVoluntaryContextSwitches: 204 (204) - CompileTime: 170.903ms - IrGenerationTime: 39.826ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.50 MB (2624960) - NumFunctions: 82 (82) - NumInstructions: 3.97K (3971) - OptimizationTime: 278.552ms - PeakMemoryUsage: 1.94 MB (2033152) - PrepareTime: 97.279ms nightly7x-unsecure-4.nightly7x-unsecure.root.hwx.site:22000: - AdmissionSlots: 1 (1) - BloomFilterBytes: 0 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns - UncompressedScratchBytesWritten: 0 Buffer pool: - AllocTime: 0.000ns - CompressionTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - EncryptionTime: 0.000ns - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment F01: CodeGen:(Total: 172.824ms, non-child: 0.000ns, % non-child: 0.00%) - CodegenInvoluntaryContextSwitches: 1 (1) - CodegenTotalWallClockTime: 172.811ms - CodegenSysTime: 13.528ms - CodegenUserTime: 102.307ms - CodegenVoluntaryContextSwitches: 119 (119) - CompileTime: 66.941ms - IrGenerationTime: 5.298ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.50 MB (2624960) - NumFunctions: 46 (46) - NumInstructions: 1.50K (1499) - OptimizationTime: 77.303ms - PeakMemoryUsage: 749.50 KB (767488) - PrepareTime: 22.101ms Fragment F00: CodeGen:(Total: 525.411ms, non-child: 0.000ns, % non-child: 0.00%) - CodegenInvoluntaryContextSwitches: 4 (4) - CodegenTotalWallClockTime: 525.398ms - CodegenSysTime: 21.007ms - CodegenUserTime: 478.061ms - CodegenVoluntaryContextSwitches: 69 (69) - CompileTime: 144.067ms - IrGenerationTime: 14.200ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.50 MB (2624960) - NumFunctions: 82 (82) - NumInstructions: 3.97K (3971) - OptimizationTime: 344.684ms - PeakMemoryUsage: 1.94 MB (2033152) - PrepareTime: 21.303ms Averaged Fragment F01:(Total: 2s741ms, non-child: 176.021ms, % non-child: 6.42%) split sizes: min: 0, max: 0, avg: 0, stddev: 0 completion times: min:2s760ms max:2s760ms mean: 2s760ms stddev:0.000ns execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec num instances: 1 - AverageThreadTokens: 0.00 - ExchangeScanRatio: 0.00 - PeakMemoryUsage: 352.00 KB (360448) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 2.91 MB (3050912) - RowsProduced: 100 (100) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 1 (1) - TotalThreadsTotalWallClockTime: 2s738ms - TotalThreadsSysTime: 13.557ms - TotalThreadsUserTime: 102.787ms - TotalThreadsVoluntaryContextSwitches: 122 (122) Fragment Instance Lifecycle Timings: - ExecTime: 1s578ms - ExecTreeExecTime: 977.117us - OpenTime: 1s159ms - ExecTreeOpenTime: 986.638ms - PrepareTime: 2.930ms - ExecTreePrepareTime: 121.364us PLAN_ROOT_SINK:(Total: 1s577ms, non-child: 1s577ms, % non-child: 100.00%) - PeakMemoryUsage: 0 - RowsSent: 100 (100) - RowsSentRate: 63.00 /sec EXCHANGE_NODE (id=2):(Total: 987.605ms, non-child: 987.605ms, % non-child: 100.00%) - ConvertRowBatchTime: 0.000ns - MergeGetNext: 936.498us - MergeGetNextBatch: 869.106us - PeakMemoryUsage: 344.00 KB (352256) - RowsReturned: 100 (100) - RowsReturnedRate: 101.00 /sec Buffer pool: - AllocTime: 62.017us - CompressionTime: 0.000ns - CumulativeAllocationBytes: 344.00 KB (352256) - CumulativeAllocations: 6 (6) - EncryptionTime: 0.000ns - PeakReservation: 344.00 KB (352256) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 344.00 KB (352256) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 52.977us - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Dequeue: - FirstBatchWaitTime: 986.591ms - TotalBytesDequeued: 199.42 KB (204211) - TotalGetBatchTime: 987.466ms - DataWaitTime: 987.455ms Enqueue: - DeserializeRowBatchTime: 477.069us - TotalBatchesEnqueued: 3 (3) - TotalBatchesReceived: 3 (3) - TotalBytesReceived: 81.07 KB (83019) - TotalEarlySenders: 0 (0) - TotalEosReceived: 3 (3) - TotalHasDeferredRPCsTime: 0.000ns - TotalRPCsDeferred: 0 (0) Coordinator Fragment F01: Instance 034e7209bd98c96c:9a448dfc00000000 (host=nightly7x-unsecure-4.nightly7x-unsecure.root.hwx.site:22000):(Total: 2s741ms, non-child: 176.021ms, % non-child: 6.42%) Last report received time: 2020-07-15 01:13:59.440 Fragment Instance Lifecycle Event Timeline: 2s741ms - Prepare Finished: 3.361ms (3.361ms) - Open Finished: 1s162ms (1s159ms) - First Batch Produced: 1s163ms (978.853us) - First Batch Sent: 2s741ms (1s577ms) - ExecInternal Finished: 2s741ms (160.386us) - MemoryUsage (500.000ms): 8.00 KB, 216.00 KB, 352.00 KB, 352.00 KB, 352.00 KB - AverageThreadTokens: 0.00 - ExchangeScanRatio: 0.00 - PeakMemoryUsage: 352.00 KB (360448) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 2.91 MB (3050912) - RowsProduced: 100 (100) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 1 (1) - TotalThreadsTotalWallClockTime: 2s738ms - TotalThreadsSysTime: 13.557ms - TotalThreadsUserTime: 102.787ms - TotalThreadsVoluntaryContextSwitches: 122 (122) Fragment Instance Lifecycle Timings: - ExecTime: 1s578ms - ExecTreeExecTime: 977.117us - OpenTime: 1s159ms - ExecTreeOpenTime: 986.638ms - PrepareTime: 2.930ms - ExecTreePrepareTime: 121.364us PLAN_ROOT_SINK:(Total: 1s577ms, non-child: 396.991us, % non-child: 0.03%) - PeakMemoryUsage: 0 - RowsSent: 100 (100) - RowsSentRate: 63.00 /sec EXCHANGE_NODE (id=2):(Total: 987.605ms, non-child: 150.195us, % non-child: 0.02%) ExecOption: Codegen Enabled Node Lifecycle Event Timeline: 2s741ms - Open Started: 176.284ms (176.284ms) - Open Finished: 1s162ms (986.630ms) - First Batch Requested: 1s162ms (43.705us) - First Batch Returned: 1s163ms (967.381us) - Last Batch Returned: 1s163ms (340.000ns) - Closed: 2s741ms (1s577ms) - ConvertRowBatchTime: 0.000ns - MergeGetNext: 936.498us - MergeGetNextBatch: 869.106us - PeakMemoryUsage: 344.00 KB (352256) - RowsReturned: 100 (100) - RowsReturnedRate: 101.00 /sec Buffer pool: - AllocTime: 62.017us - CompressionTime: 0.000ns - CumulativeAllocationBytes: 344.00 KB (352256) - CumulativeAllocations: 6 (6) - EncryptionTime: 0.000ns - PeakReservation: 344.00 KB (352256) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 344.00 KB (352256) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 52.977us - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Dequeue: - BytesDequeued (500.000ms): 0, 0, 199.42 KB, 199.42 KB, 199.42 KB - FirstBatchWaitTime: 986.591ms - TotalBytesDequeued: 199.42 KB (204211) - TotalGetBatchTime: 987.466ms - DataWaitTime: 987.455ms Enqueue: - BytesReceived (500.000ms): 0, 52.41 KB - DeferredQueueSize (500.000ms): 0, 0, 0, 0, 0 - DispatchTime: (Avg: -69715.000ns ; Min: -80007.000ns ; Max: -59908.000ns ; Number of samples: 3) - DeserializeRowBatchTime: 477.069us - TotalBatchesEnqueued: 3 (3) - TotalBatchesReceived: 3 (3) - TotalBytesReceived: 81.07 KB (83019) - TotalEarlySenders: 0 (0) - TotalEosReceived: 3 (3) - TotalHasDeferredRPCsTime: 0.000ns - TotalRPCsDeferred: 0 (0) Averaged Fragment F00:(Total: 768.601ms, non-child: 519.883ms, % non-child: 67.64%) split sizes: min: 41.78 KB, max: 64.61 KB, avg: 56.70 KB, stddev: 10.56 KB completion times: min:659.720ms max:2s760ms mean: 1s474ms stddev:920.014ms execution rates: min:15.14 KB/sec max:96.58 KB/sec mean:58.69 KB/sec stddev:33.49 KB/sec num instances: 3 - AverageThreadTokens: 1.17 - ExchangeScanRatio: 0.26 - PeakMemoryUsage: 1.05 MB (1096212) - PeakReservation: 322.67 KB (330410) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 2.42 MB (2533792) - RowsProduced: 100 (100) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 3.543ms - TotalStorageWaitTime: 279.407ms - TotalThreadsInvoluntaryContextSwitches: 18 (18) - TotalThreadsTotalWallClockTime: 1s070ms - TotalThreadsSysTime: 52.096ms - TotalThreadsUserTime: 387.146ms - TotalThreadsVoluntaryContextSwitches: 185 (185) Fragment Instance Lifecycle Timings: - ExecTime: 5.310ms - ExecTreeExecTime: 6.744us - OpenTime: 761.650ms - ExecTreeOpenTime: 242.817ms - PrepareTime: 1.582ms - ExecTreePrepareTime: 691.909us KrpcDataStreamSender (dst_id=2):(Total: 5.134ms, non-child: 5.134ms, % non-child: 100.00%) - EosSent: 1 (1) - PeakMemoryUsage: 416.00 B (416) - RowsSent: 100 (100) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 1.413ms - TotalBytesSent: 27.02 KB (27673) - UncompressedRowBatchSize: 66.47 KB (68070) SORT_NODE (id=1):(Total: 243.507ms, non-child: 0.000ns, % non-child: 0.00%) - InsertBatchTime: 558.000us - PeakMemoryUsage: 629.11 KB (644204) - RowsReturned: 100 (100) - RowsReturnedRate: 429.00 /sec - TuplePoolReclamations: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 243.582ms, non-child: 243.582ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.33 - AverageScannerThreadConcurrency: 0.33 - BytesRead: 106.97 KB (109534) - BytesReadDataNodeCache: 0 - BytesReadLocal: 106.97 KB (109534) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 106.97 KB (109534) - CachedFileHandlesHitCount: 37 (37) - CachedFileHandlesMissCount: 1 (1) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 0 - DataCacheHitCount: 0 (0) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 0.000ns - MaterializeTupleTime: 14.852ms - MaxCompressedTextFileLength: 0 - NumColumns: 28 (28) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumPages: 37 (37) - NumRowGroups: 1 (1) - NumRowGroupsWithPageIndex: 1 (1) - NumScannerThreadMemUnavailable: 0 (0) - NumScannerThreadReservationsDenied: 0 (0) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 983.57 KB (1007176) - PeakScannerThreadConcurrency: 1 (1) - PerReadThreadRawHdfsThroughput: 649.77 KB/sec - RemoteScanRanges: 0 (0) - RowBatchBytesEnqueued: 600.25 KB (614657) - RowBatchQueueGetWaitTime: 238.930ms - RowBatchQueuePeakMemoryUsage: 463.35 KB (474466) - RowBatchQueuePutWaitTime: 0.000ns - RowBatchesEnqueued: 4 (4) - RowsRead: 333 (333) - RowsReturned: 333 (333) - RowsReturnedRate: 1.50 K/sec - ScanRangesComplete: 1 (1) - ScannerIoWaitTime: 279.407ms - ScannerThreadWorklessLoops: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 1 (1) - ScannerThreadsTotalWallClockTime: 303.445ms - ScannerThreadsSysTime: 5.899ms - ScannerThreadsUserTime: 2.677ms - ScannerThreadsVoluntaryContextSwitches: 54 (54) - TotalRawHdfsOpenFileTime: 51.719ms - TotalRawHdfsReadTime: 167.834ms - TotalReadThroughput: 0.00 /sec Buffer pool: - AllocTime: 381.976us - CompressionTime: 0.000ns - CumulativeAllocationBytes: 418.67 KB (428714) - CumulativeAllocations: 38 (38) - EncryptionTime: 0.000ns - PeakReservation: 322.67 KB (330410) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 322.67 KB (330410) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 364.800us - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment F00: Instance 034e7209bd98c96c:9a448dfc00000001 (host=nightly7x-unsecure-3.nightly7x-unsecure.root.hwx.site:22000):(Total: 931.317ms, non-child: 599.624ms, % non-child: 64.38%) Last report received time: 2020-07-15 01:13:57.865 Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:1/64.61 KB Fragment Instance Lifecycle Event Timeline: 936.066ms - Prepare Finished: 8.283ms (8.283ms) - Open Finished: 925.291ms (917.007ms) - First Batch Produced: 925.298ms (6.861us) - First Batch Sent: 928.354ms (3.055ms) - ExecInternal Finished: 936.066ms (7.712ms) - MemoryUsage (500.000ms): 8.41 KB, 248.41 KB - ThreadUsage (500.000ms): 1, 2 - AverageThreadTokens: 1.50 - ExchangeScanRatio: 0.23 - PeakMemoryUsage: 986.44 KB (1010116) - PeakReservation: 256.00 KB (262144) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 2.17 MB (2275232) - RowsProduced: 100 (100) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 6.677ms - TotalStorageWaitTime: 275.251ms - TotalThreadsInvoluntaryContextSwitches: 51 (51) - TotalThreadsTotalWallClockTime: 1s239ms - TotalThreadsSysTime: 109.001ms - TotalThreadsUserTime: 326.594ms - TotalThreadsVoluntaryContextSwitches: 266 (266) Fragment Instance Lifecycle Timings: - ExecTime: 10.167ms - ExecTreeExecTime: 5.602us - OpenTime: 916.978ms - ExecTreeOpenTime: 318.536ms - PrepareTime: 4.121ms - ExecTreePrepareTime: 1.763ms KrpcDataStreamSender (dst_id=2):(Total: 9.863ms, non-child: 3.185ms, % non-child: 32.30%) ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (500.000ms): 0, 0 - NetworkThroughput: (Avg: 4.34 MB/sec ; Min: 4.34 MB/sec ; Max: 4.34 MB/sec ; Number of samples: 1) - RpcNetworkTime: (Avg: 3.562ms ; Min: 679.676us ; Max: 6.445ms ; Number of samples: 2) - RpcRecvrTime: (Avg: -151281.000ns ; Min: -231485.000ns ; Max: -71077.000ns ; Number of samples: 2) - EosSent: 1 (1) - PeakMemoryUsage: 416.00 B (416) - RowsSent: 100 (100) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 2.880ms - TotalBytesSent: 28.67 KB (29355) - UncompressedRowBatchSize: 69.29 KB (70950) SORT_NODE (id=1):(Total: 320.298ms, non-child: 0.000ns, % non-child: 0.00%) SortType: TopN ExecOption: Codegen Enabled Node Lifecycle Event Timeline: 928.730ms - Open Started: 606.704ms (606.704ms) - Open Finished: 925.235ms (318.531ms) - First Batch Requested: 925.294ms (58.356us) - First Batch Returned: 925.297ms (3.326us) - Last Batch Returned: 925.297ms (293.000ns) - Closed: 928.730ms (3.432ms) - InsertBatchTime: 626.503us - PeakMemoryUsage: 671.77 KB (687895) - RowsReturned: 100 (100) - RowsReturnedRate: 312.00 /sec - TuplePoolReclamations: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 321.828ms, non-child: 321.828ms, % non-child: 100.00%) Table Name: default.web_logs Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:1/64.61 KB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:0% 1:100% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% 28:0% 29:0% 30:0% File Formats: PARQUET/NONE:1 Node Lifecycle Event Timeline: 925.235ms - Open Started: 606.722ms (606.722ms) - Open Finished: 606.811ms (88.906us) - First Batch Requested: 606.814ms (2.974us) - First Batch Returned: 924.088ms (317.274ms) - Last Batch Returned: 924.877ms (789.419us) - Closed: 925.235ms (357.280us) - BytesReadSeries (500.000ms): 0, 0 - FooterProcessingTime: (Avg: 272.555ms ; Min: 272.555ms ; Max: 272.555ms ; Number of samples: 1) - InitialRangeActualReservation: (Avg: 224.00 KB (229376) ; Min: 224.00 KB (229376) ; Max: 224.00 KB (229376) ; Number of samples: 1) - InitialRangeIdealReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 1) - PageIndexProcessingTime: 0.000ns (Number of samples: 0) - ParquetCompressedBytesReadPerColumn: 0 (Number of samples: 0) - ParquetCompressedPageSize: 0 (Number of samples: 0) - ParquetRowGroupActualReservation: (Avg: 256.00 KB (262144) ; Min: 256.00 KB (262144) ; Max: 256.00 KB (262144) ; Number of samples: 1) - ParquetRowGroupIdealReservation: (Avg: 256.00 KB (262144) ; Min: 256.00 KB (262144) ; Max: 256.00 KB (262144) ; Number of samples: 1) - ParquetUncompressedBytesReadPerColumn: (Avg: 528.00 B (528) ; Min: 10.00 B (10) ; Max: 9.77 KB (10007) ; Number of samples: 28) - ParquetUncompressedPageSize: (Avg: 528.00 B (528) ; Min: 10.00 B (10) ; Max: 9.77 KB (10007) ; Number of samples: 28) - AverageHdfsReadThreadConcurrency: 1.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 124.34 KB (127321) - BytesReadDataNodeCache: 0 - BytesReadLocal: 124.34 KB (127321) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 124.34 KB (127321) - CachedFileHandlesHitCount: 28 (28) - CachedFileHandlesMissCount: 1 (1) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 0 - DataCacheHitCount: 0 (0) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 0.000ns - MaterializeTupleTime: 20.832ms - MaxCompressedTextFileLength: 0 - NumColumns: 28 (28) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumPages: 28 (28) - NumRowGroups: 1 (1) - NumRowGroupsWithPageIndex: 1 (1) - NumScannerThreadMemUnavailable: 0 (0) - NumScannerThreadReservationsDenied: 0 (0) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 819.86 KB (839538) - PeakScannerThreadConcurrency: 1 (1) - PerReadThreadRawHdfsThroughput: 593.65 KB/sec - RemoteScanRanges: 0 (0) - RowBatchBytesEnqueued: 478.04 KB (489508) - RowBatchQueueGetWaitTime: 310.152ms - RowBatchQueuePeakMemoryUsage: 502.04 KB (514084) - RowBatchQueuePutWaitTime: 0.000ns - RowBatchesEnqueued: 3 (3) - RowsRead: 250 (250) - RowsReturned: 250 (250) - RowsReturnedRate: 776.00 /sec - ScanRangesComplete: 1 (1) - ScannerIoWaitTime: 275.251ms - ScannerThreadWorklessLoops: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 3 (3) - ScannerThreadsTotalWallClockTime: 311.877ms - ScannerThreadsSysTime: 11.288ms - ScannerThreadsUserTime: 2.257ms - ScannerThreadsVoluntaryContextSwitches: 43 (43) - TotalRawHdfsOpenFileTime: 66.245ms - TotalRawHdfsReadTime: 209.445ms - TotalReadThroughput: 0.00 /sec Buffer pool: - AllocTime: 863.139us - CompressionTime: 0.000ns - CumulativeAllocationBytes: 384.00 KB (393216) - CumulativeAllocations: 29 (29) - EncryptionTime: 0.000ns - PeakReservation: 256.00 KB (262144) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 256.00 KB (262144) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 849.229us - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Instance 034e7209bd98c96c:9a448dfc00000003 (host=nightly7x-unsecure-4.nightly7x-unsecure.root.hwx.site:22000):(Total: 741.676ms, non-child: 525.673ms, % non-child: 70.88%) Last report received time: 2020-07-15 01:13:59.440 Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:1/41.78 KB Fragment Instance Lifecycle Event Timeline: 742.143ms - Prepare Finished: 712.967us (712.967us) - Open Finished: 739.654ms (738.941ms) - First Batch Produced: 739.660ms (6.594us) - First Batch Sent: 740.526ms (865.758us) - ExecInternal Finished: 742.143ms (1.617ms) - MemoryUsage (500.000ms): 8.41 KB - ThreadUsage (500.000ms): 1 - AverageThreadTokens: 1.00 - ExchangeScanRatio: 0.35 - PeakMemoryUsage: 847.12 KB (867453) - PeakReservation: 240.00 KB (245760) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 2.91 MB (3050912) - RowsProduced: 100 (100) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1.483ms - TotalStorageWaitTime: 197.775ms - TotalThreadsInvoluntaryContextSwitches: 4 (4) - TotalThreadsTotalWallClockTime: 953.893ms - TotalThreadsSysTime: 26.403ms - TotalThreadsUserTime: 480.661ms - TotalThreadsVoluntaryContextSwitches: 121 (121) Fragment Instance Lifecycle Timings: - ExecTime: 2.390ms - ExecTreeExecTime: 5.835us - OpenTime: 738.932ms - ExecTreeOpenTime: 213.451ms - PrepareTime: 300.416us - ExecTreePrepareTime: 133.609us KrpcDataStreamSender (dst_id=2):(Total: 2.424ms, non-child: 940.574us, % non-child: 38.80%) ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (500.000ms): 0 - NetworkThroughput: (Avg: 17.68 MB/sec ; Min: 17.68 MB/sec ; Max: 17.68 MB/sec ; Number of samples: 1) - RpcNetworkTime: (Avg: 939.727us ; Min: 368.097us ; Max: 1.511ms ; Number of samples: 2) - RpcRecvrTime: (Avg: -120994.000ns ; Min: -209424.000ns ; Max: -32564.000ns ; Number of samples: 2) - EosSent: 1 (1) - PeakMemoryUsage: 416.00 B (416) - RowsSent: 100 (100) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 826.799us - TotalBytesSent: 27.36 KB (28014) - UncompressedRowBatchSize: 67.83 KB (69454) SORT_NODE (id=1):(Total: 213.578ms, non-child: 501.033us, % non-child: 0.23%) SortType: TopN ExecOption: Codegen Enabled Node Lifecycle Event Timeline: 740.533ms - Open Started: 526.189ms (526.189ms) - Open Finished: 739.632ms (213.442ms) - First Batch Requested: 739.655ms (23.231us) - First Batch Returned: 739.659ms (3.866us) - Last Batch Returned: 739.660ms (257.000ns) - Closed: 740.533ms (872.987us) - InsertBatchTime: 413.290us - PeakMemoryUsage: 543.77 KB (556823) - RowsReturned: 100 (100) - RowsReturnedRate: 468.00 /sec - TuplePoolReclamations: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 213.077ms, non-child: 213.077ms, % non-child: 100.00%) Table Name: default.web_logs Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:1/41.78 KB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% 28:0% 29:0% 30:0% 31:0% 32:0% 33:0% 34:0% 35:0% 36:0% 37:0% 38:0% 39:0% 40:0% 41:0% 42:0% 43:0% 44:0% File Formats: PARQUET/NONE:1 Node Lifecycle Event Timeline: 739.631ms - Open Started: 526.205ms (526.205ms) - Open Finished: 526.316ms (111.192us) - First Batch Requested: 526.325ms (9.132us) - First Batch Returned: 739.024ms (212.698ms) - Last Batch Returned: 739.583ms (559.521us) - Closed: 739.631ms (48.174us) - BytesReadSeries (500.000ms): 0 - FooterProcessingTime: (Avg: 190.004ms ; Min: 190.004ms ; Max: 190.004ms ; Number of samples: 1) - InitialRangeActualReservation: (Avg: 224.00 KB (229376) ; Min: 224.00 KB (229376) ; Max: 224.00 KB (229376) ; Number of samples: 1) - InitialRangeIdealReservation: (Avg: 64.00 KB (65536) ; Min: 64.00 KB (65536) ; Max: 64.00 KB (65536) ; Number of samples: 1) - PageIndexProcessingTime: 0.000ns (Number of samples: 0) - ParquetCompressedBytesReadPerColumn: 0 (Number of samples: 0) - ParquetCompressedPageSize: 0 (Number of samples: 0) - ParquetRowGroupActualReservation: (Avg: 240.00 KB (245760) ; Min: 240.00 KB (245760) ; Max: 240.00 KB (245760) ; Number of samples: 1) - ParquetRowGroupIdealReservation: (Avg: 240.00 KB (245760) ; Min: 240.00 KB (245760) ; Max: 240.00 KB (245760) ; Number of samples: 1) - ParquetUncompressedBytesReadPerColumn: (Avg: 542.00 B (542) ; Min: 10.00 B (10) ; Max: 9.77 KB (10007) ; Number of samples: 28) - ParquetUncompressedPageSize: (Avg: 542.00 B (542) ; Min: 10.00 B (10) ; Max: 9.77 KB (10007) ; Number of samples: 28) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 78.80 KB (80689) - BytesReadDataNodeCache: 0 - BytesReadLocal: 78.80 KB (80689) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 78.80 KB (80689) - CachedFileHandlesHitCount: 28 (28) - CachedFileHandlesMissCount: 1 (1) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 0 - DataCacheHitCount: 0 (0) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 0.000ns - MaterializeTupleTime: 7.552ms - MaxCompressedTextFileLength: 0 - NumColumns: 28 (28) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumPages: 28 (28) - NumRowGroups: 1 (1) - NumRowGroupsWithPageIndex: 1 (1) - NumScannerThreadMemUnavailable: 0 (0) - NumScannerThreadReservationsDenied: 0 (0) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 773.26 KB (791817) - PeakScannerThreadConcurrency: 1 (1) - PerReadThreadRawHdfsThroughput: 507.91 KB/sec - RemoteScanRanges: 0 (0) - RowBatchBytesEnqueued: 450.72 KB (461533) - RowBatchQueueGetWaitTime: 212.395ms - RowBatchQueuePeakMemoryUsage: 419.77 KB (429847) - RowBatchQueuePutWaitTime: 0.000ns - RowBatchesEnqueued: 3 (3) - RowsRead: 250 (250) - RowsReturned: 250 (250) - RowsReturnedRate: 1.17 K/sec - ScanRangesComplete: 1 (1) - ScannerIoWaitTime: 197.775ms - ScannerThreadWorklessLoops: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 212.583ms - ScannerThreadsSysTime: 4.403ms - ScannerThreadsUserTime: 1.761ms - ScannerThreadsVoluntaryContextSwitches: 47 (47) - TotalRawHdfsOpenFileTime: 43.251ms - TotalRawHdfsReadTime: 155.140ms - TotalReadThroughput: 0.00 /sec Buffer pool: - AllocTime: 85.059us - CompressionTime: 0.000ns - CumulativeAllocationBytes: 304.00 KB (311296) - CumulativeAllocations: 29 (29) - EncryptionTime: 0.000ns - PeakReservation: 240.00 KB (245760) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 240.00 KB (245760) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 71.210us - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Instance 034e7209bd98c96c:9a448dfc00000002 (host=nightly7x-unsecure-1.nightly7x-unsecure.root.hwx.site:22000):(Total: 632.810ms, non-child: 433.048ms, % non-child: 68.43%) Last report received time: 2020-07-15 01:13:57.340 Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:2/63.72 KB Fragment Instance Lifecycle Event Timeline: 633.260ms - Prepare Finished: 736.675us (736.675us) - Open Finished: 629.785ms (629.048ms) - First Batch Produced: 629.795ms (9.573us) - First Batch Sent: 630.366ms (571.180us) - ExecInternal Finished: 633.260ms (2.894ms) - MemoryUsage (500.000ms): 8.41 KB - ThreadUsage (500.000ms): 1 - AverageThreadTokens: 1.00 - ExchangeScanRatio: 0.21 - PeakMemoryUsage: 1.35 MB (1411069) - PeakReservation: 472.00 KB (483328) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 2.17 MB (2275232) - RowsProduced: 100 (100) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 2.467ms - TotalStorageWaitTime: 365.196ms - TotalThreadsInvoluntaryContextSwitches: 1 (1) - TotalThreadsTotalWallClockTime: 1s018ms - TotalThreadsSysTime: 20.885ms - TotalThreadsUserTime: 354.183ms - TotalThreadsVoluntaryContextSwitches: 170 (170) Fragment Instance Lifecycle Timings: - ExecTime: 3.374ms - ExecTreeExecTime: 8.797us - OpenTime: 629.039ms - ExecTreeOpenTime: 196.463ms - PrepareTime: 323.914us - ExecTreePrepareTime: 178.559us KrpcDataStreamSender (dst_id=2):(Total: 3.115ms, non-child: 647.668us, % non-child: 20.79%) ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (500.000ms): 0 - NetworkThroughput: (Avg: 9.33 MB/sec ; Min: 9.33 MB/sec ; Max: 9.33 MB/sec ; Number of samples: 1) - RpcNetworkTime: (Avg: 1.621ms ; Min: 621.589us ; Max: 2.621ms ; Number of samples: 2) - RpcRecvrTime: (Avg: -170611.000ns ; Min: -298130.000ns ; Max: -43093.000ns ; Number of samples: 2) - EosSent: 1 (1) - PeakMemoryUsage: 416.00 B (416) - RowsSent: 100 (100) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 533.173us - TotalBytesSent: 25.05 KB (25650) - UncompressedRowBatchSize: 62.31 KB (63807) SORT_NODE (id=1):(Total: 196.646ms, non-child: 803.821us, % non-child: 0.41%) SortType: TopN ExecOption: Codegen Enabled Node Lifecycle Event Timeline: 630.647ms - Open Started: 433.301ms (433.301ms) - Open Finished: 629.762ms (196.460ms) - First Batch Requested: 629.787ms (25.272us) - First Batch Returned: 629.793ms (5.670us) - Last Batch Returned: 629.793ms (485.000ns) - Closed: 630.647ms (853.381us) - InsertBatchTime: 634.209us - PeakMemoryUsage: 671.77 KB (687895) - RowsReturned: 100 (100) - RowsReturnedRate: 508.00 /sec - TuplePoolReclamations: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 195.842ms, non-child: 195.842ms, % non-child: 100.00%) Table Name: default.web_logs Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:2/63.72 KB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 2 out of 2 Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% File Formats: PARQUET/NONE:2 Node Lifecycle Event Timeline: 629.761ms - Open Started: 433.310ms (433.310ms) - Open Finished: 433.388ms (77.810us) - First Batch Requested: 433.391ms (2.488us) - First Batch Returned: 625.249ms (191.858ms) - Last Batch Returned: 629.704ms (4.454ms) - Closed: 629.761ms (57.435us) - BytesReadSeries (500.000ms): 0 - FooterProcessingTime: (Avg: 169.480ms ; Min: 166.271ms ; Max: 172.689ms ; Number of samples: 2) - InitialRangeActualReservation: (Avg: 224.00 KB (229376) ; Min: 224.00 KB (229376) ; Max: 224.00 KB (229376) ; Number of samples: 2) - InitialRangeIdealReservation: (Avg: 48.00 KB (49152) ; Min: 32.00 KB (32768) ; Max: 64.00 KB (65536) ; Number of samples: 2) - PageIndexProcessingTime: 0.000ns (Number of samples: 0) - ParquetCompressedBytesReadPerColumn: 0 (Number of samples: 0) - ParquetCompressedPageSize: 0 (Number of samples: 0) - ParquetRowGroupActualReservation: (Avg: 236.00 KB (241664) ; Min: 232.00 KB (237568) ; Max: 240.00 KB (245760) ; Number of samples: 2) - ParquetRowGroupIdealReservation: (Avg: 236.00 KB (241664) ; Min: 232.00 KB (237568) ; Max: 240.00 KB (245760) ; Number of samples: 2) - ParquetUncompressedBytesReadPerColumn: (Avg: 1005.00 B (1005) ; Min: 20.00 B (20) ; Max: 19.54 KB (20014) ; Number of samples: 28) - ParquetUncompressedPageSize: (Avg: 502.00 B (502) ; Min: 10.00 B (10) ; Max: 9.77 KB (10007) ; Number of samples: 56) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 117.77 KB (120594) - BytesReadDataNodeCache: 0 - BytesReadLocal: 117.77 KB (120594) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 117.77 KB (120594) - CachedFileHandlesHitCount: 56 (56) - CachedFileHandlesMissCount: 2 (2) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 0 - DataCacheHitCount: 0 (0) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 0.000ns - MaterializeTupleTime: 16.171ms - MaxCompressedTextFileLength: 0 - NumColumns: 28 (28) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumPages: 56 (56) - NumRowGroups: 2 (2) - NumRowGroupsWithPageIndex: 2 (2) - NumScannerThreadMemUnavailable: 0 (0) - NumScannerThreadReservationsDenied: 0 (0) - NumScannerThreadsStarted: 2 (2) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 1.33 MB (1390173) - PeakScannerThreadConcurrency: 2 (2) - PerReadThreadRawHdfsThroughput: 847.75 KB/sec - RemoteScanRanges: 0 (0) - RowBatchBytesEnqueued: 872.00 KB (892930) - RowBatchQueueGetWaitTime: 194.242ms - RowBatchQueuePeakMemoryUsage: 468.23 KB (479467) - RowBatchQueuePutWaitTime: 0.000ns - RowBatchesEnqueued: 6 (6) - RowsRead: 500 (500) - RowsReturned: 500 (500) - RowsReturnedRate: 2.55 K/sec - ScanRangesComplete: 2 (2) - ScannerIoWaitTime: 365.196ms - ScannerThreadWorklessLoops: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 385.875ms - ScannerThreadsSysTime: 2.007ms - ScannerThreadsUserTime: 4.014ms - ScannerThreadsVoluntaryContextSwitches: 73 (73) - TotalRawHdfsOpenFileTime: 45.663ms - TotalRawHdfsReadTime: 138.918ms - TotalReadThroughput: 0.00 /sec Buffer pool: - AllocTime: 197.732us - CompressionTime: 0.000ns - CumulativeAllocationBytes: 568.00 KB (581632) - CumulativeAllocations: 58 (58) - EncryptionTime: 0.000ns - PeakReservation: 472.00 KB (483328) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 472.00 KB (483328) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 173.963us - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns