PROFILE: Query (id=cf493237ce392e71:b08976ea00000000): DEBUG MODE WARNING: Query profile created while running a DEBUG build of Impala. Use RELEASE builds to measure query performance. Summary: Session ID: 674fa069215d83b1:6491318dc0dc1e8e Session Type: BEESWAX Start Time: 2023-12-14 02:23:08.387646000 End Time: 2023-12-14 02:23:08.564771000 Duration: 177.125ms (177125 us) Query Type: QUERY Query State: FINISHED Impala Query State: FINISHED Query Status: OK Impala Version: impalad version 4.4.0-SNAPSHOT DEBUG (build 19c68368e945fd200b5499a1c391a2598df8ae59) User: ubuntu Connected User: ubuntu Delegated User: Network Address: 172.18.0.1:53188 Default Db: test_orc_stats_3d52a9af Sql Statement: select count(*) from tpch_orc_def.lineitem where l_orderkey = 1609411 Coordinator: 172.18.0.4:27000 Query Options (set by configuration): ABORT_ON_ERROR=1,NUM_NODES=1,EXEC_SINGLE_NODE_ROWS_THRESHOLD=0,DISABLE_CODEGEN_ROWS_THRESHOLD=0,TIMEZONE=Etc/UTC,CLIENT_IDENTIFIER=query_test/test_orc_stats.py::TestOrcStats::()::test_orc_stats[protocol:beeswax|exec_option:{'test_replan':1;'batch_size':0;'num_nodes':0;'disable_codegen_rows_threshold':0;'disable_codegen':False;'abort_on_error':1;'exec_single_node_rows_threshold':0}|ta,TEST_REPLAN=1 Query Options (set by configuration and planner): ABORT_ON_ERROR=1,NUM_NODES=1,EXEC_SINGLE_NODE_ROWS_THRESHOLD=0,MT_DOP=0,DISABLE_CODEGEN_ROWS_THRESHOLD=0,TIMEZONE=Etc/UTC,CLIENT_IDENTIFIER=query_test/test_orc_stats.py::TestOrcStats::()::test_orc_stats[protocol:beeswax|exec_option:{'test_replan':1;'batch_size':0;'num_nodes':0;'disable_codegen_rows_threshold':0;'disable_codegen':False;'abort_on_error':1;'exec_single_node_rows_threshold':0}|ta,SPOOL_QUERY_RESULTS=0,MINMAX_FILTER_THRESHOLD=0.5,MINMAX_FILTERING_LEVEL=PAGE,TEST_REPLAN=1 Plan: ---------------- Max Per-Host Resource Reservation: Memory=4.00MB Threads=2 Per-Host Resource Estimates: Memory=96MB Analyzed query: SELECT count(*) FROM tpch_orc_def.lineitem WHERE l_orderkey = CAST(1609411 AS BIGINT) F00:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1 | Per-Host Resources: mem-estimate=96.02MB mem-reservation=4.00MB thread-reservation=2 PLAN-ROOT SINK | output exprs: count(*) | mem-estimate=0B mem-reservation=0B thread-reservation=0 | 01:AGGREGATE [FINALIZE] | output: count(*) | mem-estimate=16.00KB mem-reservation=0B spill-buffer=2.00MB thread-reservation=0 | tuple-ids=1 row-size=8B cardinality=1 | in pipelines: 01(GETNEXT), 00(OPEN) | 00:SCAN HDFS [tpch_orc_def.lineitem] HDFS partitions=1/1 files=4 size=142.76MB predicates: l_orderkey = CAST(1609411 AS BIGINT) stored statistics: table: rows=6.00M size=142.76MB columns: all extrapolated-rows=disabled max-scan-range-rows=1.50M orc statistics predicates: l_orderkey = CAST(1609411 AS BIGINT) mem-estimate=96.00MB mem-reservation=4.00MB thread-reservation=1 tuple-ids=0 row-size=8B cardinality=4 in pipelines: 00(GETNEXT) ---------------- Estimated Per-Host Mem: 100679680 Request Pool: root.default Per Host Min Memory Reservation: 172.18.0.4:27000(4.00 MB) Per Host Number of Fragment Instances: 172.18.0.4:27000(1) Admission result: Admitted immediately Cluster Memory Admitted: 300.00 MB Executor Group: empty group (using coordinator only) ExecSummary: Operator #Hosts #Inst Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail ---------------------------------------------------------------------------------------------------------------------- F00:ROOT 1 1 18.960us 18.960us 0 0 01:AGGREGATE 1 1 187.964us 187.964us 1 1 43.00 KB 16.00 KB FINALIZE 00:SCAN HDFS 1 1 52.873ms 52.873ms 7 4 17.62 MB 96.00 MB tpch_orc_def.lineitem Errors: Query Compilation: 3.860ms - Metadata of all 1 tables cached: 2.176ms (2.176ms) - Analysis finished: 2.469ms (292.724us) - Authorization finished (noop): 2.556ms (86.962us) - Value transfer graph computed: 2.625ms (68.543us) - Single node plan created: 3.193ms (568.509us) - Runtime filters computed: 3.215ms (21.701us) - Distributed plan created: 3.226ms (11.191us) - Planning finished: 3.860ms (634.410us) Query Timeline: 178.043ms - Query submitted: 30.390us (30.390us) - Planning finished: 4.364ms (4.333ms) - Submit for admission: 4.520ms (155.772us) - Completed admission: 16.128ms (11.608ms) - Ready to start on 1 backends: 16.241ms (112.765us) - All 1 execution backends (1 fragment instances) started: 16.762ms (521.335us) - Rows available: 133.304ms (116.541ms) - First row fetched: 176.495ms (43.190ms) - Last row fetched: 176.508ms (13.474us) - Released admission control resources: 177.112ms (604.232us) - AdmissionControlTimeSinceLastUpdate: 21.000ms - ComputeScanRangeAssignmentTimer: 44.479us Frontend: Referenced Tables: tpch_orc_def.lineitem - CatalogFetch.ColumnStats.Hits: 0 - CatalogFetch.ColumnStats.Misses: 16 - CatalogFetch.ColumnStats.Requests: 16 - CatalogFetch.ColumnStats.Time: 0 - CatalogFetch.Config.Hits: 1 - CatalogFetch.Config.Misses: 0 - CatalogFetch.Config.Requests: 1 - CatalogFetch.Config.Time: 0 - CatalogFetch.DatabaseList.Hits: 1 - CatalogFetch.DatabaseList.Misses: 0 - CatalogFetch.DatabaseList.Requests: 1 - CatalogFetch.DatabaseList.Time: 0 - CatalogFetch.PartitionLists.Hits: 0 - CatalogFetch.PartitionLists.Misses: 1 - CatalogFetch.PartitionLists.Requests: 1 - CatalogFetch.PartitionLists.Time: 0 - CatalogFetch.Partitions.Hits: 1 - CatalogFetch.Partitions.Misses: 1 - CatalogFetch.Partitions.Requests: 2 - CatalogFetch.Partitions.Time: 0 - CatalogFetch.RPCs.Bytes: 4.48 KB (4589) - CatalogFetch.RPCs.Requests: 5 - CatalogFetch.RPCs.Time: 0 - CatalogFetch.StorageLoad.Time: 0 - CatalogFetch.TableList.Hits: 1 - CatalogFetch.TableList.Misses: 1 - CatalogFetch.TableList.Requests: 2 - CatalogFetch.TableList.Time: 0 - CatalogFetch.Tables.Hits: 0 - CatalogFetch.Tables.Misses: 1 - CatalogFetch.Tables.Requests: 1 - CatalogFetch.Tables.Time: 0 - ExecutorGroupsConsidered: 1 (1) Executor group 1 (small): Verdict: Assign to first group because the number of nodes is 1 - MemoryMax: 192.00 MB (201326592) ImpalaServer: - ClientFetchWaitTimeStats: (Avg: 42.426ms ; Min: 42.426ms ; Max: 42.426ms ; Number of samples: 1) - ClientFetchWaitTimer: 42.426ms - NumRowsFetched: 1 (1) - NumRowsFetchedFromCache: 0 (0) - RPCCount: 8 (8) - RPCReadTimer: 11.000us - RPCWriteTimer: 149.000us - RowMaterializationRate: 683.00 /sec - RowMaterializationTimer: 1.463ms Execution Profile cf493237ce392e71:b08976ea00000000:(Total: 116.836ms, non-child: 0.000ns, % non-child: 0.00%) Number of filters: 0 Filter routing table: ID Src. Node Tgt. Node(s) Target type Partition filter Pending (Expected) First arrived Completed Enabled Bloom Size Est fpp Min value Max value In-list size ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Backend startup latencies: Count: 1, sum: 0, min / max: 0 / 0, 25th %-ile: 0, 50th %-ile: 0, 75th %-ile: 0, 90th %-ile: 0, 95th %-ile: 0, 99.9th %-ile: 0 Slowest backend to start up: Per Node Peak Memory Usage: 172.18.0.4:27000(17.67 MB) Per Node Bytes Read: 172.18.0.4:27000(4.13 MB) Per Node User Time: 172.18.0.4:27000(47.661ms) Per Node System Time: 172.18.0.4:27000(9.300ms) - ExchangeScanRatio: 0.00 - FiltersReceived: 0 (0) - FinalizationTimer: 0.000ns - InnerNodeSelectivityRatio: 0.00 - NumBackends: 1 (1) - NumCompletedBackends: 1 (1) - NumFragmentInstances: 1 (1) - NumFragments: 1 (1) - TotalBytesRead: 4.13 MB (4335038) - TotalBytesSent: 0 - TotalCpuTime: 56.961ms - TotalInnerBytesSent: 0 - TotalScanBytesSent: 0 Per Node Profiles: 172.18.0.4:27000: - HostCpuIoWaitPercentage (50.000ms): 0, 0, 0 - HostCpuSysPercentage (50.000ms): 4, 5, 5 - HostCpuUserPercentage (50.000ms): 92, 89, 89 - HostDiskReadThroughput (50.000ms): 1.98 MB/sec, 880.95 KB/sec, 880.95 KB/sec - HostDiskWriteThroughput (50.000ms): 436.51 KB/sec, 9.64 MB/sec, 9.64 MB/sec - HostNetworkRx (50.000ms): 657.99 KB/sec, 568.34 KB/sec, 568.34 KB/sec - HostNetworkTx (50.000ms): 1.68 MB/sec, 1.90 MB/sec, 1.90 MB/sec - AdmissionSlots: 1 (1) - BloomFilterBytes: 0 - InListFilterItems: 0 (0) - ScratchBytesRead: 0 - ScratchBytesReadUseLocalDisk: 0 - ScratchBytesReadUseMem: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchReadsUseLocalDisk: 0 (0) - ScratchReadsUseMem: 0 (0) - ScratchWrites: 0 (0) - TotalCompressionTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns - UncompressedScratchBytesWritten: 0 Buffer pool: - AllocTime: 0.000ns - CompressionTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - EncryptionTime: 0.000ns - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns JVM: - GcCount: 0 (0) - GcNumInfoThresholdExceeded: 0 (0) - GcNumWarnThresholdExceeded: 0 (0) - GcTimeMillis: 0 - GcTotalExtraSleepTimeMillis: 0 Fragment F00: CodeGen: - CodegenCacheLookupTime: 2.044ms - CodegenCacheSaveTime: 145.958us - CodegenCompileThreadInvoluntaryContextSwitches: 0 (0) - CodegenCompileThreadTotalWallClockTime: 0.000ns - CodegenCompileThreadSysTime: 0.000ns - CodegenCompileThreadUserTime: 0.000ns - CodegenCompileThreadVoluntaryContextSwitches: 0 (0) - CodegenInvoluntaryContextSwitches: 4 (4) - CodegenTotalWallClockTime: 62.828ms - CodegenSysTime: 4.190ms - CodegenUserTime: 41.907ms - CodegenVoluntaryContextSwitches: 3 (3) - CompileTime: 8.616ms - FunctionPruneTime: 2.897ms - InactiveTotalTime: 0.000ns - IrGenerationTime: 909.343us - LoadTime: 0.000ns - MainThreadCodegenTime: 39.968ms - ModuleBitcodeGenTime: 1.909ms - ModuleBitcodeSize: 3.33 MB (3486568) - NumCachedFunctions: 0 (0) - NumFunctions: 15 (15) - NumInstructions: 274 (274) - NumOptimizedFunctions: 6 (6) - NumOptimizedInstructions: 170 (170) - OptimizationTime: 24.072ms - PeakMemoryUsage: 137.00 KB (140288) - PrepareTime: 22.866ms - TotalTime: 62.834ms Averaged Fragment F00:(Total: 158.850ms, non-child: 62.991ms, % non-child: 39.65%) split sizes: min: 142.76 MB, max: 142.76 MB, avg: 142.76 MB, stddev: 0 completion times: min:160.041ms max:160.041ms mean: 160.041ms stddev:0.000ns execution rates: min:892.01 MB/sec max:892.01 MB/sec mean:892.01 MB/sec stddev:0.00 /sec num instances: 1 - AverageThreadTokens: 0.00 - BytesAssigned: 142.76 MB (149693632) - CompletionTime: 160.041ms - ExchangeScanRatio: 0.00 - ExecutionRate: 892.01 MB/sec - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 17.67 MB (18523503) - PeakReservation: 16.00 MB (16777216) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 17.67 MB (18523503) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 129.548ms - TotalThreadsInvoluntaryContextSwitches: 39 (39) - TotalThreadsTotalWallClockTime: 315.858ms - TotalThreadsSysTime: 9.300ms - TotalThreadsUserTime: 47.661ms - TotalThreadsVoluntaryContextSwitches: 80 (80) - TotalTime: 158.850ms Fragment Instance Lifecycle Timings: - ExecTime: 42.819ms - ExecTreeExecTime: 4.772us - OpenTime: 115.880ms - ExecTreeOpenTime: 52.981ms - PrepareTime: 125.834us - ExecTreePrepareTime: 77.963us PLAN_ROOT_SINK:(Total: 42.797ms, non-child: 18.960us, % non-child: 0.04%) - CreateResultSetTime: 7.299us - InactiveTotalTime: 42.778ms - PeakMemoryUsage: 0 - RowsSent: 1 (1) - RowsSentRate: 23.00 /sec - TotalTime: 42.797ms AGGREGATION_NODE (id=1):(Total: 53.061ms, non-child: 187.964us, % non-child: 0.35%) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 43.00 KB (44032) - RowsReturned: 1 (1) - RowsReturnedRate: 18.00 /sec - TotalTime: 53.061ms NonGroupingAggregator 0: - BuildTime: 9.122us - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 1 (1) - TotalTime: 0.000ns HDFS_SCAN_NODE (id=0):(Total: 52.873ms, non-child: 52.873ms, % non-child: 100.00%) - ColumnarScannerActualReservation: (Avg: 4.00 MB (4194304) ; Min: 4.00 MB (4194304) ; Max: 4.00 MB (4194304) ; Number of samples: 8) - ColumnarScannerIdealReservation: (Avg: 640.00 KB (655360) ; Min: 256.00 KB (262144) ; Max: 1.00 MB (1048576) ; Number of samples: 8) - FooterProcessingTime: (Avg: 7.113ms ; Min: 4.694ms ; Max: 10.844ms ; Number of samples: 4) - InitialRangeActualReservation: (Avg: 4.00 MB (4194304) ; Min: 4.00 MB (4194304) ; Max: 4.00 MB (4194304) ; Number of samples: 4) - InitialRangeIdealReservation: (Avg: 16.00 KB (16384) ; Min: 16.00 KB (16384) ; Max: 16.00 KB (16384) ; Number of samples: 4) - ParquetCompressedBytesReadPerColumn: 0 (Number of samples: 0) - ParquetUncompressedBytesReadPerColumn: 0 (Number of samples: 0) - AverageHdfsReadThreadConcurrency: 3.00 - AverageScannerThreadConcurrency: 4.00 - BytesRead: 4.13 MB (4335038) - BytesReadDataNodeCache: 0 - BytesReadEncrypted: 0 - BytesReadErasureCoded: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 22 (22) - CachedFileHandlesMissCount: 6 (6) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 1.21 KB (1235) - DataCacheHitCount: 4 (4) - DataCacheMissBytes: 4.13 MB (4333803) - DataCacheMissCount: 28 (28) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 0.000ns - InactiveTotalTime: 0.000ns - IoReadAsyncBytes: 576.00 KB (589824) - IoReadAsyncRequest: 6 (6) - IoReadSkippedBytes: 976.02 KB (999448) - IoReadSyncBytes: 11.00 KB (11259) - IoReadSyncRequest: 20 (20) - IoReadTotalBytes: 587.00 KB (601083) - IoReadTotalRequest: 26 (26) - MaterializeTupleTime: 23.828ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 1 (1) - NumFileMetadataRead: 0 (0) - NumOrcStripes: 8 (8) - NumPushedDownPredicates: 1 (1) - NumPushedDownRuntimeFilters: 0 (0) - NumScannerThreadMemUnavailable: 0 (0) - NumScannerThreadReservationsDenied: 0 (0) - NumScannerThreadsStarted: 4 (4) - NumScannersWithNoReads: 0 (0) - PeakMemoryUsage: 17.62 MB (18471577) - PeakScannerThreadConcurrency: 4 (4) - PerReadThreadRawHdfsThroughput: 30.99 MB/sec - RemoteScanRanges: 100 (100) - RowBatchBytesEnqueued: 54.00 KB (55296) - RowBatchQueueGetWaitTime: 41.406ms - RowBatchQueuePeakMemoryUsage: 35.00 KB (35840) - RowBatchQueuePutWaitTime: 0.000ns - RowBatchesEnqueued: 16 (16) - RowsRead: 20.00K (20000) - RowsReturned: 7 (7) - RowsReturnedRate: 132.00 /sec - ScanRangesComplete: 4 (4) - ScannerIoWaitTime: 129.548ms - ScannerThreadWorklessLoops: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 31 (31) - ScannerThreadsTotalWallClockTime: 157.173ms - ScannerThreadsSysTime: 5.012ms - ScannerThreadsUserTime: 4.780ms - ScannerThreadsVoluntaryContextSwitches: 55 (55) - TotalRawHdfsOpenFileTime: 36.329ms - TotalRawHdfsReadTime: 133.410ms - TotalReadThroughput: 316.83 KB/sec - TotalTime: 52.873ms Buffer pool: - AllocTime: 21.253us - CompressionTime: 0.000ns - CumulativeAllocationBytes: 5.06 MB (5308416) - CumulativeAllocations: 12 (12) - EncryptionTime: 0.000ns - PeakReservation: 16.00 MB (16777216) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 4.00 MB (4194304) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Coordinator Fragment F00: Instance cf493237ce392e71:b08976ea00000000 (host=172.18.0.4:27000):(Total: 158.850ms, non-child: 62.991ms, % non-child: 39.65%) Last report received time: 2023-12-14 02:23:08.564 Hdfs split stats (:<# splits>/): -1:4/142.76 MB Fragment Instance Lifecycle Event Timeline: 158.969ms - Prepare Finished: 255.490us (255.490us) - Open Finished: 116.143ms (115.887ms) - First Batch Produced: 116.149ms (5.751us) - First Batch Sent: 158.946ms (42.797ms) - ExecInternal Finished: 158.969ms (23.724us) - MemoryUsage (50.000ms): 12.00 KB, 16.61 MB, 16.00 KB - AverageThreadTokens: 0.00 - BytesAssigned: 142.76 MB (149693632) - CompletionTime: 160.041ms - ExchangeScanRatio: 0.00 - ExecutionRate: 892.01 MB/sec - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 17.67 MB (18523503) - PeakReservation: 16.00 MB (16777216) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 17.67 MB (18523503) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 129.548ms - TotalThreadsInvoluntaryContextSwitches: 39 (39) - TotalThreadsTotalWallClockTime: 315.858ms - TotalThreadsSysTime: 9.300ms - TotalThreadsUserTime: 47.661ms - TotalThreadsVoluntaryContextSwitches: 80 (80) - TotalTime: 158.850ms Fragment Instance Lifecycle Timings: - ExecTime: 42.819ms - ExecTreeExecTime: 4.772us - OpenTime: 115.880ms - ExecTreeOpenTime: 52.981ms - PrepareTime: 125.834us - ExecTreePrepareTime: 77.963us PLAN_ROOT_SINK:(Total: 42.797ms, non-child: 18.960us, % non-child: 0.04%) - CreateResultSetTime: 7.299us - InactiveTotalTime: 42.778ms - PeakMemoryUsage: 0 - RowsSent: 1 (1) - RowsSentRate: 23.00 /sec - TotalTime: 42.797ms AGGREGATION_NODE (id=1):(Total: 53.061ms, non-child: 187.964us, % non-child: 0.35%) Node Lifecycle Event Timeline: 158.957ms - Open Started: 63.152ms (63.152ms) - Open Finished: 116.119ms (52.966ms) - First Batch Requested: 116.145ms (25.709us) - First Batch Returned: 116.148ms (3.785us) - Last Batch Returned: 116.149ms (237.000ns) - Closed: 158.957ms (42.808ms) - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 43.00 KB (44032) - RowsReturned: 1 (1) - RowsReturnedRate: 18.00 /sec - TotalTime: 53.061ms NonGroupingAggregator 0: ExecOption: Codegen Enabled - BuildTime: 9.122us - InactiveTotalTime: 0.000ns - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 1 (1) - TotalTime: 0.000ns HDFS_SCAN_NODE (id=0):(Total: 52.873ms, non-child: 52.873ms, % non-child: 100.00%) Table Name: tpch_orc_def.lineitem Hdfs split stats (:<# splits>/): -1:4/142.76 MB Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:100% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% File Formats: ORC/DEFLATE:4 ExecOption: Codegen enabled: 4 out of 4, ORC Codegen Enabled Node Lifecycle Event Timeline: 116.117ms - Open Started: 63.154ms (63.154ms) - Open Finished: 63.240ms (85.980us) - First Batch Requested: 63.248ms (7.662us) - First Batch Returned: 98.856ms (35.608ms) - Last Batch Returned: 115.948ms (17.091ms) - Closed: 116.117ms (169.313us) - BytesReadSeries (50.000ms): 0, 32.00 KB - ColumnarScannerActualReservation: (Avg: 4.00 MB (4194304) ; Min: 4.00 MB (4194304) ; Max: 4.00 MB (4194304) ; Number of samples: 8) - ColumnarScannerIdealReservation: (Avg: 640.00 KB (655360) ; Min: 256.00 KB (262144) ; Max: 1.00 MB (1048576) ; Number of samples: 8) - FooterProcessingTime: (Avg: 7.113ms ; Min: 4.694ms ; Max: 10.844ms ; Number of samples: 4) - InitialRangeActualReservation: (Avg: 4.00 MB (4194304) ; Min: 4.00 MB (4194304) ; Max: 4.00 MB (4194304) ; Number of samples: 4) - InitialRangeIdealReservation: (Avg: 16.00 KB (16384) ; Min: 16.00 KB (16384) ; Max: 16.00 KB (16384) ; Number of samples: 4) - ParquetCompressedBytesReadPerColumn: 0 (Number of samples: 0) - ParquetUncompressedBytesReadPerColumn: 0 (Number of samples: 0) - AverageHdfsReadThreadConcurrency: 3.00 - AverageScannerThreadConcurrency: 4.00 - BytesRead: 4.13 MB (4335038) - BytesReadDataNodeCache: 0 - BytesReadEncrypted: 0 - BytesReadErasureCoded: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 22 (22) - CachedFileHandlesMissCount: 6 (6) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 1.21 KB (1235) - DataCacheHitCount: 4 (4) - DataCacheMissBytes: 4.13 MB (4333803) - DataCacheMissCount: 28 (28) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 0.000ns - InactiveTotalTime: 0.000ns - IoReadAsyncBytes: 576.00 KB (589824) - IoReadAsyncRequest: 6 (6) - IoReadSkippedBytes: 976.02 KB (999448) - IoReadSyncBytes: 11.00 KB (11259) - IoReadSyncRequest: 20 (20) - IoReadTotalBytes: 587.00 KB (601083) - IoReadTotalRequest: 26 (26) - MaterializeTupleTime: 23.828ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 1 (1) - NumFileMetadataRead: 0 (0) - NumOrcStripes: 8 (8) - NumPushedDownPredicates: 1 (1) - NumPushedDownRuntimeFilters: 0 (0) - NumScannerThreadMemUnavailable: 0 (0) - NumScannerThreadReservationsDenied: 0 (0) - NumScannerThreadsStarted: 4 (4) - NumScannersWithNoReads: 0 (0) - PeakMemoryUsage: 17.62 MB (18471577) - PeakScannerThreadConcurrency: 4 (4) - PerReadThreadRawHdfsThroughput: 30.99 MB/sec - RemoteScanRanges: 100 (100) - RowBatchBytesEnqueued: 54.00 KB (55296) - RowBatchQueueGetWaitTime: 41.406ms - RowBatchQueuePeakMemoryUsage: 35.00 KB (35840) - RowBatchQueuePutWaitTime: 0.000ns - RowBatchesEnqueued: 16 (16) - RowsRead: 20.00K (20000) - RowsReturned: 7 (7) - RowsReturnedRate: 132.00 /sec - ScanRangesComplete: 4 (4) - ScannerIoWaitTime: 129.548ms - ScannerThreadWorklessLoops: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 31 (31) - ScannerThreadsTotalWallClockTime: 157.173ms - ScannerThreadsSysTime: 5.012ms - ScannerThreadsUserTime: 4.780ms - ScannerThreadsVoluntaryContextSwitches: 55 (55) - TotalRawHdfsOpenFileTime: 36.329ms - TotalRawHdfsReadTime: 133.410ms - TotalReadThroughput: 316.83 KB/sec - TotalTime: 52.873ms Buffer pool: - AllocTime: 21.253us - CompressionTime: 0.000ns - CumulativeAllocationBytes: 5.06 MB (5308416) - CumulativeAllocations: 12 (12) - EncryptionTime: 0.000ns - PeakReservation: 16.00 MB (16777216) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 4.00 MB (4194304) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns